22:51:34  Started by upstream project "integration-distribution-mri-test-scandium" build number 65
22:51:34  originally caused by:
22:51:34   Started by timer
22:51:34  Running as SYSTEM
22:51:34  [EnvInject] - Loading node environment variables.
22:51:34  Building remotely on prd-centos8-robot-2c-8g-44711 (centos8-robot-2c-8g) in workspace /w/workspace/controller-csit-3node-clustering-tell-all-scandium
22:51:35  [ssh-agent] Looking for ssh-agent implementation...
22:51:35  [ssh-agent]   Exec ssh-agent (binary ssh-agent on a remote machine)
22:51:35  $ ssh-agent
22:51:35  SSH_AUTH_SOCK=/tmp/ssh-Jk69YzU2gZMK/agent.5288
22:51:35  SSH_AGENT_PID=5290
22:51:35  [ssh-agent] Started.
22:51:35  Running ssh-add (command line suppressed)
22:51:35  Identity added: /w/workspace/controller-csit-3node-clustering-tell-all-scandium@tmp/private_key_8120577385502632720.key (/w/workspace/controller-csit-3node-clustering-tell-all-scandium@tmp/private_key_8120577385502632720.key)
22:51:35  [ssh-agent] Using credentials jenkins (Release Engineering Jenkins Key)
22:51:35  The recommended git tool is: NONE
22:51:38  using credential opendaylight-jenkins-ssh
22:51:38  Wiping out workspace first.
22:51:38  Cloning the remote Git repository
22:51:38  Cloning repository git://devvexx.opendaylight.org/mirror/integration/test
22:51:38   > git init /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test # timeout=10
22:51:38  Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test
22:51:38   > git --version # timeout=10
22:51:38   > git --version # 'git version 2.43.0'
22:51:38  using GIT_SSH to set credentials Release Engineering Jenkins Key
22:51:38  [INFO] Currently running in a labeled security context
22:51:38  [INFO] Currently SELinux is 'enforcing' on the host
22:51:38   > /usr/bin/chcon --type=ssh_home_t /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test@tmp/jenkins-gitclient-ssh8005321264973107404.key
22:51:38  Verifying host key using known hosts file
22:51:38  You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification.
22:51:38   > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test +refs/heads/*:refs/remotes/origin/* # timeout=10
22:51:41   > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10
22:51:41   > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
22:51:41   > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10
22:51:41  Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test
22:51:41  using GIT_SSH to set credentials Release Engineering Jenkins Key
22:51:41  [INFO] Currently running in a labeled security context
22:51:41  [INFO] Currently SELinux is 'enforcing' on the host
22:51:41   > /usr/bin/chcon --type=ssh_home_t /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test@tmp/jenkins-gitclient-ssh18392491738143656516.key
22:51:41  Verifying host key using known hosts file
22:51:41  You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification.
22:51:41   > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test master # timeout=10
22:51:42   > git rev-parse FETCH_HEAD^{commit} # timeout=10
22:51:42  Checking out Revision 074069f5d4a1380883ffe1b3642610e77516dcc9 (origin/master)
22:51:42   > git config core.sparsecheckout # timeout=10
22:51:42   > git checkout -f 074069f5d4a1380883ffe1b3642610e77516dcc9 # timeout=10
22:51:42  Commit message: "Update car perf tests for RFC8040 compliance"
22:51:42   > git rev-parse FETCH_HEAD^{commit} # timeout=10
22:51:42   > git rev-list --no-walk 7a5ac501dd6c185ea1e99b3d109765d08b47774f # timeout=10
22:51:43  No emails were triggered.
22:51:43  provisioning config files...
22:51:43  copy managed file [npmrc] to file:/home/jenkins/.npmrc
22:51:43  copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf
22:51:43  copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
22:51:43  [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins15024240032009545640.sh
22:51:43  ---> python-tools-install.sh
22:51:43  Setup pyenv:
22:51:43    system
22:51:43  * 3.8.13 (set by /opt/pyenv/version)
22:51:43  * 3.9.13 (set by /opt/pyenv/version)
22:51:43  * 3.10.13 (set by /opt/pyenv/version)
22:51:43  * 3.11.7 (set by /opt/pyenv/version)
22:51:49  lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-MXPj
22:51:49  lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv
22:51:55  lf-activate-venv(): INFO: Installing: lftools 
22:52:25  lf-activate-venv(): INFO: Adding /tmp/venv-MXPj/bin to PATH
22:52:25  Generating Requirements File
22:53:00  Python 3.11.7
22:53:00  pip 25.1.1 from /tmp/venv-MXPj/lib/python3.11/site-packages/pip (python 3.11)
22:53:00  appdirs==1.4.4
22:53:00  argcomplete==3.6.2
22:53:00  aspy.yaml==1.3.0
22:53:00  attrs==25.3.0
22:53:00  autopage==0.5.2
22:53:00  beautifulsoup4==4.13.4
22:53:00  boto3==1.39.9
22:53:00  botocore==1.39.9
22:53:00  bs4==0.0.2
22:53:00  cachetools==5.5.2
22:53:00  certifi==2025.7.14
22:53:00  cffi==1.17.1
22:53:00  cfgv==3.4.0
22:53:00  chardet==5.2.0
22:53:00  charset-normalizer==3.4.2
22:53:00  click==8.2.1
22:53:00  cliff==4.10.0
22:53:00  cmd2==2.7.0
22:53:00  cryptography==3.3.2
22:53:00  debtcollector==3.0.0
22:53:00  decorator==5.2.1
22:53:00  defusedxml==0.7.1
22:53:00  Deprecated==1.2.18
22:53:00  distlib==0.4.0
22:53:00  dnspython==2.7.0
22:53:00  docker==7.1.0
22:53:00  dogpile.cache==1.4.0
22:53:00  durationpy==0.10
22:53:00  email_validator==2.2.0
22:53:00  filelock==3.18.0
22:53:00  future==1.0.0
22:53:00  gitdb==4.0.12
22:53:00  GitPython==3.1.44
22:53:00  google-auth==2.40.3
22:53:00  httplib2==0.22.0
22:53:00  identify==2.6.12
22:53:00  idna==3.10
22:53:00  importlib-resources==1.5.0
22:53:00  iso8601==2.1.0
22:53:00  Jinja2==3.1.6
22:53:00  jmespath==1.0.1
22:53:00  jsonpatch==1.33
22:53:00  jsonpointer==3.0.0
22:53:00  jsonschema==4.25.0
22:53:00  jsonschema-specifications==2025.4.1
22:53:00  keystoneauth1==5.11.1
22:53:00  kubernetes==33.1.0
22:53:00  lftools==0.37.13
22:53:00  lxml==6.0.0
22:53:00  markdown-it-py==3.0.0
22:53:00  MarkupSafe==3.0.2
22:53:00  mdurl==0.1.2
22:53:00  msgpack==1.1.1
22:53:00  multi_key_dict==2.0.3
22:53:00  munch==4.0.0
22:53:00  netaddr==1.3.0
22:53:00  niet==1.4.2
22:53:00  nodeenv==1.9.1
22:53:00  oauth2client==4.1.3
22:53:00  oauthlib==3.3.1
22:53:00  openstacksdk==4.6.0
22:53:00  os-client-config==2.3.0
22:53:00  os-service-types==1.8.0
22:53:00  osc-lib==4.1.0
22:53:00  oslo.config==10.0.0
22:53:00  oslo.context==6.0.0
22:53:00  oslo.i18n==6.5.1
22:53:00  oslo.log==7.2.0
22:53:00  oslo.serialization==5.7.0
22:53:00  oslo.utils==9.0.0
22:53:00  packaging==25.0
22:53:00  pbr==6.1.1
22:53:00  platformdirs==4.3.8
22:53:00  prettytable==3.16.0
22:53:00  psutil==7.0.0
22:53:00  pyasn1==0.6.1
22:53:00  pyasn1_modules==0.4.2
22:53:00  pycparser==2.22
22:53:00  pygerrit2==2.0.15
22:53:00  PyGithub==2.6.1
22:53:00  Pygments==2.19.2
22:53:00  PyJWT==2.10.1
22:53:00  PyNaCl==1.5.0
22:53:00  pyparsing==2.4.7
22:53:00  pyperclip==1.9.0
22:53:00  pyrsistent==0.20.0
22:53:00  python-cinderclient==9.7.0
22:53:00  python-dateutil==2.9.0.post0
22:53:00  python-heatclient==4.3.0
22:53:00  python-jenkins==1.8.2
22:53:00  python-keystoneclient==5.6.0
22:53:00  python-magnumclient==4.8.1
22:53:00  python-openstackclient==8.1.0
22:53:00  python-swiftclient==4.8.0
22:53:00  PyYAML==6.0.2
22:53:00  referencing==0.36.2
22:53:00  requests==2.32.4
22:53:00  requests-oauthlib==2.0.0
22:53:00  requestsexceptions==1.4.0
22:53:00  rfc3986==2.0.0
22:53:00  rich==14.0.0
22:53:00  rich-argparse==1.7.1
22:53:00  rpds-py==0.26.0
22:53:00  rsa==4.9.1
22:53:00  ruamel.yaml==0.18.14
22:53:00  ruamel.yaml.clib==0.2.12
22:53:00  s3transfer==0.13.1
22:53:00  simplejson==3.20.1
22:53:00  six==1.17.0
22:53:00  smmap==5.0.2
22:53:00  soupsieve==2.7
22:53:00  stevedore==5.4.1
22:53:00  tabulate==0.9.0
22:53:00  toml==0.10.2
22:53:00  tomlkit==0.13.3
22:53:00  tqdm==4.67.1
22:53:00  typing_extensions==4.14.1
22:53:00  tzdata==2025.2
22:53:00  urllib3==1.26.20
22:53:00  virtualenv==20.31.2
22:53:00  wcwidth==0.2.13
22:53:00  websocket-client==1.8.0
22:53:00  wrapt==1.17.2
22:53:00  xdg==6.0.0
22:53:00  xmltodict==0.14.2
22:53:00  yq==3.4.3
22:53:01  [EnvInject] - Injecting environment variables from a build step.
22:53:01  [EnvInject] - Injecting as environment variables the properties content 
22:53:01  OS_STACK_TEMPLATE=csit-2-instance-type.yaml
22:53:01  OS_CLOUD=vex
22:53:01  OS_STACK_NAME=releng-controller-csit-3node-clustering-tell-all-scandium-65
22:53:01  OS_STACK_TEMPLATE_DIR=openstack-hot
22:53:01  
22:53:01  [EnvInject] - Variables injected successfully.
22:53:01  provisioning config files...
22:53:01  copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
22:53:01  [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins12902936559443721883.sh
22:53:01  ---> Create parameters file for OpenStack HOT
22:53:01  OpenStack Heat parameters generated
22:53:01  -----------------------------------
22:53:01  parameters:
22:53:01      vm_0_count: '3'
22:53:01      vm_0_flavor: 'v3-standard-4'
22:53:01      vm_0_image: 'ZZCI - Ubuntu 22.04 - builder - x86_64 - 20250201-010426.857'
22:53:01      vm_1_count: '0'
22:53:01      vm_1_flavor: 'v3-standard-2'
22:53:01      vm_1_image: 'ZZCI - Ubuntu 22.04 - mininet-ovs-217 - x86_64 - 20250201-060151.911'
22:53:01      
22:53:01      job_name: '43164-65'
22:53:01      silo: 'releng'
22:53:01  [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash -l /tmp/jenkins17375939370383354323.sh
22:53:01  ---> Create HEAT stack
22:53:01  + source /home/jenkins/lf-env.sh
22:53:01  + lf-activate-venv --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
22:53:01  ++ mktemp -d /tmp/venv-XXXX
22:53:01  + lf_venv=/tmp/venv-dKXC
22:53:01  + local venv_file=/tmp/.os_lf_venv
22:53:01  + local python=python3
22:53:01  + local options
22:53:01  + local set_path=true
22:53:01  + local install_args=
22:53:01  ++ getopt -o np:v: -l no-path,system-site-packages,python:,venv-file: -n lf-activate-venv -- --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
22:53:01  + options=' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\'''
22:53:01  + eval set -- ' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\'''
22:53:01  ++ set -- --python python3 -- 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
22:53:01  + true
22:53:01  + case $1 in
22:53:01  + python=python3
22:53:01  + shift 2
22:53:01  + true
22:53:01  + case $1 in
22:53:01  + shift
22:53:01  + break
22:53:01  + case $python in
22:53:01  + local pkg_list=
22:53:01  + [[ -d /opt/pyenv ]]
22:53:01  + echo 'Setup pyenv:'
22:53:01  Setup pyenv:
22:53:01  + export PYENV_ROOT=/opt/pyenv
22:53:01  + PYENV_ROOT=/opt/pyenv
22:53:01  + export PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
22:53:01  + PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
22:53:01  + pyenv versions
22:53:01    system
22:53:01    3.8.13
22:53:01    3.9.13
22:53:01    3.10.13
22:53:01  * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.python-version)
22:53:01  + command -v pyenv
22:53:01  ++ pyenv init - --no-rehash
22:53:01  + eval 'PATH="$(bash --norc -ec '\''IFS=:; paths=($PATH); 
22:53:01  for i in ${!paths[@]}; do 
22:53:01  if [[ ${paths[i]} == "'\'''\''/opt/pyenv/shims'\'''\''" ]]; then unset '\''\'\'''\''paths[i]'\''\'\'''\''; 
22:53:01  fi; done; 
22:53:01  echo "${paths[*]}"'\'')"
22:53:01  export PATH="/opt/pyenv/shims:${PATH}"
22:53:01  export PYENV_SHELL=bash
22:53:01  source '\''/opt/pyenv/libexec/../completions/pyenv.bash'\''
22:53:01  pyenv() {
22:53:01    local command
22:53:01    command="${1:-}"
22:53:01    if [ "$#" -gt 0 ]; then
22:53:01      shift
22:53:01    fi
22:53:01  
22:53:01    case "$command" in
22:53:01    rehash|shell)
22:53:01      eval "$(pyenv "sh-$command" "$@")"
22:53:01      ;;
22:53:01    *)
22:53:01      command pyenv "$command" "$@"
22:53:01      ;;
22:53:01    esac
22:53:01  }'
22:53:01  +++ bash --norc -ec 'IFS=:; paths=($PATH); 
22:53:01  for i in ${!paths[@]}; do 
22:53:01  if [[ ${paths[i]} == "/opt/pyenv/shims" ]]; then unset '\''paths[i]'\''; 
22:53:01  fi; done; 
22:53:01  echo "${paths[*]}"'
22:53:01  ++ PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
22:53:01  ++ export PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
22:53:01  ++ PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
22:53:01  ++ export PYENV_SHELL=bash
22:53:01  ++ PYENV_SHELL=bash
22:53:01  ++ source /opt/pyenv/libexec/../completions/pyenv.bash
22:53:01  +++ complete -F _pyenv pyenv
22:53:01  ++ lf-pyver python3
22:53:01  ++ local py_version_xy=python3
22:53:01  ++ local py_version_xyz=
22:53:01  ++ awk '{ print $1 }'
22:53:01  ++ pyenv versions
22:53:01  ++ local command
22:53:01  ++ command=versions
22:53:01  ++ '[' 1 -gt 0 ']'
22:53:01  ++ shift
22:53:01  ++ case "$command" in
22:53:01  ++ command pyenv versions
22:53:01  ++ pyenv versions
22:53:01  ++ sed 's/^[ *]* //'
22:53:01  ++ grep -E '^[0-9.]*[0-9]$'
22:53:02  ++ [[ ! -s /tmp/.pyenv_versions ]]
22:53:02  +++ grep '^3' /tmp/.pyenv_versions
22:53:02  +++ sort -V
22:53:02  +++ tail -n 1
22:53:02  ++ py_version_xyz=3.11.7
22:53:02  ++ [[ -z 3.11.7 ]]
22:53:02  ++ echo 3.11.7
22:53:02  ++ return 0
22:53:02  + pyenv local 3.11.7
22:53:02  + local command
22:53:02  + command=local
22:53:02  + '[' 2 -gt 0 ']'
22:53:02  + shift
22:53:02  + case "$command" in
22:53:02  + command pyenv local 3.11.7
22:53:02  + pyenv local 3.11.7
22:53:02  + for arg in "$@"
22:53:02  + case $arg in
22:53:02  + pkg_list+='lftools[openstack] '
22:53:02  + for arg in "$@"
22:53:02  + case $arg in
22:53:02  + pkg_list+='kubernetes '
22:53:02  + for arg in "$@"
22:53:02  + case $arg in
22:53:02  + pkg_list+='niet '
22:53:02  + for arg in "$@"
22:53:02  + case $arg in
22:53:02  + pkg_list+='python-heatclient '
22:53:02  + for arg in "$@"
22:53:02  + case $arg in
22:53:02  + pkg_list+='python-openstackclient '
22:53:02  + for arg in "$@"
22:53:02  + case $arg in
22:53:02  + pkg_list+='python-magnumclient '
22:53:02  + for arg in "$@"
22:53:02  + case $arg in
22:53:02  + pkg_list+='yq '
22:53:02  + [[ -f /tmp/.os_lf_venv ]]
22:53:02  ++ cat /tmp/.os_lf_venv
22:53:02  + lf_venv=/tmp/venv-MXPj
22:53:02  + echo 'lf-activate-venv(): INFO: Reuse venv:/tmp/venv-MXPj from' file:/tmp/.os_lf_venv
22:53:02  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-MXPj from file:/tmp/.os_lf_venv
22:53:02  + /tmp/venv-MXPj/bin/python3 -m pip install --upgrade --quiet pip 'setuptools<66' virtualenv
22:53:04  + [[ -z lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq  ]]
22:53:04  + echo 'lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq '
22:53:04  lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 
22:53:04  + /tmp/venv-MXPj/bin/python3 -m pip install --upgrade --quiet --upgrade-strategy eager 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
22:53:23  + type python3
22:53:23  + true
22:53:23  + echo 'lf-activate-venv(): INFO: Adding /tmp/venv-MXPj/bin to PATH'
22:53:23  lf-activate-venv(): INFO: Adding /tmp/venv-MXPj/bin to PATH
22:53:23  + PATH=/tmp/venv-MXPj/bin:/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
22:53:23  + return 0
22:53:23  + openstack --os-cloud vex limits show --absolute
22:53:25  +--------------------------+---------+
22:53:25  | Name                     |   Value |
22:53:25  +--------------------------+---------+
22:53:25  | maxTotalInstances        |      -1 |
22:53:25  | maxTotalCores            |     450 |
22:53:25  | maxTotalRAMSize          | 1000000 |
22:53:25  | maxServerMeta            |     128 |
22:53:25  | maxImageMeta             |     128 |
22:53:25  | maxPersonality           |       5 |
22:53:25  | maxPersonalitySize       |   10240 |
22:53:25  | maxTotalKeypairs         |     100 |
22:53:25  | maxServerGroups          |      10 |
22:53:25  | maxServerGroupMembers    |      10 |
22:53:25  | maxTotalFloatingIps      |      -1 |
22:53:25  | maxSecurityGroups        |      -1 |
22:53:25  | maxSecurityGroupRules    |      -1 |
22:53:25  | totalRAMUsed             |  753664 |
22:53:25  | totalCoresUsed           |     184 |
22:53:25  | totalInstancesUsed       |      63 |
22:53:25  | totalFloatingIpsUsed     |       0 |
22:53:25  | totalSecurityGroupsUsed  |       0 |
22:53:25  | totalServerGroupsUsed    |       0 |
22:53:25  | maxTotalVolumes          |      -1 |
22:53:25  | maxTotalSnapshots        |      10 |
22:53:25  | maxTotalVolumeGigabytes  |    4096 |
22:53:25  | maxTotalBackups          |      10 |
22:53:25  | maxTotalBackupGigabytes  |    1000 |
22:53:25  | totalVolumesUsed         |       3 |
22:53:25  | totalGigabytesUsed       |      60 |
22:53:25  | totalSnapshotsUsed       |       0 |
22:53:25  | totalBackupsUsed         |       0 |
22:53:25  | totalBackupGigabytesUsed |       0 |
22:53:25  +--------------------------+---------+
22:53:25  + pushd /opt/ciman/openstack-hot
22:53:25  /opt/ciman/openstack-hot /w/workspace/controller-csit-3node-clustering-tell-all-scandium
22:53:25  + lftools openstack --os-cloud vex stack create releng-controller-csit-3node-clustering-tell-all-scandium-65 csit-2-instance-type.yaml /w/workspace/controller-csit-3node-clustering-tell-all-scandium/stack-parameters.yaml
22:53:51  Creating stack releng-controller-csit-3node-clustering-tell-all-scandium-65
22:53:51  Waiting to initialize infrastructure...
22:53:51  Stack initialization successful.
22:53:51  ------------------------------------
22:53:51  Stack Details
22:53:51  ------------------------------------
22:53:51  {'added': None,
22:53:51   'capabilities': [],
22:53:51   'created_at': '2025-07-20T22:53:28Z',
22:53:51   'deleted': None,
22:53:51   'deleted_at': None,
22:53:51   'description': 'No description',
22:53:51   'environment': None,
22:53:51   'environment_files': None,
22:53:51   'files': None,
22:53:51   'files_container': None,
22:53:51   'id': '627b8f9b-16f4-4f6e-86b2-8877e701e75f',
22:53:51   'is_rollback_disabled': True,
22:53:51   'links': [{'href': 'https://orchestration.public.mtl1.vexxhost.net/v1/12c36e260d8e4bb2913965203b1b491f/stacks/releng-controller-csit-3node-clustering-tell-all-scandium-65/627b8f9b-16f4-4f6e-86b2-8877e701e75f',
22:53:51              'rel': 'self'}],
22:53:51   'location': Munch({'cloud': 'vex', 'region_name': 'ca-ymq-1', 'zone': None, 'project': Munch({'id': '12c36e260d8e4bb2913965203b1b491f', 'name': '61975f2c-7c17-4d69-82fa-c3ae420ad6fd', 'domain_id': None, 'domain_name': 'Default'})}),
22:53:51   'name': 'releng-controller-csit-3node-clustering-tell-all-scandium-65',
22:53:51   'notification_topics': [],
22:53:51   'outputs': [{'description': 'IP addresses of the 1st vm types',
22:53:51                'output_key': 'vm_0_ips',
22:53:51                'output_value': ['10.30.170.28',
22:53:51                                 '10.30.171.142',
22:53:51                                 '10.30.171.124']},
22:53:51               {'description': 'IP addresses of the 2nd vm types',
22:53:51                'output_key': 'vm_1_ips',
22:53:51                'output_value': []}],
22:53:51   'owner_id': ****,
22:53:51   'parameters': {'OS::project_id': '12c36e260d8e4bb2913965203b1b491f',
22:53:51                  'OS::stack_id': '627b8f9b-16f4-4f6e-86b2-8877e701e75f',
22:53:51                  'OS::stack_name': 'releng-controller-csit-3node-clustering-tell-all-scandium-65',
22:53:51                  'job_name': '43164-65',
22:53:51                  'silo': 'releng',
22:53:51                  'vm_0_count': '3',
22:53:51                  'vm_0_flavor': 'v3-standard-4',
22:53:51                  'vm_0_image': 'ZZCI - Ubuntu 22.04 - builder - x86_64 - '
22:53:51                                '20250201-010426.857',
22:53:51                  'vm_1_count': '0',
22:53:51                  'vm_1_flavor': 'v3-standard-2',
22:53:51                  'vm_1_image': 'ZZCI - Ubuntu 22.04 - mininet-ovs-217 - x86_64 '
22:53:51                                '- 20250201-060151.911'},
22:53:51   'parent_id': None,
22:53:51   'replaced': None,
22:53:51   'status': 'CREATE_COMPLETE',
22:53:51   'status_reason': 'Stack CREATE completed successfully',
22:53:51   'tags': [],
22:53:51   'template': None,
22:53:51   'template_description': 'No description',
22:53:51   'template_url': None,
22:53:51   'timeout_mins': 15,
22:53:51   'unchanged': None,
22:53:51   'updated': None,
22:53:51   'updated_at': None,
22:53:51   'user_project_id': '0f66f0373dc14659bde1b5df4e782c40'}
22:53:51  ------------------------------------
22:53:51  + popd
22:53:51  /w/workspace/controller-csit-3node-clustering-tell-all-scandium
22:53:51  [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash -l /tmp/jenkins670741344326192171.sh
22:53:51  ---> Copy SSH public keys to CSIT lab
22:53:51  Setup pyenv:
22:53:51    system
22:53:51    3.8.13
22:53:51    3.9.13
22:53:51    3.10.13
22:53:51  * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.python-version)
22:53:52  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-MXPj from file:/tmp/.os_lf_venv
22:53:53  lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes python-heatclient python-openstackclient 
22:54:11  lf-activate-venv(): INFO: Adding /tmp/venv-MXPj/bin to PATH
22:54:13  SSH not responding on 10.30.170.28. Retrying in 10 seconds...
22:54:13  SSH not responding on 10.30.171.142. Retrying in 10 seconds...
22:54:13  SSH not responding on 10.30.171.124. Retrying in 10 seconds...
22:54:23  Ping to 10.30.171.142 successful.
22:54:23  Ping to 10.30.170.28 successful.
22:54:23  Ping to 10.30.171.124 successful.
22:54:24  Warning: Permanently added '10.30.171.142' (ECDSA) to the list of known hosts.
22:54:24  Warning: Permanently added '10.30.170.28' (ECDSA) to the list of known hosts.
22:54:24  Warning: Permanently added '10.30.171.124' (ECDSA) to the list of known hosts.
22:54:25   releng-43164-65-0-builder-1
22:54:25  Successfully copied public keys to slave 10.30.171.142
22:54:25   releng-43164-65-0-builder-0
22:54:25  Successfully copied public keys to slave 10.30.170.28
22:54:25  Process 6517 ready.
22:54:25  Process 6518 ready.
22:54:25   releng-43164-65-0-builder-2
22:54:25  Successfully copied public keys to slave 10.30.171.124
22:54:25  Process 6519 ready.
22:54:25  SSH ready on all stack servers.
22:54:25  [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash -l /tmp/jenkins17520397927839994245.sh
22:54:25  Setup pyenv:
22:54:25    system
22:54:25    3.8.13
22:54:25    3.9.13
22:54:25    3.10.13
22:54:25  * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.python-version)
22:54:30  lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-JrvL
22:54:30  lf-activate-venv(): INFO: Save venv in file: /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.robot_venv
22:54:34  lf-activate-venv(): INFO: Installing: setuptools wheel 
22:54:36  lf-activate-venv(): INFO: Adding /tmp/venv-JrvL/bin to PATH
22:54:36  + echo 'Installing Python Requirements'
22:54:36  Installing Python Requirements
22:54:36  + cat
22:54:36  + python -m pip install -r requirements.txt
22:54:36  Looking in indexes: https://nexus3.opendaylight.org/repository/PyPi/simple
22:54:36  Collecting docker-py (from -r requirements.txt (line 1))
22:54:36    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/docker-py/1.10.6/docker_py-1.10.6-py2.py3-none-any.whl (50 kB)
22:54:36  Collecting ipaddr (from -r requirements.txt (line 2))
22:54:36    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/ipaddr/2.2.0/ipaddr-2.2.0.tar.gz (26 kB)
22:54:36    Preparing metadata (setup.py): started
22:54:37    Preparing metadata (setup.py): finished with status 'done'
22:54:37  Collecting netaddr (from -r requirements.txt (line 3))
22:54:37    Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/netaddr/1.3.0/netaddr-1.3.0-py3-none-any.whl (2.3 MB)
22:54:37  Collecting netifaces (from -r requirements.txt (line 4))
22:54:37    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/netifaces/0.11.0/netifaces-0.11.0.tar.gz (30 kB)
22:54:37    Preparing metadata (setup.py): started
22:54:37    Preparing metadata (setup.py): finished with status 'done'
22:54:37  Collecting pyhocon (from -r requirements.txt (line 5))
22:54:37    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyhocon/0.3.61/pyhocon-0.3.61-py3-none-any.whl (25 kB)
22:54:37  Collecting requests (from -r requirements.txt (line 6))
22:54:37    Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/requests/2.32.4/requests-2.32.4-py3-none-any.whl (64 kB)
22:54:37  Collecting robotframework (from -r requirements.txt (line 7))
22:54:37    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework/7.3.2/robotframework-7.3.2-py3-none-any.whl (795 kB)
22:54:37       ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 795.1/795.1 kB 34.2 MB/s eta 0:00:00
22:54:37  Collecting robotframework-httplibrary (from -r requirements.txt (line 8))
22:54:37    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-httplibrary/0.4.2/robotframework-httplibrary-0.4.2.tar.gz (9.1 kB)
22:54:37    Preparing metadata (setup.py): started
22:54:37    Preparing metadata (setup.py): finished with status 'done'
22:54:37  Collecting robotframework-requests==0.9.7 (from -r requirements.txt (line 9))
22:54:37    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-requests/0.9.7/robotframework_requests-0.9.7-py3-none-any.whl (21 kB)
22:54:37  Collecting robotframework-selenium2library (from -r requirements.txt (line 10))
22:54:37    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-selenium2library/3.0.0/robotframework_selenium2library-3.0.0-py2.py3-none-any.whl (6.2 kB)
22:54:38  Collecting robotframework-sshlibrary==3.8.0 (from -r requirements.txt (line 11))
22:54:38    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-sshlibrary/3.8.0/robotframework-sshlibrary-3.8.0.tar.gz (51 kB)
22:54:38    Preparing metadata (setup.py): started
22:54:38    Preparing metadata (setup.py): finished with status 'done'
22:54:38  Collecting scapy (from -r requirements.txt (line 12))
22:54:38    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/scapy/2.6.1/scapy-2.6.1-py3-none-any.whl (2.4 MB)
22:54:38       ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.4/2.4 MB 44.8 MB/s eta 0:00:00
22:54:38  Collecting jsonpath-rw (from -r requirements.txt (line 15))
22:54:38    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpath-rw/1.4.0/jsonpath-rw-1.4.0.tar.gz (13 kB)
22:54:38    Preparing metadata (setup.py): started
22:54:38    Preparing metadata (setup.py): finished with status 'done'
22:54:38  Collecting elasticsearch (from -r requirements.txt (line 18))
22:54:38    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch/9.0.2/elasticsearch-9.0.2-py3-none-any.whl (914 kB)
22:54:38       ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 914.3/914.3 kB 43.7 MB/s eta 0:00:00
22:54:38  Collecting elasticsearch-dsl (from -r requirements.txt (line 19))
22:54:38    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch-dsl/8.18.0/elasticsearch_dsl-8.18.0-py3-none-any.whl (10 kB)
22:54:38  Collecting pyangbind (from -r requirements.txt (line 22))
22:54:38    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyangbind/0.8.6/pyangbind-0.8.6-py3-none-any.whl (52 kB)
22:54:38  Collecting isodate (from -r requirements.txt (line 25))
22:54:38    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/isodate/0.7.2/isodate-0.7.2-py3-none-any.whl (22 kB)
22:54:38  Collecting jmespath (from -r requirements.txt (line 28))
22:54:38    Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jmespath/1.0.1/jmespath-1.0.1-py3-none-any.whl (20 kB)
22:54:38  Collecting jsonpatch (from -r requirements.txt (line 31))
22:54:38    Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpatch/1.33/jsonpatch-1.33-py2.py3-none-any.whl (12 kB)
22:54:38  Collecting paramiko>=1.15.3 (from robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
22:54:38    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/paramiko/3.5.1/paramiko-3.5.1-py3-none-any.whl (227 kB)
22:54:38  Collecting scp>=0.13.0 (from robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
22:54:38    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/scp/0.15.0/scp-0.15.0-py2.py3-none-any.whl (8.8 kB)
22:54:38  Collecting docker-pycreds>=0.2.1 (from docker-py->-r requirements.txt (line 1))
22:54:38    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/docker-pycreds/0.4.0/docker_pycreds-0.4.0-py2.py3-none-any.whl (9.0 kB)
22:54:39  Collecting six>=1.4.0 (from docker-py->-r requirements.txt (line 1))
22:54:39    Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/six/1.17.0/six-1.17.0-py2.py3-none-any.whl (11 kB)
22:54:39  Collecting websocket-client>=0.32.0 (from docker-py->-r requirements.txt (line 1))
22:54:39    Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/websocket-client/1.8.0/websocket_client-1.8.0-py3-none-any.whl (58 kB)
22:54:39  Collecting pyparsing<4,>=2 (from pyhocon->-r requirements.txt (line 5))
22:54:39    Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pyparsing/3.2.3/pyparsing-3.2.3-py3-none-any.whl (111 kB)
22:54:39  Collecting charset_normalizer<4,>=2 (from requests->-r requirements.txt (line 6))
22:54:39    Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/charset-normalizer/3.4.2/charset_normalizer-3.4.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (147 kB)
22:54:39  Collecting idna<4,>=2.5 (from requests->-r requirements.txt (line 6))
22:54:39    Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/idna/3.10/idna-3.10-py3-none-any.whl (70 kB)
22:54:39  Collecting urllib3<3,>=1.21.1 (from requests->-r requirements.txt (line 6))
22:54:39    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/urllib3/2.5.0/urllib3-2.5.0-py3-none-any.whl (129 kB)
22:54:39  Collecting certifi>=2017.4.17 (from requests->-r requirements.txt (line 6))
22:54:39    Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/certifi/2025.7.14/certifi-2025.7.14-py3-none-any.whl (162 kB)
22:54:39  Collecting webtest>=2.0 (from robotframework-httplibrary->-r requirements.txt (line 8))
22:54:39    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/webtest/3.0.6/webtest-3.0.6-py3-none-any.whl (32 kB)
22:54:39  Collecting jsonpointer (from robotframework-httplibrary->-r requirements.txt (line 8))
22:54:39    Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpointer/3.0.0/jsonpointer-3.0.0-py2.py3-none-any.whl (7.6 kB)
22:54:39  Collecting robotframework-seleniumlibrary>=3.0.0 (from robotframework-selenium2library->-r requirements.txt (line 10))
22:54:39    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-seleniumlibrary/6.7.1/robotframework_seleniumlibrary-6.7.1-py2.py3-none-any.whl (104 kB)
22:54:39  Collecting ply (from jsonpath-rw->-r requirements.txt (line 15))
22:54:39    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/ply/3.11/ply-3.11-py2.py3-none-any.whl (49 kB)
22:54:39  Collecting decorator (from jsonpath-rw->-r requirements.txt (line 15))
22:54:39    Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/decorator/5.2.1/decorator-5.2.1-py3-none-any.whl (9.2 kB)
22:54:39  Collecting elastic-transport<9,>=8.15.1 (from elasticsearch->-r requirements.txt (line 18))
22:54:39    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elastic-transport/8.17.1/elastic_transport-8.17.1-py3-none-any.whl (64 kB)
22:54:39  Collecting python-dateutil (from elasticsearch->-r requirements.txt (line 18))
22:54:39    Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/python-dateutil/2.9.0.post0/python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB)
22:54:39  Collecting typing-extensions (from elasticsearch->-r requirements.txt (line 18))
22:54:39    Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/typing-extensions/4.14.1/typing_extensions-4.14.1-py3-none-any.whl (43 kB)
22:54:39  Collecting elasticsearch (from -r requirements.txt (line 18))
22:54:39    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch/8.18.1/elasticsearch-8.18.1-py3-none-any.whl (906 kB)
22:54:39       ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 906.3/906.3 kB 30.1 MB/s eta 0:00:00
22:54:39  Collecting pyang (from pyangbind->-r requirements.txt (line 22))
22:54:39    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyang/2.6.1/pyang-2.6.1-py2.py3-none-any.whl (594 kB)
22:54:39       ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 594.7/594.7 kB 26.4 MB/s eta 0:00:00
22:54:40  Collecting lxml (from pyangbind->-r requirements.txt (line 22))
22:54:40    Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/lxml/6.0.0/lxml-6.0.0-cp311-cp311-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl (5.2 MB)
22:54:41  Collecting regex (from pyangbind->-r requirements.txt (line 22))
22:54:41    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/regex/2024.11.6/regex-2024.11.6-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (792 kB)
22:54:41       ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 792.7/792.7 kB 28.1 MB/s eta 0:00:00
22:54:41  Collecting enum34 (from pyangbind->-r requirements.txt (line 22))
22:54:41    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/enum34/1.1.10/enum34-1.1.10-py3-none-any.whl (11 kB)
22:54:41  Collecting bcrypt>=3.2 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
22:54:41    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/bcrypt/4.3.0/bcrypt-4.3.0-cp39-abi3-manylinux_2_28_x86_64.whl (284 kB)
22:54:41  Collecting cryptography>=3.3 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
22:54:41    Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/cryptography/45.0.5/cryptography-45.0.5-cp311-abi3-manylinux_2_28_x86_64.whl (4.5 MB)
22:54:41  Collecting pynacl>=1.5 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
22:54:41    Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pynacl/1.5.0/PyNaCl-1.5.0-cp36-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.manylinux_2_24_x86_64.whl (856 kB)
22:54:42  Collecting cffi>=1.14 (from cryptography>=3.3->paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
22:54:42    Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/cffi/1.17.1/cffi-1.17.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (467 kB)
22:54:42  Collecting pycparser (from cffi>=1.14->cryptography>=3.3->paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
22:54:42    Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pycparser/2.22/pycparser-2.22-py3-none-any.whl (117 kB)
22:54:42  Collecting selenium>=4.3.0 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
22:54:42    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/selenium/4.34.2/selenium-4.34.2-py3-none-any.whl (9.4 MB)
22:54:42       ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 9.4/9.4 MB 54.1 MB/s eta 0:00:00
22:54:42  Collecting robotframework-pythonlibcore>=4.4.1 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
22:54:42    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-pythonlibcore/4.4.1/robotframework_pythonlibcore-4.4.1-py2.py3-none-any.whl (12 kB)
22:54:42  Collecting click>=8.0 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
22:54:42    Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/click/8.2.1/click-8.2.1-py3-none-any.whl (102 kB)
22:54:42  Collecting trio~=0.30.0 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
22:54:42    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/trio/0.30.0/trio-0.30.0-py3-none-any.whl (499 kB)
22:54:42  Collecting trio-websocket~=0.12.2 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
22:54:42    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/trio-websocket/0.12.2/trio_websocket-0.12.2-py3-none-any.whl (21 kB)
22:54:42  Collecting attrs>=23.2.0 (from trio~=0.30.0->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
22:54:42    Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/attrs/25.3.0/attrs-25.3.0-py3-none-any.whl (63 kB)
22:54:42  Collecting sortedcontainers (from trio~=0.30.0->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
22:54:42    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/sortedcontainers/2.4.0/sortedcontainers-2.4.0-py2.py3-none-any.whl (29 kB)
22:54:42  Collecting outcome (from trio~=0.30.0->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
22:54:42    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/outcome/1.3.0.post0/outcome-1.3.0.post0-py2.py3-none-any.whl (10 kB)
22:54:42  Collecting sniffio>=1.3.0 (from trio~=0.30.0->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
22:54:42    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/sniffio/1.3.1/sniffio-1.3.1-py3-none-any.whl (10 kB)
22:54:42  Collecting wsproto>=0.14 (from trio-websocket~=0.12.2->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
22:54:42    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/wsproto/1.2.0/wsproto-1.2.0-py3-none-any.whl (24 kB)
22:54:42  Collecting pysocks!=1.5.7,<2.0,>=1.5.6 (from urllib3[socks]~=2.5.0->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
22:54:42    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pysocks/1.7.1/PySocks-1.7.1-py3-none-any.whl (16 kB)
22:54:43  Collecting WebOb>=1.2 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
22:54:43    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/webob/1.8.9/WebOb-1.8.9-py2.py3-none-any.whl (115 kB)
22:54:43  Collecting waitress>=3.0.2 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
22:54:43    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/waitress/3.0.2/waitress-3.0.2-py3-none-any.whl (56 kB)
22:54:43  Collecting beautifulsoup4 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
22:54:43    Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/beautifulsoup4/4.13.4/beautifulsoup4-4.13.4-py3-none-any.whl (187 kB)
22:54:43  Collecting h11<1,>=0.9.0 (from wsproto>=0.14->trio-websocket~=0.12.2->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
22:54:43    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/h11/0.16.0/h11-0.16.0-py3-none-any.whl (37 kB)
22:54:43  Collecting soupsieve>1.2 (from beautifulsoup4->webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
22:54:43    Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/soupsieve/2.7/soupsieve-2.7-py3-none-any.whl (36 kB)
22:54:43  Building wheels for collected packages: robotframework-sshlibrary, ipaddr, netifaces, robotframework-httplibrary, jsonpath-rw
22:54:43    DEPRECATION: Building 'robotframework-sshlibrary' using the legacy setup.py bdist_wheel mechanism, which will be removed in a future version. pip 25.3 will enforce this behaviour change. A possible replacement is to use the standardized build interface by setting the `--use-pep517` option, (possibly combined with `--no-build-isolation`), or adding a `pyproject.toml` file to the source tree of 'robotframework-sshlibrary'. Discussion can be found at https://github.com/pypa/pip/issues/6334
22:54:43    Building wheel for robotframework-sshlibrary (setup.py): started
22:54:43    Building wheel for robotframework-sshlibrary (setup.py): finished with status 'done'
22:54:43    Created wheel for robotframework-sshlibrary: filename=robotframework_sshlibrary-3.8.0-py3-none-any.whl size=55205 sha256=6c8226912fd0cf5638fad9761bee586da69d2f05107b57436a5b10d881e76eb8
22:54:43    Stored in directory: /home/jenkins/.cache/pip/wheels/f7/c9/b3/a977b7bcc410d45ae27d240df3d00a12585509180e373ecccc
22:54:43    DEPRECATION: Building 'ipaddr' using the legacy setup.py bdist_wheel mechanism, which will be removed in a future version. pip 25.3 will enforce this behaviour change. A possible replacement is to use the standardized build interface by setting the `--use-pep517` option, (possibly combined with `--no-build-isolation`), or adding a `pyproject.toml` file to the source tree of 'ipaddr'. Discussion can be found at https://github.com/pypa/pip/issues/6334
22:54:43    Building wheel for ipaddr (setup.py): started
22:54:43    Building wheel for ipaddr (setup.py): finished with status 'done'
22:54:43    Created wheel for ipaddr: filename=ipaddr-2.2.0-py3-none-any.whl size=18353 sha256=a8994fcef2f51c5c65bbd0df5dc21279b629e323037b9fa97b03f854ba5d2f46
22:54:43    Stored in directory: /home/jenkins/.cache/pip/wheels/dc/6c/04/da2d847fa8d45c59af3e1d83e2acc29cb8adcbaf04c0898dbf
22:54:43    DEPRECATION: Building 'netifaces' using the legacy setup.py bdist_wheel mechanism, which will be removed in a future version. pip 25.3 will enforce this behaviour change. A possible replacement is to use the standardized build interface by setting the `--use-pep517` option, (possibly combined with `--no-build-isolation`), or adding a `pyproject.toml` file to the source tree of 'netifaces'. Discussion can be found at https://github.com/pypa/pip/issues/6334
22:54:43    Building wheel for netifaces (setup.py): started
22:54:46    Building wheel for netifaces (setup.py): finished with status 'done'
22:54:46    Created wheel for netifaces: filename=netifaces-0.11.0-cp311-cp311-linux_x86_64.whl size=41084 sha256=2fb0be1db00c0ba558b17baaf75563ef5b3ab0cdf22396034587523526174ab0
22:54:46    Stored in directory: /home/jenkins/.cache/pip/wheels/f8/18/88/e61d54b995bea304bdb1d040a92b72228a1bf72ca2a3eba7c9
22:54:46    DEPRECATION: Building 'robotframework-httplibrary' using the legacy setup.py bdist_wheel mechanism, which will be removed in a future version. pip 25.3 will enforce this behaviour change. A possible replacement is to use the standardized build interface by setting the `--use-pep517` option, (possibly combined with `--no-build-isolation`), or adding a `pyproject.toml` file to the source tree of 'robotframework-httplibrary'. Discussion can be found at https://github.com/pypa/pip/issues/6334
22:54:46    Building wheel for robotframework-httplibrary (setup.py): started
22:54:46    Building wheel for robotframework-httplibrary (setup.py): finished with status 'done'
22:54:46    Created wheel for robotframework-httplibrary: filename=robotframework_httplibrary-0.4.2-py3-none-any.whl size=10014 sha256=a6985b96899ddf1ca84108838abfb8eaf4eecf90fd4ac998f4f0b40555198779
22:54:46    Stored in directory: /home/jenkins/.cache/pip/wheels/aa/bc/0d/9a20dd51effef392aae2733cb4c7b66c6fa29fca33d88b57ed
22:54:46    DEPRECATION: Building 'jsonpath-rw' using the legacy setup.py bdist_wheel mechanism, which will be removed in a future version. pip 25.3 will enforce this behaviour change. A possible replacement is to use the standardized build interface by setting the `--use-pep517` option, (possibly combined with `--no-build-isolation`), or adding a `pyproject.toml` file to the source tree of 'jsonpath-rw'. Discussion can be found at https://github.com/pypa/pip/issues/6334
22:54:46    Building wheel for jsonpath-rw (setup.py): started
22:54:46    Building wheel for jsonpath-rw (setup.py): finished with status 'done'
22:54:46    Created wheel for jsonpath-rw: filename=jsonpath_rw-1.4.0-py3-none-any.whl size=15176 sha256=15657bf2eaa277746e501d3f94a4fd3517bfb20fdd9c65cdfc62468b92913169
22:54:46    Stored in directory: /home/jenkins/.cache/pip/wheels/f1/54/63/9a8da38cefae13755097b36cc852decc25d8ef69c37d58d4eb
22:54:46  Successfully built robotframework-sshlibrary ipaddr netifaces robotframework-httplibrary jsonpath-rw
22:54:47  Installing collected packages: sortedcontainers, ply, netifaces, ipaddr, enum34, websocket-client, WebOb, waitress, urllib3, typing-extensions, soupsieve, sniffio, six, scapy, robotframework-pythonlibcore, robotframework, regex, pysocks, pyparsing, pycparser, netaddr, lxml, jsonpointer, jmespath, isodate, idna, h11, decorator, click, charset_normalizer, certifi, bcrypt, attrs, wsproto, requests, python-dateutil, pyhocon, pyang, outcome, jsonpath-rw, jsonpatch, elastic-transport, docker-pycreds, cffi, beautifulsoup4, webtest, trio, robotframework-requests, pynacl, pyangbind, elasticsearch, docker-py, cryptography, trio-websocket, robotframework-httplibrary, paramiko, elasticsearch-dsl, selenium, scp, robotframework-sshlibrary, robotframework-seleniumlibrary, robotframework-selenium2library
22:54:54  
22:54:54  Successfully installed WebOb-1.8.9 attrs-25.3.0 bcrypt-4.3.0 beautifulsoup4-4.13.4 certifi-2025.7.14 cffi-1.17.1 charset_normalizer-3.4.2 click-8.2.1 cryptography-45.0.5 decorator-5.2.1 docker-py-1.10.6 docker-pycreds-0.4.0 elastic-transport-8.17.1 elasticsearch-8.18.1 elasticsearch-dsl-8.18.0 enum34-1.1.10 h11-0.16.0 idna-3.10 ipaddr-2.2.0 isodate-0.7.2 jmespath-1.0.1 jsonpatch-1.33 jsonpath-rw-1.4.0 jsonpointer-3.0.0 lxml-6.0.0 netaddr-1.3.0 netifaces-0.11.0 outcome-1.3.0.post0 paramiko-3.5.1 ply-3.11 pyang-2.6.1 pyangbind-0.8.6 pycparser-2.22 pyhocon-0.3.61 pynacl-1.5.0 pyparsing-3.2.3 pysocks-1.7.1 python-dateutil-2.9.0.post0 regex-2024.11.6 requests-2.32.4 robotframework-7.3.2 robotframework-httplibrary-0.4.2 robotframework-pythonlibcore-4.4.1 robotframework-requests-0.9.7 robotframework-selenium2library-3.0.0 robotframework-seleniumlibrary-6.7.1 robotframework-sshlibrary-3.8.0 scapy-2.6.1 scp-0.15.0 selenium-4.34.2 six-1.17.0 sniffio-1.3.1 sortedcontainers-2.4.0 soupsieve-2.7 trio-0.30.0 trio-websocket-0.12.2 typing-extensions-4.14.1 urllib3-2.5.0 waitress-3.0.2 websocket-client-1.8.0 webtest-3.0.6 wsproto-1.2.0
22:54:54  + pip freeze
22:54:54  attrs==25.3.0
22:54:54  bcrypt==4.3.0
22:54:54  beautifulsoup4==4.13.4
22:54:54  certifi==2025.7.14
22:54:54  cffi==1.17.1
22:54:54  charset-normalizer==3.4.2
22:54:54  click==8.2.1
22:54:54  cryptography==45.0.5
22:54:54  decorator==5.2.1
22:54:54  distlib==0.4.0
22:54:54  docker-py==1.10.6
22:54:54  docker-pycreds==0.4.0
22:54:54  elastic-transport==8.17.1
22:54:54  elasticsearch==8.18.1
22:54:54  elasticsearch-dsl==8.18.0
22:54:54  enum34==1.1.10
22:54:54  filelock==3.18.0
22:54:54  h11==0.16.0
22:54:54  idna==3.10
22:54:54  ipaddr==2.2.0
22:54:54  isodate==0.7.2
22:54:54  jmespath==1.0.1
22:54:54  jsonpatch==1.33
22:54:54  jsonpath-rw==1.4.0
22:54:54  jsonpointer==3.0.0
22:54:54  lxml==6.0.0
22:54:54  netaddr==1.3.0
22:54:54  netifaces==0.11.0
22:54:54  outcome==1.3.0.post0
22:54:54  paramiko==3.5.1
22:54:54  platformdirs==4.3.8
22:54:54  ply==3.11
22:54:54  pyang==2.6.1
22:54:54  pyangbind==0.8.6
22:54:54  pycparser==2.22
22:54:54  pyhocon==0.3.61
22:54:54  PyNaCl==1.5.0
22:54:54  pyparsing==3.2.3
22:54:54  PySocks==1.7.1
22:54:54  python-dateutil==2.9.0.post0
22:54:54  regex==2024.11.6
22:54:54  requests==2.32.4
22:54:54  robotframework==7.3.2
22:54:54  robotframework-httplibrary==0.4.2
22:54:54  robotframework-pythonlibcore==4.4.1
22:54:54  robotframework-requests==0.9.7
22:54:54  robotframework-selenium2library==3.0.0
22:54:54  robotframework-seleniumlibrary==6.7.1
22:54:54  robotframework-sshlibrary==3.8.0
22:54:54  scapy==2.6.1
22:54:54  scp==0.15.0
22:54:54  selenium==4.34.2
22:54:54  six==1.17.0
22:54:54  sniffio==1.3.1
22:54:54  sortedcontainers==2.4.0
22:54:54  soupsieve==2.7
22:54:54  trio==0.30.0
22:54:54  trio-websocket==0.12.2
22:54:54  typing_extensions==4.14.1
22:54:54  urllib3==2.5.0
22:54:54  virtualenv==20.31.2
22:54:54  waitress==3.0.2
22:54:54  WebOb==1.8.9
22:54:54  websocket-client==1.8.0
22:54:54  WebTest==3.0.6
22:54:54  wsproto==1.2.0
22:54:54  [EnvInject] - Injecting environment variables from a build step.
22:54:54  [EnvInject] - Injecting as environment variables the properties file path 'env.properties'
22:54:54  [EnvInject] - Variables injected successfully.
22:54:54  [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash -l /tmp/jenkins12022260548522219703.sh
22:54:54  Setup pyenv:
22:54:54    system
22:54:54    3.8.13
22:54:54    3.9.13
22:54:54    3.10.13
22:54:54  * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.python-version)
22:54:55  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-MXPj from file:/tmp/.os_lf_venv
22:54:57  lf-activate-venv(): INFO: Installing: python-heatclient python-openstackclient yq 
22:55:03  ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
22:55:03  lftools 0.37.13 requires urllib3<2.1.0, but you have urllib3 2.5.0 which is incompatible.
22:55:04  lf-activate-venv(): INFO: Adding /tmp/venv-MXPj/bin to PATH
22:55:04  + ODL_SYSTEM=()
22:55:04  + TOOLS_SYSTEM=()
22:55:04  + OPENSTACK_SYSTEM=()
22:55:04  + OPENSTACK_CONTROLLERS=()
22:55:04  + mapfile -t ADDR
22:55:04  ++ jq -r '.outputs[] | select(.output_key | match("^vm_[0-9]+_ips$")) | .output_value | .[]'
22:55:04  ++ openstack stack show -f json -c outputs releng-controller-csit-3node-clustering-tell-all-scandium-65
22:55:05  + for i in "${ADDR[@]}"
22:55:05  ++ ssh 10.30.170.28 hostname -s
22:55:05  Warning: Permanently added '10.30.170.28' (ECDSA) to the list of known hosts.
22:55:06  + REMHOST=releng-43164-65-0-builder-0
22:55:06  + case ${REMHOST} in
22:55:06  + ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}")
22:55:06  + for i in "${ADDR[@]}"
22:55:06  ++ ssh 10.30.171.142 hostname -s
22:55:06  Warning: Permanently added '10.30.171.142' (ECDSA) to the list of known hosts.
22:55:06  + REMHOST=releng-43164-65-0-builder-1
22:55:06  + case ${REMHOST} in
22:55:06  + ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}")
22:55:06  + for i in "${ADDR[@]}"
22:55:06  ++ ssh 10.30.171.124 hostname -s
22:55:06  Warning: Permanently added '10.30.171.124' (ECDSA) to the list of known hosts.
22:55:06  + REMHOST=releng-43164-65-0-builder-2
22:55:06  + case ${REMHOST} in
22:55:06  + ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}")
22:55:06  + echo NUM_ODL_SYSTEM=3
22:55:06  + echo NUM_TOOLS_SYSTEM=0
22:55:06  + '[' '' == yes ']'
22:55:06  + NUM_OPENSTACK_SYSTEM=0
22:55:06  + echo NUM_OPENSTACK_SYSTEM=0
22:55:06  + '[' 0 -eq 2 ']'
22:55:06  + echo ODL_SYSTEM_IP=10.30.170.28
22:55:06  ++ seq 0 2
22:55:06  + for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 )))
22:55:06  + echo ODL_SYSTEM_1_IP=10.30.170.28
22:55:06  + for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 )))
22:55:06  + echo ODL_SYSTEM_2_IP=10.30.171.142
22:55:06  + for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 )))
22:55:06  + echo ODL_SYSTEM_3_IP=10.30.171.124
22:55:06  + echo TOOLS_SYSTEM_IP=
22:55:06  ++ seq 0 -1
22:55:06  + openstack_index=0
22:55:06  + NUM_OPENSTACK_CONTROL_NODES=1
22:55:06  + echo NUM_OPENSTACK_CONTROL_NODES=1
22:55:06  ++ seq 0 0
22:55:06  + for i in $(seq 0 $((NUM_OPENSTACK_CONTROL_NODES - 1)))
22:55:06  + echo OPENSTACK_CONTROL_NODE_1_IP=
22:55:06  + NUM_OPENSTACK_COMPUTE_NODES=-1
22:55:06  + echo NUM_OPENSTACK_COMPUTE_NODES=-1
22:55:06  + '[' -1 -ge 2 ']'
22:55:06  ++ seq 0 -2
22:55:06  + NUM_OPENSTACK_HAPROXY_NODES=0
22:55:06  + echo NUM_OPENSTACK_HAPROXY_NODES=0
22:55:06  ++ seq 0 -1
22:55:06  + echo 'Contents of slave_addresses.txt:'
22:55:06  Contents of slave_addresses.txt:
22:55:06  + cat slave_addresses.txt
22:55:06  NUM_ODL_SYSTEM=3
22:55:06  NUM_TOOLS_SYSTEM=0
22:55:06  NUM_OPENSTACK_SYSTEM=0
22:55:06  ODL_SYSTEM_IP=10.30.170.28
22:55:06  ODL_SYSTEM_1_IP=10.30.170.28
22:55:06  ODL_SYSTEM_2_IP=10.30.171.142
22:55:06  ODL_SYSTEM_3_IP=10.30.171.124
22:55:06  TOOLS_SYSTEM_IP=
22:55:06  NUM_OPENSTACK_CONTROL_NODES=1
22:55:06  OPENSTACK_CONTROL_NODE_1_IP=
22:55:06  NUM_OPENSTACK_COMPUTE_NODES=-1
22:55:06  NUM_OPENSTACK_HAPROXY_NODES=0
22:55:06  [EnvInject] - Injecting environment variables from a build step.
22:55:06  [EnvInject] - Injecting as environment variables the properties file path 'slave_addresses.txt'
22:55:06  [EnvInject] - Variables injected successfully.
22:55:06  [controller-csit-3node-clustering-tell-all-scandium] $ /bin/sh /tmp/jenkins9770707520331455888.sh
22:55:06  Preparing for JRE Version 21
22:55:06  Karaf artifact is karaf
22:55:06  Karaf project is integration
22:55:06  Java home is /usr/lib/jvm/java-21-openjdk-amd64
22:55:06  [EnvInject] - Injecting environment variables from a build step.
22:55:06  [EnvInject] - Injecting as environment variables the properties file path 'set_variables.env'
22:55:06  [EnvInject] - Variables injected successfully.
22:55:06  [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins9768907522606498798.sh
22:55:07  2025-07-20 22:55:07 URL:https://raw.githubusercontent.com/opendaylight/integration-distribution/stable/scandium/pom.xml [2619/2619] -> "pom.xml" [1]
22:55:07  Bundle version is 0.21.3-SNAPSHOT
22:55:07  --2025-07-20 22:55:07--  https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.3-SNAPSHOT/maven-metadata.xml
22:55:07  Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6
22:55:07  Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected.
22:55:07  HTTP request sent, awaiting response... 200 OK
22:55:07  Length: 1398 (1.4K) [application/xml]
22:55:07  Saving to: ‘maven-metadata.xml’
22:55:07  
22:55:07       0K .                                                     100% 50.8M=0s
22:55:07  
22:55:07  2025-07-20 22:55:07 (50.8 MB/s) - ‘maven-metadata.xml’ saved [1398/1398]
22:55:07  
22:55:07  <?xml version="1.0" encoding="UTF-8"?>
22:55:07  <metadata modelVersion="1.1.0">
22:55:07    <groupId>org.opendaylight.integration</groupId>
22:55:07    <artifactId>karaf</artifactId>
22:55:07    <version>0.21.3-SNAPSHOT</version>
22:55:07    <versioning>
22:55:07      <snapshot>
22:55:07        <timestamp>20250713.183051</timestamp>
22:55:07        <buildNumber>1</buildNumber>
22:55:07      </snapshot>
22:55:07      <lastUpdated>20250713183051</lastUpdated>
22:55:07      <snapshotVersions>
22:55:07        <snapshotVersion>
22:55:07          <extension>pom</extension>
22:55:07          <value>0.21.3-20250713.183051-1</value>
22:55:07          <updated>20250713183051</updated>
22:55:07        </snapshotVersion>
22:55:07        <snapshotVersion>
22:55:07          <extension>tar.gz</extension>
22:55:07          <value>0.21.3-20250713.183051-1</value>
22:55:07          <updated>20250713183051</updated>
22:55:07        </snapshotVersion>
22:55:07        <snapshotVersion>
22:55:07          <extension>zip</extension>
22:55:07          <value>0.21.3-20250713.183051-1</value>
22:55:07          <updated>20250713183051</updated>
22:55:07        </snapshotVersion>
22:55:07        <snapshotVersion>
22:55:07          <classifier>cyclonedx</classifier>
22:55:07          <extension>xml</extension>
22:55:07          <value>0.21.3-20250713.183051-1</value>
22:55:07          <updated>20250713183051</updated>
22:55:07        </snapshotVersion>
22:55:07        <snapshotVersion>
22:55:07          <classifier>cyclonedx</classifier>
22:55:07          <extension>json</extension>
22:55:07          <value>0.21.3-20250713.183051-1</value>
22:55:07          <updated>20250713183051</updated>
22:55:07        </snapshotVersion>
22:55:07      </snapshotVersions>
22:55:07    </versioning>
22:55:07  </metadata>
22:55:07  Nexus timestamp is 0.21.3-20250713.183051-1
22:55:07  Distribution bundle URL is https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.3-SNAPSHOT/karaf-0.21.3-20250713.183051-1.zip
22:55:07  Distribution bundle is karaf-0.21.3-20250713.183051-1.zip
22:55:07  Distribution bundle version is 0.21.3-SNAPSHOT
22:55:07  Distribution folder is karaf-0.21.3-SNAPSHOT
22:55:07  Nexus prefix is https://nexus.opendaylight.org
22:55:07  [EnvInject] - Injecting environment variables from a build step.
22:55:07  [EnvInject] - Injecting as environment variables the properties file path 'detect_variables.env'
22:55:07  [EnvInject] - Variables injected successfully.
22:55:07  [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash -l /tmp/jenkins16090741942580540110.sh
22:55:07  Setup pyenv:
22:55:07    system
22:55:07    3.8.13
22:55:07    3.9.13
22:55:07    3.10.13
22:55:07  * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.python-version)
22:55:07  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-MXPj from file:/tmp/.os_lf_venv
22:55:09  ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
22:55:09  lftools 0.37.13 requires urllib3<2.1.0, but you have urllib3 2.5.0 which is incompatible.
22:55:09  lf-activate-venv(): INFO: Installing: python-heatclient python-openstackclient 
22:55:14  ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
22:55:14  lftools 0.37.13 requires urllib3<2.1.0, but you have urllib3 2.5.0 which is incompatible.
22:55:15  lf-activate-venv(): INFO: Adding /tmp/venv-MXPj/bin to PATH
22:55:15  Copying common-functions.sh to /tmp
22:55:16  Copying common-functions.sh to 10.30.170.28:/tmp
22:55:16  Warning: Permanently added '10.30.170.28' (ECDSA) to the list of known hosts.
22:55:17  Copying common-functions.sh to 10.30.171.142:/tmp
22:55:17  Warning: Permanently added '10.30.171.142' (ECDSA) to the list of known hosts.
22:55:17  Copying common-functions.sh to 10.30.171.124:/tmp
22:55:17  Warning: Permanently added '10.30.171.124' (ECDSA) to the list of known hosts.
22:55:17  [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins10705698965201367504.sh
22:55:17  common-functions.sh is being sourced
22:55:17  common-functions environment:
22:55:17  MAVENCONF: /tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
22:55:17  ACTUALFEATURES: 
22:55:17  FEATURESCONF: /tmp/karaf-0.21.3-SNAPSHOT/etc/org.apache.karaf.features.cfg
22:55:17  CUSTOMPROP: /tmp/karaf-0.21.3-SNAPSHOT/etc/custom.properties
22:55:17  LOGCONF: /tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
22:55:17  MEMCONF: /tmp/karaf-0.21.3-SNAPSHOT/bin/setenv
22:55:17  CONTROLLERMEM: 2048m
22:55:17  AKKACONF: /tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/pekko.conf
22:55:17  MODULESCONF: /tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/modules.conf
22:55:17  MODULESHARDSCONF: /tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/module-shards.conf
22:55:17  SUITES: 
22:55:17  
22:55:17  #################################################
22:55:17  ##         Configure Cluster and Start         ##
22:55:17  #################################################
22:55:17  ACTUALFEATURES: odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app
22:55:17  SPACE_SEPARATED_FEATURES: odl-integration-compatible-with-all odl-jolokia odl-restconf odl-clustering-test-app
22:55:17  Locating script plan to use...
22:55:17  script plan exists!!!
22:55:17  Changing the script plan path...
22:55:17  # Place the scripts in run order:
22:55:17  /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/scripts/car_people_shard.sh
22:55:17  Executing /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/scripts/car_people_shard.sh...
22:55:17  Add car-people shards file
22:55:17  Copy shard config to member-1 with IP address 10.30.170.28
22:55:17  Warning: Permanently added '10.30.170.28' (ECDSA) to the list of known hosts.
22:55:18  Copy shard config to member-2 with IP address 10.30.171.142
22:55:18  Warning: Permanently added '10.30.171.142' (ECDSA) to the list of known hosts.
22:55:18  Copy shard config to member-3 with IP address 10.30.171.124
22:55:18  Warning: Permanently added '10.30.171.124' (ECDSA) to the list of known hosts.
22:55:18  Finished running script plans
22:55:18  Configuring member-1 with IP address 10.30.170.28
22:55:18  Warning: Permanently added '10.30.170.28' (ECDSA) to the list of known hosts.
22:55:18  Warning: Permanently added '10.30.170.28' (ECDSA) to the list of known hosts.
22:55:18  + source /tmp/common-functions.sh karaf-0.21.3-SNAPSHOT
22:55:18  ++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]]
22:55:18  common-functions.sh is being sourced
22:55:18  ++ echo 'common-functions.sh is being sourced'
22:55:18  ++ BUNDLEFOLDER=karaf-0.21.3-SNAPSHOT
22:55:18  ++ export MAVENCONF=/tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
22:55:18  ++ MAVENCONF=/tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
22:55:18  ++ export FEATURESCONF=/tmp/karaf-0.21.3-SNAPSHOT/etc/org.apache.karaf.features.cfg
22:55:18  ++ FEATURESCONF=/tmp/karaf-0.21.3-SNAPSHOT/etc/org.apache.karaf.features.cfg
22:55:18  ++ export CUSTOMPROP=/tmp/karaf-0.21.3-SNAPSHOT/etc/custom.properties
22:55:18  ++ CUSTOMPROP=/tmp/karaf-0.21.3-SNAPSHOT/etc/custom.properties
22:55:18  ++ export LOGCONF=/tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
22:55:18  ++ LOGCONF=/tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
22:55:18  ++ export MEMCONF=/tmp/karaf-0.21.3-SNAPSHOT/bin/setenv
22:55:18  ++ MEMCONF=/tmp/karaf-0.21.3-SNAPSHOT/bin/setenv
22:55:18  ++ export CONTROLLERMEM=
22:55:18  ++ CONTROLLERMEM=
22:55:18  ++ '[' '' = calcium ']'
22:55:18  ++ CLUSTER_SYSTEM=pekko
22:55:18  ++ export AKKACONF=/tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/pekko.conf
22:55:18  ++ AKKACONF=/tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/pekko.conf
22:55:18  ++ export MODULESCONF=/tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/modules.conf
22:55:18  ++ MODULESCONF=/tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/modules.conf
22:55:18  ++ export MODULESHARDSCONF=/tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/module-shards.conf
22:55:18  ++ MODULESHARDSCONF=/tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/module-shards.conf
22:55:18  ++ print_common_env
22:55:18  ++ cat
22:55:18  common-functions environment:
22:55:18  MAVENCONF: /tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
22:55:18  ACTUALFEATURES: 
22:55:18  FEATURESCONF: /tmp/karaf-0.21.3-SNAPSHOT/etc/org.apache.karaf.features.cfg
22:55:18  CUSTOMPROP: /tmp/karaf-0.21.3-SNAPSHOT/etc/custom.properties
22:55:18  LOGCONF: /tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
22:55:18  MEMCONF: /tmp/karaf-0.21.3-SNAPSHOT/bin/setenv
22:55:18  CONTROLLERMEM: 
22:55:18  AKKACONF: /tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/pekko.conf
22:55:18  MODULESCONF: /tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/modules.conf
22:55:18  MODULESHARDSCONF: /tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/module-shards.conf
22:55:18  SUITES: 
22:55:18  
22:55:18  ++ SSH='ssh -t -t'
22:55:18  ++ extra_services_cntl='     dnsmasq.service     httpd.service     libvirtd.service     openvswitch.service     ovs-vswitchd.service     ovsdb-server.service     rabbitmq-server.service '
22:55:18  ++ extra_services_cmp='     libvirtd.service     openvswitch.service     ovs-vswitchd.service     ovsdb-server.service '
22:55:18  Changing to /tmp
22:55:18  Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.3-SNAPSHOT/karaf-0.21.3-20250713.183051-1.zip
22:55:18  + echo 'Changing to /tmp'
22:55:18  + cd /tmp
22:55:18  + echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.3-SNAPSHOT/karaf-0.21.3-20250713.183051-1.zip'
22:55:18  + wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.3-SNAPSHOT/karaf-0.21.3-20250713.183051-1.zip
22:55:18  --2025-07-20 22:55:18--  https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.3-SNAPSHOT/karaf-0.21.3-20250713.183051-1.zip
22:55:18  Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6
22:55:18  Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected.
22:55:18  HTTP request sent, awaiting response... 200 OK
22:55:18  Length: 234634745 (224M) [application/zip]
22:55:18  Saving to: ‘karaf-0.21.3-20250713.183051-1.zip’
22:55:18  
22:55:18       0K ........ ........ ........ ........ ........ ........  1% 74.5M 3s
22:55:18    3072K ........ ........ ........ ........ ........ ........  2%  120M 2s
22:55:18    6144K ........ ........ ........ ........ ........ ........  4%  181M 2s
22:55:19    9216K ........ ........ ........ ........ ........ ........  5%  191M 2s
22:55:19   12288K ........ ........ ........ ........ ........ ........  6%  175M 2s
22:55:19   15360K ........ ........ ........ ........ ........ ........  8%  195M 1s
22:55:19   18432K ........ ........ ........ ........ ........ ........  9%  232M 1s
22:55:19   21504K ........ ........ ........ ........ ........ ........ 10%  244M 1s
22:55:19   24576K ........ ........ ........ ........ ........ ........ 12%  213M 1s
22:55:19   27648K ........ ........ ........ ........ ........ ........ 13%  257M 1s
22:55:19   30720K ........ ........ ........ ........ ........ ........ 14%  293M 1s
22:55:19   33792K ........ ........ ........ ........ ........ ........ 16%  289M 1s
22:55:19   36864K ........ ........ ........ ........ ........ ........ 17%  336M 1s
22:55:19   39936K ........ ........ ........ ........ ........ ........ 18%  354M 1s
22:55:19   43008K ........ ........ ........ ........ ........ ........ 20%  308M 1s
22:55:19   46080K ........ ........ ........ ........ ........ ........ 21%  370M 1s
22:55:19   49152K ........ ........ ........ ........ ........ ........ 22%  309M 1s
22:55:19   52224K ........ ........ ........ ........ ........ ........ 24%  345M 1s
22:55:19   55296K ........ ........ ........ ........ ........ ........ 25%  369M 1s
22:55:19   58368K ........ ........ ........ ........ ........ ........ 26%  306M 1s
22:55:19   61440K ........ ........ ........ ........ ........ ........ 28%  323M 1s
22:55:19   64512K ........ ........ ........ ........ ........ ........ 29%  376M 1s
22:55:19   67584K ........ ........ ........ ........ ........ ........ 30%  376M 1s
22:55:19   70656K ........ ........ ........ ........ ........ ........ 32%  311M 1s
22:55:19   73728K ........ ........ ........ ........ ........ ........ 33%  226M 1s
22:55:19   76800K ........ ........ ........ ........ ........ ........ 34%  225M 1s
22:55:19   79872K ........ ........ ........ ........ ........ ........ 36%  388M 1s
22:55:19   82944K ........ ........ ........ ........ ........ ........ 37%  280M 1s
22:55:19   86016K ........ ........ ........ ........ ........ ........ 38%  275M 1s
22:55:19   89088K ........ ........ ........ ........ ........ ........ 40%  272M 1s
22:55:19   92160K ........ ........ ........ ........ ........ ........ 41%  307M 1s
22:55:19   95232K ........ ........ ........ ........ ........ ........ 42%  279M 1s
22:55:19   98304K ........ ........ ........ ........ ........ ........ 44%  247M 1s
22:55:19  101376K ........ ........ ........ ........ ........ ........ 45%  304M 0s
22:55:19  104448K ........ ........ ........ ........ ........ ........ 46%  361M 0s
22:55:19  107520K ........ ........ ........ ........ ........ ........ 48%  315M 0s
22:55:19  110592K ........ ........ ........ ........ ........ ........ 49%  264M 0s
22:55:19  113664K ........ ........ ........ ........ ........ ........ 50%  248M 0s
22:55:19  116736K ........ ........ ........ ........ ........ ........ 52%  308M 0s
22:55:19  119808K ........ ........ ........ ........ ........ ........ 53%  349M 0s
22:55:19  122880K ........ ........ ........ ........ ........ ........ 54%  263M 0s
22:55:19  125952K ........ ........ ........ ........ ........ ........ 56%  317M 0s
22:55:19  129024K ........ ........ ........ ........ ........ ........ 57%  310M 0s
22:55:19  132096K ........ ........ ........ ........ ........ ........ 58%  313M 0s
22:55:19  135168K ........ ........ ........ ........ ........ ........ 60%  353M 0s
22:55:19  138240K ........ ........ ........ ........ ........ ........ 61%  359M 0s
22:55:19  141312K ........ ........ ........ ........ ........ ........ 63%  357M 0s
22:55:19  144384K ........ ........ ........ ........ ........ ........ 64%  356M 0s
22:55:19  147456K ........ ........ ........ ........ ........ ........ 65%  366M 0s
22:55:19  150528K ........ ........ ........ ........ ........ ........ 67%  363M 0s
22:55:19  153600K ........ ........ ........ ........ ........ ........ 68%  368M 0s
22:55:19  156672K ........ ........ ........ ........ ........ ........ 69%  351M 0s
22:55:19  159744K ........ ........ ........ ........ ........ ........ 71%  366M 0s
22:55:19  162816K ........ ........ ........ ........ ........ ........ 72%  362M 0s
22:55:19  165888K ........ ........ ........ ........ ........ ........ 73%  367M 0s
22:55:19  168960K ........ ........ ........ ........ ........ ........ 75%  358M 0s
22:55:19  172032K ........ ........ ........ ........ ........ ........ 76%  364M 0s
22:55:19  175104K ........ ........ ........ ........ ........ ........ 77%  360M 0s
22:55:19  178176K ........ ........ ........ ........ ........ ........ 79%  347M 0s
22:55:19  181248K ........ ........ ........ ........ ........ ........ 80%  371M 0s
22:55:19  184320K ........ ........ ........ ........ ........ ........ 81%  359M 0s
22:55:19  187392K ........ ........ ........ ........ ........ ........ 83%  299M 0s
22:55:19  190464K ........ ........ ........ ........ ........ ........ 84%  362M 0s
22:55:19  193536K ........ ........ ........ ........ ........ ........ 85%  376M 0s
22:55:19  196608K ........ ........ ........ ........ ........ ........ 87%  365M 0s
22:55:19  199680K ........ ........ ........ ........ ........ ........ 88%  362M 0s
22:55:19  202752K ........ ........ ........ ........ ........ ........ 89%  266M 0s
22:55:19  205824K ........ ........ ........ ........ ........ ........ 91%  280M 0s
22:55:19  208896K ........ ........ ........ ........ ........ ........ 92%  347M 0s
22:55:19  211968K ........ ........ ........ ........ ........ ........ 93%  372M 0s
22:55:19  215040K ........ ........ ........ ........ ........ ........ 95%  369M 0s
22:55:19  218112K ........ ........ ........ ........ ........ ........ 96%  368M 0s
22:55:19  221184K ........ ........ ........ ........ ........ ........ 97%  370M 0s
22:55:19  224256K ........ ........ ........ ........ ........ ........ 99%  346M 0s
22:55:19  227328K ........ ........ ........ ....                      100%  370M=0.8s
22:55:19  
22:55:19  2025-07-20 22:55:19 (287 MB/s) - ‘karaf-0.21.3-20250713.183051-1.zip’ saved [234634745/234634745]
22:55:19  
22:55:19  Extracting the new controller...
22:55:19  + echo 'Extracting the new controller...'
22:55:19  + unzip -q karaf-0.21.3-20250713.183051-1.zip
22:55:21  Adding external repositories...
22:55:21  + echo 'Adding external repositories...'
22:55:21  + sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
22:55:21  + cat /tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
22:55:21  ################################################################################
22:55:21  #
22:55:21  #    Licensed to the Apache Software Foundation (ASF) under one or more
22:55:21  #    contributor license agreements.  See the NOTICE file distributed with
22:55:21  #    this work for additional information regarding copyright ownership.
22:55:21  #    The ASF licenses this file to You under the Apache License, Version 2.0
22:55:21  #    (the "License"); you may not use this file except in compliance with
22:55:21  #    the License.  You may obtain a copy of the License at
22:55:21  #
22:55:21  #       http://www.apache.org/licenses/LICENSE-2.0
22:55:21  #
22:55:21  #    Unless required by applicable law or agreed to in writing, software
22:55:21  #    distributed under the License is distributed on an "AS IS" BASIS,
22:55:21  #    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
22:55:21  #    See the License for the specific language governing permissions and
22:55:21  #    limitations under the License.
22:55:21  #
22:55:21  ################################################################################
22:55:21  
22:55:21  #
22:55:21  # If set to true, the following property will not allow any certificate to be used
22:55:21  # when accessing Maven repositories through SSL
22:55:21  #
22:55:21  #org.ops4j.pax.url.mvn.certificateCheck=
22:55:21  
22:55:21  #
22:55:21  # Path to the local Maven settings file.
22:55:21  # The repositories defined in this file will be automatically added to the list
22:55:21  # of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property
22:55:21  # below is not set.
22:55:21  # The following locations are checked for the existence of the settings.xml file
22:55:21  #   * 1. looks for the specified url
22:55:21  #   * 2. if not found looks for ${user.home}/.m2/settings.xml
22:55:21  #   * 3. if not found looks for ${maven.home}/conf/settings.xml
22:55:21  #   * 4. if not found looks for ${M2_HOME}/conf/settings.xml
22:55:21  #
22:55:21  #org.ops4j.pax.url.mvn.settings=
22:55:21  
22:55:21  #
22:55:21  # Path to the local Maven repository which is used to avoid downloading
22:55:21  # artifacts when they already exist locally.
22:55:21  # The value of this property will be extracted from the settings.xml file
22:55:21  # above, or defaulted to:
22:55:21  #     System.getProperty( "user.home" ) + "/.m2/repository"
22:55:21  #
22:55:21  org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository}
22:55:21  
22:55:21  #
22:55:21  # Default this to false. It's just weird to use undocumented repos
22:55:21  #
22:55:21  org.ops4j.pax.url.mvn.useFallbackRepositories=false
22:55:21  
22:55:21  #
22:55:21  # Uncomment if you don't wanna use the proxy settings
22:55:21  # from the Maven conf/settings.xml file
22:55:21  #
22:55:21  # org.ops4j.pax.url.mvn.proxySupport=false
22:55:21  
22:55:21  #
22:55:21  # Comma separated list of repositories scanned when resolving an artifact.
22:55:21  # Those repositories will be checked before iterating through the
22:55:21  #    below list of repositories and even before the local repository
22:55:21  # A repository url can be appended with zero or more of the following flags:
22:55:21  #    @snapshots  : the repository contains snaphots
22:55:21  #    @noreleases : the repository does not contain any released artifacts
22:55:21  #
22:55:21  # The following property value will add the system folder as a repo.
22:55:21  #
22:55:21  org.ops4j.pax.url.mvn.defaultRepositories=\
22:55:21      file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\
22:55:21      file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\
22:55:21      file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots
22:55:21  
22:55:21  # Use the default local repo (e.g.~/.m2/repository) as a "remote" repo
22:55:21  #org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false
22:55:21  
22:55:21  #
22:55:21  # Comma separated list of repositories scanned when resolving an artifact.
22:55:21  # The default list includes the following repositories:
22:55:21  #    http://repo1.maven.org/maven2@id=central
22:55:21  #    http://repository.springsource.com/maven/bundles/release@id=spring.ebr
22:55:21  #    http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external
22:55:21  #    http://zodiac.springsource.com/maven/bundles/release@id=gemini
22:55:21  #    http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases
22:55:21  #    https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases
22:55:21  #    https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
22:55:21  # To add repositories to the default ones, prepend '+' to the list of repositories
22:55:21  # to add.
22:55:21  # A repository url can be appended with zero or more of the following flags:
22:55:21  #    @snapshots  : the repository contains snapshots
22:55:21  #    @noreleases : the repository does not contain any released artifacts
22:55:21  #    @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended
22:55:21  #
22:55:21  org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
22:55:21  
22:55:21  ### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.Configuring the startup features...
22:55:21  + [[ True == \T\r\u\e ]]
22:55:21  + echo 'Configuring the startup features...'
22:55:21  + sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.21.3-SNAPSHOT/etc/org.apache.karaf.features.cfg
22:55:21  + FEATURE_TEST_STRING=features-test
22:55:21  + FEATURE_TEST_VERSION=0.21.3-SNAPSHOT
22:55:21  + KARAF_VERSION=karaf4
22:55:21  + [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]]
22:55:21  + sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.21.3-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.21.3-SNAPSHOT/etc/org.apache.karaf.features.cfg
22:55:21  + [[ ! -z '' ]]
22:55:21  + cat /tmp/karaf-0.21.3-SNAPSHOT/etc/org.apache.karaf.features.cfg
22:55:21  ################################################################################
22:55:21  #
22:55:21  #    Licensed to the Apache Software Foundation (ASF) under one or more
22:55:21  #    contributor license agreements.  See the NOTICE file distributed with
22:55:21  #    this work for additional information regarding copyright ownership.
22:55:21  #    The ASF licenses this file to You under the Apache License, Version 2.0
22:55:21  #    (the "License"); you may not use this file except in compliance with
22:55:21  #    the License.  You may obtain a copy of the License at
22:55:21  #
22:55:21  #       http://www.apache.org/licenses/LICENSE-2.0
22:55:21  #
22:55:21  #    Unless required by applicable law or agreed to in writing, software
22:55:21  #    distributed under the License is distributed on an "AS IS" BASIS,
22:55:21  #    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
22:55:21  #    See the License for the specific language governing permissions and
22:55:21  #    limitations under the License.
22:55:21  #
22:55:21  ################################################################################
22:55:21  
22:55:21  #
22:55:21  # Comma separated list of features repositories to register by default
22:55:21  #
22:55:21  featuresRepositories = mvn:org.opendaylight.integration/features-test/0.21.3-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/85e4e99f-0858-420b-b76b-8b97b10100c8.xml
22:55:21  
22:55:21  #
22:55:21  # Comma separated list of features to install at startup
22:55:21  #
22:55:21  featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, 78fe7843-03b4-4322-9171-bfb7ca7953cb
22:55:21  
22:55:21  #
22:55:21  # Resource repositories (OBR) that the features resolver can use
22:55:21  # to resolve requirements/capabilities
22:55:21  #
22:55:21  # The format of the resourceRepositories is 
22:55:21  # resourceRepositories=[xml:url|json:url],...
22:55:21  # for Instance:
22:55:21  #
22:55:21  #resourceRepositories=xml:http://host/path/to/index.xml
22:55:21  # or
22:55:21  #resourceRepositories=json:http://host/path/to/index.json
22:55:21  #
22:55:21  
22:55:21  #
22:55:21  # Defines if the boot features are started in asynchronous mode (in a dedicated thread)
22:55:21  #
22:55:21  featuresBootAsynchronous=false
22:55:21  
22:55:21  #
22:55:21  # Service requirements enforcement
22:55:21  #
22:55:21  # By default, the feature resolver checks the service requirements/capabilities of
22:55:21  # bundles for new features (xml schema >= 1.3.0) in order to automatically installs
22:55:21  # the required bundles.
22:55:21  # The following flag can have those values:
22:55:21  #   - disable: service requirements are completely ignored
22:55:21  #   - default: service requirements are ignored for old features
22:55:21  #   - enforce: service requirements are always verified
22:55:21  #
22:55:21  #serviceRequirements=default
22:55:21  
22:55:21  #
22:55:21  # Store cfg file for config element in feature
22:55:21  #
22:55:21  #configCfgStore=true
22:55:21  
22:55:21  #
22:55:21  # Define if the feature service automatically refresh bundles
22:55:21  #
22:55:21  autoRefresh=true
22:55:21  
22:55:21  #
22:55:21  # Configuration of features processing mechanism (overrides, blacklisting, modification of features)
22:55:21  # XML file defines instructions related to features processing
22:55:21  # versions.properties may declare properties to resolve placeholders in XML file
22:55:21  # both files are relative to ${karaf.etc}
22:55:21  #
22:55:21  #featureProcessing=org.apache.karaf.features.xml
22:55:21  #featureProcessingVersions=versions.properties
22:55:21  + configure_karaf_log karaf4 ''
22:55:21  + local -r karaf_version=karaf4
22:55:21  + local -r controllerdebugmap=
22:55:21  + local logapi=log4j
22:55:21  + grep log4j2 /tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
22:55:21  log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
22:55:21  log4j2.rootLogger.level = INFO
22:55:21  #log4j2.rootLogger.type = asyncRoot
22:55:21  #log4j2.rootLogger.includeLocation = false
22:55:21  log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
22:55:21  log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
22:55:21  log4j2.rootLogger.appenderRef.Console.ref = Console
22:55:21  log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
22:55:21  log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
22:55:21  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
22:55:21  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
22:55:21  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
22:55:21  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
22:55:21  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
22:55:21  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
22:55:21  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
22:55:21  log4j2.logger.spifly.name = org.apache.aries.spifly
22:55:21  log4j2.logger.spifly.level = WARN
22:55:21  log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
22:55:21  log4j2.logger.audit.level = INFO
22:55:21  log4j2.logger.audit.additivity = false
22:55:21  log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
22:55:21  # Console appender not used by default (see log4j2.rootLogger.appenderRefs)
22:55:21  log4j2.appender.console.type = Console
22:55:21  log4j2.appender.console.name = Console
22:55:21  log4j2.appender.console.layout.type = PatternLayout
22:55:21  log4j2.appender.console.layout.pattern = ${log4j2.pattern}
22:55:21  log4j2.appender.rolling.type = RollingRandomAccessFile
22:55:21  log4j2.appender.rolling.name = RollingFile
22:55:21  log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
22:55:21  log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
22:55:21  #log4j2.appender.rolling.immediateFlush = false
22:55:21  log4j2.appender.rolling.append = true
22:55:21  log4j2.appender.rolling.layout.type = PatternLayout
22:55:21  log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
22:55:21  log4j2.appender.rolling.policies.type = Policies
22:55:21  log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
22:55:21  log4j2.appender.rolling.policies.size.size = 64MB
22:55:21  log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
22:55:21  log4j2.appender.rolling.strategy.max = 7
22:55:21  log4j2.appender.audit.type = RollingRandomAccessFile
22:55:21  log4j2.appender.audit.name = AuditRollingFile
22:55:21  log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
22:55:21  log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
22:55:21  log4j2.appender.audit.append = true
22:55:21  log4j2.appender.audit.layout.type = PatternLayout
22:55:21  log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
22:55:21  log4j2.appender.audit.policies.type = Policies
22:55:21  log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
22:55:21  log4j2.appender.audit.policies.size.size = 8MB
22:55:21  log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
22:55:21  log4j2.appender.audit.strategy.max = 7
22:55:21  log4j2.appender.osgi.type = PaxOsgi
22:55:21  log4j2.appender.osgi.name = PaxOsgi
22:55:21  log4j2.appender.osgi.filter = *
22:55:21  #log4j2.logger.aether.name = shaded.org.eclipse.aether
22:55:21  #log4j2.logger.aether.level = TRACE
22:55:21  #log4j2.logger.http-headers.name = shaded.org.apache.http.headers
22:55:21  #log4j2.logger.http-headers.level = DEBUG
22:55:21  #log4j2.logger.maven.name = org.ops4j.pax.url.mvn
22:55:21  #log4j2.logger.maven.level = TRACE
22:55:21  + logapi=log4j2
22:55:21  Configuring the karaf log... karaf_version: karaf4, logapi: log4j2
22:55:21  + echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2'
22:55:21  + '[' log4j2 == log4j2 ']'
22:55:21  + sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
22:55:21  + orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver
22:55:21  + orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver
22:55:21  + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN'
22:55:21  + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN'
22:55:21  + unset IFS
22:55:21  + echo 'controllerdebugmap: '
22:55:21  controllerdebugmap: 
22:55:21  + '[' -n '' ']'
22:55:21  cat /tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
22:55:21  + echo 'cat /tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg'
22:55:21  + cat /tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
22:55:21  ################################################################################
22:55:21  #
22:55:21  #    Licensed to the Apache Software Foundation (ASF) under one or more
22:55:21  #    contributor license agreements.  See the NOTICE file distributed with
22:55:21  #    this work for additional information regarding copyright ownership.
22:55:21  #    The ASF licenses this file to You under the Apache License, Version 2.0
22:55:21  #    (the "License"); you may not use this file except in compliance with
22:55:21  #    the License.  You may obtain a copy of the License at
22:55:21  #
22:55:21  #       http://www.apache.org/licenses/LICENSE-2.0
22:55:21  #
22:55:21  #    Unless required by applicable law or agreed to in writing, software
22:55:21  #    distributed under the License is distributed on an "AS IS" BASIS,
22:55:21  #    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
22:55:21  #    See the License for the specific language governing permissions and
22:55:21  #    limitations under the License.
22:55:21  #
22:55:21  ################################################################################
22:55:21  
22:55:21  # Common pattern layout for appenders
22:55:21  log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
22:55:21  
22:55:21  # Root logger
22:55:21  log4j2.rootLogger.level = INFO
22:55:21  # uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library
22:55:21  #log4j2.rootLogger.type = asyncRoot
22:55:21  #log4j2.rootLogger.includeLocation = false
22:55:21  log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
22:55:21  log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
22:55:21  log4j2.rootLogger.appenderRef.Console.ref = Console
22:55:21  log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
22:55:21  log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
22:55:21  
22:55:21  # Filters for logs marked by org.opendaylight.odlparent.Markers
22:55:21  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
22:55:21  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
22:55:21  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
22:55:21  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
22:55:21  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
22:55:21  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
22:55:21  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
22:55:21  
22:55:21  # Loggers configuration
22:55:21  
22:55:21  # Spifly logger
22:55:21  log4j2.logger.spifly.name = org.apache.aries.spifly
22:55:21  log4j2.logger.spifly.level = WARN
22:55:21  
22:55:21  # Security audit logger
22:55:21  log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
22:55:21  log4j2.logger.audit.level = INFO
22:55:21  log4j2.logger.audit.additivity = false
22:55:21  log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
22:55:21  
22:55:21  # Appenders configuration
22:55:21  
22:55:21  # Console appender not used by default (see log4j2.rootLogger.appenderRefs)
22:55:21  log4j2.appender.console.type = Console
22:55:21  log4j2.appender.console.name = Console
22:55:21  log4j2.appender.console.layout.type = PatternLayout
22:55:21  log4j2.appender.console.layout.pattern = ${log4j2.pattern}
22:55:21  
22:55:21  # Rolling file appender
22:55:21  log4j2.appender.rolling.type = RollingRandomAccessFile
22:55:21  log4j2.appender.rolling.name = RollingFile
22:55:21  log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
22:55:21  log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
22:55:21  # uncomment to not force a disk flush
22:55:21  #log4j2.appender.rolling.immediateFlush = false
22:55:21  log4j2.appender.rolling.append = true
22:55:21  log4j2.appender.rolling.layout.type = PatternLayout
22:55:21  log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
22:55:21  log4j2.appender.rolling.policies.type = Policies
22:55:21  log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
22:55:21  log4j2.appender.rolling.policies.size.size = 1GB
22:55:21  log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
22:55:21  log4j2.appender.rolling.strategy.max = 7
22:55:21  
22:55:21  # Audit file appender
22:55:21  log4j2.appender.audit.type = RollingRandomAccessFile
22:55:21  log4j2.appender.audit.name = AuditRollingFile
22:55:21  log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
22:55:21  log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
22:55:21  log4j2.appender.audit.append = true
22:55:21  log4j2.appender.audit.layout.type = PatternLayout
22:55:21  log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
22:55:21  log4j2.appender.audit.policies.type = Policies
22:55:21  log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
22:55:21  log4j2.appender.audit.policies.size.size = 8MB
22:55:21  log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
22:55:21  log4j2.appender.audit.strategy.max = 7
22:55:21  
22:55:21  # OSGi appender
22:55:21  log4j2.appender.osgi.type = PaxOsgi
22:55:21  log4j2.appender.osgi.name = PaxOsgi
22:55:21  log4j2.appender.osgi.filter = *
22:55:21  
22:55:21  # help with identification of maven-related problems with pax-url-aether
22:55:21  #log4j2.logger.aether.name = shaded.org.eclipse.aether
22:55:21  #log4j2.logger.aether.level = TRACE
22:55:21  #log4j2.logger.http-headers.name = shaded.org.apache.http.headers
22:55:21  #log4j2.logger.http-headers.level = DEBUG
22:55:21  #log4j2.logger.maven.name = org.ops4j.pax.url.mvn
22:55:21  #log4j2.logger.maven.level = TRACE
22:55:21  log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN
22:55:21  log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN
22:55:21  + set_java_vars /usr/lib/jvm/java-21-openjdk-amd64 3072m /tmp/karaf-0.21.3-SNAPSHOT/bin/setenv
22:55:21  + local -r java_home=/usr/lib/jvm/java-21-openjdk-amd64
22:55:21  + local -r controllermem=3072m
22:55:21  + local -r memconf=/tmp/karaf-0.21.3-SNAPSHOT/bin/setenv
22:55:21  + echo Configure
22:55:21  Configure
22:55:21  + echo '    java home: /usr/lib/jvm/java-21-openjdk-amd64'
22:55:21      java home: /usr/lib/jvm/java-21-openjdk-amd64
22:55:21      max memory: 3072m
22:55:21      memconf: /tmp/karaf-0.21.3-SNAPSHOT/bin/setenv
22:55:21  + echo '    max memory: 3072m'
22:55:21  + echo '    memconf: /tmp/karaf-0.21.3-SNAPSHOT/bin/setenv'
22:55:21  + sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64}%g' /tmp/karaf-0.21.3-SNAPSHOT/bin/setenv
22:55:21  + sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.21.3-SNAPSHOT/bin/setenv
22:55:21  + echo 'cat /tmp/karaf-0.21.3-SNAPSHOT/bin/setenv'
22:55:21  cat /tmp/karaf-0.21.3-SNAPSHOT/bin/setenv
22:55:21  + cat /tmp/karaf-0.21.3-SNAPSHOT/bin/setenv
22:55:21  #!/bin/sh
22:55:21  #
22:55:21  #    Licensed to the Apache Software Foundation (ASF) under one or more
22:55:21  #    contributor license agreements.  See the NOTICE file distributed with
22:55:21  #    this work for additional information regarding copyright ownership.
22:55:21  #    The ASF licenses this file to You under the Apache License, Version 2.0
22:55:21  #    (the "License"); you may not use this file except in compliance with
22:55:21  #    the License.  You may obtain a copy of the License at
22:55:21  #
22:55:21  #       http://www.apache.org/licenses/LICENSE-2.0
22:55:21  #
22:55:21  #    Unless required by applicable law or agreed to in writing, software
22:55:21  #    distributed under the License is distributed on an "AS IS" BASIS,
22:55:21  #    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
22:55:21  #    See the License for the specific language governing permissions and
22:55:21  #    limitations under the License.
22:55:21  #
22:55:21  
22:55:21  #
22:55:21  # handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf
22:55:21  # script: client, instance, shell, start, status, stop, karaf
22:55:21  #
22:55:21  # if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then
22:55:21  #   Actions go here...
22:55:21  # fi
22:55:21  
22:55:21  #
22:55:21  # general settings which should be applied for all scripts go here; please keep
22:55:21  # in mind that it is possible that scripts might be executed more than once, e.g.
22:55:21  # in example of the start script where the start script is executed first and the
22:55:21  # karaf script afterwards.
22:55:21  #
22:55:21  
22:55:21  #
22:55:21  # The following section shows the possible configuration options for the default 
22:55:21  # karaf scripts
22:55:21  #
22:55:21  export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64} # Location of Java installation
22:55:21  # export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration
22:55:21  # export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options
22:55:21  # export EXTRA_JAVA_OPTS # Additional JVM options
22:55:21  # export KARAF_HOME # Karaf home folder
22:55:21  # export KARAF_DATA # Karaf data folder
22:55:21  # export KARAF_BASE # Karaf base folder
22:55:21  # export KARAF_ETC  # Karaf etc  folder
22:55:21  # export KARAF_LOG  # Karaf log  folder
22:55:21  # export KARAF_SYSTEM_OPTS # First citizen Karaf options
22:55:21  # export KARAF_OPTS # Additional available Karaf options
22:55:21  # export KARAF_DEBUG # Enable debug mode
22:55:21  # export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start
22:55:21  # export KARAF_NOROOT # Prevent execution as root if set to true
22:55:21  + echo 'Set Java version'
22:55:21  Set Java version
22:55:21  + sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-21-openjdk-amd64/bin/java 1
22:55:21  sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper
22:55:21  sudo: a password is required
22:55:21  + sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-21-openjdk-amd64/bin/java
22:55:21  sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper
22:55:21  sudo: a password is required
22:55:21  JDK default version ...
22:55:21  + echo 'JDK default version ...'
22:55:21  + java -version
22:55:22  openjdk version "21.0.5" 2024-10-15
22:55:22  OpenJDK Runtime Environment (build 21.0.5+11-Ubuntu-1ubuntu122.04)
22:55:22  OpenJDK 64-Bit Server VM (build 21.0.5+11-Ubuntu-1ubuntu122.04, mixed mode, sharing)
22:55:22  Set JAVA_HOME
22:55:22  + echo 'Set JAVA_HOME'
22:55:22  + export JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64
22:55:22  + JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64
22:55:22  ++ readlink -e /usr/lib/jvm/java-21-openjdk-amd64/bin/java
22:55:22  Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java
22:55:22  Listing all open ports on controller system...
22:55:22  + JAVA_RESOLVED=/usr/lib/jvm/java-21-openjdk-amd64/bin/java
22:55:22  + echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java'
22:55:22  + echo 'Listing all open ports on controller system...'
22:55:22  + netstat -pnatu
22:55:22  /tmp/configuration-script.sh: line 40: netstat: command not found
22:55:22  Custom shard config exists!!!
22:55:22  Copying the shard config...
22:55:22  + '[' -f /tmp/custom_shard_config.txt ']'
22:55:22  + echo 'Custom shard config exists!!!'
22:55:22  + echo 'Copying the shard config...'
22:55:22  + cp /tmp/custom_shard_config.txt /tmp/karaf-0.21.3-SNAPSHOT/bin/
22:55:22  Configuring cluster
22:55:22  + echo 'Configuring cluster'
22:55:22  + /tmp/karaf-0.21.3-SNAPSHOT/bin/configure_cluster.sh 1 10.30.170.28 10.30.171.142 10.30.171.124
22:55:22  ################################################
22:55:22  ##             Configure Cluster              ##
22:55:22  ################################################
22:55:22   NOTE: Cluster configuration files not found. Copying from
22:55:22   /tmp/karaf-0.21.3-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/10.0.9
22:55:22  Configuring unique name in akka.conf
22:55:22  Configuring hostname in akka.conf
22:55:22  Configuring data and rpc seed nodes in akka.conf
22:55:22  modules = [
22:55:22  	
22:55:22  	{
22:55:22  		name = "inventory"
22:55:22  		namespace = "urn:opendaylight:inventory"
22:55:22  		shard-strategy = "module"
22:55:22  	},
22:55:22  	{
22:55:22  		name = "topology"
22:55:22  		namespace = "urn:TBD:params:xml:ns:yang:network-topology"
22:55:22  		shard-strategy = "module"
22:55:22  	},
22:55:22  	{
22:55:22  		name = "toaster"
22:55:22  		namespace = "http://netconfcentral.org/ns/toaster"
22:55:22  		shard-strategy = "module"
22:55:22  	},
22:55:22  	{
22:55:22  		name = "car"
22:55:22  		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
22:55:22  		shard-strategy = "module"
22:55:22  	},
22:55:22  	{
22:55:22  		name = "people"
22:55:22  		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
22:55:22  		shard-strategy = "module"
22:55:22  	},
22:55:22  	{
22:55:22  		name = "car-people"
22:55:22  		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
22:55:22  		shard-strategy = "module"
22:55:22  	}
22:55:22  ]
22:55:22  Configuring replication type in module-shards.conf
22:55:22  ################################################
22:55:22  ##   NOTE: Manually restart controller to     ##
22:55:22  ##         apply configuration.               ##
22:55:22  ################################################
22:55:22  Dump pekko.conf
22:55:22  + echo 'Dump pekko.conf'
22:55:22  + cat /tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/pekko.conf
22:55:22  cat: /tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/pekko.conf: No such file or directory
22:55:22  Dump modules.conf
22:55:22  + echo 'Dump modules.conf'
22:55:22  + cat /tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/modules.conf
22:55:22  modules = [
22:55:22  	
22:55:22  	{
22:55:22  		name = "inventory"
22:55:22  		namespace = "urn:opendaylight:inventory"
22:55:22  		shard-strategy = "module"
22:55:22  	},
22:55:22  	{
22:55:22  		name = "topology"
22:55:22  		namespace = "urn:TBD:params:xml:ns:yang:network-topology"
22:55:22  		shard-strategy = "module"
22:55:22  	},
22:55:22  	{
22:55:22  		name = "toaster"
22:55:22  		namespace = "http://netconfcentral.org/ns/toaster"
22:55:22  		shard-strategy = "module"
22:55:22  	},
22:55:22  	{
22:55:22  		name = "car"
22:55:22  		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
22:55:22  		shard-strategy = "module"
22:55:22  	},
22:55:22  	{
22:55:22  		name = "people"
22:55:22  		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
22:55:22  		shard-strategy = "module"
22:55:22  	},
22:55:22  	{
22:55:22  		name = "car-people"
22:55:22  		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
22:55:22  		shard-strategy = "module"
22:55:22  	}
22:55:22  ]
22:55:22  Dump module-shards.conf
22:55:22  + echo 'Dump module-shards.conf'
22:55:22  + cat /tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/module-shards.conf
22:55:22  module-shards = [
22:55:22  	{
22:55:22  		name = "default"
22:55:22  		shards = [
22:55:22  			{
22:55:22  				name = "default"
22:55:22  				replicas = ["member-1",
22:55:22  				"member-2",
22:55:22  				"member-3"]
22:55:22  			}
22:55:22  		]
22:55:22  	},
22:55:22  	{
22:55:22  		name = "inventory"
22:55:22  		shards = [
22:55:22  			{
22:55:22  				name="inventory"
22:55:22  				replicas = ["member-1",
22:55:22  				"member-2",
22:55:22  				"member-3"]
22:55:22  			}
22:55:22  		]
22:55:22  	},
22:55:22  	{
22:55:22  		name = "topology"
22:55:22  		shards = [
22:55:22  			{
22:55:22  				name="topology"
22:55:22  				replicas = ["member-1",
22:55:22  				"member-2",
22:55:22  				"member-3"]
22:55:22  			}
22:55:22  		]
22:55:22  	},
22:55:22  	{
22:55:22  		name = "toaster"
22:55:22  		shards = [
22:55:22  			{
22:55:22  				name="toaster"
22:55:22  				replicas = ["member-1",
22:55:22  				"member-2",
22:55:22  				"member-3"]
22:55:22  			}
22:55:22  		]
22:55:22  	},
22:55:22  	{
22:55:22  		name = "car"
22:55:22  		shards = [
22:55:22  			{
22:55:22  				name="car"
22:55:22  				replicas = ["member-1",
22:55:22  				"member-2",
22:55:22  				"member-3"]
22:55:22  			}
22:55:22  		]
22:55:22  	},
22:55:22  	{
22:55:22  		name = "people"
22:55:22  		shards = [
22:55:22  			{
22:55:22  				name="people"
22:55:22  				replicas = ["member-1",
22:55:22  				"member-2",
22:55:22  				"member-3"]
22:55:22  			}
22:55:22  		]
22:55:22  	},
22:55:22  	{
22:55:22  		name = "car-people"
22:55:22  		shards = [
22:55:22  			{
22:55:22  				name="car-people"
22:55:22  				replicas = ["member-1",
22:55:22  				"member-2",
22:55:22  				"member-3"]
22:55:22  			}
22:55:22  		]
22:55:22  	}
22:55:22  ]
22:55:22  Configuring member-2 with IP address 10.30.171.142
22:55:22  Warning: Permanently added '10.30.171.142' (ECDSA) to the list of known hosts.
22:55:22  Warning: Permanently added '10.30.171.142' (ECDSA) to the list of known hosts.
22:55:22  common-functions.sh is being sourced
22:55:22  + source /tmp/common-functions.sh karaf-0.21.3-SNAPSHOT
22:55:22  ++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]]
22:55:22  ++ echo 'common-functions.sh is being sourced'
22:55:22  ++ BUNDLEFOLDER=karaf-0.21.3-SNAPSHOT
22:55:22  ++ export MAVENCONF=/tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
22:55:22  ++ MAVENCONF=/tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
22:55:22  ++ export FEATURESCONF=/tmp/karaf-0.21.3-SNAPSHOT/etc/org.apache.karaf.features.cfg
22:55:22  ++ FEATURESCONF=/tmp/karaf-0.21.3-SNAPSHOT/etc/org.apache.karaf.features.cfg
22:55:22  ++ export CUSTOMPROP=/tmp/karaf-0.21.3-SNAPSHOT/etc/custom.properties
22:55:22  ++ CUSTOMPROP=/tmp/karaf-0.21.3-SNAPSHOT/etc/custom.properties
22:55:22  ++ export LOGCONF=/tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
22:55:22  ++ LOGCONF=/tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
22:55:22  ++ export MEMCONF=/tmp/karaf-0.21.3-SNAPSHOT/bin/setenv
22:55:22  ++ MEMCONF=/tmp/karaf-0.21.3-SNAPSHOT/bin/setenv
22:55:22  ++ export CONTROLLERMEM=
22:55:22  ++ CONTROLLERMEM=
22:55:22  ++ '[' '' = calcium ']'
22:55:22  ++ CLUSTER_SYSTEM=pekko
22:55:22  ++ export AKKACONF=/tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/pekko.conf
22:55:22  ++ AKKACONF=/tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/pekko.conf
22:55:22  ++ export MODULESCONF=/tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/modules.conf
22:55:22  ++ MODULESCONF=/tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/modules.conf
22:55:22  ++ export MODULESHARDSCONF=/tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/module-shards.conf
22:55:22  ++ MODULESHARDSCONF=/tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/module-shards.conf
22:55:22  ++ print_common_env
22:55:22  ++ cat
22:55:22  common-functions environment:
22:55:22  MAVENCONF: /tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
22:55:22  ACTUALFEATURES: 
22:55:22  FEATURESCONF: /tmp/karaf-0.21.3-SNAPSHOT/etc/org.apache.karaf.features.cfg
22:55:22  CUSTOMPROP: /tmp/karaf-0.21.3-SNAPSHOT/etc/custom.properties
22:55:22  LOGCONF: /tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
22:55:22  MEMCONF: /tmp/karaf-0.21.3-SNAPSHOT/bin/setenv
22:55:22  CONTROLLERMEM: 
22:55:22  AKKACONF: /tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/pekko.conf
22:55:22  MODULESCONF: /tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/modules.conf
22:55:22  MODULESHARDSCONF: /tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/module-shards.conf
22:55:22  SUITES: 
22:55:22  
22:55:22  ++ SSH='ssh -t -t'
22:55:22  ++ extra_services_cntl='     dnsmasq.service     httpd.service     libvirtd.service     openvswitch.service     ovs-vswitchd.service     ovsdb-server.service     rabbitmq-server.service '
22:55:22  ++ extra_services_cmp='     libvirtd.service     openvswitch.service     ovs-vswitchd.service     ovsdb-server.service '
22:55:22  Changing to /tmp
22:55:22  Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.3-SNAPSHOT/karaf-0.21.3-20250713.183051-1.zip
22:55:22  + echo 'Changing to /tmp'
22:55:22  + cd /tmp
22:55:22  + echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.3-SNAPSHOT/karaf-0.21.3-20250713.183051-1.zip'
22:55:22  + wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.3-SNAPSHOT/karaf-0.21.3-20250713.183051-1.zip
22:55:22  --2025-07-20 22:55:22--  https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.3-SNAPSHOT/karaf-0.21.3-20250713.183051-1.zip
22:55:22  Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6
22:55:22  Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected.
22:55:22  HTTP request sent, awaiting response... 200 OK
22:55:22  Length: 234634745 (224M) [application/zip]
22:55:22  Saving to: ‘karaf-0.21.3-20250713.183051-1.zip’
22:55:22  
22:55:22       0K ........ ........ ........ ........ ........ ........  1% 77.3M 3s
22:55:22    3072K ........ ........ ........ ........ ........ ........  2%  130M 2s
22:55:22    6144K ........ ........ ........ ........ ........ ........  4%  172M 2s
22:55:22    9216K ........ ........ ........ ........ ........ ........  5%  139M 2s
22:55:22   12288K ........ ........ ........ ........ ........ ........  6%  119M 2s
22:55:22   15360K ........ ........ ........ ........ ........ ........  8%  134M 2s
22:55:22   18432K ........ ........ ........ ........ ........ ........  9%  164M 2s
22:55:22   21504K ........ ........ ........ ........ ........ ........ 10%  171M 2s
22:55:22   24576K ........ ........ ........ ........ ........ ........ 12%  196M 1s
22:55:22   27648K ........ ........ ........ ........ ........ ........ 13%  223M 1s
22:55:22   30720K ........ ........ ........ ........ ........ ........ 14%  225M 1s
22:55:22   33792K ........ ........ ........ ........ ........ ........ 16%  225M 1s
22:55:22   36864K ........ ........ ........ ........ ........ ........ 17%  243M 1s
22:55:22   39936K ........ ........ ........ ........ ........ ........ 18%  248M 1s
22:55:22   43008K ........ ........ ........ ........ ........ ........ 20%  290M 1s
22:55:22   46080K ........ ........ ........ ........ ........ ........ 21%  162M 1s
22:55:22   49152K ........ ........ ........ ........ ........ ........ 22%  217M 1s
22:55:22   52224K ........ ........ ........ ........ ........ ........ 24%  256M 1s
22:55:22   55296K ........ ........ ........ ........ ........ ........ 25%  243M 1s
22:55:22   58368K ........ ........ ........ ........ ........ ........ 26%  238M 1s
22:55:22   61440K ........ ........ ........ ........ ........ ........ 28%  261M 1s
22:55:22   64512K ........ ........ ........ ........ ........ ........ 29%  241M 1s
22:55:22   67584K ........ ........ ........ ........ ........ ........ 30%  295M 1s
22:55:22   70656K ........ ........ ........ ........ ........ ........ 32%  276M 1s
22:55:22   73728K ........ ........ ........ ........ ........ ........ 33%  305M 1s
22:55:22   76800K ........ ........ ........ ........ ........ ........ 34%  309M 1s
22:55:22   79872K ........ ........ ........ ........ ........ ........ 36%  272M 1s
22:55:22   82944K ........ ........ ........ ........ ........ ........ 37%  307M 1s
22:55:22   86016K ........ ........ ........ ........ ........ ........ 38%  303M 1s
22:55:22   89088K ........ ........ ........ ........ ........ ........ 40%  262M 1s
22:55:22   92160K ........ ........ ........ ........ ........ ........ 41%  267M 1s
22:55:23   95232K ........ ........ ........ ........ ........ ........ 42%  314M 1s
22:55:23   98304K ........ ........ ........ ........ ........ ........ 44%  296M 1s
22:55:23  101376K ........ ........ ........ ........ ........ ........ 45%  332M 1s
22:55:23  104448K ........ ........ ........ ........ ........ ........ 46%  254M 1s
22:55:23  107520K ........ ........ ........ ........ ........ ........ 48%  265M 1s
22:55:23  110592K ........ ........ ........ ........ ........ ........ 49%  275M 1s
22:55:23  113664K ........ ........ ........ ........ ........ ........ 50%  296M 1s
22:55:23  116736K ........ ........ ........ ........ ........ ........ 52%  173M 1s
22:55:23  119808K ........ ........ ........ ........ ........ ........ 53%  275M 0s
22:55:23  122880K ........ ........ ........ ........ ........ ........ 54%  297M 0s
22:55:23  125952K ........ ........ ........ ........ ........ ........ 56%  289M 0s
22:55:23  129024K ........ ........ ........ ........ ........ ........ 57%  298M 0s
22:55:23  132096K ........ ........ ........ ........ ........ ........ 58%  301M 0s
22:55:23  135168K ........ ........ ........ ........ ........ ........ 60%  321M 0s
22:55:23  138240K ........ ........ ........ ........ ........ ........ 61%  232M 0s
22:55:23  141312K ........ ........ ........ ........ ........ ........ 63%  423M 0s
22:55:23  144384K ........ ........ ........ ........ ........ ........ 64%  318M 0s
22:55:23  147456K ........ ........ ........ ........ ........ ........ 65%  314M 0s
22:55:23  150528K ........ ........ ........ ........ ........ ........ 67%  307M 0s
22:55:23  153600K ........ ........ ........ ........ ........ ........ 68%  250M 0s
22:55:23  156672K ........ ........ ........ ........ ........ ........ 69%  285M 0s
22:55:23  159744K ........ ........ ........ ........ ........ ........ 71%  206M 0s
22:55:23  162816K ........ ........ ........ ........ ........ ........ 72%  278M 0s
22:55:23  165888K ........ ........ ........ ........ ........ ........ 73%  276M 0s
22:55:23  168960K ........ ........ ........ ........ ........ ........ 75%  339M 0s
22:55:23  172032K ........ ........ ........ ........ ........ ........ 76%  326M 0s
22:55:23  175104K ........ ........ ........ ........ ........ ........ 77%  238M 0s
22:55:23  178176K ........ ........ ........ ........ ........ ........ 79%  435M 0s
22:55:23  181248K ........ ........ ........ ........ ........ ........ 80%  333M 0s
22:55:23  184320K ........ ........ ........ ........ ........ ........ 81%  319M 0s
22:55:23  187392K ........ ........ ........ ........ ........ ........ 83%  323M 0s
22:55:23  190464K ........ ........ ........ ........ ........ ........ 84%  318M 0s
22:55:23  193536K ........ ........ ........ ........ ........ ........ 85%  321M 0s
22:55:23  196608K ........ ........ ........ ........ ........ ........ 87%  317M 0s
22:55:23  199680K ........ ........ ........ ........ ........ ........ 88%  233M 0s
22:55:23  202752K ........ ........ ........ ........ ........ ........ 89%  382M 0s
22:55:23  205824K ........ ........ ........ ........ ........ ........ 91%  302M 0s
22:55:23  208896K ........ ........ ........ ........ ........ ........ 92%  266M 0s
22:55:23  211968K ........ ........ ........ ........ ........ ........ 93%  442M 0s
22:55:23  215040K ........ ........ ........ ........ ........ ........ 95%  331M 0s
22:55:23  218112K ........ ........ ........ ........ ........ ........ 96%  247M 0s
22:55:23  221184K ........ ........ ........ ........ ........ ........ 97%  241M 0s
22:55:23  224256K ........ ........ ........ ........ ........ ........ 99%  285M 0s
22:55:23  227328K ........ ........ ........ ....                      100%  292M=0.9s
22:55:23  
22:55:23  2025-07-20 22:55:23 (245 MB/s) - ‘karaf-0.21.3-20250713.183051-1.zip’ saved [234634745/234634745]
22:55:23  
22:55:23  Extracting the new controller...
22:55:23  + echo 'Extracting the new controller...'
22:55:23  + unzip -q karaf-0.21.3-20250713.183051-1.zip
22:55:25  Adding external repositories...
22:55:25  + echo 'Adding external repositories...'
22:55:25  + sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
22:55:25  + cat /tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
22:55:25  ################################################################################
22:55:25  #
22:55:25  #    Licensed to the Apache Software Foundation (ASF) under one or more
22:55:25  #    contributor license agreements.  See the NOTICE file distributed with
22:55:25  #    this work for additional information regarding copyright ownership.
22:55:25  #    The ASF licenses this file to You under the Apache License, Version 2.0
22:55:25  #    (the "License"); you may not use this file except in compliance with
22:55:25  #    the License.  You may obtain a copy of the License at
22:55:25  #
22:55:25  #       http://www.apache.org/licenses/LICENSE-2.0
22:55:25  #
22:55:25  #    Unless required by applicable law or agreed to in writing, software
22:55:25  #    distributed under the License is distributed on an "AS IS" BASIS,
22:55:25  #    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
22:55:25  #    See the License for the specific language governing permissions and
22:55:25  #    limitations under the License.
22:55:25  #
22:55:25  ################################################################################
22:55:25  
22:55:25  #
22:55:25  # If set to true, the following property will not allow any certificate to be used
22:55:25  # when accessing Maven repositories through SSL
22:55:25  #
22:55:25  #org.ops4j.pax.url.mvn.certificateCheck=
22:55:25  
22:55:25  #
22:55:25  # Path to the local Maven settings file.
22:55:25  # The repositories defined in this file will be automatically added to the list
22:55:25  # of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property
22:55:25  # below is not set.
22:55:25  # The following locations are checked for the existence of the settings.xml file
22:55:25  #   * 1. looks for the specified url
22:55:25  #   * 2. if not found looks for ${user.home}/.m2/settings.xml
22:55:25  #   * 3. if not found looks for ${maven.home}/conf/settings.xml
22:55:25  #   * 4. if not found looks for ${M2_HOME}/conf/settings.xml
22:55:25  #
22:55:25  #org.ops4j.pax.url.mvn.settings=
22:55:25  
22:55:25  #
22:55:25  # Path to the local Maven repository which is used to avoid downloading
22:55:25  # artifacts when they already exist locally.
22:55:25  # The value of this property will be extracted from the settings.xml file
22:55:25  # above, or defaulted to:
22:55:25  #     System.getProperty( "user.home" ) + "/.m2/repository"
22:55:25  #
22:55:25  org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository}
22:55:25  
22:55:25  #
22:55:25  # Default this to false. It's just weird to use undocumented repos
22:55:25  #
22:55:25  org.ops4j.pax.url.mvn.useFallbackRepositories=false
22:55:25  
22:55:25  #
22:55:25  # Uncomment if you don't wanna use the proxy settings
22:55:25  # from the Maven conf/settings.xml file
22:55:25  #
22:55:25  # org.ops4j.pax.url.mvn.proxySupport=false
22:55:25  
22:55:25  #
22:55:25  # Comma separated list of repositories scanned when resolving an artifact.
22:55:25  # Those repositories will be checked before iterating through the
22:55:25  #    below list of repositories and even before the local repository
22:55:25  # A repository url can be appended with zero or more of the following flags:
22:55:25  #    @snapshots  : the repository contains snaphots
22:55:25  #    @noreleases : the repository does not contain any released artifacts
22:55:25  #
22:55:25  # The following property value will add the system folder as a repo.
22:55:25  #
22:55:25  org.ops4j.pax.url.mvn.defaultRepositories=\
22:55:25      file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\
22:55:25      file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\
22:55:25      file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots
22:55:25  
22:55:25  # Use the default local repo (e.g.~/.m2/repository) as a "remote" repo
22:55:25  #org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false
22:55:25  
22:55:25  #
22:55:25  # Comma separated list of repositories scanned when resolving an artifact.
22:55:25  # The default list includes the following repositories:
22:55:25  #    http://repo1.maven.org/maven2@id=central
22:55:25  #    http://repository.springsource.com/maven/bundles/release@id=spring.ebr
22:55:25  #    http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external
22:55:25  #    http://zodiac.springsource.com/maven/bundles/release@id=gemini
22:55:25  #    http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases
22:55:25  #    https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases
22:55:25  #    https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
22:55:25  # To add repositories to the default ones, prepend '+' to the list of repositories
22:55:25  # to add.
22:55:25  # A repository url can be appended with zero or more of the following flags:
22:55:25  #    @snapshots  : the repository contains snapshots
22:55:25  #    @noreleases : the repository does not contain any released artifacts
22:55:25  #    @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended
22:55:25  #
22:55:25  org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
22:55:25  
22:55:25  ### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.+ [[ True == \T\r\u\e ]]
22:55:25  + echo 'Configuring the startup features...'
22:55:25  Configuring the startup features...
22:55:25  + sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.21.3-SNAPSHOT/etc/org.apache.karaf.features.cfg
22:55:25  + FEATURE_TEST_STRING=features-test
22:55:25  + FEATURE_TEST_VERSION=0.21.3-SNAPSHOT
22:55:25  + KARAF_VERSION=karaf4
22:55:25  + [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]]
22:55:25  + sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.21.3-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.21.3-SNAPSHOT/etc/org.apache.karaf.features.cfg
22:55:25  + [[ ! -z '' ]]
22:55:25  + cat /tmp/karaf-0.21.3-SNAPSHOT/etc/org.apache.karaf.features.cfg
22:55:25  ################################################################################
22:55:25  #
22:55:25  #    Licensed to the Apache Software Foundation (ASF) under one or more
22:55:25  #    contributor license agreements.  See the NOTICE file distributed with
22:55:25  #    this work for additional information regarding copyright ownership.
22:55:25  #    The ASF licenses this file to You under the Apache License, Version 2.0
22:55:25  #    (the "License"); you may not use this file except in compliance with
22:55:25  #    the License.  You may obtain a copy of the License at
22:55:25  #
22:55:25  #       http://www.apache.org/licenses/LICENSE-2.0
22:55:25  #
22:55:25  #    Unless required by applicable law or agreed to in writing, software
22:55:25  #    distributed under the License is distributed on an "AS IS" BASIS,
22:55:25  #    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
22:55:25  #    See the License for the specific language governing permissions and
22:55:25  #    limitations under the License.
22:55:25  #
22:55:25  ################################################################################
22:55:25  
22:55:25  #
22:55:25  # Comma separated list of features repositories to register by default
22:55:25  #
22:55:25  featuresRepositories = mvn:org.opendaylight.integration/features-test/0.21.3-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/85e4e99f-0858-420b-b76b-8b97b10100c8.xml
22:55:25  
22:55:25  #
22:55:25  # Comma separated list of features to install at startup
22:55:25  #
22:55:25  featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, 78fe7843-03b4-4322-9171-bfb7ca7953cb
22:55:25  
22:55:25  #
22:55:25  # Resource repositories (OBR) that the features resolver can use
22:55:25  # to resolve requirements/capabilities
22:55:25  #
22:55:25  # The format of the resourceRepositories is 
22:55:25  # resourceRepositories=[xml:url|json:url],...
22:55:25  # for Instance:
22:55:25  #
22:55:25  #resourceRepositories=xml:http://host/path/to/index.xml
22:55:25  # or
22:55:25  #resourceRepositories=json:http://host/path/to/index.json
22:55:25  #
22:55:25  
22:55:25  #
22:55:25  # Defines if the boot features are started in asynchronous mode (in a dedicated thread)
22:55:25  #
22:55:25  featuresBootAsynchronous=false
22:55:25  
22:55:25  #
22:55:25  # Service requirements enforcement
22:55:25  #
22:55:25  # By default, the feature resolver checks the service requirements/capabilities of
22:55:25  # bundles for new features (xml schema >= 1.3.0) in order to automatically installs
22:55:25  # the required bundles.
22:55:25  # The following flag can have those values:
22:55:25  #   - disable: service requirements are completely ignored
22:55:25  #   - default: service requirements are ignored for old features
22:55:25  #   - enforce: service requirements are always verified
22:55:25  #
22:55:25  #serviceRequirements=default
22:55:25  
22:55:25  #
22:55:25  # Store cfg file for config element in feature
22:55:25  #
22:55:25  #configCfgStore=true
22:55:25  
22:55:25  #
22:55:25  # Define if the feature service automatically refresh bundles
22:55:25  #
22:55:25  autoRefresh=true
22:55:25  
22:55:25  #
22:55:25  # Configuration of features processing mechanism (overrides, blacklisting, modification of features)
22:55:25  # XML file defines instructions related to features processing
22:55:25  # versions.properties may declare properties to resolve placeholders in XML file
22:55:25  # both files are relative to ${karaf.etc}
22:55:25  #
22:55:25  #featureProcessing=org.apache.karaf.features.xml
22:55:25  #featureProcessingVersions=versions.properties
22:55:25  + configure_karaf_log karaf4 ''
22:55:25  + local -r karaf_version=karaf4
22:55:25  + local -r controllerdebugmap=
22:55:25  + local logapi=log4j
22:55:25  + grep log4j2 /tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
22:55:25  log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
22:55:25  log4j2.rootLogger.level = INFO
22:55:25  #log4j2.rootLogger.type = asyncRoot
22:55:25  #log4j2.rootLogger.includeLocation = false
22:55:25  log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
22:55:25  log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
22:55:25  log4j2.rootLogger.appenderRef.Console.ref = Console
22:55:25  log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
22:55:25  log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
22:55:25  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
22:55:25  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
22:55:25  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
22:55:25  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
22:55:25  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
22:55:25  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
22:55:25  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
22:55:25  log4j2.logger.spifly.name = org.apache.aries.spifly
22:55:25  log4j2.logger.spifly.level = WARN
22:55:25  log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
22:55:25  log4j2.logger.audit.level = INFO
22:55:25  log4j2.logger.audit.additivity = false
22:55:25  log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
22:55:25  # Console appender not used by default (see log4j2.rootLogger.appenderRefs)
22:55:25  log4j2.appender.console.type = Console
22:55:25  log4j2.appender.console.name = Console
22:55:25  log4j2.appender.console.layout.type = PatternLayout
22:55:25  log4j2.appender.console.layout.pattern = ${log4j2.pattern}
22:55:25  log4j2.appender.rolling.type = RollingRandomAccessFile
22:55:25  log4j2.appender.rolling.name = RollingFile
22:55:25  log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
22:55:25  log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
22:55:25  #log4j2.appender.rolling.immediateFlush = false
22:55:25  log4j2.appender.rolling.append = true
22:55:25  log4j2.appender.rolling.layout.type = PatternLayout
22:55:25  log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
22:55:25  log4j2.appender.rolling.policies.type = Policies
22:55:25  log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
22:55:25  log4j2.appender.rolling.policies.size.size = 64MB
22:55:25  log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
22:55:25  log4j2.appender.rolling.strategy.max = 7
22:55:25  log4j2.appender.audit.type = RollingRandomAccessFile
22:55:25  log4j2.appender.audit.name = AuditRollingFile
22:55:25  log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
22:55:25  log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
22:55:25  log4j2.appender.audit.append = true
22:55:25  log4j2.appender.audit.layout.type = PatternLayout
22:55:25  log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
22:55:25  log4j2.appender.audit.policies.type = Policies
22:55:25  log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
22:55:25  log4j2.appender.audit.policies.size.size = 8MB
22:55:25  log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
22:55:25  log4j2.appender.audit.strategy.max = 7
22:55:25  log4j2.appender.osgi.type = PaxOsgi
22:55:25  log4j2.appender.osgi.name = PaxOsgi
22:55:25  log4j2.appender.osgi.filter = *
22:55:25  #log4j2.logger.aether.name = shaded.org.eclipse.aether
22:55:25  #log4j2.logger.aether.level = TRACE
22:55:25  #log4j2.logger.http-headers.name = shaded.org.apache.http.headers
22:55:25  #log4j2.logger.http-headers.level = DEBUG
22:55:25  #log4j2.logger.maven.name = org.ops4j.pax.url.mvn
22:55:25  #log4j2.logger.maven.level = TRACE
22:55:25  + logapi=log4j2
22:55:25  + echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2'
22:55:25  Configuring the karaf log... karaf_version: karaf4, logapi: log4j2
22:55:25  + '[' log4j2 == log4j2 ']'
22:55:25  + sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
22:55:25  + orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver
22:55:25  + orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver
22:55:25  + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN'
22:55:25  + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN'
22:55:25  + unset IFS
22:55:25  controllerdebugmap: 
22:55:25  + echo 'controllerdebugmap: '
22:55:25  + '[' -n '' ']'
22:55:25  cat /tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
22:55:25  + echo 'cat /tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg'
22:55:25  + cat /tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
22:55:25  ################################################################################
22:55:25  #
22:55:25  #    Licensed to the Apache Software Foundation (ASF) under one or more
22:55:25  #    contributor license agreements.  See the NOTICE file distributed with
22:55:25  #    this work for additional information regarding copyright ownership.
22:55:25  #    The ASF licenses this file to You under the Apache License, Version 2.0
22:55:25  #    (the "License"); you may not use this file except in compliance with
22:55:25  #    the License.  You may obtain a copy of the License at
22:55:25  #
22:55:25  #       http://www.apache.org/licenses/LICENSE-2.0
22:55:25  #
22:55:25  #    Unless required by applicable law or agreed to in writing, software
22:55:25  #    distributed under the License is distributed on an "AS IS" BASIS,
22:55:25  #    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
22:55:25  #    See the License for the specific language governing permissions and
22:55:25  #    limitations under the License.
22:55:25  #
22:55:25  ################################################################################
22:55:25  
22:55:25  # Common pattern layout for appenders
22:55:25  log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
22:55:25  
22:55:25  # Root logger
22:55:25  log4j2.rootLogger.level = INFO
22:55:25  # uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library
22:55:25  #log4j2.rootLogger.type = asyncRoot
22:55:25  #log4j2.rootLogger.includeLocation = false
22:55:25  log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
22:55:25  log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
22:55:25  log4j2.rootLogger.appenderRef.Console.ref = Console
22:55:25  log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
22:55:25  log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
22:55:25  
22:55:25  # Filters for logs marked by org.opendaylight.odlparent.Markers
22:55:25  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
22:55:25  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
22:55:25  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
22:55:25  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
22:55:25  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
22:55:25  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
22:55:25  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
22:55:25  
22:55:25  # Loggers configuration
22:55:25  
22:55:25  # Spifly logger
22:55:25  log4j2.logger.spifly.name = org.apache.aries.spifly
22:55:25  log4j2.logger.spifly.level = WARN
22:55:25  
22:55:25  # Security audit logger
22:55:25  log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
22:55:25  log4j2.logger.audit.level = INFO
22:55:25  log4j2.logger.audit.additivity = false
22:55:25  log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
22:55:25  
22:55:25  # Appenders configuration
22:55:25  
22:55:25  # Console appender not used by default (see log4j2.rootLogger.appenderRefs)
22:55:25  log4j2.appender.console.type = Console
22:55:25  log4j2.appender.console.name = Console
22:55:25  log4j2.appender.console.layout.type = PatternLayout
22:55:25  log4j2.appender.console.layout.pattern = ${log4j2.pattern}
22:55:25  
22:55:25  # Rolling file appender
22:55:25  log4j2.appender.rolling.type = RollingRandomAccessFile
22:55:25  log4j2.appender.rolling.name = RollingFile
22:55:25  log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
22:55:25  log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
22:55:25  # uncomment to not force a disk flush
22:55:25  #log4j2.appender.rolling.immediateFlush = false
22:55:25  log4j2.appender.rolling.append = true
22:55:25  log4j2.appender.rolling.layout.type = PatternLayout
22:55:25  log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
22:55:25  log4j2.appender.rolling.policies.type = Policies
22:55:25  log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
22:55:25  log4j2.appender.rolling.policies.size.size = 1GB
22:55:25  log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
22:55:25  log4j2.appender.rolling.strategy.max = 7
22:55:25  
22:55:25  # Audit file appender
22:55:25  log4j2.appender.audit.type = RollingRandomAccessFile
22:55:25  log4j2.appender.audit.name = AuditRollingFile
22:55:25  log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
22:55:25  log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
22:55:25  log4j2.appender.audit.append = true
22:55:25  log4j2.appender.audit.layout.type = PatternLayout
22:55:25  log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
22:55:25  log4j2.appender.audit.policies.type = Policies
22:55:25  log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
22:55:25  log4j2.appender.audit.policies.size.size = 8MB
22:55:25  log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
22:55:25  log4j2.appender.audit.strategy.max = 7
22:55:25  
22:55:25  # OSGi appender
22:55:25  log4j2.appender.osgi.type = PaxOsgi
22:55:25  log4j2.appender.osgi.name = PaxOsgi
22:55:25  log4j2.appender.osgi.filter = *
22:55:25  
22:55:25  # help with identification of maven-related problems with pax-url-aether
22:55:25  #log4j2.logger.aether.name = shaded.org.eclipse.aether
22:55:25  #log4j2.logger.aether.level = TRACE
22:55:25  #log4j2.logger.http-headers.name = shaded.org.apache.http.headers
22:55:25  #log4j2.logger.http-headers.level = DEBUG
22:55:25  #log4j2.logger.maven.name = org.ops4j.pax.url.mvn
22:55:25  #log4j2.logger.maven.level = TRACE
22:55:25  log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN
22:55:25  log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN
22:55:25  + set_java_vars /usr/lib/jvm/java-21-openjdk-amd64 3072m /tmp/karaf-0.21.3-SNAPSHOT/bin/setenv
22:55:25  Configure
22:55:25  + local -r java_home=/usr/lib/jvm/java-21-openjdk-amd64
22:55:25  + local -r controllermem=3072m
22:55:25  + local -r memconf=/tmp/karaf-0.21.3-SNAPSHOT/bin/setenv
22:55:25  + echo Configure
22:55:25      java home: /usr/lib/jvm/java-21-openjdk-amd64
22:55:25      max memory: 3072m
22:55:25      memconf: /tmp/karaf-0.21.3-SNAPSHOT/bin/setenv
22:55:25  + echo '    java home: /usr/lib/jvm/java-21-openjdk-amd64'
22:55:25  + echo '    max memory: 3072m'
22:55:25  + echo '    memconf: /tmp/karaf-0.21.3-SNAPSHOT/bin/setenv'
22:55:25  + sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64}%g' /tmp/karaf-0.21.3-SNAPSHOT/bin/setenv
22:55:25  + sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.21.3-SNAPSHOT/bin/setenv
22:55:25  cat /tmp/karaf-0.21.3-SNAPSHOT/bin/setenv
22:55:25  + echo 'cat /tmp/karaf-0.21.3-SNAPSHOT/bin/setenv'
22:55:25  + cat /tmp/karaf-0.21.3-SNAPSHOT/bin/setenv
22:55:25  #!/bin/sh
22:55:25  #
22:55:25  #    Licensed to the Apache Software Foundation (ASF) under one or more
22:55:25  #    contributor license agreements.  See the NOTICE file distributed with
22:55:25  #    this work for additional information regarding copyright ownership.
22:55:25  #    The ASF licenses this file to You under the Apache License, Version 2.0
22:55:25  #    (the "License"); you may not use this file except in compliance with
22:55:25  #    the License.  You may obtain a copy of the License at
22:55:25  #
22:55:25  #       http://www.apache.org/licenses/LICENSE-2.0
22:55:25  #
22:55:25  #    Unless required by applicable law or agreed to in writing, software
22:55:25  #    distributed under the License is distributed on an "AS IS" BASIS,
22:55:25  #    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
22:55:25  #    See the License for the specific language governing permissions and
22:55:25  #    limitations under the License.
22:55:25  #
22:55:25  
22:55:25  #
22:55:25  # handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf
22:55:25  # script: client, instance, shell, start, status, stop, karaf
22:55:25  #
22:55:25  # if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then
22:55:25  #   Actions go here...
22:55:25  # fi
22:55:25  
22:55:25  #
22:55:25  # general settings which should be applied for all scripts go here; please keep
22:55:25  # in mind that it is possible that scripts might be executed more than once, e.g.
22:55:25  # in example of the start script where the start script is executed first and the
22:55:25  # karaf script afterwards.
22:55:25  #
22:55:25  
22:55:25  #
22:55:25  # The following section shows the possible configuration options for the default 
22:55:25  # karaf scripts
22:55:25  #
22:55:25  export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64} # Location of Java installation
22:55:25  # export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration
22:55:25  # export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options
22:55:25  # export EXTRA_JAVA_OPTS # Additional JVM options
22:55:25  # export KARAF_HOME # Karaf home folder
22:55:25  # export KARAF_DATA # Karaf data folder
22:55:25  # export KARAF_BASE # Karaf base folder
22:55:25  # export KARAF_ETC  # Karaf etc  folder
22:55:25  # export KARAF_LOG  # Karaf log  folder
22:55:25  # export KARAF_SYSTEM_OPTS # First citizen Karaf options
22:55:25  # export KARAF_OPTS # Additional available Karaf options
22:55:25  # export KARAF_DEBUG # Enable debug mode
22:55:25  # export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start
22:55:25  # export KARAF_NOROOT # Prevent execution as root if set to true
22:55:25  Set Java version
22:55:25  + echo 'Set Java version'
22:55:25  + sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-21-openjdk-amd64/bin/java 1
22:55:25  sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper
22:55:25  sudo: a password is required
22:55:25  + sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-21-openjdk-amd64/bin/java
22:55:25  sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper
22:55:25  sudo: a password is required
22:55:25  JDK default version ...
22:55:25  + echo 'JDK default version ...'
22:55:25  + java -version
22:55:25  openjdk version "21.0.5" 2024-10-15
22:55:25  OpenJDK Runtime Environment (build 21.0.5+11-Ubuntu-1ubuntu122.04)
22:55:25  OpenJDK 64-Bit Server VM (build 21.0.5+11-Ubuntu-1ubuntu122.04, mixed mode, sharing)
22:55:25  Set JAVA_HOME
22:55:25  + echo 'Set JAVA_HOME'
22:55:25  + export JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64
22:55:25  + JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64
22:55:25  Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java
22:55:25  Listing all open ports on controller system...
22:55:25  Custom shard config exists!!!
22:55:25  Copying the shard config...
22:55:25  ++ readlink -e /usr/lib/jvm/java-21-openjdk-amd64/bin/java
22:55:25  + JAVA_RESOLVED=/usr/lib/jvm/java-21-openjdk-amd64/bin/java
22:55:25  + echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java'
22:55:25  + echo 'Listing all open ports on controller system...'
22:55:25  + netstat -pnatu
22:55:25  /tmp/configuration-script.sh: line 40: netstat: command not found
22:55:25  + '[' -f /tmp/custom_shard_config.txt ']'
22:55:25  + echo 'Custom shard config exists!!!'
22:55:25  + echo 'Copying the shard config...'
22:55:25  + cp /tmp/custom_shard_config.txt /tmp/karaf-0.21.3-SNAPSHOT/bin/
22:55:25  Configuring cluster
22:55:25  + echo 'Configuring cluster'
22:55:25  + /tmp/karaf-0.21.3-SNAPSHOT/bin/configure_cluster.sh 2 10.30.170.28 10.30.171.142 10.30.171.124
22:55:25  ################################################
22:55:25  ##             Configure Cluster              ##
22:55:25  ################################################
22:55:25   NOTE: Cluster configuration files not found. Copying from
22:55:25   /tmp/karaf-0.21.3-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/10.0.9
22:55:25  Configuring unique name in akka.conf
22:55:25  Configuring hostname in akka.conf
22:55:25  Configuring data and rpc seed nodes in akka.conf
22:55:25  modules = [
22:55:25  	
22:55:25  	{
22:55:25  		name = "inventory"
22:55:25  		namespace = "urn:opendaylight:inventory"
22:55:25  		shard-strategy = "module"
22:55:25  	},
22:55:25  	{
22:55:25  		name = "topology"
22:55:25  		namespace = "urn:TBD:params:xml:ns:yang:network-topology"
22:55:25  		shard-strategy = "module"
22:55:25  	},
22:55:25  	{
22:55:25  		name = "toaster"
22:55:25  		namespace = "http://netconfcentral.org/ns/toaster"
22:55:25  		shard-strategy = "module"
22:55:25  	},
22:55:25  	{
22:55:25  		name = "car"
22:55:25  		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
22:55:25  		shard-strategy = "module"
22:55:25  	},
22:55:25  	{
22:55:25  		name = "people"
22:55:25  		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
22:55:25  		shard-strategy = "module"
22:55:25  	},
22:55:25  	{
22:55:25  		name = "car-people"
22:55:25  		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
22:55:25  		shard-strategy = "module"
22:55:25  	}
22:55:25  ]
22:55:25  Configuring replication type in module-shards.conf
22:55:25  ################################################
22:55:25  ##   NOTE: Manually restart controller to     ##
22:55:25  ##         apply configuration.               ##
22:55:25  ################################################
22:55:25  Dump pekko.conf
22:55:25  + echo 'Dump pekko.conf'
22:55:25  + cat /tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/pekko.conf
22:55:25  cat: /tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/pekko.conf: No such file or directory
22:55:25  Dump modules.conf
22:55:25  + echo 'Dump modules.conf'
22:55:25  + cat /tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/modules.conf
22:55:25  modules = [
22:55:25  	
22:55:25  	{
22:55:25  		name = "inventory"
22:55:25  		namespace = "urn:opendaylight:inventory"
22:55:25  		shard-strategy = "module"
22:55:25  	},
22:55:25  	{
22:55:25  		name = "topology"
22:55:25  		namespace = "urn:TBD:params:xml:ns:yang:network-topology"
22:55:25  		shard-strategy = "module"
22:55:25  	},
22:55:25  	{
22:55:25  		name = "toaster"
22:55:25  		namespace = "http://netconfcentral.org/ns/toaster"
22:55:25  		shard-strategy = "module"
22:55:25  	},
22:55:25  	{
22:55:25  		name = "car"
22:55:25  		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
22:55:25  		shard-strategy = "module"
22:55:25  	},
22:55:25  	{
22:55:25  		name = "people"
22:55:25  		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
22:55:25  		shard-strategy = "module"
22:55:25  	},
22:55:25  	{
22:55:25  		name = "car-people"
22:55:25  		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
22:55:25  		shard-strategy = "module"
22:55:25  	}
22:55:25  ]
22:55:25  Dump module-shards.conf
22:55:25  + echo 'Dump module-shards.conf'
22:55:25  + cat /tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/module-shards.conf
22:55:25  module-shards = [
22:55:25  	{
22:55:25  		name = "default"
22:55:25  		shards = [
22:55:25  			{
22:55:25  				name = "default"
22:55:25  				replicas = ["member-1",
22:55:25  				"member-2",
22:55:25  				"member-3"]
22:55:25  			}
22:55:25  		]
22:55:25  	},
22:55:25  	{
22:55:25  		name = "inventory"
22:55:25  		shards = [
22:55:25  			{
22:55:25  				name="inventory"
22:55:25  				replicas = ["member-1",
22:55:25  				"member-2",
22:55:25  				"member-3"]
22:55:25  			}
22:55:25  		]
22:55:25  	},
22:55:25  	{
22:55:25  		name = "topology"
22:55:25  		shards = [
22:55:25  			{
22:55:25  				name="topology"
22:55:25  				replicas = ["member-1",
22:55:25  				"member-2",
22:55:25  				"member-3"]
22:55:25  			}
22:55:25  		]
22:55:25  	},
22:55:25  	{
22:55:25  		name = "toaster"
22:55:25  		shards = [
22:55:25  			{
22:55:25  				name="toaster"
22:55:25  				replicas = ["member-1",
22:55:25  				"member-2",
22:55:25  				"member-3"]
22:55:25  			}
22:55:25  		]
22:55:25  	},
22:55:25  	{
22:55:25  		name = "car"
22:55:25  		shards = [
22:55:25  			{
22:55:25  				name="car"
22:55:25  				replicas = ["member-1",
22:55:25  				"member-2",
22:55:25  				"member-3"]
22:55:25  			}
22:55:25  		]
22:55:25  	},
22:55:25  	{
22:55:25  		name = "people"
22:55:25  		shards = [
22:55:25  			{
22:55:25  				name="people"
22:55:25  				replicas = ["member-1",
22:55:25  				"member-2",
22:55:25  				"member-3"]
22:55:25  			}
22:55:25  		]
22:55:25  	},
22:55:25  	{
22:55:25  		name = "car-people"
22:55:25  		shards = [
22:55:25  			{
22:55:25  				name="car-people"
22:55:25  				replicas = ["member-1",
22:55:25  				"member-2",
22:55:25  				"member-3"]
22:55:25  			}
22:55:25  		]
22:55:25  	}
22:55:25  ]
22:55:25  Configuring member-3 with IP address 10.30.171.124
22:55:25  Warning: Permanently added '10.30.171.124' (ECDSA) to the list of known hosts.
22:55:26  Warning: Permanently added '10.30.171.124' (ECDSA) to the list of known hosts.
22:55:26  + source /tmp/common-functions.sh karaf-0.21.3-SNAPSHOT
22:55:26  ++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]]
22:55:26  common-functions.sh is being sourced
22:55:26  ++ echo 'common-functions.sh is being sourced'
22:55:26  ++ BUNDLEFOLDER=karaf-0.21.3-SNAPSHOT
22:55:26  ++ export MAVENCONF=/tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
22:55:26  ++ MAVENCONF=/tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
22:55:26  ++ export FEATURESCONF=/tmp/karaf-0.21.3-SNAPSHOT/etc/org.apache.karaf.features.cfg
22:55:26  ++ FEATURESCONF=/tmp/karaf-0.21.3-SNAPSHOT/etc/org.apache.karaf.features.cfg
22:55:26  ++ export CUSTOMPROP=/tmp/karaf-0.21.3-SNAPSHOT/etc/custom.properties
22:55:26  ++ CUSTOMPROP=/tmp/karaf-0.21.3-SNAPSHOT/etc/custom.properties
22:55:26  ++ export LOGCONF=/tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
22:55:26  ++ LOGCONF=/tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
22:55:26  ++ export MEMCONF=/tmp/karaf-0.21.3-SNAPSHOT/bin/setenv
22:55:26  ++ MEMCONF=/tmp/karaf-0.21.3-SNAPSHOT/bin/setenv
22:55:26  ++ export CONTROLLERMEM=
22:55:26  ++ CONTROLLERMEM=
22:55:26  ++ '[' '' = calcium ']'
22:55:26  ++ CLUSTER_SYSTEM=pekko
22:55:26  ++ export AKKACONF=/tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/pekko.conf
22:55:26  ++ AKKACONF=/tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/pekko.conf
22:55:26  ++ export MODULESCONF=/tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/modules.conf
22:55:26  ++ MODULESCONF=/tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/modules.conf
22:55:26  ++ export MODULESHARDSCONF=/tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/module-shards.conf
22:55:26  ++ MODULESHARDSCONF=/tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/module-shards.conf
22:55:26  ++ print_common_env
22:55:26  ++ cat
22:55:26  common-functions environment:
22:55:26  MAVENCONF: /tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
22:55:26  ACTUALFEATURES: 
22:55:26  FEATURESCONF: /tmp/karaf-0.21.3-SNAPSHOT/etc/org.apache.karaf.features.cfg
22:55:26  CUSTOMPROP: /tmp/karaf-0.21.3-SNAPSHOT/etc/custom.properties
22:55:26  LOGCONF: /tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
22:55:26  MEMCONF: /tmp/karaf-0.21.3-SNAPSHOT/bin/setenv
22:55:26  CONTROLLERMEM: 
22:55:26  AKKACONF: /tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/pekko.conf
22:55:26  MODULESCONF: /tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/modules.conf
22:55:26  MODULESHARDSCONF: /tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/module-shards.conf
22:55:26  SUITES: 
22:55:26  
22:55:26  ++ SSH='ssh -t -t'
22:55:26  ++ extra_services_cntl='     dnsmasq.service     httpd.service     libvirtd.service     openvswitch.service     ovs-vswitchd.service     ovsdb-server.service     rabbitmq-server.service '
22:55:26  ++ extra_services_cmp='     libvirtd.service     openvswitch.service     ovs-vswitchd.service     ovsdb-server.service '
22:55:26  Changing to /tmp
22:55:26  Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.3-SNAPSHOT/karaf-0.21.3-20250713.183051-1.zip
22:55:26  + echo 'Changing to /tmp'
22:55:26  + cd /tmp
22:55:26  + echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.3-SNAPSHOT/karaf-0.21.3-20250713.183051-1.zip'
22:55:26  + wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.3-SNAPSHOT/karaf-0.21.3-20250713.183051-1.zip
22:55:26  --2025-07-20 22:55:26--  https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.3-SNAPSHOT/karaf-0.21.3-20250713.183051-1.zip
22:55:26  Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6
22:55:26  Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected.
22:55:26  HTTP request sent, awaiting response... 200 OK
22:55:26  Length: 234634745 (224M) [application/zip]
22:55:26  Saving to: ‘karaf-0.21.3-20250713.183051-1.zip’
22:55:26  
22:55:26       0K ........ ........ ........ ........ ........ ........  1% 49.7M 4s
22:55:26    3072K ........ ........ ........ ........ ........ ........  2% 73.3M 4s
22:55:26    6144K ........ ........ ........ ........ ........ ........  4% 76.5M 3s
22:55:26    9216K ........ ........ ........ ........ ........ ........  5%  107M 3s
22:55:26   12288K ........ ........ ........ ........ ........ ........  6%  110M 3s
22:55:26   15360K ........ ........ ........ ........ ........ ........  8%  106M 3s
22:55:26   18432K ........ ........ ........ ........ ........ ........  9%  133M 2s
22:55:26   21504K ........ ........ ........ ........ ........ ........ 10%  215M 2s
22:55:26   24576K ........ ........ ........ ........ ........ ........ 12%  234M 2s
22:55:26   27648K ........ ........ ........ ........ ........ ........ 13%  221M 2s
22:55:26   30720K ........ ........ ........ ........ ........ ........ 14%  238M 2s
22:55:26   33792K ........ ........ ........ ........ ........ ........ 16%  267M 2s
22:55:26   36864K ........ ........ ........ ........ ........ ........ 17%  184M 2s
22:55:27   39936K ........ ........ ........ ........ ........ ........ 18%  282M 1s
22:55:27   43008K ........ ........ ........ ........ ........ ........ 20%  108M 1s
22:55:27   46080K ........ ........ ........ ........ ........ ........ 21%  307M 1s
22:55:27   49152K ........ ........ ........ ........ ........ ........ 22%  285M 1s
22:55:27   52224K ........ ........ ........ ........ ........ ........ 24%  306M 1s
22:55:27   55296K ........ ........ ........ ........ ........ ........ 25%  321M 1s
22:55:27   58368K ........ ........ ........ ........ ........ ........ 26%  305M 1s
22:55:27   61440K ........ ........ ........ ........ ........ ........ 28%  317M 1s
22:55:27   64512K ........ ........ ........ ........ ........ ........ 29%  317M 1s
22:55:27   67584K ........ ........ ........ ........ ........ ........ 30%  339M 1s
22:55:27   70656K ........ ........ ........ ........ ........ ........ 32%  322M 1s
22:55:27   73728K ........ ........ ........ ........ ........ ........ 33%  315M 1s
22:55:27   76800K ........ ........ ........ ........ ........ ........ 34%  315M 1s
22:55:27   79872K ........ ........ ........ ........ ........ ........ 36%  324M 1s
22:55:27   82944K ........ ........ ........ ........ ........ ........ 37%  334M 1s
22:55:27   86016K ........ ........ ........ ........ ........ ........ 38%  334M 1s
22:55:27   89088K ........ ........ ........ ........ ........ ........ 40%  330M 1s
22:55:27   92160K ........ ........ ........ ........ ........ ........ 41%  262M 1s
22:55:27   95232K ........ ........ ........ ........ ........ ........ 42%  261M 1s
22:55:27   98304K ........ ........ ........ ........ ........ ........ 44%  245M 1s
22:55:27  101376K ........ ........ ........ ........ ........ ........ 45%  182M 1s
22:55:27  104448K ........ ........ ........ ........ ........ ........ 46%  180M 1s
22:55:27  107520K ........ ........ ........ ........ ........ ........ 48%  223M 1s
22:55:27  110592K ........ ........ ........ ........ ........ ........ 49%  174M 1s
22:55:27  113664K ........ ........ ........ ........ ........ ........ 50%  182M 1s
22:55:27  116736K ........ ........ ........ ........ ........ ........ 52%  209M 1s
22:55:27  119808K ........ ........ ........ ........ ........ ........ 53%  213M 1s
22:55:27  122880K ........ ........ ........ ........ ........ ........ 54%  215M 1s
22:55:27  125952K ........ ........ ........ ........ ........ ........ 56%  274M 1s
22:55:27  129024K ........ ........ ........ ........ ........ ........ 57%  320M 1s
22:55:27  132096K ........ ........ ........ ........ ........ ........ 58%  319M 0s
22:55:27  135168K ........ ........ ........ ........ ........ ........ 60%  315M 0s
22:55:27  138240K ........ ........ ........ ........ ........ ........ 61%  310M 0s
22:55:27  141312K ........ ........ ........ ........ ........ ........ 63%  315M 0s
22:55:27  144384K ........ ........ ........ ........ ........ ........ 64%  313M 0s
22:55:27  147456K ........ ........ ........ ........ ........ ........ 65%  321M 0s
22:55:27  150528K ........ ........ ........ ........ ........ ........ 67%  328M 0s
22:55:27  153600K ........ ........ ........ ........ ........ ........ 68%  325M 0s
22:55:27  156672K ........ ........ ........ ........ ........ ........ 69%  319M 0s
22:55:27  159744K ........ ........ ........ ........ ........ ........ 71%  328M 0s
22:55:27  162816K ........ ........ ........ ........ ........ ........ 72%  314M 0s
22:55:27  165888K ........ ........ ........ ........ ........ ........ 73%  316M 0s
22:55:27  168960K ........ ........ ........ ........ ........ ........ 75%  324M 0s
22:55:27  172032K ........ ........ ........ ........ ........ ........ 76%  325M 0s
22:55:27  175104K ........ ........ ........ ........ ........ ........ 77%  310M 0s
22:55:27  178176K ........ ........ ........ ........ ........ ........ 79%  321M 0s
22:55:27  181248K ........ ........ ........ ........ ........ ........ 80%  327M 0s
22:55:27  184320K ........ ........ ........ ........ ........ ........ 81%  319M 0s
22:55:27  187392K ........ ........ ........ ........ ........ ........ 83%  325M 0s
22:55:27  190464K ........ ........ ........ ........ ........ ........ 84%  318M 0s
22:55:27  193536K ........ ........ ........ ........ ........ ........ 85%  314M 0s
22:55:27  196608K ........ ........ ........ ........ ........ ........ 87%  307M 0s
22:55:27  199680K ........ ........ ........ ........ ........ ........ 88%  313M 0s
22:55:27  202752K ........ ........ ........ ........ ........ ........ 89%  327M 0s
22:55:27  205824K ........ ........ ........ ........ ........ ........ 91%  315M 0s
22:55:27  208896K ........ ........ ........ ........ ........ ........ 92%  317M 0s
22:55:27  211968K ........ ........ ........ ........ ........ ........ 93%  321M 0s
22:55:27  215040K ........ ........ ........ ........ ........ ........ 95%  313M 0s
22:55:27  218112K ........ ........ ........ ........ ........ ........ 96%  316M 0s
22:55:27  221184K ........ ........ ........ ........ ........ ........ 97%  325M 0s
22:55:27  224256K ........ ........ ........ ........ ........ ........ 99%  318M 0s
22:55:27  227328K ........ ........ ........ ....                      100%  325M=1.0s
22:55:27  
22:55:27  2025-07-20 22:55:27 (228 MB/s) - ‘karaf-0.21.3-20250713.183051-1.zip’ saved [234634745/234634745]
22:55:27  
22:55:27  Extracting the new controller...
22:55:27  + echo 'Extracting the new controller...'
22:55:27  + unzip -q karaf-0.21.3-20250713.183051-1.zip
22:55:29  Adding external repositories...
22:55:29  + echo 'Adding external repositories...'
22:55:29  + sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
22:55:29  + cat /tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
22:55:29  ################################################################################
22:55:29  #
22:55:29  #    Licensed to the Apache Software Foundation (ASF) under one or more
22:55:29  #    contributor license agreements.  See the NOTICE file distributed with
22:55:29  #    this work for additional information regarding copyright ownership.
22:55:29  #    The ASF licenses this file to You under the Apache License, Version 2.0
22:55:29  #    (the "License"); you may not use this file except in compliance with
22:55:29  #    the License.  You may obtain a copy of the License at
22:55:29  #
22:55:29  #       http://www.apache.org/licenses/LICENSE-2.0
22:55:29  #
22:55:29  #    Unless required by applicable law or agreed to in writing, software
22:55:29  #    distributed under the License is distributed on an "AS IS" BASIS,
22:55:29  #    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
22:55:29  #    See the License for the specific language governing permissions and
22:55:29  #    limitations under the License.
22:55:29  #
22:55:29  ################################################################################
22:55:29  
22:55:29  #
22:55:29  # If set to true, the following property will not allow any certificate to be used
22:55:29  # when accessing Maven repositories through SSL
22:55:29  #
22:55:29  #org.ops4j.pax.url.mvn.certificateCheck=
22:55:29  
22:55:29  #
22:55:29  # Path to the local Maven settings file.
22:55:29  # The repositories defined in this file will be automatically added to the list
22:55:29  # of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property
22:55:29  # below is not set.
22:55:29  # The following locations are checked for the existence of the settings.xml file
22:55:29  #   * 1. looks for the specified url
22:55:29  #   * 2. if not found looks for ${user.home}/.m2/settings.xml
22:55:29  #   * 3. if not found looks for ${maven.home}/conf/settings.xml
22:55:29  #   * 4. if not found looks for ${M2_HOME}/conf/settings.xml
22:55:29  #
22:55:29  #org.ops4j.pax.url.mvn.settings=
22:55:29  
22:55:29  #
22:55:29  # Path to the local Maven repository which is used to avoid downloading
22:55:29  # artifacts when they already exist locally.
22:55:29  # The value of this property will be extracted from the settings.xml file
22:55:29  # above, or defaulted to:
22:55:29  #     System.getProperty( "user.home" ) + "/.m2/repository"
22:55:29  #
22:55:29  org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository}
22:55:29  
22:55:29  #
22:55:29  # Default this to false. It's just weird to use undocumented repos
22:55:29  #
22:55:29  org.ops4j.pax.url.mvn.useFallbackRepositories=false
22:55:29  
22:55:29  #
22:55:29  # Uncomment if you don't wanna use the proxy settings
22:55:29  # from the Maven conf/settings.xml file
22:55:29  #
22:55:29  # org.ops4j.pax.url.mvn.proxySupport=false
22:55:29  
22:55:29  #
22:55:29  # Comma separated list of repositories scanned when resolving an artifact.
22:55:29  # Those repositories will be checked before iterating through the
22:55:29  #    below list of repositories and even before the local repository
22:55:29  # A repository url can be appended with zero or more of the following flags:
22:55:29  #    @snapshots  : the repository contains snaphots
22:55:29  #    @noreleases : the repository does not contain any released artifacts
22:55:29  #
22:55:29  # The following property value will add the system folder as a repo.
22:55:29  #
22:55:29  org.ops4j.pax.url.mvn.defaultRepositories=\
22:55:29      file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\
22:55:29      file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\
22:55:29      file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots
22:55:29  
22:55:29  # Use the default local repo (e.g.~/.m2/repository) as a "remote" repo
22:55:29  #org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false
22:55:29  
22:55:29  #
22:55:29  # Comma separated list of repositories scanned when resolving an artifact.
22:55:29  # The default list includes the following repositories:
22:55:29  #    http://repo1.maven.org/maven2@id=central
22:55:29  #    http://repository.springsource.com/maven/bundles/release@id=spring.ebr
22:55:29  #    http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external
22:55:29  #    http://zodiac.springsource.com/maven/bundles/release@id=gemini
22:55:29  #    http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases
22:55:29  #    https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases
22:55:29  #    https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
22:55:29  # To add repositories to the default ones, prepend '+' to the list of repositories
22:55:29  # to add.
22:55:29  # A repository url can be appended with zero or more of the following flags:
22:55:29  #    @snapshots  : the repository contains snapshots
22:55:29  #    @noreleases : the repository does not contain any released artifacts
22:55:29  #    @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended
22:55:29  #
22:55:29  org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
22:55:29  
22:55:29  ### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.Configuring the startup features...
22:55:29  + [[ True == \T\r\u\e ]]
22:55:29  + echo 'Configuring the startup features...'
22:55:29  + sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.21.3-SNAPSHOT/etc/org.apache.karaf.features.cfg
22:55:29  + FEATURE_TEST_STRING=features-test
22:55:29  + FEATURE_TEST_VERSION=0.21.3-SNAPSHOT
22:55:29  + KARAF_VERSION=karaf4
22:55:29  + [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]]
22:55:29  + sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.21.3-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.21.3-SNAPSHOT/etc/org.apache.karaf.features.cfg
22:55:29  + [[ ! -z '' ]]
22:55:29  + cat /tmp/karaf-0.21.3-SNAPSHOT/etc/org.apache.karaf.features.cfg
22:55:29  ################################################################################
22:55:29  #
22:55:29  #    Licensed to the Apache Software Foundation (ASF) under one or more
22:55:29  #    contributor license agreements.  See the NOTICE file distributed with
22:55:29  #    this work for additional information regarding copyright ownership.
22:55:29  #    The ASF licenses this file to You under the Apache License, Version 2.0
22:55:29  #    (the "License"); you may not use this file except in compliance with
22:55:29  #    the License.  You may obtain a copy of the License at
22:55:29  #
22:55:29  #       http://www.apache.org/licenses/LICENSE-2.0
22:55:29  #
22:55:29  #    Unless required by applicable law or agreed to in writing, software
22:55:29  #    distributed under the License is distributed on an "AS IS" BASIS,
22:55:29  #    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
22:55:29  #    See the License for the specific language governing permissions and
22:55:29  #    limitations under the License.
22:55:29  #
22:55:29  ################################################################################
22:55:29  
22:55:29  #
22:55:29  # Comma separated list of features repositories to register by default
22:55:29  #
22:55:29  featuresRepositories = mvn:org.opendaylight.integration/features-test/0.21.3-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/85e4e99f-0858-420b-b76b-8b97b10100c8.xml
22:55:29  
22:55:29  #
22:55:29  # Comma separated list of features to install at startup
22:55:29  #
22:55:29  featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, 78fe7843-03b4-4322-9171-bfb7ca7953cb
22:55:29  
22:55:29  #
22:55:29  # Resource repositories (OBR) that the features resolver can use
22:55:29  # to resolve requirements/capabilities
22:55:29  #
22:55:29  # The format of the resourceRepositories is 
22:55:29  # resourceRepositories=[xml:url|json:url],...
22:55:29  # for Instance:
22:55:29  #
22:55:29  #resourceRepositories=xml:http://host/path/to/index.xml
22:55:29  # or
22:55:29  #resourceRepositories=json:http://host/path/to/index.json
22:55:29  #
22:55:29  
22:55:29  #
22:55:29  # Defines if the boot features are started in asynchronous mode (in a dedicated thread)
22:55:29  #
22:55:29  featuresBootAsynchronous=false
22:55:29  
22:55:29  #
22:55:29  # Service requirements enforcement
22:55:29  #
22:55:29  # By default, the feature resolver checks the service requirements/capabilities of
22:55:29  # bundles for new features (xml schema >= 1.3.0) in order to automatically installs
22:55:29  # the required bundles.
22:55:29  # The following flag can have those values:
22:55:29  #   - disable: service requirements are completely ignored
22:55:29  #   - default: service requirements are ignored for old features
22:55:29  #   - enforce: service requirements are always verified
22:55:29  #
22:55:29  #serviceRequirements=default
22:55:29  
22:55:29  #
22:55:29  # Store cfg file for config element in feature
22:55:29  #
22:55:29  #configCfgStore=true
22:55:29  
22:55:29  #
22:55:29  # Define if the feature service automatically refresh bundles
22:55:29  #
22:55:29  autoRefresh=true
22:55:29  
22:55:29  #
22:55:29  # Configuration of features processing mechanism (overrides, blacklisting, modification of features)
22:55:29  # XML file defines instructions related to features processing
22:55:29  # versions.properties may declare properties to resolve placeholders in XML file
22:55:29  # both files are relative to ${karaf.etc}
22:55:29  #
22:55:29  #featureProcessing=org.apache.karaf.features.xml
22:55:29  #featureProcessingVersions=versions.properties
22:55:29  + configure_karaf_log karaf4 ''
22:55:29  + local -r karaf_version=karaf4
22:55:29  + local -r controllerdebugmap=
22:55:29  + local logapi=log4j
22:55:29  + grep log4j2 /tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
22:55:29  log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
22:55:29  log4j2.rootLogger.level = INFO
22:55:29  #log4j2.rootLogger.type = asyncRoot
22:55:29  #log4j2.rootLogger.includeLocation = false
22:55:29  log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
22:55:29  log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
22:55:29  log4j2.rootLogger.appenderRef.Console.ref = Console
22:55:29  log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
22:55:29  log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
22:55:29  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
22:55:29  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
22:55:29  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
22:55:29  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
22:55:29  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
22:55:29  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
22:55:29  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
22:55:29  log4j2.logger.spifly.name = org.apache.aries.spifly
22:55:29  log4j2.logger.spifly.level = WARN
22:55:29  log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
22:55:29  log4j2.logger.audit.level = INFO
22:55:29  log4j2.logger.audit.additivity = false
22:55:29  log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
22:55:29  # Console appender not used by default (see log4j2.rootLogger.appenderRefs)
22:55:29  log4j2.appender.console.type = Console
22:55:29  log4j2.appender.console.name = Console
22:55:29  log4j2.appender.console.layout.type = PatternLayout
22:55:29  log4j2.appender.console.layout.pattern = ${log4j2.pattern}
22:55:29  log4j2.appender.rolling.type = RollingRandomAccessFile
22:55:29  log4j2.appender.rolling.name = RollingFile
22:55:29  log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
22:55:29  log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
22:55:29  #log4j2.appender.rolling.immediateFlush = false
22:55:29  log4j2.appender.rolling.append = true
22:55:29  log4j2.appender.rolling.layout.type = PatternLayout
22:55:29  log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
22:55:29  log4j2.appender.rolling.policies.type = Policies
22:55:29  log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
22:55:29  log4j2.appender.rolling.policies.size.size = 64MB
22:55:29  log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
22:55:29  log4j2.appender.rolling.strategy.max = 7
22:55:29  log4j2.appender.audit.type = RollingRandomAccessFile
22:55:29  log4j2.appender.audit.name = AuditRollingFile
22:55:29  log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
22:55:29  log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
22:55:29  log4j2.appender.audit.append = true
22:55:29  log4j2.appender.audit.layout.type = PatternLayout
22:55:29  log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
22:55:29  log4j2.appender.audit.policies.type = Policies
22:55:29  log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
22:55:29  log4j2.appender.audit.policies.size.size = 8MB
22:55:29  log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
22:55:29  log4j2.appender.audit.strategy.max = 7
22:55:29  log4j2.appender.osgi.type = PaxOsgi
22:55:29  log4j2.appender.osgi.name = PaxOsgi
22:55:29  log4j2.appender.osgi.filter = *
22:55:29  #log4j2.logger.aether.name = shaded.org.eclipse.aether
22:55:29  #log4j2.logger.aether.level = TRACE
22:55:29  #log4j2.logger.http-headers.name = shaded.org.apache.http.headers
22:55:29  #log4j2.logger.http-headers.level = DEBUG
22:55:29  #log4j2.logger.maven.name = org.ops4j.pax.url.mvn
22:55:29  #log4j2.logger.maven.level = TRACE
22:55:29  + logapi=log4j2
22:55:29  + echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2'
22:55:29  Configuring the karaf log... karaf_version: karaf4, logapi: log4j2
22:55:29  + '[' log4j2 == log4j2 ']'
22:55:29  + sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
22:55:29  + orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver
22:55:29  + orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver
22:55:29  + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN'
22:55:29  + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN'
22:55:29  controllerdebugmap: 
22:55:29  + unset IFS
22:55:29  + echo 'controllerdebugmap: '
22:55:29  cat /tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
22:55:29  + '[' -n '' ']'
22:55:29  + echo 'cat /tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg'
22:55:29  + cat /tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
22:55:29  ################################################################################
22:55:29  #
22:55:29  #    Licensed to the Apache Software Foundation (ASF) under one or more
22:55:29  #    contributor license agreements.  See the NOTICE file distributed with
22:55:29  #    this work for additional information regarding copyright ownership.
22:55:29  #    The ASF licenses this file to You under the Apache License, Version 2.0
22:55:29  #    (the "License"); you may not use this file except in compliance with
22:55:29  #    the License.  You may obtain a copy of the License at
22:55:29  #
22:55:29  #       http://www.apache.org/licenses/LICENSE-2.0
22:55:29  #
22:55:29  #    Unless required by applicable law or agreed to in writing, software
22:55:29  #    distributed under the License is distributed on an "AS IS" BASIS,
22:55:29  #    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
22:55:29  #    See the License for the specific language governing permissions and
22:55:29  #    limitations under the License.
22:55:29  #
22:55:29  ################################################################################
22:55:29  
22:55:29  # Common pattern layout for appenders
22:55:29  log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
22:55:29  
22:55:29  # Root logger
22:55:29  log4j2.rootLogger.level = INFO
22:55:29  # uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library
22:55:29  #log4j2.rootLogger.type = asyncRoot
22:55:29  #log4j2.rootLogger.includeLocation = false
22:55:29  log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
22:55:29  log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
22:55:29  log4j2.rootLogger.appenderRef.Console.ref = Console
22:55:29  log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
22:55:29  log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
22:55:29  
22:55:29  # Filters for logs marked by org.opendaylight.odlparent.Markers
22:55:29  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
22:55:29  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
22:55:29  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
22:55:29  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
22:55:29  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
22:55:29  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
22:55:29  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
22:55:29  
22:55:29  # Loggers configuration
22:55:29  
22:55:29  # Spifly logger
22:55:29  log4j2.logger.spifly.name = org.apache.aries.spifly
22:55:29  log4j2.logger.spifly.level = WARN
22:55:29  
22:55:29  # Security audit logger
22:55:29  log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
22:55:29  log4j2.logger.audit.level = INFO
22:55:29  log4j2.logger.audit.additivity = false
22:55:29  log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
22:55:29  
22:55:29  # Appenders configuration
22:55:29  
22:55:29  # Console appender not used by default (see log4j2.rootLogger.appenderRefs)
22:55:29  log4j2.appender.console.type = Console
22:55:29  log4j2.appender.console.name = Console
22:55:29  log4j2.appender.console.layout.type = PatternLayout
22:55:29  log4j2.appender.console.layout.pattern = ${log4j2.pattern}
22:55:29  
22:55:29  # Rolling file appender
22:55:29  log4j2.appender.rolling.type = RollingRandomAccessFile
22:55:29  log4j2.appender.rolling.name = RollingFile
22:55:29  log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
22:55:29  log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
22:55:29  # uncomment to not force a disk flush
22:55:29  #log4j2.appender.rolling.immediateFlush = false
22:55:29  log4j2.appender.rolling.append = true
22:55:29  log4j2.appender.rolling.layout.type = PatternLayout
22:55:29  log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
22:55:29  log4j2.appender.rolling.policies.type = Policies
22:55:29  log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
22:55:29  log4j2.appender.rolling.policies.size.size = 1GB
22:55:29  log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
22:55:29  log4j2.appender.rolling.strategy.max = 7
22:55:29  
22:55:29  # Audit file appender
22:55:29  log4j2.appender.audit.type = RollingRandomAccessFile
22:55:29  log4j2.appender.audit.name = AuditRollingFile
22:55:29  log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
22:55:29  log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
22:55:29  log4j2.appender.audit.append = true
22:55:29  log4j2.appender.audit.layout.type = PatternLayout
22:55:29  log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
22:55:29  log4j2.appender.audit.policies.type = Policies
22:55:29  log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
22:55:29  log4j2.appender.audit.policies.size.size = 8MB
22:55:29  log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
22:55:29  log4j2.appender.audit.strategy.max = 7
22:55:29  
22:55:29  # OSGi appender
22:55:29  log4j2.appender.osgi.type = PaxOsgi
22:55:29  log4j2.appender.osgi.name = PaxOsgi
22:55:29  log4j2.appender.osgi.filter = *
22:55:29  
22:55:29  # help with identification of maven-related problems with pax-url-aether
22:55:29  #log4j2.logger.aether.name = shaded.org.eclipse.aether
22:55:29  #log4j2.logger.aether.level = TRACE
22:55:29  #log4j2.logger.http-headers.name = shaded.org.apache.http.headers
22:55:29  #log4j2.logger.http-headers.level = DEBUG
22:55:29  #log4j2.logger.maven.name = org.ops4j.pax.url.mvn
22:55:29  #log4j2.logger.maven.level = TRACE
22:55:29  log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN
22:55:29  log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN
22:55:29  + set_java_vars /usr/lib/jvm/java-21-openjdk-amd64 3072m /tmp/karaf-0.21.3-SNAPSHOT/bin/setenv
22:55:29  Configure
22:55:29      java home: /usr/lib/jvm/java-21-openjdk-amd64
22:55:29      max memory: 3072m
22:55:29      memconf: /tmp/karaf-0.21.3-SNAPSHOT/bin/setenv
22:55:29  + local -r java_home=/usr/lib/jvm/java-21-openjdk-amd64
22:55:29  + local -r controllermem=3072m
22:55:29  + local -r memconf=/tmp/karaf-0.21.3-SNAPSHOT/bin/setenv
22:55:29  + echo Configure
22:55:29  + echo '    java home: /usr/lib/jvm/java-21-openjdk-amd64'
22:55:29  + echo '    max memory: 3072m'
22:55:29  + echo '    memconf: /tmp/karaf-0.21.3-SNAPSHOT/bin/setenv'
22:55:29  + sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64}%g' /tmp/karaf-0.21.3-SNAPSHOT/bin/setenv
22:55:29  + sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.21.3-SNAPSHOT/bin/setenv
22:55:29  cat /tmp/karaf-0.21.3-SNAPSHOT/bin/setenv
22:55:29  + echo 'cat /tmp/karaf-0.21.3-SNAPSHOT/bin/setenv'
22:55:29  + cat /tmp/karaf-0.21.3-SNAPSHOT/bin/setenv
22:55:29  #!/bin/sh
22:55:29  #
22:55:29  #    Licensed to the Apache Software Foundation (ASF) under one or more
22:55:29  #    contributor license agreements.  See the NOTICE file distributed with
22:55:29  #    this work for additional information regarding copyright ownership.
22:55:29  #    The ASF licenses this file to You under the Apache License, Version 2.0
22:55:29  #    (the "License"); you may not use this file except in compliance with
22:55:29  #    the License.  You may obtain a copy of the License at
22:55:29  #
22:55:29  #       http://www.apache.org/licenses/LICENSE-2.0
22:55:29  #
22:55:29  #    Unless required by applicable law or agreed to in writing, software
22:55:29  #    distributed under the License is distributed on an "AS IS" BASIS,
22:55:29  #    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
22:55:29  #    See the License for the specific language governing permissions and
22:55:29  #    limitations under the License.
22:55:29  #
22:55:29  
22:55:29  #
22:55:29  # handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf
22:55:29  # script: client, instance, shell, start, status, stop, karaf
22:55:29  #
22:55:29  # if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then
22:55:29  #   Actions go here...
22:55:29  # fi
22:55:29  
22:55:29  #
22:55:29  # general settings which should be applied for all scripts go here; please keep
22:55:29  # in mind that it is possible that scripts might be executed more than once, e.g.
22:55:29  # in example of the start script where the start script is executed first and the
22:55:29  # karaf script afterwards.
22:55:29  #
22:55:29  
22:55:29  #
22:55:29  # The following section shows the possible configuration options for the default 
22:55:29  # karaf scripts
22:55:29  #
22:55:29  export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64} # Location of Java installation
22:55:29  # export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration
22:55:29  # export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options
22:55:29  # export EXTRA_JAVA_OPTS # Additional JVM options
22:55:29  # export KARAF_HOME # Karaf home folder
22:55:29  # export KARAF_DATA # Karaf data folder
22:55:29  # export KARAF_BASE # Karaf base folder
22:55:29  # export KARAF_ETC  # Karaf etc  folder
22:55:29  # export KARAF_LOG  # Karaf log  folder
22:55:29  # export KARAF_SYSTEM_OPTS # First citizen Karaf options
22:55:29  # export KARAF_OPTS # Additional available Karaf options
22:55:29  # export KARAF_DEBUG # Enable debug mode
22:55:29  # export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start
22:55:29  # export KARAF_NOROOT # Prevent execution as root if set to true
22:55:29  Set Java version
22:55:29  + echo 'Set Java version'
22:55:29  + sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-21-openjdk-amd64/bin/java 1
22:55:29  sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper
22:55:29  sudo: a password is required
22:55:29  + sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-21-openjdk-amd64/bin/java
22:55:29  sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper
22:55:29  sudo: a password is required
22:55:29  + echo 'JDK default version ...'
22:55:29  + java -version
22:55:29  JDK default version ...
22:55:29  openjdk version "21.0.5" 2024-10-15
22:55:29  OpenJDK Runtime Environment (build 21.0.5+11-Ubuntu-1ubuntu122.04)
22:55:29  OpenJDK 64-Bit Server VM (build 21.0.5+11-Ubuntu-1ubuntu122.04, mixed mode, sharing)
22:55:29  Set JAVA_HOME
22:55:29  + echo 'Set JAVA_HOME'
22:55:29  + export JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64
22:55:29  + JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64
22:55:29  ++ readlink -e /usr/lib/jvm/java-21-openjdk-amd64/bin/java
22:55:29  Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java
22:55:29  + JAVA_RESOLVED=/usr/lib/jvm/java-21-openjdk-amd64/bin/java
22:55:29  + echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java'
22:55:29  Listing all open ports on controller system...
22:55:29  + echo 'Listing all open ports on controller system...'
22:55:29  + netstat -pnatu
22:55:29  /tmp/configuration-script.sh: line 40: netstat: command not found
22:55:29  + '[' -f /tmp/custom_shard_config.txt ']'
22:55:29  Custom shard config exists!!!
22:55:29  Copying the shard config...
22:55:29  + echo 'Custom shard config exists!!!'
22:55:29  + echo 'Copying the shard config...'
22:55:29  + cp /tmp/custom_shard_config.txt /tmp/karaf-0.21.3-SNAPSHOT/bin/
22:55:29  Configuring cluster
22:55:29  + echo 'Configuring cluster'
22:55:29  + /tmp/karaf-0.21.3-SNAPSHOT/bin/configure_cluster.sh 3 10.30.170.28 10.30.171.142 10.30.171.124
22:55:29  ################################################
22:55:29  ##             Configure Cluster              ##
22:55:29  ################################################
22:55:30   NOTE: Cluster configuration files not found. Copying from
22:55:30   /tmp/karaf-0.21.3-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/10.0.9
22:55:30  Configuring unique name in akka.conf
22:55:30  Configuring hostname in akka.conf
22:55:30  Configuring data and rpc seed nodes in akka.conf
22:55:30  modules = [
22:55:30  	
22:55:30  	{
22:55:30  		name = "inventory"
22:55:30  		namespace = "urn:opendaylight:inventory"
22:55:30  		shard-strategy = "module"
22:55:30  	},
22:55:30  	{
22:55:30  		name = "topology"
22:55:30  		namespace = "urn:TBD:params:xml:ns:yang:network-topology"
22:55:30  		shard-strategy = "module"
22:55:30  	},
22:55:30  	{
22:55:30  		name = "toaster"
22:55:30  		namespace = "http://netconfcentral.org/ns/toaster"
22:55:30  		shard-strategy = "module"
22:55:30  	},
22:55:30  	{
22:55:30  		name = "car"
22:55:30  		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
22:55:30  		shard-strategy = "module"
22:55:30  	},
22:55:30  	{
22:55:30  		name = "people"
22:55:30  		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
22:55:30  		shard-strategy = "module"
22:55:30  	},
22:55:30  	{
22:55:30  		name = "car-people"
22:55:30  		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
22:55:30  		shard-strategy = "module"
22:55:30  	}
22:55:30  ]
22:55:30  Configuring replication type in module-shards.conf
22:55:30  ################################################
22:55:30  ##   NOTE: Manually restart controller to     ##
22:55:30  ##         apply configuration.               ##
22:55:30  ################################################
22:55:30  Dump pekko.conf
22:55:30  + echo 'Dump pekko.conf'
22:55:30  + cat /tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/pekko.conf
22:55:30  cat: /tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/pekko.conf: No such file or directory
22:55:30  Dump modules.conf
22:55:30  + echo 'Dump modules.conf'
22:55:30  + cat /tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/modules.conf
22:55:30  modules = [
22:55:30  	
22:55:30  	{
22:55:30  		name = "inventory"
22:55:30  		namespace = "urn:opendaylight:inventory"
22:55:30  		shard-strategy = "module"
22:55:30  	},
22:55:30  	{
22:55:30  		name = "topology"
22:55:30  		namespace = "urn:TBD:params:xml:ns:yang:network-topology"
22:55:30  		shard-strategy = "module"
22:55:30  	},
22:55:30  	{
22:55:30  		name = "toaster"
22:55:30  		namespace = "http://netconfcentral.org/ns/toaster"
22:55:30  		shard-strategy = "module"
22:55:30  	},
22:55:30  	{
22:55:30  		name = "car"
22:55:30  		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
22:55:30  		shard-strategy = "module"
22:55:30  	},
22:55:30  	{
22:55:30  		name = "people"
22:55:30  		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
22:55:30  		shard-strategy = "module"
22:55:30  	},
22:55:30  	{
22:55:30  		name = "car-people"
22:55:30  		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
22:55:30  		shard-strategy = "module"
22:55:30  	}
22:55:30  ]
22:55:30  Dump module-shards.conf
22:55:30  + echo 'Dump module-shards.conf'
22:55:30  + cat /tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/module-shards.conf
22:55:30  module-shards = [
22:55:30  	{
22:55:30  		name = "default"
22:55:30  		shards = [
22:55:30  			{
22:55:30  				name = "default"
22:55:30  				replicas = ["member-1",
22:55:30  				"member-2",
22:55:30  				"member-3"]
22:55:30  			}
22:55:30  		]
22:55:30  	},
22:55:30  	{
22:55:30  		name = "inventory"
22:55:30  		shards = [
22:55:30  			{
22:55:30  				name="inventory"
22:55:30  				replicas = ["member-1",
22:55:30  				"member-2",
22:55:30  				"member-3"]
22:55:30  			}
22:55:30  		]
22:55:30  	},
22:55:30  	{
22:55:30  		name = "topology"
22:55:30  		shards = [
22:55:30  			{
22:55:30  				name="topology"
22:55:30  				replicas = ["member-1",
22:55:30  				"member-2",
22:55:30  				"member-3"]
22:55:30  			}
22:55:30  		]
22:55:30  	},
22:55:30  	{
22:55:30  		name = "toaster"
22:55:30  		shards = [
22:55:30  			{
22:55:30  				name="toaster"
22:55:30  				replicas = ["member-1",
22:55:30  				"member-2",
22:55:30  				"member-3"]
22:55:30  			}
22:55:30  		]
22:55:30  	},
22:55:30  	{
22:55:30  		name = "car"
22:55:30  		shards = [
22:55:30  			{
22:55:30  				name="car"
22:55:30  				replicas = ["member-1",
22:55:30  				"member-2",
22:55:30  				"member-3"]
22:55:30  			}
22:55:30  		]
22:55:30  	},
22:55:30  	{
22:55:30  		name = "people"
22:55:30  		shards = [
22:55:30  			{
22:55:30  				name="people"
22:55:30  				replicas = ["member-1",
22:55:30  				"member-2",
22:55:30  				"member-3"]
22:55:30  			}
22:55:30  		]
22:55:30  	},
22:55:30  	{
22:55:30  		name = "car-people"
22:55:30  		shards = [
22:55:30  			{
22:55:30  				name="car-people"
22:55:30  				replicas = ["member-1",
22:55:30  				"member-2",
22:55:30  				"member-3"]
22:55:30  			}
22:55:30  		]
22:55:30  	}
22:55:30  ]
22:55:30  Locating config plan to use...
22:55:30  Finished running config plans
22:55:30  Starting member-1 with IP address 10.30.170.28
22:55:30  Warning: Permanently added '10.30.170.28' (ECDSA) to the list of known hosts.
22:55:30  Warning: Permanently added '10.30.170.28' (ECDSA) to the list of known hosts.
22:55:30  Redirecting karaf console output to karaf_console.log
22:55:30  Starting controller...
22:55:30  start: Redirecting Karaf output to /tmp/karaf-0.21.3-SNAPSHOT/data/log/karaf_console.log
22:55:30  Starting member-2 with IP address 10.30.171.142
22:55:30  Warning: Permanently added '10.30.171.142' (ECDSA) to the list of known hosts.
22:55:31  Warning: Permanently added '10.30.171.142' (ECDSA) to the list of known hosts.
22:55:31  Redirecting karaf console output to karaf_console.log
22:55:31  Starting controller...
22:55:31  start: Redirecting Karaf output to /tmp/karaf-0.21.3-SNAPSHOT/data/log/karaf_console.log
22:55:31  Starting member-3 with IP address 10.30.171.124
22:55:31  Warning: Permanently added '10.30.171.124' (ECDSA) to the list of known hosts.
22:55:31  Warning: Permanently added '10.30.171.124' (ECDSA) to the list of known hosts.
22:55:32  Redirecting karaf console output to karaf_console.log
22:55:32  Starting controller...
22:55:32  start: Redirecting Karaf output to /tmp/karaf-0.21.3-SNAPSHOT/data/log/karaf_console.log
22:55:32  [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins3076425630579012655.sh
22:55:32  common-functions.sh is being sourced
22:55:32  common-functions environment:
22:55:32  MAVENCONF: /tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
22:55:32  ACTUALFEATURES: 
22:55:32  FEATURESCONF: /tmp/karaf-0.21.3-SNAPSHOT/etc/org.apache.karaf.features.cfg
22:55:32  CUSTOMPROP: /tmp/karaf-0.21.3-SNAPSHOT/etc/custom.properties
22:55:32  LOGCONF: /tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
22:55:32  MEMCONF: /tmp/karaf-0.21.3-SNAPSHOT/bin/setenv
22:55:32  CONTROLLERMEM: 2048m
22:55:32  AKKACONF: /tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/pekko.conf
22:55:32  MODULESCONF: /tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/modules.conf
22:55:32  MODULESHARDSCONF: /tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/module-shards.conf
22:55:32  SUITES: 
22:55:32  
22:55:32  + echo '#################################################'
22:55:32  #################################################
22:55:32  + echo '##         Verify Cluster is UP                ##'
22:55:32  ##         Verify Cluster is UP                ##
22:55:32  + echo '#################################################'
22:55:32  #################################################
22:55:32  + create_post_startup_script
22:55:32  + cat
22:55:32  + copy_and_run_post_startup_script
22:55:32  + seed_index=1
22:55:32  ++ seq 1 3
22:55:32  + for i in $(seq 1 "${NUM_ODL_SYSTEM}")
22:55:32  + CONTROLLERIP=ODL_SYSTEM_1_IP
22:55:32  + echo 'Execute the post startup script on controller 10.30.170.28'
22:55:32  Execute the post startup script on controller 10.30.170.28
22:55:32  + scp /w/workspace/controller-csit-3node-clustering-tell-all-scandium/post-startup-script.sh 10.30.170.28:/tmp/
22:55:32  Warning: Permanently added '10.30.170.28' (ECDSA) to the list of known hosts.
22:55:32  + ssh 10.30.170.28 'bash /tmp/post-startup-script.sh 1'
22:55:32  Warning: Permanently added '10.30.170.28' (ECDSA) to the list of known hosts.
22:55:32  /tmp/post-startup-script.sh: line 4: netstat: command not found
22:55:37  /tmp/post-startup-script.sh: line 4: netstat: command not found
22:55:42  /tmp/post-startup-script.sh: line 4: netstat: command not found
22:55:47  /tmp/post-startup-script.sh: line 4: netstat: command not found
22:55:52  /tmp/post-startup-script.sh: line 4: netstat: command not found
22:55:57  /tmp/post-startup-script.sh: line 4: netstat: command not found
22:56:02  /tmp/post-startup-script.sh: line 4: netstat: command not found
22:56:07  /tmp/post-startup-script.sh: line 4: netstat: command not found
22:56:12  /tmp/post-startup-script.sh: line 4: netstat: command not found
22:56:17  /tmp/post-startup-script.sh: line 4: netstat: command not found
22:56:22  /tmp/post-startup-script.sh: line 4: netstat: command not found
22:56:27  /tmp/post-startup-script.sh: line 4: netstat: command not found
22:56:32  Waiting up to 3 minutes for controller to come up, checking every 5 seconds...
22:56:37  2025-07-20T22:56:14,779 | INFO  | SystemReadyService-0 | SimpleSystemReadyMonitor         | 280 - org.opendaylight.infrautils.ready-api - 7.1.2 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
22:56:37  Controller is UP
22:56:37  2025-07-20T22:56:14,779 | INFO  | SystemReadyService-0 | SimpleSystemReadyMonitor         | 280 - org.opendaylight.infrautils.ready-api - 7.1.2 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
22:56:37  Listing all open ports on controller system...
22:56:37  /tmp/post-startup-script.sh: line 51: netstat: command not found
22:56:37  looking for "BindException: Address already in use" in log file
22:56:37  looking for "server is unhealthy" in log file
22:56:37  + '[' 1 == 0 ']'
22:56:37  + for i in $(seq 1 "${NUM_ODL_SYSTEM}")
22:56:37  + CONTROLLERIP=ODL_SYSTEM_2_IP
22:56:37  + echo 'Execute the post startup script on controller 10.30.171.142'
22:56:37  Execute the post startup script on controller 10.30.171.142
22:56:37  + scp /w/workspace/controller-csit-3node-clustering-tell-all-scandium/post-startup-script.sh 10.30.171.142:/tmp/
22:56:37  Warning: Permanently added '10.30.171.142' (ECDSA) to the list of known hosts.
22:56:38  + ssh 10.30.171.142 'bash /tmp/post-startup-script.sh 2'
22:56:38  Warning: Permanently added '10.30.171.142' (ECDSA) to the list of known hosts.
22:56:38  /tmp/post-startup-script.sh: line 4: netstat: command not found
22:56:43  /tmp/post-startup-script.sh: line 4: netstat: command not found
22:56:48  /tmp/post-startup-script.sh: line 4: netstat: command not found
22:56:53  /tmp/post-startup-script.sh: line 4: netstat: command not found
22:56:58  /tmp/post-startup-script.sh: line 4: netstat: command not found
22:57:03  /tmp/post-startup-script.sh: line 4: netstat: command not found
22:57:08  /tmp/post-startup-script.sh: line 4: netstat: command not found
22:57:13  /tmp/post-startup-script.sh: line 4: netstat: command not found
22:57:18  /tmp/post-startup-script.sh: line 4: netstat: command not found
22:57:23  /tmp/post-startup-script.sh: line 4: netstat: command not found
22:57:28  /tmp/post-startup-script.sh: line 4: netstat: command not found
22:57:34  /tmp/post-startup-script.sh: line 4: netstat: command not found
22:57:38  Waiting up to 3 minutes for controller to come up, checking every 5 seconds...
22:57:43  2025-07-20T22:56:15,130 | INFO  | SystemReadyService-0 | SimpleSystemReadyMonitor         | 280 - org.opendaylight.infrautils.ready-api - 7.1.2 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
22:57:43  Controller is UP
22:57:43  2025-07-20T22:56:15,130 | INFO  | SystemReadyService-0 | SimpleSystemReadyMonitor         | 280 - org.opendaylight.infrautils.ready-api - 7.1.2 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
22:57:43  Listing all open ports on controller system...
22:57:43  /tmp/post-startup-script.sh: line 51: netstat: command not found
22:57:43  looking for "BindException: Address already in use" in log file
22:57:43  looking for "server is unhealthy" in log file
22:57:43  + '[' 2 == 0 ']'
22:57:43  + for i in $(seq 1 "${NUM_ODL_SYSTEM}")
22:57:43  + CONTROLLERIP=ODL_SYSTEM_3_IP
22:57:43  + echo 'Execute the post startup script on controller 10.30.171.124'
22:57:43  Execute the post startup script on controller 10.30.171.124
22:57:43  + scp /w/workspace/controller-csit-3node-clustering-tell-all-scandium/post-startup-script.sh 10.30.171.124:/tmp/
22:57:43  Warning: Permanently added '10.30.171.124' (ECDSA) to the list of known hosts.
22:57:44  + ssh 10.30.171.124 'bash /tmp/post-startup-script.sh 3'
22:57:44  Warning: Permanently added '10.30.171.124' (ECDSA) to the list of known hosts.
22:57:44  /tmp/post-startup-script.sh: line 4: netstat: command not found
22:57:49  /tmp/post-startup-script.sh: line 4: netstat: command not found
22:57:54  /tmp/post-startup-script.sh: line 4: netstat: command not found
22:57:59  /tmp/post-startup-script.sh: line 4: netstat: command not found
22:58:04  /tmp/post-startup-script.sh: line 4: netstat: command not found
22:58:09  /tmp/post-startup-script.sh: line 4: netstat: command not found
22:58:14  /tmp/post-startup-script.sh: line 4: netstat: command not found
22:58:19  /tmp/post-startup-script.sh: line 4: netstat: command not found
22:58:24  /tmp/post-startup-script.sh: line 4: netstat: command not found
22:58:29  /tmp/post-startup-script.sh: line 4: netstat: command not found
22:58:34  /tmp/post-startup-script.sh: line 4: netstat: command not found
22:58:39  /tmp/post-startup-script.sh: line 4: netstat: command not found
22:58:44  Waiting up to 3 minutes for controller to come up, checking every 5 seconds...
22:58:49  2025-07-20T22:56:14,929 | INFO  | SystemReadyService-0 | SimpleSystemReadyMonitor         | 280 - org.opendaylight.infrautils.ready-api - 7.1.2 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
22:58:49  Controller is UP
22:58:49  2025-07-20T22:56:14,929 | INFO  | SystemReadyService-0 | SimpleSystemReadyMonitor         | 280 - org.opendaylight.infrautils.ready-api - 7.1.2 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
22:58:49  Listing all open ports on controller system...
22:58:49  /tmp/post-startup-script.sh: line 51: netstat: command not found
22:58:49  looking for "BindException: Address already in use" in log file
22:58:49  looking for "server is unhealthy" in log file
22:58:49  + '[' 0 == 0 ']'
22:58:49  + seed_index=1
22:58:49  + dump_controller_threads
22:58:49  ++ seq 1 3
22:58:49  + for i in $(seq 1 "${NUM_ODL_SYSTEM}")
22:58:49  + CONTROLLERIP=ODL_SYSTEM_1_IP
22:58:49  + echo 'Let'\''s take the karaf thread dump'
22:58:49  Let's take the karaf thread dump
22:58:49  + ssh 10.30.170.28 'sudo ps aux'
22:58:49  Warning: Permanently added '10.30.170.28' (ECDSA) to the list of known hosts.
22:58:49  ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-scandium/ps_before.log
22:58:49  ++ grep -v grep
22:58:49  ++ tr -s ' '
22:58:49  ++ cut -f2 '-d '
22:58:49  + pid=2087
22:58:49  + echo 'karaf main: org.apache.karaf.main.Main, pid:2087'
22:58:49  karaf main: org.apache.karaf.main.Main, pid:2087
22:58:49  + ssh 10.30.170.28 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 2087'
22:58:49  Warning: Permanently added '10.30.170.28' (ECDSA) to the list of known hosts.
22:58:50  + for i in $(seq 1 "${NUM_ODL_SYSTEM}")
22:58:50  + CONTROLLERIP=ODL_SYSTEM_2_IP
22:58:50  + echo 'Let'\''s take the karaf thread dump'
22:58:50  Let's take the karaf thread dump
22:58:50  + ssh 10.30.171.142 'sudo ps aux'
22:58:50  Warning: Permanently added '10.30.171.142' (ECDSA) to the list of known hosts.
22:58:50  ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-scandium/ps_before.log
22:58:50  ++ grep -v grep
22:58:50  ++ tr -s ' '
22:58:50  ++ cut -f2 '-d '
22:58:50  + pid=2083
22:58:50  + echo 'karaf main: org.apache.karaf.main.Main, pid:2083'
22:58:50  karaf main: org.apache.karaf.main.Main, pid:2083
22:58:50  + ssh 10.30.171.142 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 2083'
22:58:50  Warning: Permanently added '10.30.171.142' (ECDSA) to the list of known hosts.
22:58:51  + for i in $(seq 1 "${NUM_ODL_SYSTEM}")
22:58:51  + CONTROLLERIP=ODL_SYSTEM_3_IP
22:58:51  + echo 'Let'\''s take the karaf thread dump'
22:58:51  Let's take the karaf thread dump
22:58:51  + ssh 10.30.171.124 'sudo ps aux'
22:58:51  Warning: Permanently added '10.30.171.124' (ECDSA) to the list of known hosts.
22:58:51  ++ tr -s ' '
22:58:51  ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-scandium/ps_before.log
22:58:51  ++ cut -f2 '-d '
22:58:51  ++ grep -v grep
22:58:51  + pid=2085
22:58:51  + echo 'karaf main: org.apache.karaf.main.Main, pid:2085'
22:58:51  karaf main: org.apache.karaf.main.Main, pid:2085
22:58:51  + ssh 10.30.171.124 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 2085'
22:58:52  Warning: Permanently added '10.30.171.124' (ECDSA) to the list of known hosts.
22:58:52  + '[' 0 -gt 0 ']'
22:58:52  + echo 'Generating controller variables...'
22:58:52  Generating controller variables...
22:58:52  ++ seq 1 3
22:58:52  + for i in $(seq 1 "${NUM_ODL_SYSTEM}")
22:58:52  + CONTROLLERIP=ODL_SYSTEM_1_IP
22:58:52  + odl_variables=' -v ODL_SYSTEM_1_IP:10.30.170.28'
22:58:52  + for i in $(seq 1 "${NUM_ODL_SYSTEM}")
22:58:52  + CONTROLLERIP=ODL_SYSTEM_2_IP
22:58:52  + odl_variables=' -v ODL_SYSTEM_1_IP:10.30.170.28 -v ODL_SYSTEM_2_IP:10.30.171.142'
22:58:52  + for i in $(seq 1 "${NUM_ODL_SYSTEM}")
22:58:52  + CONTROLLERIP=ODL_SYSTEM_3_IP
22:58:52  + odl_variables=' -v ODL_SYSTEM_1_IP:10.30.170.28 -v ODL_SYSTEM_2_IP:10.30.171.142 -v ODL_SYSTEM_3_IP:10.30.171.124'
22:58:52  + echo 'Generating mininet variables...'
22:58:52  Generating mininet variables...
22:58:52  ++ seq 1 0
22:58:52  + get_test_suites SUITES
22:58:52  + local __suite_list=SUITES
22:58:52  + echo 'Locating test plan to use...'
22:58:52  Locating test plan to use...
22:58:52  + testplan_filepath=/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/testplans/controller-clustering-tell-scandium.txt
22:58:52  + '[' '!' -f /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/testplans/controller-clustering-tell-scandium.txt ']'
22:58:52  + testplan_filepath=/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/testplans/controller-clustering-tell.txt
22:58:52  + '[' disabled '!=' disabled ']'
22:58:52  + echo 'Changing the testplan path...'
22:58:52  Changing the testplan path...
22:58:52  + sed s:integration:/w/workspace/controller-csit-3node-clustering-tell-all-scandium: /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/testplans/controller-clustering-tell.txt
22:58:52  + cat testplan.txt
22:58:52  # Place the suites in run order:
22:58:52  
22:58:52  # disabling all "prefix based" suites. This functionality was newly
22:58:52  # introduced with these tests in 2017. The assumption is that
22:58:52  # development stopped in that area, but may continue at a later
22:58:52  # time. Still, the tests are failing and no resources to solve the
22:58:52  # failures at this time. If/When this changes, we can uncomment
22:58:52  # those suites. Note that every suite is commented out with it's
22:58:52  # accompanying "restart_with_tell_based_true" setup suite.
22:58:52  
22:58:52  
22:58:52  # /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
22:58:52  # /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/ddb-sanity-prefix-based.robot
22:58:52  /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
22:58:52  /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot
22:58:52  /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
22:58:52  /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot
22:58:52  # /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
22:58:52  # /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown_prefbasedshard.robot
22:58:52  /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
22:58:52  /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot
22:58:52  # /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
22:58:52  # /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement_prefbasedshard.robot
22:58:52  /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
22:58:52  /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot
22:58:52  # /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
22:58:52  # /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/leader_isolation_prefbasedshard.robot
22:58:52  /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
22:58:52  /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/client_isolation.robot
22:58:52  # /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
22:58:52  # /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/client_isolation_prefbasedshard.robot
22:58:52  /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
22:58:52  /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/listener_stability.robot
22:58:52  # /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
22:58:52  # /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/listener_stability_prefbasedshard.robot
22:58:52  /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
22:58:52  /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/master_stability.robot
22:58:52  /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
22:58:52  /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot
22:58:52  /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
22:58:52  /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot
22:58:52  /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
22:58:52  /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot
22:58:52  /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot
22:58:52  /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot
22:58:52  /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot
22:58:52  /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot
22:58:52  /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot
22:58:52  /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot
22:58:52  /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot
22:58:52  + '[' -z '' ']'
22:58:52  ++ grep -E -v '(^[[:space:]]*#|^[[:space:]]*$)' testplan.txt
22:58:52  ++ tr '\012' ' '
22:58:52  + suite_list='/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot '
22:58:52  + eval 'SUITES='\''/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot '\'''
22:58:52  ++ SUITES='/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot '
22:58:52  + echo 'Starting Robot test suites /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot  ...'
22:58:52  Starting Robot test suites /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot  ...
22:58:52  + robot -N controller-clustering-tell.txt --removekeywords wuks -e exclude -e skip_if_scandium -v BUNDLEFOLDER:karaf-0.21.3-SNAPSHOT -v BUNDLE_URL:https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.3-SNAPSHOT/karaf-0.21.3-20250713.183051-1.zip -v CONTROLLER:10.30.170.28 -v CONTROLLER1:10.30.171.142 -v CONTROLLER2:10.30.171.124 -v CONTROLLER_USER:jenkins -v JAVA_HOME:/usr/lib/jvm/java-21-openjdk-amd64 -v JDKVERSION:openjdk21 -v JENKINS_WORKSPACE:/w/workspace/controller-csit-3node-clustering-tell-all-scandium -v MININET: -v MININET1: -v MININET2: -v MININET_USER:jenkins -v NEXUSURL_PREFIX:https://nexus.opendaylight.org -v NUM_ODL_SYSTEM:3 -v NUM_TOOLS_SYSTEM:0 -v ODL_STREAM:scandium -v ODL_SYSTEM_IP:10.30.170.28 -v ODL_SYSTEM_1_IP:10.30.170.28 -v ODL_SYSTEM_2_IP:10.30.171.142 -v ODL_SYSTEM_3_IP:10.30.171.124 -v ODL_SYSTEM_USER:jenkins -v TOOLS_SYSTEM_IP: -v TOOLS_SYSTEM_USER:jenkins -v USER_HOME:/home/jenkins -v IS_KARAF_APPL:True -v WORKSPACE:/tmp /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot
22:58:52  ==============================================================================
22:58:52  controller-clustering-tell.txt                                                
22:58:52  ==============================================================================
22:58:53  controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
22:58:53  ==============================================================================
22:58:58  Stop_All_Members :: Stop every odl node.                              | FAIL |
23:05:07  Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
23:05:07  ------------------------------------------------------------------------------
23:05:07  Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
23:05:17  ------------------------------------------------------------------------------
23:05:17  Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
23:11:21  Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.28:8181/jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore
23:11:21  ------------------------------------------------------------------------------
23:11:21  controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
23:11:21  3 tests, 1 passed, 2 failed
23:11:21  ==============================================================================
23:11:22  controller-clustering-tell.txt.Ddb-Sanity-Module-Based :: DOMDataBroker tes...
23:11:22  ==============================================================================
23:11:30  Get_Shard_Role :: Get shard role.                                     | FAIL |
23:11:31  ... click for list of related bugs or create a new one if needed (with the
23:11:31  "controller_clustering_tell_txt_ddb_sanity_module_based_get_shard_role"
23:11:31  reference somewhere inside)
23:11:31  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_get_shard_role&order=bug_status"
23:11:31  
23:11:31  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.28:8181/restconf/operations/cluster-admin:get-shard-role
23:11:31  ------------------------------------------------------------------------------
23:11:31  Subscribe_Listener_To_Leader :: Subscribe listener to leader.         | FAIL |
23:11:31  ... click for list of related bugs or create a new one if needed (with the
23:11:31  "controller_clustering_tell_txt_ddb_sanity_module_based_subscribe_listener_to_leader"
23:11:31  reference somewhere inside)
23:11:31  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_subscribe_listener_to_leader&order=bug_status"
23:11:31  
23:11:31  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.28:8181/jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore
23:11:31  ------------------------------------------------------------------------------
23:11:31  Subscribe_Listener_To_Follower :: Subscribe listener to follower.     | FAIL |
23:11:31  ... click for list of related bugs or create a new one if needed (with the
23:11:31  "controller_clustering_tell_txt_ddb_sanity_module_based_subscribe_listener_to_follower"
23:11:31  reference somewhere inside)
23:11:31  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_subscribe_listener_to_follower&order=bug_status"
23:11:31  
23:11:31  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.28:8181/jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore
23:11:31  ------------------------------------------------------------------------------
23:11:31  Make_Leader_Local :: Make the loeader local and verify.               | FAIL |
23:11:31  ... click for list of related bugs or create a new one if needed (with the
23:11:31  "controller_clustering_tell_txt_ddb_sanity_module_based_make_leader_local"
23:11:31  reference somewhere inside)
23:11:31  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_make_leader_local&order=bug_status"
23:11:31  
23:11:31  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.28:8181/jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore
23:11:31  ------------------------------------------------------------------------------
23:11:31  Remove_Leader_Shard_Replica_And_Add_It_Back :: Remove and add shar... | FAIL |
23:11:31  ... click for list of related bugs or create a new one if needed (with the
23:11:31  "controller_clustering_tell_txt_ddb_sanity_module_based_remove_leader_shard_replica_and_add_it_back"
23:11:31  reference somewhere inside)
23:11:31  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_remove_leader_shard_replica_and_add_it_back&order=bug_status"
23:11:31  
23:11:31  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.28:8181/jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore
23:11:31  ------------------------------------------------------------------------------
23:11:31  Remove_Follower_Shard_Replica_And_Add_It_Back :: Remove and add sh... | FAIL |
23:11:32  ... click for list of related bugs or create a new one if needed (with the
23:11:32  "controller_clustering_tell_txt_ddb_sanity_module_based_remove_follower_shard_replica_and_add_it_back"
23:11:32  reference somewhere inside)
23:11:32  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_remove_follower_shard_replica_and_add_it_back&order=bug_status"
23:11:32  
23:11:32  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.28:8181/jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore
23:11:32  ------------------------------------------------------------------------------
23:11:32  Write_Transactions_One_Node_Leader :: Write transactions.             | FAIL |
23:11:32  ... click for list of related bugs or create a new one if needed (with the
23:11:32  "controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_one_node_leader"
23:11:32  reference somewhere inside)
23:11:32  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_one_node_leader&order=bug_status"
23:11:32  
23:11:32  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.28:8181/jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore
23:11:32  ------------------------------------------------------------------------------
23:11:32  Write_Transactions_One_Node_Follower :: Write transactions.           | FAIL |
23:11:32  ... click for list of related bugs or create a new one if needed (with the
23:11:32  "controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_one_node_follower"
23:11:32  reference somewhere inside)
23:11:32  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_one_node_follower&order=bug_status"
23:11:32  
23:11:32  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.28:8181/jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore
23:11:32  ------------------------------------------------------------------------------
23:11:32  Write_Transactions_All_Nodes :: Write transactions.                   | FAIL |
23:11:32  ... click for list of related bugs or create a new one if needed (with the
23:11:32  "controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_all_nodes"
23:11:32  reference somewhere inside)
23:11:32  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_all_nodes&order=bug_status"
23:11:32  
23:11:32  Resolving variable '${response.text}' failed: AttributeError: 'ConnectionError' object has no attribute 'text'
23:11:32  ------------------------------------------------------------------------------
23:11:32  controller-clustering-tell.txt.Ddb-Sanity-Module-Based :: DOMDataB... | FAIL |
23:11:32  9 tests, 0 passed, 9 failed
23:11:32  ==============================================================================
23:11:32  controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
23:11:32  ==============================================================================
23:11:40  Stop_All_Members :: Stop every odl node.                              | PASS |
23:13:45  ------------------------------------------------------------------------------
23:13:45  Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
23:13:54  ------------------------------------------------------------------------------
23:13:54  Start_All_And_Sync :: Start each member and wait for sync.            | PASS |
23:14:56  ------------------------------------------------------------------------------
23:14:56  controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | PASS |
23:14:56  3 tests, 3 passed, 0 failed
23:14:56  ==============================================================================
23:14:56  controller-clustering-tell.txt.Clean Leader Shutdown :: DOMDataBroker testi...
23:14:56  ==============================================================================
23:15:00  Local_Leader_Shutdown :: Shutdown the leader on the same node as t... | FAIL |
23:17:10  ... click for list of related bugs or create a new one if needed (with the
23:17:10  "controller_clustering_tell_txt_clean_leader_shutdown_local_leader_shutdown"
23:17:10  reference somewhere inside)
23:17:10  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_clean_leader_shutdown_local_leader_shutdown&order=bug_status"
23:17:10  
23:17:10  HTTPError: 404 Client Error: Not Found for url: http://10.30.171.124:8181/restconf/operations/cluster-admin:remove-shard-replica
23:17:10  ------------------------------------------------------------------------------
23:17:10  Restart :: Restart odl                                                | FAIL |
23:23:23  ... click for list of related bugs or create a new one if needed (with the
23:23:23  "controller_clustering_tell_txt_clean_leader_shutdown_restart"
23:23:23  reference somewhere inside)
23:23:23  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_clean_leader_shutdown_restart&order=bug_status"
23:23:23  
23:23:23  Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
23:23:23  ------------------------------------------------------------------------------
23:23:23  Remote_Leader_Shutdown :: Shutdown the leader on different node as... | FAIL |
23:25:43  ... click for list of related bugs or create a new one if needed (with the
23:25:43  "controller_clustering_tell_txt_clean_leader_shutdown_remote_leader_shutdown"
23:25:43  reference somewhere inside)
23:25:43  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_clean_leader_shutdown_remote_leader_shutdown&order=bug_status"
23:25:43  
23:25:43  ConnectionError: HTTPConnectionPool(host='10.30.170.28', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fbcfa7c30d0>: Failed to establish a new connection: [Errno 111] Connection refused'))
23:25:43  ------------------------------------------------------------------------------
23:25:43  controller-clustering-tell.txt.Clean Leader Shutdown :: DOMDataBro... | FAIL |
23:25:43  3 tests, 0 passed, 3 failed
23:25:43  ==============================================================================
23:25:43  controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
23:25:43  ==============================================================================
23:25:52  Stop_All_Members :: Stop every odl node.                              | FAIL |
23:31:57  Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
23:31:57  ------------------------------------------------------------------------------
23:31:57  Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
23:32:07  ------------------------------------------------------------------------------
23:32:07  Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
23:38:18  Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore
23:38:18  ------------------------------------------------------------------------------
23:38:18  controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
23:38:18  3 tests, 1 passed, 2 failed
23:38:18  ==============================================================================
23:38:18  controller-clustering-tell.txt.Explicit Leader Movement :: DOMDataBroker te...
23:38:18  ==============================================================================
23:38:21  Local_To_Remote_Movement :: Leader moves from local to remote node... | FAIL |
23:38:22  ... click for list of related bugs or create a new one if needed (with the
23:38:22  "controller_clustering_tell_txt_explicit_leader_movement_local_to_remote_movement"
23:38:22  reference somewhere inside)
23:38:22  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_local_to_remote_movement&order=bug_status"
23:38:22  
23:38:22  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/jolokia/read/org.opendaylight.controller:Category=Shards,name=member-3-shard-default-config,type=DistributedConfigDatastore
23:38:22  ------------------------------------------------------------------------------
23:38:22  Restart1 :: Restart odl                                               | FAIL |
23:44:33  ... click for list of related bugs or create a new one if needed (with the
23:44:33  "controller_clustering_tell_txt_explicit_leader_movement_restart1"
23:44:33  reference somewhere inside)
23:44:33  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_restart1&order=bug_status"
23:44:33  
23:44:33  Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
23:44:33  ------------------------------------------------------------------------------
23:44:33  Remote_To_Remote_Movement :: Leader moves from one remote to other... | FAIL |
23:44:54  ... click for list of related bugs or create a new one if needed (with the
23:44:54  "controller_clustering_tell_txt_explicit_leader_movement_remote_to_remote_movement"
23:44:54  reference somewhere inside)
23:44:54  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_remote_to_remote_movement&order=bug_status"
23:44:54  
23:44:54  ConnectionError: HTTPConnectionPool(host='10.30.170.28', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fbd09878890>: Failed to establish a new connection: [Errno 111] Connection refused'))
23:44:54  ------------------------------------------------------------------------------
23:44:54  Restart2 :: Restart odl                                               | FAIL |
23:50:58  ... click for list of related bugs or create a new one if needed (with the
23:50:58  "controller_clustering_tell_txt_explicit_leader_movement_restart2"
23:50:58  reference somewhere inside)
23:50:58  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_restart2&order=bug_status"
23:50:58  
23:50:58  Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
23:50:58  ------------------------------------------------------------------------------
23:50:58  Remote_To_Local_Movement :: Leader moves from remote to local node... | FAIL |
23:50:58  ... click for list of related bugs or create a new one if needed (with the
23:50:58  "controller_clustering_tell_txt_explicit_leader_movement_remote_to_local_movement"
23:50:58  reference somewhere inside)
23:50:58  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_remote_to_local_movement&order=bug_status"
23:50:58  
23:50:58  ConnectionError: HTTPConnectionPool(host='10.30.170.28', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fbd097210d0>: Failed to establish a new connection: [Errno 111] Connection refused'))
23:50:58  ------------------------------------------------------------------------------
23:50:58  controller-clustering-tell.txt.Explicit Leader Movement :: DOMData... | FAIL |
23:50:58  5 tests, 0 passed, 5 failed
23:50:58  ==============================================================================
23:50:58  controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
23:50:58  ==============================================================================
23:51:07  Stop_All_Members :: Stop every odl node.                              | FAIL |
23:57:12  Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
23:57:12  ------------------------------------------------------------------------------
23:57:12  Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
23:57:21  ------------------------------------------------------------------------------
23:57:21  Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
00:03:32  Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore
00:03:32  ------------------------------------------------------------------------------
00:03:32  controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
00:03:32  3 tests, 1 passed, 2 failed
00:03:32  ==============================================================================
00:03:32  controller-clustering-tell.txt.Leader Isolation :: DOMDataBroker testing: L...
00:03:32  ==============================================================================
00:03:37  Healing_Within_Request_Timeout :: The isolated node (leader) is re... | FAIL |
00:03:38  ... click for list of related bugs or create a new one if needed (with the
00:03:38  "controller_clustering_tell_txt_leader_isolation_healing_within_request_timeout"
00:03:38  reference somewhere inside)
00:03:38  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_leader_isolation_healing_within_request_timeout&order=bug_status"
00:03:38  
00:03:38  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/jolokia/read/org.opendaylight.controller:Category=Shards,name=member-3-shard-default-config,type=DistributedConfigDatastore
00:03:38  ------------------------------------------------------------------------------
00:03:38  Restart :: Restart odl                                                | FAIL |
00:09:49  ... click for list of related bugs or create a new one if needed (with the
00:09:49  "controller_clustering_tell_txt_leader_isolation_restart"
00:09:49  reference somewhere inside)
00:09:49  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_leader_isolation_restart&order=bug_status"
00:09:49  
00:09:49  Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
00:09:49  ------------------------------------------------------------------------------
00:09:49  Healing_After_Request_Timeout :: The isolated node (leader) is rej... | FAIL |
00:10:09  ... click for list of related bugs or create a new one if needed (with the
00:10:09  "controller_clustering_tell_txt_leader_isolation_healing_after_request_timeout"
00:10:09  reference somewhere inside)
00:10:09  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_leader_isolation_healing_after_request_timeout&order=bug_status"
00:10:09  
00:10:09  ConnectionError: HTTPConnectionPool(host='10.30.170.28', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fbcfa1d8410>: Failed to establish a new connection: [Errno 111] Connection refused'))
00:10:09  ------------------------------------------------------------------------------
00:10:09  controller-clustering-tell.txt.Leader Isolation :: DOMDataBroker t... | FAIL |
00:10:09  3 tests, 0 passed, 3 failed
00:10:09  ==============================================================================
00:10:09  controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
00:10:09  ==============================================================================
00:10:18  Stop_All_Members :: Stop every odl node.                              | FAIL |
00:16:22  Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
00:16:22  ------------------------------------------------------------------------------
00:16:22  Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
00:16:32  ------------------------------------------------------------------------------
00:16:32  Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
00:22:43  Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore
00:22:43  ------------------------------------------------------------------------------
00:22:43  controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
00:22:43  3 tests, 1 passed, 2 failed
00:22:43  ==============================================================================
00:22:43  controller-clustering-tell.txt.Client Isolation :: DOMDataBroker testing: C...
00:22:43  ==============================================================================
00:22:47  Producer_On_Shard_Leader_Node_ChainedTx :: Client isolation with p... | FAIL |
00:24:05  ... click for list of related bugs or create a new one if needed (with the
00:24:05  "controller_clustering_tell_txt_client_isolation_producer_on_shard_leader_node_chainedtx"
00:24:05  reference somewhere inside)
00:24:05  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_producer_on_shard_leader_node_chainedtx&order=bug_status"
00:24:05  
00:24:05  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/jolokia/read/org.opendaylight.controller:Category=Shards,name=member-3-shard-default-config,type=DistributedConfigDatastore
00:24:05  
00:24:05  Also keyword teardown failed:
00:24:05  Several failures occurred:
00:24:05  
00:24:05  1) Variable '${client_node_dst}' not found.
00:24:05  
00:24:05  2) Variable '${client_node_dst}' not found.
00:24:05  
00:24:05  3) Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 1 minute 10 seconds. The last error was: Several failures occurred:
00:24:05  
00:24:05  1) HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/jolokia/read/org.opendaylight.controller:Category=Shards,name=member-3-shard-default-config,type=DistributedConfigDatastore
00:24:05  
00:24:05  2) Resolving variable '${response.text}' failed: AttributeError: 'NoneType' object has no attribute 'text'
00:24:05      [ Message content over the limit has been removed. ]
00:24:05  64) Resolving variable '${response.status_code}' failed: AttributeError: 'NoneType' object has no attribute 'status_code'
00:24:05  
00:24:05  65) Resolving variable '${response.text}' failed: AttributeError: 'NoneType' object has no attribute 'text'
00:24:05  
00:24:05  66) Evaluating expression "json.loads('''None''')" failed: JSONDecodeError: Expecting value: line 1 column 1 (char 0)
00:24:05  
00:24:05  67) TypeError: Expected argument 1 to be a dictionary, got None instead.
00:24:05  
00:24:05  68) TypeError: Expected argument 1 to be a dictionary, got None instead.
00:24:05  
00:24:05  69) Unrecognized Raft state: None
00:24:05  
00:24:05  70) No leader found.
00:24:05  
00:24:05  71) Too many Leaders.
00:24:05  
00:24:05  72) IndexError: Given index 0 is out of the range 0--1.
00:24:05  ------------------------------------------------------------------------------
00:24:05  Restart1 :: Restart odl                                               | FAIL |
00:30:17  ... click for list of related bugs or create a new one if needed (with the
00:30:17  "controller_clustering_tell_txt_client_isolation_restart1"
00:30:17  reference somewhere inside)
00:30:17  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_restart1&order=bug_status"
00:30:17  
00:30:17  Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
00:30:17  ------------------------------------------------------------------------------
00:30:17  Producer_On_Shard_Leader_Node_SimpleTx :: Client isolation with pr... | FAIL |
00:31:55  ... click for list of related bugs or create a new one if needed (with the
00:31:55  "controller_clustering_tell_txt_client_isolation_producer_on_shard_leader_node_simpletx"
00:31:55  reference somewhere inside)
00:31:55  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_producer_on_shard_leader_node_simpletx&order=bug_status"
00:31:55  
00:31:55  ConnectionError: HTTPConnectionPool(host='10.30.170.28', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fbcfa398890>: Failed to establish a new connection: [Errno 111] Connection refused'))
00:31:55  
00:31:55  Also keyword teardown failed:
00:31:55  Several failures occurred:
00:31:55  
00:31:55  1) Variable '${client_node_dst}' not found.
00:31:55  
00:31:55  2) Variable '${client_node_dst}' not found.
00:31:55  
00:31:55  3) Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 1 minute 10 seconds. The last error was: Several failures occurred:
00:31:55  
00:31:55  1) ConnectionError: HTTPConnectionPool(host='10.30.170.28', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fb...
00:31:55      [ Message content over the limit has been removed. ]
00:31:55  
00:31:55  173) Resolving variable '${response.text}' failed: AttributeError: 'NoneType' object has no attribute 'text'
00:31:55  
00:31:55  174) Evaluating expression "json.loads('''None''')" failed: JSONDecodeError: Expecting value: line 1 column 1 (char 0)
00:31:55  
00:31:55  175) TypeError: Expected argument 1 to be a dictionary, got None instead.
00:31:55  
00:31:55  176) TypeError: Expected argument 1 to be a dictionary, got None instead.
00:31:55  
00:31:55  177) Unrecognized Raft state: None
00:31:55  
00:31:55  178) No leader found.
00:31:55  
00:31:55  179) Too many Leaders.
00:31:55  
00:31:55  180) IndexError: Given index 0 is out of the range 0--1.
00:31:55  
00:31:55  4) KeyError: 'threads'
00:31:55  ------------------------------------------------------------------------------
00:31:55  Restart2 :: Restart odl                                               | FAIL |
00:38:00  ... click for list of related bugs or create a new one if needed (with the
00:38:00  "controller_clustering_tell_txt_client_isolation_restart2"
00:38:00  reference somewhere inside)
00:38:00  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_restart2&order=bug_status"
00:38:00  
00:38:00  Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
00:38:00  ------------------------------------------------------------------------------
00:38:00  Producer_On_Shard_Non_Leader_Node_ChainedTx :: Client isolation wi... | FAIL |
00:39:18  ... click for list of related bugs or create a new one if needed (with the
00:39:18  "controller_clustering_tell_txt_client_isolation_producer_on_shard_non_leader_node_chainedtx"
00:39:18  reference somewhere inside)
00:39:18  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_producer_on_shard_non_leader_node_chainedtx&order=bug_status"
00:39:18  
00:39:18  ConnectionError: HTTPConnectionPool(host='10.30.170.28', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fbcfbf4a310>: Failed to establish a new connection: [Errno 111] Connection refused'))
00:39:18  
00:39:18  Also keyword teardown failed:
00:39:18  Several failures occurred:
00:39:18  
00:39:18  1) Variable '${client_node_dst}' not found.
00:39:18  
00:39:18  2) Variable '${client_node_dst}' not found.
00:39:18  
00:39:18  3) Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 1 minute 10 seconds. The last error was: Several failures occurred:
00:39:18  
00:39:18  1) ConnectionError: HTTPConnectionPool(host='10.30.170.28', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fb...
00:39:18      [ Message content over the limit has been removed. ]
00:39:18  
00:39:18  173) Resolving variable '${response.text}' failed: AttributeError: 'NoneType' object has no attribute 'text'
00:39:18  
00:39:18  174) Evaluating expression "json.loads('''None''')" failed: JSONDecodeError: Expecting value: line 1 column 1 (char 0)
00:39:18  
00:39:18  175) TypeError: Expected argument 1 to be a dictionary, got None instead.
00:39:18  
00:39:18  176) TypeError: Expected argument 1 to be a dictionary, got None instead.
00:39:18  
00:39:18  177) Unrecognized Raft state: None
00:39:18  
00:39:18  178) No leader found.
00:39:18  
00:39:18  179) Too many Leaders.
00:39:18  
00:39:18  180) IndexError: Given index 0 is out of the range 0--1.
00:39:18  
00:39:18  4) KeyError: 'threads'
00:39:18  ------------------------------------------------------------------------------
00:39:18  Restart3 :: Restart odl                                               | FAIL |
00:45:24  ... click for list of related bugs or create a new one if needed (with the
00:45:24  "controller_clustering_tell_txt_client_isolation_restart3"
00:45:24  reference somewhere inside)
00:45:24  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_restart3&order=bug_status"
00:45:24  
00:45:24  Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
00:45:24  ------------------------------------------------------------------------------
00:45:24  Producer_On_Shard_Non_Leader_Node_SimpleTx :: Client isolation wit... | FAIL |
00:46:43  ... click for list of related bugs or create a new one if needed (with the
00:46:43  "controller_clustering_tell_txt_client_isolation_producer_on_shard_non_leader_node_simpletx"
00:46:43  reference somewhere inside)
00:46:43  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_producer_on_shard_non_leader_node_simpletx&order=bug_status"
00:46:43  
00:46:43  ConnectionError: HTTPConnectionPool(host='10.30.170.28', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fbcfa08c5d0>: Failed to establish a new connection: [Errno 111] Connection refused'))
00:46:43  
00:46:43  Also keyword teardown failed:
00:46:43  Several failures occurred:
00:46:43  
00:46:43  1) Variable '${client_node_dst}' not found.
00:46:43  
00:46:43  2) Variable '${client_node_dst}' not found.
00:46:43  
00:46:43  3) Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 1 minute 10 seconds. The last error was: Several failures occurred:
00:46:43  
00:46:43  1) ConnectionError: HTTPConnectionPool(host='10.30.170.28', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fb...
00:46:43      [ Message content over the limit has been removed. ]
00:46:43  
00:46:43  173) Resolving variable '${response.text}' failed: AttributeError: 'NoneType' object has no attribute 'text'
00:46:43  
00:46:43  174) Evaluating expression "json.loads('''None''')" failed: JSONDecodeError: Expecting value: line 1 column 1 (char 0)
00:46:43  
00:46:43  175) TypeError: Expected argument 1 to be a dictionary, got None instead.
00:46:43  
00:46:43  176) TypeError: Expected argument 1 to be a dictionary, got None instead.
00:46:43  
00:46:43  177) Unrecognized Raft state: None
00:46:43  
00:46:43  178) No leader found.
00:46:43  
00:46:43  179) Too many Leaders.
00:46:43  
00:46:43  180) IndexError: Given index 0 is out of the range 0--1.
00:46:43  
00:46:43  4) KeyError: 'threads'
00:46:43  ------------------------------------------------------------------------------
00:46:43  controller-clustering-tell.txt.Client Isolation :: DOMDataBroker t... | FAIL |
00:46:43  7 tests, 0 passed, 7 failed
00:46:43  ==============================================================================
00:46:43  controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
00:46:43  ==============================================================================
00:46:52  Stop_All_Members :: Stop every odl node.                              | FAIL |
00:52:55  Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
00:52:55  ------------------------------------------------------------------------------
00:52:55  Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
00:53:05  ------------------------------------------------------------------------------
00:53:05  Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
00:59:16  Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore
00:59:16  ------------------------------------------------------------------------------
00:59:16  controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
00:59:16  3 tests, 1 passed, 2 failed
00:59:16  ==============================================================================
00:59:16  controller-clustering-tell.txt.Listener Stability :: DOMDataBroker testing:...
00:59:16  ==============================================================================
00:59:20  Move_Leader_From_Listener_Local_To_Remote :: Listener runs on lead... | FAIL |
00:59:20  ... click for list of related bugs or create a new one if needed (with the
00:59:20  "controller_clustering_tell_txt_listener_stability_move_leader_from_listener_local_to_remote"
00:59:20  reference somewhere inside)
00:59:20  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_listener_stability_move_leader_from_listener_local_to_remote&order=bug_status"
00:59:20  
00:59:20  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/jolokia/read/org.opendaylight.controller:Category=Shards,name=member-3-shard-default-config,type=DistributedConfigDatastore
00:59:20  ------------------------------------------------------------------------------
00:59:20  Restart_1 :: Restart odl.                                             | FAIL |
01:05:31  ... click for list of related bugs or create a new one if needed (with the
01:05:31  "controller_clustering_tell_txt_listener_stability_restart_1"
01:05:31  reference somewhere inside)
01:05:31  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_listener_stability_restart_1&order=bug_status"
01:05:31  
01:05:31  Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
01:05:31  ------------------------------------------------------------------------------
01:05:31  Move_Leader_From_Listener_Remote_To_Other_Remote :: Listener runs ... | FAIL |
01:05:51  ... click for list of related bugs or create a new one if needed (with the
01:05:51  "controller_clustering_tell_txt_listener_stability_move_leader_from_listener_remote_to_other_remote"
01:05:51  reference somewhere inside)
01:05:51  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_listener_stability_move_leader_from_listener_remote_to_other_remote&order=bug_status"
01:05:51  
01:05:51  ConnectionError: HTTPConnectionPool(host='10.30.170.28', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fbd09433610>: Failed to establish a new connection: [Errno 111] Connection refused'))
01:05:51  ------------------------------------------------------------------------------
01:05:51  Restart_2 :: Restart odl.                                             | FAIL |
01:11:56  ... click for list of related bugs or create a new one if needed (with the
01:11:56  "controller_clustering_tell_txt_listener_stability_restart_2"
01:11:56  reference somewhere inside)
01:11:56  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_listener_stability_restart_2&order=bug_status"
01:11:56  
01:11:56  Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
01:11:56  ------------------------------------------------------------------------------
01:11:56  Move_Leader_From_Listener_Remote_To_Local :: Listener runs on foll... | FAIL |
01:11:56  ... click for list of related bugs or create a new one if needed (with the
01:11:56  "controller_clustering_tell_txt_listener_stability_move_leader_from_listener_remote_to_local"
01:11:56  reference somewhere inside)
01:11:56  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_listener_stability_move_leader_from_listener_remote_to_local&order=bug_status"
01:11:56  
01:11:56  ConnectionError: HTTPConnectionPool(host='10.30.170.28', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fbd0928f550>: Failed to establish a new connection: [Errno 111] Connection refused'))
01:11:56  ------------------------------------------------------------------------------
01:11:56  controller-clustering-tell.txt.Listener Stability :: DOMDataBroker... | FAIL |
01:11:56  5 tests, 0 passed, 5 failed
01:11:56  ==============================================================================
01:11:56  controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
01:11:56  ==============================================================================
01:12:04  Stop_All_Members :: Stop every odl node.                              | FAIL |
01:18:09  Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
01:18:09  ------------------------------------------------------------------------------
01:18:09  Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
01:18:18  ------------------------------------------------------------------------------
01:18:18  Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
01:24:29  Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore
01:24:29  ------------------------------------------------------------------------------
01:24:29  controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
01:24:29  3 tests, 1 passed, 2 failed
01:24:29  ==============================================================================
01:24:29  controller-clustering-tell.txt.Master Stability :: Cluster Singleton testin...
01:24:29  ==============================================================================
01:24:33  Register_Singleton_Constant_On_Each_Node_And_Verify :: Register a ... | FAIL |
01:24:35  ... click for list of related bugs or create a new one if needed (with the
01:24:35  "controller_clustering_tell_txt_master_stability_register_singleton_constant_on_each_node_and_verify"
01:24:35  reference somewhere inside)
01:24:35  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_register_singleton_constant_on_each_node_and_verify&order=bug_status"
01:24:35  
01:24:35  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/operations/odl-mdsal-lowlevel-control:register-singleton-constant
01:24:35  ------------------------------------------------------------------------------
01:24:35  Unregister_Singleton_Constant_On_Non_Master_Node :: Unregister the... | FAIL |
01:24:35  ... click for list of related bugs or create a new one if needed (with the
01:24:35  "controller_clustering_tell_txt_master_stability_unregister_singleton_constant_on_non_master_node"
01:24:35  reference somewhere inside)
01:24:35  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_unregister_singleton_constant_on_non_master_node&order=bug_status"
01:24:35  
01:24:35  Variable '@{cs_candidates}' not found. Did you mean:
01:24:35      @{cs_exp_candidates}
01:24:35  ------------------------------------------------------------------------------
01:24:35  Monitor_Stability_While_Unregistered :: Verify that the owner rema... | FAIL |
01:24:35  ... click for list of related bugs or create a new one if needed (with the
01:24:35  "controller_clustering_tell_txt_master_stability_monitor_stability_while_unregistered"
01:24:35  reference somewhere inside)
01:24:35  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_monitor_stability_while_unregistered&order=bug_status"
01:24:35  
01:24:35  Variable '${cs_owner}' not found.
01:24:35  ------------------------------------------------------------------------------
01:24:35  Reregister_Singleton_Constant :: Re-register the unregistered cand... | FAIL |
01:24:36  ... click for list of related bugs or create a new one if needed (with the
01:24:36  "controller_clustering_tell_txt_master_stability_reregister_singleton_constant"
01:24:36  reference somewhere inside)
01:24:36  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_reregister_singleton_constant&order=bug_status"
01:24:36  
01:24:36  Variable '${unregistered_node}' not found.
01:24:36  ------------------------------------------------------------------------------
01:24:36  Verify_Stability_After_Reregistration :: Verify that the owner rem... | FAIL |
01:24:36  ... click for list of related bugs or create a new one if needed (with the
01:24:36  "controller_clustering_tell_txt_master_stability_verify_stability_after_reregistration"
01:24:36  reference somewhere inside)
01:24:36  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_verify_stability_after_reregistration&order=bug_status"
01:24:36  
01:24:36  Variable '${cs_owner}' not found.
01:24:36  ------------------------------------------------------------------------------
01:24:36  Unregister_Singleton_Constant_On_Each_Node :: Unregister the appli... | FAIL |
01:24:37  ... click for list of related bugs or create a new one if needed (with the
01:24:37  "controller_clustering_tell_txt_master_stability_unregister_singleton_constant_on_each_node"
01:24:37  reference somewhere inside)
01:24:37  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_unregister_singleton_constant_on_each_node&order=bug_status"
01:24:37  
01:24:37  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/operations/odl-mdsal-lowlevel-control:unregister-singleton-constant
01:24:37  ------------------------------------------------------------------------------
01:24:37  controller-clustering-tell.txt.Master Stability :: Cluster Singlet... | FAIL |
01:24:37  6 tests, 0 passed, 6 failed
01:24:37  ==============================================================================
01:24:37  controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
01:24:37  ==============================================================================
01:24:39  Stop_All_Members :: Stop every odl node.                              | FAIL |
01:30:51  Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
01:30:51  ------------------------------------------------------------------------------
01:30:51  Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
01:31:01  ------------------------------------------------------------------------------
01:31:01  Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
01:37:12  Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore
01:37:12  ------------------------------------------------------------------------------
01:37:12  controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
01:37:12  3 tests, 1 passed, 2 failed
01:37:12  ==============================================================================
01:37:12  controller-clustering-tell.txt.Partition And Heal :: Cluster Singleton test...
01:37:12  ==============================================================================
01:37:16  Register_Singleton_Constant_On_Each_Node :: Register a candidate a... | FAIL |
01:37:18  ... click for list of related bugs or create a new one if needed (with the
01:37:18  "controller_clustering_tell_txt_partition_and_heal_register_singleton_constant_on_each_node"
01:37:18  reference somewhere inside)
01:37:18  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_register_singleton_constant_on_each_node&order=bug_status"
01:37:18  
01:37:18  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/operations/odl-mdsal-lowlevel-control:register-singleton-constant
01:37:18  ------------------------------------------------------------------------------
01:37:18  Verify_Singleton_Constant_On_Each_Node :: Store the owner and cand... | FAIL |
01:37:18  ... click for list of related bugs or create a new one if needed (with the
01:37:18  "controller_clustering_tell_txt_partition_and_heal_verify_singleton_constant_on_each_node"
01:37:18  reference somewhere inside)
01:37:18  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_verify_singleton_constant_on_each_node&order=bug_status"
01:37:18  
01:37:18  Could not parse owner and candidates for device get-singleton-constant-service']
01:37:18  ------------------------------------------------------------------------------
01:37:18  Isolate_Owner_Node :: Isolate the cluster node which is the owner.... | FAIL |
01:37:19  ... click for list of related bugs or create a new one if needed (with the
01:37:19  "controller_clustering_tell_txt_partition_and_heal_isolate_owner_node"
01:37:19  reference somewhere inside)
01:37:19  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_isolate_owner_node&order=bug_status"
01:37:19  
01:37:19  Variable '${cs_owner}' not found.
01:37:19  ------------------------------------------------------------------------------
01:37:19  Monitor_Stability_While_Isolated :: Monitor the stability of the s... | FAIL |
01:37:19  ... click for list of related bugs or create a new one if needed (with the
01:37:19  "controller_clustering_tell_txt_partition_and_heal_monitor_stability_while_isolated"
01:37:19  reference somewhere inside)
01:37:19  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_monitor_stability_while_isolated&order=bug_status"
01:37:19  
01:37:19  Invalid IF condition: Evaluating expression '"${index}" == "${cs_isolated_index}"' failed: Variable '${cs_isolated_index}' not found.
01:37:19  ------------------------------------------------------------------------------
01:37:19  Rejoin_Isolated_node :: Rejoin isolated node.                         | FAIL |
01:37:19  ... click for list of related bugs or create a new one if needed (with the
01:37:19  "controller_clustering_tell_txt_partition_and_heal_rejoin_isolated_node"
01:37:19  reference somewhere inside)
01:37:19  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_rejoin_isolated_node&order=bug_status"
01:37:19  
01:37:19  Variable '${cs_isolated_index}' not found.
01:37:19  ------------------------------------------------------------------------------
01:37:19  Unregister_Singleton_Constant_On_Each_Node :: Unregister the appli... | FAIL |
01:37:20  ... click for list of related bugs or create a new one if needed (with the
01:37:20  "controller_clustering_tell_txt_partition_and_heal_unregister_singleton_constant_on_each_node"
01:37:20  reference somewhere inside)
01:37:20  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_unregister_singleton_constant_on_each_node&order=bug_status"
01:37:20  
01:37:20  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/operations/odl-mdsal-lowlevel-control:unregister-singleton-constant
01:37:20  ------------------------------------------------------------------------------
01:37:20  controller-clustering-tell.txt.Partition And Heal :: Cluster Singl... | FAIL |
01:37:20  6 tests, 0 passed, 6 failed
01:37:20  ==============================================================================
01:37:20  controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
01:37:20  ==============================================================================
01:37:23  Stop_All_Members :: Stop every odl node.                              | FAIL |
01:43:35  Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
01:43:35  ------------------------------------------------------------------------------
01:43:35  Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
01:43:45  ------------------------------------------------------------------------------
01:43:45  Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
01:49:55  Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore
01:49:55  ------------------------------------------------------------------------------
01:49:55  controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
01:49:55  3 tests, 1 passed, 2 failed
01:49:55  ==============================================================================
01:49:56  controller-clustering-tell.txt.Chasing The Leader :: Cluster Singleton test...
01:49:56  ==============================================================================
01:49:59  Register_Candidates :: Register a candidate application on each no... | FAIL |
01:50:01  ... click for list of related bugs or create a new one if needed (with the
01:50:01  "controller_clustering_tell_txt_chasing_the_leader_register_candidates"
01:50:01  reference somewhere inside)
01:50:01  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_chasing_the_leader_register_candidates&order=bug_status"
01:50:01  
01:50:01  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/operations/odl-mdsal-lowlevel-control:register-flapping-singleton
01:50:01  ------------------------------------------------------------------------------
01:50:01  Do_Nothing :: Do nothing for the time of the test duration, becaus... | PASS |
01:51:01  ------------------------------------------------------------------------------
01:51:01  Unregister_Candidates_And_Validate_Criteria :: Unregister the test... | FAIL |
01:51:02  ... click for list of related bugs or create a new one if needed (with the
01:51:02  "controller_clustering_tell_txt_chasing_the_leader_unregister_candidates_and_validate_criteria"
01:51:02  reference somewhere inside)
01:51:02  "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_chasing_the_leader_unregister_candidates_and_validate_criteria&order=bug_status"
01:51:02  
01:51:02  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/operations/odl-mdsal-lowlevel-control:unregister-flapping-singleton
01:51:02  ------------------------------------------------------------------------------
01:51:02  controller-clustering-tell.txt.Chasing The Leader :: Cluster Singl... | FAIL |
01:51:02  3 tests, 1 passed, 2 failed
01:51:02  ==============================================================================
01:51:02  controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
01:51:02  ==============================================================================
01:51:05  Stop_All_Members :: Stop every odl node.                              | FAIL |
01:57:17  Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
01:57:17  ------------------------------------------------------------------------------
01:57:17  Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
01:57:26  ------------------------------------------------------------------------------
01:57:26  Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
02:03:37  Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore
02:03:37  ------------------------------------------------------------------------------
02:03:37  controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
02:03:37  3 tests, 1 passed, 2 failed
02:03:37  ==============================================================================
02:03:37  controller-clustering-tell.txt.Carpeople Crud :: Suite for performing basic...
02:03:37  ==============================================================================
02:03:42  Add_Cars_To_Leader :: Add 30 cars to car Leader by one big PUT.       | FAIL |
02:03:42  Parent suite setup failed:
02:03:42  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:42  ------------------------------------------------------------------------------
02:03:42  See_Added_Cars_On_Leader :: GET response from Leader should match ... | FAIL |
02:03:42  Parent suite setup failed:
02:03:42  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:42  ------------------------------------------------------------------------------
02:03:42  See_Added_Cars_On_Followers :: The same check on other members.       | FAIL |
02:03:42  Parent suite setup failed:
02:03:42  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:42  ------------------------------------------------------------------------------
02:03:42  Add_People_To_First_Follower :: Add 30 people to people first Foll... | FAIL |
02:03:42  Parent suite setup failed:
02:03:42  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:42  ------------------------------------------------------------------------------
02:03:42  See_Added_People_On_Leader :: GET response from Leader should matc... | FAIL |
02:03:42  Parent suite setup failed:
02:03:42  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:42  ------------------------------------------------------------------------------
02:03:42  See_Added_People_On_Followers :: The same check on other members.     | FAIL |
02:03:42  Parent suite setup failed:
02:03:42  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:42  ------------------------------------------------------------------------------
02:03:42  Buy_Cars_On_Leader :: Buy some cars on car-people Leader, loop of ... | FAIL |
02:03:42  Parent suite setup failed:
02:03:42  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:42  ------------------------------------------------------------------------------
02:03:42  Buy_Cars_On_Followers :: On each Follower buy corresponding ID seg... | FAIL |
02:03:42  Parent suite setup failed:
02:03:42  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:42  ------------------------------------------------------------------------------
02:03:42  See_Added_CarPeople_On_Leader :: GET car-person mappings from Lead... | FAIL |
02:03:42  Parent suite setup failed:
02:03:42  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:42  ------------------------------------------------------------------------------
02:03:42  See_Added_CarPeople_On_Followers :: The same check on other members.  | FAIL |
02:03:42  Parent suite setup failed:
02:03:42  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:42  ------------------------------------------------------------------------------
02:03:42  Delete_All_CarPeople_On_Leader :: DELETE car-people container. No ... | FAIL |
02:03:42  Parent suite setup failed:
02:03:42  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:42  ------------------------------------------------------------------------------
02:03:42  Delete_All_People_On_Leader :: DELETE people container. No verific... | FAIL |
02:03:42  Parent suite setup failed:
02:03:42  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:42  ------------------------------------------------------------------------------
02:03:42  Delete_All_Cars_On_Leader :: DELETE cars container. No verificatio... | FAIL |
02:03:42  Parent suite setup failed:
02:03:42  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:42  ------------------------------------------------------------------------------
02:03:42  controller-clustering-tell.txt.Carpeople Crud :: Suite for perform... | FAIL |
02:03:42  Suite setup failed:
02:03:42  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:42  
02:03:42  13 tests, 0 passed, 13 failed
02:03:42  ==============================================================================
02:03:42  controller-clustering-tell.txt.Car Failover Crud :: Suite mixing basic oper...
02:03:42  ==============================================================================
02:03:45  Add_Original_Cars_On_Old_Leader_And_Verify :: Add initial cars on ... | FAIL |
02:03:45  Parent suite setup failed:
02:03:45  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:45  ------------------------------------------------------------------------------
02:03:45  Stop_Original_Car_Leader :: Stop the car Leader to cause a new lea... | FAIL |
02:03:45  Parent suite setup failed:
02:03:45  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:45  ------------------------------------------------------------------------------
02:03:45  Wait_For_New_Leader :: Wait until new car Leader is elected.          | FAIL |
02:03:45  Parent suite setup failed:
02:03:45  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:45  ------------------------------------------------------------------------------
02:03:45  See_Original_Cars_On_New_Leader :: GET cars from new Leader, shoul... | FAIL |
02:03:45  Parent suite setup failed:
02:03:45  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:45  ------------------------------------------------------------------------------
02:03:45  See_Original_Cars_On_New_Followers :: The same check on other exis... | FAIL |
02:03:45  Parent suite setup failed:
02:03:45  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:45  ------------------------------------------------------------------------------
02:03:45  Delete_Original_Cars_On_New_Leader :: Delete cars on the new Leader.  | FAIL |
02:03:45  Parent suite setup failed:
02:03:45  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:45  ------------------------------------------------------------------------------
02:03:45  Add_Leader_Cars_On_New_Leader :: Add cars on the new Leader.          | FAIL |
02:03:45  Parent suite setup failed:
02:03:45  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:45  ------------------------------------------------------------------------------
02:03:45  See_Leader_Cars_On_New_Leader :: GET cars from new Leader, should ... | FAIL |
02:03:45  Parent suite setup failed:
02:03:45  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:45  ------------------------------------------------------------------------------
02:03:45  See_Leader_Cars_On_New_Followers :: The same check on other existi... | FAIL |
02:03:45  Parent suite setup failed:
02:03:45  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:45  ------------------------------------------------------------------------------
02:03:45  Delete_Leader_Cars_On_New_First_Follower :: Delete cars in new fir... | FAIL |
02:03:45  Parent suite setup failed:
02:03:45  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:45  ------------------------------------------------------------------------------
02:03:45  Add_Follower_Cars_On_New_First_Follower :: Add cars on the new fir... | FAIL |
02:03:45  Parent suite setup failed:
02:03:45  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:45  ------------------------------------------------------------------------------
02:03:45  See_Folower_Cars_On_New_Leader :: Get cars from the new Leader, sh... | FAIL |
02:03:45  Parent suite setup failed:
02:03:45  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:45  ------------------------------------------------------------------------------
02:03:45  See_Follower_Cars_On_New_Followers :: The same check on other exis... | FAIL |
02:03:45  Parent suite setup failed:
02:03:45  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:45  ------------------------------------------------------------------------------
02:03:45  Start_Old_Car_Leader :: Start the stopped member without deleting ... | FAIL |
02:03:45  Parent suite setup failed:
02:03:45  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:45  ------------------------------------------------------------------------------
02:03:45  See_Folower_Cars_On_Old_Leader :: GET cars from the restarted memb... | FAIL |
02:03:45  Parent suite setup failed:
02:03:45  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:45  ------------------------------------------------------------------------------
02:03:45  Delete_Follower_Cars_On_New_Leader :: Delete cars on the last Leader. | FAIL |
02:03:45  Parent suite setup failed:
02:03:45  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:45  ------------------------------------------------------------------------------
02:03:45  controller-clustering-tell.txt.Car Failover Crud :: Suite mixing b... | FAIL |
02:03:45  Suite setup failed:
02:03:45  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:45  
02:03:45  16 tests, 0 passed, 16 failed
02:03:45  ==============================================================================
02:03:45  controller-clustering-tell.txt.Car Persistence Recovery :: This test restar...
02:03:45  ==============================================================================
02:03:48  Add_Cars_On_Leader_And_Verify :: Single big PUT to datastore to ad... | FAIL |
02:03:48  Parent suite setup failed:
02:03:48  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:48  ------------------------------------------------------------------------------
02:03:48  Stop_All_Members :: Stop all controllers.                             | FAIL |
02:03:48  Parent suite setup failed:
02:03:48  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:48  ------------------------------------------------------------------------------
02:03:48  Start_All_Members :: Start all controllers (should restore the per... | FAIL |
02:03:48  Parent suite setup failed:
02:03:48  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:48  ------------------------------------------------------------------------------
02:03:48  Memorize_Leader_And_Followers :: Locate current Leader of car Shard.  | FAIL |
02:03:48  Parent suite setup failed:
02:03:48  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:48  ------------------------------------------------------------------------------
02:03:48  See_Cars_On_Leader :: GET cars from Leader, should match the PUT d... | FAIL |
02:03:48  Parent suite setup failed:
02:03:48  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:48  ------------------------------------------------------------------------------
02:03:48  See_Cars_On_Followers :: The same check on other members.             | FAIL |
02:03:48  Parent suite setup failed:
02:03:48  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:48  ------------------------------------------------------------------------------
02:03:48  Delete_Cars_On_Leader :: Delete cars on the new Leader.               | FAIL |
02:03:48  Parent suite setup failed:
02:03:48  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:48  ------------------------------------------------------------------------------
02:03:48  controller-clustering-tell.txt.Car Persistence Recovery :: This te... | FAIL |
02:03:48  Suite setup failed:
02:03:48  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:48  
02:03:48  7 tests, 0 passed, 7 failed
02:03:48  ==============================================================================
02:03:48  controller-clustering-tell.txt.Buycar Failover :: This test focuses on test...
02:03:48  ==============================================================================
02:03:50  Add_Cars_To_Leader_And_Verify :: Add all needed cars to car Leader... | FAIL |
02:03:50  Parent suite setup failed:
02:03:50  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:50  ------------------------------------------------------------------------------
02:03:50  Add_People_To_First_Follower_And_Verify :: Add all needed people t... | FAIL |
02:03:50  Parent suite setup failed:
02:03:50  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:50  ------------------------------------------------------------------------------
02:03:50  Buy_Cars_On_Leader_And_Verify :: Buy some cars on the leader member.  | FAIL |
02:03:50  Parent suite setup failed:
02:03:50  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:50  ------------------------------------------------------------------------------
02:03:50  Buy_Cars_On_Follower_And_Verify :: Buy some cars on the first foll... | FAIL |
02:03:50  Parent suite setup failed:
02:03:50  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:50  ------------------------------------------------------------------------------
02:03:50  Reboot_People_Leader :: Previous people Leader is rebooted. We sho... | FAIL |
02:03:50  Parent suite setup failed:
02:03:50  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:50  ------------------------------------------------------------------------------
02:03:50  Buy_Cars_On_Leader_After_Reboot_And_Verify :: Buy some cars on the... | FAIL |
02:03:50  Parent suite setup failed:
02:03:50  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:50  ------------------------------------------------------------------------------
02:03:50  Buy_Cars_On_Follower_After_Reboot_And_Verify :: Buy some cars on t... | FAIL |
02:03:50  Parent suite setup failed:
02:03:50  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:50  ------------------------------------------------------------------------------
02:03:50  Delete_All_CarPeople :: DELETE car-people container. No verificati... | FAIL |
02:03:50  Parent suite setup failed:
02:03:50  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:50  ------------------------------------------------------------------------------
02:03:50  Delete_All_People :: DELETE people container. No verification beyo... | FAIL |
02:03:50  Parent suite setup failed:
02:03:50  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:50  ------------------------------------------------------------------------------
02:03:50  Delete_All_Cars :: DELETE cars container. No verification beyond h... | FAIL |
02:03:50  Parent suite setup failed:
02:03:50  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:50  ------------------------------------------------------------------------------
02:03:50  controller-clustering-tell.txt.Buycar Failover :: This test focuse... | FAIL |
02:03:50  Suite setup failed:
02:03:50  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:50  
02:03:50  10 tests, 0 passed, 10 failed
02:03:50  ==============================================================================
02:03:50  controller-clustering-tell.txt.Entity Isolate :: Suite for performing membe...
02:03:50  ==============================================================================
02:03:53  Check All Shards Before Isolate :: Check all shards in controller.    | FAIL |
02:03:53  Parent suite setup failed:
02:03:53  Evaluating expression 'json.loads(\'\'\'{\n "error": "javax.management.InstanceNotFoundException : org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "error_type": "javax.management.InstanceNotFoundException",\n "request": {\n  "mbean": "org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n  "type": "read"\n },\n "stacktrace": "javax.management.InstanceNotFoundException: org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1073)\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1343)\\n\\tat java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:921)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:46)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:41)\\n\\tat org.jolokia.backend.executor.AbstractMBeanServerExecutor.call(AbstractMBeanServerExecutor.java:90)\\n\\tat org.jolokia.handler.ReadHandler.getMBeanInfo(ReadHandler.java:233)\\n\\tat org.jolokia.handler.ReadHandler.getAllAttributesNames(ReadHandler.java:245)\\n\\tat org.jolokia.handler.ReadHandler.resolveAttributes(ReadHandler.java:221)\\n\\tat org.jolokia.handler.ReadHandler.f...
02:03:53      [ Message content over the limit has been removed. ]
02:03:53  ...lipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\\n\\tat org.eclipse.jetty.server.Server.handle(Server.java:516)\\n\\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)\\n\\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)\\n\\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)\\n\\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\\n\\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\\n\\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\\n\\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)\\n\\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\\n\\tat java.base/java.lang.Thread.run(Thread.java:1583)\\n",\n "status": 404\n}\n\'\'\')' failed: JSONDecodeError: Invalid control character at: line 8 column 190 (char 619)
02:03:53  ------------------------------------------------------------------------------
02:03:53  Isolate Entity Leader :: Isolate the entity-ownership Leader to ca... | FAIL |
02:03:53  Parent suite setup failed:
02:03:53  Evaluating expression 'json.loads(\'\'\'{\n "error": "javax.management.InstanceNotFoundException : org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "error_type": "javax.management.InstanceNotFoundException",\n "request": {\n  "mbean": "org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n  "type": "read"\n },\n "stacktrace": "javax.management.InstanceNotFoundException: org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1073)\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1343)\\n\\tat java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:921)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:46)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:41)\\n\\tat org.jolokia.backend.executor.AbstractMBeanServerExecutor.call(AbstractMBeanServerExecutor.java:90)\\n\\tat org.jolokia.handler.ReadHandler.getMBeanInfo(ReadHandler.java:233)\\n\\tat org.jolokia.handler.ReadHandler.getAllAttributesNames(ReadHandler.java:245)\\n\\tat org.jolokia.handler.ReadHandler.resolveAttributes(ReadHandler.java:221)\\n\\tat org.jolokia.handler.ReadHandler.f...
02:03:53      [ Message content over the limit has been removed. ]
02:03:53  ...lipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\\n\\tat org.eclipse.jetty.server.Server.handle(Server.java:516)\\n\\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)\\n\\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)\\n\\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)\\n\\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\\n\\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\\n\\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\\n\\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)\\n\\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\\n\\tat java.base/java.lang.Thread.run(Thread.java:1583)\\n",\n "status": 404\n}\n\'\'\')' failed: JSONDecodeError: Invalid control character at: line 8 column 190 (char 619)
02:03:53  ------------------------------------------------------------------------------
02:03:53  Check All Shards After Isolate :: Check all shards in controller.     | FAIL |
02:03:53  Parent suite setup failed:
02:03:53  Evaluating expression 'json.loads(\'\'\'{\n "error": "javax.management.InstanceNotFoundException : org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "error_type": "javax.management.InstanceNotFoundException",\n "request": {\n  "mbean": "org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n  "type": "read"\n },\n "stacktrace": "javax.management.InstanceNotFoundException: org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1073)\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1343)\\n\\tat java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:921)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:46)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:41)\\n\\tat org.jolokia.backend.executor.AbstractMBeanServerExecutor.call(AbstractMBeanServerExecutor.java:90)\\n\\tat org.jolokia.handler.ReadHandler.getMBeanInfo(ReadHandler.java:233)\\n\\tat org.jolokia.handler.ReadHandler.getAllAttributesNames(ReadHandler.java:245)\\n\\tat org.jolokia.handler.ReadHandler.resolveAttributes(ReadHandler.java:221)\\n\\tat org.jolokia.handler.ReadHandler.f...
02:03:53      [ Message content over the limit has been removed. ]
02:03:53  ...lipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\\n\\tat org.eclipse.jetty.server.Server.handle(Server.java:516)\\n\\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)\\n\\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)\\n\\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)\\n\\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\\n\\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\\n\\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\\n\\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)\\n\\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\\n\\tat java.base/java.lang.Thread.run(Thread.java:1583)\\n",\n "status": 404\n}\n\'\'\')' failed: JSONDecodeError: Invalid control character at: line 8 column 190 (char 619)
02:03:53  ------------------------------------------------------------------------------
02:03:53  Rejoin Entity Leader :: Rejoin the entity-ownership Leader.           | FAIL |
02:03:53  Parent suite setup failed:
02:03:53  Evaluating expression 'json.loads(\'\'\'{\n "error": "javax.management.InstanceNotFoundException : org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "error_type": "javax.management.InstanceNotFoundException",\n "request": {\n  "mbean": "org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n  "type": "read"\n },\n "stacktrace": "javax.management.InstanceNotFoundException: org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1073)\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1343)\\n\\tat java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:921)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:46)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:41)\\n\\tat org.jolokia.backend.executor.AbstractMBeanServerExecutor.call(AbstractMBeanServerExecutor.java:90)\\n\\tat org.jolokia.handler.ReadHandler.getMBeanInfo(ReadHandler.java:233)\\n\\tat org.jolokia.handler.ReadHandler.getAllAttributesNames(ReadHandler.java:245)\\n\\tat org.jolokia.handler.ReadHandler.resolveAttributes(ReadHandler.java:221)\\n\\tat org.jolokia.handler.ReadHandler.f...
02:03:53      [ Message content over the limit has been removed. ]
02:03:53  ...lipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\\n\\tat org.eclipse.jetty.server.Server.handle(Server.java:516)\\n\\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)\\n\\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)\\n\\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)\\n\\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\\n\\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\\n\\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\\n\\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)\\n\\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\\n\\tat java.base/java.lang.Thread.run(Thread.java:1583)\\n",\n "status": 404\n}\n\'\'\')' failed: JSONDecodeError: Invalid control character at: line 8 column 190 (char 619)
02:03:53  ------------------------------------------------------------------------------
02:03:53  Check All Shards After Rejoin :: Check all shards in controller.      | FAIL |
02:03:53  Parent suite setup failed:
02:03:53  Evaluating expression 'json.loads(\'\'\'{\n "error": "javax.management.InstanceNotFoundException : org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "error_type": "javax.management.InstanceNotFoundException",\n "request": {\n  "mbean": "org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n  "type": "read"\n },\n "stacktrace": "javax.management.InstanceNotFoundException: org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1073)\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1343)\\n\\tat java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:921)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:46)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:41)\\n\\tat org.jolokia.backend.executor.AbstractMBeanServerExecutor.call(AbstractMBeanServerExecutor.java:90)\\n\\tat org.jolokia.handler.ReadHandler.getMBeanInfo(ReadHandler.java:233)\\n\\tat org.jolokia.handler.ReadHandler.getAllAttributesNames(ReadHandler.java:245)\\n\\tat org.jolokia.handler.ReadHandler.resolveAttributes(ReadHandler.java:221)\\n\\tat org.jolokia.handler.ReadHandler.f...
02:03:53      [ Message content over the limit has been removed. ]
02:03:53  ...lipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\\n\\tat org.eclipse.jetty.server.Server.handle(Server.java:516)\\n\\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)\\n\\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)\\n\\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)\\n\\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\\n\\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\\n\\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\\n\\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)\\n\\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\\n\\tat java.base/java.lang.Thread.run(Thread.java:1583)\\n",\n "status": 404\n}\n\'\'\')' failed: JSONDecodeError: Invalid control character at: line 8 column 190 (char 619)
02:03:53  ------------------------------------------------------------------------------
02:03:54  controller-clustering-tell.txt.Entity Isolate :: Suite for perform... | FAIL |
02:03:54  Suite setup failed:
02:03:54  Evaluating expression 'json.loads(\'\'\'{\n "error": "javax.management.InstanceNotFoundException : org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "error_type": "javax.management.InstanceNotFoundException",\n "request": {\n  "mbean": "org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n  "type": "read"\n },\n "stacktrace": "javax.management.InstanceNotFoundException: org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1073)\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1343)\\n\\tat java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:921)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:46)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:41)\\n\\tat org.jolokia.backend.executor.AbstractMBeanServerExecutor.call(AbstractMBeanServerExecutor.java:90)\\n\\tat org.jolokia.handler.ReadHandler.getMBeanInfo(ReadHandler.java:233)\\n\\tat org.jolokia.handler.ReadHandler.getAllAttributesNames(ReadHandler.java:245)\\n\\tat org.jolokia.handler.ReadHandler.resolveAttributes(ReadHandler.java:221)\\n\\tat org.jolokia.handler.ReadHandler.f...
02:03:54      [ Message content over the limit has been removed. ]
02:03:54  ...lipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\\n\\tat org.eclipse.jetty.server.Server.handle(Server.java:516)\\n\\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)\\n\\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)\\n\\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)\\n\\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\\n\\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\\n\\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\\n\\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)\\n\\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\\n\\tat java.base/java.lang.Thread.run(Thread.java:1583)\\n",\n "status": 404\n}\n\'\'\')' failed: JSONDecodeError: Invalid control character at: line 8 column 190 (char 619)
02:03:54  
02:03:54  5 tests, 0 passed, 5 failed
02:03:54  ==============================================================================
02:03:54  controller-clustering-tell.txt.Buycar Failover Isolation :: This test focus...
02:03:54  ==============================================================================
02:03:56  Add_Cars_To_Leader_And_Verify :: Add all needed cars to car Leader... | FAIL |
02:03:56  Parent suite setup failed:
02:03:56  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:56  ------------------------------------------------------------------------------
02:03:56  Add_People_To_First_Follower_And_Verify :: Add all needed people t... | FAIL |
02:03:57  Parent suite setup failed:
02:03:57  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:57  ------------------------------------------------------------------------------
02:03:57  Buy_Cars_On_Leader_And_Verify :: Buy some cars on the leader member.  | FAIL |
02:03:57  Parent suite setup failed:
02:03:57  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:57  ------------------------------------------------------------------------------
02:03:57  Buy_Cars_On_Follower_And_Verify :: Buy some cars on the first foll... | FAIL |
02:03:57  Parent suite setup failed:
02:03:57  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:57  ------------------------------------------------------------------------------
02:03:57  Isolate_and_Rejoin_People_Leader :: Previous people Leader is isol... | FAIL |
02:03:57  Parent suite setup failed:
02:03:57  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:57  ------------------------------------------------------------------------------
02:03:57  Buy_Cars_On_Leader_After_Rejoin_And_Verify :: Buy some cars on the... | FAIL |
02:03:57  Parent suite setup failed:
02:03:57  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:57  ------------------------------------------------------------------------------
02:03:57  Buy_Cars_On_Follower_After_Rejoin_And_Verify :: Buy some cars on t... | FAIL |
02:03:57  Parent suite setup failed:
02:03:57  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:57  ------------------------------------------------------------------------------
02:03:57  Delete_All_CarPeople :: DELETE car-people container. No verificati... | FAIL |
02:03:57  Parent suite setup failed:
02:03:57  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:57  ------------------------------------------------------------------------------
02:03:57  Delete_All_People :: DELETE people container. No verification beyo... | FAIL |
02:03:57  Parent suite setup failed:
02:03:57  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:57  ------------------------------------------------------------------------------
02:03:57  Delete_All_Cars :: DELETE cars container. No verification beyond h... | FAIL |
02:03:57  Parent suite setup failed:
02:03:57  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:57  ------------------------------------------------------------------------------
02:03:57  controller-clustering-tell.txt.Buycar Failover Isolation :: This t... | FAIL |
02:03:57  Suite setup failed:
02:03:57  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:57  
02:03:57  10 tests, 0 passed, 10 failed
02:03:57  ==============================================================================
02:03:57  controller-clustering-tell.txt.Car Failover Crud Isolation :: Suite mixing ...
02:03:57  ==============================================================================
02:03:59  Add_Original_Cars_On_Old_Leader_And_Verify :: Add initial cars on ... | FAIL |
02:03:59  Parent suite setup failed:
02:03:59  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:59  ------------------------------------------------------------------------------
02:03:59  Isolate_Original_Car_Leader :: Isolate the car Leader to cause a n... | FAIL |
02:03:59  Parent suite setup failed:
02:03:59  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:59  ------------------------------------------------------------------------------
02:03:59  Wait_For_New_Leader :: Wait until new car Leader is elected.          | FAIL |
02:03:59  Parent suite setup failed:
02:03:59  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:59  ------------------------------------------------------------------------------
02:03:59  See_Original_Cars_On_New_Leader :: GET cars from new Leader, shoul... | FAIL |
02:03:59  Parent suite setup failed:
02:03:59  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:59  ------------------------------------------------------------------------------
02:03:59  See_Original_Cars_On_New_Followers :: The same check on other exis... | FAIL |
02:03:59  Parent suite setup failed:
02:03:59  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:59  ------------------------------------------------------------------------------
02:03:59  Delete_Original_Cars_On_New_Leader :: Delete cars on the new Leader.  | FAIL |
02:03:59  Parent suite setup failed:
02:03:59  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:59  ------------------------------------------------------------------------------
02:03:59  Add_Leader_Cars_On_New_Leader :: Add cars on the new Leader.          | FAIL |
02:03:59  Parent suite setup failed:
02:03:59  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:59  ------------------------------------------------------------------------------
02:03:59  See_Leader_Cars_On_New_Leader :: GET cars from new Leader, should ... | FAIL |
02:03:59  Parent suite setup failed:
02:03:59  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:59  ------------------------------------------------------------------------------
02:03:59  See_Leader_Cars_On_New_Followers :: The same check on other existi... | FAIL |
02:03:59  Parent suite setup failed:
02:03:59  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:59  ------------------------------------------------------------------------------
02:03:59  Delete_Leader_Cars_On_New_First_Follower :: Delete cars in new fir... | FAIL |
02:03:59  Parent suite setup failed:
02:03:59  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:59  ------------------------------------------------------------------------------
02:03:59  Add_Follower_Cars_On_New_First_Follower :: Add cars on the new fir... | FAIL |
02:03:59  Parent suite setup failed:
02:03:59  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:59  ------------------------------------------------------------------------------
02:03:59  See_Folower_Cars_On_New_Leader :: Get cars from the new Leader, sh... | FAIL |
02:03:59  Parent suite setup failed:
02:03:59  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:59  ------------------------------------------------------------------------------
02:03:59  See_Follower_Cars_On_New_Followers :: The same check on other exis... | FAIL |
02:03:59  Parent suite setup failed:
02:03:59  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:59  ------------------------------------------------------------------------------
02:03:59  Rejoin_Old_Car_Leader :: Rejoin the isolated member without deleti... | FAIL |
02:03:59  Parent suite setup failed:
02:03:59  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:59  ------------------------------------------------------------------------------
02:03:59  See_Folower_Cars_On_Old_Leader :: GET cars from the restarted memb... | FAIL |
02:03:59  Parent suite setup failed:
02:03:59  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:59  ------------------------------------------------------------------------------
02:03:59  Delete_Follower_Cars_On_New_Leader :: Delete cars on the last Leader. | FAIL |
02:03:59  Parent suite setup failed:
02:03:59  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:59  ------------------------------------------------------------------------------
02:03:59  controller-clustering-tell.txt.Car Failover Crud Isolation :: Suit... | FAIL |
02:03:59  Suite setup failed:
02:03:59  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:03:59  
02:03:59  16 tests, 0 passed, 16 failed
02:03:59  ==============================================================================
02:03:59  controller-clustering-tell.txt.Car Outage Corners :: Cluster suite for test...
02:03:59  ==============================================================================
02:04:02  Stop_Majority_Of_The_Followers :: Stop half plus one car Follower ... | FAIL |
02:04:02  Parent suite setup failed:
02:04:02  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:04:02  ------------------------------------------------------------------------------
02:04:02  Attempt_To_Add_Cars_To_Leader :: Adding cars should fail, as major... | FAIL |
02:04:02  Parent suite setup failed:
02:04:02  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:04:02  ------------------------------------------------------------------------------
02:04:02  Start_Tipping_Follower :: Start one Follower member without persis... | FAIL |
02:04:02  Parent suite setup failed:
02:04:02  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:04:02  ------------------------------------------------------------------------------
02:04:02  Add_Cars_On_Tipping_Follower :: Add cars on the tipping Follower.     | FAIL |
02:04:02  Parent suite setup failed:
02:04:02  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:04:02  ------------------------------------------------------------------------------
02:04:02  See_Cars_On_Existing_Members :: On each up member: GET cars, shoul... | FAIL |
02:04:02  Parent suite setup failed:
02:04:02  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:04:02  ------------------------------------------------------------------------------
02:04:02  Start_Other_Followers :: Start other followers without persisted d... | FAIL |
02:04:02  Parent suite setup failed:
02:04:02  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:04:02  ------------------------------------------------------------------------------
02:04:02  See_Cars_On_New_Follower_Leader :: GET cars from a new follower to... | FAIL |
02:04:02  Parent suite setup failed:
02:04:02  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:04:02  ------------------------------------------------------------------------------
02:04:02  Delete_Cars_On_Leader :: Delete cars on Leader.                       | FAIL |
02:04:02  Parent suite setup failed:
02:04:02  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:04:02  ------------------------------------------------------------------------------
02:04:02  controller-clustering-tell.txt.Car Outage Corners :: Cluster suite... | FAIL |
02:04:02  Suite setup failed:
02:04:02  HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
02:04:02  
02:04:02  8 tests, 0 passed, 8 failed
02:04:02  ==============================================================================
02:04:02  controller-clustering-tell.txt                                        | FAIL |
02:04:02  162 tests, 13 passed, 149 failed
02:04:02  ==============================================================================
02:04:02  Output:  /w/workspace/controller-csit-3node-clustering-tell-all-scandium/output.xml
02:04:17  Log:     /w/workspace/controller-csit-3node-clustering-tell-all-scandium/log.html
02:04:17  Report:  /w/workspace/controller-csit-3node-clustering-tell-all-scandium/report.html
02:04:18  + true
02:04:18  + echo 'Examining the files in data/log and checking filesize'
02:04:18  Examining the files in data/log and checking filesize
02:04:18  + ssh 10.30.170.28 'ls -altr /tmp/karaf-0.21.3-SNAPSHOT/data/log/'
02:04:18  Warning: Permanently added '10.30.170.28' (ECDSA) to the list of known hosts.
02:04:18  total 11932
02:04:18  drwxrwxr-x 2 jenkins jenkins     4096 Jul 20 22:55 .
02:04:18  -rw-rw-r-- 1 jenkins jenkins     1720 Jul 20 22:55 karaf_console.log
02:04:18  drwxrwxr-x 9 jenkins jenkins     4096 Jul 21 01:57 ..
02:04:18  -rw-rw-r-- 1 jenkins jenkins 12199880 Jul 21 02:04 karaf.log
02:04:18  + ssh 10.30.170.28 'du -hs /tmp/karaf-0.21.3-SNAPSHOT/data/log/*'
02:04:18  Warning: Permanently added '10.30.170.28' (ECDSA) to the list of known hosts.
02:04:18  12M	/tmp/karaf-0.21.3-SNAPSHOT/data/log/karaf.log
02:04:18  4.0K	/tmp/karaf-0.21.3-SNAPSHOT/data/log/karaf_console.log
02:04:18  + ssh 10.30.171.142 'ls -altr /tmp/karaf-0.21.3-SNAPSHOT/data/log/'
02:04:18  Warning: Permanently added '10.30.171.142' (ECDSA) to the list of known hosts.
02:04:18  total 7300
02:04:18  drwxrwxr-x 2 jenkins jenkins    4096 Jul 20 22:55 .
02:04:18  -rw-rw-r-- 1 jenkins jenkins    7610 Jul 20 23:05 karaf_console.log
02:04:18  drwxrwxr-x 9 jenkins jenkins    4096 Jul 21 01:57 ..
02:04:18  -rw-rw-r-- 1 jenkins jenkins 7450979 Jul 21 02:04 karaf.log
02:04:18  + ssh 10.30.171.142 'du -hs /tmp/karaf-0.21.3-SNAPSHOT/data/log/*'
02:04:18  Warning: Permanently added '10.30.171.142' (ECDSA) to the list of known hosts.
02:04:18  7.2M	/tmp/karaf-0.21.3-SNAPSHOT/data/log/karaf.log
02:04:18  8.0K	/tmp/karaf-0.21.3-SNAPSHOT/data/log/karaf_console.log
02:04:18  + ssh 10.30.171.124 'ls -altr /tmp/karaf-0.21.3-SNAPSHOT/data/log/'
02:04:18  Warning: Permanently added '10.30.171.124' (ECDSA) to the list of known hosts.
02:04:19  total 263272
02:04:19  drwxrwxr-x 2 jenkins jenkins      4096 Jul 20 22:55 .
02:04:19  -rw-rw-r-- 1 jenkins jenkins     11709 Jul 20 23:05 karaf_console.log
02:04:19  drwxrwxr-x 4 jenkins jenkins      4096 Jul 21 01:57 ..
02:04:19  -rw-rw-r-- 1 jenkins jenkins 269565946 Jul 21 02:04 karaf.log
02:04:19  + ssh 10.30.171.124 'du -hs /tmp/karaf-0.21.3-SNAPSHOT/data/log/*'
02:04:19  Warning: Permanently added '10.30.171.124' (ECDSA) to the list of known hosts.
02:04:19  258M	/tmp/karaf-0.21.3-SNAPSHOT/data/log/karaf.log
02:04:19  12K	/tmp/karaf-0.21.3-SNAPSHOT/data/log/karaf_console.log
02:04:19  + set +e
02:04:19  ++ seq 1 3
02:04:19  + for i in $(seq 1 "${NUM_ODL_SYSTEM}")
02:04:19  + CONTROLLERIP=ODL_SYSTEM_1_IP
02:04:19  + echo 'Let'\''s take the karaf thread dump again'
02:04:19  Let's take the karaf thread dump again
02:04:19  + ssh 10.30.170.28 'sudo ps aux'
02:04:19  Warning: Permanently added '10.30.170.28' (ECDSA) to the list of known hosts.
02:04:19  ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-scandium/ps_after.log
02:04:19  ++ grep -v grep
02:04:19  ++ tr -s ' '
02:04:19  ++ cut -f2 '-d '
02:04:19  + pid=32146
02:04:19  + echo 'karaf main: org.apache.karaf.main.Main, pid:32146'
02:04:19  karaf main: org.apache.karaf.main.Main, pid:32146
02:04:19  + ssh 10.30.170.28 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 32146'
02:04:19  Warning: Permanently added '10.30.170.28' (ECDSA) to the list of known hosts.
02:04:20  + echo 'killing karaf process...'
02:04:20  killing karaf process...
02:04:20  + ssh 10.30.170.28 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh'
02:04:20  Warning: Permanently added '10.30.170.28' (ECDSA) to the list of known hosts.
02:04:20  + for i in $(seq 1 "${NUM_ODL_SYSTEM}")
02:04:20  + CONTROLLERIP=ODL_SYSTEM_2_IP
02:04:20  + echo 'Let'\''s take the karaf thread dump again'
02:04:20  Let's take the karaf thread dump again
02:04:20  + ssh 10.30.171.142 'sudo ps aux'
02:04:20  Warning: Permanently added '10.30.171.142' (ECDSA) to the list of known hosts.
02:04:20  ++ tr -s ' '
02:04:20  ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-scandium/ps_after.log
02:04:20  ++ cut -f2 '-d '
02:04:20  ++ grep -v grep
02:04:20  + pid=36439
02:04:20  + echo 'karaf main: org.apache.karaf.main.Main, pid:36439'
02:04:20  karaf main: org.apache.karaf.main.Main, pid:36439
02:04:20  + ssh 10.30.171.142 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 36439'
02:04:20  Warning: Permanently added '10.30.171.142' (ECDSA) to the list of known hosts.
02:04:21  + echo 'killing karaf process...'
02:04:21  killing karaf process...
02:04:21  + ssh 10.30.171.142 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh'
02:04:21  Warning: Permanently added '10.30.171.142' (ECDSA) to the list of known hosts.
02:04:21  + for i in $(seq 1 "${NUM_ODL_SYSTEM}")
02:04:21  + CONTROLLERIP=ODL_SYSTEM_3_IP
02:04:21  + echo 'Let'\''s take the karaf thread dump again'
02:04:21  Let's take the karaf thread dump again
02:04:21  + ssh 10.30.171.124 'sudo ps aux'
02:04:21  Warning: Permanently added '10.30.171.124' (ECDSA) to the list of known hosts.
02:04:21  ++ tr -s ' '
02:04:21  ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-scandium/ps_after.log
02:04:21  ++ cut -f2 '-d '
02:04:21  ++ grep -v grep
02:04:21  + pid=6095
02:04:21  + echo 'karaf main: org.apache.karaf.main.Main, pid:6095'
02:04:21  karaf main: org.apache.karaf.main.Main, pid:6095
02:04:21  + ssh 10.30.171.124 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 6095'
02:04:21  Warning: Permanently added '10.30.171.124' (ECDSA) to the list of known hosts.
02:04:22  + echo 'killing karaf process...'
02:04:22  killing karaf process...
02:04:22  + ssh 10.30.171.124 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh'
02:04:22  Warning: Permanently added '10.30.171.124' (ECDSA) to the list of known hosts.
02:04:22  + sleep 5
02:04:27  ++ seq 1 3
02:04:27  + for i in $(seq 1 "${NUM_ODL_SYSTEM}")
02:04:27  + CONTROLLERIP=ODL_SYSTEM_1_IP
02:04:27  + echo 'Compressing karaf.log 1'
02:04:27  Compressing karaf.log 1
02:04:27  + ssh 10.30.170.28 gzip --best /tmp/karaf-0.21.3-SNAPSHOT/data/log/karaf.log
02:04:27  Warning: Permanently added '10.30.170.28' (ECDSA) to the list of known hosts.
02:04:27  + echo 'Fetching compressed karaf.log 1'
02:04:27  Fetching compressed karaf.log 1
02:04:27  + scp 10.30.170.28:/tmp/karaf-0.21.3-SNAPSHOT/data/log/karaf.log.gz odl1_karaf.log.gz
02:04:27  Warning: Permanently added '10.30.170.28' (ECDSA) to the list of known hosts.
02:04:28  + ssh 10.30.170.28 rm -f /tmp/karaf-0.21.3-SNAPSHOT/data/log/karaf.log.gz
02:04:28  Warning: Permanently added '10.30.170.28' (ECDSA) to the list of known hosts.
02:04:28  + scp 10.30.170.28:/tmp/karaf-0.21.3-SNAPSHOT/data/log/karaf_console.log odl1_karaf_console.log
02:04:28  Warning: Permanently added '10.30.170.28' (ECDSA) to the list of known hosts.
02:04:28  + ssh 10.30.170.28 rm -f /tmp/karaf-0.21.3-SNAPSHOT/data/log/karaf_console.log
02:04:28  Warning: Permanently added '10.30.170.28' (ECDSA) to the list of known hosts.
02:04:28  + echo 'Fetch GC logs'
02:04:28  Fetch GC logs
02:04:28  + mkdir -p gclogs-1
02:04:28  + scp '10.30.170.28:/tmp/karaf-0.21.3-SNAPSHOT/data/log/*.log' gclogs-1/
02:04:28  Warning: Permanently added '10.30.170.28' (ECDSA) to the list of known hosts.
02:04:28  scp: /tmp/karaf-0.21.3-SNAPSHOT/data/log/*.log: No such file or directory
02:04:28  + for i in $(seq 1 "${NUM_ODL_SYSTEM}")
02:04:28  + CONTROLLERIP=ODL_SYSTEM_2_IP
02:04:28  + echo 'Compressing karaf.log 2'
02:04:28  Compressing karaf.log 2
02:04:28  + ssh 10.30.171.142 gzip --best /tmp/karaf-0.21.3-SNAPSHOT/data/log/karaf.log
02:04:29  Warning: Permanently added '10.30.171.142' (ECDSA) to the list of known hosts.
02:04:29  + echo 'Fetching compressed karaf.log 2'
02:04:29  Fetching compressed karaf.log 2
02:04:29  + scp 10.30.171.142:/tmp/karaf-0.21.3-SNAPSHOT/data/log/karaf.log.gz odl2_karaf.log.gz
02:04:29  Warning: Permanently added '10.30.171.142' (ECDSA) to the list of known hosts.
02:04:29  + ssh 10.30.171.142 rm -f /tmp/karaf-0.21.3-SNAPSHOT/data/log/karaf.log.gz
02:04:29  Warning: Permanently added '10.30.171.142' (ECDSA) to the list of known hosts.
02:04:29  + scp 10.30.171.142:/tmp/karaf-0.21.3-SNAPSHOT/data/log/karaf_console.log odl2_karaf_console.log
02:04:29  Warning: Permanently added '10.30.171.142' (ECDSA) to the list of known hosts.
02:04:30  + ssh 10.30.171.142 rm -f /tmp/karaf-0.21.3-SNAPSHOT/data/log/karaf_console.log
02:04:30  Warning: Permanently added '10.30.171.142' (ECDSA) to the list of known hosts.
02:04:30  + echo 'Fetch GC logs'
02:04:30  Fetch GC logs
02:04:30  + mkdir -p gclogs-2
02:04:30  + scp '10.30.171.142:/tmp/karaf-0.21.3-SNAPSHOT/data/log/*.log' gclogs-2/
02:04:30  Warning: Permanently added '10.30.171.142' (ECDSA) to the list of known hosts.
02:04:30  scp: /tmp/karaf-0.21.3-SNAPSHOT/data/log/*.log: No such file or directory
02:04:30  + for i in $(seq 1 "${NUM_ODL_SYSTEM}")
02:04:30  + CONTROLLERIP=ODL_SYSTEM_3_IP
02:04:30  + echo 'Compressing karaf.log 3'
02:04:30  Compressing karaf.log 3
02:04:30  + ssh 10.30.171.124 gzip --best /tmp/karaf-0.21.3-SNAPSHOT/data/log/karaf.log
02:04:30  Warning: Permanently added '10.30.171.124' (ECDSA) to the list of known hosts.
02:04:33  + echo 'Fetching compressed karaf.log 3'
02:04:33  Fetching compressed karaf.log 3
02:04:33  + scp 10.30.171.124:/tmp/karaf-0.21.3-SNAPSHOT/data/log/karaf.log.gz odl3_karaf.log.gz
02:04:33  Warning: Permanently added '10.30.171.124' (ECDSA) to the list of known hosts.
02:04:33  + ssh 10.30.171.124 rm -f /tmp/karaf-0.21.3-SNAPSHOT/data/log/karaf.log.gz
02:04:33  Warning: Permanently added '10.30.171.124' (ECDSA) to the list of known hosts.
02:04:33  + scp 10.30.171.124:/tmp/karaf-0.21.3-SNAPSHOT/data/log/karaf_console.log odl3_karaf_console.log
02:04:33  Warning: Permanently added '10.30.171.124' (ECDSA) to the list of known hosts.
02:04:33  + ssh 10.30.171.124 rm -f /tmp/karaf-0.21.3-SNAPSHOT/data/log/karaf_console.log
02:04:33  Warning: Permanently added '10.30.171.124' (ECDSA) to the list of known hosts.
02:04:34  + echo 'Fetch GC logs'
02:04:34  Fetch GC logs
02:04:34  + mkdir -p gclogs-3
02:04:34  + scp '10.30.171.124:/tmp/karaf-0.21.3-SNAPSHOT/data/log/*.log' gclogs-3/
02:04:34  Warning: Permanently added '10.30.171.124' (ECDSA) to the list of known hosts.
02:04:34  scp: /tmp/karaf-0.21.3-SNAPSHOT/data/log/*.log: No such file or directory
02:04:34  + echo 'Examine copied files'
02:04:34  Examine copied files
02:04:34  + ls -lt
02:04:34  total 112160
02:04:34  drwxrwxr-x. 2 jenkins jenkins         6 Jul 21 02:04 gclogs-3
02:04:34  -rw-rw-r--. 1 jenkins jenkins     11709 Jul 21 02:04 odl3_karaf_console.log
02:04:34  -rw-rw-r--. 1 jenkins jenkins   2860689 Jul 21 02:04 odl3_karaf.log.gz
02:04:34  drwxrwxr-x. 2 jenkins jenkins         6 Jul 21 02:04 gclogs-2
02:04:34  -rw-rw-r--. 1 jenkins jenkins      7610 Jul 21 02:04 odl2_karaf_console.log
02:04:34  -rw-rw-r--. 1 jenkins jenkins    550585 Jul 21 02:04 odl2_karaf.log.gz
02:04:34  drwxrwxr-x. 2 jenkins jenkins         6 Jul 21 02:04 gclogs-1
02:04:34  -rw-rw-r--. 1 jenkins jenkins      1720 Jul 21 02:04 odl1_karaf_console.log
02:04:34  -rw-rw-r--. 1 jenkins jenkins    786714 Jul 21 02:04 odl1_karaf.log.gz
02:04:34  -rw-rw-r--. 1 jenkins jenkins    147615 Jul 21 02:04 karaf_3_6095_threads_after.log
02:04:34  -rw-rw-r--. 1 jenkins jenkins     13932 Jul 21 02:04 ps_after.log
02:04:34  -rw-rw-r--. 1 jenkins jenkins    134734 Jul 21 02:04 karaf_2_36439_threads_after.log
02:04:34  -rw-rw-r--. 1 jenkins jenkins    126902 Jul 21 02:04 karaf_1_32146_threads_after.log
02:04:34  -rw-rw-r--. 1 jenkins jenkins    309422 Jul 21 02:04 report.html
02:04:34  -rw-rw-r--. 1 jenkins jenkins   4033217 Jul 21 02:04 log.html
02:04:34  -rw-rw-r--. 1 jenkins jenkins 105410824 Jul 21 02:04 output.xml
02:04:34  -rw-rw-r--. 1 jenkins jenkins      6069 Jul 20 22:58 testplan.txt
02:04:34  -rw-rw-r--. 1 jenkins jenkins    111942 Jul 20 22:58 karaf_3_2085_threads_before.log
02:04:34  -rw-rw-r--. 1 jenkins jenkins     14829 Jul 20 22:58 ps_before.log
02:04:34  -rw-rw-r--. 1 jenkins jenkins    114385 Jul 20 22:58 karaf_2_2083_threads_before.log
02:04:34  -rw-rw-r--. 1 jenkins jenkins    115206 Jul 20 22:58 karaf_1_2087_threads_before.log
02:04:34  -rw-rw-r--. 1 jenkins jenkins      3106 Jul 20 22:55 post-startup-script.sh
02:04:34  -rw-rw-r--. 1 jenkins jenkins       252 Jul 20 22:55 startup-script.sh
02:04:34  -rw-rw-r--. 1 jenkins jenkins      3456 Jul 20 22:55 configuration-script.sh
02:04:34  -rw-rw-r--. 1 jenkins jenkins       695 Jul 20 22:55 custom_shard_config.txt
02:04:34  -rw-rw-r--. 1 jenkins jenkins       136 Jul 20 22:55 scriptplan.txt
02:04:34  -rw-rw-r--. 1 jenkins jenkins       333 Jul 20 22:55 detect_variables.env
02:04:34  -rw-rw-r--. 1 jenkins jenkins      2619 Jul 20 22:55 pom.xml
02:04:34  -rw-rw-r--. 1 jenkins jenkins        92 Jul 20 22:55 set_variables.env
02:04:34  -rw-rw-r--. 1 jenkins jenkins       312 Jul 20 22:55 slave_addresses.txt
02:04:34  -rw-rw-r--. 1 jenkins jenkins       570 Jul 20 22:54 requirements.txt
02:04:34  -rw-rw-r--. 1 jenkins jenkins        26 Jul 20 22:54 env.properties
02:04:34  -rw-rw-r--. 1 jenkins jenkins       333 Jul 20 22:53 stack-parameters.yaml
02:04:34  drwxrwxr-x. 7 jenkins jenkins      4096 Jul 20 22:51 test
02:04:34  drwxrwxr-x. 2 jenkins jenkins         6 Jul 20 22:51 test@tmp
02:04:34  -rw-rw-r--. 1 jenkins jenkins      1398 Jul 13 18:31 maven-metadata.xml
02:04:34  + true
02:04:34  [controller-csit-3node-clustering-tell-all-scandium] $ /bin/sh /tmp/jenkins14690990600466458312.sh
02:04:34  Cleaning up Robot installation...
02:04:34  $ ssh-agent -k
02:04:34  unset SSH_AUTH_SOCK;
02:04:34  unset SSH_AGENT_PID;
02:04:34  echo Agent pid 5290 killed;
02:04:34  [ssh-agent] Stopped.
02:04:34  Recording plot data
02:04:34  Robot results publisher started...
02:04:34  INFO: Checking test criticality is deprecated and will be dropped in a future release!
02:04:34  -Parsing output xml:
02:04:37  Done!
02:04:37  -Copying log files to build dir:
02:04:40  Done!
02:04:40  -Assigning results to build:
02:04:41  Done!
02:04:41  -Checking thresholds:
02:04:41  Done!
02:04:41  Done publishing Robot results.
02:04:41  Build step 'Publish Robot Framework test results' changed build result to UNSTABLE
02:04:41  [PostBuildScript] - [INFO] Executing post build scripts.
02:04:41  [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins10721052136133483219.sh
02:04:41  Archiving csit artifacts
02:04:41  mv: cannot stat '*_1.png': No such file or directory
02:04:41  mv: cannot stat '/tmp/odl1_*': No such file or directory
02:04:41  mv: cannot stat '*_2.png': No such file or directory
02:04:41  mv: cannot stat '/tmp/odl2_*': No such file or directory
02:04:41  mv: cannot stat '*_3.png': No such file or directory
02:04:41  mv: cannot stat '/tmp/odl3_*': No such file or directory
02:04:41    % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
02:04:41                                   Dload  Upload   Total   Spent    Left  Speed
02:04:41  
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100 3144k    0 3144k    0     0  5112k      0 --:--:-- --:--:-- --:--:-- 5103k
100 8136k    0 8136k    0     0  5047k      0 --:--:--  0:00:01 --:--:-- 5044k
100 8411k    0 8411k    0     0  5104k      0 --:--:--  0:00:01 --:--:-- 5100k
02:04:42  Archive:  robot-plugin.zip
02:04:42    inflating: ./archives/robot-plugin/log.html  
02:04:42    inflating: ./archives/robot-plugin/output.xml  
02:04:43    inflating: ./archives/robot-plugin/report.html  
02:04:43  mv: cannot stat '*.log.gz': No such file or directory
02:04:43  mv: cannot stat '*.csv': No such file or directory
02:04:43  mv: cannot stat '*.png': No such file or directory
02:04:43  [PostBuildScript] - [INFO] Executing post build scripts.
02:04:43  [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins1385525082636996008.sh
02:04:43  [PostBuildScript] - [INFO] Executing post build scripts.
02:04:43  [EnvInject] - Injecting environment variables from a build step.
02:04:43  [EnvInject] - Injecting as environment variables the properties content 
02:04:43  OS_CLOUD=vex
02:04:43  OS_STACK_NAME=releng-controller-csit-3node-clustering-tell-all-scandium-65
02:04:43  
02:04:43  [EnvInject] - Variables injected successfully.
02:04:43  provisioning config files...
02:04:43  copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
02:04:43  [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins2321762777677871087.sh
02:04:43  ---> openstack-stack-delete.sh
02:04:43  Setup pyenv:
02:04:43    system
02:04:43    3.8.13
02:04:43    3.9.13
02:04:43    3.10.13
02:04:43  * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.python-version)
02:04:44  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-MXPj from file:/tmp/.os_lf_venv
02:04:45  ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
02:04:45  lftools 0.37.13 requires urllib3<2.1.0, but you have urllib3 2.5.0 which is incompatible.
02:04:46  lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes python-heatclient python-openstackclient 
02:05:00  lf-activate-venv(): INFO: Adding /tmp/venv-MXPj/bin to PATH
02:05:00  INFO: Retrieving stack cost for: releng-controller-csit-3node-clustering-tell-all-scandium-65
02:05:04  DEBUG: Successfully retrieved stack cost: total: 1.32
02:05:16  INFO: Deleting stack releng-controller-csit-3node-clustering-tell-all-scandium-65
02:05:16  Successfully deleted stack releng-controller-csit-3node-clustering-tell-all-scandium-65
02:05:16  [PostBuildScript] - [INFO] Executing post build scripts.
02:05:16  [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins3970530437497224414.sh
02:05:16  ---> sysstat.sh
02:05:17  [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins12980151673162757960.sh
02:05:17  ---> package-listing.sh
02:05:17  ++ facter osfamily
02:05:17  ++ tr '[:upper:]' '[:lower:]'
02:05:17  + OS_FAMILY=redhat
02:05:17  + workspace=/w/workspace/controller-csit-3node-clustering-tell-all-scandium
02:05:17  + START_PACKAGES=/tmp/packages_start.txt
02:05:17  + END_PACKAGES=/tmp/packages_end.txt
02:05:17  + DIFF_PACKAGES=/tmp/packages_diff.txt
02:05:17  + PACKAGES=/tmp/packages_start.txt
02:05:17  + '[' /w/workspace/controller-csit-3node-clustering-tell-all-scandium ']'
02:05:17  + PACKAGES=/tmp/packages_end.txt
02:05:17  + case "${OS_FAMILY}" in
02:05:17  + rpm -qa
02:05:17  + sort
02:05:17  + '[' -f /tmp/packages_start.txt ']'
02:05:17  + '[' -f /tmp/packages_end.txt ']'
02:05:17  + diff /tmp/packages_start.txt /tmp/packages_end.txt
02:05:17  + '[' /w/workspace/controller-csit-3node-clustering-tell-all-scandium ']'
02:05:17  + mkdir -p /w/workspace/controller-csit-3node-clustering-tell-all-scandium/archives/
02:05:17  + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/controller-csit-3node-clustering-tell-all-scandium/archives/
02:05:17  [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins7367995003687172402.sh
02:05:17  ---> capture-instance-metadata.sh
02:05:18  Setup pyenv:
02:05:18    system
02:05:18    3.8.13
02:05:18    3.9.13
02:05:18    3.10.13
02:05:18  * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.python-version)
02:05:18  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-MXPj from file:/tmp/.os_lf_venv
02:05:20  lf-activate-venv(): INFO: Installing: lftools 
02:05:30  lf-activate-venv(): INFO: Adding /tmp/venv-MXPj/bin to PATH
02:05:30  INFO: Running in OpenStack, capturing instance metadata
02:05:31  [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins2825698765690584340.sh
02:05:31  provisioning config files...
02:05:31  Could not find credentials [logs] for controller-csit-3node-clustering-tell-all-scandium #65
02:05:31  copy managed file [jenkins-log-archives-settings] to file:/w/workspace/controller-csit-3node-clustering-tell-all-scandium@tmp/config13943133434046703499tmp
02:05:31  Regular expression run condition: Expression=[^.*logs-s3.*], Label=[odl-logs-s3-cloudfront-index]
02:05:31  Run condition [Regular expression match] enabling perform for step [Provide Configuration files]
02:05:31  provisioning config files...
02:05:32  copy managed file [jenkins-s3-log-ship] to file:/home/jenkins/.aws/credentials
02:05:32  [EnvInject] - Injecting environment variables from a build step.
02:05:32  [EnvInject] - Injecting as environment variables the properties content 
02:05:32  SERVER_ID=logs
02:05:32  
02:05:32  [EnvInject] - Variables injected successfully.
02:05:32  [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins7837486513458007097.sh
02:05:32  ---> create-netrc.sh
02:05:32  WARN: Log server credential not found.
02:05:32  [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins7653513980623045717.sh
02:05:32  ---> python-tools-install.sh
02:05:32  Setup pyenv:
02:05:32    system
02:05:32    3.8.13
02:05:32    3.9.13
02:05:32    3.10.13
02:05:32  * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.python-version)
02:05:32  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-MXPj from file:/tmp/.os_lf_venv
02:05:34  lf-activate-venv(): INFO: Installing: lftools 
02:05:45  lf-activate-venv(): INFO: Adding /tmp/venv-MXPj/bin to PATH
02:05:45  [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins407515464053980945.sh
02:05:46  ---> sudo-logs.sh
02:05:46  Archiving 'sudo' log..
02:05:46  [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins13012255995105113601.sh
02:05:46  ---> job-cost.sh
02:05:46  Setup pyenv:
02:05:46    system
02:05:46    3.8.13
02:05:46    3.9.13
02:05:46    3.10.13
02:05:46  * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.python-version)
02:05:46  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-MXPj from file:/tmp/.os_lf_venv
02:05:48  lf-activate-venv(): INFO: Installing: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 
02:05:55  lf-activate-venv(): INFO: Adding /tmp/venv-MXPj/bin to PATH
02:05:55  DEBUG: total: 1.32
02:05:55  INFO: Retrieving Stack Cost...
02:05:56  INFO: Retrieving Pricing Info for: v3-standard-2
02:05:56  INFO: Archiving Costs
02:05:56  [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash -l /tmp/jenkins10033048091318292660.sh
02:05:56  ---> logs-deploy.sh
02:05:56  Setup pyenv:
02:05:56    system
02:05:56    3.8.13
02:05:56    3.9.13
02:05:56    3.10.13
02:05:56  * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.python-version)
02:05:56  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-MXPj from file:/tmp/.os_lf_venv
02:05:58  lf-activate-venv(): INFO: Installing: lftools 
02:06:08  lf-activate-venv(): INFO: Adding /tmp/venv-MXPj/bin to PATH
02:06:08  WARNING: Nexus logging server not set
02:06:08  INFO: S3 path logs/releng/vex-yul-odl-jenkins-1/controller-csit-3node-clustering-tell-all-scandium/65/
02:06:08  INFO: archiving logs to S3
02:06:09  ---> uname -a:
02:06:09  Linux prd-centos8-robot-2c-8g-44711.novalocal 4.18.0-553.5.1.el8.x86_64 #1 SMP Tue May 21 05:46:01 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
02:06:09  
02:06:09  
02:06:09  ---> lscpu:
02:06:09  Architecture:        x86_64
02:06:09  CPU op-mode(s):      32-bit, 64-bit
02:06:09  Byte Order:          Little Endian
02:06:09  CPU(s):              2
02:06:09  On-line CPU(s) list: 0,1
02:06:09  Thread(s) per core:  1
02:06:09  Core(s) per socket:  1
02:06:09  Socket(s):           2
02:06:09  NUMA node(s):        1
02:06:09  Vendor ID:           AuthenticAMD
02:06:09  CPU family:          23
02:06:09  Model:               49
02:06:09  Model name:          AMD EPYC-Rome Processor
02:06:09  Stepping:            0
02:06:09  CPU MHz:             2799.998
02:06:09  BogoMIPS:            5599.99
02:06:09  Virtualization:      AMD-V
02:06:09  Hypervisor vendor:   KVM
02:06:09  Virtualization type: full
02:06:09  L1d cache:           32K
02:06:09  L1i cache:           32K
02:06:09  L2 cache:            512K
02:06:09  L3 cache:            16384K
02:06:09  NUMA node0 CPU(s):   0,1
02:06:09  Flags:               fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities
02:06:09  
02:06:09  
02:06:09  ---> nproc:
02:06:09  2
02:06:09  
02:06:09  
02:06:09  ---> df -h:
02:06:09  Filesystem      Size  Used Avail Use% Mounted on
02:06:09  devtmpfs        3.8G     0  3.8G   0% /dev
02:06:09  tmpfs           3.8G     0  3.8G   0% /dev/shm
02:06:09  tmpfs           3.8G   17M  3.8G   1% /run
02:06:09  tmpfs           3.8G     0  3.8G   0% /sys/fs/cgroup
02:06:09  /dev/vda1        40G  8.5G   32G  22% /
02:06:09  tmpfs           770M     0  770M   0% /run/user/1001
02:06:09  
02:06:09  
02:06:09  ---> free -m:
02:06:09                total        used        free      shared  buff/cache   available
02:06:09  Mem:           7697         658        4625          19        2413        6741
02:06:09  Swap:          1023           0        1023
02:06:09  
02:06:09  
02:06:09  ---> ip addr:
02:06:09  1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
02:06:09      link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
02:06:09      inet 127.0.0.1/8 scope host lo
02:06:09         valid_lft forever preferred_lft forever
02:06:09      inet6 ::1/128 scope host 
02:06:09         valid_lft forever preferred_lft forever
02:06:09  2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1458 qdisc mq state UP group default qlen 1000
02:06:09      link/ether fa:16:3e:ed:52:18 brd ff:ff:ff:ff:ff:ff
02:06:09      altname enp0s3
02:06:09      altname ens3
02:06:09      inet 10.30.171.156/23 brd 10.30.171.255 scope global dynamic noprefixroute eth0
02:06:09         valid_lft 74653sec preferred_lft 74653sec
02:06:09      inet6 fe80::f816:3eff:feed:5218/64 scope link 
02:06:09         valid_lft forever preferred_lft forever
02:06:09  
02:06:09  
02:06:09  ---> sar -b -r -n DEV:
02:06:09  Linux 4.18.0-553.5.1.el8.x86_64 (prd-centos8-robot-2c-8g-44711.novalocal) 	07/21/2025 	_x86_64_	(2 CPU)
02:06:09  
02:06:09  12:00:01 AM       tps      rtps      wtps   bread/s   bwrtn/s
02:06:09  12:01:01 AM      0.92      0.00      0.92      0.00    206.18
02:06:09  12:02:01 AM      0.43      0.00      0.43      0.00     28.75
02:06:09  12:03:01 AM      0.22      0.00      0.22      0.00     12.70
02:06:09  12:04:01 AM      0.13      0.00      0.13      0.00     33.51
02:06:09  12:05:01 AM      0.18      0.00      0.18      0.00     15.76
02:06:09  12:06:01 AM      0.35      0.00      0.35      0.00      9.07
02:06:09  12:07:01 AM      0.50      0.03      0.47      4.53     22.79
02:06:09  12:08:01 AM      0.40      0.03      0.37      3.07     23.28
02:06:09  12:09:01 AM      0.22      0.00      0.22      0.00     16.41
02:06:09  12:10:01 AM      0.13      0.00      0.13      0.00     10.40
02:06:09  12:11:01 AM      0.52      0.00      0.52      0.00     29.87
02:06:09  12:12:01 AM      0.27      0.00      0.27      0.00     18.43
02:06:09  12:13:01 AM      0.13      0.00      0.13      0.00      8.68
02:06:09  12:14:01 AM      0.17      0.00      0.17      0.00     16.28
02:06:09  12:15:01 AM      0.13      0.00      0.13      0.00     15.46
02:06:09  12:16:01 AM      0.37      0.00      0.37      0.00     18.39
02:06:09  12:17:01 AM      0.17      0.00      0.17      0.00     18.55
02:06:09  12:18:01 AM      0.23      0.00      0.23      0.00     15.18
02:06:09  12:19:01 AM      0.15      0.00      0.15      0.00     22.31
02:06:09  12:20:01 AM      0.15      0.00      0.15      0.00     12.01
02:06:09  12:21:01 AM      0.53      0.00      0.53      0.00     30.41
02:06:09  12:22:01 AM      0.25      0.00      0.25      0.00     13.90
02:06:09  12:23:01 AM      0.15      0.00      0.15      0.00     45.73
02:06:09  12:24:01 AM      0.15      0.00      0.15      0.00     50.94
02:06:09  12:25:01 AM      0.20      0.00      0.20      0.00     78.79
02:06:09  12:26:01 AM      0.60      0.00      0.60      0.00     24.15
02:06:09  12:27:01 AM      0.55      0.00      0.55      0.00     18.28
02:06:09  12:28:01 AM      0.40      0.00      0.40      0.00     16.23
02:06:09  12:29:01 AM      0.13      0.00      0.13      0.00      8.53
02:06:09  12:30:01 AM      0.13      0.00      0.13      0.00     15.86
02:06:09  12:31:01 AM      0.40      0.00      0.40      0.00     14.85
02:06:09  12:32:01 AM      0.20      0.00      0.20      0.00    117.25
02:06:09  12:33:01 AM      0.22      0.00      0.22      0.00     57.01
02:06:09  12:34:01 AM      0.23      0.00      0.23      0.00     10.01
02:06:09  12:35:01 AM      0.30      0.00      0.30      0.00     18.10
02:06:09  12:36:01 AM      0.30      0.00      0.30      0.00     16.71
02:06:09  12:37:01 AM      0.32      0.00      0.32      0.00     19.76
02:06:09  12:38:01 AM      0.18      0.00      0.18      0.00     39.18
02:06:09  12:39:01 AM      0.13      0.00      0.13      0.00     57.73
02:06:09  12:40:01 AM      0.27      0.00      0.27      0.00     90.67
02:06:09  12:41:01 AM      0.55      0.00      0.55      0.00     13.88
02:06:09  12:42:01 AM      0.40      0.00      0.40      0.00     19.85
02:06:09  12:43:01 AM      0.20      0.00      0.20      0.00     16.18
02:06:09  12:44:01 AM      0.15      0.00      0.15      0.00      8.55
02:06:09  12:45:02 AM      0.22      0.00      0.22      0.00     17.51
02:06:09  12:46:01 AM      0.20      0.00      0.20      0.00     32.60
02:06:09  12:47:01 AM      0.33      0.00      0.33      0.00    138.03
02:06:09  12:48:01 AM      0.17      0.00      0.17      0.00     21.88
02:06:09  12:49:01 AM      0.10      0.00      0.10      0.00      8.13
02:06:09  12:50:01 AM      0.17      0.00      0.17      0.00     16.29
02:06:09  12:51:01 AM      0.37      0.00      0.37      0.00     19.46
02:06:09  12:52:01 AM      0.28      0.00      0.28      0.00     12.45
02:06:09  12:53:01 AM      0.17      0.00      0.17      0.00     16.26
02:06:09  12:54:01 AM      0.18      0.00      0.18      0.00     29.86
02:06:09  12:55:01 AM      0.13      0.00      0.13      0.00     12.05
02:06:09  12:56:01 AM      0.20      0.00      0.20      0.00     12.21
02:06:09  12:57:01 AM      0.27      0.00      0.27      0.00     24.83
02:06:09  12:58:01 AM      0.15      0.00      0.15      0.00     11.73
02:06:09  12:59:01 AM      0.33      0.00      0.33      0.00     25.36
02:06:09  01:00:01 AM      0.22      0.00      0.22      0.00     23.89
02:06:09  01:01:01 AM      0.22      0.00      0.22      0.00     18.23
02:06:09  01:02:01 AM      0.40      0.00      0.40      0.00     21.77
02:06:09  01:03:01 AM      0.20      0.00      0.20      0.00      9.38
02:06:09  01:04:01 AM      0.13      0.00      0.13      0.00     15.99
02:06:09  01:05:01 AM      0.18      0.00      0.18      0.00     18.96
02:06:09  01:06:01 AM      0.20      0.00      0.20      0.00      8.06
02:06:09  01:07:01 AM      0.23      0.00      0.23      0.00     21.91
02:06:09  01:08:01 AM      0.20      0.00      0.20      0.00     16.54
02:06:09  01:09:01 AM      0.12      0.00      0.12      0.00      8.27
02:06:09  01:10:01 AM      0.17      0.00      0.17      0.00     20.13
02:06:09  01:11:01 AM      0.42      0.00      0.42      0.00     16.05
02:06:09  01:12:01 AM      0.23      0.00      0.23      0.00     18.43
02:06:09  01:13:01 AM      0.20      0.00      0.20      0.00     21.48
02:06:09  01:14:01 AM      0.13      0.00      0.13      0.00     16.00
02:06:09  01:15:01 AM      0.13      0.00      0.13      0.00     10.53
02:06:09  01:16:01 AM      0.18      0.00      0.18      0.00     15.38
02:06:09  01:17:01 AM      0.28      0.00      0.28      0.00     20.33
02:06:09  01:18:01 AM      0.35      0.00      0.35      0.00     13.48
02:06:09  01:19:01 AM      0.15      0.00      0.15      0.00     23.86
02:06:09  01:20:01 AM      0.17      0.00      0.17      0.00     14.93
02:06:09  01:21:01 AM      0.40      0.00      0.40      0.00     28.11
02:06:09  01:22:01 AM      0.15      0.00      0.15      0.00     12.80
02:06:09  01:23:01 AM      0.15      0.00      0.15      0.00     17.06
02:06:09  01:24:01 AM      0.13      0.00      0.13      0.00     16.93
02:06:09  01:25:01 AM      0.23      0.00      0.23      0.00     47.23
02:06:09  01:26:01 AM      0.45      0.00      0.45      0.00     23.30
02:06:09  01:27:01 AM      0.13      0.00      0.13      0.00     14.26
02:06:09  01:28:01 AM      0.17      0.00      0.17      0.00     10.79
02:06:09  01:29:01 AM      0.75      0.00      0.75      0.00     25.66
02:06:09  01:30:01 AM      0.25      0.00      0.25      0.00     10.83
02:06:09  01:31:01 AM      0.75      0.00      0.75      0.00     34.01
02:06:09  01:32:01 AM      0.18      0.00      0.18      0.00     17.05
02:06:09  01:33:01 AM      0.15      0.00      0.15      0.00     11.86
02:06:09  01:34:01 AM      0.15      0.00      0.15      0.00     22.45
02:06:09  01:35:01 AM      0.17      0.00      0.17      0.00     17.08
02:06:09  01:36:01 AM      0.40      0.00      0.40      0.00     22.03
02:06:09  01:37:01 AM      0.20      0.00      0.20      0.00     13.18
02:06:09  01:38:02 AM      0.25      0.00      0.25      0.00     47.77
02:06:09  01:39:01 AM      0.19      0.00      0.19      0.00     15.60
02:06:09  01:40:01 AM      0.15      0.00      0.15      0.00     16.03
02:06:09  01:41:01 AM      0.35      0.00      0.35      0.00     13.46
02:06:09  01:42:01 AM      0.18      0.00      0.18      0.00     17.33
02:06:09  01:43:01 AM      0.15      0.00      0.15      0.00     11.06
02:06:09  01:44:01 AM      0.15      0.00      0.15      0.00     27.39
02:06:09  01:45:01 AM      0.22      0.00      0.22      0.00     15.06
02:06:09  01:46:01 AM      0.33      0.00      0.33      0.00     15.16
02:06:09  01:47:01 AM      0.33      0.00      0.33      0.00     25.91
02:06:09  01:48:01 AM      0.18      0.00      0.18      0.00     18.11
02:06:09  01:49:01 AM      0.10      0.00      0.10      0.00      8.80
02:06:09  01:50:01 AM      0.13      0.00      0.13      0.00     16.80
02:06:09  01:51:01 AM      0.33      0.00      0.33      0.00     26.34
02:06:09  01:52:01 AM      0.42      0.00      0.42      0.00     27.07
02:06:09  01:53:01 AM      0.23      0.00      0.23      0.00     19.25
02:06:09  01:54:01 AM      0.23      0.00      0.23      0.00     13.90
02:06:09  01:55:01 AM      0.17      0.00      0.17      0.00     10.70
02:06:09  01:56:01 AM      0.25      0.00      0.25      0.00     17.55
02:06:09  01:57:01 AM      0.27      0.00      0.27      0.00     18.61
02:06:09  01:58:01 AM      0.17      0.00      0.17      0.00     20.28
02:06:09  01:59:01 AM      0.13      0.00      0.13      0.00     18.93
02:06:09  02:00:01 AM      0.12      0.00      0.12      0.00     11.46
02:06:09  02:01:01 AM      0.33      0.00      0.33      0.00     25.16
02:06:09  02:02:01 AM      0.32      0.00      0.32      0.00     16.46
02:06:09  02:03:01 AM      0.15      0.00      0.15      0.00     22.40
02:06:09  02:04:01 AM      0.23      0.00      0.23      0.00     16.80
02:06:09  02:05:01 AM     11.80      0.28     11.51     33.86    681.86
02:06:09  02:06:01 AM     32.39      0.43     31.96     49.18   5281.39
02:06:09  Average:         0.60      0.01      0.59      0.72     70.89
02:06:09  
02:06:09  12:00:01 AM kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty
02:06:09  12:01:01 AM   4846028   6989728   3036404     38.52      2688   2311192    726756      8.14    272504   2381952       248
02:06:09  12:02:01 AM   4846272   6990452   3036160     38.52      2688   2311672    726756      8.14    272564   2381860        88
02:06:09  12:03:01 AM   4846164   6990820   3036268     38.52      2688   2312148    726756      8.14    272564   2382152       248
02:06:09  12:04:01 AM   4844692   6990120   3037740     38.54      2688   2312912    743764      8.33    272564   2383504        36
02:06:09  12:05:01 AM   4842776   6988584   3039656     38.56      2688   2313292    743764      8.33    272564   2385340         4
02:06:09  12:06:01 AM   4841996   6988180   3040436     38.57      2688   2313668    743764      8.33    272564   2386320       216
02:06:09  12:07:01 AM   4840812   6987480   3041620     38.59      2688   2314160    736752      8.25    272560   2387204       140
02:06:09  12:08:01 AM   4840044   6987352   3042388     38.60      2688   2314796    738712      8.27    272676   2388260       112
02:06:09  12:09:01 AM   4839648   6987320   3042784     38.60      2688   2315160    738712      8.27    272676   2388508        68
02:06:09  12:10:01 AM   4839100   6987128   3043332     38.61      2688   2315508    744012      8.33    272688   2389000       132
02:06:09  12:11:01 AM   4838648   6987280   3043784     38.61      2688   2316120    744012      8.33    272676   2389480       116
02:06:09  12:12:01 AM   4837928   6986944   3044504     38.62      2688   2316496    744012      8.33    272676   2390096        40
02:06:09  12:13:01 AM   4837992   6987388   3044440     38.62      2688   2316876    744012      8.33    272676   2390424       192
02:06:09  12:14:01 AM   4837468   6987240   3044964     38.63      2688   2317252    744012      8.33    272676   2390812       116
02:06:09  12:15:01 AM   4837012   6987164   3045420     38.64      2688   2317632    744012      8.33    272676   2391068        60
02:06:09  12:16:01 AM   4836732   6987264   3045700     38.64      2688   2318020    727684      8.15    272676   2391444        52
02:06:09  12:17:01 AM   4835916   6987068   3046516     38.65      2688   2318632    727684      8.15    272676   2392248       148
02:06:09  12:18:01 AM   4835772   6987404   3046660     38.65      2688   2319112    727684      8.15    272676   2392544       248
02:06:09  12:19:01 AM   4834756   6986868   3047676     38.66      2688   2319592    727684      8.15    272676   2393380       100
02:06:09  12:20:01 AM   4834084   6986672   3048348     38.67      2688   2320068    745256      8.34    272676   2393864       252
02:06:09  12:21:01 AM   4834208   6987280   3048224     38.67      2688   2320548    727056      8.14    272676   2394112        88
02:06:09  12:22:01 AM   4833868   6987408   3048564     38.68      2688   2321024    727056      8.14    272676   2394540       248
02:06:09  12:23:01 AM   4832140   6987276   3050292     38.70      2688   2322624    727056      8.14    272676   2396100       508
02:06:09  12:24:01 AM   4828860   6986516   3053572     38.74      2688   2325128    727056      8.14    272676   2399084      1520
02:06:09  12:25:01 AM   4828332   6986944   3054100     38.75      2688   2326092    745072      8.34    272676   2399896       160
02:06:09  12:26:01 AM   4827076   6986064   3055356     38.76      2688   2326468    745072      8.34    272676   2401016         4
02:06:09  12:27:01 AM   4826160   6985548   3056272     38.77      2688   2326856    745072      8.34    272676   2401648        16
02:06:09  12:28:01 AM   4826376   6986140   3056056     38.77      2688   2327240    745072      8.34    272676   2401812        68
02:06:09  12:29:01 AM   4824960   6985100   3057472     38.79      2688   2327616    745072      8.34    272676   2403132       216
02:06:09  12:30:01 AM   4824480   6984996   3057952     38.79      2688   2327992    760920      8.52    272676   2403508       144
02:06:09  12:31:01 AM   4822948   6985368   3059484     38.81      2688   2329904    760920      8.52    272676   2405296      1788
02:06:09  12:32:01 AM   4816712   6982160   3065720     38.89      2688   2332912    760920      8.52    272684   2411476      1312
02:06:09  12:33:01 AM   4815688   6981512   3066744     38.91      2688   2333296    760920      8.52    272684   2412408        36
02:06:09  12:34:01 AM   4815640   6981856   3066792     38.91      2688   2333688    760920      8.52    272684   2412484       204
02:06:09  12:35:01 AM   4814840   6981444   3067592     38.92      2688   2334064    760920      8.52    272684   2413184       172
02:06:09  12:36:01 AM   4814916   6981892   3067516     38.92      2688   2334444    760920      8.52    272684   2413244       156
02:06:09  12:37:01 AM   4814496   6981848   3067936     38.92      2688   2334820    760920      8.52    272684   2413688        84
02:06:09  12:38:01 AM   4813424   6981804   3069008     38.93      2688   2335856    760920      8.52    272684   2414648        84
02:06:09  12:39:01 AM   4810584   6981816   3071848     38.97      2688   2338704    760920      8.52    272684   2417496      1144
02:06:09  12:40:01 AM   4808528   6981312   3073904     39.00      2688   2340248    755636      8.46    272684   2419408        24
02:06:09  12:41:01 AM   4808524   6981648   3073908     39.00      2688   2340584    755636      8.46    272684   2419540       112
02:06:09  12:42:01 AM   4808032   6981540   3074400     39.00      2688   2340960    755636      8.46    272684   2420132       108
02:06:09  12:43:01 AM   4807808   6981692   3074624     39.01      2688   2341336    755636      8.46    272684   2420188        56
02:06:09  12:44:01 AM   4807460   6981732   3074972     39.01      2688   2341732    755636      8.46    272684   2420572       220
02:06:09  12:45:02 AM   4807280   6981932   3075152     39.01      2688   2342108    755636      8.46    272684   2420948       116
02:06:09  12:46:01 AM   4804636   6981796   3077796     39.05      2688   2344624    755636      8.46    272684   2423456      1716
02:06:09  12:47:01 AM   4801680   6981476   3080752     39.08      2688   2347248    755636      8.46    272684   2426380       300
02:06:09  12:48:01 AM   4801252   6981424   3081180     39.09      2688   2347624    755636      8.46    272684   2426892        80
02:06:09  12:49:01 AM   4800996   6981544   3081436     39.09      2688   2348000    755636      8.46    272684   2427180       224
02:06:09  12:50:01 AM   4800540   6981468   3081892     39.10      2688   2348380    749888      8.40    272684   2427560       144
02:06:09  12:51:01 AM   4800140   6981448   3082292     39.10      2688   2348756    749888      8.40    272684   2427936        68
02:06:09  12:52:01 AM   4799388   6981076   3083044     39.11      2688   2349136    749888      8.40    272688   2428592       220
02:06:09  12:53:01 AM   4799112   6981336   3083320     39.12      2688   2349664    749888      8.40    272688   2428748       300
02:06:09  12:54:01 AM   4798596   6981360   3083836     39.12      2688   2350212    749888      8.40    272688   2429680         4
02:06:09  12:55:01 AM   4797924   6981168   3084508     39.13      2688   2350692    749888      8.40    272688   2430024       168
02:06:09  12:56:01 AM   4797436   6981156   3084996     39.14      2688   2351168    749888      8.40    272688   2430488       336
02:06:09  12:57:01 AM   4797072   6981196   3085360     39.14      2688   2351564    749888      8.40    272688   2430756        88
02:06:09  12:58:01 AM   4796868   6981476   3085564     39.14      2688   2352048    749888      8.40    272688   2431172       252
02:06:09  12:59:01 AM   4796616   6981704   3085816     39.15      2688   2352524    749888      8.40    272688   2431648        88
02:06:09  01:00:01 AM   4795264   6981148   3087168     39.17      2688   2353328    745404      8.35    272688   2432576       248
02:06:09  01:01:01 AM   4793684   6979948   3088748     39.19      2688   2353708    745404      8.35    272688   2433936       144
02:06:09  01:02:01 AM   4794540   6981180   3087892     39.17      2688   2354084    745404      8.35    272696   2433404        68
02:06:09  01:03:01 AM   4794396   6981432   3088036     39.18      2688   2354480    745404      8.35    272696   2433736       236
02:06:09  01:04:01 AM   4793500   6980912   3088932     39.19      2688   2354856    745404      8.35    272696   2434476       172
02:06:09  01:05:01 AM   4793472   6981260   3088960     39.19      2688   2355232    745404      8.35    272696   2434516        24
02:06:09  01:06:01 AM   4792884   6981152   3089548     39.20      2688   2355704    745404      8.35    272696   2434996       300
02:06:09  01:07:01 AM   4792148   6980792   3090284     39.20      2688   2356088    745404      8.35    272696   2435596       132
02:06:09  01:08:01 AM   4792144   6981164   3090288     39.20      2688   2356464    745404      8.35    272696   2435884        52
02:06:09  01:09:01 AM   4791688   6981084   3090744     39.21      2688   2356840    745404      8.35    272696   2436260       204
02:06:09  01:10:01 AM   4791012   6980796   3091420     39.22      2688   2357220    743364      8.32    272696   2436784        40
02:06:09  01:11:01 AM   4791108   6981276   3091324     39.22      2688   2357600    743364      8.32    272696   2437020       112
02:06:09  01:12:01 AM   4790396   6981096   3092036     39.23      2688   2358156    743364      8.32    272696   2437500       216
02:06:09  01:13:01 AM   4789904   6981164   3092528     39.23      2688   2358692    743364      8.32    272696   2438116       172
02:06:09  01:14:01 AM   4789528   6981172   3092904     39.24      2688   2359068    743364      8.32    272696   2438380        96
02:06:09  01:15:01 AM   4789316   6981332   3093116     39.24      2688   2359448    743364      8.32    272696   2438752       188
02:06:09  01:16:01 AM   4788648   6981040   3093784     39.25      2688   2359824    743364      8.32    272696   2439244       144
02:06:09  01:17:01 AM   4788200   6980976   3094232     39.25      2688   2360200    743364      8.32    272696   2439864        36
02:06:09  01:18:01 AM   4788040   6981188   3094392     39.26      2688   2360580    743364      8.32    272696   2439916       160
02:06:09  01:19:01 AM   4787160   6981004   3095272     39.27      2688   2361276    743364      8.32    272700   2440940       180
02:06:09  01:20:01 AM   4786628   6980884   3095804     39.27      2688   2361676    726664      8.14    272696   2441164       176
02:06:09  01:21:01 AM   4786472   6981208   3095960     39.28      2688   2362156    726664      8.14    272696   2441648         4
02:06:09  01:22:01 AM   4785368   6980580   3097064     39.29      2688   2362632    726664      8.14    272696   2442648       168
02:06:09  01:23:01 AM   4785164   6980856   3097268     39.29      2688   2363112    726664      8.14    272696   2442892       168
02:06:09  01:24:01 AM   4784520   6980688   3097912     39.30      2688   2363588    726664      8.14    272696   2443284       164
02:06:09  01:25:01 AM   4783392   6980852   3099040     39.32      2688   2364880    745676      8.35    272708   2444584       112
02:06:09  01:26:01 AM   4782964   6980804   3099468     39.32      2688   2365260    745676      8.35    272708   2445096        20
02:06:09  01:27:01 AM   4782464   6980680   3099968     39.33      2688   2365644    745676      8.35    272708   2445404        16
02:06:09  01:28:01 AM   4782192   6980796   3100240     39.33      2688   2366032    753712      8.44    282320   2436116       356
02:06:09  01:29:01 AM   4781500   6980484   3100932     39.34      2688   2366412    753712      8.44    282320   2436816        68
02:06:09  01:30:01 AM   4780972   6980332   3101460     39.35      2688   2366788    773012      8.66    282320   2437260       216
02:06:09  01:31:01 AM   4780500   6980588   3101932     39.35      2688   2367508    741916      8.31    282320   2437648       212
02:06:09  01:32:01 AM   4780160   6980568   3102272     39.36      2688   2367828    741916      8.31    282320   2437960        92
02:06:09  01:33:01 AM   4779824   6980708   3102608     39.36      2688   2368304    741916      8.31    282320   2438496       244
02:06:09  01:34:01 AM   4779500   6980868   3102932     39.37      2688   2368788    741916      8.31    282320   2438912        88
02:06:09  01:35:01 AM   4778680   6980524   3103752     39.38      2688   2369264    741916      8.31    282320   2439692       100
02:06:09  01:36:01 AM   4778312   6980632   3104120     39.38      2688   2369740    741916      8.31    282320   2439896        92
02:06:09  01:37:01 AM   4777872   6980672   3104560     39.39      2688   2370220    741916      8.31    282320   2440444       244
02:06:09  01:38:02 AM   4776544   6980592   3105888     39.40      2688   2371464    744232      8.33    282328   2441656       128
02:06:09  01:39:01 AM   4774180   6978592   3108252     39.43      2688   2371824    744232      8.33    282328   2444012        80
02:06:09  01:40:01 AM   4773884   6978684   3108548     39.44      2688   2372204    745344      8.35    282328   2444552         4
02:06:09  01:41:01 AM   4773544   6978716   3108888     39.44      2688   2372580    745344      8.35    282328   2444732       156
02:06:09  01:42:01 AM   4772588   6978136   3109844     39.45      2688   2372956    745344      8.35    282328   2445436        92
02:06:09  01:43:01 AM   4772096   6978024   3110336     39.46      2688   2373336    745344      8.35    282328   2445864       176
02:06:09  01:44:01 AM   4771916   6978540   3110516     39.46      2688   2374024    745344      8.35    282328   2446240        72
02:06:09  01:45:01 AM   4771684   6978724   3110748     39.46      2688   2374440    745344      8.35    282328   2446656        88
02:06:09  01:46:01 AM   4771112   6978624   3111320     39.47      2688   2374920    745344      8.35    282328   2447128       248
02:06:09  01:47:01 AM   4770520   6978436   3111912     39.48      2688   2375316    745344      8.35    282328   2447600         4
02:06:09  01:48:01 AM   4770256   6978648   3112176     39.48      2688   2375792    745344      8.35    282328   2448012        20
02:06:09  01:49:01 AM   4769720   6978596   3112712     39.49      2688   2376272    745344      8.35    282328   2448608       244
02:06:09  01:50:01 AM   4768504   6978220   3113928     39.50      2688   2377112    747016      8.36    282332   2449692       604
02:06:09  01:51:01 AM   4768620   6978372   3113812     39.50      2688   2377148    747016      8.36    282332   2449388         4
02:06:09  01:52:01 AM   4767740   6978240   3114692     39.51      2688   2377896    762432      8.54    282336   2450276       172
02:06:09  01:53:01 AM   4767592   6978468   3114840     39.52      2688   2378272    762432      8.54    282344   2450580        36
02:06:09  01:54:01 AM   4767224   6978484   3115208     39.52      2688   2378656    762432      8.54    282336   2450968        80
02:06:09  01:55:01 AM   4766848   6978476   3115584     39.53      2688   2379032    762432      8.54    282336   2451368       172
02:06:09  01:56:01 AM   4766692   6978696   3115740     39.53      2688   2379408    762432      8.54    282336   2451628        96
02:06:09  01:57:01 AM   4766020   6978416   3116412     39.54      2688   2379788    762432      8.54    282336   2452172        24
02:06:09  01:58:01 AM   4765568   6978644   3116864     39.54      2688   2380484    762432      8.54    282336   2452700       152
02:06:09  01:59:01 AM   4764988   6978548   3117444     39.55      2688   2380960    762432      8.54    282336   2453184        88
02:06:09  02:00:01 AM   4764072   6978112   3118360     39.56      2688   2381440    746444      8.36    282336   2453780       248
02:06:09  02:01:01 AM   4763000   6977444   3119432     39.57      2688   2381840    746444      8.36    282336   2454876         4
02:06:09  02:02:01 AM   4763376   6978304   3119056     39.57      2688   2382324    746444      8.36    282336   2454616       168
02:06:09  02:03:01 AM   4762944   6978356   3119488     39.58      2688   2382800    746444      8.36    282336   2455172         4
02:06:09  02:04:01 AM   4751156   6969676   3131276     39.72      2688   2385880    900296     10.08    282336   2465452      2672
02:06:09  02:05:01 AM   4754144   6914936   3128288     39.69      2688   2333832    755224      8.46    420960   2347364    145080
02:06:09  02:06:01 AM   4772532   6936212   3109900     39.45      2688   2337164    719248      8.05    580252   2173908     25036
02:06:09  Average:      4798667   6981164   3083765     39.12      2688   2350032    747394      8.37    279129   2423246      1560
02:06:09  
02:06:09  12:00:01 AM     IFACE   rxpck/s   txpck/s    rxkB/s    txkB/s   rxcmp/s   txcmp/s  rxmcst/s   %ifutil
02:06:09  12:01:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  12:01:01 AM      eth0      1.47      1.08      0.40      0.23      0.00      0.00      0.00      0.00
02:06:09  12:02:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  12:02:01 AM      eth0      1.42      1.15      0.49      0.28      0.00      0.00      0.00      0.00
02:06:09  12:03:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  12:03:01 AM      eth0      1.33      1.05      0.36      0.22      0.00      0.00      0.00      0.00
02:06:09  12:04:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  12:04:01 AM      eth0     30.83     29.56      5.52      3.17      0.00      0.00      0.00      0.00
02:06:09  12:05:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  12:05:01 AM      eth0     11.61      9.25      2.95      2.00      0.00      0.00      0.00      0.00
02:06:09  12:06:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  12:06:01 AM      eth0     11.11      8.92      2.68      1.79      0.00      0.00      0.00      0.00
02:06:09  12:07:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  12:07:01 AM      eth0     11.46      9.30      2.82      1.88      0.00      0.00      0.00      0.00
02:06:09  12:08:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  12:08:01 AM      eth0     11.18      9.05      2.71      1.80      0.00      0.00      0.00      0.00
02:06:09  12:09:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  12:09:01 AM      eth0     10.71      8.80      2.55      1.74      0.00      0.00      0.00      0.00
02:06:09  12:10:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  12:10:01 AM      eth0      9.20      7.48      2.25      1.48      0.00      0.00      0.00      0.00
02:06:09  12:11:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  12:11:01 AM      eth0     17.18     15.46      3.59      2.31      0.00      0.00      0.00      0.00
02:06:09  12:12:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  12:12:01 AM      eth0     11.76      9.13      2.96      1.87      0.00      0.00      0.00      0.00
02:06:09  12:13:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  12:13:01 AM      eth0     11.10      9.05      2.67      1.83      0.00      0.00      0.00      0.00
02:06:09  12:14:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  12:14:01 AM      eth0     11.23      9.15      2.72      1.81      0.00      0.00      0.00      0.00
02:06:09  12:15:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  12:15:01 AM      eth0     11.63      9.28      2.82      1.84      0.00      0.00      0.00      0.00
02:06:09  12:16:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  12:16:01 AM      eth0     10.75      9.16      2.66      1.81      0.00      0.00      0.00      0.00
02:06:09  12:17:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  12:17:01 AM      eth0     17.16     14.25      4.33      2.75      0.00      0.00      0.00      0.00
02:06:09  12:18:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  12:18:01 AM      eth0      1.27      1.13      0.36      0.22      0.00      0.00      0.00      0.00
02:06:09  12:19:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  12:19:01 AM      eth0      1.83      1.22      0.69      0.41      0.00      0.00      0.00      0.00
02:06:09  12:20:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  12:20:01 AM      eth0      1.03      1.00      0.35      0.22      0.00      0.00      0.00      0.00
02:06:09  12:21:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  12:21:01 AM      eth0      1.27      1.05      0.36      0.22      0.00      0.00      0.00      0.00
02:06:09  12:22:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  12:22:01 AM      eth0      1.47      1.15      0.50      0.28      0.00      0.00      0.00      0.00
02:06:09  12:23:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  12:23:01 AM      eth0     21.35     21.50      4.20      2.16      0.00      0.00      0.00      0.00
02:06:09  12:24:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  12:24:01 AM      eth0      3.58      4.20      2.20      0.91      0.00      0.00      0.00      0.00
02:06:09  12:25:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  12:25:01 AM      eth0     17.56     15.93      3.98      2.48      0.00      0.00      0.00      0.00
02:06:09  12:26:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  12:26:01 AM      eth0     11.63      8.98      2.79      1.80      0.00      0.00      0.00      0.00
02:06:09  12:27:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  12:27:01 AM      eth0     12.58      9.70      3.48      2.34      0.00      0.00      0.00      0.00
02:06:09  12:28:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  12:28:01 AM      eth0     11.71      9.50      2.83      1.84      0.00      0.00      0.00      0.00
02:06:09  12:29:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  12:29:01 AM      eth0     11.50      9.06      2.76      1.80      0.00      0.00      0.00      0.00
02:06:09  12:30:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  12:30:01 AM      eth0     10.98      9.00      2.66      1.80      0.00      0.00      0.00      0.00
02:06:09  12:31:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  12:31:01 AM      eth0      6.66      6.06      1.15      0.85      0.00      0.00      0.00      0.00
02:06:09  12:32:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  12:32:01 AM      eth0      7.05      6.10      1.25      0.95      0.00      0.00      0.00      0.00
02:06:09  12:33:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  12:33:01 AM      eth0     11.85      9.50      3.01      2.06      0.00      0.00      0.00      0.00
02:06:09  12:34:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  12:34:01 AM      eth0     11.93      9.10      2.83      1.81      0.00      0.00      0.00      0.00
02:06:09  12:35:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  12:35:01 AM      eth0     12.38      9.48      3.32      2.23      0.00      0.00      0.00      0.00
02:06:09  12:36:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  12:36:01 AM      eth0     11.40      9.17      2.76      1.81      0.00      0.00      0.00      0.00
02:06:09  12:37:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  12:37:01 AM      eth0     11.18      9.10      2.73      1.86      0.00      0.00      0.00      0.00
02:06:09  12:38:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  12:38:01 AM      eth0     13.75     11.86      3.10      2.04      0.00      0.00      0.00      0.00
02:06:09  12:39:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  12:39:01 AM      eth0      2.05      2.17      0.13      0.30      0.00      0.00      0.00      0.00
02:06:09  12:40:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  12:40:01 AM      eth0     13.06     10.75      3.02      2.05      0.00      0.00      0.00      0.00
02:06:09  12:41:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  12:41:01 AM      eth0     10.10      8.26      2.43      1.63      0.00      0.00      0.00      0.00
02:06:09  12:42:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  12:42:01 AM      eth0     12.23      9.48      3.13      2.11      0.00      0.00      0.00      0.00
02:06:09  12:43:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  12:43:01 AM      eth0     11.26      9.23      2.77      1.82      0.00      0.00      0.00      0.00
02:06:09  12:44:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  12:44:01 AM      eth0     11.73      9.08      2.80      1.81      0.00      0.00      0.00      0.00
02:06:09  12:45:02 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  12:45:02 AM      eth0     11.31      9.12      2.74      1.81      0.00      0.00      0.00      0.00
02:06:09  12:46:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  12:46:01 AM      eth0      8.54      7.81      1.57      1.15      0.00      0.00      0.00      0.00
02:06:09  12:47:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  12:47:01 AM      eth0     10.40      9.85      2.00      1.46      0.00      0.00      0.00      0.00
02:06:09  12:48:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  12:48:01 AM      eth0     11.66      9.16      3.04      1.99      0.00      0.00      0.00      0.00
02:06:09  12:49:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  12:49:01 AM      eth0     11.00      9.02      2.67      1.80      0.00      0.00      0.00      0.00
02:06:09  12:50:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  12:50:01 AM      eth0     11.33      9.15      2.74      1.81      0.00      0.00      0.00      0.00
02:06:09  12:51:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  12:51:01 AM      eth0     11.58      9.10      2.79      1.83      0.00      0.00      0.00      0.00
02:06:09  12:52:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  12:52:01 AM      eth0     11.63      9.40      3.09      2.08      0.00      0.00      0.00      0.00
02:06:09  12:53:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  12:53:01 AM      eth0     17.28     12.90      4.19      2.55      0.00      0.00      0.00      0.00
02:06:09  12:54:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  12:54:01 AM      eth0     14.38      7.92      3.56      2.08      0.00      0.00      0.00      0.00
02:06:09  12:55:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  12:55:01 AM      eth0      2.15      1.40      0.90      0.61      0.00      0.00      0.00      0.00
02:06:09  12:56:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  12:56:01 AM      eth0      8.08      1.22      1.54      0.41      0.00      0.00      0.00      0.00
02:06:09  12:57:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  12:57:01 AM      eth0      3.10      1.03      0.63      0.25      0.00      0.00      0.00      0.00
02:06:09  12:58:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  12:58:01 AM      eth0      1.93      1.15      0.48      0.23      0.00      0.00      0.00      0.00
02:06:09  12:59:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  12:59:01 AM      eth0      1.42      1.00      0.37      0.22      0.00      0.00      0.00      0.00
02:06:09  01:00:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  01:00:01 AM      eth0     34.46     32.34      6.35      3.67      0.00      0.00      0.00      0.00
02:06:09  01:01:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  01:01:01 AM      eth0     12.91      9.25      3.12      2.00      0.00      0.00      0.00      0.00
02:06:09  01:02:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  01:02:01 AM      eth0     11.68      9.06      2.80      1.86      0.00      0.00      0.00      0.00
02:06:09  01:03:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  01:03:01 AM      eth0     13.11      9.43      2.88      1.88      0.00      0.00      0.00      0.00
02:06:09  01:04:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  01:04:01 AM      eth0     13.18      9.16      2.99      1.99      0.00      0.00      0.00      0.00
02:06:09  01:05:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  01:05:01 AM      eth0     11.70      9.03      2.83      1.80      0.00      0.00      0.00      0.00
02:06:09  01:06:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  01:06:01 AM      eth0     16.04     11.88      3.14      1.83      0.00      0.00      0.00      0.00
02:06:09  01:07:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  01:07:01 AM      eth0     12.53      9.68      3.45      2.30      0.00      0.00      0.00      0.00
02:06:09  01:08:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  01:08:01 AM      eth0     12.98      9.06      2.97      1.80      0.00      0.00      0.00      0.00
02:06:09  01:09:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  01:09:01 AM      eth0     13.13      9.08      2.93      1.81      0.00      0.00      0.00      0.00
02:06:09  01:10:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  01:10:01 AM      eth0     12.06      9.43      3.03      2.04      0.00      0.00      0.00      0.00
02:06:09  01:11:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  01:11:01 AM      eth0     11.83      9.28      2.84      1.86      0.00      0.00      0.00      0.00
02:06:09  01:12:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  01:12:01 AM      eth0     14.10     12.10      3.27      2.16      0.00      0.00      0.00      0.00
02:06:09  01:13:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  01:13:01 AM      eth0     16.16     13.91      3.61      2.31      0.00      0.00      0.00      0.00
02:06:09  01:14:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  01:14:01 AM      eth0     11.51      9.03      2.79      1.80      0.00      0.00      0.00      0.00
02:06:09  01:15:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  01:15:01 AM      eth0     11.41      9.21      2.75      1.81      0.00      0.00      0.00      0.00
02:06:09  01:16:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  01:16:01 AM      eth0     13.01      9.10      2.89      1.81      0.00      0.00      0.00      0.00
02:06:09  01:17:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  01:17:01 AM      eth0     12.78      9.65      3.60      2.44      0.00      0.00      0.00      0.00
02:06:09  01:18:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  01:18:01 AM      eth0     13.33      9.13      3.02      1.81      0.00      0.00      0.00      0.00
02:06:09  01:19:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  01:19:01 AM      eth0     16.28     12.91      4.13      2.59      0.00      0.00      0.00      0.00
02:06:09  01:20:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  01:20:01 AM      eth0      1.22      0.92      0.32      0.19      0.00      0.00      0.00      0.00
02:06:09  01:21:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  01:21:01 AM      eth0      2.10      1.00      0.49      0.22      0.00      0.00      0.00      0.00
02:06:09  01:22:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  01:22:01 AM      eth0      2.15      1.30      0.81      0.50      0.00      0.00      0.00      0.00
02:06:09  01:23:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  01:23:01 AM      eth0      1.27      1.07      0.38      0.22      0.00      0.00      0.00      0.00
02:06:09  01:24:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  01:24:01 AM      eth0      1.73      1.05      0.45      0.22      0.00      0.00      0.00      0.00
02:06:09  01:25:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  01:25:01 AM      eth0     71.52     70.30     11.65      6.21      0.00      0.00      0.00      0.00
02:06:09  01:26:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  01:26:01 AM      eth0     11.46      9.10      2.71      1.83      0.00      0.00      0.00      0.00
02:06:09  01:27:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  01:27:01 AM      eth0     11.48      9.15      2.80      1.89      0.00      0.00      0.00      0.00
02:06:09  01:28:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  01:28:01 AM      eth0     11.94      9.28      2.83      1.82      0.00      0.00      0.00      0.00
02:06:09  01:29:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  01:29:01 AM      eth0     11.45      9.37      2.93      2.01      0.00      0.00      0.00      0.00
02:06:09  01:30:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  01:30:01 AM      eth0     11.05      8.98      2.64      1.80      0.00      0.00      0.00      0.00
02:06:09  01:31:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  01:31:01 AM      eth0     21.41     17.53      5.29      3.38      0.00      0.00      0.00      0.00
02:06:09  01:32:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  01:32:01 AM      eth0      2.72      1.65      0.63      0.35      0.00      0.00      0.00      0.00
02:06:09  01:33:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  01:33:01 AM      eth0      1.62      1.27      0.61      0.41      0.00      0.00      0.00      0.00
02:06:09  01:34:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  01:34:01 AM      eth0      1.42      1.03      0.38      0.22      0.00      0.00      0.00      0.00
02:06:09  01:35:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  01:35:01 AM      eth0      2.25      1.18      0.73      0.41      0.00      0.00      0.00      0.00
02:06:09  01:36:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  01:36:01 AM      eth0      1.37      1.00      0.55      0.22      0.00      0.00      0.00      0.00
02:06:09  01:37:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  01:37:01 AM      eth0      1.62      1.13      0.51      0.28      0.00      0.00      0.00      0.00
02:06:09  01:38:02 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  01:38:02 AM      eth0     68.59     66.82     11.80      6.21      0.00      0.00      0.00      0.00
02:06:09  01:39:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  01:39:01 AM      eth0     11.25      9.05      2.73      1.80      0.00      0.00      0.00      0.00
02:06:09  01:40:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  01:40:01 AM      eth0     10.80      8.85      2.59      1.77      0.00      0.00      0.00      0.00
02:06:09  01:41:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  01:41:01 AM      eth0     11.01      8.95      2.64      1.80      0.00      0.00      0.00      0.00
02:06:09  01:42:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  01:42:01 AM      eth0     13.03      9.53      3.31      2.10      0.00      0.00      0.00      0.00
02:06:09  01:43:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  01:43:01 AM      eth0     11.60      9.40      3.04      2.04      0.00      0.00      0.00      0.00
02:06:09  01:44:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  01:44:01 AM      eth0     19.79     16.29      4.93      3.09      0.00      0.00      0.00      0.00
02:06:09  01:45:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  01:45:01 AM      eth0      1.32      0.98      0.32      0.19      0.00      0.00      0.00      0.00
02:06:09  01:46:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  01:46:01 AM      eth0      1.18      1.00      0.35      0.22      0.00      0.00      0.00      0.00
02:06:09  01:47:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  01:47:01 AM      eth0      1.52      1.12      0.49      0.28      0.00      0.00      0.00      0.00
02:06:09  01:48:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  01:48:01 AM      eth0      1.02      0.87      0.31      0.18      0.00      0.00      0.00      0.00
02:06:09  01:49:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  01:49:01 AM      eth0      1.67      1.00      0.43      0.22      0.00      0.00      0.00      0.00
02:06:09  01:50:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  01:50:01 AM      eth0     19.33     18.98      3.46      1.88      0.00      0.00      0.00      0.00
02:06:09  01:51:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  01:51:01 AM      eth0      4.13      3.83      0.58      0.25      0.00      0.00      0.00      0.00
02:06:09  01:52:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  01:52:01 AM      eth0     31.52     29.16      6.08      3.66      0.00      0.00      0.00      0.00
02:06:09  01:53:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  01:53:01 AM      eth0     11.35      9.05      2.73      1.80      0.00      0.00      0.00      0.00
02:06:09  01:54:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  01:54:01 AM      eth0     11.21      9.10      2.75      1.81      0.00      0.00      0.00      0.00
02:06:09  01:55:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  01:55:01 AM      eth0     11.31      9.10      2.72      1.81      0.00      0.00      0.00      0.00
02:06:09  01:56:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  01:56:01 AM      eth0     10.88      8.95      2.65      1.80      0.00      0.00      0.00      0.00
02:06:09  01:57:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  01:57:01 AM      eth0     12.01      9.28      2.93      1.87      0.00      0.00      0.00      0.00
02:06:09  01:58:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  01:58:01 AM      eth0     16.21     13.73      4.10      2.60      0.00      0.00      0.00      0.00
02:06:09  01:59:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  01:59:01 AM      eth0      1.20      1.15      0.38      0.23      0.00      0.00      0.00      0.00
02:06:09  02:00:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  02:00:01 AM      eth0      1.08      1.00      0.35      0.22      0.00      0.00      0.00      0.00
02:06:09  02:01:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  02:01:01 AM      eth0      1.10      0.87      0.31      0.18      0.00      0.00      0.00      0.00
02:06:09  02:02:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  02:02:01 AM      eth0      1.72      1.12      0.53      0.28      0.00      0.00      0.00      0.00
02:06:09  02:03:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  02:03:01 AM      eth0      1.53      1.22      0.65      0.44      0.00      0.00      0.00      0.00
02:06:09  02:04:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  02:04:01 AM      eth0     85.69     85.09     23.99      9.34      0.00      0.00      0.00      0.00
02:06:09  02:05:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  02:05:01 AM      eth0    165.44    104.98    303.77    457.57      0.00      0.00      0.00      0.00
02:06:09  02:06:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  02:06:01 AM      eth0     19.53     17.84     16.31      8.63      0.00      0.00      0.00      0.00
02:06:09  Average:           lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:09  Average:         eth0     12.65     10.32      5.14      5.29      0.00      0.00      0.00      0.00
02:06:09  
02:06:09  
02:06:09  ---> sar -P ALL:
02:06:09  Linux 4.18.0-553.5.1.el8.x86_64 (prd-centos8-robot-2c-8g-44711.novalocal) 	07/21/2025 	_x86_64_	(2 CPU)
02:06:09  
02:06:09  12:00:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
02:06:09  12:01:01 AM     all      1.32      0.03      0.31      0.14      0.08     98.12
02:06:09  12:01:01 AM       0      1.52      0.02      0.32      0.17      0.08     97.89
02:06:09  12:01:01 AM       1      1.12      0.05      0.30      0.12      0.07     98.35
02:06:09  12:02:01 AM     all      1.25      0.00      0.15      0.00      0.04     98.56
02:06:09  12:02:01 AM       0      1.94      0.00      0.18      0.00      0.05     97.83
02:06:09  12:02:01 AM       1      0.57      0.00      0.12      0.00      0.03     99.28
02:06:09  12:03:01 AM     all      1.17      0.00      0.13      0.00      0.04     98.65
02:06:09  12:03:01 AM       0      1.70      0.00      0.17      0.00      0.05     98.08
02:06:09  12:03:01 AM       1      0.64      0.00      0.10      0.00      0.03     99.23
02:06:09  12:04:01 AM     all      4.79      0.00      0.26      0.00      0.05     94.90
02:06:09  12:04:01 AM       0      6.00      0.00      0.25      0.00      0.05     93.70
02:06:09  12:04:01 AM       1      3.58      0.00      0.27      0.00      0.05     96.11
02:06:09  12:05:01 AM     all      4.34      0.00      0.19      0.00      0.05     95.42
02:06:09  12:05:01 AM       0      4.10      0.00      0.18      0.00      0.05     95.67
02:06:09  12:05:01 AM       1      4.58      0.00      0.20      0.00      0.05     95.17
02:06:09  12:06:01 AM     all      4.45      0.01      0.27      0.01      0.05     95.22
02:06:09  12:06:01 AM       0      5.25      0.00      0.33      0.02      0.05     94.35
02:06:09  12:06:01 AM       1      3.64      0.02      0.20      0.00      0.05     96.09
02:06:09  12:07:01 AM     all      4.33      0.00      0.19      0.00      0.05     95.43
02:06:09  12:07:01 AM       0      4.23      0.00      0.18      0.00      0.05     95.53
02:06:09  12:07:01 AM       1      4.43      0.00      0.20      0.00      0.05     95.32
02:06:09  12:08:01 AM     all      4.37      0.00      0.23      0.00      0.06     95.34
02:06:09  12:08:01 AM       0      4.72      0.00      0.27      0.00      0.05     94.96
02:06:09  12:08:01 AM       1      4.03      0.00      0.18      0.00      0.07     95.72
02:06:09  12:09:01 AM     all      4.21      0.00      0.18      0.00      0.04     95.58
02:06:09  12:09:01 AM       0      2.17      0.00      0.15      0.00      0.03     97.64
02:06:09  12:09:01 AM       1      6.24      0.00      0.20      0.00      0.05     93.51
02:06:09  12:10:01 AM     all      4.99      0.00      0.28      0.00      0.06     94.68
02:06:09  12:10:01 AM       0      3.98      0.00      0.20      0.00      0.07     95.75
02:06:09  12:10:01 AM       1      6.00      0.00      0.35      0.00      0.05     93.59
02:06:09  12:11:01 AM     all      5.67      0.00      0.40      0.01      0.05     93.87
02:06:09  12:11:01 AM       0      5.93      0.00      0.42      0.02      0.05     93.58
02:06:09  12:11:01 AM       1      5.41      0.00      0.38      0.00      0.05     94.15
02:06:09  
02:06:09  12:11:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
02:06:09  12:12:01 AM     all      4.40      0.00      0.36      0.00      0.06     95.19
02:06:09  12:12:01 AM       0      4.37      0.00      0.35      0.00      0.05     95.23
02:06:09  12:12:01 AM       1      4.43      0.00      0.37      0.00      0.07     95.14
02:06:09  12:13:01 AM     all      4.31      0.00      0.35      0.00      0.06     95.29
02:06:09  12:13:01 AM       0      3.95      0.00      0.30      0.00      0.07     95.68
02:06:09  12:13:01 AM       1      4.66      0.00      0.40      0.00      0.05     94.89
02:06:09  12:14:01 AM     all      4.48      0.00      0.34      0.00      0.07     95.11
02:06:09  12:14:01 AM       0      4.99      0.00      0.32      0.00      0.07     94.63
02:06:09  12:14:01 AM       1      3.98      0.00      0.37      0.00      0.07     95.59
02:06:09  12:15:01 AM     all      4.40      0.00      0.37      0.00      0.06     95.18
02:06:09  12:15:01 AM       0      4.59      0.00      0.42      0.00      0.07     94.93
02:06:09  12:15:01 AM       1      4.21      0.00      0.32      0.00      0.05     95.42
02:06:09  12:16:01 AM     all      4.35      0.00      0.37      0.00      0.07     95.21
02:06:09  12:16:01 AM       0      3.30      0.00      0.28      0.00      0.03     96.38
02:06:09  12:16:01 AM       1      5.40      0.00      0.45      0.00      0.10     94.05
02:06:09  12:17:01 AM     all      5.69      0.00      0.35      0.00      0.08     93.89
02:06:09  12:17:01 AM       0      6.36      0.00      0.30      0.00      0.07     93.28
02:06:09  12:17:01 AM       1      5.02      0.00      0.40      0.00      0.08     94.50
02:06:09  12:18:01 AM     all      1.28      0.00      0.11      0.00      0.08     98.54
02:06:09  12:18:01 AM       0      1.71      0.00      0.13      0.00      0.08     98.08
02:06:09  12:18:01 AM       1      0.85      0.00      0.08      0.00      0.07     99.00
02:06:09  12:19:01 AM     all      1.23      0.00      0.16      0.00      0.09     98.52
02:06:09  12:19:01 AM       0      1.17      0.00      0.18      0.00      0.10     98.55
02:06:09  12:19:01 AM       1      1.29      0.00      0.13      0.00      0.08     98.50
02:06:09  12:20:01 AM     all      1.27      0.00      0.11      0.00      0.08     98.55
02:06:09  12:20:01 AM       0      0.65      0.00      0.08      0.00      0.07     99.20
02:06:09  12:20:01 AM       1      1.89      0.00      0.13      0.00      0.08     97.90
02:06:09  12:21:01 AM     all      1.24      0.00      0.16      0.00      0.08     98.52
02:06:09  12:21:01 AM       0      1.12      0.00      0.10      0.00      0.07     98.71
02:06:09  12:21:01 AM       1      1.37      0.00      0.22      0.00      0.08     98.33
02:06:09  12:22:01 AM     all      1.28      0.00      0.12      0.00      0.08     98.53
02:06:09  12:22:01 AM       0      1.72      0.00      0.17      0.00      0.10     98.01
02:06:09  12:22:01 AM       1      0.83      0.00      0.07      0.00      0.05     99.05
02:06:09  
02:06:09  12:22:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
02:06:09  12:23:01 AM     all      3.98      0.00      0.32      0.00      0.08     95.63
02:06:09  12:23:01 AM       0      1.41      0.00      0.18      0.00      0.07     98.34
02:06:09  12:23:01 AM       1      6.55      0.00      0.45      0.00      0.08     92.91
02:06:09  12:24:01 AM     all      3.87      0.00      0.38      0.00      0.08     95.67
02:06:09  12:24:01 AM       0      2.19      0.00      0.27      0.00      0.08     97.46
02:06:09  12:24:01 AM       1      5.56      0.00      0.50      0.00      0.07     93.88
02:06:09  12:25:01 AM     all      5.39      0.00      0.23      0.00      0.08     94.30
02:06:09  12:25:01 AM       0      4.93      0.00      0.25      0.00      0.07     94.75
02:06:09  12:25:01 AM       1      5.85      0.00      0.22      0.00      0.08     93.85
02:06:09  12:26:01 AM     all      4.38      0.00      0.20      0.00      0.09     95.33
02:06:09  12:26:01 AM       0      4.13      0.00      0.18      0.00      0.08     95.60
02:06:09  12:26:01 AM       1      4.63      0.00      0.22      0.00      0.10     95.06
02:06:09  12:27:01 AM     all      4.50      0.00      0.17      0.00      0.08     95.25
02:06:09  12:27:01 AM       0      2.71      0.00      0.13      0.00      0.07     97.09
02:06:09  12:27:01 AM       1      6.28      0.00      0.20      0.00      0.10     93.42
02:06:09  12:28:01 AM     all      4.29      0.00      0.20      0.00      0.09     95.41
02:06:09  12:28:01 AM       0      3.29      0.00      0.20      0.00      0.08     96.42
02:06:09  12:28:01 AM       1      5.30      0.00      0.20      0.00      0.10     94.40
02:06:09  12:29:01 AM     all      4.33      0.00      0.15      0.00      0.07     95.45
02:06:09  12:29:01 AM       0      3.66      0.00      0.15      0.00      0.07     96.12
02:06:09  12:29:01 AM       1      4.99      0.00      0.15      0.00      0.07     94.79
02:06:09  12:30:01 AM     all      4.34      0.00      0.18      0.00      0.08     95.39
02:06:09  12:30:01 AM       0      2.54      0.00      0.17      0.00      0.07     97.23
02:06:09  12:30:01 AM       1      6.15      0.00      0.20      0.00      0.10     93.55
02:06:09  12:31:01 AM     all      5.92      0.00      0.46      0.01      0.08     93.54
02:06:09  12:31:01 AM       0      2.92      0.00      0.27      0.02      0.07     96.73
02:06:09  12:31:01 AM       1      8.89      0.00      0.64      0.00      0.08     90.38
02:06:09  12:32:01 AM     all      4.96      0.00      0.43      0.00      0.08     94.53
02:06:09  12:32:01 AM       0      3.38      0.00      0.25      0.00      0.07     96.31
02:06:09  12:32:01 AM       1      6.54      0.00      0.62      0.00      0.08     92.76
02:06:09  12:33:01 AM     all      4.46      0.00      0.18      0.01      0.08     95.26
02:06:09  12:33:01 AM       0      1.42      0.00      0.17      0.00      0.07     98.35
02:06:09  12:33:01 AM       1      7.50      0.00      0.20      0.02      0.10     92.18
02:06:09  
02:06:09  12:33:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
02:06:09  12:34:01 AM     all      4.44      0.00      0.18      0.00      0.08     95.30
02:06:09  12:34:01 AM       0      2.62      0.00      0.17      0.00      0.08     97.13
02:06:09  12:34:01 AM       1      6.25      0.00      0.20      0.00      0.08     93.47
02:06:09  12:35:01 AM     all      4.33      0.00      0.20      0.00      0.08     95.40
02:06:09  12:35:01 AM       0      2.81      0.00      0.18      0.00      0.07     96.94
02:06:09  12:35:01 AM       1      5.85      0.00      0.22      0.00      0.08     93.85
02:06:09  12:36:01 AM     all      4.52      0.00      0.17      0.00      0.08     95.24
02:06:09  12:36:01 AM       0      1.92      0.00      0.13      0.00      0.07     97.88
02:06:09  12:36:01 AM       1      7.12      0.00      0.20      0.00      0.08     92.60
02:06:09  12:37:01 AM     all      4.43      0.00      0.18      0.00      0.09     95.30
02:06:09  12:37:01 AM       0      3.36      0.00      0.18      0.00      0.10     96.36
02:06:09  12:37:01 AM       1      5.50      0.00      0.18      0.00      0.08     94.24
02:06:09  12:38:01 AM     all      5.26      0.00      0.23      0.00      0.11     94.40
02:06:09  12:38:01 AM       0      3.66      0.00      0.13      0.00      0.13     96.07
02:06:09  12:38:01 AM       1      6.85      0.00      0.33      0.00      0.08     92.73
02:06:09  12:39:01 AM     all      4.02      0.00      0.42      0.00      0.08     95.48
02:06:09  12:39:01 AM       0      1.45      0.00      0.22      0.00      0.07     98.26
02:06:09  12:39:01 AM       1      6.57      0.00      0.62      0.00      0.10     92.71
02:06:09  12:40:01 AM     all      5.57      0.00      0.32      0.00      0.08     94.02
02:06:09  12:40:01 AM       0      4.58      0.00      0.33      0.00      0.10     94.98
02:06:09  12:40:01 AM       1      6.57      0.00      0.30      0.00      0.07     93.06
02:06:09  12:41:01 AM     all      4.02      0.00      0.18      0.00      0.08     95.73
02:06:09  12:41:01 AM       0      1.74      0.00      0.18      0.00      0.07     98.01
02:06:09  12:41:01 AM       1      6.29      0.00      0.17      0.00      0.08     93.45
02:06:09  12:42:01 AM     all      4.46      0.00      0.18      0.00      0.08     95.27
02:06:09  12:42:01 AM       0      1.72      0.00      0.18      0.00      0.07     98.03
02:06:09  12:42:01 AM       1      7.20      0.00      0.18      0.00      0.10     92.51
02:06:09  12:43:01 AM     all      4.35      0.00      0.18      0.00      0.08     95.40
02:06:09  12:43:01 AM       0      2.36      0.00      0.12      0.00      0.05     97.48
02:06:09  12:43:01 AM       1      6.35      0.00      0.23      0.00      0.10     93.32
02:06:09  12:44:01 AM     all      4.34      0.00      0.18      0.00      0.10     95.37
02:06:09  12:44:01 AM       0      2.04      0.00      0.18      0.00      0.08     97.70
02:06:09  12:44:01 AM       1      6.65      0.00      0.18      0.00      0.12     93.05
02:06:09  
02:06:09  12:44:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
02:06:09  12:45:02 AM     all      4.51      0.00      0.15      0.00      0.08     95.26
02:06:09  12:45:02 AM       0      2.96      0.00      0.12      0.00      0.08     96.84
02:06:09  12:45:02 AM       1      6.05      0.00      0.18      0.00      0.08     93.68
02:06:09  12:46:01 AM     all      5.14      0.00      0.39      0.00      0.11     94.36
02:06:09  12:46:01 AM       0      0.78      0.00      0.12      0.00      0.08     99.01
02:06:09  12:46:01 AM       1      9.49      0.00      0.66      0.00      0.14     89.71
02:06:09  12:47:01 AM     all      5.45      0.00      0.43      0.00      0.08     94.04
02:06:09  12:47:01 AM       0      1.70      0.00      0.17      0.00      0.07     98.06
02:06:09  12:47:01 AM       1      9.21      0.00      0.70      0.00      0.08     90.01
02:06:09  12:48:01 AM     all      4.39      0.00      0.34      0.00      0.08     95.18
02:06:09  12:48:01 AM       0      2.22      0.00      0.22      0.00      0.08     97.48
02:06:09  12:48:01 AM       1      6.56      0.00      0.47      0.00      0.08     92.89
02:06:09  12:49:01 AM     all      4.30      0.00      0.32      0.00      0.09     95.29
02:06:09  12:49:01 AM       0      2.76      0.00      0.25      0.00      0.08     96.91
02:06:09  12:49:01 AM       1      5.85      0.00      0.38      0.00      0.10     93.67
02:06:09  12:50:01 AM     all      4.28      0.00      0.36      0.00      0.08     95.29
02:06:09  12:50:01 AM       0      5.23      0.00      0.40      0.00      0.08     94.28
02:06:09  12:50:01 AM       1      3.32      0.00      0.32      0.00      0.07     96.29
02:06:09  12:51:01 AM     all      4.22      0.00      0.37      0.00      0.09     95.32
02:06:09  12:51:01 AM       0      4.21      0.00      0.38      0.00      0.10     95.30
02:06:09  12:51:01 AM       1      4.23      0.00      0.35      0.00      0.08     95.34
02:06:09  12:52:01 AM     all      4.35      0.00      0.35      0.00      0.09     95.21
02:06:09  12:52:01 AM       0      4.30      0.00      0.33      0.00      0.10     95.27
02:06:09  12:52:01 AM       1      4.41      0.00      0.37      0.00      0.08     95.14
02:06:09  12:53:01 AM     all      5.72      0.00      0.40      0.00      0.09     93.79
02:06:09  12:53:01 AM       0      2.17      0.00      0.20      0.00      0.08     97.54
02:06:09  12:53:01 AM       1      9.27      0.00      0.60      0.00      0.10     90.03
02:06:09  12:54:01 AM     all      2.97      0.00      0.23      0.00      0.09     96.72
02:06:09  12:54:01 AM       0      1.27      0.00      0.17      0.00      0.08     98.48
02:06:09  12:54:01 AM       1      4.66      0.00      0.28      0.00      0.10     94.96
02:06:09  12:55:01 AM     all      1.24      0.00      0.13      0.00      0.08     98.55
02:06:09  12:55:01 AM       0      0.63      0.00      0.08      0.00      0.07     99.22
02:06:09  12:55:01 AM       1      1.84      0.00      0.18      0.00      0.10     97.88
02:06:09  
02:06:09  12:55:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
02:06:09  12:56:01 AM     all      1.28      0.00      0.12      0.00      0.08     98.52
02:06:09  12:56:01 AM       0      1.37      0.00      0.15      0.00      0.10     98.38
02:06:09  12:56:01 AM       1      1.18      0.00      0.08      0.00      0.07     98.67
02:06:09  12:57:01 AM     all      1.09      0.00      0.11      0.00      0.08     98.71
02:06:09  12:57:01 AM       0      0.55      0.00      0.07      0.00      0.07     99.31
02:06:09  12:57:01 AM       1      1.64      0.00      0.15      0.00      0.10     98.11
02:06:09  12:58:01 AM     all      1.11      0.00      0.15      0.00      0.10     98.64
02:06:09  12:58:01 AM       0      0.33      0.00      0.13      0.00      0.08     99.45
02:06:09  12:58:01 AM       1      1.88      0.00      0.17      0.00      0.12     97.83
02:06:09  12:59:01 AM     all      1.28      0.00      0.13      0.00      0.07     98.53
02:06:09  12:59:01 AM       0      1.79      0.00      0.17      0.00      0.08     97.96
02:06:09  12:59:01 AM       1      0.77      0.00      0.08      0.00      0.05     99.10
02:06:09  01:00:01 AM     all      5.57      0.00      0.29      0.00      0.08     94.05
02:06:09  01:00:01 AM       0      2.49      0.00      0.27      0.00      0.08     97.16
02:06:09  01:00:01 AM       1      8.66      0.00      0.32      0.00      0.08     90.94
02:06:09  01:01:01 AM     all      4.39      0.00      0.17      0.00      0.08     95.36
02:06:09  01:01:01 AM       0      3.13      0.00      0.15      0.00      0.08     96.64
02:06:09  01:01:01 AM       1      5.65      0.00      0.18      0.00      0.08     94.08
02:06:09  01:02:01 AM     all      4.28      0.00      0.18      0.00      0.08     95.45
02:06:09  01:02:01 AM       0      4.61      0.00      0.20      0.00      0.07     95.12
02:06:09  01:02:01 AM       1      3.96      0.00      0.17      0.00      0.10     95.78
02:06:09  01:03:01 AM     all      4.46      0.00      0.18      0.00      0.08     95.28
02:06:09  01:03:01 AM       0      4.06      0.00      0.18      0.00      0.08     95.67
02:06:09  01:03:01 AM       1      4.86      0.00      0.17      0.00      0.08     94.89
02:06:09  01:04:01 AM     all      4.30      0.00      0.18      0.00      0.07     95.46
02:06:09  01:04:01 AM       0      2.79      0.00      0.15      0.00      0.07     96.99
02:06:09  01:04:01 AM       1      5.80      0.00      0.20      0.00      0.07     93.93
02:06:09  01:05:01 AM     all      4.27      0.00      0.17      0.00      0.09     95.47
02:06:09  01:05:01 AM       0      2.49      0.00      0.12      0.00      0.08     97.31
02:06:09  01:05:01 AM       1      6.05      0.00      0.22      0.00      0.10     93.64
02:06:09  01:06:01 AM     all      6.03      0.00      0.30      0.01      0.06     93.60
02:06:09  01:06:01 AM       0      6.51      0.00      0.32      0.00      0.07     93.10
02:06:09  01:06:01 AM       1      5.55      0.00      0.29      0.02      0.05     94.09
02:06:09  
02:06:09  01:06:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
02:06:09  01:07:01 AM     all      4.34      0.00      0.18      0.00      0.09     95.39
02:06:09  01:07:01 AM       0      3.34      0.00      0.17      0.00      0.08     96.40
02:06:09  01:07:01 AM       1      5.33      0.00      0.20      0.00      0.10     94.37
02:06:09  01:08:01 AM     all      4.35      0.00      0.18      0.00      0.08     95.39
02:06:09  01:08:01 AM       0      1.62      0.00      0.13      0.00      0.07     98.18
02:06:09  01:08:01 AM       1      7.07      0.00      0.23      0.00      0.08     92.61
02:06:09  01:09:01 AM     all      4.40      0.00      0.18      0.00      0.08     95.34
02:06:09  01:09:01 AM       0      4.35      0.00      0.18      0.00      0.08     95.39
02:06:09  01:09:01 AM       1      4.46      0.00      0.17      0.00      0.07     95.30
02:06:09  01:10:01 AM     all      4.29      0.00      0.17      0.00      0.08     95.46
02:06:09  01:10:01 AM       0      4.16      0.00      0.13      0.00      0.08     95.62
02:06:09  01:10:01 AM       1      4.43      0.00      0.20      0.00      0.07     95.31
02:06:09  01:11:01 AM     all      4.47      0.00      0.18      0.01      0.09     95.26
02:06:09  01:11:01 AM       0      2.84      0.00      0.17      0.02      0.08     96.89
02:06:09  01:11:01 AM       1      6.10      0.00      0.18      0.00      0.10     93.62
02:06:09  01:12:01 AM     all      4.66      0.00      0.20      0.00      0.08     95.06
02:06:09  01:12:01 AM       0      1.79      0.00      0.18      0.00      0.08     97.94
02:06:09  01:12:01 AM       1      7.52      0.00      0.22      0.00      0.08     92.18
02:06:09  01:13:01 AM     all      4.95      0.00      0.37      0.00      0.08     94.60
02:06:09  01:13:01 AM       0      1.87      0.00      0.17      0.00      0.08     97.88
02:06:09  01:13:01 AM       1      8.03      0.00      0.57      0.00      0.08     91.32
02:06:09  01:14:01 AM     all      4.17      0.00      0.36      0.00      0.07     95.40
02:06:09  01:14:01 AM       0      1.69      0.00      0.20      0.00      0.05     98.06
02:06:09  01:14:01 AM       1      6.65      0.00      0.52      0.00      0.08     92.74
02:06:09  01:15:01 AM     all      4.23      0.00      0.34      0.00      0.08     95.35
02:06:09  01:15:01 AM       0      2.86      0.00      0.28      0.00      0.08     96.77
02:06:09  01:15:01 AM       1      5.60      0.00      0.40      0.00      0.08     93.92
02:06:09  01:16:01 AM     all      4.26      0.00      0.36      0.00      0.09     95.29
02:06:09  01:16:01 AM       0      2.27      0.00      0.23      0.00      0.08     97.41
02:06:09  01:16:01 AM       1      6.25      0.00      0.48      0.00      0.10     93.16
02:06:09  01:17:01 AM     all      4.33      0.00      0.33      0.00      0.08     95.27
02:06:09  01:17:01 AM       0      3.36      0.00      0.27      0.00      0.07     96.31
02:06:09  01:17:01 AM       1      5.29      0.00      0.38      0.00      0.08     94.24
02:06:09  
02:06:09  01:17:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
02:06:09  01:18:01 AM     all      4.23      0.00      0.35      0.00      0.09     95.33
02:06:09  01:18:01 AM       0      1.50      0.00      0.17      0.00      0.07     98.26
02:06:09  01:18:01 AM       1      6.95      0.00      0.53      0.00      0.12     92.40
02:06:09  01:19:01 AM     all      5.11      0.00      0.29      0.00      0.08     94.52
02:06:09  01:19:01 AM       0      2.06      0.00      0.20      0.00      0.07     97.68
02:06:09  01:19:01 AM       1      8.15      0.00      0.38      0.00      0.10     91.36
02:06:09  01:20:01 AM     all      1.09      0.00      0.13      0.00      0.08     98.69
02:06:09  01:20:01 AM       0      0.97      0.00      0.13      0.00      0.08     98.81
02:06:09  01:20:01 AM       1      1.22      0.00      0.13      0.00      0.08     98.56
02:06:09  01:21:01 AM     all      1.26      0.00      0.14      0.00      0.06     98.54
02:06:09  01:21:01 AM       0      0.95      0.00      0.13      0.00      0.05     98.86
02:06:09  01:21:01 AM       1      1.57      0.00      0.15      0.00      0.07     98.21
02:06:09  01:22:01 AM     all      1.12      0.00      0.14      0.00      0.08     98.65
02:06:09  01:22:01 AM       0      0.35      0.00      0.15      0.00      0.07     99.43
02:06:09  01:22:01 AM       1      1.89      0.00      0.13      0.00      0.10     97.88
02:06:09  01:23:01 AM     all      1.25      0.00      0.12      0.00      0.06     98.57
02:06:09  01:23:01 AM       0      0.65      0.00      0.10      0.00      0.05     99.20
02:06:09  01:23:01 AM       1      1.85      0.00      0.13      0.00      0.07     97.95
02:06:09  01:24:01 AM     all      1.31      0.00      0.13      0.00      0.07     98.49
02:06:09  01:24:01 AM       0      0.62      0.00      0.07      0.00      0.05     99.26
02:06:09  01:24:01 AM       1      2.00      0.00      0.20      0.00      0.08     97.71
02:06:09  01:25:01 AM     all      6.55      0.00      0.55      0.00      0.07     92.83
02:06:09  01:25:01 AM       0      4.28      0.00      0.33      0.00      0.07     95.32
02:06:09  01:25:01 AM       1      8.82      0.00      0.77      0.00      0.07     90.34
02:06:09  01:26:01 AM     all      4.34      0.00      0.35      0.00      0.08     95.23
02:06:09  01:26:01 AM       0      1.86      0.00      0.22      0.00      0.07     97.86
02:06:09  01:26:01 AM       1      6.82      0.00      0.48      0.00      0.08     92.61
02:06:09  01:27:01 AM     all      4.42      0.00      0.33      0.00      0.08     95.18
02:06:09  01:27:01 AM       0      3.71      0.00      0.28      0.00      0.07     95.94
02:06:09  01:27:01 AM       1      5.13      0.00      0.37      0.00      0.08     94.42
02:06:09  01:28:01 AM     all      4.39      0.16      0.42      0.00      0.08     94.95
02:06:09  01:28:01 AM       0      2.78      0.32      0.37      0.00      0.08     96.45
02:06:09  01:28:01 AM       1      5.99      0.00      0.47      0.00      0.08     93.45
02:06:09  
02:06:09  01:28:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
02:06:09  01:29:01 AM     all      4.34      0.00      0.30      0.00      0.08     95.29
02:06:09  01:29:01 AM       0      2.96      0.00      0.22      0.00      0.07     96.76
02:06:09  01:29:01 AM       1      5.71      0.00      0.38      0.00      0.08     93.82
02:06:09  01:30:01 AM     all      4.43      0.00      0.33      0.00      0.09     95.14
02:06:09  01:30:01 AM       0      2.29      0.00      0.27      0.00      0.05     97.39
02:06:09  01:30:01 AM       1      6.57      0.00      0.40      0.00      0.13     92.90
02:06:09  01:31:01 AM     all      7.04      0.00      0.43      0.00      0.07     92.46
02:06:09  01:31:01 AM       0      3.28      0.00      0.32      0.00      0.05     96.35
02:06:09  01:31:01 AM       1     10.80      0.00      0.55      0.00      0.08     88.56
02:06:09  01:32:01 AM     all      1.23      0.00      0.13      0.00      0.08     98.56
02:06:09  01:32:01 AM       0      0.70      0.00      0.10      0.00      0.07     99.13
02:06:09  01:32:01 AM       1      1.75      0.00      0.17      0.00      0.08     98.00
02:06:09  01:33:01 AM     all      1.27      0.00      0.14      0.00      0.06     98.53
02:06:09  01:33:01 AM       0      1.22      0.00      0.13      0.00      0.05     98.60
02:06:09  01:33:01 AM       1      1.32      0.00      0.15      0.00      0.07     98.46
02:06:09  01:34:01 AM     all      1.24      0.00      0.12      0.00      0.07     98.57
02:06:09  01:34:01 AM       0      0.84      0.00      0.10      0.00      0.05     99.01
02:06:09  01:34:01 AM       1      1.65      0.00      0.13      0.00      0.08     98.13
02:06:09  01:35:01 AM     all      1.26      0.00      0.13      0.00      0.08     98.54
02:06:09  01:35:01 AM       0      1.14      0.00      0.08      0.00      0.07     98.71
02:06:09  01:35:01 AM       1      1.39      0.00      0.17      0.00      0.08     98.36
02:06:09  01:36:01 AM     all      1.27      0.00      0.13      0.00      0.07     98.53
02:06:09  01:36:01 AM       0      0.80      0.00      0.10      0.00      0.05     99.05
02:06:09  01:36:01 AM       1      1.74      0.00      0.17      0.00      0.08     98.01
02:06:09  01:37:01 AM     all      1.27      0.00      0.13      0.01      0.06     98.54
02:06:09  01:37:01 AM       0      1.47      0.00      0.13      0.02      0.05     98.33
02:06:09  01:37:01 AM       1      1.07      0.00      0.12      0.00      0.07     98.75
02:06:09  01:38:02 AM     all      7.51      0.00      1.03      0.00      0.10     91.36
02:06:09  01:38:02 AM       0      6.22      0.00      1.34      0.00      0.12     92.32
02:06:09  01:38:02 AM       1      8.80      0.00      0.71      0.00      0.08     90.40
02:06:09  01:39:01 AM     all      4.51      0.00      0.33      0.00      0.08     95.08
02:06:09  01:39:01 AM       0      4.46      0.00      0.34      0.00      0.07     95.13
02:06:09  01:39:01 AM       1      4.57      0.00      0.32      0.00      0.08     95.02
02:06:09  
02:06:09  01:39:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
02:06:09  01:40:01 AM     all      4.78      0.00      0.35      0.00      0.07     94.80
02:06:09  01:40:01 AM       0      3.62      0.00      0.28      0.00      0.07     96.03
02:06:09  01:40:01 AM       1      5.95      0.00      0.42      0.00      0.07     93.57
02:06:09  01:41:01 AM     all      4.54      0.00      0.35      0.01      0.07     95.04
02:06:09  01:41:01 AM       0      3.73      0.00      0.33      0.00      0.07     95.87
02:06:09  01:41:01 AM       1      5.35      0.00      0.37      0.02      0.07     94.20
02:06:09  01:42:01 AM     all      4.55      0.00      0.38      0.00      0.07     95.01
02:06:09  01:42:01 AM       0      1.74      0.00      0.22      0.00      0.05     97.99
02:06:09  01:42:01 AM       1      7.35      0.00      0.53      0.00      0.08     92.03
02:06:09  01:43:01 AM     all      4.50      0.00      0.37      0.00      0.07     95.06
02:06:09  01:43:01 AM       0      4.33      0.00      0.38      0.00      0.05     95.23
02:06:09  01:43:01 AM       1      4.68      0.00      0.35      0.00      0.08     94.89
02:06:09  01:44:01 AM     all      6.75      0.00      0.43      0.00      0.08     92.74
02:06:09  01:44:01 AM       0      4.86      0.00      0.40      0.00      0.08     94.65
02:06:09  01:44:01 AM       1      8.64      0.00      0.45      0.00      0.08     90.83
02:06:09  01:45:01 AM     all      1.18      0.00      0.15      0.00      0.06     98.61
02:06:09  01:45:01 AM       0      1.10      0.00      0.18      0.00      0.08     98.63
02:06:09  01:45:01 AM       1      1.25      0.00      0.12      0.00      0.03     98.60
02:06:09  01:46:01 AM     all      1.28      0.00      0.13      0.01      0.08     98.51
02:06:09  01:46:01 AM       0      1.96      0.00      0.13      0.00      0.08     97.83
02:06:09  01:46:01 AM       1      0.60      0.00      0.12      0.02      0.07     99.20
02:06:09  01:47:01 AM     all      1.25      0.00      0.13      0.00      0.07     98.55
02:06:09  01:47:01 AM       0      1.17      0.00      0.12      0.00      0.07     98.65
02:06:09  01:47:01 AM       1      1.34      0.00      0.15      0.00      0.07     98.45
02:06:09  01:48:01 AM     all      1.13      0.00      0.12      0.00      0.08     98.68
02:06:09  01:48:01 AM       0      0.79      0.00      0.07      0.00      0.07     99.08
02:06:09  01:48:01 AM       1      1.47      0.00      0.17      0.00      0.08     98.28
02:06:09  01:49:01 AM     all      1.18      0.00      0.14      0.00      0.06     98.62
02:06:09  01:49:01 AM       0      1.40      0.00      0.17      0.00      0.07     98.36
02:06:09  01:49:01 AM       1      0.95      0.00      0.12      0.00      0.05     98.88
02:06:09  01:50:01 AM     all      3.07      0.00      0.35      0.00      0.08     96.50
02:06:09  01:50:01 AM       0      2.31      0.00      0.43      0.00      0.08     97.17
02:06:09  01:50:01 AM       1      3.83      0.00      0.27      0.00      0.08     95.82
02:06:09  
02:06:09  01:50:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
02:06:09  01:51:01 AM     all      0.47      0.00      0.13      0.00      0.07     99.34
02:06:09  01:51:01 AM       0      0.74      0.00      0.08      0.00      0.05     99.13
02:06:09  01:51:01 AM       1      0.20      0.00      0.17      0.00      0.08     99.55
02:06:09  01:52:01 AM     all      6.20      0.00      0.41      0.00      0.08     93.30
02:06:09  01:52:01 AM       0      6.19      0.00      0.45      0.00      0.08     93.28
02:06:09  01:52:01 AM       1      6.22      0.00      0.37      0.00      0.08     93.33
02:06:09  01:53:01 AM     all      4.24      0.00      0.32      0.00      0.08     95.36
02:06:09  01:53:01 AM       0      2.82      0.00      0.27      0.00      0.08     96.82
02:06:09  01:53:01 AM       1      5.67      0.00      0.37      0.00      0.07     93.90
02:06:09  01:54:01 AM     all      4.32      0.00      0.33      0.00      0.08     95.28
02:06:09  01:54:01 AM       0      3.18      0.00      0.28      0.00      0.07     96.47
02:06:09  01:54:01 AM       1      5.46      0.00      0.37      0.00      0.08     94.08
02:06:09  01:55:01 AM     all      4.31      0.00      0.31      0.00      0.08     95.30
02:06:09  01:55:01 AM       0      3.98      0.00      0.27      0.00      0.07     95.69
02:06:09  01:55:01 AM       1      4.64      0.00      0.35      0.00      0.08     94.92
02:06:09  01:56:01 AM     all      4.27      0.00      0.33      0.00      0.08     95.32
02:06:09  01:56:01 AM       0      3.26      0.00      0.23      0.00      0.08     96.42
02:06:09  01:56:01 AM       1      5.28      0.00      0.42      0.00      0.08     94.22
02:06:09  01:57:01 AM     all      4.28      0.00      0.35      0.00      0.08     95.30
02:06:09  01:57:01 AM       0      3.81      0.00      0.35      0.00      0.07     95.77
02:06:09  01:57:01 AM       1      4.74      0.00      0.35      0.00      0.08     94.82
02:06:09  01:58:01 AM     all      5.47      0.00      0.30      0.00      0.07     94.17
02:06:09  01:58:01 AM       0      6.68      0.00      0.32      0.00      0.08     92.92
02:06:09  01:58:01 AM       1      4.26      0.00      0.28      0.00      0.05     95.41
02:06:09  01:59:01 AM     all      1.20      0.00      0.13      0.00      0.07     98.61
02:06:09  01:59:01 AM       0      1.29      0.00      0.13      0.00      0.08     98.50
02:06:09  01:59:01 AM       1      1.12      0.00      0.12      0.00      0.05     98.72
02:06:09  02:00:01 AM     all      1.28      0.00      0.15      0.00      0.08     98.49
02:06:09  02:00:01 AM       0      0.60      0.00      0.13      0.00      0.07     99.20
02:06:09  02:00:01 AM       1      1.95      0.00      0.17      0.00      0.10     97.78
02:06:09  02:01:01 AM     all      1.09      0.00      0.13      0.00      0.07     98.71
02:06:09  02:01:01 AM       0      0.62      0.00      0.10      0.00      0.07     99.21
02:06:09  02:01:01 AM       1      1.57      0.00      0.17      0.00      0.07     98.20
02:06:09  
02:06:09  02:01:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
02:06:09  02:02:01 AM     all      1.09      0.00      0.13      0.00      0.07     98.71
02:06:09  02:02:01 AM       0      0.69      0.00      0.10      0.00      0.07     99.15
02:06:09  02:02:01 AM       1      1.50      0.00      0.15      0.00      0.07     98.28
02:06:09  02:03:01 AM     all      1.24      0.00      0.12      0.00      0.09     98.55
02:06:09  02:03:01 AM       0      0.58      0.00      0.07      0.00      0.07     99.28
02:06:09  02:03:01 AM       1      1.90      0.00      0.17      0.00      0.12     97.81
02:06:09  02:04:01 AM     all     10.41      0.00      1.95      0.00      0.08     87.57
02:06:09  02:04:01 AM       0      5.10      0.00      1.32      0.00      0.07     93.51
02:06:09  02:04:01 AM       1     15.74      0.00      2.57      0.00      0.08     81.60
02:06:09  02:05:01 AM     all     33.12      0.00      3.26      0.10      0.11     63.41
02:06:09  02:05:01 AM       0     43.53      0.00      3.34      0.15      0.12     52.86
02:06:09  02:05:01 AM       1     22.70      0.00      3.18      0.05      0.10     73.98
02:06:09  02:06:01 AM     all     29.26      0.00      3.99      0.39      0.08     66.29
02:06:09  02:06:01 AM       0     13.91      0.00      2.77      0.25      0.08     82.98
02:06:09  02:06:01 AM       1     44.61      0.00      5.21      0.53      0.07     49.58
02:06:09  Average:        all      4.16      0.00      0.32      0.01      0.08     95.43
02:06:09  Average:          0      3.13      0.00      0.27      0.01      0.07     96.52
02:06:09  Average:          1      5.20      0.00      0.37      0.01      0.08     94.34
02:06:09  
02:06:09  
02:06:09