04:31:41  Started by upstream project "integration-distribution-test-calcium" build number 648
04:31:41  originally caused by:
04:31:41   Started by upstream project "autorelease-release-calcium-mvn38-openjdk17" build number 549
04:31:41   originally caused by:
04:31:41    Started by timer
04:31:41  Running as SYSTEM
04:31:41  [EnvInject] - Loading node environment variables.
04:31:41  Building remotely on prd-centos8-robot-2c-8g-2479 (centos8-robot-2c-8g) in workspace /w/workspace/ovsdb-csit-3node-upstream-clustering-only-calcium
04:31:41  [ssh-agent] Looking for ssh-agent implementation...
04:31:41  [ssh-agent]   Exec ssh-agent (binary ssh-agent on a remote machine)
04:31:41  $ ssh-agent
04:31:41  SSH_AUTH_SOCK=/tmp/ssh-48in8y3FnkQE/agent.5287
04:31:41  SSH_AGENT_PID=5288
04:31:41  [ssh-agent] Started.
04:31:41  Running ssh-add (command line suppressed)
04:31:41  Identity added: /w/workspace/ovsdb-csit-3node-upstream-clustering-only-calcium@tmp/private_key_13059472596608000291.key (/w/workspace/ovsdb-csit-3node-upstream-clustering-only-calcium@tmp/private_key_13059472596608000291.key)
04:31:41  [ssh-agent] Using credentials jenkins (Release Engineering Jenkins Key)
04:31:41  The recommended git tool is: NONE
04:31:44  using credential opendaylight-jenkins-ssh
04:31:44  Wiping out workspace first.
04:31:44  Cloning the remote Git repository
04:31:44  Cloning repository git://devvexx.opendaylight.org/mirror/integration/test
04:31:44   > git init /w/workspace/ovsdb-csit-3node-upstream-clustering-only-calcium/test # timeout=10
04:31:44  Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test
04:31:44   > git --version # timeout=10
04:31:44   > git --version # 'git version 2.43.0'
04:31:44  using GIT_SSH to set credentials Release Engineering Jenkins Key
04:31:44  [INFO] Currently running in a labeled security context
04:31:44  [INFO] Currently SELinux is 'enforcing' on the host
04:31:44   > /usr/bin/chcon --type=ssh_home_t /w/workspace/ovsdb-csit-3node-upstream-clustering-only-calcium/test@tmp/jenkins-gitclient-ssh10218620795174442543.key
04:31:44  Verifying host key using known hosts file
04:31:44  You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification.
04:31:44   > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test +refs/heads/*:refs/remotes/origin/* # timeout=10
04:31:46   > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10
04:31:46   > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
04:31:47   > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10
04:31:47  Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test
04:31:47  using GIT_SSH to set credentials Release Engineering Jenkins Key
04:31:47  [INFO] Currently running in a labeled security context
04:31:47  [INFO] Currently SELinux is 'enforcing' on the host
04:31:47   > /usr/bin/chcon --type=ssh_home_t /w/workspace/ovsdb-csit-3node-upstream-clustering-only-calcium/test@tmp/jenkins-gitclient-ssh12893861662707699903.key
04:31:47  Verifying host key using known hosts file
04:31:47  You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification.
04:31:47   > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test master # timeout=10
04:31:47   > git rev-parse FETCH_HEAD^{commit} # timeout=10
04:31:47  Checking out Revision 1d2a1a30bcc48e3c8d571eb0d9b6891fe29dfed4 (origin/master)
04:31:47   > git config core.sparsecheckout # timeout=10
04:31:47   > git checkout -f 1d2a1a30bcc48e3c8d571eb0d9b6891fe29dfed4 # timeout=10
04:31:48  Commit message: "Add bgpcep variables for titanium"
04:31:48   > git rev-parse FETCH_HEAD^{commit} # timeout=10
04:31:48   > git rev-list --no-walk d42b2c24fe4fcc7fe3ae0d352311e768f07a15b7 # timeout=10
04:31:48  No emails were triggered.
04:31:48  provisioning config files...
04:31:48  copy managed file [npmrc] to file:/home/jenkins/.npmrc
04:31:48  copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf
04:31:49  copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
04:31:49  [ovsdb-csit-3node-upstream-clustering-only-calcium] $ /bin/bash /tmp/jenkins16719498173371903830.sh
04:31:49  ---> python-tools-install.sh
04:31:49  Setup pyenv:
04:31:49    system
04:31:49  * 3.8.13 (set by /opt/pyenv/version)
04:31:49  * 3.9.13 (set by /opt/pyenv/version)
04:31:49  * 3.10.13 (set by /opt/pyenv/version)
04:31:49  * 3.11.7 (set by /opt/pyenv/version)
04:31:53  lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-jXOv
04:31:53  lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv
04:31:56  lf-activate-venv(): INFO: Installing: lftools 
04:32:22  lf-activate-venv(): INFO: Adding /tmp/venv-jXOv/bin to PATH
04:32:22  Generating Requirements File
04:32:40  Python 3.11.7
04:32:40  pip 25.0.1 from /tmp/venv-jXOv/lib/python3.11/site-packages/pip (python 3.11)
04:32:41  appdirs==1.4.4
04:32:41  argcomplete==3.5.3
04:32:41  aspy.yaml==1.3.0
04:32:41  attrs==25.1.0
04:32:41  autopage==0.5.2
04:32:41  beautifulsoup4==4.13.3
04:32:41  boto3==1.37.0
04:32:41  botocore==1.37.0
04:32:41  bs4==0.0.2
04:32:41  cachetools==5.5.2
04:32:41  certifi==2025.1.31
04:32:41  cffi==1.17.1
04:32:41  cfgv==3.4.0
04:32:41  chardet==5.2.0
04:32:41  charset-normalizer==3.4.1
04:32:41  click==8.1.8
04:32:41  cliff==4.8.0
04:32:41  cmd2==2.5.11
04:32:41  cryptography==3.3.2
04:32:41  debtcollector==3.0.0
04:32:41  decorator==5.2.1
04:32:41  defusedxml==0.7.1
04:32:41  Deprecated==1.2.18
04:32:41  distlib==0.3.9
04:32:41  dnspython==2.7.0
04:32:41  docker==4.2.2
04:32:41  dogpile.cache==1.3.4
04:32:41  durationpy==0.9
04:32:41  email_validator==2.2.0
04:32:41  filelock==3.17.0
04:32:41  future==1.0.0
04:32:41  gitdb==4.0.12
04:32:41  GitPython==3.1.44
04:32:41  google-auth==2.38.0
04:32:41  httplib2==0.22.0
04:32:41  identify==2.6.8
04:32:41  idna==3.10
04:32:41  importlib-resources==1.5.0
04:32:41  iso8601==2.1.0
04:32:41  Jinja2==3.1.5
04:32:41  jmespath==1.0.1
04:32:41  jsonpatch==1.33
04:32:41  jsonpointer==3.0.0
04:32:41  jsonschema==4.23.0
04:32:41  jsonschema-specifications==2024.10.1
04:32:41  keystoneauth1==5.10.0
04:32:41  kubernetes==32.0.1
04:32:41  lftools==0.37.10
04:32:41  lxml==5.3.1
04:32:41  MarkupSafe==3.0.2
04:32:41  msgpack==1.1.0
04:32:41  multi_key_dict==2.0.3
04:32:41  munch==4.0.0
04:32:41  netaddr==1.3.0
04:32:41  niet==1.4.2
04:32:41  nodeenv==1.9.1
04:32:41  oauth2client==4.1.3
04:32:41  oauthlib==3.2.2
04:32:41  openstacksdk==4.3.0
04:32:41  os-client-config==2.1.0
04:32:41  os-service-types==1.7.0
04:32:41  osc-lib==3.2.0
04:32:41  oslo.config==9.7.1
04:32:41  oslo.context==5.7.1
04:32:41  oslo.i18n==6.5.1
04:32:41  oslo.log==7.1.0
04:32:41  oslo.serialization==5.7.0
04:32:41  oslo.utils==8.2.0
04:32:41  packaging==24.2
04:32:41  pbr==6.1.1
04:32:41  platformdirs==4.3.6
04:32:41  prettytable==3.14.0
04:32:41  psutil==7.0.0
04:32:41  pyasn1==0.6.1
04:32:41  pyasn1_modules==0.4.1
04:32:41  pycparser==2.22
04:32:41  pygerrit2==2.0.15
04:32:41  PyGithub==2.6.1
04:32:41  PyJWT==2.10.1
04:32:41  PyNaCl==1.5.0
04:32:41  pyparsing==2.4.7
04:32:41  pyperclip==1.9.0
04:32:41  pyrsistent==0.20.0
04:32:41  python-cinderclient==9.6.0
04:32:41  python-dateutil==2.9.0.post0
04:32:41  python-heatclient==4.1.0
04:32:41  python-jenkins==1.8.2
04:32:41  python-keystoneclient==5.5.0
04:32:41  python-magnumclient==4.7.0
04:32:41  python-openstackclient==7.3.1
04:32:41  python-swiftclient==4.6.0
04:32:41  PyYAML==6.0.2
04:32:41  referencing==0.36.2
04:32:41  requests==2.32.3
04:32:41  requests-oauthlib==2.0.0
04:32:41  requestsexceptions==1.4.0
04:32:41  rfc3986==2.0.0
04:32:41  rpds-py==0.23.1
04:32:41  rsa==4.9
04:32:41  ruamel.yaml==0.18.10
04:32:41  ruamel.yaml.clib==0.2.12
04:32:41  s3transfer==0.11.2
04:32:41  simplejson==3.20.1
04:32:41  six==1.17.0
04:32:41  smmap==5.0.2
04:32:41  soupsieve==2.6
04:32:41  stevedore==5.4.1
04:32:41  tabulate==0.9.0
04:32:41  toml==0.10.2
04:32:41  tomlkit==0.13.2
04:32:41  tqdm==4.67.1
04:32:41  typing_extensions==4.12.2
04:32:41  tzdata==2025.1
04:32:41  urllib3==1.26.20
04:32:41  virtualenv==20.29.2
04:32:41  wcwidth==0.2.13
04:32:41  websocket-client==1.8.0
04:32:41  wrapt==1.17.2
04:32:41  xdg==6.0.0
04:32:41  xmltodict==0.14.2
04:32:41  yq==3.4.3
04:32:41  [EnvInject] - Injecting environment variables from a build step.
04:32:41  [EnvInject] - Injecting as environment variables the properties content 
04:32:41  OS_STACK_TEMPLATE=csit-2-instance-type.yaml
04:32:41  OS_CLOUD=vex
04:32:41  OS_STACK_NAME=releng-ovsdb-csit-3node-upstream-clustering-only-calcium-646
04:32:41  OS_STACK_TEMPLATE_DIR=openstack-hot
04:32:41  
04:32:41  [EnvInject] - Variables injected successfully.
04:32:41  provisioning config files...
04:32:41  copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
04:32:41  [ovsdb-csit-3node-upstream-clustering-only-calcium] $ /bin/bash /tmp/jenkins17828927934765433254.sh
04:32:41  ---> Create parameters file for OpenStack HOT
04:32:41  OpenStack Heat parameters generated
04:32:41  -----------------------------------
04:32:41  parameters:
04:32:41      vm_0_count: '3'
04:32:41      vm_0_flavor: 'v3-standard-4'
04:32:41      vm_0_image: 'ZZCI - Ubuntu 20.04 - builder - x86_64 - 20250101-160150.998'
04:32:41      vm_1_count: '1'
04:32:41      vm_1_flavor: 'v3-standard-2'
04:32:41      vm_1_image: 'ZZCI - Ubuntu 22.04 - mininet-ovs-217 - x86_64 - 20250201-060151.911'
04:32:41      
04:32:41      job_name: '07564-646'
04:32:41      silo: 'releng'
04:32:41  [ovsdb-csit-3node-upstream-clustering-only-calcium] $ /bin/bash -l /tmp/jenkins17020499082726077627.sh
04:32:41  ---> Create HEAT stack
04:32:41  + source /home/jenkins/lf-env.sh
04:32:41  + lf-activate-venv --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
04:32:41  ++ mktemp -d /tmp/venv-XXXX
04:32:41  + lf_venv=/tmp/venv-02Xz
04:32:41  + local venv_file=/tmp/.os_lf_venv
04:32:41  + local python=python3
04:32:41  + local options
04:32:41  + local set_path=true
04:32:41  + local install_args=
04:32:41  ++ getopt -o np:v: -l no-path,system-site-packages,python:,venv-file: -n lf-activate-venv -- --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
04:32:41  + options=' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\'''
04:32:41  + eval set -- ' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\'''
04:32:41  ++ set -- --python python3 -- 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
04:32:41  + true
04:32:41  + case $1 in
04:32:41  + python=python3
04:32:41  + shift 2
04:32:41  + true
04:32:41  + case $1 in
04:32:41  + shift
04:32:41  + break
04:32:41  + case $python in
04:32:41  + local pkg_list=
04:32:41  + [[ -d /opt/pyenv ]]
04:32:41  + echo 'Setup pyenv:'
04:32:41  Setup pyenv:
04:32:41  + export PYENV_ROOT=/opt/pyenv
04:32:41  + PYENV_ROOT=/opt/pyenv
04:32:41  + export PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
04:32:41  + PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
04:32:41  + pyenv versions
04:32:41    system
04:32:41    3.8.13
04:32:41    3.9.13
04:32:41    3.10.13
04:32:41  * 3.11.7 (set by /w/workspace/ovsdb-csit-3node-upstream-clustering-only-calcium/.python-version)
04:32:41  + command -v pyenv
04:32:41  ++ pyenv init - --no-rehash
04:32:41  + eval 'PATH="$(bash --norc -ec '\''IFS=:; paths=($PATH); 
04:32:41  for i in ${!paths[@]}; do 
04:32:41  if [[ ${paths[i]} == "'\'''\''/opt/pyenv/shims'\'''\''" ]]; then unset '\''\'\'''\''paths[i]'\''\'\'''\''; 
04:32:41  fi; done; 
04:32:41  echo "${paths[*]}"'\'')"
04:32:41  export PATH="/opt/pyenv/shims:${PATH}"
04:32:41  export PYENV_SHELL=bash
04:32:41  source '\''/opt/pyenv/libexec/../completions/pyenv.bash'\''
04:32:41  pyenv() {
04:32:41    local command
04:32:41    command="${1:-}"
04:32:41    if [ "$#" -gt 0 ]; then
04:32:41      shift
04:32:41    fi
04:32:41  
04:32:41    case "$command" in
04:32:41    rehash|shell)
04:32:41      eval "$(pyenv "sh-$command" "$@")"
04:32:41      ;;
04:32:41    *)
04:32:41      command pyenv "$command" "$@"
04:32:41      ;;
04:32:41    esac
04:32:41  }'
04:32:41  +++ bash --norc -ec 'IFS=:; paths=($PATH); 
04:32:41  for i in ${!paths[@]}; do 
04:32:41  if [[ ${paths[i]} == "/opt/pyenv/shims" ]]; then unset '\''paths[i]'\''; 
04:32:41  fi; done; 
04:32:41  echo "${paths[*]}"'
04:32:41  ++ PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
04:32:41  ++ export PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
04:32:41  ++ PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
04:32:41  ++ export PYENV_SHELL=bash
04:32:41  ++ PYENV_SHELL=bash
04:32:41  ++ source /opt/pyenv/libexec/../completions/pyenv.bash
04:32:41  +++ complete -F _pyenv pyenv
04:32:41  ++ lf-pyver python3
04:32:41  ++ local py_version_xy=python3
04:32:41  ++ local py_version_xyz=
04:32:41  ++ awk '{ print $1 }'
04:32:41  ++ pyenv versions
04:32:41  ++ local command
04:32:41  ++ command=versions
04:32:41  ++ '[' 1 -gt 0 ']'
04:32:41  ++ shift
04:32:41  ++ case "$command" in
04:32:41  ++ command pyenv versions
04:32:41  ++ pyenv versions
04:32:41  ++ sed 's/^[ *]* //'
04:32:41  ++ grep -E '^[0-9.]*[0-9]$'
04:32:41  ++ [[ ! -s /tmp/.pyenv_versions ]]
04:32:41  +++ grep '^3' /tmp/.pyenv_versions
04:32:41  +++ tail -n 1
04:32:41  +++ sort -V
04:32:41  ++ py_version_xyz=3.11.7
04:32:41  ++ [[ -z 3.11.7 ]]
04:32:41  ++ echo 3.11.7
04:32:41  ++ return 0
04:32:41  + pyenv local 3.11.7
04:32:41  + local command
04:32:41  + command=local
04:32:41  + '[' 2 -gt 0 ']'
04:32:41  + shift
04:32:41  + case "$command" in
04:32:41  + command pyenv local 3.11.7
04:32:41  + pyenv local 3.11.7
04:32:41  + for arg in "$@"
04:32:41  + case $arg in
04:32:41  + pkg_list+='lftools[openstack] '
04:32:41  + for arg in "$@"
04:32:41  + case $arg in
04:32:41  + pkg_list+='kubernetes '
04:32:41  + for arg in "$@"
04:32:41  + case $arg in
04:32:41  + pkg_list+='niet '
04:32:41  + for arg in "$@"
04:32:41  + case $arg in
04:32:41  + pkg_list+='python-heatclient '
04:32:41  + for arg in "$@"
04:32:41  + case $arg in
04:32:41  + pkg_list+='python-openstackclient '
04:32:41  + for arg in "$@"
04:32:41  + case $arg in
04:32:41  + pkg_list+='python-magnumclient '
04:32:41  + for arg in "$@"
04:32:41  + case $arg in
04:32:41  + pkg_list+='yq '
04:32:41  + [[ -f /tmp/.os_lf_venv ]]
04:32:41  ++ cat /tmp/.os_lf_venv
04:32:41  + lf_venv=/tmp/venv-jXOv
04:32:41  + echo 'lf-activate-venv(): INFO: Reuse venv:/tmp/venv-jXOv from' file:/tmp/.os_lf_venv
04:32:41  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-jXOv from file:/tmp/.os_lf_venv
04:32:41  + /tmp/venv-jXOv/bin/python3 -m pip install --upgrade --quiet pip virtualenv
04:32:42  + [[ -z lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq  ]]
04:32:42  + echo 'lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq '
04:32:42  lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 
04:32:42  + /tmp/venv-jXOv/bin/python3 -m pip install --upgrade --quiet --upgrade-strategy eager 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
04:32:57  + type python3
04:32:57  + true
04:32:57  + echo 'lf-activate-venv(): INFO: Adding /tmp/venv-jXOv/bin to PATH'
04:32:57  lf-activate-venv(): INFO: Adding /tmp/venv-jXOv/bin to PATH
04:32:57  + PATH=/tmp/venv-jXOv/bin:/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
04:32:57  + return 0
04:32:57  + openstack --os-cloud vex limits show --absolute
04:32:58  +--------------------------+---------+
04:32:58  | Name                     |   Value |
04:32:58  +--------------------------+---------+
04:32:58  | maxTotalInstances        |      -1 |
04:32:58  | maxTotalCores            |     450 |
04:32:58  | maxTotalRAMSize          | 1000000 |
04:32:58  | maxServerMeta            |     128 |
04:32:58  | maxImageMeta             |     128 |
04:32:58  | maxPersonality           |       5 |
04:32:58  | maxPersonalitySize       |   10240 |
04:32:58  | maxTotalKeypairs         |     100 |
04:32:58  | maxServerGroups          |      10 |
04:32:58  | maxServerGroupMembers    |      10 |
04:32:58  | maxTotalFloatingIps      |      -1 |
04:32:58  | maxSecurityGroups        |      -1 |
04:32:58  | maxSecurityGroupRules    |      -1 |
04:32:58  | totalRAMUsed             |  688128 |
04:32:58  | totalCoresUsed           |     168 |
04:32:58  | totalInstancesUsed       |      58 |
04:32:58  | totalFloatingIpsUsed     |       0 |
04:32:58  | totalSecurityGroupsUsed  |       0 |
04:32:58  | totalServerGroupsUsed    |       0 |
04:32:58  | maxTotalVolumes          |      -1 |
04:32:58  | maxTotalSnapshots        |      10 |
04:32:58  | maxTotalVolumeGigabytes  |    4096 |
04:32:58  | maxTotalBackups          |      10 |
04:32:58  | maxTotalBackupGigabytes  |    1000 |
04:32:58  | totalVolumesUsed         |       3 |
04:32:58  | totalGigabytesUsed       |      60 |
04:32:58  | totalSnapshotsUsed       |       0 |
04:32:58  | totalBackupsUsed         |       0 |
04:32:58  | totalBackupGigabytesUsed |       0 |
04:32:58  +--------------------------+---------+
04:32:58  + pushd /opt/ciman/openstack-hot
04:32:58  /opt/ciman/openstack-hot /w/workspace/ovsdb-csit-3node-upstream-clustering-only-calcium
04:32:58  + lftools openstack --os-cloud vex stack create releng-ovsdb-csit-3node-upstream-clustering-only-calcium-646 csit-2-instance-type.yaml /w/workspace/ovsdb-csit-3node-upstream-clustering-only-calcium/stack-parameters.yaml
04:33:25  Creating stack releng-ovsdb-csit-3node-upstream-clustering-only-calcium-646
04:33:25  Waiting to initialize infrastructure...
04:33:25  Stack initialization successful.
04:33:25  ------------------------------------
04:33:25  Stack Details
04:33:25  ------------------------------------
04:33:25  {'added': None,
04:33:25   'capabilities': [],
04:33:25   'created_at': '2025-02-25T04:33:01Z',
04:33:25   'deleted': None,
04:33:25   'deleted_at': None,
04:33:25   'description': 'No description',
04:33:25   'environment': None,
04:33:25   'environment_files': None,
04:33:25   'files': None,
04:33:25   'files_container': None,
04:33:25   'id': 'd12f951e-5109-407e-9f76-522222f29b27',
04:33:25   'is_rollback_disabled': True,
04:33:25   'links': [{'href': 'https://orchestration.public.mtl1.vexxhost.net/v1/12c36e260d8e4bb2913965203b1b491f/stacks/releng-ovsdb-csit-3node-upstream-clustering-only-calcium-646/d12f951e-5109-407e-9f76-522222f29b27',
04:33:25              'rel': 'self'}],
04:33:25   'location': Munch({'cloud': 'vex', 'region_name': 'ca-ymq-1', 'zone': None, 'project': Munch({'id': '12c36e260d8e4bb2913965203b1b491f', 'name': '61975f2c-7c17-4d69-82fa-c3ae420ad6fd', 'domain_id': None, 'domain_name': 'Default'})}),
04:33:25   'name': 'releng-ovsdb-csit-3node-upstream-clustering-only-calcium-646',
04:33:25   'notification_topics': [],
04:33:25   'outputs': [{'description': 'IP addresses of the 1st vm types',
04:33:25                'output_key': 'vm_0_ips',
04:33:25                'output_value': ['10.30.171.228',
04:33:25                                 '10.30.170.250',
04:33:25                                 '10.30.171.190']},
04:33:25               {'description': 'IP addresses of the 2nd vm types',
04:33:25                'output_key': 'vm_1_ips',
04:33:25                'output_value': ['10.30.171.177']}],
04:33:25   'owner_id': ****,
04:33:25   'parameters': {'OS::project_id': '12c36e260d8e4bb2913965203b1b491f',
04:33:25                  'OS::stack_id': 'd12f951e-5109-407e-9f76-522222f29b27',
04:33:25                  'OS::stack_name': 'releng-ovsdb-csit-3node-upstream-clustering-only-calcium-646',
04:33:25                  'job_name': '07564-646',
04:33:25                  'silo': 'releng',
04:33:25                  'vm_0_count': '3',
04:33:25                  'vm_0_flavor': 'v3-standard-4',
04:33:25                  'vm_0_image': 'ZZCI - Ubuntu 20.04 - builder - x86_64 - '
04:33:25                                '20250101-160150.998',
04:33:25                  'vm_1_count': '1',
04:33:25                  'vm_1_flavor': 'v3-standard-2',
04:33:25                  'vm_1_image': 'ZZCI - Ubuntu 22.04 - mininet-ovs-217 - x86_64 '
04:33:25                                '- 20250201-060151.911'},
04:33:25   'parent_id': None,
04:33:25   'replaced': None,
04:33:25   'status': 'CREATE_COMPLETE',
04:33:25   'status_reason': 'Stack CREATE completed successfully',
04:33:25   'tags': [],
04:33:25   'template': None,
04:33:25   'template_description': 'No description',
04:33:25   'template_url': None,
04:33:25   'timeout_mins': 15,
04:33:25   'unchanged': None,
04:33:25   'updated': None,
04:33:25   'updated_at': None,
04:33:25   'user_project_id': 'dfa2c12a66244f26ae48f803c586197e'}
04:33:25  ------------------------------------
04:33:26  + popd
04:33:26  /w/workspace/ovsdb-csit-3node-upstream-clustering-only-calcium
04:33:26  [ovsdb-csit-3node-upstream-clustering-only-calcium] $ /bin/bash -l /tmp/jenkins1296910375897725212.sh
04:33:26  ---> Copy SSH public keys to CSIT lab
04:33:26  Setup pyenv:
04:33:26    system
04:33:26    3.8.13
04:33:26    3.9.13
04:33:26    3.10.13
04:33:26  * 3.11.7 (set by /w/workspace/ovsdb-csit-3node-upstream-clustering-only-calcium/.python-version)
04:33:26  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-jXOv from file:/tmp/.os_lf_venv
04:33:27  lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes python-heatclient python-openstackclient 
04:33:40  lf-activate-venv(): INFO: Adding /tmp/venv-jXOv/bin to PATH
04:33:41  SSH not responding on 10.30.170.250. Retrying in 10 seconds...
04:33:41  SSH not responding on 10.30.171.190. Retrying in 10 seconds...
04:33:41  SSH not responding on 10.30.171.228. Retrying in 10 seconds...
04:33:42  Warning: Permanently added '10.30.171.177' (ECDSA) to the list of known hosts.
04:33:43   releng-07564-646-1-mininet-ovs-217-0
04:33:43  Successfully copied public keys to slave 10.30.171.177
04:33:43  Process 6506 ready.
04:33:51  Ping to 10.30.171.190 successful.
04:33:51  Ping to 10.30.170.250 successful.
04:33:51  Ping to 10.30.171.228 successful.
04:33:51  SSH not responding on 10.30.171.228. Retrying in 10 seconds...
04:33:52  Warning: Permanently added '10.30.171.190' (ECDSA) to the list of known hosts.
04:33:52  Warning: Permanently added '10.30.170.250' (ECDSA) to the list of known hosts.
04:33:53   releng-07564-646-0-builder-2
04:33:53  Successfully copied public keys to slave 10.30.171.190
04:33:53   releng-07564-646-0-builder-1
04:33:53  Successfully copied public keys to slave 10.30.170.250
04:34:01  Ping to 10.30.171.228 successful.
04:34:03  Warning: Permanently added '10.30.171.228' (ECDSA) to the list of known hosts.
04:34:03   releng-07564-646-0-builder-0
04:34:03  Successfully copied public keys to slave 10.30.171.228
04:34:03  Process 6507 ready.
04:34:03  Process 6508 ready.
04:34:03  Process 6509 ready.
04:34:03  SSH ready on all stack servers.
04:34:03  [ovsdb-csit-3node-upstream-clustering-only-calcium] $ /bin/bash -l /tmp/jenkins4932582856085613995.sh
04:34:03  Setup pyenv:
04:34:03    system
04:34:03    3.8.13
04:34:03    3.9.13
04:34:03    3.10.13
04:34:03  * 3.11.7 (set by /w/workspace/ovsdb-csit-3node-upstream-clustering-only-calcium/.python-version)
04:34:08  lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-yXSO
04:34:08  lf-activate-venv(): INFO: Save venv in file: /w/workspace/ovsdb-csit-3node-upstream-clustering-only-calcium/.robot_venv
04:34:10  lf-activate-venv(): INFO: Installing: setuptools wheel 
04:34:12  lf-activate-venv(): INFO: Adding /tmp/venv-yXSO/bin to PATH
04:34:12  + echo 'Installing Python Requirements'
04:34:12  Installing Python Requirements
04:34:12  + cat
04:34:12  + python -m pip install -r requirements.txt
04:34:12  Looking in indexes: https://nexus3.opendaylight.org/repository/PyPi/simple
04:34:13  Collecting docker-py (from -r requirements.txt (line 1))
04:34:13    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/docker-py/1.10.6/docker_py-1.10.6-py2.py3-none-any.whl (50 kB)
04:34:13  Collecting ipaddr (from -r requirements.txt (line 2))
04:34:13    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/ipaddr/2.2.0/ipaddr-2.2.0.tar.gz (26 kB)
04:34:13    Preparing metadata (setup.py): started
04:34:13    Preparing metadata (setup.py): finished with status 'done'
04:34:13  Collecting netaddr (from -r requirements.txt (line 3))
04:34:13    Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/netaddr/1.3.0/netaddr-1.3.0-py3-none-any.whl (2.3 MB)
04:34:13  Collecting netifaces (from -r requirements.txt (line 4))
04:34:13    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/netifaces/0.11.0/netifaces-0.11.0.tar.gz (30 kB)
04:34:13    Preparing metadata (setup.py): started
04:34:13    Preparing metadata (setup.py): finished with status 'done'
04:34:13  Collecting pyhocon (from -r requirements.txt (line 5))
04:34:13    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyhocon/0.3.61/pyhocon-0.3.61-py3-none-any.whl (25 kB)
04:34:13  Collecting requests (from -r requirements.txt (line 6))
04:34:13    Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/requests/2.32.3/requests-2.32.3-py3-none-any.whl (64 kB)
04:34:14  Collecting robotframework (from -r requirements.txt (line 7))
04:34:14    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework/7.2.2/robotframework-7.2.2-py3-none-any.whl (777 kB)
04:34:14       ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 777.7/777.7 kB 16.9 MB/s eta 0:00:00
04:34:14  Collecting robotframework-httplibrary (from -r requirements.txt (line 8))
04:34:14    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-httplibrary/0.4.2/robotframework-httplibrary-0.4.2.tar.gz (9.1 kB)
04:34:14    Preparing metadata (setup.py): started
04:34:14    Preparing metadata (setup.py): finished with status 'done'
04:34:14  Collecting robotframework-requests==0.9.7 (from -r requirements.txt (line 9))
04:34:14    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-requests/0.9.7/robotframework_requests-0.9.7-py3-none-any.whl (21 kB)
04:34:14  Collecting robotframework-selenium2library (from -r requirements.txt (line 10))
04:34:14    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-selenium2library/3.0.0/robotframework_selenium2library-3.0.0-py2.py3-none-any.whl (6.2 kB)
04:34:14  Collecting robotframework-sshlibrary==3.8.0 (from -r requirements.txt (line 11))
04:34:14    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-sshlibrary/3.8.0/robotframework-sshlibrary-3.8.0.tar.gz (51 kB)
04:34:14    Preparing metadata (setup.py): started
04:34:14    Preparing metadata (setup.py): finished with status 'done'
04:34:14  Collecting scapy (from -r requirements.txt (line 12))
04:34:15    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/scapy/2.6.1/scapy-2.6.1-py3-none-any.whl (2.4 MB)
04:34:15       ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.4/2.4 MB 25.8 MB/s eta 0:00:00
04:34:15  Collecting jsonpath-rw (from -r requirements.txt (line 15))
04:34:15    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpath-rw/1.4.0/jsonpath-rw-1.4.0.tar.gz (13 kB)
04:34:15    Preparing metadata (setup.py): started
04:34:15    Preparing metadata (setup.py): finished with status 'done'
04:34:15  Collecting elasticsearch (from -r requirements.txt (line 18))
04:34:15    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch/8.17.1/elasticsearch-8.17.1-py3-none-any.whl (653 kB)
04:34:15       ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 654.0/654.0 kB 25.6 MB/s eta 0:00:00
04:34:15  Collecting elasticsearch-dsl (from -r requirements.txt (line 19))
04:34:15    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch-dsl/8.17.1/elasticsearch_dsl-8.17.1-py3-none-any.whl (158 kB)
04:34:15  Collecting pyangbind (from -r requirements.txt (line 22))
04:34:15    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyangbind/0.8.6/pyangbind-0.8.6-py3-none-any.whl (52 kB)
04:34:17  Collecting isodate (from -r requirements.txt (line 25))
04:34:17    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/isodate/0.7.2/isodate-0.7.2-py3-none-any.whl (22 kB)
04:34:17  Collecting jmespath (from -r requirements.txt (line 28))
04:34:17    Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jmespath/1.0.1/jmespath-1.0.1-py3-none-any.whl (20 kB)
04:34:17  Collecting jsonpatch (from -r requirements.txt (line 31))
04:34:17    Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpatch/1.33/jsonpatch-1.33-py2.py3-none-any.whl (12 kB)
04:34:17  Collecting paramiko>=1.15.3 (from robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
04:34:17    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/paramiko/3.5.1/paramiko-3.5.1-py3-none-any.whl (227 kB)
04:34:17  Collecting scp>=0.13.0 (from robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
04:34:17    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/scp/0.15.0/scp-0.15.0-py2.py3-none-any.whl (8.8 kB)
04:34:18  Collecting docker-pycreds>=0.2.1 (from docker-py->-r requirements.txt (line 1))
04:34:18    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/docker-pycreds/0.4.0/docker_pycreds-0.4.0-py2.py3-none-any.whl (9.0 kB)
04:34:18  Collecting six>=1.4.0 (from docker-py->-r requirements.txt (line 1))
04:34:18    Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/six/1.17.0/six-1.17.0-py2.py3-none-any.whl (11 kB)
04:34:18  Collecting websocket-client>=0.32.0 (from docker-py->-r requirements.txt (line 1))
04:34:18    Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/websocket-client/1.8.0/websocket_client-1.8.0-py3-none-any.whl (58 kB)
04:34:18  Collecting pyparsing<4,>=2 (from pyhocon->-r requirements.txt (line 5))
04:34:18    Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pyparsing/3.2.1/pyparsing-3.2.1-py3-none-any.whl (107 kB)
04:34:18  Collecting charset-normalizer<4,>=2 (from requests->-r requirements.txt (line 6))
04:34:18    Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/charset-normalizer/3.4.1/charset_normalizer-3.4.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (143 kB)
04:34:18  Collecting idna<4,>=2.5 (from requests->-r requirements.txt (line 6))
04:34:18    Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/idna/3.10/idna-3.10-py3-none-any.whl (70 kB)
04:34:18  Collecting urllib3<3,>=1.21.1 (from requests->-r requirements.txt (line 6))
04:34:18    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/urllib3/2.3.0/urllib3-2.3.0-py3-none-any.whl (128 kB)
04:34:18  Collecting certifi>=2017.4.17 (from requests->-r requirements.txt (line 6))
04:34:18    Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/certifi/2025.1.31/certifi-2025.1.31-py3-none-any.whl (166 kB)
04:34:18  Collecting webtest>=2.0 (from robotframework-httplibrary->-r requirements.txt (line 8))
04:34:18    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/webtest/3.0.4/WebTest-3.0.4-py3-none-any.whl (32 kB)
04:34:18  Collecting jsonpointer (from robotframework-httplibrary->-r requirements.txt (line 8))
04:34:18    Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpointer/3.0.0/jsonpointer-3.0.0-py2.py3-none-any.whl (7.6 kB)
04:34:18  Collecting robotframework-seleniumlibrary>=3.0.0 (from robotframework-selenium2library->-r requirements.txt (line 10))
04:34:18    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-seleniumlibrary/6.7.0/robotframework_seleniumlibrary-6.7.0-py2.py3-none-any.whl (104 kB)
04:34:19  Collecting ply (from jsonpath-rw->-r requirements.txt (line 15))
04:34:19    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/ply/3.11/ply-3.11-py2.py3-none-any.whl (49 kB)
04:34:19  Collecting decorator (from jsonpath-rw->-r requirements.txt (line 15))
04:34:19    Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/decorator/5.2.1/decorator-5.2.1-py3-none-any.whl (9.2 kB)
04:34:19  Collecting elastic-transport<9,>=8.15.1 (from elasticsearch->-r requirements.txt (line 18))
04:34:19    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elastic-transport/8.17.0/elastic_transport-8.17.0-py3-none-any.whl (64 kB)
04:34:19  Collecting python-dateutil (from elasticsearch-dsl->-r requirements.txt (line 19))
04:34:19    Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/python-dateutil/2.9.0.post0/python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB)
04:34:19  Collecting typing-extensions (from elasticsearch-dsl->-r requirements.txt (line 19))
04:34:19    Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/typing-extensions/4.12.2/typing_extensions-4.12.2-py3-none-any.whl (37 kB)
04:34:19  Collecting pyang (from pyangbind->-r requirements.txt (line 22))
04:34:19    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyang/2.6.1/pyang-2.6.1-py2.py3-none-any.whl (594 kB)
04:34:19       ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 594.7/594.7 kB 11.3 MB/s eta 0:00:00
04:34:19  Collecting lxml (from pyangbind->-r requirements.txt (line 22))
04:34:19    Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/lxml/5.3.1/lxml-5.3.1-cp311-cp311-manylinux_2_28_x86_64.whl (5.0 MB)
04:34:20  Collecting regex (from pyangbind->-r requirements.txt (line 22))
04:34:20    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/regex/2024.11.6/regex-2024.11.6-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (792 kB)
04:34:20       ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 792.7/792.7 kB 13.1 MB/s eta 0:00:00
04:34:21  Collecting enum34 (from pyangbind->-r requirements.txt (line 22))
04:34:21    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/enum34/1.1.10/enum34-1.1.10-py3-none-any.whl (11 kB)
04:34:21  Collecting bcrypt>=3.2 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
04:34:21    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/bcrypt/4.2.1/bcrypt-4.2.1-cp39-abi3-manylinux_2_28_x86_64.whl (278 kB)
04:34:21  Collecting cryptography>=3.3 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
04:34:21    Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/cryptography/44.0.1/cryptography-44.0.1-cp39-abi3-manylinux_2_28_x86_64.whl (4.2 MB)
04:34:21  Collecting pynacl>=1.5 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
04:34:21    Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pynacl/1.5.0/PyNaCl-1.5.0-cp36-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.manylinux_2_24_x86_64.whl (856 kB)
04:34:21  Collecting selenium>=4.3.0 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
04:34:21    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/selenium/4.29.0/selenium-4.29.0-py3-none-any.whl (9.5 MB)
04:34:22       ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 9.5/9.5 MB 24.8 MB/s eta 0:00:00
04:34:22  Collecting robotframework-pythonlibcore>=4.4.1 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
04:34:22    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-pythonlibcore/4.4.1/robotframework_pythonlibcore-4.4.1-py2.py3-none-any.whl (12 kB)
04:34:22  Collecting click>=8.1.7 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
04:34:22    Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/click/8.1.8/click-8.1.8-py3-none-any.whl (98 kB)
04:34:22  Collecting WebOb>=1.2 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
04:34:22    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/webob/1.8.9/WebOb-1.8.9-py2.py3-none-any.whl (115 kB)
04:34:22  Collecting waitress>=3.0.2 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
04:34:22    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/waitress/3.0.2/waitress-3.0.2-py3-none-any.whl (56 kB)
04:34:22  Collecting beautifulsoup4 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
04:34:22    Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/beautifulsoup4/4.13.3/beautifulsoup4-4.13.3-py3-none-any.whl (186 kB)
04:34:22  Collecting cffi>=1.12 (from cryptography>=3.3->paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
04:34:22    Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/cffi/1.17.1/cffi-1.17.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (467 kB)
04:34:23  Collecting trio~=0.17 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
04:34:23    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/trio/0.29.0/trio-0.29.0-py3-none-any.whl (492 kB)
04:34:23  Collecting trio-websocket~=0.9 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
04:34:23    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/trio-websocket/0.12.1/trio_websocket-0.12.1-py3-none-any.whl (21 kB)
04:34:23  Collecting soupsieve>1.2 (from beautifulsoup4->webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
04:34:23    Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/soupsieve/2.6/soupsieve-2.6-py3-none-any.whl (36 kB)
04:34:23  Collecting pycparser (from cffi>=1.12->cryptography>=3.3->paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
04:34:23    Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pycparser/2.22/pycparser-2.22-py3-none-any.whl (117 kB)
04:34:23  Collecting attrs>=23.2.0 (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
04:34:23    Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/attrs/25.1.0/attrs-25.1.0-py3-none-any.whl (63 kB)
04:34:23  Collecting sortedcontainers (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
04:34:23    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/sortedcontainers/2.4.0/sortedcontainers-2.4.0-py2.py3-none-any.whl (29 kB)
04:34:23  Collecting outcome (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
04:34:23    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/outcome/1.3.0.post0/outcome-1.3.0.post0-py2.py3-none-any.whl (10 kB)
04:34:23  Collecting sniffio>=1.3.0 (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
04:34:23    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/sniffio/1.3.1/sniffio-1.3.1-py3-none-any.whl (10 kB)
04:34:23  Collecting wsproto>=0.14 (from trio-websocket~=0.9->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
04:34:23    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/wsproto/1.2.0/wsproto-1.2.0-py3-none-any.whl (24 kB)
04:34:25  Collecting pysocks!=1.5.7,<2.0,>=1.5.6 (from urllib3[socks]<3,>=1.26->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
04:34:25    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pysocks/1.7.1/PySocks-1.7.1-py3-none-any.whl (16 kB)
04:34:25  Collecting h11<1,>=0.9.0 (from wsproto>=0.14->trio-websocket~=0.9->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
04:34:25    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/h11/0.14.0/h11-0.14.0-py3-none-any.whl (58 kB)
04:34:25  Building wheels for collected packages: robotframework-sshlibrary, ipaddr, netifaces, robotframework-httplibrary, jsonpath-rw
04:34:25    Building wheel for robotframework-sshlibrary (setup.py): started
04:34:26    Building wheel for robotframework-sshlibrary (setup.py): finished with status 'done'
04:34:26    Created wheel for robotframework-sshlibrary: filename=robotframework_sshlibrary-3.8.0-py3-none-any.whl size=55176 sha256=f3bdc1b0e46973933778d17987620c2d88e0409fe860cb99cba0cd6e05914f00
04:34:26    Stored in directory: /home/jenkins/.cache/pip/wheels/f7/c9/b3/a977b7bcc410d45ae27d240df3d00a12585509180e373ecccc
04:34:26    Building wheel for ipaddr (setup.py): started
04:34:26    Building wheel for ipaddr (setup.py): finished with status 'done'
04:34:26    Created wheel for ipaddr: filename=ipaddr-2.2.0-py3-none-any.whl size=18322 sha256=f7d9d5e3ad7e85bd02f2301ad108b2cd323e8b89729204783770081d39fbdeef
04:34:26    Stored in directory: /home/jenkins/.cache/pip/wheels/dc/6c/04/da2d847fa8d45c59af3e1d83e2acc29cb8adcbaf04c0898dbf
04:34:26    Building wheel for netifaces (setup.py): started
04:34:28    Building wheel for netifaces (setup.py): finished with status 'done'
04:34:28    Created wheel for netifaces: filename=netifaces-0.11.0-cp311-cp311-linux_x86_64.whl size=41066 sha256=d42a0aab30c5e268c69760f3d5d02ca6355417a55f6580d41791894054f29a0a
04:34:28    Stored in directory: /home/jenkins/.cache/pip/wheels/f8/18/88/e61d54b995bea304bdb1d040a92b72228a1bf72ca2a3eba7c9
04:34:28    Building wheel for robotframework-httplibrary (setup.py): started
04:34:28    Building wheel for robotframework-httplibrary (setup.py): finished with status 'done'
04:34:28    Created wheel for robotframework-httplibrary: filename=robotframework_httplibrary-0.4.2-py3-none-any.whl size=10013 sha256=f0dcd745a59293052d9ac2869355548725e35f50f7df7e49d048f21fd78d1462
04:34:28    Stored in directory: /home/jenkins/.cache/pip/wheels/aa/bc/0d/9a20dd51effef392aae2733cb4c7b66c6fa29fca33d88b57ed
04:34:28    Building wheel for jsonpath-rw (setup.py): started
04:34:29    Building wheel for jsonpath-rw (setup.py): finished with status 'done'
04:34:29    Created wheel for jsonpath-rw: filename=jsonpath_rw-1.4.0-py3-none-any.whl size=15176 sha256=c93a21e0bd55ad8c401daa199e10858e091fc98b079eee3634301943b6dec87d
04:34:29    Stored in directory: /home/jenkins/.cache/pip/wheels/f1/54/63/9a8da38cefae13755097b36cc852decc25d8ef69c37d58d4eb
04:34:29  Successfully built robotframework-sshlibrary ipaddr netifaces robotframework-httplibrary jsonpath-rw
04:34:29  Installing collected packages: sortedcontainers, ply, netifaces, ipaddr, enum34, websocket-client, WebOb, waitress, urllib3, typing-extensions, soupsieve, sniffio, six, scapy, robotframework-pythonlibcore, robotframework, regex, pysocks, pyparsing, pycparser, netaddr, lxml, jsonpointer, jmespath, isodate, idna, h11, decorator, click, charset-normalizer, certifi, bcrypt, attrs, wsproto, requests, python-dateutil, pyhocon, pyang, outcome, jsonpath-rw, jsonpatch, elastic-transport, docker-pycreds, cffi, beautifulsoup4, webtest, trio, robotframework-requests, pynacl, pyangbind, elasticsearch, docker-py, cryptography, trio-websocket, robotframework-httplibrary, paramiko, elasticsearch-dsl, selenium, scp, robotframework-sshlibrary, robotframework-seleniumlibrary, robotframework-selenium2library
04:34:36  Successfully installed WebOb-1.8.9 attrs-25.1.0 bcrypt-4.2.1 beautifulsoup4-4.13.3 certifi-2025.1.31 cffi-1.17.1 charset-normalizer-3.4.1 click-8.1.8 cryptography-44.0.1 decorator-5.2.1 docker-py-1.10.6 docker-pycreds-0.4.0 elastic-transport-8.17.0 elasticsearch-8.17.1 elasticsearch-dsl-8.17.1 enum34-1.1.10 h11-0.14.0 idna-3.10 ipaddr-2.2.0 isodate-0.7.2 jmespath-1.0.1 jsonpatch-1.33 jsonpath-rw-1.4.0 jsonpointer-3.0.0 lxml-5.3.1 netaddr-1.3.0 netifaces-0.11.0 outcome-1.3.0.post0 paramiko-3.5.1 ply-3.11 pyang-2.6.1 pyangbind-0.8.6 pycparser-2.22 pyhocon-0.3.61 pynacl-1.5.0 pyparsing-3.2.1 pysocks-1.7.1 python-dateutil-2.9.0.post0 regex-2024.11.6 requests-2.32.3 robotframework-7.2.2 robotframework-httplibrary-0.4.2 robotframework-pythonlibcore-4.4.1 robotframework-requests-0.9.7 robotframework-selenium2library-3.0.0 robotframework-seleniumlibrary-6.7.0 robotframework-sshlibrary-3.8.0 scapy-2.6.1 scp-0.15.0 selenium-4.29.0 six-1.17.0 sniffio-1.3.1 sortedcontainers-2.4.0 soupsieve-2.6 trio-0.29.0 trio-websocket-0.12.1 typing-extensions-4.12.2 urllib3-2.3.0 waitress-3.0.2 websocket-client-1.8.0 webtest-3.0.4 wsproto-1.2.0
04:34:36  + pip freeze
04:34:36  attrs==25.1.0
04:34:36  bcrypt==4.2.1
04:34:36  beautifulsoup4==4.13.3
04:34:36  certifi==2025.1.31
04:34:36  cffi==1.17.1
04:34:36  charset-normalizer==3.4.1
04:34:36  click==8.1.8
04:34:36  cryptography==44.0.1
04:34:36  decorator==5.2.1
04:34:36  distlib==0.3.9
04:34:36  docker-py==1.10.6
04:34:36  docker-pycreds==0.4.0
04:34:36  elastic-transport==8.17.0
04:34:36  elasticsearch==8.17.1
04:34:36  elasticsearch-dsl==8.17.1
04:34:36  enum34==1.1.10
04:34:36  filelock==3.17.0
04:34:36  h11==0.14.0
04:34:36  idna==3.10
04:34:36  ipaddr==2.2.0
04:34:36  isodate==0.7.2
04:34:36  jmespath==1.0.1
04:34:36  jsonpatch==1.33
04:34:36  jsonpath-rw==1.4.0
04:34:36  jsonpointer==3.0.0
04:34:36  lxml==5.3.1
04:34:36  netaddr==1.3.0
04:34:36  netifaces==0.11.0
04:34:36  outcome==1.3.0.post0
04:34:36  paramiko==3.5.1
04:34:36  platformdirs==4.3.6
04:34:36  ply==3.11
04:34:36  pyang==2.6.1
04:34:36  pyangbind==0.8.6
04:34:36  pycparser==2.22
04:34:36  pyhocon==0.3.61
04:34:36  PyNaCl==1.5.0
04:34:36  pyparsing==3.2.1
04:34:36  PySocks==1.7.1
04:34:36  python-dateutil==2.9.0.post0
04:34:36  regex==2024.11.6
04:34:36  requests==2.32.3
04:34:36  robotframework==7.2.2
04:34:36  robotframework-httplibrary==0.4.2
04:34:36  robotframework-pythonlibcore==4.4.1
04:34:36  robotframework-requests==0.9.7
04:34:36  robotframework-selenium2library==3.0.0
04:34:36  robotframework-seleniumlibrary==6.7.0
04:34:36  robotframework-sshlibrary==3.8.0
04:34:36  scapy==2.6.1
04:34:36  scp==0.15.0
04:34:36  selenium==4.29.0
04:34:36  six==1.17.0
04:34:36  sniffio==1.3.1
04:34:36  sortedcontainers==2.4.0
04:34:36  soupsieve==2.6
04:34:36  trio==0.29.0
04:34:36  trio-websocket==0.12.1
04:34:36  typing_extensions==4.12.2
04:34:36  urllib3==2.3.0
04:34:36  virtualenv==20.29.2
04:34:36  waitress==3.0.2
04:34:36  WebOb==1.8.9
04:34:36  websocket-client==1.8.0
04:34:36  WebTest==3.0.4
04:34:36  wsproto==1.2.0
04:34:36  [EnvInject] - Injecting environment variables from a build step.
04:34:36  [EnvInject] - Injecting as environment variables the properties file path 'env.properties'
04:34:36  [EnvInject] - Variables injected successfully.
04:34:36  [ovsdb-csit-3node-upstream-clustering-only-calcium] $ /bin/bash -l /tmp/jenkins14674762436997981319.sh
04:34:36  Setup pyenv:
04:34:36    system
04:34:36    3.8.13
04:34:36    3.9.13
04:34:36    3.10.13
04:34:36  * 3.11.7 (set by /w/workspace/ovsdb-csit-3node-upstream-clustering-only-calcium/.python-version)
04:34:37  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-jXOv from file:/tmp/.os_lf_venv
04:34:39  lf-activate-venv(): INFO: Installing: python-heatclient python-openstackclient yq 
04:34:45  ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
04:34:45  lftools 0.37.10 requires urllib3<2.1.0, but you have urllib3 2.3.0 which is incompatible.
04:34:45  lf-activate-venv(): INFO: Adding /tmp/venv-jXOv/bin to PATH
04:34:45  + ODL_SYSTEM=()
04:34:45  + TOOLS_SYSTEM=()
04:34:45  + OPENSTACK_SYSTEM=()
04:34:45  + OPENSTACK_CONTROLLERS=()
04:34:45  + mapfile -t ADDR
04:34:45  ++ jq -r '.outputs[] | select(.output_key | match("^vm_[0-9]+_ips$")) | .output_value | .[]'
04:34:45  ++ openstack stack show -f json -c outputs releng-ovsdb-csit-3node-upstream-clustering-only-calcium-646
04:34:47  + for i in "${ADDR[@]}"
04:34:47  ++ ssh 10.30.171.177 hostname -s
04:34:47  Warning: Permanently added '10.30.171.177' (ECDSA) to the list of known hosts.
04:34:47  + REMHOST=releng-07564-646-1-mininet-ovs-217-0
04:34:47  + case ${REMHOST} in
04:34:47  + TOOLS_SYSTEM=("${TOOLS_SYSTEM[@]}" "${i}")
04:34:47  + for i in "${ADDR[@]}"
04:34:47  ++ ssh 10.30.171.228 hostname -s
04:34:47  Warning: Permanently added '10.30.171.228' (ECDSA) to the list of known hosts.
04:34:47  + REMHOST=releng-07564-646-0-builder-0
04:34:47  + case ${REMHOST} in
04:34:47  + ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}")
04:34:47  + for i in "${ADDR[@]}"
04:34:47  ++ ssh 10.30.170.250 hostname -s
04:34:47  Warning: Permanently added '10.30.170.250' (ECDSA) to the list of known hosts.
04:34:48  + REMHOST=releng-07564-646-0-builder-1
04:34:48  + case ${REMHOST} in
04:34:48  + ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}")
04:34:48  + for i in "${ADDR[@]}"
04:34:48  ++ ssh 10.30.171.190 hostname -s
04:34:48  Warning: Permanently added '10.30.171.190' (ECDSA) to the list of known hosts.
04:34:48  + REMHOST=releng-07564-646-0-builder-2
04:34:48  + case ${REMHOST} in
04:34:48  + ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}")
04:34:48  + echo NUM_ODL_SYSTEM=3
04:34:48  + echo NUM_TOOLS_SYSTEM=1
04:34:48  + '[' '' == yes ']'
04:34:48  + NUM_OPENSTACK_SYSTEM=0
04:34:48  + echo NUM_OPENSTACK_SYSTEM=0
04:34:48  + '[' 0 -eq 2 ']'
04:34:48  + echo ODL_SYSTEM_IP=10.30.171.228
04:34:48  ++ seq 0 2
04:34:48  + for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 )))
04:34:48  + echo ODL_SYSTEM_1_IP=10.30.171.228
04:34:48  + for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 )))
04:34:48  + echo ODL_SYSTEM_2_IP=10.30.170.250
04:34:48  + for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 )))
04:34:48  + echo ODL_SYSTEM_3_IP=10.30.171.190
04:34:48  + echo TOOLS_SYSTEM_IP=10.30.171.177
04:34:48  ++ seq 0 0
04:34:48  + for i in $(seq 0 $(( ${#TOOLS_SYSTEM[@]} - 1 )))
04:34:48  + echo TOOLS_SYSTEM_1_IP=10.30.171.177
04:34:48  + openstack_index=0
04:34:48  + NUM_OPENSTACK_CONTROL_NODES=1
04:34:48  + echo NUM_OPENSTACK_CONTROL_NODES=1
04:34:48  ++ seq 0 0
04:34:48  + for i in $(seq 0 $((NUM_OPENSTACK_CONTROL_NODES - 1)))
04:34:48  + echo OPENSTACK_CONTROL_NODE_1_IP=
04:34:48  + NUM_OPENSTACK_COMPUTE_NODES=-1
04:34:48  + echo NUM_OPENSTACK_COMPUTE_NODES=-1
04:34:48  + '[' -1 -ge 2 ']'
04:34:48  ++ seq 0 -2
04:34:48  + NUM_OPENSTACK_HAPROXY_NODES=0
04:34:48  + echo NUM_OPENSTACK_HAPROXY_NODES=0
04:34:48  ++ seq 0 -1
04:34:48  + echo 'Contents of slave_addresses.txt:'
04:34:48  Contents of slave_addresses.txt:
04:34:48  + cat slave_addresses.txt
04:34:48  NUM_ODL_SYSTEM=3
04:34:48  NUM_TOOLS_SYSTEM=1
04:34:48  NUM_OPENSTACK_SYSTEM=0
04:34:48  ODL_SYSTEM_IP=10.30.171.228
04:34:48  ODL_SYSTEM_1_IP=10.30.171.228
04:34:48  ODL_SYSTEM_2_IP=10.30.170.250
04:34:48  ODL_SYSTEM_3_IP=10.30.171.190
04:34:48  TOOLS_SYSTEM_IP=10.30.171.177
04:34:48  TOOLS_SYSTEM_1_IP=10.30.171.177
04:34:48  NUM_OPENSTACK_CONTROL_NODES=1
04:34:48  OPENSTACK_CONTROL_NODE_1_IP=
04:34:48  NUM_OPENSTACK_COMPUTE_NODES=-1
04:34:48  NUM_OPENSTACK_HAPROXY_NODES=0
04:34:48  [EnvInject] - Injecting environment variables from a build step.
04:34:48  [EnvInject] - Injecting as environment variables the properties file path 'slave_addresses.txt'
04:34:48  [EnvInject] - Variables injected successfully.
04:34:48  [ovsdb-csit-3node-upstream-clustering-only-calcium] $ /bin/sh /tmp/jenkins18299630455179138010.sh
04:34:48  Preparing for JRE Version 17
04:34:48  Karaf artifact is karaf
04:34:48  Karaf project is integration
04:34:48  Java home is /usr/lib/jvm/java-17-openjdk-amd64
04:34:48  [EnvInject] - Injecting environment variables from a build step.
04:34:48  [EnvInject] - Injecting as environment variables the properties file path 'set_variables.env'
04:34:48  [EnvInject] - Variables injected successfully.
04:34:48  [ovsdb-csit-3node-upstream-clustering-only-calcium] $ /bin/bash /tmp/jenkins5145358324039753963.sh
04:34:48  Distribution bundle URL is https://nexus.opendaylight.org/content/repositories//autorelease-8645/org/opendaylight/integration/karaf/0.20.4/karaf-0.20.4.zip
04:34:48  Distribution bundle is karaf-0.20.4.zip
04:34:48  Distribution bundle version is 0.20.4
04:34:48  Distribution folder is karaf-0.20.4
04:34:48  Nexus prefix is https://nexus.opendaylight.org
04:34:48  [EnvInject] - Injecting environment variables from a build step.
04:34:48  [EnvInject] - Injecting as environment variables the properties file path 'detect_variables.env'
04:34:48  [EnvInject] - Variables injected successfully.
04:34:48  [ovsdb-csit-3node-upstream-clustering-only-calcium] $ /bin/bash -l /tmp/jenkins14485118550811208188.sh
04:34:48  Setup pyenv:
04:34:48    system
04:34:48    3.8.13
04:34:48    3.9.13
04:34:48    3.10.13
04:34:48  * 3.11.7 (set by /w/workspace/ovsdb-csit-3node-upstream-clustering-only-calcium/.python-version)
04:34:49  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-jXOv from file:/tmp/.os_lf_venv
04:34:49  lf-activate-venv(): INFO: Installing: python-heatclient python-openstackclient 
04:34:53  lf-activate-venv(): INFO: Adding /tmp/venv-jXOv/bin to PATH
04:34:53  Copying common-functions.sh to /tmp
04:34:55  Copying common-functions.sh to 10.30.171.177:/tmp
04:34:55  Warning: Permanently added '10.30.171.177' (ECDSA) to the list of known hosts.
04:34:55  Copying common-functions.sh to 10.30.171.228:/tmp
04:34:55  Warning: Permanently added '10.30.171.228' (ECDSA) to the list of known hosts.
04:34:55  Copying common-functions.sh to 10.30.170.250:/tmp
04:34:55  Warning: Permanently added '10.30.170.250' (ECDSA) to the list of known hosts.
04:34:56  Copying common-functions.sh to 10.30.171.190:/tmp
04:34:56  Warning: Permanently added '10.30.171.190' (ECDSA) to the list of known hosts.
04:34:56  [ovsdb-csit-3node-upstream-clustering-only-calcium] $ /bin/bash /tmp/jenkins18295475075198216063.sh
04:34:56  common-functions.sh is being sourced
04:34:56  common-functions environment:
04:34:56  MAVENCONF: /tmp/karaf-0.20.4/etc/org.ops4j.pax.url.mvn.cfg
04:34:56  ACTUALFEATURES: 
04:34:56  FEATURESCONF: /tmp/karaf-0.20.4/etc/org.apache.karaf.features.cfg
04:34:56  CUSTOMPROP: /tmp/karaf-0.20.4/etc/custom.properties
04:34:56  LOGCONF: /tmp/karaf-0.20.4/etc/org.ops4j.pax.logging.cfg
04:34:56  MEMCONF: /tmp/karaf-0.20.4/bin/setenv
04:34:56  CONTROLLERMEM: 2048m
04:34:56  AKKACONF: /tmp/karaf-0.20.4/configuration/initial/akka.conf
04:34:56  MODULESCONF: /tmp/karaf-0.20.4/configuration/initial/modules.conf
04:34:56  MODULESHARDSCONF: /tmp/karaf-0.20.4/configuration/initial/module-shards.conf
04:34:56  SUITES: 
04:34:56  
04:34:56  #################################################
04:34:56  ##         Configure Cluster and Start         ##
04:34:56  #################################################
04:34:56  ACTUALFEATURES: odl-infrautils-ready,odl-jolokia,odl-ovsdb-southbound-impl-rest
04:34:56  SPACE_SEPARATED_FEATURES: odl-infrautils-ready odl-jolokia odl-ovsdb-southbound-impl-rest
04:34:56  Locating script plan to use...
04:34:56  Finished running script plans
04:34:56  Configuring member-1 with IP address 10.30.171.228
04:34:56  Warning: Permanently added '10.30.171.228' (ECDSA) to the list of known hosts.
04:34:57  Warning: Permanently added '10.30.171.228' (ECDSA) to the list of known hosts.
04:34:57  common-functions.sh is being sourced
04:34:57  + source /tmp/common-functions.sh karaf-0.20.4
04:34:57  ++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]]
04:34:57  ++ echo 'common-functions.sh is being sourced'
04:34:57  ++ BUNDLEFOLDER=karaf-0.20.4
04:34:57  ++ export MAVENCONF=/tmp/karaf-0.20.4/etc/org.ops4j.pax.url.mvn.cfg
04:34:57  ++ MAVENCONF=/tmp/karaf-0.20.4/etc/org.ops4j.pax.url.mvn.cfg
04:34:57  ++ export FEATURESCONF=/tmp/karaf-0.20.4/etc/org.apache.karaf.features.cfg
04:34:57  ++ FEATURESCONF=/tmp/karaf-0.20.4/etc/org.apache.karaf.features.cfg
04:34:57  ++ export CUSTOMPROP=/tmp/karaf-0.20.4/etc/custom.properties
04:34:57  ++ CUSTOMPROP=/tmp/karaf-0.20.4/etc/custom.properties
04:34:57  ++ export LOGCONF=/tmp/karaf-0.20.4/etc/org.ops4j.pax.logging.cfg
04:34:57  ++ LOGCONF=/tmp/karaf-0.20.4/etc/org.ops4j.pax.logging.cfg
04:34:57  ++ export MEMCONF=/tmp/karaf-0.20.4/bin/setenv
04:34:57  ++ MEMCONF=/tmp/karaf-0.20.4/bin/setenv
04:34:57  ++ export CONTROLLERMEM=
04:34:57  ++ CONTROLLERMEM=
04:34:57  ++ export AKKACONF=/tmp/karaf-0.20.4/configuration/initial/akka.conf
04:34:57  ++ AKKACONF=/tmp/karaf-0.20.4/configuration/initial/akka.conf
04:34:57  ++ export MODULESCONF=/tmp/karaf-0.20.4/configuration/initial/modules.conf
04:34:57  ++ MODULESCONF=/tmp/karaf-0.20.4/configuration/initial/modules.conf
04:34:57  ++ export MODULESHARDSCONF=/tmp/karaf-0.20.4/configuration/initial/module-shards.conf
04:34:57  ++ MODULESHARDSCONF=/tmp/karaf-0.20.4/configuration/initial/module-shards.conf
04:34:57  ++ print_common_env
04:34:57  ++ cat
04:34:57  common-functions environment:
04:34:57  MAVENCONF: /tmp/karaf-0.20.4/etc/org.ops4j.pax.url.mvn.cfg
04:34:57  ACTUALFEATURES: 
04:34:57  FEATURESCONF: /tmp/karaf-0.20.4/etc/org.apache.karaf.features.cfg
04:34:57  CUSTOMPROP: /tmp/karaf-0.20.4/etc/custom.properties
04:34:57  LOGCONF: /tmp/karaf-0.20.4/etc/org.ops4j.pax.logging.cfg
04:34:57  MEMCONF: /tmp/karaf-0.20.4/bin/setenv
04:34:57  CONTROLLERMEM: 
04:34:57  AKKACONF: /tmp/karaf-0.20.4/configuration/initial/akka.conf
04:34:57  MODULESCONF: /tmp/karaf-0.20.4/configuration/initial/modules.conf
04:34:57  MODULESHARDSCONF: /tmp/karaf-0.20.4/configuration/initial/module-shards.conf
04:34:57  SUITES: 
04:34:57  
04:34:57  ++ SSH='ssh -t -t'
04:34:57  ++ extra_services_cntl='     dnsmasq.service     httpd.service     libvirtd.service     openvswitch.service     ovs-vswitchd.service     ovsdb-server.service     rabbitmq-server.service '
04:34:57  ++ extra_services_cmp='     libvirtd.service     openvswitch.service     ovs-vswitchd.service     ovsdb-server.service '
04:34:57  Changing to /tmp
04:34:57  + echo 'Changing to /tmp'
04:34:57  + cd /tmp
04:34:57  Downloading the distribution from https://nexus.opendaylight.org/content/repositories//autorelease-8645/org/opendaylight/integration/karaf/0.20.4/karaf-0.20.4.zip
04:34:57  + echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories//autorelease-8645/org/opendaylight/integration/karaf/0.20.4/karaf-0.20.4.zip'
04:34:57  + wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories//autorelease-8645/org/opendaylight/integration/karaf/0.20.4/karaf-0.20.4.zip
04:34:57  --2025-02-25 04:34:57--  https://nexus.opendaylight.org/content/repositories//autorelease-8645/org/opendaylight/integration/karaf/0.20.4/karaf-0.20.4.zip
04:34:57  Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6
04:34:57  Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected.
04:34:57  HTTP request sent, awaiting response... 200 OK
04:34:57  Length: 234139102 (223M) [application/zip]
04:34:57  Saving to: ‘karaf-0.20.4.zip’
04:34:57  
04:34:57       0K ........ ........ ........ ........ ........ ........  1% 43.7M 5s
04:34:57    3072K ........ ........ ........ ........ ........ ........  2% 55.5M 4s
04:34:57    6144K ........ ........ ........ ........ ........ ........  4% 52.9M 4s
04:34:57    9216K ........ ........ ........ ........ ........ ........  5% 86.7M 4s
04:34:57   12288K ........ ........ ........ ........ ........ ........  6% 94.4M 3s
04:34:57   15360K ........ ........ ........ ........ ........ ........  8% 82.0M 3s
04:34:57   18432K ........ ........ ........ ........ ........ ........  9% 70.6M 3s
04:34:57   21504K ........ ........ ........ ........ ........ ........ 10% 82.0M 3s
04:34:57   24576K ........ ........ ........ ........ ........ ........ 12% 78.7M 3s
04:34:57   27648K ........ ........ ........ ........ ........ ........ 13% 69.9M 3s
04:34:57   30720K ........ ........ ........ ........ ........ ........ 14%  196M 3s
04:34:57   33792K ........ ........ ........ ........ ........ ........ 16%  208M 2s
04:34:57   36864K ........ ........ ........ ........ ........ ........ 17%  231M 2s
04:34:57   39936K ........ ........ ........ ........ ........ ........ 18%  308M 2s
04:34:57   43008K ........ ........ ........ ........ ........ ........ 20%  284M 2s
04:34:57   46080K ........ ........ ........ ........ ........ ........ 21%  291M 2s
04:34:57   49152K ........ ........ ........ ........ ........ ........ 22%  310M 2s
04:34:57   52224K ........ ........ ........ ........ ........ ........ 24% 44.8M 2s
04:34:57   55296K ........ ........ ........ ........ ........ ........ 25%  315M 2s
04:34:58   58368K ........ ........ ........ ........ ........ ........ 26%  298M 2s
04:34:58   61440K ........ ........ ........ ........ ........ ........ 28%  259M 2s
04:34:58   64512K ........ ........ ........ ........ ........ ........ 29%  268M 2s
04:34:58   67584K ........ ........ ........ ........ ........ ........ 30%  283M 1s
04:34:58   70656K ........ ........ ........ ........ ........ ........ 32%  260M 1s
04:34:58   73728K ........ ........ ........ ........ ........ ........ 33%  272M 1s
04:34:58   76800K ........ ........ ........ ........ ........ ........ 34%  281M 1s
04:34:58   79872K ........ ........ ........ ........ ........ ........ 36%  286M 1s
04:34:58   82944K ........ ........ ........ ........ ........ ........ 37%  286M 1s
04:34:58   86016K ........ ........ ........ ........ ........ ........ 38%  283M 1s
04:34:58   89088K ........ ........ ........ ........ ........ ........ 40%  302M 1s
04:34:58   92160K ........ ........ ........ ........ ........ ........ 41%  286M 1s
04:34:58   95232K ........ ........ ........ ........ ........ ........ 42%  270M 1s
04:34:58   98304K ........ ........ ........ ........ ........ ........ 44%  295M 1s
04:34:58  101376K ........ ........ ........ ........ ........ ........ 45%  242M 1s
04:34:58  104448K ........ ........ ........ ........ ........ ........ 47%  245M 1s
04:34:58  107520K ........ ........ ........ ........ ........ ........ 48%  248M 1s
04:34:58  110592K ........ ........ ........ ........ ........ ........ 49%  250M 1s
04:34:58  113664K ........ ........ ........ ........ ........ ........ 51%  252M 1s
04:34:58  116736K ........ ........ ........ ........ ........ ........ 52%  215M 1s
04:34:58  119808K ........ ........ ........ ........ ........ ........ 53%  237M 1s
04:34:58  122880K ........ ........ ........ ........ ........ ........ 55%  255M 1s
04:34:58  125952K ........ ........ ........ ........ ........ ........ 56%  235M 1s
04:34:58  129024K ........ ........ ........ ........ ........ ........ 57%  216M 1s
04:34:58  132096K ........ ........ ........ ........ ........ ........ 59%  243M 1s
04:34:58  135168K ........ ........ ........ ........ ........ ........ 60%  178M 1s
04:34:58  138240K ........ ........ ........ ........ ........ ........ 61%  188M 1s
04:34:58  141312K ........ ........ ........ ........ ........ ........ 63%  197M 1s
04:34:58  144384K ........ ........ ........ ........ ........ ........ 64%  204M 1s
04:34:58  147456K ........ ........ ........ ........ ........ ........ 65%  181M 1s
04:34:58  150528K ........ ........ ........ ........ ........ ........ 67%  196M 0s
04:34:58  153600K ........ ........ ........ ........ ........ ........ 68%  200M 0s
04:34:58  156672K ........ ........ ........ ........ ........ ........ 69%  210M 0s
04:34:58  159744K ........ ........ ........ ........ ........ ........ 71%  229M 0s
04:34:58  162816K ........ ........ ........ ........ ........ ........ 72%  190M 0s
04:34:58  165888K ........ ........ ........ ........ ........ ........ 73%  121M 0s
04:34:58  168960K ........ ........ ........ ........ ........ ........ 75%  130M 0s
04:34:58  172032K ........ ........ ........ ........ ........ ........ 76%  165M 0s
04:34:58  175104K ........ ........ ........ ........ ........ ........ 77%  166M 0s
04:34:58  178176K ........ ........ ........ ........ ........ ........ 79%  191M 0s
04:34:58  181248K ........ ........ ........ ........ ........ ........ 80%  170M 0s
04:34:58  184320K ........ ........ ........ ........ ........ ........ 81%  187M 0s
04:34:58  187392K ........ ........ ........ ........ ........ ........ 83%  172M 0s
04:34:58  190464K ........ ........ ........ ........ ........ ........ 84%  174M 0s
04:34:58  193536K ........ ........ ........ ........ ........ ........ 85%  178M 0s
04:34:58  196608K ........ ........ ........ ........ ........ ........ 87%  157M 0s
04:34:58  199680K ........ ........ ........ ........ ........ ........ 88%  207M 0s
04:34:58  202752K ........ ........ ........ ........ ........ ........ 90%  194M 0s
04:34:58  205824K ........ ........ ........ ........ ........ ........ 91%  201M 0s
04:34:58  208896K ........ ........ ........ ........ ........ ........ 92%  135M 0s
04:34:58  211968K ........ ........ ........ ........ ........ ........ 94%  157M 0s
04:34:58  215040K ........ ........ ........ ........ ........ ........ 95%  137M 0s
04:34:58  218112K ........ ........ ........ ........ ........ ........ 96%  160M 0s
04:34:58  221184K ........ ........ ........ ........ ........ ........ 98%  138M 0s
04:34:58  224256K ........ ........ ........ ........ ........ ........ 99%  137M 0s
04:34:58  227328K ........ ........ ....                               100%  144M=1.4s
04:34:58  
04:34:58  2025-02-25 04:34:58 (157 MB/s) - ‘karaf-0.20.4.zip’ saved [234139102/234139102]
04:34:58  
04:34:58  Extracting the new controller...
04:34:58  + echo 'Extracting the new controller...'
04:34:58  + unzip -q karaf-0.20.4.zip
04:35:00  Adding external repositories...
04:35:00  + echo 'Adding external repositories...'
04:35:00  + sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.20.4/etc/org.ops4j.pax.url.mvn.cfg
04:35:00  + cat /tmp/karaf-0.20.4/etc/org.ops4j.pax.url.mvn.cfg
04:35:00  ################################################################################
04:35:00  #
04:35:00  #    Licensed to the Apache Software Foundation (ASF) under one or more
04:35:00  #    contributor license agreements.  See the NOTICE file distributed with
04:35:00  #    this work for additional information regarding copyright ownership.
04:35:00  #    The ASF licenses this file to You under the Apache License, Version 2.0
04:35:00  #    (the "License"); you may not use this file except in compliance with
04:35:00  #    the License.  You may obtain a copy of the License at
04:35:00  #
04:35:00  #       http://www.apache.org/licenses/LICENSE-2.0
04:35:00  #
04:35:00  #    Unless required by applicable law or agreed to in writing, software
04:35:00  #    distributed under the License is distributed on an "AS IS" BASIS,
04:35:00  #    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
04:35:00  #    See the License for the specific language governing permissions and
04:35:00  #    limitations under the License.
04:35:00  #
04:35:00  ################################################################################
04:35:00  
04:35:00  #
04:35:00  # If set to true, the following property will not allow any certificate to be used
04:35:00  # when accessing Maven repositories through SSL
04:35:00  #
04:35:00  #org.ops4j.pax.url.mvn.certificateCheck=
04:35:00  
04:35:00  #
04:35:00  # Path to the local Maven settings file.
04:35:00  # The repositories defined in this file will be automatically added to the list
04:35:00  # of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property
04:35:00  # below is not set.
04:35:00  # The following locations are checked for the existence of the settings.xml file
04:35:00  #   * 1. looks for the specified url
04:35:00  #   * 2. if not found looks for ${user.home}/.m2/settings.xml
04:35:00  #   * 3. if not found looks for ${maven.home}/conf/settings.xml
04:35:00  #   * 4. if not found looks for ${M2_HOME}/conf/settings.xml
04:35:00  #
04:35:00  #org.ops4j.pax.url.mvn.settings=
04:35:00  
04:35:00  #
04:35:00  # Path to the local Maven repository which is used to avoid downloading
04:35:00  # artifacts when they already exist locally.
04:35:00  # The value of this property will be extracted from the settings.xml file
04:35:00  # above, or defaulted to:
04:35:00  #     System.getProperty( "user.home" ) + "/.m2/repository"
04:35:00  #
04:35:00  org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository}
04:35:00  
04:35:00  #
04:35:00  # Default this to false. It's just weird to use undocumented repos
04:35:00  #
04:35:00  org.ops4j.pax.url.mvn.useFallbackRepositories=false
04:35:00  
04:35:00  #
04:35:00  # Uncomment if you don't wanna use the proxy settings
04:35:00  # from the Maven conf/settings.xml file
04:35:00  #
04:35:00  # org.ops4j.pax.url.mvn.proxySupport=false
04:35:00  
04:35:00  #
04:35:00  # Comma separated list of repositories scanned when resolving an artifact.
04:35:00  # Those repositories will be checked before iterating through the
04:35:00  #    below list of repositories and even before the local repository
04:35:00  # A repository url can be appended with zero or more of the following flags:
04:35:00  #    @snapshots  : the repository contains snaphots
04:35:00  #    @noreleases : the repository does not contain any released artifacts
04:35:00  #
04:35:00  # The following property value will add the system folder as a repo.
04:35:00  #
04:35:00  org.ops4j.pax.url.mvn.defaultRepositories=\
04:35:00      file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\
04:35:00      file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\
04:35:00      file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots
04:35:00  
04:35:00  # Use the default local repo (e.g.~/.m2/repository) as a "remote" repo
04:35:00  #org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false
04:35:00  
04:35:00  #
04:35:00  # Comma separated list of repositories scanned when resolving an artifact.
04:35:00  # The default list includes the following repositories:
04:35:00  #    http://repo1.maven.org/maven2@id=central
04:35:00  #    http://repository.springsource.com/maven/bundles/release@id=spring.ebr
04:35:00  #    http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external
04:35:00  #    http://zodiac.springsource.com/maven/bundles/release@id=gemini
04:35:00  #    http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases
04:35:00  #    https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases
04:35:00  #    https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
04:35:00  # To add repositories to the default ones, prepend '+' to the list of repositories
04:35:00  # to add.
04:35:00  # A repository url can be appended with zero or more of the following flags:
04:35:00  #    @snapshots  : the repository contains snapshots
04:35:00  #    @noreleases : the repository does not contain any released artifacts
04:35:00  #    @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended
04:35:00  #
04:35:00  org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
04:35:00  
04:35:00  ### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.Configuring the startup features...
04:35:00  + [[ True == \T\r\u\e ]]
04:35:00  + echo 'Configuring the startup features...'
04:35:00  + sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-infrautils-ready,odl-jolokia,odl-ovsdb-southbound-impl-rest,/g' /tmp/karaf-0.20.4/etc/org.apache.karaf.features.cfg
04:35:00  + FEATURE_TEST_STRING=features-test
04:35:00  + FEATURE_TEST_VERSION=0.20.4
04:35:00  + KARAF_VERSION=karaf4
04:35:00  + [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]]
04:35:00  + sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.20.4/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.20.4/etc/org.apache.karaf.features.cfg
04:35:00  + [[ ! -z '' ]]
04:35:00  + cat /tmp/karaf-0.20.4/etc/org.apache.karaf.features.cfg
04:35:00  ################################################################################
04:35:00  #
04:35:00  #    Licensed to the Apache Software Foundation (ASF) under one or more
04:35:00  #    contributor license agreements.  See the NOTICE file distributed with
04:35:00  #    this work for additional information regarding copyright ownership.
04:35:00  #    The ASF licenses this file to You under the Apache License, Version 2.0
04:35:00  #    (the "License"); you may not use this file except in compliance with
04:35:00  #    the License.  You may obtain a copy of the License at
04:35:00  #
04:35:00  #       http://www.apache.org/licenses/LICENSE-2.0
04:35:00  #
04:35:00  #    Unless required by applicable law or agreed to in writing, software
04:35:00  #    distributed under the License is distributed on an "AS IS" BASIS,
04:35:00  #    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
04:35:00  #    See the License for the specific language governing permissions and
04:35:00  #    limitations under the License.
04:35:00  #
04:35:00  ################################################################################
04:35:00  
04:35:00  #
04:35:00  # Comma separated list of features repositories to register by default
04:35:00  #
04:35:00  featuresRepositories = mvn:org.opendaylight.integration/features-test/0.20.4/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/290d8cd0-90b7-436d-8e9c-f26d70ee4bd5.xml
04:35:00  
04:35:00  #
04:35:00  # Comma separated list of features to install at startup
04:35:00  #
04:35:00  featuresBoot = odl-infrautils-ready,odl-jolokia,odl-ovsdb-southbound-impl-rest, a1e7a267-4169-4830-a802-e7ef39ca0207
04:35:00  
04:35:00  #
04:35:00  # Resource repositories (OBR) that the features resolver can use
04:35:00  # to resolve requirements/capabilities
04:35:00  #
04:35:00  # The format of the resourceRepositories is 
04:35:00  # resourceRepositories=[xml:url|json:url],...
04:35:00  # for Instance:
04:35:00  #
04:35:00  #resourceRepositories=xml:http://host/path/to/index.xml
04:35:00  # or
04:35:00  #resourceRepositories=json:http://host/path/to/index.json
04:35:00  #
04:35:00  
04:35:00  #
04:35:00  # Defines if the boot features are started in asynchronous mode (in a dedicated thread)
04:35:00  #
04:35:00  featuresBootAsynchronous=false
04:35:00  
04:35:00  #
04:35:00  # Service requirements enforcement
04:35:00  #
04:35:00  # By default, the feature resolver checks the service requirements/capabilities of
04:35:00  # bundles for new features (xml schema >= 1.3.0) in order to automatically installs
04:35:00  # the required bundles.
04:35:00  # The following flag can have those values:
04:35:00  #   - disable: service requirements are completely ignored
04:35:00  #   - default: service requirements are ignored for old features
04:35:00  #   - enforce: service requirements are always verified
04:35:00  #
04:35:00  #serviceRequirements=default
04:35:00  
04:35:00  #
04:35:00  # Store cfg file for config element in feature
04:35:00  #
04:35:00  #configCfgStore=true
04:35:00  
04:35:00  #
04:35:00  # Define if the feature service automatically refresh bundles
04:35:00  #
04:35:00  autoRefresh=true
04:35:00  
04:35:00  #
04:35:00  # Configuration of features processing mechanism (overrides, blacklisting, modification of features)
04:35:00  # XML file defines instructions related to features processing
04:35:00  # versions.properties may declare properties to resolve placeholders in XML file
04:35:00  # both files are relative to ${karaf.etc}
04:35:00  #
04:35:00  #featureProcessing=org.apache.karaf.features.xml
04:35:00  #featureProcessingVersions=versions.properties
04:35:00  + configure_karaf_log karaf4 ''
04:35:00  + local -r karaf_version=karaf4
04:35:00  + local -r controllerdebugmap=
04:35:00  + local logapi=log4j
04:35:00  + grep log4j2 /tmp/karaf-0.20.4/etc/org.ops4j.pax.logging.cfg
04:35:00  log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
04:35:00  log4j2.rootLogger.level = INFO
04:35:00  #log4j2.rootLogger.type = asyncRoot
04:35:00  #log4j2.rootLogger.includeLocation = false
04:35:00  log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
04:35:00  log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
04:35:00  log4j2.rootLogger.appenderRef.Console.ref = Console
04:35:00  log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
04:35:00  log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
04:35:00  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
04:35:00  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
04:35:00  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
04:35:00  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
04:35:00  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
04:35:00  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
04:35:00  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
04:35:00  log4j2.logger.spifly.name = org.apache.aries.spifly
04:35:00  log4j2.logger.spifly.level = WARN
04:35:00  log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
04:35:00  log4j2.logger.audit.level = INFO
04:35:00  log4j2.logger.audit.additivity = false
04:35:00  log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
04:35:00  # Console appender not used by default (see log4j2.rootLogger.appenderRefs)
04:35:00  log4j2.appender.console.type = Console
04:35:00  log4j2.appender.console.name = Console
04:35:00  log4j2.appender.console.layout.type = PatternLayout
04:35:00  log4j2.appender.console.layout.pattern = ${log4j2.pattern}
04:35:00  log4j2.appender.rolling.type = RollingRandomAccessFile
04:35:00  log4j2.appender.rolling.name = RollingFile
04:35:00  log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
04:35:00  log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
04:35:00  #log4j2.appender.rolling.immediateFlush = false
04:35:00  log4j2.appender.rolling.append = true
04:35:00  log4j2.appender.rolling.layout.type = PatternLayout
04:35:00  log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
04:35:00  log4j2.appender.rolling.policies.type = Policies
04:35:00  log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
04:35:00  log4j2.appender.rolling.policies.size.size = 64MB
04:35:00  log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
04:35:00  log4j2.appender.rolling.strategy.max = 7
04:35:00  log4j2.appender.audit.type = RollingRandomAccessFile
04:35:00  log4j2.appender.audit.name = AuditRollingFile
04:35:00  log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
04:35:00  log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
04:35:00  log4j2.appender.audit.append = true
04:35:00  log4j2.appender.audit.layout.type = PatternLayout
04:35:00  log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
04:35:00  log4j2.appender.audit.policies.type = Policies
04:35:00  log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
04:35:00  log4j2.appender.audit.policies.size.size = 8MB
04:35:00  log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
04:35:00  log4j2.appender.audit.strategy.max = 7
04:35:00  log4j2.appender.osgi.type = PaxOsgi
04:35:00  log4j2.appender.osgi.name = PaxOsgi
04:35:00  log4j2.appender.osgi.filter = *
04:35:00  #log4j2.logger.aether.name = shaded.org.eclipse.aether
04:35:00  #log4j2.logger.aether.level = TRACE
04:35:00  #log4j2.logger.http-headers.name = shaded.org.apache.http.headers
04:35:00  #log4j2.logger.http-headers.level = DEBUG
04:35:00  #log4j2.logger.maven.name = org.ops4j.pax.url.mvn
04:35:00  #log4j2.logger.maven.level = TRACE
04:35:00  Configuring the karaf log... karaf_version: karaf4, logapi: log4j2
04:35:00  + logapi=log4j2
04:35:00  + echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2'
04:35:00  + '[' log4j2 == log4j2 ']'
04:35:00  + sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.20.4/etc/org.ops4j.pax.logging.cfg
04:35:00  controllerdebugmap: 
04:35:00  cat /tmp/karaf-0.20.4/etc/org.ops4j.pax.logging.cfg
04:35:00  + orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver
04:35:00  + orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver
04:35:00  + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN'
04:35:00  + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN'
04:35:00  + unset IFS
04:35:00  + echo 'controllerdebugmap: '
04:35:00  + '[' -n '' ']'
04:35:00  + echo 'cat /tmp/karaf-0.20.4/etc/org.ops4j.pax.logging.cfg'
04:35:00  + cat /tmp/karaf-0.20.4/etc/org.ops4j.pax.logging.cfg
04:35:00  ################################################################################
04:35:00  #
04:35:00  #    Licensed to the Apache Software Foundation (ASF) under one or more
04:35:00  #    contributor license agreements.  See the NOTICE file distributed with
04:35:00  #    this work for additional information regarding copyright ownership.
04:35:00  #    The ASF licenses this file to You under the Apache License, Version 2.0
04:35:00  #    (the "License"); you may not use this file except in compliance with
04:35:00  #    the License.  You may obtain a copy of the License at
04:35:00  #
04:35:00  #       http://www.apache.org/licenses/LICENSE-2.0
04:35:00  #
04:35:00  #    Unless required by applicable law or agreed to in writing, software
04:35:00  #    distributed under the License is distributed on an "AS IS" BASIS,
04:35:00  #    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
04:35:00  #    See the License for the specific language governing permissions and
04:35:00  #    limitations under the License.
04:35:00  #
04:35:00  ################################################################################
04:35:00  
04:35:00  # Common pattern layout for appenders
04:35:00  log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
04:35:00  
04:35:00  # Root logger
04:35:00  log4j2.rootLogger.level = INFO
04:35:00  # uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library
04:35:00  #log4j2.rootLogger.type = asyncRoot
04:35:00  #log4j2.rootLogger.includeLocation = false
04:35:00  log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
04:35:00  log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
04:35:00  log4j2.rootLogger.appenderRef.Console.ref = Console
04:35:00  log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
04:35:00  log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
04:35:00  
04:35:00  # Filters for logs marked by org.opendaylight.odlparent.Markers
04:35:00  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
04:35:00  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
04:35:00  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
04:35:00  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
04:35:00  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
04:35:00  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
04:35:00  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
04:35:00  
04:35:00  # Loggers configuration
04:35:00  
04:35:00  # Spifly logger
04:35:00  log4j2.logger.spifly.name = org.apache.aries.spifly
04:35:00  log4j2.logger.spifly.level = WARN
04:35:00  
04:35:00  # Security audit logger
04:35:00  log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
04:35:00  log4j2.logger.audit.level = INFO
04:35:00  log4j2.logger.audit.additivity = false
04:35:00  log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
04:35:00  
04:35:00  # Appenders configuration
04:35:00  
04:35:00  # Console appender not used by default (see log4j2.rootLogger.appenderRefs)
04:35:00  log4j2.appender.console.type = Console
04:35:00  log4j2.appender.console.name = Console
04:35:00  log4j2.appender.console.layout.type = PatternLayout
04:35:00  log4j2.appender.console.layout.pattern = ${log4j2.pattern}
04:35:00  
04:35:00  # Rolling file appender
04:35:00  log4j2.appender.rolling.type = RollingRandomAccessFile
04:35:00  log4j2.appender.rolling.name = RollingFile
04:35:00  log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
04:35:00  log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
04:35:00  # uncomment to not force a disk flush
04:35:00  #log4j2.appender.rolling.immediateFlush = false
04:35:00  log4j2.appender.rolling.append = true
04:35:00  log4j2.appender.rolling.layout.type = PatternLayout
04:35:00  log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
04:35:00  log4j2.appender.rolling.policies.type = Policies
04:35:00  log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
04:35:00  log4j2.appender.rolling.policies.size.size = 1GB
04:35:00  log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
04:35:00  log4j2.appender.rolling.strategy.max = 7
04:35:00  
04:35:00  # Audit file appender
04:35:00  log4j2.appender.audit.type = RollingRandomAccessFile
04:35:00  log4j2.appender.audit.name = AuditRollingFile
04:35:00  log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
04:35:00  log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
04:35:00  log4j2.appender.audit.append = true
04:35:00  log4j2.appender.audit.layout.type = PatternLayout
04:35:00  log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
04:35:00  log4j2.appender.audit.policies.type = Policies
04:35:00  log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
04:35:00  log4j2.appender.audit.policies.size.size = 8MB
04:35:00  log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
04:35:00  log4j2.appender.audit.strategy.max = 7
04:35:00  
04:35:00  # OSGi appender
04:35:00  log4j2.appender.osgi.type = PaxOsgi
04:35:00  log4j2.appender.osgi.name = PaxOsgi
04:35:00  log4j2.appender.osgi.filter = *
04:35:00  
04:35:00  # help with identification of maven-related problems with pax-url-aether
04:35:00  #log4j2.logger.aether.name = shaded.org.eclipse.aether
04:35:00  #log4j2.logger.aether.level = TRACE
04:35:00  #log4j2.logger.http-headers.name = shaded.org.apache.http.headers
04:35:00  #log4j2.logger.http-headers.level = DEBUG
04:35:00  #log4j2.logger.maven.name = org.ops4j.pax.url.mvn
04:35:00  #log4j2.logger.maven.level = TRACE
04:35:00  log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN
04:35:00  log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN
04:35:00  + set_java_vars /usr/lib/jvm/java-17-openjdk-amd64 2048m /tmp/karaf-0.20.4/bin/setenv
04:35:00  + local -r java_home=/usr/lib/jvm/java-17-openjdk-amd64
04:35:00  + local -r controllermem=2048m
04:35:00  + local -r memconf=/tmp/karaf-0.20.4/bin/setenv
04:35:00  Configure
04:35:00      java home: /usr/lib/jvm/java-17-openjdk-amd64
04:35:00  + echo Configure
04:35:00  + echo '    java home: /usr/lib/jvm/java-17-openjdk-amd64'
04:35:00  + echo '    max memory: 2048m'
04:35:00      max memory: 2048m
04:35:00      memconf: /tmp/karaf-0.20.4/bin/setenv
04:35:00  + echo '    memconf: /tmp/karaf-0.20.4/bin/setenv'
04:35:00  + sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk-amd64}%g' /tmp/karaf-0.20.4/bin/setenv
04:35:00  + sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=2048m/g' /tmp/karaf-0.20.4/bin/setenv
04:35:00  cat /tmp/karaf-0.20.4/bin/setenv
04:35:00  + echo 'cat /tmp/karaf-0.20.4/bin/setenv'
04:35:00  + cat /tmp/karaf-0.20.4/bin/setenv
04:35:00  #!/bin/sh
04:35:00  #
04:35:00  #    Licensed to the Apache Software Foundation (ASF) under one or more
04:35:00  #    contributor license agreements.  See the NOTICE file distributed with
04:35:00  #    this work for additional information regarding copyright ownership.
04:35:00  #    The ASF licenses this file to You under the Apache License, Version 2.0
04:35:00  #    (the "License"); you may not use this file except in compliance with
04:35:00  #    the License.  You may obtain a copy of the License at
04:35:00  #
04:35:00  #       http://www.apache.org/licenses/LICENSE-2.0
04:35:00  #
04:35:00  #    Unless required by applicable law or agreed to in writing, software
04:35:00  #    distributed under the License is distributed on an "AS IS" BASIS,
04:35:00  #    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
04:35:00  #    See the License for the specific language governing permissions and
04:35:00  #    limitations under the License.
04:35:00  #
04:35:00  
04:35:00  #
04:35:00  # handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf
04:35:00  # script: client, instance, shell, start, status, stop, karaf
04:35:00  #
04:35:00  # if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then
04:35:00  #   Actions go here...
04:35:00  # fi
04:35:00  
04:35:00  #
04:35:00  # general settings which should be applied for all scripts go here; please keep
04:35:00  # in mind that it is possible that scripts might be executed more than once, e.g.
04:35:00  # in example of the start script where the start script is executed first and the
04:35:00  # karaf script afterwards.
04:35:00  #
04:35:00  
04:35:00  #
04:35:00  # The following section shows the possible configuration options for the default 
04:35:00  # karaf scripts
04:35:00  #
04:35:00  export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk-amd64} # Location of Java installation
04:35:00  # export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration
04:35:00  # export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options
04:35:00  # export EXTRA_JAVA_OPTS # Additional JVM options
04:35:00  # export KARAF_HOME # Karaf home folder
04:35:00  # export KARAF_DATA # Karaf data folder
04:35:00  # export KARAF_BASE # Karaf base folder
04:35:00  # export KARAF_ETC  # Karaf etc  folder
04:35:00  # export KARAF_LOG  # Karaf log  folder
04:35:00  # export KARAF_SYSTEM_OPTS # First citizen Karaf options
04:35:00  # export KARAF_OPTS # Additional available Karaf options
04:35:00  # export KARAF_DEBUG # Enable debug mode
04:35:00  # export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start
04:35:00  # export KARAF_NOROOT # Prevent execution as root if set to true
04:35:00  Set Java version
04:35:00  + echo 'Set Java version'
04:35:00  + sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-17-openjdk-amd64/bin/java 1
04:35:00  sudo: /usr/sbin/alternatives: command not found
04:35:00  + sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-17-openjdk-amd64/bin/java
04:35:00  sudo: /usr/sbin/alternatives: command not found
04:35:00  JDK default version ...
04:35:00  + echo 'JDK default version ...'
04:35:00  + java -version
04:35:01  openjdk version "11.0.25" 2024-10-15
04:35:01  OpenJDK Runtime Environment (build 11.0.25+9-post-Ubuntu-1ubuntu120.04)
04:35:01  OpenJDK 64-Bit Server VM (build 11.0.25+9-post-Ubuntu-1ubuntu120.04, mixed mode, sharing)
04:35:01  Set JAVA_HOME
04:35:01  + echo 'Set JAVA_HOME'
04:35:01  + export JAVA_HOME=/usr/lib/jvm/java-17-openjdk-amd64
04:35:01  + JAVA_HOME=/usr/lib/jvm/java-17-openjdk-amd64
04:35:01  ++ readlink -e /usr/lib/jvm/java-17-openjdk-amd64/bin/java
04:35:01  Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-amd64/bin/java
04:35:01  Listing all open ports on controller system...
04:35:01  + JAVA_RESOLVED=/usr/lib/jvm/java-17-openjdk-amd64/bin/java
04:35:01  + echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-amd64/bin/java'
04:35:01  + echo 'Listing all open ports on controller system...'
04:35:01  + netstat -pnatu
04:35:01  /tmp/configuration-script.sh: line 40: netstat: command not found
04:35:01  Configuring cluster
04:35:01  + '[' -f /tmp/custom_shard_config.txt ']'
04:35:01  + echo 'Configuring cluster'
04:35:01  + /tmp/karaf-0.20.4/bin/configure_cluster.sh 1 10.30.171.228 10.30.170.250 10.30.171.190
04:35:01  ################################################
04:35:01  ##             Configure Cluster              ##
04:35:01  ################################################
04:35:01   NOTE: Cluster configuration files not found. Copying from
04:35:01   /tmp/karaf-0.20.4/system/org/opendaylight/controller/sal-clustering-config/9.0.6
04:35:01  Configuring unique name in akka.conf
04:35:01  Configuring hostname in akka.conf
04:35:01  Configuring data and rpc seed nodes in akka.conf
04:35:01  modules = [
04:35:01  	
04:35:01  	{
04:35:01  		name = "inventory"
04:35:01  		namespace = "urn:opendaylight:inventory"
04:35:01  		shard-strategy = "module"
04:35:01  	},
04:35:01  	{
04:35:01  		name = "topology"
04:35:01  		namespace = "urn:TBD:params:xml:ns:yang:network-topology"
04:35:01  		shard-strategy = "module"
04:35:01  	},
04:35:01  	{
04:35:01  		name = "toaster"
04:35:01  		namespace = "http://netconfcentral.org/ns/toaster"
04:35:01  		shard-strategy = "module"
04:35:01  	}
04:35:01  ]
04:35:01  Configuring replication type in module-shards.conf
04:35:01  ################################################
04:35:01  ##   NOTE: Manually restart controller to     ##
04:35:01  ##         apply configuration.               ##
04:35:01  ################################################
04:35:01  Dump akka.conf
04:35:01  + echo 'Dump akka.conf'
04:35:01  + cat /tmp/karaf-0.20.4/configuration/initial/akka.conf
04:35:01  
04:35:01  odl-cluster-data {
04:35:01    akka {
04:35:01      remote {
04:35:01        artery {
04:35:01          enabled = on
04:35:01          transport = tcp
04:35:01          canonical.hostname = "10.30.171.228"
04:35:01          canonical.port = 2550
04:35:01        }
04:35:01      }
04:35:01  
04:35:01      cluster {
04:35:01        # Using artery.
04:35:01        seed-nodes = ["akka://opendaylight-cluster-data@10.30.171.228:2550",
04:35:01  				"akka://opendaylight-cluster-data@10.30.170.250:2550",
04:35:01  				"akka://opendaylight-cluster-data@10.30.171.190:2550"]
04:35:01  
04:35:01        roles = ["member-1"]
04:35:01  
04:35:01        # when under load we might trip a false positive on the failure detector
04:35:01        # failure-detector {
04:35:01          # heartbeat-interval = 4 s
04:35:01          # acceptable-heartbeat-pause = 16s
04:35:01        # }
04:35:01      }
04:35:01  
04:35:01      persistence {
04:35:01        # By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by
04:35:01        # modifying the following two properties. The directory location specified may be a relative or absolute path. 
04:35:01        # The relative path is always relative to KARAF_HOME.
04:35:01  
04:35:01        # snapshot-store.local.dir = "target/snapshots"
04:35:01  
04:35:01        # Use lz4 compression for LocalSnapshotStore snapshots
04:35:01        snapshot-store.local.use-lz4-compression = false
04:35:01        # Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB
04:35:01        snapshot-store.local.lz4-blocksize = 256KB
04:35:01      }
04:35:01      disable-default-actor-system-quarantined-event-handling = "false"
04:35:01    }
04:35:01  }
04:35:01  Dump modules.conf
04:35:01  + echo 'Dump modules.conf'
04:35:01  + cat /tmp/karaf-0.20.4/configuration/initial/modules.conf
04:35:01  modules = [
04:35:01  	
04:35:01  	{
04:35:01  		name = "inventory"
04:35:01  		namespace = "urn:opendaylight:inventory"
04:35:01  		shard-strategy = "module"
04:35:01  	},
04:35:01  	{
04:35:01  		name = "topology"
04:35:01  		namespace = "urn:TBD:params:xml:ns:yang:network-topology"
04:35:01  		shard-strategy = "module"
04:35:01  	},
04:35:01  	{
04:35:01  		name = "toaster"
04:35:01  		namespace = "http://netconfcentral.org/ns/toaster"
04:35:01  		shard-strategy = "module"
04:35:01  	}
04:35:01  ]
04:35:01  Dump module-shards.conf
04:35:01  + echo 'Dump module-shards.conf'
04:35:01  + cat /tmp/karaf-0.20.4/configuration/initial/module-shards.conf
04:35:01  module-shards = [
04:35:01  	{
04:35:01  		name = "default"
04:35:01  		shards = [
04:35:01  			{
04:35:01  				name = "default"
04:35:01  				replicas = ["member-1",
04:35:01  				"member-2",
04:35:01  				"member-3"]
04:35:01  			}
04:35:01  		]
04:35:01  	},
04:35:01  	{
04:35:01  		name = "inventory"
04:35:01  		shards = [
04:35:01  			{
04:35:01  				name="inventory"
04:35:01  				replicas = ["member-1",
04:35:01  				"member-2",
04:35:01  				"member-3"]
04:35:01  			}
04:35:01  		]
04:35:01  	},
04:35:01  	{
04:35:01  		name = "topology"
04:35:01  		shards = [
04:35:01  			{
04:35:01  				name="topology"
04:35:01  				replicas = ["member-1",
04:35:01  				"member-2",
04:35:01  				"member-3"]
04:35:01  			}
04:35:01  		]
04:35:01  	},
04:35:01  	{
04:35:01  		name = "toaster"
04:35:01  		shards = [
04:35:01  			{
04:35:01  				name="toaster"
04:35:01  				replicas = ["member-1",
04:35:01  				"member-2",
04:35:01  				"member-3"]
04:35:01  			}
04:35:01  		]
04:35:01  	}
04:35:01  ]
04:35:01  Configuring member-2 with IP address 10.30.170.250
04:35:01  Warning: Permanently added '10.30.170.250' (ECDSA) to the list of known hosts.
04:35:01  Warning: Permanently added '10.30.170.250' (ECDSA) to the list of known hosts.
04:35:01  + source /tmp/common-functions.sh karaf-0.20.4
04:35:01  common-functions.sh is being sourced
04:35:01  ++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]]
04:35:01  ++ echo 'common-functions.sh is being sourced'
04:35:01  ++ BUNDLEFOLDER=karaf-0.20.4
04:35:01  ++ export MAVENCONF=/tmp/karaf-0.20.4/etc/org.ops4j.pax.url.mvn.cfg
04:35:01  ++ MAVENCONF=/tmp/karaf-0.20.4/etc/org.ops4j.pax.url.mvn.cfg
04:35:01  ++ export FEATURESCONF=/tmp/karaf-0.20.4/etc/org.apache.karaf.features.cfg
04:35:01  ++ FEATURESCONF=/tmp/karaf-0.20.4/etc/org.apache.karaf.features.cfg
04:35:01  ++ export CUSTOMPROP=/tmp/karaf-0.20.4/etc/custom.properties
04:35:01  ++ CUSTOMPROP=/tmp/karaf-0.20.4/etc/custom.properties
04:35:01  ++ export LOGCONF=/tmp/karaf-0.20.4/etc/org.ops4j.pax.logging.cfg
04:35:01  ++ LOGCONF=/tmp/karaf-0.20.4/etc/org.ops4j.pax.logging.cfg
04:35:01  ++ export MEMCONF=/tmp/karaf-0.20.4/bin/setenv
04:35:01  ++ MEMCONF=/tmp/karaf-0.20.4/bin/setenv
04:35:01  ++ export CONTROLLERMEM=
04:35:01  ++ CONTROLLERMEM=
04:35:01  ++ export AKKACONF=/tmp/karaf-0.20.4/configuration/initial/akka.conf
04:35:01  ++ AKKACONF=/tmp/karaf-0.20.4/configuration/initial/akka.conf
04:35:01  ++ export MODULESCONF=/tmp/karaf-0.20.4/configuration/initial/modules.conf
04:35:01  ++ MODULESCONF=/tmp/karaf-0.20.4/configuration/initial/modules.conf
04:35:01  ++ export MODULESHARDSCONF=/tmp/karaf-0.20.4/configuration/initial/module-shards.conf
04:35:01  ++ MODULESHARDSCONF=/tmp/karaf-0.20.4/configuration/initial/module-shards.conf
04:35:01  ++ print_common_env
04:35:01  ++ cat
04:35:01  common-functions environment:
04:35:01  MAVENCONF: /tmp/karaf-0.20.4/etc/org.ops4j.pax.url.mvn.cfg
04:35:01  ACTUALFEATURES: 
04:35:01  FEATURESCONF: /tmp/karaf-0.20.4/etc/org.apache.karaf.features.cfg
04:35:01  CUSTOMPROP: /tmp/karaf-0.20.4/etc/custom.properties
04:35:01  LOGCONF: /tmp/karaf-0.20.4/etc/org.ops4j.pax.logging.cfg
04:35:01  MEMCONF: /tmp/karaf-0.20.4/bin/setenv
04:35:01  CONTROLLERMEM: 
04:35:01  AKKACONF: /tmp/karaf-0.20.4/configuration/initial/akka.conf
04:35:01  MODULESCONF: /tmp/karaf-0.20.4/configuration/initial/modules.conf
04:35:01  MODULESHARDSCONF: /tmp/karaf-0.20.4/configuration/initial/module-shards.conf
04:35:01  SUITES: 
04:35:01  
04:35:01  ++ SSH='ssh -t -t'
04:35:01  ++ extra_services_cntl='     dnsmasq.service     httpd.service     libvirtd.service     openvswitch.service     ovs-vswitchd.service     ovsdb-server.service     rabbitmq-server.service '
04:35:01  ++ extra_services_cmp='     libvirtd.service     openvswitch.service     ovs-vswitchd.service     ovsdb-server.service '
04:35:01  Changing to /tmp
04:35:01  Downloading the distribution from https://nexus.opendaylight.org/content/repositories//autorelease-8645/org/opendaylight/integration/karaf/0.20.4/karaf-0.20.4.zip
04:35:01  + echo 'Changing to /tmp'
04:35:01  + cd /tmp
04:35:01  + echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories//autorelease-8645/org/opendaylight/integration/karaf/0.20.4/karaf-0.20.4.zip'
04:35:01  + wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories//autorelease-8645/org/opendaylight/integration/karaf/0.20.4/karaf-0.20.4.zip
04:35:01  --2025-02-25 04:35:01--  https://nexus.opendaylight.org/content/repositories//autorelease-8645/org/opendaylight/integration/karaf/0.20.4/karaf-0.20.4.zip
04:35:01  Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6
04:35:01  Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected.
04:35:01  HTTP request sent, awaiting response... 200 OK
04:35:01  Length: 234139102 (223M) [application/zip]
04:35:01  Saving to: ‘karaf-0.20.4.zip’
04:35:01  
04:35:01       0K ........ ........ ........ ........ ........ ........  1% 78.1M 3s
04:35:01    3072K ........ ........ ........ ........ ........ ........  2% 57.3M 3s
04:35:01    6144K ........ ........ ........ ........ ........ ........  4% 89.6M 3s
04:35:01    9216K ........ ........ ........ ........ ........ ........  5%  135M 3s
04:35:02   12288K ........ ........ ........ ........ ........ ........  6%  129M 2s
04:35:02   15360K ........ ........ ........ ........ ........ ........  8%  148M 2s
04:35:02   18432K ........ ........ ........ ........ ........ ........  9%  194M 2s
04:35:02   21504K ........ ........ ........ ........ ........ ........ 10%  224M 2s
04:35:02   24576K ........ ........ ........ ........ ........ ........ 12%  204M 2s
04:35:02   27648K ........ ........ ........ ........ ........ ........ 13%  212M 2s
04:35:02   30720K ........ ........ ........ ........ ........ ........ 14%  176M 2s
04:35:02   33792K ........ ........ ........ ........ ........ ........ 16%  208M 1s
04:35:02   36864K ........ ........ ........ ........ ........ ........ 17%  191M 1s
04:35:02   39936K ........ ........ ........ ........ ........ ........ 18%  212M 1s
04:35:02   43008K ........ ........ ........ ........ ........ ........ 20%  226M 1s
04:35:02   46080K ........ ........ ........ ........ ........ ........ 21%  214M 1s
04:35:02   49152K ........ ........ ........ ........ ........ ........ 22%  218M 1s
04:35:02   52224K ........ ........ ........ ........ ........ ........ 24%  221M 1s
04:35:02   55296K ........ ........ ........ ........ ........ ........ 25%  219M 1s
04:35:02   58368K ........ ........ ........ ........ ........ ........ 26%  252M 1s
04:35:02   61440K ........ ........ ........ ........ ........ ........ 28%  228M 1s
04:35:02   64512K ........ ........ ........ ........ ........ ........ 29%  219M 1s
04:35:02   67584K ........ ........ ........ ........ ........ ........ 30%  279M 1s
04:35:02   70656K ........ ........ ........ ........ ........ ........ 32%  224M 1s
04:35:02   73728K ........ ........ ........ ........ ........ ........ 33%  196M 1s
04:35:02   76800K ........ ........ ........ ........ ........ ........ 34%  212M 1s
04:35:02   79872K ........ ........ ........ ........ ........ ........ 36%  237M 1s
04:35:02   82944K ........ ........ ........ ........ ........ ........ 37%  223M 1s
04:35:02   86016K ........ ........ ........ ........ ........ ........ 38%  232M 1s
04:35:02   89088K ........ ........ ........ ........ ........ ........ 40%  218M 1s
04:35:02   92160K ........ ........ ........ ........ ........ ........ 41%  228M 1s
04:35:02   95232K ........ ........ ........ ........ ........ ........ 42%  218M 1s
04:35:02   98304K ........ ........ ........ ........ ........ ........ 44%  211M 1s
04:35:02  101376K ........ ........ ........ ........ ........ ........ 45%  216M 1s
04:35:02  104448K ........ ........ ........ ........ ........ ........ 47%  221M 1s
04:35:02  107520K ........ ........ ........ ........ ........ ........ 48%  229M 1s
04:35:02  110592K ........ ........ ........ ........ ........ ........ 49%  225M 1s
04:35:02  113664K ........ ........ ........ ........ ........ ........ 51%  206M 1s
04:35:02  116736K ........ ........ ........ ........ ........ ........ 52%  211M 1s
04:35:02  119808K ........ ........ ........ ........ ........ ........ 53%  231M 1s
04:35:02  122880K ........ ........ ........ ........ ........ ........ 55%  205M 1s
04:35:02  125952K ........ ........ ........ ........ ........ ........ 56%  206M 1s
04:35:02  129024K ........ ........ ........ ........ ........ ........ 57%  227M 1s
04:35:02  132096K ........ ........ ........ ........ ........ ........ 59%  232M 0s
04:35:02  135168K ........ ........ ........ ........ ........ ........ 60%  240M 0s
04:35:02  138240K ........ ........ ........ ........ ........ ........ 61%  234M 0s
04:35:02  141312K ........ ........ ........ ........ ........ ........ 63%  199M 0s
04:35:02  144384K ........ ........ ........ ........ ........ ........ 64%  212M 0s
04:35:02  147456K ........ ........ ........ ........ ........ ........ 65%  211M 0s
04:35:02  150528K ........ ........ ........ ........ ........ ........ 67%  236M 0s
04:35:02  153600K ........ ........ ........ ........ ........ ........ 68%  243M 0s
04:35:02  156672K ........ ........ ........ ........ ........ ........ 69%  234M 0s
04:35:02  159744K ........ ........ ........ ........ ........ ........ 71%  220M 0s
04:35:02  162816K ........ ........ ........ ........ ........ ........ 72%  222M 0s
04:35:02  165888K ........ ........ ........ ........ ........ ........ 73%  232M 0s
04:35:02  168960K ........ ........ ........ ........ ........ ........ 75%  237M 0s
04:35:02  172032K ........ ........ ........ ........ ........ ........ 76%  219M 0s
04:35:02  175104K ........ ........ ........ ........ ........ ........ 77%  227M 0s
04:35:02  178176K ........ ........ ........ ........ ........ ........ 79%  223M 0s
04:35:02  181248K ........ ........ ........ ........ ........ ........ 80%  214M 0s
04:35:02  184320K ........ ........ ........ ........ ........ ........ 81%  207M 0s
04:35:02  187392K ........ ........ ........ ........ ........ ........ 83%  223M 0s
04:35:02  190464K ........ ........ ........ ........ ........ ........ 84%  180M 0s
04:35:02  193536K ........ ........ ........ ........ ........ ........ 85%  214M 0s
04:35:02  196608K ........ ........ ........ ........ ........ ........ 87%  219M 0s
04:35:02  199680K ........ ........ ........ ........ ........ ........ 88%  221M 0s
04:35:02  202752K ........ ........ ........ ........ ........ ........ 90%  209M 0s
04:35:02  205824K ........ ........ ........ ........ ........ ........ 91%  224M 0s
04:35:02  208896K ........ ........ ........ ........ ........ ........ 92%  203M 0s
04:35:02  211968K ........ ........ ........ ........ ........ ........ 94%  211M 0s
04:35:02  215040K ........ ........ ........ ........ ........ ........ 95%  215M 0s
04:35:02  218112K ........ ........ ........ ........ ........ ........ 96%  195M 0s
04:35:02  221184K ........ ........ ........ ........ ........ ........ 98%  219M 0s
04:35:02  224256K ........ ........ ........ ........ ........ ........ 99%  219M 0s
04:35:02  227328K ........ ........ ....                               100%  226M=1.1s
04:35:02  
04:35:02  2025-02-25 04:35:02 (197 MB/s) - ‘karaf-0.20.4.zip’ saved [234139102/234139102]
04:35:02  
04:35:02  Extracting the new controller...
04:35:02  + echo 'Extracting the new controller...'
04:35:02  + unzip -q karaf-0.20.4.zip
04:35:04  Adding external repositories...
04:35:04  + echo 'Adding external repositories...'
04:35:04  + sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.20.4/etc/org.ops4j.pax.url.mvn.cfg
04:35:04  + cat /tmp/karaf-0.20.4/etc/org.ops4j.pax.url.mvn.cfg
04:35:04  ################################################################################
04:35:04  #
04:35:04  #    Licensed to the Apache Software Foundation (ASF) under one or more
04:35:04  #    contributor license agreements.  See the NOTICE file distributed with
04:35:04  #    this work for additional information regarding copyright ownership.
04:35:04  #    The ASF licenses this file to You under the Apache License, Version 2.0
04:35:04  #    (the "License"); you may not use this file except in compliance with
04:35:04  #    the License.  You may obtain a copy of the License at
04:35:04  #
04:35:04  #       http://www.apache.org/licenses/LICENSE-2.0
04:35:04  #
04:35:04  #    Unless required by applicable law or agreed to in writing, software
04:35:04  #    distributed under the License is distributed on an "AS IS" BASIS,
04:35:04  #    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
04:35:04  #    See the License for the specific language governing permissions and
04:35:04  #    limitations under the License.
04:35:04  #
04:35:04  ################################################################################
04:35:04  
04:35:04  #
04:35:04  # If set to true, the following property will not allow any certificate to be used
04:35:04  # when accessing Maven repositories through SSL
04:35:04  #
04:35:04  #org.ops4j.pax.url.mvn.certificateCheck=
04:35:04  
04:35:04  #
04:35:04  # Path to the local Maven settings file.
04:35:04  # The repositories defined in this file will be automatically added to the list
04:35:04  # of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property
04:35:04  # below is not set.
04:35:04  # The following locations are checked for the existence of the settings.xml file
04:35:04  #   * 1. looks for the specified url
04:35:04  #   * 2. if not found looks for ${user.home}/.m2/settings.xml
04:35:04  #   * 3. if not found looks for ${maven.home}/conf/settings.xml
04:35:04  #   * 4. if not found looks for ${M2_HOME}/conf/settings.xml
04:35:04  #
04:35:04  #org.ops4j.pax.url.mvn.settings=
04:35:04  
04:35:04  #
04:35:04  # Path to the local Maven repository which is used to avoid downloading
04:35:04  # artifacts when they already exist locally.
04:35:04  # The value of this property will be extracted from the settings.xml file
04:35:04  # above, or defaulted to:
04:35:04  #     System.getProperty( "user.home" ) + "/.m2/repository"
04:35:04  #
04:35:04  org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository}
04:35:04  
04:35:04  #
04:35:04  # Default this to false. It's just weird to use undocumented repos
04:35:04  #
04:35:04  org.ops4j.pax.url.mvn.useFallbackRepositories=false
04:35:04  
04:35:04  #
04:35:04  # Uncomment if you don't wanna use the proxy settings
04:35:04  # from the Maven conf/settings.xml file
04:35:04  #
04:35:04  # org.ops4j.pax.url.mvn.proxySupport=false
04:35:04  
04:35:04  #
04:35:04  # Comma separated list of repositories scanned when resolving an artifact.
04:35:04  # Those repositories will be checked before iterating through the
04:35:04  #    below list of repositories and even before the local repository
04:35:04  # A repository url can be appended with zero or more of the following flags:
04:35:04  #    @snapshots  : the repository contains snaphots
04:35:04  #    @noreleases : the repository does not contain any released artifacts
04:35:04  #
04:35:04  # The following property value will add the system folder as a repo.
04:35:04  #
04:35:04  org.ops4j.pax.url.mvn.defaultRepositories=\
04:35:04      file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\
04:35:04      file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\
04:35:04      file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots
04:35:04  
04:35:04  # Use the default local repo (e.g.~/.m2/repository) as a "remote" repo
04:35:04  #org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false
04:35:04  
04:35:04  #
04:35:04  # Comma separated list of repositories scanned when resolving an artifact.
04:35:04  # The default list includes the following repositories:
04:35:04  #    http://repo1.maven.org/maven2@id=central
04:35:04  #    http://repository.springsource.com/maven/bundles/release@id=spring.ebr
04:35:04  #    http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external
04:35:04  #    http://zodiac.springsource.com/maven/bundles/release@id=gemini
04:35:04  #    http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases
04:35:04  #    https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases
04:35:04  #    https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
04:35:04  # To add repositories to the default ones, prepend '+' to the list of repositories
04:35:04  # to add.
04:35:04  # A repository url can be appended with zero or more of the following flags:
04:35:04  #    @snapshots  : the repository contains snapshots
04:35:04  #    @noreleases : the repository does not contain any released artifacts
04:35:04  #    @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended
04:35:04  #
04:35:04  org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
04:35:04  
04:35:04  ### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.Configuring the startup features...
04:35:04  + [[ True == \T\r\u\e ]]
04:35:04  + echo 'Configuring the startup features...'
04:35:04  + sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-infrautils-ready,odl-jolokia,odl-ovsdb-southbound-impl-rest,/g' /tmp/karaf-0.20.4/etc/org.apache.karaf.features.cfg
04:35:04  + FEATURE_TEST_STRING=features-test
04:35:04  + FEATURE_TEST_VERSION=0.20.4
04:35:04  + KARAF_VERSION=karaf4
04:35:04  + [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]]
04:35:04  + sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.20.4/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.20.4/etc/org.apache.karaf.features.cfg
04:35:04  + [[ ! -z '' ]]
04:35:04  + cat /tmp/karaf-0.20.4/etc/org.apache.karaf.features.cfg
04:35:04  ################################################################################
04:35:04  #
04:35:04  #    Licensed to the Apache Software Foundation (ASF) under one or more
04:35:04  #    contributor license agreements.  See the NOTICE file distributed with
04:35:04  #    this work for additional information regarding copyright ownership.
04:35:04  #    The ASF licenses this file to You under the Apache License, Version 2.0
04:35:04  #    (the "License"); you may not use this file except in compliance with
04:35:04  #    the License.  You may obtain a copy of the License at
04:35:04  #
04:35:04  #       http://www.apache.org/licenses/LICENSE-2.0
04:35:04  #
04:35:04  #    Unless required by applicable law or agreed to in writing, software
04:35:04  #    distributed under the License is distributed on an "AS IS" BASIS,
04:35:04  #    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
04:35:04  #    See the License for the specific language governing permissions and
04:35:04  #    limitations under the License.
04:35:04  #
04:35:04  ################################################################################
04:35:04  
04:35:04  #
04:35:04  # Comma separated list of features repositories to register by default
04:35:04  #
04:35:04  featuresRepositories = mvn:org.opendaylight.integration/features-test/0.20.4/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/290d8cd0-90b7-436d-8e9c-f26d70ee4bd5.xml
04:35:04  
04:35:04  #
04:35:04  # Comma separated list of features to install at startup
04:35:04  #
04:35:04  featuresBoot = odl-infrautils-ready,odl-jolokia,odl-ovsdb-southbound-impl-rest, a1e7a267-4169-4830-a802-e7ef39ca0207
04:35:04  
04:35:04  #
04:35:04  # Resource repositories (OBR) that the features resolver can use
04:35:04  # to resolve requirements/capabilities
04:35:04  #
04:35:04  # The format of the resourceRepositories is 
04:35:04  # resourceRepositories=[xml:url|json:url],...
04:35:04  # for Instance:
04:35:04  #
04:35:04  #resourceRepositories=xml:http://host/path/to/index.xml
04:35:04  # or
04:35:04  #resourceRepositories=json:http://host/path/to/index.json
04:35:04  #
04:35:04  
04:35:04  #
04:35:04  # Defines if the boot features are started in asynchronous mode (in a dedicated thread)
04:35:04  #
04:35:04  featuresBootAsynchronous=false
04:35:04  
04:35:04  #
04:35:04  # Service requirements enforcement
04:35:04  #
04:35:04  # By default, the feature resolver checks the service requirements/capabilities of
04:35:04  # bundles for new features (xml schema >= 1.3.0) in order to automatically installs
04:35:04  # the required bundles.
04:35:04  # The following flag can have those values:
04:35:04  #   - disable: service requirements are completely ignored
04:35:04  #   - default: service requirements are ignored for old features
04:35:04  #   - enforce: service requirements are always verified
04:35:04  #
04:35:04  #serviceRequirements=default
04:35:04  
04:35:04  #
04:35:04  # Store cfg file for config element in feature
04:35:04  #
04:35:04  #configCfgStore=true
04:35:04  
04:35:04  #
04:35:04  # Define if the feature service automatically refresh bundles
04:35:04  #
04:35:04  autoRefresh=true
04:35:04  
04:35:04  #
04:35:04  # Configuration of features processing mechanism (overrides, blacklisting, modification of features)
04:35:04  # XML file defines instructions related to features processing
04:35:04  # versions.properties may declare properties to resolve placeholders in XML file
04:35:04  # both files are relative to ${karaf.etc}
04:35:04  #
04:35:04  #featureProcessing=org.apache.karaf.features.xml
04:35:04  #featureProcessingVersions=versions.properties
04:35:04  + configure_karaf_log karaf4 ''
04:35:04  + local -r karaf_version=karaf4
04:35:04  + local -r controllerdebugmap=
04:35:04  + local logapi=log4j
04:35:04  + grep log4j2 /tmp/karaf-0.20.4/etc/org.ops4j.pax.logging.cfg
04:35:04  log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
04:35:04  log4j2.rootLogger.level = INFO
04:35:04  #log4j2.rootLogger.type = asyncRoot
04:35:04  #log4j2.rootLogger.includeLocation = false
04:35:04  log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
04:35:04  log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
04:35:04  log4j2.rootLogger.appenderRef.Console.ref = Console
04:35:04  log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
04:35:04  log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
04:35:04  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
04:35:04  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
04:35:04  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
04:35:04  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
04:35:04  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
04:35:04  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
04:35:04  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
04:35:04  log4j2.logger.spifly.name = org.apache.aries.spifly
04:35:04  log4j2.logger.spifly.level = WARN
04:35:04  log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
04:35:04  log4j2.logger.audit.level = INFO
04:35:04  log4j2.logger.audit.additivity = false
04:35:04  log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
04:35:04  # Console appender not used by default (see log4j2.rootLogger.appenderRefs)
04:35:04  log4j2.appender.console.type = Console
04:35:04  log4j2.appender.console.name = Console
04:35:04  log4j2.appender.console.layout.type = PatternLayout
04:35:04  log4j2.appender.console.layout.pattern = ${log4j2.pattern}
04:35:04  log4j2.appender.rolling.type = RollingRandomAccessFile
04:35:04  log4j2.appender.rolling.name = RollingFile
04:35:04  log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
04:35:04  log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
04:35:04  #log4j2.appender.rolling.immediateFlush = false
04:35:04  log4j2.appender.rolling.append = true
04:35:04  log4j2.appender.rolling.layout.type = PatternLayout
04:35:04  log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
04:35:04  log4j2.appender.rolling.policies.type = Policies
04:35:04  log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
04:35:04  log4j2.appender.rolling.policies.size.size = 64MB
04:35:04  log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
04:35:04  log4j2.appender.rolling.strategy.max = 7
04:35:04  log4j2.appender.audit.type = RollingRandomAccessFile
04:35:04  log4j2.appender.audit.name = AuditRollingFile
04:35:04  log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
04:35:04  log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
04:35:04  log4j2.appender.audit.append = true
04:35:04  log4j2.appender.audit.layout.type = PatternLayout
04:35:04  log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
04:35:04  log4j2.appender.audit.policies.type = Policies
04:35:04  log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
04:35:04  log4j2.appender.audit.policies.size.size = 8MB
04:35:04  log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
04:35:04  log4j2.appender.audit.strategy.max = 7
04:35:04  log4j2.appender.osgi.type = PaxOsgi
04:35:04  log4j2.appender.osgi.name = PaxOsgi
04:35:04  log4j2.appender.osgi.filter = *
04:35:04  #log4j2.logger.aether.name = shaded.org.eclipse.aether
04:35:04  #log4j2.logger.aether.level = TRACE
04:35:04  #log4j2.logger.http-headers.name = shaded.org.apache.http.headers
04:35:04  #log4j2.logger.http-headers.level = DEBUG
04:35:04  #log4j2.logger.maven.name = org.ops4j.pax.url.mvn
04:35:04  #log4j2.logger.maven.level = TRACE
04:35:04  Configuring the karaf log... karaf_version: karaf4, logapi: log4j2
04:35:04  + logapi=log4j2
04:35:04  + echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2'
04:35:04  + '[' log4j2 == log4j2 ']'
04:35:04  + sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.20.4/etc/org.ops4j.pax.logging.cfg
04:35:04  + orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver
04:35:04  + orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver
04:35:04  + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN'
04:35:04  controllerdebugmap: 
04:35:04  + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN'
04:35:04  + unset IFS
04:35:04  + echo 'controllerdebugmap: '
04:35:04  cat /tmp/karaf-0.20.4/etc/org.ops4j.pax.logging.cfg
04:35:04  + '[' -n '' ']'
04:35:04  + echo 'cat /tmp/karaf-0.20.4/etc/org.ops4j.pax.logging.cfg'
04:35:04  + cat /tmp/karaf-0.20.4/etc/org.ops4j.pax.logging.cfg
04:35:04  ################################################################################
04:35:04  #
04:35:04  #    Licensed to the Apache Software Foundation (ASF) under one or more
04:35:04  #    contributor license agreements.  See the NOTICE file distributed with
04:35:04  #    this work for additional information regarding copyright ownership.
04:35:04  #    The ASF licenses this file to You under the Apache License, Version 2.0
04:35:04  #    (the "License"); you may not use this file except in compliance with
04:35:04  #    the License.  You may obtain a copy of the License at
04:35:04  #
04:35:04  #       http://www.apache.org/licenses/LICENSE-2.0
04:35:04  #
04:35:04  #    Unless required by applicable law or agreed to in writing, software
04:35:04  #    distributed under the License is distributed on an "AS IS" BASIS,
04:35:04  #    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
04:35:04  #    See the License for the specific language governing permissions and
04:35:04  #    limitations under the License.
04:35:04  #
04:35:04  ################################################################################
04:35:04  
04:35:04  # Common pattern layout for appenders
04:35:04  log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
04:35:04  
04:35:04  # Root logger
04:35:04  log4j2.rootLogger.level = INFO
04:35:04  # uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library
04:35:04  #log4j2.rootLogger.type = asyncRoot
04:35:04  #log4j2.rootLogger.includeLocation = false
04:35:04  log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
04:35:04  log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
04:35:04  log4j2.rootLogger.appenderRef.Console.ref = Console
04:35:04  log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
04:35:04  log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
04:35:04  
04:35:04  # Filters for logs marked by org.opendaylight.odlparent.Markers
04:35:04  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
04:35:04  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
04:35:04  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
04:35:04  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
04:35:04  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
04:35:04  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
04:35:04  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
04:35:04  
04:35:04  # Loggers configuration
04:35:04  
04:35:04  # Spifly logger
04:35:04  log4j2.logger.spifly.name = org.apache.aries.spifly
04:35:04  log4j2.logger.spifly.level = WARN
04:35:04  
04:35:04  # Security audit logger
04:35:04  log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
04:35:04  log4j2.logger.audit.level = INFO
04:35:04  log4j2.logger.audit.additivity = false
04:35:04  log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
04:35:04  
04:35:04  # Appenders configuration
04:35:04  
04:35:04  # Console appender not used by default (see log4j2.rootLogger.appenderRefs)
04:35:04  log4j2.appender.console.type = Console
04:35:04  log4j2.appender.console.name = Console
04:35:04  log4j2.appender.console.layout.type = PatternLayout
04:35:04  log4j2.appender.console.layout.pattern = ${log4j2.pattern}
04:35:04  
04:35:04  # Rolling file appender
04:35:04  log4j2.appender.rolling.type = RollingRandomAccessFile
04:35:04  log4j2.appender.rolling.name = RollingFile
04:35:04  log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
04:35:04  log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
04:35:04  # uncomment to not force a disk flush
04:35:04  #log4j2.appender.rolling.immediateFlush = false
04:35:04  log4j2.appender.rolling.append = true
04:35:04  log4j2.appender.rolling.layout.type = PatternLayout
04:35:04  log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
04:35:04  log4j2.appender.rolling.policies.type = Policies
04:35:04  log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
04:35:04  log4j2.appender.rolling.policies.size.size = 1GB
04:35:04  log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
04:35:04  log4j2.appender.rolling.strategy.max = 7
04:35:04  
04:35:04  # Audit file appender
04:35:04  log4j2.appender.audit.type = RollingRandomAccessFile
04:35:04  log4j2.appender.audit.name = AuditRollingFile
04:35:04  log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
04:35:04  log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
04:35:04  log4j2.appender.audit.append = true
04:35:04  log4j2.appender.audit.layout.type = PatternLayout
04:35:04  log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
04:35:04  log4j2.appender.audit.policies.type = Policies
04:35:04  log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
04:35:04  log4j2.appender.audit.policies.size.size = 8MB
04:35:04  log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
04:35:04  log4j2.appender.audit.strategy.max = 7
04:35:04  
04:35:04  # OSGi appender
04:35:04  log4j2.appender.osgi.type = PaxOsgi
04:35:04  log4j2.appender.osgi.name = PaxOsgi
04:35:04  log4j2.appender.osgi.filter = *
04:35:04  
04:35:04  # help with identification of maven-related problems with pax-url-aether
04:35:04  #log4j2.logger.aether.name = shaded.org.eclipse.aether
04:35:04  #log4j2.logger.aether.level = TRACE
04:35:04  #log4j2.logger.http-headers.name = shaded.org.apache.http.headers
04:35:04  #log4j2.logger.http-headers.level = DEBUG
04:35:04  #log4j2.logger.maven.name = org.ops4j.pax.url.mvn
04:35:04  #log4j2.logger.maven.level = TRACE
04:35:04  log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN
04:35:04  log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN
04:35:04  Configure
04:35:04      java home: /usr/lib/jvm/java-17-openjdk-amd64
04:35:04      max memory: 2048m
04:35:04      memconf: /tmp/karaf-0.20.4/bin/setenv
04:35:04  + set_java_vars /usr/lib/jvm/java-17-openjdk-amd64 2048m /tmp/karaf-0.20.4/bin/setenv
04:35:04  + local -r java_home=/usr/lib/jvm/java-17-openjdk-amd64
04:35:04  + local -r controllermem=2048m
04:35:04  + local -r memconf=/tmp/karaf-0.20.4/bin/setenv
04:35:04  + echo Configure
04:35:04  + echo '    java home: /usr/lib/jvm/java-17-openjdk-amd64'
04:35:04  + echo '    max memory: 2048m'
04:35:04  + echo '    memconf: /tmp/karaf-0.20.4/bin/setenv'
04:35:04  + sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk-amd64}%g' /tmp/karaf-0.20.4/bin/setenv
04:35:05  + sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=2048m/g' /tmp/karaf-0.20.4/bin/setenv
04:35:05  cat /tmp/karaf-0.20.4/bin/setenv
04:35:05  + echo 'cat /tmp/karaf-0.20.4/bin/setenv'
04:35:05  + cat /tmp/karaf-0.20.4/bin/setenv
04:35:05  #!/bin/sh
04:35:05  #
04:35:05  #    Licensed to the Apache Software Foundation (ASF) under one or more
04:35:05  #    contributor license agreements.  See the NOTICE file distributed with
04:35:05  #    this work for additional information regarding copyright ownership.
04:35:05  #    The ASF licenses this file to You under the Apache License, Version 2.0
04:35:05  #    (the "License"); you may not use this file except in compliance with
04:35:05  #    the License.  You may obtain a copy of the License at
04:35:05  #
04:35:05  #       http://www.apache.org/licenses/LICENSE-2.0
04:35:05  #
04:35:05  #    Unless required by applicable law or agreed to in writing, software
04:35:05  #    distributed under the License is distributed on an "AS IS" BASIS,
04:35:05  #    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
04:35:05  #    See the License for the specific language governing permissions and
04:35:05  #    limitations under the License.
04:35:05  #
04:35:05  
04:35:05  #
04:35:05  # handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf
04:35:05  # script: client, instance, shell, start, status, stop, karaf
04:35:05  #
04:35:05  # if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then
04:35:05  #   Actions go here...
04:35:05  # fi
04:35:05  
04:35:05  #
04:35:05  # general settings which should be applied for all scripts go here; please keep
04:35:05  # in mind that it is possible that scripts might be executed more than once, e.g.
04:35:05  # in example of the start script where the start script is executed first and the
04:35:05  # karaf script afterwards.
04:35:05  #
04:35:05  
04:35:05  #
04:35:05  # The following section shows the possible configuration options for the default 
04:35:05  # karaf scripts
04:35:05  #
04:35:05  export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk-amd64} # Location of Java installation
04:35:05  # export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration
04:35:05  # export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options
04:35:05  # export EXTRA_JAVA_OPTS # Additional JVM options
04:35:05  # export KARAF_HOME # Karaf home folder
04:35:05  # export KARAF_DATA # Karaf data folder
04:35:05  # export KARAF_BASE # Karaf base folder
04:35:05  # export KARAF_ETC  # Karaf etc  folder
04:35:05  # export KARAF_LOG  # Karaf log  folder
04:35:05  # export KARAF_SYSTEM_OPTS # First citizen Karaf options
04:35:05  # export KARAF_OPTS # Additional available Karaf options
04:35:05  # export KARAF_DEBUG # Enable debug mode
04:35:05  # export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start
04:35:05  # export KARAF_NOROOT # Prevent execution as root if set to true
04:35:05  Set Java version
04:35:05  + echo 'Set Java version'
04:35:05  + sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-17-openjdk-amd64/bin/java 1
04:35:05  sudo: /usr/sbin/alternatives: command not found
04:35:05  + sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-17-openjdk-amd64/bin/java
04:35:05  sudo: /usr/sbin/alternatives: command not found
04:35:05  JDK default version ...
04:35:05  + echo 'JDK default version ...'
04:35:05  + java -version
04:35:05  openjdk version "11.0.25" 2024-10-15
04:35:05  OpenJDK Runtime Environment (build 11.0.25+9-post-Ubuntu-1ubuntu120.04)
04:35:05  OpenJDK 64-Bit Server VM (build 11.0.25+9-post-Ubuntu-1ubuntu120.04, mixed mode, sharing)
04:35:05  Set JAVA_HOME
04:35:05  + echo 'Set JAVA_HOME'
04:35:05  + export JAVA_HOME=/usr/lib/jvm/java-17-openjdk-amd64
04:35:05  + JAVA_HOME=/usr/lib/jvm/java-17-openjdk-amd64
04:35:05  ++ readlink -e /usr/lib/jvm/java-17-openjdk-amd64/bin/java
04:35:05  Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-amd64/bin/java
04:35:05  + JAVA_RESOLVED=/usr/lib/jvm/java-17-openjdk-amd64/bin/java
04:35:05  + echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-amd64/bin/java'
04:35:05  Listing all open ports on controller system...
04:35:05  + echo 'Listing all open ports on controller system...'
04:35:05  + netstat -pnatu
04:35:05  /tmp/configuration-script.sh: line 40: netstat: command not found
04:35:05  Configuring cluster
04:35:05  + '[' -f /tmp/custom_shard_config.txt ']'
04:35:05  + echo 'Configuring cluster'
04:35:05  + /tmp/karaf-0.20.4/bin/configure_cluster.sh 2 10.30.171.228 10.30.170.250 10.30.171.190
04:35:05  ################################################
04:35:05  ##             Configure Cluster              ##
04:35:05  ################################################
04:35:05   NOTE: Cluster configuration files not found. Copying from
04:35:05   /tmp/karaf-0.20.4/system/org/opendaylight/controller/sal-clustering-config/9.0.6
04:35:05  Configuring unique name in akka.conf
04:35:05  Configuring hostname in akka.conf
04:35:05  Configuring data and rpc seed nodes in akka.conf
04:35:05  modules = [
04:35:05  	
04:35:05  	{
04:35:05  		name = "inventory"
04:35:05  		namespace = "urn:opendaylight:inventory"
04:35:05  		shard-strategy = "module"
04:35:05  	},
04:35:05  	{
04:35:05  		name = "topology"
04:35:05  		namespace = "urn:TBD:params:xml:ns:yang:network-topology"
04:35:05  		shard-strategy = "module"
04:35:05  	},
04:35:05  	{
04:35:05  		name = "toaster"
04:35:05  		namespace = "http://netconfcentral.org/ns/toaster"
04:35:05  		shard-strategy = "module"
04:35:05  	}
04:35:05  ]
04:35:05  Configuring replication type in module-shards.conf
04:35:05  ################################################
04:35:05  ##   NOTE: Manually restart controller to     ##
04:35:05  ##         apply configuration.               ##
04:35:05  ################################################
04:35:05  Dump akka.conf
04:35:05  + echo 'Dump akka.conf'
04:35:05  + cat /tmp/karaf-0.20.4/configuration/initial/akka.conf
04:35:05  
04:35:05  odl-cluster-data {
04:35:05    akka {
04:35:05      remote {
04:35:05        artery {
04:35:05          enabled = on
04:35:05          transport = tcp
04:35:05          canonical.hostname = "10.30.170.250"
04:35:05          canonical.port = 2550
04:35:05        }
04:35:05      }
04:35:05  
04:35:05      cluster {
04:35:05        # Using artery.
04:35:05        seed-nodes = ["akka://opendaylight-cluster-data@10.30.171.228:2550",
04:35:05  				"akka://opendaylight-cluster-data@10.30.170.250:2550",
04:35:05  				"akka://opendaylight-cluster-data@10.30.171.190:2550"]
04:35:05  
04:35:05        roles = ["member-2"]
04:35:05  
04:35:05        # when under load we might trip a false positive on the failure detector
04:35:05        # failure-detector {
04:35:05          # heartbeat-interval = 4 s
04:35:05          # acceptable-heartbeat-pause = 16s
04:35:05        # }
04:35:05      }
04:35:05  
04:35:05      persistence {
04:35:05        # By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by
04:35:05        # modifying the following two properties. The directory location specified may be a relative or absolute path. 
04:35:05        # The relative path is always relative to KARAF_HOME.
04:35:05  
04:35:05        # snapshot-store.local.dir = "target/snapshots"
04:35:05  
04:35:05        # Use lz4 compression for LocalSnapshotStore snapshots
04:35:05        snapshot-store.local.use-lz4-compression = false
04:35:05        # Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB
04:35:05        snapshot-store.local.lz4-blocksize = 256KB
04:35:05      }
04:35:05      disable-default-actor-system-quarantined-event-handling = "false"
04:35:05    }
04:35:05  }
04:35:05  Dump modules.conf
04:35:05  + echo 'Dump modules.conf'
04:35:05  + cat /tmp/karaf-0.20.4/configuration/initial/modules.conf
04:35:05  modules = [
04:35:05  	
04:35:05  	{
04:35:05  		name = "inventory"
04:35:05  		namespace = "urn:opendaylight:inventory"
04:35:05  		shard-strategy = "module"
04:35:05  	},
04:35:05  	{
04:35:05  		name = "topology"
04:35:05  		namespace = "urn:TBD:params:xml:ns:yang:network-topology"
04:35:05  		shard-strategy = "module"
04:35:05  	},
04:35:05  	{
04:35:05  		name = "toaster"
04:35:05  		namespace = "http://netconfcentral.org/ns/toaster"
04:35:05  		shard-strategy = "module"
04:35:05  	}
04:35:05  ]
04:35:05  Dump module-shards.conf
04:35:05  + echo 'Dump module-shards.conf'
04:35:05  + cat /tmp/karaf-0.20.4/configuration/initial/module-shards.conf
04:35:05  module-shards = [
04:35:05  	{
04:35:05  		name = "default"
04:35:05  		shards = [
04:35:05  			{
04:35:05  				name = "default"
04:35:05  				replicas = ["member-1",
04:35:05  				"member-2",
04:35:05  				"member-3"]
04:35:05  			}
04:35:05  		]
04:35:05  	},
04:35:05  	{
04:35:05  		name = "inventory"
04:35:05  		shards = [
04:35:05  			{
04:35:05  				name="inventory"
04:35:05  				replicas = ["member-1",
04:35:05  				"member-2",
04:35:05  				"member-3"]
04:35:05  			}
04:35:05  		]
04:35:05  	},
04:35:05  	{
04:35:05  		name = "topology"
04:35:05  		shards = [
04:35:05  			{
04:35:05  				name="topology"
04:35:05  				replicas = ["member-1",
04:35:05  				"member-2",
04:35:05  				"member-3"]
04:35:05  			}
04:35:05  		]
04:35:05  	},
04:35:05  	{
04:35:05  		name = "toaster"
04:35:05  		shards = [
04:35:05  			{
04:35:05  				name="toaster"
04:35:05  				replicas = ["member-1",
04:35:05  				"member-2",
04:35:05  				"member-3"]
04:35:05  			}
04:35:05  		]
04:35:05  	}
04:35:05  ]
04:35:05  Configuring member-3 with IP address 10.30.171.190
04:35:05  Warning: Permanently added '10.30.171.190' (ECDSA) to the list of known hosts.
04:35:05  Warning: Permanently added '10.30.171.190' (ECDSA) to the list of known hosts.
04:35:05  + source /tmp/common-functions.sh karaf-0.20.4
04:35:05  common-functions.sh is being sourced
04:35:05  ++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]]
04:35:05  ++ echo 'common-functions.sh is being sourced'
04:35:05  ++ BUNDLEFOLDER=karaf-0.20.4
04:35:05  ++ export MAVENCONF=/tmp/karaf-0.20.4/etc/org.ops4j.pax.url.mvn.cfg
04:35:05  ++ MAVENCONF=/tmp/karaf-0.20.4/etc/org.ops4j.pax.url.mvn.cfg
04:35:05  ++ export FEATURESCONF=/tmp/karaf-0.20.4/etc/org.apache.karaf.features.cfg
04:35:05  ++ FEATURESCONF=/tmp/karaf-0.20.4/etc/org.apache.karaf.features.cfg
04:35:05  ++ export CUSTOMPROP=/tmp/karaf-0.20.4/etc/custom.properties
04:35:05  ++ CUSTOMPROP=/tmp/karaf-0.20.4/etc/custom.properties
04:35:05  ++ export LOGCONF=/tmp/karaf-0.20.4/etc/org.ops4j.pax.logging.cfg
04:35:05  ++ LOGCONF=/tmp/karaf-0.20.4/etc/org.ops4j.pax.logging.cfg
04:35:05  ++ export MEMCONF=/tmp/karaf-0.20.4/bin/setenv
04:35:05  ++ MEMCONF=/tmp/karaf-0.20.4/bin/setenv
04:35:05  ++ export CONTROLLERMEM=
04:35:05  ++ CONTROLLERMEM=
04:35:05  ++ export AKKACONF=/tmp/karaf-0.20.4/configuration/initial/akka.conf
04:35:05  ++ AKKACONF=/tmp/karaf-0.20.4/configuration/initial/akka.conf
04:35:05  ++ export MODULESCONF=/tmp/karaf-0.20.4/configuration/initial/modules.conf
04:35:05  ++ MODULESCONF=/tmp/karaf-0.20.4/configuration/initial/modules.conf
04:35:05  ++ export MODULESHARDSCONF=/tmp/karaf-0.20.4/configuration/initial/module-shards.conf
04:35:05  ++ MODULESHARDSCONF=/tmp/karaf-0.20.4/configuration/initial/module-shards.conf
04:35:05  ++ print_common_env
04:35:05  ++ cat
04:35:05  common-functions environment:
04:35:05  MAVENCONF: /tmp/karaf-0.20.4/etc/org.ops4j.pax.url.mvn.cfg
04:35:05  ACTUALFEATURES: 
04:35:05  FEATURESCONF: /tmp/karaf-0.20.4/etc/org.apache.karaf.features.cfg
04:35:05  CUSTOMPROP: /tmp/karaf-0.20.4/etc/custom.properties
04:35:05  LOGCONF: /tmp/karaf-0.20.4/etc/org.ops4j.pax.logging.cfg
04:35:05  MEMCONF: /tmp/karaf-0.20.4/bin/setenv
04:35:05  CONTROLLERMEM: 
04:35:05  AKKACONF: /tmp/karaf-0.20.4/configuration/initial/akka.conf
04:35:05  MODULESCONF: /tmp/karaf-0.20.4/configuration/initial/modules.conf
04:35:05  MODULESHARDSCONF: /tmp/karaf-0.20.4/configuration/initial/module-shards.conf
04:35:05  SUITES: 
04:35:05  
04:35:05  ++ SSH='ssh -t -t'
04:35:05  ++ extra_services_cntl='     dnsmasq.service     httpd.service     libvirtd.service     openvswitch.service     ovs-vswitchd.service     ovsdb-server.service     rabbitmq-server.service '
04:35:05  ++ extra_services_cmp='     libvirtd.service     openvswitch.service     ovs-vswitchd.service     ovsdb-server.service '
04:35:05  Changing to /tmp
04:35:05  Downloading the distribution from https://nexus.opendaylight.org/content/repositories//autorelease-8645/org/opendaylight/integration/karaf/0.20.4/karaf-0.20.4.zip
04:35:05  + echo 'Changing to /tmp'
04:35:05  + cd /tmp
04:35:05  + echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories//autorelease-8645/org/opendaylight/integration/karaf/0.20.4/karaf-0.20.4.zip'
04:35:05  + wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories//autorelease-8645/org/opendaylight/integration/karaf/0.20.4/karaf-0.20.4.zip
04:35:05  --2025-02-25 04:35:05--  https://nexus.opendaylight.org/content/repositories//autorelease-8645/org/opendaylight/integration/karaf/0.20.4/karaf-0.20.4.zip
04:35:05  Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6
04:35:05  Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected.
04:35:05  HTTP request sent, awaiting response... 200 OK
04:35:05  Length: 234139102 (223M) [application/zip]
04:35:05  Saving to: ‘karaf-0.20.4.zip’
04:35:05  
04:35:05       0K ........ ........ ........ ........ ........ ........  1% 68.7M 3s
04:35:05    3072K ........ ........ ........ ........ ........ ........  2%  108M 3s
04:35:05    6144K ........ ........ ........ ........ ........ ........  4%  159M 2s
04:35:05    9216K ........ ........ ........ ........ ........ ........  5%  171M 2s
04:35:06   12288K ........ ........ ........ ........ ........ ........  6%  164M 2s
04:35:06   15360K ........ ........ ........ ........ ........ ........  8%  197M 2s
04:35:06   18432K ........ ........ ........ ........ ........ ........  9%  228M 1s
04:35:06   21504K ........ ........ ........ ........ ........ ........ 10%  129M 1s
04:35:06   24576K ........ ........ ........ ........ ........ ........ 12%  236M 1s
04:35:06   27648K ........ ........ ........ ........ ........ ........ 13%  274M 1s
04:35:06   30720K ........ ........ ........ ........ ........ ........ 14%  293M 1s
04:35:06   33792K ........ ........ ........ ........ ........ ........ 16%  284M 1s
04:35:06   36864K ........ ........ ........ ........ ........ ........ 17%  323M 1s
04:35:06   39936K ........ ........ ........ ........ ........ ........ 18%  314M 1s
04:35:06   43008K ........ ........ ........ ........ ........ ........ 20%  347M 1s
04:35:06   46080K ........ ........ ........ ........ ........ ........ 21%  340M 1s
04:35:06   49152K ........ ........ ........ ........ ........ ........ 22%  352M 1s
04:35:06   52224K ........ ........ ........ ........ ........ ........ 24%  344M 1s
04:35:06   55296K ........ ........ ........ ........ ........ ........ 25%  348M 1s
04:35:06   58368K ........ ........ ........ ........ ........ ........ 26%  353M 1s
04:35:06   61440K ........ ........ ........ ........ ........ ........ 28%  345M 1s
04:35:06   64512K ........ ........ ........ ........ ........ ........ 29%  356M 1s
04:35:06   67584K ........ ........ ........ ........ ........ ........ 30%  350M 1s
04:35:06   70656K ........ ........ ........ ........ ........ ........ 32%  339M 1s
04:35:06   73728K ........ ........ ........ ........ ........ ........ 33%  362M 1s
04:35:06   76800K ........ ........ ........ ........ ........ ........ 34%  330M 1s
04:35:06   79872K ........ ........ ........ ........ ........ ........ 36%  323M 1s
04:35:06   82944K ........ ........ ........ ........ ........ ........ 37%  336M 1s
04:35:06   86016K ........ ........ ........ ........ ........ ........ 38%  334M 1s
04:35:06   89088K ........ ........ ........ ........ ........ ........ 40%  340M 1s
04:35:06   92160K ........ ........ ........ ........ ........ ........ 41%  319M 1s
04:35:06   95232K ........ ........ ........ ........ ........ ........ 42%  270M 1s
04:35:06   98304K ........ ........ ........ ........ ........ ........ 44%  306M 1s
04:35:06  101376K ........ ........ ........ ........ ........ ........ 45%  286M 1s
04:35:06  104448K ........ ........ ........ ........ ........ ........ 47%  313M 0s
04:35:06  107520K ........ ........ ........ ........ ........ ........ 48%  326M 0s
04:35:06  110592K ........ ........ ........ ........ ........ ........ 49%  294M 0s
04:35:06  113664K ........ ........ ........ ........ ........ ........ 51%  299M 0s
04:35:06  116736K ........ ........ ........ ........ ........ ........ 52%  292M 0s
04:35:06  119808K ........ ........ ........ ........ ........ ........ 53%  285M 0s
04:35:06  122880K ........ ........ ........ ........ ........ ........ 55%  282M 0s
04:35:06  125952K ........ ........ ........ ........ ........ ........ 56%  278M 0s
04:35:06  129024K ........ ........ ........ ........ ........ ........ 57%  278M 0s
04:35:06  132096K ........ ........ ........ ........ ........ ........ 59%  274M 0s
04:35:06  135168K ........ ........ ........ ........ ........ ........ 60%  275M 0s
04:35:06  138240K ........ ........ ........ ........ ........ ........ 61%  162M 0s
04:35:06  141312K ........ ........ ........ ........ ........ ........ 63%  263M 0s
04:35:06  144384K ........ ........ ........ ........ ........ ........ 64%  269M 0s
04:35:06  147456K ........ ........ ........ ........ ........ ........ 65%  273M 0s
04:35:06  150528K ........ ........ ........ ........ ........ ........ 67%  263M 0s
04:35:06  153600K ........ ........ ........ ........ ........ ........ 68%  289M 0s
04:35:06  156672K ........ ........ ........ ........ ........ ........ 69%  256M 0s
04:35:06  159744K ........ ........ ........ ........ ........ ........ 71%  267M 0s
04:35:06  162816K ........ ........ ........ ........ ........ ........ 72%  280M 0s
04:35:06  165888K ........ ........ ........ ........ ........ ........ 73%  248M 0s
04:35:06  168960K ........ ........ ........ ........ ........ ........ 75%  266M 0s
04:35:06  172032K ........ ........ ........ ........ ........ ........ 76%  263M 0s
04:35:06  175104K ........ ........ ........ ........ ........ ........ 77%  264M 0s
04:35:06  178176K ........ ........ ........ ........ ........ ........ 79%  263M 0s
04:35:06  181248K ........ ........ ........ ........ ........ ........ 80%  262M 0s
04:35:06  184320K ........ ........ ........ ........ ........ ........ 81%  263M 0s
04:35:06  187392K ........ ........ ........ ........ ........ ........ 83%  259M 0s
04:35:06  190464K ........ ........ ........ ........ ........ ........ 84%  260M 0s
04:35:06  193536K ........ ........ ........ ........ ........ ........ 85%  255M 0s
04:35:06  196608K ........ ........ ........ ........ ........ ........ 87%  258M 0s
04:35:06  199680K ........ ........ ........ ........ ........ ........ 88%  261M 0s
04:35:06  202752K ........ ........ ........ ........ ........ ........ 90%  273M 0s
04:35:06  205824K ........ ........ ........ ........ ........ ........ 91%  250M 0s
04:35:06  208896K ........ ........ ........ ........ ........ ........ 92%  246M 0s
04:35:06  211968K ........ ........ ........ ........ ........ ........ 94%  249M 0s
04:35:06  215040K ........ ........ ........ ........ ........ ........ 95%  254M 0s
04:35:06  218112K ........ ........ ........ ........ ........ ........ 96%  259M 0s
04:35:06  221184K ........ ........ ........ ........ ........ ........ 98%  255M 0s
04:35:06  224256K ........ ........ ........ ........ ........ ........ 99%  205M 0s
04:35:06  227328K ........ ........ ....                               100%  242M=0.9s
04:35:06  
04:35:06  2025-02-25 04:35:06 (253 MB/s) - ‘karaf-0.20.4.zip’ saved [234139102/234139102]
04:35:06  
04:35:06  Extracting the new controller...
04:35:06  + echo 'Extracting the new controller...'
04:35:06  + unzip -q karaf-0.20.4.zip
04:35:08  Adding external repositories...
04:35:08  + echo 'Adding external repositories...'
04:35:08  + sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.20.4/etc/org.ops4j.pax.url.mvn.cfg
04:35:08  + cat /tmp/karaf-0.20.4/etc/org.ops4j.pax.url.mvn.cfg
04:35:08  ################################################################################
04:35:08  #
04:35:08  #    Licensed to the Apache Software Foundation (ASF) under one or more
04:35:08  #    contributor license agreements.  See the NOTICE file distributed with
04:35:08  #    this work for additional information regarding copyright ownership.
04:35:08  #    The ASF licenses this file to You under the Apache License, Version 2.0
04:35:08  #    (the "License"); you may not use this file except in compliance with
04:35:08  #    the License.  You may obtain a copy of the License at
04:35:08  #
04:35:08  #       http://www.apache.org/licenses/LICENSE-2.0
04:35:08  #
04:35:08  #    Unless required by applicable law or agreed to in writing, software
04:35:08  #    distributed under the License is distributed on an "AS IS" BASIS,
04:35:08  #    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
04:35:08  #    See the License for the specific language governing permissions and
04:35:08  #    limitations under the License.
04:35:08  #
04:35:08  ################################################################################
04:35:08  
04:35:08  #
04:35:08  # If set to true, the following property will not allow any certificate to be used
04:35:08  # when accessing Maven repositories through SSL
04:35:08  #
04:35:08  #org.ops4j.pax.url.mvn.certificateCheck=
04:35:08  
04:35:08  #
04:35:08  # Path to the local Maven settings file.
04:35:08  # The repositories defined in this file will be automatically added to the list
04:35:08  # of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property
04:35:08  # below is not set.
04:35:08  # The following locations are checked for the existence of the settings.xml file
04:35:08  #   * 1. looks for the specified url
04:35:08  #   * 2. if not found looks for ${user.home}/.m2/settings.xml
04:35:08  #   * 3. if not found looks for ${maven.home}/conf/settings.xml
04:35:08  #   * 4. if not found looks for ${M2_HOME}/conf/settings.xml
04:35:08  #
04:35:08  #org.ops4j.pax.url.mvn.settings=
04:35:08  
04:35:08  #
04:35:08  # Path to the local Maven repository which is used to avoid downloading
04:35:08  # artifacts when they already exist locally.
04:35:08  # The value of this property will be extracted from the settings.xml file
04:35:08  # above, or defaulted to:
04:35:08  #     System.getProperty( "user.home" ) + "/.m2/repository"
04:35:08  #
04:35:08  org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository}
04:35:08  
04:35:08  #
04:35:08  # Default this to false. It's just weird to use undocumented repos
04:35:08  #
04:35:08  org.ops4j.pax.url.mvn.useFallbackRepositories=false
04:35:08  
04:35:08  #
04:35:08  # Uncomment if you don't wanna use the proxy settings
04:35:08  # from the Maven conf/settings.xml file
04:35:08  #
04:35:08  # org.ops4j.pax.url.mvn.proxySupport=false
04:35:08  
04:35:08  #
04:35:08  # Comma separated list of repositories scanned when resolving an artifact.
04:35:08  # Those repositories will be checked before iterating through the
04:35:08  #    below list of repositories and even before the local repository
04:35:08  # A repository url can be appended with zero or more of the following flags:
04:35:08  #    @snapshots  : the repository contains snaphots
04:35:08  #    @noreleases : the repository does not contain any released artifacts
04:35:08  #
04:35:08  # The following property value will add the system folder as a repo.
04:35:08  #
04:35:08  org.ops4j.pax.url.mvn.defaultRepositories=\
04:35:08      file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\
04:35:08      file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\
04:35:08      file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots
04:35:08  
04:35:08  # Use the default local repo (e.g.~/.m2/repository) as a "remote" repo
04:35:08  #org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false
04:35:08  
04:35:08  #
04:35:08  # Comma separated list of repositories scanned when resolving an artifact.
04:35:08  # The default list includes the following repositories:
04:35:08  #    http://repo1.maven.org/maven2@id=central
04:35:08  #    http://repository.springsource.com/maven/bundles/release@id=spring.ebr
04:35:08  #    http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external
04:35:08  #    http://zodiac.springsource.com/maven/bundles/release@id=gemini
04:35:08  #    http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases
04:35:08  #    https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases
04:35:08  #    https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
04:35:08  # To add repositories to the default ones, prepend '+' to the list of repositories
04:35:08  # to add.
04:35:08  # A repository url can be appended with zero or more of the following flags:
04:35:08  #    @snapshots  : the repository contains snapshots
04:35:08  #    @noreleases : the repository does not contain any released artifacts
04:35:08  #    @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended
04:35:08  #
04:35:08  org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
04:35:08  
04:35:08  ### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.Configuring the startup features...
04:35:08  + [[ True == \T\r\u\e ]]
04:35:08  + echo 'Configuring the startup features...'
04:35:08  + sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-infrautils-ready,odl-jolokia,odl-ovsdb-southbound-impl-rest,/g' /tmp/karaf-0.20.4/etc/org.apache.karaf.features.cfg
04:35:08  + FEATURE_TEST_STRING=features-test
04:35:08  + FEATURE_TEST_VERSION=0.20.4
04:35:08  + KARAF_VERSION=karaf4
04:35:08  + [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]]
04:35:08  + sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.20.4/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.20.4/etc/org.apache.karaf.features.cfg
04:35:08  + [[ ! -z '' ]]
04:35:08  + cat /tmp/karaf-0.20.4/etc/org.apache.karaf.features.cfg
04:35:08  ################################################################################
04:35:08  #
04:35:08  #    Licensed to the Apache Software Foundation (ASF) under one or more
04:35:08  #    contributor license agreements.  See the NOTICE file distributed with
04:35:08  #    this work for additional information regarding copyright ownership.
04:35:08  #    The ASF licenses this file to You under the Apache License, Version 2.0
04:35:08  #    (the "License"); you may not use this file except in compliance with
04:35:08  #    the License.  You may obtain a copy of the License at
04:35:08  #
04:35:08  #       http://www.apache.org/licenses/LICENSE-2.0
04:35:08  #
04:35:08  #    Unless required by applicable law or agreed to in writing, software
04:35:08  #    distributed under the License is distributed on an "AS IS" BASIS,
04:35:08  #    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
04:35:08  #    See the License for the specific language governing permissions and
04:35:08  #    limitations under the License.
04:35:08  #
04:35:08  ################################################################################
04:35:08  
04:35:08  #
04:35:08  # Comma separated list of features repositories to register by default
04:35:08  #
04:35:08  featuresRepositories = mvn:org.opendaylight.integration/features-test/0.20.4/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/290d8cd0-90b7-436d-8e9c-f26d70ee4bd5.xml
04:35:08  
04:35:08  #
04:35:08  # Comma separated list of features to install at startup
04:35:08  #
04:35:08  featuresBoot = odl-infrautils-ready,odl-jolokia,odl-ovsdb-southbound-impl-rest, a1e7a267-4169-4830-a802-e7ef39ca0207
04:35:08  
04:35:08  #
04:35:08  # Resource repositories (OBR) that the features resolver can use
04:35:08  # to resolve requirements/capabilities
04:35:08  #
04:35:08  # The format of the resourceRepositories is 
04:35:08  # resourceRepositories=[xml:url|json:url],...
04:35:08  # for Instance:
04:35:08  #
04:35:08  #resourceRepositories=xml:http://host/path/to/index.xml
04:35:08  # or
04:35:08  #resourceRepositories=json:http://host/path/to/index.json
04:35:08  #
04:35:08  
04:35:08  #
04:35:08  # Defines if the boot features are started in asynchronous mode (in a dedicated thread)
04:35:08  #
04:35:08  featuresBootAsynchronous=false
04:35:08  
04:35:08  #
04:35:08  # Service requirements enforcement
04:35:08  #
04:35:08  # By default, the feature resolver checks the service requirements/capabilities of
04:35:08  # bundles for new features (xml schema >= 1.3.0) in order to automatically installs
04:35:08  # the required bundles.
04:35:08  # The following flag can have those values:
04:35:08  #   - disable: service requirements are completely ignored
04:35:08  #   - default: service requirements are ignored for old features
04:35:08  #   - enforce: service requirements are always verified
04:35:08  #
04:35:08  #serviceRequirements=default
04:35:08  
04:35:08  #
04:35:08  # Store cfg file for config element in feature
04:35:08  #
04:35:08  #configCfgStore=true
04:35:08  
04:35:08  #
04:35:08  # Define if the feature service automatically refresh bundles
04:35:08  #
04:35:08  autoRefresh=true
04:35:08  
04:35:08  #
04:35:08  # Configuration of features processing mechanism (overrides, blacklisting, modification of features)
04:35:08  # XML file defines instructions related to features processing
04:35:08  # versions.properties may declare properties to resolve placeholders in XML file
04:35:08  # both files are relative to ${karaf.etc}
04:35:08  #
04:35:08  #featureProcessing=org.apache.karaf.features.xml
04:35:08  #featureProcessingVersions=versions.properties
04:35:08  + configure_karaf_log karaf4 ''
04:35:08  + local -r karaf_version=karaf4
04:35:08  + local -r controllerdebugmap=
04:35:08  + local logapi=log4j
04:35:08  + grep log4j2 /tmp/karaf-0.20.4/etc/org.ops4j.pax.logging.cfg
04:35:08  log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
04:35:08  log4j2.rootLogger.level = INFO
04:35:08  #log4j2.rootLogger.type = asyncRoot
04:35:08  #log4j2.rootLogger.includeLocation = false
04:35:08  log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
04:35:08  log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
04:35:08  log4j2.rootLogger.appenderRef.Console.ref = Console
04:35:08  log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
04:35:08  log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
04:35:08  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
04:35:08  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
04:35:08  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
04:35:08  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
04:35:08  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
04:35:08  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
04:35:08  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
04:35:08  log4j2.logger.spifly.name = org.apache.aries.spifly
04:35:08  log4j2.logger.spifly.level = WARN
04:35:08  log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
04:35:08  log4j2.logger.audit.level = INFO
04:35:08  log4j2.logger.audit.additivity = false
04:35:08  log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
04:35:08  # Console appender not used by default (see log4j2.rootLogger.appenderRefs)
04:35:08  log4j2.appender.console.type = Console
04:35:08  log4j2.appender.console.name = Console
04:35:08  log4j2.appender.console.layout.type = PatternLayout
04:35:08  log4j2.appender.console.layout.pattern = ${log4j2.pattern}
04:35:08  log4j2.appender.rolling.type = RollingRandomAccessFile
04:35:08  log4j2.appender.rolling.name = RollingFile
04:35:08  log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
04:35:08  log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
04:35:08  #log4j2.appender.rolling.immediateFlush = false
04:35:08  log4j2.appender.rolling.append = true
04:35:08  log4j2.appender.rolling.layout.type = PatternLayout
04:35:08  log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
04:35:08  log4j2.appender.rolling.policies.type = Policies
04:35:08  log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
04:35:08  log4j2.appender.rolling.policies.size.size = 64MB
04:35:08  log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
04:35:08  log4j2.appender.rolling.strategy.max = 7
04:35:08  log4j2.appender.audit.type = RollingRandomAccessFile
04:35:08  log4j2.appender.audit.name = AuditRollingFile
04:35:08  log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
04:35:08  log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
04:35:08  log4j2.appender.audit.append = true
04:35:08  log4j2.appender.audit.layout.type = PatternLayout
04:35:08  log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
04:35:08  log4j2.appender.audit.policies.type = Policies
04:35:08  log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
04:35:08  log4j2.appender.audit.policies.size.size = 8MB
04:35:08  log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
04:35:08  log4j2.appender.audit.strategy.max = 7
04:35:08  log4j2.appender.osgi.type = PaxOsgi
04:35:08  log4j2.appender.osgi.name = PaxOsgi
04:35:08  log4j2.appender.osgi.filter = *
04:35:08  #log4j2.logger.aether.name = shaded.org.eclipse.aether
04:35:08  #log4j2.logger.aether.level = TRACE
04:35:08  #log4j2.logger.http-headers.name = shaded.org.apache.http.headers
04:35:08  #log4j2.logger.http-headers.level = DEBUG
04:35:08  #log4j2.logger.maven.name = org.ops4j.pax.url.mvn
04:35:08  #log4j2.logger.maven.level = TRACE
04:35:08  Configuring the karaf log... karaf_version: karaf4, logapi: log4j2
04:35:08  + logapi=log4j2
04:35:08  + echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2'
04:35:08  + '[' log4j2 == log4j2 ']'
04:35:08  + sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.20.4/etc/org.ops4j.pax.logging.cfg
04:35:08  + orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver
04:35:08  + orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver
04:35:08  + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN'
04:35:08  + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN'
04:35:08  + unset IFS
04:35:08  controllerdebugmap: 
04:35:08  cat /tmp/karaf-0.20.4/etc/org.ops4j.pax.logging.cfg
04:35:08  + echo 'controllerdebugmap: '
04:35:08  + '[' -n '' ']'
04:35:08  + echo 'cat /tmp/karaf-0.20.4/etc/org.ops4j.pax.logging.cfg'
04:35:08  + cat /tmp/karaf-0.20.4/etc/org.ops4j.pax.logging.cfg
04:35:08  ################################################################################
04:35:08  #
04:35:08  #    Licensed to the Apache Software Foundation (ASF) under one or more
04:35:08  #    contributor license agreements.  See the NOTICE file distributed with
04:35:08  #    this work for additional information regarding copyright ownership.
04:35:08  #    The ASF licenses this file to You under the Apache License, Version 2.0
04:35:08  #    (the "License"); you may not use this file except in compliance with
04:35:08  #    the License.  You may obtain a copy of the License at
04:35:08  #
04:35:08  #       http://www.apache.org/licenses/LICENSE-2.0
04:35:08  #
04:35:08  #    Unless required by applicable law or agreed to in writing, software
04:35:08  #    distributed under the License is distributed on an "AS IS" BASIS,
04:35:08  #    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
04:35:08  #    See the License for the specific language governing permissions and
04:35:08  #    limitations under the License.
04:35:08  #
04:35:08  ################################################################################
04:35:08  
04:35:08  # Common pattern layout for appenders
04:35:08  log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
04:35:08  
04:35:08  # Root logger
04:35:08  log4j2.rootLogger.level = INFO
04:35:08  # uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library
04:35:08  #log4j2.rootLogger.type = asyncRoot
04:35:08  #log4j2.rootLogger.includeLocation = false
04:35:08  log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
04:35:08  log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
04:35:08  log4j2.rootLogger.appenderRef.Console.ref = Console
04:35:08  log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
04:35:08  log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
04:35:08  
04:35:08  # Filters for logs marked by org.opendaylight.odlparent.Markers
04:35:08  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
04:35:08  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
04:35:08  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
04:35:08  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
04:35:08  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
04:35:08  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
04:35:08  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
04:35:08  
04:35:08  # Loggers configuration
04:35:08  
04:35:08  # Spifly logger
04:35:08  log4j2.logger.spifly.name = org.apache.aries.spifly
04:35:08  log4j2.logger.spifly.level = WARN
04:35:08  
04:35:08  # Security audit logger
04:35:08  log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
04:35:08  log4j2.logger.audit.level = INFO
04:35:08  log4j2.logger.audit.additivity = false
04:35:08  log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
04:35:08  
04:35:08  # Appenders configuration
04:35:08  
04:35:08  # Console appender not used by default (see log4j2.rootLogger.appenderRefs)
04:35:08  log4j2.appender.console.type = Console
04:35:08  log4j2.appender.console.name = Console
04:35:08  log4j2.appender.console.layout.type = PatternLayout
04:35:08  log4j2.appender.console.layout.pattern = ${log4j2.pattern}
04:35:08  
04:35:08  # Rolling file appender
04:35:08  log4j2.appender.rolling.type = RollingRandomAccessFile
04:35:08  log4j2.appender.rolling.name = RollingFile
04:35:08  log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
04:35:08  log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
04:35:08  # uncomment to not force a disk flush
04:35:08  #log4j2.appender.rolling.immediateFlush = false
04:35:08  log4j2.appender.rolling.append = true
04:35:08  log4j2.appender.rolling.layout.type = PatternLayout
04:35:08  log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
04:35:08  log4j2.appender.rolling.policies.type = Policies
04:35:08  log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
04:35:08  log4j2.appender.rolling.policies.size.size = 1GB
04:35:08  log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
04:35:08  log4j2.appender.rolling.strategy.max = 7
04:35:08  
04:35:08  # Audit file appender
04:35:08  log4j2.appender.audit.type = RollingRandomAccessFile
04:35:08  log4j2.appender.audit.name = AuditRollingFile
04:35:08  log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
04:35:08  log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
04:35:08  log4j2.appender.audit.append = true
04:35:08  log4j2.appender.audit.layout.type = PatternLayout
04:35:08  log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
04:35:08  log4j2.appender.audit.policies.type = Policies
04:35:08  log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
04:35:08  log4j2.appender.audit.policies.size.size = 8MB
04:35:08  log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
04:35:08  log4j2.appender.audit.strategy.max = 7
04:35:08  
04:35:08  # OSGi appender
04:35:08  log4j2.appender.osgi.type = PaxOsgi
04:35:08  log4j2.appender.osgi.name = PaxOsgi
04:35:08  log4j2.appender.osgi.filter = *
04:35:08  
04:35:08  # help with identification of maven-related problems with pax-url-aether
04:35:08  #log4j2.logger.aether.name = shaded.org.eclipse.aether
04:35:08  #log4j2.logger.aether.level = TRACE
04:35:08  #log4j2.logger.http-headers.name = shaded.org.apache.http.headers
04:35:08  #log4j2.logger.http-headers.level = DEBUG
04:35:08  #log4j2.logger.maven.name = org.ops4j.pax.url.mvn
04:35:08  #log4j2.logger.maven.level = TRACE
04:35:08  log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN
04:35:08  log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN
04:35:08  + set_java_vars /usr/lib/jvm/java-17-openjdk-amd64 2048m /tmp/karaf-0.20.4/bin/setenv
04:35:08  + local -r java_home=/usr/lib/jvm/java-17-openjdk-amd64
04:35:08  + local -r controllermem=2048m
04:35:08  Configure
04:35:08      java home: /usr/lib/jvm/java-17-openjdk-amd64
04:35:08  + local -r memconf=/tmp/karaf-0.20.4/bin/setenv
04:35:08  + echo Configure
04:35:08  + echo '    java home: /usr/lib/jvm/java-17-openjdk-amd64'
04:35:08      max memory: 2048m
04:35:08      memconf: /tmp/karaf-0.20.4/bin/setenv
04:35:08  + echo '    max memory: 2048m'
04:35:08  + echo '    memconf: /tmp/karaf-0.20.4/bin/setenv'
04:35:08  + sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk-amd64}%g' /tmp/karaf-0.20.4/bin/setenv
04:35:08  + sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=2048m/g' /tmp/karaf-0.20.4/bin/setenv
04:35:08  cat /tmp/karaf-0.20.4/bin/setenv
04:35:08  + echo 'cat /tmp/karaf-0.20.4/bin/setenv'
04:35:08  + cat /tmp/karaf-0.20.4/bin/setenv
04:35:08  #!/bin/sh
04:35:08  #
04:35:08  #    Licensed to the Apache Software Foundation (ASF) under one or more
04:35:08  #    contributor license agreements.  See the NOTICE file distributed with
04:35:08  #    this work for additional information regarding copyright ownership.
04:35:08  #    The ASF licenses this file to You under the Apache License, Version 2.0
04:35:08  #    (the "License"); you may not use this file except in compliance with
04:35:08  #    the License.  You may obtain a copy of the License at
04:35:08  #
04:35:08  #       http://www.apache.org/licenses/LICENSE-2.0
04:35:08  #
04:35:08  #    Unless required by applicable law or agreed to in writing, software
04:35:08  #    distributed under the License is distributed on an "AS IS" BASIS,
04:35:08  #    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
04:35:08  #    See the License for the specific language governing permissions and
04:35:08  #    limitations under the License.
04:35:08  #
04:35:08  
04:35:08  #
04:35:08  # handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf
04:35:08  # script: client, instance, shell, start, status, stop, karaf
04:35:08  #
04:35:08  # if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then
04:35:08  #   Actions go here...
04:35:08  # fi
04:35:08  
04:35:08  #
04:35:08  # general settings which should be applied for all scripts go here; please keep
04:35:08  # in mind that it is possible that scripts might be executed more than once, e.g.
04:35:08  # in example of the start script where the start script is executed first and the
04:35:08  # karaf script afterwards.
04:35:08  #
04:35:08  
04:35:08  #
04:35:08  # The following section shows the possible configuration options for the default 
04:35:08  # karaf scripts
04:35:08  #
04:35:08  export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk-amd64} # Location of Java installation
04:35:08  # export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration
04:35:08  # export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options
04:35:08  # export EXTRA_JAVA_OPTS # Additional JVM options
04:35:08  # export KARAF_HOME # Karaf home folder
04:35:08  # export KARAF_DATA # Karaf data folder
04:35:08  # export KARAF_BASE # Karaf base folder
04:35:08  # export KARAF_ETC  # Karaf etc  folder
04:35:08  # export KARAF_LOG  # Karaf log  folder
04:35:08  # export KARAF_SYSTEM_OPTS # First citizen Karaf options
04:35:08  # export KARAF_OPTS # Additional available Karaf options
04:35:08  # export KARAF_DEBUG # Enable debug mode
04:35:08  # export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start
04:35:08  # export KARAF_NOROOT # Prevent execution as root if set to true
04:35:08  Set Java version
04:35:08  + echo 'Set Java version'
04:35:08  + sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-17-openjdk-amd64/bin/java 1
04:35:08  sudo: /usr/sbin/alternatives: command not found
04:35:08  + sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-17-openjdk-amd64/bin/java
04:35:08  sudo: /usr/sbin/alternatives: command not found
04:35:08  JDK default version ...
04:35:08  + echo 'JDK default version ...'
04:35:08  + java -version
04:35:09  openjdk version "11.0.25" 2024-10-15
04:35:09  OpenJDK Runtime Environment (build 11.0.25+9-post-Ubuntu-1ubuntu120.04)
04:35:09  OpenJDK 64-Bit Server VM (build 11.0.25+9-post-Ubuntu-1ubuntu120.04, mixed mode, sharing)
04:35:09  Set JAVA_HOME
04:35:09  + echo 'Set JAVA_HOME'
04:35:09  + export JAVA_HOME=/usr/lib/jvm/java-17-openjdk-amd64
04:35:09  + JAVA_HOME=/usr/lib/jvm/java-17-openjdk-amd64
04:35:09  ++ readlink -e /usr/lib/jvm/java-17-openjdk-amd64/bin/java
04:35:09  Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-amd64/bin/java
04:35:09  + JAVA_RESOLVED=/usr/lib/jvm/java-17-openjdk-amd64/bin/java
04:35:09  + echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-amd64/bin/java'
04:35:09  Listing all open ports on controller system...
04:35:09  + echo 'Listing all open ports on controller system...'
04:35:09  + netstat -pnatu
04:35:09  /tmp/configuration-script.sh: line 40: netstat: command not found
04:35:09  Configuring cluster
04:35:09  + '[' -f /tmp/custom_shard_config.txt ']'
04:35:09  + echo 'Configuring cluster'
04:35:09  + /tmp/karaf-0.20.4/bin/configure_cluster.sh 3 10.30.171.228 10.30.170.250 10.30.171.190
04:35:09  ################################################
04:35:09  ##             Configure Cluster              ##
04:35:09  ################################################
04:35:09   NOTE: Cluster configuration files not found. Copying from
04:35:09   /tmp/karaf-0.20.4/system/org/opendaylight/controller/sal-clustering-config/9.0.6
04:35:09  Configuring unique name in akka.conf
04:35:09  Configuring hostname in akka.conf
04:35:09  Configuring data and rpc seed nodes in akka.conf
04:35:09  modules = [
04:35:09  	
04:35:09  	{
04:35:09  		name = "inventory"
04:35:09  		namespace = "urn:opendaylight:inventory"
04:35:09  		shard-strategy = "module"
04:35:09  	},
04:35:09  	{
04:35:09  		name = "topology"
04:35:09  		namespace = "urn:TBD:params:xml:ns:yang:network-topology"
04:35:09  		shard-strategy = "module"
04:35:09  	},
04:35:09  	{
04:35:09  		name = "toaster"
04:35:09  		namespace = "http://netconfcentral.org/ns/toaster"
04:35:09  		shard-strategy = "module"
04:35:09  	}
04:35:09  ]
04:35:09  Configuring replication type in module-shards.conf
04:35:09  ################################################
04:35:09  ##   NOTE: Manually restart controller to     ##
04:35:09  ##         apply configuration.               ##
04:35:09  ################################################
04:35:09  Dump akka.conf
04:35:09  + echo 'Dump akka.conf'
04:35:09  + cat /tmp/karaf-0.20.4/configuration/initial/akka.conf
04:35:09  
04:35:09  odl-cluster-data {
04:35:09    akka {
04:35:09      remote {
04:35:09        artery {
04:35:09          enabled = on
04:35:09          transport = tcp
04:35:09          canonical.hostname = "10.30.171.190"
04:35:09          canonical.port = 2550
04:35:09        }
04:35:09      }
04:35:09  
04:35:09      cluster {
04:35:09        # Using artery.
04:35:09        seed-nodes = ["akka://opendaylight-cluster-data@10.30.171.228:2550",
04:35:09  				"akka://opendaylight-cluster-data@10.30.170.250:2550",
04:35:09  				"akka://opendaylight-cluster-data@10.30.171.190:2550"]
04:35:09  
04:35:09        roles = ["member-3"]
04:35:09  
04:35:09        # when under load we might trip a false positive on the failure detector
04:35:09        # failure-detector {
04:35:09          # heartbeat-interval = 4 s
04:35:09          # acceptable-heartbeat-pause = 16s
04:35:09        # }
04:35:09      }
04:35:09  
04:35:09      persistence {
04:35:09        # By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by
04:35:09        # modifying the following two properties. The directory location specified may be a relative or absolute path. 
04:35:09        # The relative path is always relative to KARAF_HOME.
04:35:09  
04:35:09        # snapshot-store.local.dir = "target/snapshots"
04:35:09  
04:35:09        # Use lz4 compression for LocalSnapshotStore snapshots
04:35:09        snapshot-store.local.use-lz4-compression = false
04:35:09        # Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB
04:35:09        snapshot-store.local.lz4-blocksize = 256KB
04:35:09      }
04:35:09      disable-default-actor-system-quarantined-event-handling = "false"
04:35:09    }
04:35:09  }
04:35:09  Dump modules.conf
04:35:09  + echo 'Dump modules.conf'
04:35:09  + cat /tmp/karaf-0.20.4/configuration/initial/modules.conf
04:35:09  modules = [
04:35:09  	
04:35:09  	{
04:35:09  		name = "inventory"
04:35:09  		namespace = "urn:opendaylight:inventory"
04:35:09  		shard-strategy = "module"
04:35:09  	},
04:35:09  	{
04:35:09  		name = "topology"
04:35:09  		namespace = "urn:TBD:params:xml:ns:yang:network-topology"
04:35:09  		shard-strategy = "module"
04:35:09  	},
04:35:09  	{
04:35:09  		name = "toaster"
04:35:09  		namespace = "http://netconfcentral.org/ns/toaster"
04:35:09  		shard-strategy = "module"
04:35:09  	}
04:35:09  ]
04:35:09  Dump module-shards.conf
04:35:09  + echo 'Dump module-shards.conf'
04:35:09  + cat /tmp/karaf-0.20.4/configuration/initial/module-shards.conf
04:35:09  module-shards = [
04:35:09  	{
04:35:09  		name = "default"
04:35:09  		shards = [
04:35:09  			{
04:35:09  				name = "default"
04:35:09  				replicas = ["member-1",
04:35:09  				"member-2",
04:35:09  				"member-3"]
04:35:09  			}
04:35:09  		]
04:35:09  	},
04:35:09  	{
04:35:09  		name = "inventory"
04:35:09  		shards = [
04:35:09  			{
04:35:09  				name="inventory"
04:35:09  				replicas = ["member-1",
04:35:09  				"member-2",
04:35:09  				"member-3"]
04:35:09  			}
04:35:09  		]
04:35:09  	},
04:35:09  	{
04:35:09  		name = "topology"
04:35:09  		shards = [
04:35:09  			{
04:35:09  				name="topology"
04:35:09  				replicas = ["member-1",
04:35:09  				"member-2",
04:35:09  				"member-3"]
04:35:09  			}
04:35:09  		]
04:35:09  	},
04:35:09  	{
04:35:09  		name = "toaster"
04:35:09  		shards = [
04:35:09  			{
04:35:09  				name="toaster"
04:35:09  				replicas = ["member-1",
04:35:09  				"member-2",
04:35:09  				"member-3"]
04:35:09  			}
04:35:09  		]
04:35:09  	}
04:35:09  ]
04:35:09  Locating config plan to use...
04:35:09  Finished running config plans
04:35:09  Starting member-1 with IP address 10.30.171.228
04:35:09  Warning: Permanently added '10.30.171.228' (ECDSA) to the list of known hosts.
04:35:09  Warning: Permanently added '10.30.171.228' (ECDSA) to the list of known hosts.
04:35:09  Redirecting karaf console output to karaf_console.log
04:35:09  Starting controller...
04:35:09  start: Redirecting Karaf output to /tmp/karaf-0.20.4/data/log/karaf_console.log
04:35:09  Starting member-2 with IP address 10.30.170.250
04:35:09  Warning: Permanently added '10.30.170.250' (ECDSA) to the list of known hosts.
04:35:10  Warning: Permanently added '10.30.170.250' (ECDSA) to the list of known hosts.
04:35:10  Redirecting karaf console output to karaf_console.log
04:35:10  Starting controller...
04:35:10  start: Redirecting Karaf output to /tmp/karaf-0.20.4/data/log/karaf_console.log
04:35:10  Starting member-3 with IP address 10.30.171.190
04:35:10  Warning: Permanently added '10.30.171.190' (ECDSA) to the list of known hosts.
04:35:10  Warning: Permanently added '10.30.171.190' (ECDSA) to the list of known hosts.
04:35:10  Redirecting karaf console output to karaf_console.log
04:35:10  Starting controller...
04:35:10  start: Redirecting Karaf output to /tmp/karaf-0.20.4/data/log/karaf_console.log
04:35:10  [ovsdb-csit-3node-upstream-clustering-only-calcium] $ /bin/bash /tmp/jenkins10656387680960021635.sh
04:35:10  common-functions.sh is being sourced
04:35:10  common-functions environment:
04:35:10  MAVENCONF: /tmp/karaf-0.20.4/etc/org.ops4j.pax.url.mvn.cfg
04:35:10  ACTUALFEATURES: 
04:35:10  FEATURESCONF: /tmp/karaf-0.20.4/etc/org.apache.karaf.features.cfg
04:35:10  CUSTOMPROP: /tmp/karaf-0.20.4/etc/custom.properties
04:35:10  LOGCONF: /tmp/karaf-0.20.4/etc/org.ops4j.pax.logging.cfg
04:35:10  MEMCONF: /tmp/karaf-0.20.4/bin/setenv
04:35:10  CONTROLLERMEM: 2048m
04:35:10  AKKACONF: /tmp/karaf-0.20.4/configuration/initial/akka.conf
04:35:10  MODULESCONF: /tmp/karaf-0.20.4/configuration/initial/modules.conf
04:35:10  MODULESHARDSCONF: /tmp/karaf-0.20.4/configuration/initial/module-shards.conf
04:35:10  SUITES: 
04:35:10  
04:35:10  + echo '#################################################'
04:35:10  #################################################
04:35:10  + echo '##         Verify Cluster is UP                ##'
04:35:10  ##         Verify Cluster is UP                ##
04:35:10  + echo '#################################################'
04:35:10  #################################################
04:35:10  + create_post_startup_script
04:35:10  + cat
04:35:10  + copy_and_run_post_startup_script
04:35:10  + seed_index=1
04:35:10  ++ seq 1 3
04:35:10  + for i in $(seq 1 "${NUM_ODL_SYSTEM}")
04:35:10  + CONTROLLERIP=ODL_SYSTEM_1_IP
04:35:10  + echo 'Execute the post startup script on controller 10.30.171.228'
04:35:10  Execute the post startup script on controller 10.30.171.228
04:35:10  + scp /w/workspace/ovsdb-csit-3node-upstream-clustering-only-calcium/post-startup-script.sh 10.30.171.228:/tmp/
04:35:10  Warning: Permanently added '10.30.171.228' (ECDSA) to the list of known hosts.
04:35:11  + ssh 10.30.171.228 'bash /tmp/post-startup-script.sh 1'
04:35:11  Warning: Permanently added '10.30.171.228' (ECDSA) to the list of known hosts.
04:35:11  /tmp/post-startup-script.sh: line 4: netstat: command not found
04:35:16  /tmp/post-startup-script.sh: line 4: netstat: command not found
04:35:21  /tmp/post-startup-script.sh: line 4: netstat: command not found
04:35:26  /tmp/post-startup-script.sh: line 4: netstat: command not found
04:35:31  /tmp/post-startup-script.sh: line 4: netstat: command not found
04:35:36  /tmp/post-startup-script.sh: line 4: netstat: command not found
04:35:41  /tmp/post-startup-script.sh: line 4: netstat: command not found
04:35:46  /tmp/post-startup-script.sh: line 4: netstat: command not found
04:35:51  /tmp/post-startup-script.sh: line 4: netstat: command not found
04:35:56  /tmp/post-startup-script.sh: line 4: netstat: command not found
04:36:01  /tmp/post-startup-script.sh: line 4: netstat: command not found
04:36:06  /tmp/post-startup-script.sh: line 4: netstat: command not found
04:36:11  Waiting up to 3 minutes for controller to come up, checking every 5 seconds...
04:36:16  2025-02-25T04:35:43,806 | INFO  | SystemReadyService-0 | SimpleSystemReadyMonitor         | 210 - org.opendaylight.infrautils.ready-api - 6.0.11 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
04:36:16  Controller is UP
04:36:16  2025-02-25T04:35:43,806 | INFO  | SystemReadyService-0 | SimpleSystemReadyMonitor         | 210 - org.opendaylight.infrautils.ready-api - 6.0.11 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
04:36:16  Listing all open ports on controller system...
04:36:16  /tmp/post-startup-script.sh: line 51: netstat: command not found
04:36:16  looking for "BindException: Address already in use" in log file
04:36:16  looking for "server is unhealthy" in log file
04:36:16  + '[' 1 == 0 ']'
04:36:16  + for i in $(seq 1 "${NUM_ODL_SYSTEM}")
04:36:16  + CONTROLLERIP=ODL_SYSTEM_2_IP
04:36:16  + echo 'Execute the post startup script on controller 10.30.170.250'
04:36:16  Execute the post startup script on controller 10.30.170.250
04:36:16  + scp /w/workspace/ovsdb-csit-3node-upstream-clustering-only-calcium/post-startup-script.sh 10.30.170.250:/tmp/
04:36:16  Warning: Permanently added '10.30.170.250' (ECDSA) to the list of known hosts.
04:36:17  + ssh 10.30.170.250 'bash /tmp/post-startup-script.sh 2'
04:36:17  Warning: Permanently added '10.30.170.250' (ECDSA) to the list of known hosts.
04:36:17  /tmp/post-startup-script.sh: line 4: netstat: command not found
04:36:22  /tmp/post-startup-script.sh: line 4: netstat: command not found
04:36:27  /tmp/post-startup-script.sh: line 4: netstat: command not found
04:36:32  /tmp/post-startup-script.sh: line 4: netstat: command not found
04:36:37  /tmp/post-startup-script.sh: line 4: netstat: command not found
04:36:42  /tmp/post-startup-script.sh: line 4: netstat: command not found
04:36:47  /tmp/post-startup-script.sh: line 4: netstat: command not found
04:36:52  /tmp/post-startup-script.sh: line 4: netstat: command not found
04:36:57  /tmp/post-startup-script.sh: line 4: netstat: command not found
04:37:02  /tmp/post-startup-script.sh: line 4: netstat: command not found
04:37:07  /tmp/post-startup-script.sh: line 4: netstat: command not found
04:37:13  /tmp/post-startup-script.sh: line 4: netstat: command not found
04:37:17  Waiting up to 3 minutes for controller to come up, checking every 5 seconds...
04:37:22  2025-02-25T04:35:44,194 | INFO  | SystemReadyService-0 | SimpleSystemReadyMonitor         | 210 - org.opendaylight.infrautils.ready-api - 6.0.11 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
04:37:22  Controller is UP
04:37:22  2025-02-25T04:35:44,194 | INFO  | SystemReadyService-0 | SimpleSystemReadyMonitor         | 210 - org.opendaylight.infrautils.ready-api - 6.0.11 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
04:37:22  Listing all open ports on controller system...
04:37:22  /tmp/post-startup-script.sh: line 51: netstat: command not found
04:37:22  looking for "BindException: Address already in use" in log file
04:37:22  looking for "server is unhealthy" in log file
04:37:22  + '[' 2 == 0 ']'
04:37:22  + for i in $(seq 1 "${NUM_ODL_SYSTEM}")
04:37:22  + CONTROLLERIP=ODL_SYSTEM_3_IP
04:37:22  + echo 'Execute the post startup script on controller 10.30.171.190'
04:37:22  Execute the post startup script on controller 10.30.171.190
04:37:22  + scp /w/workspace/ovsdb-csit-3node-upstream-clustering-only-calcium/post-startup-script.sh 10.30.171.190:/tmp/
04:37:22  Warning: Permanently added '10.30.171.190' (ECDSA) to the list of known hosts.
04:37:22  + ssh 10.30.171.190 'bash /tmp/post-startup-script.sh 3'
04:37:22  Warning: Permanently added '10.30.171.190' (ECDSA) to the list of known hosts.
04:37:23  /tmp/post-startup-script.sh: line 4: netstat: command not found
04:37:28  /tmp/post-startup-script.sh: line 4: netstat: command not found
04:37:33  /tmp/post-startup-script.sh: line 4: netstat: command not found
04:37:38  /tmp/post-startup-script.sh: line 4: netstat: command not found
04:37:43  /tmp/post-startup-script.sh: line 4: netstat: command not found
04:37:48  /tmp/post-startup-script.sh: line 4: netstat: command not found
04:37:53  /tmp/post-startup-script.sh: line 4: netstat: command not found
04:37:58  /tmp/post-startup-script.sh: line 4: netstat: command not found
04:38:03  /tmp/post-startup-script.sh: line 4: netstat: command not found
04:38:08  /tmp/post-startup-script.sh: line 4: netstat: command not found
04:38:13  /tmp/post-startup-script.sh: line 4: netstat: command not found
04:38:18  /tmp/post-startup-script.sh: line 4: netstat: command not found
04:38:23  Waiting up to 3 minutes for controller to come up, checking every 5 seconds...
04:38:28  2025-02-25T04:35:43,292 | INFO  | SystemReadyService-0 | SimpleSystemReadyMonitor         | 210 - org.opendaylight.infrautils.ready-api - 6.0.11 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
04:38:28  Controller is UP
04:38:28  2025-02-25T04:35:43,292 | INFO  | SystemReadyService-0 | SimpleSystemReadyMonitor         | 210 - org.opendaylight.infrautils.ready-api - 6.0.11 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
04:38:28  Listing all open ports on controller system...
04:38:28  /tmp/post-startup-script.sh: line 51: netstat: command not found
04:38:28  looking for "BindException: Address already in use" in log file
04:38:28  looking for "server is unhealthy" in log file
04:38:28  + '[' 0 == 0 ']'
04:38:28  + seed_index=1
04:38:28  + dump_controller_threads
04:38:28  ++ seq 1 3
04:38:28  + for i in $(seq 1 "${NUM_ODL_SYSTEM}")
04:38:28  + CONTROLLERIP=ODL_SYSTEM_1_IP
04:38:28  + echo 'Let'\''s take the karaf thread dump'
04:38:28  Let's take the karaf thread dump
04:38:28  + ssh 10.30.171.228 'sudo ps aux'
04:38:28  Warning: Permanently added '10.30.171.228' (ECDSA) to the list of known hosts.
04:38:28  ++ grep org.apache.karaf.main.Main /w/workspace/ovsdb-csit-3node-upstream-clustering-only-calcium/ps_before.log
04:38:28  ++ grep -v grep
04:38:28  ++ tr -s ' '
04:38:28  ++ cut -f2 '-d '
04:38:28  + pid=28718
04:38:28  + echo 'karaf main: org.apache.karaf.main.Main, pid:28718'
04:38:28  karaf main: org.apache.karaf.main.Main, pid:28718
04:38:28  + ssh 10.30.171.228 '/usr/lib/jvm/java-17-openjdk-amd64/bin/jstack -l 28718'
04:38:28  Warning: Permanently added '10.30.171.228' (ECDSA) to the list of known hosts.
04:38:29  + for i in $(seq 1 "${NUM_ODL_SYSTEM}")
04:38:29  + CONTROLLERIP=ODL_SYSTEM_2_IP
04:38:29  + echo 'Let'\''s take the karaf thread dump'
04:38:29  Let's take the karaf thread dump
04:38:29  + ssh 10.30.170.250 'sudo ps aux'
04:38:29  Warning: Permanently added '10.30.170.250' (ECDSA) to the list of known hosts.
04:38:29  ++ tr -s ' '
04:38:29  ++ grep org.apache.karaf.main.Main /w/workspace/ovsdb-csit-3node-upstream-clustering-only-calcium/ps_before.log
04:38:29  ++ grep -v grep
04:38:29  ++ cut -f2 '-d '
04:38:29  + pid=28743
04:38:29  + echo 'karaf main: org.apache.karaf.main.Main, pid:28743'
04:38:29  karaf main: org.apache.karaf.main.Main, pid:28743
04:38:29  + ssh 10.30.170.250 '/usr/lib/jvm/java-17-openjdk-amd64/bin/jstack -l 28743'
04:38:29  Warning: Permanently added '10.30.170.250' (ECDSA) to the list of known hosts.
04:38:30  + for i in $(seq 1 "${NUM_ODL_SYSTEM}")
04:38:30  + CONTROLLERIP=ODL_SYSTEM_3_IP
04:38:30  + echo 'Let'\''s take the karaf thread dump'
04:38:30  Let's take the karaf thread dump
04:38:30  + ssh 10.30.171.190 'sudo ps aux'
04:38:30  Warning: Permanently added '10.30.171.190' (ECDSA) to the list of known hosts.
04:38:31  ++ grep org.apache.karaf.main.Main /w/workspace/ovsdb-csit-3node-upstream-clustering-only-calcium/ps_before.log
04:38:31  ++ grep -v grep
04:38:31  ++ cut -f2 '-d '
04:38:31  ++ tr -s ' '
04:38:31  + pid=28745
04:38:31  + echo 'karaf main: org.apache.karaf.main.Main, pid:28745'
04:38:31  karaf main: org.apache.karaf.main.Main, pid:28745
04:38:31  + ssh 10.30.171.190 '/usr/lib/jvm/java-17-openjdk-amd64/bin/jstack -l 28745'
04:38:31  Warning: Permanently added '10.30.171.190' (ECDSA) to the list of known hosts.
04:38:31  + '[' 0 -gt 0 ']'
04:38:31  + echo 'Generating controller variables...'
04:38:31  Generating controller variables...
04:38:31  ++ seq 1 3
04:38:31  + for i in $(seq 1 "${NUM_ODL_SYSTEM}")
04:38:31  + CONTROLLERIP=ODL_SYSTEM_1_IP
04:38:31  + odl_variables=' -v ODL_SYSTEM_1_IP:10.30.171.228'
04:38:31  + for i in $(seq 1 "${NUM_ODL_SYSTEM}")
04:38:31  + CONTROLLERIP=ODL_SYSTEM_2_IP
04:38:31  + odl_variables=' -v ODL_SYSTEM_1_IP:10.30.171.228 -v ODL_SYSTEM_2_IP:10.30.170.250'
04:38:31  + for i in $(seq 1 "${NUM_ODL_SYSTEM}")
04:38:31  + CONTROLLERIP=ODL_SYSTEM_3_IP
04:38:31  + odl_variables=' -v ODL_SYSTEM_1_IP:10.30.171.228 -v ODL_SYSTEM_2_IP:10.30.170.250 -v ODL_SYSTEM_3_IP:10.30.171.190'
04:38:31  + echo 'Generating mininet variables...'
04:38:31  Generating mininet variables...
04:38:31  ++ seq 1 1
04:38:31  + for i in $(seq 1 "${NUM_TOOLS_SYSTEM}")
04:38:31  + MININETIP=TOOLS_SYSTEM_1_IP
04:38:31  + tools_variables=' -v TOOLS_SYSTEM_1_IP:10.30.171.177'
04:38:31  + get_test_suites SUITES
04:38:31  + local __suite_list=SUITES
04:38:31  + echo 'Locating test plan to use...'
04:38:31  Locating test plan to use...
04:38:31  + testplan_filepath=/w/workspace/ovsdb-csit-3node-upstream-clustering-only-calcium/test/csit/testplans/ovsdb-upstream-clustering-calcium.txt
04:38:31  + '[' '!' -f /w/workspace/ovsdb-csit-3node-upstream-clustering-only-calcium/test/csit/testplans/ovsdb-upstream-clustering-calcium.txt ']'
04:38:31  + testplan_filepath=/w/workspace/ovsdb-csit-3node-upstream-clustering-only-calcium/test/csit/testplans/ovsdb-upstream-clustering.txt
04:38:31  + '[' disabled '!=' disabled ']'
04:38:31  + echo 'Changing the testplan path...'
04:38:31  Changing the testplan path...
04:38:31  + sed s:integration:/w/workspace/ovsdb-csit-3node-upstream-clustering-only-calcium: /w/workspace/ovsdb-csit-3node-upstream-clustering-only-calcium/test/csit/testplans/ovsdb-upstream-clustering.txt
04:38:31  + cat testplan.txt
04:38:31  # Place the suites in run order:
04:38:31  /w/workspace/ovsdb-csit-3node-upstream-clustering-only-calcium/test/csit/suites/ovsdb/Southbound_Cluster
04:38:31  /w/workspace/ovsdb-csit-3node-upstream-clustering-only-calcium/test/csit/suites/ovsdb/Southbound_Cluster
04:38:31  + '[' -z '' ']'
04:38:31  ++ grep -E -v '(^[[:space:]]*#|^[[:space:]]*$)' testplan.txt
04:38:31  ++ tr '\012' ' '
04:38:31  + suite_list='/w/workspace/ovsdb-csit-3node-upstream-clustering-only-calcium/test/csit/suites/ovsdb/Southbound_Cluster /w/workspace/ovsdb-csit-3node-upstream-clustering-only-calcium/test/csit/suites/ovsdb/Southbound_Cluster '
04:38:31  + eval 'SUITES='\''/w/workspace/ovsdb-csit-3node-upstream-clustering-only-calcium/test/csit/suites/ovsdb/Southbound_Cluster /w/workspace/ovsdb-csit-3node-upstream-clustering-only-calcium/test/csit/suites/ovsdb/Southbound_Cluster '\'''
04:38:31  ++ SUITES='/w/workspace/ovsdb-csit-3node-upstream-clustering-only-calcium/test/csit/suites/ovsdb/Southbound_Cluster /w/workspace/ovsdb-csit-3node-upstream-clustering-only-calcium/test/csit/suites/ovsdb/Southbound_Cluster '
04:38:31  + echo 'Starting Robot test suites /w/workspace/ovsdb-csit-3node-upstream-clustering-only-calcium/test/csit/suites/ovsdb/Southbound_Cluster /w/workspace/ovsdb-csit-3node-upstream-clustering-only-calcium/test/csit/suites/ovsdb/Southbound_Cluster  ...'
04:38:31  Starting Robot test suites /w/workspace/ovsdb-csit-3node-upstream-clustering-only-calcium/test/csit/suites/ovsdb/Southbound_Cluster /w/workspace/ovsdb-csit-3node-upstream-clustering-only-calcium/test/csit/suites/ovsdb/Southbound_Cluster  ...
04:38:31  + robot -N ovsdb-upstream-clustering.txt --removekeywords wuks -e exclude -e skip_if_calcium -v BUNDLEFOLDER:karaf-0.20.4 -v BUNDLE_URL:https://nexus.opendaylight.org/content/repositories//autorelease-8645/org/opendaylight/integration/karaf/0.20.4/karaf-0.20.4.zip -v CONTROLLER:10.30.171.228 -v CONTROLLER1:10.30.170.250 -v CONTROLLER2:10.30.171.190 -v CONTROLLER_USER:jenkins -v JAVA_HOME:/usr/lib/jvm/java-17-openjdk-amd64 -v JDKVERSION:openjdk17 -v JENKINS_WORKSPACE:/w/workspace/ovsdb-csit-3node-upstream-clustering-only-calcium -v MININET:10.30.171.177 -v MININET1: -v MININET2: -v MININET_USER:jenkins -v NEXUSURL_PREFIX:https://nexus.opendaylight.org -v NUM_ODL_SYSTEM:3 -v NUM_TOOLS_SYSTEM:1 -v ODL_STREAM:calcium -v ODL_SYSTEM_IP:10.30.171.228 -v ODL_SYSTEM_1_IP:10.30.171.228 -v ODL_SYSTEM_2_IP:10.30.170.250 -v ODL_SYSTEM_3_IP:10.30.171.190 -v ODL_SYSTEM_USER:jenkins -v TOOLS_SYSTEM_IP:10.30.171.177 -v TOOLS_SYSTEM_1_IP:10.30.171.177 -v TOOLS_SYSTEM_USER:jenkins -v USER_HOME:/home/jenkins -v IS_KARAF_APPL:True -v WORKSPACE:/tmp /w/workspace/ovsdb-csit-3node-upstream-clustering-only-calcium/test/csit/suites/ovsdb/Southbound_Cluster /w/workspace/ovsdb-csit-3node-upstream-clustering-only-calcium/test/csit/suites/ovsdb/Southbound_Cluster
04:38:32  ==============================================================================
04:38:32  ovsdb-upstream-clustering.txt                                                 
04:38:32  ==============================================================================
04:38:32  ovsdb-upstream-clustering.txt.Southbound Cluster                              
04:38:32  ==============================================================================
04:38:32  ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster :...
04:38:32  ==============================================================================
04:38:37  Check Shards Status Before Fail :: Check Status for all shards in ... | PASS |
04:38:46  ------------------------------------------------------------------------------
04:38:46  Start OVS Multiple Connections :: Connect OVS to all cluster insta... | PASS |
04:38:53  ------------------------------------------------------------------------------
04:38:53  Check Entity Owner Status And Find Owner and Candidate Before Fail... | PASS |
04:38:53  ------------------------------------------------------------------------------
04:38:53  Create Bridge Manually and Verify Before Fail :: Create bridge wit... | PASS |
04:38:55  ------------------------------------------------------------------------------
04:38:55  Add Port Manually and Verify Before Fail :: Add port with OVS comm... | PASS |
04:38:56  ------------------------------------------------------------------------------
04:38:56  Create Tap Device Before Fail :: Create tap devices to add to the ... | PASS |
04:38:58  ------------------------------------------------------------------------------
04:38:58  Add Tap Device Manually and Verify Before Fail :: Add tap devices ... | PASS |
04:38:59  ------------------------------------------------------------------------------
04:38:59  Delete the Bridge Manually and Verify Before Fail :: Delete bridge... | PASS |
04:39:00  ------------------------------------------------------------------------------
04:39:00  Create Bridge In Owner and Verify Before Fail :: Create Bridge in ... | FAIL |
04:39:11  Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 10 seconds. The last error was: '{"network-topology:node":[{"node-id":"ovsdb://uuid/548ac92b-69d7-4d67-8018-8c0c339a56f8","ovsdb:db-version":"8.3.0","ovsdb:interface-type-entry":[{"interface-type":"ovsdb:interface-type-vxlan"},{"interface-type":"ovsdb:interface-type-tap"},{"interface-type":"ovsdb:interface-type-stt"},{"interface-type":"ovsdb:interface-type-internal"},{"interface-type":"ovsdb:interface-type-patch"},{"interface-type":"ovsdb:interface-type-lisp"},{"interface-type":"ovsdb:interface-type-geneve"},{"interface-type":"ovsdb:interface-type-gre"},{"interface-type":"ovsdb:interface-type-system"}],"ovsdb:ovs-version":"2.17.11","ovsdb:connection-info":{"local-port":6640,"remote-port":38848,"local-ip":"10.30.171.228","remote-ip":"10.30.171.177"},"ovsdb:openvswitch-external-ids":[{"external-id-key":"system-id","external-id-value":"4cb0bfbc-0bc4-4591-8cc9-bc6146d75221"},{"external-id-key":"hostname","external-id-value":"ubuntu-22-04-mininet-ovs-217-5ebb25bd-57cf-4a0a-aab5-227d5bff4b"},{"external-id-key":"rundir","external-id-value":"/var/run/openvswitch"}],"ovsdb:datapath-type-entry":[{"datapath-type":"ovsdb:datapath-type-netdev"},{"datapath-type":"ovsdb:datapath-type-system"}],"ovsdb:manager-entry":[{"target":"tcp:10.30.171.190:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.171.228:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.250:6640","number_of_connections":1,"connected":true}]}]}' contains 'br01' 0 times, not 1 time.
04:39:11  ------------------------------------------------------------------------------
04:39:11  Create Port In Owner and Verify Before Fail :: Create Port in Owne... | FAIL |
04:39:22  Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 10 seconds. The last error was: HTTPError: 409 Client Error: Conflict for url: http://10.30.171.228:8181/rests/data/network-topology:network-topology/topology=ovsdb%3A1/node=ovsdb%3A%2F%2Fuuid%2F548ac92b-69d7-4d67-8018-8c0c339a56f8%2Fbridge%2Fbr01/termination-point=vx2?content=nonconfig
04:39:22  ------------------------------------------------------------------------------
04:39:22  Modify the destination IP of Port In Owner Before Fail :: Modify t... | PASS |
04:39:22  ------------------------------------------------------------------------------
04:39:22  Verify Port Is Modified Before Fail :: Verify port is modified in ... | FAIL |
04:39:28  Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: HTTPError: 409 Client Error: Conflict for url: http://10.30.171.228:8181/rests/data/network-topology:network-topology/topology=ovsdb%3A1/node=ovsdb%3A%2F%2Fuuid%2F548ac92b-69d7-4d67-8018-8c0c339a56f8%2Fbridge%2Fbr01?content=nonconfig
04:39:28  ------------------------------------------------------------------------------
04:39:28  Delete Port In Owner Before Fail :: Delete port in Owner and verif... | PASS |
04:39:29  ------------------------------------------------------------------------------
04:39:29  Delete Bridge In Owner And Verify Before Fail :: Delete bridge in ... | PASS |
04:39:30  ------------------------------------------------------------------------------
04:39:30  Kill Owner Instance :: Kill Owner Instance and verify it is dead      | PASS |
04:39:34  ------------------------------------------------------------------------------
04:39:34  Check Shards Status After Fail :: Create original cluster list and... | PASS |
04:39:46  ------------------------------------------------------------------------------
04:39:46  Check Entity Owner Status And Find Owner and Candidate After Fail ... | PASS |
04:39:50  ------------------------------------------------------------------------------
04:39:50  Create Bridge Manually and Verify After Fail :: Create bridge with... | FAIL |
04:39:57  Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: '{"network-topology:network-topology":{"topology":[{"topology-id":"ovsdb:1","node":[{"node-id":"ovsdb://uuid/548ac92b-69d7-4d67-8018-8c0c339a56f8","ovsdb:db-version":"8.3.0","ovsdb:interface-type-entry":[{"interface-type":"ovsdb:interface-type-vxlan"},{"interface-type":"ovsdb:interface-type-tap"},{"interface-type":"ovsdb:interface-type-stt"},{"interface-type":"ovsdb:interface-type-internal"},{"interface-type":"ovsdb:interface-type-patch"},{"interface-type":"ovsdb:interface-type-lisp"},{"interface-type":"ovsdb:interface-type-geneve"},{"interface-type":"ovsdb:interface-type-gre"},{"interface-type":"ovsdb:interface-type-system"}],"ovsdb:ovs-version":"2.17.11","ovsdb:connection-info":{"local-port":6640,"remote-port":38848,"local-ip":"10.30.171.228","remote-ip":"10.30.171.177"},"ovsdb:openvswitch-external-ids":[{"external-id-key":"hostname","external-id-value":"ubuntu-22-04-mininet-ovs-217-5ebb25bd-57cf-4a0a-aab5-227d5bff4b"},{"external-id-key":"system-id","external-id-value":"4cb0bfbc-0bc4-4591-8cc9-bc6146d75221"},{"external-id-key":"rundir","external-id-value":"/var/run/openvswitch"}],"ovsdb:datapath-type-entry":[{"datapath-type":"ovsdb:datapath-type-netdev"},{"datapath-type":"ovsdb:datapath-type-system"}],"ovsdb:manager-entry":[{"target":"tcp:10.30.171.190:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.171.228:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.250:6640","number_of_connections":1,"connected":true}]}]}]}}' contains 'br-s1' 0 times, not 5 times.
04:39:57  ------------------------------------------------------------------------------
04:39:57  Add Port Manually and Verify After Fail :: Add port with OVS comma... | FAIL |
04:40:03  Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: '{"network-topology:network-topology":{"topology":[{"topology-id":"ovsdb:1","node":[{"node-id":"ovsdb://uuid/548ac92b-69d7-4d67-8018-8c0c339a56f8","ovsdb:db-version":"8.3.0","ovsdb:interface-type-entry":[{"interface-type":"ovsdb:interface-type-vxlan"},{"interface-type":"ovsdb:interface-type-tap"},{"interface-type":"ovsdb:interface-type-stt"},{"interface-type":"ovsdb:interface-type-internal"},{"interface-type":"ovsdb:interface-type-patch"},{"interface-type":"ovsdb:interface-type-lisp"},{"interface-type":"ovsdb:interface-type-geneve"},{"interface-type":"ovsdb:interface-type-gre"},{"interface-type":"ovsdb:interface-type-system"}],"ovsdb:ovs-version":"2.17.11","ovsdb:connection-info":{"local-port":6640,"remote-port":38848,"local-ip":"10.30.171.228","remote-ip":"10.30.171.177"},"ovsdb:openvswitch-external-ids":[{"external-id-key":"hostname","external-id-value":"ubuntu-22-04-mininet-ovs-217-5ebb25bd-57cf-4a0a-aab5-227d5bff4b"},{"external-id-key":"system-id","external-id-value":"4cb0bfbc-0bc4-4591-8cc9-bc6146d75221"},{"external-id-key":"rundir","external-id-value":"/var/run/openvswitch"}],"ovsdb:datapath-type-entry":[{"datapath-type":"ovsdb:datapath-type-netdev"},{"datapath-type":"ovsdb:datapath-type-system"}],"ovsdb:manager-entry":[{"target":"tcp:10.30.171.190:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.171.228:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.250:6640","number_of_connections":1,"connected":true}]}]}]}}' contains 'vx1' 0 times, not 2 times.
04:40:03  ------------------------------------------------------------------------------
04:40:03  Create Tap Device After Fail :: Create tap devices to add to the b... | PASS |
04:40:05  ------------------------------------------------------------------------------
04:40:05  Add Tap Device Manually and Verify After Fail :: Add tap devices t... | FAIL |
04:40:11  Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: '{"network-topology:network-topology":{"topology":[{"topology-id":"ovsdb:1","node":[{"node-id":"ovsdb://uuid/548ac92b-69d7-4d67-8018-8c0c339a56f8","ovsdb:db-version":"8.3.0","ovsdb:interface-type-entry":[{"interface-type":"ovsdb:interface-type-vxlan"},{"interface-type":"ovsdb:interface-type-tap"},{"interface-type":"ovsdb:interface-type-stt"},{"interface-type":"ovsdb:interface-type-internal"},{"interface-type":"ovsdb:interface-type-patch"},{"interface-type":"ovsdb:interface-type-lisp"},{"interface-type":"ovsdb:interface-type-geneve"},{"interface-type":"ovsdb:interface-type-gre"},{"interface-type":"ovsdb:interface-type-system"}],"ovsdb:ovs-version":"2.17.11","ovsdb:connection-info":{"local-port":6640,"remote-port":38848,"local-ip":"10.30.171.228","remote-ip":"10.30.171.177"},"ovsdb:openvswitch-external-ids":[{"external-id-key":"hostname","external-id-value":"ubuntu-22-04-mininet-ovs-217-5ebb25bd-57cf-4a0a-aab5-227d5bff4b"},{"external-id-key":"system-id","external-id-value":"4cb0bfbc-0bc4-4591-8cc9-bc6146d75221"},{"external-id-key":"rundir","external-id-value":"/var/run/openvswitch"}],"ovsdb:datapath-type-entry":[{"datapath-type":"ovsdb:datapath-type-netdev"},{"datapath-type":"ovsdb:datapath-type-system"}],"ovsdb:manager-entry":[{"target":"tcp:10.30.171.190:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.171.228:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.250:6640","number_of_connections":1,"connected":true}]}]}]}}' contains 'vport1' 0 times, not 2 times.
04:40:11  ------------------------------------------------------------------------------
04:40:11  Delete the Bridge Manually and Verify After Fail :: Delete bridge ... | PASS |
04:40:12  ------------------------------------------------------------------------------
04:40:12  Create Bridge In Owner and Verify After Fail :: Create Bridge in O... | FAIL |
04:40:23  Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 10 seconds. The last error was: '{"network-topology:node":[{"node-id":"ovsdb://uuid/548ac92b-69d7-4d67-8018-8c0c339a56f8","ovsdb:db-version":"8.3.0","ovsdb:interface-type-entry":[{"interface-type":"ovsdb:interface-type-vxlan"},{"interface-type":"ovsdb:interface-type-tap"},{"interface-type":"ovsdb:interface-type-stt"},{"interface-type":"ovsdb:interface-type-internal"},{"interface-type":"ovsdb:interface-type-patch"},{"interface-type":"ovsdb:interface-type-lisp"},{"interface-type":"ovsdb:interface-type-geneve"},{"interface-type":"ovsdb:interface-type-gre"},{"interface-type":"ovsdb:interface-type-system"}],"ovsdb:ovs-version":"2.17.11","ovsdb:connection-info":{"local-port":6640,"remote-port":38848,"local-ip":"10.30.171.228","remote-ip":"10.30.171.177"},"ovsdb:openvswitch-external-ids":[{"external-id-key":"hostname","external-id-value":"ubuntu-22-04-mininet-ovs-217-5ebb25bd-57cf-4a0a-aab5-227d5bff4b"},{"external-id-key":"system-id","external-id-value":"4cb0bfbc-0bc4-4591-8cc9-bc6146d75221"},{"external-id-key":"rundir","external-id-value":"/var/run/openvswitch"}],"ovsdb:datapath-type-entry":[{"datapath-type":"ovsdb:datapath-type-netdev"},{"datapath-type":"ovsdb:datapath-type-system"}],"ovsdb:manager-entry":[{"target":"tcp:10.30.171.190:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.171.228:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.250:6640","number_of_connections":1,"connected":true}]}]}' contains 'br01' 0 times, not 1 time.
04:40:23  ------------------------------------------------------------------------------
04:40:23  Create Port In Owner and Verify After Fail :: Create Port in Owner... | FAIL |
04:40:33  Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 10 seconds. The last error was: HTTPError: 409 Client Error: Conflict for url: http://10.30.170.250:8181/rests/data/network-topology:network-topology/topology=ovsdb%3A1/node=ovsdb%3A%2F%2Fuuid%2F548ac92b-69d7-4d67-8018-8c0c339a56f8%2Fbridge%2Fbr01/termination-point=vx2?content=nonconfig
04:40:33  ------------------------------------------------------------------------------
04:40:33  Modify the destination IP of Port In Owner After Fail :: Modify th... | PASS |
04:40:34  ------------------------------------------------------------------------------
04:40:34  Verify Port Is Modified After Fail :: Verify port is modified in a... | FAIL |
04:40:39  Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: HTTPError: 409 Client Error: Conflict for url: http://10.30.170.250:8181/rests/data/network-topology:network-topology/topology=ovsdb%3A1/node=ovsdb%3A%2F%2Fuuid%2F548ac92b-69d7-4d67-8018-8c0c339a56f8%2Fbridge%2Fbr01?content=nonconfig
04:40:39  ------------------------------------------------------------------------------
04:40:39  Start Old Owner Instance :: Start Owner Instance and verify it is ... | PASS |
04:40:55  ------------------------------------------------------------------------------
04:40:55  Check Shards Status After Recover :: Create original cluster list ... | PASS |
04:40:58  ------------------------------------------------------------------------------
04:40:58  Check Entity Owner Status After Recover :: Check Entity Owner Stat... | PASS |
04:40:59  ------------------------------------------------------------------------------
04:40:59  Create Bridge Manually and Verify After Recover :: Create bridge w... | FAIL |
04:41:06  Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: '{"network-topology:network-topology":{"topology":[{"topology-id":"ovsdb:1","node":[{"node-id":"ovsdb://uuid/548ac92b-69d7-4d67-8018-8c0c339a56f8","ovsdb:db-version":"8.3.0","ovsdb:interface-type-entry":[{"interface-type":"ovsdb:interface-type-vxlan"},{"interface-type":"ovsdb:interface-type-tap"},{"interface-type":"ovsdb:interface-type-stt"},{"interface-type":"ovsdb:interface-type-internal"},{"interface-type":"ovsdb:interface-type-patch"},{"interface-type":"ovsdb:interface-type-lisp"},{"interface-type":"ovsdb:interface-type-geneve"},{"interface-type":"ovsdb:interface-type-gre"},{"interface-type":"ovsdb:interface-type-system"}],"ovsdb:ovs-version":"2.17.11","ovsdb:connection-info":{"local-port":6640,"remote-port":38848,"local-ip":"10.30.171.228","remote-ip":"10.30.171.177"},"ovsdb:openvswitch-external-ids":[{"external-id-key":"system-id","external-id-value":"4cb0bfbc-0bc4-4591-8cc9-bc6146d75221"},{"external-id-key":"hostname","external-id-value":"ubuntu-22-04-mininet-ovs-217-5ebb25bd-57cf-4a0a-aab5-227d5bff4b"},{"external-id-key":"rundir","external-id-value":"/var/run/openvswitch"}],"ovsdb:datapath-type-entry":[{"datapath-type":"ovsdb:datapath-type-netdev"},{"datapath-type":"ovsdb:datapath-type-system"}],"ovsdb:manager-entry":[{"target":"tcp:10.30.171.190:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.171.228:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.250:6640","number_of_connections":1,"connected":true}]}]}]}}' contains 'br-s1' 0 times, not 5 times.
04:41:06  ------------------------------------------------------------------------------
04:41:06  Add Port Manually and Verify After Recover :: Add port with OVS co... | FAIL |
04:41:12  Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: '{"network-topology:network-topology":{"topology":[{"topology-id":"ovsdb:1","node":[{"node-id":"ovsdb://uuid/548ac92b-69d7-4d67-8018-8c0c339a56f8","ovsdb:db-version":"8.3.0","ovsdb:interface-type-entry":[{"interface-type":"ovsdb:interface-type-vxlan"},{"interface-type":"ovsdb:interface-type-tap"},{"interface-type":"ovsdb:interface-type-stt"},{"interface-type":"ovsdb:interface-type-internal"},{"interface-type":"ovsdb:interface-type-patch"},{"interface-type":"ovsdb:interface-type-lisp"},{"interface-type":"ovsdb:interface-type-geneve"},{"interface-type":"ovsdb:interface-type-gre"},{"interface-type":"ovsdb:interface-type-system"}],"ovsdb:ovs-version":"2.17.11","ovsdb:connection-info":{"local-port":6640,"remote-port":38848,"local-ip":"10.30.171.228","remote-ip":"10.30.171.177"},"ovsdb:openvswitch-external-ids":[{"external-id-key":"system-id","external-id-value":"4cb0bfbc-0bc4-4591-8cc9-bc6146d75221"},{"external-id-key":"hostname","external-id-value":"ubuntu-22-04-mininet-ovs-217-5ebb25bd-57cf-4a0a-aab5-227d5bff4b"},{"external-id-key":"rundir","external-id-value":"/var/run/openvswitch"}],"ovsdb:datapath-type-entry":[{"datapath-type":"ovsdb:datapath-type-netdev"},{"datapath-type":"ovsdb:datapath-type-system"}],"ovsdb:manager-entry":[{"target":"tcp:10.30.171.190:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.171.228:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.250:6640","number_of_connections":1,"connected":true}]}]}]}}' contains 'vx1' 0 times, not 2 times.
04:41:12  ------------------------------------------------------------------------------
04:41:12  Create Tap Device After Recover :: Create tap devices to add to th... | PASS |
04:41:14  ------------------------------------------------------------------------------
04:41:14  Add Tap Device Manually and Verify After Recover :: Add tap device... | FAIL |
04:41:20  Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: '{"network-topology:network-topology":{"topology":[{"topology-id":"ovsdb:1","node":[{"node-id":"ovsdb://uuid/548ac92b-69d7-4d67-8018-8c0c339a56f8","ovsdb:db-version":"8.3.0","ovsdb:interface-type-entry":[{"interface-type":"ovsdb:interface-type-vxlan"},{"interface-type":"ovsdb:interface-type-tap"},{"interface-type":"ovsdb:interface-type-stt"},{"interface-type":"ovsdb:interface-type-internal"},{"interface-type":"ovsdb:interface-type-patch"},{"interface-type":"ovsdb:interface-type-lisp"},{"interface-type":"ovsdb:interface-type-geneve"},{"interface-type":"ovsdb:interface-type-gre"},{"interface-type":"ovsdb:interface-type-system"}],"ovsdb:ovs-version":"2.17.11","ovsdb:connection-info":{"local-port":6640,"remote-port":38848,"local-ip":"10.30.171.228","remote-ip":"10.30.171.177"},"ovsdb:openvswitch-external-ids":[{"external-id-key":"system-id","external-id-value":"4cb0bfbc-0bc4-4591-8cc9-bc6146d75221"},{"external-id-key":"hostname","external-id-value":"ubuntu-22-04-mininet-ovs-217-5ebb25bd-57cf-4a0a-aab5-227d5bff4b"},{"external-id-key":"rundir","external-id-value":"/var/run/openvswitch"}],"ovsdb:datapath-type-entry":[{"datapath-type":"ovsdb:datapath-type-netdev"},{"datapath-type":"ovsdb:datapath-type-system"}],"ovsdb:manager-entry":[{"target":"tcp:10.30.171.190:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.171.228:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.250:6640","number_of_connections":1,"connected":true}]}]}]}}' contains 'vport1' 0 times, not 2 times.
04:41:20  ------------------------------------------------------------------------------
04:41:20  Delete the Bridge Manually and Verify After Recover :: Delete brid... | PASS |
04:41:21  ------------------------------------------------------------------------------
04:41:21  Verify Modified Port After Recover :: Verify modified port exists ... | FAIL |
04:41:27  Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: HTTPError: 409 Client Error: Conflict for url: http://10.30.171.228:8181/rests/data/network-topology:network-topology/topology=ovsdb%3A1/node=ovsdb%3A%2F%2Fuuid%2F548ac92b-69d7-4d67-8018-8c0c339a56f8%2Fbridge%2Fbr01?content=nonconfig
04:41:27  ------------------------------------------------------------------------------
04:41:27  Delete Port In New Owner After Recover :: Delete port in Owner and... | PASS |
04:41:28  ------------------------------------------------------------------------------
04:41:28  Delete Bridge In New Owner And Verify After Recover :: Delete brid... | PASS |
04:41:28  ------------------------------------------------------------------------------
04:41:28  Create Bridge In Old Owner and Verify After Recover :: Create Brid... | FAIL |
04:41:39  Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 10 seconds. The last error was: '{"network-topology:node":[{"node-id":"ovsdb://uuid/548ac92b-69d7-4d67-8018-8c0c339a56f8","ovsdb:db-version":"8.3.0","ovsdb:interface-type-entry":[{"interface-type":"ovsdb:interface-type-vxlan"},{"interface-type":"ovsdb:interface-type-tap"},{"interface-type":"ovsdb:interface-type-stt"},{"interface-type":"ovsdb:interface-type-internal"},{"interface-type":"ovsdb:interface-type-patch"},{"interface-type":"ovsdb:interface-type-lisp"},{"interface-type":"ovsdb:interface-type-geneve"},{"interface-type":"ovsdb:interface-type-gre"},{"interface-type":"ovsdb:interface-type-system"}],"ovsdb:ovs-version":"2.17.11","ovsdb:connection-info":{"local-port":6640,"remote-port":38848,"local-ip":"10.30.171.228","remote-ip":"10.30.171.177"},"ovsdb:openvswitch-external-ids":[{"external-id-key":"system-id","external-id-value":"4cb0bfbc-0bc4-4591-8cc9-bc6146d75221"},{"external-id-key":"hostname","external-id-value":"ubuntu-22-04-mininet-ovs-217-5ebb25bd-57cf-4a0a-aab5-227d5bff4b"},{"external-id-key":"rundir","external-id-value":"/var/run/openvswitch"}],"ovsdb:datapath-type-entry":[{"datapath-type":"ovsdb:datapath-type-netdev"},{"datapath-type":"ovsdb:datapath-type-system"}],"ovsdb:manager-entry":[{"target":"tcp:10.30.171.190:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.171.228:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.250:6640","number_of_connections":1,"connected":true}]}]}' contains 'br01' 0 times, not 1 time.
04:41:39  ------------------------------------------------------------------------------
04:41:39  Create Port In Old Owner and Verify After Recover :: Create Port i... | FAIL |
04:41:50  Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 10 seconds. The last error was: HTTPError: 409 Client Error: Conflict for url: http://10.30.171.228:8181/rests/data/network-topology:network-topology/topology=ovsdb%3A1/node=ovsdb%3A%2F%2Fuuid%2F548ac92b-69d7-4d67-8018-8c0c339a56f8%2Fbridge%2Fbr01/termination-point=vx2?content=nonconfig
04:41:50  ------------------------------------------------------------------------------
04:41:50  Modify the destination IP of Port In Old Owner After Recover :: Mo... | PASS |
04:41:51  ------------------------------------------------------------------------------
04:41:51  Verify Port Is Modified After Recover :: Verify port is modified i... | FAIL |
04:41:57  Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: HTTPError: 409 Client Error: Conflict for url: http://10.30.171.228:8181/rests/data/network-topology:network-topology/topology=ovsdb%3A1/node=ovsdb%3A%2F%2Fuuid%2F548ac92b-69d7-4d67-8018-8c0c339a56f8%2Fbridge%2Fbr01?content=nonconfig
04:41:57  ------------------------------------------------------------------------------
04:41:57  Delete Port In Old Owner After Recover :: Delete port in Owner and... | PASS |
04:41:57  ------------------------------------------------------------------------------
04:41:57  Delete Bridge In Old Owner And Verify After Recover :: Delete brid... | PASS |
04:41:58  ------------------------------------------------------------------------------
04:41:58  Cleans Up Test Environment For Next Suite :: Cleans up test enviro... | FAIL |
04:42:08  Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: '{"network-topology:network-topology":{"topology":[{"topology-id":"ovsdb:1","node":[{"node-id":"ovsdb://uuid/548ac92b-69d7-4d67-8018-8c0c339a56f8","ovsdb:db-version":"8.3.0","ovsdb:interface-type-entry":[{"interface-type":"ovsdb:interface-type-vxlan"},{"interface-type":"ovsdb:interface-type-tap"},{"interface-type":"ovsdb:interface-type-stt"},{"interface-type":"ovsdb:interface-type-internal"},{"interface-type":"ovsdb:interface-type-patch"},{"interface-type":"ovsdb:interface-type-lisp"},{"interface-type":"ovsdb:interface-type-geneve"},{"interface-type":"ovsdb:interface-type-gre"},{"interface-type":"ovsdb:interface-type-system"}],"ovsdb:ovs-version":"2.17.11","ovsdb:connection-info":{"local-port":6640,"remote-port":38848,"local-ip":"10.30.171.228","remote-ip":"10.30.171.177"},"ovsdb:openvswitch-external-ids":[{"external-id-key":"system-id","external-id-value":"4cb0bfbc-0bc4-4591-8cc9-bc6146d75221"},{"external-id-key":"hostname","external-id-value":"ubuntu-22-04-mininet-ovs-217-5ebb25bd-57cf-4a0a-aab5-227d5bff4b"},{"external-id-key":"rundir","external-id-value":"/var/run/openvswitch"}],"ovsdb:datapath-type-entry":[{"datapath-type":"ovsdb:datapath-type-netdev"},{"datapath-type":"ovsdb:datapath-type-system"}],"ovsdb:manager-entry":[{"target":"tcp:10.30.171.190:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.171.228:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.250:6640","number_of_connections":1,"connected":true}]}]}]}}' contains 'ovsdb://uuid' 1 time, not 0 times.
04:42:08  ------------------------------------------------------------------------------
04:42:08  ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound ... | FAIL |
04:42:08  44 tests, 27 passed, 17 failed
04:42:08  ==============================================================================
04:42:08  ovsdb-upstream-clustering.txt.Southbound Cluster.Southbound Cluster Extensi...
04:42:08  ==============================================================================
04:42:11  Check Shards Status Before Fail :: Check Status for all shards in ... | PASS |
04:42:14  ------------------------------------------------------------------------------
04:42:14  Start OVS Multiple Connections :: Connect OVS to all cluster insta... | PASS |
04:42:18  ------------------------------------------------------------------------------
04:42:18  Check Entity Owner Status And Find Owner and Candidate Before Fail... | FAIL |
04:42:39  Keyword 'ClusterManagement.Verify_Owner_And_Successors_For_Device' failed after retrying for 20 seconds. The last error was: Successor list [] is not the came as expected [1, 3]
04:42:39  Lengths are different: 2 != 0
04:42:39  ------------------------------------------------------------------------------
04:42:39  Create Bridge Manually and Verify Before Fail :: Create bridge wit... | FAIL |
04:42:46  Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: '{"network-topology:network-topology":{"topology":[{"topology-id":"ovsdb:1","node":[{"node-id":"ovsdb://uuid/548ac92b-69d7-4d67-8018-8c0c339a56f8","ovsdb:db-version":"8.3.0","ovsdb:interface-type-entry":[{"interface-type":"ovsdb:interface-type-vxlan"},{"interface-type":"ovsdb:interface-type-tap"},{"interface-type":"ovsdb:interface-type-stt"},{"interface-type":"ovsdb:interface-type-internal"},{"interface-type":"ovsdb:interface-type-patch"},{"interface-type":"ovsdb:interface-type-lisp"},{"interface-type":"ovsdb:interface-type-geneve"},{"interface-type":"ovsdb:interface-type-gre"},{"interface-type":"ovsdb:interface-type-system"}],"ovsdb:ovs-version":"2.17.11","ovsdb:connection-info":{"local-port":6640,"remote-port":38848,"local-ip":"10.30.171.228","remote-ip":"10.30.171.177"},"ovsdb:openvswitch-external-ids":[{"external-id-key":"system-id","external-id-value":"4cb0bfbc-0bc4-4591-8cc9-bc6146d75221"},{"external-id-key":"hostname","external-id-value":"ubuntu-22-04-mininet-ovs-217-5ebb25bd-57cf-4a0a-aab5-227d5bff4b"},{"external-id-key":"rundir","external-id-value":"/var/run/openvswitch"}],"ovsdb:datapath-type-entry":[{"datapath-type":"ovsdb:datapath-type-netdev"},{"datapath-type":"ovsdb:datapath-type-system"}],"ovsdb:manager-entry":[{"target":"tcp:10.30.171.190:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.171.228:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.250:6640","number_of_connections":1,"connected":true}]}]}]}}' contains 'br-s1' 0 times, not 5 times.
04:42:46  ------------------------------------------------------------------------------
04:42:46  Add Port Manually and Verify Before Fail :: Add port with OVS comm... | FAIL |
04:42:52  Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: '{"network-topology:network-topology":{"topology":[{"topology-id":"ovsdb:1","node":[{"node-id":"ovsdb://uuid/548ac92b-69d7-4d67-8018-8c0c339a56f8","ovsdb:db-version":"8.3.0","ovsdb:interface-type-entry":[{"interface-type":"ovsdb:interface-type-vxlan"},{"interface-type":"ovsdb:interface-type-tap"},{"interface-type":"ovsdb:interface-type-stt"},{"interface-type":"ovsdb:interface-type-internal"},{"interface-type":"ovsdb:interface-type-patch"},{"interface-type":"ovsdb:interface-type-lisp"},{"interface-type":"ovsdb:interface-type-geneve"},{"interface-type":"ovsdb:interface-type-gre"},{"interface-type":"ovsdb:interface-type-system"}],"ovsdb:ovs-version":"2.17.11","ovsdb:connection-info":{"local-port":6640,"remote-port":38848,"local-ip":"10.30.171.228","remote-ip":"10.30.171.177"},"ovsdb:openvswitch-external-ids":[{"external-id-key":"system-id","external-id-value":"4cb0bfbc-0bc4-4591-8cc9-bc6146d75221"},{"external-id-key":"hostname","external-id-value":"ubuntu-22-04-mininet-ovs-217-5ebb25bd-57cf-4a0a-aab5-227d5bff4b"},{"external-id-key":"rundir","external-id-value":"/var/run/openvswitch"}],"ovsdb:datapath-type-entry":[{"datapath-type":"ovsdb:datapath-type-netdev"},{"datapath-type":"ovsdb:datapath-type-system"}],"ovsdb:manager-entry":[{"target":"tcp:10.30.171.190:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.171.228:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.250:6640","number_of_connections":1,"connected":true}]}]}]}}' contains 'vx1' 0 times, not 2 times.
04:42:52  ------------------------------------------------------------------------------
04:42:52  Delete the Bridge Manually and Verify Before Fail :: Delete bridge... | PASS |
04:42:53  ------------------------------------------------------------------------------
04:42:53  Create Bridge In Owner and Verify Before Fail :: Create Bridge in ... | FAIL |
04:42:53  Variable '${original_owner}' not found.
04:42:53  ------------------------------------------------------------------------------
04:42:53  Create Port In Owner and Verify Before Fail :: Create Port in Owne... | FAIL |
04:42:54  Variable '${original_owner}' not found.
04:42:54  ------------------------------------------------------------------------------
04:42:54  Modify the destination IP of Port In Owner Before Fail :: Modify t... | FAIL |
04:42:54  Variable '${original_owner}' not found.
04:42:54  ------------------------------------------------------------------------------
04:42:54  Verify Port Is Modified Before Fail :: Verify port is modified in ... | FAIL |
04:43:00  Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: HTTPError: 409 Client Error: Conflict for url: http://10.30.171.228:8181/rests/data/network-topology:network-topology/topology=ovsdb%3A1/node=ovsdb%3A%2F%2Fuuid%2F548ac92b-69d7-4d67-8018-8c0c339a56f8%2Fbridge%2Fbr01?content=nonconfig
04:43:00  ------------------------------------------------------------------------------
04:43:00  Delete Port In Owner Before Fail :: Delete port in Owner and verif... | FAIL |
04:43:00  Variable '${original_owner}' not found.
04:43:00  ------------------------------------------------------------------------------
04:43:00  Delete Bridge In Owner And Verify Before Fail :: Delete bridge in ... | FAIL |
04:43:00  Variable '${original_owner}' not found.
04:43:00  ------------------------------------------------------------------------------
04:43:00  Kill Candidate Instance :: Kill Owner Instance and verify it is dead  | FAIL |
04:43:01  Variable '${original_candidate}' not found.
04:43:01  ------------------------------------------------------------------------------
04:43:01  Check Shards Status After Fail :: Create original cluster list and... | FAIL |
04:43:01  Variable '${new_cluster_list}' not found.
04:43:01  ------------------------------------------------------------------------------
04:43:01  Check Entity Owner Status And Find Owner and Candidate After Fail ... | FAIL |
04:43:02  Variable '${original_owner}' not found.
04:43:02  ------------------------------------------------------------------------------
04:43:02  Create Bridge Manually and Verify After Fail :: Create bridge with... | FAIL |
04:43:02  Variable '${new_cluster_list}' not found.
04:43:02  ------------------------------------------------------------------------------
04:43:02  Add Port Manually and Verify After Fail :: Add port with OVS comma... | FAIL |
04:43:02  Variable '${new_cluster_list}' not found.
04:43:02  ------------------------------------------------------------------------------
04:43:02  Delete the Bridge Manually and Verify After Fail :: Delete bridge ... | FAIL |
04:43:03  Variable '${new_cluster_list}' not found.
04:43:03  ------------------------------------------------------------------------------
04:43:03  Create Bridge In Owner and Verify After Fail :: Create Bridge in O... | FAIL |
04:43:03  Variable '${new_owner}' not found.
04:43:03  ------------------------------------------------------------------------------
04:43:03  Create Port In Owner and Verify After Fail :: Create Port in Owner... | FAIL |
04:43:03  Variable '${new_owner}' not found.
04:43:03  ------------------------------------------------------------------------------
04:43:03  Modify the destination IP of Port In Owner After Fail :: Modify th... | FAIL |
04:43:04  Variable '${new_owner}' not found.
04:43:04  ------------------------------------------------------------------------------
04:43:04  Verify Port Is Modified After Fail :: Verify port is modified in a... | FAIL |
04:43:04  Variable '${new_cluster_list}' not found.
04:43:04  ------------------------------------------------------------------------------
04:43:04  Start Old Candidate Instance :: Start Owner Instance and verify it... | FAIL |
04:43:04  Variable '${original_candidate}' not found.
04:43:04  ------------------------------------------------------------------------------
04:43:04  Check Shards Status After Recover :: Create original cluster list ... | PASS |
04:43:07  ------------------------------------------------------------------------------
04:43:07  Check Entity Owner Status After Recover :: Check Entity Owner Stat... | FAIL |
04:43:28  Keyword 'ClusterManagement.Verify_Owner_And_Successors_For_Device' failed after retrying for 20 seconds. The last error was: Successor list [] is not the came as expected [1, 3]
04:43:28  Lengths are different: 2 != 0
04:43:28  ------------------------------------------------------------------------------
04:43:28  Create Bridge Manually and Verify After Recover :: Create bridge w... | FAIL |
04:43:35  Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: '{"network-topology:network-topology":{"topology":[{"topology-id":"ovsdb:1","node":[{"node-id":"ovsdb://uuid/548ac92b-69d7-4d67-8018-8c0c339a56f8","ovsdb:db-version":"8.3.0","ovsdb:interface-type-entry":[{"interface-type":"ovsdb:interface-type-vxlan"},{"interface-type":"ovsdb:interface-type-tap"},{"interface-type":"ovsdb:interface-type-stt"},{"interface-type":"ovsdb:interface-type-internal"},{"interface-type":"ovsdb:interface-type-patch"},{"interface-type":"ovsdb:interface-type-lisp"},{"interface-type":"ovsdb:interface-type-geneve"},{"interface-type":"ovsdb:interface-type-gre"},{"interface-type":"ovsdb:interface-type-system"}],"ovsdb:ovs-version":"2.17.11","ovsdb:connection-info":{"local-port":6640,"remote-port":38848,"local-ip":"10.30.171.228","remote-ip":"10.30.171.177"},"ovsdb:openvswitch-external-ids":[{"external-id-key":"system-id","external-id-value":"4cb0bfbc-0bc4-4591-8cc9-bc6146d75221"},{"external-id-key":"hostname","external-id-value":"ubuntu-22-04-mininet-ovs-217-5ebb25bd-57cf-4a0a-aab5-227d5bff4b"},{"external-id-key":"rundir","external-id-value":"/var/run/openvswitch"}],"ovsdb:datapath-type-entry":[{"datapath-type":"ovsdb:datapath-type-netdev"},{"datapath-type":"ovsdb:datapath-type-system"}],"ovsdb:manager-entry":[{"target":"tcp:10.30.171.190:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.171.228:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.250:6640","number_of_connections":1,"connected":true}]}]}]}}' contains 'br-s1' 0 times, not 5 times.
04:43:35  ------------------------------------------------------------------------------
04:43:35  Add Port Manually and Verify After Recover :: Add port with OVS co... | FAIL |
04:43:41  Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: '{"network-topology:network-topology":{"topology":[{"topology-id":"ovsdb:1","node":[{"node-id":"ovsdb://uuid/548ac92b-69d7-4d67-8018-8c0c339a56f8","ovsdb:db-version":"8.3.0","ovsdb:interface-type-entry":[{"interface-type":"ovsdb:interface-type-vxlan"},{"interface-type":"ovsdb:interface-type-tap"},{"interface-type":"ovsdb:interface-type-stt"},{"interface-type":"ovsdb:interface-type-internal"},{"interface-type":"ovsdb:interface-type-patch"},{"interface-type":"ovsdb:interface-type-lisp"},{"interface-type":"ovsdb:interface-type-geneve"},{"interface-type":"ovsdb:interface-type-gre"},{"interface-type":"ovsdb:interface-type-system"}],"ovsdb:ovs-version":"2.17.11","ovsdb:connection-info":{"local-port":6640,"remote-port":38848,"local-ip":"10.30.171.228","remote-ip":"10.30.171.177"},"ovsdb:openvswitch-external-ids":[{"external-id-key":"system-id","external-id-value":"4cb0bfbc-0bc4-4591-8cc9-bc6146d75221"},{"external-id-key":"hostname","external-id-value":"ubuntu-22-04-mininet-ovs-217-5ebb25bd-57cf-4a0a-aab5-227d5bff4b"},{"external-id-key":"rundir","external-id-value":"/var/run/openvswitch"}],"ovsdb:datapath-type-entry":[{"datapath-type":"ovsdb:datapath-type-netdev"},{"datapath-type":"ovsdb:datapath-type-system"}],"ovsdb:manager-entry":[{"target":"tcp:10.30.171.190:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.171.228:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.250:6640","number_of_connections":1,"connected":true}]}]}]}}' contains 'vx1' 0 times, not 2 times.
04:43:41  ------------------------------------------------------------------------------
04:43:41  Delete the Bridge Manually and Verify After Recover :: Delete brid... | PASS |
04:43:42  ------------------------------------------------------------------------------
04:43:42  Verify Modified Port After Recover :: Verify modified port exists ... | FAIL |
04:43:48  Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: HTTPError: 409 Client Error: Conflict for url: http://10.30.171.228:8181/rests/data/network-topology:network-topology/topology=ovsdb%3A1/node=ovsdb%3A%2F%2Fuuid%2F548ac92b-69d7-4d67-8018-8c0c339a56f8%2Fbridge%2Fbr01?content=nonconfig
04:43:48  ------------------------------------------------------------------------------
04:43:48  Delete Port In New Owner After Recover :: Delete port in Owner and... | FAIL |
04:43:48  Variable '${new_owner}' not found.
04:43:48  ------------------------------------------------------------------------------
04:43:48  Delete Bridge In New Owner And Verify After Recover :: Delete brid... | FAIL |
04:43:48  Variable '${new_owner}' not found.
04:43:48  ------------------------------------------------------------------------------
04:43:48  Create Bridge In Old Candidate and Verify After Recover :: Create ... | FAIL |
04:43:49  Variable '${original_candidate}' not found.
04:43:49  ------------------------------------------------------------------------------
04:43:49  Create Port In Old Owner and Verify After Recover :: Create Port i... | FAIL |
04:43:49  Variable '${original_candidate}' not found.
04:43:49  ------------------------------------------------------------------------------
04:43:49  Modify the destination IP of Port In Old Owner After Recover :: Mo... | FAIL |
04:43:49  Variable '${original_candidate}' not found.
04:43:49  ------------------------------------------------------------------------------
04:43:49  Verify Port Is Modified After Recover :: Verify port is modified i... | FAIL |
04:43:55  Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: HTTPError: 409 Client Error: Conflict for url: http://10.30.171.228:8181/rests/data/network-topology:network-topology/topology=ovsdb%3A1/node=ovsdb%3A%2F%2Fuuid%2F548ac92b-69d7-4d67-8018-8c0c339a56f8%2Fbridge%2Fbr01?content=nonconfig
04:43:55  ------------------------------------------------------------------------------
04:43:55  Delete Port In Old Owner After Recover :: Delete port in Owner and... | FAIL |
04:43:55  Variable '${original_candidate}' not found.
04:43:55  ------------------------------------------------------------------------------
04:43:55  Delete Bridge In Old Owner And Verify After Recover :: Delete brid... | FAIL |
04:43:56  Variable '${original_candidate}' not found.
04:43:56  ------------------------------------------------------------------------------
04:43:56  Cleans Up Test Environment For Next Suite :: Cleans up test enviro... | FAIL |
04:44:05  Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: '{"network-topology:network-topology":{"topology":[{"topology-id":"ovsdb:1","node":[{"node-id":"ovsdb://uuid/548ac92b-69d7-4d67-8018-8c0c339a56f8","ovsdb:db-version":"8.3.0","ovsdb:interface-type-entry":[{"interface-type":"ovsdb:interface-type-vxlan"},{"interface-type":"ovsdb:interface-type-tap"},{"interface-type":"ovsdb:interface-type-stt"},{"interface-type":"ovsdb:interface-type-internal"},{"interface-type":"ovsdb:interface-type-patch"},{"interface-type":"ovsdb:interface-type-lisp"},{"interface-type":"ovsdb:interface-type-geneve"},{"interface-type":"ovsdb:interface-type-gre"},{"interface-type":"ovsdb:interface-type-system"}],"ovsdb:ovs-version":"2.17.11","ovsdb:connection-info":{"local-port":6640,"remote-port":38848,"local-ip":"10.30.171.228","remote-ip":"10.30.171.177"},"ovsdb:openvswitch-external-ids":[{"external-id-key":"system-id","external-id-value":"4cb0bfbc-0bc4-4591-8cc9-bc6146d75221"},{"external-id-key":"hostname","external-id-value":"ubuntu-22-04-mininet-ovs-217-5ebb25bd-57cf-4a0a-aab5-227d5bff4b"},{"external-id-key":"rundir","external-id-value":"/var/run/openvswitch"}],"ovsdb:datapath-type-entry":[{"datapath-type":"ovsdb:datapath-type-netdev"},{"datapath-type":"ovsdb:datapath-type-system"}],"ovsdb:manager-entry":[{"target":"tcp:10.30.171.190:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.171.228:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.250:6640","number_of_connections":1,"connected":true}]}]}]}}' contains 'ovsdb://uuid' 1 time, not 0 times.
04:44:05  ------------------------------------------------------------------------------
04:44:05  ovsdb-upstream-clustering.txt.Southbound Cluster.Southbound Cluste... | FAIL |
04:44:05  38 tests, 5 passed, 33 failed
04:44:05  ==============================================================================
04:44:05  ovsdb-upstream-clustering.txt.Southbound Cluster                      | FAIL |
04:44:05  82 tests, 32 passed, 50 failed
04:44:05  ==============================================================================
04:44:05  ovsdb-upstream-clustering.txt.Southbound Cluster                              
04:44:05  ==============================================================================
04:44:05  ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound Cluster :...
04:44:05  ==============================================================================
04:44:08  Check Shards Status Before Fail :: Check Status for all shards in ... | PASS |
04:44:11  ------------------------------------------------------------------------------
04:44:11  Start OVS Multiple Connections :: Connect OVS to all cluster insta... | PASS |
04:44:15  ------------------------------------------------------------------------------
04:44:15  Check Entity Owner Status And Find Owner and Candidate Before Fail... | FAIL |
04:44:36  Keyword 'ClusterManagement.Verify_Owner_And_Successors_For_Device' failed after retrying for 20 seconds. The last error was: Successor list [] is not the came as expected [1, 3]
04:44:36  Lengths are different: 2 != 0
04:44:36  ------------------------------------------------------------------------------
04:44:36  Create Bridge Manually and Verify Before Fail :: Create bridge wit... | FAIL |
04:44:43  Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: '{"network-topology:network-topology":{"topology":[{"topology-id":"ovsdb:1","node":[{"node-id":"ovsdb://uuid/548ac92b-69d7-4d67-8018-8c0c339a56f8","ovsdb:db-version":"8.3.0","ovsdb:interface-type-entry":[{"interface-type":"ovsdb:interface-type-vxlan"},{"interface-type":"ovsdb:interface-type-tap"},{"interface-type":"ovsdb:interface-type-stt"},{"interface-type":"ovsdb:interface-type-internal"},{"interface-type":"ovsdb:interface-type-patch"},{"interface-type":"ovsdb:interface-type-lisp"},{"interface-type":"ovsdb:interface-type-geneve"},{"interface-type":"ovsdb:interface-type-gre"},{"interface-type":"ovsdb:interface-type-system"}],"ovsdb:ovs-version":"2.17.11","ovsdb:connection-info":{"local-port":6640,"remote-port":38848,"local-ip":"10.30.171.228","remote-ip":"10.30.171.177"},"ovsdb:openvswitch-external-ids":[{"external-id-key":"system-id","external-id-value":"4cb0bfbc-0bc4-4591-8cc9-bc6146d75221"},{"external-id-key":"hostname","external-id-value":"ubuntu-22-04-mininet-ovs-217-5ebb25bd-57cf-4a0a-aab5-227d5bff4b"},{"external-id-key":"rundir","external-id-value":"/var/run/openvswitch"}],"ovsdb:datapath-type-entry":[{"datapath-type":"ovsdb:datapath-type-netdev"},{"datapath-type":"ovsdb:datapath-type-system"}],"ovsdb:manager-entry":[{"target":"tcp:10.30.171.190:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.171.228:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.250:6640","number_of_connections":1,"connected":true}]}]}]}}' contains 'br-s1' 0 times, not 5 times.
04:44:43  ------------------------------------------------------------------------------
04:44:43  Add Port Manually and Verify Before Fail :: Add port with OVS comm... | FAIL |
04:44:49  Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: '{"network-topology:network-topology":{"topology":[{"topology-id":"ovsdb:1","node":[{"node-id":"ovsdb://uuid/548ac92b-69d7-4d67-8018-8c0c339a56f8","ovsdb:db-version":"8.3.0","ovsdb:interface-type-entry":[{"interface-type":"ovsdb:interface-type-vxlan"},{"interface-type":"ovsdb:interface-type-tap"},{"interface-type":"ovsdb:interface-type-stt"},{"interface-type":"ovsdb:interface-type-internal"},{"interface-type":"ovsdb:interface-type-patch"},{"interface-type":"ovsdb:interface-type-lisp"},{"interface-type":"ovsdb:interface-type-geneve"},{"interface-type":"ovsdb:interface-type-gre"},{"interface-type":"ovsdb:interface-type-system"}],"ovsdb:ovs-version":"2.17.11","ovsdb:connection-info":{"local-port":6640,"remote-port":38848,"local-ip":"10.30.171.228","remote-ip":"10.30.171.177"},"ovsdb:openvswitch-external-ids":[{"external-id-key":"system-id","external-id-value":"4cb0bfbc-0bc4-4591-8cc9-bc6146d75221"},{"external-id-key":"hostname","external-id-value":"ubuntu-22-04-mininet-ovs-217-5ebb25bd-57cf-4a0a-aab5-227d5bff4b"},{"external-id-key":"rundir","external-id-value":"/var/run/openvswitch"}],"ovsdb:datapath-type-entry":[{"datapath-type":"ovsdb:datapath-type-netdev"},{"datapath-type":"ovsdb:datapath-type-system"}],"ovsdb:manager-entry":[{"target":"tcp:10.30.171.190:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.171.228:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.250:6640","number_of_connections":1,"connected":true}]}]}]}}' contains 'vx1' 0 times, not 2 times.
04:44:49  ------------------------------------------------------------------------------
04:44:49  Create Tap Device Before Fail :: Create tap devices to add to the ... | PASS |
04:44:51  ------------------------------------------------------------------------------
04:44:51  Add Tap Device Manually and Verify Before Fail :: Add tap devices ... | FAIL |
04:44:57  Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: '{"network-topology:network-topology":{"topology":[{"topology-id":"ovsdb:1","node":[{"node-id":"ovsdb://uuid/548ac92b-69d7-4d67-8018-8c0c339a56f8","ovsdb:db-version":"8.3.0","ovsdb:interface-type-entry":[{"interface-type":"ovsdb:interface-type-vxlan"},{"interface-type":"ovsdb:interface-type-tap"},{"interface-type":"ovsdb:interface-type-stt"},{"interface-type":"ovsdb:interface-type-internal"},{"interface-type":"ovsdb:interface-type-patch"},{"interface-type":"ovsdb:interface-type-lisp"},{"interface-type":"ovsdb:interface-type-geneve"},{"interface-type":"ovsdb:interface-type-gre"},{"interface-type":"ovsdb:interface-type-system"}],"ovsdb:ovs-version":"2.17.11","ovsdb:connection-info":{"local-port":6640,"remote-port":38848,"local-ip":"10.30.171.228","remote-ip":"10.30.171.177"},"ovsdb:openvswitch-external-ids":[{"external-id-key":"system-id","external-id-value":"4cb0bfbc-0bc4-4591-8cc9-bc6146d75221"},{"external-id-key":"hostname","external-id-value":"ubuntu-22-04-mininet-ovs-217-5ebb25bd-57cf-4a0a-aab5-227d5bff4b"},{"external-id-key":"rundir","external-id-value":"/var/run/openvswitch"}],"ovsdb:datapath-type-entry":[{"datapath-type":"ovsdb:datapath-type-netdev"},{"datapath-type":"ovsdb:datapath-type-system"}],"ovsdb:manager-entry":[{"target":"tcp:10.30.171.190:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.171.228:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.250:6640","number_of_connections":1,"connected":true}]}]}]}}' contains 'vport1' 0 times, not 2 times.
04:44:57  ------------------------------------------------------------------------------
04:44:57  Delete the Bridge Manually and Verify Before Fail :: Delete bridge... | PASS |
04:44:58  ------------------------------------------------------------------------------
04:44:58  Create Bridge In Owner and Verify Before Fail :: Create Bridge in ... | FAIL |
04:44:59  Variable '${original_owner}' not found.
04:44:59  ------------------------------------------------------------------------------
04:44:59  Create Port In Owner and Verify Before Fail :: Create Port in Owne... | FAIL |
04:44:59  Variable '${original_owner}' not found.
04:44:59  ------------------------------------------------------------------------------
04:44:59  Modify the destination IP of Port In Owner Before Fail :: Modify t... | FAIL |
04:44:59  Variable '${original_owner}' not found.
04:44:59  ------------------------------------------------------------------------------
04:44:59  Verify Port Is Modified Before Fail :: Verify port is modified in ... | FAIL |
04:45:05  Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: HTTPError: 409 Client Error: Conflict for url: http://10.30.171.228:8181/rests/data/network-topology:network-topology/topology=ovsdb%3A1/node=ovsdb%3A%2F%2Fuuid%2F548ac92b-69d7-4d67-8018-8c0c339a56f8%2Fbridge%2Fbr01?content=nonconfig
04:45:05  ------------------------------------------------------------------------------
04:45:05  Delete Port In Owner Before Fail :: Delete port in Owner and verif... | FAIL |
04:45:05  Variable '${original_owner}' not found.
04:45:05  ------------------------------------------------------------------------------
04:45:05  Delete Bridge In Owner And Verify Before Fail :: Delete bridge in ... | FAIL |
04:45:06  Variable '${original_owner}' not found.
04:45:06  ------------------------------------------------------------------------------
04:45:06  Kill Owner Instance :: Kill Owner Instance and verify it is dead      | FAIL |
04:45:06  Variable '${original_owner}' not found.
04:45:06  ------------------------------------------------------------------------------
04:45:06  Check Shards Status After Fail :: Create original cluster list and... | FAIL |
04:45:06  Variable '${new_cluster_list}' not found.
04:45:06  ------------------------------------------------------------------------------
04:45:06  Check Entity Owner Status And Find Owner and Candidate After Fail ... | FAIL |
04:45:07  Variable '${original_candidate}' not found.
04:45:07  ------------------------------------------------------------------------------
04:45:07  Create Bridge Manually and Verify After Fail :: Create bridge with... | FAIL |
04:45:07  Variable '${new_cluster_list}' not found.
04:45:07  ------------------------------------------------------------------------------
04:45:07  Add Port Manually and Verify After Fail :: Add port with OVS comma... | FAIL |
04:45:07  Variable '${new_cluster_list}' not found.
04:45:07  ------------------------------------------------------------------------------
04:45:07  Create Tap Device After Fail :: Create tap devices to add to the b... | PASS |
04:45:09  ------------------------------------------------------------------------------
04:45:09  Add Tap Device Manually and Verify After Fail :: Add tap devices t... | FAIL |
04:45:09  Variable '${new_cluster_list}' not found.
04:45:09  ------------------------------------------------------------------------------
04:45:09  Delete the Bridge Manually and Verify After Fail :: Delete bridge ... | FAIL |
04:45:10  Variable '${new_cluster_list}' not found.
04:45:10  ------------------------------------------------------------------------------
04:45:10  Create Bridge In Owner and Verify After Fail :: Create Bridge in O... | FAIL |
04:45:10  Variable '${new_owner}' not found.
04:45:10  ------------------------------------------------------------------------------
04:45:10  Create Port In Owner and Verify After Fail :: Create Port in Owner... | FAIL |
04:45:10  Variable '${new_owner}' not found.
04:45:10  ------------------------------------------------------------------------------
04:45:10  Modify the destination IP of Port In Owner After Fail :: Modify th... | FAIL |
04:45:11  Variable '${new_owner}' not found.
04:45:11  ------------------------------------------------------------------------------
04:45:11  Verify Port Is Modified After Fail :: Verify port is modified in a... | FAIL |
04:45:11  Variable '${new_cluster_list}' not found.
04:45:11  ------------------------------------------------------------------------------
04:45:11  Start Old Owner Instance :: Start Owner Instance and verify it is ... | FAIL |
04:45:11  Variable '${original_owner}' not found.
04:45:11  ------------------------------------------------------------------------------
04:45:11  Check Shards Status After Recover :: Create original cluster list ... | PASS |
04:45:14  ------------------------------------------------------------------------------
04:45:14  Check Entity Owner Status After Recover :: Check Entity Owner Stat... | FAIL |
04:45:35  Keyword 'ClusterManagement.Verify_Owner_And_Successors_For_Device' failed after retrying for 20 seconds. The last error was: Successor list [] is not the came as expected [1, 3]
04:45:35  Lengths are different: 2 != 0
04:45:35  ------------------------------------------------------------------------------
04:45:35  Create Bridge Manually and Verify After Recover :: Create bridge w... | FAIL |
04:45:41  Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: '{"network-topology:network-topology":{"topology":[{"topology-id":"ovsdb:1","node":[{"node-id":"ovsdb://uuid/548ac92b-69d7-4d67-8018-8c0c339a56f8","ovsdb:db-version":"8.3.0","ovsdb:interface-type-entry":[{"interface-type":"ovsdb:interface-type-vxlan"},{"interface-type":"ovsdb:interface-type-tap"},{"interface-type":"ovsdb:interface-type-stt"},{"interface-type":"ovsdb:interface-type-internal"},{"interface-type":"ovsdb:interface-type-patch"},{"interface-type":"ovsdb:interface-type-lisp"},{"interface-type":"ovsdb:interface-type-geneve"},{"interface-type":"ovsdb:interface-type-gre"},{"interface-type":"ovsdb:interface-type-system"}],"ovsdb:ovs-version":"2.17.11","ovsdb:connection-info":{"local-port":6640,"remote-port":38848,"local-ip":"10.30.171.228","remote-ip":"10.30.171.177"},"ovsdb:openvswitch-external-ids":[{"external-id-key":"system-id","external-id-value":"4cb0bfbc-0bc4-4591-8cc9-bc6146d75221"},{"external-id-key":"hostname","external-id-value":"ubuntu-22-04-mininet-ovs-217-5ebb25bd-57cf-4a0a-aab5-227d5bff4b"},{"external-id-key":"rundir","external-id-value":"/var/run/openvswitch"}],"ovsdb:datapath-type-entry":[{"datapath-type":"ovsdb:datapath-type-netdev"},{"datapath-type":"ovsdb:datapath-type-system"}],"ovsdb:manager-entry":[{"target":"tcp:10.30.171.190:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.171.228:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.250:6640","number_of_connections":1,"connected":true}]}]}]}}' contains 'br-s1' 0 times, not 5 times.
04:45:41  ------------------------------------------------------------------------------
04:45:41  Add Port Manually and Verify After Recover :: Add port with OVS co... | FAIL |
04:45:48  Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: '{"network-topology:network-topology":{"topology":[{"topology-id":"ovsdb:1","node":[{"node-id":"ovsdb://uuid/548ac92b-69d7-4d67-8018-8c0c339a56f8","ovsdb:db-version":"8.3.0","ovsdb:interface-type-entry":[{"interface-type":"ovsdb:interface-type-vxlan"},{"interface-type":"ovsdb:interface-type-tap"},{"interface-type":"ovsdb:interface-type-stt"},{"interface-type":"ovsdb:interface-type-internal"},{"interface-type":"ovsdb:interface-type-patch"},{"interface-type":"ovsdb:interface-type-lisp"},{"interface-type":"ovsdb:interface-type-geneve"},{"interface-type":"ovsdb:interface-type-gre"},{"interface-type":"ovsdb:interface-type-system"}],"ovsdb:ovs-version":"2.17.11","ovsdb:connection-info":{"local-port":6640,"remote-port":38848,"local-ip":"10.30.171.228","remote-ip":"10.30.171.177"},"ovsdb:openvswitch-external-ids":[{"external-id-key":"system-id","external-id-value":"4cb0bfbc-0bc4-4591-8cc9-bc6146d75221"},{"external-id-key":"hostname","external-id-value":"ubuntu-22-04-mininet-ovs-217-5ebb25bd-57cf-4a0a-aab5-227d5bff4b"},{"external-id-key":"rundir","external-id-value":"/var/run/openvswitch"}],"ovsdb:datapath-type-entry":[{"datapath-type":"ovsdb:datapath-type-netdev"},{"datapath-type":"ovsdb:datapath-type-system"}],"ovsdb:manager-entry":[{"target":"tcp:10.30.171.190:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.171.228:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.250:6640","number_of_connections":1,"connected":true}]}]}]}}' contains 'vx1' 0 times, not 2 times.
04:45:48  ------------------------------------------------------------------------------
04:45:48  Create Tap Device After Recover :: Create tap devices to add to th... | PASS |
04:45:49  ------------------------------------------------------------------------------
04:45:49  Add Tap Device Manually and Verify After Recover :: Add tap device... | FAIL |
04:45:56  Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: '{"network-topology:network-topology":{"topology":[{"topology-id":"ovsdb:1","node":[{"node-id":"ovsdb://uuid/548ac92b-69d7-4d67-8018-8c0c339a56f8","ovsdb:db-version":"8.3.0","ovsdb:interface-type-entry":[{"interface-type":"ovsdb:interface-type-vxlan"},{"interface-type":"ovsdb:interface-type-tap"},{"interface-type":"ovsdb:interface-type-stt"},{"interface-type":"ovsdb:interface-type-internal"},{"interface-type":"ovsdb:interface-type-patch"},{"interface-type":"ovsdb:interface-type-lisp"},{"interface-type":"ovsdb:interface-type-geneve"},{"interface-type":"ovsdb:interface-type-gre"},{"interface-type":"ovsdb:interface-type-system"}],"ovsdb:ovs-version":"2.17.11","ovsdb:connection-info":{"local-port":6640,"remote-port":38848,"local-ip":"10.30.171.228","remote-ip":"10.30.171.177"},"ovsdb:openvswitch-external-ids":[{"external-id-key":"system-id","external-id-value":"4cb0bfbc-0bc4-4591-8cc9-bc6146d75221"},{"external-id-key":"hostname","external-id-value":"ubuntu-22-04-mininet-ovs-217-5ebb25bd-57cf-4a0a-aab5-227d5bff4b"},{"external-id-key":"rundir","external-id-value":"/var/run/openvswitch"}],"ovsdb:datapath-type-entry":[{"datapath-type":"ovsdb:datapath-type-netdev"},{"datapath-type":"ovsdb:datapath-type-system"}],"ovsdb:manager-entry":[{"target":"tcp:10.30.171.190:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.171.228:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.250:6640","number_of_connections":1,"connected":true}]}]}]}}' contains 'vport1' 0 times, not 2 times.
04:45:56  ------------------------------------------------------------------------------
04:45:56  Delete the Bridge Manually and Verify After Recover :: Delete brid... | PASS |
04:45:57  ------------------------------------------------------------------------------
04:45:57  Verify Modified Port After Recover :: Verify modified port exists ... | FAIL |
04:46:02  Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: HTTPError: 409 Client Error: Conflict for url: http://10.30.171.228:8181/rests/data/network-topology:network-topology/topology=ovsdb%3A1/node=ovsdb%3A%2F%2Fuuid%2F548ac92b-69d7-4d67-8018-8c0c339a56f8%2Fbridge%2Fbr01?content=nonconfig
04:46:02  ------------------------------------------------------------------------------
04:46:02  Delete Port In New Owner After Recover :: Delete port in Owner and... | FAIL |
04:46:02  Variable '${new_owner}' not found.
04:46:02  ------------------------------------------------------------------------------
04:46:02  Delete Bridge In New Owner And Verify After Recover :: Delete brid... | FAIL |
04:46:03  Variable '${new_owner}' not found.
04:46:03  ------------------------------------------------------------------------------
04:46:03  Create Bridge In Old Owner and Verify After Recover :: Create Brid... | FAIL |
04:46:03  Variable '${original_owner}' not found.
04:46:03  ------------------------------------------------------------------------------
04:46:03  Create Port In Old Owner and Verify After Recover :: Create Port i... | FAIL |
04:46:04  Variable '${original_owner}' not found.
04:46:04  ------------------------------------------------------------------------------
04:46:04  Modify the destination IP of Port In Old Owner After Recover :: Mo... | FAIL |
04:46:04  Variable '${original_owner}' not found.
04:46:04  ------------------------------------------------------------------------------
04:46:04  Verify Port Is Modified After Recover :: Verify port is modified i... | FAIL |
04:46:10  Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: HTTPError: 409 Client Error: Conflict for url: http://10.30.171.228:8181/rests/data/network-topology:network-topology/topology=ovsdb%3A1/node=ovsdb%3A%2F%2Fuuid%2F548ac92b-69d7-4d67-8018-8c0c339a56f8%2Fbridge%2Fbr01?content=nonconfig
04:46:10  ------------------------------------------------------------------------------
04:46:10  Delete Port In Old Owner After Recover :: Delete port in Owner and... | FAIL |
04:46:10  Variable '${original_owner}' not found.
04:46:10  ------------------------------------------------------------------------------
04:46:10  Delete Bridge In Old Owner And Verify After Recover :: Delete brid... | FAIL |
04:46:10  Variable '${original_owner}' not found.
04:46:10  ------------------------------------------------------------------------------
04:46:10  Cleans Up Test Environment For Next Suite :: Cleans up test enviro... | FAIL |
04:46:20  Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: '{"network-topology:network-topology":{"topology":[{"topology-id":"ovsdb:1","node":[{"node-id":"ovsdb://uuid/548ac92b-69d7-4d67-8018-8c0c339a56f8","ovsdb:db-version":"8.3.0","ovsdb:interface-type-entry":[{"interface-type":"ovsdb:interface-type-vxlan"},{"interface-type":"ovsdb:interface-type-tap"},{"interface-type":"ovsdb:interface-type-stt"},{"interface-type":"ovsdb:interface-type-internal"},{"interface-type":"ovsdb:interface-type-patch"},{"interface-type":"ovsdb:interface-type-lisp"},{"interface-type":"ovsdb:interface-type-geneve"},{"interface-type":"ovsdb:interface-type-gre"},{"interface-type":"ovsdb:interface-type-system"}],"ovsdb:ovs-version":"2.17.11","ovsdb:connection-info":{"local-port":6640,"remote-port":38848,"local-ip":"10.30.171.228","remote-ip":"10.30.171.177"},"ovsdb:openvswitch-external-ids":[{"external-id-key":"system-id","external-id-value":"4cb0bfbc-0bc4-4591-8cc9-bc6146d75221"},{"external-id-key":"hostname","external-id-value":"ubuntu-22-04-mininet-ovs-217-5ebb25bd-57cf-4a0a-aab5-227d5bff4b"},{"external-id-key":"rundir","external-id-value":"/var/run/openvswitch"}],"ovsdb:datapath-type-entry":[{"datapath-type":"ovsdb:datapath-type-netdev"},{"datapath-type":"ovsdb:datapath-type-system"}],"ovsdb:manager-entry":[{"target":"tcp:10.30.171.190:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.171.228:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.250:6640","number_of_connections":1,"connected":true}]}]}]}}' contains 'ovsdb://uuid' 1 time, not 0 times.
04:46:20  ------------------------------------------------------------------------------
04:46:20  ovsdb-upstream-clustering.txt.Southbound Cluster.Ovsdb Southbound ... | FAIL |
04:46:20  44 tests, 8 passed, 36 failed
04:46:20  ==============================================================================
04:46:20  ovsdb-upstream-clustering.txt.Southbound Cluster.Southbound Cluster Extensi...
04:46:20  ==============================================================================
04:46:23  Check Shards Status Before Fail :: Check Status for all shards in ... | PASS |
04:46:25  ------------------------------------------------------------------------------
04:46:25  Start OVS Multiple Connections :: Connect OVS to all cluster insta... | PASS |
04:46:30  ------------------------------------------------------------------------------
04:46:30  Check Entity Owner Status And Find Owner and Candidate Before Fail... | FAIL |
04:46:51  Keyword 'ClusterManagement.Verify_Owner_And_Successors_For_Device' failed after retrying for 20 seconds. The last error was: Successor list [] is not the came as expected [1, 3]
04:46:51  Lengths are different: 2 != 0
04:46:51  ------------------------------------------------------------------------------
04:46:51  Create Bridge Manually and Verify Before Fail :: Create bridge wit... | FAIL |
04:46:57  Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: '{"network-topology:network-topology":{"topology":[{"topology-id":"ovsdb:1","node":[{"node-id":"ovsdb://uuid/548ac92b-69d7-4d67-8018-8c0c339a56f8","ovsdb:db-version":"8.3.0","ovsdb:interface-type-entry":[{"interface-type":"ovsdb:interface-type-vxlan"},{"interface-type":"ovsdb:interface-type-tap"},{"interface-type":"ovsdb:interface-type-stt"},{"interface-type":"ovsdb:interface-type-internal"},{"interface-type":"ovsdb:interface-type-patch"},{"interface-type":"ovsdb:interface-type-lisp"},{"interface-type":"ovsdb:interface-type-geneve"},{"interface-type":"ovsdb:interface-type-gre"},{"interface-type":"ovsdb:interface-type-system"}],"ovsdb:ovs-version":"2.17.11","ovsdb:connection-info":{"local-port":6640,"remote-port":38848,"local-ip":"10.30.171.228","remote-ip":"10.30.171.177"},"ovsdb:openvswitch-external-ids":[{"external-id-key":"system-id","external-id-value":"4cb0bfbc-0bc4-4591-8cc9-bc6146d75221"},{"external-id-key":"hostname","external-id-value":"ubuntu-22-04-mininet-ovs-217-5ebb25bd-57cf-4a0a-aab5-227d5bff4b"},{"external-id-key":"rundir","external-id-value":"/var/run/openvswitch"}],"ovsdb:datapath-type-entry":[{"datapath-type":"ovsdb:datapath-type-netdev"},{"datapath-type":"ovsdb:datapath-type-system"}],"ovsdb:manager-entry":[{"target":"tcp:10.30.171.190:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.171.228:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.250:6640","number_of_connections":1,"connected":true}]}]}]}}' contains 'br-s1' 0 times, not 5 times.
04:46:57  ------------------------------------------------------------------------------
04:46:57  Add Port Manually and Verify Before Fail :: Add port with OVS comm... | FAIL |
04:47:04  Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: '{"network-topology:network-topology":{"topology":[{"topology-id":"ovsdb:1","node":[{"node-id":"ovsdb://uuid/548ac92b-69d7-4d67-8018-8c0c339a56f8","ovsdb:db-version":"8.3.0","ovsdb:interface-type-entry":[{"interface-type":"ovsdb:interface-type-vxlan"},{"interface-type":"ovsdb:interface-type-tap"},{"interface-type":"ovsdb:interface-type-stt"},{"interface-type":"ovsdb:interface-type-internal"},{"interface-type":"ovsdb:interface-type-patch"},{"interface-type":"ovsdb:interface-type-lisp"},{"interface-type":"ovsdb:interface-type-geneve"},{"interface-type":"ovsdb:interface-type-gre"},{"interface-type":"ovsdb:interface-type-system"}],"ovsdb:ovs-version":"2.17.11","ovsdb:connection-info":{"local-port":6640,"remote-port":38848,"local-ip":"10.30.171.228","remote-ip":"10.30.171.177"},"ovsdb:openvswitch-external-ids":[{"external-id-key":"system-id","external-id-value":"4cb0bfbc-0bc4-4591-8cc9-bc6146d75221"},{"external-id-key":"hostname","external-id-value":"ubuntu-22-04-mininet-ovs-217-5ebb25bd-57cf-4a0a-aab5-227d5bff4b"},{"external-id-key":"rundir","external-id-value":"/var/run/openvswitch"}],"ovsdb:datapath-type-entry":[{"datapath-type":"ovsdb:datapath-type-netdev"},{"datapath-type":"ovsdb:datapath-type-system"}],"ovsdb:manager-entry":[{"target":"tcp:10.30.171.190:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.171.228:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.250:6640","number_of_connections":1,"connected":true}]}]}]}}' contains 'vx1' 0 times, not 2 times.
04:47:04  ------------------------------------------------------------------------------
04:47:04  Delete the Bridge Manually and Verify Before Fail :: Delete bridge... | PASS |
04:47:04  ------------------------------------------------------------------------------
04:47:04  Create Bridge In Owner and Verify Before Fail :: Create Bridge in ... | FAIL |
04:47:05  Variable '${original_owner}' not found.
04:47:05  ------------------------------------------------------------------------------
04:47:05  Create Port In Owner and Verify Before Fail :: Create Port in Owne... | FAIL |
04:47:05  Variable '${original_owner}' not found.
04:47:05  ------------------------------------------------------------------------------
04:47:05  Modify the destination IP of Port In Owner Before Fail :: Modify t... | FAIL |
04:47:05  Variable '${original_owner}' not found.
04:47:05  ------------------------------------------------------------------------------
04:47:05  Verify Port Is Modified Before Fail :: Verify port is modified in ... | FAIL |
04:47:11  Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: HTTPError: 409 Client Error: Conflict for url: http://10.30.171.228:8181/rests/data/network-topology:network-topology/topology=ovsdb%3A1/node=ovsdb%3A%2F%2Fuuid%2F548ac92b-69d7-4d67-8018-8c0c339a56f8%2Fbridge%2Fbr01?content=nonconfig
04:47:11  ------------------------------------------------------------------------------
04:47:11  Delete Port In Owner Before Fail :: Delete port in Owner and verif... | FAIL |
04:47:11  Variable '${original_owner}' not found.
04:47:11  ------------------------------------------------------------------------------
04:47:11  Delete Bridge In Owner And Verify Before Fail :: Delete bridge in ... | FAIL |
04:47:12  Variable '${original_owner}' not found.
04:47:12  ------------------------------------------------------------------------------
04:47:12  Kill Candidate Instance :: Kill Owner Instance and verify it is dead  | FAIL |
04:47:12  Variable '${original_candidate}' not found.
04:47:12  ------------------------------------------------------------------------------
04:47:12  Check Shards Status After Fail :: Create original cluster list and... | FAIL |
04:47:12  Variable '${new_cluster_list}' not found.
04:47:12  ------------------------------------------------------------------------------
04:47:12  Check Entity Owner Status And Find Owner and Candidate After Fail ... | FAIL |
04:47:13  Variable '${original_owner}' not found.
04:47:13  ------------------------------------------------------------------------------
04:47:13  Create Bridge Manually and Verify After Fail :: Create bridge with... | FAIL |
04:47:13  Variable '${new_cluster_list}' not found.
04:47:13  ------------------------------------------------------------------------------
04:47:13  Add Port Manually and Verify After Fail :: Add port with OVS comma... | FAIL |
04:47:13  Variable '${new_cluster_list}' not found.
04:47:13  ------------------------------------------------------------------------------
04:47:13  Delete the Bridge Manually and Verify After Fail :: Delete bridge ... | FAIL |
04:47:14  Variable '${new_cluster_list}' not found.
04:47:14  ------------------------------------------------------------------------------
04:47:14  Create Bridge In Owner and Verify After Fail :: Create Bridge in O... | FAIL |
04:47:14  Variable '${new_owner}' not found.
04:47:14  ------------------------------------------------------------------------------
04:47:14  Create Port In Owner and Verify After Fail :: Create Port in Owner... | FAIL |
04:47:14  Variable '${new_owner}' not found.
04:47:14  ------------------------------------------------------------------------------
04:47:14  Modify the destination IP of Port In Owner After Fail :: Modify th... | FAIL |
04:47:15  Variable '${new_owner}' not found.
04:47:15  ------------------------------------------------------------------------------
04:47:15  Verify Port Is Modified After Fail :: Verify port is modified in a... | FAIL |
04:47:15  Variable '${new_cluster_list}' not found.
04:47:15  ------------------------------------------------------------------------------
04:47:15  Start Old Candidate Instance :: Start Owner Instance and verify it... | FAIL |
04:47:15  Variable '${original_candidate}' not found.
04:47:15  ------------------------------------------------------------------------------
04:47:15  Check Shards Status After Recover :: Create original cluster list ... | PASS |
04:47:18  ------------------------------------------------------------------------------
04:47:18  Check Entity Owner Status After Recover :: Check Entity Owner Stat... | FAIL |
04:47:39  Keyword 'ClusterManagement.Verify_Owner_And_Successors_For_Device' failed after retrying for 20 seconds. The last error was: Successor list [] is not the came as expected [1, 3]
04:47:39  Lengths are different: 2 != 0
04:47:39  ------------------------------------------------------------------------------
04:47:39  Create Bridge Manually and Verify After Recover :: Create bridge w... | FAIL |
04:47:45  Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: '{"network-topology:network-topology":{"topology":[{"topology-id":"ovsdb:1","node":[{"node-id":"ovsdb://uuid/548ac92b-69d7-4d67-8018-8c0c339a56f8","ovsdb:db-version":"8.3.0","ovsdb:interface-type-entry":[{"interface-type":"ovsdb:interface-type-vxlan"},{"interface-type":"ovsdb:interface-type-tap"},{"interface-type":"ovsdb:interface-type-stt"},{"interface-type":"ovsdb:interface-type-internal"},{"interface-type":"ovsdb:interface-type-patch"},{"interface-type":"ovsdb:interface-type-lisp"},{"interface-type":"ovsdb:interface-type-geneve"},{"interface-type":"ovsdb:interface-type-gre"},{"interface-type":"ovsdb:interface-type-system"}],"ovsdb:ovs-version":"2.17.11","ovsdb:connection-info":{"local-port":6640,"remote-port":38848,"local-ip":"10.30.171.228","remote-ip":"10.30.171.177"},"ovsdb:openvswitch-external-ids":[{"external-id-key":"system-id","external-id-value":"4cb0bfbc-0bc4-4591-8cc9-bc6146d75221"},{"external-id-key":"hostname","external-id-value":"ubuntu-22-04-mininet-ovs-217-5ebb25bd-57cf-4a0a-aab5-227d5bff4b"},{"external-id-key":"rundir","external-id-value":"/var/run/openvswitch"}],"ovsdb:datapath-type-entry":[{"datapath-type":"ovsdb:datapath-type-netdev"},{"datapath-type":"ovsdb:datapath-type-system"}],"ovsdb:manager-entry":[{"target":"tcp:10.30.171.190:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.171.228:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.250:6640","number_of_connections":1,"connected":true}]}]}]}}' contains 'br-s1' 0 times, not 5 times.
04:47:45  ------------------------------------------------------------------------------
04:47:45  Add Port Manually and Verify After Recover :: Add port with OVS co... | FAIL |
04:47:52  Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: '{"network-topology:network-topology":{"topology":[{"topology-id":"ovsdb:1","node":[{"node-id":"ovsdb://uuid/548ac92b-69d7-4d67-8018-8c0c339a56f8","ovsdb:db-version":"8.3.0","ovsdb:interface-type-entry":[{"interface-type":"ovsdb:interface-type-vxlan"},{"interface-type":"ovsdb:interface-type-tap"},{"interface-type":"ovsdb:interface-type-stt"},{"interface-type":"ovsdb:interface-type-internal"},{"interface-type":"ovsdb:interface-type-patch"},{"interface-type":"ovsdb:interface-type-lisp"},{"interface-type":"ovsdb:interface-type-geneve"},{"interface-type":"ovsdb:interface-type-gre"},{"interface-type":"ovsdb:interface-type-system"}],"ovsdb:ovs-version":"2.17.11","ovsdb:connection-info":{"local-port":6640,"remote-port":38848,"local-ip":"10.30.171.228","remote-ip":"10.30.171.177"},"ovsdb:openvswitch-external-ids":[{"external-id-key":"system-id","external-id-value":"4cb0bfbc-0bc4-4591-8cc9-bc6146d75221"},{"external-id-key":"hostname","external-id-value":"ubuntu-22-04-mininet-ovs-217-5ebb25bd-57cf-4a0a-aab5-227d5bff4b"},{"external-id-key":"rundir","external-id-value":"/var/run/openvswitch"}],"ovsdb:datapath-type-entry":[{"datapath-type":"ovsdb:datapath-type-netdev"},{"datapath-type":"ovsdb:datapath-type-system"}],"ovsdb:manager-entry":[{"target":"tcp:10.30.171.190:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.171.228:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.250:6640","number_of_connections":1,"connected":true}]}]}]}}' contains 'vx1' 0 times, not 2 times.
04:47:52  ------------------------------------------------------------------------------
04:47:52  Delete the Bridge Manually and Verify After Recover :: Delete brid... | PASS |
04:47:53  ------------------------------------------------------------------------------
04:47:53  Verify Modified Port After Recover :: Verify modified port exists ... | FAIL |
04:47:58  Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: HTTPError: 409 Client Error: Conflict for url: http://10.30.171.228:8181/rests/data/network-topology:network-topology/topology=ovsdb%3A1/node=ovsdb%3A%2F%2Fuuid%2F548ac92b-69d7-4d67-8018-8c0c339a56f8%2Fbridge%2Fbr01?content=nonconfig
04:47:58  ------------------------------------------------------------------------------
04:47:58  Delete Port In New Owner After Recover :: Delete port in Owner and... | FAIL |
04:47:59  Variable '${new_owner}' not found.
04:47:59  ------------------------------------------------------------------------------
04:47:59  Delete Bridge In New Owner And Verify After Recover :: Delete brid... | FAIL |
04:47:59  Variable '${new_owner}' not found.
04:47:59  ------------------------------------------------------------------------------
04:47:59  Create Bridge In Old Candidate and Verify After Recover :: Create ... | FAIL |
04:48:00  Variable '${original_candidate}' not found.
04:48:00  ------------------------------------------------------------------------------
04:48:00  Create Port In Old Owner and Verify After Recover :: Create Port i... | FAIL |
04:48:00  Variable '${original_candidate}' not found.
04:48:00  ------------------------------------------------------------------------------
04:48:00  Modify the destination IP of Port In Old Owner After Recover :: Mo... | FAIL |
04:48:00  Variable '${original_candidate}' not found.
04:48:00  ------------------------------------------------------------------------------
04:48:00  Verify Port Is Modified After Recover :: Verify port is modified i... | FAIL |
04:48:06  Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: HTTPError: 409 Client Error: Conflict for url: http://10.30.171.228:8181/rests/data/network-topology:network-topology/topology=ovsdb%3A1/node=ovsdb%3A%2F%2Fuuid%2F548ac92b-69d7-4d67-8018-8c0c339a56f8%2Fbridge%2Fbr01?content=nonconfig
04:48:06  ------------------------------------------------------------------------------
04:48:06  Delete Port In Old Owner After Recover :: Delete port in Owner and... | FAIL |
04:48:06  Variable '${original_candidate}' not found.
04:48:06  ------------------------------------------------------------------------------
04:48:06  Delete Bridge In Old Owner And Verify After Recover :: Delete brid... | FAIL |
04:48:07  Variable '${original_candidate}' not found.
04:48:07  ------------------------------------------------------------------------------
04:48:07  Cleans Up Test Environment For Next Suite :: Cleans up test enviro... | FAIL |
04:48:16  Keyword 'ClusterManagement.Check_Item_Occurrence_Member_List_Or_All' failed after retrying for 5 seconds. The last error was: '{"network-topology:network-topology":{"topology":[{"topology-id":"ovsdb:1","node":[{"node-id":"ovsdb://uuid/548ac92b-69d7-4d67-8018-8c0c339a56f8","ovsdb:db-version":"8.3.0","ovsdb:interface-type-entry":[{"interface-type":"ovsdb:interface-type-vxlan"},{"interface-type":"ovsdb:interface-type-tap"},{"interface-type":"ovsdb:interface-type-stt"},{"interface-type":"ovsdb:interface-type-internal"},{"interface-type":"ovsdb:interface-type-patch"},{"interface-type":"ovsdb:interface-type-lisp"},{"interface-type":"ovsdb:interface-type-geneve"},{"interface-type":"ovsdb:interface-type-gre"},{"interface-type":"ovsdb:interface-type-system"}],"ovsdb:ovs-version":"2.17.11","ovsdb:connection-info":{"local-port":6640,"remote-port":38848,"local-ip":"10.30.171.228","remote-ip":"10.30.171.177"},"ovsdb:openvswitch-external-ids":[{"external-id-key":"system-id","external-id-value":"4cb0bfbc-0bc4-4591-8cc9-bc6146d75221"},{"external-id-key":"hostname","external-id-value":"ubuntu-22-04-mininet-ovs-217-5ebb25bd-57cf-4a0a-aab5-227d5bff4b"},{"external-id-key":"rundir","external-id-value":"/var/run/openvswitch"}],"ovsdb:datapath-type-entry":[{"datapath-type":"ovsdb:datapath-type-netdev"},{"datapath-type":"ovsdb:datapath-type-system"}],"ovsdb:manager-entry":[{"target":"tcp:10.30.171.190:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.171.228:6640","number_of_connections":1,"connected":true},{"target":"tcp:10.30.170.250:6640","number_of_connections":1,"connected":true}]}]}]}}' contains 'ovsdb://uuid' 1 time, not 0 times.
04:48:16  ------------------------------------------------------------------------------
04:48:16  ovsdb-upstream-clustering.txt.Southbound Cluster.Southbound Cluste... | FAIL |
04:48:16  38 tests, 5 passed, 33 failed
04:48:16  ==============================================================================
04:48:16  ovsdb-upstream-clustering.txt.Southbound Cluster                      | FAIL |
04:48:16  82 tests, 13 passed, 69 failed
04:48:16  ==============================================================================
04:48:16  ovsdb-upstream-clustering.txt                                         | FAIL |
04:48:16  164 tests, 45 passed, 119 failed
04:48:16  ==============================================================================
04:48:16  Output:  /w/workspace/ovsdb-csit-3node-upstream-clustering-only-calcium/output.xml
04:48:23  Log:     /w/workspace/ovsdb-csit-3node-upstream-clustering-only-calcium/log.html
04:48:23  Report:  /w/workspace/ovsdb-csit-3node-upstream-clustering-only-calcium/report.html
04:48:23  + true
04:48:23  + echo 'Examining the files in data/log and checking filesize'
04:48:23  Examining the files in data/log and checking filesize
04:48:23  + ssh 10.30.171.228 'ls -altr /tmp/karaf-0.20.4/data/log/'
04:48:23  Warning: Permanently added '10.30.171.228' (ECDSA) to the list of known hosts.
04:48:23  total 668
04:48:23  drwxrwxr-x 2 jenkins jenkins   4096 Feb 25 04:35 .
04:48:23  drwxrwxr-x 9 jenkins jenkins   4096 Feb 25 04:35 ..
04:48:23  -rw-rw-r-- 1 jenkins jenkins   4232 Feb 25 04:39 karaf_console.log
04:48:23  -rw-rw-r-- 1 jenkins jenkins 665161 Feb 25 04:48 karaf.log
04:48:23  + ssh 10.30.171.228 'du -hs /tmp/karaf-0.20.4/data/log/*'
04:48:23  Warning: Permanently added '10.30.171.228' (ECDSA) to the list of known hosts.
04:48:24  652K	/tmp/karaf-0.20.4/data/log/karaf.log
04:48:24  8.0K	/tmp/karaf-0.20.4/data/log/karaf_console.log
04:48:24  + ssh 10.30.170.250 'ls -altr /tmp/karaf-0.20.4/data/log/'
04:48:24  Warning: Permanently added '10.30.170.250' (ECDSA) to the list of known hosts.
04:48:24  total 568
04:48:24  drwxrwxr-x 2 jenkins jenkins   4096 Feb 25 04:35 .
04:48:24  drwxrwxr-x 9 jenkins jenkins   4096 Feb 25 04:35 ..
04:48:24  -rw-rw-r-- 1 jenkins jenkins   4225 Feb 25 04:39 karaf_console.log
04:48:24  -rw-rw-r-- 1 jenkins jenkins 562771 Feb 25 04:48 karaf.log
04:48:24  + ssh 10.30.170.250 'du -hs /tmp/karaf-0.20.4/data/log/*'
04:48:24  Warning: Permanently added '10.30.170.250' (ECDSA) to the list of known hosts.
04:48:24  552K	/tmp/karaf-0.20.4/data/log/karaf.log
04:48:24  8.0K	/tmp/karaf-0.20.4/data/log/karaf_console.log
04:48:24  + ssh 10.30.171.190 'ls -altr /tmp/karaf-0.20.4/data/log/'
04:48:24  Warning: Permanently added '10.30.171.190' (ECDSA) to the list of known hosts.
04:48:25  total 500
04:48:25  drwxrwxr-x 2 jenkins jenkins   4096 Feb 25 04:35 .
04:48:25  -rw-rw-r-- 1 jenkins jenkins   1720 Feb 25 04:35 karaf_console.log
04:48:25  drwxrwxr-x 9 jenkins jenkins   4096 Feb 25 04:35 ..
04:48:25  -rw-rw-r-- 1 jenkins jenkins 496837 Feb 25 04:48 karaf.log
04:48:25  + ssh 10.30.171.190 'du -hs /tmp/karaf-0.20.4/data/log/*'
04:48:25  Warning: Permanently added '10.30.171.190' (ECDSA) to the list of known hosts.
04:48:25  488K	/tmp/karaf-0.20.4/data/log/karaf.log
04:48:25  4.0K	/tmp/karaf-0.20.4/data/log/karaf_console.log
04:48:25  + set +e
04:48:25  ++ seq 1 3
04:48:25  + for i in $(seq 1 "${NUM_ODL_SYSTEM}")
04:48:25  + CONTROLLERIP=ODL_SYSTEM_1_IP
04:48:25  + echo 'Let'\''s take the karaf thread dump again'
04:48:25  Let's take the karaf thread dump again
04:48:25  + ssh 10.30.171.228 'sudo ps aux'
04:48:25  Warning: Permanently added '10.30.171.228' (ECDSA) to the list of known hosts.
04:48:25  ++ grep org.apache.karaf.main.Main /w/workspace/ovsdb-csit-3node-upstream-clustering-only-calcium/ps_after.log
04:48:25  ++ grep -v grep
04:48:25  ++ tr -s ' '
04:48:25  ++ cut -f2 '-d '
04:48:25  + pid=31215
04:48:25  + echo 'karaf main: org.apache.karaf.main.Main, pid:31215'
04:48:25  karaf main: org.apache.karaf.main.Main, pid:31215
04:48:25  + ssh 10.30.171.228 '/usr/lib/jvm/java-17-openjdk-amd64/bin/jstack -l 31215'
04:48:25  Warning: Permanently added '10.30.171.228' (ECDSA) to the list of known hosts.
04:48:26  + echo 'killing karaf process...'
04:48:26  killing karaf process...
04:48:26  + ssh 10.30.171.228 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh'
04:48:26  Warning: Permanently added '10.30.171.228' (ECDSA) to the list of known hosts.
04:48:26  + for i in $(seq 1 "${NUM_ODL_SYSTEM}")
04:48:26  + CONTROLLERIP=ODL_SYSTEM_2_IP
04:48:26  + echo 'Let'\''s take the karaf thread dump again'
04:48:26  Let's take the karaf thread dump again
04:48:26  + ssh 10.30.170.250 'sudo ps aux'
04:48:26  Warning: Permanently added '10.30.170.250' (ECDSA) to the list of known hosts.
04:48:26  ++ tr -s ' '
04:48:26  ++ grep org.apache.karaf.main.Main /w/workspace/ovsdb-csit-3node-upstream-clustering-only-calcium/ps_after.log
04:48:26  ++ cut -f2 '-d '
04:48:26  ++ grep -v grep
04:48:26  + pid=28743
04:48:26  + echo 'karaf main: org.apache.karaf.main.Main, pid:28743'
04:48:26  karaf main: org.apache.karaf.main.Main, pid:28743
04:48:26  + ssh 10.30.170.250 '/usr/lib/jvm/java-17-openjdk-amd64/bin/jstack -l 28743'
04:48:26  Warning: Permanently added '10.30.170.250' (ECDSA) to the list of known hosts.
04:48:27  + echo 'killing karaf process...'
04:48:27  killing karaf process...
04:48:27  + ssh 10.30.170.250 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh'
04:48:27  Warning: Permanently added '10.30.170.250' (ECDSA) to the list of known hosts.
04:48:27  + for i in $(seq 1 "${NUM_ODL_SYSTEM}")
04:48:27  + CONTROLLERIP=ODL_SYSTEM_3_IP
04:48:27  + echo 'Let'\''s take the karaf thread dump again'
04:48:27  Let's take the karaf thread dump again
04:48:27  + ssh 10.30.171.190 'sudo ps aux'
04:48:27  Warning: Permanently added '10.30.171.190' (ECDSA) to the list of known hosts.
04:48:27  ++ grep org.apache.karaf.main.Main /w/workspace/ovsdb-csit-3node-upstream-clustering-only-calcium/ps_after.log
04:48:27  ++ grep -v grep
04:48:27  ++ tr -s ' '
04:48:27  ++ cut -f2 '-d '
04:48:27  + pid=28745
04:48:27  + echo 'karaf main: org.apache.karaf.main.Main, pid:28745'
04:48:27  karaf main: org.apache.karaf.main.Main, pid:28745
04:48:27  + ssh 10.30.171.190 '/usr/lib/jvm/java-17-openjdk-amd64/bin/jstack -l 28745'
04:48:27  Warning: Permanently added '10.30.171.190' (ECDSA) to the list of known hosts.
04:48:28  + echo 'killing karaf process...'
04:48:28  killing karaf process...
04:48:28  + ssh 10.30.171.190 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh'
04:48:28  Warning: Permanently added '10.30.171.190' (ECDSA) to the list of known hosts.
04:48:28  + sleep 5
04:48:33  ++ seq 1 3
04:48:33  + for i in $(seq 1 "${NUM_ODL_SYSTEM}")
04:48:33  + CONTROLLERIP=ODL_SYSTEM_1_IP
04:48:33  + echo 'Compressing karaf.log 1'
04:48:33  Compressing karaf.log 1
04:48:33  + ssh 10.30.171.228 gzip --best /tmp/karaf-0.20.4/data/log/karaf.log
04:48:33  Warning: Permanently added '10.30.171.228' (ECDSA) to the list of known hosts.
04:48:33  + echo 'Fetching compressed karaf.log 1'
04:48:33  Fetching compressed karaf.log 1
04:48:33  + scp 10.30.171.228:/tmp/karaf-0.20.4/data/log/karaf.log.gz odl1_karaf.log.gz
04:48:33  Warning: Permanently added '10.30.171.228' (ECDSA) to the list of known hosts.
04:48:34  + ssh 10.30.171.228 rm -f /tmp/karaf-0.20.4/data/log/karaf.log.gz
04:48:34  Warning: Permanently added '10.30.171.228' (ECDSA) to the list of known hosts.
04:48:34  + scp 10.30.171.228:/tmp/karaf-0.20.4/data/log/karaf_console.log odl1_karaf_console.log
04:48:34  Warning: Permanently added '10.30.171.228' (ECDSA) to the list of known hosts.
04:48:34  + ssh 10.30.171.228 rm -f /tmp/karaf-0.20.4/data/log/karaf_console.log
04:48:34  Warning: Permanently added '10.30.171.228' (ECDSA) to the list of known hosts.
04:48:34  + echo 'Fetch GC logs'
04:48:34  Fetch GC logs
04:48:34  + mkdir -p gclogs-1
04:48:34  + scp '10.30.171.228:/tmp/karaf-0.20.4/data/log/*.log' gclogs-1/
04:48:34  Warning: Permanently added '10.30.171.228' (ECDSA) to the list of known hosts.
04:48:35  scp: /tmp/karaf-0.20.4/data/log/*.log: No such file or directory
04:48:35  + for i in $(seq 1 "${NUM_ODL_SYSTEM}")
04:48:35  + CONTROLLERIP=ODL_SYSTEM_2_IP
04:48:35  + echo 'Compressing karaf.log 2'
04:48:35  Compressing karaf.log 2
04:48:35  + ssh 10.30.170.250 gzip --best /tmp/karaf-0.20.4/data/log/karaf.log
04:48:35  Warning: Permanently added '10.30.170.250' (ECDSA) to the list of known hosts.
04:48:35  + echo 'Fetching compressed karaf.log 2'
04:48:35  Fetching compressed karaf.log 2
04:48:35  + scp 10.30.170.250:/tmp/karaf-0.20.4/data/log/karaf.log.gz odl2_karaf.log.gz
04:48:35  Warning: Permanently added '10.30.170.250' (ECDSA) to the list of known hosts.
04:48:35  + ssh 10.30.170.250 rm -f /tmp/karaf-0.20.4/data/log/karaf.log.gz
04:48:35  Warning: Permanently added '10.30.170.250' (ECDSA) to the list of known hosts.
04:48:35  + scp 10.30.170.250:/tmp/karaf-0.20.4/data/log/karaf_console.log odl2_karaf_console.log
04:48:35  Warning: Permanently added '10.30.170.250' (ECDSA) to the list of known hosts.
04:48:36  + ssh 10.30.170.250 rm -f /tmp/karaf-0.20.4/data/log/karaf_console.log
04:48:36  Warning: Permanently added '10.30.170.250' (ECDSA) to the list of known hosts.
04:48:36  + echo 'Fetch GC logs'
04:48:36  Fetch GC logs
04:48:36  + mkdir -p gclogs-2
04:48:36  + scp '10.30.170.250:/tmp/karaf-0.20.4/data/log/*.log' gclogs-2/
04:48:36  Warning: Permanently added '10.30.170.250' (ECDSA) to the list of known hosts.
04:48:36  scp: /tmp/karaf-0.20.4/data/log/*.log: No such file or directory
04:48:36  + for i in $(seq 1 "${NUM_ODL_SYSTEM}")
04:48:36  + CONTROLLERIP=ODL_SYSTEM_3_IP
04:48:36  + echo 'Compressing karaf.log 3'
04:48:36  Compressing karaf.log 3
04:48:36  + ssh 10.30.171.190 gzip --best /tmp/karaf-0.20.4/data/log/karaf.log
04:48:36  Warning: Permanently added '10.30.171.190' (ECDSA) to the list of known hosts.
04:48:36  + echo 'Fetching compressed karaf.log 3'
04:48:36  Fetching compressed karaf.log 3
04:48:36  + scp 10.30.171.190:/tmp/karaf-0.20.4/data/log/karaf.log.gz odl3_karaf.log.gz
04:48:36  Warning: Permanently added '10.30.171.190' (ECDSA) to the list of known hosts.
04:48:37  + ssh 10.30.171.190 rm -f /tmp/karaf-0.20.4/data/log/karaf.log.gz
04:48:37  Warning: Permanently added '10.30.171.190' (ECDSA) to the list of known hosts.
04:48:37  + scp 10.30.171.190:/tmp/karaf-0.20.4/data/log/karaf_console.log odl3_karaf_console.log
04:48:37  Warning: Permanently added '10.30.171.190' (ECDSA) to the list of known hosts.
04:48:37  + ssh 10.30.171.190 rm -f /tmp/karaf-0.20.4/data/log/karaf_console.log
04:48:37  Warning: Permanently added '10.30.171.190' (ECDSA) to the list of known hosts.
04:48:37  + echo 'Fetch GC logs'
04:48:37  Fetch GC logs
04:48:37  + mkdir -p gclogs-3
04:48:37  + scp '10.30.171.190:/tmp/karaf-0.20.4/data/log/*.log' gclogs-3/
04:48:37  Warning: Permanently added '10.30.171.190' (ECDSA) to the list of known hosts.
04:48:38  scp: /tmp/karaf-0.20.4/data/log/*.log: No such file or directory
04:48:38  + echo 'Examine copied files'
04:48:38  Examine copied files
04:48:38  + ls -lt
04:48:38  total 31172
04:48:38  drwxrwxr-x. 2 jenkins jenkins        6 Feb 25 04:48 gclogs-3
04:48:38  -rw-rw-r--. 1 jenkins jenkins     1720 Feb 25 04:48 odl3_karaf_console.log
04:48:38  -rw-rw-r--. 1 jenkins jenkins    36651 Feb 25 04:48 odl3_karaf.log.gz
04:48:38  drwxrwxr-x. 2 jenkins jenkins        6 Feb 25 04:48 gclogs-2
04:48:38  -rw-rw-r--. 1 jenkins jenkins     4225 Feb 25 04:48 odl2_karaf_console.log
04:48:38  -rw-rw-r--. 1 jenkins jenkins    41140 Feb 25 04:48 odl2_karaf.log.gz
04:48:38  drwxrwxr-x. 2 jenkins jenkins        6 Feb 25 04:48 gclogs-1
04:48:38  -rw-rw-r--. 1 jenkins jenkins     4232 Feb 25 04:48 odl1_karaf_console.log
04:48:38  -rw-rw-r--. 1 jenkins jenkins    51596 Feb 25 04:48 odl1_karaf.log.gz
04:48:38  -rw-rw-r--. 1 jenkins jenkins   108959 Feb 25 04:48 karaf_3_28745_threads_after.log
04:48:38  -rw-rw-r--. 1 jenkins jenkins    16063 Feb 25 04:48 ps_after.log
04:48:38  -rw-rw-r--. 1 jenkins jenkins   108533 Feb 25 04:48 karaf_2_28743_threads_after.log
04:48:38  -rw-rw-r--. 1 jenkins jenkins   107519 Feb 25 04:48 karaf_1_31215_threads_after.log
04:48:38  -rw-rw-r--. 1 jenkins jenkins   264876 Feb 25 04:48 report.html
04:48:38  -rw-rw-r--. 1 jenkins jenkins  3181044 Feb 25 04:48 log.html
04:48:38  -rw-rw-r--. 1 jenkins jenkins 27648536 Feb 25 04:48 output.xml
04:48:38  -rw-rw-r--. 1 jenkins jenkins      243 Feb 25 04:38 testplan.txt
04:48:38  -rw-rw-r--. 1 jenkins jenkins    85229 Feb 25 04:38 karaf_3_28745_threads_before.log
04:48:38  -rw-rw-r--. 1 jenkins jenkins    16200 Feb 25 04:38 ps_before.log
04:48:38  -rw-rw-r--. 1 jenkins jenkins    83478 Feb 25 04:38 karaf_2_28743_threads_before.log
04:48:38  -rw-rw-r--. 1 jenkins jenkins    81016 Feb 25 04:38 karaf_1_28718_threads_before.log
04:48:38  -rw-rw-r--. 1 jenkins jenkins     3043 Feb 25 04:35 post-startup-script.sh
04:48:38  -rw-rw-r--. 1 jenkins jenkins      225 Feb 25 04:34 startup-script.sh
04:48:38  -rw-rw-r--. 1 jenkins jenkins     3228 Feb 25 04:34 configuration-script.sh
04:48:38  -rw-rw-r--. 1 jenkins jenkins      266 Feb 25 04:34 detect_variables.env
04:48:38  -rw-rw-r--. 1 jenkins jenkins       92 Feb 25 04:34 set_variables.env
04:48:38  -rw-rw-r--. 1 jenkins jenkins      359 Feb 25 04:34 slave_addresses.txt
04:48:38  -rw-rw-r--. 1 jenkins jenkins      570 Feb 25 04:34 requirements.txt
04:48:38  -rw-rw-r--. 1 jenkins jenkins       26 Feb 25 04:34 env.properties
04:48:38  -rw-rw-r--. 1 jenkins jenkins      334 Feb 25 04:32 stack-parameters.yaml
04:48:38  drwxrwxr-x. 7 jenkins jenkins     4096 Feb 25 04:31 test
04:48:38  drwxrwxr-x. 2 jenkins jenkins        6 Feb 25 04:31 test@tmp
04:48:38  + true
04:48:38  [ovsdb-csit-3node-upstream-clustering-only-calcium] $ /bin/sh /tmp/jenkins9503506565748262340.sh
04:48:38  Cleaning up Robot installation...
04:48:38  $ ssh-agent -k
04:48:38  unset SSH_AUTH_SOCK;
04:48:38  unset SSH_AGENT_PID;
04:48:38  echo Agent pid 5288 killed;
04:48:38  [ssh-agent] Stopped.
04:48:38  Recording plot data
04:48:38  Robot results publisher started...
04:48:38  INFO: Checking test criticality is deprecated and will be dropped in a future release!
04:48:38  -Parsing output xml:
04:48:40  Done!
04:48:40  -Copying log files to build dir:
04:48:41  Done!
04:48:41  -Assigning results to build:
04:48:41  Done!
04:48:41  -Checking thresholds:
04:48:41  Done!
04:48:41  Done publishing Robot results.
04:48:41  Build step 'Publish Robot Framework test results' changed build result to UNSTABLE
04:48:41  [PostBuildScript] - [INFO] Executing post build scripts.
04:48:41  [ovsdb-csit-3node-upstream-clustering-only-calcium] $ /bin/bash /tmp/jenkins14605033983477800124.sh
04:48:41  Archiving csit artifacts
04:48:41  mv: cannot stat '*_1.png': No such file or directory
04:48:41  mv: cannot stat '/tmp/odl1_*': No such file or directory
04:48:41  mv: cannot stat '*_2.png': No such file or directory
04:48:41  mv: cannot stat '/tmp/odl2_*': No such file or directory
04:48:41  mv: cannot stat '*_3.png': No such file or directory
04:48:41  mv: cannot stat '/tmp/odl3_*': No such file or directory
04:48:41    % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
04:48:41                                   Dload  Upload   Total   Spent    Left  Speed
04:48:41  
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100 2312k    0 2312k    0     0  4265k      0 --:--:-- --:--:-- --:--:-- 4257k
100 3390k    0 3390k    0     0  4551k      0 --:--:-- --:--:-- --:--:-- 4545k
04:48:42  Archive:  robot-plugin.zip
04:48:42    inflating: ./archives/robot-plugin/log.html  
04:48:42    inflating: ./archives/robot-plugin/output.xml  
04:48:42    inflating: ./archives/robot-plugin/report.html  
04:48:42  mv: cannot stat '*.log.gz': No such file or directory
04:48:42  mv: cannot stat '*.csv': No such file or directory
04:48:42  mv: cannot stat '*.png': No such file or directory
04:48:42  [PostBuildScript] - [INFO] Executing post build scripts.
04:48:42  [ovsdb-csit-3node-upstream-clustering-only-calcium] $ /bin/bash /tmp/jenkins12308326346662474116.sh
04:48:42  [PostBuildScript] - [INFO] Executing post build scripts.
04:48:42  [EnvInject] - Injecting environment variables from a build step.
04:48:42  [EnvInject] - Injecting as environment variables the properties content 
04:48:42  OS_CLOUD=vex
04:48:42  OS_STACK_NAME=releng-ovsdb-csit-3node-upstream-clustering-only-calcium-646
04:48:42  
04:48:42  [EnvInject] - Variables injected successfully.
04:48:42  provisioning config files...
04:48:43  copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
04:48:43  [ovsdb-csit-3node-upstream-clustering-only-calcium] $ /bin/bash /tmp/jenkins6694809197321822038.sh
04:48:43  ---> openstack-stack-delete.sh
04:48:43  Setup pyenv:
04:48:43    system
04:48:43    3.8.13
04:48:43    3.9.13
04:48:43    3.10.13
04:48:43  * 3.11.7 (set by /w/workspace/ovsdb-csit-3node-upstream-clustering-only-calcium/.python-version)
04:48:43  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-jXOv from file:/tmp/.os_lf_venv
04:48:44  lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes python-heatclient python-openstackclient 
04:48:59  lf-activate-venv(): INFO: Adding /tmp/venv-jXOv/bin to PATH
04:48:59  INFO: Retrieving stack cost for: releng-ovsdb-csit-3node-upstream-clustering-only-calcium-646
04:49:04  DEBUG: Successfully retrieved stack cost: total: 0.39
04:49:16  INFO: Deleting stack releng-ovsdb-csit-3node-upstream-clustering-only-calcium-646
04:49:16  Successfully deleted stack releng-ovsdb-csit-3node-upstream-clustering-only-calcium-646
04:49:16  [PostBuildScript] - [INFO] Executing post build scripts.
04:49:16  [ovsdb-csit-3node-upstream-clustering-only-calcium] $ /bin/bash /tmp/jenkins6383239563431686097.sh
04:49:16  ---> sysstat.sh
04:49:17  [ovsdb-csit-3node-upstream-clustering-only-calcium] $ /bin/bash /tmp/jenkins3982159518365825025.sh
04:49:17  ---> package-listing.sh
04:49:17  ++ facter osfamily
04:49:17  ++ tr '[:upper:]' '[:lower:]'
04:49:17  + OS_FAMILY=redhat
04:49:17  + workspace=/w/workspace/ovsdb-csit-3node-upstream-clustering-only-calcium
04:49:17  + START_PACKAGES=/tmp/packages_start.txt
04:49:17  + END_PACKAGES=/tmp/packages_end.txt
04:49:17  + DIFF_PACKAGES=/tmp/packages_diff.txt
04:49:17  + PACKAGES=/tmp/packages_start.txt
04:49:17  + '[' /w/workspace/ovsdb-csit-3node-upstream-clustering-only-calcium ']'
04:49:17  + PACKAGES=/tmp/packages_end.txt
04:49:17  + case "${OS_FAMILY}" in
04:49:17  + rpm -qa
04:49:17  + sort
04:49:18  + '[' -f /tmp/packages_start.txt ']'
04:49:18  + '[' -f /tmp/packages_end.txt ']'
04:49:18  + diff /tmp/packages_start.txt /tmp/packages_end.txt
04:49:18  + '[' /w/workspace/ovsdb-csit-3node-upstream-clustering-only-calcium ']'
04:49:18  + mkdir -p /w/workspace/ovsdb-csit-3node-upstream-clustering-only-calcium/archives/
04:49:18  + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/ovsdb-csit-3node-upstream-clustering-only-calcium/archives/
04:49:18  [ovsdb-csit-3node-upstream-clustering-only-calcium] $ /bin/bash /tmp/jenkins8853956233974666714.sh
04:49:18  ---> capture-instance-metadata.sh
04:49:18  Setup pyenv:
04:49:18    system
04:49:18    3.8.13
04:49:18    3.9.13
04:49:18    3.10.13
04:49:18  * 3.11.7 (set by /w/workspace/ovsdb-csit-3node-upstream-clustering-only-calcium/.python-version)
04:49:18  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-jXOv from file:/tmp/.os_lf_venv
04:49:19  lf-activate-venv(): INFO: Installing: lftools 
04:49:27  lf-activate-venv(): INFO: Adding /tmp/venv-jXOv/bin to PATH
04:49:27  INFO: Running in OpenStack, capturing instance metadata
04:49:27  [ovsdb-csit-3node-upstream-clustering-only-calcium] $ /bin/bash /tmp/jenkins3906176277901165108.sh
04:49:27  provisioning config files...
04:49:28  Could not find credentials [logs] for ovsdb-csit-3node-upstream-clustering-only-calcium #646
04:49:28  copy managed file [jenkins-log-archives-settings] to file:/w/workspace/ovsdb-csit-3node-upstream-clustering-only-calcium@tmp/config8119844209940919024tmp
04:49:28  Regular expression run condition: Expression=[^.*logs-s3.*], Label=[odl-logs-s3-cloudfront-index]
04:49:28  Run condition [Regular expression match] enabling perform for step [Provide Configuration files]
04:49:28  provisioning config files...
04:49:28  copy managed file [jenkins-s3-log-ship] to file:/home/jenkins/.aws/credentials
04:49:28  [EnvInject] - Injecting environment variables from a build step.
04:49:28  [EnvInject] - Injecting as environment variables the properties content 
04:49:28  SERVER_ID=logs
04:49:28  
04:49:28  [EnvInject] - Variables injected successfully.
04:49:28  [ovsdb-csit-3node-upstream-clustering-only-calcium] $ /bin/bash /tmp/jenkins6634191115513513584.sh
04:49:28  ---> create-netrc.sh
04:49:28  WARN: Log server credential not found.
04:49:28  [ovsdb-csit-3node-upstream-clustering-only-calcium] $ /bin/bash /tmp/jenkins64843305163229596.sh
04:49:28  ---> python-tools-install.sh
04:49:28  Setup pyenv:
04:49:28    system
04:49:28    3.8.13
04:49:28    3.9.13
04:49:28    3.10.13
04:49:28  * 3.11.7 (set by /w/workspace/ovsdb-csit-3node-upstream-clustering-only-calcium/.python-version)
04:49:28  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-jXOv from file:/tmp/.os_lf_venv
04:49:29  lf-activate-venv(): INFO: Installing: lftools 
04:49:37  lf-activate-venv(): INFO: Adding /tmp/venv-jXOv/bin to PATH
04:49:37  [ovsdb-csit-3node-upstream-clustering-only-calcium] $ /bin/bash /tmp/jenkins13287289923264551813.sh
04:49:37  ---> sudo-logs.sh
04:49:37  Archiving 'sudo' log..
04:49:37  [ovsdb-csit-3node-upstream-clustering-only-calcium] $ /bin/bash /tmp/jenkins16761227740314010090.sh
04:49:37  ---> job-cost.sh
04:49:37  Setup pyenv:
04:49:37    system
04:49:37    3.8.13
04:49:37    3.9.13
04:49:37    3.10.13
04:49:37  * 3.11.7 (set by /w/workspace/ovsdb-csit-3node-upstream-clustering-only-calcium/.python-version)
04:49:38  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-jXOv from file:/tmp/.os_lf_venv
04:49:38  lf-activate-venv(): INFO: Installing: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 
04:49:44  lf-activate-venv(): INFO: Adding /tmp/venv-jXOv/bin to PATH
04:49:44  DEBUG: total: 0.39
04:49:44  INFO: Retrieving Stack Cost...
04:49:44  INFO: Retrieving Pricing Info for: v3-standard-2
04:49:44  INFO: Archiving Costs
04:49:44  [ovsdb-csit-3node-upstream-clustering-only-calcium] $ /bin/bash -l /tmp/jenkins5784483608953615769.sh
04:49:45  ---> logs-deploy.sh
04:49:45  Setup pyenv:
04:49:45    system
04:49:45    3.8.13
04:49:45    3.9.13
04:49:45    3.10.13
04:49:45  * 3.11.7 (set by /w/workspace/ovsdb-csit-3node-upstream-clustering-only-calcium/.python-version)
04:49:45  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-jXOv from file:/tmp/.os_lf_venv
04:49:46  lf-activate-venv(): INFO: Installing: lftools 
04:49:55  lf-activate-venv(): INFO: Adding /tmp/venv-jXOv/bin to PATH
04:49:55  WARNING: Nexus logging server not set
04:49:55  INFO: S3 path logs/releng/vex-yul-odl-jenkins-1/ovsdb-csit-3node-upstream-clustering-only-calcium/646/
04:49:55  INFO: archiving logs to S3
04:49:56  ---> uname -a:
04:49:56  Linux prd-centos8-robot-2c-8g-2479.novalocal 4.18.0-553.5.1.el8.x86_64 #1 SMP Tue May 21 05:46:01 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
04:49:56  
04:49:56  
04:49:56  ---> lscpu:
04:49:56  Architecture:        x86_64
04:49:56  CPU op-mode(s):      32-bit, 64-bit
04:49:56  Byte Order:          Little Endian
04:49:56  CPU(s):              2
04:49:56  On-line CPU(s) list: 0,1
04:49:56  Thread(s) per core:  1
04:49:56  Core(s) per socket:  1
04:49:56  Socket(s):           2
04:49:56  NUMA node(s):        1
04:49:56  Vendor ID:           AuthenticAMD
04:49:56  CPU family:          23
04:49:56  Model:               49
04:49:56  Model name:          AMD EPYC-Rome Processor
04:49:56  Stepping:            0
04:49:56  CPU MHz:             2800.000
04:49:56  BogoMIPS:            5600.00
04:49:56  Virtualization:      AMD-V
04:49:56  Hypervisor vendor:   KVM
04:49:56  Virtualization type: full
04:49:56  L1d cache:           32K
04:49:56  L1i cache:           32K
04:49:56  L2 cache:            512K
04:49:56  L3 cache:            16384K
04:49:56  NUMA node0 CPU(s):   0,1
04:49:56  Flags:               fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities
04:49:56  
04:49:56  
04:49:56  ---> nproc:
04:49:56  2
04:49:56  
04:49:56  
04:49:56  ---> df -h:
04:49:56  Filesystem      Size  Used Avail Use% Mounted on
04:49:56  devtmpfs        3.8G     0  3.8G   0% /dev
04:49:56  tmpfs           3.8G     0  3.8G   0% /dev/shm
04:49:56  tmpfs           3.8G   17M  3.8G   1% /run
04:49:56  tmpfs           3.8G     0  3.8G   0% /sys/fs/cgroup
04:49:56  /dev/vda1        40G  8.3G   32G  21% /
04:49:56  tmpfs           770M     0  770M   0% /run/user/1001
04:49:56  
04:49:56  
04:49:56  ---> free -m:
04:49:56                total        used        free      shared  buff/cache   available
04:49:56  Mem:           7697         668        4837          19        2191        6732
04:49:56  Swap:          1023           0        1023
04:49:56  
04:49:56  
04:49:56  ---> ip addr:
04:49:56  1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
04:49:56      link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
04:49:56      inet 127.0.0.1/8 scope host lo
04:49:56         valid_lft forever preferred_lft forever
04:49:56      inet6 ::1/128 scope host 
04:49:56         valid_lft forever preferred_lft forever
04:49:56  2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1458 qdisc mq state UP group default qlen 1000
04:49:56      link/ether fa:16:3e:49:1a:8f brd ff:ff:ff:ff:ff:ff
04:49:56      altname enp0s3
04:49:56      altname ens3
04:49:56      inet 10.30.171.152/23 brd 10.30.171.255 scope global dynamic noprefixroute eth0
04:49:56         valid_lft 85266sec preferred_lft 85266sec
04:49:56      inet6 fe80::f816:3eff:fe49:1a8f/64 scope link 
04:49:56         valid_lft forever preferred_lft forever
04:49:56  
04:49:56  
04:49:56  ---> sar -b -r -n DEV:
04:49:56  Linux 4.18.0-553.5.1.el8.x86_64 (centos-stream-8-robot-7d7a37eb-bc14-4dd6-9530-dc22c5eae738.noval) 	02/25/2025 	_x86_64_	(2 CPU)
04:49:56  
04:49:56  04:30:58     LINUX RESTART	(2 CPU)
04:49:56  
04:49:56  04:32:01 AM       tps      rtps      wtps   bread/s   bwrtn/s
04:49:56  04:33:01 AM    120.18      0.87    119.31     56.78  11403.72
04:49:56  04:34:01 AM     31.46      0.38     31.07     64.25   4038.40
04:49:56  04:35:01 AM     54.62      6.78     47.84   1249.93   3653.24
04:49:56  04:36:01 AM     23.61      0.00     23.61      0.00   5508.25
04:49:56  04:37:01 AM      0.42      0.00      0.42      0.00      7.60
04:49:56  04:38:01 AM      0.13      0.00      0.13      0.00      1.05
04:49:56  04:39:01 AM      0.43      0.10      0.33     32.12     13.53
04:49:56  04:40:01 AM      2.02      0.00      2.02      0.00    164.06
04:49:56  04:41:01 AM      0.28      0.03      0.25      1.87     86.30
04:49:56  04:42:02 AM      0.50      0.00      0.50      0.00     98.40
04:49:56  04:43:01 AM      0.39      0.00      0.39      0.00    102.12
04:49:56  04:44:01 AM      0.22      0.00      0.22      0.00    110.43
04:49:56  04:45:01 AM      0.22      0.00      0.22      0.00     63.88
04:49:56  04:46:01 AM      0.23      0.00      0.23      0.00    113.96
04:49:56  04:47:01 AM      1.55      0.03      1.52      0.27    136.34
04:49:56  04:48:01 AM      0.35      0.00      0.35      0.00    119.61
04:49:56  04:49:01 AM      7.58      0.32      7.27     36.93    357.62
04:49:56  Average:        14.38      0.50     13.88     84.91   1529.57
04:49:56  
04:49:56  04:32:01 AM kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty
04:49:56  04:33:01 AM   5150000   6955828   2732432     34.66      2688   1982872    752580      8.43    197880   2189004    104028
04:49:56  04:34:01 AM   5223260   7030640   2659172     33.74      2688   1984800    706552      7.91    217060   2096668         8
04:49:56  04:35:01 AM   4961736   7010536   2920696     37.05      2688   2217756    687984      7.70    258392   2290548    157696
04:49:56  04:36:01 AM   4955552   7003948   2926880     37.13      2688   2217764    687984      7.70    258404   2290804         8
04:49:56  04:37:01 AM   4955836   7004232   2926596     37.13      2688   2217764    687984      7.70    258408   2290752         8
04:49:56  04:38:01 AM   4955720   7004120   2926712     37.13      2688   2217768    687984      7.70    258408   2290692         8
04:49:56  04:39:01 AM   4906656   6958272   2975776     37.75      2688   2221008    763840      8.55    258560   2339552      2100
04:49:56  04:40:01 AM   4900996   6954664   2981436     37.82      2688   2223068    777208      8.70    258908   2344844      1168
04:49:56  04:41:01 AM   4898224   6954516   2984208     37.86      2688   2225672    777208      8.70    259100   2347704      1184
04:49:56  04:42:02 AM   4895456   6953872   2986976     37.89      2688   2227792    777208      8.70    259100   2350144       556
04:49:56  04:43:01 AM   4892476   6953696   2989956     37.93      2688   2230580    810960      9.08    259100   2353088       468
04:49:56  04:44:01 AM   4888024   6952252   2994408     37.99      2688   2233616    810960      9.08    259100   2356984       244
04:49:56  04:45:01 AM   4883464   6950652   2998968     38.05      2688   2236556    827108      9.26    259100   2361980      1324
04:49:56  04:46:01 AM   4879724   6950000   3002708     38.09      2688   2239676    846492      9.48    259100   2365312      1084
04:49:56  04:47:01 AM   4874924   6948000   3007508     38.15      2688   2242440    862476      9.66    259300   2370036       776
04:49:56  04:48:01 AM   4871796   6948136   3010636     38.19      2688   2245692    862476      9.66    259300   2373232       556
04:49:56  04:49:01 AM   4967432   6903500   2915000     36.98      2688   2109580    774136      8.67    318684   2237520     49832
04:49:56  Average:      4944781   6966874   2937651     37.27      2688   2192612    770655      8.63    256347   2308757     18885
04:49:56  
04:49:56  04:32:01 AM     IFACE   rxpck/s   txpck/s    rxkB/s    txkB/s   rxcmp/s   txcmp/s  rxmcst/s   %ifutil
04:49:56  04:33:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:49:56  04:33:01 AM      eth0    116.79     91.84   1151.22     12.78      0.00      0.00      0.00      0.00
04:49:56  04:34:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:49:56  04:34:01 AM      eth0     16.13     11.78      5.94      4.16      0.00      0.00      0.00      0.00
04:49:56  04:35:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:49:56  04:35:01 AM      eth0    257.74    188.57    340.33     48.02      0.00      0.00      0.00      0.00
04:49:56  04:36:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:49:56  04:36:01 AM      eth0    392.80    280.04     73.22     56.73      0.00      0.00      0.00      0.00
04:49:56  04:37:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:49:56  04:37:01 AM      eth0      2.57      1.87      0.54      0.46      0.00      0.00      0.00      0.00
04:49:56  04:38:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:49:56  04:38:01 AM      eth0      2.75      1.98      0.45      0.45      0.00      0.00      0.00      0.00
04:49:56  04:39:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:49:56  04:39:01 AM      eth0    124.18    109.26     25.66      9.18      0.00      0.00      0.00      0.00
04:49:56  04:40:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:49:56  04:40:01 AM      eth0     76.14     76.21     13.60      5.95      0.00      0.00      0.00      0.00
04:49:56  04:41:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:49:56  04:41:01 AM      eth0     74.68     73.88     14.61      6.29      0.00      0.00      0.00      0.00
04:49:56  04:42:02 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:49:56  04:42:02 AM      eth0    117.91    118.39     20.00      9.40      0.00      0.00      0.00      0.00
04:49:56  04:43:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:49:56  04:43:01 AM      eth0    117.88    118.06     21.06      9.22      0.00      0.00      0.00      0.00
04:49:56  04:44:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:49:56  04:44:01 AM      eth0    218.78    214.20    160.18     16.37      0.00      0.00      0.00      0.00
04:49:56  04:45:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:49:56  04:45:01 AM      eth0    109.45    109.31     20.52      8.82      0.00      0.00      0.00      0.00
04:49:56  04:46:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:49:56  04:46:01 AM      eth0    176.64    177.99     30.69     13.14      0.00      0.00      0.00      0.00
04:49:56  04:47:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:49:56  04:47:01 AM      eth0    129.66    129.59     23.24     10.17      0.00      0.00      0.00      0.00
04:49:56  04:48:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:49:56  04:48:01 AM      eth0    235.28    237.69     39.26     16.74      0.00      0.00      0.00      0.00
04:49:56  04:49:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:49:56  04:49:01 AM      eth0    138.64     94.32    147.09    117.94      0.00      0.00      0.00      0.00
04:49:56  Average:           lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:49:56  Average:         eth0    135.78    119.71    122.90     20.35      0.00      0.00      0.00      0.00
04:49:56  
04:49:56  
04:49:56  ---> sar -P ALL:
04:49:56  Linux 4.18.0-553.5.1.el8.x86_64 (centos-stream-8-robot-7d7a37eb-bc14-4dd6-9530-dc22c5eae738.noval) 	02/25/2025 	_x86_64_	(2 CPU)
04:49:56  
04:49:56  04:30:58     LINUX RESTART	(2 CPU)
04:49:56  
04:49:56  04:32:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
04:49:56  04:33:01 AM     all     37.20      0.00      5.29      1.33      0.10     56.08
04:49:56  04:33:01 AM       0     20.84      0.00      4.38      1.12      0.10     73.56
04:49:56  04:33:01 AM       1     53.60      0.00      6.19      1.55      0.10     38.56
04:49:56  04:34:01 AM     all      9.14      0.00      1.36      0.38      0.08     89.04
04:49:56  04:34:01 AM       0     11.11      0.00      1.40      0.50      0.08     86.91
04:49:56  04:34:01 AM       1      7.17      0.00      1.32      0.27      0.07     91.18
04:49:56  04:35:01 AM     all     27.31      0.00      5.25      0.54      0.08     66.81
04:49:56  04:35:01 AM       0     15.22      0.00      4.32      0.52      0.07     79.87
04:49:56  04:35:01 AM       1     39.44      0.00      6.18      0.57      0.10     53.72
04:49:56  04:36:01 AM     all      0.71      0.00      0.91      0.33      0.04     98.01
04:49:56  04:36:01 AM       0      0.52      0.00      0.85      0.22      0.03     98.38
04:49:56  04:36:01 AM       1      0.90      0.00      0.97      0.44      0.05     97.64
04:49:56  04:37:01 AM     all      0.33      0.00      0.08      0.00      0.03     99.57
04:49:56  04:37:01 AM       0      0.07      0.00      0.07      0.00      0.02     99.85
04:49:56  04:37:01 AM       1      0.58      0.00      0.08      0.00      0.03     99.30
04:49:56  04:38:01 AM     all      0.32      0.00      0.10      0.00      0.03     99.55
04:49:56  04:38:01 AM       0      0.37      0.00      0.12      0.00      0.03     99.48
04:49:56  04:38:01 AM       1      0.27      0.00      0.08      0.00      0.03     99.62
04:49:56  04:39:01 AM     all      8.43      0.00      0.87      0.01      0.06     90.63
04:49:56  04:39:01 AM       0      6.93      0.00      0.74      0.02      0.07     92.24
04:49:56  04:39:01 AM       1      9.93      0.00      0.99      0.00      0.05     89.02
04:49:56  04:40:01 AM     all      6.96      0.00      0.56      0.01      0.08     92.39
04:49:56  04:40:01 AM       0      4.24      0.00      0.54      0.02      0.07     95.13
04:49:56  04:40:01 AM       1      9.64      0.00      0.59      0.00      0.08     89.69
04:49:56  04:41:01 AM     all      7.27      0.00      0.65      0.01      0.06     92.01
04:49:56  04:41:01 AM       0      7.56      0.00      0.72      0.02      0.07     91.63
04:49:56  04:41:01 AM       1      6.99      0.00      0.57      0.00      0.05     92.39
04:49:56  04:42:02 AM     all      7.12      0.00      0.55      0.00      0.08     92.24
04:49:56  04:42:02 AM       0      7.77      0.00      0.55      0.00      0.08     91.59
04:49:56  04:42:02 AM       1      6.47      0.00      0.55      0.00      0.08     92.90
04:49:56  04:43:01 AM     all      9.20      0.00      0.68      0.01      0.09     90.03
04:49:56  04:43:01 AM       0      6.17      0.00      0.65      0.02      0.09     93.08
04:49:56  04:43:01 AM       1     12.22      0.00      0.72      0.00      0.09     86.98
04:49:56  
04:49:56  04:43:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
04:49:56  04:44:01 AM     all      9.61      0.00      0.86      0.00      0.07     89.46
04:49:56  04:44:01 AM       0      6.07      0.00      0.86      0.00      0.07     93.00
04:49:56  04:44:01 AM       1     13.16      0.00      0.86      0.00      0.07     85.91
04:49:56  04:45:01 AM     all      9.29      0.00      0.74      0.00      0.08     89.89
04:49:56  04:45:01 AM       0      4.70      0.00      0.57      0.00      0.08     94.65
04:49:56  04:45:01 AM       1     13.87      0.00      0.91      0.00      0.08     85.14
04:49:56  04:46:01 AM     all      9.50      0.00      0.75      0.00      0.08     89.67
04:49:56  04:46:01 AM       0     10.85      0.00      0.76      0.00      0.08     88.30
04:49:56  04:46:01 AM       1      8.14      0.00      0.74      0.00      0.08     91.03
04:49:56  04:47:01 AM     all      9.25      0.00      0.86      0.01      0.09     89.80
04:49:56  04:47:01 AM       0      7.26      0.00      0.74      0.00      0.08     91.92
04:49:56  04:47:01 AM       1     11.22      0.00      0.97      0.02      0.10     87.69
04:49:56  04:48:01 AM     all      9.69      0.00      1.04      0.00      0.08     89.20
04:49:56  04:48:01 AM       0      5.86      0.00      1.04      0.00      0.08     93.01
04:49:56  04:48:01 AM       1     13.53      0.00      1.03      0.00      0.07     85.37
04:49:56  04:49:01 AM     all     21.12      0.00      2.28      0.06      0.07     76.47
04:49:56  04:49:01 AM       0     24.38      0.00      2.33      0.05      0.07     73.18
04:49:56  04:49:01 AM       1     17.88      0.00      2.22      0.07      0.07     79.77
04:49:56  Average:        all     10.74      0.00      1.34      0.16      0.07     87.68
04:49:56  Average:          0      8.24      0.00      1.22      0.15      0.07     90.33
04:49:56  Average:          1     13.24      0.00      1.47      0.17      0.07     85.04
04:49:56  
04:49:56  
04:49:56