12:21:40  Started by upstream project "integration-distribution-test-scandium" build number 213
12:21:40  originally caused by:
12:21:40   Started by upstream project "autorelease-release-scandium-mvn39-openjdk21" build number 219
12:21:40   originally caused by:
12:21:40    Started by user Robert Varga
12:21:40  Running as SYSTEM
12:21:40  [EnvInject] - Loading node environment variables.
12:21:40  Building remotely on prd-centos8-robot-2c-8g-6413 (centos8-robot-2c-8g) in workspace /w/workspace/openflowplugin-csit-3node-clustering-only-scandium
12:21:40  [ssh-agent] Looking for ssh-agent implementation...
12:21:41  [ssh-agent]   Exec ssh-agent (binary ssh-agent on a remote machine)
12:21:41  $ ssh-agent
12:21:41  SSH_AUTH_SOCK=/tmp/ssh-dp0U4z8wmTwK/agent.5281
12:21:41  SSH_AGENT_PID=5282
12:21:41  [ssh-agent] Started.
12:21:41  Running ssh-add (command line suppressed)
12:21:41  Identity added: /w/workspace/openflowplugin-csit-3node-clustering-only-scandium@tmp/private_key_2888487568737433861.key (/w/workspace/openflowplugin-csit-3node-clustering-only-scandium@tmp/private_key_2888487568737433861.key)
12:21:41  [ssh-agent] Using credentials jenkins (Release Engineering Jenkins Key)
12:21:41  The recommended git tool is: NONE
12:21:44  using credential opendaylight-jenkins-ssh
12:21:44  Wiping out workspace first.
12:21:44  Cloning the remote Git repository
12:21:44  Cloning repository git://devvexx.opendaylight.org/mirror/integration/test
12:21:44   > git init /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test # timeout=10
12:21:44  Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test
12:21:44   > git --version # timeout=10
12:21:44   > git --version # 'git version 2.43.0'
12:21:44  using GIT_SSH to set credentials Release Engineering Jenkins Key
12:21:44  [INFO] Currently running in a labeled security context
12:21:44  [INFO] Currently SELinux is 'enforcing' on the host
12:21:44   > /usr/bin/chcon --type=ssh_home_t /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test@tmp/jenkins-gitclient-ssh2905093554269519882.key
12:21:44  Verifying host key using known hosts file
12:21:44  You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification.
12:21:44   > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test +refs/heads/*:refs/remotes/origin/* # timeout=10
12:21:46   > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10
12:21:46   > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
12:21:47   > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10
12:21:47  Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test
12:21:47  using GIT_SSH to set credentials Release Engineering Jenkins Key
12:21:47  [INFO] Currently running in a labeled security context
12:21:47  [INFO] Currently SELinux is 'enforcing' on the host
12:21:47   > /usr/bin/chcon --type=ssh_home_t /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test@tmp/jenkins-gitclient-ssh11123135436260887222.key
12:21:47  Verifying host key using known hosts file
12:21:47  You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification.
12:21:47   > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test master # timeout=10
12:21:47   > git rev-parse FETCH_HEAD^{commit} # timeout=10
12:21:47  Checking out Revision 1d2a1a30bcc48e3c8d571eb0d9b6891fe29dfed4 (origin/master)
12:21:47   > git config core.sparsecheckout # timeout=10
12:21:47   > git checkout -f 1d2a1a30bcc48e3c8d571eb0d9b6891fe29dfed4 # timeout=10
12:21:47  Commit message: "Add bgpcep variables for titanium"
12:21:47   > git rev-parse FETCH_HEAD^{commit} # timeout=10
12:21:47   > git rev-list --no-walk d42b2c24fe4fcc7fe3ae0d352311e768f07a15b7 # timeout=10
12:21:48  No emails were triggered.
12:21:48  provisioning config files...
12:21:48  copy managed file [npmrc] to file:/home/jenkins/.npmrc
12:21:48  copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf
12:21:48  copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
12:21:48  [openflowplugin-csit-3node-clustering-only-scandium] $ /bin/bash /tmp/jenkins15438589015194330921.sh
12:21:48  ---> python-tools-install.sh
12:21:48  Setup pyenv:
12:21:48    system
12:21:48  * 3.8.13 (set by /opt/pyenv/version)
12:21:48  * 3.9.13 (set by /opt/pyenv/version)
12:21:48  * 3.10.13 (set by /opt/pyenv/version)
12:21:48  * 3.11.7 (set by /opt/pyenv/version)
12:21:53  lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-Tm5S
12:21:53  lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv
12:21:56  lf-activate-venv(): INFO: Installing: lftools 
12:22:21  lf-activate-venv(): INFO: Adding /tmp/venv-Tm5S/bin to PATH
12:22:21  Generating Requirements File
12:22:41  Python 3.11.7
12:22:41  pip 25.0.1 from /tmp/venv-Tm5S/lib/python3.11/site-packages/pip (python 3.11)
12:22:41  appdirs==1.4.4
12:22:41  argcomplete==3.6.0
12:22:41  aspy.yaml==1.3.0
12:22:41  attrs==25.1.0
12:22:41  autopage==0.5.2
12:22:41  beautifulsoup4==4.13.3
12:22:41  boto3==1.37.9
12:22:41  botocore==1.37.9
12:22:41  bs4==0.0.2
12:22:41  cachetools==5.5.2
12:22:41  certifi==2025.1.31
12:22:41  cffi==1.17.1
12:22:41  cfgv==3.4.0
12:22:41  chardet==5.2.0
12:22:41  charset-normalizer==3.4.1
12:22:41  click==8.1.8
12:22:41  cliff==4.9.1
12:22:41  cmd2==2.5.11
12:22:41  cryptography==3.3.2
12:22:41  debtcollector==3.0.0
12:22:41  decorator==5.2.1
12:22:41  defusedxml==0.7.1
12:22:41  Deprecated==1.2.18
12:22:41  distlib==0.3.9
12:22:41  dnspython==2.7.0
12:22:41  docker==4.2.2
12:22:41  dogpile.cache==1.3.4
12:22:41  durationpy==0.9
12:22:41  email_validator==2.2.0
12:22:41  filelock==3.17.0
12:22:41  future==1.0.0
12:22:41  gitdb==4.0.12
12:22:41  GitPython==3.1.44
12:22:41  google-auth==2.38.0
12:22:41  httplib2==0.22.0
12:22:41  identify==2.6.9
12:22:41  idna==3.10
12:22:41  importlib-resources==1.5.0
12:22:41  iso8601==2.1.0
12:22:41  Jinja2==3.1.6
12:22:41  jmespath==1.0.1
12:22:41  jsonpatch==1.33
12:22:41  jsonpointer==3.0.0
12:22:41  jsonschema==4.23.0
12:22:41  jsonschema-specifications==2024.10.1
12:22:41  keystoneauth1==5.10.0
12:22:41  kubernetes==32.0.1
12:22:41  lftools==0.37.10
12:22:41  lxml==5.3.1
12:22:41  MarkupSafe==3.0.2
12:22:41  msgpack==1.1.0
12:22:41  multi_key_dict==2.0.3
12:22:41  munch==4.0.0
12:22:41  netaddr==1.3.0
12:22:41  niet==1.4.2
12:22:41  nodeenv==1.9.1
12:22:41  oauth2client==4.1.3
12:22:41  oauthlib==3.2.2
12:22:41  openstacksdk==4.4.0
12:22:41  os-client-config==2.1.0
12:22:41  os-service-types==1.7.0
12:22:41  osc-lib==3.2.0
12:22:41  oslo.config==9.7.1
12:22:41  oslo.context==5.7.1
12:22:41  oslo.i18n==6.5.1
12:22:41  oslo.log==7.1.0
12:22:41  oslo.serialization==5.7.0
12:22:41  oslo.utils==8.2.0
12:22:41  packaging==24.2
12:22:41  pbr==6.1.1
12:22:41  platformdirs==4.3.6
12:22:41  prettytable==3.15.1
12:22:41  psutil==7.0.0
12:22:41  pyasn1==0.6.1
12:22:41  pyasn1_modules==0.4.1
12:22:41  pycparser==2.22
12:22:41  pygerrit2==2.0.15
12:22:41  PyGithub==2.6.1
12:22:41  PyJWT==2.10.1
12:22:41  PyNaCl==1.5.0
12:22:41  pyparsing==2.4.7
12:22:41  pyperclip==1.9.0
12:22:41  pyrsistent==0.20.0
12:22:41  python-cinderclient==9.7.0
12:22:41  python-dateutil==2.9.0.post0
12:22:41  python-heatclient==4.1.0
12:22:41  python-jenkins==1.8.2
12:22:41  python-keystoneclient==5.6.0
12:22:41  python-magnumclient==4.8.1
12:22:41  python-openstackclient==7.4.0
12:22:41  python-swiftclient==4.7.0
12:22:41  PyYAML==6.0.2
12:22:41  referencing==0.36.2
12:22:41  requests==2.32.3
12:22:41  requests-oauthlib==2.0.0
12:22:41  requestsexceptions==1.4.0
12:22:41  rfc3986==2.0.0
12:22:41  rpds-py==0.23.1
12:22:41  rsa==4.9
12:22:41  ruamel.yaml==0.18.10
12:22:41  ruamel.yaml.clib==0.2.12
12:22:41  s3transfer==0.11.4
12:22:41  simplejson==3.20.1
12:22:41  six==1.17.0
12:22:41  smmap==5.0.2
12:22:41  soupsieve==2.6
12:22:41  stevedore==5.4.1
12:22:41  tabulate==0.9.0
12:22:41  toml==0.10.2
12:22:41  tomlkit==0.13.2
12:22:41  tqdm==4.67.1
12:22:41  typing_extensions==4.12.2
12:22:41  tzdata==2025.1
12:22:41  urllib3==1.26.20
12:22:41  virtualenv==20.29.3
12:22:41  wcwidth==0.2.13
12:22:41  websocket-client==1.8.0
12:22:41  wrapt==1.17.2
12:22:41  xdg==6.0.0
12:22:41  xmltodict==0.14.2
12:22:41  yq==3.4.3
12:22:41  [EnvInject] - Injecting environment variables from a build step.
12:22:41  [EnvInject] - Injecting as environment variables the properties content 
12:22:41  OS_STACK_TEMPLATE=csit-2-instance-type.yaml
12:22:41  OS_CLOUD=vex
12:22:41  OS_STACK_NAME=releng-openflowplugin-csit-3node-clustering-only-scandium-212
12:22:41  OS_STACK_TEMPLATE_DIR=openstack-hot
12:22:41  
12:22:41  [EnvInject] - Variables injected successfully.
12:22:41  provisioning config files...
12:22:42  copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
12:22:42  [openflowplugin-csit-3node-clustering-only-scandium] $ /bin/bash /tmp/jenkins8196401140586304818.sh
12:22:42  ---> Create parameters file for OpenStack HOT
12:22:42  OpenStack Heat parameters generated
12:22:42  -----------------------------------
12:22:42  parameters:
12:22:42      vm_0_count: '3'
12:22:42      vm_0_flavor: 'v3-standard-4'
12:22:42      vm_0_image: 'ZZCI - Ubuntu 20.04 - builder - x86_64 - 20250101-160150.998'
12:22:42      vm_1_count: '1'
12:22:42      vm_1_flavor: 'v3-standard-2'
12:22:42      vm_1_image: 'ZZCI - Ubuntu 22.04 - mininet-ovs-217 - x86_64 - 20250201-060151.911'
12:22:42      
12:22:42      job_name: '24937-212'
12:22:42      silo: 'releng'
12:22:42  [openflowplugin-csit-3node-clustering-only-scandium] $ /bin/bash -l /tmp/jenkins14531480847094640876.sh
12:22:42  ---> Create HEAT stack
12:22:42  + source /home/jenkins/lf-env.sh
12:22:42  + lf-activate-venv --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
12:22:42  ++ mktemp -d /tmp/venv-XXXX
12:22:42  + lf_venv=/tmp/venv-e7ac
12:22:42  + local venv_file=/tmp/.os_lf_venv
12:22:42  + local python=python3
12:22:42  + local options
12:22:42  + local set_path=true
12:22:42  + local install_args=
12:22:42  ++ getopt -o np:v: -l no-path,system-site-packages,python:,venv-file: -n lf-activate-venv -- --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
12:22:42  + options=' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\'''
12:22:42  + eval set -- ' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\'''
12:22:42  ++ set -- --python python3 -- 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
12:22:42  + true
12:22:42  + case $1 in
12:22:42  + python=python3
12:22:42  + shift 2
12:22:42  + true
12:22:42  + case $1 in
12:22:42  + shift
12:22:42  + break
12:22:42  + case $python in
12:22:42  + local pkg_list=
12:22:42  + [[ -d /opt/pyenv ]]
12:22:42  + echo 'Setup pyenv:'
12:22:42  Setup pyenv:
12:22:42  + export PYENV_ROOT=/opt/pyenv
12:22:42  + PYENV_ROOT=/opt/pyenv
12:22:42  + export PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
12:22:42  + PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
12:22:42  + pyenv versions
12:22:42    system
12:22:42    3.8.13
12:22:42    3.9.13
12:22:42    3.10.13
12:22:42  * 3.11.7 (set by /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/.python-version)
12:22:42  + command -v pyenv
12:22:42  ++ pyenv init - --no-rehash
12:22:42  + eval 'PATH="$(bash --norc -ec '\''IFS=:; paths=($PATH); 
12:22:42  for i in ${!paths[@]}; do 
12:22:42  if [[ ${paths[i]} == "'\'''\''/opt/pyenv/shims'\'''\''" ]]; then unset '\''\'\'''\''paths[i]'\''\'\'''\''; 
12:22:42  fi; done; 
12:22:42  echo "${paths[*]}"'\'')"
12:22:42  export PATH="/opt/pyenv/shims:${PATH}"
12:22:42  export PYENV_SHELL=bash
12:22:42  source '\''/opt/pyenv/libexec/../completions/pyenv.bash'\''
12:22:42  pyenv() {
12:22:42    local command
12:22:42    command="${1:-}"
12:22:42    if [ "$#" -gt 0 ]; then
12:22:42      shift
12:22:42    fi
12:22:42  
12:22:42    case "$command" in
12:22:42    rehash|shell)
12:22:42      eval "$(pyenv "sh-$command" "$@")"
12:22:42      ;;
12:22:42    *)
12:22:42      command pyenv "$command" "$@"
12:22:42      ;;
12:22:42    esac
12:22:42  }'
12:22:42  +++ bash --norc -ec 'IFS=:; paths=($PATH); 
12:22:42  for i in ${!paths[@]}; do 
12:22:42  if [[ ${paths[i]} == "/opt/pyenv/shims" ]]; then unset '\''paths[i]'\''; 
12:22:42  fi; done; 
12:22:42  echo "${paths[*]}"'
12:22:42  ++ PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
12:22:42  ++ export PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
12:22:42  ++ PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
12:22:42  ++ export PYENV_SHELL=bash
12:22:42  ++ PYENV_SHELL=bash
12:22:42  ++ source /opt/pyenv/libexec/../completions/pyenv.bash
12:22:42  +++ complete -F _pyenv pyenv
12:22:42  ++ lf-pyver python3
12:22:42  ++ local py_version_xy=python3
12:22:42  ++ local py_version_xyz=
12:22:42  ++ pyenv versions
12:22:42  ++ local command
12:22:42  ++ command=versions
12:22:42  ++ '[' 1 -gt 0 ']'
12:22:42  ++ grep -E '^[0-9.]*[0-9]$'
12:22:42  ++ shift
12:22:42  ++ case "$command" in
12:22:42  ++ command pyenv versions
12:22:42  ++ pyenv versions
12:22:42  ++ sed 's/^[ *]* //'
12:22:42  ++ awk '{ print $1 }'
12:22:42  ++ [[ ! -s /tmp/.pyenv_versions ]]
12:22:42  +++ tail -n 1
12:22:42  +++ grep '^3' /tmp/.pyenv_versions
12:22:42  +++ sort -V
12:22:42  ++ py_version_xyz=3.11.7
12:22:42  ++ [[ -z 3.11.7 ]]
12:22:42  ++ echo 3.11.7
12:22:42  ++ return 0
12:22:42  + pyenv local 3.11.7
12:22:42  + local command
12:22:42  + command=local
12:22:42  + '[' 2 -gt 0 ']'
12:22:42  + shift
12:22:42  + case "$command" in
12:22:42  + command pyenv local 3.11.7
12:22:42  + pyenv local 3.11.7
12:22:42  + for arg in "$@"
12:22:42  + case $arg in
12:22:42  + pkg_list+='lftools[openstack] '
12:22:42  + for arg in "$@"
12:22:42  + case $arg in
12:22:42  + pkg_list+='kubernetes '
12:22:42  + for arg in "$@"
12:22:42  + case $arg in
12:22:42  + pkg_list+='niet '
12:22:42  + for arg in "$@"
12:22:42  + case $arg in
12:22:42  + pkg_list+='python-heatclient '
12:22:42  + for arg in "$@"
12:22:42  + case $arg in
12:22:42  + pkg_list+='python-openstackclient '
12:22:42  + for arg in "$@"
12:22:42  + case $arg in
12:22:42  + pkg_list+='python-magnumclient '
12:22:42  + for arg in "$@"
12:22:42  + case $arg in
12:22:42  + pkg_list+='yq '
12:22:42  + [[ -f /tmp/.os_lf_venv ]]
12:22:42  ++ cat /tmp/.os_lf_venv
12:22:42  + lf_venv=/tmp/venv-Tm5S
12:22:42  + echo 'lf-activate-venv(): INFO: Reuse venv:/tmp/venv-Tm5S from' file:/tmp/.os_lf_venv
12:22:42  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-Tm5S from file:/tmp/.os_lf_venv
12:22:42  + /tmp/venv-Tm5S/bin/python3 -m pip install --upgrade --quiet pip virtualenv
12:22:43  + [[ -z lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq  ]]
12:22:43  + echo 'lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq '
12:22:43  lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 
12:22:43  + /tmp/venv-Tm5S/bin/python3 -m pip install --upgrade --quiet --upgrade-strategy eager 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
12:22:58  + type python3
12:22:58  + true
12:22:58  + echo 'lf-activate-venv(): INFO: Adding /tmp/venv-Tm5S/bin to PATH'
12:22:58  lf-activate-venv(): INFO: Adding /tmp/venv-Tm5S/bin to PATH
12:22:58  + PATH=/tmp/venv-Tm5S/bin:/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
12:22:58  + return 0
12:22:58  + openstack --os-cloud vex limits show --absolute
12:22:59  +--------------------------+---------+
12:22:59  | Name                     |   Value |
12:22:59  +--------------------------+---------+
12:22:59  | maxTotalInstances        |      -1 |
12:22:59  | maxTotalCores            |     450 |
12:22:59  | maxTotalRAMSize          | 1000000 |
12:22:59  | maxServerMeta            |     128 |
12:22:59  | maxImageMeta             |     128 |
12:22:59  | maxPersonality           |       5 |
12:22:59  | maxPersonalitySize       |   10240 |
12:22:59  | maxTotalKeypairs         |     100 |
12:22:59  | maxServerGroups          |      10 |
12:22:59  | maxServerGroupMembers    |      10 |
12:22:59  | maxTotalFloatingIps      |      -1 |
12:22:59  | maxSecurityGroups        |      -1 |
12:22:59  | maxSecurityGroupRules    |      -1 |
12:22:59  | totalRAMUsed             |  647168 |
12:22:59  | totalCoresUsed           |     158 |
12:22:59  | totalInstancesUsed       |      56 |
12:22:59  | totalFloatingIpsUsed     |       0 |
12:22:59  | totalSecurityGroupsUsed  |       0 |
12:22:59  | totalServerGroupsUsed    |       0 |
12:22:59  | maxTotalVolumes          |      -1 |
12:22:59  | maxTotalSnapshots        |      10 |
12:22:59  | maxTotalVolumeGigabytes  |    4096 |
12:22:59  | maxTotalBackups          |      10 |
12:22:59  | maxTotalBackupGigabytes  |    1000 |
12:22:59  | totalVolumesUsed         |       3 |
12:22:59  | totalGigabytesUsed       |      60 |
12:22:59  | totalSnapshotsUsed       |       0 |
12:22:59  | totalBackupsUsed         |       0 |
12:22:59  | totalBackupGigabytesUsed |       0 |
12:22:59  +--------------------------+---------+
12:22:59  + pushd /opt/ciman/openstack-hot
12:22:59  /opt/ciman/openstack-hot /w/workspace/openflowplugin-csit-3node-clustering-only-scandium
12:22:59  + lftools openstack --os-cloud vex stack create releng-openflowplugin-csit-3node-clustering-only-scandium-212 csit-2-instance-type.yaml /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/stack-parameters.yaml
12:23:27  Creating stack releng-openflowplugin-csit-3node-clustering-only-scandium-212
12:23:27  Waiting to initialize infrastructure...
12:23:27  Stack initialization successful.
12:23:27  ------------------------------------
12:23:27  Stack Details
12:23:27  ------------------------------------
12:23:27  {'added': None,
12:23:27   'capabilities': [],
12:23:27   'created_at': '2025-03-10T12:23:03Z',
12:23:27   'deleted': None,
12:23:27   'deleted_at': None,
12:23:27   'description': 'No description',
12:23:27   'environment': None,
12:23:27   'environment_files': None,
12:23:27   'files': None,
12:23:27   'files_container': None,
12:23:27   'id': 'bc7dec0a-69e2-4a55-af04-966b83edb49d',
12:23:27   'is_rollback_disabled': True,
12:23:27   'links': [{'href': 'https://orchestration.public.mtl1.vexxhost.net/v1/12c36e260d8e4bb2913965203b1b491f/stacks/releng-openflowplugin-csit-3node-clustering-only-scandium-212/bc7dec0a-69e2-4a55-af04-966b83edb49d',
12:23:27              'rel': 'self'}],
12:23:27   'location': Munch({'cloud': 'vex', 'region_name': 'ca-ymq-1', 'zone': None, 'project': Munch({'id': '12c36e260d8e4bb2913965203b1b491f', 'name': '61975f2c-7c17-4d69-82fa-c3ae420ad6fd', 'domain_id': None, 'domain_name': 'Default'})}),
12:23:27   'name': 'releng-openflowplugin-csit-3node-clustering-only-scandium-212',
12:23:27   'notification_topics': [],
12:23:27   'outputs': [{'description': 'IP addresses of the 2nd vm types',
12:23:27                'output_key': 'vm_1_ips',
12:23:27                'output_value': ['10.30.171.226']},
12:23:27               {'description': 'IP addresses of the 1st vm types',
12:23:27                'output_key': 'vm_0_ips',
12:23:27                'output_value': ['10.30.170.110',
12:23:27                                 '10.30.171.121',
12:23:27                                 '10.30.170.124']}],
12:23:27   'owner_id': ****,
12:23:27   'parameters': {'OS::project_id': '12c36e260d8e4bb2913965203b1b491f',
12:23:27                  'OS::stack_id': 'bc7dec0a-69e2-4a55-af04-966b83edb49d',
12:23:27                  'OS::stack_name': 'releng-openflowplugin-csit-3node-clustering-only-scandium-212',
12:23:27                  'job_name': '24937-212',
12:23:27                  'silo': 'releng',
12:23:27                  'vm_0_count': '3',
12:23:27                  'vm_0_flavor': 'v3-standard-4',
12:23:27                  'vm_0_image': 'ZZCI - Ubuntu 20.04 - builder - x86_64 - '
12:23:27                                '20250101-160150.998',
12:23:27                  'vm_1_count': '1',
12:23:27                  'vm_1_flavor': 'v3-standard-2',
12:23:27                  'vm_1_image': 'ZZCI - Ubuntu 22.04 - mininet-ovs-217 - x86_64 '
12:23:27                                '- 20250201-060151.911'},
12:23:27   'parent_id': None,
12:23:27   'replaced': None,
12:23:27   'status': 'CREATE_COMPLETE',
12:23:27   'status_reason': 'Stack CREATE completed successfully',
12:23:27   'tags': [],
12:23:27   'template': None,
12:23:27   'template_description': 'No description',
12:23:27   'template_url': None,
12:23:27   'timeout_mins': 15,
12:23:27   'unchanged': None,
12:23:27   'updated': None,
12:23:27   'updated_at': None,
12:23:27   'user_project_id': '55274352cdc1442ba50671e2f31901be'}
12:23:27  ------------------------------------
12:23:27  + popd
12:23:27  /w/workspace/openflowplugin-csit-3node-clustering-only-scandium
12:23:27  [openflowplugin-csit-3node-clustering-only-scandium] $ /bin/bash -l /tmp/jenkins12724419147632955209.sh
12:23:27  ---> Copy SSH public keys to CSIT lab
12:23:27  Setup pyenv:
12:23:27    system
12:23:27    3.8.13
12:23:27    3.9.13
12:23:27    3.10.13
12:23:27  * 3.11.7 (set by /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/.python-version)
12:23:28  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-Tm5S from file:/tmp/.os_lf_venv
12:23:29  lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes python-heatclient python-openstackclient 
12:23:40  lf-activate-venv(): INFO: Adding /tmp/venv-Tm5S/bin to PATH
12:23:42  SSH not responding on 10.30.170.124. Retrying in 10 seconds...
12:23:42  SSH not responding on 10.30.171.121. Retrying in 10 seconds...
12:23:42  SSH not responding on 10.30.170.110. Retrying in 10 seconds...
12:23:43  Warning: Permanently added '10.30.171.226' (ECDSA) to the list of known hosts.
12:23:44   releng-24937-212-1-mininet-ovs-217-0
12:23:44  Successfully copied public keys to slave 10.30.171.226
12:23:52  Ping to 10.30.170.124 successful.
12:23:52  Ping to 10.30.171.121 successful.
12:23:52  Ping to 10.30.170.110 successful.
12:23:53  SSH not responding on 10.30.171.121. Retrying in 10 seconds...
12:23:53  Warning: Permanently added '10.30.170.110' (ECDSA) to the list of known hosts.
12:23:54  Warning: Permanently added '10.30.170.124' (ECDSA) to the list of known hosts.
12:23:54   releng-24937-212-0-builder-0
12:23:54  Successfully copied public keys to slave 10.30.170.110
12:23:54  Process 6499 ready.
12:23:54   releng-24937-212-0-builder-2
12:23:54  Successfully copied public keys to slave 10.30.170.124
12:24:03  Ping to 10.30.171.121 successful.
12:24:04  Warning: Permanently added '10.30.171.121' (ECDSA) to the list of known hosts.
12:24:04   releng-24937-212-0-builder-1
12:24:04  Successfully copied public keys to slave 10.30.171.121
12:24:04  Process 6500 ready.
12:24:04  Process 6501 ready.
12:24:04  Process 6502 ready.
12:24:04  SSH ready on all stack servers.
12:24:04  [openflowplugin-csit-3node-clustering-only-scandium] $ /bin/bash -l /tmp/jenkins17773594482111253719.sh
12:24:04  Setup pyenv:
12:24:04    system
12:24:04    3.8.13
12:24:04    3.9.13
12:24:04    3.10.13
12:24:05  * 3.11.7 (set by /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/.python-version)
12:24:09  lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-Iycg
12:24:09  lf-activate-venv(): INFO: Save venv in file: /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/.robot_venv
12:24:11  lf-activate-venv(): INFO: Installing: setuptools wheel 
12:24:13  lf-activate-venv(): INFO: Adding /tmp/venv-Iycg/bin to PATH
12:24:13  + echo 'Installing Python Requirements'
12:24:13  Installing Python Requirements
12:24:13  + cat
12:24:13  + python -m pip install -r requirements.txt
12:24:13  Looking in indexes: https://nexus3.opendaylight.org/repository/PyPi/simple
12:24:14  Collecting docker-py (from -r requirements.txt (line 1))
12:24:14    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/docker-py/1.10.6/docker_py-1.10.6-py2.py3-none-any.whl (50 kB)
12:24:14  Collecting ipaddr (from -r requirements.txt (line 2))
12:24:14    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/ipaddr/2.2.0/ipaddr-2.2.0.tar.gz (26 kB)
12:24:14    Preparing metadata (setup.py): started
12:24:14    Preparing metadata (setup.py): finished with status 'done'
12:24:14  Collecting netaddr (from -r requirements.txt (line 3))
12:24:14    Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/netaddr/1.3.0/netaddr-1.3.0-py3-none-any.whl (2.3 MB)
12:24:14  Collecting netifaces (from -r requirements.txt (line 4))
12:24:14    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/netifaces/0.11.0/netifaces-0.11.0.tar.gz (30 kB)
12:24:14    Preparing metadata (setup.py): started
12:24:14    Preparing metadata (setup.py): finished with status 'done'
12:24:14  Collecting pyhocon (from -r requirements.txt (line 5))
12:24:14    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyhocon/0.3.61/pyhocon-0.3.61-py3-none-any.whl (25 kB)
12:24:14  Collecting requests (from -r requirements.txt (line 6))
12:24:14    Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/requests/2.32.3/requests-2.32.3-py3-none-any.whl (64 kB)
12:24:14  Collecting robotframework (from -r requirements.txt (line 7))
12:24:14    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework/7.2.2/robotframework-7.2.2-py3-none-any.whl (777 kB)
12:24:14       ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 777.7/777.7 kB 12.4 MB/s eta 0:00:00
12:24:15  Collecting robotframework-httplibrary (from -r requirements.txt (line 8))
12:24:15    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-httplibrary/0.4.2/robotframework-httplibrary-0.4.2.tar.gz (9.1 kB)
12:24:15    Preparing metadata (setup.py): started
12:24:15    Preparing metadata (setup.py): finished with status 'done'
12:24:15  Collecting robotframework-requests==0.9.7 (from -r requirements.txt (line 9))
12:24:15    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-requests/0.9.7/robotframework_requests-0.9.7-py3-none-any.whl (21 kB)
12:24:15  Collecting robotframework-selenium2library (from -r requirements.txt (line 10))
12:24:15    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-selenium2library/3.0.0/robotframework_selenium2library-3.0.0-py2.py3-none-any.whl (6.2 kB)
12:24:15  Collecting robotframework-sshlibrary==3.8.0 (from -r requirements.txt (line 11))
12:24:15    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-sshlibrary/3.8.0/robotframework-sshlibrary-3.8.0.tar.gz (51 kB)
12:24:15    Preparing metadata (setup.py): started
12:24:15    Preparing metadata (setup.py): finished with status 'done'
12:24:15  Collecting scapy (from -r requirements.txt (line 12))
12:24:15    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/scapy/2.6.1/scapy-2.6.1-py3-none-any.whl (2.4 MB)
12:24:15       ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.4/2.4 MB 29.9 MB/s eta 0:00:00
12:24:15  Collecting jsonpath-rw (from -r requirements.txt (line 15))
12:24:15    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpath-rw/1.4.0/jsonpath-rw-1.4.0.tar.gz (13 kB)
12:24:15    Preparing metadata (setup.py): started
12:24:16    Preparing metadata (setup.py): finished with status 'done'
12:24:16  Collecting elasticsearch (from -r requirements.txt (line 18))
12:24:16    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch/8.17.2/elasticsearch-8.17.2-py3-none-any.whl (717 kB)
12:24:16       ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 718.0/718.0 kB 12.2 MB/s eta 0:00:00
12:24:16  Collecting elasticsearch-dsl (from -r requirements.txt (line 19))
12:24:16    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch-dsl/8.17.1/elasticsearch_dsl-8.17.1-py3-none-any.whl (158 kB)
12:24:16  Collecting pyangbind (from -r requirements.txt (line 22))
12:24:16    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyangbind/0.8.6/pyangbind-0.8.6-py3-none-any.whl (52 kB)
12:24:16  Collecting isodate (from -r requirements.txt (line 25))
12:24:16    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/isodate/0.7.2/isodate-0.7.2-py3-none-any.whl (22 kB)
12:24:16  Collecting jmespath (from -r requirements.txt (line 28))
12:24:16    Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jmespath/1.0.1/jmespath-1.0.1-py3-none-any.whl (20 kB)
12:24:16  Collecting jsonpatch (from -r requirements.txt (line 31))
12:24:16    Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpatch/1.33/jsonpatch-1.33-py2.py3-none-any.whl (12 kB)
12:24:16  Collecting paramiko>=1.15.3 (from robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
12:24:16    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/paramiko/3.5.1/paramiko-3.5.1-py3-none-any.whl (227 kB)
12:24:16  Collecting scp>=0.13.0 (from robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
12:24:16    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/scp/0.15.0/scp-0.15.0-py2.py3-none-any.whl (8.8 kB)
12:24:16  Collecting docker-pycreds>=0.2.1 (from docker-py->-r requirements.txt (line 1))
12:24:16    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/docker-pycreds/0.4.0/docker_pycreds-0.4.0-py2.py3-none-any.whl (9.0 kB)
12:24:16  Collecting six>=1.4.0 (from docker-py->-r requirements.txt (line 1))
12:24:16    Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/six/1.17.0/six-1.17.0-py2.py3-none-any.whl (11 kB)
12:24:16  Collecting websocket-client>=0.32.0 (from docker-py->-r requirements.txt (line 1))
12:24:16    Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/websocket-client/1.8.0/websocket_client-1.8.0-py3-none-any.whl (58 kB)
12:24:16  Collecting pyparsing<4,>=2 (from pyhocon->-r requirements.txt (line 5))
12:24:16    Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pyparsing/3.2.1/pyparsing-3.2.1-py3-none-any.whl (107 kB)
12:24:17  Collecting charset-normalizer<4,>=2 (from requests->-r requirements.txt (line 6))
12:24:17    Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/charset-normalizer/3.4.1/charset_normalizer-3.4.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (143 kB)
12:24:17  Collecting idna<4,>=2.5 (from requests->-r requirements.txt (line 6))
12:24:17    Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/idna/3.10/idna-3.10-py3-none-any.whl (70 kB)
12:24:17  Collecting urllib3<3,>=1.21.1 (from requests->-r requirements.txt (line 6))
12:24:17    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/urllib3/2.3.0/urllib3-2.3.0-py3-none-any.whl (128 kB)
12:24:17  Collecting certifi>=2017.4.17 (from requests->-r requirements.txt (line 6))
12:24:17    Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/certifi/2025.1.31/certifi-2025.1.31-py3-none-any.whl (166 kB)
12:24:17  Collecting webtest>=2.0 (from robotframework-httplibrary->-r requirements.txt (line 8))
12:24:17    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/webtest/3.0.4/WebTest-3.0.4-py3-none-any.whl (32 kB)
12:24:17  Collecting jsonpointer (from robotframework-httplibrary->-r requirements.txt (line 8))
12:24:17    Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpointer/3.0.0/jsonpointer-3.0.0-py2.py3-none-any.whl (7.6 kB)
12:24:17  Collecting robotframework-seleniumlibrary>=3.0.0 (from robotframework-selenium2library->-r requirements.txt (line 10))
12:24:17    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-seleniumlibrary/6.7.1/robotframework_seleniumlibrary-6.7.1-py2.py3-none-any.whl (104 kB)
12:24:17  Collecting ply (from jsonpath-rw->-r requirements.txt (line 15))
12:24:17    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/ply/3.11/ply-3.11-py2.py3-none-any.whl (49 kB)
12:24:17  Collecting decorator (from jsonpath-rw->-r requirements.txt (line 15))
12:24:17    Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/decorator/5.2.1/decorator-5.2.1-py3-none-any.whl (9.2 kB)
12:24:17  Collecting elastic-transport<9,>=8.15.1 (from elasticsearch->-r requirements.txt (line 18))
12:24:17    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elastic-transport/8.17.0/elastic_transport-8.17.0-py3-none-any.whl (64 kB)
12:24:17  Collecting python-dateutil (from elasticsearch-dsl->-r requirements.txt (line 19))
12:24:17    Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/python-dateutil/2.9.0.post0/python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB)
12:24:17  Collecting typing-extensions (from elasticsearch-dsl->-r requirements.txt (line 19))
12:24:17    Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/typing-extensions/4.12.2/typing_extensions-4.12.2-py3-none-any.whl (37 kB)
12:24:17  Collecting pyang (from pyangbind->-r requirements.txt (line 22))
12:24:17    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyang/2.6.1/pyang-2.6.1-py2.py3-none-any.whl (594 kB)
12:24:17       ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 594.7/594.7 kB 9.9 MB/s eta 0:00:00
12:24:18  Collecting lxml (from pyangbind->-r requirements.txt (line 22))
12:24:18    Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/lxml/5.3.1/lxml-5.3.1-cp311-cp311-manylinux_2_28_x86_64.whl (5.0 MB)
12:24:19  Collecting regex (from pyangbind->-r requirements.txt (line 22))
12:24:19    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/regex/2024.11.6/regex-2024.11.6-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (792 kB)
12:24:19       ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 792.7/792.7 kB 27.8 MB/s eta 0:00:00
12:24:19  Collecting enum34 (from pyangbind->-r requirements.txt (line 22))
12:24:19    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/enum34/1.1.10/enum34-1.1.10-py3-none-any.whl (11 kB)
12:24:19  Collecting bcrypt>=3.2 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
12:24:19    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/bcrypt/4.3.0/bcrypt-4.3.0-cp39-abi3-manylinux_2_28_x86_64.whl (284 kB)
12:24:19  Collecting cryptography>=3.3 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
12:24:19    Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/cryptography/44.0.2/cryptography-44.0.2-cp39-abi3-manylinux_2_28_x86_64.whl (4.2 MB)
12:24:19  Collecting pynacl>=1.5 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
12:24:19    Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pynacl/1.5.0/PyNaCl-1.5.0-cp36-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.manylinux_2_24_x86_64.whl (856 kB)
12:24:19  Collecting selenium>=4.3.0 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
12:24:19    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/selenium/4.29.0/selenium-4.29.0-py3-none-any.whl (9.5 MB)
12:24:20       ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 9.5/9.5 MB 45.2 MB/s eta 0:00:00
12:24:20  Collecting robotframework-pythonlibcore>=4.4.1 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
12:24:20    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-pythonlibcore/4.4.1/robotframework_pythonlibcore-4.4.1-py2.py3-none-any.whl (12 kB)
12:24:20  Collecting click>=8.0 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
12:24:20    Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/click/8.1.8/click-8.1.8-py3-none-any.whl (98 kB)
12:24:20  Collecting WebOb>=1.2 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
12:24:20    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/webob/1.8.9/WebOb-1.8.9-py2.py3-none-any.whl (115 kB)
12:24:20  Collecting waitress>=3.0.2 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
12:24:20    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/waitress/3.0.2/waitress-3.0.2-py3-none-any.whl (56 kB)
12:24:20  Collecting beautifulsoup4 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
12:24:20    Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/beautifulsoup4/4.13.3/beautifulsoup4-4.13.3-py3-none-any.whl (186 kB)
12:24:20  Collecting cffi>=1.12 (from cryptography>=3.3->paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
12:24:20    Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/cffi/1.17.1/cffi-1.17.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (467 kB)
12:24:20  Collecting trio~=0.17 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
12:24:20    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/trio/0.29.0/trio-0.29.0-py3-none-any.whl (492 kB)
12:24:20  Collecting trio-websocket~=0.9 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
12:24:20    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/trio-websocket/0.12.2/trio_websocket-0.12.2-py3-none-any.whl (21 kB)
12:24:20  Collecting soupsieve>1.2 (from beautifulsoup4->webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
12:24:20    Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/soupsieve/2.6/soupsieve-2.6-py3-none-any.whl (36 kB)
12:24:20  Collecting pycparser (from cffi>=1.12->cryptography>=3.3->paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
12:24:20    Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pycparser/2.22/pycparser-2.22-py3-none-any.whl (117 kB)
12:24:20  Collecting attrs>=23.2.0 (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
12:24:20    Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/attrs/25.1.0/attrs-25.1.0-py3-none-any.whl (63 kB)
12:24:21  Collecting sortedcontainers (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
12:24:21    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/sortedcontainers/2.4.0/sortedcontainers-2.4.0-py2.py3-none-any.whl (29 kB)
12:24:21  Collecting outcome (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
12:24:21    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/outcome/1.3.0.post0/outcome-1.3.0.post0-py2.py3-none-any.whl (10 kB)
12:24:21  Collecting sniffio>=1.3.0 (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
12:24:21    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/sniffio/1.3.1/sniffio-1.3.1-py3-none-any.whl (10 kB)
12:24:21  Collecting wsproto>=0.14 (from trio-websocket~=0.9->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
12:24:21    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/wsproto/1.2.0/wsproto-1.2.0-py3-none-any.whl (24 kB)
12:24:21  Collecting pysocks!=1.5.7,<2.0,>=1.5.6 (from urllib3[socks]<3,>=1.26->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
12:24:21    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pysocks/1.7.1/PySocks-1.7.1-py3-none-any.whl (16 kB)
12:24:21  Collecting h11<1,>=0.9.0 (from wsproto>=0.14->trio-websocket~=0.9->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
12:24:21    Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/h11/0.14.0/h11-0.14.0-py3-none-any.whl (58 kB)
12:24:21  Building wheels for collected packages: robotframework-sshlibrary, ipaddr, netifaces, robotframework-httplibrary, jsonpath-rw
12:24:21    Building wheel for robotframework-sshlibrary (setup.py): started
12:24:21    Building wheel for robotframework-sshlibrary (setup.py): finished with status 'done'
12:24:21    Created wheel for robotframework-sshlibrary: filename=robotframework_sshlibrary-3.8.0-py3-none-any.whl size=55175 sha256=d042581ff39d086d4b009113f3ead7a2c8793bc337e20de191fde51e0686dccb
12:24:21    Stored in directory: /home/jenkins/.cache/pip/wheels/f7/c9/b3/a977b7bcc410d45ae27d240df3d00a12585509180e373ecccc
12:24:21    Building wheel for ipaddr (setup.py): started
12:24:21    Building wheel for ipaddr (setup.py): finished with status 'done'
12:24:21    Created wheel for ipaddr: filename=ipaddr-2.2.0-py3-none-any.whl size=18322 sha256=7462ef099166332faadc28490e880964dec59f60ff2f55f9cdb01664a84eea7c
12:24:21    Stored in directory: /home/jenkins/.cache/pip/wheels/dc/6c/04/da2d847fa8d45c59af3e1d83e2acc29cb8adcbaf04c0898dbf
12:24:21    Building wheel for netifaces (setup.py): started
12:24:24    Building wheel for netifaces (setup.py): finished with status 'done'
12:24:24    Created wheel for netifaces: filename=netifaces-0.11.0-cp311-cp311-linux_x86_64.whl size=41064 sha256=2a05cac66a6f08addaca0eabd76cbba2d709cd6e9de52bf7135da7c8b29ba0c1
12:24:24    Stored in directory: /home/jenkins/.cache/pip/wheels/f8/18/88/e61d54b995bea304bdb1d040a92b72228a1bf72ca2a3eba7c9
12:24:24    Building wheel for robotframework-httplibrary (setup.py): started
12:24:24    Building wheel for robotframework-httplibrary (setup.py): finished with status 'done'
12:24:24    Created wheel for robotframework-httplibrary: filename=robotframework_httplibrary-0.4.2-py3-none-any.whl size=10013 sha256=f6be17b13f9a62c33089085f07fa23111fa088a2fdade52b17bbf36cfb2658dd
12:24:24    Stored in directory: /home/jenkins/.cache/pip/wheels/aa/bc/0d/9a20dd51effef392aae2733cb4c7b66c6fa29fca33d88b57ed
12:24:24    Building wheel for jsonpath-rw (setup.py): started
12:24:24    Building wheel for jsonpath-rw (setup.py): finished with status 'done'
12:24:24    Created wheel for jsonpath-rw: filename=jsonpath_rw-1.4.0-py3-none-any.whl size=15175 sha256=085d6bb537548767f8b3065f145b46353e75a7507866fc61fc68f2371d4b71fd
12:24:24    Stored in directory: /home/jenkins/.cache/pip/wheels/f1/54/63/9a8da38cefae13755097b36cc852decc25d8ef69c37d58d4eb
12:24:24  Successfully built robotframework-sshlibrary ipaddr netifaces robotframework-httplibrary jsonpath-rw
12:24:24  Installing collected packages: sortedcontainers, ply, netifaces, ipaddr, enum34, websocket-client, WebOb, waitress, urllib3, typing-extensions, soupsieve, sniffio, six, scapy, robotframework-pythonlibcore, robotframework, regex, pysocks, pyparsing, pycparser, netaddr, lxml, jsonpointer, jmespath, isodate, idna, h11, decorator, click, charset-normalizer, certifi, bcrypt, attrs, wsproto, requests, python-dateutil, pyhocon, pyang, outcome, jsonpath-rw, jsonpatch, elastic-transport, docker-pycreds, cffi, beautifulsoup4, webtest, trio, robotframework-requests, pynacl, pyangbind, elasticsearch, docker-py, cryptography, trio-websocket, robotframework-httplibrary, paramiko, elasticsearch-dsl, selenium, scp, robotframework-sshlibrary, robotframework-seleniumlibrary, robotframework-selenium2library
12:24:31  Successfully installed WebOb-1.8.9 attrs-25.1.0 bcrypt-4.3.0 beautifulsoup4-4.13.3 certifi-2025.1.31 cffi-1.17.1 charset-normalizer-3.4.1 click-8.1.8 cryptography-44.0.2 decorator-5.2.1 docker-py-1.10.6 docker-pycreds-0.4.0 elastic-transport-8.17.0 elasticsearch-8.17.2 elasticsearch-dsl-8.17.1 enum34-1.1.10 h11-0.14.0 idna-3.10 ipaddr-2.2.0 isodate-0.7.2 jmespath-1.0.1 jsonpatch-1.33 jsonpath-rw-1.4.0 jsonpointer-3.0.0 lxml-5.3.1 netaddr-1.3.0 netifaces-0.11.0 outcome-1.3.0.post0 paramiko-3.5.1 ply-3.11 pyang-2.6.1 pyangbind-0.8.6 pycparser-2.22 pyhocon-0.3.61 pynacl-1.5.0 pyparsing-3.2.1 pysocks-1.7.1 python-dateutil-2.9.0.post0 regex-2024.11.6 requests-2.32.3 robotframework-7.2.2 robotframework-httplibrary-0.4.2 robotframework-pythonlibcore-4.4.1 robotframework-requests-0.9.7 robotframework-selenium2library-3.0.0 robotframework-seleniumlibrary-6.7.1 robotframework-sshlibrary-3.8.0 scapy-2.6.1 scp-0.15.0 selenium-4.29.0 six-1.17.0 sniffio-1.3.1 sortedcontainers-2.4.0 soupsieve-2.6 trio-0.29.0 trio-websocket-0.12.2 typing-extensions-4.12.2 urllib3-2.3.0 waitress-3.0.2 websocket-client-1.8.0 webtest-3.0.4 wsproto-1.2.0
12:24:31  + pip freeze
12:24:31  attrs==25.1.0
12:24:31  bcrypt==4.3.0
12:24:31  beautifulsoup4==4.13.3
12:24:31  certifi==2025.1.31
12:24:31  cffi==1.17.1
12:24:31  charset-normalizer==3.4.1
12:24:31  click==8.1.8
12:24:31  cryptography==44.0.2
12:24:31  decorator==5.2.1
12:24:31  distlib==0.3.9
12:24:31  docker-py==1.10.6
12:24:31  docker-pycreds==0.4.0
12:24:31  elastic-transport==8.17.0
12:24:31  elasticsearch==8.17.2
12:24:31  elasticsearch-dsl==8.17.1
12:24:31  enum34==1.1.10
12:24:31  filelock==3.17.0
12:24:31  h11==0.14.0
12:24:31  idna==3.10
12:24:31  ipaddr==2.2.0
12:24:31  isodate==0.7.2
12:24:31  jmespath==1.0.1
12:24:31  jsonpatch==1.33
12:24:31  jsonpath-rw==1.4.0
12:24:31  jsonpointer==3.0.0
12:24:31  lxml==5.3.1
12:24:31  netaddr==1.3.0
12:24:31  netifaces==0.11.0
12:24:31  outcome==1.3.0.post0
12:24:31  paramiko==3.5.1
12:24:31  platformdirs==4.3.6
12:24:31  ply==3.11
12:24:31  pyang==2.6.1
12:24:31  pyangbind==0.8.6
12:24:31  pycparser==2.22
12:24:31  pyhocon==0.3.61
12:24:31  PyNaCl==1.5.0
12:24:31  pyparsing==3.2.1
12:24:31  PySocks==1.7.1
12:24:31  python-dateutil==2.9.0.post0
12:24:31  regex==2024.11.6
12:24:31  requests==2.32.3
12:24:31  robotframework==7.2.2
12:24:31  robotframework-httplibrary==0.4.2
12:24:31  robotframework-pythonlibcore==4.4.1
12:24:31  robotframework-requests==0.9.7
12:24:31  robotframework-selenium2library==3.0.0
12:24:31  robotframework-seleniumlibrary==6.7.1
12:24:31  robotframework-sshlibrary==3.8.0
12:24:31  scapy==2.6.1
12:24:31  scp==0.15.0
12:24:31  selenium==4.29.0
12:24:31  six==1.17.0
12:24:31  sniffio==1.3.1
12:24:31  sortedcontainers==2.4.0
12:24:31  soupsieve==2.6
12:24:31  trio==0.29.0
12:24:31  trio-websocket==0.12.2
12:24:31  typing_extensions==4.12.2
12:24:31  urllib3==2.3.0
12:24:31  virtualenv==20.29.3
12:24:31  waitress==3.0.2
12:24:31  WebOb==1.8.9
12:24:31  websocket-client==1.8.0
12:24:31  WebTest==3.0.4
12:24:31  wsproto==1.2.0
12:24:31  [EnvInject] - Injecting environment variables from a build step.
12:24:31  [EnvInject] - Injecting as environment variables the properties file path 'env.properties'
12:24:31  [EnvInject] - Variables injected successfully.
12:24:32  [openflowplugin-csit-3node-clustering-only-scandium] $ /bin/bash -l /tmp/jenkins11840874255943531354.sh
12:24:32  Setup pyenv:
12:24:32    system
12:24:32    3.8.13
12:24:32    3.9.13
12:24:32    3.10.13
12:24:32  * 3.11.7 (set by /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/.python-version)
12:24:32  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-Tm5S from file:/tmp/.os_lf_venv
12:24:33  lf-activate-venv(): INFO: Installing: python-heatclient python-openstackclient yq 
12:24:38  ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
12:24:38  lftools 0.37.10 requires urllib3<2.1.0, but you have urllib3 2.3.0 which is incompatible.
12:24:38  lf-activate-venv(): INFO: Adding /tmp/venv-Tm5S/bin to PATH
12:24:38  + ODL_SYSTEM=()
12:24:38  + TOOLS_SYSTEM=()
12:24:38  + OPENSTACK_SYSTEM=()
12:24:38  + OPENSTACK_CONTROLLERS=()
12:24:38  + mapfile -t ADDR
12:24:38  ++ jq -r '.outputs[] | select(.output_key | match("^vm_[0-9]+_ips$")) | .output_value | .[]'
12:24:38  ++ openstack stack show -f json -c outputs releng-openflowplugin-csit-3node-clustering-only-scandium-212
12:24:40  + for i in "${ADDR[@]}"
12:24:40  ++ ssh 10.30.170.110 hostname -s
12:24:40  Warning: Permanently added '10.30.170.110' (ECDSA) to the list of known hosts.
12:24:40  + REMHOST=releng-24937-212-0-builder-0
12:24:40  + case ${REMHOST} in
12:24:40  + ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}")
12:24:40  + for i in "${ADDR[@]}"
12:24:40  ++ ssh 10.30.171.121 hostname -s
12:24:40  Warning: Permanently added '10.30.171.121' (ECDSA) to the list of known hosts.
12:24:41  + REMHOST=releng-24937-212-0-builder-1
12:24:41  + case ${REMHOST} in
12:24:41  + ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}")
12:24:41  + for i in "${ADDR[@]}"
12:24:41  ++ ssh 10.30.170.124 hostname -s
12:24:41  Warning: Permanently added '10.30.170.124' (ECDSA) to the list of known hosts.
12:24:41  + REMHOST=releng-24937-212-0-builder-2
12:24:41  + case ${REMHOST} in
12:24:41  + ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}")
12:24:41  + for i in "${ADDR[@]}"
12:24:41  ++ ssh 10.30.171.226 hostname -s
12:24:41  Warning: Permanently added '10.30.171.226' (ECDSA) to the list of known hosts.
12:24:41  + REMHOST=releng-24937-212-1-mininet-ovs-217-0
12:24:41  + case ${REMHOST} in
12:24:41  + TOOLS_SYSTEM=("${TOOLS_SYSTEM[@]}" "${i}")
12:24:41  + echo NUM_ODL_SYSTEM=3
12:24:41  + echo NUM_TOOLS_SYSTEM=1
12:24:41  + '[' '' == yes ']'
12:24:41  + NUM_OPENSTACK_SYSTEM=0
12:24:41  + echo NUM_OPENSTACK_SYSTEM=0
12:24:41  + '[' 0 -eq 2 ']'
12:24:41  + echo ODL_SYSTEM_IP=10.30.170.110
12:24:41  ++ seq 0 2
12:24:41  + for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 )))
12:24:41  + echo ODL_SYSTEM_1_IP=10.30.170.110
12:24:41  + for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 )))
12:24:41  + echo ODL_SYSTEM_2_IP=10.30.171.121
12:24:41  + for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 )))
12:24:41  + echo ODL_SYSTEM_3_IP=10.30.170.124
12:24:41  + echo TOOLS_SYSTEM_IP=10.30.171.226
12:24:41  ++ seq 0 0
12:24:41  + for i in $(seq 0 $(( ${#TOOLS_SYSTEM[@]} - 1 )))
12:24:41  + echo TOOLS_SYSTEM_1_IP=10.30.171.226
12:24:41  + openstack_index=0
12:24:41  + NUM_OPENSTACK_CONTROL_NODES=1
12:24:41  + echo NUM_OPENSTACK_CONTROL_NODES=1
12:24:41  ++ seq 0 0
12:24:41  + for i in $(seq 0 $((NUM_OPENSTACK_CONTROL_NODES - 1)))
12:24:41  + echo OPENSTACK_CONTROL_NODE_1_IP=
12:24:41  + NUM_OPENSTACK_COMPUTE_NODES=-1
12:24:41  + echo NUM_OPENSTACK_COMPUTE_NODES=-1
12:24:41  + '[' -1 -ge 2 ']'
12:24:41  ++ seq 0 -2
12:24:41  + NUM_OPENSTACK_HAPROXY_NODES=0
12:24:41  + echo NUM_OPENSTACK_HAPROXY_NODES=0
12:24:41  ++ seq 0 -1
12:24:41  + echo 'Contents of slave_addresses.txt:'
12:24:41  Contents of slave_addresses.txt:
12:24:41  + cat slave_addresses.txt
12:24:41  NUM_ODL_SYSTEM=3
12:24:41  NUM_TOOLS_SYSTEM=1
12:24:41  NUM_OPENSTACK_SYSTEM=0
12:24:41  ODL_SYSTEM_IP=10.30.170.110
12:24:41  ODL_SYSTEM_1_IP=10.30.170.110
12:24:41  ODL_SYSTEM_2_IP=10.30.171.121
12:24:41  ODL_SYSTEM_3_IP=10.30.170.124
12:24:41  TOOLS_SYSTEM_IP=10.30.171.226
12:24:41  TOOLS_SYSTEM_1_IP=10.30.171.226
12:24:41  NUM_OPENSTACK_CONTROL_NODES=1
12:24:41  OPENSTACK_CONTROL_NODE_1_IP=
12:24:41  NUM_OPENSTACK_COMPUTE_NODES=-1
12:24:41  NUM_OPENSTACK_HAPROXY_NODES=0
12:24:41  [EnvInject] - Injecting environment variables from a build step.
12:24:41  [EnvInject] - Injecting as environment variables the properties file path 'slave_addresses.txt'
12:24:41  [EnvInject] - Variables injected successfully.
12:24:41  [openflowplugin-csit-3node-clustering-only-scandium] $ /bin/sh /tmp/jenkins15149097356800415074.sh
12:24:41  Preparing for JRE Version 21
12:24:41  Karaf artifact is karaf
12:24:41  Karaf project is integration
12:24:41  Java home is /usr/lib/jvm/java-21-openjdk-amd64
12:24:41  [EnvInject] - Injecting environment variables from a build step.
12:24:41  [EnvInject] - Injecting as environment variables the properties file path 'set_variables.env'
12:24:41  [EnvInject] - Variables injected successfully.
12:24:41  [openflowplugin-csit-3node-clustering-only-scandium] $ /bin/bash /tmp/jenkins17008644169897629621.sh
12:24:41  Distribution bundle URL is https://nexus.opendaylight.org/content/repositories//autorelease-8681/org/opendaylight/integration/karaf/0.21.2/karaf-0.21.2.zip
12:24:41  Distribution bundle is karaf-0.21.2.zip
12:24:41  Distribution bundle version is 0.21.2
12:24:41  Distribution folder is karaf-0.21.2
12:24:41  Nexus prefix is https://nexus.opendaylight.org
12:24:41  [EnvInject] - Injecting environment variables from a build step.
12:24:41  [EnvInject] - Injecting as environment variables the properties file path 'detect_variables.env'
12:24:41  [EnvInject] - Variables injected successfully.
12:24:41  [openflowplugin-csit-3node-clustering-only-scandium] $ /bin/bash -l /tmp/jenkins9844577870078444151.sh
12:24:41  Setup pyenv:
12:24:42    system
12:24:42    3.8.13
12:24:42    3.9.13
12:24:42    3.10.13
12:24:42  * 3.11.7 (set by /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/.python-version)
12:24:42  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-Tm5S from file:/tmp/.os_lf_venv
12:24:43  lf-activate-venv(): INFO: Installing: python-heatclient python-openstackclient 
12:24:47  lf-activate-venv(): INFO: Adding /tmp/venv-Tm5S/bin to PATH
12:24:47  Copying common-functions.sh to /tmp
12:24:49  Copying common-functions.sh to 10.30.170.110:/tmp
12:24:49  Warning: Permanently added '10.30.170.110' (ECDSA) to the list of known hosts.
12:24:49  Copying common-functions.sh to 10.30.171.121:/tmp
12:24:49  Warning: Permanently added '10.30.171.121' (ECDSA) to the list of known hosts.
12:24:49  Copying common-functions.sh to 10.30.170.124:/tmp
12:24:49  Warning: Permanently added '10.30.170.124' (ECDSA) to the list of known hosts.
12:24:50  Copying common-functions.sh to 10.30.171.226:/tmp
12:24:50  Warning: Permanently added '10.30.171.226' (ECDSA) to the list of known hosts.
12:24:50  [openflowplugin-csit-3node-clustering-only-scandium] $ /bin/bash /tmp/jenkins7663176595945383990.sh
12:24:50  common-functions.sh is being sourced
12:24:50  common-functions environment:
12:24:50  MAVENCONF: /tmp/karaf-0.21.2/etc/org.ops4j.pax.url.mvn.cfg
12:24:50  ACTUALFEATURES: 
12:24:50  FEATURESCONF: /tmp/karaf-0.21.2/etc/org.apache.karaf.features.cfg
12:24:50  CUSTOMPROP: /tmp/karaf-0.21.2/etc/custom.properties
12:24:50  LOGCONF: /tmp/karaf-0.21.2/etc/org.ops4j.pax.logging.cfg
12:24:50  MEMCONF: /tmp/karaf-0.21.2/bin/setenv
12:24:50  CONTROLLERMEM: 2048m
12:24:50  AKKACONF: /tmp/karaf-0.21.2/configuration/initial/akka.conf
12:24:50  MODULESCONF: /tmp/karaf-0.21.2/configuration/initial/modules.conf
12:24:50  MODULESHARDSCONF: /tmp/karaf-0.21.2/configuration/initial/module-shards.conf
12:24:50  SUITES: 
12:24:50  
12:24:50  #################################################
12:24:50  ##         Configure Cluster and Start         ##
12:24:50  #################################################
12:24:50  ACTUALFEATURES: odl-infrautils-ready,odl-jolokia,odl-openflowplugin-flow-services-rest,odl-openflowplugin-app-table-miss-enforcer
12:24:50  SPACE_SEPARATED_FEATURES: odl-infrautils-ready odl-jolokia odl-openflowplugin-flow-services-rest odl-openflowplugin-app-table-miss-enforcer
12:24:50  Locating script plan to use...
12:24:50  Finished running script plans
12:24:50  Configuring member-1 with IP address 10.30.170.110
12:24:50  Warning: Permanently added '10.30.170.110' (ECDSA) to the list of known hosts.
12:24:50  Warning: Permanently added '10.30.170.110' (ECDSA) to the list of known hosts.
12:24:50  common-functions.sh is being sourced
12:24:50  + source /tmp/common-functions.sh karaf-0.21.2
12:24:50  ++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]]
12:24:50  ++ echo 'common-functions.sh is being sourced'
12:24:50  ++ BUNDLEFOLDER=karaf-0.21.2
12:24:50  ++ export MAVENCONF=/tmp/karaf-0.21.2/etc/org.ops4j.pax.url.mvn.cfg
12:24:50  ++ MAVENCONF=/tmp/karaf-0.21.2/etc/org.ops4j.pax.url.mvn.cfg
12:24:50  ++ export FEATURESCONF=/tmp/karaf-0.21.2/etc/org.apache.karaf.features.cfg
12:24:50  ++ FEATURESCONF=/tmp/karaf-0.21.2/etc/org.apache.karaf.features.cfg
12:24:50  ++ export CUSTOMPROP=/tmp/karaf-0.21.2/etc/custom.properties
12:24:50  ++ CUSTOMPROP=/tmp/karaf-0.21.2/etc/custom.properties
12:24:50  ++ export LOGCONF=/tmp/karaf-0.21.2/etc/org.ops4j.pax.logging.cfg
12:24:50  ++ LOGCONF=/tmp/karaf-0.21.2/etc/org.ops4j.pax.logging.cfg
12:24:50  ++ export MEMCONF=/tmp/karaf-0.21.2/bin/setenv
12:24:50  ++ MEMCONF=/tmp/karaf-0.21.2/bin/setenv
12:24:50  ++ export CONTROLLERMEM=
12:24:50  ++ CONTROLLERMEM=
12:24:50  ++ export AKKACONF=/tmp/karaf-0.21.2/configuration/initial/akka.conf
12:24:50  ++ AKKACONF=/tmp/karaf-0.21.2/configuration/initial/akka.conf
12:24:50  ++ export MODULESCONF=/tmp/karaf-0.21.2/configuration/initial/modules.conf
12:24:50  ++ MODULESCONF=/tmp/karaf-0.21.2/configuration/initial/modules.conf
12:24:50  ++ export MODULESHARDSCONF=/tmp/karaf-0.21.2/configuration/initial/module-shards.conf
12:24:50  ++ MODULESHARDSCONF=/tmp/karaf-0.21.2/configuration/initial/module-shards.conf
12:24:50  ++ print_common_env
12:24:50  ++ cat
12:24:50  common-functions environment:
12:24:50  MAVENCONF: /tmp/karaf-0.21.2/etc/org.ops4j.pax.url.mvn.cfg
12:24:50  ACTUALFEATURES: 
12:24:50  FEATURESCONF: /tmp/karaf-0.21.2/etc/org.apache.karaf.features.cfg
12:24:50  CUSTOMPROP: /tmp/karaf-0.21.2/etc/custom.properties
12:24:50  LOGCONF: /tmp/karaf-0.21.2/etc/org.ops4j.pax.logging.cfg
12:24:50  MEMCONF: /tmp/karaf-0.21.2/bin/setenv
12:24:50  CONTROLLERMEM: 
12:24:50  AKKACONF: /tmp/karaf-0.21.2/configuration/initial/akka.conf
12:24:50  MODULESCONF: /tmp/karaf-0.21.2/configuration/initial/modules.conf
12:24:50  MODULESHARDSCONF: /tmp/karaf-0.21.2/configuration/initial/module-shards.conf
12:24:50  SUITES: 
12:24:50  
12:24:50  Changing to /tmp
12:24:50  Downloading the distribution from https://nexus.opendaylight.org/content/repositories//autorelease-8681/org/opendaylight/integration/karaf/0.21.2/karaf-0.21.2.zip
12:24:50  ++ SSH='ssh -t -t'
12:24:50  ++ extra_services_cntl='     dnsmasq.service     httpd.service     libvirtd.service     openvswitch.service     ovs-vswitchd.service     ovsdb-server.service     rabbitmq-server.service '
12:24:50  ++ extra_services_cmp='     libvirtd.service     openvswitch.service     ovs-vswitchd.service     ovsdb-server.service '
12:24:50  + echo 'Changing to /tmp'
12:24:50  + cd /tmp
12:24:50  + echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories//autorelease-8681/org/opendaylight/integration/karaf/0.21.2/karaf-0.21.2.zip'
12:24:50  + wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories//autorelease-8681/org/opendaylight/integration/karaf/0.21.2/karaf-0.21.2.zip
12:24:50  --2025-03-10 12:24:50--  https://nexus.opendaylight.org/content/repositories//autorelease-8681/org/opendaylight/integration/karaf/0.21.2/karaf-0.21.2.zip
12:24:50  Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6
12:24:50  Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected.
12:24:50  HTTP request sent, awaiting response... 200 OK
12:24:50  Length: 234524817 (224M) [application/zip]
12:24:50  Saving to: ‘karaf-0.21.2.zip’
12:24:50  
12:24:50       0K ........ ........ ........ ........ ........ ........  1% 45.2M 5s
12:24:50    3072K ........ ........ ........ ........ ........ ........  2% 89.6M 4s
12:24:51    6144K ........ ........ ........ ........ ........ ........  4%  122M 3s
12:24:51    9216K ........ ........ ........ ........ ........ ........  5%  132M 3s
12:24:51   12288K ........ ........ ........ ........ ........ ........  6%  147M 2s
12:24:51   15360K ........ ........ ........ ........ ........ ........  8%  172M 2s
12:24:51   18432K ........ ........ ........ ........ ........ ........  9%  201M 2s
12:24:51   21504K ........ ........ ........ ........ ........ ........ 10%  201M 2s
12:24:51   24576K ........ ........ ........ ........ ........ ........ 12%  213M 2s
12:24:51   27648K ........ ........ ........ ........ ........ ........ 13%  243M 2s
12:24:51   30720K ........ ........ ........ ........ ........ ........ 14%  267M 1s
12:24:51   33792K ........ ........ ........ ........ ........ ........ 16%  299M 1s
12:24:51   36864K ........ ........ ........ ........ ........ ........ 17%  270M 1s
12:24:51   39936K ........ ........ ........ ........ ........ ........ 18%  343M 1s
12:24:51   43008K ........ ........ ........ ........ ........ ........ 20%  282M 1s
12:24:51   46080K ........ ........ ........ ........ ........ ........ 21%  335M 1s
12:24:51   49152K ........ ........ ........ ........ ........ ........ 22%  263M 1s
12:24:51   52224K ........ ........ ........ ........ ........ ........ 24%  238M 1s
12:24:51   55296K ........ ........ ........ ........ ........ ........ 25%  162M 1s
12:24:51   58368K ........ ........ ........ ........ ........ ........ 26%  175M 1s
12:24:51   61440K ........ ........ ........ ........ ........ ........ 28%  187M 1s
12:24:51   64512K ........ ........ ........ ........ ........ ........ 29%  150M 1s
12:24:51   67584K ........ ........ ........ ........ ........ ........ 30%  231M 1s
12:24:51   70656K ........ ........ ........ ........ ........ ........ 32%  272M 1s
12:24:51   73728K ........ ........ ........ ........ ........ ........ 33%  268M 1s
12:24:51   76800K ........ ........ ........ ........ ........ ........ 34%  213M 1s
12:24:51   79872K ........ ........ ........ ........ ........ ........ 36%  193M 1s
12:24:51   82944K ........ ........ ........ ........ ........ ........ 37%  191M 1s
12:24:51   86016K ........ ........ ........ ........ ........ ........ 38%  181M 1s
12:24:51   89088K ........ ........ ........ ........ ........ ........ 40%  185M 1s
12:24:51   92160K ........ ........ ........ ........ ........ ........ 41%  170M 1s
12:24:51   95232K ........ ........ ........ ........ ........ ........ 42%  162M 1s
12:24:51   98304K ........ ........ ........ ........ ........ ........ 44%  216M 1s
12:24:51  101376K ........ ........ ........ ........ ........ ........ 45%  231M 1s
12:24:51  104448K ........ ........ ........ ........ ........ ........ 46%  213M 1s
12:24:51  107520K ........ ........ ........ ........ ........ ........ 48%  218M 1s
12:24:51  110592K ........ ........ ........ ........ ........ ........ 49%  247M 1s
12:24:51  113664K ........ ........ ........ ........ ........ ........ 50%  293M 1s
12:24:51  116736K ........ ........ ........ ........ ........ ........ 52%  277M 1s
12:24:51  119808K ........ ........ ........ ........ ........ ........ 53%  276M 1s
12:24:51  122880K ........ ........ ........ ........ ........ ........ 54%  272M 1s
12:24:51  125952K ........ ........ ........ ........ ........ ........ 56%  280M 1s
12:24:51  129024K ........ ........ ........ ........ ........ ........ 57%  267M 0s
12:24:51  132096K ........ ........ ........ ........ ........ ........ 59%  287M 0s
12:24:51  135168K ........ ........ ........ ........ ........ ........ 60%  273M 0s
12:24:51  138240K ........ ........ ........ ........ ........ ........ 61%  292M 0s
12:24:51  141312K ........ ........ ........ ........ ........ ........ 63%  277M 0s
12:24:51  144384K ........ ........ ........ ........ ........ ........ 64%  287M 0s
12:24:51  147456K ........ ........ ........ ........ ........ ........ 65%  218M 0s
12:24:51  150528K ........ ........ ........ ........ ........ ........ 67%  214M 0s
12:24:51  153600K ........ ........ ........ ........ ........ ........ 68%  178M 0s
12:24:51  156672K ........ ........ ........ ........ ........ ........ 69%  186M 0s
12:24:51  159744K ........ ........ ........ ........ ........ ........ 71%  179M 0s
12:24:51  162816K ........ ........ ........ ........ ........ ........ 72%  171M 0s
12:24:51  165888K ........ ........ ........ ........ ........ ........ 73%  222M 0s
12:24:51  168960K ........ ........ ........ ........ ........ ........ 75%  215M 0s
12:24:51  172032K ........ ........ ........ ........ ........ ........ 76%  220M 0s
12:24:51  175104K ........ ........ ........ ........ ........ ........ 77%  232M 0s
12:24:51  178176K ........ ........ ........ ........ ........ ........ 79%  216M 0s
12:24:51  181248K ........ ........ ........ ........ ........ ........ 80%  237M 0s
12:24:51  184320K ........ ........ ........ ........ ........ ........ 81%  229M 0s
12:24:51  187392K ........ ........ ........ ........ ........ ........ 83%  212M 0s
12:24:51  190464K ........ ........ ........ ........ ........ ........ 84%  224M 0s
12:24:51  193536K ........ ........ ........ ........ ........ ........ 85%  236M 0s
12:24:51  196608K ........ ........ ........ ........ ........ ........ 87%  226M 0s
12:24:51  199680K ........ ........ ........ ........ ........ ........ 88%  239M 0s
12:24:51  202752K ........ ........ ........ ........ ........ ........ 89%  237M 0s
12:24:51  205824K ........ ........ ........ ........ ........ ........ 91%  296M 0s
12:24:51  208896K ........ ........ ........ ........ ........ ........ 92%  292M 0s
12:24:51  211968K ........ ........ ........ ........ ........ ........ 93%  140M 0s
12:24:51  215040K ........ ........ ........ ........ ........ ........ 95%  207M 0s
12:24:51  218112K ........ ........ ........ ........ ........ ........ 96%  225M 0s
12:24:51  221184K ........ ........ ........ ........ ........ ........ 97%  240M 0s
12:24:52  224256K ........ ........ ........ ........ ........ ........ 99%  211M 0s
12:24:52  227328K ........ ........ ........ ..                        100%  236M=1.1s
12:24:52  
12:24:52  2025-03-10 12:24:52 (203 MB/s) - ‘karaf-0.21.2.zip’ saved [234524817/234524817]
12:24:52  
12:24:52  Extracting the new controller...
12:24:52  + echo 'Extracting the new controller...'
12:24:52  + unzip -q karaf-0.21.2.zip
12:24:54  Adding external repositories...
12:24:54  + echo 'Adding external repositories...'
12:24:54  + sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.21.2/etc/org.ops4j.pax.url.mvn.cfg
12:24:54  + cat /tmp/karaf-0.21.2/etc/org.ops4j.pax.url.mvn.cfg
12:24:54  ################################################################################
12:24:54  #
12:24:54  #    Licensed to the Apache Software Foundation (ASF) under one or more
12:24:54  #    contributor license agreements.  See the NOTICE file distributed with
12:24:54  #    this work for additional information regarding copyright ownership.
12:24:54  #    The ASF licenses this file to You under the Apache License, Version 2.0
12:24:54  #    (the "License"); you may not use this file except in compliance with
12:24:54  #    the License.  You may obtain a copy of the License at
12:24:54  #
12:24:54  #       http://www.apache.org/licenses/LICENSE-2.0
12:24:54  #
12:24:54  #    Unless required by applicable law or agreed to in writing, software
12:24:54  #    distributed under the License is distributed on an "AS IS" BASIS,
12:24:54  #    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
12:24:54  #    See the License for the specific language governing permissions and
12:24:54  #    limitations under the License.
12:24:54  #
12:24:54  ################################################################################
12:24:54  
12:24:54  #
12:24:54  # If set to true, the following property will not allow any certificate to be used
12:24:54  # when accessing Maven repositories through SSL
12:24:54  #
12:24:54  #org.ops4j.pax.url.mvn.certificateCheck=
12:24:54  
12:24:54  #
12:24:54  # Path to the local Maven settings file.
12:24:54  # The repositories defined in this file will be automatically added to the list
12:24:54  # of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property
12:24:54  # below is not set.
12:24:54  # The following locations are checked for the existence of the settings.xml file
12:24:54  #   * 1. looks for the specified url
12:24:54  #   * 2. if not found looks for ${user.home}/.m2/settings.xml
12:24:54  #   * 3. if not found looks for ${maven.home}/conf/settings.xml
12:24:54  #   * 4. if not found looks for ${M2_HOME}/conf/settings.xml
12:24:54  #
12:24:54  #org.ops4j.pax.url.mvn.settings=
12:24:54  
12:24:54  #
12:24:54  # Path to the local Maven repository which is used to avoid downloading
12:24:54  # artifacts when they already exist locally.
12:24:54  # The value of this property will be extracted from the settings.xml file
12:24:54  # above, or defaulted to:
12:24:54  #     System.getProperty( "user.home" ) + "/.m2/repository"
12:24:54  #
12:24:54  org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository}
12:24:54  
12:24:54  #
12:24:54  # Default this to false. It's just weird to use undocumented repos
12:24:54  #
12:24:54  org.ops4j.pax.url.mvn.useFallbackRepositories=false
12:24:54  
12:24:54  #
12:24:54  # Uncomment if you don't wanna use the proxy settings
12:24:54  # from the Maven conf/settings.xml file
12:24:54  #
12:24:54  # org.ops4j.pax.url.mvn.proxySupport=false
12:24:54  
12:24:54  #
12:24:54  # Comma separated list of repositories scanned when resolving an artifact.
12:24:54  # Those repositories will be checked before iterating through the
12:24:54  #    below list of repositories and even before the local repository
12:24:54  # A repository url can be appended with zero or more of the following flags:
12:24:54  #    @snapshots  : the repository contains snaphots
12:24:54  #    @noreleases : the repository does not contain any released artifacts
12:24:54  #
12:24:54  # The following property value will add the system folder as a repo.
12:24:54  #
12:24:54  org.ops4j.pax.url.mvn.defaultRepositories=\
12:24:54      file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\
12:24:54      file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\
12:24:54      file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots
12:24:54  
12:24:54  # Use the default local repo (e.g.~/.m2/repository) as a "remote" repo
12:24:54  #org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false
12:24:54  
12:24:54  #
12:24:54  # Comma separated list of repositories scanned when resolving an artifact.
12:24:54  # The default list includes the following repositories:
12:24:54  #    http://repo1.maven.org/maven2@id=central
12:24:54  #    http://repository.springsource.com/maven/bundles/release@id=spring.ebr
12:24:54  #    http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external
12:24:54  #    http://zodiac.springsource.com/maven/bundles/release@id=gemini
12:24:54  #    http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases
12:24:54  #    https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases
12:24:54  #    https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
12:24:54  # To add repositories to the default ones, prepend '+' to the list of repositories
12:24:54  # to add.
12:24:54  # A repository url can be appended with zero or more of the following flags:
12:24:54  #    @snapshots  : the repository contains snapshots
12:24:54  #    @noreleases : the repository does not contain any released artifacts
12:24:54  #    @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended
12:24:54  #
12:24:54  org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
12:24:54  
12:24:54  ### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.Configuring the startup features...
12:24:54  + [[ True == \T\r\u\e ]]
12:24:54  + echo 'Configuring the startup features...'
12:24:54  + sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-infrautils-ready,odl-jolokia,odl-openflowplugin-flow-services-rest,odl-openflowplugin-app-table-miss-enforcer,/g' /tmp/karaf-0.21.2/etc/org.apache.karaf.features.cfg
12:24:54  + FEATURE_TEST_STRING=features-test
12:24:54  + FEATURE_TEST_VERSION=0.21.2
12:24:54  + KARAF_VERSION=karaf4
12:24:54  + [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]]
12:24:54  + sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.21.2/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.21.2/etc/org.apache.karaf.features.cfg
12:24:54  + [[ ! -z '' ]]
12:24:54  + cat /tmp/karaf-0.21.2/etc/org.apache.karaf.features.cfg
12:24:54  ################################################################################
12:24:54  #
12:24:54  #    Licensed to the Apache Software Foundation (ASF) under one or more
12:24:54  #    contributor license agreements.  See the NOTICE file distributed with
12:24:54  #    this work for additional information regarding copyright ownership.
12:24:54  #    The ASF licenses this file to You under the Apache License, Version 2.0
12:24:54  #    (the "License"); you may not use this file except in compliance with
12:24:54  #    the License.  You may obtain a copy of the License at
12:24:54  #
12:24:54  #       http://www.apache.org/licenses/LICENSE-2.0
12:24:54  #
12:24:54  #    Unless required by applicable law or agreed to in writing, software
12:24:54  #    distributed under the License is distributed on an "AS IS" BASIS,
12:24:54  #    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
12:24:54  #    See the License for the specific language governing permissions and
12:24:54  #    limitations under the License.
12:24:54  #
12:24:54  ################################################################################
12:24:54  
12:24:54  #
12:24:54  # Comma separated list of features repositories to register by default
12:24:54  #
12:24:54  featuresRepositories = mvn:org.opendaylight.integration/features-test/0.21.2/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/0c1b6937-8a27-40a9-abe5-b582b00918ae.xml
12:24:54  
12:24:54  #
12:24:54  # Comma separated list of features to install at startup
12:24:54  #
12:24:54  featuresBoot = odl-infrautils-ready,odl-jolokia,odl-openflowplugin-flow-services-rest,odl-openflowplugin-app-table-miss-enforcer, d7842298-e427-4095-a150-da4f98dec4d8
12:24:54  
12:24:54  #
12:24:54  # Resource repositories (OBR) that the features resolver can use
12:24:54  # to resolve requirements/capabilities
12:24:54  #
12:24:54  # The format of the resourceRepositories is 
12:24:54  # resourceRepositories=[xml:url|json:url],...
12:24:54  # for Instance:
12:24:54  #
12:24:54  #resourceRepositories=xml:http://host/path/to/index.xml
12:24:54  # or
12:24:54  #resourceRepositories=json:http://host/path/to/index.json
12:24:54  #
12:24:54  
12:24:54  #
12:24:54  # Defines if the boot features are started in asynchronous mode (in a dedicated thread)
12:24:54  #
12:24:54  featuresBootAsynchronous=false
12:24:54  
12:24:54  #
12:24:54  # Service requirements enforcement
12:24:54  #
12:24:54  # By default, the feature resolver checks the service requirements/capabilities of
12:24:54  # bundles for new features (xml schema >= 1.3.0) in order to automatically installs
12:24:54  # the required bundles.
12:24:54  # The following flag can have those values:
12:24:54  #   - disable: service requirements are completely ignored
12:24:54  #   - default: service requirements are ignored for old features
12:24:54  #   - enforce: service requirements are always verified
12:24:54  #
12:24:54  #serviceRequirements=default
12:24:54  
12:24:54  #
12:24:54  # Store cfg file for config element in feature
12:24:54  #
12:24:54  #configCfgStore=true
12:24:54  
12:24:54  #
12:24:54  # Define if the feature service automatically refresh bundles
12:24:54  #
12:24:54  autoRefresh=true
12:24:54  
12:24:54  #
12:24:54  # Configuration of features processing mechanism (overrides, blacklisting, modification of features)
12:24:54  # XML file defines instructions related to features processing
12:24:54  # versions.properties may declare properties to resolve placeholders in XML file
12:24:54  # both files are relative to ${karaf.etc}
12:24:54  #
12:24:54  #featureProcessing=org.apache.karaf.features.xml
12:24:54  #featureProcessingVersions=versions.properties
12:24:54  + configure_karaf_log karaf4 ''
12:24:54  + local -r karaf_version=karaf4
12:24:54  + local -r controllerdebugmap=
12:24:54  + local logapi=log4j
12:24:54  + grep log4j2 /tmp/karaf-0.21.2/etc/org.ops4j.pax.logging.cfg
12:24:54  log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
12:24:54  log4j2.rootLogger.level = INFO
12:24:54  #log4j2.rootLogger.type = asyncRoot
12:24:54  #log4j2.rootLogger.includeLocation = false
12:24:54  log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
12:24:54  log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
12:24:54  log4j2.rootLogger.appenderRef.Console.ref = Console
12:24:54  log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
12:24:54  log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
12:24:54  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
12:24:54  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
12:24:54  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
12:24:54  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
12:24:54  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
12:24:54  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
12:24:54  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
12:24:54  log4j2.logger.spifly.name = org.apache.aries.spifly
12:24:54  log4j2.logger.spifly.level = WARN
12:24:54  log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
12:24:54  log4j2.logger.audit.level = INFO
12:24:54  log4j2.logger.audit.additivity = false
12:24:54  log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
12:24:54  # Console appender not used by default (see log4j2.rootLogger.appenderRefs)
12:24:54  log4j2.appender.console.type = Console
12:24:54  log4j2.appender.console.name = Console
12:24:54  log4j2.appender.console.layout.type = PatternLayout
12:24:54  log4j2.appender.console.layout.pattern = ${log4j2.pattern}
12:24:54  log4j2.appender.rolling.type = RollingRandomAccessFile
12:24:54  log4j2.appender.rolling.name = RollingFile
12:24:54  log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
12:24:54  log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
12:24:54  #log4j2.appender.rolling.immediateFlush = false
12:24:54  log4j2.appender.rolling.append = true
12:24:54  log4j2.appender.rolling.layout.type = PatternLayout
12:24:54  log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
12:24:54  log4j2.appender.rolling.policies.type = Policies
12:24:54  log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
12:24:54  log4j2.appender.rolling.policies.size.size = 64MB
12:24:54  log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
12:24:54  log4j2.appender.rolling.strategy.max = 7
12:24:54  log4j2.appender.audit.type = RollingRandomAccessFile
12:24:54  log4j2.appender.audit.name = AuditRollingFile
12:24:54  log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
12:24:54  log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
12:24:54  log4j2.appender.audit.append = true
12:24:54  log4j2.appender.audit.layout.type = PatternLayout
12:24:54  log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
12:24:54  log4j2.appender.audit.policies.type = Policies
12:24:54  log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
12:24:54  log4j2.appender.audit.policies.size.size = 8MB
12:24:54  log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
12:24:54  log4j2.appender.audit.strategy.max = 7
12:24:54  log4j2.appender.osgi.type = PaxOsgi
12:24:54  log4j2.appender.osgi.name = PaxOsgi
12:24:54  log4j2.appender.osgi.filter = *
12:24:54  #log4j2.logger.aether.name = shaded.org.eclipse.aether
12:24:54  #log4j2.logger.aether.level = TRACE
12:24:54  #log4j2.logger.http-headers.name = shaded.org.apache.http.headers
12:24:54  #log4j2.logger.http-headers.level = DEBUG
12:24:54  #log4j2.logger.maven.name = org.ops4j.pax.url.mvn
12:24:54  #log4j2.logger.maven.level = TRACE
12:24:54  + logapi=log4j2
12:24:54  + echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2'
12:24:54  Configuring the karaf log... karaf_version: karaf4, logapi: log4j2
12:24:54  + '[' log4j2 == log4j2 ']'
12:24:54  + sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.21.2/etc/org.ops4j.pax.logging.cfg
12:24:54  + orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver
12:24:54  + orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver
12:24:54  + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN'
12:24:54  + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN'
12:24:54  + unset IFS
12:24:54  controllerdebugmap: 
12:24:54  cat /tmp/karaf-0.21.2/etc/org.ops4j.pax.logging.cfg
12:24:54  + echo 'controllerdebugmap: '
12:24:54  + '[' -n '' ']'
12:24:54  + echo 'cat /tmp/karaf-0.21.2/etc/org.ops4j.pax.logging.cfg'
12:24:54  + cat /tmp/karaf-0.21.2/etc/org.ops4j.pax.logging.cfg
12:24:54  ################################################################################
12:24:54  #
12:24:54  #    Licensed to the Apache Software Foundation (ASF) under one or more
12:24:54  #    contributor license agreements.  See the NOTICE file distributed with
12:24:54  #    this work for additional information regarding copyright ownership.
12:24:54  #    The ASF licenses this file to You under the Apache License, Version 2.0
12:24:54  #    (the "License"); you may not use this file except in compliance with
12:24:54  #    the License.  You may obtain a copy of the License at
12:24:54  #
12:24:54  #       http://www.apache.org/licenses/LICENSE-2.0
12:24:54  #
12:24:54  #    Unless required by applicable law or agreed to in writing, software
12:24:54  #    distributed under the License is distributed on an "AS IS" BASIS,
12:24:54  #    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
12:24:54  #    See the License for the specific language governing permissions and
12:24:54  #    limitations under the License.
12:24:54  #
12:24:54  ################################################################################
12:24:54  
12:24:54  # Common pattern layout for appenders
12:24:54  log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
12:24:54  
12:24:54  # Root logger
12:24:54  log4j2.rootLogger.level = INFO
12:24:54  # uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library
12:24:54  #log4j2.rootLogger.type = asyncRoot
12:24:54  #log4j2.rootLogger.includeLocation = false
12:24:54  log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
12:24:54  log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
12:24:54  log4j2.rootLogger.appenderRef.Console.ref = Console
12:24:54  log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
12:24:54  log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
12:24:54  
12:24:54  # Filters for logs marked by org.opendaylight.odlparent.Markers
12:24:54  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
12:24:54  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
12:24:54  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
12:24:54  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
12:24:54  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
12:24:54  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
12:24:54  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
12:24:54  
12:24:54  # Loggers configuration
12:24:54  
12:24:54  # Spifly logger
12:24:54  log4j2.logger.spifly.name = org.apache.aries.spifly
12:24:54  log4j2.logger.spifly.level = WARN
12:24:54  
12:24:54  # Security audit logger
12:24:54  log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
12:24:54  log4j2.logger.audit.level = INFO
12:24:54  log4j2.logger.audit.additivity = false
12:24:54  log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
12:24:54  
12:24:54  # Appenders configuration
12:24:54  
12:24:54  # Console appender not used by default (see log4j2.rootLogger.appenderRefs)
12:24:54  log4j2.appender.console.type = Console
12:24:54  log4j2.appender.console.name = Console
12:24:54  log4j2.appender.console.layout.type = PatternLayout
12:24:54  log4j2.appender.console.layout.pattern = ${log4j2.pattern}
12:24:54  
12:24:54  # Rolling file appender
12:24:54  log4j2.appender.rolling.type = RollingRandomAccessFile
12:24:54  log4j2.appender.rolling.name = RollingFile
12:24:54  log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
12:24:54  log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
12:24:54  # uncomment to not force a disk flush
12:24:54  #log4j2.appender.rolling.immediateFlush = false
12:24:54  log4j2.appender.rolling.append = true
12:24:54  log4j2.appender.rolling.layout.type = PatternLayout
12:24:54  log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
12:24:54  log4j2.appender.rolling.policies.type = Policies
12:24:54  log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
12:24:54  log4j2.appender.rolling.policies.size.size = 1GB
12:24:54  log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
12:24:54  log4j2.appender.rolling.strategy.max = 7
12:24:54  
12:24:54  # Audit file appender
12:24:54  log4j2.appender.audit.type = RollingRandomAccessFile
12:24:54  log4j2.appender.audit.name = AuditRollingFile
12:24:54  log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
12:24:54  log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
12:24:54  log4j2.appender.audit.append = true
12:24:54  log4j2.appender.audit.layout.type = PatternLayout
12:24:54  log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
12:24:54  log4j2.appender.audit.policies.type = Policies
12:24:54  log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
12:24:54  log4j2.appender.audit.policies.size.size = 8MB
12:24:54  log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
12:24:54  log4j2.appender.audit.strategy.max = 7
12:24:54  
12:24:54  # OSGi appender
12:24:54  log4j2.appender.osgi.type = PaxOsgi
12:24:54  log4j2.appender.osgi.name = PaxOsgi
12:24:54  log4j2.appender.osgi.filter = *
12:24:54  
12:24:54  # help with identification of maven-related problems with pax-url-aether
12:24:54  #log4j2.logger.aether.name = shaded.org.eclipse.aether
12:24:54  #log4j2.logger.aether.level = TRACE
12:24:54  #log4j2.logger.http-headers.name = shaded.org.apache.http.headers
12:24:54  #log4j2.logger.http-headers.level = DEBUG
12:24:54  #log4j2.logger.maven.name = org.ops4j.pax.url.mvn
12:24:54  #log4j2.logger.maven.level = TRACE
12:24:54  log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN
12:24:54  log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN
12:24:54  + set_java_vars /usr/lib/jvm/java-21-openjdk-amd64 2048m /tmp/karaf-0.21.2/bin/setenv
12:24:54  Configure
12:24:54      java home: /usr/lib/jvm/java-21-openjdk-amd64
12:24:54      max memory: 2048m
12:24:54      memconf: /tmp/karaf-0.21.2/bin/setenv
12:24:54  + local -r java_home=/usr/lib/jvm/java-21-openjdk-amd64
12:24:54  + local -r controllermem=2048m
12:24:54  + local -r memconf=/tmp/karaf-0.21.2/bin/setenv
12:24:54  + echo Configure
12:24:54  + echo '    java home: /usr/lib/jvm/java-21-openjdk-amd64'
12:24:54  + echo '    max memory: 2048m'
12:24:54  + echo '    memconf: /tmp/karaf-0.21.2/bin/setenv'
12:24:54  + sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64}%g' /tmp/karaf-0.21.2/bin/setenv
12:24:54  + sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=2048m/g' /tmp/karaf-0.21.2/bin/setenv
12:24:54  cat /tmp/karaf-0.21.2/bin/setenv
12:24:54  + echo 'cat /tmp/karaf-0.21.2/bin/setenv'
12:24:54  + cat /tmp/karaf-0.21.2/bin/setenv
12:24:54  #!/bin/sh
12:24:54  #
12:24:54  #    Licensed to the Apache Software Foundation (ASF) under one or more
12:24:54  #    contributor license agreements.  See the NOTICE file distributed with
12:24:54  #    this work for additional information regarding copyright ownership.
12:24:54  #    The ASF licenses this file to You under the Apache License, Version 2.0
12:24:54  #    (the "License"); you may not use this file except in compliance with
12:24:54  #    the License.  You may obtain a copy of the License at
12:24:54  #
12:24:54  #       http://www.apache.org/licenses/LICENSE-2.0
12:24:54  #
12:24:54  #    Unless required by applicable law or agreed to in writing, software
12:24:54  #    distributed under the License is distributed on an "AS IS" BASIS,
12:24:54  #    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
12:24:54  #    See the License for the specific language governing permissions and
12:24:54  #    limitations under the License.
12:24:54  #
12:24:54  
12:24:54  #
12:24:54  # handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf
12:24:54  # script: client, instance, shell, start, status, stop, karaf
12:24:54  #
12:24:54  # if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then
12:24:54  #   Actions go here...
12:24:54  # fi
12:24:54  
12:24:54  #
12:24:54  # general settings which should be applied for all scripts go here; please keep
12:24:54  # in mind that it is possible that scripts might be executed more than once, e.g.
12:24:54  # in example of the start script where the start script is executed first and the
12:24:54  # karaf script afterwards.
12:24:54  #
12:24:54  
12:24:54  #
12:24:54  # The following section shows the possible configuration options for the default 
12:24:54  # karaf scripts
12:24:54  #
12:24:54  export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64} # Location of Java installation
12:24:54  # export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration
12:24:54  # export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options
12:24:54  # export EXTRA_JAVA_OPTS # Additional JVM options
12:24:54  # export KARAF_HOME # Karaf home folder
12:24:54  # export KARAF_DATA # Karaf data folder
12:24:54  # export KARAF_BASE # Karaf base folder
12:24:54  # export KARAF_ETC  # Karaf etc  folder
12:24:54  # export KARAF_LOG  # Karaf log  folder
12:24:54  # export KARAF_SYSTEM_OPTS # First citizen Karaf options
12:24:54  # export KARAF_OPTS # Additional available Karaf options
12:24:54  # export KARAF_DEBUG # Enable debug mode
12:24:54  # export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start
12:24:54  # export KARAF_NOROOT # Prevent execution as root if set to true
12:24:54  Set Java version
12:24:54  + echo 'Set Java version'
12:24:54  + sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-21-openjdk-amd64/bin/java 1
12:24:54  sudo: /usr/sbin/alternatives: command not found
12:24:54  + sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-21-openjdk-amd64/bin/java
12:24:54  sudo: /usr/sbin/alternatives: command not found
12:24:54  JDK default version ...
12:24:54  + echo 'JDK default version ...'
12:24:54  + java -version
12:24:54  openjdk version "11.0.25" 2024-10-15
12:24:54  OpenJDK Runtime Environment (build 11.0.25+9-post-Ubuntu-1ubuntu120.04)
12:24:54  OpenJDK 64-Bit Server VM (build 11.0.25+9-post-Ubuntu-1ubuntu120.04, mixed mode, sharing)
12:24:54  Set JAVA_HOME
12:24:54  + echo 'Set JAVA_HOME'
12:24:54  + export JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64
12:24:54  + JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64
12:24:54  ++ readlink -e /usr/lib/jvm/java-21-openjdk-amd64/bin/java
12:24:54  Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java
12:24:54  + JAVA_RESOLVED=/usr/lib/jvm/java-21-openjdk-amd64/bin/java
12:24:54  + echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java'
12:24:54  Listing all open ports on controller system...
12:24:54  + echo 'Listing all open ports on controller system...'
12:24:54  + netstat -pnatu
12:24:54  /tmp/configuration-script.sh: line 40: netstat: command not found
12:24:54  Configuring cluster
12:24:54  + '[' -f /tmp/custom_shard_config.txt ']'
12:24:54  + echo 'Configuring cluster'
12:24:54  + /tmp/karaf-0.21.2/bin/configure_cluster.sh 1 10.30.170.110 10.30.171.121 10.30.170.124
12:24:54  ################################################
12:24:54  ##             Configure Cluster              ##
12:24:54  ################################################
12:24:54   NOTE: Cluster configuration files not found. Copying from
12:24:54   /tmp/karaf-0.21.2/system/org/opendaylight/controller/sal-clustering-config/10.0.9
12:24:54  Configuring unique name in akka.conf
12:24:54  Configuring hostname in akka.conf
12:24:54  Configuring data and rpc seed nodes in akka.conf
12:24:54  modules = [
12:24:54  	
12:24:54  	{
12:24:54  		name = "inventory"
12:24:54  		namespace = "urn:opendaylight:inventory"
12:24:54  		shard-strategy = "module"
12:24:54  	},
12:24:54  	{
12:24:54  		name = "topology"
12:24:54  		namespace = "urn:TBD:params:xml:ns:yang:network-topology"
12:24:54  		shard-strategy = "module"
12:24:54  	},
12:24:54  	{
12:24:54  		name = "toaster"
12:24:54  		namespace = "http://netconfcentral.org/ns/toaster"
12:24:54  		shard-strategy = "module"
12:24:54  	}
12:24:54  ]
12:24:54  Configuring replication type in module-shards.conf
12:24:54  ################################################
12:24:54  ##   NOTE: Manually restart controller to     ##
12:24:54  ##         apply configuration.               ##
12:24:54  ################################################
12:24:54  Dump akka.conf
12:24:54  + echo 'Dump akka.conf'
12:24:54  + cat /tmp/karaf-0.21.2/configuration/initial/akka.conf
12:24:54  
12:24:54  odl-cluster-data {
12:24:54    akka {
12:24:54      remote {
12:24:54        artery {
12:24:54          enabled = on
12:24:54          transport = tcp
12:24:54          canonical.hostname = "10.30.170.110"
12:24:54          canonical.port = 2550
12:24:54        }
12:24:54      }
12:24:54  
12:24:54      cluster {
12:24:54        # Using artery.
12:24:54        seed-nodes = ["akka://opendaylight-cluster-data@10.30.170.110:2550",
12:24:54  				"akka://opendaylight-cluster-data@10.30.171.121:2550",
12:24:54  				"akka://opendaylight-cluster-data@10.30.170.124:2550"]
12:24:54  
12:24:54        roles = ["member-1"]
12:24:54  
12:24:54        # when under load we might trip a false positive on the failure detector
12:24:54        # failure-detector {
12:24:54          # heartbeat-interval = 4 s
12:24:54          # acceptable-heartbeat-pause = 16s
12:24:54        # }
12:24:54      }
12:24:54  
12:24:54      persistence {
12:24:54        # By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by
12:24:54        # modifying the following two properties. The directory location specified may be a relative or absolute path. 
12:24:54        # The relative path is always relative to KARAF_HOME.
12:24:54  
12:24:54        # snapshot-store.local.dir = "target/snapshots"
12:24:54  
12:24:54        # Use lz4 compression for LocalSnapshotStore snapshots
12:24:54        snapshot-store.local.use-lz4-compression = false
12:24:54        # Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB
12:24:54        snapshot-store.local.lz4-blocksize = 256KB
12:24:54      }
12:24:54      disable-default-actor-system-quarantined-event-handling = "false"
12:24:54    }
12:24:54  }
12:24:54  Dump modules.conf
12:24:54  + echo 'Dump modules.conf'
12:24:54  + cat /tmp/karaf-0.21.2/configuration/initial/modules.conf
12:24:54  modules = [
12:24:54  	
12:24:54  	{
12:24:54  		name = "inventory"
12:24:54  		namespace = "urn:opendaylight:inventory"
12:24:54  		shard-strategy = "module"
12:24:54  	},
12:24:54  	{
12:24:54  		name = "topology"
12:24:54  		namespace = "urn:TBD:params:xml:ns:yang:network-topology"
12:24:54  		shard-strategy = "module"
12:24:54  	},
12:24:54  	{
12:24:54  		name = "toaster"
12:24:54  		namespace = "http://netconfcentral.org/ns/toaster"
12:24:54  		shard-strategy = "module"
12:24:54  	}
12:24:54  ]
12:24:54  Dump module-shards.conf
12:24:54  + echo 'Dump module-shards.conf'
12:24:54  + cat /tmp/karaf-0.21.2/configuration/initial/module-shards.conf
12:24:54  module-shards = [
12:24:54  	{
12:24:54  		name = "default"
12:24:54  		shards = [
12:24:54  			{
12:24:54  				name = "default"
12:24:54  				replicas = ["member-1",
12:24:54  				"member-2",
12:24:54  				"member-3"]
12:24:54  			}
12:24:54  		]
12:24:54  	},
12:24:54  	{
12:24:54  		name = "inventory"
12:24:54  		shards = [
12:24:54  			{
12:24:54  				name="inventory"
12:24:54  				replicas = ["member-1",
12:24:54  				"member-2",
12:24:54  				"member-3"]
12:24:54  			}
12:24:54  		]
12:24:54  	},
12:24:54  	{
12:24:54  		name = "topology"
12:24:54  		shards = [
12:24:54  			{
12:24:54  				name="topology"
12:24:54  				replicas = ["member-1",
12:24:54  				"member-2",
12:24:54  				"member-3"]
12:24:54  			}
12:24:54  		]
12:24:54  	},
12:24:54  	{
12:24:54  		name = "toaster"
12:24:54  		shards = [
12:24:54  			{
12:24:54  				name="toaster"
12:24:54  				replicas = ["member-1",
12:24:54  				"member-2",
12:24:54  				"member-3"]
12:24:54  			}
12:24:54  		]
12:24:54  	}
12:24:54  ]
12:24:54  Configuring member-2 with IP address 10.30.171.121
12:24:54  Warning: Permanently added '10.30.171.121' (ECDSA) to the list of known hosts.
12:24:54  Warning: Permanently added '10.30.171.121' (ECDSA) to the list of known hosts.
12:24:54  common-functions.sh is being sourced
12:24:54  + source /tmp/common-functions.sh karaf-0.21.2
12:24:54  ++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]]
12:24:54  ++ echo 'common-functions.sh is being sourced'
12:24:54  ++ BUNDLEFOLDER=karaf-0.21.2
12:24:54  ++ export MAVENCONF=/tmp/karaf-0.21.2/etc/org.ops4j.pax.url.mvn.cfg
12:24:54  ++ MAVENCONF=/tmp/karaf-0.21.2/etc/org.ops4j.pax.url.mvn.cfg
12:24:54  ++ export FEATURESCONF=/tmp/karaf-0.21.2/etc/org.apache.karaf.features.cfg
12:24:54  ++ FEATURESCONF=/tmp/karaf-0.21.2/etc/org.apache.karaf.features.cfg
12:24:54  ++ export CUSTOMPROP=/tmp/karaf-0.21.2/etc/custom.properties
12:24:54  ++ CUSTOMPROP=/tmp/karaf-0.21.2/etc/custom.properties
12:24:54  ++ export LOGCONF=/tmp/karaf-0.21.2/etc/org.ops4j.pax.logging.cfg
12:24:54  ++ LOGCONF=/tmp/karaf-0.21.2/etc/org.ops4j.pax.logging.cfg
12:24:54  ++ export MEMCONF=/tmp/karaf-0.21.2/bin/setenv
12:24:54  ++ MEMCONF=/tmp/karaf-0.21.2/bin/setenv
12:24:54  ++ export CONTROLLERMEM=
12:24:54  ++ CONTROLLERMEM=
12:24:54  ++ export AKKACONF=/tmp/karaf-0.21.2/configuration/initial/akka.conf
12:24:54  ++ AKKACONF=/tmp/karaf-0.21.2/configuration/initial/akka.conf
12:24:54  ++ export MODULESCONF=/tmp/karaf-0.21.2/configuration/initial/modules.conf
12:24:54  ++ MODULESCONF=/tmp/karaf-0.21.2/configuration/initial/modules.conf
12:24:54  ++ export MODULESHARDSCONF=/tmp/karaf-0.21.2/configuration/initial/module-shards.conf
12:24:54  ++ MODULESHARDSCONF=/tmp/karaf-0.21.2/configuration/initial/module-shards.conf
12:24:54  ++ print_common_env
12:24:54  ++ cat
12:24:54  common-functions environment:
12:24:54  MAVENCONF: /tmp/karaf-0.21.2/etc/org.ops4j.pax.url.mvn.cfg
12:24:54  ACTUALFEATURES: 
12:24:54  FEATURESCONF: /tmp/karaf-0.21.2/etc/org.apache.karaf.features.cfg
12:24:54  CUSTOMPROP: /tmp/karaf-0.21.2/etc/custom.properties
12:24:54  LOGCONF: /tmp/karaf-0.21.2/etc/org.ops4j.pax.logging.cfg
12:24:54  MEMCONF: /tmp/karaf-0.21.2/bin/setenv
12:24:54  CONTROLLERMEM: 
12:24:54  AKKACONF: /tmp/karaf-0.21.2/configuration/initial/akka.conf
12:24:54  MODULESCONF: /tmp/karaf-0.21.2/configuration/initial/modules.conf
12:24:54  MODULESHARDSCONF: /tmp/karaf-0.21.2/configuration/initial/module-shards.conf
12:24:54  SUITES: 
12:24:54  
12:24:54  ++ SSH='ssh -t -t'
12:24:54  ++ extra_services_cntl='     dnsmasq.service     httpd.service     libvirtd.service     openvswitch.service     ovs-vswitchd.service     ovsdb-server.service     rabbitmq-server.service '
12:24:54  ++ extra_services_cmp='     libvirtd.service     openvswitch.service     ovs-vswitchd.service     ovsdb-server.service '
12:24:54  Changing to /tmp
12:24:54  Downloading the distribution from https://nexus.opendaylight.org/content/repositories//autorelease-8681/org/opendaylight/integration/karaf/0.21.2/karaf-0.21.2.zip
12:24:54  + echo 'Changing to /tmp'
12:24:54  + cd /tmp
12:24:54  + echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories//autorelease-8681/org/opendaylight/integration/karaf/0.21.2/karaf-0.21.2.zip'
12:24:54  + wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories//autorelease-8681/org/opendaylight/integration/karaf/0.21.2/karaf-0.21.2.zip
12:24:54  --2025-03-10 12:24:54--  https://nexus.opendaylight.org/content/repositories//autorelease-8681/org/opendaylight/integration/karaf/0.21.2/karaf-0.21.2.zip
12:24:54  Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6
12:24:54  Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected.
12:24:54  HTTP request sent, awaiting response... 200 OK
12:24:54  Length: 234524817 (224M) [application/zip]
12:24:54  Saving to: ‘karaf-0.21.2.zip’
12:24:54  
12:24:54       0K ........ ........ ........ ........ ........ ........  1% 87.4M 3s
12:24:54    3072K ........ ........ ........ ........ ........ ........  2%  123M 2s
12:24:54    6144K ........ ........ ........ ........ ........ ........  4%  194M 2s
12:24:54    9216K ........ ........ ........ ........ ........ ........  5%  193M 2s
12:24:55   12288K ........ ........ ........ ........ ........ ........  6%  216M 1s
12:24:55   15360K ........ ........ ........ ........ ........ ........  8%  232M 1s
12:24:55   18432K ........ ........ ........ ........ ........ ........  9%  184M 1s
12:24:55   21504K ........ ........ ........ ........ ........ ........ 10%  234M 1s
12:24:55   24576K ........ ........ ........ ........ ........ ........ 12%  213M 1s
12:24:55   27648K ........ ........ ........ ........ ........ ........ 13%  220M 1s
12:24:55   30720K ........ ........ ........ ........ ........ ........ 14%  237M 1s
12:24:55   33792K ........ ........ ........ ........ ........ ........ 16%  255M 1s
12:24:55   36864K ........ ........ ........ ........ ........ ........ 17%  256M 1s
12:24:55   39936K ........ ........ ........ ........ ........ ........ 18%  257M 1s
12:24:55   43008K ........ ........ ........ ........ ........ ........ 20%  147M 1s
12:24:55   46080K ........ ........ ........ ........ ........ ........ 21%  324M 1s
12:24:55   49152K ........ ........ ........ ........ ........ ........ 22%  326M 1s
12:24:55   52224K ........ ........ ........ ........ ........ ........ 24%  282M 1s
12:24:55   55296K ........ ........ ........ ........ ........ ........ 25%  319M 1s
12:24:55   58368K ........ ........ ........ ........ ........ ........ 26%  294M 1s
12:24:55   61440K ........ ........ ........ ........ ........ ........ 28%  350M 1s
12:24:55   64512K ........ ........ ........ ........ ........ ........ 29%  289M 1s
12:24:55   67584K ........ ........ ........ ........ ........ ........ 30%  288M 1s
12:24:55   70656K ........ ........ ........ ........ ........ ........ 32%  348M 1s
12:24:55   73728K ........ ........ ........ ........ ........ ........ 33%  311M 1s
12:24:55   76800K ........ ........ ........ ........ ........ ........ 34%  211M 1s
12:24:55   79872K ........ ........ ........ ........ ........ ........ 36%  206M 1s
12:24:55   82944K ........ ........ ........ ........ ........ ........ 37%  188M 1s
12:24:55   86016K ........ ........ ........ ........ ........ ........ 38%  257M 1s
12:24:55   89088K ........ ........ ........ ........ ........ ........ 40%  202M 1s
12:24:55   92160K ........ ........ ........ ........ ........ ........ 41%  202M 1s
12:24:55   95232K ........ ........ ........ ........ ........ ........ 42%  217M 1s
12:24:55   98304K ........ ........ ........ ........ ........ ........ 44%  215M 1s
12:24:55  101376K ........ ........ ........ ........ ........ ........ 45%  213M 1s
12:24:55  104448K ........ ........ ........ ........ ........ ........ 46%  190M 1s
12:24:55  107520K ........ ........ ........ ........ ........ ........ 48%  208M 1s
12:24:55  110592K ........ ........ ........ ........ ........ ........ 49%  214M 1s
12:24:55  113664K ........ ........ ........ ........ ........ ........ 50%  217M 1s
12:24:55  116736K ........ ........ ........ ........ ........ ........ 52%  211M 0s
12:24:55  119808K ........ ........ ........ ........ ........ ........ 53%  203M 0s
12:24:55  122880K ........ ........ ........ ........ ........ ........ 54%  243M 0s
12:24:55  125952K ........ ........ ........ ........ ........ ........ 56%  198M 0s
12:24:55  129024K ........ ........ ........ ........ ........ ........ 57%  220M 0s
12:24:55  132096K ........ ........ ........ ........ ........ ........ 59%  265M 0s
12:24:55  135168K ........ ........ ........ ........ ........ ........ 60%  331M 0s
12:24:55  138240K ........ ........ ........ ........ ........ ........ 61%  270M 0s
12:24:55  141312K ........ ........ ........ ........ ........ ........ 63%  228M 0s
12:24:55  144384K ........ ........ ........ ........ ........ ........ 64%  235M 0s
12:24:55  147456K ........ ........ ........ ........ ........ ........ 65%  221M 0s
12:24:55  150528K ........ ........ ........ ........ ........ ........ 67%  287M 0s
12:24:55  153600K ........ ........ ........ ........ ........ ........ 68%  350M 0s
12:24:55  156672K ........ ........ ........ ........ ........ ........ 69%  330M 0s
12:24:55  159744K ........ ........ ........ ........ ........ ........ 71%  295M 0s
12:24:55  162816K ........ ........ ........ ........ ........ ........ 72%  287M 0s
12:24:55  165888K ........ ........ ........ ........ ........ ........ 73%  304M 0s
12:24:55  168960K ........ ........ ........ ........ ........ ........ 75%  336M 0s
12:24:55  172032K ........ ........ ........ ........ ........ ........ 76%  317M 0s
12:24:55  175104K ........ ........ ........ ........ ........ ........ 77%  310M 0s
12:24:55  178176K ........ ........ ........ ........ ........ ........ 79%  327M 0s
12:24:55  181248K ........ ........ ........ ........ ........ ........ 80%  317M 0s
12:24:55  184320K ........ ........ ........ ........ ........ ........ 81%  314M 0s
12:24:55  187392K ........ ........ ........ ........ ........ ........ 83%  300M 0s
12:24:55  190464K ........ ........ ........ ........ ........ ........ 84%  257M 0s
12:24:55  193536K ........ ........ ........ ........ ........ ........ 85%  186M 0s
12:24:55  196608K ........ ........ ........ ........ ........ ........ 87%  230M 0s
12:24:55  199680K ........ ........ ........ ........ ........ ........ 88%  203M 0s
12:24:55  202752K ........ ........ ........ ........ ........ ........ 89%  299M 0s
12:24:55  205824K ........ ........ ........ ........ ........ ........ 91%  437M 0s
12:24:55  208896K ........ ........ ........ ........ ........ ........ 92%  330M 0s
12:24:55  211968K ........ ........ ........ ........ ........ ........ 93%  314M 0s
12:24:55  215040K ........ ........ ........ ........ ........ ........ 95%  312M 0s
12:24:55  218112K ........ ........ ........ ........ ........ ........ 96%  316M 0s
12:24:55  221184K ........ ........ ........ ........ ........ ........ 97%  300M 0s
12:24:55  224256K ........ ........ ........ ........ ........ ........ 99%  299M 0s
12:24:55  227328K ........ ........ ........ ..                        100%  307M=0.9s
12:24:55  
12:24:55  2025-03-10 12:24:55 (242 MB/s) - ‘karaf-0.21.2.zip’ saved [234524817/234524817]
12:24:55  
12:24:55  Extracting the new controller...
12:24:55  + echo 'Extracting the new controller...'
12:24:55  + unzip -q karaf-0.21.2.zip
12:24:57  Adding external repositories...
12:24:57  + echo 'Adding external repositories...'
12:24:57  + sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.21.2/etc/org.ops4j.pax.url.mvn.cfg
12:24:57  + cat /tmp/karaf-0.21.2/etc/org.ops4j.pax.url.mvn.cfg
12:24:57  ################################################################################
12:24:57  #
12:24:57  #    Licensed to the Apache Software Foundation (ASF) under one or more
12:24:57  #    contributor license agreements.  See the NOTICE file distributed with
12:24:57  #    this work for additional information regarding copyright ownership.
12:24:57  #    The ASF licenses this file to You under the Apache License, Version 2.0
12:24:57  #    (the "License"); you may not use this file except in compliance with
12:24:57  #    the License.  You may obtain a copy of the License at
12:24:57  #
12:24:57  #       http://www.apache.org/licenses/LICENSE-2.0
12:24:57  #
12:24:57  #    Unless required by applicable law or agreed to in writing, software
12:24:57  #    distributed under the License is distributed on an "AS IS" BASIS,
12:24:57  #    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
12:24:57  #    See the License for the specific language governing permissions and
12:24:57  #    limitations under the License.
12:24:57  #
12:24:57  ################################################################################
12:24:57  
12:24:57  #
12:24:57  # If set to true, the following property will not allow any certificate to be used
12:24:57  # when accessing Maven repositories through SSL
12:24:57  #
12:24:57  #org.ops4j.pax.url.mvn.certificateCheck=
12:24:57  
12:24:57  #
12:24:57  # Path to the local Maven settings file.
12:24:57  # The repositories defined in this file will be automatically added to the list
12:24:57  # of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property
12:24:57  # below is not set.
12:24:57  # The following locations are checked for the existence of the settings.xml file
12:24:57  #   * 1. looks for the specified url
12:24:57  #   * 2. if not found looks for ${user.home}/.m2/settings.xml
12:24:57  #   * 3. if not found looks for ${maven.home}/conf/settings.xml
12:24:57  #   * 4. if not found looks for ${M2_HOME}/conf/settings.xml
12:24:57  #
12:24:57  #org.ops4j.pax.url.mvn.settings=
12:24:57  
12:24:57  #
12:24:57  # Path to the local Maven repository which is used to avoid downloading
12:24:57  # artifacts when they already exist locally.
12:24:57  # The value of this property will be extracted from the settings.xml file
12:24:57  # above, or defaulted to:
12:24:57  #     System.getProperty( "user.home" ) + "/.m2/repository"
12:24:57  #
12:24:57  org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository}
12:24:57  
12:24:57  #
12:24:57  # Default this to false. It's just weird to use undocumented repos
12:24:57  #
12:24:57  org.ops4j.pax.url.mvn.useFallbackRepositories=false
12:24:57  
12:24:57  #
12:24:57  # Uncomment if you don't wanna use the proxy settings
12:24:57  # from the Maven conf/settings.xml file
12:24:57  #
12:24:57  # org.ops4j.pax.url.mvn.proxySupport=false
12:24:57  
12:24:57  #
12:24:57  # Comma separated list of repositories scanned when resolving an artifact.
12:24:57  # Those repositories will be checked before iterating through the
12:24:57  #    below list of repositories and even before the local repository
12:24:57  # A repository url can be appended with zero or more of the following flags:
12:24:57  #    @snapshots  : the repository contains snaphots
12:24:57  #    @noreleases : the repository does not contain any released artifacts
12:24:57  #
12:24:57  # The following property value will add the system folder as a repo.
12:24:57  #
12:24:57  org.ops4j.pax.url.mvn.defaultRepositories=\
12:24:57      file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\
12:24:57      file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\
12:24:57      file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots
12:24:57  
12:24:57  # Use the default local repo (e.g.~/.m2/repository) as a "remote" repo
12:24:57  #org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false
12:24:57  
12:24:57  #
12:24:57  # Comma separated list of repositories scanned when resolving an artifact.
12:24:57  # The default list includes the following repositories:
12:24:57  #    http://repo1.maven.org/maven2@id=central
12:24:57  #    http://repository.springsource.com/maven/bundles/release@id=spring.ebr
12:24:57  #    http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external
12:24:57  #    http://zodiac.springsource.com/maven/bundles/release@id=gemini
12:24:57  #    http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases
12:24:57  #    https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases
12:24:57  #    https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
12:24:57  # To add repositories to the default ones, prepend '+' to the list of repositories
12:24:57  # to add.
12:24:57  # A repository url can be appended with zero or more of the following flags:
12:24:57  #    @snapshots  : the repository contains snapshots
12:24:57  #    @noreleases : the repository does not contain any released artifacts
12:24:57  #    @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended
12:24:57  #
12:24:57  org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
12:24:57  
12:24:57  ### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.Configuring the startup features...
12:24:57  + [[ True == \T\r\u\e ]]
12:24:57  + echo 'Configuring the startup features...'
12:24:57  + sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-infrautils-ready,odl-jolokia,odl-openflowplugin-flow-services-rest,odl-openflowplugin-app-table-miss-enforcer,/g' /tmp/karaf-0.21.2/etc/org.apache.karaf.features.cfg
12:24:57  + FEATURE_TEST_STRING=features-test
12:24:57  + FEATURE_TEST_VERSION=0.21.2
12:24:57  + KARAF_VERSION=karaf4
12:24:57  + [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]]
12:24:57  + sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.21.2/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.21.2/etc/org.apache.karaf.features.cfg
12:24:57  + [[ ! -z '' ]]
12:24:57  + cat /tmp/karaf-0.21.2/etc/org.apache.karaf.features.cfg
12:24:57  ################################################################################
12:24:57  #
12:24:57  #    Licensed to the Apache Software Foundation (ASF) under one or more
12:24:57  #    contributor license agreements.  See the NOTICE file distributed with
12:24:57  #    this work for additional information regarding copyright ownership.
12:24:57  #    The ASF licenses this file to You under the Apache License, Version 2.0
12:24:57  #    (the "License"); you may not use this file except in compliance with
12:24:57  #    the License.  You may obtain a copy of the License at
12:24:57  #
12:24:57  #       http://www.apache.org/licenses/LICENSE-2.0
12:24:57  #
12:24:57  #    Unless required by applicable law or agreed to in writing, software
12:24:57  #    distributed under the License is distributed on an "AS IS" BASIS,
12:24:57  #    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
12:24:57  #    See the License for the specific language governing permissions and
12:24:57  #    limitations under the License.
12:24:57  #
12:24:57  ################################################################################
12:24:57  
12:24:57  #
12:24:57  # Comma separated list of features repositories to register by default
12:24:57  #
12:24:57  featuresRepositories = mvn:org.opendaylight.integration/features-test/0.21.2/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/0c1b6937-8a27-40a9-abe5-b582b00918ae.xml
12:24:57  
12:24:57  #
12:24:57  # Comma separated list of features to install at startup
12:24:57  #
12:24:57  featuresBoot = odl-infrautils-ready,odl-jolokia,odl-openflowplugin-flow-services-rest,odl-openflowplugin-app-table-miss-enforcer, d7842298-e427-4095-a150-da4f98dec4d8
12:24:57  
12:24:57  #
12:24:57  # Resource repositories (OBR) that the features resolver can use
12:24:57  # to resolve requirements/capabilities
12:24:57  #
12:24:57  # The format of the resourceRepositories is 
12:24:57  # resourceRepositories=[xml:url|json:url],...
12:24:57  # for Instance:
12:24:57  #
12:24:57  #resourceRepositories=xml:http://host/path/to/index.xml
12:24:57  # or
12:24:57  #resourceRepositories=json:http://host/path/to/index.json
12:24:57  #
12:24:57  
12:24:57  #
12:24:57  # Defines if the boot features are started in asynchronous mode (in a dedicated thread)
12:24:57  #
12:24:57  featuresBootAsynchronous=false
12:24:57  
12:24:57  #
12:24:57  # Service requirements enforcement
12:24:57  #
12:24:57  # By default, the feature resolver checks the service requirements/capabilities of
12:24:57  # bundles for new features (xml schema >= 1.3.0) in order to automatically installs
12:24:57  # the required bundles.
12:24:57  # The following flag can have those values:
12:24:57  #   - disable: service requirements are completely ignored
12:24:57  #   - default: service requirements are ignored for old features
12:24:57  #   - enforce: service requirements are always verified
12:24:57  #
12:24:57  #serviceRequirements=default
12:24:57  
12:24:57  #
12:24:57  # Store cfg file for config element in feature
12:24:57  #
12:24:57  #configCfgStore=true
12:24:57  
12:24:57  #
12:24:57  # Define if the feature service automatically refresh bundles
12:24:57  #
12:24:57  autoRefresh=true
12:24:57  
12:24:57  #
12:24:57  # Configuration of features processing mechanism (overrides, blacklisting, modification of features)
12:24:57  # XML file defines instructions related to features processing
12:24:57  # versions.properties may declare properties to resolve placeholders in XML file
12:24:57  # both files are relative to ${karaf.etc}
12:24:57  #
12:24:57  #featureProcessing=org.apache.karaf.features.xml
12:24:57  #featureProcessingVersions=versions.properties
12:24:57  + configure_karaf_log karaf4 ''
12:24:57  + local -r karaf_version=karaf4
12:24:57  + local -r controllerdebugmap=
12:24:57  + local logapi=log4j
12:24:57  + grep log4j2 /tmp/karaf-0.21.2/etc/org.ops4j.pax.logging.cfg
12:24:57  log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
12:24:57  log4j2.rootLogger.level = INFO
12:24:57  #log4j2.rootLogger.type = asyncRoot
12:24:57  #log4j2.rootLogger.includeLocation = false
12:24:57  log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
12:24:57  log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
12:24:57  log4j2.rootLogger.appenderRef.Console.ref = Console
12:24:57  log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
12:24:57  log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
12:24:57  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
12:24:57  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
12:24:57  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
12:24:57  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
12:24:57  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
12:24:57  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
12:24:57  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
12:24:57  log4j2.logger.spifly.name = org.apache.aries.spifly
12:24:57  log4j2.logger.spifly.level = WARN
12:24:57  log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
12:24:57  log4j2.logger.audit.level = INFO
12:24:57  log4j2.logger.audit.additivity = false
12:24:57  log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
12:24:57  # Console appender not used by default (see log4j2.rootLogger.appenderRefs)
12:24:57  log4j2.appender.console.type = Console
12:24:57  log4j2.appender.console.name = Console
12:24:57  log4j2.appender.console.layout.type = PatternLayout
12:24:57  log4j2.appender.console.layout.pattern = ${log4j2.pattern}
12:24:57  log4j2.appender.rolling.type = RollingRandomAccessFile
12:24:57  log4j2.appender.rolling.name = RollingFile
12:24:57  log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
12:24:57  log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
12:24:57  #log4j2.appender.rolling.immediateFlush = false
12:24:57  log4j2.appender.rolling.append = true
12:24:57  log4j2.appender.rolling.layout.type = PatternLayout
12:24:57  log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
12:24:57  log4j2.appender.rolling.policies.type = Policies
12:24:57  log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
12:24:57  log4j2.appender.rolling.policies.size.size = 64MB
12:24:57  log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
12:24:57  log4j2.appender.rolling.strategy.max = 7
12:24:57  log4j2.appender.audit.type = RollingRandomAccessFile
12:24:57  log4j2.appender.audit.name = AuditRollingFile
12:24:57  log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
12:24:57  log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
12:24:57  log4j2.appender.audit.append = true
12:24:57  log4j2.appender.audit.layout.type = PatternLayout
12:24:57  log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
12:24:57  log4j2.appender.audit.policies.type = Policies
12:24:57  log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
12:24:57  log4j2.appender.audit.policies.size.size = 8MB
12:24:57  log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
12:24:57  log4j2.appender.audit.strategy.max = 7
12:24:57  log4j2.appender.osgi.type = PaxOsgi
12:24:57  log4j2.appender.osgi.name = PaxOsgi
12:24:57  log4j2.appender.osgi.filter = *
12:24:57  #log4j2.logger.aether.name = shaded.org.eclipse.aether
12:24:57  #log4j2.logger.aether.level = TRACE
12:24:57  #log4j2.logger.http-headers.name = shaded.org.apache.http.headers
12:24:57  #log4j2.logger.http-headers.level = DEBUG
12:24:57  #log4j2.logger.maven.name = org.ops4j.pax.url.mvn
12:24:57  #log4j2.logger.maven.level = TRACE
12:24:57  + logapi=log4j2
12:24:57  + echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2'
12:24:57  Configuring the karaf log... karaf_version: karaf4, logapi: log4j2
12:24:57  + '[' log4j2 == log4j2 ']'
12:24:57  + sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.21.2/etc/org.ops4j.pax.logging.cfg
12:24:57  + orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver
12:24:57  + orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver
12:24:57  + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN'
12:24:57  controllerdebugmap: 
12:24:57  cat /tmp/karaf-0.21.2/etc/org.ops4j.pax.logging.cfg
12:24:57  + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN'
12:24:57  + unset IFS
12:24:57  + echo 'controllerdebugmap: '
12:24:57  + '[' -n '' ']'
12:24:57  + echo 'cat /tmp/karaf-0.21.2/etc/org.ops4j.pax.logging.cfg'
12:24:57  + cat /tmp/karaf-0.21.2/etc/org.ops4j.pax.logging.cfg
12:24:57  ################################################################################
12:24:57  #
12:24:57  #    Licensed to the Apache Software Foundation (ASF) under one or more
12:24:57  #    contributor license agreements.  See the NOTICE file distributed with
12:24:57  #    this work for additional information regarding copyright ownership.
12:24:57  #    The ASF licenses this file to You under the Apache License, Version 2.0
12:24:57  #    (the "License"); you may not use this file except in compliance with
12:24:57  #    the License.  You may obtain a copy of the License at
12:24:57  #
12:24:57  #       http://www.apache.org/licenses/LICENSE-2.0
12:24:57  #
12:24:57  #    Unless required by applicable law or agreed to in writing, software
12:24:57  #    distributed under the License is distributed on an "AS IS" BASIS,
12:24:57  #    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
12:24:57  #    See the License for the specific language governing permissions and
12:24:57  #    limitations under the License.
12:24:57  #
12:24:57  ################################################################################
12:24:57  
12:24:57  # Common pattern layout for appenders
12:24:57  log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
12:24:57  
12:24:57  # Root logger
12:24:57  log4j2.rootLogger.level = INFO
12:24:57  # uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library
12:24:57  #log4j2.rootLogger.type = asyncRoot
12:24:57  #log4j2.rootLogger.includeLocation = false
12:24:57  log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
12:24:57  log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
12:24:57  log4j2.rootLogger.appenderRef.Console.ref = Console
12:24:57  log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
12:24:57  log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
12:24:57  
12:24:57  # Filters for logs marked by org.opendaylight.odlparent.Markers
12:24:57  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
12:24:57  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
12:24:57  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
12:24:57  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
12:24:57  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
12:24:57  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
12:24:57  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
12:24:57  
12:24:57  # Loggers configuration
12:24:57  
12:24:57  # Spifly logger
12:24:57  log4j2.logger.spifly.name = org.apache.aries.spifly
12:24:57  log4j2.logger.spifly.level = WARN
12:24:57  
12:24:57  # Security audit logger
12:24:57  log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
12:24:57  log4j2.logger.audit.level = INFO
12:24:57  log4j2.logger.audit.additivity = false
12:24:57  log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
12:24:57  
12:24:57  # Appenders configuration
12:24:57  
12:24:57  # Console appender not used by default (see log4j2.rootLogger.appenderRefs)
12:24:57  log4j2.appender.console.type = Console
12:24:57  log4j2.appender.console.name = Console
12:24:57  log4j2.appender.console.layout.type = PatternLayout
12:24:57  log4j2.appender.console.layout.pattern = ${log4j2.pattern}
12:24:57  
12:24:57  # Rolling file appender
12:24:57  log4j2.appender.rolling.type = RollingRandomAccessFile
12:24:57  log4j2.appender.rolling.name = RollingFile
12:24:57  log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
12:24:57  log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
12:24:57  # uncomment to not force a disk flush
12:24:57  #log4j2.appender.rolling.immediateFlush = false
12:24:57  log4j2.appender.rolling.append = true
12:24:57  log4j2.appender.rolling.layout.type = PatternLayout
12:24:57  log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
12:24:57  log4j2.appender.rolling.policies.type = Policies
12:24:57  log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
12:24:57  log4j2.appender.rolling.policies.size.size = 1GB
12:24:57  log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
12:24:57  log4j2.appender.rolling.strategy.max = 7
12:24:57  
12:24:57  # Audit file appender
12:24:57  log4j2.appender.audit.type = RollingRandomAccessFile
12:24:57  log4j2.appender.audit.name = AuditRollingFile
12:24:57  log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
12:24:57  log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
12:24:57  log4j2.appender.audit.append = true
12:24:57  log4j2.appender.audit.layout.type = PatternLayout
12:24:57  log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
12:24:57  log4j2.appender.audit.policies.type = Policies
12:24:57  log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
12:24:57  log4j2.appender.audit.policies.size.size = 8MB
12:24:57  log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
12:24:57  log4j2.appender.audit.strategy.max = 7
12:24:57  
12:24:57  # OSGi appender
12:24:57  log4j2.appender.osgi.type = PaxOsgi
12:24:57  log4j2.appender.osgi.name = PaxOsgi
12:24:57  log4j2.appender.osgi.filter = *
12:24:57  
12:24:57  # help with identification of maven-related problems with pax-url-aether
12:24:57  #log4j2.logger.aether.name = shaded.org.eclipse.aether
12:24:57  #log4j2.logger.aether.level = TRACE
12:24:57  #log4j2.logger.http-headers.name = shaded.org.apache.http.headers
12:24:57  #log4j2.logger.http-headers.level = DEBUG
12:24:57  #log4j2.logger.maven.name = org.ops4j.pax.url.mvn
12:24:57  #log4j2.logger.maven.level = TRACE
12:24:57  log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN
12:24:57  log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN
12:24:57  + set_java_vars /usr/lib/jvm/java-21-openjdk-amd64 2048m /tmp/karaf-0.21.2/bin/setenv
12:24:57  + local -r java_home=/usr/lib/jvm/java-21-openjdk-amd64
12:24:57  + local -r controllermem=2048m
12:24:57  Configure
12:24:57      java home: /usr/lib/jvm/java-21-openjdk-amd64
12:24:57  + local -r memconf=/tmp/karaf-0.21.2/bin/setenv
12:24:57  + echo Configure
12:24:57  + echo '    java home: /usr/lib/jvm/java-21-openjdk-amd64'
12:24:57      max memory: 2048m
12:24:57  + echo '    max memory: 2048m'
12:24:57      memconf: /tmp/karaf-0.21.2/bin/setenv
12:24:57  + echo '    memconf: /tmp/karaf-0.21.2/bin/setenv'
12:24:57  + sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64}%g' /tmp/karaf-0.21.2/bin/setenv
12:24:57  + sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=2048m/g' /tmp/karaf-0.21.2/bin/setenv
12:24:57  cat /tmp/karaf-0.21.2/bin/setenv
12:24:57  + echo 'cat /tmp/karaf-0.21.2/bin/setenv'
12:24:57  + cat /tmp/karaf-0.21.2/bin/setenv
12:24:57  #!/bin/sh
12:24:57  #
12:24:57  #    Licensed to the Apache Software Foundation (ASF) under one or more
12:24:57  #    contributor license agreements.  See the NOTICE file distributed with
12:24:57  #    this work for additional information regarding copyright ownership.
12:24:57  #    The ASF licenses this file to You under the Apache License, Version 2.0
12:24:57  #    (the "License"); you may not use this file except in compliance with
12:24:57  #    the License.  You may obtain a copy of the License at
12:24:57  #
12:24:57  #       http://www.apache.org/licenses/LICENSE-2.0
12:24:57  #
12:24:57  #    Unless required by applicable law or agreed to in writing, software
12:24:57  #    distributed under the License is distributed on an "AS IS" BASIS,
12:24:57  #    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
12:24:57  #    See the License for the specific language governing permissions and
12:24:57  #    limitations under the License.
12:24:57  #
12:24:57  
12:24:57  #
12:24:57  # handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf
12:24:57  # script: client, instance, shell, start, status, stop, karaf
12:24:57  #
12:24:57  # if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then
12:24:57  #   Actions go here...
12:24:57  # fi
12:24:57  
12:24:57  #
12:24:57  # general settings which should be applied for all scripts go here; please keep
12:24:57  # in mind that it is possible that scripts might be executed more than once, e.g.
12:24:57  # in example of the start script where the start script is executed first and the
12:24:57  # karaf script afterwards.
12:24:57  #
12:24:57  
12:24:57  #
12:24:57  # The following section shows the possible configuration options for the default 
12:24:57  # karaf scripts
12:24:57  #
12:24:57  export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64} # Location of Java installation
12:24:57  # export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration
12:24:57  # export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options
12:24:57  # export EXTRA_JAVA_OPTS # Additional JVM options
12:24:57  # export KARAF_HOME # Karaf home folder
12:24:57  # export KARAF_DATA # Karaf data folder
12:24:57  # export KARAF_BASE # Karaf base folder
12:24:57  # export KARAF_ETC  # Karaf etc  folder
12:24:57  # export KARAF_LOG  # Karaf log  folder
12:24:57  # export KARAF_SYSTEM_OPTS # First citizen Karaf options
12:24:57  # export KARAF_OPTS # Additional available Karaf options
12:24:57  # export KARAF_DEBUG # Enable debug mode
12:24:57  # export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start
12:24:57  # export KARAF_NOROOT # Prevent execution as root if set to true
12:24:57  Set Java version
12:24:57  + echo 'Set Java version'
12:24:57  + sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-21-openjdk-amd64/bin/java 1
12:24:57  sudo: /usr/sbin/alternatives: command not found
12:24:57  + sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-21-openjdk-amd64/bin/java
12:24:57  sudo: /usr/sbin/alternatives: command not found
12:24:57  JDK default version ...
12:24:57  + echo 'JDK default version ...'
12:24:57  + java -version
12:24:58  openjdk version "11.0.25" 2024-10-15
12:24:58  OpenJDK Runtime Environment (build 11.0.25+9-post-Ubuntu-1ubuntu120.04)
12:24:58  OpenJDK 64-Bit Server VM (build 11.0.25+9-post-Ubuntu-1ubuntu120.04, mixed mode, sharing)
12:24:58  Set JAVA_HOME
12:24:58  + echo 'Set JAVA_HOME'
12:24:58  + export JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64
12:24:58  + JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64
12:24:58  ++ readlink -e /usr/lib/jvm/java-21-openjdk-amd64/bin/java
12:24:58  Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java
12:24:58  Listing all open ports on controller system...
12:24:58  + JAVA_RESOLVED=/usr/lib/jvm/java-21-openjdk-amd64/bin/java
12:24:58  + echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java'
12:24:58  + echo 'Listing all open ports on controller system...'
12:24:58  + netstat -pnatu
12:24:58  /tmp/configuration-script.sh: line 40: netstat: command not found
12:24:58  Configuring cluster
12:24:58  + '[' -f /tmp/custom_shard_config.txt ']'
12:24:58  + echo 'Configuring cluster'
12:24:58  + /tmp/karaf-0.21.2/bin/configure_cluster.sh 2 10.30.170.110 10.30.171.121 10.30.170.124
12:24:58  ################################################
12:24:58  ##             Configure Cluster              ##
12:24:58  ################################################
12:24:58   NOTE: Cluster configuration files not found. Copying from
12:24:58   /tmp/karaf-0.21.2/system/org/opendaylight/controller/sal-clustering-config/10.0.9
12:24:58  Configuring unique name in akka.conf
12:24:58  Configuring hostname in akka.conf
12:24:58  Configuring data and rpc seed nodes in akka.conf
12:24:58  modules = [
12:24:58  	
12:24:58  	{
12:24:58  		name = "inventory"
12:24:58  		namespace = "urn:opendaylight:inventory"
12:24:58  		shard-strategy = "module"
12:24:58  	},
12:24:58  	{
12:24:58  		name = "topology"
12:24:58  		namespace = "urn:TBD:params:xml:ns:yang:network-topology"
12:24:58  		shard-strategy = "module"
12:24:58  	},
12:24:58  	{
12:24:58  		name = "toaster"
12:24:58  		namespace = "http://netconfcentral.org/ns/toaster"
12:24:58  		shard-strategy = "module"
12:24:58  	}
12:24:58  ]
12:24:58  Configuring replication type in module-shards.conf
12:24:58  ################################################
12:24:58  ##   NOTE: Manually restart controller to     ##
12:24:58  ##         apply configuration.               ##
12:24:58  ################################################
12:24:58  Dump akka.conf
12:24:58  + echo 'Dump akka.conf'
12:24:58  + cat /tmp/karaf-0.21.2/configuration/initial/akka.conf
12:24:58  
12:24:58  odl-cluster-data {
12:24:58    akka {
12:24:58      remote {
12:24:58        artery {
12:24:58          enabled = on
12:24:58          transport = tcp
12:24:58          canonical.hostname = "10.30.171.121"
12:24:58          canonical.port = 2550
12:24:58        }
12:24:58      }
12:24:58  
12:24:58      cluster {
12:24:58        # Using artery.
12:24:58        seed-nodes = ["akka://opendaylight-cluster-data@10.30.170.110:2550",
12:24:58  				"akka://opendaylight-cluster-data@10.30.171.121:2550",
12:24:58  				"akka://opendaylight-cluster-data@10.30.170.124:2550"]
12:24:58  
12:24:58        roles = ["member-2"]
12:24:58  
12:24:58        # when under load we might trip a false positive on the failure detector
12:24:58        # failure-detector {
12:24:58          # heartbeat-interval = 4 s
12:24:58          # acceptable-heartbeat-pause = 16s
12:24:58        # }
12:24:58      }
12:24:58  
12:24:58      persistence {
12:24:58        # By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by
12:24:58        # modifying the following two properties. The directory location specified may be a relative or absolute path. 
12:24:58        # The relative path is always relative to KARAF_HOME.
12:24:58  
12:24:58        # snapshot-store.local.dir = "target/snapshots"
12:24:58  
12:24:58        # Use lz4 compression for LocalSnapshotStore snapshots
12:24:58        snapshot-store.local.use-lz4-compression = false
12:24:58        # Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB
12:24:58        snapshot-store.local.lz4-blocksize = 256KB
12:24:58      }
12:24:58      disable-default-actor-system-quarantined-event-handling = "false"
12:24:58    }
12:24:58  }
12:24:58  Dump modules.conf
12:24:58  + echo 'Dump modules.conf'
12:24:58  + cat /tmp/karaf-0.21.2/configuration/initial/modules.conf
12:24:58  modules = [
12:24:58  	
12:24:58  	{
12:24:58  		name = "inventory"
12:24:58  		namespace = "urn:opendaylight:inventory"
12:24:58  		shard-strategy = "module"
12:24:58  	},
12:24:58  	{
12:24:58  		name = "topology"
12:24:58  		namespace = "urn:TBD:params:xml:ns:yang:network-topology"
12:24:58  		shard-strategy = "module"
12:24:58  	},
12:24:58  	{
12:24:58  		name = "toaster"
12:24:58  		namespace = "http://netconfcentral.org/ns/toaster"
12:24:58  		shard-strategy = "module"
12:24:58  	}
12:24:58  ]
12:24:58  Dump module-shards.conf
12:24:58  + echo 'Dump module-shards.conf'
12:24:58  + cat /tmp/karaf-0.21.2/configuration/initial/module-shards.conf
12:24:58  module-shards = [
12:24:58  	{
12:24:58  		name = "default"
12:24:58  		shards = [
12:24:58  			{
12:24:58  				name = "default"
12:24:58  				replicas = ["member-1",
12:24:58  				"member-2",
12:24:58  				"member-3"]
12:24:58  			}
12:24:58  		]
12:24:58  	},
12:24:58  	{
12:24:58  		name = "inventory"
12:24:58  		shards = [
12:24:58  			{
12:24:58  				name="inventory"
12:24:58  				replicas = ["member-1",
12:24:58  				"member-2",
12:24:58  				"member-3"]
12:24:58  			}
12:24:58  		]
12:24:58  	},
12:24:58  	{
12:24:58  		name = "topology"
12:24:58  		shards = [
12:24:58  			{
12:24:58  				name="topology"
12:24:58  				replicas = ["member-1",
12:24:58  				"member-2",
12:24:58  				"member-3"]
12:24:58  			}
12:24:58  		]
12:24:58  	},
12:24:58  	{
12:24:58  		name = "toaster"
12:24:58  		shards = [
12:24:58  			{
12:24:58  				name="toaster"
12:24:58  				replicas = ["member-1",
12:24:58  				"member-2",
12:24:58  				"member-3"]
12:24:58  			}
12:24:58  		]
12:24:58  	}
12:24:58  ]
12:24:58  Configuring member-3 with IP address 10.30.170.124
12:24:58  Warning: Permanently added '10.30.170.124' (ECDSA) to the list of known hosts.
12:24:58  Warning: Permanently added '10.30.170.124' (ECDSA) to the list of known hosts.
12:24:58  common-functions.sh is being sourced
12:24:58  common-functions environment:
12:24:58  MAVENCONF: /tmp/karaf-0.21.2/etc/org.ops4j.pax.url.mvn.cfg
12:24:58  ACTUALFEATURES: 
12:24:58  FEATURESCONF: /tmp/karaf-0.21.2/etc/org.apache.karaf.features.cfg
12:24:58  CUSTOMPROP: /tmp/karaf-0.21.2/etc/custom.properties
12:24:58  LOGCONF: /tmp/karaf-0.21.2/etc/org.ops4j.pax.logging.cfg
12:24:58  MEMCONF: /tmp/karaf-0.21.2/bin/setenv
12:24:58  CONTROLLERMEM: 
12:24:58  AKKACONF: /tmp/karaf-0.21.2/configuration/initial/akka.conf
12:24:58  MODULESCONF: /tmp/karaf-0.21.2/configuration/initial/modules.conf
12:24:58  MODULESHARDSCONF: /tmp/karaf-0.21.2/configuration/initial/module-shards.conf
12:24:58  SUITES: 
12:24:58  
12:24:58  + source /tmp/common-functions.sh karaf-0.21.2
12:24:58  ++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]]
12:24:58  ++ echo 'common-functions.sh is being sourced'
12:24:58  ++ BUNDLEFOLDER=karaf-0.21.2
12:24:58  ++ export MAVENCONF=/tmp/karaf-0.21.2/etc/org.ops4j.pax.url.mvn.cfg
12:24:58  ++ MAVENCONF=/tmp/karaf-0.21.2/etc/org.ops4j.pax.url.mvn.cfg
12:24:58  ++ export FEATURESCONF=/tmp/karaf-0.21.2/etc/org.apache.karaf.features.cfg
12:24:58  ++ FEATURESCONF=/tmp/karaf-0.21.2/etc/org.apache.karaf.features.cfg
12:24:58  ++ export CUSTOMPROP=/tmp/karaf-0.21.2/etc/custom.properties
12:24:58  ++ CUSTOMPROP=/tmp/karaf-0.21.2/etc/custom.properties
12:24:58  ++ export LOGCONF=/tmp/karaf-0.21.2/etc/org.ops4j.pax.logging.cfg
12:24:58  ++ LOGCONF=/tmp/karaf-0.21.2/etc/org.ops4j.pax.logging.cfg
12:24:58  ++ export MEMCONF=/tmp/karaf-0.21.2/bin/setenv
12:24:58  ++ MEMCONF=/tmp/karaf-0.21.2/bin/setenv
12:24:58  ++ export CONTROLLERMEM=
12:24:58  ++ CONTROLLERMEM=
12:24:58  ++ export AKKACONF=/tmp/karaf-0.21.2/configuration/initial/akka.conf
12:24:58  ++ AKKACONF=/tmp/karaf-0.21.2/configuration/initial/akka.conf
12:24:58  ++ export MODULESCONF=/tmp/karaf-0.21.2/configuration/initial/modules.conf
12:24:58  ++ MODULESCONF=/tmp/karaf-0.21.2/configuration/initial/modules.conf
12:24:58  ++ export MODULESHARDSCONF=/tmp/karaf-0.21.2/configuration/initial/module-shards.conf
12:24:58  ++ MODULESHARDSCONF=/tmp/karaf-0.21.2/configuration/initial/module-shards.conf
12:24:58  ++ print_common_env
12:24:58  ++ cat
12:24:58  ++ SSH='ssh -t -t'
12:24:58  ++ extra_services_cntl='     dnsmasq.service     httpd.service     libvirtd.service     openvswitch.service     ovs-vswitchd.service     ovsdb-server.service     rabbitmq-server.service '
12:24:58  ++ extra_services_cmp='     libvirtd.service     openvswitch.service     ovs-vswitchd.service     ovsdb-server.service '
12:24:58  Changing to /tmp
12:24:58  Downloading the distribution from https://nexus.opendaylight.org/content/repositories//autorelease-8681/org/opendaylight/integration/karaf/0.21.2/karaf-0.21.2.zip
12:24:58  + echo 'Changing to /tmp'
12:24:58  + cd /tmp
12:24:58  + echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories//autorelease-8681/org/opendaylight/integration/karaf/0.21.2/karaf-0.21.2.zip'
12:24:58  + wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories//autorelease-8681/org/opendaylight/integration/karaf/0.21.2/karaf-0.21.2.zip
12:24:58  --2025-03-10 12:24:58--  https://nexus.opendaylight.org/content/repositories//autorelease-8681/org/opendaylight/integration/karaf/0.21.2/karaf-0.21.2.zip
12:24:58  Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6
12:24:58  Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected.
12:24:58  HTTP request sent, awaiting response... 200 OK
12:24:59  Length: 234524817 (224M) [application/zip]
12:24:59  Saving to: ‘karaf-0.21.2.zip’
12:24:59  
12:24:59       0K ........ ........ ........ ........ ........ ........  1% 72.0M 3s
12:24:59    3072K ........ ........ ........ ........ ........ ........  2%  117M 2s
12:24:59    6144K ........ ........ ........ ........ ........ ........  4%  166M 2s
12:24:59    9216K ........ ........ ........ ........ ........ ........  5%  177M 2s
12:24:59   12288K ........ ........ ........ ........ ........ ........  6%  192M 2s
12:24:59   15360K ........ ........ ........ ........ ........ ........  8%  206M 2s
12:24:59   18432K ........ ........ ........ ........ ........ ........  9%  213M 1s
12:24:59   21504K ........ ........ ........ ........ ........ ........ 10%  245M 1s
12:24:59   24576K ........ ........ ........ ........ ........ ........ 12%  270M 1s
12:24:59   27648K ........ ........ ........ ........ ........ ........ 13%  269M 1s
12:24:59   30720K ........ ........ ........ ........ ........ ........ 14%  286M 1s
12:24:59   33792K ........ ........ ........ ........ ........ ........ 16%  319M 1s
12:24:59   36864K ........ ........ ........ ........ ........ ........ 17%  322M 1s
12:24:59   39936K ........ ........ ........ ........ ........ ........ 18%  340M 1s
12:24:59   43008K ........ ........ ........ ........ ........ ........ 20%  321M 1s
12:24:59   46080K ........ ........ ........ ........ ........ ........ 21%  315M 1s
12:24:59   49152K ........ ........ ........ ........ ........ ........ 22%  337M 1s
12:24:59   52224K ........ ........ ........ ........ ........ ........ 24%  297M 1s
12:24:59   55296K ........ ........ ........ ........ ........ ........ 25%  306M 1s
12:24:59   58368K ........ ........ ........ ........ ........ ........ 26%  270M 1s
12:24:59   61440K ........ ........ ........ ........ ........ ........ 28%  291M 1s
12:24:59   64512K ........ ........ ........ ........ ........ ........ 29%  302M 1s
12:24:59   67584K ........ ........ ........ ........ ........ ........ 30%  377M 1s
12:24:59   70656K ........ ........ ........ ........ ........ ........ 32%  457M 1s
12:24:59   73728K ........ ........ ........ ........ ........ ........ 33%  429M 1s
12:24:59   76800K ........ ........ ........ ........ ........ ........ 34%  332M 1s
12:24:59   79872K ........ ........ ........ ........ ........ ........ 36%  308M 1s
12:24:59   82944K ........ ........ ........ ........ ........ ........ 37%  304M 1s
12:24:59   86016K ........ ........ ........ ........ ........ ........ 38%  148M 1s
12:24:59   89088K ........ ........ ........ ........ ........ ........ 40%  282M 1s
12:24:59   92160K ........ ........ ........ ........ ........ ........ 41%  316M 1s
12:24:59   95232K ........ ........ ........ ........ ........ ........ 42%  296M 1s
12:24:59   98304K ........ ........ ........ ........ ........ ........ 44%  343M 1s
12:24:59  101376K ........ ........ ........ ........ ........ ........ 45%  308M 0s
12:24:59  104448K ........ ........ ........ ........ ........ ........ 46%  369M 0s
12:24:59  107520K ........ ........ ........ ........ ........ ........ 48%  245M 0s
12:24:59  110592K ........ ........ ........ ........ ........ ........ 49%  274M 0s
12:24:59  113664K ........ ........ ........ ........ ........ ........ 50%  455M 0s
12:24:59  116736K ........ ........ ........ ........ ........ ........ 52%  411M 0s
12:24:59  119808K ........ ........ ........ ........ ........ ........ 53%  312M 0s
12:24:59  122880K ........ ........ ........ ........ ........ ........ 54%  308M 0s
12:24:59  125952K ........ ........ ........ ........ ........ ........ 56%  324M 0s
12:24:59  129024K ........ ........ ........ ........ ........ ........ 57%  377M 0s
12:24:59  132096K ........ ........ ........ ........ ........ ........ 59%  358M 0s
12:24:59  135168K ........ ........ ........ ........ ........ ........ 60%  272M 0s
12:24:59  138240K ........ ........ ........ ........ ........ ........ 61%  326M 0s
12:24:59  141312K ........ ........ ........ ........ ........ ........ 63%  332M 0s
12:24:59  144384K ........ ........ ........ ........ ........ ........ 64%  358M 0s
12:24:59  147456K ........ ........ ........ ........ ........ ........ 65%  367M 0s
12:24:59  150528K ........ ........ ........ ........ ........ ........ 67%  282M 0s
12:24:59  153600K ........ ........ ........ ........ ........ ........ 68%  274M 0s
12:24:59  156672K ........ ........ ........ ........ ........ ........ 69%  399M 0s
12:24:59  159744K ........ ........ ........ ........ ........ ........ 71%  379M 0s
12:24:59  162816K ........ ........ ........ ........ ........ ........ 72%  354M 0s
12:24:59  165888K ........ ........ ........ ........ ........ ........ 73%  343M 0s
12:24:59  168960K ........ ........ ........ ........ ........ ........ 75%  233M 0s
12:24:59  172032K ........ ........ ........ ........ ........ ........ 76%  339M 0s
12:24:59  175104K ........ ........ ........ ........ ........ ........ 77%  389M 0s
12:24:59  178176K ........ ........ ........ ........ ........ ........ 79%  362M 0s
12:24:59  181248K ........ ........ ........ ........ ........ ........ 80%  340M 0s
12:24:59  184320K ........ ........ ........ ........ ........ ........ 81%  227M 0s
12:24:59  187392K ........ ........ ........ ........ ........ ........ 83%  318M 0s
12:24:59  190464K ........ ........ ........ ........ ........ ........ 84%  411M 0s
12:24:59  193536K ........ ........ ........ ........ ........ ........ 85%  257M 0s
12:24:59  196608K ........ ........ ........ ........ ........ ........ 87%  318M 0s
12:24:59  199680K ........ ........ ........ ........ ........ ........ 88%  413M 0s
12:24:59  202752K ........ ........ ........ ........ ........ ........ 89%  377M 0s
12:24:59  205824K ........ ........ ........ ........ ........ ........ 91%  380M 0s
12:24:59  208896K ........ ........ ........ ........ ........ ........ 92%  268M 0s
12:24:59  211968K ........ ........ ........ ........ ........ ........ 93%  214M 0s
12:24:59  215040K ........ ........ ........ ........ ........ ........ 95%  302M 0s
12:24:59  218112K ........ ........ ........ ........ ........ ........ 96%  349M 0s
12:24:59  221184K ........ ........ ........ ........ ........ ........ 97%  368M 0s
12:24:59  224256K ........ ........ ........ ........ ........ ........ 99%  356M 0s
12:24:59  227328K ........ ........ ........ ..                        100%  367M=0.8s
12:24:59  
12:24:59  2025-03-10 12:24:59 (282 MB/s) - ‘karaf-0.21.2.zip’ saved [234524817/234524817]
12:24:59  
12:24:59  Extracting the new controller...
12:24:59  + echo 'Extracting the new controller...'
12:24:59  + unzip -q karaf-0.21.2.zip
12:25:01  Adding external repositories...
12:25:01  + echo 'Adding external repositories...'
12:25:01  + sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.21.2/etc/org.ops4j.pax.url.mvn.cfg
12:25:01  + cat /tmp/karaf-0.21.2/etc/org.ops4j.pax.url.mvn.cfg
12:25:01  ################################################################################
12:25:01  #
12:25:01  #    Licensed to the Apache Software Foundation (ASF) under one or more
12:25:01  #    contributor license agreements.  See the NOTICE file distributed with
12:25:01  #    this work for additional information regarding copyright ownership.
12:25:01  #    The ASF licenses this file to You under the Apache License, Version 2.0
12:25:01  #    (the "License"); you may not use this file except in compliance with
12:25:01  #    the License.  You may obtain a copy of the License at
12:25:01  #
12:25:01  #       http://www.apache.org/licenses/LICENSE-2.0
12:25:01  #
12:25:01  #    Unless required by applicable law or agreed to in writing, software
12:25:01  #    distributed under the License is distributed on an "AS IS" BASIS,
12:25:01  #    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
12:25:01  #    See the License for the specific language governing permissions and
12:25:01  #    limitations under the License.
12:25:01  #
12:25:01  ################################################################################
12:25:01  
12:25:01  #
12:25:01  # If set to true, the following property will not allow any certificate to be used
12:25:01  # when accessing Maven repositories through SSL
12:25:01  #
12:25:01  #org.ops4j.pax.url.mvn.certificateCheck=
12:25:01  
12:25:01  #
12:25:01  # Path to the local Maven settings file.
12:25:01  # The repositories defined in this file will be automatically added to the list
12:25:01  # of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property
12:25:01  # below is not set.
12:25:01  # The following locations are checked for the existence of the settings.xml file
12:25:01  #   * 1. looks for the specified url
12:25:01  #   * 2. if not found looks for ${user.home}/.m2/settings.xml
12:25:01  #   * 3. if not found looks for ${maven.home}/conf/settings.xml
12:25:01  #   * 4. if not found looks for ${M2_HOME}/conf/settings.xml
12:25:01  #
12:25:01  #org.ops4j.pax.url.mvn.settings=
12:25:01  
12:25:01  #
12:25:01  # Path to the local Maven repository which is used to avoid downloading
12:25:01  # artifacts when they already exist locally.
12:25:01  # The value of this property will be extracted from the settings.xml file
12:25:01  # above, or defaulted to:
12:25:01  #     System.getProperty( "user.home" ) + "/.m2/repository"
12:25:01  #
12:25:01  org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository}
12:25:01  
12:25:01  #
12:25:01  # Default this to false. It's just weird to use undocumented repos
12:25:01  #
12:25:01  org.ops4j.pax.url.mvn.useFallbackRepositories=false
12:25:01  
12:25:01  #
12:25:01  # Uncomment if you don't wanna use the proxy settings
12:25:01  # from the Maven conf/settings.xml file
12:25:01  #
12:25:01  # org.ops4j.pax.url.mvn.proxySupport=false
12:25:01  
12:25:01  #
12:25:01  # Comma separated list of repositories scanned when resolving an artifact.
12:25:01  # Those repositories will be checked before iterating through the
12:25:01  #    below list of repositories and even before the local repository
12:25:01  # A repository url can be appended with zero or more of the following flags:
12:25:01  #    @snapshots  : the repository contains snaphots
12:25:01  #    @noreleases : the repository does not contain any released artifacts
12:25:01  #
12:25:01  # The following property value will add the system folder as a repo.
12:25:01  #
12:25:01  org.ops4j.pax.url.mvn.defaultRepositories=\
12:25:01      file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\
12:25:01      file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\
12:25:01      file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots
12:25:01  
12:25:01  # Use the default local repo (e.g.~/.m2/repository) as a "remote" repo
12:25:01  #org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false
12:25:01  
12:25:01  #
12:25:01  # Comma separated list of repositories scanned when resolving an artifact.
12:25:01  # The default list includes the following repositories:
12:25:01  #    http://repo1.maven.org/maven2@id=central
12:25:01  #    http://repository.springsource.com/maven/bundles/release@id=spring.ebr
12:25:01  #    http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external
12:25:01  #    http://zodiac.springsource.com/maven/bundles/release@id=gemini
12:25:01  #    http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases
12:25:01  #    https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases
12:25:01  #    https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
12:25:01  # To add repositories to the default ones, prepend '+' to the list of repositories
12:25:01  # to add.
12:25:01  # A repository url can be appended with zero or more of the following flags:
12:25:01  #    @snapshots  : the repository contains snapshots
12:25:01  #    @noreleases : the repository does not contain any released artifacts
12:25:01  #    @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended
12:25:01  #
12:25:01  org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
12:25:01  
12:25:01  ### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.Configuring the startup features...
12:25:01  + [[ True == \T\r\u\e ]]
12:25:01  + echo 'Configuring the startup features...'
12:25:01  + sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-infrautils-ready,odl-jolokia,odl-openflowplugin-flow-services-rest,odl-openflowplugin-app-table-miss-enforcer,/g' /tmp/karaf-0.21.2/etc/org.apache.karaf.features.cfg
12:25:01  + FEATURE_TEST_STRING=features-test
12:25:01  + FEATURE_TEST_VERSION=0.21.2
12:25:01  + KARAF_VERSION=karaf4
12:25:01  + [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]]
12:25:01  + sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.21.2/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.21.2/etc/org.apache.karaf.features.cfg
12:25:01  + [[ ! -z '' ]]
12:25:01  + cat /tmp/karaf-0.21.2/etc/org.apache.karaf.features.cfg
12:25:01  ################################################################################
12:25:01  #
12:25:01  #    Licensed to the Apache Software Foundation (ASF) under one or more
12:25:01  #    contributor license agreements.  See the NOTICE file distributed with
12:25:01  #    this work for additional information regarding copyright ownership.
12:25:01  #    The ASF licenses this file to You under the Apache License, Version 2.0
12:25:01  #    (the "License"); you may not use this file except in compliance with
12:25:01  #    the License.  You may obtain a copy of the License at
12:25:01  #
12:25:01  #       http://www.apache.org/licenses/LICENSE-2.0
12:25:01  #
12:25:01  #    Unless required by applicable law or agreed to in writing, software
12:25:01  #    distributed under the License is distributed on an "AS IS" BASIS,
12:25:01  #    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
12:25:01  #    See the License for the specific language governing permissions and
12:25:01  #    limitations under the License.
12:25:01  #
12:25:01  ################################################################################
12:25:01  
12:25:01  #
12:25:01  # Comma separated list of features repositories to register by default
12:25:01  #
12:25:01  featuresRepositories = mvn:org.opendaylight.integration/features-test/0.21.2/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/0c1b6937-8a27-40a9-abe5-b582b00918ae.xml
12:25:01  
12:25:01  #
12:25:01  # Comma separated list of features to install at startup
12:25:01  #
12:25:01  featuresBoot = odl-infrautils-ready,odl-jolokia,odl-openflowplugin-flow-services-rest,odl-openflowplugin-app-table-miss-enforcer, d7842298-e427-4095-a150-da4f98dec4d8
12:25:01  
12:25:01  #
12:25:01  # Resource repositories (OBR) that the features resolver can use
12:25:01  # to resolve requirements/capabilities
12:25:01  #
12:25:01  # The format of the resourceRepositories is 
12:25:01  # resourceRepositories=[xml:url|json:url],...
12:25:01  # for Instance:
12:25:01  #
12:25:01  #resourceRepositories=xml:http://host/path/to/index.xml
12:25:01  # or
12:25:01  #resourceRepositories=json:http://host/path/to/index.json
12:25:01  #
12:25:01  
12:25:01  #
12:25:01  # Defines if the boot features are started in asynchronous mode (in a dedicated thread)
12:25:01  #
12:25:01  featuresBootAsynchronous=false
12:25:01  
12:25:01  #
12:25:01  # Service requirements enforcement
12:25:01  #
12:25:01  # By default, the feature resolver checks the service requirements/capabilities of
12:25:01  # bundles for new features (xml schema >= 1.3.0) in order to automatically installs
12:25:01  # the required bundles.
12:25:01  # The following flag can have those values:
12:25:01  #   - disable: service requirements are completely ignored
12:25:01  #   - default: service requirements are ignored for old features
12:25:01  #   - enforce: service requirements are always verified
12:25:01  #
12:25:01  #serviceRequirements=default
12:25:01  
12:25:01  #
12:25:01  # Store cfg file for config element in feature
12:25:01  #
12:25:01  #configCfgStore=true
12:25:01  
12:25:01  #
12:25:01  # Define if the feature service automatically refresh bundles
12:25:01  #
12:25:01  autoRefresh=true
12:25:01  
12:25:01  #
12:25:01  # Configuration of features processing mechanism (overrides, blacklisting, modification of features)
12:25:01  # XML file defines instructions related to features processing
12:25:01  # versions.properties may declare properties to resolve placeholders in XML file
12:25:01  # both files are relative to ${karaf.etc}
12:25:01  #
12:25:01  #featureProcessing=org.apache.karaf.features.xml
12:25:01  #featureProcessingVersions=versions.properties
12:25:01  + configure_karaf_log karaf4 ''
12:25:01  + local -r karaf_version=karaf4
12:25:01  + local -r controllerdebugmap=
12:25:01  + local logapi=log4j
12:25:01  + grep log4j2 /tmp/karaf-0.21.2/etc/org.ops4j.pax.logging.cfg
12:25:01  log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
12:25:01  log4j2.rootLogger.level = INFO
12:25:01  #log4j2.rootLogger.type = asyncRoot
12:25:01  #log4j2.rootLogger.includeLocation = false
12:25:01  log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
12:25:01  log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
12:25:01  log4j2.rootLogger.appenderRef.Console.ref = Console
12:25:01  log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
12:25:01  log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
12:25:01  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
12:25:01  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
12:25:01  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
12:25:01  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
12:25:01  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
12:25:01  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
12:25:01  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
12:25:01  log4j2.logger.spifly.name = org.apache.aries.spifly
12:25:01  log4j2.logger.spifly.level = WARN
12:25:01  log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
12:25:01  log4j2.logger.audit.level = INFO
12:25:01  log4j2.logger.audit.additivity = false
12:25:01  log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
12:25:01  # Console appender not used by default (see log4j2.rootLogger.appenderRefs)
12:25:01  log4j2.appender.console.type = Console
12:25:01  log4j2.appender.console.name = Console
12:25:01  log4j2.appender.console.layout.type = PatternLayout
12:25:01  log4j2.appender.console.layout.pattern = ${log4j2.pattern}
12:25:01  log4j2.appender.rolling.type = RollingRandomAccessFile
12:25:01  log4j2.appender.rolling.name = RollingFile
12:25:01  log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
12:25:01  log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
12:25:01  #log4j2.appender.rolling.immediateFlush = false
12:25:01  log4j2.appender.rolling.append = true
12:25:01  log4j2.appender.rolling.layout.type = PatternLayout
12:25:01  log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
12:25:01  log4j2.appender.rolling.policies.type = Policies
12:25:01  log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
12:25:01  log4j2.appender.rolling.policies.size.size = 64MB
12:25:01  log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
12:25:01  log4j2.appender.rolling.strategy.max = 7
12:25:01  log4j2.appender.audit.type = RollingRandomAccessFile
12:25:01  log4j2.appender.audit.name = AuditRollingFile
12:25:01  log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
12:25:01  log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
12:25:01  log4j2.appender.audit.append = true
12:25:01  log4j2.appender.audit.layout.type = PatternLayout
12:25:01  log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
12:25:01  log4j2.appender.audit.policies.type = Policies
12:25:01  log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
12:25:01  log4j2.appender.audit.policies.size.size = 8MB
12:25:01  log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
12:25:01  log4j2.appender.audit.strategy.max = 7
12:25:01  log4j2.appender.osgi.type = PaxOsgi
12:25:01  log4j2.appender.osgi.name = PaxOsgi
12:25:01  log4j2.appender.osgi.filter = *
12:25:01  #log4j2.logger.aether.name = shaded.org.eclipse.aether
12:25:01  #log4j2.logger.aether.level = TRACE
12:25:01  #log4j2.logger.http-headers.name = shaded.org.apache.http.headers
12:25:01  #log4j2.logger.http-headers.level = DEBUG
12:25:01  #log4j2.logger.maven.name = org.ops4j.pax.url.mvn
12:25:01  #log4j2.logger.maven.level = TRACE
12:25:01  Configuring the karaf log... karaf_version: karaf4, logapi: log4j2
12:25:01  + logapi=log4j2
12:25:01  + echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2'
12:25:01  + '[' log4j2 == log4j2 ']'
12:25:01  + sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.21.2/etc/org.ops4j.pax.logging.cfg
12:25:01  + orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver
12:25:01  + orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver
12:25:01  + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN'
12:25:01  + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN'
12:25:01  controllerdebugmap: 
12:25:01  cat /tmp/karaf-0.21.2/etc/org.ops4j.pax.logging.cfg
12:25:01  + unset IFS
12:25:01  + echo 'controllerdebugmap: '
12:25:01  + '[' -n '' ']'
12:25:01  + echo 'cat /tmp/karaf-0.21.2/etc/org.ops4j.pax.logging.cfg'
12:25:01  + cat /tmp/karaf-0.21.2/etc/org.ops4j.pax.logging.cfg
12:25:01  ################################################################################
12:25:01  #
12:25:01  #    Licensed to the Apache Software Foundation (ASF) under one or more
12:25:01  #    contributor license agreements.  See the NOTICE file distributed with
12:25:01  #    this work for additional information regarding copyright ownership.
12:25:01  #    The ASF licenses this file to You under the Apache License, Version 2.0
12:25:01  #    (the "License"); you may not use this file except in compliance with
12:25:01  #    the License.  You may obtain a copy of the License at
12:25:01  #
12:25:01  #       http://www.apache.org/licenses/LICENSE-2.0
12:25:01  #
12:25:01  #    Unless required by applicable law or agreed to in writing, software
12:25:01  #    distributed under the License is distributed on an "AS IS" BASIS,
12:25:01  #    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
12:25:01  #    See the License for the specific language governing permissions and
12:25:01  #    limitations under the License.
12:25:01  #
12:25:01  ################################################################################
12:25:01  
12:25:01  # Common pattern layout for appenders
12:25:01  log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
12:25:01  
12:25:01  # Root logger
12:25:01  log4j2.rootLogger.level = INFO
12:25:01  # uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library
12:25:01  #log4j2.rootLogger.type = asyncRoot
12:25:01  #log4j2.rootLogger.includeLocation = false
12:25:01  log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
12:25:01  log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
12:25:01  log4j2.rootLogger.appenderRef.Console.ref = Console
12:25:01  log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
12:25:01  log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
12:25:01  
12:25:01  # Filters for logs marked by org.opendaylight.odlparent.Markers
12:25:01  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
12:25:01  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
12:25:01  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
12:25:01  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
12:25:01  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
12:25:01  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
12:25:01  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
12:25:01  
12:25:01  # Loggers configuration
12:25:01  
12:25:01  # Spifly logger
12:25:01  log4j2.logger.spifly.name = org.apache.aries.spifly
12:25:01  log4j2.logger.spifly.level = WARN
12:25:01  
12:25:01  # Security audit logger
12:25:01  log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
12:25:01  log4j2.logger.audit.level = INFO
12:25:01  log4j2.logger.audit.additivity = false
12:25:01  log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
12:25:01  
12:25:01  # Appenders configuration
12:25:01  
12:25:01  # Console appender not used by default (see log4j2.rootLogger.appenderRefs)
12:25:01  log4j2.appender.console.type = Console
12:25:01  log4j2.appender.console.name = Console
12:25:01  log4j2.appender.console.layout.type = PatternLayout
12:25:01  log4j2.appender.console.layout.pattern = ${log4j2.pattern}
12:25:01  
12:25:01  # Rolling file appender
12:25:01  log4j2.appender.rolling.type = RollingRandomAccessFile
12:25:01  log4j2.appender.rolling.name = RollingFile
12:25:01  log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
12:25:01  log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
12:25:01  # uncomment to not force a disk flush
12:25:01  #log4j2.appender.rolling.immediateFlush = false
12:25:01  log4j2.appender.rolling.append = true
12:25:01  log4j2.appender.rolling.layout.type = PatternLayout
12:25:01  log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
12:25:01  log4j2.appender.rolling.policies.type = Policies
12:25:01  log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
12:25:01  log4j2.appender.rolling.policies.size.size = 1GB
12:25:01  log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
12:25:01  log4j2.appender.rolling.strategy.max = 7
12:25:01  
12:25:01  # Audit file appender
12:25:01  log4j2.appender.audit.type = RollingRandomAccessFile
12:25:01  log4j2.appender.audit.name = AuditRollingFile
12:25:01  log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
12:25:01  log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
12:25:01  log4j2.appender.audit.append = true
12:25:01  log4j2.appender.audit.layout.type = PatternLayout
12:25:01  log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
12:25:01  log4j2.appender.audit.policies.type = Policies
12:25:01  log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
12:25:01  log4j2.appender.audit.policies.size.size = 8MB
12:25:01  log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
12:25:01  log4j2.appender.audit.strategy.max = 7
12:25:01  
12:25:01  # OSGi appender
12:25:01  log4j2.appender.osgi.type = PaxOsgi
12:25:01  log4j2.appender.osgi.name = PaxOsgi
12:25:01  log4j2.appender.osgi.filter = *
12:25:01  
12:25:01  # help with identification of maven-related problems with pax-url-aether
12:25:01  #log4j2.logger.aether.name = shaded.org.eclipse.aether
12:25:01  #log4j2.logger.aether.level = TRACE
12:25:01  #log4j2.logger.http-headers.name = shaded.org.apache.http.headers
12:25:01  #log4j2.logger.http-headers.level = DEBUG
12:25:01  #log4j2.logger.maven.name = org.ops4j.pax.url.mvn
12:25:01  #log4j2.logger.maven.level = TRACE
12:25:01  log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN
12:25:01  log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN
12:25:01  + set_java_vars /usr/lib/jvm/java-21-openjdk-amd64 2048m /tmp/karaf-0.21.2/bin/setenv
12:25:01  + local -r java_home=/usr/lib/jvm/java-21-openjdk-amd64
12:25:01  Configure
12:25:01      java home: /usr/lib/jvm/java-21-openjdk-amd64
12:25:01  + local -r controllermem=2048m
12:25:01  + local -r memconf=/tmp/karaf-0.21.2/bin/setenv
12:25:01  + echo Configure
12:25:01  + echo '    java home: /usr/lib/jvm/java-21-openjdk-amd64'
12:25:01      max memory: 2048m
12:25:01      memconf: /tmp/karaf-0.21.2/bin/setenv
12:25:01  + echo '    max memory: 2048m'
12:25:01  + echo '    memconf: /tmp/karaf-0.21.2/bin/setenv'
12:25:01  + sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64}%g' /tmp/karaf-0.21.2/bin/setenv
12:25:01  + sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=2048m/g' /tmp/karaf-0.21.2/bin/setenv
12:25:01  cat /tmp/karaf-0.21.2/bin/setenv
12:25:01  + echo 'cat /tmp/karaf-0.21.2/bin/setenv'
12:25:01  + cat /tmp/karaf-0.21.2/bin/setenv
12:25:01  #!/bin/sh
12:25:01  #
12:25:01  #    Licensed to the Apache Software Foundation (ASF) under one or more
12:25:01  #    contributor license agreements.  See the NOTICE file distributed with
12:25:01  #    this work for additional information regarding copyright ownership.
12:25:01  #    The ASF licenses this file to You under the Apache License, Version 2.0
12:25:01  #    (the "License"); you may not use this file except in compliance with
12:25:01  #    the License.  You may obtain a copy of the License at
12:25:01  #
12:25:01  #       http://www.apache.org/licenses/LICENSE-2.0
12:25:01  #
12:25:01  #    Unless required by applicable law or agreed to in writing, software
12:25:01  #    distributed under the License is distributed on an "AS IS" BASIS,
12:25:01  #    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
12:25:01  #    See the License for the specific language governing permissions and
12:25:01  #    limitations under the License.
12:25:01  #
12:25:01  
12:25:01  #
12:25:01  # handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf
12:25:01  # script: client, instance, shell, start, status, stop, karaf
12:25:01  #
12:25:01  # if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then
12:25:01  #   Actions go here...
12:25:01  # fi
12:25:01  
12:25:01  #
12:25:01  # general settings which should be applied for all scripts go here; please keep
12:25:01  # in mind that it is possible that scripts might be executed more than once, e.g.
12:25:01  # in example of the start script where the start script is executed first and the
12:25:01  # karaf script afterwards.
12:25:01  #
12:25:01  
12:25:01  #
12:25:01  # The following section shows the possible configuration options for the default 
12:25:01  # karaf scripts
12:25:01  #
12:25:01  export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64} # Location of Java installation
12:25:01  # export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration
12:25:01  # export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options
12:25:01  # export EXTRA_JAVA_OPTS # Additional JVM options
12:25:01  # export KARAF_HOME # Karaf home folder
12:25:01  # export KARAF_DATA # Karaf data folder
12:25:01  # export KARAF_BASE # Karaf base folder
12:25:01  # export KARAF_ETC  # Karaf etc  folder
12:25:01  # export KARAF_LOG  # Karaf log  folder
12:25:01  # export KARAF_SYSTEM_OPTS # First citizen Karaf options
12:25:01  # export KARAF_OPTS # Additional available Karaf options
12:25:01  # export KARAF_DEBUG # Enable debug mode
12:25:01  # export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start
12:25:01  # export KARAF_NOROOT # Prevent execution as root if set to true
12:25:01  + echo 'Set Java version'
12:25:01  Set Java version
12:25:01  + sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-21-openjdk-amd64/bin/java 1
12:25:01  sudo: /usr/sbin/alternatives: command not found
12:25:01  + sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-21-openjdk-amd64/bin/java
12:25:01  sudo: /usr/sbin/alternatives: command not found
12:25:01  JDK default version ...
12:25:01  + echo 'JDK default version ...'
12:25:01  + java -version
12:25:02  openjdk version "11.0.25" 2024-10-15
12:25:02  OpenJDK Runtime Environment (build 11.0.25+9-post-Ubuntu-1ubuntu120.04)
12:25:02  OpenJDK 64-Bit Server VM (build 11.0.25+9-post-Ubuntu-1ubuntu120.04, mixed mode, sharing)
12:25:02  Set JAVA_HOME
12:25:02  + echo 'Set JAVA_HOME'
12:25:02  + export JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64
12:25:02  + JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64
12:25:02  ++ readlink -e /usr/lib/jvm/java-21-openjdk-amd64/bin/java
12:25:02  Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java
12:25:02  Listing all open ports on controller system...
12:25:02  + JAVA_RESOLVED=/usr/lib/jvm/java-21-openjdk-amd64/bin/java
12:25:02  + echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java'
12:25:02  + echo 'Listing all open ports on controller system...'
12:25:02  + netstat -pnatu
12:25:02  /tmp/configuration-script.sh: line 40: netstat: command not found
12:25:02  Configuring cluster
12:25:02  + '[' -f /tmp/custom_shard_config.txt ']'
12:25:02  + echo 'Configuring cluster'
12:25:02  + /tmp/karaf-0.21.2/bin/configure_cluster.sh 3 10.30.170.110 10.30.171.121 10.30.170.124
12:25:02  ################################################
12:25:02  ##             Configure Cluster              ##
12:25:02  ################################################
12:25:02   NOTE: Cluster configuration files not found. Copying from
12:25:02   /tmp/karaf-0.21.2/system/org/opendaylight/controller/sal-clustering-config/10.0.9
12:25:02  Configuring unique name in akka.conf
12:25:02  Configuring hostname in akka.conf
12:25:02  Configuring data and rpc seed nodes in akka.conf
12:25:02  modules = [
12:25:02  	
12:25:02  	{
12:25:02  		name = "inventory"
12:25:02  		namespace = "urn:opendaylight:inventory"
12:25:02  		shard-strategy = "module"
12:25:02  	},
12:25:02  	{
12:25:02  		name = "topology"
12:25:02  		namespace = "urn:TBD:params:xml:ns:yang:network-topology"
12:25:02  		shard-strategy = "module"
12:25:02  	},
12:25:02  	{
12:25:02  		name = "toaster"
12:25:02  		namespace = "http://netconfcentral.org/ns/toaster"
12:25:02  		shard-strategy = "module"
12:25:02  	}
12:25:02  ]
12:25:02  Configuring replication type in module-shards.conf
12:25:02  ################################################
12:25:02  ##   NOTE: Manually restart controller to     ##
12:25:02  ##         apply configuration.               ##
12:25:02  ################################################
12:25:02  Dump akka.conf
12:25:02  + echo 'Dump akka.conf'
12:25:02  + cat /tmp/karaf-0.21.2/configuration/initial/akka.conf
12:25:02  
12:25:02  odl-cluster-data {
12:25:02    akka {
12:25:02      remote {
12:25:02        artery {
12:25:02          enabled = on
12:25:02          transport = tcp
12:25:02          canonical.hostname = "10.30.170.124"
12:25:02          canonical.port = 2550
12:25:02        }
12:25:02      }
12:25:02  
12:25:02      cluster {
12:25:02        # Using artery.
12:25:02        seed-nodes = ["akka://opendaylight-cluster-data@10.30.170.110:2550",
12:25:02  				"akka://opendaylight-cluster-data@10.30.171.121:2550",
12:25:02  				"akka://opendaylight-cluster-data@10.30.170.124:2550"]
12:25:02  
12:25:02        roles = ["member-3"]
12:25:02  
12:25:02        # when under load we might trip a false positive on the failure detector
12:25:02        # failure-detector {
12:25:02          # heartbeat-interval = 4 s
12:25:02          # acceptable-heartbeat-pause = 16s
12:25:02        # }
12:25:02      }
12:25:02  
12:25:02      persistence {
12:25:02        # By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by
12:25:02        # modifying the following two properties. The directory location specified may be a relative or absolute path. 
12:25:02        # The relative path is always relative to KARAF_HOME.
12:25:02  
12:25:02        # snapshot-store.local.dir = "target/snapshots"
12:25:02  
12:25:02        # Use lz4 compression for LocalSnapshotStore snapshots
12:25:02        snapshot-store.local.use-lz4-compression = false
12:25:02        # Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB
12:25:02        snapshot-store.local.lz4-blocksize = 256KB
12:25:02      }
12:25:02      disable-default-actor-system-quarantined-event-handling = "false"
12:25:02    }
12:25:02  }
12:25:02  Dump modules.conf
12:25:02  + echo 'Dump modules.conf'
12:25:02  + cat /tmp/karaf-0.21.2/configuration/initial/modules.conf
12:25:02  modules = [
12:25:02  	
12:25:02  	{
12:25:02  		name = "inventory"
12:25:02  		namespace = "urn:opendaylight:inventory"
12:25:02  		shard-strategy = "module"
12:25:02  	},
12:25:02  	{
12:25:02  		name = "topology"
12:25:02  		namespace = "urn:TBD:params:xml:ns:yang:network-topology"
12:25:02  		shard-strategy = "module"
12:25:02  	},
12:25:02  	{
12:25:02  		name = "toaster"
12:25:02  		namespace = "http://netconfcentral.org/ns/toaster"
12:25:02  		shard-strategy = "module"
12:25:02  	}
12:25:02  ]
12:25:02  + echo 'Dump module-shards.conf'
12:25:02  Dump module-shards.conf
12:25:02  + cat /tmp/karaf-0.21.2/configuration/initial/module-shards.conf
12:25:02  module-shards = [
12:25:02  	{
12:25:02  		name = "default"
12:25:02  		shards = [
12:25:02  			{
12:25:02  				name = "default"
12:25:02  				replicas = ["member-1",
12:25:02  				"member-2",
12:25:02  				"member-3"]
12:25:02  			}
12:25:02  		]
12:25:02  	},
12:25:02  	{
12:25:02  		name = "inventory"
12:25:02  		shards = [
12:25:02  			{
12:25:02  				name="inventory"
12:25:02  				replicas = ["member-1",
12:25:02  				"member-2",
12:25:02  				"member-3"]
12:25:02  			}
12:25:02  		]
12:25:02  	},
12:25:02  	{
12:25:02  		name = "topology"
12:25:02  		shards = [
12:25:02  			{
12:25:02  				name="topology"
12:25:02  				replicas = ["member-1",
12:25:02  				"member-2",
12:25:02  				"member-3"]
12:25:02  			}
12:25:02  		]
12:25:02  	},
12:25:02  	{
12:25:02  		name = "toaster"
12:25:02  		shards = [
12:25:02  			{
12:25:02  				name="toaster"
12:25:02  				replicas = ["member-1",
12:25:02  				"member-2",
12:25:02  				"member-3"]
12:25:02  			}
12:25:02  		]
12:25:02  	}
12:25:02  ]
12:25:02  Locating config plan to use...
12:25:02  config plan exists!!!
12:25:02  Changing the config plan path...
12:25:02  # Place the suites in run order:
12:25:02  /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test/csit/scripts/set_akka_debug.sh
12:25:02  Executing /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test/csit/scripts/set_akka_debug.sh...
12:25:02  Copying config files to ODL Controller folder
12:25:02  Set AKKA debug on 10.30.170.110
12:25:02  Warning: Permanently added '10.30.170.110' (ECDSA) to the list of known hosts.
12:25:02  Warning: Permanently added '10.30.170.110' (ECDSA) to the list of known hosts.
12:25:02  Enable AKKA debug
12:25:02  Dump /tmp/karaf-0.21.2/configuration/initial/akka.conf
12:25:02  
12:25:02  odl-cluster-data {
12:25:02    akka {
12:25:02  loglevel = "DEBUG"
12:25:02  actor {
12:25:02  debug {
12:25:02  autoreceive = on
12:25:02  lifecycle = on
12:25:02  unhandled = on
12:25:02  fsm = on
12:25:02  event-stream = on
12:25:02  }
12:25:02  }
12:25:02      remote {
12:25:02        artery {
12:25:02          enabled = on
12:25:02          transport = tcp
12:25:02          canonical.hostname = "10.30.170.110"
12:25:02          canonical.port = 2550
12:25:02        }
12:25:02      }
12:25:02  
12:25:02      cluster {
12:25:02        # Using artery.
12:25:02        seed-nodes = ["akka://opendaylight-cluster-data@10.30.170.110:2550",
12:25:02  				"akka://opendaylight-cluster-data@10.30.171.121:2550",
12:25:02  				"akka://opendaylight-cluster-data@10.30.170.124:2550"]
12:25:02  
12:25:02        roles = ["member-1"]
12:25:02  
12:25:02        # when under load we might trip a false positive on the failure detector
12:25:02        # failure-detector {
12:25:02          # heartbeat-interval = 4 s
12:25:02          # acceptable-heartbeat-pause = 16s
12:25:02        # }
12:25:02      }
12:25:02  
12:25:02      persistence {
12:25:02        # By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by
12:25:02        # modifying the following two properties. The directory location specified may be a relative or absolute path. 
12:25:02        # The relative path is always relative to KARAF_HOME.
12:25:02  
12:25:02        # snapshot-store.local.dir = "target/snapshots"
12:25:02  
12:25:02        # Use lz4 compression for LocalSnapshotStore snapshots
12:25:02        snapshot-store.local.use-lz4-compression = false
12:25:02        # Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB
12:25:02        snapshot-store.local.lz4-blocksize = 256KB
12:25:02      }
12:25:02      disable-default-actor-system-quarantined-event-handling = "false"
12:25:02    }
12:25:02  }
12:25:02  Dump /tmp/karaf-0.21.2/etc/org.ops4j.pax.logging.cfg
12:25:02  ################################################################################
12:25:02  #
12:25:02  #    Licensed to the Apache Software Foundation (ASF) under one or more
12:25:02  #    contributor license agreements.  See the NOTICE file distributed with
12:25:02  #    this work for additional information regarding copyright ownership.
12:25:02  #    The ASF licenses this file to You under the Apache License, Version 2.0
12:25:02  #    (the "License"); you may not use this file except in compliance with
12:25:02  #    the License.  You may obtain a copy of the License at
12:25:02  #
12:25:02  #       http://www.apache.org/licenses/LICENSE-2.0
12:25:02  #
12:25:02  #    Unless required by applicable law or agreed to in writing, software
12:25:02  #    distributed under the License is distributed on an "AS IS" BASIS,
12:25:02  #    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
12:25:02  #    See the License for the specific language governing permissions and
12:25:02  #    limitations under the License.
12:25:02  #
12:25:02  ################################################################################
12:25:02  
12:25:02  # Common pattern layout for appenders
12:25:02  log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
12:25:02  
12:25:02  # Root logger
12:25:02  log4j2.rootLogger.level = INFO
12:25:02  # uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library
12:25:02  #log4j2.rootLogger.type = asyncRoot
12:25:02  #log4j2.rootLogger.includeLocation = false
12:25:02  log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
12:25:02  log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
12:25:02  log4j2.rootLogger.appenderRef.Console.ref = Console
12:25:02  log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
12:25:02  log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
12:25:02  
12:25:02  # Filters for logs marked by org.opendaylight.odlparent.Markers
12:25:02  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
12:25:02  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
12:25:02  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
12:25:02  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
12:25:02  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
12:25:02  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
12:25:02  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
12:25:02  
12:25:02  # Loggers configuration
12:25:02  
12:25:02  # Spifly logger
12:25:02  log4j2.logger.spifly.name = org.apache.aries.spifly
12:25:02  log4j2.logger.spifly.level = WARN
12:25:02  
12:25:02  # Security audit logger
12:25:02  log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
12:25:02  log4j2.logger.audit.level = INFO
12:25:02  log4j2.logger.audit.additivity = false
12:25:02  log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
12:25:02  
12:25:02  # Appenders configuration
12:25:02  
12:25:02  # Console appender not used by default (see log4j2.rootLogger.appenderRefs)
12:25:02  log4j2.appender.console.type = Console
12:25:02  log4j2.appender.console.name = Console
12:25:02  log4j2.appender.console.layout.type = PatternLayout
12:25:02  log4j2.appender.console.layout.pattern = ${log4j2.pattern}
12:25:02  
12:25:02  # Rolling file appender
12:25:02  log4j2.appender.rolling.type = RollingRandomAccessFile
12:25:02  log4j2.appender.rolling.name = RollingFile
12:25:02  log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
12:25:02  log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
12:25:02  # uncomment to not force a disk flush
12:25:02  #log4j2.appender.rolling.immediateFlush = false
12:25:02  log4j2.appender.rolling.append = true
12:25:02  log4j2.appender.rolling.layout.type = PatternLayout
12:25:02  log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
12:25:02  log4j2.appender.rolling.policies.type = Policies
12:25:02  log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
12:25:02  log4j2.appender.rolling.policies.size.size = 1GB
12:25:02  log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
12:25:02  log4j2.appender.rolling.strategy.max = 7
12:25:02  
12:25:02  # Audit file appender
12:25:02  log4j2.appender.audit.type = RollingRandomAccessFile
12:25:02  log4j2.appender.audit.name = AuditRollingFile
12:25:02  log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
12:25:02  log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
12:25:02  log4j2.appender.audit.append = true
12:25:02  log4j2.appender.audit.layout.type = PatternLayout
12:25:02  log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
12:25:02  log4j2.appender.audit.policies.type = Policies
12:25:02  log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
12:25:02  log4j2.appender.audit.policies.size.size = 8MB
12:25:02  log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
12:25:02  log4j2.appender.audit.strategy.max = 7
12:25:02  
12:25:02  # OSGi appender
12:25:02  log4j2.appender.osgi.type = PaxOsgi
12:25:02  log4j2.appender.osgi.name = PaxOsgi
12:25:02  log4j2.appender.osgi.filter = *
12:25:02  
12:25:02  # help with identification of maven-related problems with pax-url-aether
12:25:02  #log4j2.logger.aether.name = shaded.org.eclipse.aether
12:25:02  #log4j2.logger.aether.level = TRACE
12:25:02  #log4j2.logger.http-headers.name = shaded.org.apache.http.headers
12:25:02  #log4j2.logger.http-headers.level = DEBUG
12:25:02  #log4j2.logger.maven.name = org.ops4j.pax.url.mvn
12:25:02  #log4j2.logger.maven.level = TRACE
12:25:02  log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN
12:25:02  log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN
12:25:02  log4j2.logger.cluster.name=akka.cluster
12:25:02  log4j2.logger.cluster.level=DEBUG
12:25:02  log4j2.logger.remote.name=akka.remote
12:25:02  log4j2.logger.remote.level=DEBUG
12:25:02  Set AKKA debug on 10.30.171.121
12:25:02  Warning: Permanently added '10.30.171.121' (ECDSA) to the list of known hosts.
12:25:03  Warning: Permanently added '10.30.171.121' (ECDSA) to the list of known hosts.
12:25:03  Enable AKKA debug
12:25:03  Dump /tmp/karaf-0.21.2/configuration/initial/akka.conf
12:25:03  
12:25:03  odl-cluster-data {
12:25:03    akka {
12:25:03  loglevel = "DEBUG"
12:25:03  actor {
12:25:03  debug {
12:25:03  autoreceive = on
12:25:03  lifecycle = on
12:25:03  unhandled = on
12:25:03  fsm = on
12:25:03  event-stream = on
12:25:03  }
12:25:03  }
12:25:03      remote {
12:25:03        artery {
12:25:03          enabled = on
12:25:03          transport = tcp
12:25:03          canonical.hostname = "10.30.171.121"
12:25:03          canonical.port = 2550
12:25:03        }
12:25:03      }
12:25:03  
12:25:03      cluster {
12:25:03        # Using artery.
12:25:03        seed-nodes = ["akka://opendaylight-cluster-data@10.30.170.110:2550",
12:25:03  				"akka://opendaylight-cluster-data@10.30.171.121:2550",
12:25:03  				"akka://opendaylight-cluster-data@10.30.170.124:2550"]
12:25:03  
12:25:03        roles = ["member-2"]
12:25:03  
12:25:03        # when under load we might trip a false positive on the failure detector
12:25:03        # failure-detector {
12:25:03          # heartbeat-interval = 4 s
12:25:03          # acceptable-heartbeat-pause = 16s
12:25:03        # }
12:25:03      }
12:25:03  
12:25:03      persistence {
12:25:03        # By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by
12:25:03        # modifying the following two properties. The directory location specified may be a relative or absolute path. 
12:25:03        # The relative path is always relative to KARAF_HOME.
12:25:03  
12:25:03        # snapshot-store.local.dir = "target/snapshots"
12:25:03  
12:25:03        # Use lz4 compression for LocalSnapshotStore snapshots
12:25:03        snapshot-store.local.use-lz4-compression = false
12:25:03        # Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB
12:25:03        snapshot-store.local.lz4-blocksize = 256KB
12:25:03      }
12:25:03      disable-default-actor-system-quarantined-event-handling = "false"
12:25:03    }
12:25:03  }
12:25:03  Dump /tmp/karaf-0.21.2/etc/org.ops4j.pax.logging.cfg
12:25:03  ################################################################################
12:25:03  #
12:25:03  #    Licensed to the Apache Software Foundation (ASF) under one or more
12:25:03  #    contributor license agreements.  See the NOTICE file distributed with
12:25:03  #    this work for additional information regarding copyright ownership.
12:25:03  #    The ASF licenses this file to You under the Apache License, Version 2.0
12:25:03  #    (the "License"); you may not use this file except in compliance with
12:25:03  #    the License.  You may obtain a copy of the License at
12:25:03  #
12:25:03  #       http://www.apache.org/licenses/LICENSE-2.0
12:25:03  #
12:25:03  #    Unless required by applicable law or agreed to in writing, software
12:25:03  #    distributed under the License is distributed on an "AS IS" BASIS,
12:25:03  #    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
12:25:03  #    See the License for the specific language governing permissions and
12:25:03  #    limitations under the License.
12:25:03  #
12:25:03  ################################################################################
12:25:03  
12:25:03  # Common pattern layout for appenders
12:25:03  log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
12:25:03  
12:25:03  # Root logger
12:25:03  log4j2.rootLogger.level = INFO
12:25:03  # uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library
12:25:03  #log4j2.rootLogger.type = asyncRoot
12:25:03  #log4j2.rootLogger.includeLocation = false
12:25:03  log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
12:25:03  log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
12:25:03  log4j2.rootLogger.appenderRef.Console.ref = Console
12:25:03  log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
12:25:03  log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
12:25:03  
12:25:03  # Filters for logs marked by org.opendaylight.odlparent.Markers
12:25:03  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
12:25:03  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
12:25:03  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
12:25:03  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
12:25:03  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
12:25:03  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
12:25:03  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
12:25:03  
12:25:03  # Loggers configuration
12:25:03  
12:25:03  # Spifly logger
12:25:03  log4j2.logger.spifly.name = org.apache.aries.spifly
12:25:03  log4j2.logger.spifly.level = WARN
12:25:03  
12:25:03  # Security audit logger
12:25:03  log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
12:25:03  log4j2.logger.audit.level = INFO
12:25:03  log4j2.logger.audit.additivity = false
12:25:03  log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
12:25:03  
12:25:03  # Appenders configuration
12:25:03  
12:25:03  # Console appender not used by default (see log4j2.rootLogger.appenderRefs)
12:25:03  log4j2.appender.console.type = Console
12:25:03  log4j2.appender.console.name = Console
12:25:03  log4j2.appender.console.layout.type = PatternLayout
12:25:03  log4j2.appender.console.layout.pattern = ${log4j2.pattern}
12:25:03  
12:25:03  # Rolling file appender
12:25:03  log4j2.appender.rolling.type = RollingRandomAccessFile
12:25:03  log4j2.appender.rolling.name = RollingFile
12:25:03  log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
12:25:03  log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
12:25:03  # uncomment to not force a disk flush
12:25:03  #log4j2.appender.rolling.immediateFlush = false
12:25:03  log4j2.appender.rolling.append = true
12:25:03  log4j2.appender.rolling.layout.type = PatternLayout
12:25:03  log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
12:25:03  log4j2.appender.rolling.policies.type = Policies
12:25:03  log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
12:25:03  log4j2.appender.rolling.policies.size.size = 1GB
12:25:03  log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
12:25:03  log4j2.appender.rolling.strategy.max = 7
12:25:03  
12:25:03  # Audit file appender
12:25:03  log4j2.appender.audit.type = RollingRandomAccessFile
12:25:03  log4j2.appender.audit.name = AuditRollingFile
12:25:03  log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
12:25:03  log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
12:25:03  log4j2.appender.audit.append = true
12:25:03  log4j2.appender.audit.layout.type = PatternLayout
12:25:03  log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
12:25:03  log4j2.appender.audit.policies.type = Policies
12:25:03  log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
12:25:03  log4j2.appender.audit.policies.size.size = 8MB
12:25:03  log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
12:25:03  log4j2.appender.audit.strategy.max = 7
12:25:03  
12:25:03  # OSGi appender
12:25:03  log4j2.appender.osgi.type = PaxOsgi
12:25:03  log4j2.appender.osgi.name = PaxOsgi
12:25:03  log4j2.appender.osgi.filter = *
12:25:03  
12:25:03  # help with identification of maven-related problems with pax-url-aether
12:25:03  #log4j2.logger.aether.name = shaded.org.eclipse.aether
12:25:03  #log4j2.logger.aether.level = TRACE
12:25:03  #log4j2.logger.http-headers.name = shaded.org.apache.http.headers
12:25:03  #log4j2.logger.http-headers.level = DEBUG
12:25:03  #log4j2.logger.maven.name = org.ops4j.pax.url.mvn
12:25:03  #log4j2.logger.maven.level = TRACE
12:25:03  log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN
12:25:03  log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN
12:25:03  log4j2.logger.cluster.name=akka.cluster
12:25:03  log4j2.logger.cluster.level=DEBUG
12:25:03  log4j2.logger.remote.name=akka.remote
12:25:03  log4j2.logger.remote.level=DEBUG
12:25:03  Set AKKA debug on 10.30.170.124
12:25:03  Warning: Permanently added '10.30.170.124' (ECDSA) to the list of known hosts.
12:25:03  Warning: Permanently added '10.30.170.124' (ECDSA) to the list of known hosts.
12:25:03  Enable AKKA debug
12:25:03  Dump /tmp/karaf-0.21.2/configuration/initial/akka.conf
12:25:03  
12:25:03  odl-cluster-data {
12:25:03    akka {
12:25:03  loglevel = "DEBUG"
12:25:03  actor {
12:25:03  debug {
12:25:03  autoreceive = on
12:25:03  lifecycle = on
12:25:03  unhandled = on
12:25:03  fsm = on
12:25:03  event-stream = on
12:25:03  }
12:25:03  }
12:25:03      remote {
12:25:03        artery {
12:25:03          enabled = on
12:25:03          transport = tcp
12:25:03          canonical.hostname = "10.30.170.124"
12:25:03          canonical.port = 2550
12:25:03        }
12:25:03      }
12:25:03  
12:25:03      cluster {
12:25:03        # Using artery.
12:25:03        seed-nodes = ["akka://opendaylight-cluster-data@10.30.170.110:2550",
12:25:03  				"akka://opendaylight-cluster-data@10.30.171.121:2550",
12:25:03  				"akka://opendaylight-cluster-data@10.30.170.124:2550"]
12:25:03  
12:25:03        roles = ["member-3"]
12:25:03  
12:25:03        # when under load we might trip a false positive on the failure detector
12:25:03        # failure-detector {
12:25:03          # heartbeat-interval = 4 s
12:25:03          # acceptable-heartbeat-pause = 16s
12:25:03        # }
12:25:03      }
12:25:03  
12:25:03      persistence {
12:25:03        # By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by
12:25:03        # modifying the following two properties. The directory location specified may be a relative or absolute path. 
12:25:03        # The relative path is always relative to KARAF_HOME.
12:25:03  
12:25:03        # snapshot-store.local.dir = "target/snapshots"
12:25:03  
12:25:03        # Use lz4 compression for LocalSnapshotStore snapshots
12:25:03        snapshot-store.local.use-lz4-compression = false
12:25:03        # Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB
12:25:03        snapshot-store.local.lz4-blocksize = 256KB
12:25:03      }
12:25:03      disable-default-actor-system-quarantined-event-handling = "false"
12:25:03    }
12:25:03  }
12:25:03  Dump /tmp/karaf-0.21.2/etc/org.ops4j.pax.logging.cfg
12:25:03  ################################################################################
12:25:03  #
12:25:03  #    Licensed to the Apache Software Foundation (ASF) under one or more
12:25:03  #    contributor license agreements.  See the NOTICE file distributed with
12:25:03  #    this work for additional information regarding copyright ownership.
12:25:03  #    The ASF licenses this file to You under the Apache License, Version 2.0
12:25:03  #    (the "License"); you may not use this file except in compliance with
12:25:03  #    the License.  You may obtain a copy of the License at
12:25:03  #
12:25:03  #       http://www.apache.org/licenses/LICENSE-2.0
12:25:03  #
12:25:03  #    Unless required by applicable law or agreed to in writing, software
12:25:03  #    distributed under the License is distributed on an "AS IS" BASIS,
12:25:03  #    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
12:25:03  #    See the License for the specific language governing permissions and
12:25:03  #    limitations under the License.
12:25:03  #
12:25:03  ################################################################################
12:25:03  
12:25:03  # Common pattern layout for appenders
12:25:03  log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
12:25:03  
12:25:03  # Root logger
12:25:03  log4j2.rootLogger.level = INFO
12:25:03  # uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library
12:25:03  #log4j2.rootLogger.type = asyncRoot
12:25:03  #log4j2.rootLogger.includeLocation = false
12:25:03  log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
12:25:03  log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
12:25:03  log4j2.rootLogger.appenderRef.Console.ref = Console
12:25:03  log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
12:25:03  log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
12:25:03  
12:25:03  # Filters for logs marked by org.opendaylight.odlparent.Markers
12:25:03  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
12:25:03  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
12:25:03  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
12:25:03  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
12:25:03  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
12:25:03  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
12:25:03  log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
12:25:03  
12:25:03  # Loggers configuration
12:25:03  
12:25:03  # Spifly logger
12:25:03  log4j2.logger.spifly.name = org.apache.aries.spifly
12:25:03  log4j2.logger.spifly.level = WARN
12:25:03  
12:25:03  # Security audit logger
12:25:03  log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
12:25:03  log4j2.logger.audit.level = INFO
12:25:03  log4j2.logger.audit.additivity = false
12:25:03  log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
12:25:03  
12:25:03  # Appenders configuration
12:25:03  
12:25:03  # Console appender not used by default (see log4j2.rootLogger.appenderRefs)
12:25:03  log4j2.appender.console.type = Console
12:25:03  log4j2.appender.console.name = Console
12:25:03  log4j2.appender.console.layout.type = PatternLayout
12:25:03  log4j2.appender.console.layout.pattern = ${log4j2.pattern}
12:25:03  
12:25:03  # Rolling file appender
12:25:03  log4j2.appender.rolling.type = RollingRandomAccessFile
12:25:03  log4j2.appender.rolling.name = RollingFile
12:25:03  log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
12:25:03  log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
12:25:03  # uncomment to not force a disk flush
12:25:03  #log4j2.appender.rolling.immediateFlush = false
12:25:03  log4j2.appender.rolling.append = true
12:25:03  log4j2.appender.rolling.layout.type = PatternLayout
12:25:03  log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
12:25:03  log4j2.appender.rolling.policies.type = Policies
12:25:03  log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
12:25:03  log4j2.appender.rolling.policies.size.size = 1GB
12:25:03  log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
12:25:03  log4j2.appender.rolling.strategy.max = 7
12:25:03  
12:25:03  # Audit file appender
12:25:03  log4j2.appender.audit.type = RollingRandomAccessFile
12:25:03  log4j2.appender.audit.name = AuditRollingFile
12:25:03  log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
12:25:03  log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
12:25:03  log4j2.appender.audit.append = true
12:25:03  log4j2.appender.audit.layout.type = PatternLayout
12:25:03  log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
12:25:03  log4j2.appender.audit.policies.type = Policies
12:25:03  log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
12:25:03  log4j2.appender.audit.policies.size.size = 8MB
12:25:03  log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
12:25:03  log4j2.appender.audit.strategy.max = 7
12:25:03  
12:25:03  # OSGi appender
12:25:03  log4j2.appender.osgi.type = PaxOsgi
12:25:03  log4j2.appender.osgi.name = PaxOsgi
12:25:03  log4j2.appender.osgi.filter = *
12:25:03  
12:25:03  # help with identification of maven-related problems with pax-url-aether
12:25:03  #log4j2.logger.aether.name = shaded.org.eclipse.aether
12:25:03  #log4j2.logger.aether.level = TRACE
12:25:03  #log4j2.logger.http-headers.name = shaded.org.apache.http.headers
12:25:03  #log4j2.logger.http-headers.level = DEBUG
12:25:03  #log4j2.logger.maven.name = org.ops4j.pax.url.mvn
12:25:03  #log4j2.logger.maven.level = TRACE
12:25:03  log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN
12:25:03  log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN
12:25:03  log4j2.logger.cluster.name=akka.cluster
12:25:03  log4j2.logger.cluster.level=DEBUG
12:25:03  log4j2.logger.remote.name=akka.remote
12:25:03  log4j2.logger.remote.level=DEBUG
12:25:03  Finished running config plans
12:25:03  Starting member-1 with IP address 10.30.170.110
12:25:03  Warning: Permanently added '10.30.170.110' (ECDSA) to the list of known hosts.
12:25:04  Warning: Permanently added '10.30.170.110' (ECDSA) to the list of known hosts.
12:25:04  Redirecting karaf console output to karaf_console.log
12:25:04  Starting controller...
12:25:04  start: Redirecting Karaf output to /tmp/karaf-0.21.2/data/log/karaf_console.log
12:25:04  Starting member-2 with IP address 10.30.171.121
12:25:04  Warning: Permanently added '10.30.171.121' (ECDSA) to the list of known hosts.
12:25:04  Warning: Permanently added '10.30.171.121' (ECDSA) to the list of known hosts.
12:25:05  Redirecting karaf console output to karaf_console.log
12:25:05  Starting controller...
12:25:05  start: Redirecting Karaf output to /tmp/karaf-0.21.2/data/log/karaf_console.log
12:25:05  Starting member-3 with IP address 10.30.170.124
12:25:05  Warning: Permanently added '10.30.170.124' (ECDSA) to the list of known hosts.
12:25:05  Warning: Permanently added '10.30.170.124' (ECDSA) to the list of known hosts.
12:25:05  Redirecting karaf console output to karaf_console.log
12:25:05  Starting controller...
12:25:05  start: Redirecting Karaf output to /tmp/karaf-0.21.2/data/log/karaf_console.log
12:25:05  [openflowplugin-csit-3node-clustering-only-scandium] $ /bin/bash /tmp/jenkins7773794027546613906.sh
12:25:05  common-functions.sh is being sourced
12:25:05  common-functions environment:
12:25:05  MAVENCONF: /tmp/karaf-0.21.2/etc/org.ops4j.pax.url.mvn.cfg
12:25:05  ACTUALFEATURES: 
12:25:05  FEATURESCONF: /tmp/karaf-0.21.2/etc/org.apache.karaf.features.cfg
12:25:05  CUSTOMPROP: /tmp/karaf-0.21.2/etc/custom.properties
12:25:05  LOGCONF: /tmp/karaf-0.21.2/etc/org.ops4j.pax.logging.cfg
12:25:05  MEMCONF: /tmp/karaf-0.21.2/bin/setenv
12:25:05  CONTROLLERMEM: 2048m
12:25:05  AKKACONF: /tmp/karaf-0.21.2/configuration/initial/akka.conf
12:25:05  MODULESCONF: /tmp/karaf-0.21.2/configuration/initial/modules.conf
12:25:05  MODULESHARDSCONF: /tmp/karaf-0.21.2/configuration/initial/module-shards.conf
12:25:05  SUITES: 
12:25:05  
12:25:05  + echo '#################################################'
12:25:05  #################################################
12:25:05  + echo '##         Verify Cluster is UP                ##'
12:25:05  ##         Verify Cluster is UP                ##
12:25:05  + echo '#################################################'
12:25:05  #################################################
12:25:05  + create_post_startup_script
12:25:05  + cat
12:25:05  + copy_and_run_post_startup_script
12:25:05  + seed_index=1
12:25:05  ++ seq 1 3
12:25:05  + for i in $(seq 1 "${NUM_ODL_SYSTEM}")
12:25:05  + CONTROLLERIP=ODL_SYSTEM_1_IP
12:25:05  + echo 'Execute the post startup script on controller 10.30.170.110'
12:25:05  Execute the post startup script on controller 10.30.170.110
12:25:05  + scp /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/post-startup-script.sh 10.30.170.110:/tmp/
12:25:05  Warning: Permanently added '10.30.170.110' (ECDSA) to the list of known hosts.
12:25:05  + ssh 10.30.170.110 'bash /tmp/post-startup-script.sh 1'
12:25:06  Warning: Permanently added '10.30.170.110' (ECDSA) to the list of known hosts.
12:25:06  /tmp/post-startup-script.sh: line 4: netstat: command not found
12:25:11  /tmp/post-startup-script.sh: line 4: netstat: command not found
12:25:16  /tmp/post-startup-script.sh: line 4: netstat: command not found
12:25:21  /tmp/post-startup-script.sh: line 4: netstat: command not found
12:25:26  /tmp/post-startup-script.sh: line 4: netstat: command not found
12:25:31  /tmp/post-startup-script.sh: line 4: netstat: command not found
12:25:36  /tmp/post-startup-script.sh: line 4: netstat: command not found
12:25:41  /tmp/post-startup-script.sh: line 4: netstat: command not found
12:25:46  /tmp/post-startup-script.sh: line 4: netstat: command not found
12:25:51  /tmp/post-startup-script.sh: line 4: netstat: command not found
12:25:56  /tmp/post-startup-script.sh: line 4: netstat: command not found
12:26:01  /tmp/post-startup-script.sh: line 4: netstat: command not found
12:26:06  Waiting up to 3 minutes for controller to come up, checking every 5 seconds...
12:26:11  2025-03-10T12:25:33,117 | INFO  | SystemReadyService-0 | SimpleSystemReadyMonitor         | 197 - org.opendaylight.infrautils.ready-api - 7.1.2 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
12:26:11  Controller is UP
12:26:11  2025-03-10T12:25:33,117 | INFO  | SystemReadyService-0 | SimpleSystemReadyMonitor         | 197 - org.opendaylight.infrautils.ready-api - 7.1.2 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
12:26:11  Listing all open ports on controller system...
12:26:11  /tmp/post-startup-script.sh: line 51: netstat: command not found
12:26:11  looking for "BindException: Address already in use" in log file
12:26:11  looking for "server is unhealthy" in log file
12:26:11  + '[' 1 == 0 ']'
12:26:11  + for i in $(seq 1 "${NUM_ODL_SYSTEM}")
12:26:11  + CONTROLLERIP=ODL_SYSTEM_2_IP
12:26:11  + echo 'Execute the post startup script on controller 10.30.171.121'
12:26:11  Execute the post startup script on controller 10.30.171.121
12:26:11  + scp /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/post-startup-script.sh 10.30.171.121:/tmp/
12:26:11  Warning: Permanently added '10.30.171.121' (ECDSA) to the list of known hosts.
12:26:12  + ssh 10.30.171.121 'bash /tmp/post-startup-script.sh 2'
12:26:12  Warning: Permanently added '10.30.171.121' (ECDSA) to the list of known hosts.
12:26:12  /tmp/post-startup-script.sh: line 4: netstat: command not found
12:26:17  /tmp/post-startup-script.sh: line 4: netstat: command not found
12:26:22  /tmp/post-startup-script.sh: line 4: netstat: command not found
12:26:27  /tmp/post-startup-script.sh: line 4: netstat: command not found
12:26:32  /tmp/post-startup-script.sh: line 4: netstat: command not found
12:26:37  /tmp/post-startup-script.sh: line 4: netstat: command not found
12:26:42  /tmp/post-startup-script.sh: line 4: netstat: command not found
12:26:47  /tmp/post-startup-script.sh: line 4: netstat: command not found
12:26:52  /tmp/post-startup-script.sh: line 4: netstat: command not found
12:26:57  /tmp/post-startup-script.sh: line 4: netstat: command not found
12:27:02  /tmp/post-startup-script.sh: line 4: netstat: command not found
12:27:07  /tmp/post-startup-script.sh: line 4: netstat: command not found
12:27:12  Waiting up to 3 minutes for controller to come up, checking every 5 seconds...
12:27:17  2025-03-10T12:25:36,156 | INFO  | SystemReadyService-0 | SimpleSystemReadyMonitor         | 197 - org.opendaylight.infrautils.ready-api - 7.1.2 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
12:27:17  Controller is UP
12:27:17  2025-03-10T12:25:36,156 | INFO  | SystemReadyService-0 | SimpleSystemReadyMonitor         | 197 - org.opendaylight.infrautils.ready-api - 7.1.2 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
12:27:17  Listing all open ports on controller system...
12:27:17  /tmp/post-startup-script.sh: line 51: netstat: command not found
12:27:17  looking for "BindException: Address already in use" in log file
12:27:17  looking for "server is unhealthy" in log file
12:27:17  + '[' 2 == 0 ']'
12:27:17  + for i in $(seq 1 "${NUM_ODL_SYSTEM}")
12:27:17  + CONTROLLERIP=ODL_SYSTEM_3_IP
12:27:17  + echo 'Execute the post startup script on controller 10.30.170.124'
12:27:17  Execute the post startup script on controller 10.30.170.124
12:27:17  + scp /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/post-startup-script.sh 10.30.170.124:/tmp/
12:27:17  Warning: Permanently added '10.30.170.124' (ECDSA) to the list of known hosts.
12:27:17  + ssh 10.30.170.124 'bash /tmp/post-startup-script.sh 3'
12:27:17  Warning: Permanently added '10.30.170.124' (ECDSA) to the list of known hosts.
12:27:17  /tmp/post-startup-script.sh: line 4: netstat: command not found
12:27:22  /tmp/post-startup-script.sh: line 4: netstat: command not found
12:27:27  /tmp/post-startup-script.sh: line 4: netstat: command not found
12:27:32  /tmp/post-startup-script.sh: line 4: netstat: command not found
12:27:37  /tmp/post-startup-script.sh: line 4: netstat: command not found
12:27:42  /tmp/post-startup-script.sh: line 4: netstat: command not found
12:27:47  /tmp/post-startup-script.sh: line 4: netstat: command not found
12:27:52  /tmp/post-startup-script.sh: line 4: netstat: command not found
12:27:57  /tmp/post-startup-script.sh: line 4: netstat: command not found
12:28:02  /tmp/post-startup-script.sh: line 4: netstat: command not found
12:28:07  /tmp/post-startup-script.sh: line 4: netstat: command not found
12:28:12  /tmp/post-startup-script.sh: line 4: netstat: command not found
12:28:17  Waiting up to 3 minutes for controller to come up, checking every 5 seconds...
12:28:22  2025-03-10T12:25:34,323 | INFO  | SystemReadyService-0 | SimpleSystemReadyMonitor         | 197 - org.opendaylight.infrautils.ready-api - 7.1.2 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
12:28:22  Controller is UP
12:28:23  2025-03-10T12:25:34,323 | INFO  | SystemReadyService-0 | SimpleSystemReadyMonitor         | 197 - org.opendaylight.infrautils.ready-api - 7.1.2 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
12:28:23  Listing all open ports on controller system...
12:28:23  /tmp/post-startup-script.sh: line 51: netstat: command not found
12:28:23  looking for "BindException: Address already in use" in log file
12:28:23  looking for "server is unhealthy" in log file
12:28:23  + '[' 0 == 0 ']'
12:28:23  + seed_index=1
12:28:23  + dump_controller_threads
12:28:23  ++ seq 1 3
12:28:23  + for i in $(seq 1 "${NUM_ODL_SYSTEM}")
12:28:23  + CONTROLLERIP=ODL_SYSTEM_1_IP
12:28:23  + echo 'Let'\''s take the karaf thread dump'
12:28:23  Let's take the karaf thread dump
12:28:23  + ssh 10.30.170.110 'sudo ps aux'
12:28:23  Warning: Permanently added '10.30.170.110' (ECDSA) to the list of known hosts.
12:28:23  ++ grep org.apache.karaf.main.Main /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/ps_before.log
12:28:23  ++ tr -s ' '
12:28:23  ++ cut -f2 '-d '
12:28:23  ++ grep -v grep
12:28:23  + pid=28848
12:28:23  + echo 'karaf main: org.apache.karaf.main.Main, pid:28848'
12:28:23  karaf main: org.apache.karaf.main.Main, pid:28848
12:28:23  + ssh 10.30.170.110 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 28848'
12:28:23  Warning: Permanently added '10.30.170.110' (ECDSA) to the list of known hosts.
12:28:24  + for i in $(seq 1 "${NUM_ODL_SYSTEM}")
12:28:24  + CONTROLLERIP=ODL_SYSTEM_2_IP
12:28:24  + echo 'Let'\''s take the karaf thread dump'
12:28:24  Let's take the karaf thread dump
12:28:24  + ssh 10.30.171.121 'sudo ps aux'
12:28:24  Warning: Permanently added '10.30.171.121' (ECDSA) to the list of known hosts.
12:28:24  ++ grep org.apache.karaf.main.Main /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/ps_before.log
12:28:24  ++ grep -v grep
12:28:24  ++ cut -f2 '-d '
12:28:24  ++ tr -s ' '
12:28:24  + pid=28880
12:28:24  + echo 'karaf main: org.apache.karaf.main.Main, pid:28880'
12:28:24  karaf main: org.apache.karaf.main.Main, pid:28880
12:28:24  + ssh 10.30.171.121 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 28880'
12:28:24  Warning: Permanently added '10.30.171.121' (ECDSA) to the list of known hosts.
12:28:25  + for i in $(seq 1 "${NUM_ODL_SYSTEM}")
12:28:25  + CONTROLLERIP=ODL_SYSTEM_3_IP
12:28:25  + echo 'Let'\''s take the karaf thread dump'
12:28:25  Let's take the karaf thread dump
12:28:25  + ssh 10.30.170.124 'sudo ps aux'
12:28:25  Warning: Permanently added '10.30.170.124' (ECDSA) to the list of known hosts.
12:28:25  ++ grep org.apache.karaf.main.Main /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/ps_before.log
12:28:25  ++ grep -v grep
12:28:25  ++ cut -f2 '-d '
12:28:25  ++ tr -s ' '
12:28:25  + pid=28861
12:28:25  + echo 'karaf main: org.apache.karaf.main.Main, pid:28861'
12:28:25  karaf main: org.apache.karaf.main.Main, pid:28861
12:28:25  + ssh 10.30.170.124 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 28861'
12:28:25  Warning: Permanently added '10.30.170.124' (ECDSA) to the list of known hosts.
12:28:26  + '[' 0 -gt 0 ']'
12:28:26  + echo 'Generating controller variables...'
12:28:26  Generating controller variables...
12:28:26  ++ seq 1 3
12:28:26  + for i in $(seq 1 "${NUM_ODL_SYSTEM}")
12:28:26  + CONTROLLERIP=ODL_SYSTEM_1_IP
12:28:26  + odl_variables=' -v ODL_SYSTEM_1_IP:10.30.170.110'
12:28:26  + for i in $(seq 1 "${NUM_ODL_SYSTEM}")
12:28:26  + CONTROLLERIP=ODL_SYSTEM_2_IP
12:28:26  + odl_variables=' -v ODL_SYSTEM_1_IP:10.30.170.110 -v ODL_SYSTEM_2_IP:10.30.171.121'
12:28:26  + for i in $(seq 1 "${NUM_ODL_SYSTEM}")
12:28:26  + CONTROLLERIP=ODL_SYSTEM_3_IP
12:28:26  + odl_variables=' -v ODL_SYSTEM_1_IP:10.30.170.110 -v ODL_SYSTEM_2_IP:10.30.171.121 -v ODL_SYSTEM_3_IP:10.30.170.124'
12:28:26  + echo 'Generating mininet variables...'
12:28:26  Generating mininet variables...
12:28:26  ++ seq 1 1
12:28:26  + for i in $(seq 1 "${NUM_TOOLS_SYSTEM}")
12:28:26  + MININETIP=TOOLS_SYSTEM_1_IP
12:28:26  + tools_variables=' -v TOOLS_SYSTEM_1_IP:10.30.171.226'
12:28:26  + get_test_suites SUITES
12:28:26  + local __suite_list=SUITES
12:28:26  + echo 'Locating test plan to use...'
12:28:26  Locating test plan to use...
12:28:26  + testplan_filepath=/w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test/csit/testplans/openflowplugin-clustering-scandium.txt
12:28:26  + '[' '!' -f /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test/csit/testplans/openflowplugin-clustering-scandium.txt ']'
12:28:26  + testplan_filepath=/w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test/csit/testplans/openflowplugin-clustering.txt
12:28:26  + '[' disabled '!=' disabled ']'
12:28:26  + echo 'Changing the testplan path...'
12:28:26  Changing the testplan path...
12:28:26  + sed s:integration:/w/workspace/openflowplugin-csit-3node-clustering-only-scandium: /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test/csit/testplans/openflowplugin-clustering.txt
12:28:26  + cat testplan.txt
12:28:26  # Place the suites in run order:
12:28:26  /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test/csit/suites/openflowplugin/Clustering/010__Cluster_HA_Owner_Failover.robot
12:28:26  /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test/csit/suites/openflowplugin/Clustering/020__Cluster_HA_Owner_Restart.robot
12:28:26  /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test/csit/suites/openflowplugin/Clustering/030__Cluster_HA_Data_Recovery_Leader_Follower_Failover.robot
12:28:26  /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test/csit/suites/openflowplugin/Clustered_Reconciliation/010_Group_Flows.robot
12:28:26  /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test/csit/suites/openflowplugin/EntityOwnership/010_Switch_Disconnect.robot
12:28:26  /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test/csit/suites/openflowplugin/EntityOwnership/020_Cluster_Node_Failure.robot
12:28:26  /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test/csit/suites/openflowplugin/EntityOwnership/030_Cluster_Sync_Problems.robot
12:28:26  /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test/csit/suites/openflowplugin/Bug_Validation/9145.robot
12:28:26  + '[' -z '' ']'
12:28:26  ++ grep -E -v '(^[[:space:]]*#|^[[:space:]]*$)' testplan.txt
12:28:26  ++ tr '\012' ' '
12:28:26  + suite_list='/w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test/csit/suites/openflowplugin/Clustering/010__Cluster_HA_Owner_Failover.robot /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test/csit/suites/openflowplugin/Clustering/020__Cluster_HA_Owner_Restart.robot /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test/csit/suites/openflowplugin/Clustering/030__Cluster_HA_Data_Recovery_Leader_Follower_Failover.robot /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test/csit/suites/openflowplugin/Clustered_Reconciliation/010_Group_Flows.robot /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test/csit/suites/openflowplugin/EntityOwnership/010_Switch_Disconnect.robot /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test/csit/suites/openflowplugin/EntityOwnership/020_Cluster_Node_Failure.robot /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test/csit/suites/openflowplugin/EntityOwnership/030_Cluster_Sync_Problems.robot /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test/csit/suites/openflowplugin/Bug_Validation/9145.robot '
12:28:26  + eval 'SUITES='\''/w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test/csit/suites/openflowplugin/Clustering/010__Cluster_HA_Owner_Failover.robot /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test/csit/suites/openflowplugin/Clustering/020__Cluster_HA_Owner_Restart.robot /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test/csit/suites/openflowplugin/Clustering/030__Cluster_HA_Data_Recovery_Leader_Follower_Failover.robot /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test/csit/suites/openflowplugin/Clustered_Reconciliation/010_Group_Flows.robot /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test/csit/suites/openflowplugin/EntityOwnership/010_Switch_Disconnect.robot /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test/csit/suites/openflowplugin/EntityOwnership/020_Cluster_Node_Failure.robot /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test/csit/suites/openflowplugin/EntityOwnership/030_Cluster_Sync_Problems.robot /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test/csit/suites/openflowplugin/Bug_Validation/9145.robot '\'''
12:28:26  ++ SUITES='/w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test/csit/suites/openflowplugin/Clustering/010__Cluster_HA_Owner_Failover.robot /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test/csit/suites/openflowplugin/Clustering/020__Cluster_HA_Owner_Restart.robot /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test/csit/suites/openflowplugin/Clustering/030__Cluster_HA_Data_Recovery_Leader_Follower_Failover.robot /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test/csit/suites/openflowplugin/Clustered_Reconciliation/010_Group_Flows.robot /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test/csit/suites/openflowplugin/EntityOwnership/010_Switch_Disconnect.robot /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test/csit/suites/openflowplugin/EntityOwnership/020_Cluster_Node_Failure.robot /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test/csit/suites/openflowplugin/EntityOwnership/030_Cluster_Sync_Problems.robot /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test/csit/suites/openflowplugin/Bug_Validation/9145.robot '
12:28:26  + echo 'Starting Robot test suites /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test/csit/suites/openflowplugin/Clustering/010__Cluster_HA_Owner_Failover.robot /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test/csit/suites/openflowplugin/Clustering/020__Cluster_HA_Owner_Restart.robot /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test/csit/suites/openflowplugin/Clustering/030__Cluster_HA_Data_Recovery_Leader_Follower_Failover.robot /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test/csit/suites/openflowplugin/Clustered_Reconciliation/010_Group_Flows.robot /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test/csit/suites/openflowplugin/EntityOwnership/010_Switch_Disconnect.robot /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test/csit/suites/openflowplugin/EntityOwnership/020_Cluster_Node_Failure.robot /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test/csit/suites/openflowplugin/EntityOwnership/030_Cluster_Sync_Problems.robot /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test/csit/suites/openflowplugin/Bug_Validation/9145.robot  ...'
12:28:26  Starting Robot test suites /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test/csit/suites/openflowplugin/Clustering/010__Cluster_HA_Owner_Failover.robot /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test/csit/suites/openflowplugin/Clustering/020__Cluster_HA_Owner_Restart.robot /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test/csit/suites/openflowplugin/Clustering/030__Cluster_HA_Data_Recovery_Leader_Follower_Failover.robot /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test/csit/suites/openflowplugin/Clustered_Reconciliation/010_Group_Flows.robot /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test/csit/suites/openflowplugin/EntityOwnership/010_Switch_Disconnect.robot /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test/csit/suites/openflowplugin/EntityOwnership/020_Cluster_Node_Failure.robot /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test/csit/suites/openflowplugin/EntityOwnership/030_Cluster_Sync_Problems.robot /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test/csit/suites/openflowplugin/Bug_Validation/9145.robot  ...
12:28:26  + robot -N openflowplugin-clustering.txt --removekeywords wuks -e exclude -e skip_if_scandium -v BUNDLEFOLDER:karaf-0.21.2 -v BUNDLE_URL:https://nexus.opendaylight.org/content/repositories//autorelease-8681/org/opendaylight/integration/karaf/0.21.2/karaf-0.21.2.zip -v CONTROLLER:10.30.170.110 -v CONTROLLER1:10.30.171.121 -v CONTROLLER2:10.30.170.124 -v CONTROLLER_USER:jenkins -v JAVA_HOME:/usr/lib/jvm/java-21-openjdk-amd64 -v JDKVERSION:openjdk21 -v JENKINS_WORKSPACE:/w/workspace/openflowplugin-csit-3node-clustering-only-scandium -v MININET:10.30.171.226 -v MININET1: -v MININET2: -v MININET_USER:jenkins -v NEXUSURL_PREFIX:https://nexus.opendaylight.org -v NUM_ODL_SYSTEM:3 -v NUM_TOOLS_SYSTEM:1 -v ODL_STREAM:scandium -v ODL_SYSTEM_IP:10.30.170.110 -v ODL_SYSTEM_1_IP:10.30.170.110 -v ODL_SYSTEM_2_IP:10.30.171.121 -v ODL_SYSTEM_3_IP:10.30.170.124 -v ODL_SYSTEM_USER:jenkins -v TOOLS_SYSTEM_IP:10.30.171.226 -v TOOLS_SYSTEM_1_IP:10.30.171.226 -v TOOLS_SYSTEM_USER:jenkins -v USER_HOME:/home/jenkins -v IS_KARAF_APPL:True -v WORKSPACE:/tmp -v ODL_OF_PLUGIN:lithium /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test/csit/suites/openflowplugin/Clustering/010__Cluster_HA_Owner_Failover.robot /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test/csit/suites/openflowplugin/Clustering/020__Cluster_HA_Owner_Restart.robot /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test/csit/suites/openflowplugin/Clustering/030__Cluster_HA_Data_Recovery_Leader_Follower_Failover.robot /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test/csit/suites/openflowplugin/Clustered_Reconciliation/010_Group_Flows.robot /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test/csit/suites/openflowplugin/EntityOwnership/010_Switch_Disconnect.robot /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test/csit/suites/openflowplugin/EntityOwnership/020_Cluster_Node_Failure.robot /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test/csit/suites/openflowplugin/EntityOwnership/030_Cluster_Sync_Problems.robot /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test/csit/suites/openflowplugin/Bug_Validation/9145.robot
12:28:26  ==============================================================================
12:28:26  openflowplugin-clustering.txt                                                 
12:28:26  ==============================================================================
12:28:27  openflowplugin-clustering.txt.Cluster HA Owner Failover :: Test suite for C...
12:28:27  ==============================================================================
12:28:32  Check Shards Status Before Fail :: Check Status for all shards in ... | PASS |
12:28:40  ------------------------------------------------------------------------------
12:28:40  Start Mininet Multiple Connections :: Start mininet tree,2 with co... | PASS |
12:28:49  ------------------------------------------------------------------------------
12:28:49  Check Entity Owner Status And Find Owner and Successor Before Fail... | PASS |
12:28:49  ------------------------------------------------------------------------------
12:28:49  Reconnect Extra Switches To Successors And Check OVS Connections :... | PASS |
12:28:53  ------------------------------------------------------------------------------
12:28:53  Check Network Operational Information Before Fail :: Check devices... | PASS |
12:28:54  ------------------------------------------------------------------------------
12:28:54  Add Configuration In Owner and Verify Before Fail :: Add Flow in O... | PASS |
12:28:57  ------------------------------------------------------------------------------
12:28:57  Modify Configuration In Owner and Verify Before Fail :: Modify Flo... | PASS |
12:29:00  ------------------------------------------------------------------------------
12:29:00  Delete Configuration In Owner and Verify Before Fail :: Delete Flo... | PASS |
12:29:03  ------------------------------------------------------------------------------
12:29:03  Add Configuration In Successor and Verify Before Fail :: Add Flow ... | PASS |
12:29:07  ------------------------------------------------------------------------------
12:29:07  Modify Configuration In Successor and Verify Before Fail :: Modify... | PASS |
12:29:09  ------------------------------------------------------------------------------
12:29:09  Delete Configuration In Successor and Verify Before Fail :: Delete... | PASS |
12:29:13  ------------------------------------------------------------------------------
12:29:13  Send RPC Add to Owner and Verify Before Fail :: Add Flow in Owner ... | PASS |
12:29:16  ------------------------------------------------------------------------------
12:29:16  Send RPC Delete to Owner and Verify Before Fail :: Delete Flow in ... | PASS |
12:29:18  ------------------------------------------------------------------------------
12:29:18  Send RPC Add to Successor and Verify Before Fail :: Add Flow in Su... | PASS |
12:29:22  ------------------------------------------------------------------------------
12:29:22  Send RPC Delete to Successor and Verify Before Fail :: Delete Flow... | PASS |
12:29:24  ------------------------------------------------------------------------------
12:29:24  Modify Network And Verify Before Fail :: Take a link down and veri... | PASS |
12:29:25  ------------------------------------------------------------------------------
12:29:25  Restore Network And Verify Before Fail :: Take the link up and ver... | PASS |
12:29:30  ------------------------------------------------------------------------------
12:29:30  Kill Owner Instance :: Kill Owner Instance and verify it is dead      <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:29:30  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:29:30  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:29:31  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:29:31  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:29:32  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:29:32  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:29:33  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:29:33  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:29:33  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:29:33  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:29:34  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:29:34  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:29:34  | PASS |
12:29:34  ------------------------------------------------------------------------------
12:29:34  Check Shards Status After Fail :: Create original cluster list and... | PASS |
12:29:55  ------------------------------------------------------------------------------
12:29:55  Check Entity Owner Status And Find Owner and Successor After Fail ... | PASS |
12:29:55  ------------------------------------------------------------------------------
12:29:55  Check Network Operational Information After Fail :: Check devices ... | PASS |
12:29:55  ------------------------------------------------------------------------------
12:29:55  Add Configuration In Owner and Verify After Fail :: Add Flow in Ow... | PASS |
12:29:58  ------------------------------------------------------------------------------
12:29:58  Modify Configuration In Owner and Verify After Fail :: Modify Flow... | PASS |
12:30:00  ------------------------------------------------------------------------------
12:30:00  Delete Configuration In Owner and Verify After Fail :: Delete Flow... | PASS |
12:30:04  ------------------------------------------------------------------------------
12:30:04  Add Configuration In Successor and Verify After Fail :: Add Flow i... | PASS |
12:30:09  ------------------------------------------------------------------------------
12:30:09  Modify Configuration In Successor and Verify After Fail :: Modify ... | PASS |
12:30:10  ------------------------------------------------------------------------------
12:30:10  Delete Configuration In Successor and Verify After Fail :: Delete ... | PASS |
12:30:13  ------------------------------------------------------------------------------
12:30:13  Send RPC Add to Owner and Verify After Fail :: Add Flow in Owner a... | PASS |
12:30:15  ------------------------------------------------------------------------------
12:30:15  Send RPC Delete to Owner and Verify After Fail :: Delete Flow in O... | PASS |
12:30:21  ------------------------------------------------------------------------------
12:30:21  Send RPC Add to Successor and Verify After Fail :: Add Flow in Suc... | PASS |
12:30:21  ------------------------------------------------------------------------------
12:30:21  Send RPC Delete to Successor and Verify After Fail :: Delete Flow ... | PASS |
12:30:25  ------------------------------------------------------------------------------
12:30:25  Modify Network and Verify After Fail :: Take a link down and verif... | PASS |
12:30:25  ------------------------------------------------------------------------------
12:30:25  Restore Network and Verify After Fail :: Take the link up and veri... | PASS |
12:30:31  ------------------------------------------------------------------------------
12:30:31  Start Old Owner Instance :: Start old Owner Instance and verify it... <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:30:41  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:30:41  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:30:41  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:30:42  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:30:42  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:31:04  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:31:04  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:31:05  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:31:05  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:31:05  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:31:05  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:31:05  | PASS |
12:31:05  ------------------------------------------------------------------------------
12:31:05  Check Shards Status After Recover :: Create original cluster list ... | PASS |
12:31:09  ------------------------------------------------------------------------------
12:31:09  Check Entity Owner Status After Recover :: Check Entity Owner Stat... | PASS |
12:31:09  ------------------------------------------------------------------------------
12:31:09  Check Network Operational Information After Recover :: Check devic... | PASS |
12:31:09  ------------------------------------------------------------------------------
12:31:09  Add Configuration In Owner and Verify After Recover :: Add Flow in... | PASS |
12:31:11  ------------------------------------------------------------------------------
12:31:11  Modify Configuration In Owner and Verify After Recover :: Modify F... | PASS |
12:31:13  ------------------------------------------------------------------------------
12:31:13  Delete Configuration In Owner and Verify After Recover :: Delete F... | PASS |
12:31:17  ------------------------------------------------------------------------------
12:31:17  Add Configuration In Old Owner and Verify After Recover :: Add Flo... | PASS |
12:31:19  ------------------------------------------------------------------------------
12:31:19  Modify Configuration In Old Owner and Verify After Recover :: Modi... | PASS |
12:31:23  ------------------------------------------------------------------------------
12:31:23  Delete Configuration In Old Owner and Verify After Recover :: Dele... | PASS |
12:31:26  ------------------------------------------------------------------------------
12:31:26  Send RPC Add to Owner and Verify After Recover :: Add Flow in Owne... | PASS |
12:31:29  ------------------------------------------------------------------------------
12:31:29  Send RPC Delete to Owner and Verify After Recover :: Delete Flow i... | PASS |
12:31:32  ------------------------------------------------------------------------------
12:31:32  Send RPC Add to Old Owner and Verify After Recover :: Add Flow in ... | PASS |
12:31:34  ------------------------------------------------------------------------------
12:31:34  Send RPC Delete to Old Owner and Verify After Recover :: Delete Fl... | PASS |
12:31:38  ------------------------------------------------------------------------------
12:31:38  Modify Network and Verify After Recover :: Take a link down and ve... | PASS |
12:31:38  ------------------------------------------------------------------------------
12:31:38  Restore Network and Verify After Recover :: Take the link up and v... | PASS |
12:31:41  ------------------------------------------------------------------------------
12:31:41  Stop Mininet and Exit :: Stop mininet and exit connection.            | PASS |
12:31:43  ------------------------------------------------------------------------------
12:31:43  Check No Network Operational Information :: Check device is not in... | PASS |
12:31:44  ------------------------------------------------------------------------------
12:31:44  openflowplugin-clustering.txt.Cluster HA Owner Failover :: Test su... | PASS |
12:31:44  51 tests, 51 passed, 0 failed
12:31:44  ==============================================================================
12:31:44  openflowplugin-clustering.txt.Cluster HA Owner Restart :: Test suite for Cl...
12:31:44  ==============================================================================
12:31:47  Check Shards Status Before Stop :: Check Status for all shards in ... | PASS |
12:31:51  ------------------------------------------------------------------------------
12:31:51  Start Mininet Multiple Connections :: Start mininet tree,2 with co... | PASS |
12:31:59  ------------------------------------------------------------------------------
12:31:59  Check Entity Owner Status And Find Owner and Successor Before Stop... | PASS |
12:32:00  ------------------------------------------------------------------------------
12:32:00  Reconnect Extra Switches To Successors And Check OVS Connections :... | PASS |
12:32:05  ------------------------------------------------------------------------------
12:32:05  Check Network Operational Information Before Stop :: Check devices... | PASS |
12:32:05  ------------------------------------------------------------------------------
12:32:05  Add Configuration In Owner and Verify Before Stop :: Add Flow in O... | PASS |
12:32:08  ------------------------------------------------------------------------------
12:32:08  Modify Configuration In Owner and Verify Before Stop :: Modify Flo... | PASS |
12:32:11  ------------------------------------------------------------------------------
12:32:11  Delete Configuration In Owner and Verify Before Stop :: Delete Flo... | PASS |
12:32:13  ------------------------------------------------------------------------------
12:32:13  Add Configuration In Successor and Verify Before Stop :: Add Flow ... | PASS |
12:32:17  ------------------------------------------------------------------------------
12:32:17  Modify Configuration In Successor and Verify Before Stop :: Modify... | PASS |
12:32:19  ------------------------------------------------------------------------------
12:32:19  Delete Configuration In Successor and Verify Before Stop :: Delete... | PASS |
12:32:23  ------------------------------------------------------------------------------
12:32:23  Send RPC Add to Owner and Verify Before Stop :: Add Flow in Owner ... | PASS |
12:32:25  ------------------------------------------------------------------------------
12:32:25  Send RPC Delete to Owner and Verify Before Stop :: Delete Flow in ... | PASS |
12:32:29  ------------------------------------------------------------------------------
12:32:29  Send RPC Add to Successor and Verify Before Stop :: Add Flow in Su... | PASS |
12:32:32  ------------------------------------------------------------------------------
12:32:32  Send RPC Delete to Successor and Verify Before Stop :: Delete Flow... | PASS |
12:32:34  ------------------------------------------------------------------------------
12:32:34  Modify Network And Verify Before Stop :: Take a link down and veri... | PASS |
12:32:35  ------------------------------------------------------------------------------
12:32:35  Restore Network And Verify Before Stop :: Take the link up and ver... | PASS |
12:32:38  ------------------------------------------------------------------------------
12:32:38  Stop Owner Instance :: Stop Owner Instance and verify it is dead      <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:32:38  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:32:38  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:32:39  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:32:39  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:32:40  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:32:40  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:32:42  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:32:42  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:32:45  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:32:45  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:32:46  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:32:46  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:32:46  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:32:46  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:32:47  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:32:47  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:32:48  | PASS |
12:32:48  ------------------------------------------------------------------------------
12:32:48  Check Shards Status After Stop :: Create original cluster list and... | PASS |
12:32:49  ------------------------------------------------------------------------------
12:32:49  Check Entity Owner Status And Find Owner and Successor After Stop ... | PASS |
12:32:49  ------------------------------------------------------------------------------
12:32:49  Check Network Operational Information After Stop :: Check devices ... | PASS |
12:32:49  ------------------------------------------------------------------------------
12:32:49  Add Configuration In Owner and Verify After Stop :: Add Flow in Ow... | PASS |
12:32:53  ------------------------------------------------------------------------------
12:32:53  Modify Configuration In Owner and Verify After Stop :: Modify Flow... | PASS |
12:32:55  ------------------------------------------------------------------------------
12:32:55  Delete Configuration In Owner and Verify After Stop :: Delete Flow... | PASS |
12:32:59  ------------------------------------------------------------------------------
12:32:59  Add Configuration In Successor and Verify After Stop :: Add Flow i... | PASS |
12:33:02  ------------------------------------------------------------------------------
12:33:02  Modify Configuration In Successor and Verify After Stop :: Modify ... | PASS |
12:33:04  ------------------------------------------------------------------------------
12:33:04  Delete Configuration In Successor and Verify After Stop :: Delete ... | PASS |
12:33:08  ------------------------------------------------------------------------------
12:33:08  Send RPC Add to Owner and Verify After Stop :: Add Flow in Owner a... | PASS |
12:33:10  ------------------------------------------------------------------------------
12:33:10  Send RPC Delete to Owner and Verify After Stop :: Delete Flow in O... | PASS |
12:33:14  ------------------------------------------------------------------------------
12:33:14  Send RPC Add to Successor and Verify After Stop :: Add Flow in Suc... | PASS |
12:33:16  ------------------------------------------------------------------------------
12:33:16  Send RPC Delete to Successor and Verify After Stop :: Delete Flow ... | PASS |
12:33:20  ------------------------------------------------------------------------------
12:33:20  Modify Network and Verify After Stop :: Take a link down and verif... | PASS |
12:33:20  ------------------------------------------------------------------------------
12:33:20  Restore Network and Verify After Stop :: Take the link up and veri... | PASS |
12:33:24  ------------------------------------------------------------------------------
12:33:24  Start Old Owner Instance :: Start old Owner Instance and verify it... <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:33:24  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:33:34  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:33:34  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:33:34  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:33:34  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:33:56  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:33:56  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:33:57  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:33:57  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:33:58  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:33:58  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:33:58  | PASS |
12:33:58  ------------------------------------------------------------------------------
12:33:58  Check Shards Status After Start :: Create original cluster list an... | PASS |
12:34:01  ------------------------------------------------------------------------------
12:34:01  Check Entity Owner Status After Start :: Check Entity Owner Status... | PASS |
12:34:01  ------------------------------------------------------------------------------
12:34:01  Check Network Operational Information After Start :: Check devices... | PASS |
12:34:02  ------------------------------------------------------------------------------
12:34:02  Add Configuration In Owner and Verify After Start :: Add Flow in O... | PASS |
12:34:05  ------------------------------------------------------------------------------
12:34:05  Modify Configuration In Owner and Verify After Start :: Modify Flo... | PASS |
12:34:09  ------------------------------------------------------------------------------
12:34:09  Delete Configuration In Owner and Verify After Start :: Delete Flo... | PASS |
12:34:11  ------------------------------------------------------------------------------
12:34:11  Add Configuration In Old Owner and Verify After Start :: Add Flow ... | PASS |
12:34:15  ------------------------------------------------------------------------------
12:34:15  Modify Configuration In Old Owner and Verify After Start :: Modify... | PASS |
12:34:17  ------------------------------------------------------------------------------
12:34:17  Delete Configuration In Old Owner and Verify After Start :: Delete... | PASS |
12:34:21  ------------------------------------------------------------------------------
12:34:21  Send RPC Add to Owner and Verify After Start :: Add Flow in Owner ... | PASS |
12:34:23  ------------------------------------------------------------------------------
12:34:23  Send RPC Delete to Owner and Verify After Start :: Delete Flow in ... | PASS |
12:34:27  ------------------------------------------------------------------------------
12:34:27  Send RPC Add to Old Owner and Verify After Start :: Add Flow in Ow... | PASS |
12:34:30  ------------------------------------------------------------------------------
12:34:30  Send RPC Delete to Old Owner and Verify After Start :: Delete Flow... | PASS |
12:34:32  ------------------------------------------------------------------------------
12:34:32  Modify Network and Verify After Start :: Take a link down and veri... | PASS |
12:34:32  ------------------------------------------------------------------------------
12:34:32  Restore Network and Verify After Start :: Take the link up and ver... | PASS |
12:34:33  ------------------------------------------------------------------------------
12:34:33  Stop Mininet and Exit :: Stop mininet and exit connection.            | PASS |
12:34:35  ------------------------------------------------------------------------------
12:34:35  Check No Network Operational Information :: Check device is not in... | PASS |
12:34:35  ------------------------------------------------------------------------------
12:34:35  openflowplugin-clustering.txt.Cluster HA Owner Restart :: Test sui... | PASS |
12:34:35  51 tests, 51 passed, 0 failed
12:34:35  ==============================================================================
12:34:35  openflowplugin-clustering.txt.Cluster HA Data Recovery Leader Follower Fail...
12:34:35  ==============================================================================
12:34:38  Check Shards Status Before Leader Restart :: Check Status for all ... | PASS |
12:34:43  ------------------------------------------------------------------------------
12:34:43  Get inventory Leader Before Leader Restart :: Find leader in the i... | PASS |
12:34:44  ------------------------------------------------------------------------------
12:34:44  Start Mininet Connect To Follower Node1 :: Start mininet with conn... | PASS |
12:34:48  ------------------------------------------------------------------------------
12:34:48  Add Flows In Follower Node2 and Verify Before Leader Restart :: Ad... <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:34:48  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:34:49  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:34:51  | PASS |
12:34:51  ------------------------------------------------------------------------------
12:34:51  Stop Mininet Connected To Follower Node1 and Exit :: Stop mininet ... <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:34:51  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:34:52  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:34:54  | PASS |
12:34:54  ------------------------------------------------------------------------------
12:34:54  Restart Leader From Cluster Node :: Stop Leader Node and Start it ... | PASS |
12:35:36  ------------------------------------------------------------------------------
12:35:36  Get inventory Follower After Leader Restart :: Find new Followers ... | PASS |
12:35:38  ------------------------------------------------------------------------------
12:35:38  Start Mininet Connect To Old Leader :: Start mininet with connecti... | PASS |
12:35:41  ------------------------------------------------------------------------------
12:35:41  Verify Flows In Switch After Leader Restart :: Verify flows are in... <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:35:41  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:35:41  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:35:43  | PASS |
12:35:43  ------------------------------------------------------------------------------
12:35:43  Stop Mininet Connected To Old Leader and Exit :: Stop mininet and ... <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:35:43  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:35:43  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:35:45  | PASS |
12:35:45  ------------------------------------------------------------------------------
12:35:45  Restart Follower Node2 :: Stop Follower Node2 and Start it Up, Ver... | PASS |
12:36:32  ------------------------------------------------------------------------------
12:36:32  Get inventory Follower After Follower Restart :: Find Followers an... | PASS |
12:36:34  ------------------------------------------------------------------------------
12:36:34  Start Mininet Connect To Leader :: Start mininet with connection t... | PASS |
12:36:37  ------------------------------------------------------------------------------
12:36:37  Verify Flows In Switch After Follower Restart :: Verify flows are ... <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:36:37  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:36:37  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:36:38  | PASS |
12:36:38  ------------------------------------------------------------------------------
12:36:38  Stop Mininet Connected To Leader and Exit :: Stop mininet Connecte... <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:36:38  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:36:38  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:36:40  | PASS |
12:36:40  ------------------------------------------------------------------------------
12:36:40  Restart Full Cluster :: Stop all Cluster Nodes and Start it Up All.   | PASS |
12:39:27  ------------------------------------------------------------------------------
12:39:27  Get inventory Status After Cluster Restart :: Find New Followers a... | PASS |
12:40:00  ------------------------------------------------------------------------------
12:40:00  Start Mininet Connect To Follower Node2 After Cluster Restart :: S... | PASS |
12:40:04  ------------------------------------------------------------------------------
12:40:04  Verify Flows In Switch After Cluster Restart :: Verify flows are i... <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:40:04  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:40:04  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:40:05  | PASS |
12:40:05  ------------------------------------------------------------------------------
12:40:05  Delete Flows In Follower Node1 and Verify After Leader Restart :: ... <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:40:06  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:40:06  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:40:08  | PASS |
12:40:08  ------------------------------------------------------------------------------
12:40:08  Stop Mininet Connected To Follower Node2 and Exit After Cluster Re... <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:40:09  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:40:09  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:40:11  | PASS |
12:40:11  ------------------------------------------------------------------------------
12:40:11  openflowplugin-clustering.txt.Cluster HA Data Recovery Leader Foll... | PASS |
12:40:11  21 tests, 21 passed, 0 failed
12:40:11  ==============================================================================
12:40:11  /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/test/csit/libraries/VsctlListParser.py:61: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:40:11    if ctl_ref is not "":
12:40:11  openflowplugin-clustering.txt.010 Group Flows :: Switch connections and clu...
12:40:11  ==============================================================================
12:40:14  Add Groups And Flows :: Add 100 groups 1&2 and flows in every switch. | PASS |
12:40:18  ------------------------------------------------------------------------------
12:40:18  Start Mininet Multiple Connections :: Start mininet linear with co... | PASS |
12:40:26  ------------------------------------------------------------------------------
12:40:26  Check Linear Topology :: Check Linear Topology.                       | PASS |
12:40:27  ------------------------------------------------------------------------------
12:40:27  Check Stats Are Not Frozen :: Check that duration flow stat is inc... | PASS |
12:40:32  ------------------------------------------------------------------------------
12:40:32  Check Flows In Operational DS :: Check Flows in operational DS.       | PASS |
12:40:33  ------------------------------------------------------------------------------
12:40:33  Check Groups In Operational DS :: Check Groups in operational DS.     | PASS |
12:40:33  ------------------------------------------------------------------------------
12:40:33  Check Flows In Switch :: Check Flows in switch.                       | PASS |
12:40:33  ------------------------------------------------------------------------------
12:40:33  Check Entity Owner Status And Find Owner and Successor Before Fail... <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:40:34  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:40:34  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:40:34  | PASS |
12:40:34  ------------------------------------------------------------------------------
12:40:34  Disconnect Mininet From Owner :: Disconnect mininet from the owner    <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:40:34  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:40:34  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:40:34  10.30.170.110
12:40:35  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:40:35  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:40:35  | PASS |
12:40:35  ------------------------------------------------------------------------------
12:40:35  Check Entity Owner Status And Find Owner and Successor After Fail ... <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:40:35  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:40:35  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:40:44  | PASS |
12:40:44  ------------------------------------------------------------------------------
12:40:44  Check Switch Moves To New Master :: Check switch s1 is connected t... <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:40:44  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:40:44  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:40:54  | FAIL |
12:40:54  Keyword 'OvsManager.Should Be Master' failed after retrying for 10 seconds. The last error was: Dictionary does not contain key 's1'.
12:40:54  ------------------------------------------------------------------------------
12:40:54  Check Linear Topology After Disconnect :: Check Linear Topology.      <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:40:55  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:40:55  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:40:55  | PASS |
12:40:55  ------------------------------------------------------------------------------
12:40:55  Check Stats Are Not Frozen After Disconnect :: Check that duration... <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:40:55  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:40:55  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:41:00  | PASS |
12:41:00  ------------------------------------------------------------------------------
12:41:00  Remove Flows And Groups After Mininet Is Disconnected :: Remove 1 ... <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:41:01  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:41:01  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:41:01  | PASS |
12:41:01  ------------------------------------------------------------------------------
12:41:01  Check Flows In Operational DS After Mininet Is Disconnected :: Che... <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:41:01  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:41:01  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:41:03  | PASS |
12:41:03  ------------------------------------------------------------------------------
12:41:03  Check Groups In Operational DS After Mininet Is Disconnected :: Ch... <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:41:04  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:41:04  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:41:04  | PASS |
12:41:04  ------------------------------------------------------------------------------
12:41:04  Check Flows In Switch After Mininet Is Disconnected :: Check Flows... <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:41:04  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:41:04  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:41:04  | PASS |
12:41:04  ------------------------------------------------------------------------------
12:41:04  Reconnect Mininet To Owner :: Reconnect mininet to switch 1 owner.    <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:41:05  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:41:05  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:41:05  10.30.170.110
12:41:05  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:41:06  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:41:06  | PASS |
12:41:06  ------------------------------------------------------------------------------
12:41:06  Check Entity Owner Status And Find Owner and Successor After Recon... <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:41:06  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:41:06  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:41:06  | PASS |
12:41:06  ------------------------------------------------------------------------------
12:41:06  Add Flows And Groups After Owner Reconnect :: Add 1 group type 1&2... <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:41:06  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:41:06  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:41:08  | PASS |
12:41:08  ------------------------------------------------------------------------------
12:41:08  Check Stats Are Not Frozen After Owner Reconnect :: Check that dur... <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:41:08  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:41:08  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:41:15  | PASS |
12:41:15  ------------------------------------------------------------------------------
12:41:15  Check Flows After Owner Reconnect In Operational DS :: Check Flows... <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:41:22  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:41:22  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:41:22  | PASS |
12:41:22  ------------------------------------------------------------------------------
12:41:22  Check Groups After Owner Reconnect In Operational DS :: Check Grou... <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:41:22  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:41:22  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:41:22  | PASS |
12:41:22  ------------------------------------------------------------------------------
12:41:22  Check Flows After Owner Reconnect In Switch :: Check Flows in switch. <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:41:22  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:41:22  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:41:22  | PASS |
12:41:22  ------------------------------------------------------------------------------
12:41:22  Check Switches Generate Slave Connection :: Check switches are con... <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:41:22  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:41:22  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:42:07  | FAIL |
12:42:07  Keyword 'OvsManager.Should Be Slave' failed after retrying for 50 seconds. The last error was: Dictionary does not contain key 's1'.
12:42:07  ------------------------------------------------------------------------------
12:42:07  Disconnect Mininet From Successor :: Disconnect mininet from the S... <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:42:07  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:42:07  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:42:07  10.30.170.124
12:42:08  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:42:09  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:42:09  | PASS |
12:42:09  ------------------------------------------------------------------------------
12:42:09  Check Entity Owner Status And Find New Owner and Successor After D... <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:42:09  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:42:09  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:42:17  | PASS |
12:42:17  ------------------------------------------------------------------------------
12:42:17  Disconnect Mininet From Current Owner :: Disconnect mininet from t... <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:42:17  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:42:18  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:42:18  10.30.171.121
12:42:18  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:42:19  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:42:19  | PASS |
12:42:19  ------------------------------------------------------------------------------
12:42:19  Check Entity Owner Status And Find Current Owner and Successor Aft... <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:42:19  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:42:19  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:42:27  | PASS |
12:42:27  ------------------------------------------------------------------------------
12:42:27  Check Switch Moves To Current Master :: Check switch s1 is connect... <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:42:27  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:42:28  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:42:38  | FAIL |
12:42:38  Keyword 'OvsManager.Should Be Master' failed after retrying for 10 seconds. The last error was: Dictionary does not contain key 's1'.
12:42:38  ------------------------------------------------------------------------------
12:42:38  Check Linear Topology After Owner Disconnect :: Check Linear Topol... <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:42:38  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:42:38  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:42:38  | PASS |
12:42:38  ------------------------------------------------------------------------------
12:42:38  Check Stats Are Not Frozen After Owner Disconnect :: Check that du... <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:42:39  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:42:39  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:42:44  | PASS |
12:42:44  ------------------------------------------------------------------------------
12:42:44  Remove Flows And Groups After Owner Disconnected :: Remove 1 group... <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:42:44  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:42:44  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:42:44  | PASS |
12:42:44  ------------------------------------------------------------------------------
12:42:44  Check Flows In Operational DS After Owner Disconnected :: Check Fl... <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:42:44  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:42:45  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:42:47  | PASS |
12:42:47  ------------------------------------------------------------------------------
12:42:47  Check Groups In Operational DS After Owner Disconnected :: Check G... <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:42:47  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:42:47  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:42:48  | PASS |
12:42:48  ------------------------------------------------------------------------------
12:42:48  Check Flows In Switch After Owner Disconnected :: Check Flows in s... <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:42:48  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:42:48  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:42:48  | PASS |
12:42:48  ------------------------------------------------------------------------------
12:42:48  Disconnect Mininet From Cluster :: Disconnect Mininet from Cluster.   <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:42:48  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:42:48  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:42:48  10.30.170.110
12:42:49  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:42:49  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:42:49  | PASS |
12:42:49  ------------------------------------------------------------------------------
12:42:49  Check No Switches After Disconnect :: Check no switches in topology.  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:42:49  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:42:49  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:43:00  | PASS |
12:43:00  ------------------------------------------------------------------------------
12:43:00  Check Switch Is Not Connected :: Check switch s1 is not connected ... <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:43:00  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:43:00  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:43:11  | FAIL |
12:43:11  Keyword 'OvsManager.Should Be Disconnected' failed after retrying for 10 seconds. The last error was: Dictionary does not contain key 's1'.
12:43:11  ------------------------------------------------------------------------------
12:43:11  Reconnect Mininet To Cluster :: Reconnect mininet to cluster by re... <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:43:11  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:43:11  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:43:11  10.30.170.110
12:43:12  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:43:12  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:43:12  10.30.171.121
12:43:13  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:43:13  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:43:13  10.30.170.124
12:43:14  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:43:14  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:43:14  | PASS |
12:43:14  ------------------------------------------------------------------------------
12:43:14  Check Linear Topology After Mininet Reconnects :: Check Linear Top... <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:43:14  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:43:15  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:43:22  | PASS |
12:43:22  ------------------------------------------------------------------------------
12:43:22  Add Flows And Groups After Mininet Reconnects :: Add 1 group type ... <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:43:22  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:43:22  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:43:24  | PASS |
12:43:24  ------------------------------------------------------------------------------
12:43:24  Check Flows In Operational DS After Mininet Reconnects :: Check Fl... <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:43:24  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:43:24  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:43:28  | PASS |
12:43:28  ------------------------------------------------------------------------------
12:43:28  Check Groups In Operational DS After Mininet Reconnects :: Check G... <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:43:28  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:43:28  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:43:28  | PASS |
12:43:28  ------------------------------------------------------------------------------
12:43:28  Check Flows In Switch After Mininet Reconnects :: Check Flows in s... <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:43:29  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:43:29  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:43:29  | PASS |
12:43:29  ------------------------------------------------------------------------------
12:43:29  Check Entity Owner Status And Find Owner and Successor Before Owne... <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:43:29  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:43:29  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:43:29  | PASS |
12:43:29  ------------------------------------------------------------------------------
12:43:29  Check Switch Generates Slave Connection Before Owner Stop :: Check... <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:43:30  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:43:30  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:44:21  | FAIL |
12:44:21  Keyword 'OvsManager.Should Be Slave' failed after retrying for 50 seconds. The last error was: Dictionary does not contain key 's1'.
12:44:21  ------------------------------------------------------------------------------
12:44:21  Check Shards Status Before Owner Stop :: Check Status for all shar... <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:44:21  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:44:21  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:44:26  | PASS |
12:44:26  ------------------------------------------------------------------------------
12:44:26  Stop Owner Instance :: Stop Owner Instance and verify it is shutdown  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:44:26  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:44:26  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:44:26  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:44:26  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:44:26  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:44:27  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:44:27  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:44:27  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:44:27  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:44:30  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:44:30  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:44:32  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:44:32  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:44:33  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:44:33  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:44:34  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:44:34  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:44:34  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:44:34  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:44:34  | PASS |
12:44:34  ------------------------------------------------------------------------------
12:44:34  Check Shards Status After Stop :: Check Status for all shards in O... <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:44:44  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:44:44  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:44:44  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:44:47  | PASS |
12:44:47  ------------------------------------------------------------------------------
12:44:47  Check Entity Owner Status And Find Owner and Successor After Stop ... <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:44:47  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:44:47  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:44:47  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:44:47  | PASS |
12:44:47  ------------------------------------------------------------------------------
12:44:47  Check Stats Are Not Frozen After Owner Stop :: Check that duration... <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:44:47  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:44:48  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:44:48  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:44:53  | PASS |
12:44:53  ------------------------------------------------------------------------------
12:44:53  Remove Configuration In Owner and Verify After Owner Stop :: Remov... <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:44:53  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:44:53  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:44:53  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:44:53  | PASS |
12:44:53  ------------------------------------------------------------------------------
12:44:53  Check Flows After Owner Stop In Operational DS :: Check Flows in O... <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:44:53  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:44:53  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:44:53  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:44:56  | PASS |
12:44:56  ------------------------------------------------------------------------------
12:44:56  Check Groups After Owner Stop In Operational DS :: Check Groups in... <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:44:56  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:44:56  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:44:56  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:44:56  | PASS |
12:44:56  ------------------------------------------------------------------------------
12:44:56  Check Flows In Switch After Owner Stop :: Check Flows in switch.      <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:44:56  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:44:56  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:44:56  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:44:56  | PASS |
12:44:56  ------------------------------------------------------------------------------
12:44:56  Start Old Owner Instance :: Start old Owner Instance and verify it... <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:44:56  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:44:57  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:44:57  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:44:57  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:44:57  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:44:57  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:44:57  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:44:57  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:44:57  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:45:19  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:45:19  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:45:20  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:45:20  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:45:20  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:45:20  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:45:20  | PASS |
12:45:20  ------------------------------------------------------------------------------
12:45:20  Check Entity Owner Status And Find Owner and Successor After Start... <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:45:20  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:45:21  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:45:21  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:45:21  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:45:21  | PASS |
12:45:21  ------------------------------------------------------------------------------
12:45:21  Check Linear Topology After Owner Restart :: Check Linear Topology.   <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:45:22  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:45:22  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:45:22  | PASS |
12:45:22  ------------------------------------------------------------------------------
12:45:22  Add Configuration In Owner and Verify After Owner Restart :: Add 1... <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:45:22  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:45:22  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:45:24  | PASS |
12:45:24  ------------------------------------------------------------------------------
12:45:24  Check Stats Are Not Frozen After Owner Restart :: Check that durat... <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:45:24  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:45:24  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:45:31  | PASS |
12:45:31  ------------------------------------------------------------------------------
12:45:31  Check Flows In Operational DS After Owner Restart :: Check Flows i... <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:45:32  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:45:32  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:45:32  | PASS |
12:45:32  ------------------------------------------------------------------------------
12:45:32  Check Groups In Operational DS After Owner Restart :: Check Groups... <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:45:32  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:45:32  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:45:32  | PASS |
12:45:32  ------------------------------------------------------------------------------
12:45:32  Check Flows In Switch After Owner Restart :: Check Flows in switch.   <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:45:33  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:45:33  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:45:33  | PASS |
12:45:33  ------------------------------------------------------------------------------
12:45:33  Restart Cluster :: Stop and Start cluster.                            <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:45:33  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:45:33  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:45:34  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:45:34  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:45:36  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:45:36  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:45:38  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:45:38  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:45:38  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:45:38  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:45:41  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:45:41  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:45:41  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:45:41  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:45:44  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:45:44  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:45:44  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:45:44  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:45:46  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:45:46  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:45:49  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:45:49  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:45:51  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:45:51  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:45:54  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:45:54  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:45:56  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:45:56  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:45:59  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:45:59  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:46:01  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:46:01  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:46:04  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:46:04  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:46:06  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:46:06  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:46:09  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:46:09  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:46:11  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:46:11  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:46:14  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:46:14  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:46:16  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:46:16  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:46:18  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:46:18  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:46:21  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:46:21  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:46:23  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:46:23  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:46:26  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:46:26  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:46:28  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:46:28  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:46:31  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:46:31  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:46:33  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:46:33  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:46:36  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:46:36  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:46:38  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:46:38  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:46:41  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:46:41  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:46:43  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:46:43  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:46:46  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:46:46  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:46:48  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:46:48  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:46:51  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:46:51  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:46:53  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:46:53  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:46:55  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:46:55  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:46:58  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:46:58  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:47:00  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:47:00  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:47:03  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:47:03  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:47:05  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:47:05  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:47:08  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:47:08  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:47:10  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:47:10  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:47:13  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:47:13  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:47:15  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:47:15  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:47:18  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:47:18  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:47:20  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:47:20  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:47:22  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:47:23  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:47:25  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:47:25  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:47:27  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:47:27  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:47:30  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:47:30  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:47:32  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:47:32  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:47:35  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:47:35  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:47:37  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:47:37  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:47:40  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:47:40  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:47:42  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:47:42  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:47:43  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:47:43  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:47:44  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:47:44  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:47:44  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:47:44  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:47:45  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:47:45  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:47:45  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:47:45  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:47:46  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:47:46  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:48:20  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:48:20  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:48:20  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:48:20  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:48:21  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:48:21  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:48:21  | PASS |
12:48:21  ------------------------------------------------------------------------------
12:48:21  Check Linear Topology After Controller Restarts :: Check Linear To... <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:48:32  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:48:32  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:48:42  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:48:42  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:48:43  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:48:53  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:48:53  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:48:54  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:48:54  | PASS |
12:48:54  ------------------------------------------------------------------------------
12:48:54  Check Stats Are Not Frozen After Cluster Restart :: Check that dur... <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:48:54  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:48:54  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:48:59  | PASS |
12:48:59  ------------------------------------------------------------------------------
12:48:59  Check Flows In Operational DS After Controller Restarts :: Check F... <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:49:00  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:49:00  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:49:00  | PASS |
12:49:00  ------------------------------------------------------------------------------
12:49:00  Check Groups In Operational DS After Controller Restarts :: Check ... <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:49:00  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:49:00  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:49:01  | PASS |
12:49:01  ------------------------------------------------------------------------------
12:49:01  Check Flows In Switch After Controller Restarts :: Check Flows in ... <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:49:01  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:49:01  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:49:01  | PASS |
12:49:01  ------------------------------------------------------------------------------
12:49:01  Stop Mininet :: Stop Mininet.                                         <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:49:01  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:49:01  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:49:02  | PASS |
12:49:02  ------------------------------------------------------------------------------
12:49:02  Check No Switches :: Check no switches in topology.                   | PASS |
12:49:03  ------------------------------------------------------------------------------
12:49:05  openflowplugin-clustering.txt.010 Group Flows :: Switch connection... | FAIL |
12:49:05  72 tests, 67 passed, 5 failed
12:49:05  ==============================================================================
12:49:05  openflowplugin-clustering.txt.010 Switch Disconnect :: Test suite for entit...
12:49:05  ==============================================================================
12:49:10  Switches To Be Connected To All Nodes :: Initial check for correct... | FAIL |
12:49:10  Parent suite setup failed:
12:49:10  Dictionary does not contain key 's1'.
12:49:10  ------------------------------------------------------------------------------
12:49:10  Reconnecting Switch s1                                                | FAIL |
12:49:10  Parent suite setup failed:
12:49:10  Dictionary does not contain key 's1'.
12:49:10  ------------------------------------------------------------------------------
12:49:10  Switches Still Be Connected To All Nodes                              | FAIL |
12:49:10  Parent suite setup failed:
12:49:10  Dictionary does not contain key 's1'.
12:49:10  ------------------------------------------------------------------------------
12:49:10  openflowplugin-clustering.txt.010 Switch Disconnect :: Test suite ... | FAIL |
12:49:10  Suite setup failed:
12:49:10  Dictionary does not contain key 's1'.
12:49:10  
12:49:10  3 tests, 0 passed, 3 failed
12:49:10  ==============================================================================
12:49:10  openflowplugin-clustering.txt.020 Cluster Node Failure :: Test suite for en...
12:49:10  ==============================================================================
12:49:14  Switches To Be Connected To All Nodes :: Initial check for correct... | FAIL |
12:49:14  Parent suite setup failed:
12:49:14  Dictionary does not contain key 's1'.
12:49:14  ------------------------------------------------------------------------------
12:49:14  Restarting Owner Of Switch s1                                         | FAIL |
12:49:14  Parent suite setup failed:
12:49:14  Dictionary does not contain key 's1'.
12:49:14  ------------------------------------------------------------------------------
12:49:14  Switches Still Be Connected To All Nodes                              | FAIL |
12:49:14  Parent suite setup failed:
12:49:14  Dictionary does not contain key 's1'.
12:49:14  ------------------------------------------------------------------------------
12:49:14  openflowplugin-clustering.txt.020 Cluster Node Failure :: Test sui... | FAIL |
12:49:14  Suite setup failed:
12:49:14  Dictionary does not contain key 's1'.
12:49:14  
12:49:14  3 tests, 0 passed, 3 failed
12:49:14  ==============================================================================
12:49:14  openflowplugin-clustering.txt.030 Cluster Sync Problems :: Test suite for e...
12:49:14  ==============================================================================
12:49:17  Start Mininet To All Nodes                                            | FAIL |
12:49:19  Dictionary does not contain key 's1'.
12:49:19  ------------------------------------------------------------------------------
12:49:19  Switches To Be Connected To All Nodes :: Initial check for correct... <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:49:19  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:49:19  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:49:35  | FAIL |
12:49:35  Keyword 'Check All Switches Connected To All Cluster Nodes' failed after retrying 15 times. The last error was: Dictionary does not contain key 's1'.
12:49:35  ------------------------------------------------------------------------------
12:49:35  Isolating Owner Of Switch s1                                          <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:49:35  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:49:35  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:50:06  | FAIL |
12:50:06  This test fails due to https://bugs.opendaylight.org/show_bug.cgi?id=6177
12:50:06  
12:50:06  Keyword 'ClusterManagement.Verify_Owner_And_Successors_For_Device' failed after retrying for 30 seconds. The last error was: Could not parse owner and candidates for device openflow:1
12:50:06  ------------------------------------------------------------------------------
12:50:06  Switches Still Be Connected To All Nodes                              <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:50:06  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:50:06  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:50:22  | FAIL |
12:50:22  This test fails due to https://bugs.opendaylight.org/show_bug.cgi?id=6177
12:50:22  
12:50:22  Keyword 'Check All Switches Connected To All Cluster Nodes' failed after retrying 15 times. The last error was: Dictionary does not contain key 's1'.
12:50:22  ------------------------------------------------------------------------------
12:50:22  Stop Mininet And Verify No Owners                                     <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:50:22  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:50:22  <string>:1: SyntaxWarning: "is not" with a literal. Did you mean "!="?
12:50:36  | FAIL |
12:50:36  This test fails due to https://bugs.opendaylight.org/show_bug.cgi?id=6177
12:50:36  
12:50:36  Keyword 'Check No Device Owners In Controller' failed after retrying 15 times. The last error was: Dictionary does not contain key '1'.
12:50:36  ------------------------------------------------------------------------------
12:50:39  openflowplugin-clustering.txt.030 Cluster Sync Problems :: Test su... | FAIL |
12:50:39  5 tests, 0 passed, 5 failed
12:50:39  ==============================================================================
12:50:39  openflowplugin-clustering.txt.9145 :: Switch connections and cluster are re...
12:50:39  ==============================================================================
12:50:39  Start Mininet Multiple Connections :: Start mininet linear with co... | PASS |
12:50:47  ------------------------------------------------------------------------------
12:50:47  Check Entity Owner Status And Find Owner and Successor :: Check En... | PASS |
12:50:47  ------------------------------------------------------------------------------
12:50:47  Stop Mininet :: Stop Mininet.                                         | PASS |
12:50:47  ------------------------------------------------------------------------------
12:50:47  openflowplugin-clustering.txt.9145 :: Switch connections and clust... | PASS |
12:50:47  3 tests, 3 passed, 0 failed
12:50:47  ==============================================================================
12:50:47  openflowplugin-clustering.txt                                         | FAIL |
12:50:47  209 tests, 193 passed, 16 failed
12:50:47  ==============================================================================
12:50:47  Output:  /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/output.xml
12:50:57  Log:     /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/log.html
12:50:57  Report:  /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/report.html
12:50:57  + true
12:50:57  + echo 'Examining the files in data/log and checking filesize'
12:50:57  Examining the files in data/log and checking filesize
12:50:57  + ssh 10.30.170.110 'ls -altr /tmp/karaf-0.21.2/data/log/'
12:50:57  Warning: Permanently added '10.30.170.110' (ECDSA) to the list of known hosts.
12:50:57  total 29292
12:50:57  drwxrwxr-x 2 jenkins jenkins     4096 Mar 10 12:25 .
12:50:57  drwxrwxr-x 9 jenkins jenkins     4096 Mar 10 12:25 ..
12:50:57  -rw-rw-r-- 1 jenkins jenkins     1727 Mar 10 12:29 karaf_console.log
12:50:57  -rw-rw-r-- 1 jenkins jenkins 29975147 Mar 10 12:50 karaf.log
12:50:57  + ssh 10.30.170.110 'du -hs /tmp/karaf-0.21.2/data/log/*'
12:50:57  Warning: Permanently added '10.30.170.110' (ECDSA) to the list of known hosts.
12:50:57  29M	/tmp/karaf-0.21.2/data/log/karaf.log
12:50:57  4.0K	/tmp/karaf-0.21.2/data/log/karaf_console.log
12:50:57  + ssh 10.30.171.121 'ls -altr /tmp/karaf-0.21.2/data/log/'
12:50:57  Warning: Permanently added '10.30.171.121' (ECDSA) to the list of known hosts.
12:50:58  total 30472
12:50:58  drwxrwxr-x 2 jenkins jenkins     4096 Mar 10 12:25 .
12:50:58  -rw-rw-r-- 1 jenkins jenkins     1720 Mar 10 12:25 karaf_console.log
12:50:58  drwxrwxr-x 9 jenkins jenkins     4096 Mar 10 12:25 ..
12:50:58  -rw-rw-r-- 1 jenkins jenkins 31184508 Mar 10 12:50 karaf.log
12:50:58  + ssh 10.30.171.121 'du -hs /tmp/karaf-0.21.2/data/log/*'
12:50:58  Warning: Permanently added '10.30.171.121' (ECDSA) to the list of known hosts.
12:50:58  30M	/tmp/karaf-0.21.2/data/log/karaf.log
12:50:58  4.0K	/tmp/karaf-0.21.2/data/log/karaf_console.log
12:50:58  + ssh 10.30.170.124 'ls -altr /tmp/karaf-0.21.2/data/log/'
12:50:58  Warning: Permanently added '10.30.170.124' (ECDSA) to the list of known hosts.
12:50:58  total 32536
12:50:58  drwxrwxr-x 2 jenkins jenkins     4096 Mar 10 12:25 .
12:50:58  -rw-rw-r-- 1 jenkins jenkins     2337 Mar 10 12:25 karaf_console.log
12:50:58  drwxrwxr-x 9 jenkins jenkins     4096 Mar 10 12:25 ..
12:50:58  -rw-rw-r-- 1 jenkins jenkins 33300009 Mar 10 12:50 karaf.log
12:50:58  + ssh 10.30.170.124 'du -hs /tmp/karaf-0.21.2/data/log/*'
12:50:58  Warning: Permanently added '10.30.170.124' (ECDSA) to the list of known hosts.
12:50:58  32M	/tmp/karaf-0.21.2/data/log/karaf.log
12:50:58  4.0K	/tmp/karaf-0.21.2/data/log/karaf_console.log
12:50:58  + set +e
12:50:58  ++ seq 1 3
12:50:58  + for i in $(seq 1 "${NUM_ODL_SYSTEM}")
12:50:58  + CONTROLLERIP=ODL_SYSTEM_1_IP
12:50:58  + echo 'Let'\''s take the karaf thread dump again'
12:50:58  Let's take the karaf thread dump again
12:50:58  + ssh 10.30.170.110 'sudo ps aux'
12:50:59  Warning: Permanently added '10.30.170.110' (ECDSA) to the list of known hosts.
12:50:59  ++ grep org.apache.karaf.main.Main /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/ps_after.log
12:50:59  ++ grep -v grep
12:50:59  ++ tr -s ' '
12:50:59  ++ cut -f2 '-d '
12:50:59  + pid=36237
12:50:59  + echo 'karaf main: org.apache.karaf.main.Main, pid:36237'
12:50:59  karaf main: org.apache.karaf.main.Main, pid:36237
12:50:59  + ssh 10.30.170.110 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 36237'
12:50:59  Warning: Permanently added '10.30.170.110' (ECDSA) to the list of known hosts.
12:50:59  + echo 'killing karaf process...'
12:50:59  killing karaf process...
12:50:59  + ssh 10.30.170.110 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh'
12:50:59  Warning: Permanently added '10.30.170.110' (ECDSA) to the list of known hosts.
12:51:00  + for i in $(seq 1 "${NUM_ODL_SYSTEM}")
12:51:00  + CONTROLLERIP=ODL_SYSTEM_2_IP
12:51:00  + echo 'Let'\''s take the karaf thread dump again'
12:51:00  Let's take the karaf thread dump again
12:51:00  + ssh 10.30.171.121 'sudo ps aux'
12:51:00  Warning: Permanently added '10.30.171.121' (ECDSA) to the list of known hosts.
12:51:00  ++ grep org.apache.karaf.main.Main /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/ps_after.log
12:51:00  ++ grep -v grep
12:51:00  ++ tr -s ' '
12:51:00  ++ cut -f2 '-d '
12:51:00  + pid=36441
12:51:00  + echo 'karaf main: org.apache.karaf.main.Main, pid:36441'
12:51:00  karaf main: org.apache.karaf.main.Main, pid:36441
12:51:00  + ssh 10.30.171.121 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 36441'
12:51:00  Warning: Permanently added '10.30.171.121' (ECDSA) to the list of known hosts.
12:51:00  + echo 'killing karaf process...'
12:51:00  killing karaf process...
12:51:00  + ssh 10.30.171.121 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh'
12:51:00  Warning: Permanently added '10.30.171.121' (ECDSA) to the list of known hosts.
12:51:01  + for i in $(seq 1 "${NUM_ODL_SYSTEM}")
12:51:01  + CONTROLLERIP=ODL_SYSTEM_3_IP
12:51:01  + echo 'Let'\''s take the karaf thread dump again'
12:51:01  Let's take the karaf thread dump again
12:51:01  + ssh 10.30.170.124 'sudo ps aux'
12:51:01  Warning: Permanently added '10.30.170.124' (ECDSA) to the list of known hosts.
12:51:01  ++ grep org.apache.karaf.main.Main /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/ps_after.log
12:51:01  ++ grep -v grep
12:51:01  ++ cut -f2 '-d '
12:51:01  ++ tr -s ' '
12:51:01  + pid=44650
12:51:01  + echo 'karaf main: org.apache.karaf.main.Main, pid:44650'
12:51:01  karaf main: org.apache.karaf.main.Main, pid:44650
12:51:01  + ssh 10.30.170.124 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 44650'
12:51:01  Warning: Permanently added '10.30.170.124' (ECDSA) to the list of known hosts.
12:51:02  + echo 'killing karaf process...'
12:51:02  killing karaf process...
12:51:02  + ssh 10.30.170.124 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh'
12:51:02  Warning: Permanently added '10.30.170.124' (ECDSA) to the list of known hosts.
12:51:02  + sleep 5
12:51:07  ++ seq 1 3
12:51:07  + for i in $(seq 1 "${NUM_ODL_SYSTEM}")
12:51:07  + CONTROLLERIP=ODL_SYSTEM_1_IP
12:51:07  + echo 'Compressing karaf.log 1'
12:51:07  Compressing karaf.log 1
12:51:07  + ssh 10.30.170.110 gzip --best /tmp/karaf-0.21.2/data/log/karaf.log
12:51:07  Warning: Permanently added '10.30.170.110' (ECDSA) to the list of known hosts.
12:51:07  gzip: /tmp/karaf-0.21.2/data/log/karaf.log: file size changed while zipping
12:51:07  + echo 'Fetching compressed karaf.log 1'
12:51:07  Fetching compressed karaf.log 1
12:51:07  + scp 10.30.170.110:/tmp/karaf-0.21.2/data/log/karaf.log.gz odl1_karaf.log.gz
12:51:07  Warning: Permanently added '10.30.170.110' (ECDSA) to the list of known hosts.
12:51:08  + ssh 10.30.170.110 rm -f /tmp/karaf-0.21.2/data/log/karaf.log.gz
12:51:08  Warning: Permanently added '10.30.170.110' (ECDSA) to the list of known hosts.
12:51:08  + scp 10.30.170.110:/tmp/karaf-0.21.2/data/log/karaf_console.log odl1_karaf_console.log
12:51:08  Warning: Permanently added '10.30.170.110' (ECDSA) to the list of known hosts.
12:51:08  + ssh 10.30.170.110 rm -f /tmp/karaf-0.21.2/data/log/karaf_console.log
12:51:08  Warning: Permanently added '10.30.170.110' (ECDSA) to the list of known hosts.
12:51:09  + echo 'Fetch GC logs'
12:51:09  Fetch GC logs
12:51:09  + mkdir -p gclogs-1
12:51:09  + scp '10.30.170.110:/tmp/karaf-0.21.2/data/log/*.log' gclogs-1/
12:51:09  Warning: Permanently added '10.30.170.110' (ECDSA) to the list of known hosts.
12:51:09  scp: /tmp/karaf-0.21.2/data/log/*.log: No such file or directory
12:51:09  + for i in $(seq 1 "${NUM_ODL_SYSTEM}")
12:51:09  + CONTROLLERIP=ODL_SYSTEM_2_IP
12:51:09  + echo 'Compressing karaf.log 2'
12:51:09  Compressing karaf.log 2
12:51:09  + ssh 10.30.171.121 gzip --best /tmp/karaf-0.21.2/data/log/karaf.log
12:51:09  Warning: Permanently added '10.30.171.121' (ECDSA) to the list of known hosts.
12:51:09  gzip: /tmp/karaf-0.21.2/data/log/karaf.log: file size changed while zipping
12:51:09  + echo 'Fetching compressed karaf.log 2'
12:51:09  Fetching compressed karaf.log 2
12:51:09  + scp 10.30.171.121:/tmp/karaf-0.21.2/data/log/karaf.log.gz odl2_karaf.log.gz
12:51:09  Warning: Permanently added '10.30.171.121' (ECDSA) to the list of known hosts.
12:51:10  + ssh 10.30.171.121 rm -f /tmp/karaf-0.21.2/data/log/karaf.log.gz
12:51:10  Warning: Permanently added '10.30.171.121' (ECDSA) to the list of known hosts.
12:51:10  + scp 10.30.171.121:/tmp/karaf-0.21.2/data/log/karaf_console.log odl2_karaf_console.log
12:51:10  Warning: Permanently added '10.30.171.121' (ECDSA) to the list of known hosts.
12:51:10  + ssh 10.30.171.121 rm -f /tmp/karaf-0.21.2/data/log/karaf_console.log
12:51:10  Warning: Permanently added '10.30.171.121' (ECDSA) to the list of known hosts.
12:51:10  + echo 'Fetch GC logs'
12:51:10  Fetch GC logs
12:51:10  + mkdir -p gclogs-2
12:51:10  + scp '10.30.171.121:/tmp/karaf-0.21.2/data/log/*.log' gclogs-2/
12:51:10  Warning: Permanently added '10.30.171.121' (ECDSA) to the list of known hosts.
12:51:11  scp: /tmp/karaf-0.21.2/data/log/*.log: No such file or directory
12:51:11  + for i in $(seq 1 "${NUM_ODL_SYSTEM}")
12:51:11  + CONTROLLERIP=ODL_SYSTEM_3_IP
12:51:11  + echo 'Compressing karaf.log 3'
12:51:11  Compressing karaf.log 3
12:51:11  + ssh 10.30.170.124 gzip --best /tmp/karaf-0.21.2/data/log/karaf.log
12:51:11  Warning: Permanently added '10.30.170.124' (ECDSA) to the list of known hosts.
12:51:11  gzip: /tmp/karaf-0.21.2/data/log/karaf.log: file size changed while zipping
12:51:11  + echo 'Fetching compressed karaf.log 3'
12:51:11  Fetching compressed karaf.log 3
12:51:11  + scp 10.30.170.124:/tmp/karaf-0.21.2/data/log/karaf.log.gz odl3_karaf.log.gz
12:51:11  Warning: Permanently added '10.30.170.124' (ECDSA) to the list of known hosts.
12:51:12  + ssh 10.30.170.124 rm -f /tmp/karaf-0.21.2/data/log/karaf.log.gz
12:51:12  Warning: Permanently added '10.30.170.124' (ECDSA) to the list of known hosts.
12:51:12  + scp 10.30.170.124:/tmp/karaf-0.21.2/data/log/karaf_console.log odl3_karaf_console.log
12:51:12  Warning: Permanently added '10.30.170.124' (ECDSA) to the list of known hosts.
12:51:12  + ssh 10.30.170.124 rm -f /tmp/karaf-0.21.2/data/log/karaf_console.log
12:51:12  Warning: Permanently added '10.30.170.124' (ECDSA) to the list of known hosts.
12:51:12  + echo 'Fetch GC logs'
12:51:12  Fetch GC logs
12:51:12  + mkdir -p gclogs-3
12:51:12  + scp '10.30.170.124:/tmp/karaf-0.21.2/data/log/*.log' gclogs-3/
12:51:12  Warning: Permanently added '10.30.170.124' (ECDSA) to the list of known hosts.
12:51:13  scp: /tmp/karaf-0.21.2/data/log/*.log: No such file or directory
12:51:13  + echo 'Examine copied files'
12:51:13  Examine copied files
12:51:13  + ls -lt
12:51:13  total 72220
12:51:13  drwxrwxr-x. 2 jenkins jenkins        6 Mar 10 12:51 gclogs-3
12:51:13  -rw-rw-r--. 1 jenkins jenkins     2337 Mar 10 12:51 odl3_karaf_console.log
12:51:13  -rw-rw-r--. 1 jenkins jenkins   650535 Mar 10 12:51 odl3_karaf.log.gz
12:51:13  drwxrwxr-x. 2 jenkins jenkins        6 Mar 10 12:51 gclogs-2
12:51:13  -rw-rw-r--. 1 jenkins jenkins     1720 Mar 10 12:51 odl2_karaf_console.log
12:51:13  -rw-rw-r--. 1 jenkins jenkins   630091 Mar 10 12:51 odl2_karaf.log.gz
12:51:13  drwxrwxr-x. 2 jenkins jenkins        6 Mar 10 12:51 gclogs-1
12:51:13  -rw-rw-r--. 1 jenkins jenkins     1727 Mar 10 12:51 odl1_karaf_console.log
12:51:13  -rw-rw-r--. 1 jenkins jenkins   576728 Mar 10 12:51 odl1_karaf.log.gz
12:51:13  -rw-rw-r--. 1 jenkins jenkins   122415 Mar 10 12:51 karaf_3_44650_threads_after.log
12:51:13  -rw-rw-r--. 1 jenkins jenkins    15485 Mar 10 12:51 ps_after.log
12:51:13  -rw-rw-r--. 1 jenkins jenkins   131045 Mar 10 12:51 karaf_2_36441_threads_after.log
12:51:13  -rw-rw-r--. 1 jenkins jenkins   136769 Mar 10 12:50 karaf_1_36237_threads_after.log
12:51:13  -rw-rw-r--. 1 jenkins jenkins   271723 Mar 10 12:50 report.html
12:51:13  -rw-rw-r--. 1 jenkins jenkins  6149740 Mar 10 12:50 log.html
12:51:13  -rw-rw-r--. 1 jenkins jenkins 64884192 Mar 10 12:50 output.xml
12:51:13  -rw-rw-r--. 1 jenkins jenkins     1180 Mar 10 12:28 testplan.txt
12:51:13  -rw-rw-r--. 1 jenkins jenkins    95240 Mar 10 12:28 karaf_3_28861_threads_before.log
12:51:13  -rw-rw-r--. 1 jenkins jenkins    16149 Mar 10 12:28 ps_before.log
12:51:13  -rw-rw-r--. 1 jenkins jenkins    93553 Mar 10 12:28 karaf_2_28880_threads_before.log
12:51:13  -rw-rw-r--. 1 jenkins jenkins    94378 Mar 10 12:28 karaf_1_28848_threads_before.log
12:51:13  -rw-rw-r--. 1 jenkins jenkins     3043 Mar 10 12:25 post-startup-script.sh
12:51:13  -rw-rw-r--. 1 jenkins jenkins     1156 Mar 10 12:25 set_akka_debug.sh
12:51:13  -rw-rw-r--. 1 jenkins jenkins      133 Mar 10 12:25 configplan.txt
12:51:13  -rw-rw-r--. 1 jenkins jenkins      225 Mar 10 12:24 startup-script.sh
12:51:13  -rw-rw-r--. 1 jenkins jenkins     3278 Mar 10 12:24 configuration-script.sh
12:51:13  -rw-rw-r--. 1 jenkins jenkins      266 Mar 10 12:24 detect_variables.env
12:51:13  -rw-rw-r--. 1 jenkins jenkins       92 Mar 10 12:24 set_variables.env
12:51:13  -rw-rw-r--. 1 jenkins jenkins      359 Mar 10 12:24 slave_addresses.txt
12:51:13  -rw-rw-r--. 1 jenkins jenkins      570 Mar 10 12:24 requirements.txt
12:51:13  -rw-rw-r--. 1 jenkins jenkins       26 Mar 10 12:24 env.properties
12:51:13  -rw-rw-r--. 1 jenkins jenkins      334 Mar 10 12:22 stack-parameters.yaml
12:51:13  drwxrwxr-x. 7 jenkins jenkins     4096 Mar 10 12:21 test
12:51:13  drwxrwxr-x. 2 jenkins jenkins        6 Mar 10 12:21 test@tmp
12:51:13  + true
12:51:13  [openflowplugin-csit-3node-clustering-only-scandium] $ /bin/sh /tmp/jenkins9705363739665376710.sh
12:51:13  Cleaning up Robot installation...
12:51:13  $ ssh-agent -k
12:51:13  unset SSH_AUTH_SOCK;
12:51:13  unset SSH_AGENT_PID;
12:51:13  echo Agent pid 5282 killed;
12:51:13  [ssh-agent] Stopped.
12:51:13  Recording plot data
12:51:13  Robot results publisher started...
12:51:13  INFO: Checking test criticality is deprecated and will be dropped in a future release!
12:51:13  -Parsing output xml:
12:51:15  Done!
12:51:15  -Copying log files to build dir:
12:51:17  Done!
12:51:17  -Assigning results to build:
12:51:18  Done!
12:51:18  -Checking thresholds:
12:51:18  Done!
12:51:18  Done publishing Robot results.
12:51:18  Build step 'Publish Robot Framework test results' changed build result to UNSTABLE
12:51:18  [PostBuildScript] - [INFO] Executing post build scripts.
12:51:18  [openflowplugin-csit-3node-clustering-only-scandium] $ /bin/bash /tmp/jenkins12718038430664823937.sh
12:51:18  Archiving csit artifacts
12:51:18  mv: cannot stat '*_1.png': No such file or directory
12:51:18  mv: cannot stat '/tmp/odl1_*': No such file or directory
12:51:18  mv: cannot stat '*_2.png': No such file or directory
12:51:18  mv: cannot stat '/tmp/odl2_*': No such file or directory
12:51:18  mv: cannot stat '*_3.png': No such file or directory
12:51:18  mv: cannot stat '/tmp/odl3_*': No such file or directory
12:51:18    % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
12:51:18                                   Dload  Upload   Total   Spent    Left  Speed
12:51:18  
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100 3560k    0 3560k    0     0  5281k      0 --:--:-- --:--:-- --:--:-- 5274k
100 7206k    0 7206k    0     0  5264k      0 --:--:--  0:00:01 --:--:-- 5264k
12:51:19  Archive:  robot-plugin.zip
12:51:19    inflating: ./archives/robot-plugin/log.html  
12:51:19    inflating: ./archives/robot-plugin/output.xml  
12:51:19    inflating: ./archives/robot-plugin/report.html  
12:51:19  mv: cannot stat '*.log.gz': No such file or directory
12:51:19  mv: cannot stat '*.csv': No such file or directory
12:51:19  mv: cannot stat '*.png': No such file or directory
12:51:19  [PostBuildScript] - [INFO] Executing post build scripts.
12:51:19  [openflowplugin-csit-3node-clustering-only-scandium] $ /bin/bash /tmp/jenkins17494253194822248246.sh
12:51:19  [PostBuildScript] - [INFO] Executing post build scripts.
12:51:19  [EnvInject] - Injecting environment variables from a build step.
12:51:19  [EnvInject] - Injecting as environment variables the properties content 
12:51:19  OS_CLOUD=vex
12:51:19  OS_STACK_NAME=releng-openflowplugin-csit-3node-clustering-only-scandium-212
12:51:19  
12:51:19  [EnvInject] - Variables injected successfully.
12:51:19  provisioning config files...
12:51:20  copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
12:51:20  [openflowplugin-csit-3node-clustering-only-scandium] $ /bin/bash /tmp/jenkins8335378805896976592.sh
12:51:20  ---> openstack-stack-delete.sh
12:51:20  Setup pyenv:
12:51:20    system
12:51:20    3.8.13
12:51:20    3.9.13
12:51:20    3.10.13
12:51:20  * 3.11.7 (set by /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/.python-version)
12:51:20  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-Tm5S from file:/tmp/.os_lf_venv
12:51:21  lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes python-heatclient python-openstackclient 
12:51:36  lf-activate-venv(): INFO: Adding /tmp/venv-Tm5S/bin to PATH
12:51:36  INFO: Retrieving stack cost for: releng-openflowplugin-csit-3node-clustering-only-scandium-212
12:51:40  DEBUG: Successfully retrieved stack cost: total: 0.38999999999999996
12:51:52  INFO: Deleting stack releng-openflowplugin-csit-3node-clustering-only-scandium-212
12:51:52  Successfully deleted stack releng-openflowplugin-csit-3node-clustering-only-scandium-212
12:51:53  [PostBuildScript] - [INFO] Executing post build scripts.
12:51:53  [openflowplugin-csit-3node-clustering-only-scandium] $ /bin/bash /tmp/jenkins10866355149924708657.sh
12:51:53  ---> sysstat.sh
12:51:53  [openflowplugin-csit-3node-clustering-only-scandium] $ /bin/bash /tmp/jenkins1366056793737276465.sh
12:51:53  ---> package-listing.sh
12:51:53  ++ facter osfamily
12:51:53  ++ tr '[:upper:]' '[:lower:]'
12:51:53  + OS_FAMILY=redhat
12:51:53  + workspace=/w/workspace/openflowplugin-csit-3node-clustering-only-scandium
12:51:53  + START_PACKAGES=/tmp/packages_start.txt
12:51:53  + END_PACKAGES=/tmp/packages_end.txt
12:51:53  + DIFF_PACKAGES=/tmp/packages_diff.txt
12:51:53  + PACKAGES=/tmp/packages_start.txt
12:51:53  + '[' /w/workspace/openflowplugin-csit-3node-clustering-only-scandium ']'
12:51:53  + PACKAGES=/tmp/packages_end.txt
12:51:53  + case "${OS_FAMILY}" in
12:51:53  + rpm -qa
12:51:53  + sort
12:51:54  + '[' -f /tmp/packages_start.txt ']'
12:51:54  + '[' -f /tmp/packages_end.txt ']'
12:51:54  + diff /tmp/packages_start.txt /tmp/packages_end.txt
12:51:54  + '[' /w/workspace/openflowplugin-csit-3node-clustering-only-scandium ']'
12:51:54  + mkdir -p /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/archives/
12:51:54  + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/archives/
12:51:54  [openflowplugin-csit-3node-clustering-only-scandium] $ /bin/bash /tmp/jenkins10756938462762256968.sh
12:51:54  ---> capture-instance-metadata.sh
12:51:54  Setup pyenv:
12:51:54    system
12:51:54    3.8.13
12:51:54    3.9.13
12:51:54    3.10.13
12:51:54  * 3.11.7 (set by /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/.python-version)
12:51:54  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-Tm5S from file:/tmp/.os_lf_venv
12:51:55  lf-activate-venv(): INFO: Installing: lftools 
12:52:02  lf-activate-venv(): INFO: Adding /tmp/venv-Tm5S/bin to PATH
12:52:02  INFO: Running in OpenStack, capturing instance metadata
12:52:03  [openflowplugin-csit-3node-clustering-only-scandium] $ /bin/bash /tmp/jenkins16045001920018473845.sh
12:52:03  provisioning config files...
12:52:03  Could not find credentials [logs] for openflowplugin-csit-3node-clustering-only-scandium #212
12:52:03  copy managed file [jenkins-log-archives-settings] to file:/w/workspace/openflowplugin-csit-3node-clustering-only-scandium@tmp/config10483180935667316578tmp
12:52:03  Regular expression run condition: Expression=[^.*logs-s3.*], Label=[odl-logs-s3-cloudfront-index]
12:52:03  Run condition [Regular expression match] enabling perform for step [Provide Configuration files]
12:52:03  provisioning config files...
12:52:03  copy managed file [jenkins-s3-log-ship] to file:/home/jenkins/.aws/credentials
12:52:03  [EnvInject] - Injecting environment variables from a build step.
12:52:03  [EnvInject] - Injecting as environment variables the properties content 
12:52:03  SERVER_ID=logs
12:52:03  
12:52:03  [EnvInject] - Variables injected successfully.
12:52:03  [openflowplugin-csit-3node-clustering-only-scandium] $ /bin/bash /tmp/jenkins14296057297942444444.sh
12:52:03  ---> create-netrc.sh
12:52:03  WARN: Log server credential not found.
12:52:03  [openflowplugin-csit-3node-clustering-only-scandium] $ /bin/bash /tmp/jenkins11393118633454179044.sh
12:52:03  ---> python-tools-install.sh
12:52:03  Setup pyenv:
12:52:03    system
12:52:03    3.8.13
12:52:03    3.9.13
12:52:03    3.10.13
12:52:03  * 3.11.7 (set by /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/.python-version)
12:52:04  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-Tm5S from file:/tmp/.os_lf_venv
12:52:05  lf-activate-venv(): INFO: Installing: lftools 
12:52:12  lf-activate-venv(): INFO: Adding /tmp/venv-Tm5S/bin to PATH
12:52:12  [openflowplugin-csit-3node-clustering-only-scandium] $ /bin/bash /tmp/jenkins8537484548830063645.sh
12:52:12  ---> sudo-logs.sh
12:52:12  Archiving 'sudo' log..
12:52:12  [openflowplugin-csit-3node-clustering-only-scandium] $ /bin/bash /tmp/jenkins2445767149836536776.sh
12:52:12  ---> job-cost.sh
12:52:12  Setup pyenv:
12:52:12    system
12:52:12    3.8.13
12:52:12    3.9.13
12:52:12    3.10.13
12:52:12  * 3.11.7 (set by /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/.python-version)
12:52:13  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-Tm5S from file:/tmp/.os_lf_venv
12:52:14  lf-activate-venv(): INFO: Installing: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 
12:52:19  lf-activate-venv(): INFO: Adding /tmp/venv-Tm5S/bin to PATH
12:52:19  DEBUG: total: 0.38999999999999996
12:52:19  INFO: Retrieving Stack Cost...
12:52:19  INFO: Retrieving Pricing Info for: v3-standard-2
12:52:19  INFO: Archiving Costs
12:52:19  [openflowplugin-csit-3node-clustering-only-scandium] $ /bin/bash -l /tmp/jenkins4195450490207396166.sh
12:52:19  ---> logs-deploy.sh
12:52:19  Setup pyenv:
12:52:19    system
12:52:19    3.8.13
12:52:19    3.9.13
12:52:19    3.10.13
12:52:20  * 3.11.7 (set by /w/workspace/openflowplugin-csit-3node-clustering-only-scandium/.python-version)
12:52:20  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-Tm5S from file:/tmp/.os_lf_venv
12:52:21  lf-activate-venv(): INFO: Installing: lftools 
12:52:28  lf-activate-venv(): INFO: Adding /tmp/venv-Tm5S/bin to PATH
12:52:28  WARNING: Nexus logging server not set
12:52:28  INFO: S3 path logs/releng/vex-yul-odl-jenkins-1/openflowplugin-csit-3node-clustering-only-scandium/212/
12:52:28  INFO: archiving logs to S3
12:52:29  ---> uname -a:
12:52:29  Linux prd-centos8-robot-2c-8g-6413.novalocal 4.18.0-553.5.1.el8.x86_64 #1 SMP Tue May 21 05:46:01 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
12:52:29  
12:52:29  
12:52:29  ---> lscpu:
12:52:29  Architecture:        x86_64
12:52:29  CPU op-mode(s):      32-bit, 64-bit
12:52:29  Byte Order:          Little Endian
12:52:29  CPU(s):              2
12:52:29  On-line CPU(s) list: 0,1
12:52:29  Thread(s) per core:  1
12:52:29  Core(s) per socket:  1
12:52:29  Socket(s):           2
12:52:29  NUMA node(s):        1
12:52:29  Vendor ID:           AuthenticAMD
12:52:29  CPU family:          23
12:52:29  Model:               49
12:52:29  Model name:          AMD EPYC-Rome Processor
12:52:29  Stepping:            0
12:52:29  CPU MHz:             2799.998
12:52:29  BogoMIPS:            5599.99
12:52:29  Virtualization:      AMD-V
12:52:29  Hypervisor vendor:   KVM
12:52:29  Virtualization type: full
12:52:29  L1d cache:           32K
12:52:29  L1i cache:           32K
12:52:29  L2 cache:            512K
12:52:29  L3 cache:            16384K
12:52:29  NUMA node0 CPU(s):   0,1
12:52:29  Flags:               fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities
12:52:29  
12:52:29  
12:52:29  ---> nproc:
12:52:29  2
12:52:29  
12:52:29  
12:52:29  ---> df -h:
12:52:29  Filesystem      Size  Used Avail Use% Mounted on
12:52:29  devtmpfs        3.8G     0  3.8G   0% /dev
12:52:29  tmpfs           3.8G     0  3.8G   0% /dev/shm
12:52:29  tmpfs           3.8G   17M  3.8G   1% /run
12:52:29  tmpfs           3.8G     0  3.8G   0% /sys/fs/cgroup
12:52:29  /dev/vda1        40G  8.4G   32G  21% /
12:52:29  tmpfs           770M     0  770M   0% /run/user/1001
12:52:29  
12:52:29  
12:52:29  ---> free -m:
12:52:29                total        used        free      shared  buff/cache   available
12:52:29  Mem:           7697         574        4844          19        2279        6826
12:52:29  Swap:          1023           0        1023
12:52:29  
12:52:29  
12:52:29  ---> ip addr:
12:52:29  1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
12:52:29      link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
12:52:29      inet 127.0.0.1/8 scope host lo
12:52:29         valid_lft forever preferred_lft forever
12:52:29      inet6 ::1/128 scope host 
12:52:29         valid_lft forever preferred_lft forever
12:52:29  2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1458 qdisc mq state UP group default qlen 1000
12:52:29      link/ether fa:16:3e:cb:1e:a0 brd ff:ff:ff:ff:ff:ff
12:52:29      altname enp0s3
12:52:29      altname ens3
12:52:29      inet 10.30.171.173/23 brd 10.30.171.255 scope global dynamic noprefixroute eth0
12:52:29         valid_lft 84513sec preferred_lft 84513sec
12:52:29      inet6 fe80::f816:3eff:fecb:1ea0/64 scope link 
12:52:29         valid_lft forever preferred_lft forever
12:52:29  
12:52:29  
12:52:29  ---> sar -b -r -n DEV:
12:52:29  Linux 4.18.0-553.5.1.el8.x86_64 (centos-stream-8-robot-7d7a37eb-bc14-4dd6-9530-dc22c5eae738.noval) 	03/10/2025 	_x86_64_	(2 CPU)
12:52:29  
12:52:29  12:20:58     LINUX RESTART	(2 CPU)
12:52:29  
12:52:29  12:22:01 PM       tps      rtps      wtps   bread/s   bwrtn/s
12:52:29  12:23:01 PM    116.64      0.87    115.78     56.78  10695.22
12:52:29  12:24:01 PM     34.33      0.42     33.91     64.79   4712.48
12:52:29  12:25:01 PM     58.16      6.75     51.42   1249.18   4269.28
12:52:29  12:26:01 PM     15.28      0.00     15.28      0.00   4202.28
12:52:29  12:27:01 PM      0.43      0.00      0.43      0.00      7.53
12:52:29  12:28:01 PM      0.20      0.00      0.20      0.00      1.87
12:52:29  12:29:01 PM      2.13      0.10      2.03     32.12     86.72
12:52:29  12:30:01 PM      0.45      0.07      0.38      3.20    141.84
12:52:29  12:31:01 PM      0.42      0.00      0.42      0.00    142.27
12:52:29  12:32:01 PM      0.53      0.00      0.53      0.00    125.76
12:52:29  12:33:01 PM      0.32      0.00      0.32      0.00    224.25
12:52:29  12:34:01 PM      0.32      0.00      0.32      0.00     37.64
12:52:29  12:35:01 PM      0.32      0.00      0.32      0.00    209.35
12:52:29  12:36:01 PM      0.20      0.03      0.17      0.27     49.65
12:52:29  12:37:01 PM      1.38      0.00      1.38      0.00     61.42
12:52:29  12:38:01 PM      0.18      0.00      0.18      0.00     17.60
12:52:29  12:39:01 PM      0.15      0.00      0.15      0.00      8.20
12:52:29  12:40:01 PM      0.20      0.00      0.20      0.00     23.73
12:52:29  12:41:01 PM      0.42      0.00      0.42      0.00    196.68
12:52:29  12:42:01 PM      0.75      0.00      0.75      0.00    170.60
12:52:29  12:43:01 PM      0.20      0.00      0.20      0.00    156.37
12:52:29  12:44:01 PM      0.25      0.00      0.25      0.00    142.27
12:52:29  12:45:01 PM      0.32      0.00      0.32      0.00    156.77
12:52:29  12:46:01 PM      0.28      0.00      0.28      0.00    161.02
12:52:29  12:47:01 PM      0.23      0.00      0.23      0.00     12.38
12:52:29  12:48:01 PM      0.28      0.00      0.28      0.00     17.21
12:52:29  12:49:01 PM      0.18      0.00      0.18      0.00     18.15
12:52:29  12:50:01 PM      0.38      0.00      0.38      0.00     86.44
12:52:29  12:51:01 PM      0.33      0.00      0.33      0.00     47.59
12:52:29  12:52:01 PM     17.91      0.42     17.49     47.72   3432.72
12:52:29  Average:         8.44      0.29      8.15     48.47    987.20
12:52:29  
12:52:29  12:22:01 PM kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty
12:52:29  12:23:01 PM   5211372   7022120   2671052     33.89      2688   1987772    694168      7.77    198700   2127256    123808
12:52:29  12:24:01 PM   5282572   7094704   2599852     32.98      2688   1989716    627876      7.03    218060   2035840        16
12:52:29  12:25:01 PM   5020468   7074528   2861956     36.31      2688   2223480    629712      7.05    259008   2229920    120004
12:52:29  12:26:01 PM   5016064   7070140   2866360     36.36      2688   2223496    629712      7.05    259020   2229916         4
12:52:29  12:27:01 PM   5016036   7070112   2866388     36.36      2688   2223496    629712      7.05    259024   2230064         4
12:52:29  12:28:01 PM   5014464   7068544   2867960     36.38      2688   2223500    629712      7.05    259028   2231692         8
12:52:29  12:29:01 PM   4960236   7018520   2922188     37.07      2688   2227720    731164      8.19    259160   2285304      2636
12:52:29  12:30:01 PM   4952132   7014804   2930292     37.18      2688   2232096    751648      8.42    259380   2292348      2816
12:52:29  12:31:01 PM   4952740   7016724   2929684     37.17      2688   2233376    732176      8.20    259712   2292048         4
12:52:29  12:32:01 PM   4945636   7015616   2936788     37.26      2688   2239372    752088      8.42    259712   2299052      2440
12:52:29  12:33:01 PM   4941004   7015224   2941420     37.32      2688   2243636    752088      8.42    259712   2303608        32
12:52:29  12:34:01 PM   4938292   7015352   2944132     37.35      2688   2246480    752088      8.42    259712   2306324      1844
12:52:29  12:35:01 PM   4932040   7013904   2950384     37.43      2688   2251256    733052      8.21    259716   2313000       396
12:52:29  12:36:01 PM   4930656   7013584   2951768     37.45      2688   2252312    725688      8.13    259848   2314072        12
12:52:29  12:37:01 PM   4929640   7013552   2952784     37.46      2688   2253304    725688      8.13    259848   2315268       120
12:52:29  12:38:01 PM   4929316   7013600   2953108     37.46      2688   2253668    725688      8.13    259848   2315508        24
12:52:29  12:39:01 PM   4929276   7013968   2953148     37.46      2688   2254076    725688      8.13    259848   2315888       232
12:52:29  12:40:01 PM   4927896   7013388   2954528     37.48      2688   2254876    721860      8.08    259848   2316832       392
12:52:29  12:41:01 PM   4917700   7009264   2964724     37.61      2688   2260928    754756      8.45    259908   2326560       640
12:52:29  12:42:01 PM   4913612   7009968   2968812     37.66      2688   2265748    754756      8.45    259908   2330980       712
12:52:29  12:43:01 PM   4906492   7006936   2975932     37.75      2688   2269848    754756      8.45    259908   2338088       160
12:52:29  12:44:01 PM   4899592   7004968   2982832     37.84      2688   2274744    754756      8.45    259908   2345012       836
12:52:29  12:45:01 PM   4893756   7005392   2988668     37.92      2688   2280996    754756      8.45    259908   2350552      2464
12:52:29  12:46:01 PM   4894740   7008760   2987684     37.90      2688   2283380    738680      8.27    259908   2350168        56
12:52:29  12:47:01 PM   4894356   7008760   2988068     37.91      2688   2283764    738680      8.27    259908   2350548       196
12:52:29  12:48:01 PM   4895168   7009992   2987256     37.90      2688   2284192    738680      8.27    259908   2349880       200
12:52:29  12:49:01 PM   4891640   7008132   2990784     37.94      2688   2285868    738680      8.27    259908   2353116      1384
12:52:29  12:50:01 PM   4887364   7005580   2995060     38.00      2688   2287592    790796      8.85    260056   2356328       720
12:52:29  12:51:01 PM   4942952   7068528   2939472     37.29      2688   2294936    619208      6.93    260396   2301876      6756
12:52:29  12:52:01 PM   4969620   6994056   2912804     36.95      2688   2199352    699684      7.83    514672   2044300     13428
12:52:29  Average:      4957894   7023957   2924530     37.10      2688   2236166    716933      8.03    264783   2285045      9411
12:52:29  
12:52:29  12:22:01 PM     IFACE   rxpck/s   txpck/s    rxkB/s    txkB/s   rxcmp/s   txcmp/s  rxmcst/s   %ifutil
12:52:29  12:23:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:52:29  12:23:01 PM      eth0    107.65     84.41   1170.99     12.30      0.00      0.00      0.00      0.00
12:52:29  12:24:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:52:29  12:24:01 PM      eth0     17.00     12.10      6.12      4.19      0.00      0.00      0.00      0.00
12:52:29  12:25:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:52:29  12:25:01 PM      eth0    495.55    408.36    403.07     97.88      0.00      0.00      0.00      0.00
12:52:29  12:26:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:52:29  12:26:01 PM      eth0     14.55     11.26      4.18      4.90      0.00      0.00      0.00      0.00
12:52:29  12:27:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:52:29  12:27:01 PM      eth0      2.72      2.25      0.63      0.54      0.00      0.00      0.00      0.00
12:52:29  12:28:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:52:29  12:28:01 PM      eth0      2.92      2.10      0.47      0.45      0.00      0.00      0.00      0.00
12:52:29  12:29:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:52:29  12:29:01 PM      eth0     51.50     36.54     28.62      4.58      0.00      0.00      0.00      0.00
12:52:29  12:30:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:52:29  12:30:01 PM      eth0     13.11     14.08     18.68      2.29      0.00      0.00      0.00      0.00
12:52:29  12:31:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:52:29  12:31:01 PM      eth0      5.30      5.80      1.80      1.05      0.00      0.00      0.00      0.00
12:52:29  12:32:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:52:29  12:32:01 PM      eth0     32.94     32.08     31.75      4.63      0.00      0.00      0.00      0.00
12:52:29  12:33:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:52:29  12:33:01 PM      eth0     17.00     17.98     20.69      3.29      0.00      0.00      0.00      0.00
12:52:29  12:34:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:52:29  12:34:01 PM      eth0      9.25      9.65     11.91      1.53      0.00      0.00      0.00      0.00
12:52:29  12:35:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:52:29  12:35:01 PM      eth0     82.97     83.60     31.42      7.58      0.00      0.00      0.00      0.00
12:52:29  12:36:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:52:29  12:36:01 PM      eth0     56.43     53.57     11.44      4.60      0.00      0.00      0.00      0.00
12:52:29  12:37:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:52:29  12:37:01 PM      eth0     51.26     47.79     10.92      4.43      0.00      0.00      0.00      0.00
12:52:29  12:38:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:52:29  12:38:01 PM      eth0     13.35      9.53      2.74      1.83      0.00      0.00      0.00      0.00
12:52:29  12:39:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:52:29  12:39:01 PM      eth0     14.35      9.88      2.90      1.87      0.00      0.00      0.00      0.00
12:52:29  12:40:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:52:29  12:40:01 PM      eth0     15.95     14.65      6.06      1.38      0.00      0.00      0.00      0.00
12:52:29  12:41:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:52:29  12:41:01 PM      eth0    150.85    148.63     51.11     19.96      0.00      0.00      0.00      0.00
12:52:29  12:42:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:52:29  12:42:01 PM      eth0    116.93     83.49     67.04      6.35      0.00      0.00      0.00      0.00
12:52:29  12:43:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:52:29  12:43:01 PM      eth0    111.45    100.25     55.04      7.77      0.00      0.00      0.00      0.00
12:52:29  12:44:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:52:29  12:44:01 PM      eth0    108.35     68.33     66.84      5.38      0.00      0.00      0.00      0.00
12:52:29  12:45:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:52:29  12:45:01 PM      eth0     72.24     60.69     64.23      5.27      0.00      0.00      0.00      0.00
12:52:29  12:46:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:52:29  12:46:01 PM      eth0     63.94     61.16     28.47      5.60      0.00      0.00      0.00      0.00
12:52:29  12:47:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:52:29  12:47:01 PM      eth0     15.36     11.25      3.27      2.24      0.00      0.00      0.00      0.00
12:52:29  12:48:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:52:29  12:48:01 PM      eth0     14.40     10.53      3.01      2.08      0.00      0.00      0.00      0.00
12:52:29  12:49:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:52:29  12:49:01 PM      eth0     42.83     41.69     25.57      3.30      0.00      0.00      0.00      0.00
12:52:29  12:50:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:52:29  12:50:01 PM      eth0     81.36     64.56     14.68      6.57      0.00      0.00      0.00      0.00
12:52:29  12:51:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:52:29  12:51:01 PM      eth0     49.91     37.53     13.99      4.29      0.00      0.00      0.00      0.00
12:52:29  12:52:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:52:29  12:52:01 PM      eth0    115.29     78.99    237.04    153.70      0.00      0.00      0.00      0.00
12:52:29  Average:           lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:52:29  Average:         eth0     64.89     54.09     79.83     12.73      0.00      0.00      0.00      0.00
12:52:29  
12:52:29  
12:52:29  ---> sar -P ALL:
12:52:29  Linux 4.18.0-553.5.1.el8.x86_64 (centos-stream-8-robot-7d7a37eb-bc14-4dd6-9530-dc22c5eae738.noval) 	03/10/2025 	_x86_64_	(2 CPU)
12:52:29  
12:52:29  12:20:58     LINUX RESTART	(2 CPU)
12:52:29  
12:52:29  12:22:01 PM     CPU     %user     %nice   %system   %iowait    %steal     %idle
12:52:29  12:23:01 PM     all     37.26      0.00      5.50      2.52      0.10     54.62
12:52:29  12:23:01 PM       0     33.39      0.00      4.94      2.41      0.10     59.15
12:52:29  12:23:01 PM       1     41.12      0.00      6.06      2.63      0.10     50.09
12:52:29  12:24:01 PM     all      9.11      0.00      1.53      0.99      0.05     88.32
12:52:29  12:24:01 PM       0      7.48      0.00      1.32      0.60      0.05     90.54
12:52:29  12:24:01 PM       1     10.74      0.00      1.74      1.39      0.05     86.09
12:52:29  12:25:01 PM     all     27.44      0.00      5.83      1.12      0.08     65.53
12:52:29  12:25:01 PM       0     18.75      0.00      5.39      1.07      0.08     74.71
12:52:29  12:25:01 PM       1     36.16      0.00      6.26      1.17      0.08     56.31
12:52:29  12:26:01 PM     all      0.59      0.00      0.38      0.50      0.05     98.47
12:52:29  12:26:01 PM       0      0.38      0.00      0.35      0.62      0.05     98.60
12:52:29  12:26:01 PM       1      0.80      0.00      0.42      0.38      0.05     98.35
12:52:29  12:27:01 PM     all      0.33      0.00      0.08      0.00      0.04     99.55
12:52:29  12:27:01 PM       0      0.12      0.00      0.08      0.00      0.05     99.75
12:52:29  12:27:01 PM       1      0.55      0.00      0.07      0.00      0.03     99.35
12:52:29  12:28:01 PM     all      0.32      0.00      0.09      0.00      0.05     99.54
12:52:29  12:28:01 PM       0      0.23      0.00      0.10      0.00      0.03     99.63
12:52:29  12:28:01 PM       1      0.40      0.00      0.08      0.00      0.07     99.45
12:52:29  12:29:01 PM     all      7.90      0.00      1.15      0.04      0.07     90.85
12:52:29  12:29:01 PM       0      7.68      0.00      0.42      0.03      0.05     91.82
12:52:29  12:29:01 PM       1      8.12      0.00      1.87      0.05      0.08     89.87
12:52:29  12:30:01 PM     all      8.24      0.00      0.28      0.01      0.08     91.40
12:52:29  12:30:01 PM       0      1.19      0.00      0.15      0.02      0.08     98.56
12:52:29  12:30:01 PM       1     15.28      0.00      0.40      0.00      0.08     84.24
12:52:29  12:31:01 PM     all      4.10      0.00      0.22      0.00      0.08     95.61
12:52:29  12:31:01 PM       0      1.59      0.00      0.17      0.00      0.07     98.18
12:52:29  12:31:01 PM       1      6.65      0.00      0.27      0.00      0.08     93.00
12:52:29  12:32:01 PM     all     13.05      0.00      1.28      0.03      0.09     85.55
12:52:29  12:32:01 PM       0      6.13      0.00      0.37      0.00      0.10     93.40
12:52:29  12:32:01 PM       1     19.98      0.00      2.19      0.05      0.08     77.69
12:52:29  12:33:01 PM     all      8.79      0.00      0.27      0.03      0.08     90.83
12:52:29  12:33:01 PM       0      7.11      0.00      0.18      0.05      0.08     92.58
12:52:29  12:33:01 PM       1     10.48      0.00      0.35      0.00      0.08     89.09
12:52:29  
12:52:29  12:33:01 PM     CPU     %user     %nice   %system   %iowait    %steal     %idle
12:52:29  12:34:01 PM     all      6.83      0.00      0.34      0.00      0.08     92.75
12:52:29  12:34:01 PM       0      6.08      0.00      0.27      0.00      0.08     93.57
12:52:29  12:34:01 PM       1      7.58      0.00      0.41      0.00      0.08     91.93
12:52:29  12:35:01 PM     all     11.17      0.00      1.28      0.00      0.08     87.46
12:52:29  12:35:01 PM       0     10.02      0.00      1.22      0.00      0.08     88.67
12:52:29  12:35:01 PM       1     12.32      0.00      1.34      0.00      0.08     86.25
12:52:29  12:36:01 PM     all      7.13      0.00      0.66      0.00      0.08     92.13
12:52:29  12:36:01 PM       0      9.92      0.00      0.63      0.00      0.09     89.36
12:52:29  12:36:01 PM       1      4.40      0.00      0.69      0.00      0.08     94.83
12:52:29  12:37:01 PM     all      5.89      0.00      0.49      0.10      0.07     93.46
12:52:29  12:37:01 PM       0      4.01      0.00      0.37      0.02      0.07     95.53
12:52:29  12:37:01 PM       1      7.75      0.00      0.61      0.18      0.07     91.39
12:52:29  12:38:01 PM     all      4.36      0.00      0.31      0.00      0.09     95.24
12:52:29  12:38:01 PM       0      4.48      0.00      0.28      0.00      0.10     95.14
12:52:29  12:38:01 PM       1      4.24      0.00      0.33      0.00      0.08     95.34
12:52:29  12:39:01 PM     all      4.37      0.00      0.28      0.00      0.08     95.28
12:52:29  12:39:01 PM       0      1.85      0.00      0.20      0.00      0.07     97.88
12:52:29  12:39:01 PM       1      6.89      0.00      0.35      0.00      0.08     92.67
12:52:29  12:40:01 PM     all      5.83      0.00      0.52      0.00      0.08     93.57
12:52:29  12:40:01 PM       0      3.18      0.00      0.34      0.00      0.07     96.41
12:52:29  12:40:01 PM       1      8.51      0.00      0.71      0.00      0.09     90.69
12:52:29  12:41:01 PM     all     10.92      0.00      0.86      0.00      0.09     88.13
12:52:29  12:41:01 PM       0      6.21      0.00      0.81      0.00      0.08     92.90
12:52:29  12:41:01 PM       1     15.64      0.00      0.91      0.00      0.10     83.35
12:52:29  12:42:01 PM     all      7.06      0.00      0.45      0.02      0.09     92.38
12:52:29  12:42:01 PM       0      5.42      0.00      0.42      0.02      0.08     94.06
12:52:29  12:42:01 PM       1      8.70      0.00      0.49      0.02      0.10     90.70
12:52:29  12:43:01 PM     all      6.40      0.00      0.73      0.00      0.08     92.79
12:52:29  12:43:01 PM       0      5.44      0.00      0.60      0.00      0.07     93.89
12:52:29  12:43:01 PM       1      7.35      0.00      0.86      0.00      0.10     91.69
12:52:29  12:44:01 PM     all      7.45      0.00      0.44      0.01      0.09     92.00
12:52:29  12:44:01 PM       0      6.75      0.00      0.45      0.00      0.10     92.70
12:52:29  12:44:01 PM       1      8.16      0.00      0.44      0.02      0.08     91.30
12:52:29  
12:52:29  12:44:01 PM     CPU     %user     %nice   %system   %iowait    %steal     %idle
12:52:29  12:45:01 PM     all     10.36      0.00      1.50      0.03      0.09     88.02
12:52:29  12:45:01 PM       0      4.02      0.00      0.44      0.05      0.10     95.39
12:52:29  12:45:01 PM       1     16.79      0.00      2.59      0.00      0.09     80.54
12:52:29  12:46:01 PM     all      6.25      0.00      0.44      0.03      0.08     93.21
12:52:29  12:46:01 PM       0      2.91      0.00      0.37      0.05      0.08     96.58
12:52:29  12:46:01 PM       1      9.59      0.00      0.50      0.00      0.08     89.82
12:52:29  12:47:01 PM     all      4.13      0.00      0.18      0.00      0.08     95.61
12:52:29  12:47:01 PM       0      2.70      0.00      0.17      0.00      0.07     97.07
12:52:29  12:47:01 PM       1      5.57      0.00      0.20      0.00      0.08     94.15
12:52:29  12:48:01 PM     all      4.29      0.00      0.21      0.00      0.09     95.40
12:52:29  12:48:01 PM       0      5.65      0.00      0.25      0.00      0.10     94.00
12:52:29  12:48:01 PM       1      2.94      0.00      0.17      0.00      0.08     96.81
12:52:29  12:49:01 PM     all      5.77      0.00      0.50      0.00      0.07     93.67
12:52:29  12:49:01 PM       0      9.92      0.00      0.79      0.00      0.07     89.23
12:52:29  12:49:01 PM       1      1.79      0.00      0.22      0.00      0.07     97.93
12:52:29  12:50:01 PM     all      7.31      0.00      1.24      0.00      0.08     91.36
12:52:29  12:50:01 PM       0      8.77      0.00      1.46      0.00      0.08     89.68
12:52:29  12:50:01 PM       1      5.85      0.00      1.02      0.00      0.08     93.04
12:52:29  12:51:01 PM     all     11.93      0.00      0.81      0.00      0.09     87.16
12:52:29  12:51:01 PM       0     20.21      0.00      0.97      0.00      0.10     78.72
12:52:29  12:51:01 PM       1      3.66      0.00      0.65      0.00      0.08     95.60
12:52:29  12:52:01 PM     all     22.97      0.00      2.81      0.45      0.08     73.70
12:52:29  12:52:01 PM       0     13.42      0.00      2.39      0.15      0.07     83.97
12:52:29  12:52:01 PM       1     32.50      0.00      3.22      0.75      0.08     63.45
12:52:29  Average:        all      8.93      0.00      1.02      0.20      0.08     89.77
12:52:29  Average:          0      7.17      0.00      0.87      0.17      0.08     91.71
12:52:29  Average:          1     10.69      0.00      1.18      0.22      0.08     87.82
12:52:29  
12:52:29  
12:52:29