Started by upstream project "integration-distribution-mri-test-scandium" build number 14
originally caused by:
 Started by timer
Running as SYSTEM
[EnvInject] - Loading node environment variables.
Building remotely on prd-centos8-robot-2c-8g-20310 (centos8-robot-2c-8g) in workspace /w/workspace/controller-csit-3node-clustering-tell-all-scandium
[ssh-agent] Looking for ssh-agent implementation...
[ssh-agent]   Exec ssh-agent (binary ssh-agent on a remote machine)
$ ssh-agent
SSH_AUTH_SOCK=/tmp/ssh-tnAqVLz8dEZV/agent.5284
SSH_AGENT_PID=5285
[ssh-agent] Started.
Running ssh-add (command line suppressed)
Identity added: /w/workspace/controller-csit-3node-clustering-tell-all-scandium@tmp/private_key_4066486557541507510.key (/w/workspace/controller-csit-3node-clustering-tell-all-scandium@tmp/private_key_4066486557541507510.key)
[ssh-agent] Using credentials jenkins (Release Engineering Jenkins Key)
The recommended git tool is: NONE
using credential opendaylight-jenkins-ssh
Wiping out workspace first.
Cloning the remote Git repository
Cloning repository git://devvexx.opendaylight.org/mirror/integration/test
 > git init /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test # timeout=10
Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test
 > git --version # timeout=10
 > git --version # 'git version 2.43.0'
using GIT_SSH to set credentials Release Engineering Jenkins Key
[INFO] Currently running in a labeled security context
[INFO] Currently SELinux is 'enforcing' on the host
 > /usr/bin/chcon --type=ssh_home_t /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test@tmp/jenkins-gitclient-ssh1560800055147815171.key
Verifying host key using known hosts file
You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification.
 > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10
Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test
using GIT_SSH to set credentials Release Engineering Jenkins Key
[INFO] Currently running in a labeled security context
[INFO] Currently SELinux is 'enforcing' on the host
 > /usr/bin/chcon --type=ssh_home_t /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test@tmp/jenkins-gitclient-ssh7283921748457094645.key
Verifying host key using known hosts file
You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification.
 > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test master # timeout=10
 > git rev-parse FETCH_HEAD^{commit} # timeout=10
Checking out Revision b9619182128fdbcc633129519168ca8029edb080 (origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f b9619182128fdbcc633129519168ca8029edb080 # timeout=10
Commit message: "Define scandium stream"
 > git rev-parse FETCH_HEAD^{commit} # timeout=10
 > git rev-list --no-walk 84e81edbe867428cee8930673872d4d2bdf3942f # timeout=10
No emails were triggered.
provisioning config files...
copy managed file [npmrc] to file:/home/jenkins/.npmrc
copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf
copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
[controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins6360151766941829935.sh
---> python-tools-install.sh
Setup pyenv:
  system
* 3.8.13 (set by /opt/pyenv/version)
* 3.9.13 (set by /opt/pyenv/version)
* 3.10.13 (set by /opt/pyenv/version)
* 3.11.7 (set by /opt/pyenv/version)
lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-ysqr
lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: lftools 
lf-activate-venv(): INFO: Adding /tmp/venv-ysqr/bin to PATH
Generating Requirements File
Python 3.11.7
pip 24.1.2 from /tmp/venv-ysqr/lib/python3.11/site-packages/pip (python 3.11)
appdirs==1.4.4
argcomplete==3.4.0
aspy.yaml==1.3.0
attrs==23.2.0
autopage==0.5.2
beautifulsoup4==4.12.3
boto3==1.34.144
botocore==1.34.144
bs4==0.0.2
cachetools==5.3.3
certifi==2024.7.4
cffi==1.16.0
cfgv==3.4.0
chardet==5.2.0
charset-normalizer==3.3.2
click==8.1.7
cliff==4.7.0
cmd2==2.4.3
cryptography==3.3.2
debtcollector==3.0.0
decorator==5.1.1
defusedxml==0.7.1
Deprecated==1.2.14
distlib==0.3.8
dnspython==2.6.1
docker==4.2.2
dogpile.cache==1.3.3
email_validator==2.2.0
filelock==3.15.4
future==1.0.0
gitdb==4.0.11
GitPython==3.1.43
google-auth==2.32.0
httplib2==0.22.0
identify==2.6.0
idna==3.7
importlib-resources==1.5.0
iso8601==2.1.0
Jinja2==3.1.4
jmespath==1.0.1
jsonpatch==1.33
jsonpointer==3.0.0
jsonschema==4.23.0
jsonschema-specifications==2023.12.1
keystoneauth1==5.7.0
kubernetes==30.1.0
lftools==0.37.10
lxml==5.2.2
MarkupSafe==2.1.5
msgpack==1.0.8
multi_key_dict==2.0.3
munch==4.0.0
netaddr==1.3.0
netifaces==0.11.0
niet==1.4.2
nodeenv==1.9.1
oauth2client==4.1.3
oauthlib==3.2.2
openstacksdk==3.2.0
os-client-config==2.1.0
os-service-types==1.7.0
osc-lib==3.1.0
oslo.config==9.5.0
oslo.context==5.5.0
oslo.i18n==6.3.0
oslo.log==6.1.0
oslo.serialization==5.4.0
oslo.utils==7.2.0
packaging==24.1
pbr==6.0.0
platformdirs==4.2.2
prettytable==3.10.2
pyasn1==0.6.0
pyasn1_modules==0.4.0
pycparser==2.22
pygerrit2==2.0.15
PyGithub==2.3.0
PyJWT==2.8.0
PyNaCl==1.5.0
pyparsing==2.4.7
pyperclip==1.9.0
pyrsistent==0.20.0
python-cinderclient==9.5.0
python-dateutil==2.9.0.post0
python-heatclient==3.5.0
python-jenkins==1.8.2
python-keystoneclient==5.4.0
python-magnumclient==4.6.0
python-novaclient==18.6.0
python-openstackclient==6.6.0
python-swiftclient==4.6.0
PyYAML==6.0.1
referencing==0.35.1
requests==2.32.3
requests-oauthlib==2.0.0
requestsexceptions==1.4.0
rfc3986==2.0.0
rpds-py==0.19.0
rsa==4.9
ruamel.yaml==0.18.6
ruamel.yaml.clib==0.2.8
s3transfer==0.10.2
simplejson==3.19.2
six==1.16.0
smmap==5.0.1
soupsieve==2.5
stevedore==5.2.0
tabulate==0.9.0
toml==0.10.2
tomlkit==0.13.0
tqdm==4.66.4
typing_extensions==4.12.2
tzdata==2024.1
urllib3==1.26.19
virtualenv==20.26.3
wcwidth==0.2.13
websocket-client==1.8.0
wrapt==1.16.0
xdg==6.0.0
xmltodict==0.13.0
yq==3.4.3
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties content 
OS_STACK_TEMPLATE=csit-2-instance-type.yaml
OS_CLOUD=vex
OS_STACK_NAME=releng-controller-csit-3node-clustering-tell-all-scandium-14
OS_STACK_TEMPLATE_DIR=openstack-hot

[EnvInject] - Variables injected successfully.
provisioning config files...
copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
[controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins10599339667547871320.sh
---> Create parameters file for OpenStack HOT
OpenStack Heat parameters generated
-----------------------------------
parameters:
    vm_0_count: '3'
    vm_0_flavor: 'v3-standard-4'
    vm_0_image: 'ZZCI - CentOS Stream 8 - builder - x86_64 - 20240601-160217.263'
    vm_1_count: '0'
    vm_1_flavor: 'v3-standard-2'
    vm_1_image: 'ZZCI - Ubuntu 18.04 - mininet-ovs-28 - x86_64 - 20230601-180106.003'
    
    job_name: '43164-14'
    silo: 'releng'
[controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash -l /tmp/jenkins1876820963201466241.sh
---> Create HEAT stack
+ source /home/jenkins/lf-env.sh
+ lf-activate-venv --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
++ mktemp -d /tmp/venv-XXXX
+ lf_venv=/tmp/venv-TysD
+ local venv_file=/tmp/.os_lf_venv
+ local python=python3
+ local options
+ local set_path=true
+ local install_args=
++ getopt -o np:v: -l no-path,system-site-packages,python:,venv-file: -n lf-activate-venv -- --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
+ options=' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\'''
+ eval set -- ' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\'''
++ set -- --python python3 -- 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
+ true
+ case $1 in
+ python=python3
+ shift 2
+ true
+ case $1 in
+ shift
+ break
+ case $python in
+ local pkg_list=
+ [[ -d /opt/pyenv ]]
+ echo 'Setup pyenv:'
Setup pyenv:
+ export PYENV_ROOT=/opt/pyenv
+ PYENV_ROOT=/opt/pyenv
+ export PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
+ PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
+ pyenv versions
  system
  3.8.13
  3.9.13
  3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.python-version)
+ command -v pyenv
++ pyenv init - --no-rehash
+ eval 'PATH="$(bash --norc -ec '\''IFS=:; paths=($PATH); 
for i in ${!paths[@]}; do 
if [[ ${paths[i]} == "'\'''\''/opt/pyenv/shims'\'''\''" ]]; then unset '\''\'\'''\''paths[i]'\''\'\'''\''; 
fi; done; 
echo "${paths[*]}"'\'')"
export PATH="/opt/pyenv/shims:${PATH}"
export PYENV_SHELL=bash
source '\''/opt/pyenv/libexec/../completions/pyenv.bash'\''
pyenv() {
  local command
  command="${1:-}"
  if [ "$#" -gt 0 ]; then
    shift
  fi

  case "$command" in
  rehash|shell)
    eval "$(pyenv "sh-$command" "$@")"
    ;;
  *)
    command pyenv "$command" "$@"
    ;;
  esac
}'
+++ bash --norc -ec 'IFS=:; paths=($PATH); 
for i in ${!paths[@]}; do 
if [[ ${paths[i]} == "/opt/pyenv/shims" ]]; then unset '\''paths[i]'\''; 
fi; done; 
echo "${paths[*]}"'
++ PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
++ export PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
++ PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
++ export PYENV_SHELL=bash
++ PYENV_SHELL=bash
++ source /opt/pyenv/libexec/../completions/pyenv.bash
+++ complete -F _pyenv pyenv
++ lf-pyver python3
++ local py_version_xy=python3
++ local py_version_xyz=
++ awk '{ print $1 }'
++ pyenv versions
++ local command
++ command=versions
++ '[' 1 -gt 0 ']'
++ shift
++ case "$command" in
++ command pyenv versions
++ pyenv versions
++ sed 's/^[ *]* //'
++ grep -E '^[0-9.]*[0-9]$'
++ [[ ! -s /tmp/.pyenv_versions ]]
+++ grep '^3' /tmp/.pyenv_versions
+++ tail -n 1
+++ sort -V
++ py_version_xyz=3.11.7
++ [[ -z 3.11.7 ]]
++ echo 3.11.7
++ return 0
+ pyenv local 3.11.7
+ local command
+ command=local
+ '[' 2 -gt 0 ']'
+ shift
+ case "$command" in
+ command pyenv local 3.11.7
+ pyenv local 3.11.7
+ for arg in "$@"
+ case $arg in
+ pkg_list+='lftools[openstack] '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='kubernetes '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='niet '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='python-heatclient '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='python-openstackclient '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='python-magnumclient '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='yq '
+ [[ -f /tmp/.os_lf_venv ]]
++ cat /tmp/.os_lf_venv
+ lf_venv=/tmp/venv-ysqr
+ echo 'lf-activate-venv(): INFO: Reuse venv:/tmp/venv-ysqr from' file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-ysqr from file:/tmp/.os_lf_venv
+ /tmp/venv-ysqr/bin/python3 -m pip install --upgrade --quiet pip virtualenv
+ [[ -z lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq  ]]
+ echo 'lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq '
lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 
+ /tmp/venv-ysqr/bin/python3 -m pip install --upgrade --quiet --upgrade-strategy eager 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
+ type python3
+ true
+ echo 'lf-activate-venv(): INFO: Adding /tmp/venv-ysqr/bin to PATH'
lf-activate-venv(): INFO: Adding /tmp/venv-ysqr/bin to PATH
+ PATH=/tmp/venv-ysqr/bin:/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
+ return 0
+ openstack --os-cloud vex limits show --absolute
+--------------------------+---------+
| Name                     |   Value |
+--------------------------+---------+
| maxTotalInstances        |      -1 |
| maxTotalCores            |     450 |
| maxTotalRAMSize          | 1000000 |
| maxServerMeta            |     128 |
| maxImageMeta             |     128 |
| maxPersonality           |       5 |
| maxPersonalitySize       |   10240 |
| maxTotalKeypairs         |     100 |
| maxServerGroups          |      10 |
| maxServerGroupMembers    |      10 |
| maxTotalFloatingIps      |      -1 |
| maxSecurityGroups        |      -1 |
| maxSecurityGroupRules    |      -1 |
| totalRAMUsed             |  876544 |
| totalCoresUsed           |     214 |
| totalInstancesUsed       |      69 |
| totalFloatingIpsUsed     |       0 |
| totalSecurityGroupsUsed  |       0 |
| totalServerGroupsUsed    |       0 |
| maxTotalVolumes          |      -1 |
| maxTotalSnapshots        |      10 |
| maxTotalVolumeGigabytes  |    4096 |
| maxTotalBackups          |      10 |
| maxTotalBackupGigabytes  |    1000 |
| totalVolumesUsed         |       1 |
| totalGigabytesUsed       |      20 |
| totalSnapshotsUsed       |       0 |
| totalBackupsUsed         |       0 |
| totalBackupGigabytesUsed |       0 |
+--------------------------+---------+
+ pushd /opt/ciman/openstack-hot
/opt/ciman/openstack-hot /w/workspace/controller-csit-3node-clustering-tell-all-scandium
+ lftools openstack --os-cloud vex stack create releng-controller-csit-3node-clustering-tell-all-scandium-14 csit-2-instance-type.yaml /w/workspace/controller-csit-3node-clustering-tell-all-scandium/stack-parameters.yaml
Creating stack releng-controller-csit-3node-clustering-tell-all-scandium-14
Waiting to initialize infrastructure...
Stack initialization successful.
------------------------------------
Stack Details
------------------------------------
{'added': None,
 'capabilities': [],
 'created_at': '2024-07-14T00:28:34Z',
 'deleted': None,
 'deleted_at': None,
 'description': 'No description',
 'environment': None,
 'environment_files': None,
 'files': None,
 'files_container': None,
 'id': '55ba2630-0786-4d29-a3eb-7b946b6a7c3f',
 'is_rollback_disabled': True,
 'links': [{'href': 'https://orchestration.public.mtl1.vexxhost.net/v1/12c36e260d8e4bb2913965203b1b491f/stacks/releng-controller-csit-3node-clustering-tell-all-scandium-14/55ba2630-0786-4d29-a3eb-7b946b6a7c3f',
            'rel': 'self'}],
 'location': Munch({'cloud': 'vex', 'region_name': 'ca-ymq-1', 'zone': None, 'project': Munch({'id': '12c36e260d8e4bb2913965203b1b491f', 'name': '61975f2c-7c17-4d69-82fa-c3ae420ad6fd', 'domain_id': None, 'domain_name': 'Default'})}),
 'name': 'releng-controller-csit-3node-clustering-tell-all-scandium-14',
 'notification_topics': [],
 'outputs': [{'description': 'IP addresses of the 1st vm types',
              'output_key': 'vm_0_ips',
              'output_value': ['10.30.171.240',
                               '10.30.170.251',
                               '10.30.170.138']},
             {'description': 'IP addresses of the 2nd vm types',
              'output_key': 'vm_1_ips',
              'output_value': []}],
 'owner_id': ****,
 'parameters': {'OS::project_id': '12c36e260d8e4bb2913965203b1b491f',
                'OS::stack_id': '55ba2630-0786-4d29-a3eb-7b946b6a7c3f',
                'OS::stack_name': 'releng-controller-csit-3node-clustering-tell-all-scandium-14',
                'job_name': '43164-14',
                'silo': 'releng',
                'vm_0_count': '3',
                'vm_0_flavor': 'v3-standard-4',
                'vm_0_image': 'ZZCI - CentOS Stream 8 - builder - x86_64 - '
                              '20240601-160217.263',
                'vm_1_count': '0',
                'vm_1_flavor': 'v3-standard-2',
                'vm_1_image': 'ZZCI - Ubuntu 18.04 - mininet-ovs-28 - x86_64 - '
                              '20230601-180106.003'},
 'parent_id': None,
 'replaced': None,
 'status': 'CREATE_COMPLETE',
 'status_reason': 'Stack CREATE completed successfully',
 'tags': [],
 'template': None,
 'template_description': 'No description',
 'template_url': None,
 'timeout_mins': 15,
 'unchanged': None,
 'updated': None,
 'updated_at': None,
 'user_project_id': '149219e90a474990b263efc63e8bc20a'}
------------------------------------
+ popd
/w/workspace/controller-csit-3node-clustering-tell-all-scandium
[controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash -l /tmp/jenkins1118798792555204374.sh
---> Copy SSH public keys to CSIT lab
Setup pyenv:
  system
  3.8.13
  3.9.13
  3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-ysqr from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes python-heatclient python-openstackclient 
lf-activate-venv(): INFO: Adding /tmp/venv-ysqr/bin to PATH
SSH not responding on 10.30.171.240. Retrying in 10 seconds...
SSH not responding on 10.30.170.251. Retrying in 10 seconds...
SSH not responding on 10.30.170.138. Retrying in 10 seconds...
Ping to 10.30.170.251 successful.
Ping to 10.30.171.240 successful.
Ping to 10.30.170.138 successful.
SSH not responding on 10.30.170.138. Retrying in 10 seconds...
SSH not responding on 10.30.170.251. Retrying in 10 seconds...
SSH not responding on 10.30.171.240. Retrying in 10 seconds...
Ping to 10.30.170.138 successful.
Ping to 10.30.170.251 successful.
Ping to 10.30.171.240 successful.
SSH not responding on 10.30.170.251. Retrying in 10 seconds...
Warning: Permanently added '10.30.170.138' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.171.240' (ECDSA) to the list of known hosts.
10.30.171.240 releng-43164-14-0-builder-0.novalocal
Successfully copied public keys to slave 10.30.171.240
Process 6676 ready.
10.30.170.138 releng-43164-14-0-builder-2.novalocal
Successfully copied public keys to slave 10.30.170.138
Ping to 10.30.170.251 successful.
Warning: Permanently added '10.30.170.251' (ECDSA) to the list of known hosts.
10.30.170.251 releng-43164-14-0-builder-1.novalocal
Successfully copied public keys to slave 10.30.170.251
Process 6677 ready.
Process 6678 ready.
SSH ready on all stack servers.
[controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash -l /tmp/jenkins7110965420653730847.sh
Setup pyenv:
  system
  3.8.13
  3.9.13
  3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.python-version)
lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-ejP0
lf-activate-venv(): INFO: Save venv in file: /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.robot_venv
lf-activate-venv(): INFO: Installing: setuptools wheel 
lf-activate-venv(): INFO: Adding /tmp/venv-ejP0/bin to PATH
+ echo 'Installing Python Requirements'
Installing Python Requirements
+ cat
+ python -m pip install -r requirements.txt
Looking in indexes: https://nexus3.opendaylight.org/repository/PyPi/simple
Collecting docker-py (from -r requirements.txt (line 1))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/docker-py/1.10.6/docker_py-1.10.6-py2.py3-none-any.whl (50 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 50.0/50.0 kB 8.9 MB/s eta 0:00:00
Collecting ipaddr (from -r requirements.txt (line 2))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/ipaddr/2.2.0/ipaddr-2.2.0.tar.gz (26 kB)
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'done'
Collecting netaddr (from -r requirements.txt (line 3))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/netaddr/1.3.0/netaddr-1.3.0-py3-none-any.whl (2.3 MB)
Collecting netifaces (from -r requirements.txt (line 4))
  Using cached netifaces-0.11.0-cp311-cp311-linux_x86_64.whl
Collecting pyhocon (from -r requirements.txt (line 5))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyhocon/0.3.61/pyhocon-0.3.61-py3-none-any.whl (25 kB)
Collecting requests (from -r requirements.txt (line 6))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/requests/2.32.3/requests-2.32.3-py3-none-any.whl (64 kB)
Collecting robotframework (from -r requirements.txt (line 7))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework/7.0.1/robotframework-7.0.1-py3-none-any.whl (727 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 727.6/727.6 kB 16.2 MB/s eta 0:00:00
Collecting robotframework-httplibrary (from -r requirements.txt (line 8))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-httplibrary/0.4.2/robotframework-httplibrary-0.4.2.tar.gz (9.1 kB)
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'done'
Collecting robotframework-requests==0.9.7 (from -r requirements.txt (line 9))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-requests/0.9.7/robotframework_requests-0.9.7-py3-none-any.whl (21 kB)
Collecting robotframework-selenium2library (from -r requirements.txt (line 10))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-selenium2library/3.0.0/robotframework_selenium2library-3.0.0-py2.py3-none-any.whl (6.2 kB)
Collecting robotframework-sshlibrary==3.8.0 (from -r requirements.txt (line 11))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-sshlibrary/3.8.0/robotframework-sshlibrary-3.8.0.tar.gz (51 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 51.4/51.4 kB 5.9 MB/s eta 0:00:00
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'done'
Collecting scapy (from -r requirements.txt (line 12))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/scapy/2.5.0/scapy-2.5.0.tar.gz (1.3 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.3/1.3 MB 37.7 MB/s eta 0:00:00
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'done'
Collecting jsonpath-rw (from -r requirements.txt (line 15))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpath-rw/1.4.0/jsonpath-rw-1.4.0.tar.gz (13 kB)
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'done'
Collecting elasticsearch (from -r requirements.txt (line 18))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch/8.14.0/elasticsearch-8.14.0-py3-none-any.whl (480 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 480.2/480.2 kB 15.1 MB/s eta 0:00:00
Collecting elasticsearch-dsl (from -r requirements.txt (line 19))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch-dsl/8.14.0/elasticsearch_dsl-8.14.0-py3-none-any.whl (92 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 92.3/92.3 kB 11.9 MB/s eta 0:00:00
Collecting pyangbind (from -r requirements.txt (line 22))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyangbind/0.8.5/pyangbind-0.8.5-py3-none-any.whl (52 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 52.9/52.9 kB 5.9 MB/s eta 0:00:00
Collecting isodate (from -r requirements.txt (line 25))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/isodate/0.6.1/isodate-0.6.1-py2.py3-none-any.whl (41 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 41.7/41.7 kB 5.1 MB/s eta 0:00:00
Collecting jmespath (from -r requirements.txt (line 28))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jmespath/1.0.1/jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting jsonpatch (from -r requirements.txt (line 31))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpatch/1.33/jsonpatch-1.33-py2.py3-none-any.whl (12 kB)
Collecting paramiko>=1.15.3 (from robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/paramiko/3.4.0/paramiko-3.4.0-py3-none-any.whl (225 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 225.9/225.9 kB 7.2 MB/s eta 0:00:00
Collecting scp>=0.13.0 (from robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/scp/0.15.0/scp-0.15.0-py2.py3-none-any.whl (8.8 kB)
Collecting docker-pycreds>=0.2.1 (from docker-py->-r requirements.txt (line 1))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/docker-pycreds/0.4.0/docker_pycreds-0.4.0-py2.py3-none-any.whl (9.0 kB)
Collecting six>=1.4.0 (from docker-py->-r requirements.txt (line 1))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/six/1.16.0/six-1.16.0-py2.py3-none-any.whl (11 kB)
Collecting websocket-client>=0.32.0 (from docker-py->-r requirements.txt (line 1))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/websocket-client/1.8.0/websocket_client-1.8.0-py3-none-any.whl (58 kB)
Collecting pyparsing<4,>=2 (from pyhocon->-r requirements.txt (line 5))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pyparsing/3.1.2/pyparsing-3.1.2-py3-none-any.whl (103 kB)
Collecting charset-normalizer<4,>=2 (from requests->-r requirements.txt (line 6))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/charset-normalizer/3.3.2/charset_normalizer-3.3.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (140 kB)
Collecting idna<4,>=2.5 (from requests->-r requirements.txt (line 6))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/idna/3.7/idna-3.7-py3-none-any.whl (66 kB)
Collecting urllib3<3,>=1.21.1 (from requests->-r requirements.txt (line 6))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/urllib3/2.2.2/urllib3-2.2.2-py3-none-any.whl (121 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 121.4/121.4 kB 12.1 MB/s eta 0:00:00
Collecting certifi>=2017.4.17 (from requests->-r requirements.txt (line 6))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/certifi/2024.7.4/certifi-2024.7.4-py3-none-any.whl (162 kB)
Collecting webtest>=2.0 (from robotframework-httplibrary->-r requirements.txt (line 8))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/webtest/3.0.0/WebTest-3.0.0-py3-none-any.whl (31 kB)
Collecting jsonpointer (from robotframework-httplibrary->-r requirements.txt (line 8))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpointer/3.0.0/jsonpointer-3.0.0-py2.py3-none-any.whl (7.6 kB)
Collecting robotframework-seleniumlibrary>=3.0.0 (from robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-seleniumlibrary/6.5.0/robotframework_seleniumlibrary-6.5.0-py2.py3-none-any.whl (104 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 104.6/104.6 kB 13.9 MB/s eta 0:00:00
Collecting ply (from jsonpath-rw->-r requirements.txt (line 15))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/ply/3.11/ply-3.11-py2.py3-none-any.whl (49 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 49.6/49.6 kB 6.4 MB/s eta 0:00:00
Collecting decorator (from jsonpath-rw->-r requirements.txt (line 15))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/decorator/5.1.1/decorator-5.1.1-py3-none-any.whl (9.1 kB)
Collecting elastic-transport<9,>=8.13 (from elasticsearch->-r requirements.txt (line 18))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elastic-transport/8.13.1/elastic_transport-8.13.1-py3-none-any.whl (64 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 64.5/64.5 kB 8.7 MB/s eta 0:00:00
Collecting python-dateutil (from elasticsearch-dsl->-r requirements.txt (line 19))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/python-dateutil/2.9.0.post0/python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB)
Collecting typing-extensions (from elasticsearch-dsl->-r requirements.txt (line 19))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/typing-extensions/4.12.2/typing_extensions-4.12.2-py3-none-any.whl (37 kB)
Collecting pyang (from pyangbind->-r requirements.txt (line 22))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyang/2.6.1/pyang-2.6.1-py2.py3-none-any.whl (594 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 594.7/594.7 kB 43.3 MB/s eta 0:00:00
Collecting lxml (from pyangbind->-r requirements.txt (line 22))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/lxml/5.2.2/lxml-5.2.2-cp311-cp311-manylinux_2_28_x86_64.whl (5.0 MB)
Collecting regex (from pyangbind->-r requirements.txt (line 22))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/regex/2024.5.15/regex-2024.5.15-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (785 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 785.0/785.0 kB 51.9 MB/s eta 0:00:00
Collecting enum34 (from pyangbind->-r requirements.txt (line 22))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/enum34/1.1.10/enum34-1.1.10-py3-none-any.whl (11 kB)
Collecting bcrypt>=3.2 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/bcrypt/4.1.3/bcrypt-4.1.3-cp39-abi3-manylinux_2_28_x86_64.whl (283 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 283.7/283.7 kB 9.3 MB/s eta 0:00:00
Collecting cryptography>=3.3 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/cryptography/42.0.8/cryptography-42.0.8-cp39-abi3-manylinux_2_28_x86_64.whl (3.9 MB)
Collecting pynacl>=1.5 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pynacl/1.5.0/PyNaCl-1.5.0-cp36-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.manylinux_2_24_x86_64.whl (856 kB)
Collecting selenium>=4.3.0 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/selenium/4.22.0/selenium-4.22.0-py3-none-any.whl (9.4 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 9.4/9.4 MB 75.9 MB/s eta 0:00:00
Collecting robotframework-pythonlibcore>=4.4.1 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-pythonlibcore/4.4.1/robotframework_pythonlibcore-4.4.1-py2.py3-none-any.whl (12 kB)
Collecting click>=8.1.7 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/click/8.1.7/click-8.1.7-py3-none-any.whl (97 kB)
Collecting WebOb>=1.2 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/webob/1.8.7/WebOb-1.8.7-py2.py3-none-any.whl (114 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 115.0/115.0 kB 14.5 MB/s eta 0:00:00
Collecting waitress>=0.8.5 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/waitress/3.0.0/waitress-3.0.0-py3-none-any.whl (56 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 56.7/56.7 kB 6.7 MB/s eta 0:00:00
Collecting beautifulsoup4 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/beautifulsoup4/4.12.3/beautifulsoup4-4.12.3-py3-none-any.whl (147 kB)
Collecting cffi>=1.12 (from cryptography>=3.3->paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/cffi/1.16.0/cffi-1.16.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (464 kB)
Collecting trio~=0.17 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/trio/0.26.0/trio-0.26.0-py3-none-any.whl (475 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 475.7/475.7 kB 14.2 MB/s eta 0:00:00
Collecting trio-websocket~=0.9 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/trio-websocket/0.11.1/trio_websocket-0.11.1-py3-none-any.whl (17 kB)
Collecting soupsieve>1.2 (from beautifulsoup4->webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/soupsieve/2.5/soupsieve-2.5-py3-none-any.whl (36 kB)
Collecting pycparser (from cffi>=1.12->cryptography>=3.3->paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pycparser/2.22/pycparser-2.22-py3-none-any.whl (117 kB)
Collecting attrs>=23.2.0 (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/attrs/23.2.0/attrs-23.2.0-py3-none-any.whl (60 kB)
Collecting sortedcontainers (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/sortedcontainers/2.4.0/sortedcontainers-2.4.0-py2.py3-none-any.whl (29 kB)
Collecting outcome (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/outcome/1.3.0.post0/outcome-1.3.0.post0-py2.py3-none-any.whl (10 kB)
Collecting sniffio>=1.3.0 (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/sniffio/1.3.1/sniffio-1.3.1-py3-none-any.whl (10 kB)
Collecting wsproto>=0.14 (from trio-websocket~=0.9->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/wsproto/1.2.0/wsproto-1.2.0-py3-none-any.whl (24 kB)
Collecting pysocks!=1.5.7,<2.0,>=1.5.6 (from urllib3[socks]<3,>=1.26->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pysocks/1.7.1/PySocks-1.7.1-py3-none-any.whl (16 kB)
Collecting h11<1,>=0.9.0 (from wsproto>=0.14->trio-websocket~=0.9->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/h11/0.14.0/h11-0.14.0-py3-none-any.whl (58 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 58.3/58.3 kB 12.8 MB/s eta 0:00:00
Building wheels for collected packages: robotframework-sshlibrary, ipaddr, robotframework-httplibrary, scapy, jsonpath-rw
  Building wheel for robotframework-sshlibrary (setup.py): started
  Building wheel for robotframework-sshlibrary (setup.py): finished with status 'done'
  Created wheel for robotframework-sshlibrary: filename=robotframework_sshlibrary-3.8.0-py3-none-any.whl size=55116 sha256=03825cad79ca779ae04fe2b0188ef96800bac3a068f82abd9884c27b4e2d36ff
  Stored in directory: /home/jenkins/.cache/pip/wheels/f7/c9/b3/a977b7bcc410d45ae27d240df3d00a12585509180e373ecccc
  Building wheel for ipaddr (setup.py): started
  Building wheel for ipaddr (setup.py): finished with status 'done'
  Created wheel for ipaddr: filename=ipaddr-2.2.0-py3-none-any.whl size=18280 sha256=ff4c00d174f5f5e00e2d8a9e2374d08f4a86a8e6491991d2fa195717120fddd0
  Stored in directory: /home/jenkins/.cache/pip/wheels/dc/6c/04/da2d847fa8d45c59af3e1d83e2acc29cb8adcbaf04c0898dbf
  Building wheel for robotframework-httplibrary (setup.py): started
  Building wheel for robotframework-httplibrary (setup.py): finished with status 'done'
  Created wheel for robotframework-httplibrary: filename=robotframework_httplibrary-0.4.2-py3-none-any.whl size=9954 sha256=e866d9f744bd174ba8d705ac0f1e8cd9b7cfa7663b7ea8a037da7f887c5d24e9
  Stored in directory: /home/jenkins/.cache/pip/wheels/aa/bc/0d/9a20dd51effef392aae2733cb4c7b66c6fa29fca33d88b57ed
  Building wheel for scapy (setup.py): started
  Building wheel for scapy (setup.py): finished with status 'done'
  Created wheel for scapy: filename=scapy-2.5.0-py2.py3-none-any.whl size=1444328 sha256=b99be760d4c755d3ed8280224a7e9c85bcb56f779a573acb916d33a46c89e43c
  Stored in directory: /home/jenkins/.cache/pip/wheels/3b/a7/d6/87eeec31fbfcb2bd8ace7dad8172b6d6ebbe1ec6827dbb389a
  Building wheel for jsonpath-rw (setup.py): started
  Building wheel for jsonpath-rw (setup.py): finished with status 'done'
  Created wheel for jsonpath-rw: filename=jsonpath_rw-1.4.0-py3-none-any.whl size=15127 sha256=06ab46aec393f23d8d77ef5cece87594180ee0ba173500f15338c8f3eca79c0c
  Stored in directory: /home/jenkins/.cache/pip/wheels/f1/54/63/9a8da38cefae13755097b36cc852decc25d8ef69c37d58d4eb
Successfully built robotframework-sshlibrary ipaddr robotframework-httplibrary scapy jsonpath-rw
Installing collected packages: sortedcontainers, ply, netifaces, ipaddr, enum34, websocket-client, WebOb, waitress, urllib3, typing-extensions, soupsieve, sniffio, six, scapy, robotframework-pythonlibcore, robotframework, regex, pysocks, pyparsing, pycparser, netaddr, lxml, jsonpointer, jmespath, idna, h11, decorator, click, charset-normalizer, certifi, bcrypt, attrs, wsproto, requests, python-dateutil, pyhocon, pyang, outcome, jsonpath-rw, jsonpatch, isodate, elastic-transport, docker-pycreds, cffi, beautifulsoup4, webtest, trio, robotframework-requests, pynacl, pyangbind, elasticsearch, docker-py, cryptography, trio-websocket, robotframework-httplibrary, paramiko, elasticsearch-dsl, selenium, scp, robotframework-sshlibrary, robotframework-seleniumlibrary, robotframework-selenium2library
Successfully installed WebOb-1.8.7 attrs-23.2.0 bcrypt-4.1.3 beautifulsoup4-4.12.3 certifi-2024.7.4 cffi-1.16.0 charset-normalizer-3.3.2 click-8.1.7 cryptography-42.0.8 decorator-5.1.1 docker-py-1.10.6 docker-pycreds-0.4.0 elastic-transport-8.13.1 elasticsearch-8.14.0 elasticsearch-dsl-8.14.0 enum34-1.1.10 h11-0.14.0 idna-3.7 ipaddr-2.2.0 isodate-0.6.1 jmespath-1.0.1 jsonpatch-1.33 jsonpath-rw-1.4.0 jsonpointer-3.0.0 lxml-5.2.2 netaddr-1.3.0 netifaces-0.11.0 outcome-1.3.0.post0 paramiko-3.4.0 ply-3.11 pyang-2.6.1 pyangbind-0.8.5 pycparser-2.22 pyhocon-0.3.61 pynacl-1.5.0 pyparsing-3.1.2 pysocks-1.7.1 python-dateutil-2.9.0.post0 regex-2024.5.15 requests-2.32.3 robotframework-7.0.1 robotframework-httplibrary-0.4.2 robotframework-pythonlibcore-4.4.1 robotframework-requests-0.9.7 robotframework-selenium2library-3.0.0 robotframework-seleniumlibrary-6.5.0 robotframework-sshlibrary-3.8.0 scapy-2.5.0 scp-0.15.0 selenium-4.22.0 six-1.16.0 sniffio-1.3.1 sortedcontainers-2.4.0 soupsieve-2.5 trio-0.26.0 trio-websocket-0.11.1 typing-extensions-4.12.2 urllib3-2.2.2 waitress-3.0.0 websocket-client-1.8.0 webtest-3.0.0 wsproto-1.2.0
+ pip freeze
attrs==23.2.0
bcrypt==4.1.3
beautifulsoup4==4.12.3
certifi==2024.7.4
cffi==1.16.0
charset-normalizer==3.3.2
click==8.1.7
cryptography==42.0.8
decorator==5.1.1
distlib==0.3.8
docker-py==1.10.6
docker-pycreds==0.4.0
elastic-transport==8.13.1
elasticsearch==8.14.0
elasticsearch-dsl==8.14.0
enum34==1.1.10
filelock==3.15.4
h11==0.14.0
idna==3.7
ipaddr==2.2.0
isodate==0.6.1
jmespath==1.0.1
jsonpatch==1.33
jsonpath-rw==1.4.0
jsonpointer==3.0.0
lxml==5.2.2
netaddr==1.3.0
netifaces==0.11.0
outcome==1.3.0.post0
paramiko==3.4.0
platformdirs==4.2.2
ply==3.11
pyang==2.6.1
pyangbind==0.8.5
pycparser==2.22
pyhocon==0.3.61
PyNaCl==1.5.0
pyparsing==3.1.2
PySocks==1.7.1
python-dateutil==2.9.0.post0
regex==2024.5.15
requests==2.32.3
robotframework==7.0.1
robotframework-httplibrary==0.4.2
robotframework-pythonlibcore==4.4.1
robotframework-requests==0.9.7
robotframework-selenium2library==3.0.0
robotframework-seleniumlibrary==6.5.0
robotframework-sshlibrary==3.8.0
scapy==2.5.0
scp==0.15.0
selenium==4.22.0
six==1.16.0
sniffio==1.3.1
sortedcontainers==2.4.0
soupsieve==2.5
trio==0.26.0
trio-websocket==0.11.1
typing_extensions==4.12.2
urllib3==2.2.2
virtualenv==20.26.3
waitress==3.0.0
WebOb==1.8.7
websocket-client==1.8.0
WebTest==3.0.0
wsproto==1.2.0
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties file path 'env.properties'
[EnvInject] - Variables injected successfully.
[controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash -l /tmp/jenkins7920893456657871302.sh
Setup pyenv:
  system
  3.8.13
  3.9.13
  3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-ysqr from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: python-heatclient python-openstackclient yq 
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
lftools 0.37.10 requires urllib3<2.1.0, but you have urllib3 2.2.2 which is incompatible.
lf-activate-venv(): INFO: Adding /tmp/venv-ysqr/bin to PATH
+ ODL_SYSTEM=()
+ TOOLS_SYSTEM=()
+ OPENSTACK_SYSTEM=()
+ OPENSTACK_CONTROLLERS=()
+ mapfile -t ADDR
++ openstack stack show -f json -c outputs releng-controller-csit-3node-clustering-tell-all-scandium-14
++ jq -r '.outputs[] | select(.output_key | match("^vm_[0-9]+_ips$")) | .output_value | .[]'
+ for i in "${ADDR[@]}"
++ ssh 10.30.171.240 hostname -s
Warning: Permanently added '10.30.171.240' (ECDSA) to the list of known hosts.
+ REMHOST=releng-43164-14-0-builder-0
+ case ${REMHOST} in
+ ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}")
+ for i in "${ADDR[@]}"
++ ssh 10.30.170.251 hostname -s
Warning: Permanently added '10.30.170.251' (ECDSA) to the list of known hosts.
+ REMHOST=releng-43164-14-0-builder-1
+ case ${REMHOST} in
+ ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}")
+ for i in "${ADDR[@]}"
++ ssh 10.30.170.138 hostname -s
Warning: Permanently added '10.30.170.138' (ECDSA) to the list of known hosts.
+ REMHOST=releng-43164-14-0-builder-2
+ case ${REMHOST} in
+ ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}")
+ echo NUM_ODL_SYSTEM=3
+ echo NUM_TOOLS_SYSTEM=0
+ '[' '' == yes ']'
+ NUM_OPENSTACK_SYSTEM=0
+ echo NUM_OPENSTACK_SYSTEM=0
+ '[' 0 -eq 2 ']'
+ echo ODL_SYSTEM_IP=10.30.171.240
++ seq 0 2
+ for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 )))
+ echo ODL_SYSTEM_1_IP=10.30.171.240
+ for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 )))
+ echo ODL_SYSTEM_2_IP=10.30.170.251
+ for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 )))
+ echo ODL_SYSTEM_3_IP=10.30.170.138
+ echo TOOLS_SYSTEM_IP=
++ seq 0 -1
+ openstack_index=0
+ NUM_OPENSTACK_CONTROL_NODES=1
+ echo NUM_OPENSTACK_CONTROL_NODES=1
++ seq 0 0
+ for i in $(seq 0 $((NUM_OPENSTACK_CONTROL_NODES - 1)))
+ echo OPENSTACK_CONTROL_NODE_1_IP=
+ NUM_OPENSTACK_COMPUTE_NODES=-1
+ echo NUM_OPENSTACK_COMPUTE_NODES=-1
+ '[' -1 -ge 2 ']'
++ seq 0 -2
+ NUM_OPENSTACK_HAPROXY_NODES=0
+ echo NUM_OPENSTACK_HAPROXY_NODES=0
++ seq 0 -1
+ echo 'Contents of slave_addresses.txt:'
Contents of slave_addresses.txt:
+ cat slave_addresses.txt
NUM_ODL_SYSTEM=3
NUM_TOOLS_SYSTEM=0
NUM_OPENSTACK_SYSTEM=0
ODL_SYSTEM_IP=10.30.171.240
ODL_SYSTEM_1_IP=10.30.171.240
ODL_SYSTEM_2_IP=10.30.170.251
ODL_SYSTEM_3_IP=10.30.170.138
TOOLS_SYSTEM_IP=
NUM_OPENSTACK_CONTROL_NODES=1
OPENSTACK_CONTROL_NODE_1_IP=
NUM_OPENSTACK_COMPUTE_NODES=-1
NUM_OPENSTACK_HAPROXY_NODES=0
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties file path 'slave_addresses.txt'
[EnvInject] - Variables injected successfully.
[controller-csit-3node-clustering-tell-all-scandium] $ /bin/sh /tmp/jenkins2234979995922875641.sh
Preparing for JRE Version 17
Karaf artifact is karaf
Karaf project is integration
Java home is /usr/lib/jvm/java-17-openjdk
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties file path 'set_variables.env'
[EnvInject] - Variables injected successfully.
[controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins18221945683122192599.sh
--2024-07-14 00:30:24--  http://git.opendaylight.org/gerrit/gitweb?p=integration/distribution.git;a=blob_plain;f=pom.xml;hb=refs/heads/master
Resolving git.opendaylight.org (git.opendaylight.org)... 13.39.230.180, 35.181.223.58, 52.47.161.242, ...
Connecting to git.opendaylight.org (git.opendaylight.org)|13.39.230.180|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 2620 (2.6K) [text/plain]
Saving to: ‘pom.xml’

     0K ..                                                    100%  352M=0s

2024-07-14 00:30:24 (352 MB/s) - ‘pom.xml’ saved [2620/2620]

Bundle version is 0.21.0-SNAPSHOT
--2024-07-14 00:30:25--  https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.0-SNAPSHOT/maven-metadata.xml
Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6
Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 1410 (1.4K) [application/xml]
Saving to: ‘maven-metadata.xml’

     0K .                                                     100% 76.4M=0s

2024-07-14 00:30:25 (76.4 MB/s) - ‘maven-metadata.xml’ saved [1410/1410]

<?xml version="1.0" encoding="UTF-8"?>
<metadata modelVersion="1.1.0">
  <groupId>org.opendaylight.integration</groupId>
  <artifactId>karaf</artifactId>
  <version>0.21.0-SNAPSHOT</version>
  <versioning>
    <snapshot>
      <timestamp>20240713.213108</timestamp>
      <buildNumber>566</buildNumber>
    </snapshot>
    <lastUpdated>20240713213108</lastUpdated>
    <snapshotVersions>
      <snapshotVersion>
        <extension>pom</extension>
        <value>0.21.0-20240713.213108-566</value>
        <updated>20240713213108</updated>
      </snapshotVersion>
      <snapshotVersion>
        <extension>tar.gz</extension>
        <value>0.21.0-20240713.213108-566</value>
        <updated>20240713213108</updated>
      </snapshotVersion>
      <snapshotVersion>
        <extension>zip</extension>
        <value>0.21.0-20240713.213108-566</value>
        <updated>20240713213108</updated>
      </snapshotVersion>
      <snapshotVersion>
        <classifier>cyclonedx</classifier>
        <extension>xml</extension>
        <value>0.21.0-20240713.213108-566</value>
        <updated>20240713213108</updated>
      </snapshotVersion>
      <snapshotVersion>
        <classifier>cyclonedx</classifier>
        <extension>json</extension>
        <value>0.21.0-20240713.213108-566</value>
        <updated>20240713213108</updated>
      </snapshotVersion>
    </snapshotVersions>
  </versioning>
</metadata>
Nexus timestamp is 0.21.0-20240713.213108-566
Distribution bundle URL is https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.0-SNAPSHOT/karaf-0.21.0-20240713.213108-566.zip
Distribution bundle is karaf-0.21.0-20240713.213108-566.zip
Distribution bundle version is 0.21.0-SNAPSHOT
Distribution folder is karaf-0.21.0-SNAPSHOT
Nexus prefix is https://nexus.opendaylight.org
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties file path 'detect_variables.env'
[EnvInject] - Variables injected successfully.
[controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash -l /tmp/jenkins6839999757008039361.sh
Setup pyenv:
  system
  3.8.13
  3.9.13
  3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-ysqr from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: python-heatclient python-openstackclient 
lf-activate-venv(): INFO: Adding /tmp/venv-ysqr/bin to PATH
Copying common-functions.sh to /tmp
Copying common-functions.sh to 10.30.171.240:/tmp
Warning: Permanently added '10.30.171.240' (ECDSA) to the list of known hosts.
Copying common-functions.sh to 10.30.170.251:/tmp
Warning: Permanently added '10.30.170.251' (ECDSA) to the list of known hosts.
Copying common-functions.sh to 10.30.170.138:/tmp
Warning: Permanently added '10.30.170.138' (ECDSA) to the list of known hosts.
[controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins6416313275650960437.sh
common-functions.sh is being sourced
common-functions environment:
MAVENCONF: /tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
ACTUALFEATURES: 
FEATURESCONF: /tmp/karaf-0.21.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
CUSTOMPROP: /tmp/karaf-0.21.0-SNAPSHOT/etc/custom.properties
LOGCONF: /tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
MEMCONF: /tmp/karaf-0.21.0-SNAPSHOT/bin/setenv
CONTROLLERMEM: 2048m
AKKACONF: /tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/akka.conf
MODULESCONF: /tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/modules.conf
MODULESHARDSCONF: /tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/module-shards.conf
SUITES: 

#################################################
##         Configure Cluster and Start         ##
#################################################
ACTUALFEATURES: odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app
SPACE_SEPARATED_FEATURES: odl-integration-compatible-with-all odl-jolokia odl-restconf odl-clustering-test-app
Locating script plan to use...
script plan exists!!!
Changing the script plan path...
# Place the scripts in run order:
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/scripts/car_people_shard.sh
Executing /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/scripts/car_people_shard.sh...
Add car-people shards file
Copy shard config to member-1 with IP address 10.30.171.240
Warning: Permanently added '10.30.171.240' (ECDSA) to the list of known hosts.
Copy shard config to member-2 with IP address 10.30.170.251
Warning: Permanently added '10.30.170.251' (ECDSA) to the list of known hosts.
Copy shard config to member-3 with IP address 10.30.170.138
Warning: Permanently added '10.30.170.138' (ECDSA) to the list of known hosts.
Finished running script plans
Configuring member-1 with IP address 10.30.171.240
Warning: Permanently added '10.30.171.240' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.171.240' (ECDSA) to the list of known hosts.
+ source /tmp/common-functions.sh karaf-0.21.0-SNAPSHOT
++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]]
common-functions.sh is being sourced
++ echo 'common-functions.sh is being sourced'
++ BUNDLEFOLDER=karaf-0.21.0-SNAPSHOT
++ export MAVENCONF=/tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
++ MAVENCONF=/tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
++ export FEATURESCONF=/tmp/karaf-0.21.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
++ FEATURESCONF=/tmp/karaf-0.21.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
++ export CUSTOMPROP=/tmp/karaf-0.21.0-SNAPSHOT/etc/custom.properties
++ CUSTOMPROP=/tmp/karaf-0.21.0-SNAPSHOT/etc/custom.properties
++ export LOGCONF=/tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
++ LOGCONF=/tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
++ export MEMCONF=/tmp/karaf-0.21.0-SNAPSHOT/bin/setenv
++ MEMCONF=/tmp/karaf-0.21.0-SNAPSHOT/bin/setenv
++ export CONTROLLERMEM=
++ CONTROLLERMEM=
++ export AKKACONF=/tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/akka.conf
++ AKKACONF=/tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/akka.conf
++ export MODULESCONF=/tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/modules.conf
++ MODULESCONF=/tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/modules.conf
++ export MODULESHARDSCONF=/tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/module-shards.conf
++ MODULESHARDSCONF=/tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/module-shards.conf
++ print_common_env
++ cat
common-functions environment:
MAVENCONF: /tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
ACTUALFEATURES: 
FEATURESCONF: /tmp/karaf-0.21.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
CUSTOMPROP: /tmp/karaf-0.21.0-SNAPSHOT/etc/custom.properties
LOGCONF: /tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
MEMCONF: /tmp/karaf-0.21.0-SNAPSHOT/bin/setenv
CONTROLLERMEM: 
AKKACONF: /tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/akka.conf
MODULESCONF: /tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/modules.conf
MODULESHARDSCONF: /tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/module-shards.conf
SUITES: 

++ SSH='ssh -t -t'
++ extra_services_cntl='     dnsmasq.service     httpd.service     libvirtd.service     openvswitch.service     ovs-vswitchd.service     ovsdb-server.service     rabbitmq-server.service '
++ extra_services_cmp='     libvirtd.service     openvswitch.service     ovs-vswitchd.service     ovsdb-server.service '
Changing to /tmp
+ echo 'Changing to /tmp'
+ cd /tmp
Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.0-SNAPSHOT/karaf-0.21.0-20240713.213108-566.zip
+ echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.0-SNAPSHOT/karaf-0.21.0-20240713.213108-566.zip'
+ wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.0-SNAPSHOT/karaf-0.21.0-20240713.213108-566.zip
--2024-07-14 00:30:35--  https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.0-SNAPSHOT/karaf-0.21.0-20240713.213108-566.zip
Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6
Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 290595168 (277M) [application/zip]
Saving to: ‘karaf-0.21.0-20240713.213108-566.zip’

     0K ........ ........ ........ ........ ........ ........  1% 25.5M 11s
  3072K ........ ........ ........ ........ ........ ........  2% 45.3M 8s
  6144K ........ ........ ........ ........ ........ ........  3% 45.6M 7s
  9216K ........ ........ ........ ........ ........ ........  4% 27.9M 8s
 12288K ........ ........ ........ ........ ........ ........  5% 56.3M 7s
 15360K ........ ........ ........ ........ ........ ........  6% 74.8M 6s
 18432K ........ ........ ........ ........ ........ ........  7% 88.8M 6s
 21504K ........ ........ ........ ........ ........ ........  8%  102M 5s
 24576K ........ ........ ........ ........ ........ ........  9%  114M 5s
 27648K ........ ........ ........ ........ ........ ........ 10%  136M 5s
 30720K ........ ........ ........ ........ ........ ........ 11%  140M 4s
 33792K ........ ........ ........ ........ ........ ........ 12%  141M 4s
 36864K ........ ........ ........ ........ ........ ........ 14% 83.6M 4s
 39936K ........ ........ ........ ........ ........ ........ 15%  152M 4s
 43008K ........ ........ ........ ........ ........ ........ 16%  154M 4s
 46080K ........ ........ ........ ........ ........ ........ 17%  136M 3s
 49152K ........ ........ ........ ........ ........ ........ 18%  156M 3s
 52224K ........ ........ ........ ........ ........ ........ 19%  131M 3s
 55296K ........ ........ ........ ........ ........ ........ 20%  127M 3s
 58368K ........ ........ ........ ........ ........ ........ 21%  120M 3s
 61440K ........ ........ ........ ........ ........ ........ 22%  126M 3s
 64512K ........ ........ ........ ........ ........ ........ 23% 82.2M 3s
 67584K ........ ........ ........ ........ ........ ........ 24%  139M 3s
 70656K ........ ........ ........ ........ ........ ........ 25%  127M 3s
 73728K ........ ........ ........ ........ ........ ........ 27%  128M 2s
 76800K ........ ........ ........ ........ ........ ........ 28%  132M 2s
 79872K ........ ........ ........ ........ ........ ........ 29%  129M 2s
 82944K ........ ........ ........ ........ ........ ........ 30%  121M 2s
 86016K ........ ........ ........ ........ ........ ........ 31%  151M 2s
 89088K ........ ........ ........ ........ ........ ........ 32%  235M 2s
 92160K ........ ........ ........ ........ ........ ........ 33%  258M 2s
 95232K ........ ........ ........ ........ ........ ........ 34%  242M 2s
 98304K ........ ........ ........ ........ ........ ........ 35%  284M 2s
101376K ........ ........ ........ ........ ........ ........ 36%  277M 2s
104448K ........ ........ ........ ........ ........ ........ 37%  236M 2s
107520K ........ ........ ........ ........ ........ ........ 38%  275M 2s
110592K ........ ........ ........ ........ ........ ........ 40%  243M 2s
113664K ........ ........ ........ ........ ........ ........ 41%  242M 2s
116736K ........ ........ ........ ........ ........ ........ 42%  264M 2s
119808K ........ ........ ........ ........ ........ ........ 43%  265M 1s
122880K ........ ........ ........ ........ ........ ........ 44%  300M 1s
125952K ........ ........ ........ ........ ........ ........ 45%  234M 1s
129024K ........ ........ ........ ........ ........ ........ 46%  282M 1s
132096K ........ ........ ........ ........ ........ ........ 47%  258M 1s
135168K ........ ........ ........ ........ ........ ........ 48%  214M 1s
138240K ........ ........ ........ ........ ........ ........ 49%  312M 1s
141312K ........ ........ ........ ........ ........ ........ 50%  262M 1s
144384K ........ ........ ........ ........ ........ ........ 51%  255M 1s
147456K ........ ........ ........ ........ ........ ........ 53%  291M 1s
150528K ........ ........ ........ ........ ........ ........ 54%  287M 1s
153600K ........ ........ ........ ........ ........ ........ 55%  276M 1s
156672K ........ ........ ........ ........ ........ ........ 56%  276M 1s
159744K ........ ........ ........ ........ ........ ........ 57%  285M 1s
162816K ........ ........ ........ ........ ........ ........ 58%  272M 1s
165888K ........ ........ ........ ........ ........ ........ 59%  283M 1s
168960K ........ ........ ........ ........ ........ ........ 60%  292M 1s
172032K ........ ........ ........ ........ ........ ........ 61%  285M 1s
175104K ........ ........ ........ ........ ........ ........ 62%  263M 1s
178176K ........ ........ ........ ........ ........ ........ 63%  307M 1s
181248K ........ ........ ........ ........ ........ ........ 64%  289M 1s
184320K ........ ........ ........ ........ ........ ........ 66%  284M 1s
187392K ........ ........ ........ ........ ........ ........ 67% 68.0M 1s
190464K ........ ........ ........ ........ ........ ........ 68%  270M 1s
193536K ........ ........ ........ ........ ........ ........ 69%  280M 1s
196608K ........ ........ ........ ........ ........ ........ 70%  280M 1s
199680K ........ ........ ........ ........ ........ ........ 71%  271M 1s
202752K ........ ........ ........ ........ ........ ........ 72%  262M 1s
205824K ........ ........ ........ ........ ........ ........ 73%  300M 1s
208896K ........ ........ ........ ........ ........ ........ 74%  289M 1s
211968K ........ ........ ........ ........ ........ ........ 75%  287M 0s
215040K ........ ........ ........ ........ ........ ........ 76%  298M 0s
218112K ........ ........ ........ ........ ........ ........ 77%  280M 0s
221184K ........ ........ ........ ........ ........ ........ 79%  297M 0s
224256K ........ ........ ........ ........ ........ ........ 80%  286M 0s
227328K ........ ........ ........ ........ ........ ........ 81%  287M 0s
230400K ........ ........ ........ ........ ........ ........ 82%  288M 0s
233472K ........ ........ ........ ........ ........ ........ 83%  279M 0s
236544K ........ ........ ........ ........ ........ ........ 84%  279M 0s
239616K ........ ........ ........ ........ ........ ........ 85%  274M 0s
242688K ........ ........ ........ ........ ........ ........ 86%  290M 0s
245760K ........ ........ ........ ........ ........ ........ 87%  287M 0s
248832K ........ ........ ........ ........ ........ ........ 88%  283M 0s
251904K ........ ........ ........ ........ ........ ........ 89%  286M 0s
254976K ........ ........ ........ ........ ........ ........ 90%  282M 0s
258048K ........ ........ ........ ........ ........ ........ 92%  294M 0s
261120K ........ ........ ........ ........ ........ ........ 93%  283M 0s
264192K ........ ........ ........ ........ ........ ........ 94%  278M 0s
267264K ........ ........ ........ ........ ........ ........ 95%  244M 0s
270336K ........ ........ ........ ........ ........ ........ 96%  265M 0s
273408K ........ ........ ........ ........ ........ ........ 97%  273M 0s
276480K ........ ........ ........ ........ ........ ........ 98%  273M 0s
279552K ........ ........ ........ ........ ........ ........ 99%  277M 0s
282624K ........ ........ ..                                 100%  295M=1.7s

2024-07-14 00:30:37 (159 MB/s) - ‘karaf-0.21.0-20240713.213108-566.zip’ saved [290595168/290595168]

Extracting the new controller...
+ echo 'Extracting the new controller...'
+ unzip -q karaf-0.21.0-20240713.213108-566.zip
Adding external repositories...
+ echo 'Adding external repositories...'
+ sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
+ cat /tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
################################################################################
#
#    Licensed to the Apache Software Foundation (ASF) under one or more
#    contributor license agreements.  See the NOTICE file distributed with
#    this work for additional information regarding copyright ownership.
#    The ASF licenses this file to You under the Apache License, Version 2.0
#    (the "License"); you may not use this file except in compliance with
#    the License.  You may obtain a copy of the License at
#
#       http://www.apache.org/licenses/LICENSE-2.0
#
#    Unless required by applicable law or agreed to in writing, software
#    distributed under the License is distributed on an "AS IS" BASIS,
#    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
#    See the License for the specific language governing permissions and
#    limitations under the License.
#
################################################################################

#
# If set to true, the following property will not allow any certificate to be used
# when accessing Maven repositories through SSL
#
#org.ops4j.pax.url.mvn.certificateCheck=

#
# Path to the local Maven settings file.
# The repositories defined in this file will be automatically added to the list
# of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property
# below is not set.
# The following locations are checked for the existence of the settings.xml file
#   * 1. looks for the specified url
#   * 2. if not found looks for ${user.home}/.m2/settings.xml
#   * 3. if not found looks for ${maven.home}/conf/settings.xml
#   * 4. if not found looks for ${M2_HOME}/conf/settings.xml
#
#org.ops4j.pax.url.mvn.settings=

#
# Path to the local Maven repository which is used to avoid downloading
# artifacts when they already exist locally.
# The value of this property will be extracted from the settings.xml file
# above, or defaulted to:
#     System.getProperty( "user.home" ) + "/.m2/repository"
#
org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository}

#
# Default this to false. It's just weird to use undocumented repos
#
org.ops4j.pax.url.mvn.useFallbackRepositories=false

#
# Uncomment if you don't wanna use the proxy settings
# from the Maven conf/settings.xml file
#
# org.ops4j.pax.url.mvn.proxySupport=false

#
# Comma separated list of repositories scanned when resolving an artifact.
# Those repositories will be checked before iterating through the
#    below list of repositories and even before the local repository
# A repository url can be appended with zero or more of the following flags:
#    @snapshots  : the repository contains snaphots
#    @noreleases : the repository does not contain any released artifacts
#
# The following property value will add the system folder as a repo.
#
org.ops4j.pax.url.mvn.defaultRepositories=\
    file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\
    file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\
    file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots

# Use the default local repo (e.g.~/.m2/repository) as a "remote" repo
#org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false

#
# Comma separated list of repositories scanned when resolving an artifact.
# The default list includes the following repositories:
#    http://repo1.maven.org/maven2@id=central
#    http://repository.springsource.com/maven/bundles/release@id=spring.ebr
#    http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external
#    http://zodiac.springsource.com/maven/bundles/release@id=gemini
#    http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases
#    https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases
#    https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
# To add repositories to the default ones, prepend '+' to the list of repositories
# to add.
# A repository url can be appended with zero or more of the following flags:
#    @snapshots  : the repository contains snapshots
#    @noreleases : the repository does not contain any released artifacts
#    @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended
#
org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases

### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.Configuring the startup features...
+ [[ True == \T\r\u\e ]]
+ echo 'Configuring the startup features...'
+ sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.21.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
+ FEATURE_TEST_STRING=features-test
+ FEATURE_TEST_VERSION=0.21.0-SNAPSHOT
+ KARAF_VERSION=karaf4
+ [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]]
+ sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.21.0-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.21.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
+ [[ ! -z '' ]]
+ cat /tmp/karaf-0.21.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
################################################################################
#
#    Licensed to the Apache Software Foundation (ASF) under one or more
#    contributor license agreements.  See the NOTICE file distributed with
#    this work for additional information regarding copyright ownership.
#    The ASF licenses this file to You under the Apache License, Version 2.0
#    (the "License"); you may not use this file except in compliance with
#    the License.  You may obtain a copy of the License at
#
#       http://www.apache.org/licenses/LICENSE-2.0
#
#    Unless required by applicable law or agreed to in writing, software
#    distributed under the License is distributed on an "AS IS" BASIS,
#    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
#    See the License for the specific language governing permissions and
#    limitations under the License.
#
################################################################################

#
# Comma separated list of features repositories to register by default
#
featuresRepositories = mvn:org.opendaylight.integration/features-test/0.21.0-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/08493256-6265-4383-ab30-d45ce4e978f5.xml

#
# Comma separated list of features to install at startup
#
featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, 49b78555-1641-42ff-9274-1e872c373654

#
# Resource repositories (OBR) that the features resolver can use
# to resolve requirements/capabilities
#
# The format of the resourceRepositories is 
# resourceRepositories=[xml:url|json:url],...
# for Instance:
#
#resourceRepositories=xml:http://host/path/to/index.xml
# or
#resourceRepositories=json:http://host/path/to/index.json
#

#
# Defines if the boot features are started in asynchronous mode (in a dedicated thread)
#
featuresBootAsynchronous=false

#
# Service requirements enforcement
#
# By default, the feature resolver checks the service requirements/capabilities of
# bundles for new features (xml schema >= 1.3.0) in order to automatically installs
# the required bundles.
# The following flag can have those values:
#   - disable: service requirements are completely ignored
#   - default: service requirements are ignored for old features
#   - enforce: service requirements are always verified
#
#serviceRequirements=default

#
# Store cfg file for config element in feature
#
#configCfgStore=true

#
# Define if the feature service automatically refresh bundles
#
autoRefresh=true

#
# Configuration of features processing mechanism (overrides, blacklisting, modification of features)
# XML file defines instructions related to features processing
# versions.properties may declare properties to resolve placeholders in XML file
# both files are relative to ${karaf.etc}
#
#featureProcessing=org.apache.karaf.features.xml
#featureProcessingVersions=versions.properties
+ configure_karaf_log karaf4 ''
+ local -r karaf_version=karaf4
+ local -r controllerdebugmap=
+ local logapi=log4j
+ grep log4j2 /tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
log4j2.rootLogger.level = INFO
#log4j2.rootLogger.type = asyncRoot
#log4j2.rootLogger.includeLocation = false
log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
log4j2.rootLogger.appenderRef.Console.ref = Console
log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
log4j2.logger.spifly.name = org.apache.aries.spifly
log4j2.logger.spifly.level = WARN
log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
log4j2.logger.audit.level = INFO
log4j2.logger.audit.additivity = false
log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
# Console appender not used by default (see log4j2.rootLogger.appenderRefs)
log4j2.appender.console.type = Console
log4j2.appender.console.name = Console
log4j2.appender.console.layout.type = PatternLayout
log4j2.appender.console.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.type = RollingRandomAccessFile
log4j2.appender.rolling.name = RollingFile
log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
#log4j2.appender.rolling.immediateFlush = false
log4j2.appender.rolling.append = true
log4j2.appender.rolling.layout.type = PatternLayout
log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.policies.type = Policies
log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.rolling.policies.size.size = 64MB
log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
log4j2.appender.rolling.strategy.max = 7
log4j2.appender.audit.type = RollingRandomAccessFile
log4j2.appender.audit.name = AuditRollingFile
log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
log4j2.appender.audit.append = true
log4j2.appender.audit.layout.type = PatternLayout
log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
log4j2.appender.audit.policies.type = Policies
log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.audit.policies.size.size = 8MB
log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
log4j2.appender.audit.strategy.max = 7
log4j2.appender.osgi.type = PaxOsgi
log4j2.appender.osgi.name = PaxOsgi
log4j2.appender.osgi.filter = *
#log4j2.logger.aether.name = shaded.org.eclipse.aether
#log4j2.logger.aether.level = TRACE
#log4j2.logger.http-headers.name = shaded.org.apache.http.headers
#log4j2.logger.http-headers.level = DEBUG
#log4j2.logger.maven.name = org.ops4j.pax.url.mvn
#log4j2.logger.maven.level = TRACE
Configuring the karaf log... karaf_version: karaf4, logapi: log4j2
+ logapi=log4j2
+ echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2'
+ '[' log4j2 == log4j2 ']'
+ sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
+ orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver
+ orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver
+ echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN'
controllerdebugmap: 
+ echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN'
+ unset IFS
+ echo 'controllerdebugmap: '
cat /tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
+ '[' -n '' ']'
+ echo 'cat /tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg'
+ cat /tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
################################################################################
#
#    Licensed to the Apache Software Foundation (ASF) under one or more
#    contributor license agreements.  See the NOTICE file distributed with
#    this work for additional information regarding copyright ownership.
#    The ASF licenses this file to You under the Apache License, Version 2.0
#    (the "License"); you may not use this file except in compliance with
#    the License.  You may obtain a copy of the License at
#
#       http://www.apache.org/licenses/LICENSE-2.0
#
#    Unless required by applicable law or agreed to in writing, software
#    distributed under the License is distributed on an "AS IS" BASIS,
#    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
#    See the License for the specific language governing permissions and
#    limitations under the License.
#
################################################################################

# Common pattern layout for appenders
log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n

# Root logger
log4j2.rootLogger.level = INFO
# uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library
#log4j2.rootLogger.type = asyncRoot
#log4j2.rootLogger.includeLocation = false
log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
log4j2.rootLogger.appenderRef.Console.ref = Console
log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}

# Filters for logs marked by org.opendaylight.odlparent.Markers
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL

# Loggers configuration

# Spifly logger
log4j2.logger.spifly.name = org.apache.aries.spifly
log4j2.logger.spifly.level = WARN

# Security audit logger
log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
log4j2.logger.audit.level = INFO
log4j2.logger.audit.additivity = false
log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile

# Appenders configuration

# Console appender not used by default (see log4j2.rootLogger.appenderRefs)
log4j2.appender.console.type = Console
log4j2.appender.console.name = Console
log4j2.appender.console.layout.type = PatternLayout
log4j2.appender.console.layout.pattern = ${log4j2.pattern}

# Rolling file appender
log4j2.appender.rolling.type = RollingRandomAccessFile
log4j2.appender.rolling.name = RollingFile
log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
# uncomment to not force a disk flush
#log4j2.appender.rolling.immediateFlush = false
log4j2.appender.rolling.append = true
log4j2.appender.rolling.layout.type = PatternLayout
log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.policies.type = Policies
log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.rolling.policies.size.size = 1GB
log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
log4j2.appender.rolling.strategy.max = 7

# Audit file appender
log4j2.appender.audit.type = RollingRandomAccessFile
log4j2.appender.audit.name = AuditRollingFile
log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
log4j2.appender.audit.append = true
log4j2.appender.audit.layout.type = PatternLayout
log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
log4j2.appender.audit.policies.type = Policies
log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.audit.policies.size.size = 8MB
log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
log4j2.appender.audit.strategy.max = 7

# OSGi appender
log4j2.appender.osgi.type = PaxOsgi
log4j2.appender.osgi.name = PaxOsgi
log4j2.appender.osgi.filter = *

# help with identification of maven-related problems with pax-url-aether
#log4j2.logger.aether.name = shaded.org.eclipse.aether
#log4j2.logger.aether.level = TRACE
#log4j2.logger.http-headers.name = shaded.org.apache.http.headers
#log4j2.logger.http-headers.level = DEBUG
#log4j2.logger.maven.name = org.ops4j.pax.url.mvn
#log4j2.logger.maven.level = TRACE
log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN
log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN
Configure
    java home: /usr/lib/jvm/java-17-openjdk
    max memory: 3072m
    memconf: /tmp/karaf-0.21.0-SNAPSHOT/bin/setenv
+ set_java_vars /usr/lib/jvm/java-17-openjdk 3072m /tmp/karaf-0.21.0-SNAPSHOT/bin/setenv
+ local -r java_home=/usr/lib/jvm/java-17-openjdk
+ local -r controllermem=3072m
+ local -r memconf=/tmp/karaf-0.21.0-SNAPSHOT/bin/setenv
+ echo Configure
+ echo '    java home: /usr/lib/jvm/java-17-openjdk'
+ echo '    max memory: 3072m'
+ echo '    memconf: /tmp/karaf-0.21.0-SNAPSHOT/bin/setenv'
+ sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk}%g' /tmp/karaf-0.21.0-SNAPSHOT/bin/setenv
+ sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.21.0-SNAPSHOT/bin/setenv
cat /tmp/karaf-0.21.0-SNAPSHOT/bin/setenv
+ echo 'cat /tmp/karaf-0.21.0-SNAPSHOT/bin/setenv'
+ cat /tmp/karaf-0.21.0-SNAPSHOT/bin/setenv
#!/bin/sh
#
#    Licensed to the Apache Software Foundation (ASF) under one or more
#    contributor license agreements.  See the NOTICE file distributed with
#    this work for additional information regarding copyright ownership.
#    The ASF licenses this file to You under the Apache License, Version 2.0
#    (the "License"); you may not use this file except in compliance with
#    the License.  You may obtain a copy of the License at
#
#       http://www.apache.org/licenses/LICENSE-2.0
#
#    Unless required by applicable law or agreed to in writing, software
#    distributed under the License is distributed on an "AS IS" BASIS,
#    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
#    See the License for the specific language governing permissions and
#    limitations under the License.
#

#
# handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf
# script: client, instance, shell, start, status, stop, karaf
#
# if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then
#   Actions go here...
# fi

#
# general settings which should be applied for all scripts go here; please keep
# in mind that it is possible that scripts might be executed more than once, e.g.
# in example of the start script where the start script is executed first and the
# karaf script afterwards.
#

#
# The following section shows the possible configuration options for the default 
# karaf scripts
#
export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk} # Location of Java installation
# export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration
# export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options
# export EXTRA_JAVA_OPTS # Additional JVM options
# export KARAF_HOME # Karaf home folder
# export KARAF_DATA # Karaf data folder
# export KARAF_BASE # Karaf base folder
# export KARAF_ETC  # Karaf etc  folder
# export KARAF_LOG  # Karaf log  folder
# export KARAF_SYSTEM_OPTS # First citizen Karaf options
# export KARAF_OPTS # Additional available Karaf options
# export KARAF_DEBUG # Enable debug mode
# export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start
# export KARAF_NOROOT # Prevent execution as root if set to true
Set Java version
+ echo 'Set Java version'
+ sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-17-openjdk/bin/java 1
+ sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-17-openjdk/bin/java
JDK default version ...
+ echo 'JDK default version ...'
+ java -version
openjdk version "17.0.6-ea" 2023-01-17 LTS
OpenJDK Runtime Environment (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS)
OpenJDK 64-Bit Server VM (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS, mixed mode, sharing)
Set JAVA_HOME
+ echo 'Set JAVA_HOME'
+ export JAVA_HOME=/usr/lib/jvm/java-17-openjdk
+ JAVA_HOME=/usr/lib/jvm/java-17-openjdk
++ readlink -e /usr/lib/jvm/java-17-openjdk/bin/java
Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java
Listing all open ports on controller system...
+ JAVA_RESOLVED=/usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java
+ echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java'
+ echo 'Listing all open ports on controller system...'
+ netstat -pnatu
(Not all processes could be identified, non-owned process info
 will not be shown, you would have to be root to see it all.)
Active Internet connections (servers and established)
Proto Recv-Q Send-Q Local Address           Foreign Address         State       PID/Program name    
tcp        0      0 0.0.0.0:22              0.0.0.0:*               LISTEN      -                   
tcp        0      0 0.0.0.0:111             0.0.0.0:*               LISTEN      -                   
tcp        0      0 10.30.171.240:46076     199.204.45.87:443       TIME_WAIT   -                   
tcp        0    164 10.30.171.240:22        10.30.171.81:43776      ESTABLISHED -                   
tcp6       0      0 :::22                   :::*                    LISTEN      -                   
tcp6       0      0 :::111                  :::*                    LISTEN      -                   
tcp6       0      0 :::5555                 :::*                    LISTEN      -                   
udp        0      0 10.30.171.240:68        10.30.170.3:67          ESTABLISHED -                   
udp        0      0 0.0.0.0:111             0.0.0.0:*                           -                   
udp        0      0 127.0.0.1:323           0.0.0.0:*                           -                   
udp6       0      0 :::111                  :::*                                -                   
udp6       0      0 ::1:323                 :::*                                -                   
Custom shard config exists!!!
Copying the shard config...
+ '[' -f /tmp/custom_shard_config.txt ']'
+ echo 'Custom shard config exists!!!'
+ echo 'Copying the shard config...'
+ cp /tmp/custom_shard_config.txt /tmp/karaf-0.21.0-SNAPSHOT/bin/
Configuring cluster
+ echo 'Configuring cluster'
+ /tmp/karaf-0.21.0-SNAPSHOT/bin/configure_cluster.sh 1 10.30.171.240 10.30.170.251 10.30.170.138
################################################
##             Configure Cluster              ##
################################################
 NOTE: Cluster configuration files not found. Copying from
 /tmp/karaf-0.21.0-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/9.0.2
Configuring unique name in akka.conf
Configuring hostname in akka.conf
Configuring data and rpc seed nodes in akka.conf
modules = [
	
	{
		name = "inventory"
		namespace = "urn:opendaylight:inventory"
		shard-strategy = "module"
	},
	{
		name = "topology"
		namespace = "urn:TBD:params:xml:ns:yang:network-topology"
		shard-strategy = "module"
	},
	{
		name = "toaster"
		namespace = "http://netconfcentral.org/ns/toaster"
		shard-strategy = "module"
	},
	{
		name = "car"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
		shard-strategy = "module"
	},
	{
		name = "people"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
		shard-strategy = "module"
	},
	{
		name = "car-people"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
		shard-strategy = "module"
	}
]
Configuring replication type in module-shards.conf
################################################
##   NOTE: Manually restart controller to     ##
##         apply configuration.               ##
################################################
Dump akka.conf
+ echo 'Dump akka.conf'
+ cat /tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/akka.conf

odl-cluster-data {
  akka {
    remote {
      artery {
        enabled = on
        transport = tcp
        canonical.hostname = "10.30.171.240"
        canonical.port = 2550
      }
    }

    cluster {
      # Using artery.
      seed-nodes = ["akka://opendaylight-cluster-data@10.30.171.240:2550",
				"akka://opendaylight-cluster-data@10.30.170.251:2550",
				"akka://opendaylight-cluster-data@10.30.170.138:2550"]

      roles = ["member-1"]

      # when under load we might trip a false positive on the failure detector
      # failure-detector {
        # heartbeat-interval = 4 s
        # acceptable-heartbeat-pause = 16s
      # }
    }

    persistence {
      # By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by
      # modifying the following two properties. The directory location specified may be a relative or absolute path. 
      # The relative path is always relative to KARAF_HOME.

      # snapshot-store.local.dir = "target/snapshots"

      # Use lz4 compression for LocalSnapshotStore snapshots
      snapshot-store.local.use-lz4-compression = false
      # Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB
      snapshot-store.local.lz4-blocksize = 256KB
    }
    disable-default-actor-system-quarantined-event-handling = "false"
  }
}
Dump modules.conf
+ echo 'Dump modules.conf'
+ cat /tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/modules.conf
modules = [
	
	{
		name = "inventory"
		namespace = "urn:opendaylight:inventory"
		shard-strategy = "module"
	},
	{
		name = "topology"
		namespace = "urn:TBD:params:xml:ns:yang:network-topology"
		shard-strategy = "module"
	},
	{
		name = "toaster"
		namespace = "http://netconfcentral.org/ns/toaster"
		shard-strategy = "module"
	},
	{
		name = "car"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
		shard-strategy = "module"
	},
	{
		name = "people"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
		shard-strategy = "module"
	},
	{
		name = "car-people"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
		shard-strategy = "module"
	}
]
Dump module-shards.conf
+ echo 'Dump module-shards.conf'
+ cat /tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/module-shards.conf
module-shards = [
	{
		name = "default"
		shards = [
			{
				name = "default"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "inventory"
		shards = [
			{
				name="inventory"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "topology"
		shards = [
			{
				name="topology"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "toaster"
		shards = [
			{
				name="toaster"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "car"
		shards = [
			{
				name="car"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "people"
		shards = [
			{
				name="people"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "car-people"
		shards = [
			{
				name="car-people"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	}
]
Configuring member-2 with IP address 10.30.170.251
Warning: Permanently added '10.30.170.251' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.170.251' (ECDSA) to the list of known hosts.
common-functions.sh is being sourced
+ source /tmp/common-functions.sh karaf-0.21.0-SNAPSHOT
++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]]
++ echo 'common-functions.sh is being sourced'
++ BUNDLEFOLDER=karaf-0.21.0-SNAPSHOT
++ export MAVENCONF=/tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
++ MAVENCONF=/tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
++ export FEATURESCONF=/tmp/karaf-0.21.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
++ FEATURESCONF=/tmp/karaf-0.21.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
++ export CUSTOMPROP=/tmp/karaf-0.21.0-SNAPSHOT/etc/custom.properties
++ CUSTOMPROP=/tmp/karaf-0.21.0-SNAPSHOT/etc/custom.properties
++ export LOGCONF=/tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
++ LOGCONF=/tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
++ export MEMCONF=/tmp/karaf-0.21.0-SNAPSHOT/bin/setenv
++ MEMCONF=/tmp/karaf-0.21.0-SNAPSHOT/bin/setenv
++ export CONTROLLERMEM=
++ CONTROLLERMEM=
++ export AKKACONF=/tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/akka.conf
++ AKKACONF=/tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/akka.conf
++ export MODULESCONF=/tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/modules.conf
++ MODULESCONF=/tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/modules.conf
++ export MODULESHARDSCONF=/tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/module-shards.conf
++ MODULESHARDSCONF=/tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/module-shards.conf
++ print_common_env
++ cat
common-functions environment:
MAVENCONF: /tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
ACTUALFEATURES: 
FEATURESCONF: /tmp/karaf-0.21.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
CUSTOMPROP: /tmp/karaf-0.21.0-SNAPSHOT/etc/custom.properties
LOGCONF: /tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
MEMCONF: /tmp/karaf-0.21.0-SNAPSHOT/bin/setenv
CONTROLLERMEM: 
AKKACONF: /tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/akka.conf
MODULESCONF: /tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/modules.conf
MODULESHARDSCONF: /tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/module-shards.conf
SUITES: 

Changing to /tmp
Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.0-SNAPSHOT/karaf-0.21.0-20240713.213108-566.zip
++ SSH='ssh -t -t'
++ extra_services_cntl='     dnsmasq.service     httpd.service     libvirtd.service     openvswitch.service     ovs-vswitchd.service     ovsdb-server.service     rabbitmq-server.service '
++ extra_services_cmp='     libvirtd.service     openvswitch.service     ovs-vswitchd.service     ovsdb-server.service '
+ echo 'Changing to /tmp'
+ cd /tmp
+ echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.0-SNAPSHOT/karaf-0.21.0-20240713.213108-566.zip'
+ wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.0-SNAPSHOT/karaf-0.21.0-20240713.213108-566.zip
--2024-07-14 00:30:41--  https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.0-SNAPSHOT/karaf-0.21.0-20240713.213108-566.zip
Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6
Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 290595168 (277M) [application/zip]
Saving to: ‘karaf-0.21.0-20240713.213108-566.zip’

     0K ........ ........ ........ ........ ........ ........  1% 84.7M 3s
  3072K ........ ........ ........ ........ ........ ........  2%  134M 3s
  6144K ........ ........ ........ ........ ........ ........  3%  128M 2s
  9216K ........ ........ ........ ........ ........ ........  4%  148M 2s
 12288K ........ ........ ........ ........ ........ ........  5%  231M 2s
 15360K ........ ........ ........ ........ ........ ........  6%  227M 2s
 18432K ........ ........ ........ ........ ........ ........  7%  249M 2s
 21504K ........ ........ ........ ........ ........ ........  8%  257M 2s
 24576K ........ ........ ........ ........ ........ ........  9%  270M 2s
 27648K ........ ........ ........ ........ ........ ........ 10%  281M 1s
 30720K ........ ........ ........ ........ ........ ........ 11%  286M 1s
 33792K ........ ........ ........ ........ ........ ........ 12%  329M 1s
 36864K ........ ........ ........ ........ ........ ........ 14%  314M 1s
 39936K ........ ........ ........ ........ ........ ........ 15%  290M 1s
 43008K ........ ........ ........ ........ ........ ........ 16%  310M 1s
 46080K ........ ........ ........ ........ ........ ........ 17%  344M 1s
 49152K ........ ........ ........ ........ ........ ........ 18%  321M 1s
 52224K ........ ........ ........ ........ ........ ........ 19%  295M 1s
 55296K ........ ........ ........ ........ ........ ........ 20%  355M 1s
 58368K ........ ........ ........ ........ ........ ........ 21%  310M 1s
 61440K ........ ........ ........ ........ ........ ........ 22%  304M 1s
 64512K ........ ........ ........ ........ ........ ........ 23%  330M 1s
 67584K ........ ........ ........ ........ ........ ........ 24%  346M 1s
 70656K ........ ........ ........ ........ ........ ........ 25%  340M 1s
 73728K ........ ........ ........ ........ ........ ........ 27%  346M 1s
 76800K ........ ........ ........ ........ ........ ........ 28%  350M 1s
 79872K ........ ........ ........ ........ ........ ........ 29%  294M 1s
 82944K ........ ........ ........ ........ ........ ........ 30%  333M 1s
 86016K ........ ........ ........ ........ ........ ........ 31%  339M 1s
 89088K ........ ........ ........ ........ ........ ........ 32%  348M 1s
 92160K ........ ........ ........ ........ ........ ........ 33%  184M 1s
 95232K ........ ........ ........ ........ ........ ........ 34%  285M 1s
 98304K ........ ........ ........ ........ ........ ........ 35%  298M 1s
101376K ........ ........ ........ ........ ........ ........ 36%  279M 1s
104448K ........ ........ ........ ........ ........ ........ 37%  228M 1s
107520K ........ ........ ........ ........ ........ ........ 38%  350M 1s
110592K ........ ........ ........ ........ ........ ........ 40%  389M 1s
113664K ........ ........ ........ ........ ........ ........ 41%  396M 1s
116736K ........ ........ ........ ........ ........ ........ 42%  321M 1s
119808K ........ ........ ........ ........ ........ ........ 43%  200M 1s
122880K ........ ........ ........ ........ ........ ........ 44%  390M 1s
125952K ........ ........ ........ ........ ........ ........ 45%  389M 1s
129024K ........ ........ ........ ........ ........ ........ 46%  390M 1s
132096K ........ ........ ........ ........ ........ ........ 47%  323M 1s
135168K ........ ........ ........ ........ ........ ........ 48%  310M 1s
138240K ........ ........ ........ ........ ........ ........ 49%  313M 1s
141312K ........ ........ ........ ........ ........ ........ 50%  305M 1s
144384K ........ ........ ........ ........ ........ ........ 51%  315M 0s
147456K ........ ........ ........ ........ ........ ........ 53%  319M 0s
150528K ........ ........ ........ ........ ........ ........ 54%  328M 0s
153600K ........ ........ ........ ........ ........ ........ 55%  321M 0s
156672K ........ ........ ........ ........ ........ ........ 56%  323M 0s
159744K ........ ........ ........ ........ ........ ........ 57%  323M 0s
162816K ........ ........ ........ ........ ........ ........ 58%  305M 0s
165888K ........ ........ ........ ........ ........ ........ 59%  318M 0s
168960K ........ ........ ........ ........ ........ ........ 60%  317M 0s
172032K ........ ........ ........ ........ ........ ........ 61%  339M 0s
175104K ........ ........ ........ ........ ........ ........ 62%  196M 0s
178176K ........ ........ ........ ........ ........ ........ 63%  266M 0s
181248K ........ ........ ........ ........ ........ ........ 64%  381M 0s
184320K ........ ........ ........ ........ ........ ........ 66%  353M 0s
187392K ........ ........ ........ ........ ........ ........ 67%  309M 0s
190464K ........ ........ ........ ........ ........ ........ 68%  296M 0s
193536K ........ ........ ........ ........ ........ ........ 69%  326M 0s
196608K ........ ........ ........ ........ ........ ........ 70%  327M 0s
199680K ........ ........ ........ ........ ........ ........ 71%  286M 0s
202752K ........ ........ ........ ........ ........ ........ 72%  303M 0s
205824K ........ ........ ........ ........ ........ ........ 73%  344M 0s
208896K ........ ........ ........ ........ ........ ........ 74%  334M 0s
211968K ........ ........ ........ ........ ........ ........ 75%  326M 0s
215040K ........ ........ ........ ........ ........ ........ 76%  339M 0s
218112K ........ ........ ........ ........ ........ ........ 77%  347M 0s
221184K ........ ........ ........ ........ ........ ........ 79%  342M 0s
224256K ........ ........ ........ ........ ........ ........ 80%  344M 0s
227328K ........ ........ ........ ........ ........ ........ 81%  341M 0s
230400K ........ ........ ........ ........ ........ ........ 82%  336M 0s
233472K ........ ........ ........ ........ ........ ........ 83%  283M 0s
236544K ........ ........ ........ ........ ........ ........ 84%  302M 0s
239616K ........ ........ ........ ........ ........ ........ 85%  322M 0s
242688K ........ ........ ........ ........ ........ ........ 86%  324M 0s
245760K ........ ........ ........ ........ ........ ........ 87%  319M 0s
248832K ........ ........ ........ ........ ........ ........ 88%  306M 0s
251904K ........ ........ ........ ........ ........ ........ 89%  224M 0s
254976K ........ ........ ........ ........ ........ ........ 90%  269M 0s
258048K ........ ........ ........ ........ ........ ........ 92%  274M 0s
261120K ........ ........ ........ ........ ........ ........ 93%  320M 0s
264192K ........ ........ ........ ........ ........ ........ 94%  331M 0s
267264K ........ ........ ........ ........ ........ ........ 95%  323M 0s
270336K ........ ........ ........ ........ ........ ........ 96%  316M 0s
273408K ........ ........ ........ ........ ........ ........ 97%  289M 0s
276480K ........ ........ ........ ........ ........ ........ 98%  295M 0s
279552K ........ ........ ........ ........ ........ ........ 99%  345M 0s
282624K ........ ........ ..                                 100%  349M=1.0s

2024-07-14 00:30:42 (286 MB/s) - ‘karaf-0.21.0-20240713.213108-566.zip’ saved [290595168/290595168]

Extracting the new controller...
+ echo 'Extracting the new controller...'
+ unzip -q karaf-0.21.0-20240713.213108-566.zip
Adding external repositories...
+ echo 'Adding external repositories...'
+ sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
+ cat /tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
################################################################################
#
#    Licensed to the Apache Software Foundation (ASF) under one or more
#    contributor license agreements.  See the NOTICE file distributed with
#    this work for additional information regarding copyright ownership.
#    The ASF licenses this file to You under the Apache License, Version 2.0
#    (the "License"); you may not use this file except in compliance with
#    the License.  You may obtain a copy of the License at
#
#       http://www.apache.org/licenses/LICENSE-2.0
#
#    Unless required by applicable law or agreed to in writing, software
#    distributed under the License is distributed on an "AS IS" BASIS,
#    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
#    See the License for the specific language governing permissions and
#    limitations under the License.
#
################################################################################

#
# If set to true, the following property will not allow any certificate to be used
# when accessing Maven repositories through SSL
#
#org.ops4j.pax.url.mvn.certificateCheck=

#
# Path to the local Maven settings file.
# The repositories defined in this file will be automatically added to the list
# of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property
# below is not set.
# The following locations are checked for the existence of the settings.xml file
#   * 1. looks for the specified url
#   * 2. if not found looks for ${user.home}/.m2/settings.xml
#   * 3. if not found looks for ${maven.home}/conf/settings.xml
#   * 4. if not found looks for ${M2_HOME}/conf/settings.xml
#
#org.ops4j.pax.url.mvn.settings=

#
# Path to the local Maven repository which is used to avoid downloading
# artifacts when they already exist locally.
# The value of this property will be extracted from the settings.xml file
# above, or defaulted to:
#     System.getProperty( "user.home" ) + "/.m2/repository"
#
org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository}

#
# Default this to false. It's just weird to use undocumented repos
#
org.ops4j.pax.url.mvn.useFallbackRepositories=false

#
# Uncomment if you don't wanna use the proxy settings
# from the Maven conf/settings.xml file
#
# org.ops4j.pax.url.mvn.proxySupport=false

#
# Comma separated list of repositories scanned when resolving an artifact.
# Those repositories will be checked before iterating through the
#    below list of repositories and even before the local repository
# A repository url can be appended with zero or more of the following flags:
#    @snapshots  : the repository contains snaphots
#    @noreleases : the repository does not contain any released artifacts
#
# The following property value will add the system folder as a repo.
#
org.ops4j.pax.url.mvn.defaultRepositories=\
    file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\
    file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\
    file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots

# Use the default local repo (e.g.~/.m2/repository) as a "remote" repo
#org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false

#
# Comma separated list of repositories scanned when resolving an artifact.
# The default list includes the following repositories:
#    http://repo1.maven.org/maven2@id=central
#    http://repository.springsource.com/maven/bundles/release@id=spring.ebr
#    http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external
#    http://zodiac.springsource.com/maven/bundles/release@id=gemini
#    http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases
#    https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases
#    https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
# To add repositories to the default ones, prepend '+' to the list of repositories
# to add.
# A repository url can be appended with zero or more of the following flags:
#    @snapshots  : the repository contains snapshots
#    @noreleases : the repository does not contain any released artifacts
#    @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended
#
org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases

### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.+ [[ True == \T\r\u\e ]]
+ echo 'Configuring the startup features...'
Configuring the startup features...
+ sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.21.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
+ FEATURE_TEST_STRING=features-test
+ FEATURE_TEST_VERSION=0.21.0-SNAPSHOT
+ KARAF_VERSION=karaf4
+ [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]]
+ sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.21.0-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.21.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
+ [[ ! -z '' ]]
+ cat /tmp/karaf-0.21.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
################################################################################
#
#    Licensed to the Apache Software Foundation (ASF) under one or more
#    contributor license agreements.  See the NOTICE file distributed with
#    this work for additional information regarding copyright ownership.
#    The ASF licenses this file to You under the Apache License, Version 2.0
#    (the "License"); you may not use this file except in compliance with
#    the License.  You may obtain a copy of the License at
#
#       http://www.apache.org/licenses/LICENSE-2.0
#
#    Unless required by applicable law or agreed to in writing, software
#    distributed under the License is distributed on an "AS IS" BASIS,
#    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
#    See the License for the specific language governing permissions and
#    limitations under the License.
#
################################################################################

#
# Comma separated list of features repositories to register by default
#
featuresRepositories = mvn:org.opendaylight.integration/features-test/0.21.0-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/08493256-6265-4383-ab30-d45ce4e978f5.xml

#
# Comma separated list of features to install at startup
#
featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, 49b78555-1641-42ff-9274-1e872c373654

#
# Resource repositories (OBR) that the features resolver can use
# to resolve requirements/capabilities
#
# The format of the resourceRepositories is 
# resourceRepositories=[xml:url|json:url],...
# for Instance:
#
#resourceRepositories=xml:http://host/path/to/index.xml
# or
#resourceRepositories=json:http://host/path/to/index.json
#

#
# Defines if the boot features are started in asynchronous mode (in a dedicated thread)
#
featuresBootAsynchronous=false

#
# Service requirements enforcement
#
# By default, the feature resolver checks the service requirements/capabilities of
# bundles for new features (xml schema >= 1.3.0) in order to automatically installs
# the required bundles.
# The following flag can have those values:
#   - disable: service requirements are completely ignored
#   - default: service requirements are ignored for old features
#   - enforce: service requirements are always verified
#
#serviceRequirements=default

#
# Store cfg file for config element in feature
#
#configCfgStore=true

#
# Define if the feature service automatically refresh bundles
#
autoRefresh=true

#
# Configuration of features processing mechanism (overrides, blacklisting, modification of features)
# XML file defines instructions related to features processing
# versions.properties may declare properties to resolve placeholders in XML file
# both files are relative to ${karaf.etc}
#
#featureProcessing=org.apache.karaf.features.xml
#featureProcessingVersions=versions.properties
+ configure_karaf_log karaf4 ''
+ local -r karaf_version=karaf4
+ local -r controllerdebugmap=
+ local logapi=log4j
+ grep log4j2 /tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
log4j2.rootLogger.level = INFO
#log4j2.rootLogger.type = asyncRoot
#log4j2.rootLogger.includeLocation = false
log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
log4j2.rootLogger.appenderRef.Console.ref = Console
log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
log4j2.logger.spifly.name = org.apache.aries.spifly
log4j2.logger.spifly.level = WARN
log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
log4j2.logger.audit.level = INFO
log4j2.logger.audit.additivity = false
log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
# Console appender not used by default (see log4j2.rootLogger.appenderRefs)
log4j2.appender.console.type = Console
log4j2.appender.console.name = Console
log4j2.appender.console.layout.type = PatternLayout
log4j2.appender.console.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.type = RollingRandomAccessFile
log4j2.appender.rolling.name = RollingFile
log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
#log4j2.appender.rolling.immediateFlush = false
log4j2.appender.rolling.append = true
log4j2.appender.rolling.layout.type = PatternLayout
log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.policies.type = Policies
log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.rolling.policies.size.size = 64MB
log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
log4j2.appender.rolling.strategy.max = 7
log4j2.appender.audit.type = RollingRandomAccessFile
log4j2.appender.audit.name = AuditRollingFile
log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
log4j2.appender.audit.append = true
log4j2.appender.audit.layout.type = PatternLayout
log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
log4j2.appender.audit.policies.type = Policies
log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.audit.policies.size.size = 8MB
log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
log4j2.appender.audit.strategy.max = 7
log4j2.appender.osgi.type = PaxOsgi
log4j2.appender.osgi.name = PaxOsgi
log4j2.appender.osgi.filter = *
#log4j2.logger.aether.name = shaded.org.eclipse.aether
#log4j2.logger.aether.level = TRACE
#log4j2.logger.http-headers.name = shaded.org.apache.http.headers
#log4j2.logger.http-headers.level = DEBUG
#log4j2.logger.maven.name = org.ops4j.pax.url.mvn
#log4j2.logger.maven.level = TRACE
Configuring the karaf log... karaf_version: karaf4, logapi: log4j2
+ logapi=log4j2
+ echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2'
+ '[' log4j2 == log4j2 ']'
+ sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
+ orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver
+ orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver
+ echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN'
+ echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN'
+ unset IFS
+ echo 'controllerdebugmap: '
controllerdebugmap: 
+ '[' -n '' ']'
cat /tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
+ echo 'cat /tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg'
+ cat /tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
################################################################################
#
#    Licensed to the Apache Software Foundation (ASF) under one or more
#    contributor license agreements.  See the NOTICE file distributed with
#    this work for additional information regarding copyright ownership.
#    The ASF licenses this file to You under the Apache License, Version 2.0
#    (the "License"); you may not use this file except in compliance with
#    the License.  You may obtain a copy of the License at
#
#       http://www.apache.org/licenses/LICENSE-2.0
#
#    Unless required by applicable law or agreed to in writing, software
#    distributed under the License is distributed on an "AS IS" BASIS,
#    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
#    See the License for the specific language governing permissions and
#    limitations under the License.
#
################################################################################

# Common pattern layout for appenders
log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n

# Root logger
log4j2.rootLogger.level = INFO
# uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library
#log4j2.rootLogger.type = asyncRoot
#log4j2.rootLogger.includeLocation = false
log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
log4j2.rootLogger.appenderRef.Console.ref = Console
log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}

# Filters for logs marked by org.opendaylight.odlparent.Markers
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL

# Loggers configuration

# Spifly logger
log4j2.logger.spifly.name = org.apache.aries.spifly
log4j2.logger.spifly.level = WARN

# Security audit logger
log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
log4j2.logger.audit.level = INFO
log4j2.logger.audit.additivity = false
log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile

# Appenders configuration

# Console appender not used by default (see log4j2.rootLogger.appenderRefs)
log4j2.appender.console.type = Console
log4j2.appender.console.name = Console
log4j2.appender.console.layout.type = PatternLayout
log4j2.appender.console.layout.pattern = ${log4j2.pattern}

# Rolling file appender
log4j2.appender.rolling.type = RollingRandomAccessFile
log4j2.appender.rolling.name = RollingFile
log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
# uncomment to not force a disk flush
#log4j2.appender.rolling.immediateFlush = false
log4j2.appender.rolling.append = true
log4j2.appender.rolling.layout.type = PatternLayout
log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.policies.type = Policies
log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.rolling.policies.size.size = 1GB
log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
log4j2.appender.rolling.strategy.max = 7

# Audit file appender
log4j2.appender.audit.type = RollingRandomAccessFile
log4j2.appender.audit.name = AuditRollingFile
log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
log4j2.appender.audit.append = true
log4j2.appender.audit.layout.type = PatternLayout
log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
log4j2.appender.audit.policies.type = Policies
log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.audit.policies.size.size = 8MB
log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
log4j2.appender.audit.strategy.max = 7

# OSGi appender
log4j2.appender.osgi.type = PaxOsgi
log4j2.appender.osgi.name = PaxOsgi
log4j2.appender.osgi.filter = *

# help with identification of maven-related problems with pax-url-aether
#log4j2.logger.aether.name = shaded.org.eclipse.aether
#log4j2.logger.aether.level = TRACE
#log4j2.logger.http-headers.name = shaded.org.apache.http.headers
#log4j2.logger.http-headers.level = DEBUG
#log4j2.logger.maven.name = org.ops4j.pax.url.mvn
#log4j2.logger.maven.level = TRACE
log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN
log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN
+ set_java_vars /usr/lib/jvm/java-17-openjdk 3072m /tmp/karaf-0.21.0-SNAPSHOT/bin/setenv
+ local -r java_home=/usr/lib/jvm/java-17-openjdk
+ local -r controllermem=3072m
+ local -r memconf=/tmp/karaf-0.21.0-SNAPSHOT/bin/setenv
Configure
+ echo Configure
    java home: /usr/lib/jvm/java-17-openjdk
    max memory: 3072m
    memconf: /tmp/karaf-0.21.0-SNAPSHOT/bin/setenv
+ echo '    java home: /usr/lib/jvm/java-17-openjdk'
+ echo '    max memory: 3072m'
+ echo '    memconf: /tmp/karaf-0.21.0-SNAPSHOT/bin/setenv'
+ sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk}%g' /tmp/karaf-0.21.0-SNAPSHOT/bin/setenv
+ sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.21.0-SNAPSHOT/bin/setenv
cat /tmp/karaf-0.21.0-SNAPSHOT/bin/setenv
+ echo 'cat /tmp/karaf-0.21.0-SNAPSHOT/bin/setenv'
+ cat /tmp/karaf-0.21.0-SNAPSHOT/bin/setenv
#!/bin/sh
#
#    Licensed to the Apache Software Foundation (ASF) under one or more
#    contributor license agreements.  See the NOTICE file distributed with
#    this work for additional information regarding copyright ownership.
#    The ASF licenses this file to You under the Apache License, Version 2.0
#    (the "License"); you may not use this file except in compliance with
#    the License.  You may obtain a copy of the License at
#
#       http://www.apache.org/licenses/LICENSE-2.0
#
#    Unless required by applicable law or agreed to in writing, software
#    distributed under the License is distributed on an "AS IS" BASIS,
#    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
#    See the License for the specific language governing permissions and
#    limitations under the License.
#

#
# handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf
# script: client, instance, shell, start, status, stop, karaf
#
# if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then
#   Actions go here...
# fi

#
# general settings which should be applied for all scripts go here; please keep
# in mind that it is possible that scripts might be executed more than once, e.g.
# in example of the start script where the start script is executed first and the
# karaf script afterwards.
#

#
# The following section shows the possible configuration options for the default 
# karaf scripts
#
export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk} # Location of Java installation
# export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration
# export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options
# export EXTRA_JAVA_OPTS # Additional JVM options
# export KARAF_HOME # Karaf home folder
# export KARAF_DATA # Karaf data folder
# export KARAF_BASE # Karaf base folder
# export KARAF_ETC  # Karaf etc  folder
# export KARAF_LOG  # Karaf log  folder
# export KARAF_SYSTEM_OPTS # First citizen Karaf options
# export KARAF_OPTS # Additional available Karaf options
# export KARAF_DEBUG # Enable debug mode
# export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start
# export KARAF_NOROOT # Prevent execution as root if set to true
Set Java version
+ echo 'Set Java version'
+ sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-17-openjdk/bin/java 1
+ sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-17-openjdk/bin/java
JDK default version ...
+ echo 'JDK default version ...'
+ java -version
openjdk version "17.0.6-ea" 2023-01-17 LTS
OpenJDK Runtime Environment (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS)
OpenJDK 64-Bit Server VM (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS, mixed mode, sharing)
Set JAVA_HOME
+ echo 'Set JAVA_HOME'
+ export JAVA_HOME=/usr/lib/jvm/java-17-openjdk
+ JAVA_HOME=/usr/lib/jvm/java-17-openjdk
++ readlink -e /usr/lib/jvm/java-17-openjdk/bin/java
Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java
+ JAVA_RESOLVED=/usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java
+ echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java'
Listing all open ports on controller system...
+ echo 'Listing all open ports on controller system...'
+ netstat -pnatu
(Not all processes could be identified, non-owned process info
 will not be shown, you would have to be root to see it all.)
Active Internet connections (servers and established)
Proto Recv-Q Send-Q Local Address           Foreign Address         State       PID/Program name    
tcp        0      0 0.0.0.0:22              0.0.0.0:*               LISTEN      -                   
tcp        0      0 0.0.0.0:111             0.0.0.0:*               LISTEN      -                   
tcp        0      0 10.30.170.251:55980     199.204.45.87:443       TIME_WAIT   -                   
tcp        0      0 10.30.170.251:22        10.30.171.81:39230      ESTABLISHED -                   
tcp6       0      0 :::5555                 :::*                    LISTEN      -                   
tcp6       0      0 :::22                   :::*                    LISTEN      -                   
tcp6       0      0 :::111                  :::*                    LISTEN      -                   
udp        0      0 10.30.170.251:68        10.30.170.2:67          ESTABLISHED -                   
udp        0      0 0.0.0.0:111             0.0.0.0:*                           -                   
udp        0      0 127.0.0.1:323           0.0.0.0:*                           -                   
udp6       0      0 :::111                  :::*                                -                   
udp6       0      0 ::1:323                 :::*                                -                   
Custom shard config exists!!!
Copying the shard config...
+ '[' -f /tmp/custom_shard_config.txt ']'
+ echo 'Custom shard config exists!!!'
+ echo 'Copying the shard config...'
+ cp /tmp/custom_shard_config.txt /tmp/karaf-0.21.0-SNAPSHOT/bin/
Configuring cluster
+ echo 'Configuring cluster'
+ /tmp/karaf-0.21.0-SNAPSHOT/bin/configure_cluster.sh 2 10.30.171.240 10.30.170.251 10.30.170.138
################################################
##             Configure Cluster              ##
################################################
 NOTE: Cluster configuration files not found. Copying from
 /tmp/karaf-0.21.0-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/9.0.2
Configuring unique name in akka.conf
Configuring hostname in akka.conf
Configuring data and rpc seed nodes in akka.conf
modules = [
	
	{
		name = "inventory"
		namespace = "urn:opendaylight:inventory"
		shard-strategy = "module"
	},
	{
		name = "topology"
		namespace = "urn:TBD:params:xml:ns:yang:network-topology"
		shard-strategy = "module"
	},
	{
		name = "toaster"
		namespace = "http://netconfcentral.org/ns/toaster"
		shard-strategy = "module"
	},
	{
		name = "car"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
		shard-strategy = "module"
	},
	{
		name = "people"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
		shard-strategy = "module"
	},
	{
		name = "car-people"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
		shard-strategy = "module"
	}
]
Configuring replication type in module-shards.conf
################################################
##   NOTE: Manually restart controller to     ##
##         apply configuration.               ##
################################################
Dump akka.conf
+ echo 'Dump akka.conf'
+ cat /tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/akka.conf

odl-cluster-data {
  akka {
    remote {
      artery {
        enabled = on
        transport = tcp
        canonical.hostname = "10.30.170.251"
        canonical.port = 2550
      }
    }

    cluster {
      # Using artery.
      seed-nodes = ["akka://opendaylight-cluster-data@10.30.171.240:2550",
				"akka://opendaylight-cluster-data@10.30.170.251:2550",
				"akka://opendaylight-cluster-data@10.30.170.138:2550"]

      roles = ["member-2"]

      # when under load we might trip a false positive on the failure detector
      # failure-detector {
        # heartbeat-interval = 4 s
        # acceptable-heartbeat-pause = 16s
      # }
    }

    persistence {
      # By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by
      # modifying the following two properties. The directory location specified may be a relative or absolute path. 
      # The relative path is always relative to KARAF_HOME.

      # snapshot-store.local.dir = "target/snapshots"

      # Use lz4 compression for LocalSnapshotStore snapshots
      snapshot-store.local.use-lz4-compression = false
      # Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB
      snapshot-store.local.lz4-blocksize = 256KB
    }
    disable-default-actor-system-quarantined-event-handling = "false"
  }
}
Dump modules.conf
+ echo 'Dump modules.conf'
+ cat /tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/modules.conf
modules = [
	
	{
		name = "inventory"
		namespace = "urn:opendaylight:inventory"
		shard-strategy = "module"
	},
	{
		name = "topology"
		namespace = "urn:TBD:params:xml:ns:yang:network-topology"
		shard-strategy = "module"
	},
	{
		name = "toaster"
		namespace = "http://netconfcentral.org/ns/toaster"
		shard-strategy = "module"
	},
	{
		name = "car"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
		shard-strategy = "module"
	},
	{
		name = "people"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
		shard-strategy = "module"
	},
	{
		name = "car-people"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
		shard-strategy = "module"
	}
]
Dump module-shards.conf
+ echo 'Dump module-shards.conf'
+ cat /tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/module-shards.conf
module-shards = [
	{
		name = "default"
		shards = [
			{
				name = "default"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "inventory"
		shards = [
			{
				name="inventory"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "topology"
		shards = [
			{
				name="topology"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "toaster"
		shards = [
			{
				name="toaster"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "car"
		shards = [
			{
				name="car"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "people"
		shards = [
			{
				name="people"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "car-people"
		shards = [
			{
				name="car-people"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	}
]
Configuring member-3 with IP address 10.30.170.138
Warning: Permanently added '10.30.170.138' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.170.138' (ECDSA) to the list of known hosts.
+ source /tmp/common-functions.sh karaf-0.21.0-SNAPSHOT
++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]]
common-functions.sh is being sourced
++ echo 'common-functions.sh is being sourced'
++ BUNDLEFOLDER=karaf-0.21.0-SNAPSHOT
++ export MAVENCONF=/tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
++ MAVENCONF=/tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
++ export FEATURESCONF=/tmp/karaf-0.21.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
++ FEATURESCONF=/tmp/karaf-0.21.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
++ export CUSTOMPROP=/tmp/karaf-0.21.0-SNAPSHOT/etc/custom.properties
++ CUSTOMPROP=/tmp/karaf-0.21.0-SNAPSHOT/etc/custom.properties
++ export LOGCONF=/tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
++ LOGCONF=/tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
++ export MEMCONF=/tmp/karaf-0.21.0-SNAPSHOT/bin/setenv
++ MEMCONF=/tmp/karaf-0.21.0-SNAPSHOT/bin/setenv
++ export CONTROLLERMEM=
++ CONTROLLERMEM=
++ export AKKACONF=/tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/akka.conf
++ AKKACONF=/tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/akka.conf
++ export MODULESCONF=/tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/modules.conf
++ MODULESCONF=/tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/modules.conf
++ export MODULESHARDSCONF=/tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/module-shards.conf
++ MODULESHARDSCONF=/tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/module-shards.conf
++ print_common_env
++ cat
common-functions environment:
MAVENCONF: /tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
ACTUALFEATURES: 
FEATURESCONF: /tmp/karaf-0.21.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
CUSTOMPROP: /tmp/karaf-0.21.0-SNAPSHOT/etc/custom.properties
LOGCONF: /tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
MEMCONF: /tmp/karaf-0.21.0-SNAPSHOT/bin/setenv
CONTROLLERMEM: 
AKKACONF: /tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/akka.conf
MODULESCONF: /tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/modules.conf
MODULESHARDSCONF: /tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/module-shards.conf
SUITES: 

++ SSH='ssh -t -t'
++ extra_services_cntl='     dnsmasq.service     httpd.service     libvirtd.service     openvswitch.service     ovs-vswitchd.service     ovsdb-server.service     rabbitmq-server.service '
++ extra_services_cmp='     libvirtd.service     openvswitch.service     ovs-vswitchd.service     ovsdb-server.service '
Changing to /tmp
Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.0-SNAPSHOT/karaf-0.21.0-20240713.213108-566.zip
+ echo 'Changing to /tmp'
+ cd /tmp
+ echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.0-SNAPSHOT/karaf-0.21.0-20240713.213108-566.zip'
+ wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.0-SNAPSHOT/karaf-0.21.0-20240713.213108-566.zip
--2024-07-14 00:30:46--  https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.0-SNAPSHOT/karaf-0.21.0-20240713.213108-566.zip
Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6
Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 290595168 (277M) [application/zip]
Saving to: ‘karaf-0.21.0-20240713.213108-566.zip’

     0K ........ ........ ........ ........ ........ ........  1% 78.8M 3s
  3072K ........ ........ ........ ........ ........ ........  2%  117M 3s
  6144K ........ ........ ........ ........ ........ ........  3%  160M 2s
  9216K ........ ........ ........ ........ ........ ........  4%  168M 2s
 12288K ........ ........ ........ ........ ........ ........  5%  166M 2s
 15360K ........ ........ ........ ........ ........ ........  6%  205M 2s
 18432K ........ ........ ........ ........ ........ ........  7%  223M 2s
 21504K ........ ........ ........ ........ ........ ........  8%  204M 2s
 24576K ........ ........ ........ ........ ........ ........  9%  218M 2s
 27648K ........ ........ ........ ........ ........ ........ 10%  123M 2s
 30720K ........ ........ ........ ........ ........ ........ 11%  263M 2s
 33792K ........ ........ ........ ........ ........ ........ 12%  236M 1s
 36864K ........ ........ ........ ........ ........ ........ 14%  261M 1s
 39936K ........ ........ ........ ........ ........ ........ 15%  175M 1s
 43008K ........ ........ ........ ........ ........ ........ 16%  249M 1s
 46080K ........ ........ ........ ........ ........ ........ 17%  273M 1s
 49152K ........ ........ ........ ........ ........ ........ 18%  325M 1s
 52224K ........ ........ ........ ........ ........ ........ 19%  251M 1s
 55296K ........ ........ ........ ........ ........ ........ 20%  188M 1s
 58368K ........ ........ ........ ........ ........ ........ 21%  317M 1s
 61440K ........ ........ ........ ........ ........ ........ 22%  333M 1s
 64512K ........ ........ ........ ........ ........ ........ 23%  335M 1s
 67584K ........ ........ ........ ........ ........ ........ 24%  259M 1s
 70656K ........ ........ ........ ........ ........ ........ 25%  263M 1s
 73728K ........ ........ ........ ........ ........ ........ 27%  226M 1s
 76800K ........ ........ ........ ........ ........ ........ 28%  271M 1s
 79872K ........ ........ ........ ........ ........ ........ 29%  205M 1s
 82944K ........ ........ ........ ........ ........ ........ 30%  276M 1s
 86016K ........ ........ ........ ........ ........ ........ 31%  307M 1s
 89088K ........ ........ ........ ........ ........ ........ 32%  206M 1s
 92160K ........ ........ ........ ........ ........ ........ 33%  290M 1s
 95232K ........ ........ ........ ........ ........ ........ 34%  237M 1s
 98304K ........ ........ ........ ........ ........ ........ 35%  289M 1s
101376K ........ ........ ........ ........ ........ ........ 36%  217M 1s
104448K ........ ........ ........ ........ ........ ........ 37%  291M 1s
107520K ........ ........ ........ ........ ........ ........ 38%  233M 1s
110592K ........ ........ ........ ........ ........ ........ 40%  305M 1s
113664K ........ ........ ........ ........ ........ ........ 41%  332M 1s
116736K ........ ........ ........ ........ ........ ........ 42%  324M 1s
119808K ........ ........ ........ ........ ........ ........ 43%  348M 1s
122880K ........ ........ ........ ........ ........ ........ 44%  336M 1s
125952K ........ ........ ........ ........ ........ ........ 45%  343M 1s
129024K ........ ........ ........ ........ ........ ........ 46%  334M 1s
132096K ........ ........ ........ ........ ........ ........ 47%  343M 1s
135168K ........ ........ ........ ........ ........ ........ 48%  336M 1s
138240K ........ ........ ........ ........ ........ ........ 49%  345M 1s
141312K ........ ........ ........ ........ ........ ........ 50%  346M 1s
144384K ........ ........ ........ ........ ........ ........ 51%  358M 1s
147456K ........ ........ ........ ........ ........ ........ 53%  346M 1s
150528K ........ ........ ........ ........ ........ ........ 54%  353M 1s
153600K ........ ........ ........ ........ ........ ........ 55%  283M 1s
156672K ........ ........ ........ ........ ........ ........ 56%  303M 1s
159744K ........ ........ ........ ........ ........ ........ 57%  273M 0s
162816K ........ ........ ........ ........ ........ ........ 58%  359M 0s
165888K ........ ........ ........ ........ ........ ........ 59%  353M 0s
168960K ........ ........ ........ ........ ........ ........ 60%  356M 0s
172032K ........ ........ ........ ........ ........ ........ 61%  316M 0s
175104K ........ ........ ........ ........ ........ ........ 62%  375M 0s
178176K ........ ........ ........ ........ ........ ........ 63%  341M 0s
181248K ........ ........ ........ ........ ........ ........ 64%  174M 0s
184320K ........ ........ ........ ........ ........ ........ 66%  339M 0s
187392K ........ ........ ........ ........ ........ ........ 67%  340M 0s
190464K ........ ........ ........ ........ ........ ........ 68%  332M 0s
193536K ........ ........ ........ ........ ........ ........ 69%  346M 0s
196608K ........ ........ ........ ........ ........ ........ 70%  334M 0s
199680K ........ ........ ........ ........ ........ ........ 71%  319M 0s
202752K ........ ........ ........ ........ ........ ........ 72%  332M 0s
205824K ........ ........ ........ ........ ........ ........ 73%  346M 0s
208896K ........ ........ ........ ........ ........ ........ 74%  320M 0s
211968K ........ ........ ........ ........ ........ ........ 75%  353M 0s
215040K ........ ........ ........ ........ ........ ........ 76%  345M 0s
218112K ........ ........ ........ ........ ........ ........ 77%  343M 0s
221184K ........ ........ ........ ........ ........ ........ 79%  336M 0s
224256K ........ ........ ........ ........ ........ ........ 80%  342M 0s
227328K ........ ........ ........ ........ ........ ........ 81%  216M 0s
230400K ........ ........ ........ ........ ........ ........ 82%  295M 0s
233472K ........ ........ ........ ........ ........ ........ 83%  384M 0s
236544K ........ ........ ........ ........ ........ ........ 84%  395M 0s
239616K ........ ........ ........ ........ ........ ........ 85%  381M 0s
242688K ........ ........ ........ ........ ........ ........ 86%  384M 0s
245760K ........ ........ ........ ........ ........ ........ 87%  354M 0s
248832K ........ ........ ........ ........ ........ ........ 88%  343M 0s
251904K ........ ........ ........ ........ ........ ........ 89%  345M 0s
254976K ........ ........ ........ ........ ........ ........ 90%  337M 0s
258048K ........ ........ ........ ........ ........ ........ 92%  332M 0s
261120K ........ ........ ........ ........ ........ ........ 93%  243M 0s
264192K ........ ........ ........ ........ ........ ........ 94%  279M 0s
267264K ........ ........ ........ ........ ........ ........ 95%  368M 0s
270336K ........ ........ ........ ........ ........ ........ 96%  324M 0s
273408K ........ ........ ........ ........ ........ ........ 97%  356M 0s
276480K ........ ........ ........ ........ ........ ........ 98%  256M 0s
279552K ........ ........ ........ ........ ........ ........ 99%  279M 0s
282624K ........ ........ ..                                 100%  351M=1.0s

2024-07-14 00:30:47 (269 MB/s) - ‘karaf-0.21.0-20240713.213108-566.zip’ saved [290595168/290595168]

+ echo 'Extracting the new controller...'
Extracting the new controller...
+ unzip -q karaf-0.21.0-20240713.213108-566.zip
Adding external repositories...
+ echo 'Adding external repositories...'
+ sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
+ cat /tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
################################################################################
#
#    Licensed to the Apache Software Foundation (ASF) under one or more
#    contributor license agreements.  See the NOTICE file distributed with
#    this work for additional information regarding copyright ownership.
#    The ASF licenses this file to You under the Apache License, Version 2.0
#    (the "License"); you may not use this file except in compliance with
#    the License.  You may obtain a copy of the License at
#
#       http://www.apache.org/licenses/LICENSE-2.0
#
#    Unless required by applicable law or agreed to in writing, software
#    distributed under the License is distributed on an "AS IS" BASIS,
#    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
#    See the License for the specific language governing permissions and
#    limitations under the License.
#
################################################################################

#
# If set to true, the following property will not allow any certificate to be used
# when accessing Maven repositories through SSL
#
#org.ops4j.pax.url.mvn.certificateCheck=

#
# Path to the local Maven settings file.
# The repositories defined in this file will be automatically added to the list
# of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property
# below is not set.
# The following locations are checked for the existence of the settings.xml file
#   * 1. looks for the specified url
#   * 2. if not found looks for ${user.home}/.m2/settings.xml
#   * 3. if not found looks for ${maven.home}/conf/settings.xml
#   * 4. if not found looks for ${M2_HOME}/conf/settings.xml
#
#org.ops4j.pax.url.mvn.settings=

#
# Path to the local Maven repository which is used to avoid downloading
# artifacts when they already exist locally.
# The value of this property will be extracted from the settings.xml file
# above, or defaulted to:
#     System.getProperty( "user.home" ) + "/.m2/repository"
#
org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository}

#
# Default this to false. It's just weird to use undocumented repos
#
org.ops4j.pax.url.mvn.useFallbackRepositories=false

#
# Uncomment if you don't wanna use the proxy settings
# from the Maven conf/settings.xml file
#
# org.ops4j.pax.url.mvn.proxySupport=false

#
# Comma separated list of repositories scanned when resolving an artifact.
# Those repositories will be checked before iterating through the
#    below list of repositories and even before the local repository
# A repository url can be appended with zero or more of the following flags:
#    @snapshots  : the repository contains snaphots
#    @noreleases : the repository does not contain any released artifacts
#
# The following property value will add the system folder as a repo.
#
org.ops4j.pax.url.mvn.defaultRepositories=\
    file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\
    file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\
    file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots

# Use the default local repo (e.g.~/.m2/repository) as a "remote" repo
#org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false

#
# Comma separated list of repositories scanned when resolving an artifact.
# The default list includes the following repositories:
#    http://repo1.maven.org/maven2@id=central
#    http://repository.springsource.com/maven/bundles/release@id=spring.ebr
#    http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external
#    http://zodiac.springsource.com/maven/bundles/release@id=gemini
#    http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases
#    https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases
#    https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
# To add repositories to the default ones, prepend '+' to the list of repositories
# to add.
# A repository url can be appended with zero or more of the following flags:
#    @snapshots  : the repository contains snapshots
#    @noreleases : the repository does not contain any released artifacts
#    @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended
#
org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases

### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.Configuring the startup features...
+ [[ True == \T\r\u\e ]]
+ echo 'Configuring the startup features...'
+ sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.21.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
+ FEATURE_TEST_STRING=features-test
+ FEATURE_TEST_VERSION=0.21.0-SNAPSHOT
+ KARAF_VERSION=karaf4
+ [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]]
+ sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.21.0-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.21.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
+ [[ ! -z '' ]]
+ cat /tmp/karaf-0.21.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
################################################################################
#
#    Licensed to the Apache Software Foundation (ASF) under one or more
#    contributor license agreements.  See the NOTICE file distributed with
#    this work for additional information regarding copyright ownership.
#    The ASF licenses this file to You under the Apache License, Version 2.0
#    (the "License"); you may not use this file except in compliance with
#    the License.  You may obtain a copy of the License at
#
#       http://www.apache.org/licenses/LICENSE-2.0
#
#    Unless required by applicable law or agreed to in writing, software
#    distributed under the License is distributed on an "AS IS" BASIS,
#    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
#    See the License for the specific language governing permissions and
#    limitations under the License.
#
################################################################################

#
# Comma separated list of features repositories to register by default
#
featuresRepositories = mvn:org.opendaylight.integration/features-test/0.21.0-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/08493256-6265-4383-ab30-d45ce4e978f5.xml

#
# Comma separated list of features to install at startup
#
featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, 49b78555-1641-42ff-9274-1e872c373654

#
# Resource repositories (OBR) that the features resolver can use
# to resolve requirements/capabilities
#
# The format of the resourceRepositories is 
# resourceRepositories=[xml:url|json:url],...
# for Instance:
#
#resourceRepositories=xml:http://host/path/to/index.xml
# or
#resourceRepositories=json:http://host/path/to/index.json
#

#
# Defines if the boot features are started in asynchronous mode (in a dedicated thread)
#
featuresBootAsynchronous=false

#
# Service requirements enforcement
#
# By default, the feature resolver checks the service requirements/capabilities of
# bundles for new features (xml schema >= 1.3.0) in order to automatically installs
# the required bundles.
# The following flag can have those values:
#   - disable: service requirements are completely ignored
#   - default: service requirements are ignored for old features
#   - enforce: service requirements are always verified
#
#serviceRequirements=default

#
# Store cfg file for config element in feature
#
#configCfgStore=true

#
# Define if the feature service automatically refresh bundles
#
autoRefresh=true

#
# Configuration of features processing mechanism (overrides, blacklisting, modification of features)
# XML file defines instructions related to features processing
# versions.properties may declare properties to resolve placeholders in XML file
# both files are relative to ${karaf.etc}
#
#featureProcessing=org.apache.karaf.features.xml
#featureProcessingVersions=versions.properties
+ configure_karaf_log karaf4 ''
+ local -r karaf_version=karaf4
+ local -r controllerdebugmap=
+ local logapi=log4j
+ grep log4j2 /tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
log4j2.rootLogger.level = INFO
#log4j2.rootLogger.type = asyncRoot
#log4j2.rootLogger.includeLocation = false
log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
log4j2.rootLogger.appenderRef.Console.ref = Console
log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
log4j2.logger.spifly.name = org.apache.aries.spifly
log4j2.logger.spifly.level = WARN
log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
log4j2.logger.audit.level = INFO
log4j2.logger.audit.additivity = false
log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
# Console appender not used by default (see log4j2.rootLogger.appenderRefs)
log4j2.appender.console.type = Console
log4j2.appender.console.name = Console
log4j2.appender.console.layout.type = PatternLayout
log4j2.appender.console.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.type = RollingRandomAccessFile
log4j2.appender.rolling.name = RollingFile
log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
#log4j2.appender.rolling.immediateFlush = false
log4j2.appender.rolling.append = true
log4j2.appender.rolling.layout.type = PatternLayout
log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.policies.type = Policies
log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.rolling.policies.size.size = 64MB
log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
log4j2.appender.rolling.strategy.max = 7
log4j2.appender.audit.type = RollingRandomAccessFile
log4j2.appender.audit.name = AuditRollingFile
log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
log4j2.appender.audit.append = true
log4j2.appender.audit.layout.type = PatternLayout
log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
log4j2.appender.audit.policies.type = Policies
log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.audit.policies.size.size = 8MB
log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
log4j2.appender.audit.strategy.max = 7
log4j2.appender.osgi.type = PaxOsgi
log4j2.appender.osgi.name = PaxOsgi
log4j2.appender.osgi.filter = *
#log4j2.logger.aether.name = shaded.org.eclipse.aether
#log4j2.logger.aether.level = TRACE
#log4j2.logger.http-headers.name = shaded.org.apache.http.headers
#log4j2.logger.http-headers.level = DEBUG
#log4j2.logger.maven.name = org.ops4j.pax.url.mvn
#log4j2.logger.maven.level = TRACE
Configuring the karaf log... karaf_version: karaf4, logapi: log4j2
+ logapi=log4j2
+ echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2'
+ '[' log4j2 == log4j2 ']'
+ sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
+ orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver
+ orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver
+ echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN'
controllerdebugmap: 
+ echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN'
+ unset IFS
+ echo 'controllerdebugmap: '
cat /tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
+ '[' -n '' ']'
+ echo 'cat /tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg'
+ cat /tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
################################################################################
#
#    Licensed to the Apache Software Foundation (ASF) under one or more
#    contributor license agreements.  See the NOTICE file distributed with
#    this work for additional information regarding copyright ownership.
#    The ASF licenses this file to You under the Apache License, Version 2.0
#    (the "License"); you may not use this file except in compliance with
#    the License.  You may obtain a copy of the License at
#
#       http://www.apache.org/licenses/LICENSE-2.0
#
#    Unless required by applicable law or agreed to in writing, software
#    distributed under the License is distributed on an "AS IS" BASIS,
#    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
#    See the License for the specific language governing permissions and
#    limitations under the License.
#
################################################################################

# Common pattern layout for appenders
log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n

# Root logger
log4j2.rootLogger.level = INFO
# uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library
#log4j2.rootLogger.type = asyncRoot
#log4j2.rootLogger.includeLocation = false
log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
log4j2.rootLogger.appenderRef.Console.ref = Console
log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}

# Filters for logs marked by org.opendaylight.odlparent.Markers
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL

# Loggers configuration

# Spifly logger
log4j2.logger.spifly.name = org.apache.aries.spifly
log4j2.logger.spifly.level = WARN

# Security audit logger
log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
log4j2.logger.audit.level = INFO
log4j2.logger.audit.additivity = false
log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile

# Appenders configuration

# Console appender not used by default (see log4j2.rootLogger.appenderRefs)
log4j2.appender.console.type = Console
log4j2.appender.console.name = Console
log4j2.appender.console.layout.type = PatternLayout
log4j2.appender.console.layout.pattern = ${log4j2.pattern}

# Rolling file appender
log4j2.appender.rolling.type = RollingRandomAccessFile
log4j2.appender.rolling.name = RollingFile
log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
# uncomment to not force a disk flush
#log4j2.appender.rolling.immediateFlush = false
log4j2.appender.rolling.append = true
log4j2.appender.rolling.layout.type = PatternLayout
log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.policies.type = Policies
log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.rolling.policies.size.size = 1GB
log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
log4j2.appender.rolling.strategy.max = 7

# Audit file appender
log4j2.appender.audit.type = RollingRandomAccessFile
log4j2.appender.audit.name = AuditRollingFile
log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
log4j2.appender.audit.append = true
log4j2.appender.audit.layout.type = PatternLayout
log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
log4j2.appender.audit.policies.type = Policies
log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.audit.policies.size.size = 8MB
log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
log4j2.appender.audit.strategy.max = 7

# OSGi appender
log4j2.appender.osgi.type = PaxOsgi
log4j2.appender.osgi.name = PaxOsgi
log4j2.appender.osgi.filter = *

# help with identification of maven-related problems with pax-url-aether
#log4j2.logger.aether.name = shaded.org.eclipse.aether
#log4j2.logger.aether.level = TRACE
#log4j2.logger.http-headers.name = shaded.org.apache.http.headers
#log4j2.logger.http-headers.level = DEBUG
#log4j2.logger.maven.name = org.ops4j.pax.url.mvn
#log4j2.logger.maven.level = TRACE
log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN
log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN
Configure
    java home: /usr/lib/jvm/java-17-openjdk
    max memory: 3072m
    memconf: /tmp/karaf-0.21.0-SNAPSHOT/bin/setenv
+ set_java_vars /usr/lib/jvm/java-17-openjdk 3072m /tmp/karaf-0.21.0-SNAPSHOT/bin/setenv
+ local -r java_home=/usr/lib/jvm/java-17-openjdk
+ local -r controllermem=3072m
+ local -r memconf=/tmp/karaf-0.21.0-SNAPSHOT/bin/setenv
+ echo Configure
+ echo '    java home: /usr/lib/jvm/java-17-openjdk'
+ echo '    max memory: 3072m'
+ echo '    memconf: /tmp/karaf-0.21.0-SNAPSHOT/bin/setenv'
+ sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk}%g' /tmp/karaf-0.21.0-SNAPSHOT/bin/setenv
+ sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.21.0-SNAPSHOT/bin/setenv
cat /tmp/karaf-0.21.0-SNAPSHOT/bin/setenv
+ echo 'cat /tmp/karaf-0.21.0-SNAPSHOT/bin/setenv'
+ cat /tmp/karaf-0.21.0-SNAPSHOT/bin/setenv
#!/bin/sh
#
#    Licensed to the Apache Software Foundation (ASF) under one or more
#    contributor license agreements.  See the NOTICE file distributed with
#    this work for additional information regarding copyright ownership.
#    The ASF licenses this file to You under the Apache License, Version 2.0
#    (the "License"); you may not use this file except in compliance with
#    the License.  You may obtain a copy of the License at
#
#       http://www.apache.org/licenses/LICENSE-2.0
#
#    Unless required by applicable law or agreed to in writing, software
#    distributed under the License is distributed on an "AS IS" BASIS,
#    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
#    See the License for the specific language governing permissions and
#    limitations under the License.
#

#
# handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf
# script: client, instance, shell, start, status, stop, karaf
#
# if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then
#   Actions go here...
# fi

#
# general settings which should be applied for all scripts go here; please keep
# in mind that it is possible that scripts might be executed more than once, e.g.
# in example of the start script where the start script is executed first and the
# karaf script afterwards.
#

#
# The following section shows the possible configuration options for the default 
# karaf scripts
#
export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk} # Location of Java installation
# export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration
# export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options
# export EXTRA_JAVA_OPTS # Additional JVM options
# export KARAF_HOME # Karaf home folder
# export KARAF_DATA # Karaf data folder
# export KARAF_BASE # Karaf base folder
# export KARAF_ETC  # Karaf etc  folder
# export KARAF_LOG  # Karaf log  folder
# export KARAF_SYSTEM_OPTS # First citizen Karaf options
# export KARAF_OPTS # Additional available Karaf options
# export KARAF_DEBUG # Enable debug mode
# export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start
# export KARAF_NOROOT # Prevent execution as root if set to true
+ echo 'Set Java version'
Set Java version
+ sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-17-openjdk/bin/java 1
+ sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-17-openjdk/bin/java
JDK default version ...
+ echo 'JDK default version ...'
+ java -version
openjdk version "17.0.6-ea" 2023-01-17 LTS
OpenJDK Runtime Environment (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS)
OpenJDK 64-Bit Server VM (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS, mixed mode, sharing)
Set JAVA_HOME
+ echo 'Set JAVA_HOME'
+ export JAVA_HOME=/usr/lib/jvm/java-17-openjdk
+ JAVA_HOME=/usr/lib/jvm/java-17-openjdk
++ readlink -e /usr/lib/jvm/java-17-openjdk/bin/java
Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java
+ JAVA_RESOLVED=/usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java
+ echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java'
Listing all open ports on controller system...
+ echo 'Listing all open ports on controller system...'
+ netstat -pnatu
(Not all processes could be identified, non-owned process info
 will not be shown, you would have to be root to see it all.)
Active Internet connections (servers and established)
Proto Recv-Q Send-Q Local Address           Foreign Address         State       PID/Program name    
tcp        0      0 0.0.0.0:111             0.0.0.0:*               LISTEN      -                   
tcp        0      0 0.0.0.0:22              0.0.0.0:*               LISTEN      -                   
tcp        0      0 10.30.170.138:37196     199.204.45.87:443       TIME_WAIT   -                   
tcp        0      0 10.30.170.138:22        10.30.171.81:53358      ESTABLISHED -                   
tcp6       0      0 :::111                  :::*                    LISTEN      -                   
tcp6       0      0 :::5555                 :::*                    LISTEN      -                   
tcp6       0      0 :::22                   :::*                    LISTEN      -                   
udp        0      0 10.30.170.138:68        10.30.170.2:67          ESTABLISHED -                   
udp        0      0 0.0.0.0:111             0.0.0.0:*                           -                   
udp        0      0 127.0.0.1:323           0.0.0.0:*                           -                   
udp6       0      0 :::111                  :::*                                -                   
udp6       0      0 ::1:323                 :::*                                -                   
Custom shard config exists!!!
Copying the shard config...
+ '[' -f /tmp/custom_shard_config.txt ']'
+ echo 'Custom shard config exists!!!'
+ echo 'Copying the shard config...'
+ cp /tmp/custom_shard_config.txt /tmp/karaf-0.21.0-SNAPSHOT/bin/
Configuring cluster
+ echo 'Configuring cluster'
+ /tmp/karaf-0.21.0-SNAPSHOT/bin/configure_cluster.sh 3 10.30.171.240 10.30.170.251 10.30.170.138
################################################
##             Configure Cluster              ##
################################################
 NOTE: Cluster configuration files not found. Copying from
 /tmp/karaf-0.21.0-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/9.0.2
Configuring unique name in akka.conf
Configuring hostname in akka.conf
Configuring data and rpc seed nodes in akka.conf
modules = [
	
	{
		name = "inventory"
		namespace = "urn:opendaylight:inventory"
		shard-strategy = "module"
	},
	{
		name = "topology"
		namespace = "urn:TBD:params:xml:ns:yang:network-topology"
		shard-strategy = "module"
	},
	{
		name = "toaster"
		namespace = "http://netconfcentral.org/ns/toaster"
		shard-strategy = "module"
	},
	{
		name = "car"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
		shard-strategy = "module"
	},
	{
		name = "people"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
		shard-strategy = "module"
	},
	{
		name = "car-people"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
		shard-strategy = "module"
	}
]
Configuring replication type in module-shards.conf
################################################
##   NOTE: Manually restart controller to     ##
##         apply configuration.               ##
################################################
Dump akka.conf
+ echo 'Dump akka.conf'
+ cat /tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/akka.conf

odl-cluster-data {
  akka {
    remote {
      artery {
        enabled = on
        transport = tcp
        canonical.hostname = "10.30.170.138"
        canonical.port = 2550
      }
    }

    cluster {
      # Using artery.
      seed-nodes = ["akka://opendaylight-cluster-data@10.30.171.240:2550",
				"akka://opendaylight-cluster-data@10.30.170.251:2550",
				"akka://opendaylight-cluster-data@10.30.170.138:2550"]

      roles = ["member-3"]

      # when under load we might trip a false positive on the failure detector
      # failure-detector {
        # heartbeat-interval = 4 s
        # acceptable-heartbeat-pause = 16s
      # }
    }

    persistence {
      # By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by
      # modifying the following two properties. The directory location specified may be a relative or absolute path. 
      # The relative path is always relative to KARAF_HOME.

      # snapshot-store.local.dir = "target/snapshots"

      # Use lz4 compression for LocalSnapshotStore snapshots
      snapshot-store.local.use-lz4-compression = false
      # Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB
      snapshot-store.local.lz4-blocksize = 256KB
    }
    disable-default-actor-system-quarantined-event-handling = "false"
  }
}
Dump modules.conf
+ echo 'Dump modules.conf'
+ cat /tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/modules.conf
modules = [
	
	{
		name = "inventory"
		namespace = "urn:opendaylight:inventory"
		shard-strategy = "module"
	},
	{
		name = "topology"
		namespace = "urn:TBD:params:xml:ns:yang:network-topology"
		shard-strategy = "module"
	},
	{
		name = "toaster"
		namespace = "http://netconfcentral.org/ns/toaster"
		shard-strategy = "module"
	},
	{
		name = "car"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
		shard-strategy = "module"
	},
	{
		name = "people"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
		shard-strategy = "module"
	},
	{
		name = "car-people"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
		shard-strategy = "module"
	}
]
Dump module-shards.conf
+ echo 'Dump module-shards.conf'
+ cat /tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/module-shards.conf
module-shards = [
	{
		name = "default"
		shards = [
			{
				name = "default"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "inventory"
		shards = [
			{
				name="inventory"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "topology"
		shards = [
			{
				name="topology"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "toaster"
		shards = [
			{
				name="toaster"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "car"
		shards = [
			{
				name="car"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "people"
		shards = [
			{
				name="people"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "car-people"
		shards = [
			{
				name="car-people"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	}
]
Locating config plan to use...
Finished running config plans
Starting member-1 with IP address 10.30.171.240
Warning: Permanently added '10.30.171.240' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.171.240' (ECDSA) to the list of known hosts.
Redirecting karaf console output to karaf_console.log
Starting controller...
start: Redirecting Karaf output to /tmp/karaf-0.21.0-SNAPSHOT/data/log/karaf_console.log
Starting member-2 with IP address 10.30.170.251
Warning: Permanently added '10.30.170.251' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.170.251' (ECDSA) to the list of known hosts.
Redirecting karaf console output to karaf_console.log
Starting controller...
start: Redirecting Karaf output to /tmp/karaf-0.21.0-SNAPSHOT/data/log/karaf_console.log
Starting member-3 with IP address 10.30.170.138
Warning: Permanently added '10.30.170.138' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.170.138' (ECDSA) to the list of known hosts.
Redirecting karaf console output to karaf_console.log
Starting controller...
start: Redirecting Karaf output to /tmp/karaf-0.21.0-SNAPSHOT/data/log/karaf_console.log
[controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins14561517020368486834.sh
common-functions.sh is being sourced
common-functions environment:
MAVENCONF: /tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
ACTUALFEATURES: 
FEATURESCONF: /tmp/karaf-0.21.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
CUSTOMPROP: /tmp/karaf-0.21.0-SNAPSHOT/etc/custom.properties
LOGCONF: /tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
MEMCONF: /tmp/karaf-0.21.0-SNAPSHOT/bin/setenv
CONTROLLERMEM: 2048m
AKKACONF: /tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/akka.conf
MODULESCONF: /tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/modules.conf
MODULESHARDSCONF: /tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/module-shards.conf
SUITES: 

+ echo '#################################################'
#################################################
+ echo '##         Verify Cluster is UP                ##'
##         Verify Cluster is UP                ##
+ echo '#################################################'
#################################################
+ create_post_startup_script
+ cat
+ copy_and_run_post_startup_script
+ seed_index=1
++ seq 1 3
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_1_IP
+ echo 'Execute the post startup script on controller 10.30.171.240'
Execute the post startup script on controller 10.30.171.240
+ scp /w/workspace/controller-csit-3node-clustering-tell-all-scandium/post-startup-script.sh 10.30.171.240:/tmp/
Warning: Permanently added '10.30.171.240' (ECDSA) to the list of known hosts.
+ ssh 10.30.171.240 'bash /tmp/post-startup-script.sh 1'
Warning: Permanently added '10.30.171.240' (ECDSA) to the list of known hosts.
tcp6       0      0 :::8101                 :::*                    LISTEN     
Waiting up to 3 minutes for controller to come up, checking every 5 seconds...
2024-07-14T00:31:48,165 | INFO  | SystemReadyService-0 | SimpleSystemReadyMonitor         | 300 - org.opendaylight.infrautils.ready-api - 6.0.6 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
Controller is UP
2024-07-14T00:31:48,165 | INFO  | SystemReadyService-0 | SimpleSystemReadyMonitor         | 300 - org.opendaylight.infrautils.ready-api - 6.0.6 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
Listing all open ports on controller system...
(Not all processes could be identified, non-owned process info
 will not be shown, you would have to be root to see it all.)
Active Internet connections (servers and established)
Proto Recv-Q Send-Q Local Address           Foreign Address         State       PID/Program name    
tcp        0      0 0.0.0.0:22              0.0.0.0:*               LISTEN      -                   
tcp        0      0 0.0.0.0:111             0.0.0.0:*               LISTEN      -                   
tcp        0      0 10.30.171.240:22        10.30.171.81:52130      ESTABLISHED -                   
tcp6       0      0 :::8181                 :::*                    LISTEN      5748/java           
tcp6       0      0 10.30.171.240:2550      :::*                    LISTEN      5748/java           
tcp6       0      0 :::22                   :::*                    LISTEN      -                   
tcp6       0      0 :::12345                :::*                    LISTEN      5748/java           
tcp6       0      0 127.0.0.1:44444         :::*                    LISTEN      5748/java           
tcp6       0      0 :::6653                 :::*                    LISTEN      5748/java           
tcp6       0      0 :::4189                 :::*                    LISTEN      5748/java           
tcp6       0      0 :::1790                 :::*                    LISTEN      5748/java           
tcp6       0      0 :::8101                 :::*                    LISTEN      5748/java           
tcp6       0      0 127.0.0.1:32837         :::*                    LISTEN      5748/java           
tcp6       0      0 :::6633                 :::*                    LISTEN      5748/java           
tcp6       0      0 127.0.0.1:1099          :::*                    LISTEN      5748/java           
tcp6       0      0 :::111                  :::*                    LISTEN      -                   
tcp6       0      0 :::6640                 :::*                    LISTEN      5748/java           
tcp6       0      0 :::5555                 :::*                    LISTEN      -                   
tcp6       0      0 127.0.0.1:39400         127.0.0.1:44444         TIME_WAIT   -                   
tcp6       0      0 10.30.171.240:54684     10.30.170.138:2550      ESTABLISHED 5748/java           
tcp6      32      0 10.30.171.240:39906     199.204.45.87:443       CLOSE_WAIT  5748/java           
tcp6       0      0 10.30.171.240:49212     10.30.170.251:2550      ESTABLISHED 5748/java           
tcp6       0      0 10.30.171.240:2550      10.30.170.251:50248     ESTABLISHED 5748/java           
tcp6       0      0 10.30.171.240:2550      10.30.170.251:50238     ESTABLISHED 5748/java           
tcp6       0      0 127.0.0.1:39390         127.0.0.1:44444         TIME_WAIT   -                   
tcp6       0      0 10.30.171.240:54672     10.30.170.138:2550      ESTABLISHED 5748/java           
tcp6       0      0 10.30.171.240:2550      10.30.170.138:56162     ESTABLISHED 5748/java           
tcp6       0      0 10.30.171.240:2550      10.30.170.138:56156     ESTABLISHED 5748/java           
tcp6       0      0 127.0.0.1:60336         127.0.0.1:1099          TIME_WAIT   -                   
tcp6       0      0 10.30.171.240:49220     10.30.170.251:2550      ESTABLISHED 5748/java           
udp        0      0 10.30.171.240:68        10.30.170.3:67          ESTABLISHED -                   
udp        0      0 0.0.0.0:111             0.0.0.0:*                           -                   
udp        0      0 127.0.0.1:323           0.0.0.0:*                           -                   
udp6       0      0 :::4342                 :::*                                5748/java           
udp6       0      0 :::111                  :::*                                -                   
udp6       0      0 ::1:323                 :::*                                -                   
looking for "BindException: Address already in use" in log file
looking for "server is unhealthy" in log file
+ '[' 1 == 0 ']'
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_2_IP
+ echo 'Execute the post startup script on controller 10.30.170.251'
Execute the post startup script on controller 10.30.170.251
+ scp /w/workspace/controller-csit-3node-clustering-tell-all-scandium/post-startup-script.sh 10.30.170.251:/tmp/
Warning: Permanently added '10.30.170.251' (ECDSA) to the list of known hosts.
+ ssh 10.30.170.251 'bash /tmp/post-startup-script.sh 2'
Warning: Permanently added '10.30.170.251' (ECDSA) to the list of known hosts.
tcp6       0      0 :::8101                 :::*                    LISTEN     
Waiting up to 3 minutes for controller to come up, checking every 5 seconds...
2024-07-14T00:31:48,142 | INFO  | SystemReadyService-0 | SimpleSystemReadyMonitor         | 300 - org.opendaylight.infrautils.ready-api - 6.0.6 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
Controller is UP
2024-07-14T00:31:48,142 | INFO  | SystemReadyService-0 | SimpleSystemReadyMonitor         | 300 - org.opendaylight.infrautils.ready-api - 6.0.6 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
Listing all open ports on controller system...
(Not all processes could be identified, non-owned process info
 will not be shown, you would have to be root to see it all.)
Active Internet connections (servers and established)
Proto Recv-Q Send-Q Local Address           Foreign Address         State       PID/Program name    
tcp        0      0 0.0.0.0:22              0.0.0.0:*               LISTEN      -                   
tcp        0      0 0.0.0.0:111             0.0.0.0:*               LISTEN      -                   
tcp        0    164 10.30.170.251:22        10.30.171.81:52356      ESTABLISHED -                   
tcp6       0      0 :::6640                 :::*                    LISTEN      5739/java           
tcp6       0      0 :::5555                 :::*                    LISTEN      -                   
tcp6       0      0 :::8181                 :::*                    LISTEN      5739/java           
tcp6       0      0 10.30.170.251:2550      :::*                    LISTEN      5739/java           
tcp6       0      0 :::22                   :::*                    LISTEN      -                   
tcp6       0      0 127.0.0.1:42715         :::*                    LISTEN      5739/java           
tcp6       0      0 127.0.0.1:44444         :::*                    LISTEN      5739/java           
tcp6       0      0 :::6653                 :::*                    LISTEN      5739/java           
tcp6       0      0 :::1790                 :::*                    LISTEN      5739/java           
tcp6       0      0 :::8101                 :::*                    LISTEN      5739/java           
tcp6       0      0 :::6633                 :::*                    LISTEN      5739/java           
tcp6       0      0 127.0.0.1:1099          :::*                    LISTEN      5739/java           
tcp6       0      0 :::111                  :::*                    LISTEN      -                   
tcp6       0      0 127.0.0.1:57258         127.0.0.1:1099          TIME_WAIT   -                   
tcp6       0      0 10.30.170.251:50248     10.30.171.240:2550      ESTABLISHED 5739/java           
tcp6       0      0 10.30.170.251:2550      10.30.170.138:47580     ESTABLISHED 5739/java           
tcp6       0      0 10.30.170.251:50238     10.30.171.240:2550      ESTABLISHED 5739/java           
tcp6       0      0 10.30.170.251:2550      10.30.171.240:49220     ESTABLISHED 5739/java           
tcp6       0      0 10.30.170.251:2550      10.30.170.138:47564     ESTABLISHED 5739/java           
tcp6      32      0 10.30.170.251:51480     199.204.45.87:443       CLOSE_WAIT  5739/java           
tcp6       0      0 10.30.170.251:2550      10.30.171.240:49212     ESTABLISHED 5739/java           
tcp6       0      0 127.0.0.1:36032         127.0.0.1:44444         TIME_WAIT   -                   
tcp6       0      0 10.30.170.251:35408     10.30.170.138:2550      ESTABLISHED 5739/java           
tcp6       0      0 10.30.170.251:35420     10.30.170.138:2550      ESTABLISHED 5739/java           
tcp6       0      0 127.0.0.1:36038         127.0.0.1:44444         TIME_WAIT   -                   
udp        0      0 10.30.170.251:68        10.30.170.2:67          ESTABLISHED -                   
udp        0      0 0.0.0.0:111             0.0.0.0:*                           -                   
udp        0      0 127.0.0.1:323           0.0.0.0:*                           -                   
udp6       0      0 :::4342                 :::*                                5739/java           
udp6       0      0 :::111                  :::*                                -                   
udp6       0      0 ::1:323                 :::*                                -                   
looking for "BindException: Address already in use" in log file
looking for "server is unhealthy" in log file
+ '[' 2 == 0 ']'
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_3_IP
+ echo 'Execute the post startup script on controller 10.30.170.138'
Execute the post startup script on controller 10.30.170.138
+ scp /w/workspace/controller-csit-3node-clustering-tell-all-scandium/post-startup-script.sh 10.30.170.138:/tmp/
Warning: Permanently added '10.30.170.138' (ECDSA) to the list of known hosts.
+ ssh 10.30.170.138 'bash /tmp/post-startup-script.sh 3'
Warning: Permanently added '10.30.170.138' (ECDSA) to the list of known hosts.
tcp6       0      0 :::8101                 :::*                    LISTEN     
Waiting up to 3 minutes for controller to come up, checking every 5 seconds...
2024-07-14T00:31:48,147 | INFO  | SystemReadyService-0 | SimpleSystemReadyMonitor         | 300 - org.opendaylight.infrautils.ready-api - 6.0.6 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
Controller is UP
2024-07-14T00:31:48,147 | INFO  | SystemReadyService-0 | SimpleSystemReadyMonitor         | 300 - org.opendaylight.infrautils.ready-api - 6.0.6 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
Listing all open ports on controller system...
(Not all processes could be identified, non-owned process info
 will not be shown, you would have to be root to see it all.)
Active Internet connections (servers and established)
Proto Recv-Q Send-Q Local Address           Foreign Address         State       PID/Program name    
tcp        0      0 0.0.0.0:111             0.0.0.0:*               LISTEN      -                   
tcp        0      0 0.0.0.0:22              0.0.0.0:*               LISTEN      -                   
tcp        0      0 10.30.170.138:22        10.30.171.81:37452      ESTABLISHED -                   
tcp6       0      0 :::8101                 :::*                    LISTEN      5755/java           
tcp6       0      0 :::6633                 :::*                    LISTEN      5755/java           
tcp6       0      0 127.0.0.1:1099          :::*                    LISTEN      5755/java           
tcp6       0      0 :::111                  :::*                    LISTEN      -                   
tcp6       0      0 :::6640                 :::*                    LISTEN      5755/java           
tcp6       0      0 :::5555                 :::*                    LISTEN      -                   
tcp6       0      0 :::8181                 :::*                    LISTEN      5755/java           
tcp6       0      0 10.30.170.138:2550      :::*                    LISTEN      5755/java           
tcp6       0      0 :::22                   :::*                    LISTEN      -                   
tcp6       0      0 127.0.0.1:39927         :::*                    LISTEN      5755/java           
tcp6       0      0 127.0.0.1:44444         :::*                    LISTEN      5755/java           
tcp6       0      0 :::6653                 :::*                    LISTEN      5755/java           
tcp6       0      0 :::1790                 :::*                    LISTEN      5755/java           
tcp6       0      0 10.30.170.138:2550      10.30.171.240:54672     ESTABLISHED 5755/java           
tcp6       0      0 10.30.170.138:2550      10.30.171.240:54684     ESTABLISHED 5755/java           
tcp6       0      0 10.30.170.138:2550      10.30.170.251:35408     ESTABLISHED 5755/java           
tcp6       0      0 10.30.170.138:47564     10.30.170.251:2550      ESTABLISHED 5755/java           
tcp6       0      0 10.30.170.138:2550      10.30.170.251:35420     ESTABLISHED 5755/java           
tcp6       0      0 10.30.170.138:47580     10.30.170.251:2550      ESTABLISHED 5755/java           
tcp6       0      0 127.0.0.1:45312         127.0.0.1:1099          TIME_WAIT   -                   
tcp6      32      0 10.30.170.138:57852     199.204.45.87:443       CLOSE_WAIT  5755/java           
tcp6       0      0 127.0.0.1:32936         127.0.0.1:44444         TIME_WAIT   -                   
tcp6       0      0 10.30.170.138:56162     10.30.171.240:2550      ESTABLISHED 5755/java           
tcp6       0      0 10.30.170.138:56156     10.30.171.240:2550      ESTABLISHED 5755/java           
tcp6       0      0 127.0.0.1:32940         127.0.0.1:44444         TIME_WAIT   -                   
udp        0      0 10.30.170.138:68        10.30.170.2:67          ESTABLISHED -                   
udp        0      0 0.0.0.0:111             0.0.0.0:*                           -                   
udp        0      0 127.0.0.1:323           0.0.0.0:*                           -                   
udp6       0      0 :::4342                 :::*                                5755/java           
udp6       0      0 :::111                  :::*                                -                   
udp6       0      0 ::1:323                 :::*                                -                   
looking for "BindException: Address already in use" in log file
looking for "server is unhealthy" in log file
+ '[' 0 == 0 ']'
+ seed_index=1
+ dump_controller_threads
++ seq 1 3
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_1_IP
+ echo 'Let'\''s take the karaf thread dump'
Let's take the karaf thread dump
+ ssh 10.30.171.240 'sudo ps aux'
Warning: Permanently added '10.30.171.240' (ECDSA) to the list of known hosts.
++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-scandium/ps_before.log
++ grep -v grep
++ tr -s ' '
++ cut -f2 '-d '
+ pid=5748
+ echo 'karaf main: org.apache.karaf.main.Main, pid:5748'
karaf main: org.apache.karaf.main.Main, pid:5748
+ ssh 10.30.171.240 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 5748'
Warning: Permanently added '10.30.171.240' (ECDSA) to the list of known hosts.
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_2_IP
+ echo 'Let'\''s take the karaf thread dump'
Let's take the karaf thread dump
+ ssh 10.30.170.251 'sudo ps aux'
Warning: Permanently added '10.30.170.251' (ECDSA) to the list of known hosts.
++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-scandium/ps_before.log
++ grep -v grep
++ cut -f2 '-d '
++ tr -s ' '
+ pid=5739
+ echo 'karaf main: org.apache.karaf.main.Main, pid:5739'
karaf main: org.apache.karaf.main.Main, pid:5739
+ ssh 10.30.170.251 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 5739'
Warning: Permanently added '10.30.170.251' (ECDSA) to the list of known hosts.
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_3_IP
+ echo 'Let'\''s take the karaf thread dump'
Let's take the karaf thread dump
+ ssh 10.30.170.138 'sudo ps aux'
Warning: Permanently added '10.30.170.138' (ECDSA) to the list of known hosts.
++ tr -s ' '
++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-scandium/ps_before.log
++ grep -v grep
++ cut -f2 '-d '
+ pid=5755
+ echo 'karaf main: org.apache.karaf.main.Main, pid:5755'
karaf main: org.apache.karaf.main.Main, pid:5755
+ ssh 10.30.170.138 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 5755'
Warning: Permanently added '10.30.170.138' (ECDSA) to the list of known hosts.
+ '[' 0 -gt 0 ']'
+ echo 'Generating controller variables...'
Generating controller variables...
++ seq 1 3
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_1_IP
+ odl_variables=' -v ODL_SYSTEM_1_IP:10.30.171.240'
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_2_IP
+ odl_variables=' -v ODL_SYSTEM_1_IP:10.30.171.240 -v ODL_SYSTEM_2_IP:10.30.170.251'
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_3_IP
+ odl_variables=' -v ODL_SYSTEM_1_IP:10.30.171.240 -v ODL_SYSTEM_2_IP:10.30.170.251 -v ODL_SYSTEM_3_IP:10.30.170.138'
+ echo 'Generating mininet variables...'
Generating mininet variables...
++ seq 1 0
+ get_test_suites SUITES
+ local __suite_list=SUITES
+ echo 'Locating test plan to use...'
Locating test plan to use...
+ testplan_filepath=/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/testplans/controller-clustering-tell-scandium.txt
+ '[' '!' -f /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/testplans/controller-clustering-tell-scandium.txt ']'
+ testplan_filepath=/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/testplans/controller-clustering-tell.txt
+ '[' disabled '!=' disabled ']'
+ echo 'Changing the testplan path...'
Changing the testplan path...
+ sed s:integration:/w/workspace/controller-csit-3node-clustering-tell-all-scandium: /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/testplans/controller-clustering-tell.txt
+ cat testplan.txt
# Place the suites in run order:

# disabling all "prefix based" suites. This functionality was newly
# introduced with these tests in 2017. The assumption is that
# development stopped in that area, but may continue at a later
# time. Still, the tests are failing and no resources to solve the
# failures at this time. If/When this changes, we can uncomment
# those suites. Note that every suite is commented out with it's
# accompanying "restart_with_tell_based_true" setup suite.


# /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/ddb-sanity-prefix-based.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown_prefbasedshard.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement_prefbasedshard.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/leader_isolation_prefbasedshard.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/client_isolation.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/client_isolation_prefbasedshard.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/listener_stability.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/listener_stability_prefbasedshard.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/master_stability.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot
+ '[' -z '' ']'
++ grep -E -v '(^[[:space:]]*#|^[[:space:]]*$)' testplan.txt
++ tr '\012' ' '
+ suite_list='/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot '
+ eval 'SUITES='\''/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot '\'''
++ SUITES='/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot '
+ echo 'Starting Robot test suites /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot  ...'
Starting Robot test suites /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot  ...
+ robot -N controller-clustering-tell.txt --removekeywords wuks -e exclude -e skip_if_scandium -v BUNDLEFOLDER:karaf-0.21.0-SNAPSHOT -v BUNDLE_URL:https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.0-SNAPSHOT/karaf-0.21.0-20240713.213108-566.zip -v CONTROLLER:10.30.171.240 -v CONTROLLER1:10.30.170.251 -v CONTROLLER2:10.30.170.138 -v CONTROLLER_USER:jenkins -v JAVA_HOME:/usr/lib/jvm/java-17-openjdk -v JDKVERSION:openjdk17 -v JENKINS_WORKSPACE:/w/workspace/controller-csit-3node-clustering-tell-all-scandium -v MININET: -v MININET1: -v MININET2: -v MININET_USER:jenkins -v NEXUSURL_PREFIX:https://nexus.opendaylight.org -v NUM_ODL_SYSTEM:3 -v NUM_TOOLS_SYSTEM:0 -v ODL_STREAM:scandium -v ODL_SYSTEM_IP:10.30.171.240 -v ODL_SYSTEM_1_IP:10.30.171.240 -v ODL_SYSTEM_2_IP:10.30.170.251 -v ODL_SYSTEM_3_IP:10.30.170.138 -v ODL_SYSTEM_USER:jenkins -v TOOLS_SYSTEM_IP: -v TOOLS_SYSTEM_USER:jenkins -v USER_HOME:/home/jenkins -v IS_KARAF_APPL:True -v WORKSPACE:/tmp /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot
==============================================================================
controller-clustering-tell.txt                                                
==============================================================================
controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
==============================================================================
Stop_All_Members :: Stop every odl node.                              | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.138', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-tell.txt.Ddb-Sanity-Module-Based :: DOMDataBroker tes...
==============================================================================
Get_Shard_Role :: Get shard role.                                     | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_ddb_sanity_module_based_get_shard_role"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_get_shard_role&order=bug_status"

HTTPError: 404 Client Error: Not Found for url: http://10.30.171.240:8181/restconf/operations/cluster-admin:get-shard-role
------------------------------------------------------------------------------
Subscribe_Listener_To_Leader :: Subscribe listener to leader.         | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_ddb_sanity_module_based_subscribe_listener_to_leader"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_subscribe_listener_to_leader&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.170.138', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Subscribe_Listener_To_Follower :: Subscribe listener to follower.     | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_ddb_sanity_module_based_subscribe_listener_to_follower"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_subscribe_listener_to_follower&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.170.138', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Make_Leader_Local :: Make the loeader local and verify.               | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_ddb_sanity_module_based_make_leader_local"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_make_leader_local&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.170.138', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Remove_Leader_Shard_Replica_And_Add_It_Back :: Remove and add shar... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_ddb_sanity_module_based_remove_leader_shard_replica_and_add_it_back"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_remove_leader_shard_replica_and_add_it_back&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.170.138', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Remove_Follower_Shard_Replica_And_Add_It_Back :: Remove and add sh... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_ddb_sanity_module_based_remove_follower_shard_replica_and_add_it_back"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_remove_follower_shard_replica_and_add_it_back&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.170.138', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Write_Transactions_One_Node_Leader :: Write transactions.             | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_one_node_leader"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_one_node_leader&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.170.138', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Write_Transactions_One_Node_Follower :: Write transactions.           | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_one_node_follower"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_one_node_follower&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.170.138', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Write_Transactions_All_Nodes :: Write transactions.                   | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_all_nodes"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_all_nodes&order=bug_status"

[ 200 | 201 | 204 ] does not contain value '500'.
------------------------------------------------------------------------------
controller-clustering-tell.txt.Ddb-Sanity-Module-Based :: DOMDataB... | FAIL |
9 tests, 0 passed, 9 failed
==============================================================================
controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
==============================================================================
Stop_All_Members :: Stop every odl node.                              | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.138', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-tell.txt.Clean Leader Shutdown :: DOMDataBroker testi...
==============================================================================
Local_Leader_Shutdown :: Shutdown the leader on the same node as t... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_clean_leader_shutdown_local_leader_shutdown"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_clean_leader_shutdown_local_leader_shutdown&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.170.138', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Restart :: Restart odl                                                | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_clean_leader_shutdown_restart"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_clean_leader_shutdown_restart&order=bug_status"

Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Remote_Leader_Shutdown :: Shutdown the leader on different node as... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_clean_leader_shutdown_remote_leader_shutdown"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_clean_leader_shutdown_remote_leader_shutdown&order=bug_status"

ConnectionError: HTTPConnectionPool(host='10.30.171.240', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f2cbc1b7fd0>: Failed to establish a new connection: [Errno 111] Connection refused'))
------------------------------------------------------------------------------
controller-clustering-tell.txt.Clean Leader Shutdown :: DOMDataBro... | FAIL |
3 tests, 0 passed, 3 failed
==============================================================================
controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
==============================================================================
Stop_All_Members :: Stop every odl node.                              | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.138', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-tell.txt.Explicit Leader Movement :: DOMDataBroker te...
==============================================================================
Local_To_Remote_Movement :: Leader moves from local to remote node... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_explicit_leader_movement_local_to_remote_movement"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_local_to_remote_movement&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.170.138', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Restart1 :: Restart odl                                               | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_explicit_leader_movement_restart1"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_restart1&order=bug_status"

Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Remote_To_Remote_Movement :: Leader moves from one remote to other... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_explicit_leader_movement_remote_to_remote_movement"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_remote_to_remote_movement&order=bug_status"

ConnectionError: HTTPConnectionPool(host='10.30.171.240', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f2cbc34f150>: Failed to establish a new connection: [Errno 111] Connection refused'))
------------------------------------------------------------------------------
Restart2 :: Restart odl                                               | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_explicit_leader_movement_restart2"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_restart2&order=bug_status"

Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Remote_To_Local_Movement :: Leader moves from remote to local node... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_explicit_leader_movement_remote_to_local_movement"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_remote_to_local_movement&order=bug_status"

ConnectionError: HTTPConnectionPool(host='10.30.171.240', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f2cbc3cb110>: Failed to establish a new connection: [Errno 111] Connection refused'))
------------------------------------------------------------------------------
controller-clustering-tell.txt.Explicit Leader Movement :: DOMData... | FAIL |
5 tests, 0 passed, 5 failed
==============================================================================
controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
==============================================================================
Stop_All_Members :: Stop every odl node.                              | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.138', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-tell.txt.Leader Isolation :: DOMDataBroker testing: L...
==============================================================================
Healing_Within_Request_Timeout :: The isolated node (leader) is re... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_leader_isolation_healing_within_request_timeout"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_leader_isolation_healing_within_request_timeout&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.170.138', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Restart :: Restart odl                                                | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_leader_isolation_restart"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_leader_isolation_restart&order=bug_status"

Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Healing_After_Request_Timeout :: The isolated node (leader) is rej... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_leader_isolation_healing_after_request_timeout"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_leader_isolation_healing_after_request_timeout&order=bug_status"

ConnectionError: HTTPConnectionPool(host='10.30.171.240', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f2cb752c810>: Failed to establish a new connection: [Errno 111] Connection refused'))
------------------------------------------------------------------------------
controller-clustering-tell.txt.Leader Isolation :: DOMDataBroker t... | FAIL |
3 tests, 0 passed, 3 failed
==============================================================================
controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
==============================================================================
Stop_All_Members :: Stop every odl node.                              | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.138', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-tell.txt.Client Isolation :: DOMDataBroker testing: C...
==============================================================================
Producer_On_Shard_Leader_Node_ChainedTx :: Client isolation with p... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_client_isolation_producer_on_shard_leader_node_chainedtx"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_producer_on_shard_leader_node_chainedtx&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.170.138', port=8181): Read timed out. (read timeout=125.0)

Also keyword teardown failed:
Several failures occurred:

1) Variable '${client_node_dst}' not found.

2) Variable '${client_node_dst}' not found.

3) Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 1 minute 10 seconds. The last error was: Several failures occurred:

1) ReadTimeout: HTTPConnectionPool(host='10.30.170.138', port=8181): Read timed out. (read timeout=125.0)

2) Resolving variable '${response.text}' failed: AttributeError: 'NoneType' object has no attribute 'text'

3) Resolving variable '${response.status_code}' failed: AttributeError: 'No...
    [ Message content over the limit has been removed. ]

65) Resolving variable '${response.text}' failed: AttributeError: 'NoneType' object has no attribute 'text'

66) Evaluating expression "json.loads('''None''')" failed: JSONDecodeError: Expecting value: line 1 column 1 (char 0)

67) TypeError: Expected argument 1 to be a dictionary, got None instead.

68) TypeError: Expected argument 1 to be a dictionary, got None instead.

69) Unrecognized Raft state: None

70) No leader found.

71) Too many Leaders.

72) IndexError: Given index 0 is out of the range 0--1.

4) KeyError: 'threads'
------------------------------------------------------------------------------
Restart1 :: Restart odl                                               | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_client_isolation_restart1"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_restart1&order=bug_status"

Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Producer_On_Shard_Leader_Node_SimpleTx :: Client isolation with pr... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_client_isolation_producer_on_shard_leader_node_simpletx"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_producer_on_shard_leader_node_simpletx&order=bug_status"

ConnectionError: HTTPConnectionPool(host='10.30.171.240', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f2cb750a710>: Failed to establish a new connection: [Errno 111] Connection refused'))

Also keyword teardown failed:
Several failures occurred:

1) Variable '${client_node_dst}' not found.

2) Variable '${client_node_dst}' not found.

3) Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 1 minute 10 seconds. The last error was: Several failures occurred:

1) ConnectionError: HTTPConnectionPool(host='10.30.171.240', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f...
    [ Message content over the limit has been removed. ]

173) Resolving variable '${response.text}' failed: AttributeError: 'NoneType' object has no attribute 'text'

174) Evaluating expression "json.loads('''None''')" failed: JSONDecodeError: Expecting value: line 1 column 1 (char 0)

175) TypeError: Expected argument 1 to be a dictionary, got None instead.

176) TypeError: Expected argument 1 to be a dictionary, got None instead.

177) Unrecognized Raft state: None

178) No leader found.

179) Too many Leaders.

180) IndexError: Given index 0 is out of the range 0--1.

4) KeyError: 'threads'
------------------------------------------------------------------------------
Restart2 :: Restart odl                                               | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_client_isolation_restart2"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_restart2&order=bug_status"

Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Producer_On_Shard_Non_Leader_Node_ChainedTx :: Client isolation wi... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_client_isolation_producer_on_shard_non_leader_node_chainedtx"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_producer_on_shard_non_leader_node_chainedtx&order=bug_status"

ConnectionError: HTTPConnectionPool(host='10.30.171.240', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f2cbc645010>: Failed to establish a new connection: [Errno 111] Connection refused'))

Also keyword teardown failed:
Several failures occurred:

1) Variable '${client_node_dst}' not found.

2) Variable '${client_node_dst}' not found.

3) Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 1 minute 10 seconds. The last error was: Several failures occurred:

1) ConnectionError: HTTPConnectionPool(host='10.30.171.240', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f...
    [ Message content over the limit has been removed. ]

173) Resolving variable '${response.text}' failed: AttributeError: 'NoneType' object has no attribute 'text'

174) Evaluating expression "json.loads('''None''')" failed: JSONDecodeError: Expecting value: line 1 column 1 (char 0)

175) TypeError: Expected argument 1 to be a dictionary, got None instead.

176) TypeError: Expected argument 1 to be a dictionary, got None instead.

177) Unrecognized Raft state: None

178) No leader found.

179) Too many Leaders.

180) IndexError: Given index 0 is out of the range 0--1.

4) KeyError: 'threads'
------------------------------------------------------------------------------
Restart3 :: Restart odl                                               | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_client_isolation_restart3"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_restart3&order=bug_status"

Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Producer_On_Shard_Non_Leader_Node_SimpleTx :: Client isolation wit... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_client_isolation_producer_on_shard_non_leader_node_simpletx"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_producer_on_shard_non_leader_node_simpletx&order=bug_status"

ConnectionError: HTTPConnectionPool(host='10.30.171.240', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f2cb7645010>: Failed to establish a new connection: [Errno 111] Connection refused'))

Also keyword teardown failed:
Several failures occurred:

1) Variable '${client_node_dst}' not found.

2) Variable '${client_node_dst}' not found.

3) Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 1 minute 10 seconds. The last error was: Several failures occurred:

1) ConnectionError: HTTPConnectionPool(host='10.30.171.240', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f...
    [ Message content over the limit has been removed. ]

173) Resolving variable '${response.text}' failed: AttributeError: 'NoneType' object has no attribute 'text'

174) Evaluating expression "json.loads('''None''')" failed: JSONDecodeError: Expecting value: line 1 column 1 (char 0)

175) TypeError: Expected argument 1 to be a dictionary, got None instead.

176) TypeError: Expected argument 1 to be a dictionary, got None instead.

177) Unrecognized Raft state: None

178) No leader found.

179) Too many Leaders.

180) IndexError: Given index 0 is out of the range 0--1.

4) KeyError: 'threads'
------------------------------------------------------------------------------
controller-clustering-tell.txt.Client Isolation :: DOMDataBroker t... | FAIL |
7 tests, 0 passed, 7 failed
==============================================================================
controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
==============================================================================
Stop_All_Members :: Stop every odl node.                              | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.138', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-tell.txt.Listener Stability :: DOMDataBroker testing:...
==============================================================================
Move_Leader_From_Listener_Local_To_Remote :: Listener runs on lead... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_listener_stability_move_leader_from_listener_local_to_remote"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_listener_stability_move_leader_from_listener_local_to_remote&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.170.138', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Restart_1 :: Restart odl.                                             | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_listener_stability_restart_1"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_listener_stability_restart_1&order=bug_status"

Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Move_Leader_From_Listener_Remote_To_Other_Remote :: Listener runs ... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_listener_stability_move_leader_from_listener_remote_to_other_remote"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_listener_stability_move_leader_from_listener_remote_to_other_remote&order=bug_status"

ConnectionError: HTTPConnectionPool(host='10.30.171.240', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f2cbd925e10>: Failed to establish a new connection: [Errno 111] Connection refused'))
------------------------------------------------------------------------------
Restart_2 :: Restart odl.                                             | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_listener_stability_restart_2"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_listener_stability_restart_2&order=bug_status"

Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Move_Leader_From_Listener_Remote_To_Local :: Listener runs on foll... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_listener_stability_move_leader_from_listener_remote_to_local"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_listener_stability_move_leader_from_listener_remote_to_local&order=bug_status"

ConnectionError: HTTPConnectionPool(host='10.30.171.240', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f2cb746d050>: Failed to establish a new connection: [Errno 111] Connection refused'))
------------------------------------------------------------------------------
controller-clustering-tell.txt.Listener Stability :: DOMDataBroker... | FAIL |
5 tests, 0 passed, 5 failed
==============================================================================
controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
==============================================================================
Stop_All_Members :: Stop every odl node.                              | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.138', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-tell.txt.Master Stability :: Cluster Singleton testin...
==============================================================================
Register_Singleton_Constant_On_Each_Node_And_Verify :: Register a ... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_master_stability_register_singleton_constant_on_each_node_and_verify"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_register_singleton_constant_on_each_node_and_verify&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.170.138', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Unregister_Singleton_Constant_On_Non_Master_Node :: Unregister the... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_master_stability_unregister_singleton_constant_on_non_master_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_unregister_singleton_constant_on_non_master_node&order=bug_status"

Variable '@{cs_candidates}' not found. Did you mean:
    @{cs_exp_candidates}
------------------------------------------------------------------------------
Monitor_Stability_While_Unregistered :: Verify that the owner rema... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_master_stability_monitor_stability_while_unregistered"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_monitor_stability_while_unregistered&order=bug_status"

Variable '${cs_owner}' not found.
------------------------------------------------------------------------------
Reregister_Singleton_Constant :: Re-register the unregistered cand... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_master_stability_reregister_singleton_constant"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_reregister_singleton_constant&order=bug_status"

Variable '${unregistered_node}' not found.
------------------------------------------------------------------------------
Verify_Stability_After_Reregistration :: Verify that the owner rem... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_master_stability_verify_stability_after_reregistration"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_verify_stability_after_reregistration&order=bug_status"

Variable '${cs_owner}' not found.
------------------------------------------------------------------------------
Unregister_Singleton_Constant_On_Each_Node :: Unregister the appli... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_master_stability_unregister_singleton_constant_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_unregister_singleton_constant_on_each_node&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.170.138', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-tell.txt.Master Stability :: Cluster Singlet... | FAIL |
6 tests, 0 passed, 6 failed
==============================================================================
controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
==============================================================================
Stop_All_Members :: Stop every odl node.                              | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.138', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-tell.txt.Partition And Heal :: Cluster Singleton test...
==============================================================================
Register_Singleton_Constant_On_Each_Node :: Register a candidate a... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_partition_and_heal_register_singleton_constant_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_register_singleton_constant_on_each_node&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.170.138', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Verify_Singleton_Constant_On_Each_Node :: Store the owner and cand... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_partition_and_heal_verify_singleton_constant_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_verify_singleton_constant_on_each_node&order=bug_status"

Could not parse owner and candidates for device get-singleton-constant-service']
------------------------------------------------------------------------------
Isolate_Owner_Node :: Isolate the cluster node which is the owner.... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_partition_and_heal_isolate_owner_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_isolate_owner_node&order=bug_status"

Variable '${cs_owner}' not found.
------------------------------------------------------------------------------
Monitor_Stability_While_Isolated :: Monitor the stability of the s... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_partition_and_heal_monitor_stability_while_isolated"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_monitor_stability_while_isolated&order=bug_status"

Invalid IF condition: Evaluating expression '"${index}" == "${cs_isolated_index}"' failed: Variable '${cs_isolated_index}' not found.
------------------------------------------------------------------------------
Rejoin_Isolated_node :: Rejoin isolated node.                         | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_partition_and_heal_rejoin_isolated_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_rejoin_isolated_node&order=bug_status"

Variable '${cs_isolated_index}' not found.
------------------------------------------------------------------------------
Unregister_Singleton_Constant_On_Each_Node :: Unregister the appli... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_partition_and_heal_unregister_singleton_constant_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_unregister_singleton_constant_on_each_node&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.170.138', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-tell.txt.Partition And Heal :: Cluster Singl... | FAIL |
6 tests, 0 passed, 6 failed
==============================================================================
controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
==============================================================================
Stop_All_Members :: Stop every odl node.                              | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.138', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-tell.txt.Chasing The Leader :: Cluster Singleton test...
==============================================================================
Register_Candidates :: Register a candidate application on each no... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_chasing_the_leader_register_candidates"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_chasing_the_leader_register_candidates&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.170.138', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Do_Nothing :: Do nothing for the time of the test duration, becaus... | PASS |
------------------------------------------------------------------------------
Unregister_Candidates_And_Validate_Criteria :: Unregister the test... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_chasing_the_leader_unregister_candidates_and_validate_criteria"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_chasing_the_leader_unregister_candidates_and_validate_criteria&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.170.138', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-tell.txt.Chasing The Leader :: Cluster Singl... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
==============================================================================
Stop_All_Members :: Stop every odl node.                              | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.138', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-tell.txt.Carpeople Crud :: Suite for performing basic...
==============================================================================
Add_Cars_To_Leader :: Add 30 cars to car Leader by one big PUT.       | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Added_Cars_On_Leader :: GET response from Leader should match ... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Added_Cars_On_Followers :: The same check on other members.       | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Add_People_To_First_Follower :: Add 30 people to people first Foll... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Added_People_On_Leader :: GET response from Leader should matc... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Added_People_On_Followers :: The same check on other members.     | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Leader :: Buy some cars on car-people Leader, loop of ... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Followers :: On each Follower buy corresponding ID seg... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Added_CarPeople_On_Leader :: GET car-person mappings from Lead... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Added_CarPeople_On_Followers :: The same check on other members.  | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_All_CarPeople_On_Leader :: DELETE car-people container. No ... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_All_People_On_Leader :: DELETE people container. No verific... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_All_Cars_On_Leader :: DELETE cars container. No verificatio... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
controller-clustering-tell.txt.Carpeople Crud :: Suite for perform... | FAIL |
Suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig

13 tests, 0 passed, 13 failed
==============================================================================
controller-clustering-tell.txt.Car Failover Crud :: Suite mixing basic oper...
==============================================================================
Add_Original_Cars_On_Old_Leader_And_Verify :: Add initial cars on ... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Stop_Original_Car_Leader :: Stop the car Leader to cause a new lea... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Wait_For_New_Leader :: Wait until new car Leader is elected.          | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Original_Cars_On_New_Leader :: GET cars from new Leader, shoul... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Original_Cars_On_New_Followers :: The same check on other exis... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_Original_Cars_On_New_Leader :: Delete cars on the new Leader.  | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Add_Leader_Cars_On_New_Leader :: Add cars on the new Leader.          | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Leader_Cars_On_New_Leader :: GET cars from new Leader, should ... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Leader_Cars_On_New_Followers :: The same check on other existi... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_Leader_Cars_On_New_First_Follower :: Delete cars in new fir... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Add_Follower_Cars_On_New_First_Follower :: Add cars on the new fir... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Folower_Cars_On_New_Leader :: Get cars from the new Leader, sh... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Follower_Cars_On_New_Followers :: The same check on other exis... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Start_Old_Car_Leader :: Start the stopped member without deleting ... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Folower_Cars_On_Old_Leader :: GET cars from the restarted memb... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_Follower_Cars_On_New_Leader :: Delete cars on the last Leader. | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
controller-clustering-tell.txt.Car Failover Crud :: Suite mixing b... | FAIL |
Suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig

16 tests, 0 passed, 16 failed
==============================================================================
controller-clustering-tell.txt.Car Persistence Recovery :: This test restar...
==============================================================================
Add_Cars_On_Leader_And_Verify :: Single big PUT to datastore to ad... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Stop_All_Members :: Stop all controllers.                             | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Start_All_Members :: Start all controllers (should restore the per... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Memorize_Leader_And_Followers :: Locate current Leader of car Shard.  | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Cars_On_Leader :: GET cars from Leader, should match the PUT d... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Cars_On_Followers :: The same check on other members.             | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_Cars_On_Leader :: Delete cars on the new Leader.               | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
controller-clustering-tell.txt.Car Persistence Recovery :: This te... | FAIL |
Suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig

7 tests, 0 passed, 7 failed
==============================================================================
controller-clustering-tell.txt.Buycar Failover :: This test focuses on test...
==============================================================================
Add_Cars_To_Leader_And_Verify :: Add all needed cars to car Leader... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Add_People_To_First_Follower_And_Verify :: Add all needed people t... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Leader_And_Verify :: Buy some cars on the leader member.  | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Follower_And_Verify :: Buy some cars on the first foll... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Reboot_People_Leader :: Previous people Leader is rebooted. We sho... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Leader_After_Reboot_And_Verify :: Buy some cars on the... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Follower_After_Reboot_And_Verify :: Buy some cars on t... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_All_CarPeople :: DELETE car-people container. No verificati... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_All_People :: DELETE people container. No verification beyo... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_All_Cars :: DELETE cars container. No verification beyond h... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
controller-clustering-tell.txt.Buycar Failover :: This test focuse... | FAIL |
Suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig

10 tests, 0 passed, 10 failed
==============================================================================
controller-clustering-tell.txt.Entity Isolate :: Suite for performing membe...
==============================================================================
Check All Shards Before Isolate :: Check all shards in controller.    | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Isolate Entity Leader :: Isolate the entity-ownership Leader to ca... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Check All Shards After Isolate :: Check all shards in controller.     | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Rejoin Entity Leader :: Rejoin the entity-ownership Leader.           | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Check All Shards After Rejoin :: Check all shards in controller.      | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
controller-clustering-tell.txt.Entity Isolate :: Suite for perform... | FAIL |
Suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig

5 tests, 0 passed, 5 failed
==============================================================================
controller-clustering-tell.txt.Buycar Failover Isolation :: This test focus...
==============================================================================
Add_Cars_To_Leader_And_Verify :: Add all needed cars to car Leader... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Add_People_To_First_Follower_And_Verify :: Add all needed people t... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Leader_And_Verify :: Buy some cars on the leader member.  | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Follower_And_Verify :: Buy some cars on the first foll... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Isolate_and_Rejoin_People_Leader :: Previous people Leader is isol... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Leader_After_Rejoin_And_Verify :: Buy some cars on the... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Follower_After_Rejoin_And_Verify :: Buy some cars on t... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_All_CarPeople :: DELETE car-people container. No verificati... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_All_People :: DELETE people container. No verification beyo... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_All_Cars :: DELETE cars container. No verification beyond h... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
controller-clustering-tell.txt.Buycar Failover Isolation :: This t... | FAIL |
Suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig

10 tests, 0 passed, 10 failed
==============================================================================
controller-clustering-tell.txt.Car Failover Crud Isolation :: Suite mixing ...
==============================================================================
Add_Original_Cars_On_Old_Leader_And_Verify :: Add initial cars on ... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Isolate_Original_Car_Leader :: Isolate the car Leader to cause a n... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Wait_For_New_Leader :: Wait until new car Leader is elected.          | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Original_Cars_On_New_Leader :: GET cars from new Leader, shoul... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Original_Cars_On_New_Followers :: The same check on other exis... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_Original_Cars_On_New_Leader :: Delete cars on the new Leader.  | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Add_Leader_Cars_On_New_Leader :: Add cars on the new Leader.          | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Leader_Cars_On_New_Leader :: GET cars from new Leader, should ... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Leader_Cars_On_New_Followers :: The same check on other existi... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_Leader_Cars_On_New_First_Follower :: Delete cars in new fir... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Add_Follower_Cars_On_New_First_Follower :: Add cars on the new fir... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Folower_Cars_On_New_Leader :: Get cars from the new Leader, sh... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Follower_Cars_On_New_Followers :: The same check on other exis... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Rejoin_Old_Car_Leader :: Rejoin the isolated member without deleti... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Folower_Cars_On_Old_Leader :: GET cars from the restarted memb... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_Follower_Cars_On_New_Leader :: Delete cars on the last Leader. | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
controller-clustering-tell.txt.Car Failover Crud Isolation :: Suit... | FAIL |
Suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig

16 tests, 0 passed, 16 failed
==============================================================================
controller-clustering-tell.txt.Car Outage Corners :: Cluster suite for test...
==============================================================================
Stop_Majority_Of_The_Followers :: Stop half plus one car Follower ... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Attempt_To_Add_Cars_To_Leader :: Adding cars should fail, as major... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Start_Tipping_Follower :: Start one Follower member without persis... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Add_Cars_On_Tipping_Follower :: Add cars on the tipping Follower.     | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Cars_On_Existing_Members :: On each up member: GET cars, shoul... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Start_Other_Followers :: Start other followers without persisted d... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Cars_On_New_Follower_Leader :: GET cars from a new follower to... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_Cars_On_Leader :: Delete cars on Leader.                       | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
controller-clustering-tell.txt.Car Outage Corners :: Cluster suite... | FAIL |
Suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.240:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig

8 tests, 0 passed, 8 failed
==============================================================================
controller-clustering-tell.txt                                        | FAIL |
162 tests, 11 passed, 151 failed
==============================================================================
Output:  /w/workspace/controller-csit-3node-clustering-tell-all-scandium/output.xml
Log:     /w/workspace/controller-csit-3node-clustering-tell-all-scandium/log.html
Report:  /w/workspace/controller-csit-3node-clustering-tell-all-scandium/report.html
+ true
+ echo 'Examining the files in data/log and checking filesize'
Examining the files in data/log and checking filesize
+ ssh 10.30.171.240 'ls -altr /tmp/karaf-0.21.0-SNAPSHOT/data/log/'
Warning: Permanently added '10.30.171.240' (ECDSA) to the list of known hosts.
total 102404
drwxrwxr-x. 2 jenkins jenkins       48 Jul 14 00:30 .
-rw-rw-r--. 1 jenkins jenkins     1720 Jul 14 00:30 karaf_console.log
drwxrwxr-x. 9 jenkins jenkins      149 Jul 14 06:07 ..
-rw-rw-r--. 1 jenkins jenkins 78697401 Jul 14 06:21 karaf.log
+ ssh 10.30.171.240 'du -hs /tmp/karaf-0.21.0-SNAPSHOT/data/log/*'
Warning: Permanently added '10.30.171.240' (ECDSA) to the list of known hosts.
4.0K	/tmp/karaf-0.21.0-SNAPSHOT/data/log/karaf_console.log
100M	/tmp/karaf-0.21.0-SNAPSHOT/data/log/karaf.log
+ ssh 10.30.170.251 'ls -altr /tmp/karaf-0.21.0-SNAPSHOT/data/log/'
Warning: Permanently added '10.30.170.251' (ECDSA) to the list of known hosts.
total 108356
drwxrwxr-x. 2 jenkins jenkins       48 Jul 14 00:30 .
-rw-rw-r--. 1 jenkins jenkins     1720 Jul 14 00:30 karaf_console.log
drwxrwxr-x. 9 jenkins jenkins      149 Jul 14 06:07 ..
-rw-rw-r--. 1 jenkins jenkins 85128277 Jul 14 06:21 karaf.log
+ ssh 10.30.170.251 'du -hs /tmp/karaf-0.21.0-SNAPSHOT/data/log/*'
Warning: Permanently added '10.30.170.251' (ECDSA) to the list of known hosts.
4.0K	/tmp/karaf-0.21.0-SNAPSHOT/data/log/karaf_console.log
106M	/tmp/karaf-0.21.0-SNAPSHOT/data/log/karaf.log
+ ssh 10.30.170.138 'ls -altr /tmp/karaf-0.21.0-SNAPSHOT/data/log/'
Warning: Permanently added '10.30.170.138' (ECDSA) to the list of known hosts.
total 16072
drwxrwxr-x. 2 jenkins jenkins       48 Jul 14 00:30 .
-rw-rw-r--. 1 jenkins jenkins   136181 Jul 14 00:39 karaf_console.log
drwxrwxr-x. 4 jenkins jenkins       28 Jul 14 06:06 ..
-rw-rw-r--. 1 jenkins jenkins 12164698 Jul 14 06:21 karaf.log
+ ssh 10.30.170.138 'du -hs /tmp/karaf-0.21.0-SNAPSHOT/data/log/*'
Warning: Permanently added '10.30.170.138' (ECDSA) to the list of known hosts.
136K	/tmp/karaf-0.21.0-SNAPSHOT/data/log/karaf_console.log
16M	/tmp/karaf-0.21.0-SNAPSHOT/data/log/karaf.log
+ set +e
++ seq 1 3
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_1_IP
+ echo 'Let'\''s take the karaf thread dump again'
Let's take the karaf thread dump again
+ ssh 10.30.171.240 'sudo ps aux'
Warning: Permanently added '10.30.171.240' (ECDSA) to the list of known hosts.
++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-scandium/ps_after.log
++ grep -v grep
++ tr -s ' '
++ cut -f2 '-d '
+ pid=30994
+ echo 'karaf main: org.apache.karaf.main.Main, pid:30994'
karaf main: org.apache.karaf.main.Main, pid:30994
+ ssh 10.30.171.240 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 30994'
Warning: Permanently added '10.30.171.240' (ECDSA) to the list of known hosts.
+ echo 'killing karaf process...'
killing karaf process...
+ ssh 10.30.171.240 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh'
Warning: Permanently added '10.30.171.240' (ECDSA) to the list of known hosts.
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_2_IP
+ echo 'Let'\''s take the karaf thread dump again'
Let's take the karaf thread dump again
+ ssh 10.30.170.251 'sudo ps aux'
Warning: Permanently added '10.30.170.251' (ECDSA) to the list of known hosts.
++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-scandium/ps_after.log
++ grep -v grep
++ cut -f2 '-d '
++ tr -s ' '
+ pid=30181
+ echo 'karaf main: org.apache.karaf.main.Main, pid:30181'
karaf main: org.apache.karaf.main.Main, pid:30181
+ ssh 10.30.170.251 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 30181'
Warning: Permanently added '10.30.170.251' (ECDSA) to the list of known hosts.
+ echo 'killing karaf process...'
killing karaf process...
+ ssh 10.30.170.251 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh'
Warning: Permanently added '10.30.170.251' (ECDSA) to the list of known hosts.
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_3_IP
+ echo 'Let'\''s take the karaf thread dump again'
Let's take the karaf thread dump again
+ ssh 10.30.170.138 'sudo ps aux'
Warning: Permanently added '10.30.170.138' (ECDSA) to the list of known hosts.
++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-scandium/ps_after.log
++ grep -v grep
++ cut -f2 '-d '
++ tr -s ' '
+ pid=5755
+ echo 'karaf main: org.apache.karaf.main.Main, pid:5755'
karaf main: org.apache.karaf.main.Main, pid:5755
+ ssh 10.30.170.138 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 5755'
Warning: Permanently added '10.30.170.138' (ECDSA) to the list of known hosts.
+ echo 'killing karaf process...'
killing karaf process...
+ ssh 10.30.170.138 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh'
Warning: Permanently added '10.30.170.138' (ECDSA) to the list of known hosts.
+ sleep 5
++ seq 1 3
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_1_IP
+ echo 'Compressing karaf.log 1'
Compressing karaf.log 1
+ ssh 10.30.171.240 gzip --best /tmp/karaf-0.21.0-SNAPSHOT/data/log/karaf.log
Warning: Permanently added '10.30.171.240' (ECDSA) to the list of known hosts.
gzip: /tmp/karaf-0.21.0-SNAPSHOT/data/log/karaf.log: file size changed while zipping
+ echo 'Fetching compressed karaf.log 1'
Fetching compressed karaf.log 1
+ scp 10.30.171.240:/tmp/karaf-0.21.0-SNAPSHOT/data/log/karaf.log.gz odl1_karaf.log.gz
Warning: Permanently added '10.30.171.240' (ECDSA) to the list of known hosts.
+ ssh 10.30.171.240 rm -f /tmp/karaf-0.21.0-SNAPSHOT/data/log/karaf.log.gz
Warning: Permanently added '10.30.171.240' (ECDSA) to the list of known hosts.
+ scp 10.30.171.240:/tmp/karaf-0.21.0-SNAPSHOT/data/log/karaf_console.log odl1_karaf_console.log
Warning: Permanently added '10.30.171.240' (ECDSA) to the list of known hosts.
+ ssh 10.30.171.240 rm -f /tmp/karaf-0.21.0-SNAPSHOT/data/log/karaf_console.log
Warning: Permanently added '10.30.171.240' (ECDSA) to the list of known hosts.
+ echo 'Fetch GC logs'
Fetch GC logs
+ mkdir -p gclogs-1
+ scp '10.30.171.240:/tmp/karaf-0.21.0-SNAPSHOT/data/log/*.log' gclogs-1/
Warning: Permanently added '10.30.171.240' (ECDSA) to the list of known hosts.
scp: /tmp/karaf-0.21.0-SNAPSHOT/data/log/*.log: No such file or directory
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_2_IP
+ echo 'Compressing karaf.log 2'
Compressing karaf.log 2
+ ssh 10.30.170.251 gzip --best /tmp/karaf-0.21.0-SNAPSHOT/data/log/karaf.log
Warning: Permanently added '10.30.170.251' (ECDSA) to the list of known hosts.
gzip: /tmp/karaf-0.21.0-SNAPSHOT/data/log/karaf.log: file size changed while zipping
+ echo 'Fetching compressed karaf.log 2'
Fetching compressed karaf.log 2
+ scp 10.30.170.251:/tmp/karaf-0.21.0-SNAPSHOT/data/log/karaf.log.gz odl2_karaf.log.gz
Warning: Permanently added '10.30.170.251' (ECDSA) to the list of known hosts.
+ ssh 10.30.170.251 rm -f /tmp/karaf-0.21.0-SNAPSHOT/data/log/karaf.log.gz
Warning: Permanently added '10.30.170.251' (ECDSA) to the list of known hosts.
+ scp 10.30.170.251:/tmp/karaf-0.21.0-SNAPSHOT/data/log/karaf_console.log odl2_karaf_console.log
Warning: Permanently added '10.30.170.251' (ECDSA) to the list of known hosts.
+ ssh 10.30.170.251 rm -f /tmp/karaf-0.21.0-SNAPSHOT/data/log/karaf_console.log
Warning: Permanently added '10.30.170.251' (ECDSA) to the list of known hosts.
+ echo 'Fetch GC logs'
Fetch GC logs
+ mkdir -p gclogs-2
+ scp '10.30.170.251:/tmp/karaf-0.21.0-SNAPSHOT/data/log/*.log' gclogs-2/
Warning: Permanently added '10.30.170.251' (ECDSA) to the list of known hosts.
scp: /tmp/karaf-0.21.0-SNAPSHOT/data/log/*.log: No such file or directory
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_3_IP
+ echo 'Compressing karaf.log 3'
Compressing karaf.log 3
+ ssh 10.30.170.138 gzip --best /tmp/karaf-0.21.0-SNAPSHOT/data/log/karaf.log
Warning: Permanently added '10.30.170.138' (ECDSA) to the list of known hosts.
+ echo 'Fetching compressed karaf.log 3'
Fetching compressed karaf.log 3
+ scp 10.30.170.138:/tmp/karaf-0.21.0-SNAPSHOT/data/log/karaf.log.gz odl3_karaf.log.gz
Warning: Permanently added '10.30.170.138' (ECDSA) to the list of known hosts.
+ ssh 10.30.170.138 rm -f /tmp/karaf-0.21.0-SNAPSHOT/data/log/karaf.log.gz
Warning: Permanently added '10.30.170.138' (ECDSA) to the list of known hosts.
+ scp 10.30.170.138:/tmp/karaf-0.21.0-SNAPSHOT/data/log/karaf_console.log odl3_karaf_console.log
Warning: Permanently added '10.30.170.138' (ECDSA) to the list of known hosts.
+ ssh 10.30.170.138 rm -f /tmp/karaf-0.21.0-SNAPSHOT/data/log/karaf_console.log
Warning: Permanently added '10.30.170.138' (ECDSA) to the list of known hosts.
+ echo 'Fetch GC logs'
Fetch GC logs
+ mkdir -p gclogs-3
+ scp '10.30.170.138:/tmp/karaf-0.21.0-SNAPSHOT/data/log/*.log' gclogs-3/
Warning: Permanently added '10.30.170.138' (ECDSA) to the list of known hosts.
scp: /tmp/karaf-0.21.0-SNAPSHOT/data/log/*.log: No such file or directory
+ echo 'Examine copied files'
Examine copied files
+ ls -lt
total 71228
drwxrwxr-x. 2 jenkins jenkins        6 Jul 14 06:21 gclogs-3
-rw-rw-r--. 1 jenkins jenkins   136181 Jul 14 06:21 odl3_karaf_console.log
-rw-rw-r--. 1 jenkins jenkins   414356 Jul 14 06:21 odl3_karaf.log.gz
drwxrwxr-x. 2 jenkins jenkins        6 Jul 14 06:21 gclogs-2
-rw-rw-r--. 1 jenkins jenkins     1720 Jul 14 06:21 odl2_karaf_console.log
-rw-rw-r--. 1 jenkins jenkins  2504119 Jul 14 06:21 odl2_karaf.log.gz
drwxrwxr-x. 2 jenkins jenkins        6 Jul 14 06:21 gclogs-1
-rw-rw-r--. 1 jenkins jenkins     1720 Jul 14 06:21 odl1_karaf_console.log
-rw-rw-r--. 1 jenkins jenkins  2344547 Jul 14 06:21 odl1_karaf.log.gz
-rw-rw-r--. 1 jenkins jenkins   142649 Jul 14 06:21 karaf_3_5755_threads_after.log
-rw-rw-r--. 1 jenkins jenkins    15705 Jul 14 06:21 ps_after.log
-rw-rw-r--. 1 jenkins jenkins   126061 Jul 14 06:21 karaf_2_30181_threads_after.log
-rw-rw-r--. 1 jenkins jenkins   143308 Jul 14 06:21 karaf_1_30994_threads_after.log
-rw-rw-r--. 1 jenkins jenkins   305665 Jul 14 06:21 report.html
-rw-rw-r--. 1 jenkins jenkins  3436601 Jul 14 06:21 log.html
-rw-rw-r--. 1 jenkins jenkins 62763493 Jul 14 06:21 output.xml
-rw-rw-r--. 1 jenkins jenkins     6069 Jul 14 00:32 testplan.txt
-rw-rw-r--. 1 jenkins jenkins   158981 Jul 14 00:32 karaf_3_5755_threads_before.log
-rw-rw-r--. 1 jenkins jenkins    16823 Jul 14 00:32 ps_before.log
-rw-rw-r--. 1 jenkins jenkins   160179 Jul 14 00:32 karaf_2_5739_threads_before.log
-rw-rw-r--. 1 jenkins jenkins   160749 Jul 14 00:32 karaf_1_5748_threads_before.log
-rw-rw-r--. 1 jenkins jenkins     3106 Jul 14 00:30 post-startup-script.sh
-rw-rw-r--. 1 jenkins jenkins      252 Jul 14 00:30 startup-script.sh
-rw-rw-r--. 1 jenkins jenkins     3455 Jul 14 00:30 configuration-script.sh
-rw-rw-r--. 1 jenkins jenkins      695 Jul 14 00:30 custom_shard_config.txt
-rw-rw-r--. 1 jenkins jenkins      136 Jul 14 00:30 scriptplan.txt
-rw-rw-r--. 1 jenkins jenkins      337 Jul 14 00:30 detect_variables.env
-rw-rw-r--. 1 jenkins jenkins     2620 Jul 14 00:30 pom.xml
-rw-rw-r--. 1 jenkins jenkins       86 Jul 14 00:30 set_variables.env
-rw-rw-r--. 1 jenkins jenkins      314 Jul 14 00:30 slave_addresses.txt
-rw-rw-r--. 1 jenkins jenkins      570 Jul 14 00:29 requirements.txt
-rw-rw-r--. 1 jenkins jenkins       26 Jul 14 00:29 env.properties
-rw-rw-r--. 1 jenkins jenkins      335 Jul 14 00:28 stack-parameters.yaml
drwxrwxr-x. 7 jenkins jenkins     4096 Jul 14 00:27 test
drwxrwxr-x. 2 jenkins jenkins        6 Jul 14 00:27 test@tmp
-rw-rw-r--. 1 jenkins jenkins     1410 Jul 13 21:31 maven-metadata.xml
+ true
[controller-csit-3node-clustering-tell-all-scandium] $ /bin/sh /tmp/jenkins17379975002343149022.sh
Cleaning up Robot installation...
$ ssh-agent -k
unset SSH_AUTH_SOCK;
unset SSH_AGENT_PID;
echo Agent pid 5285 killed;
[ssh-agent] Stopped.
Recording plot data
Robot results publisher started...
INFO: Checking test criticality is deprecated and will be dropped in a future release!
-Parsing output xml:
Done!
-Copying log files to build dir:
Done!
-Assigning results to build:
Done!
-Checking thresholds:
Done!
Done publishing Robot results.
Build step 'Publish Robot Framework test results' changed build result to UNSTABLE
[PostBuildScript] - [INFO] Executing post build scripts.
[controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins8984652487805540067.sh
Archiving csit artifacts
mv: cannot stat '*_1.png': No such file or directory
mv: cannot stat '/tmp/odl1_*': No such file or directory
mv: cannot stat '*_2.png': No such file or directory
mv: cannot stat '/tmp/odl2_*': No such file or directory
mv: cannot stat '*_3.png': No such file or directory
mv: cannot stat '/tmp/odl3_*': No such file or directory
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed

  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100 2952k    0 2952k    0     0  3962k      0 --:--:-- --:--:-- --:--:-- 3957k
100 4863k    0 4863k    0     0  4342k      0 --:--:--  0:00:01 --:--:-- 4342k
Archive:  robot-plugin.zip
  inflating: ./archives/robot-plugin/log.html  
  inflating: ./archives/robot-plugin/output.xml  
  inflating: ./archives/robot-plugin/report.html  
mv: cannot stat '*.log.gz': No such file or directory
mv: cannot stat '*.csv': No such file or directory
mv: cannot stat '*.png': No such file or directory
[PostBuildScript] - [INFO] Executing post build scripts.
[controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins18103496531059175572.sh
[PostBuildScript] - [INFO] Executing post build scripts.
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties content 
OS_CLOUD=vex
OS_STACK_NAME=releng-controller-csit-3node-clustering-tell-all-scandium-14

[EnvInject] - Variables injected successfully.
provisioning config files...
copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
[controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins17207564737148952605.sh
---> openstack-stack-delete.sh
Setup pyenv:
  system
  3.8.13
  3.9.13
  3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-ysqr from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes python-heatclient python-openstackclient 
lf-activate-venv(): INFO: Adding /tmp/venv-ysqr/bin to PATH
INFO: Retrieving stack cost for: releng-controller-csit-3node-clustering-tell-all-scandium-14
DEBUG: Successfully retrieved stack cost: total: 1.98
INFO: Deleting stack releng-controller-csit-3node-clustering-tell-all-scandium-14
Successfully deleted stack releng-controller-csit-3node-clustering-tell-all-scandium-14
[PostBuildScript] - [INFO] Executing post build scripts.
[controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins15097426013832263664.sh
---> sysstat.sh
[controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins12932849032681784288.sh
---> package-listing.sh
++ facter osfamily
++ tr '[:upper:]' '[:lower:]'
+ OS_FAMILY=redhat
+ workspace=/w/workspace/controller-csit-3node-clustering-tell-all-scandium
+ START_PACKAGES=/tmp/packages_start.txt
+ END_PACKAGES=/tmp/packages_end.txt
+ DIFF_PACKAGES=/tmp/packages_diff.txt
+ PACKAGES=/tmp/packages_start.txt
+ '[' /w/workspace/controller-csit-3node-clustering-tell-all-scandium ']'
+ PACKAGES=/tmp/packages_end.txt
+ case "${OS_FAMILY}" in
+ rpm -qa
+ sort
+ '[' -f /tmp/packages_start.txt ']'
+ '[' -f /tmp/packages_end.txt ']'
+ diff /tmp/packages_start.txt /tmp/packages_end.txt
+ '[' /w/workspace/controller-csit-3node-clustering-tell-all-scandium ']'
+ mkdir -p /w/workspace/controller-csit-3node-clustering-tell-all-scandium/archives/
+ cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/controller-csit-3node-clustering-tell-all-scandium/archives/
[controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins14919417102184009569.sh
---> capture-instance-metadata.sh
Setup pyenv:
  system
  3.8.13
  3.9.13
  3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-ysqr from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: lftools 
lf-activate-venv(): INFO: Adding /tmp/venv-ysqr/bin to PATH
INFO: Running in OpenStack, capturing instance metadata
[controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins9064205562290012125.sh
provisioning config files...
Could not find credentials [logs] for controller-csit-3node-clustering-tell-all-scandium #14
copy managed file [jenkins-log-archives-settings] to file:/w/workspace/controller-csit-3node-clustering-tell-all-scandium@tmp/config5810301483334374575tmp
Regular expression run condition: Expression=[^.*logs-s3.*], Label=[odl-logs-s3-cloudfront-index]
Run condition [Regular expression match] enabling perform for step [Provide Configuration files]
provisioning config files...
copy managed file [jenkins-s3-log-ship] to file:/home/jenkins/.aws/credentials
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties content 
SERVER_ID=logs

[EnvInject] - Variables injected successfully.
[controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins11981302110551209933.sh
---> create-netrc.sh
WARN: Log server credential not found.
[controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins17528362105438908235.sh
---> python-tools-install.sh
Setup pyenv:
  system
  3.8.13
  3.9.13
  3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-ysqr from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: lftools 
lf-activate-venv(): INFO: Adding /tmp/venv-ysqr/bin to PATH
[controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins8166332199668225714.sh
---> sudo-logs.sh
Archiving 'sudo' log..
[controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins8767663193491916928.sh
---> job-cost.sh
Setup pyenv:
  system
  3.8.13
  3.9.13
  3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-ysqr from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 
lf-activate-venv(): INFO: Adding /tmp/venv-ysqr/bin to PATH
DEBUG: total: 1.98
INFO: Retrieving Stack Cost...
INFO: Retrieving Pricing Info for: v3-standard-2
INFO: Archiving Costs
[controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash -l /tmp/jenkins2016662403871768959.sh
---> logs-deploy.sh
Setup pyenv:
  system
  3.8.13
  3.9.13
  3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-ysqr from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: lftools 
lf-activate-venv(): INFO: Adding /tmp/venv-ysqr/bin to PATH
WARNING: Nexus logging server not set
INFO: S3 path logs/releng/vex-yul-odl-jenkins-1/controller-csit-3node-clustering-tell-all-scandium/14/
INFO: archiving logs to S3
---> uname -a:
Linux prd-centos8-robot-2c-8g-20310.novalocal 4.18.0-553.5.1.el8.x86_64 #1 SMP Tue May 21 05:46:01 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux


---> lscpu:
Architecture:        x86_64
CPU op-mode(s):      32-bit, 64-bit
Byte Order:          Little Endian
CPU(s):              2
On-line CPU(s) list: 0,1
Thread(s) per core:  1
Core(s) per socket:  1
Socket(s):           2
NUMA node(s):        1
Vendor ID:           AuthenticAMD
CPU family:          23
Model:               49
Model name:          AMD EPYC-Rome Processor
Stepping:            0
CPU MHz:             2799.998
BogoMIPS:            5599.99
Virtualization:      AMD-V
Hypervisor vendor:   KVM
Virtualization type: full
L1d cache:           32K
L1i cache:           32K
L2 cache:            512K
L3 cache:            16384K
NUMA node0 CPU(s):   0,1
Flags:               fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities


---> nproc:
2


---> df -h:
Filesystem      Size  Used Avail Use% Mounted on
devtmpfs        3.8G     0  3.8G   0% /dev
tmpfs           3.8G     0  3.8G   0% /dev/shm
tmpfs           3.8G   17M  3.8G   1% /run
tmpfs           3.8G     0  3.8G   0% /sys/fs/cgroup
/dev/vda1        40G  8.4G   32G  21% /
tmpfs           770M     0  770M   0% /run/user/1001


---> free -m:
              total        used        free      shared  buff/cache   available
Mem:           7697         665        4753          19        2278        6735
Swap:          1023           0        1023


---> ip addr:
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host 
       valid_lft forever preferred_lft forever
2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1458 qdisc mq state UP group default qlen 1000
    link/ether fa:16:3e:68:2a:9e brd ff:ff:ff:ff:ff:ff
    altname enp0s3
    altname ens3
    inet 10.30.171.81/23 brd 10.30.171.255 scope global dynamic noprefixroute eth0
       valid_lft 64977sec preferred_lft 64977sec
    inet6 fe80::f816:3eff:fe68:2a9e/64 scope link 
       valid_lft forever preferred_lft forever


---> sar -b -r -n DEV:
Linux 4.18.0-553.5.1.el8.x86_64 (centos-stream-8-robot-7d7a37eb-bc14-4dd6-9530-dc22c5eae738.noval) 	07/14/2024 	_x86_64_	(2 CPU)

00:26:11     LINUX RESTART	(2 CPU)

12:27:02 AM       tps      rtps      wtps   bread/s   bwrtn/s
12:28:01 AM     91.34     13.30     78.04   2382.51   6618.13
12:29:01 AM     70.49      0.70     69.79     50.78   8321.69
12:30:01 AM     21.93      0.85     21.08    123.96   1939.12
12:31:01 AM     58.00      2.52     55.48    396.00   7356.38
12:32:01 AM      5.36      0.00      5.36      0.00    232.34
12:33:01 AM      2.10      0.08      2.02     31.99     97.68
12:34:01 AM      0.48      0.00      0.48      0.00     21.16
12:35:01 AM      0.20      0.00      0.20      0.00     11.08
12:36:01 AM      0.17      0.00      0.17      0.00     14.55
12:37:01 AM      0.38      0.00      0.38      0.00     18.81
12:38:01 AM      0.20      0.00      0.20      0.00     11.35
12:39:01 AM      0.22      0.03      0.18      1.87     24.94
12:40:01 AM      0.18      0.00      0.18      0.00      5.08
12:41:01 AM      0.25      0.00      0.25      0.00      3.75
12:42:01 AM      0.45      0.07      0.38      1.60     11.16
12:43:01 AM      1.23      0.00      1.23      0.00     28.76
12:44:01 AM      0.15      0.00      0.15      0.00      1.25
12:45:01 AM      0.30      0.00      0.30      0.00      5.90
12:46:01 AM      0.17      0.00      0.17      0.00      1.88
12:47:01 AM      0.40      0.00      0.40      0.00     11.81
12:48:01 AM      0.13      0.00      0.13      0.00      6.28
12:49:01 AM      0.13      0.00      0.13      0.00      4.42
12:50:01 AM      0.17      0.00      0.17      0.00      1.77
12:51:01 AM      0.15      0.00      0.15      0.00      3.40
12:52:01 AM      0.48      0.00      0.48      0.00     11.05
12:53:01 AM      0.18      0.00      0.18      0.00      2.12
12:54:01 AM      0.12      0.00      0.12      0.00      3.23
12:55:01 AM      0.15      0.00      0.15      0.00      3.33
12:56:01 AM      0.10      0.00      0.10      0.00      0.68
12:57:01 AM      0.40      0.00      0.40      0.00      9.48
12:58:01 AM      0.13      0.00      0.13      0.00      2.15
12:59:01 AM      0.15      0.00      0.15      0.00      1.20
01:00:01 AM      0.15      0.00      0.15      0.00      5.20
01:01:01 AM      0.33      0.05      0.28      0.40      4.50
01:02:01 AM      0.57      0.07      0.50      1.73     11.61
01:03:01 AM      0.27      0.00      0.27      0.00      5.00
01:04:01 AM      0.18      0.00      0.18      0.00      2.12
01:05:01 AM      0.12      0.00      0.12      0.00      3.33
01:06:01 AM      0.15      0.00      0.15      0.00      3.65
01:07:01 AM      0.35      0.00      0.35      0.00      5.18
01:08:01 AM      0.15      0.00      0.15      0.00      3.63
01:09:01 AM      0.25      0.00      0.25      0.00      3.48
01:10:01 AM      0.18      0.00      0.18      0.00      1.73
01:11:01 AM      0.13      0.00      0.13      0.00      1.10
01:12:01 AM      0.33      0.00      0.33      0.00      5.40
01:13:01 AM      0.17      0.00      0.17      0.00      1.63
01:14:01 AM      0.10      0.00      0.10      0.00      0.80
01:15:01 AM      0.15      0.02      0.13      0.13      0.93
01:16:01 AM      0.13      0.00      0.13      0.00      5.90
01:17:01 AM      0.38      0.00      0.38      0.00     17.63
01:18:01 AM      0.32      0.00      0.32      0.00     12.86
01:19:01 AM      0.17      0.00      0.17      0.00     15.98
01:20:01 AM      0.35      0.00      0.35      0.00     18.80
01:21:01 AM      0.23      0.00      0.23      0.00     12.06
01:22:01 AM      0.20      0.00      0.20      0.00      9.40
01:23:01 AM      0.40      0.00      0.40      0.00     28.96
01:24:01 AM      0.22      0.00      0.22      0.00      5.78
01:25:01 AM      0.15      0.00      0.15      0.00      1.58
01:26:01 AM      0.13      0.00      0.13      0.00      3.90
01:27:01 AM      0.23      0.00      0.23      0.00      2.33
01:28:01 AM      0.27      0.00      0.27      0.00      6.13
01:29:02 AM      0.32      0.00      0.32      0.00      3.97
01:30:01 AM      0.24      0.00      0.24      0.00      6.42
01:31:01 AM      0.32      0.00      0.32      0.00      7.28
01:32:01 AM      0.28      0.00      0.28      0.00      5.60
01:33:01 AM      0.37      0.00      0.37      0.00      6.45
01:34:01 AM      0.17      0.00      0.17      0.00      2.98
01:35:01 AM      0.12      0.00      0.12      0.00      0.80
01:36:01 AM      0.18      0.02      0.17      0.13      3.12
01:37:01 AM      9.58      6.05      3.53    562.25    103.53
01:38:01 AM      0.42      0.00      0.42      0.00     13.28
01:39:01 AM      0.22      0.00      0.22      0.00     18.14
01:40:01 AM      0.13      0.00      0.13      0.00     13.86
01:41:01 AM      0.18      0.00      0.18      0.00      8.11
01:42:01 AM      0.32      0.00      0.32      0.00     20.20
01:43:01 AM      0.27      0.00      0.27      0.00     10.31
01:44:01 AM      0.13      0.00      0.13      0.00      2.40
01:45:01 AM      0.23      0.00      0.23      0.00      2.93
01:46:01 AM      0.18      0.00      0.18      0.00      8.98
01:47:01 AM      0.25      0.00      0.25      0.00     11.58
01:48:01 AM      0.30      0.00      0.30      0.00     17.30
01:49:01 AM      0.18      0.00      0.18      0.00     14.58
01:50:01 AM      0.15      0.00      0.15      0.00      7.22
01:51:01 AM      0.17      0.00      0.17      0.00     15.36
01:52:01 AM      0.47      0.00      0.47      0.00     21.16
01:53:01 AM      0.18      0.00      0.18      0.00     21.08
01:54:01 AM      0.18      0.00      0.18      0.00      5.33
01:55:01 AM      0.32      0.00      0.32      0.00      3.55
01:56:01 AM      0.28      0.00      0.28      0.00      5.58
01:57:01 AM      0.65      0.00      0.65      0.00      9.78
01:58:01 AM      0.38      0.00      0.38      0.00      7.10
01:59:01 AM      0.35      0.00      0.35      0.00      4.00
02:00:01 AM      0.47      0.00      0.47      0.00     11.68
02:01:01 AM      0.42      0.00      0.42      0.00      6.40
02:02:01 AM      0.37      0.00      0.37      0.00      7.81
02:03:01 AM      0.13      0.00      0.13      0.00      1.38
02:04:01 AM      0.25      0.00      0.25      0.00      5.25
02:05:01 AM      0.20      0.00      0.20      0.00     10.73
02:06:01 AM      0.20      0.00      0.20      0.00     16.38
02:07:01 AM      0.33      0.00      0.33      0.00     18.10
02:08:01 AM      0.12      0.00      0.12      0.00      8.27
02:09:01 AM      0.15      0.00      0.15      0.00     15.19
02:10:01 AM      0.13      0.00      0.13      0.00     14.55
02:11:01 AM      0.28      0.00      0.28      0.00     10.96
02:12:01 AM      0.50      0.00      0.50      0.00     15.70
02:13:01 AM      0.18      0.00      0.18      0.00     10.25
02:14:01 AM      0.17      0.00      0.17      0.00     10.30
02:15:01 AM      0.20      0.00      0.20      0.00     15.50
02:16:01 AM      0.20      0.00      0.20      0.00     17.91
02:17:01 AM      0.53      0.00      0.53      0.00     17.91
02:18:01 AM      0.38      0.00      0.38      0.00     18.36
02:19:01 AM      0.12      0.00      0.12      0.00      3.33
02:20:01 AM      0.15      0.00      0.15      0.00     16.19
02:21:01 AM      0.17      0.00      0.17      0.00      8.48
02:22:01 AM      0.22      0.00      0.22      0.00     16.60
02:23:01 AM      0.22      0.00      0.22      0.00     15.63
02:24:01 AM      0.15      0.00      0.15      0.00     15.06
02:25:01 AM      0.25      0.00      0.25      0.00     10.70
02:26:01 AM      0.27      0.00      0.27      0.00     24.48
02:27:01 AM      0.37      0.00      0.37      0.00     13.71
02:28:01 AM      0.17      0.00      0.17      0.00      1.72
02:29:01 AM      0.10      0.00      0.10      0.00      0.72
02:30:01 AM      0.15      0.00      0.15      0.00      5.05
02:31:01 AM      0.22      0.00      0.22      0.00      3.33
02:32:01 AM      0.35      0.00      0.35      0.00      7.43
02:33:01 AM      0.35      0.00      0.35      0.00      6.22
02:34:01 AM      0.32      0.00      0.32      0.00     10.46
02:35:01 AM      0.17      0.00      0.17      0.00      3.85
02:36:01 AM      0.12      0.00      0.12      0.00      3.23
02:37:01 AM      0.18      0.00      0.18      0.00      1.77
02:38:02 AM      0.28      0.00      0.28      0.00      5.78
02:39:01 AM      0.20      0.00      0.20      0.00     18.59
02:40:01 AM      0.13      0.00      0.13      0.00     14.26
02:41:01 AM      0.25      0.00      0.25      0.00      9.80
02:42:01 AM      0.30      0.00      0.30      0.00     16.76
02:43:01 AM      0.23      0.00      0.23      0.00     17.63
02:44:01 AM      0.15      0.00      0.15      0.00     13.73
02:45:01 AM      0.13      0.00      0.13      0.00      2.53
02:46:01 AM      0.17      0.00      0.17      0.00     14.13
02:47:01 AM      0.18      0.00      0.18      0.00      7.67
02:48:01 AM      0.27      0.00      0.27      0.00     17.56
02:49:01 AM      0.28      0.00      0.28      0.00     18.01
02:50:01 AM      0.17      0.00      0.17      0.00      7.78
02:51:01 AM      0.22      0.00      0.22      0.00     18.71
02:52:01 AM      0.32      0.00      0.32      0.00     29.77
02:53:01 AM      0.20      0.00      0.20      0.00      4.47
02:54:01 AM      0.13      0.00      0.13      0.00      3.20
02:55:01 AM      0.12      0.00      0.12      0.00      1.47
02:56:01 AM      0.22      0.00      0.22      0.00      5.07
02:57:01 AM      0.22      0.00      0.22      0.00      2.85
02:58:01 AM      0.25      0.00      0.25      0.00      6.17
02:59:01 AM      0.13      0.00      0.13      0.00      1.75
03:00:01 AM      0.18      0.00      0.18      0.00      7.46
03:01:01 AM      0.47      0.00      0.47      0.00      8.98
03:02:01 AM      0.43      0.00      0.43      0.00      8.08
03:03:01 AM      0.13      0.00      0.13      0.00      1.45
03:04:01 AM      0.13      0.00      0.13      0.00      3.73
03:05:01 AM      0.17      0.00      0.17      0.00      2.03
03:06:01 AM      0.15      0.00      0.15      0.00      3.90
03:07:01 AM      0.37      0.00      0.37      0.00      5.68
03:08:01 AM      0.13      0.00      0.13      0.00      3.60
03:09:01 AM      0.13      0.00      0.13      0.00      1.43
03:10:01 AM      0.23      0.00      0.23      0.00      5.73
03:11:01 AM      0.18      0.00      0.18      0.00      1.95
03:12:01 AM      0.37      0.00      0.37      0.00      9.16
03:13:01 AM      0.17      0.00      0.17      0.00      1.75
03:14:01 AM      0.13      0.00      0.13      0.00      3.72
03:15:01 AM      0.83      0.00      0.83      0.00     13.08
03:16:01 AM      0.22      0.00      0.22      0.00      3.20
03:17:01 AM      0.37      0.00      0.37      0.00     16.71
03:18:01 AM      0.20      0.00      0.20      0.00     14.86
03:19:01 AM      0.18      0.00      0.18      0.00     10.38
03:20:01 AM      0.13      0.00      0.13      0.00     15.19
03:21:01 AM      0.37      0.00      0.37      0.00     13.31
03:22:01 AM      0.37      0.00      0.37      0.00     18.91
03:23:01 AM      0.23      0.00      0.23      0.00     13.25
03:24:01 AM      0.33      0.00      0.33      0.00      6.92
03:25:01 AM      0.30      0.00      0.30      0.00      3.42
03:26:01 AM      0.35      0.00      0.35      0.00      7.23
03:27:01 AM      0.50      0.00      0.50      0.00      7.18
03:28:01 AM      0.38      0.00      0.38      0.00      7.23
03:29:01 AM      0.33      0.00      0.33      0.00      4.67
03:30:01 AM      0.45      0.00      0.45      0.00      8.88
03:31:01 AM      0.37      0.00      0.37      0.00      4.50
03:32:01 AM      0.45      0.00      0.45      0.00      9.00
03:33:01 AM      0.33      0.00      0.33      0.00      3.38
03:34:01 AM      0.37      0.00      0.37      0.00      7.37
03:35:01 AM      0.40      0.00      0.40      0.00      4.28
03:36:01 AM      0.30      0.00      0.30      0.00      6.10
03:37:01 AM      0.57      0.00      0.57      0.00      9.67
03:38:01 AM      0.15      0.00      0.15      0.00     14.53
03:39:01 AM      0.15      0.00      0.15      0.00     15.06
03:40:01 AM      0.20      0.00      0.20      0.00     13.05
03:41:01 AM      0.18      0.00      0.18      0.00     15.81
03:42:01 AM      0.60      0.00      0.60      0.00     18.46
03:43:01 AM      0.55      0.00      0.55      0.00     17.01
03:44:01 AM      0.47      0.00      0.47      0.00      9.50
03:45:01 AM      0.28      0.00      0.28      0.00      2.72
03:46:01 AM      0.28      0.00      0.28      0.00      5.36
03:47:01 AM      0.40      0.00      0.40      0.00      4.70
03:48:01 AM      0.37      0.00      0.37      0.00      8.00
03:49:02 AM      0.17      0.00      0.17      0.00      2.37
03:50:01 AM      0.14      0.00      0.14      0.00      1.75
03:51:01 AM      0.28      0.00      0.28      0.00      6.35
03:52:01 AM      0.30      0.00      0.30      0.00      4.47
03:53:01 AM      0.22      0.00      0.22      0.00      6.30
03:54:01 AM      0.13      0.00      0.13      0.00      1.43
03:55:01 AM      0.12      0.00      0.12      0.00      3.87
03:56:01 AM      0.15      0.00      0.15      0.00      1.53
03:57:01 AM      0.22      0.00      0.22      0.00      5.83
03:58:01 AM      0.28      0.00      0.28      0.00     19.11
03:59:01 AM      0.13      0.00      0.13      0.00     14.13
04:00:01 AM      0.13      0.00      0.13      0.00      8.26
04:01:01 AM      0.25      0.00      0.25      0.00     15.50
04:02:01 AM      0.28      0.00      0.28      0.00     18.07
04:03:01 AM      0.23      0.00      0.23      0.00     15.90
04:04:01 AM      0.10      0.00      0.10      0.00      4.40
04:05:01 AM      0.22      0.00      0.22      0.00      2.80
04:06:01 AM      0.17      0.00      0.17      0.00      4.80
04:07:01 AM      0.17      0.00      0.17      0.00      1.63
04:08:01 AM      0.25      0.00      0.25      0.00      3.55
04:09:01 AM      0.15      0.00      0.15      0.00      4.72
04:10:01 AM      0.13      0.00      0.13      0.00      0.93
04:11:01 AM      0.20      0.00      0.20      0.00      5.08
04:12:01 AM      0.30      0.00      0.30      0.00      7.10
04:13:01 AM      0.27      0.00      0.27      0.00      4.42
04:14:01 AM      0.17      0.00      0.17      0.00      2.08
04:15:01 AM      0.15      0.00      0.15      0.00      4.33
04:16:01 AM      0.18      0.00      0.18      0.00      1.77
04:17:01 AM      0.37      0.00      0.37      0.00     18.48
04:18:01 AM      0.13      0.00      0.13      0.00      7.37
04:19:01 AM      0.15      0.00      0.15      0.00     14.80
04:20:01 AM      0.13      0.00      0.13      0.00     14.13
04:21:01 AM      0.43      0.00      0.43      0.00     18.30
04:22:01 AM      0.68      0.00      0.68      0.00     19.83
04:23:01 AM      0.23      0.00      0.23      0.00     12.65
04:24:01 AM      0.15      0.00      0.15      0.00     20.70
04:25:01 AM      0.15      0.00      0.15      0.00      1.63
04:26:01 AM      0.13      0.00      0.13      0.00      0.92
04:27:01 AM      0.37      0.00      0.37      0.00      8.22
04:28:01 AM      0.15      0.00      0.15      0.00      1.57
04:29:01 AM      0.25      0.00      0.25      0.00      5.50
04:30:01 AM      0.20      0.00      0.20      0.00      2.72
04:31:01 AM      0.17      0.00      0.17      0.00      7.21
04:32:01 AM      0.38      0.00      0.38      0.00      8.27
04:33:01 AM      0.17      0.00      0.17      0.00      4.12
04:34:01 AM      0.12      0.00      0.12      0.00      0.90
04:35:01 AM      0.72      0.00      0.72      0.00     11.68
04:36:01 AM      0.52      0.00      0.52      0.00     22.21
04:37:01 AM      0.38      0.00      0.38      0.00     18.15
04:38:01 AM      0.15      0.00      0.15      0.00     10.26
04:39:01 AM      0.17      0.00      0.17      0.00     15.49
04:40:01 AM      0.13      0.00      0.13      0.00      7.63
04:41:01 AM      0.30      0.00      0.30      0.00     15.41
04:42:01 AM      0.55      0.00      0.55      0.00     18.78
04:43:01 AM      0.33      0.00      0.33      0.00      9.18
04:44:01 AM      0.20      0.00      0.20      0.00     13.45
04:45:01 AM      0.13      0.00      0.13      0.00     13.06
04:46:01 AM      0.28      0.00      0.28      0.00     15.48
04:47:01 AM      0.45      0.00      0.45      0.00     15.86
04:48:01 AM      0.13      0.00      0.13      0.00      8.83
04:49:01 AM      0.27      0.00      0.27      0.00     15.88
04:50:01 AM      0.20      0.00      0.20      0.00     14.41
04:51:01 AM      0.40      0.00      0.40      0.00      9.21
04:52:01 AM      0.42      0.00      0.42      0.00     24.00
04:53:01 AM      0.28      0.00      0.28      0.00     14.83
04:54:01 AM      0.13      0.00      0.13      0.00      7.71
04:55:01 AM      0.22      0.00      0.22      0.00     16.53
04:56:01 AM      0.25      0.00      0.25      0.00     17.06
04:57:01 AM      0.27      0.00      0.27      0.00     24.33
04:58:01 AM      0.25      0.00      0.25      0.00      7.52
04:59:02 AM      0.22      0.00      0.22      0.00      2.83
05:00:01 AM      0.14      0.00      0.14      0.00      1.75
05:01:01 AM      0.17      0.00      0.17      0.00      4.42
05:02:01 AM      0.28      0.00      0.28      0.00      3.78
05:03:01 AM      0.28      0.00      0.28      0.00      6.90
05:04:01 AM      0.18      0.00      0.18      0.00      2.17
05:05:01 AM      0.17      0.00      0.17      0.00      7.48
05:06:01 AM      0.15      0.00      0.15      0.00      7.61
05:07:01 AM      0.38      0.00      0.38      0.00      5.10
05:08:01 AM      0.43      0.00      0.43      0.00      6.32
05:09:01 AM      0.42      0.00      0.42      0.00      6.07
05:10:01 AM      0.53      0.00      0.53      0.00      9.75
05:11:01 AM      0.30      0.00      0.30      0.00      5.33
05:12:01 AM      0.18      0.00      0.18      0.00      7.13
05:13:01 AM      0.22      0.00      0.22      0.00      3.47
05:14:01 AM      0.15      0.00      0.15      0.00      5.20
05:15:01 AM      0.15      0.00      0.15      0.00     13.91
05:16:01 AM      0.17      0.00      0.17      0.00     14.01
05:17:01 AM      0.27      0.00      0.27      0.00      9.93
05:18:01 AM      0.35      0.00      0.35      0.00     20.71
05:19:01 AM      0.15      0.00      0.15      0.00     10.58
05:20:01 AM      0.17      0.00      0.17      0.00     13.90
05:21:01 AM      0.18      0.00      0.18      0.00     22.16
05:22:01 AM      0.20      0.00      0.20      0.00      5.25
05:23:01 AM      0.20      0.00      0.20      0.00      3.73
05:24:01 AM      0.22      0.00      0.22      0.00      5.18
05:25:01 AM      0.20      0.00      0.20      0.00      2.32
05:26:01 AM      0.10      0.00      0.10      0.00      0.65
05:27:01 AM      0.35      0.00      0.35      0.00      8.10
05:28:01 AM      0.17      0.00      0.17      0.00      1.32
05:29:01 AM      0.13      0.00      0.13      0.00      8.80
05:30:01 AM      0.35      0.00      0.35      0.00      8.70
05:31:01 AM      0.48      0.00      0.48      0.00      6.75
05:32:01 AM      0.33      0.00      0.33      0.00      7.30
05:33:01 AM      0.13      0.00      0.13      0.00      3.60
05:34:01 AM      0.13      0.00      0.13      0.00      2.80
05:35:01 AM      0.13      0.00      0.13      0.00      4.97
05:36:01 AM      0.22      0.00      0.22      0.00      5.88
05:37:01 AM      0.50      0.00      0.50      0.00      9.38
05:38:01 AM      0.15      0.00      0.15      0.00      7.25
05:39:01 AM      0.18      0.00      0.18      0.00      7.90
05:40:01 AM      0.12      0.00      0.12      0.00     14.93
05:41:01 AM      0.25      0.00      0.25      0.00     16.06
05:42:01 AM      0.42      0.00      0.42      0.00     20.80
05:43:01 AM      0.13      0.00      0.13      0.00      8.40
05:44:01 AM      0.17      0.00      0.17      0.00     14.96
05:45:01 AM      0.15      0.00      0.15      0.00     20.93
05:46:01 AM      0.12      0.00      0.12      0.00      2.03
05:47:01 AM      0.37      0.00      0.37      0.00      5.68
05:48:01 AM      0.23      0.00      0.23      0.00      5.23
05:49:01 AM      0.22      0.00      0.22      0.00      2.57
05:50:01 AM      0.20      0.00      0.20      0.00      3.78
05:51:01 AM      0.20      0.00      0.20      0.00      2.17
05:52:01 AM      0.52      0.00      0.52      0.00     12.73
05:53:01 AM      1.22      0.00      1.22      0.00     21.95
05:54:01 AM      0.17      0.00      0.17      0.00      6.80
05:55:01 AM      0.10      0.00      0.10      0.00      0.67
05:56:01 AM      0.15      0.00      0.15      0.00      2.72
05:57:01 AM      0.47      0.00      0.47      0.00      8.25
05:58:01 AM      0.20      0.00      0.20      0.00      4.23
05:59:01 AM      0.20      0.00      0.20      0.00      6.67
06:00:01 AM      0.20      0.00      0.20      0.00      2.30
06:01:01 AM      0.22      0.00      0.22      0.00     11.28
06:02:01 AM      0.47      0.00      0.47      0.00     21.86
06:03:01 AM      0.17      0.00      0.17      0.00      9.35
06:04:01 AM      0.48      0.00      0.48      0.00     22.43
06:05:01 AM      0.47      0.00      0.47      0.00     15.31
06:06:01 AM      0.32      0.00      0.32      0.00      9.45
06:07:01 AM      0.22      0.00      0.22      0.00     15.46
06:08:02 AM      0.28      0.00      0.28      0.00     23.88
06:09:01 AM      0.12      0.00      0.12      0.00      1.75
06:10:01 AM      0.22      0.00      0.22      0.00      3.62
06:11:01 AM      0.32      0.00      0.32      0.00      7.87
06:12:01 AM      0.30      0.00      0.30      0.00      4.42
06:13:01 AM      0.20      0.00      0.20      0.00      5.75
06:14:01 AM      0.13      0.00      0.13      0.00      1.45
06:15:01 AM      0.15      0.00      0.15      0.00      7.57
06:16:01 AM      0.13      0.00      0.13      0.00      6.40
06:17:01 AM      0.23      0.00      0.23      0.00     10.46
06:18:01 AM      0.37      0.00      0.37      0.00     11.38
06:19:01 AM      0.28      0.00      0.28      0.00     14.68
06:20:01 AM      0.12      0.00      0.12      0.00      2.27
06:21:01 AM      0.20      0.00      0.20      0.00     10.73
06:22:01 AM      2.83      0.32      2.52     36.92    242.99
06:23:01 AM     29.29      0.48     28.81     53.85   3612.81
Average:         1.06      0.07      0.99     10.13     88.60

12:27:02 AM kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty
12:28:01 AM   5320788   7055664   2561644     32.50      2688   1917076    671604      7.52    210688   2031564    159308
12:29:01 AM   5220984   7045116   2661448     33.76      2688   2001400    657360      7.36    230432   2086384     27168
12:30:01 AM   5162432   7040772   2720000     34.51      2688   2053092    690700      7.73    253328   2113916     44084
12:31:01 AM   4993596   7024828   2888836     36.65      2688   2200920    651592      7.30    263588   2250588        84
12:32:01 AM   4995772   7027008   2886660     36.62      2688   2200924    651592      7.30    263596   2250660         8
12:33:01 AM   4949144   6982380   2933288     37.21      2688   2202920    734752      8.23    263732   2296804       136
12:34:01 AM   4948276   6981868   2934156     37.22      2688   2203280    734752      8.23    263732   2297796        40
12:35:01 AM   4946360   6980316   2936072     37.25      2688   2203640    734752      8.23    263732   2299504       128
12:36:01 AM   4944988   6979288   2937444     37.27      2688   2203976    734752      8.23    263732   2301096        64
12:37:01 AM   4943484   6978144   2938948     37.28      2688   2204336    734752      8.23    263732   2302344        36
12:38:01 AM   4942096   6977108   2940336     37.30      2688   2204696    734752      8.23    263732   2303980       128
12:39:01 AM   4940764   6976436   2941668     37.32      2688   2205356    734752      8.23    264000   2304996        24
12:40:01 AM   4942216   6977980   2940216     37.30      2688   2205436    740108      8.29    264516   2303380         4
12:41:01 AM   4942056   6977804   2940376     37.30      2688   2205440    740108      8.29    264516   2303552        16
12:42:01 AM   4940296   6976172   2942136     37.33      2688   2205560    760364      8.51    264636   2305036        20
12:43:01 AM   4940336   6976212   2942096     37.32      2688   2205564    760364      8.51    264636   2305252         4
12:44:01 AM   4940136   6976076   2942296     37.33      2688   2205632    760364      8.51    264636   2305236        84
12:45:01 AM   4940628   6976568   2941804     37.32      2688   2205632    760364      8.51    264636   2305056        12
12:46:01 AM   4940120   6976200   2942312     37.33      2688   2205780    760364      8.51    264636   2305484       152
12:47:01 AM   4939900   6976052   2942532     37.33      2688   2205852    760364      8.51    264784   2305420        60
12:48:01 AM   4939916   6976188   2942516     37.33      2688   2205972    760364      8.51    264784   2305532        28
12:49:01 AM   4939868   6976200   2942564     37.33      2688   2206032    760364      8.51    264784   2305700         8
12:50:01 AM   4939724   6976056   2942708     37.33      2688   2206032    742536      8.31    264784   2305548         4
12:51:01 AM   4939668   6976120   2942764     37.33      2688   2206152    742536      8.31    264788   2305548        60
12:52:01 AM   4939776   6976228   2942656     37.33      2688   2206152    742536      8.31    264788   2305736         4
12:53:01 AM   4939816   6976268   2942616     37.33      2688   2206152    742536      8.31    264788   2305560         4
12:54:01 AM   4939432   6976008   2943000     37.34      2688   2206276    742536      8.31    264788   2305692        64
12:55:01 AM   4939372   6975948   2943060     37.34      2688   2206276    742536      8.31    264788   2305808         4
12:56:01 AM   4939680   6976300   2942752     37.33      2688   2206320    742536      8.31    264788   2305736        56
12:57:01 AM   4939196   6975888   2943236     37.34      2688   2206392    742536      8.31    264788   2306088        16
12:58:01 AM   4939176   6975872   2943256     37.34      2688   2206396    742536      8.31    264788   2306128         8
12:59:01 AM   4939044   6975796   2943388     37.34      2688   2206452    742536      8.31    264788   2306188        68
01:00:01 AM   4938044   6974860   2944388     37.35      2688   2206516    762948      8.54    264788   2306744         4
01:01:01 AM   4938288   6975124   2944144     37.35      2688   2206532    762948      8.54    264792   2306760         4
01:02:01 AM   4938100   6975072   2944332     37.35      2688   2206724    762948      8.54    264860   2306680        72
01:03:01 AM   4938564   6975596   2943868     37.35      2688   2206728    762948      8.54    264860   2306468         8
01:04:01 AM   4938568   6975600   2943864     37.35      2688   2206728    762948      8.54    264860   2306468         4
01:05:01 AM   4938276   6975428   2944156     37.35      2688   2206848    762948      8.54    264860   2306916        68
01:06:01 AM   4938388   6975544   2944044     37.35      2688   2206852    762948      8.54    264860   2306600         4
01:07:01 AM   4938476   6975680   2943956     37.35      2688   2206900    762948      8.54    264860   2306824        64
01:08:01 AM   4938184   6975412   2944248     37.35      2688   2206924    762948      8.54    264860   2306964        16
01:09:01 AM   4938128   6975360   2944304     37.35      2688   2206928    762948      8.54    264860   2306824         4
01:10:01 AM   4937984   6975216   2944448     37.35      2688   2206928    757196      8.48    264860   2307048         4
01:11:01 AM   4937812   6975044   2944620     37.36      2688   2206932    757196      8.48    264860   2307292         4
01:12:01 AM   4937644   6974876   2944788     37.36      2688   2206932    757196      8.48    264860   2307368         4
01:13:01 AM   4937904   6975136   2944528     37.36      2688   2206932    757196      8.48    264860   2307300         4
01:14:01 AM   4937688   6974924   2944744     37.36      2688   2206936    757196      8.48    264860   2307304         4
01:15:01 AM   4939804   6977144   2942628     37.33      2688   2207040    757196      8.48    264860   2305340       108
01:16:01 AM   4937732   6975224   2944700     37.36      2688   2207192    757196      8.48    264860   2307684       124
01:17:01 AM   4937304   6975168   2945128     37.36      2688   2207564    740368      8.29    264860   2308024       128
01:18:01 AM   4936904   6975116   2945528     37.37      2688   2207920    740368      8.29    264860   2308336       204
01:19:01 AM   4936664   6975236   2945768     37.37      2688   2208272    740368      8.29    264860   2308748       136
01:20:01 AM   4935772   6974708   2946660     37.38      2688   2208636    740764      8.29    264860   2309320        56
01:21:01 AM   4935220   6974488   2947212     37.39      2688   2208976    740764      8.29    264860   2309816        48
01:22:01 AM   4933984   6973616   2948448     37.41      2688   2209340    740764      8.29    264860   2311212       208
01:23:01 AM   4933072   6973268   2949360     37.42      2688   2209896    740764      8.29    264860   2312212        96
01:24:01 AM   4933140   6973336   2949292     37.42      2688   2209896    740764      8.29    264860   2312216         4
01:25:01 AM   4933260   6973460   2949172     37.41      2688   2209900    740764      8.29    264860   2312104         4
01:26:01 AM   4932656   6972936   2949776     37.42      2688   2209980    740764      8.29    264860   2312456         4
01:27:01 AM   4932852   6973132   2949580     37.42      2688   2209980    740764      8.29    264860   2312252         4
01:28:01 AM   4933032   6973388   2949400     37.42      2688   2210056    740764      8.29    264860   2312260         4
01:29:02 AM   4932504   6972860   2949928     37.42      2688   2210056    740764      8.29    264860   2312664         4
01:30:01 AM   4932504   6973036   2949928     37.42      2688   2210232    756580      8.47    264860   2312704        76
01:31:01 AM   4932612   6973208   2949820     37.42      2688   2210292    756580      8.47    264860   2312540        20
01:32:01 AM   4932496   6973144   2949936     37.42      2688   2210344    756580      8.47    264860   2312676        12
01:33:01 AM   4932424   6973072   2950008     37.43      2688   2210344    756580      8.47    264860   2312816         4
01:34:01 AM   4932348   6973024   2950084     37.43      2688   2210372    756580      8.47    264860   2312900         4
01:35:01 AM   4932556   6973240   2949876     37.42      2688   2210380    756580      8.47    264864   2312676        16
01:36:01 AM   4930984   6971788   2951448     37.44      2688   2210508    772624      8.65    264860   2314044        92
01:37:01 AM   4914772   6972876   2967660     37.65      2688   2227736    750268      8.40    267352   2327752        40
01:38:01 AM   4914168   6972632   2968264     37.66      2688   2228096    750268      8.40    267352   2328212       208
01:39:01 AM   4914120   6972932   2968312     37.66      2688   2228452    750268      8.40    267352   2328300        80
01:40:01 AM   4913468   6972644   2968964     37.67      2688   2228808    751176      8.41    267352   2328780        48
01:41:01 AM   4913016   6972540   2969416     37.67      2688   2229156    751176      8.41    267352   2329344       208
01:42:01 AM   4912724   6972600   2969708     37.68      2688   2229516    751176      8.41    267352   2329664        92
01:43:01 AM   4912952   6972948   2969480     37.67      2688   2229628    751176      8.41    267464   2329460         8
01:44:01 AM   4912684   6972720   2969748     37.68      2688   2229668    751176      8.41    267464   2329884        16
01:45:01 AM   4913048   6973092   2969384     37.67      2688   2229680    751176      8.41    267464   2329636        16
01:46:01 AM   4912100   6972352   2970332     37.68      2688   2229888    751176      8.41    267464   2330404         4
01:47:01 AM   4910152   6970792   2972280     37.71      2688   2230284    751176      8.41    267464   2332280       144
01:48:01 AM   4909700   6970692   2972732     37.71      2688   2230624    751176      8.41    267464   2332988        72
01:49:01 AM   4909408   6970752   2973024     37.72      2688   2230984    751176      8.41    267464   2333224        32
01:50:01 AM   4908736   6970436   2973696     37.73      2688   2231340    746564      8.36    267464   2333704       204
01:51:01 AM   4908388   6970448   2974044     37.73      2688   2231688    746564      8.36    267464   2334084       128
01:52:01 AM   4908080   6970492   2974352     37.73      2688   2232040    746564      8.36    267464   2334384        96
01:53:01 AM   4907548   6970496   2974884     37.74      2688   2232576    746564      8.36    267464   2335064        52
01:54:01 AM   4907504   6970524   2974928     37.74      2688   2232648    746564      8.36    267464   2335148         4
01:55:01 AM   4907476   6970496   2974956     37.74      2688   2232648    746564      8.36    267464   2335148         4
01:56:01 AM   4907124   6970224   2975308     37.75      2688   2232728    746564      8.36    267464   2335228         4
01:57:01 AM   4907132   6970232   2975300     37.75      2688   2232728    746564      8.36    267492   2335404         4
01:58:01 AM   4906772   6969944   2975660     37.75      2688   2232800    746564      8.36    267492   2335604        16
01:59:01 AM   4907212   6970388   2975220     37.74      2688   2232804    746564      8.36    267492   2335404         4
02:00:01 AM   4906512   6969864   2975920     37.75      2688   2232980    745472      8.35    267492   2335712         4
02:01:01 AM   4905896   6969312   2976536     37.76      2688   2233040    745472      8.35    267492   2336132         4
02:02:01 AM   4906356   6969828   2976076     37.76      2688   2233096    745472      8.35    267516   2335880        12
02:03:01 AM   4906452   6969924   2975980     37.75      2688   2233096    745472      8.35    267516   2335964         4
02:04:01 AM   4906564   6970104   2975868     37.75      2688   2233164    745472      8.35    267516   2335776         4
02:05:01 AM   4905816   6969768   2976616     37.76      2688   2233584    745472      8.35    267516   2336580       176
02:06:01 AM   4905772   6970084   2976660     37.76      2688   2233944    745472      8.35    267516   2336616       112
02:07:01 AM   4905436   6970096   2976996     37.77      2688   2234284    745472      8.35    267516   2337032        60
02:08:01 AM   4905176   6970192   2977256     37.77      2688   2234640    745472      8.35    267516   2337324       196
02:09:01 AM   4904700   6970076   2977732     37.78      2688   2235000    745472      8.35    267516   2337828       128
02:10:01 AM   4902444   6968236   2979988     37.81      2688   2235364    764332      8.56    267516   2339636       108
02:11:01 AM   4902956   6968928   2979476     37.80      2688   2235504    764332      8.56    267516   2339432        36
02:12:01 AM   4902588   6968772   2979844     37.80      2688   2235712    764332      8.56    267516   2339780        16
02:13:01 AM   4902360   6968904   2980072     37.81      2688   2236068    764332      8.56    267516   2340040       132
02:14:01 AM   4901672   6968564   2980760     37.82      2688   2236424    764332      8.56    267516   2340452       212
02:15:01 AM   4901476   6968724   2980956     37.82      2688   2236780    764332      8.56    267516   2340804       144
02:16:01 AM   4901652   6969268   2980780     37.82      2688   2237136    764332      8.56    267520   2340968         8
02:17:01 AM   4901088   6969052   2981344     37.82      2688   2237492    764332      8.56    267520   2341300        72
02:18:01 AM   4900876   6969248   2981556     37.83      2688   2237892    764332      8.56    267520   2341640        72
02:19:01 AM   4902724   6971340   2979708     37.80      2688   2238136    745900      8.35    267520   2339836       240
02:20:01 AM   4902056   6970884   2980376     37.81      2688   2238356    746200      8.36    267520   2340180         4
02:21:01 AM   4901816   6971024   2980616     37.81      2688   2238716    746200      8.36    267520   2340432       152
02:22:01 AM   4901436   6970996   2980996     37.82      2688   2239076    746200      8.36    267520   2340852       100
02:23:01 AM   4901396   6971312   2981036     37.82      2688   2239432    746200      8.36    267520   2341256        84
02:24:01 AM   4900672   6970944   2981760     37.83      2688   2239780    746200      8.36    267520   2341508       100
02:25:01 AM   4900456   6971080   2981976     37.83      2688   2240132    746200      8.36    267520   2341848       120
02:26:01 AM   4899792   6971092   2982640     37.84      2688   2240804    746200      8.36    267520   2342544       144
02:27:01 AM   4899516   6970936   2982916     37.84      2688   2240924    746200      8.36    267520   2342736        12
02:28:01 AM   4899752   6971172   2982680     37.84      2688   2240924    746200      8.36    267520   2342672         8
02:29:01 AM   4898836   6970336   2983596     37.85      2688   2241004    746200      8.36    267520   2343420       100
02:30:01 AM   4899136   6970640   2983296     37.85      2688   2241008    743512      8.33    267520   2343016        12
02:31:01 AM   4899400   6970924   2983032     37.84      2688   2241016    743512      8.33    267520   2342908        16
02:32:01 AM   4899268   6970856   2983164     37.85      2688   2241080    743512      8.33    267520   2343152        12
02:33:01 AM   4899164   6970752   2983268     37.85      2688   2241080    743512      8.33    267520   2343116         4
02:34:01 AM   4896892   6968664   2985540     37.88      2688   2241264    743512      8.33    267520   2345356        16
02:35:01 AM   4896680   6968568   2985752     37.88      2688   2241380    743512      8.33    267520   2345480        80
02:36:01 AM   4896616   6968504   2985816     37.88      2688   2241380    743512      8.33    267520   2345480         4
02:37:01 AM   4896392   6968328   2986040     37.88      2688   2241428    743512      8.33    267520   2345748        56
02:38:02 AM   4895904   6968080   2986528     37.89      2688   2241668    758888      8.50    267520   2346316       228
02:39:01 AM   4895772   6968300   2986660     37.89      2688   2242020    758888      8.50    267520   2346592        88
02:40:01 AM   4895220   6968100   2987212     37.90      2688   2242380    756656      8.47    267520   2347116        52
02:41:01 AM   4894820   6968044   2987612     37.90      2688   2242724    756656      8.47    267520   2347356       184
02:42:01 AM   4894492   6968080   2987940     37.91      2688   2243076    756656      8.47    267520   2347796       152
02:43:01 AM   4894320   6968272   2988112     37.91      2688   2243440    756656      8.47    267520   2348092        84
02:44:01 AM   4893664   6967924   2988768     37.92      2688   2243748    756656      8.47    267520   2348400         4
02:45:01 AM   4895392   6969868   2987040     37.89      2688   2243964    756656      8.47    267520   2346888       192
02:46:01 AM   4895244   6969932   2987188     37.90      2688   2244176    756656      8.47    267520   2346780        16
02:47:01 AM   4894888   6969932   2987544     37.90      2688   2244532    756656      8.47    267520   2347216       188
02:48:01 AM   4894600   6970004   2987832     37.90      2688   2244892    756656      8.47    267524   2347804       128
02:49:01 AM   4894416   6970172   2988016     37.91      2688   2245244    756656      8.47    267520   2347860        32
02:50:01 AM   4893832   6969948   2988600     37.91      2688   2245604    772132      8.65    267520   2348336       208
02:51:01 AM   4893596   6970076   2988836     37.92      2688   2245964    756708      8.47    267520   2348572        56
02:52:01 AM   4892688   6969892   2989744     37.93      2688   2246680    756708      8.47    267520   2349388         4
02:53:01 AM   4892816   6970136   2989616     37.93      2688   2246796    756708      8.47    267520   2349420        80
02:54:01 AM   4892696   6970016   2989736     37.93      2688   2246796    756708      8.47    267520   2349440         4
02:55:01 AM   4892760   6970172   2989672     37.93      2688   2246884    756708      8.47    267520   2349524        88
02:56:01 AM   4892760   6970172   2989672     37.93      2688   2246884    756708      8.47    267520   2349644         4
02:57:01 AM   4892528   6969940   2989904     37.93      2688   2246884    756708      8.47    267520   2349740        16
02:58:01 AM   4892536   6970024   2989896     37.93      2688   2246960    756708      8.47    267520   2349612         8
02:59:01 AM   4892364   6969852   2990068     37.93      2688   2246960    756708      8.47    267520   2349832         4
03:00:01 AM   4891952   6969620   2990480     37.94      2688   2247140    756008      8.46    267520   2350044        16
03:01:01 AM   4889108   6966892   2993324     37.97      2688   2247256    756008      8.46    267520   2352640         4
03:02:01 AM   4889904   6967688   2992528     37.96      2688   2247256    756008      8.46    267536   2352028         4
03:03:01 AM   4889808   6967668   2992624     37.97      2688   2247332    756008      8.46    267536   2352152        84
03:04:01 AM   4889928   6967788   2992504     37.96      2688   2247332    756008      8.46    267536   2352248        12
03:05:01 AM   4889652   6967512   2992780     37.97      2688   2247332    756008      8.46    267536   2352240         8
03:06:01 AM   4889876   6967820   2992556     37.96      2688   2247416    756008      8.46    267536   2352256         4
03:07:01 AM   4889940   6967884   2992492     37.96      2688   2247416    756008      8.46    267536   2352316        12
03:08:01 AM   4889948   6967968   2992484     37.96      2688   2247492    756008      8.46    267536   2352240         8
03:09:01 AM   4889924   6967948   2992508     37.96      2688   2247496    756008      8.46    267536   2352244         4
03:10:01 AM   4889484   6967588   2992948     37.97      2688   2247576    754504      8.45    267536   2352556         4
03:11:01 AM   4889556   6967664   2992876     37.97      2688   2247580    754504      8.45    267536   2352332         4
03:12:01 AM   4889472   6967664   2992960     37.97      2688   2247664    754504      8.45    267536   2352484        12
03:13:01 AM   4889620   6967812   2992812     37.97      2688   2247664    754504      8.45    267536   2352416         8
03:14:01 AM   4888584   6966860   2993848     37.98      2688   2247748    756036      8.47    267536   2353196         4
03:15:01 AM   4889220   6967504   2993212     37.97      2688   2247752    764768      8.56    276704   2343352         4
03:16:01 AM   4889312   6967680   2993120     37.97      2688   2247836    764768      8.56    276712   2343420        92
03:17:01 AM   4888992   6967716   2993440     37.98      2688   2248192    764768      8.56    276716   2343936       104
03:18:01 AM   4888564   6967636   2993868     37.98      2688   2248548    764768      8.56    276712   2344268        72
03:19:01 AM   4888308   6967740   2994124     37.98      2688   2248900    764768      8.56    276712   2344552       176
03:20:01 AM   4887776   6967564   2994656     37.99      2688   2249264    755988      8.46    276712   2345052       112
03:21:01 AM   4887368   6967500   2995064     38.00      2688   2249608    755988      8.46    276712   2345456       184
03:22:01 AM   4887116   6967612   2995316     38.00      2688   2249964    755988      8.46    276712   2345784       160
03:23:01 AM   4887036   6967732   2995396     38.00      2688   2250164    755988      8.46    276712   2345920         4
03:24:01 AM   4886992   6967796   2995440     38.00      2688   2250272    755988      8.46    276712   2346080         4
03:25:01 AM   4887048   6967852   2995384     38.00      2688   2250272    755988      8.46    276712   2346152         4
03:26:01 AM   4886556   6967460   2995876     38.01      2688   2250372    755988      8.46    276712   2346136         4
03:27:01 AM   4886552   6967456   2995880     38.01      2688   2250372    755988      8.46    276712   2346320         4
03:28:01 AM   4886792   6967788   2995640     38.00      2688   2250464    755988      8.46    276712   2346236         8
03:29:01 AM   4886060   6967060   2996372     38.01      2688   2250468    755988      8.46    276712   2346632         4
03:30:01 AM   4886260   6967352   2996172     38.01      2688   2250560    753776      8.44    276712   2346644         4
03:31:01 AM   4886640   6967736   2995792     38.01      2688   2250564    753776      8.44    276712   2346436         4
03:32:01 AM   4885960   6967148   2996472     38.01      2688   2250656    753776      8.44    276712   2346972         4
03:33:01 AM   4885576   6966764   2996856     38.02      2688   2250656    753776      8.44    276712   2347108         4
03:34:01 AM   4884132   6965416   2998300     38.04      2688   2250752    753776      8.44    276712   2348304         4
03:35:01 AM   4884188   6965476   2998244     38.04      2688   2250756    753776      8.44    276712   2348192         4
03:36:01 AM   4884264   6965644   2998168     38.04      2688   2250848    753776      8.44    276712   2348276         4
03:37:01 AM   4884300   6965900   2998132     38.04      2688   2251076    753776      8.44    276712   2348680       192
03:38:01 AM   4884096   6966056   2998336     38.04      2688   2251436    753776      8.44    276712   2349100       148
03:39:01 AM   4883428   6965736   2999004     38.05      2688   2251776    753776      8.44    276712   2349736        64
03:40:01 AM   4882528   6965192   2999904     38.06      2688   2252132    769388      8.61    276712   2350320        96
03:41:01 AM   4882348   6965368   3000084     38.06      2688   2252492    769388      8.61    276712   2350440        24
03:42:01 AM   4881996   6965376   3000436     38.06      2688   2252844    769388      8.61    276712   2350868         4
03:43:01 AM   4881920   6965604   3000512     38.07      2688   2253148    769388      8.61    276712   2351104         8
03:44:01 AM   4881836   6965632   3000596     38.07      2688   2253260    769388      8.61    276712   2351224         4
03:45:01 AM   4881764   6965564   3000668     38.07      2688   2253264    769388      8.61    276712   2351228         4
03:46:01 AM   4881672   6965564   3000760     38.07      2688   2253356    769388      8.61    276712   2351324         4
03:47:01 AM   4881756   6965648   3000676     38.07      2688   2253356    769388      8.61    276712   2351392         4
03:48:01 AM   4881680   6965668   3000752     38.07      2688   2253452    769388      8.61    276712   2351424         8
03:49:02 AM   4881740   6965728   3000692     38.07      2688   2253452    769388      8.61    276712   2351424         4
03:50:01 AM   4881404   6965484   3001028     38.07      2688   2253544    756376      8.47    276712   2351632       100
03:51:01 AM   4881396   6965484   3001036     38.07      2688   2253552    756376      8.47    276712   2351640         4
03:52:01 AM   4881004   6965184   3001428     38.08      2688   2253644    756376      8.47    276712   2351688       108
03:53:01 AM   4881056   6965236   3001376     38.08      2688   2253644    756376      8.47    276712   2351620         8
03:54:01 AM   4881060   6965336   3001372     38.08      2688   2253740    756376      8.47    276712   2351716       100
03:55:01 AM   4881032   6965308   3001400     38.08      2688   2253740    756376      8.47    276712   2351716         4
03:56:01 AM   4881132   6965500   3001300     38.08      2688   2253832    756376      8.47    276712   2351936       100
03:57:01 AM   4880304   6964880   3002128     38.09      2688   2254056    756376      8.47    276712   2352540       224
03:58:01 AM   4880120   6965056   3002312     38.09      2688   2254416    756376      8.47    276712   2352832       116
03:59:01 AM   4879432   6964732   3003000     38.10      2688   2254768    756376      8.47    276712   2353468        80
04:00:01 AM   4879128   6964772   3003304     38.10      2688   2255112    750724      8.41    276712   2353652       204
04:01:01 AM   4878016   6964016   3004416     38.12      2688   2255472    750724      8.41    276712   2354592       184
04:02:01 AM   4878512   6964876   3003920     38.11      2688   2255828    750724      8.41    276712   2354336       104
04:03:01 AM   4878288   6964944   3004144     38.11      2688   2256120    750724      8.41    276712   2354556        16
04:04:01 AM   4878356   6965116   3004076     38.11      2688   2256224    750724      8.41    276712   2354668         4
04:05:01 AM   4878356   6965116   3004076     38.11      2688   2256224    750724      8.41    276712   2354668         4
04:06:01 AM   4878360   6965216   3004072     38.11      2688   2256320    750724      8.41    276712   2354768         4
04:07:01 AM   4878224   6965080   3004208     38.11      2688   2256320    750724      8.41    276712   2354836        16
04:08:01 AM   4878116   6965064   3004316     38.11      2688   2256412    750724      8.41    276712   2354860       104
04:09:01 AM   4878112   6965064   3004320     38.11      2688   2256416    750724      8.41    276712   2354864         4
04:10:01 AM   4877696   6964740   3004736     38.12      2688   2256508    766804      8.59    276712   2355072       100
04:11:01 AM   4877808   6964856   3004624     38.12      2688   2256512    766804      8.59    276712   2355080         4
04:12:01 AM   4877576   6964716   3004856     38.12      2688   2256604    766804      8.59    276712   2355120        12
04:13:01 AM   4877652   6964792   3004780     38.12      2688   2256604    766804      8.59    276712   2355064         8
04:14:01 AM   4877568   6964804   3004864     38.12      2688   2256700    766804      8.59    276712   2355248       100
04:15:01 AM   4877740   6964980   3004692     38.12      2688   2256704    766804      8.59    276712   2355172         4
04:16:01 AM   4877508   6964936   3004924     38.12      2688   2256892    766804      8.59    276712   2355352       196
04:17:01 AM   4877044   6964676   3005388     38.13      2688   2257096    766804      8.59    276712   2355772        28
04:18:01 AM   4876748   6964716   3005684     38.13      2688   2257440    766804      8.59    276712   2356156       180
04:19:01 AM   4876588   6964912   3005844     38.13      2688   2257796    766804      8.59    276712   2356396       120
04:20:01 AM   4875976   6964664   3006456     38.14      2688   2258152    749192      8.39    276712   2356876        80
04:21:01 AM   4875828   6964860   3006604     38.14      2688   2258496    749192      8.39    276712   2357104        32
04:22:01 AM   4875304   6964688   3007128     38.15      2688   2258856    749192      8.39    276712   2357644        24
04:23:01 AM   4874912   6964864   3007520     38.15      2688   2259416    749192      8.39    276712   2358040       284
04:24:01 AM   4874720   6964992   3007712     38.16      2688   2259732    749192      8.39    276712   2358348         4
04:25:01 AM   4874752   6965028   3007680     38.16      2688   2259736    749192      8.39    276712   2358352         4
04:26:01 AM   4874580   6964856   3007852     38.16      2688   2259744    749192      8.39    276712   2358348        16
04:27:01 AM   4874440   6964792   3007992     38.16      2688   2259812    749192      8.39    276712   2358708         8
04:28:01 AM   4874628   6964984   3007804     38.16      2688   2259816    749192      8.39    276712   2358440         8
04:29:01 AM   4873840   6964268   3008592     38.17      2688   2259888    749192      8.39    276712   2358948        16
04:30:01 AM   4873904   6964332   3008528     38.17      2688   2259888    749256      8.39    276716   2358904         8
04:31:01 AM   4874448   6965056   3007984     38.16      2688   2260068    749256      8.39    276712   2358172         4
04:32:01 AM   4874288   6964952   3008144     38.16      2688   2260124    749256      8.39    276712   2358432        16
04:33:01 AM   4874380   6965108   3008052     38.16      2688   2260188    749256      8.39    276712   2358428         4
04:34:01 AM   4874240   6964968   3008192     38.16      2688   2260188    749256      8.39    276716   2358512         4
04:35:01 AM   4874296   6965224   3008136     38.16      2688   2260392    753944      8.44    277660   2357684       144
04:36:01 AM   4873872   6965164   3008560     38.17      2688   2260748    753944      8.44    277660   2357936        64
04:37:01 AM   4873452   6965100   3008980     38.17      2688   2261104    753944      8.44    277660   2358364        32
04:38:01 AM   4872960   6964960   3009472     38.18      2688   2261464    753944      8.44    277660   2358764       116
04:39:01 AM   4872812   6965176   3009620     38.18      2688   2261816    753944      8.44    277660   2359124        32
04:40:01 AM   4872156   6964880   3010276     38.19      2688   2262176    752416      8.42    277660   2359600       192
04:41:01 AM   4871984   6965060   3010448     38.19      2688   2262536    752416      8.42    277660   2359712       184
04:42:01 AM   4872080   6965320   3010352     38.19      2688   2262684    752416      8.42    277660   2359952         4
04:43:01 AM   4871728   6965164   3010704     38.20      2688   2262880    752416      8.42    277660   2360116        32
04:44:01 AM   4871460   6965256   3010972     38.20      2688   2263240    752416      8.42    277660   2360476        56
04:45:01 AM   4871008   6965160   3011424     38.20      2688   2263604    752416      8.42    277660   2360832        56
04:46:01 AM   4870708   6965216   3011724     38.21      2688   2263952    752416      8.42    277660   2361304        16
04:47:01 AM   4870448   6965308   3011984     38.21      2688   2264312    752416      8.42    277660   2361728        72
04:48:01 AM   4869616   6964840   3012816     38.22      2688   2264668    752416      8.42    277660   2362204       200
04:49:01 AM   4869552   6965092   3012880     38.22      2688   2264984    752416      8.42    277660   2362564       136
04:50:01 AM   4871136   6966924   3011296     38.20      2688   2265232    748560      8.38    277660   2360676         4
04:51:01 AM   4871216   6967304   3011216     38.20      2688   2265540    748560      8.38    277660   2360748       208
04:52:01 AM   4870664   6967116   3011768     38.21      2688   2265896    748560      8.38    277660   2361184        24
04:53:01 AM   4870536   6967340   3011896     38.21      2688   2266244    748560      8.38    277660   2361468        16
04:54:01 AM   4869724   6966880   3012708     38.22      2688   2266596    748560      8.38    277660   2362120       176
04:55:01 AM   4869600   6967104   3012832     38.22      2688   2266952    748560      8.38    277660   2362392       120
04:56:01 AM   4869208   6967076   3013224     38.23      2688   2267308    748560      8.38    277660   2362640        48
04:57:01 AM   4868268   6966748   3014164     38.24      2688   2267928    748560      8.38    277660   2363472        52
04:58:01 AM   4868484   6967060   3013948     38.24      2688   2268016    748560      8.38    277660   2363392         8
04:59:02 AM   4868392   6966972   3014040     38.24      2688   2268020    748560      8.38    277660   2363512         4
05:00:01 AM   4868292   6966952   3014140     38.24      2688   2268100    740436      8.29    277660   2363592        88
05:01:01 AM   4867196   6965864   3015236     38.25      2688   2268104    740436      8.29    277660   2364292         4
05:02:01 AM   4868260   6967000   3014172     38.24      2688   2268176    740436      8.29    277668   2363612        92
05:03:01 AM   4868292   6967032   3014140     38.24      2688   2268176    740436      8.29    277668   2363552         8
05:04:01 AM   4868208   6967048   3014224     38.24      2688   2268276    740436      8.29    277668   2363644       104
05:05:01 AM   4866012   6964976   3016420     38.27      2688   2268400    740436      8.29    277668   2365828        52
05:06:01 AM   4865684   6964800   3016748     38.27      2688   2268552    740436      8.29    277676   2365936         4
05:07:01 AM   4865672   6964792   3016760     38.27      2688   2268556    740436      8.29    277676   2366160         4
05:08:01 AM   4865816   6964976   3016616     38.27      2688   2268596    740436      8.29    277676   2366132         4
05:09:01 AM   4865792   6965016   3016640     38.27      2688   2268660    740436      8.29    277676   2366080         4
05:10:01 AM   4865372   6964696   3017060     38.28      2688   2268760    757116      8.48    277676   2366296         4
05:11:01 AM   4865464   6964852   3016968     38.27      2688   2268824    757116      8.48    277676   2366368        16
05:12:01 AM   4865260   6964792   3017172     38.28      2688   2268968    757116      8.48    277680   2366524         4
05:13:01 AM   4865376   6964908   3017056     38.28      2688   2268968    757116      8.48    277680   2366456         4
05:14:01 AM   4865372   6965044   3017060     38.28      2688   2269108    757116      8.48    277680   2366596        20
05:15:01 AM   4864864   6964940   3017568     38.28      2688   2269520    757116      8.48    277680   2367108        48
05:16:01 AM   4864504   6964940   3017928     38.29      2688   2269880    757116      8.48    277680   2367352        24
05:17:01 AM   4863996   6964792   3018436     38.29      2688   2270228    757116      8.48    277680   2367852       172
05:18:01 AM   4863744   6964892   3018688     38.30      2688   2270580    757116      8.48    277680   2368144        32
05:19:01 AM   4863068   6964564   3019364     38.30      2688   2270936    757116      8.48    277680   2368764       116
05:20:01 AM   4862944   6964796   3019488     38.31      2688   2271284    757116      8.48    277680   2368972        84
05:21:01 AM   4862408   6964824   3020024     38.31      2688   2271852    757116      8.48    277680   2369416        24
05:22:01 AM   4862304   6964800   3020128     38.31      2688   2271924    757116      8.48    277680   2369560        16
05:23:01 AM   4862364   6964860   3020068     38.31      2688   2271924    757116      8.48    277680   2369500         8
05:24:01 AM   4862316   6964892   3020116     38.31      2688   2272004    757116      8.48    277680   2369580         4
05:25:01 AM   4862432   6965008   3020000     38.31      2688   2272004    757116      8.48    277680   2369580         4
05:26:01 AM   4862184   6964832   3020248     38.32      2688   2272076    757116      8.48    277680   2369652        80
05:27:01 AM   4862164   6964816   3020268     38.32      2688   2272080    757116      8.48    277680   2369724        12
05:28:01 AM   4862116   6964912   3020316     38.32      2688   2272224    757116      8.48    277680   2369792       152
05:29:01 AM   4861772   6964648   3020660     38.32      2688   2272304    757116      8.48    277680   2370196         4
05:30:01 AM   4861536   6964568   3020896     38.32      2688   2272460    778172      8.71    277680   2370152         4
05:31:01 AM   4861528   6964560   3020904     38.32      2688   2272460    778172      8.71    277680   2370152         4
05:32:01 AM   4861624   6964708   3020808     38.32      2688   2272520    778172      8.71    277680   2370276        76
05:33:01 AM   4861348   6964552   3021084     38.33      2688   2272632    778172      8.71    277688   2370340        56
05:34:01 AM   4861376   6964648   3021056     38.33      2688   2272700    778172      8.71    277688   2370272        68
05:35:01 AM   4861356   6964816   3021076     38.33      2688   2272888    778172      8.71    277688   2370460       136
05:36:01 AM   4861412   6964872   3021020     38.33      2688   2272888    778172      8.71    277688   2370460         4
05:37:01 AM   4861336   6964868   3021096     38.33      2688   2272992    754736      8.45    277688   2370592        32
05:38:01 AM   4861136   6964884   3021296     38.33      2688   2273176    754736      8.45    277696   2370844        32
05:39:01 AM   4860896   6965000   3021536     38.33      2688   2273532    754736      8.45    277692   2371200       192
05:40:01 AM   4860200   6964656   3022232     38.34      2688   2273892    772236      8.65    277688   2371572       128
05:41:01 AM   4859912   6964728   3022520     38.35      2688   2274244    772236      8.65    277688   2371896        84
05:42:01 AM   4859540   6964708   3022892     38.35      2688   2274604    772236      8.65    277688   2372360        32
05:43:01 AM   4859300   6964824   3023132     38.35      2688   2274952    772236      8.65    277688   2372528       156
05:44:01 AM   4858776   6964712   3023656     38.36      2688   2275364    772236      8.65    277688   2373072       152
05:45:01 AM   4858360   6964784   3024072     38.36      2688   2275852    772236      8.65    277688   2373428        40
05:46:01 AM   4858472   6964900   3023960     38.36      2688   2275856    772236      8.65    277688   2373436         4
05:47:01 AM   4858484   6964912   3023948     38.36      2688   2275864    772236      8.65    277688   2373500        24
05:48:01 AM   4858428   6964936   3024004     38.36      2688   2275932    772236      8.65    277688   2373512         8
05:49:01 AM   4858504   6965016   3023928     38.36      2688   2275936    772236      8.65    277688   2373516         4
05:50:01 AM   4858004   6964588   3024428     38.37      2688   2276008    759056      8.50    277688   2373704         4
05:51:01 AM   4858184   6964776   3024248     38.37      2688   2276016    759056      8.50    277688   2373596         4
05:52:01 AM   4855496   6962264   3026936     38.40      2688   2276192    748812      8.38    277688   2376032         4
05:53:01 AM   4857900   6964740   3024532     38.37      2688   2276264    748768      8.38    278420   2373116        20
05:54:01 AM   4857668   6964648   3024764     38.37      2688   2276404    748768      8.38    278424   2373252         4
05:55:01 AM   4857572   6964556   3024860     38.37      2688   2276408    748768      8.38    278424   2373256         4
05:56:01 AM   4857556   6964596   3024876     38.37      2688   2276464    748768      8.38    278424   2373428        16
05:57:01 AM   4857492   6964564   3024940     38.38      2688   2276496    748768      8.38    278424   2373420        48
05:58:01 AM   4857464   6964692   3024968     38.38      2688   2276652    748768      8.38    278428   2373620       144
05:59:01 AM   4857404   6964632   3025028     38.38      2688   2276652    748768      8.38    278428   2373620         8
06:00:01 AM   4857052   6964416   3025380     38.38      2688   2276788    767964      8.60    278428   2373864       144
06:01:01 AM   4855932   6963536   3026500     38.40      2688   2277036    748436      8.38    278428   2374688       116
06:02:01 AM   4856548   6964520   3025884     38.39      2688   2277396    748436      8.38    278428   2374320        68
06:03:01 AM   4856336   6964664   3026096     38.39      2688   2277752    748436      8.38    278428   2374724       196
06:04:01 AM   4855848   6964532   3026584     38.40      2688   2278108    748436      8.38    278428   2375080         4
06:05:01 AM   4855508   6964544   3026924     38.40      2688   2278460    748436      8.38    278428   2375432        32
06:06:01 AM   4855380   6964764   3027052     38.40      2688   2278808    748436      8.38    278428   2375780       192
06:07:01 AM   4854620   6964676   3027812     38.41      2688   2279480    748436      8.38    278428   2376520       480
06:08:02 AM   4854724   6964912   3027708     38.41      2688   2279612    748436      8.38    278428   2376472         8