Started by upstream project "integration-distribution-mri-test-calcium" build number 30
originally caused by:
 Started by timer
Running as SYSTEM
[EnvInject] - Loading node environment variables.
Building remotely on prd-centos8-robot-2c-8g-5506 (centos8-robot-2c-8g) in workspace /w/workspace/controller-csit-3node-clustering-ask-all-calcium
[ssh-agent] Looking for ssh-agent implementation...
[ssh-agent]   Exec ssh-agent (binary ssh-agent on a remote machine)
$ ssh-agent
SSH_AUTH_SOCK=/tmp/ssh-h61Yzan0Ghw4/agent.5288
SSH_AGENT_PID=5289
[ssh-agent] Started.
Running ssh-add (command line suppressed)
Identity added: /w/workspace/controller-csit-3node-clustering-ask-all-calcium@tmp/private_key_12690839899266074702.key (/w/workspace/controller-csit-3node-clustering-ask-all-calcium@tmp/private_key_12690839899266074702.key)
[ssh-agent] Using credentials jenkins (Release Engineering Jenkins Key)
The recommended git tool is: NONE
using credential opendaylight-jenkins-ssh
Wiping out workspace first.
Cloning the remote Git repository
Cloning repository git://devvexx.opendaylight.org/mirror/integration/test
 > git init /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test # timeout=10
Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test
 > git --version # timeout=10
 > git --version # 'git version 2.43.0'
using GIT_SSH to set credentials Release Engineering Jenkins Key
[INFO] Currently running in a labeled security context
[INFO] Currently SELinux is 'enforcing' on the host
 > /usr/bin/chcon --type=ssh_home_t /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test@tmp/jenkins-gitclient-ssh3787663939730940425.key
Verifying host key using known hosts file
You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification.
 > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10
Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test
using GIT_SSH to set credentials Release Engineering Jenkins Key
[INFO] Currently running in a labeled security context
[INFO] Currently SELinux is 'enforcing' on the host
 > /usr/bin/chcon --type=ssh_home_t /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test@tmp/jenkins-gitclient-ssh344948204989552196.key
Verifying host key using known hosts file
You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification.
 > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test master # timeout=10
 > git rev-parse FETCH_HEAD^{commit} # timeout=10
Checking out Revision c88ead2b4a65ba004398ad07cfe033ae1e467b17 (origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f c88ead2b4a65ba004398ad07cfe033ae1e467b17 # timeout=10
Commit message: "Reformat '* On Session' keywords (aaa)"
 > git rev-parse FETCH_HEAD^{commit} # timeout=10
 > git rev-list --no-walk 7df40c8c0ac70da634e98ef506471a9aa0c475be # timeout=10
No emails were triggered.
provisioning config files...
copy managed file [npmrc] to file:/home/jenkins/.npmrc
copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf
copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
[controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash /tmp/jenkins9164921892507523634.sh
---> python-tools-install.sh
Setup pyenv:
  system
* 3.8.13 (set by /opt/pyenv/version)
* 3.9.13 (set by /opt/pyenv/version)
* 3.10.13 (set by /opt/pyenv/version)
* 3.11.7 (set by /opt/pyenv/version)
lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-5Vr6
lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: lftools 
lf-activate-venv(): INFO: Adding /tmp/venv-5Vr6/bin to PATH
Generating Requirements File
Python 3.11.7
pip 24.0 from /tmp/venv-5Vr6/lib/python3.11/site-packages/pip (python 3.11)
appdirs==1.4.4
argcomplete==3.2.3
aspy.yaml==1.3.0
attrs==23.2.0
autopage==0.5.2
beautifulsoup4==4.12.3
boto3==1.34.79
botocore==1.34.79
bs4==0.0.2
cachetools==5.3.3
certifi==2024.2.2
cffi==1.16.0
cfgv==3.4.0
chardet==5.2.0
charset-normalizer==3.3.2
click==8.1.7
cliff==4.6.0
cmd2==2.4.3
cryptography==3.3.2
debtcollector==3.0.0
decorator==5.1.1
defusedxml==0.7.1
Deprecated==1.2.14
distlib==0.3.8
dnspython==2.6.1
docker==4.2.2
dogpile.cache==1.3.2
email_validator==2.1.1
filelock==3.13.3
future==1.0.0
gitdb==4.0.11
GitPython==3.1.43
google-auth==2.29.0
httplib2==0.22.0
identify==2.5.35
idna==3.6
importlib-resources==1.5.0
iso8601==2.1.0
Jinja2==3.1.3
jmespath==1.0.1
jsonpatch==1.33
jsonpointer==2.4
jsonschema==4.21.1
jsonschema-specifications==2023.12.1
keystoneauth1==5.6.0
kubernetes==29.0.0
lftools==0.37.10
lxml==5.2.1
MarkupSafe==2.1.5
msgpack==1.0.8
multi_key_dict==2.0.3
munch==4.0.0
netaddr==1.2.1
netifaces==0.11.0
niet==1.4.2
nodeenv==1.8.0
oauth2client==4.1.3
oauthlib==3.2.2
openstacksdk==3.0.0
os-client-config==2.1.0
os-service-types==1.7.0
osc-lib==3.0.1
oslo.config==9.4.0
oslo.context==5.5.0
oslo.i18n==6.3.0
oslo.log==5.5.1
oslo.serialization==5.4.0
oslo.utils==7.1.0
packaging==24.0
pbr==6.0.0
platformdirs==4.2.0
prettytable==3.10.0
pyasn1==0.6.0
pyasn1_modules==0.4.0
pycparser==2.22
pygerrit2==2.0.15
PyGithub==2.3.0
pyinotify==0.9.6
PyJWT==2.8.0
PyNaCl==1.5.0
pyparsing==2.4.7
pyperclip==1.8.2
pyrsistent==0.20.0
python-cinderclient==9.5.0
python-dateutil==2.9.0.post0
python-heatclient==3.5.0
python-jenkins==1.8.2
python-keystoneclient==5.4.0
python-magnumclient==4.4.0
python-novaclient==18.6.0
python-openstackclient==6.6.0
python-swiftclient==4.5.0
PyYAML==6.0.1
referencing==0.34.0
requests==2.31.0
requests-oauthlib==2.0.0
requestsexceptions==1.4.0
rfc3986==2.0.0
rpds-py==0.18.0
rsa==4.9
ruamel.yaml==0.18.6
ruamel.yaml.clib==0.2.8
s3transfer==0.10.1
simplejson==3.19.2
six==1.16.0
smmap==5.0.1
soupsieve==2.5
stevedore==5.2.0
tabulate==0.9.0
toml==0.10.2
tomlkit==0.12.4
tqdm==4.66.2
typing_extensions==4.11.0
tzdata==2024.1
urllib3==1.26.18
virtualenv==20.25.1
wcwidth==0.2.13
websocket-client==1.7.0
wrapt==1.16.0
xdg==6.0.0
xmltodict==0.13.0
yq==3.2.3
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties content 
OS_STACK_TEMPLATE=csit-2-instance-type.yaml
OS_CLOUD=vex
OS_STACK_NAME=releng-controller-csit-3node-clustering-ask-all-calcium-30
OS_STACK_TEMPLATE_DIR=openstack-hot

[EnvInject] - Variables injected successfully.
provisioning config files...
copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
[controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash /tmp/jenkins3354026084971243422.sh
---> Create parameters file for OpenStack HOT
OpenStack Heat parameters generated
-----------------------------------
parameters:
    vm_0_count: '3'
    vm_0_flavor: 'v3-standard-4'
    vm_0_image: 'ZZCI - CentOS Stream 8 - builder - x86_64 - 20240401-160147.446'
    vm_1_count: '0'
    vm_1_flavor: 'v3-standard-2'
    vm_1_image: 'ZZCI - Ubuntu 18.04 - mininet-ovs-28 - x86_64 - 20230601-180106.003'
    
    job_name: '37733-30'
    silo: 'releng'
[controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash -l /tmp/jenkins11057735961268677316.sh
---> Create HEAT stack
+ source /home/jenkins/lf-env.sh
+ lf-activate-venv --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
++ mktemp -d /tmp/venv-XXXX
+ lf_venv=/tmp/venv-AUP1
+ local venv_file=/tmp/.os_lf_venv
+ local python=python3
+ local options
+ local set_path=true
+ local install_args=
++ getopt -o np:v: -l no-path,system-site-packages,python:,venv-file: -n lf-activate-venv -- --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
+ options=' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\'''
+ eval set -- ' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\'''
++ set -- --python python3 -- 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
+ true
+ case $1 in
+ python=python3
+ shift 2
+ true
+ case $1 in
+ shift
+ break
+ case $python in
+ local pkg_list=
+ [[ -d /opt/pyenv ]]
+ echo 'Setup pyenv:'
Setup pyenv:
+ export PYENV_ROOT=/opt/pyenv
+ PYENV_ROOT=/opt/pyenv
+ export PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
+ PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
+ pyenv versions
  system
  3.8.13
  3.9.13
  3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-ask-all-calcium/.python-version)
+ command -v pyenv
++ pyenv init - --no-rehash
+ eval 'PATH="$(bash --norc -ec '\''IFS=:; paths=($PATH); 
for i in ${!paths[@]}; do 
if [[ ${paths[i]} == "'\'''\''/opt/pyenv/shims'\'''\''" ]]; then unset '\''\'\'''\''paths[i]'\''\'\'''\''; 
fi; done; 
echo "${paths[*]}"'\'')"
export PATH="/opt/pyenv/shims:${PATH}"
export PYENV_SHELL=bash
source '\''/opt/pyenv/libexec/../completions/pyenv.bash'\''
pyenv() {
  local command
  command="${1:-}"
  if [ "$#" -gt 0 ]; then
    shift
  fi

  case "$command" in
  rehash|shell)
    eval "$(pyenv "sh-$command" "$@")"
    ;;
  *)
    command pyenv "$command" "$@"
    ;;
  esac
}'
+++ bash --norc -ec 'IFS=:; paths=($PATH); 
for i in ${!paths[@]}; do 
if [[ ${paths[i]} == "/opt/pyenv/shims" ]]; then unset '\''paths[i]'\''; 
fi; done; 
echo "${paths[*]}"'
++ PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
++ export PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
++ PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
++ export PYENV_SHELL=bash
++ PYENV_SHELL=bash
++ source /opt/pyenv/libexec/../completions/pyenv.bash
+++ complete -F _pyenv pyenv
++ lf-pyver python3
++ local py_version_xy=python3
++ local py_version_xyz=
++ pyenv versions
++ local command
++ command=versions
++ '[' 1 -gt 0 ']'
++ shift
++ case "$command" in
++ command pyenv versions
++ pyenv versions
++ grep -E '^[0-9.]*[0-9]$'
++ sed 's/^[ *]* //'
++ awk '{ print $1 }'
++ [[ ! -s /tmp/.pyenv_versions ]]
+++ grep '^3' /tmp/.pyenv_versions
+++ sort -V
+++ tail -n 1
++ py_version_xyz=3.11.7
++ [[ -z 3.11.7 ]]
++ echo 3.11.7
++ return 0
+ pyenv local 3.11.7
+ local command
+ command=local
+ '[' 2 -gt 0 ']'
+ shift
+ case "$command" in
+ command pyenv local 3.11.7
+ pyenv local 3.11.7
+ for arg in "$@"
+ case $arg in
+ pkg_list+='lftools[openstack] '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='kubernetes '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='niet '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='python-heatclient '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='python-openstackclient '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='python-magnumclient '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='yq '
+ [[ -f /tmp/.os_lf_venv ]]
++ cat /tmp/.os_lf_venv
+ lf_venv=/tmp/venv-5Vr6
+ echo 'lf-activate-venv(): INFO: Reuse venv:/tmp/venv-5Vr6 from' file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-5Vr6 from file:/tmp/.os_lf_venv
+ /tmp/venv-5Vr6/bin/python3 -m pip install --upgrade --quiet pip virtualenv
+ [[ -z lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq  ]]
+ echo 'lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq '
lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 
+ /tmp/venv-5Vr6/bin/python3 -m pip install --upgrade --quiet --upgrade-strategy eager 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
+ type python3
+ true
+ echo 'lf-activate-venv(): INFO: Adding /tmp/venv-5Vr6/bin to PATH'
lf-activate-venv(): INFO: Adding /tmp/venv-5Vr6/bin to PATH
+ PATH=/tmp/venv-5Vr6/bin:/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
+ return 0
+ openstack --os-cloud vex limits show --absolute
+--------------------------+---------+
| Name                     |   Value |
+--------------------------+---------+
| maxTotalInstances        |      -1 |
| maxTotalCores            |     450 |
| maxTotalRAMSize          | 1000000 |
| maxServerMeta            |     128 |
| maxImageMeta             |     128 |
| maxPersonality           |       5 |
| maxPersonalitySize       |   10240 |
| maxTotalKeypairs         |     100 |
| maxServerGroups          |      10 |
| maxServerGroupMembers    |      10 |
| maxTotalFloatingIps      |      -1 |
| maxSecurityGroups        |      -1 |
| maxSecurityGroupRules    |      -1 |
| totalRAMUsed             |  655360 |
| totalCoresUsed           |     160 |
| totalInstancesUsed       |      51 |
| totalFloatingIpsUsed     |       0 |
| totalSecurityGroupsUsed  |       0 |
| totalServerGroupsUsed    |       0 |
| maxTotalVolumes          |      -1 |
| maxTotalSnapshots        |      10 |
| maxTotalVolumeGigabytes  |    4096 |
| maxTotalBackups          |      10 |
| maxTotalBackupGigabytes  |    1000 |
| totalVolumesUsed         |       0 |
| totalGigabytesUsed       |       0 |
| totalSnapshotsUsed       |       0 |
| totalBackupsUsed         |       0 |
| totalBackupGigabytesUsed |       0 |
+--------------------------+---------+
+ pushd /opt/ciman/openstack-hot
/opt/ciman/openstack-hot /w/workspace/controller-csit-3node-clustering-ask-all-calcium
+ lftools openstack --os-cloud vex stack create releng-controller-csit-3node-clustering-ask-all-calcium-30 csit-2-instance-type.yaml /w/workspace/controller-csit-3node-clustering-ask-all-calcium/stack-parameters.yaml
Creating stack releng-controller-csit-3node-clustering-ask-all-calcium-30
Waiting to initialize infrastructure...
Stack initialization successful.
------------------------------------
Stack Details
------------------------------------
{'added': None,
 'capabilities': [],
 'created_at': '2024-04-06T23:38:13Z',
 'deleted': None,
 'deleted_at': None,
 'description': 'No description',
 'environment': None,
 'environment_files': None,
 'files': None,
 'files_container': None,
 'id': '692379bd-529c-4129-b8a8-48dd9dc854f8',
 'is_rollback_disabled': True,
 'links': [{'href': 'https://orchestration.public.mtl1.vexxhost.net/v1/12c36e260d8e4bb2913965203b1b491f/stacks/releng-controller-csit-3node-clustering-ask-all-calcium-30/692379bd-529c-4129-b8a8-48dd9dc854f8',
            'rel': 'self'}],
 'location': Munch({'cloud': 'vex', 'region_name': 'ca-ymq-1', 'zone': None, 'project': Munch({'id': '12c36e260d8e4bb2913965203b1b491f', 'name': '61975f2c-7c17-4d69-82fa-c3ae420ad6fd', 'domain_id': None, 'domain_name': 'Default'})}),
 'name': 'releng-controller-csit-3node-clustering-ask-all-calcium-30',
 'notification_topics': [],
 'outputs': [{'description': 'IP addresses of the 1st vm types',
              'output_key': 'vm_0_ips',
              'output_value': ['10.30.171.213',
                               '10.30.171.233',
                               '10.30.170.172']},
             {'description': 'IP addresses of the 2nd vm types',
              'output_key': 'vm_1_ips',
              'output_value': []}],
 'owner_id': ****,
 'parameters': {'OS::project_id': '12c36e260d8e4bb2913965203b1b491f',
                'OS::stack_id': '692379bd-529c-4129-b8a8-48dd9dc854f8',
                'OS::stack_name': 'releng-controller-csit-3node-clustering-ask-all-calcium-30',
                'job_name': '37733-30',
                'silo': 'releng',
                'vm_0_count': '3',
                'vm_0_flavor': 'v3-standard-4',
                'vm_0_image': 'ZZCI - CentOS Stream 8 - builder - x86_64 - '
                              '20240401-160147.446',
                'vm_1_count': '0',
                'vm_1_flavor': 'v3-standard-2',
                'vm_1_image': 'ZZCI - Ubuntu 18.04 - mininet-ovs-28 - x86_64 - '
                              '20230601-180106.003'},
 'parent_id': None,
 'replaced': None,
 'status': 'CREATE_COMPLETE',
 'status_reason': 'Stack CREATE completed successfully',
 'tags': [],
 'template': None,
 'template_description': 'No description',
 'template_url': None,
 'timeout_mins': 15,
 'unchanged': None,
 'updated': None,
 'updated_at': None,
 'user_project_id': 'd740921174784c96b5d1b16d53d7516d'}
------------------------------------
+ popd
/w/workspace/controller-csit-3node-clustering-ask-all-calcium
[controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash -l /tmp/jenkins12026207021269211244.sh
---> Copy SSH public keys to CSIT lab
Setup pyenv:
  system
  3.8.13
  3.9.13
  3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-ask-all-calcium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-5Vr6 from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes python-heatclient python-openstackclient 
lf-activate-venv(): INFO: Adding /tmp/venv-5Vr6/bin to PATH
SSH not responding on 10.30.171.213. Retrying in 10 seconds...
SSH not responding on 10.30.170.172. Retrying in 10 seconds...
SSH not responding on 10.30.171.233. Retrying in 10 seconds...
Ping to 10.30.171.213 successful.
Ping to 10.30.170.172 successful.
Ping to 10.30.171.233 successful.
SSH not responding on 10.30.171.213. Retrying in 10 seconds...
SSH not responding on 10.30.170.172. Retrying in 10 seconds...
SSH not responding on 10.30.171.233. Retrying in 10 seconds...
Ping to 10.30.171.213 successful.
Ping to 10.30.170.172 successful.
Ping to 10.30.171.233 successful.
Warning: Permanently added '10.30.171.213' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.170.172' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.171.233' (ECDSA) to the list of known hosts.
10.30.171.213 releng-37733-30-0-builder-0.novalocal
Successfully copied public keys to slave 10.30.171.213
Process 6706 ready.
10.30.170.172 releng-37733-30-0-builder-2.novalocal
Successfully copied public keys to slave 10.30.170.172
10.30.171.233 releng-37733-30-0-builder-1.novalocal
Successfully copied public keys to slave 10.30.171.233
Process 6707 ready.
Process 6708 ready.
SSH ready on all stack servers.
[controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash -l /tmp/jenkins2710378718662994235.sh
Setup pyenv:
  system
  3.8.13
  3.9.13
  3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-ask-all-calcium/.python-version)
lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-a6HR
lf-activate-venv(): INFO: Save venv in file: /w/workspace/controller-csit-3node-clustering-ask-all-calcium/.robot_venv
lf-activate-venv(): INFO: Installing: setuptools wheel 
lf-activate-venv(): INFO: Adding /tmp/venv-a6HR/bin to PATH
+ echo 'Installing Python Requirements'
Installing Python Requirements
+ cat
+ python -m pip install -r requirements.txt
Looking in indexes: https://nexus3.opendaylight.org/repository/PyPi/simple
Collecting docker-py (from -r requirements.txt (line 1))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/docker-py/1.10.6/docker_py-1.10.6-py2.py3-none-any.whl (50 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 50.0/50.0 kB 5.1 MB/s eta 0:00:00
Collecting ipaddr (from -r requirements.txt (line 2))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/ipaddr/2.2.0/ipaddr-2.2.0.tar.gz (26 kB)
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'done'
Collecting netaddr (from -r requirements.txt (line 3))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/netaddr/1.2.1/netaddr-1.2.1-py3-none-any.whl (2.3 MB)
Collecting netifaces (from -r requirements.txt (line 4))
  Using cached netifaces-0.11.0-cp311-cp311-linux_x86_64.whl
Collecting pyhocon (from -r requirements.txt (line 5))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyhocon/0.3.60/pyhocon-0.3.60.tar.gz (158 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 158.8/158.8 kB 22.3 MB/s eta 0:00:00
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'done'
Collecting requests (from -r requirements.txt (line 6))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/requests/2.31.0/requests-2.31.0-py3-none-any.whl (62 kB)
Collecting robotframework (from -r requirements.txt (line 7))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework/7.0/robotframework-7.0-py3-none-any.whl (726 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 726.3/726.3 kB 9.3 MB/s eta 0:00:00
Collecting robotframework-httplibrary (from -r requirements.txt (line 8))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-httplibrary/0.4.2/robotframework-httplibrary-0.4.2.tar.gz (9.1 kB)
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'done'
Collecting robotframework-requests==0.9.3 (from -r requirements.txt (line 9))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-requests/0.9.3/robotframework_requests-0.9.3-py3-none-any.whl (21 kB)
Collecting robotframework-selenium2library (from -r requirements.txt (line 10))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-selenium2library/3.0.0/robotframework_selenium2library-3.0.0-py2.py3-none-any.whl (6.2 kB)
Collecting robotframework-sshlibrary==3.8.0 (from -r requirements.txt (line 11))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-sshlibrary/3.8.0/robotframework-sshlibrary-3.8.0.tar.gz (51 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 51.4/51.4 kB 7.7 MB/s eta 0:00:00
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'done'
Collecting scapy (from -r requirements.txt (line 12))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/scapy/2.5.0/scapy-2.5.0.tar.gz (1.3 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.3/1.3 MB 24.2 MB/s eta 0:00:00
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'done'
Collecting jsonpath-rw (from -r requirements.txt (line 15))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpath-rw/1.4.0/jsonpath-rw-1.4.0.tar.gz (13 kB)
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'done'
Collecting elasticsearch (from -r requirements.txt (line 18))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch/8.13.0/elasticsearch-8.13.0-py3-none-any.whl (451 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 451.0/451.0 kB 31.8 MB/s eta 0:00:00
Collecting elasticsearch-dsl (from -r requirements.txt (line 19))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch-dsl/8.13.0/elasticsearch_dsl-8.13.0-py3-none-any.whl (88 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 88.6/88.6 kB 5.3 MB/s eta 0:00:00
Collecting pyangbind (from -r requirements.txt (line 22))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyangbind/0.8.5/pyangbind-0.8.5-py3-none-any.whl (52 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 52.9/52.9 kB 10.0 MB/s eta 0:00:00
Collecting isodate (from -r requirements.txt (line 25))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/isodate/0.6.1/isodate-0.6.1-py2.py3-none-any.whl (41 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 41.7/41.7 kB 5.5 MB/s eta 0:00:00
Collecting jmespath (from -r requirements.txt (line 28))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jmespath/1.0.1/jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting jsonpatch (from -r requirements.txt (line 31))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpatch/1.33/jsonpatch-1.33-py2.py3-none-any.whl (12 kB)
Collecting paramiko>=1.15.3 (from robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/paramiko/3.4.0/paramiko-3.4.0-py3-none-any.whl (225 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 225.9/225.9 kB 19.6 MB/s eta 0:00:00
Collecting scp>=0.13.0 (from robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/scp/0.14.5/scp-0.14.5-py2.py3-none-any.whl (8.7 kB)
Collecting docker-pycreds>=0.2.1 (from docker-py->-r requirements.txt (line 1))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/docker-pycreds/0.4.0/docker_pycreds-0.4.0-py2.py3-none-any.whl (9.0 kB)
Collecting six>=1.4.0 (from docker-py->-r requirements.txt (line 1))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/six/1.16.0/six-1.16.0-py2.py3-none-any.whl (11 kB)
Collecting websocket-client>=0.32.0 (from docker-py->-r requirements.txt (line 1))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/websocket-client/1.7.0/websocket_client-1.7.0-py3-none-any.whl (58 kB)
Collecting pyparsing<4,>=2 (from pyhocon->-r requirements.txt (line 5))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pyparsing/3.1.2/pyparsing-3.1.2-py3-none-any.whl (103 kB)
Collecting charset-normalizer<4,>=2 (from requests->-r requirements.txt (line 6))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/charset-normalizer/3.3.2/charset_normalizer-3.3.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (140 kB)
Collecting idna<4,>=2.5 (from requests->-r requirements.txt (line 6))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/idna/3.6/idna-3.6-py3-none-any.whl (61 kB)
Collecting urllib3<3,>=1.21.1 (from requests->-r requirements.txt (line 6))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/urllib3/2.2.1/urllib3-2.2.1-py3-none-any.whl (121 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 121.1/121.1 kB 16.4 MB/s eta 0:00:00
Collecting certifi>=2017.4.17 (from requests->-r requirements.txt (line 6))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/certifi/2024.2.2/certifi-2024.2.2-py3-none-any.whl (163 kB)
Collecting webtest>=2.0 (from robotframework-httplibrary->-r requirements.txt (line 8))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/webtest/3.0.0/WebTest-3.0.0-py3-none-any.whl (31 kB)
Collecting jsonpointer (from robotframework-httplibrary->-r requirements.txt (line 8))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpointer/2.4/jsonpointer-2.4-py2.py3-none-any.whl (7.8 kB)
Collecting robotframework-seleniumlibrary>=3.0.0 (from robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-seleniumlibrary/6.2.0/robotframework_seleniumlibrary-6.2.0-py2.py3-none-any.whl (95 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 95.5/95.5 kB 13.3 MB/s eta 0:00:00
Collecting ply (from jsonpath-rw->-r requirements.txt (line 15))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/ply/3.11/ply-3.11-py2.py3-none-any.whl (49 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 49.6/49.6 kB 5.7 MB/s eta 0:00:00
Collecting decorator (from jsonpath-rw->-r requirements.txt (line 15))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/decorator/5.1.1/decorator-5.1.1-py3-none-any.whl (9.1 kB)
Collecting elastic-transport<9,>=8.13 (from elasticsearch->-r requirements.txt (line 18))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elastic-transport/8.13.0/elastic_transport-8.13.0-py3-none-any.whl (64 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 64.3/64.3 kB 7.5 MB/s eta 0:00:00
Collecting python-dateutil (from elasticsearch-dsl->-r requirements.txt (line 19))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/python-dateutil/2.9.0.post0/python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB)
Collecting pyang (from pyangbind->-r requirements.txt (line 22))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyang/2.6.0/pyang-2.6.0-py2.py3-none-any.whl (594 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 594.1/594.1 kB 22.4 MB/s eta 0:00:00
Collecting lxml (from pyangbind->-r requirements.txt (line 22))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/lxml/5.2.1/lxml-5.2.1-cp311-cp311-manylinux_2_28_x86_64.whl (5.0 MB)
Collecting regex (from pyangbind->-r requirements.txt (line 22))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/regex/2023.12.25/regex-2023.12.25-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (785 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 785.1/785.1 kB 19.0 MB/s eta 0:00:00
Collecting enum34 (from pyangbind->-r requirements.txt (line 22))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/enum34/1.1.10/enum34-1.1.10-py3-none-any.whl (11 kB)
Collecting bcrypt>=3.2 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/bcrypt/4.1.2/bcrypt-4.1.2-cp39-abi3-manylinux_2_28_x86_64.whl (698 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 698.9/698.9 kB 13.5 MB/s eta 0:00:00
Collecting cryptography>=3.3 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/cryptography/42.0.5/cryptography-42.0.5-cp39-abi3-manylinux_2_28_x86_64.whl (4.6 MB)
Collecting pynacl>=1.5 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pynacl/1.5.0/PyNaCl-1.5.0-cp36-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.manylinux_2_24_x86_64.whl (856 kB)
Collecting selenium>=4.3.0 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/selenium/4.19.0/selenium-4.19.0-py3-none-any.whl (10.5 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 10.5/10.5 MB 51.1 MB/s eta 0:00:00
Collecting robotframework-pythonlibcore>=3.0.0 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-pythonlibcore/4.4.1/robotframework_pythonlibcore-4.4.1-py2.py3-none-any.whl (12 kB)
Collecting WebOb>=1.2 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/webob/1.8.7/WebOb-1.8.7-py2.py3-none-any.whl (114 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 115.0/115.0 kB 6.0 MB/s eta 0:00:00
Collecting waitress>=0.8.5 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/waitress/3.0.0/waitress-3.0.0-py3-none-any.whl (56 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 56.7/56.7 kB 6.7 MB/s eta 0:00:00
Collecting beautifulsoup4 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/beautifulsoup4/4.12.3/beautifulsoup4-4.12.3-py3-none-any.whl (147 kB)
Collecting cffi>=1.12 (from cryptography>=3.3->paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/cffi/1.16.0/cffi-1.16.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (464 kB)
Collecting trio~=0.17 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/trio/0.25.0/trio-0.25.0-py3-none-any.whl (467 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 467.2/467.2 kB 35.5 MB/s eta 0:00:00
Collecting trio-websocket~=0.9 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/trio-websocket/0.11.1/trio_websocket-0.11.1-py3-none-any.whl (17 kB)
Collecting typing_extensions>=4.9.0 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/typing-extensions/4.11.0/typing_extensions-4.11.0-py3-none-any.whl (34 kB)
Collecting soupsieve>1.2 (from beautifulsoup4->webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/soupsieve/2.5/soupsieve-2.5-py3-none-any.whl (36 kB)
Collecting pycparser (from cffi>=1.12->cryptography>=3.3->paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pycparser/2.22/pycparser-2.22-py3-none-any.whl (117 kB)
Collecting attrs>=23.2.0 (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/attrs/23.2.0/attrs-23.2.0-py3-none-any.whl (60 kB)
Collecting sortedcontainers (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/sortedcontainers/2.4.0/sortedcontainers-2.4.0-py2.py3-none-any.whl (29 kB)
Collecting outcome (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/outcome/1.3.0.post0/outcome-1.3.0.post0-py2.py3-none-any.whl (10 kB)
Collecting sniffio>=1.3.0 (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/sniffio/1.3.1/sniffio-1.3.1-py3-none-any.whl (10 kB)
Collecting wsproto>=0.14 (from trio-websocket~=0.9->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/wsproto/1.2.0/wsproto-1.2.0-py3-none-any.whl (24 kB)
Collecting pysocks!=1.5.7,<2.0,>=1.5.6 (from urllib3[socks]<3,>=1.26->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pysocks/1.7.1/PySocks-1.7.1-py3-none-any.whl (16 kB)
Collecting h11<1,>=0.9.0 (from wsproto>=0.14->trio-websocket~=0.9->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/h11/0.14.0/h11-0.14.0-py3-none-any.whl (58 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 58.3/58.3 kB 8.4 MB/s eta 0:00:00
Building wheels for collected packages: robotframework-sshlibrary, ipaddr, pyhocon, robotframework-httplibrary, scapy, jsonpath-rw
  Building wheel for robotframework-sshlibrary (setup.py): started
  Building wheel for robotframework-sshlibrary (setup.py): finished with status 'done'
  Created wheel for robotframework-sshlibrary: filename=robotframework_sshlibrary-3.8.0-py3-none-any.whl size=55119 sha256=b268e97b2f40906301a203716a9766c62c161bf66b8735140c53cf91a15ce3bf
  Stored in directory: /home/jenkins/.cache/pip/wheels/f7/c9/b3/a977b7bcc410d45ae27d240df3d00a12585509180e373ecccc
  Building wheel for ipaddr (setup.py): started
  Building wheel for ipaddr (setup.py): finished with status 'done'
  Created wheel for ipaddr: filename=ipaddr-2.2.0-py3-none-any.whl size=18280 sha256=2727f250eb8b0e11cf8f15251d05464e54a8dccf653231a1b00c4f8c69830908
  Stored in directory: /home/jenkins/.cache/pip/wheels/dc/6c/04/da2d847fa8d45c59af3e1d83e2acc29cb8adcbaf04c0898dbf
  Building wheel for pyhocon (setup.py): started
  Building wheel for pyhocon (setup.py): finished with status 'done'
  Created wheel for pyhocon: filename=pyhocon-0.3.60-py3-none-any.whl size=20865 sha256=b07a227398f888ef04a388fc3319c3c8efb4c813464f01aa47660931039f0a95
  Stored in directory: /home/jenkins/.cache/pip/wheels/02/09/4e/04a983205b51f96912ae6fc13f56f3050a586c98200fe36725
  Building wheel for robotframework-httplibrary (setup.py): started
  Building wheel for robotframework-httplibrary (setup.py): finished with status 'done'
  Created wheel for robotframework-httplibrary: filename=robotframework_httplibrary-0.4.2-py3-none-any.whl size=9953 sha256=3999335e9daa468f27662e5a7836b590e77fabfcb20f6f5a0e2d9ae6171ab320
  Stored in directory: /home/jenkins/.cache/pip/wheels/aa/bc/0d/9a20dd51effef392aae2733cb4c7b66c6fa29fca33d88b57ed
  Building wheel for scapy (setup.py): started
  Building wheel for scapy (setup.py): finished with status 'done'
  Created wheel for scapy: filename=scapy-2.5.0-py2.py3-none-any.whl size=1444327 sha256=dc18653435ef8360bfd8e67e8118081dcb378860267c6fc1f08dbcd45ab36f7f
  Stored in directory: /home/jenkins/.cache/pip/wheels/3b/a7/d6/87eeec31fbfcb2bd8ace7dad8172b6d6ebbe1ec6827dbb389a
  Building wheel for jsonpath-rw (setup.py): started
  Building wheel for jsonpath-rw (setup.py): finished with status 'done'
  Created wheel for jsonpath-rw: filename=jsonpath_rw-1.4.0-py3-none-any.whl size=15130 sha256=099ac759940bdaac15601a3a5a9d0eda2e2fc8df712e072719a30b01fb036a7d
  Stored in directory: /home/jenkins/.cache/pip/wheels/f1/54/63/9a8da38cefae13755097b36cc852decc25d8ef69c37d58d4eb
Successfully built robotframework-sshlibrary ipaddr pyhocon robotframework-httplibrary scapy jsonpath-rw
Installing collected packages: sortedcontainers, ply, netifaces, ipaddr, enum34, websocket-client, WebOb, waitress, urllib3, typing_extensions, soupsieve, sniffio, six, scapy, robotframework-pythonlibcore, robotframework, regex, pysocks, pyparsing, pycparser, netaddr, lxml, jsonpointer, jmespath, idna, h11, decorator, charset-normalizer, certifi, bcrypt, attrs, wsproto, requests, python-dateutil, pyhocon, pyang, outcome, jsonpath-rw, jsonpatch, isodate, elastic-transport, docker-pycreds, cffi, beautifulsoup4, webtest, trio, robotframework-requests, pynacl, pyangbind, elasticsearch, docker-py, cryptography, trio-websocket, robotframework-httplibrary, paramiko, elasticsearch-dsl, selenium, scp, robotframework-sshlibrary, robotframework-seleniumlibrary, robotframework-selenium2library
Successfully installed WebOb-1.8.7 attrs-23.2.0 bcrypt-4.1.2 beautifulsoup4-4.12.3 certifi-2024.2.2 cffi-1.16.0 charset-normalizer-3.3.2 cryptography-42.0.5 decorator-5.1.1 docker-py-1.10.6 docker-pycreds-0.4.0 elastic-transport-8.13.0 elasticsearch-8.13.0 elasticsearch-dsl-8.13.0 enum34-1.1.10 h11-0.14.0 idna-3.6 ipaddr-2.2.0 isodate-0.6.1 jmespath-1.0.1 jsonpatch-1.33 jsonpath-rw-1.4.0 jsonpointer-2.4 lxml-5.2.1 netaddr-1.2.1 netifaces-0.11.0 outcome-1.3.0.post0 paramiko-3.4.0 ply-3.11 pyang-2.6.0 pyangbind-0.8.5 pycparser-2.22 pyhocon-0.3.60 pynacl-1.5.0 pyparsing-3.1.2 pysocks-1.7.1 python-dateutil-2.9.0.post0 regex-2023.12.25 requests-2.31.0 robotframework-7.0 robotframework-httplibrary-0.4.2 robotframework-pythonlibcore-4.4.1 robotframework-requests-0.9.3 robotframework-selenium2library-3.0.0 robotframework-seleniumlibrary-6.2.0 robotframework-sshlibrary-3.8.0 scapy-2.5.0 scp-0.14.5 selenium-4.19.0 six-1.16.0 sniffio-1.3.1 sortedcontainers-2.4.0 soupsieve-2.5 trio-0.25.0 trio-websocket-0.11.1 typing_extensions-4.11.0 urllib3-2.2.1 waitress-3.0.0 websocket-client-1.7.0 webtest-3.0.0 wsproto-1.2.0
+ pip freeze
attrs==23.2.0
bcrypt==4.1.2
beautifulsoup4==4.12.3
certifi==2024.2.2
cffi==1.16.0
charset-normalizer==3.3.2
cryptography==42.0.5
decorator==5.1.1
distlib==0.3.8
docker-py==1.10.6
docker-pycreds==0.4.0
elastic-transport==8.13.0
elasticsearch==8.13.0
elasticsearch-dsl==8.13.0
enum34==1.1.10
filelock==3.13.3
h11==0.14.0
idna==3.6
ipaddr==2.2.0
isodate==0.6.1
jmespath==1.0.1
jsonpatch==1.33
jsonpath-rw==1.4.0
jsonpointer==2.4
lxml==5.2.1
netaddr==1.2.1
netifaces==0.11.0
outcome==1.3.0.post0
paramiko==3.4.0
platformdirs==4.2.0
ply==3.11
pyang==2.6.0
pyangbind==0.8.5
pycparser==2.22
pyhocon==0.3.60
PyNaCl==1.5.0
pyparsing==3.1.2
PySocks==1.7.1
python-dateutil==2.9.0.post0
regex==2023.12.25
requests==2.31.0
robotframework==7.0
robotframework-httplibrary==0.4.2
robotframework-pythonlibcore==4.4.1
robotframework-requests==0.9.3
robotframework-selenium2library==3.0.0
robotframework-seleniumlibrary==6.2.0
robotframework-sshlibrary==3.8.0
scapy==2.5.0
scp==0.14.5
selenium==4.19.0
six==1.16.0
sniffio==1.3.1
sortedcontainers==2.4.0
soupsieve==2.5
trio==0.25.0
trio-websocket==0.11.1
typing_extensions==4.11.0
urllib3==2.2.1
virtualenv==20.25.1
waitress==3.0.0
WebOb==1.8.7
websocket-client==1.7.0
WebTest==3.0.0
wsproto==1.2.0
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties file path 'env.properties'
[EnvInject] - Variables injected successfully.
[controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash -l /tmp/jenkins732185099665838094.sh
Setup pyenv:
  system
  3.8.13
  3.9.13
  3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-ask-all-calcium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-5Vr6 from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: python-heatclient python-openstackclient yq 
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
lftools 0.37.10 requires urllib3<2.1.0, but you have urllib3 2.2.1 which is incompatible.
lf-activate-venv(): INFO: Adding /tmp/venv-5Vr6/bin to PATH
+ ODL_SYSTEM=()
+ TOOLS_SYSTEM=()
+ OPENSTACK_SYSTEM=()
+ OPENSTACK_CONTROLLERS=()
+ mapfile -t ADDR
++ openstack stack show -f json -c outputs releng-controller-csit-3node-clustering-ask-all-calcium-30
++ jq -r '.outputs[] | select(.output_key | match("^vm_[0-9]+_ips$")) | .output_value | .[]'
+ for i in "${ADDR[@]}"
++ ssh 10.30.171.213 hostname -s
Warning: Permanently added '10.30.171.213' (ECDSA) to the list of known hosts.
+ REMHOST=releng-37733-30-0-builder-0
+ case ${REMHOST} in
+ ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}")
+ for i in "${ADDR[@]}"
++ ssh 10.30.171.233 hostname -s
Warning: Permanently added '10.30.171.233' (ECDSA) to the list of known hosts.
+ REMHOST=releng-37733-30-0-builder-1
+ case ${REMHOST} in
+ ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}")
+ for i in "${ADDR[@]}"
++ ssh 10.30.170.172 hostname -s
Warning: Permanently added '10.30.170.172' (ECDSA) to the list of known hosts.
+ REMHOST=releng-37733-30-0-builder-2
+ case ${REMHOST} in
+ ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}")
+ echo NUM_ODL_SYSTEM=3
+ echo NUM_TOOLS_SYSTEM=0
+ '[' '' == yes ']'
+ NUM_OPENSTACK_SYSTEM=0
+ echo NUM_OPENSTACK_SYSTEM=0
+ '[' 0 -eq 2 ']'
+ echo ODL_SYSTEM_IP=10.30.171.213
++ seq 0 2
+ for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 )))
+ echo ODL_SYSTEM_1_IP=10.30.171.213
+ for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 )))
+ echo ODL_SYSTEM_2_IP=10.30.171.233
+ for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 )))
+ echo ODL_SYSTEM_3_IP=10.30.170.172
+ echo TOOLS_SYSTEM_IP=
++ seq 0 -1
+ openstack_index=0
+ NUM_OPENSTACK_CONTROL_NODES=1
+ echo NUM_OPENSTACK_CONTROL_NODES=1
++ seq 0 0
+ for i in $(seq 0 $((NUM_OPENSTACK_CONTROL_NODES - 1)))
+ echo OPENSTACK_CONTROL_NODE_1_IP=
+ NUM_OPENSTACK_COMPUTE_NODES=-1
+ echo NUM_OPENSTACK_COMPUTE_NODES=-1
+ '[' -1 -ge 2 ']'
++ seq 0 -2
+ NUM_OPENSTACK_HAPROXY_NODES=0
+ echo NUM_OPENSTACK_HAPROXY_NODES=0
++ seq 0 -1
+ echo 'Contents of slave_addresses.txt:'
Contents of slave_addresses.txt:
+ cat slave_addresses.txt
NUM_ODL_SYSTEM=3
NUM_TOOLS_SYSTEM=0
NUM_OPENSTACK_SYSTEM=0
ODL_SYSTEM_IP=10.30.171.213
ODL_SYSTEM_1_IP=10.30.171.213
ODL_SYSTEM_2_IP=10.30.171.233
ODL_SYSTEM_3_IP=10.30.170.172
TOOLS_SYSTEM_IP=
NUM_OPENSTACK_CONTROL_NODES=1
OPENSTACK_CONTROL_NODE_1_IP=
NUM_OPENSTACK_COMPUTE_NODES=-1
NUM_OPENSTACK_HAPROXY_NODES=0
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties file path 'slave_addresses.txt'
[EnvInject] - Variables injected successfully.
[controller-csit-3node-clustering-ask-all-calcium] $ /bin/sh /tmp/jenkins5435831938865706442.sh
Preparing for JRE Version 17
Karaf artifact is karaf
Karaf project is integration
Java home is /usr/lib/jvm/java-17-openjdk
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties file path 'set_variables.env'
[EnvInject] - Variables injected successfully.
[controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash /tmp/jenkins6548083877333679146.sh
--2024-04-06 23:39:56--  http://git.opendaylight.org/gerrit/gitweb?p=integration/distribution.git;a=blob_plain;f=pom.xml;hb=refs/heads/master
Resolving git.opendaylight.org (git.opendaylight.org)... 52.47.161.242, 35.181.223.58, 13.39.230.180, ...
Connecting to git.opendaylight.org (git.opendaylight.org)|52.47.161.242|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 2620 (2.6K) [text/plain]
Saving to: ‘pom.xml’

     0K ..                                                    100%  283M=0s

2024-04-06 23:39:56 (283 MB/s) - ‘pom.xml’ saved [2620/2620]

Bundle version is 0.20.0-SNAPSHOT
--2024-04-06 23:39:56--  https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.0-SNAPSHOT/maven-metadata.xml
Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6
Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 1404 (1.4K) [application/xml]
Saving to: ‘maven-metadata.xml’

     0K .                                                     100% 57.3M=0s

2024-04-06 23:39:56 (57.3 MB/s) - ‘maven-metadata.xml’ saved [1404/1404]

<?xml version="1.0" encoding="UTF-8"?>
<metadata modelVersion="1.1.0">
  <groupId>org.opendaylight.integration</groupId>
  <artifactId>karaf</artifactId>
  <version>0.20.0-SNAPSHOT</version>
  <versioning>
    <snapshot>
      <timestamp>20240406.205840</timestamp>
      <buildNumber>97</buildNumber>
    </snapshot>
    <lastUpdated>20240406205840</lastUpdated>
    <snapshotVersions>
      <snapshotVersion>
        <extension>pom</extension>
        <value>0.20.0-20240406.205840-97</value>
        <updated>20240406205840</updated>
      </snapshotVersion>
      <snapshotVersion>
        <extension>tar.gz</extension>
        <value>0.20.0-20240406.205840-97</value>
        <updated>20240406205840</updated>
      </snapshotVersion>
      <snapshotVersion>
        <extension>zip</extension>
        <value>0.20.0-20240406.205840-97</value>
        <updated>20240406205840</updated>
      </snapshotVersion>
      <snapshotVersion>
        <classifier>cyclonedx</classifier>
        <extension>xml</extension>
        <value>0.20.0-20240406.205840-97</value>
        <updated>20240406205840</updated>
      </snapshotVersion>
      <snapshotVersion>
        <classifier>cyclonedx</classifier>
        <extension>json</extension>
        <value>0.20.0-20240406.205840-97</value>
        <updated>20240406205840</updated>
      </snapshotVersion>
    </snapshotVersions>
  </versioning>
</metadata>
Nexus timestamp is 0.20.0-20240406.205840-97
Distribution bundle URL is https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.0-SNAPSHOT/karaf-0.20.0-20240406.205840-97.zip
Distribution bundle is karaf-0.20.0-20240406.205840-97.zip
Distribution bundle version is 0.20.0-SNAPSHOT
Distribution folder is karaf-0.20.0-SNAPSHOT
Nexus prefix is https://nexus.opendaylight.org
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties file path 'detect_variables.env'
[EnvInject] - Variables injected successfully.
[controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash -l /tmp/jenkins10829708842098987959.sh
Setup pyenv:
  system
  3.8.13
  3.9.13
  3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-ask-all-calcium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-5Vr6 from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: python-heatclient python-openstackclient 
lf-activate-venv(): INFO: Adding /tmp/venv-5Vr6/bin to PATH
Copying common-functions.sh to /tmp
Copying common-functions.sh to 10.30.171.213:/tmp
Warning: Permanently added '10.30.171.213' (ECDSA) to the list of known hosts.
Copying common-functions.sh to 10.30.171.233:/tmp
Warning: Permanently added '10.30.171.233' (ECDSA) to the list of known hosts.
Copying common-functions.sh to 10.30.170.172:/tmp
Warning: Permanently added '10.30.170.172' (ECDSA) to the list of known hosts.
[controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash /tmp/jenkins16763222946214975875.sh
common-functions.sh is being sourced
common-functions environment:
MAVENCONF: /tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
ACTUALFEATURES: 
FEATURESCONF: /tmp/karaf-0.20.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
CUSTOMPROP: /tmp/karaf-0.20.0-SNAPSHOT/etc/custom.properties
LOGCONF: /tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
MEMCONF: /tmp/karaf-0.20.0-SNAPSHOT/bin/setenv
CONTROLLERMEM: 2048m
AKKACONF: /tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/akka.conf
MODULESCONF: /tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/modules.conf
MODULESHARDSCONF: /tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/module-shards.conf
SUITES: 

#################################################
##         Configure Cluster and Start         ##
#################################################
ACTUALFEATURES: odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app
SPACE_SEPARATED_FEATURES: odl-integration-compatible-with-all odl-jolokia odl-restconf odl-clustering-test-app
Locating script plan to use...
script plan exists!!!
Changing the script plan path...
# Place the scripts in run order:
/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/scripts/car_people_shard.sh
Executing /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/scripts/car_people_shard.sh...
Add car-people shards file
Copy shard config to member-1 with IP address 10.30.171.213
Warning: Permanently added '10.30.171.213' (ECDSA) to the list of known hosts.
Copy shard config to member-2 with IP address 10.30.171.233
Warning: Permanently added '10.30.171.233' (ECDSA) to the list of known hosts.
Copy shard config to member-3 with IP address 10.30.170.172
Warning: Permanently added '10.30.170.172' (ECDSA) to the list of known hosts.
Finished running script plans
Configuring member-1 with IP address 10.30.171.213
Warning: Permanently added '10.30.171.213' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.171.213' (ECDSA) to the list of known hosts.
+ source /tmp/common-functions.sh karaf-0.20.0-SNAPSHOT
common-functions.sh is being sourced
++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]]
++ echo 'common-functions.sh is being sourced'
++ BUNDLEFOLDER=karaf-0.20.0-SNAPSHOT
++ export MAVENCONF=/tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
++ MAVENCONF=/tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
++ export FEATURESCONF=/tmp/karaf-0.20.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
++ FEATURESCONF=/tmp/karaf-0.20.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
++ export CUSTOMPROP=/tmp/karaf-0.20.0-SNAPSHOT/etc/custom.properties
++ CUSTOMPROP=/tmp/karaf-0.20.0-SNAPSHOT/etc/custom.properties
++ export LOGCONF=/tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
++ LOGCONF=/tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
++ export MEMCONF=/tmp/karaf-0.20.0-SNAPSHOT/bin/setenv
++ MEMCONF=/tmp/karaf-0.20.0-SNAPSHOT/bin/setenv
++ export CONTROLLERMEM=
++ CONTROLLERMEM=
++ export AKKACONF=/tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/akka.conf
++ AKKACONF=/tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/akka.conf
++ export MODULESCONF=/tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/modules.conf
++ MODULESCONF=/tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/modules.conf
++ export MODULESHARDSCONF=/tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/module-shards.conf
++ MODULESHARDSCONF=/tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/module-shards.conf
++ print_common_env
++ cat
common-functions environment:
MAVENCONF: /tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
ACTUALFEATURES: 
FEATURESCONF: /tmp/karaf-0.20.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
CUSTOMPROP: /tmp/karaf-0.20.0-SNAPSHOT/etc/custom.properties
LOGCONF: /tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
MEMCONF: /tmp/karaf-0.20.0-SNAPSHOT/bin/setenv
CONTROLLERMEM: 
AKKACONF: /tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/akka.conf
MODULESCONF: /tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/modules.conf
MODULESHARDSCONF: /tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/module-shards.conf
SUITES: 

++ SSH='ssh -t -t'
++ extra_services_cntl='     dnsmasq.service     httpd.service     libvirtd.service     openvswitch.service     ovs-vswitchd.service     ovsdb-server.service     rabbitmq-server.service '
++ extra_services_cmp='     libvirtd.service     openvswitch.service     ovs-vswitchd.service     ovsdb-server.service '
Changing to /tmp
Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.0-SNAPSHOT/karaf-0.20.0-20240406.205840-97.zip
+ echo 'Changing to /tmp'
+ cd /tmp
+ echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.0-SNAPSHOT/karaf-0.20.0-20240406.205840-97.zip'
+ wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.0-SNAPSHOT/karaf-0.20.0-20240406.205840-97.zip
--2024-04-06 23:40:07--  https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.0-SNAPSHOT/karaf-0.20.0-20240406.205840-97.zip
Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6
Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 290573781 (277M) [application/zip]
Saving to: ‘karaf-0.20.0-20240406.205840-97.zip’

     0K ........ ........ ........ ........ ........ ........  1% 42.2M 7s
  3072K ........ ........ ........ ........ ........ ........  2%  129M 4s
  6144K ........ ........ ........ ........ ........ ........  3%  129M 4s
  9216K ........ ........ ........ ........ ........ ........  4%  124M 3s
 12288K ........ ........ ........ ........ ........ ........  5%  160M 3s
 15360K ........ ........ ........ ........ ........ ........  6%  171M 3s
 18432K ........ ........ ........ ........ ........ ........  7%  171M 2s
 21504K ........ ........ ........ ........ ........ ........  8%  196M 2s
 24576K ........ ........ ........ ........ ........ ........  9%  214M 2s
 27648K ........ ........ ........ ........ ........ ........ 10%  247M 2s
 30720K ........ ........ ........ ........ ........ ........ 11%  241M 2s
 33792K ........ ........ ........ ........ ........ ........ 12%  223M 2s
 36864K ........ ........ ........ ........ ........ ........ 14%  216M 2s
 39936K ........ ........ ........ ........ ........ ........ 15%  234M 2s
 43008K ........ ........ ........ ........ ........ ........ 16%  219M 2s
 46080K ........ ........ ........ ........ ........ ........ 17%  218M 2s
 49152K ........ ........ ........ ........ ........ ........ 18%  216M 1s
 52224K ........ ........ ........ ........ ........ ........ 19%  248M 1s
 55296K ........ ........ ........ ........ ........ ........ 20%  283M 1s
 58368K ........ ........ ........ ........ ........ ........ 21%  208M 1s
 61440K ........ ........ ........ ........ ........ ........ 22%  261M 1s
 64512K ........ ........ ........ ........ ........ ........ 23%  278M 1s
 67584K ........ ........ ........ ........ ........ ........ 24%  201M 1s
 70656K ........ ........ ........ ........ ........ ........ 25%  197M 1s
 73728K ........ ........ ........ ........ ........ ........ 27%  268M 1s
 76800K ........ ........ ........ ........ ........ ........ 28%  200M 1s
 79872K ........ ........ ........ ........ ........ ........ 29%  178M 1s
 82944K ........ ........ ........ ........ ........ ........ 30%  205M 1s
 86016K ........ ........ ........ ........ ........ ........ 31%  217M 1s
 89088K ........ ........ ........ ........ ........ ........ 32%  262M 1s
 92160K ........ ........ ........ ........ ........ ........ 33%  210M 1s
 95232K ........ ........ ........ ........ ........ ........ 34%  240M 1s
 98304K ........ ........ ........ ........ ........ ........ 35%  274M 1s
101376K ........ ........ ........ ........ ........ ........ 36%  292M 1s
104448K ........ ........ ........ ........ ........ ........ 37%  172M 1s
107520K ........ ........ ........ ........ ........ ........ 38%  252M 1s
110592K ........ ........ ........ ........ ........ ........ 40%  273M 1s
113664K ........ ........ ........ ........ ........ ........ 41%  216M 1s
116736K ........ ........ ........ ........ ........ ........ 42%  254M 1s
119808K ........ ........ ........ ........ ........ ........ 43%  185M 1s
122880K ........ ........ ........ ........ ........ ........ 44%  220M 1s
125952K ........ ........ ........ ........ ........ ........ 45%  184M 1s
129024K ........ ........ ........ ........ ........ ........ 46%  290M 1s
132096K ........ ........ ........ ........ ........ ........ 47%  266M 1s
135168K ........ ........ ........ ........ ........ ........ 48%  218M 1s
138240K ........ ........ ........ ........ ........ ........ 49%  174M 1s
141312K ........ ........ ........ ........ ........ ........ 50%  287M 1s
144384K ........ ........ ........ ........ ........ ........ 51%  368M 1s
147456K ........ ........ ........ ........ ........ ........ 53%  216M 1s
150528K ........ ........ ........ ........ ........ ........ 54%  247M 1s
153600K ........ ........ ........ ........ ........ ........ 55%  283M 1s
156672K ........ ........ ........ ........ ........ ........ 56%  277M 1s
159744K ........ ........ ........ ........ ........ ........ 57%  150M 1s
162816K ........ ........ ........ ........ ........ ........ 58%  230M 1s
165888K ........ ........ ........ ........ ........ ........ 59%  277M 1s
168960K ........ ........ ........ ........ ........ ........ 60%  226M 1s
172032K ........ ........ ........ ........ ........ ........ 61%  229M 1s
175104K ........ ........ ........ ........ ........ ........ 62%  333M 1s
178176K ........ ........ ........ ........ ........ ........ 63%  182M 0s
181248K ........ ........ ........ ........ ........ ........ 64%  278M 0s
184320K ........ ........ ........ ........ ........ ........ 66%  246M 0s
187392K ........ ........ ........ ........ ........ ........ 67%  313M 0s
190464K ........ ........ ........ ........ ........ ........ 68%  285M 0s
193536K ........ ........ ........ ........ ........ ........ 69%  279M 0s
196608K ........ ........ ........ ........ ........ ........ 70%  162M 0s
199680K ........ ........ ........ ........ ........ ........ 71%  262M 0s
202752K ........ ........ ........ ........ ........ ........ 72%  230M 0s
205824K ........ ........ ........ ........ ........ ........ 73%  219M 0s
208896K ........ ........ ........ ........ ........ ........ 74%  197M 0s
211968K ........ ........ ........ ........ ........ ........ 75%  260M 0s
215040K ........ ........ ........ ........ ........ ........ 76%  220M 0s
218112K ........ ........ ........ ........ ........ ........ 77%  223M 0s
221184K ........ ........ ........ ........ ........ ........ 79%  268M 0s
224256K ........ ........ ........ ........ ........ ........ 80%  166M 0s
227328K ........ ........ ........ ........ ........ ........ 81%  304M 0s
230400K ........ ........ ........ ........ ........ ........ 82%  320M 0s
233472K ........ ........ ........ ........ ........ ........ 83%  271M 0s
236544K ........ ........ ........ ........ ........ ........ 84%  271M 0s
239616K ........ ........ ........ ........ ........ ........ 85%  278M 0s
242688K ........ ........ ........ ........ ........ ........ 86%  276M 0s
245760K ........ ........ ........ ........ ........ ........ 87%  277M 0s
248832K ........ ........ ........ ........ ........ ........ 88%  256M 0s
251904K ........ ........ ........ ........ ........ ........ 89%  182M 0s
254976K ........ ........ ........ ........ ........ ........ 90%  283M 0s
258048K ........ ........ ........ ........ ........ ........ 92%  180M 0s
261120K ........ ........ ........ ........ ........ ........ 93%  189M 0s
264192K ........ ........ ........ ........ ........ ........ 94%  306M 0s
267264K ........ ........ ........ ........ ........ ........ 95%  285M 0s
270336K ........ ........ ........ ........ ........ ........ 96%  280M 0s
273408K ........ ........ ........ ........ ........ ........ 97%  295M 0s
276480K ........ ........ ........ ........ ........ ........ 98%  267M 0s
279552K ........ ........ ........ ........ ........ ........ 99%  297M 0s
282624K ........ ........ .                                  100%  288M=1.3s

2024-04-06 23:40:09 (216 MB/s) - ‘karaf-0.20.0-20240406.205840-97.zip’ saved [290573781/290573781]

Extracting the new controller...
+ echo 'Extracting the new controller...'
+ unzip -q karaf-0.20.0-20240406.205840-97.zip
Adding external repositories...
+ echo 'Adding external repositories...'
+ sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
+ cat /tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
################################################################################
#
#    Licensed to the Apache Software Foundation (ASF) under one or more
#    contributor license agreements.  See the NOTICE file distributed with
#    this work for additional information regarding copyright ownership.
#    The ASF licenses this file to You under the Apache License, Version 2.0
#    (the "License"); you may not use this file except in compliance with
#    the License.  You may obtain a copy of the License at
#
#       http://www.apache.org/licenses/LICENSE-2.0
#
#    Unless required by applicable law or agreed to in writing, software
#    distributed under the License is distributed on an "AS IS" BASIS,
#    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
#    See the License for the specific language governing permissions and
#    limitations under the License.
#
################################################################################

#
# If set to true, the following property will not allow any certificate to be used
# when accessing Maven repositories through SSL
#
#org.ops4j.pax.url.mvn.certificateCheck=

#
# Path to the local Maven settings file.
# The repositories defined in this file will be automatically added to the list
# of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property
# below is not set.
# The following locations are checked for the existence of the settings.xml file
#   * 1. looks for the specified url
#   * 2. if not found looks for ${user.home}/.m2/settings.xml
#   * 3. if not found looks for ${maven.home}/conf/settings.xml
#   * 4. if not found looks for ${M2_HOME}/conf/settings.xml
#
#org.ops4j.pax.url.mvn.settings=

#
# Path to the local Maven repository which is used to avoid downloading
# artifacts when they already exist locally.
# The value of this property will be extracted from the settings.xml file
# above, or defaulted to:
#     System.getProperty( "user.home" ) + "/.m2/repository"
#
org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository}

#
# Default this to false. It's just weird to use undocumented repos
#
org.ops4j.pax.url.mvn.useFallbackRepositories=false

#
# Uncomment if you don't wanna use the proxy settings
# from the Maven conf/settings.xml file
#
# org.ops4j.pax.url.mvn.proxySupport=false

#
# Comma separated list of repositories scanned when resolving an artifact.
# Those repositories will be checked before iterating through the
#    below list of repositories and even before the local repository
# A repository url can be appended with zero or more of the following flags:
#    @snapshots  : the repository contains snaphots
#    @noreleases : the repository does not contain any released artifacts
#
# The following property value will add the system folder as a repo.
#
org.ops4j.pax.url.mvn.defaultRepositories=\
    file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\
    file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\
    file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots

# Use the default local repo (e.g.~/.m2/repository) as a "remote" repo
#org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false

#
# Comma separated list of repositories scanned when resolving an artifact.
# The default list includes the following repositories:
#    http://repo1.maven.org/maven2@id=central
#    http://repository.springsource.com/maven/bundles/release@id=spring.ebr
#    http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external
#    http://zodiac.springsource.com/maven/bundles/release@id=gemini
#    http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases
#    https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases
#    https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
# To add repositories to the default ones, prepend '+' to the list of repositories
# to add.
# A repository url can be appended with zero or more of the following flags:
#    @snapshots  : the repository contains snapshots
#    @noreleases : the repository does not contain any released artifacts
#    @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended
#
org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases

### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.Configuring the startup features...
+ [[ True == \T\r\u\e ]]
+ echo 'Configuring the startup features...'
+ sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.20.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
+ FEATURE_TEST_STRING=features-test
+ FEATURE_TEST_VERSION=0.20.0-SNAPSHOT
+ KARAF_VERSION=karaf4
+ [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]]
+ sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.20.0-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.20.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
+ [[ ! -z '' ]]
+ cat /tmp/karaf-0.20.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
################################################################################
#
#    Licensed to the Apache Software Foundation (ASF) under one or more
#    contributor license agreements.  See the NOTICE file distributed with
#    this work for additional information regarding copyright ownership.
#    The ASF licenses this file to You under the Apache License, Version 2.0
#    (the "License"); you may not use this file except in compliance with
#    the License.  You may obtain a copy of the License at
#
#       http://www.apache.org/licenses/LICENSE-2.0
#
#    Unless required by applicable law or agreed to in writing, software
#    distributed under the License is distributed on an "AS IS" BASIS,
#    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
#    See the License for the specific language governing permissions and
#    limitations under the License.
#
################################################################################

#
# Comma separated list of features repositories to register by default
#
featuresRepositories = mvn:org.opendaylight.integration/features-test/0.20.0-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/ca543f94-b763-48a9-8aa4-6f5379359e80.xml

#
# Comma separated list of features to install at startup
#
featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, 4aa7544c-afb6-453b-8a90-e6b511b1a6c8

#
# Resource repositories (OBR) that the features resolver can use
# to resolve requirements/capabilities
#
# The format of the resourceRepositories is 
# resourceRepositories=[xml:url|json:url],...
# for Instance:
#
#resourceRepositories=xml:http://host/path/to/index.xml
# or
#resourceRepositories=json:http://host/path/to/index.json
#

#
# Defines if the boot features are started in asynchronous mode (in a dedicated thread)
#
featuresBootAsynchronous=false

#
# Service requirements enforcement
#
# By default, the feature resolver checks the service requirements/capabilities of
# bundles for new features (xml schema >= 1.3.0) in order to automatically installs
# the required bundles.
# The following flag can have those values:
#   - disable: service requirements are completely ignored
#   - default: service requirements are ignored for old features
#   - enforce: service requirements are always verified
#
#serviceRequirements=default

#
# Store cfg file for config element in feature
#
#configCfgStore=true

#
# Define if the feature service automatically refresh bundles
#
autoRefresh=true

#
# Configuration of features processing mechanism (overrides, blacklisting, modification of features)
# XML file defines instructions related to features processing
# versions.properties may declare properties to resolve placeholders in XML file
# both files are relative to ${karaf.etc}
#
#featureProcessing=org.apache.karaf.features.xml
#featureProcessingVersions=versions.properties
+ configure_karaf_log karaf4 ''
+ local -r karaf_version=karaf4
+ local -r controllerdebugmap=
+ local logapi=log4j
+ grep log4j2 /tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
log4j2.rootLogger.level = INFO
#log4j2.rootLogger.type = asyncRoot
#log4j2.rootLogger.includeLocation = false
log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
log4j2.rootLogger.appenderRef.Console.ref = Console
log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
log4j2.logger.spifly.name = org.apache.aries.spifly
log4j2.logger.spifly.level = WARN
log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
log4j2.logger.audit.level = INFO
log4j2.logger.audit.additivity = false
log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
# Console appender not used by default (see log4j2.rootLogger.appenderRefs)
log4j2.appender.console.type = Console
log4j2.appender.console.name = Console
log4j2.appender.console.layout.type = PatternLayout
log4j2.appender.console.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.type = RollingRandomAccessFile
log4j2.appender.rolling.name = RollingFile
log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
#log4j2.appender.rolling.immediateFlush = false
log4j2.appender.rolling.append = true
log4j2.appender.rolling.layout.type = PatternLayout
log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.policies.type = Policies
log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.rolling.policies.size.size = 64MB
log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
log4j2.appender.rolling.strategy.max = 7
log4j2.appender.audit.type = RollingRandomAccessFile
log4j2.appender.audit.name = AuditRollingFile
log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
log4j2.appender.audit.append = true
log4j2.appender.audit.layout.type = PatternLayout
log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
log4j2.appender.audit.policies.type = Policies
log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.audit.policies.size.size = 8MB
log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
log4j2.appender.audit.strategy.max = 7
log4j2.appender.osgi.type = PaxOsgi
log4j2.appender.osgi.name = PaxOsgi
log4j2.appender.osgi.filter = *
#log4j2.logger.aether.name = shaded.org.eclipse.aether
#log4j2.logger.aether.level = TRACE
#log4j2.logger.http-headers.name = shaded.org.apache.http.headers
#log4j2.logger.http-headers.level = DEBUG
#log4j2.logger.maven.name = org.ops4j.pax.url.mvn
#log4j2.logger.maven.level = TRACE
+ logapi=log4j2
Configuring the karaf log... karaf_version: karaf4, logapi: log4j2
+ echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2'
+ '[' log4j2 == log4j2 ']'
+ sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
+ orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver
+ orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver
+ echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN'
controllerdebugmap: 
cat /tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
+ echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN'
+ unset IFS
+ echo 'controllerdebugmap: '
+ '[' -n '' ']'
+ echo 'cat /tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg'
+ cat /tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
################################################################################
#
#    Licensed to the Apache Software Foundation (ASF) under one or more
#    contributor license agreements.  See the NOTICE file distributed with
#    this work for additional information regarding copyright ownership.
#    The ASF licenses this file to You under the Apache License, Version 2.0
#    (the "License"); you may not use this file except in compliance with
#    the License.  You may obtain a copy of the License at
#
#       http://www.apache.org/licenses/LICENSE-2.0
#
#    Unless required by applicable law or agreed to in writing, software
#    distributed under the License is distributed on an "AS IS" BASIS,
#    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
#    See the License for the specific language governing permissions and
#    limitations under the License.
#
################################################################################

# Common pattern layout for appenders
log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n

# Root logger
log4j2.rootLogger.level = INFO
# uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library
#log4j2.rootLogger.type = asyncRoot
#log4j2.rootLogger.includeLocation = false
log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
log4j2.rootLogger.appenderRef.Console.ref = Console
log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}

# Filters for logs marked by org.opendaylight.odlparent.Markers
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL

# Loggers configuration

# Spifly logger
log4j2.logger.spifly.name = org.apache.aries.spifly
log4j2.logger.spifly.level = WARN

# Security audit logger
log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
log4j2.logger.audit.level = INFO
log4j2.logger.audit.additivity = false
log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile

# Appenders configuration

# Console appender not used by default (see log4j2.rootLogger.appenderRefs)
log4j2.appender.console.type = Console
log4j2.appender.console.name = Console
log4j2.appender.console.layout.type = PatternLayout
log4j2.appender.console.layout.pattern = ${log4j2.pattern}

# Rolling file appender
log4j2.appender.rolling.type = RollingRandomAccessFile
log4j2.appender.rolling.name = RollingFile
log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
# uncomment to not force a disk flush
#log4j2.appender.rolling.immediateFlush = false
log4j2.appender.rolling.append = true
log4j2.appender.rolling.layout.type = PatternLayout
log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.policies.type = Policies
log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.rolling.policies.size.size = 1GB
log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
log4j2.appender.rolling.strategy.max = 7

# Audit file appender
log4j2.appender.audit.type = RollingRandomAccessFile
log4j2.appender.audit.name = AuditRollingFile
log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
log4j2.appender.audit.append = true
log4j2.appender.audit.layout.type = PatternLayout
log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
log4j2.appender.audit.policies.type = Policies
log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.audit.policies.size.size = 8MB
log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
log4j2.appender.audit.strategy.max = 7

# OSGi appender
log4j2.appender.osgi.type = PaxOsgi
log4j2.appender.osgi.name = PaxOsgi
log4j2.appender.osgi.filter = *

# help with identification of maven-related problems with pax-url-aether
#log4j2.logger.aether.name = shaded.org.eclipse.aether
#log4j2.logger.aether.level = TRACE
#log4j2.logger.http-headers.name = shaded.org.apache.http.headers
#log4j2.logger.http-headers.level = DEBUG
#log4j2.logger.maven.name = org.ops4j.pax.url.mvn
#log4j2.logger.maven.level = TRACE
log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN
log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN
+ set_java_vars /usr/lib/jvm/java-17-openjdk 3072m /tmp/karaf-0.20.0-SNAPSHOT/bin/setenv
+ local -r java_home=/usr/lib/jvm/java-17-openjdk
+ local -r controllermem=3072m
+ local -r memconf=/tmp/karaf-0.20.0-SNAPSHOT/bin/setenv
Configure
    java home: /usr/lib/jvm/java-17-openjdk
    max memory: 3072m
    memconf: /tmp/karaf-0.20.0-SNAPSHOT/bin/setenv
+ echo Configure
+ echo '    java home: /usr/lib/jvm/java-17-openjdk'
+ echo '    max memory: 3072m'
+ echo '    memconf: /tmp/karaf-0.20.0-SNAPSHOT/bin/setenv'
+ sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk}%g' /tmp/karaf-0.20.0-SNAPSHOT/bin/setenv
+ sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.20.0-SNAPSHOT/bin/setenv
cat /tmp/karaf-0.20.0-SNAPSHOT/bin/setenv
+ echo 'cat /tmp/karaf-0.20.0-SNAPSHOT/bin/setenv'
+ cat /tmp/karaf-0.20.0-SNAPSHOT/bin/setenv
#!/bin/sh
#
#    Licensed to the Apache Software Foundation (ASF) under one or more
#    contributor license agreements.  See the NOTICE file distributed with
#    this work for additional information regarding copyright ownership.
#    The ASF licenses this file to You under the Apache License, Version 2.0
#    (the "License"); you may not use this file except in compliance with
#    the License.  You may obtain a copy of the License at
#
#       http://www.apache.org/licenses/LICENSE-2.0
#
#    Unless required by applicable law or agreed to in writing, software
#    distributed under the License is distributed on an "AS IS" BASIS,
#    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
#    See the License for the specific language governing permissions and
#    limitations under the License.
#

#
# handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf
# script: client, instance, shell, start, status, stop, karaf
#
# if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then
#   Actions go here...
# fi

#
# general settings which should be applied for all scripts go here; please keep
# in mind that it is possible that scripts might be executed more than once, e.g.
# in example of the start script where the start script is executed first and the
# karaf script afterwards.
#

#
# The following section shows the possible configuration options for the default 
# karaf scripts
#
export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk} # Location of Java installation
# export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration
# export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options
# export EXTRA_JAVA_OPTS # Additional JVM options
# export KARAF_HOME # Karaf home folder
# export KARAF_DATA # Karaf data folder
# export KARAF_BASE # Karaf base folder
# export KARAF_ETC  # Karaf etc  folder
# export KARAF_LOG  # Karaf log  folder
# export KARAF_SYSTEM_OPTS # First citizen Karaf options
# export KARAF_OPTS # Additional available Karaf options
# export KARAF_DEBUG # Enable debug mode
# export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start
# export KARAF_NOROOT # Prevent execution as root if set to true
Set Java version
+ echo 'Set Java version'
+ sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-17-openjdk/bin/java 1
+ sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-17-openjdk/bin/java
JDK default version ...
+ echo 'JDK default version ...'
+ java -version
openjdk version "17.0.6-ea" 2023-01-17 LTS
OpenJDK Runtime Environment (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS)
OpenJDK 64-Bit Server VM (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS, mixed mode, sharing)
Set JAVA_HOME
+ echo 'Set JAVA_HOME'
+ export JAVA_HOME=/usr/lib/jvm/java-17-openjdk
+ JAVA_HOME=/usr/lib/jvm/java-17-openjdk
++ readlink -e /usr/lib/jvm/java-17-openjdk/bin/java
Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java
Listing all open ports on controller system...
+ JAVA_RESOLVED=/usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java
+ echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java'
+ echo 'Listing all open ports on controller system...'
+ netstat -pnatu
(Not all processes could be identified, non-owned process info
 will not be shown, you would have to be root to see it all.)
Active Internet connections (servers and established)
Proto Recv-Q Send-Q Local Address           Foreign Address         State       PID/Program name    
tcp        0      0 0.0.0.0:111             0.0.0.0:*               LISTEN      -                   
tcp        0      0 0.0.0.0:22              0.0.0.0:*               LISTEN      -                   
tcp        0    164 10.30.171.213:22        10.30.171.214:40336     ESTABLISHED -                   
tcp        0      0 10.30.171.213:44024     199.204.45.87:443       TIME_WAIT   -                   
tcp6       0      0 :::111                  :::*                    LISTEN      -                   
tcp6       0      0 :::5555                 :::*                    LISTEN      -                   
tcp6       0      0 :::22                   :::*                    LISTEN      -                   
udp        0      0 10.30.171.213:68        10.30.170.2:67          ESTABLISHED -                   
udp        0      0 0.0.0.0:111             0.0.0.0:*                           -                   
udp        0      0 127.0.0.1:323           0.0.0.0:*                           -                   
udp6       0      0 :::111                  :::*                                -                   
udp6       0      0 ::1:323                 :::*                                -                   
Custom shard config exists!!!
Copying the shard config...
+ '[' -f /tmp/custom_shard_config.txt ']'
+ echo 'Custom shard config exists!!!'
+ echo 'Copying the shard config...'
+ cp /tmp/custom_shard_config.txt /tmp/karaf-0.20.0-SNAPSHOT/bin/
Configuring cluster
+ echo 'Configuring cluster'
+ /tmp/karaf-0.20.0-SNAPSHOT/bin/configure_cluster.sh 1 10.30.171.213 10.30.171.233 10.30.170.172
################################################
##             Configure Cluster              ##
################################################
 NOTE: Cluster configuration files not found. Copying from
 /tmp/karaf-0.20.0-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/9.0.2
Configuring unique name in akka.conf
Configuring hostname in akka.conf
Configuring data and rpc seed nodes in akka.conf
modules = [
	
	{
		name = "inventory"
		namespace = "urn:opendaylight:inventory"
		shard-strategy = "module"
	},
	{
		name = "topology"
		namespace = "urn:TBD:params:xml:ns:yang:network-topology"
		shard-strategy = "module"
	},
	{
		name = "toaster"
		namespace = "http://netconfcentral.org/ns/toaster"
		shard-strategy = "module"
	},
	{
		name = "car"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
		shard-strategy = "module"
	},
	{
		name = "people"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
		shard-strategy = "module"
	},
	{
		name = "car-people"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
		shard-strategy = "module"
	}
]
Configuring replication type in module-shards.conf
################################################
##   NOTE: Manually restart controller to     ##
##         apply configuration.               ##
################################################
Dump akka.conf
+ echo 'Dump akka.conf'
+ cat /tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/akka.conf

odl-cluster-data {
  akka {
    remote {
      artery {
        enabled = on
        transport = tcp
        canonical.hostname = "10.30.171.213"
        canonical.port = 2550
      }
    }

    cluster {
      # Using artery.
      seed-nodes = ["akka://opendaylight-cluster-data@10.30.171.213:2550",
				"akka://opendaylight-cluster-data@10.30.171.233:2550",
				"akka://opendaylight-cluster-data@10.30.170.172:2550"]

      roles = ["member-1"]

      # when under load we might trip a false positive on the failure detector
      # failure-detector {
        # heartbeat-interval = 4 s
        # acceptable-heartbeat-pause = 16s
      # }
    }

    persistence {
      # By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by
      # modifying the following two properties. The directory location specified may be a relative or absolute path. 
      # The relative path is always relative to KARAF_HOME.

      # snapshot-store.local.dir = "target/snapshots"

      # Use lz4 compression for LocalSnapshotStore snapshots
      snapshot-store.local.use-lz4-compression = false
      # Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB
      snapshot-store.local.lz4-blocksize = 256KB
    }
    disable-default-actor-system-quarantined-event-handling = "false"
  }
}
Dump modules.conf
+ echo 'Dump modules.conf'
+ cat /tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/modules.conf
modules = [
	
	{
		name = "inventory"
		namespace = "urn:opendaylight:inventory"
		shard-strategy = "module"
	},
	{
		name = "topology"
		namespace = "urn:TBD:params:xml:ns:yang:network-topology"
		shard-strategy = "module"
	},
	{
		name = "toaster"
		namespace = "http://netconfcentral.org/ns/toaster"
		shard-strategy = "module"
	},
	{
		name = "car"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
		shard-strategy = "module"
	},
	{
		name = "people"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
		shard-strategy = "module"
	},
	{
		name = "car-people"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
		shard-strategy = "module"
	}
]
Dump module-shards.conf
+ echo 'Dump module-shards.conf'
+ cat /tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/module-shards.conf
module-shards = [
	{
		name = "default"
		shards = [
			{
				name = "default"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "inventory"
		shards = [
			{
				name="inventory"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "topology"
		shards = [
			{
				name="topology"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "toaster"
		shards = [
			{
				name="toaster"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "car"
		shards = [
			{
				name="car"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "people"
		shards = [
			{
				name="people"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "car-people"
		shards = [
			{
				name="car-people"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	}
]
Configuring member-2 with IP address 10.30.171.233
Warning: Permanently added '10.30.171.233' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.171.233' (ECDSA) to the list of known hosts.
+ source /tmp/common-functions.sh karaf-0.20.0-SNAPSHOT
common-functions.sh is being sourced
++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]]
++ echo 'common-functions.sh is being sourced'
++ BUNDLEFOLDER=karaf-0.20.0-SNAPSHOT
++ export MAVENCONF=/tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
++ MAVENCONF=/tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
++ export FEATURESCONF=/tmp/karaf-0.20.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
++ FEATURESCONF=/tmp/karaf-0.20.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
++ export CUSTOMPROP=/tmp/karaf-0.20.0-SNAPSHOT/etc/custom.properties
++ CUSTOMPROP=/tmp/karaf-0.20.0-SNAPSHOT/etc/custom.properties
++ export LOGCONF=/tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
++ LOGCONF=/tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
++ export MEMCONF=/tmp/karaf-0.20.0-SNAPSHOT/bin/setenv
++ MEMCONF=/tmp/karaf-0.20.0-SNAPSHOT/bin/setenv
++ export CONTROLLERMEM=
++ CONTROLLERMEM=
++ export AKKACONF=/tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/akka.conf
++ AKKACONF=/tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/akka.conf
++ export MODULESCONF=/tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/modules.conf
++ MODULESCONF=/tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/modules.conf
++ export MODULESHARDSCONF=/tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/module-shards.conf
++ MODULESHARDSCONF=/tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/module-shards.conf
++ print_common_env
++ cat
common-functions environment:
MAVENCONF: /tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
ACTUALFEATURES: 
FEATURESCONF: /tmp/karaf-0.20.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
CUSTOMPROP: /tmp/karaf-0.20.0-SNAPSHOT/etc/custom.properties
LOGCONF: /tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
MEMCONF: /tmp/karaf-0.20.0-SNAPSHOT/bin/setenv
CONTROLLERMEM: 
AKKACONF: /tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/akka.conf
MODULESCONF: /tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/modules.conf
MODULESHARDSCONF: /tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/module-shards.conf
SUITES: 

++ SSH='ssh -t -t'
++ extra_services_cntl='     dnsmasq.service     httpd.service     libvirtd.service     openvswitch.service     ovs-vswitchd.service     ovsdb-server.service     rabbitmq-server.service '
++ extra_services_cmp='     libvirtd.service     openvswitch.service     ovs-vswitchd.service     ovsdb-server.service '
Changing to /tmp
Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.0-SNAPSHOT/karaf-0.20.0-20240406.205840-97.zip
+ echo 'Changing to /tmp'
+ cd /tmp
+ echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.0-SNAPSHOT/karaf-0.20.0-20240406.205840-97.zip'
+ wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.0-SNAPSHOT/karaf-0.20.0-20240406.205840-97.zip
--2024-04-06 23:40:12--  https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.0-SNAPSHOT/karaf-0.20.0-20240406.205840-97.zip
Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6
Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 290573781 (277M) [application/zip]
Saving to: ‘karaf-0.20.0-20240406.205840-97.zip’

     0K ........ ........ ........ ........ ........ ........  1% 94.4M 3s
  3072K ........ ........ ........ ........ ........ ........  2%  143M 2s
  6144K ........ ........ ........ ........ ........ ........  3%  158M 2s
  9216K ........ ........ ........ ........ ........ ........  4%  179M 2s
 12288K ........ ........ ........ ........ ........ ........  5%  169M 2s
 15360K ........ ........ ........ ........ ........ ........  6%  168M 2s
 18432K ........ ........ ........ ........ ........ ........  7%  218M 2s
 21504K ........ ........ ........ ........ ........ ........  8%  216M 2s
 24576K ........ ........ ........ ........ ........ ........  9%  266M 2s
 27648K ........ ........ ........ ........ ........ ........ 10%  271M 1s
 30720K ........ ........ ........ ........ ........ ........ 11%  276M 1s
 33792K ........ ........ ........ ........ ........ ........ 12%  305M 1s
 36864K ........ ........ ........ ........ ........ ........ 14%  317M 1s
 39936K ........ ........ ........ ........ ........ ........ 15%  308M 1s
 43008K ........ ........ ........ ........ ........ ........ 16%  333M 1s
 46080K ........ ........ ........ ........ ........ ........ 17%  242M 1s
 49152K ........ ........ ........ ........ ........ ........ 18%  276M 1s
 52224K ........ ........ ........ ........ ........ ........ 19%  296M 1s
 55296K ........ ........ ........ ........ ........ ........ 20%  359M 1s
 58368K ........ ........ ........ ........ ........ ........ 21%  332M 1s
 61440K ........ ........ ........ ........ ........ ........ 22%  307M 1s
 64512K ........ ........ ........ ........ ........ ........ 23%  216M 1s
 67584K ........ ........ ........ ........ ........ ........ 24%  288M 1s
 70656K ........ ........ ........ ........ ........ ........ 25%  349M 1s
 73728K ........ ........ ........ ........ ........ ........ 27%  360M 1s
 76800K ........ ........ ........ ........ ........ ........ 28%  298M 1s
 79872K ........ ........ ........ ........ ........ ........ 29%  309M 1s
 82944K ........ ........ ........ ........ ........ ........ 30%  305M 1s
 86016K ........ ........ ........ ........ ........ ........ 31%  353M 1s
 89088K ........ ........ ........ ........ ........ ........ 32%  359M 1s
 92160K ........ ........ ........ ........ ........ ........ 33%  359M 1s
 95232K ........ ........ ........ ........ ........ ........ 34%  326M 1s
 98304K ........ ........ ........ ........ ........ ........ 35%  295M 1s
101376K ........ ........ ........ ........ ........ ........ 36%  334M 1s
104448K ........ ........ ........ ........ ........ ........ 37%  338M 1s
107520K ........ ........ ........ ........ ........ ........ 38%  351M 1s
110592K ........ ........ ........ ........ ........ ........ 40%  349M 1s
113664K ........ ........ ........ ........ ........ ........ 41%  365M 1s
116736K ........ ........ ........ ........ ........ ........ 42%  349M 1s
119808K ........ ........ ........ ........ ........ ........ 43%  339M 1s
122880K ........ ........ ........ ........ ........ ........ 44%  352M 1s
125952K ........ ........ ........ ........ ........ ........ 45%  353M 1s
129024K ........ ........ ........ ........ ........ ........ 46%  353M 1s
132096K ........ ........ ........ ........ ........ ........ 47%  333M 1s
135168K ........ ........ ........ ........ ........ ........ 48%  335M 1s
138240K ........ ........ ........ ........ ........ ........ 49%  298M 1s
141312K ........ ........ ........ ........ ........ ........ 50%  336M 1s
144384K ........ ........ ........ ........ ........ ........ 51%  345M 0s
147456K ........ ........ ........ ........ ........ ........ 53%  319M 0s
150528K ........ ........ ........ ........ ........ ........ 54%  340M 0s
153600K ........ ........ ........ ........ ........ ........ 55%  336M 0s
156672K ........ ........ ........ ........ ........ ........ 56%  343M 0s
159744K ........ ........ ........ ........ ........ ........ 57%  345M 0s
162816K ........ ........ ........ ........ ........ ........ 58%  336M 0s
165888K ........ ........ ........ ........ ........ ........ 59%  232M 0s
168960K ........ ........ ........ ........ ........ ........ 60%  209M 0s
172032K ........ ........ ........ ........ ........ ........ 61%  382M 0s
175104K ........ ........ ........ ........ ........ ........ 62%  351M 0s
178176K ........ ........ ........ ........ ........ ........ 63%  345M 0s
181248K ........ ........ ........ ........ ........ ........ 64%  348M 0s
184320K ........ ........ ........ ........ ........ ........ 66%  348M 0s
187392K ........ ........ ........ ........ ........ ........ 67%  321M 0s
190464K ........ ........ ........ ........ ........ ........ 68%  295M 0s
193536K ........ ........ ........ ........ ........ ........ 69%  293M 0s
196608K ........ ........ ........ ........ ........ ........ 70%  233M 0s
199680K ........ ........ ........ ........ ........ ........ 71%  346M 0s
202752K ........ ........ ........ ........ ........ ........ 72%  343M 0s
205824K ........ ........ ........ ........ ........ ........ 73%  379M 0s
208896K ........ ........ ........ ........ ........ ........ 74%  364M 0s
211968K ........ ........ ........ ........ ........ ........ 75%  382M 0s
215040K ........ ........ ........ ........ ........ ........ 76%  373M 0s
218112K ........ ........ ........ ........ ........ ........ 77%  381M 0s
221184K ........ ........ ........ ........ ........ ........ 79%  369M 0s
224256K ........ ........ ........ ........ ........ ........ 80%  372M 0s
227328K ........ ........ ........ ........ ........ ........ 81%  355M 0s
230400K ........ ........ ........ ........ ........ ........ 82%  380M 0s
233472K ........ ........ ........ ........ ........ ........ 83%  373M 0s
236544K ........ ........ ........ ........ ........ ........ 84%  368M 0s
239616K ........ ........ ........ ........ ........ ........ 85%  370M 0s
242688K ........ ........ ........ ........ ........ ........ 86%  365M 0s
245760K ........ ........ ........ ........ ........ ........ 87%  354M 0s
248832K ........ ........ ........ ........ ........ ........ 88%  356M 0s
251904K ........ ........ ........ ........ ........ ........ 89%  359M 0s
254976K ........ ........ ........ ........ ........ ........ 90%  350M 0s
258048K ........ ........ ........ ........ ........ ........ 92%  356M 0s
261120K ........ ........ ........ ........ ........ ........ 93%  361M 0s
264192K ........ ........ ........ ........ ........ ........ 94%  271M 0s
267264K ........ ........ ........ ........ ........ ........ 95%  292M 0s
270336K ........ ........ ........ ........ ........ ........ 96%  298M 0s
273408K ........ ........ ........ ........ ........ ........ 97%  358M 0s
276480K ........ ........ ........ ........ ........ ........ 98%  361M 0s
279552K ........ ........ ........ ........ ........ ........ 99%  360M 0s
282624K ........ ........ .                                  100%  352M=0.9s

2024-04-06 23:40:13 (298 MB/s) - ‘karaf-0.20.0-20240406.205840-97.zip’ saved [290573781/290573781]

Extracting the new controller...
+ echo 'Extracting the new controller...'
+ unzip -q karaf-0.20.0-20240406.205840-97.zip
Adding external repositories...
+ echo 'Adding external repositories...'
+ sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
+ cat /tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
################################################################################
#
#    Licensed to the Apache Software Foundation (ASF) under one or more
#    contributor license agreements.  See the NOTICE file distributed with
#    this work for additional information regarding copyright ownership.
#    The ASF licenses this file to You under the Apache License, Version 2.0
#    (the "License"); you may not use this file except in compliance with
#    the License.  You may obtain a copy of the License at
#
#       http://www.apache.org/licenses/LICENSE-2.0
#
#    Unless required by applicable law or agreed to in writing, software
#    distributed under the License is distributed on an "AS IS" BASIS,
#    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
#    See the License for the specific language governing permissions and
#    limitations under the License.
#
################################################################################

#
# If set to true, the following property will not allow any certificate to be used
# when accessing Maven repositories through SSL
#
#org.ops4j.pax.url.mvn.certificateCheck=

#
# Path to the local Maven settings file.
# The repositories defined in this file will be automatically added to the list
# of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property
# below is not set.
# The following locations are checked for the existence of the settings.xml file
#   * 1. looks for the specified url
#   * 2. if not found looks for ${user.home}/.m2/settings.xml
#   * 3. if not found looks for ${maven.home}/conf/settings.xml
#   * 4. if not found looks for ${M2_HOME}/conf/settings.xml
#
#org.ops4j.pax.url.mvn.settings=

#
# Path to the local Maven repository which is used to avoid downloading
# artifacts when they already exist locally.
# The value of this property will be extracted from the settings.xml file
# above, or defaulted to:
#     System.getProperty( "user.home" ) + "/.m2/repository"
#
org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository}

#
# Default this to false. It's just weird to use undocumented repos
#
org.ops4j.pax.url.mvn.useFallbackRepositories=false

#
# Uncomment if you don't wanna use the proxy settings
# from the Maven conf/settings.xml file
#
# org.ops4j.pax.url.mvn.proxySupport=false

#
# Comma separated list of repositories scanned when resolving an artifact.
# Those repositories will be checked before iterating through the
#    below list of repositories and even before the local repository
# A repository url can be appended with zero or more of the following flags:
#    @snapshots  : the repository contains snaphots
#    @noreleases : the repository does not contain any released artifacts
#
# The following property value will add the system folder as a repo.
#
org.ops4j.pax.url.mvn.defaultRepositories=\
    file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\
    file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\
    file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots

# Use the default local repo (e.g.~/.m2/repository) as a "remote" repo
#org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false

#
# Comma separated list of repositories scanned when resolving an artifact.
# The default list includes the following repositories:
#    http://repo1.maven.org/maven2@id=central
#    http://repository.springsource.com/maven/bundles/release@id=spring.ebr
#    http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external
#    http://zodiac.springsource.com/maven/bundles/release@id=gemini
#    http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases
#    https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases
#    https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
# To add repositories to the default ones, prepend '+' to the list of repositories
# to add.
# A repository url can be appended with zero or more of the following flags:
#    @snapshots  : the repository contains snapshots
#    @noreleases : the repository does not contain any released artifacts
#    @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended
#
org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases

### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.Configuring the startup features...
+ [[ True == \T\r\u\e ]]
+ echo 'Configuring the startup features...'
+ sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.20.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
+ FEATURE_TEST_STRING=features-test
+ FEATURE_TEST_VERSION=0.20.0-SNAPSHOT
+ KARAF_VERSION=karaf4
+ [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]]
+ sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.20.0-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.20.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
+ [[ ! -z '' ]]
+ cat /tmp/karaf-0.20.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
################################################################################
#
#    Licensed to the Apache Software Foundation (ASF) under one or more
#    contributor license agreements.  See the NOTICE file distributed with
#    this work for additional information regarding copyright ownership.
#    The ASF licenses this file to You under the Apache License, Version 2.0
#    (the "License"); you may not use this file except in compliance with
#    the License.  You may obtain a copy of the License at
#
#       http://www.apache.org/licenses/LICENSE-2.0
#
#    Unless required by applicable law or agreed to in writing, software
#    distributed under the License is distributed on an "AS IS" BASIS,
#    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
#    See the License for the specific language governing permissions and
#    limitations under the License.
#
################################################################################

#
# Comma separated list of features repositories to register by default
#
featuresRepositories = mvn:org.opendaylight.integration/features-test/0.20.0-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/ca543f94-b763-48a9-8aa4-6f5379359e80.xml

#
# Comma separated list of features to install at startup
#
featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, 4aa7544c-afb6-453b-8a90-e6b511b1a6c8

#
# Resource repositories (OBR) that the features resolver can use
# to resolve requirements/capabilities
#
# The format of the resourceRepositories is 
# resourceRepositories=[xml:url|json:url],...
# for Instance:
#
#resourceRepositories=xml:http://host/path/to/index.xml
# or
#resourceRepositories=json:http://host/path/to/index.json
#

#
# Defines if the boot features are started in asynchronous mode (in a dedicated thread)
#
featuresBootAsynchronous=false

#
# Service requirements enforcement
#
# By default, the feature resolver checks the service requirements/capabilities of
# bundles for new features (xml schema >= 1.3.0) in order to automatically installs
# the required bundles.
# The following flag can have those values:
#   - disable: service requirements are completely ignored
#   - default: service requirements are ignored for old features
#   - enforce: service requirements are always verified
#
#serviceRequirements=default

#
# Store cfg file for config element in feature
#
#configCfgStore=true

#
# Define if the feature service automatically refresh bundles
#
autoRefresh=true

#
# Configuration of features processing mechanism (overrides, blacklisting, modification of features)
# XML file defines instructions related to features processing
# versions.properties may declare properties to resolve placeholders in XML file
# both files are relative to ${karaf.etc}
#
#featureProcessing=org.apache.karaf.features.xml
#featureProcessingVersions=versions.properties
+ configure_karaf_log karaf4 ''
+ local -r karaf_version=karaf4
+ local -r controllerdebugmap=
+ local logapi=log4j
+ grep log4j2 /tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
log4j2.rootLogger.level = INFO
#log4j2.rootLogger.type = asyncRoot
#log4j2.rootLogger.includeLocation = false
log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
log4j2.rootLogger.appenderRef.Console.ref = Console
log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
log4j2.logger.spifly.name = org.apache.aries.spifly
log4j2.logger.spifly.level = WARN
log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
log4j2.logger.audit.level = INFO
log4j2.logger.audit.additivity = false
log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
# Console appender not used by default (see log4j2.rootLogger.appenderRefs)
log4j2.appender.console.type = Console
log4j2.appender.console.name = Console
log4j2.appender.console.layout.type = PatternLayout
log4j2.appender.console.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.type = RollingRandomAccessFile
log4j2.appender.rolling.name = RollingFile
log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
#log4j2.appender.rolling.immediateFlush = false
log4j2.appender.rolling.append = true
log4j2.appender.rolling.layout.type = PatternLayout
log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.policies.type = Policies
log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.rolling.policies.size.size = 64MB
log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
log4j2.appender.rolling.strategy.max = 7
log4j2.appender.audit.type = RollingRandomAccessFile
log4j2.appender.audit.name = AuditRollingFile
log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
log4j2.appender.audit.append = true
log4j2.appender.audit.layout.type = PatternLayout
log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
log4j2.appender.audit.policies.type = Policies
log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.audit.policies.size.size = 8MB
log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
log4j2.appender.audit.strategy.max = 7
log4j2.appender.osgi.type = PaxOsgi
log4j2.appender.osgi.name = PaxOsgi
log4j2.appender.osgi.filter = *
#log4j2.logger.aether.name = shaded.org.eclipse.aether
#log4j2.logger.aether.level = TRACE
#log4j2.logger.http-headers.name = shaded.org.apache.http.headers
#log4j2.logger.http-headers.level = DEBUG
#log4j2.logger.maven.name = org.ops4j.pax.url.mvn
#log4j2.logger.maven.level = TRACE
+ logapi=log4j2
+ echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2'
Configuring the karaf log... karaf_version: karaf4, logapi: log4j2
+ '[' log4j2 == log4j2 ']'
+ sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
+ orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver
+ orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver
+ echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN'
controllerdebugmap: 
cat /tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
+ echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN'
+ unset IFS
+ echo 'controllerdebugmap: '
+ '[' -n '' ']'
+ echo 'cat /tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg'
+ cat /tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
################################################################################
#
#    Licensed to the Apache Software Foundation (ASF) under one or more
#    contributor license agreements.  See the NOTICE file distributed with
#    this work for additional information regarding copyright ownership.
#    The ASF licenses this file to You under the Apache License, Version 2.0
#    (the "License"); you may not use this file except in compliance with
#    the License.  You may obtain a copy of the License at
#
#       http://www.apache.org/licenses/LICENSE-2.0
#
#    Unless required by applicable law or agreed to in writing, software
#    distributed under the License is distributed on an "AS IS" BASIS,
#    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
#    See the License for the specific language governing permissions and
#    limitations under the License.
#
################################################################################

# Common pattern layout for appenders
log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n

# Root logger
log4j2.rootLogger.level = INFO
# uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library
#log4j2.rootLogger.type = asyncRoot
#log4j2.rootLogger.includeLocation = false
log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
log4j2.rootLogger.appenderRef.Console.ref = Console
log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}

# Filters for logs marked by org.opendaylight.odlparent.Markers
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL

# Loggers configuration

# Spifly logger
log4j2.logger.spifly.name = org.apache.aries.spifly
log4j2.logger.spifly.level = WARN

# Security audit logger
log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
log4j2.logger.audit.level = INFO
log4j2.logger.audit.additivity = false
log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile

# Appenders configuration

# Console appender not used by default (see log4j2.rootLogger.appenderRefs)
log4j2.appender.console.type = Console
log4j2.appender.console.name = Console
log4j2.appender.console.layout.type = PatternLayout
log4j2.appender.console.layout.pattern = ${log4j2.pattern}

# Rolling file appender
log4j2.appender.rolling.type = RollingRandomAccessFile
log4j2.appender.rolling.name = RollingFile
log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
# uncomment to not force a disk flush
#log4j2.appender.rolling.immediateFlush = false
log4j2.appender.rolling.append = true
log4j2.appender.rolling.layout.type = PatternLayout
log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.policies.type = Policies
log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.rolling.policies.size.size = 1GB
log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
log4j2.appender.rolling.strategy.max = 7

# Audit file appender
log4j2.appender.audit.type = RollingRandomAccessFile
log4j2.appender.audit.name = AuditRollingFile
log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
log4j2.appender.audit.append = true
log4j2.appender.audit.layout.type = PatternLayout
log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
log4j2.appender.audit.policies.type = Policies
log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.audit.policies.size.size = 8MB
log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
log4j2.appender.audit.strategy.max = 7

# OSGi appender
log4j2.appender.osgi.type = PaxOsgi
log4j2.appender.osgi.name = PaxOsgi
log4j2.appender.osgi.filter = *

# help with identification of maven-related problems with pax-url-aether
#log4j2.logger.aether.name = shaded.org.eclipse.aether
#log4j2.logger.aether.level = TRACE
#log4j2.logger.http-headers.name = shaded.org.apache.http.headers
#log4j2.logger.http-headers.level = DEBUG
#log4j2.logger.maven.name = org.ops4j.pax.url.mvn
#log4j2.logger.maven.level = TRACE
log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN
log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN
+ set_java_vars /usr/lib/jvm/java-17-openjdk 3072m /tmp/karaf-0.20.0-SNAPSHOT/bin/setenv
Configure
    java home: /usr/lib/jvm/java-17-openjdk
    max memory: 3072m
+ local -r java_home=/usr/lib/jvm/java-17-openjdk
+ local -r controllermem=3072m
+ local -r memconf=/tmp/karaf-0.20.0-SNAPSHOT/bin/setenv
+ echo Configure
+ echo '    java home: /usr/lib/jvm/java-17-openjdk'
+ echo '    max memory: 3072m'
    memconf: /tmp/karaf-0.20.0-SNAPSHOT/bin/setenv
+ echo '    memconf: /tmp/karaf-0.20.0-SNAPSHOT/bin/setenv'
+ sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk}%g' /tmp/karaf-0.20.0-SNAPSHOT/bin/setenv
+ sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.20.0-SNAPSHOT/bin/setenv
cat /tmp/karaf-0.20.0-SNAPSHOT/bin/setenv
+ echo 'cat /tmp/karaf-0.20.0-SNAPSHOT/bin/setenv'
+ cat /tmp/karaf-0.20.0-SNAPSHOT/bin/setenv
#!/bin/sh
#
#    Licensed to the Apache Software Foundation (ASF) under one or more
#    contributor license agreements.  See the NOTICE file distributed with
#    this work for additional information regarding copyright ownership.
#    The ASF licenses this file to You under the Apache License, Version 2.0
#    (the "License"); you may not use this file except in compliance with
#    the License.  You may obtain a copy of the License at
#
#       http://www.apache.org/licenses/LICENSE-2.0
#
#    Unless required by applicable law or agreed to in writing, software
#    distributed under the License is distributed on an "AS IS" BASIS,
#    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
#    See the License for the specific language governing permissions and
#    limitations under the License.
#

#
# handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf
# script: client, instance, shell, start, status, stop, karaf
#
# if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then
#   Actions go here...
# fi

#
# general settings which should be applied for all scripts go here; please keep
# in mind that it is possible that scripts might be executed more than once, e.g.
# in example of the start script where the start script is executed first and the
# karaf script afterwards.
#

#
# The following section shows the possible configuration options for the default 
# karaf scripts
#
export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk} # Location of Java installation
# export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration
# export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options
# export EXTRA_JAVA_OPTS # Additional JVM options
# export KARAF_HOME # Karaf home folder
# export KARAF_DATA # Karaf data folder
# export KARAF_BASE # Karaf base folder
# export KARAF_ETC  # Karaf etc  folder
# export KARAF_LOG  # Karaf log  folder
# export KARAF_SYSTEM_OPTS # First citizen Karaf options
# export KARAF_OPTS # Additional available Karaf options
# export KARAF_DEBUG # Enable debug mode
# export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start
# export KARAF_NOROOT # Prevent execution as root if set to true
Set Java version
+ echo 'Set Java version'
+ sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-17-openjdk/bin/java 1
+ sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-17-openjdk/bin/java
JDK default version ...
+ echo 'JDK default version ...'
+ java -version
openjdk version "17.0.6-ea" 2023-01-17 LTS
OpenJDK Runtime Environment (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS)
OpenJDK 64-Bit Server VM (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS, mixed mode, sharing)
Set JAVA_HOME
+ echo 'Set JAVA_HOME'
+ export JAVA_HOME=/usr/lib/jvm/java-17-openjdk
+ JAVA_HOME=/usr/lib/jvm/java-17-openjdk
++ readlink -e /usr/lib/jvm/java-17-openjdk/bin/java
Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java
+ JAVA_RESOLVED=/usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java
+ echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java'
Listing all open ports on controller system...
+ echo 'Listing all open ports on controller system...'
+ netstat -pnatu
(Not all processes could be identified, non-owned process info
 will not be shown, you would have to be root to see it all.)
Active Internet connections (servers and established)
Proto Recv-Q Send-Q Local Address           Foreign Address         State       PID/Program name    
tcp        0      0 0.0.0.0:22              0.0.0.0:*               LISTEN      -                   
tcp        0      0 0.0.0.0:111             0.0.0.0:*               LISTEN      -                   
tcp        0    164 10.30.171.233:22        10.30.171.214:45762     ESTABLISHED -                   
tcp        0      0 10.30.171.233:47000     199.204.45.87:443       TIME_WAIT   -                   
tcp6       0      0 :::22                   :::*                    LISTEN      -                   
tcp6       0      0 :::111                  :::*                    LISTEN      -                   
tcp6       0      0 :::5555                 :::*                    LISTEN      -                   
udp        0      0 10.30.171.233:68        10.30.170.2:67          ESTABLISHED -                   
udp        0      0 0.0.0.0:111             0.0.0.0:*                           -                   
udp        0      0 127.0.0.1:323           0.0.0.0:*                           -                   
udp6       0      0 :::111                  :::*                                -                   
udp6       0      0 ::1:323                 :::*                                -                   
+ '[' -f /tmp/custom_shard_config.txt ']'
+ echo 'Custom shard config exists!!!'
Custom shard config exists!!!
Copying the shard config...
+ echo 'Copying the shard config...'
+ cp /tmp/custom_shard_config.txt /tmp/karaf-0.20.0-SNAPSHOT/bin/
Configuring cluster
+ echo 'Configuring cluster'
+ /tmp/karaf-0.20.0-SNAPSHOT/bin/configure_cluster.sh 2 10.30.171.213 10.30.171.233 10.30.170.172
################################################
##             Configure Cluster              ##
################################################
 NOTE: Cluster configuration files not found. Copying from
 /tmp/karaf-0.20.0-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/9.0.2
Configuring unique name in akka.conf
Configuring hostname in akka.conf
Configuring data and rpc seed nodes in akka.conf
modules = [
	
	{
		name = "inventory"
		namespace = "urn:opendaylight:inventory"
		shard-strategy = "module"
	},
	{
		name = "topology"
		namespace = "urn:TBD:params:xml:ns:yang:network-topology"
		shard-strategy = "module"
	},
	{
		name = "toaster"
		namespace = "http://netconfcentral.org/ns/toaster"
		shard-strategy = "module"
	},
	{
		name = "car"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
		shard-strategy = "module"
	},
	{
		name = "people"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
		shard-strategy = "module"
	},
	{
		name = "car-people"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
		shard-strategy = "module"
	}
]
Configuring replication type in module-shards.conf
################################################
##   NOTE: Manually restart controller to     ##
##         apply configuration.               ##
################################################
Dump akka.conf
+ echo 'Dump akka.conf'
+ cat /tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/akka.conf

odl-cluster-data {
  akka {
    remote {
      artery {
        enabled = on
        transport = tcp
        canonical.hostname = "10.30.171.233"
        canonical.port = 2550
      }
    }

    cluster {
      # Using artery.
      seed-nodes = ["akka://opendaylight-cluster-data@10.30.171.213:2550",
				"akka://opendaylight-cluster-data@10.30.171.233:2550",
				"akka://opendaylight-cluster-data@10.30.170.172:2550"]

      roles = ["member-2"]

      # when under load we might trip a false positive on the failure detector
      # failure-detector {
        # heartbeat-interval = 4 s
        # acceptable-heartbeat-pause = 16s
      # }
    }

    persistence {
      # By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by
      # modifying the following two properties. The directory location specified may be a relative or absolute path. 
      # The relative path is always relative to KARAF_HOME.

      # snapshot-store.local.dir = "target/snapshots"

      # Use lz4 compression for LocalSnapshotStore snapshots
      snapshot-store.local.use-lz4-compression = false
      # Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB
      snapshot-store.local.lz4-blocksize = 256KB
    }
    disable-default-actor-system-quarantined-event-handling = "false"
  }
}
Dump modules.conf
+ echo 'Dump modules.conf'
+ cat /tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/modules.conf
modules = [
	
	{
		name = "inventory"
		namespace = "urn:opendaylight:inventory"
		shard-strategy = "module"
	},
	{
		name = "topology"
		namespace = "urn:TBD:params:xml:ns:yang:network-topology"
		shard-strategy = "module"
	},
	{
		name = "toaster"
		namespace = "http://netconfcentral.org/ns/toaster"
		shard-strategy = "module"
	},
	{
		name = "car"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
		shard-strategy = "module"
	},
	{
		name = "people"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
		shard-strategy = "module"
	},
	{
		name = "car-people"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
		shard-strategy = "module"
	}
]
Dump module-shards.conf
+ echo 'Dump module-shards.conf'
+ cat /tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/module-shards.conf
module-shards = [
	{
		name = "default"
		shards = [
			{
				name = "default"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "inventory"
		shards = [
			{
				name="inventory"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "topology"
		shards = [
			{
				name="topology"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "toaster"
		shards = [
			{
				name="toaster"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "car"
		shards = [
			{
				name="car"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "people"
		shards = [
			{
				name="people"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "car-people"
		shards = [
			{
				name="car-people"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	}
]
Configuring member-3 with IP address 10.30.170.172
Warning: Permanently added '10.30.170.172' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.170.172' (ECDSA) to the list of known hosts.
+ source /tmp/common-functions.sh karaf-0.20.0-SNAPSHOT
common-functions.sh is being sourced
++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]]
++ echo 'common-functions.sh is being sourced'
++ BUNDLEFOLDER=karaf-0.20.0-SNAPSHOT
++ export MAVENCONF=/tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
++ MAVENCONF=/tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
++ export FEATURESCONF=/tmp/karaf-0.20.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
++ FEATURESCONF=/tmp/karaf-0.20.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
++ export CUSTOMPROP=/tmp/karaf-0.20.0-SNAPSHOT/etc/custom.properties
++ CUSTOMPROP=/tmp/karaf-0.20.0-SNAPSHOT/etc/custom.properties
++ export LOGCONF=/tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
++ LOGCONF=/tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
++ export MEMCONF=/tmp/karaf-0.20.0-SNAPSHOT/bin/setenv
++ MEMCONF=/tmp/karaf-0.20.0-SNAPSHOT/bin/setenv
++ export CONTROLLERMEM=
++ CONTROLLERMEM=
++ export AKKACONF=/tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/akka.conf
++ AKKACONF=/tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/akka.conf
++ export MODULESCONF=/tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/modules.conf
++ MODULESCONF=/tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/modules.conf
++ export MODULESHARDSCONF=/tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/module-shards.conf
++ MODULESHARDSCONF=/tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/module-shards.conf
++ print_common_env
++ cat
common-functions environment:
MAVENCONF: /tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
ACTUALFEATURES: 
FEATURESCONF: /tmp/karaf-0.20.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
CUSTOMPROP: /tmp/karaf-0.20.0-SNAPSHOT/etc/custom.properties
LOGCONF: /tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
MEMCONF: /tmp/karaf-0.20.0-SNAPSHOT/bin/setenv
CONTROLLERMEM: 
AKKACONF: /tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/akka.conf
MODULESCONF: /tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/modules.conf
MODULESHARDSCONF: /tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/module-shards.conf
SUITES: 

++ SSH='ssh -t -t'
++ extra_services_cntl='     dnsmasq.service     httpd.service     libvirtd.service     openvswitch.service     ovs-vswitchd.service     ovsdb-server.service     rabbitmq-server.service '
++ extra_services_cmp='     libvirtd.service     openvswitch.service     ovs-vswitchd.service     ovsdb-server.service '
Changing to /tmp
Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.0-SNAPSHOT/karaf-0.20.0-20240406.205840-97.zip
+ echo 'Changing to /tmp'
+ cd /tmp
+ echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.0-SNAPSHOT/karaf-0.20.0-20240406.205840-97.zip'
+ wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.0-SNAPSHOT/karaf-0.20.0-20240406.205840-97.zip
--2024-04-06 23:40:17--  https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.0-SNAPSHOT/karaf-0.20.0-20240406.205840-97.zip
Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6
Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 290573781 (277M) [application/zip]
Saving to: ‘karaf-0.20.0-20240406.205840-97.zip’

     0K ........ ........ ........ ........ ........ ........  1% 26.3M 10s
  3072K ........ ........ ........ ........ ........ ........  2% 39.1M 9s
  6144K ........ ........ ........ ........ ........ ........  3% 45.6M 8s
  9216K ........ ........ ........ ........ ........ ........  4%  148M 6s
 12288K ........ ........ ........ ........ ........ ........  5%  162M 5s
 15360K ........ ........ ........ ........ ........ ........  6%  159M 5s
 18432K ........ ........ ........ ........ ........ ........  7%  221M 4s
 21504K ........ ........ ........ ........ ........ ........  8%  197M 4s
 24576K ........ ........ ........ ........ ........ ........  9%  217M 3s
 27648K ........ ........ ........ ........ ........ ........ 10%  244M 3s
 30720K ........ ........ ........ ........ ........ ........ 11%  311M 3s
 33792K ........ ........ ........ ........ ........ ........ 12%  274M 3s
 36864K ........ ........ ........ ........ ........ ........ 14%  285M 2s
 39936K ........ ........ ........ ........ ........ ........ 15%  261M 2s
 43008K ........ ........ ........ ........ ........ ........ 16%  306M 2s
 46080K ........ ........ ........ ........ ........ ........ 17%  306M 2s
 49152K ........ ........ ........ ........ ........ ........ 18%  301M 2s
 52224K ........ ........ ........ ........ ........ ........ 19%  314M 2s
 55296K ........ ........ ........ ........ ........ ........ 20%  291M 2s
 58368K ........ ........ ........ ........ ........ ........ 21%  318M 2s
 61440K ........ ........ ........ ........ ........ ........ 22%  307M 2s
 64512K ........ ........ ........ ........ ........ ........ 23%  303M 2s
 67584K ........ ........ ........ ........ ........ ........ 24%  298M 2s
 70656K ........ ........ ........ ........ ........ ........ 25%  316M 1s
 73728K ........ ........ ........ ........ ........ ........ 27%  306M 1s
 76800K ........ ........ ........ ........ ........ ........ 28%  300M 1s
 79872K ........ ........ ........ ........ ........ ........ 29%  291M 1s
 82944K ........ ........ ........ ........ ........ ........ 30%  300M 1s
 86016K ........ ........ ........ ........ ........ ........ 31%  288M 1s
 89088K ........ ........ ........ ........ ........ ........ 32%  298M 1s
 92160K ........ ........ ........ ........ ........ ........ 33%  286M 1s
 95232K ........ ........ ........ ........ ........ ........ 34%  309M 1s
 98304K ........ ........ ........ ........ ........ ........ 35%  311M 1s
101376K ........ ........ ........ ........ ........ ........ 36%  304M 1s
104448K ........ ........ ........ ........ ........ ........ 37%  302M 1s
107520K ........ ........ ........ ........ ........ ........ 38%  304M 1s
110592K ........ ........ ........ ........ ........ ........ 40%  311M 1s
113664K ........ ........ ........ ........ ........ ........ 41%  299M 1s
116736K ........ ........ ........ ........ ........ ........ 42%  295M 1s
119808K ........ ........ ........ ........ ........ ........ 43%  316M 1s
122880K ........ ........ ........ ........ ........ ........ 44%  255M 1s
125952K ........ ........ ........ ........ ........ ........ 45%  157M 1s
129024K ........ ........ ........ ........ ........ ........ 46%  300M 1s
132096K ........ ........ ........ ........ ........ ........ 47%  356M 1s
135168K ........ ........ ........ ........ ........ ........ 48%  355M 1s
138240K ........ ........ ........ ........ ........ ........ 49%  374M 1s
141312K ........ ........ ........ ........ ........ ........ 50%  316M 1s
144384K ........ ........ ........ ........ ........ ........ 51%  302M 1s
147456K ........ ........ ........ ........ ........ ........ 53%  304M 1s
150528K ........ ........ ........ ........ ........ ........ 54%  309M 1s
153600K ........ ........ ........ ........ ........ ........ 55%  311M 1s
156672K ........ ........ ........ ........ ........ ........ 56%  290M 1s
159744K ........ ........ ........ ........ ........ ........ 57%  279M 1s
162816K ........ ........ ........ ........ ........ ........ 58%  306M 1s
165888K ........ ........ ........ ........ ........ ........ 59%  289M 1s
168960K ........ ........ ........ ........ ........ ........ 60%  285M 1s
172032K ........ ........ ........ ........ ........ ........ 61%  289M 1s
175104K ........ ........ ........ ........ ........ ........ 62%  291M 1s
178176K ........ ........ ........ ........ ........ ........ 63%  302M 0s
181248K ........ ........ ........ ........ ........ ........ 64%  303M 0s
184320K ........ ........ ........ ........ ........ ........ 66%  302M 0s
187392K ........ ........ ........ ........ ........ ........ 67%  300M 0s
190464K ........ ........ ........ ........ ........ ........ 68%  300M 0s
193536K ........ ........ ........ ........ ........ ........ 69%  270M 0s
196608K ........ ........ ........ ........ ........ ........ 70%  330M 0s
199680K ........ ........ ........ ........ ........ ........ 71%  307M 0s
202752K ........ ........ ........ ........ ........ ........ 72%  303M 0s
205824K ........ ........ ........ ........ ........ ........ 73%  287M 0s
208896K ........ ........ ........ ........ ........ ........ 74%  292M 0s
211968K ........ ........ ........ ........ ........ ........ 75%  299M 0s
215040K ........ ........ ........ ........ ........ ........ 76%  304M 0s
218112K ........ ........ ........ ........ ........ ........ 77%  247M 0s
221184K ........ ........ ........ ........ ........ ........ 79%  262M 0s
224256K ........ ........ ........ ........ ........ ........ 80%  383M 0s
227328K ........ ........ ........ ........ ........ ........ 81%  328M 0s
230400K ........ ........ ........ ........ ........ ........ 82%  306M 0s
233472K ........ ........ ........ ........ ........ ........ 83%  305M 0s
236544K ........ ........ ........ ........ ........ ........ 84%  312M 0s
239616K ........ ........ ........ ........ ........ ........ 85%  282M 0s
242688K ........ ........ ........ ........ ........ ........ 86%  272M 0s
245760K ........ ........ ........ ........ ........ ........ 87%  287M 0s
248832K ........ ........ ........ ........ ........ ........ 88%  332M 0s
251904K ........ ........ ........ ........ ........ ........ 89%  302M 0s
254976K ........ ........ ........ ........ ........ ........ 90%  307M 0s
258048K ........ ........ ........ ........ ........ ........ 92%  295M 0s
261120K ........ ........ ........ ........ ........ ........ 93%  311M 0s
264192K ........ ........ ........ ........ ........ ........ 94%  310M 0s
267264K ........ ........ ........ ........ ........ ........ 95%  310M 0s
270336K ........ ........ ........ ........ ........ ........ 96%  282M 0s
273408K ........ ........ ........ ........ ........ ........ 97%  311M 0s
276480K ........ ........ ........ ........ ........ ........ 98%  295M 0s
279552K ........ ........ ........ ........ ........ ........ 99%  305M 0s
282624K ........ ........ .                                  100%  320M=1.2s

2024-04-06 23:40:18 (231 MB/s) - ‘karaf-0.20.0-20240406.205840-97.zip’ saved [290573781/290573781]

Extracting the new controller...
+ echo 'Extracting the new controller...'
+ unzip -q karaf-0.20.0-20240406.205840-97.zip
Adding external repositories...
+ echo 'Adding external repositories...'
+ sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
+ cat /tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
################################################################################
#
#    Licensed to the Apache Software Foundation (ASF) under one or more
#    contributor license agreements.  See the NOTICE file distributed with
#    this work for additional information regarding copyright ownership.
#    The ASF licenses this file to You under the Apache License, Version 2.0
#    (the "License"); you may not use this file except in compliance with
#    the License.  You may obtain a copy of the License at
#
#       http://www.apache.org/licenses/LICENSE-2.0
#
#    Unless required by applicable law or agreed to in writing, software
#    distributed under the License is distributed on an "AS IS" BASIS,
#    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
#    See the License for the specific language governing permissions and
#    limitations under the License.
#
################################################################################

#
# If set to true, the following property will not allow any certificate to be used
# when accessing Maven repositories through SSL
#
#org.ops4j.pax.url.mvn.certificateCheck=

#
# Path to the local Maven settings file.
# The repositories defined in this file will be automatically added to the list
# of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property
# below is not set.
# The following locations are checked for the existence of the settings.xml file
#   * 1. looks for the specified url
#   * 2. if not found looks for ${user.home}/.m2/settings.xml
#   * 3. if not found looks for ${maven.home}/conf/settings.xml
#   * 4. if not found looks for ${M2_HOME}/conf/settings.xml
#
#org.ops4j.pax.url.mvn.settings=

#
# Path to the local Maven repository which is used to avoid downloading
# artifacts when they already exist locally.
# The value of this property will be extracted from the settings.xml file
# above, or defaulted to:
#     System.getProperty( "user.home" ) + "/.m2/repository"
#
org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository}

#
# Default this to false. It's just weird to use undocumented repos
#
org.ops4j.pax.url.mvn.useFallbackRepositories=false

#
# Uncomment if you don't wanna use the proxy settings
# from the Maven conf/settings.xml file
#
# org.ops4j.pax.url.mvn.proxySupport=false

#
# Comma separated list of repositories scanned when resolving an artifact.
# Those repositories will be checked before iterating through the
#    below list of repositories and even before the local repository
# A repository url can be appended with zero or more of the following flags:
#    @snapshots  : the repository contains snaphots
#    @noreleases : the repository does not contain any released artifacts
#
# The following property value will add the system folder as a repo.
#
org.ops4j.pax.url.mvn.defaultRepositories=\
    file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\
    file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\
    file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots

# Use the default local repo (e.g.~/.m2/repository) as a "remote" repo
#org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false

#
# Comma separated list of repositories scanned when resolving an artifact.
# The default list includes the following repositories:
#    http://repo1.maven.org/maven2@id=central
#    http://repository.springsource.com/maven/bundles/release@id=spring.ebr
#    http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external
#    http://zodiac.springsource.com/maven/bundles/release@id=gemini
#    http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases
#    https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases
#    https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
# To add repositories to the default ones, prepend '+' to the list of repositories
# to add.
# A repository url can be appended with zero or more of the following flags:
#    @snapshots  : the repository contains snapshots
#    @noreleases : the repository does not contain any released artifacts
#    @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended
#
org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases

### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.Configuring the startup features...
+ [[ True == \T\r\u\e ]]
+ echo 'Configuring the startup features...'
+ sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.20.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
+ FEATURE_TEST_STRING=features-test
+ FEATURE_TEST_VERSION=0.20.0-SNAPSHOT
+ KARAF_VERSION=karaf4
+ [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]]
+ sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.20.0-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.20.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
+ [[ ! -z '' ]]
+ cat /tmp/karaf-0.20.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
################################################################################
#
#    Licensed to the Apache Software Foundation (ASF) under one or more
#    contributor license agreements.  See the NOTICE file distributed with
#    this work for additional information regarding copyright ownership.
#    The ASF licenses this file to You under the Apache License, Version 2.0
#    (the "License"); you may not use this file except in compliance with
#    the License.  You may obtain a copy of the License at
#
#       http://www.apache.org/licenses/LICENSE-2.0
#
#    Unless required by applicable law or agreed to in writing, software
#    distributed under the License is distributed on an "AS IS" BASIS,
#    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
#    See the License for the specific language governing permissions and
#    limitations under the License.
#
################################################################################

#
# Comma separated list of features repositories to register by default
#
featuresRepositories = mvn:org.opendaylight.integration/features-test/0.20.0-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/ca543f94-b763-48a9-8aa4-6f5379359e80.xml

#
# Comma separated list of features to install at startup
#
featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, 4aa7544c-afb6-453b-8a90-e6b511b1a6c8

#
# Resource repositories (OBR) that the features resolver can use
# to resolve requirements/capabilities
#
# The format of the resourceRepositories is 
# resourceRepositories=[xml:url|json:url],...
# for Instance:
#
#resourceRepositories=xml:http://host/path/to/index.xml
# or
#resourceRepositories=json:http://host/path/to/index.json
#

#
# Defines if the boot features are started in asynchronous mode (in a dedicated thread)
#
featuresBootAsynchronous=false

#
# Service requirements enforcement
#
# By default, the feature resolver checks the service requirements/capabilities of
# bundles for new features (xml schema >= 1.3.0) in order to automatically installs
# the required bundles.
# The following flag can have those values:
#   - disable: service requirements are completely ignored
#   - default: service requirements are ignored for old features
#   - enforce: service requirements are always verified
#
#serviceRequirements=default

#
# Store cfg file for config element in feature
#
#configCfgStore=true

#
# Define if the feature service automatically refresh bundles
#
autoRefresh=true

#
# Configuration of features processing mechanism (overrides, blacklisting, modification of features)
# XML file defines instructions related to features processing
# versions.properties may declare properties to resolve placeholders in XML file
# both files are relative to ${karaf.etc}
#
#featureProcessing=org.apache.karaf.features.xml
#featureProcessingVersions=versions.properties
+ configure_karaf_log karaf4 ''
+ local -r karaf_version=karaf4
+ local -r controllerdebugmap=
+ local logapi=log4j
+ grep log4j2 /tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
log4j2.rootLogger.level = INFO
#log4j2.rootLogger.type = asyncRoot
#log4j2.rootLogger.includeLocation = false
log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
log4j2.rootLogger.appenderRef.Console.ref = Console
log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
log4j2.logger.spifly.name = org.apache.aries.spifly
log4j2.logger.spifly.level = WARN
log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
log4j2.logger.audit.level = INFO
log4j2.logger.audit.additivity = false
log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
# Console appender not used by default (see log4j2.rootLogger.appenderRefs)
log4j2.appender.console.type = Console
log4j2.appender.console.name = Console
log4j2.appender.console.layout.type = PatternLayout
log4j2.appender.console.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.type = RollingRandomAccessFile
log4j2.appender.rolling.name = RollingFile
log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
#log4j2.appender.rolling.immediateFlush = false
log4j2.appender.rolling.append = true
log4j2.appender.rolling.layout.type = PatternLayout
log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.policies.type = Policies
log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.rolling.policies.size.size = 64MB
log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
log4j2.appender.rolling.strategy.max = 7
log4j2.appender.audit.type = RollingRandomAccessFile
log4j2.appender.audit.name = AuditRollingFile
log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
log4j2.appender.audit.append = true
log4j2.appender.audit.layout.type = PatternLayout
log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
log4j2.appender.audit.policies.type = Policies
log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.audit.policies.size.size = 8MB
log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
log4j2.appender.audit.strategy.max = 7
log4j2.appender.osgi.type = PaxOsgi
log4j2.appender.osgi.name = PaxOsgi
log4j2.appender.osgi.filter = *
#log4j2.logger.aether.name = shaded.org.eclipse.aether
#log4j2.logger.aether.level = TRACE
#log4j2.logger.http-headers.name = shaded.org.apache.http.headers
#log4j2.logger.http-headers.level = DEBUG
#log4j2.logger.maven.name = org.ops4j.pax.url.mvn
#log4j2.logger.maven.level = TRACE
+ logapi=log4j2
Configuring the karaf log... karaf_version: karaf4, logapi: log4j2
+ echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2'
+ '[' log4j2 == log4j2 ']'
+ sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
+ orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver
+ orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver
+ echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN'
+ echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN'
controllerdebugmap: 
+ unset IFS
+ echo 'controllerdebugmap: '
cat /tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
+ '[' -n '' ']'
+ echo 'cat /tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg'
+ cat /tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
################################################################################
#
#    Licensed to the Apache Software Foundation (ASF) under one or more
#    contributor license agreements.  See the NOTICE file distributed with
#    this work for additional information regarding copyright ownership.
#    The ASF licenses this file to You under the Apache License, Version 2.0
#    (the "License"); you may not use this file except in compliance with
#    the License.  You may obtain a copy of the License at
#
#       http://www.apache.org/licenses/LICENSE-2.0
#
#    Unless required by applicable law or agreed to in writing, software
#    distributed under the License is distributed on an "AS IS" BASIS,
#    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
#    See the License for the specific language governing permissions and
#    limitations under the License.
#
################################################################################

# Common pattern layout for appenders
log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n

# Root logger
log4j2.rootLogger.level = INFO
# uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library
#log4j2.rootLogger.type = asyncRoot
#log4j2.rootLogger.includeLocation = false
log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
log4j2.rootLogger.appenderRef.Console.ref = Console
log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}

# Filters for logs marked by org.opendaylight.odlparent.Markers
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL

# Loggers configuration

# Spifly logger
log4j2.logger.spifly.name = org.apache.aries.spifly
log4j2.logger.spifly.level = WARN

# Security audit logger
log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
log4j2.logger.audit.level = INFO
log4j2.logger.audit.additivity = false
log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile

# Appenders configuration

# Console appender not used by default (see log4j2.rootLogger.appenderRefs)
log4j2.appender.console.type = Console
log4j2.appender.console.name = Console
log4j2.appender.console.layout.type = PatternLayout
log4j2.appender.console.layout.pattern = ${log4j2.pattern}

# Rolling file appender
log4j2.appender.rolling.type = RollingRandomAccessFile
log4j2.appender.rolling.name = RollingFile
log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
# uncomment to not force a disk flush
#log4j2.appender.rolling.immediateFlush = false
log4j2.appender.rolling.append = true
log4j2.appender.rolling.layout.type = PatternLayout
log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.policies.type = Policies
log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.rolling.policies.size.size = 1GB
log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
log4j2.appender.rolling.strategy.max = 7

# Audit file appender
log4j2.appender.audit.type = RollingRandomAccessFile
log4j2.appender.audit.name = AuditRollingFile
log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
log4j2.appender.audit.append = true
log4j2.appender.audit.layout.type = PatternLayout
log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
log4j2.appender.audit.policies.type = Policies
log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.audit.policies.size.size = 8MB
log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
log4j2.appender.audit.strategy.max = 7

# OSGi appender
log4j2.appender.osgi.type = PaxOsgi
log4j2.appender.osgi.name = PaxOsgi
log4j2.appender.osgi.filter = *

# help with identification of maven-related problems with pax-url-aether
#log4j2.logger.aether.name = shaded.org.eclipse.aether
#log4j2.logger.aether.level = TRACE
#log4j2.logger.http-headers.name = shaded.org.apache.http.headers
#log4j2.logger.http-headers.level = DEBUG
#log4j2.logger.maven.name = org.ops4j.pax.url.mvn
#log4j2.logger.maven.level = TRACE
log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN
log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN
+ set_java_vars /usr/lib/jvm/java-17-openjdk 3072m /tmp/karaf-0.20.0-SNAPSHOT/bin/setenv
+ local -r java_home=/usr/lib/jvm/java-17-openjdk
+ local -r controllermem=3072m
+ local -r memconf=/tmp/karaf-0.20.0-SNAPSHOT/bin/setenv
Configure
    java home: /usr/lib/jvm/java-17-openjdk
    max memory: 3072m
    memconf: /tmp/karaf-0.20.0-SNAPSHOT/bin/setenv
+ echo Configure
+ echo '    java home: /usr/lib/jvm/java-17-openjdk'
+ echo '    max memory: 3072m'
+ echo '    memconf: /tmp/karaf-0.20.0-SNAPSHOT/bin/setenv'
+ sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk}%g' /tmp/karaf-0.20.0-SNAPSHOT/bin/setenv
+ sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.20.0-SNAPSHOT/bin/setenv
cat /tmp/karaf-0.20.0-SNAPSHOT/bin/setenv
+ echo 'cat /tmp/karaf-0.20.0-SNAPSHOT/bin/setenv'
+ cat /tmp/karaf-0.20.0-SNAPSHOT/bin/setenv
#!/bin/sh
#
#    Licensed to the Apache Software Foundation (ASF) under one or more
#    contributor license agreements.  See the NOTICE file distributed with
#    this work for additional information regarding copyright ownership.
#    The ASF licenses this file to You under the Apache License, Version 2.0
#    (the "License"); you may not use this file except in compliance with
#    the License.  You may obtain a copy of the License at
#
#       http://www.apache.org/licenses/LICENSE-2.0
#
#    Unless required by applicable law or agreed to in writing, software
#    distributed under the License is distributed on an "AS IS" BASIS,
#    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
#    See the License for the specific language governing permissions and
#    limitations under the License.
#

#
# handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf
# script: client, instance, shell, start, status, stop, karaf
#
# if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then
#   Actions go here...
# fi

#
# general settings which should be applied for all scripts go here; please keep
# in mind that it is possible that scripts might be executed more than once, e.g.
# in example of the start script where the start script is executed first and the
# karaf script afterwards.
#

#
# The following section shows the possible configuration options for the default 
# karaf scripts
#
export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk} # Location of Java installation
# export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration
# export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options
# export EXTRA_JAVA_OPTS # Additional JVM options
# export KARAF_HOME # Karaf home folder
# export KARAF_DATA # Karaf data folder
# export KARAF_BASE # Karaf base folder
# export KARAF_ETC  # Karaf etc  folder
# export KARAF_LOG  # Karaf log  folder
# export KARAF_SYSTEM_OPTS # First citizen Karaf options
# export KARAF_OPTS # Additional available Karaf options
# export KARAF_DEBUG # Enable debug mode
# export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start
# export KARAF_NOROOT # Prevent execution as root if set to true
Set Java version
+ echo 'Set Java version'
+ sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-17-openjdk/bin/java 1
+ sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-17-openjdk/bin/java
JDK default version ...
+ echo 'JDK default version ...'
+ java -version
openjdk version "17.0.6-ea" 2023-01-17 LTS
OpenJDK Runtime Environment (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS)
OpenJDK 64-Bit Server VM (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS, mixed mode, sharing)
Set JAVA_HOME
+ echo 'Set JAVA_HOME'
+ export JAVA_HOME=/usr/lib/jvm/java-17-openjdk
+ JAVA_HOME=/usr/lib/jvm/java-17-openjdk
++ readlink -e /usr/lib/jvm/java-17-openjdk/bin/java
+ JAVA_RESOLVED=/usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java
Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java
Listing all open ports on controller system...
+ echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java'
+ echo 'Listing all open ports on controller system...'
+ netstat -pnatu
(Not all processes could be identified, non-owned process info
 will not be shown, you would have to be root to see it all.)
Active Internet connections (servers and established)
Proto Recv-Q Send-Q Local Address           Foreign Address         State       PID/Program name    
tcp        0      0 0.0.0.0:22              0.0.0.0:*               LISTEN      -                   
tcp        0      0 0.0.0.0:111             0.0.0.0:*               LISTEN      -                   
tcp        0      0 10.30.170.172:22        10.30.171.214:50276     ESTABLISHED -                   
tcp        0      0 10.30.170.172:41480     199.204.45.87:443       TIME_WAIT   -                   
tcp6       0      0 :::22                   :::*                    LISTEN      -                   
tcp6       0      0 :::111                  :::*                    LISTEN      -                   
tcp6       0      0 :::5555                 :::*                    LISTEN      -                   
udp        0      0 10.30.170.172:68        10.30.170.4:67          ESTABLISHED -                   
udp        0      0 0.0.0.0:111             0.0.0.0:*                           -                   
udp        0      0 127.0.0.1:323           0.0.0.0:*                           -                   
udp6       0      0 :::111                  :::*                                -                   
udp6       0      0 ::1:323                 :::*                                -                   
+ '[' -f /tmp/custom_shard_config.txt ']'
Custom shard config exists!!!
Copying the shard config...
+ echo 'Custom shard config exists!!!'
+ echo 'Copying the shard config...'
+ cp /tmp/custom_shard_config.txt /tmp/karaf-0.20.0-SNAPSHOT/bin/
Configuring cluster
+ echo 'Configuring cluster'
+ /tmp/karaf-0.20.0-SNAPSHOT/bin/configure_cluster.sh 3 10.30.171.213 10.30.171.233 10.30.170.172
################################################
##             Configure Cluster              ##
################################################
 NOTE: Cluster configuration files not found. Copying from
 /tmp/karaf-0.20.0-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/9.0.2
Configuring unique name in akka.conf
Configuring hostname in akka.conf
Configuring data and rpc seed nodes in akka.conf
modules = [
	
	{
		name = "inventory"
		namespace = "urn:opendaylight:inventory"
		shard-strategy = "module"
	},
	{
		name = "topology"
		namespace = "urn:TBD:params:xml:ns:yang:network-topology"
		shard-strategy = "module"
	},
	{
		name = "toaster"
		namespace = "http://netconfcentral.org/ns/toaster"
		shard-strategy = "module"
	},
	{
		name = "car"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
		shard-strategy = "module"
	},
	{
		name = "people"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
		shard-strategy = "module"
	},
	{
		name = "car-people"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
		shard-strategy = "module"
	}
]
Configuring replication type in module-shards.conf
################################################
##   NOTE: Manually restart controller to     ##
##         apply configuration.               ##
################################################
Dump akka.conf
+ echo 'Dump akka.conf'
+ cat /tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/akka.conf

odl-cluster-data {
  akka {
    remote {
      artery {
        enabled = on
        transport = tcp
        canonical.hostname = "10.30.170.172"
        canonical.port = 2550
      }
    }

    cluster {
      # Using artery.
      seed-nodes = ["akka://opendaylight-cluster-data@10.30.171.213:2550",
				"akka://opendaylight-cluster-data@10.30.171.233:2550",
				"akka://opendaylight-cluster-data@10.30.170.172:2550"]

      roles = ["member-3"]

      # when under load we might trip a false positive on the failure detector
      # failure-detector {
        # heartbeat-interval = 4 s
        # acceptable-heartbeat-pause = 16s
      # }
    }

    persistence {
      # By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by
      # modifying the following two properties. The directory location specified may be a relative or absolute path. 
      # The relative path is always relative to KARAF_HOME.

      # snapshot-store.local.dir = "target/snapshots"

      # Use lz4 compression for LocalSnapshotStore snapshots
      snapshot-store.local.use-lz4-compression = false
      # Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB
      snapshot-store.local.lz4-blocksize = 256KB
    }
    disable-default-actor-system-quarantined-event-handling = "false"
  }
}
Dump modules.conf
+ echo 'Dump modules.conf'
+ cat /tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/modules.conf
modules = [
	
	{
		name = "inventory"
		namespace = "urn:opendaylight:inventory"
		shard-strategy = "module"
	},
	{
		name = "topology"
		namespace = "urn:TBD:params:xml:ns:yang:network-topology"
		shard-strategy = "module"
	},
	{
		name = "toaster"
		namespace = "http://netconfcentral.org/ns/toaster"
		shard-strategy = "module"
	},
	{
		name = "car"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
		shard-strategy = "module"
	},
	{
		name = "people"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
		shard-strategy = "module"
	},
	{
		name = "car-people"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
		shard-strategy = "module"
	}
]
Dump module-shards.conf
+ echo 'Dump module-shards.conf'
+ cat /tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/module-shards.conf
module-shards = [
	{
		name = "default"
		shards = [
			{
				name = "default"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "inventory"
		shards = [
			{
				name="inventory"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "topology"
		shards = [
			{
				name="topology"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "toaster"
		shards = [
			{
				name="toaster"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "car"
		shards = [
			{
				name="car"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "people"
		shards = [
			{
				name="people"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "car-people"
		shards = [
			{
				name="car-people"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	}
]
Locating config plan to use...
Finished running config plans
Starting member-1 with IP address 10.30.171.213
Warning: Permanently added '10.30.171.213' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.171.213' (ECDSA) to the list of known hosts.
Redirecting karaf console output to karaf_console.log
Starting controller...
start: Redirecting Karaf output to /tmp/karaf-0.20.0-SNAPSHOT/data/log/karaf_console.log
Starting member-2 with IP address 10.30.171.233
Warning: Permanently added '10.30.171.233' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.171.233' (ECDSA) to the list of known hosts.
Redirecting karaf console output to karaf_console.log
Starting controller...
start: Redirecting Karaf output to /tmp/karaf-0.20.0-SNAPSHOT/data/log/karaf_console.log
Starting member-3 with IP address 10.30.170.172
Warning: Permanently added '10.30.170.172' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.170.172' (ECDSA) to the list of known hosts.
Redirecting karaf console output to karaf_console.log
Starting controller...
start: Redirecting Karaf output to /tmp/karaf-0.20.0-SNAPSHOT/data/log/karaf_console.log
[controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash /tmp/jenkins5792918391792075842.sh
common-functions.sh is being sourced
common-functions environment:
MAVENCONF: /tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
ACTUALFEATURES: 
FEATURESCONF: /tmp/karaf-0.20.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
CUSTOMPROP: /tmp/karaf-0.20.0-SNAPSHOT/etc/custom.properties
LOGCONF: /tmp/karaf-0.20.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
MEMCONF: /tmp/karaf-0.20.0-SNAPSHOT/bin/setenv
CONTROLLERMEM: 2048m
AKKACONF: /tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/akka.conf
MODULESCONF: /tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/modules.conf
MODULESHARDSCONF: /tmp/karaf-0.20.0-SNAPSHOT/configuration/initial/module-shards.conf
SUITES: 

+ echo '#################################################'
#################################################
+ echo '##         Verify Cluster is UP                ##'
##         Verify Cluster is UP                ##
+ echo '#################################################'
#################################################
+ create_post_startup_script
+ cat
+ copy_and_run_post_startup_script
+ seed_index=1
++ seq 1 3
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_1_IP
+ echo 'Execute the post startup script on controller 10.30.171.213'
Execute the post startup script on controller 10.30.171.213
+ scp /w/workspace/controller-csit-3node-clustering-ask-all-calcium/post-startup-script.sh 10.30.171.213:/tmp/
Warning: Permanently added '10.30.171.213' (ECDSA) to the list of known hosts.
+ ssh 10.30.171.213 'bash /tmp/post-startup-script.sh 1'
Warning: Permanently added '10.30.171.213' (ECDSA) to the list of known hosts.
tcp6       0      0 :::8101                 :::*                    LISTEN     
Waiting up to 3 minutes for controller to come up, checking every 5 seconds...
2024-04-06T23:41:17,683 | INFO  | SystemReadyService-0 | SimpleSystemReadyMonitor         | 300 - org.opendaylight.infrautils.ready-api - 6.0.6 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
Controller is UP
2024-04-06T23:41:17,683 | INFO  | SystemReadyService-0 | SimpleSystemReadyMonitor         | 300 - org.opendaylight.infrautils.ready-api - 6.0.6 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
Listing all open ports on controller system...
(Not all processes could be identified, non-owned process info
 will not be shown, you would have to be root to see it all.)
Active Internet connections (servers and established)
Proto Recv-Q Send-Q Local Address           Foreign Address         State       PID/Program name    
tcp        0      0 0.0.0.0:111             0.0.0.0:*               LISTEN      -                   
tcp        0      0 0.0.0.0:22              0.0.0.0:*               LISTEN      -                   
tcp        0    292 10.30.171.213:22        10.30.171.214:60472     ESTABLISHED -                   
tcp6       0      0 127.0.0.1:44444         :::*                    LISTEN      5751/java           
tcp6       0      0 :::6653                 :::*                    LISTEN      5751/java           
tcp6       0      0 :::4189                 :::*                    LISTEN      5751/java           
tcp6       0      0 :::1790                 :::*                    LISTEN      5751/java           
tcp6       0      0 127.0.0.1:40703         :::*                    LISTEN      5751/java           
tcp6       0      0 :::8101                 :::*                    LISTEN      5751/java           
tcp6       0      0 :::6633                 :::*                    LISTEN      5751/java           
tcp6       0      0 127.0.0.1:1099          :::*                    LISTEN      5751/java           
tcp6       0      0 :::111                  :::*                    LISTEN      -                   
tcp6       0      0 :::6640                 :::*                    LISTEN      5751/java           
tcp6       0      0 :::5555                 :::*                    LISTEN      -                   
tcp6       0      0 :::8181                 :::*                    LISTEN      5751/java           
tcp6       0      0 10.30.171.213:2550      :::*                    LISTEN      5751/java           
tcp6       0      0 :::22                   :::*                    LISTEN      -                   
tcp6       0      0 :::12345                :::*                    LISTEN      5751/java           
tcp6       0      0 127.0.0.1:34836         127.0.0.1:1099          TIME_WAIT   -                   
tcp6       0      0 127.0.0.1:47550         127.0.0.1:44444         TIME_WAIT   -                   
tcp6       0      0 10.30.171.213:2550      10.30.170.172:38252     ESTABLISHED 5751/java           
tcp6       0      0 10.30.171.213:2550      10.30.171.233:45464     ESTABLISHED 5751/java           
tcp6       0      0 10.30.171.213:2550      10.30.170.172:38236     ESTABLISHED 5751/java           
tcp6       0      0 127.0.0.1:47540         127.0.0.1:44444         TIME_WAIT   -                   
tcp6       0      0 10.30.171.213:47810     10.30.171.233:2550      ESTABLISHED 5751/java           
tcp6      32      0 10.30.171.213:39036     199.204.45.87:443       CLOSE_WAIT  5751/java           
tcp6       0      0 10.30.171.213:47814     10.30.171.233:2550      ESTABLISHED 5751/java           
tcp6       0      0 10.30.171.213:2550      10.30.171.233:45448     ESTABLISHED 5751/java           
tcp6       0      0 10.30.171.213:53114     10.30.170.172:2550      ESTABLISHED 5751/java           
tcp6       0      0 10.30.171.213:53112     10.30.170.172:2550      ESTABLISHED 5751/java           
udp        0      0 10.30.171.213:68        10.30.170.2:67          ESTABLISHED -                   
udp        0      0 0.0.0.0:111             0.0.0.0:*                           -                   
udp        0      0 127.0.0.1:323           0.0.0.0:*                           -                   
udp6       0      0 :::4342                 :::*                                5751/java           
udp6       0      0 :::111                  :::*                                -                   
udp6       0      0 ::1:323                 :::*                                -                   
looking for "BindException: Address already in use" in log file
looking for "server is unhealthy" in log file
+ '[' 1 == 0 ']'
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_2_IP
+ echo 'Execute the post startup script on controller 10.30.171.233'
Execute the post startup script on controller 10.30.171.233
+ scp /w/workspace/controller-csit-3node-clustering-ask-all-calcium/post-startup-script.sh 10.30.171.233:/tmp/
Warning: Permanently added '10.30.171.233' (ECDSA) to the list of known hosts.
+ ssh 10.30.171.233 'bash /tmp/post-startup-script.sh 2'
Warning: Permanently added '10.30.171.233' (ECDSA) to the list of known hosts.
tcp6       0      0 :::8101                 :::*                    LISTEN     
Waiting up to 3 minutes for controller to come up, checking every 5 seconds...
2024-04-06T23:41:18,254 | INFO  | SystemReadyService-0 | SimpleSystemReadyMonitor         | 300 - org.opendaylight.infrautils.ready-api - 6.0.6 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
Controller is UP
2024-04-06T23:41:18,254 | INFO  | SystemReadyService-0 | SimpleSystemReadyMonitor         | 300 - org.opendaylight.infrautils.ready-api - 6.0.6 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
Listing all open ports on controller system...
(Not all processes could be identified, non-owned process info
 will not be shown, you would have to be root to see it all.)
Active Internet connections (servers and established)
Proto Recv-Q Send-Q Local Address           Foreign Address         State       PID/Program name    
tcp        0      0 0.0.0.0:22              0.0.0.0:*               LISTEN      -                   
tcp        0      0 0.0.0.0:111             0.0.0.0:*               LISTEN      -                   
tcp        0    164 10.30.171.233:22        10.30.171.214:59200     ESTABLISHED -                   
tcp6       0      0 :::8181                 :::*                    LISTEN      5744/java           
tcp6       0      0 10.30.171.233:2550      :::*                    LISTEN      5744/java           
tcp6       0      0 :::22                   :::*                    LISTEN      -                   
tcp6       0      0 127.0.0.1:39255         :::*                    LISTEN      5744/java           
tcp6       0      0 127.0.0.1:44444         :::*                    LISTEN      5744/java           
tcp6       0      0 :::6653                 :::*                    LISTEN      5744/java           
tcp6       0      0 :::1790                 :::*                    LISTEN      5744/java           
tcp6       0      0 :::8101                 :::*                    LISTEN      5744/java           
tcp6       0      0 :::6633                 :::*                    LISTEN      5744/java           
tcp6       0      0 127.0.0.1:1099          :::*                    LISTEN      5744/java           
tcp6       0      0 :::111                  :::*                    LISTEN      -                   
tcp6       0      0 :::6640                 :::*                    LISTEN      5744/java           
tcp6       0      0 :::5555                 :::*                    LISTEN      -                   
tcp6       0      0 10.30.171.233:2550      10.30.171.213:47810     ESTABLISHED 5744/java           
tcp6       0      0 10.30.171.233:2550      10.30.170.172:45112     ESTABLISHED 5744/java           
tcp6       0      0 10.30.171.233:45448     10.30.171.213:2550      ESTABLISHED 5744/java           
tcp6       0      0 127.0.0.1:59124         127.0.0.1:1099          TIME_WAIT   -                   
tcp6      32      0 10.30.171.233:57440     199.204.45.87:443       CLOSE_WAIT  5744/java           
tcp6       0      0 10.30.171.233:2550      10.30.170.172:45096     ESTABLISHED 5744/java           
tcp6       0      0 127.0.0.1:52278         127.0.0.1:44444         TIME_WAIT   -                   
tcp6       0      0 10.30.171.233:54312     10.30.170.172:2550      ESTABLISHED 5744/java           
tcp6       0      0 127.0.0.1:59140         127.0.0.1:1099          TIME_WAIT   -                   
tcp6       0      0 10.30.171.233:45464     10.30.171.213:2550      ESTABLISHED 5744/java           
tcp6       0      0 127.0.0.1:52290         127.0.0.1:44444         TIME_WAIT   -                   
tcp6       0      0 10.30.171.233:2550      10.30.171.213:47814     ESTABLISHED 5744/java           
tcp6       0      0 10.30.171.233:54320     10.30.170.172:2550      ESTABLISHED 5744/java           
udp        0      0 10.30.171.233:68        10.30.170.2:67          ESTABLISHED -                   
udp        0      0 0.0.0.0:111             0.0.0.0:*                           -                   
udp        0      0 127.0.0.1:323           0.0.0.0:*                           -                   
udp6       0      0 :::111                  :::*                                -                   
udp6       0      0 ::1:323                 :::*                                -                   
udp6       0      0 :::4342                 :::*                                5744/java           
looking for "BindException: Address already in use" in log file
looking for "server is unhealthy" in log file
+ '[' 2 == 0 ']'
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_3_IP
+ echo 'Execute the post startup script on controller 10.30.170.172'
Execute the post startup script on controller 10.30.170.172
+ scp /w/workspace/controller-csit-3node-clustering-ask-all-calcium/post-startup-script.sh 10.30.170.172:/tmp/
Warning: Permanently added '10.30.170.172' (ECDSA) to the list of known hosts.
+ ssh 10.30.170.172 'bash /tmp/post-startup-script.sh 3'
Warning: Permanently added '10.30.170.172' (ECDSA) to the list of known hosts.
tcp6       0      0 :::8101                 :::*                    LISTEN     
Waiting up to 3 minutes for controller to come up, checking every 5 seconds...
2024-04-06T23:41:17,468 | INFO  | SystemReadyService-0 | SimpleSystemReadyMonitor         | 300 - org.opendaylight.infrautils.ready-api - 6.0.6 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
Controller is UP
2024-04-06T23:41:17,468 | INFO  | SystemReadyService-0 | SimpleSystemReadyMonitor         | 300 - org.opendaylight.infrautils.ready-api - 6.0.6 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
Listing all open ports on controller system...
(Not all processes could be identified, non-owned process info
 will not be shown, you would have to be root to see it all.)
Active Internet connections (servers and established)
Proto Recv-Q Send-Q Local Address           Foreign Address         State       PID/Program name    
tcp        0      0 0.0.0.0:22              0.0.0.0:*               LISTEN      -                   
tcp        0      0 0.0.0.0:111             0.0.0.0:*               LISTEN      -                   
tcp        0    164 10.30.170.172:22        10.30.171.214:45244     ESTABLISHED -                   
tcp6       0      0 :::8181                 :::*                    LISTEN      5751/java           
tcp6       0      0 10.30.170.172:2550      :::*                    LISTEN      5751/java           
tcp6       0      0 :::22                   :::*                    LISTEN      -                   
tcp6       0      0 127.0.0.1:44444         :::*                    LISTEN      5751/java           
tcp6       0      0 :::6653                 :::*                    LISTEN      5751/java           
tcp6       0      0 :::1790                 :::*                    LISTEN      5751/java           
tcp6       0      0 :::8101                 :::*                    LISTEN      5751/java           
tcp6       0      0 127.0.0.1:41381         :::*                    LISTEN      5751/java           
tcp6       0      0 :::6633                 :::*                    LISTEN      5751/java           
tcp6       0      0 127.0.0.1:1099          :::*                    LISTEN      5751/java           
tcp6       0      0 :::111                  :::*                    LISTEN      -                   
tcp6       0      0 :::6640                 :::*                    LISTEN      5751/java           
tcp6       0      0 :::5555                 :::*                    LISTEN      -                   
tcp6       0      0 127.0.0.1:55712         127.0.0.1:44444         TIME_WAIT   -                   
tcp6       0      0 127.0.0.1:56286         127.0.0.1:1099          TIME_WAIT   -                   
tcp6       0      0 10.30.170.172:38252     10.30.171.213:2550      ESTABLISHED 5751/java           
tcp6       0      0 10.30.170.172:45112     10.30.171.233:2550      ESTABLISHED 5751/java           
tcp6       0      0 10.30.170.172:2550      10.30.171.233:54312     ESTABLISHED 5751/java           
tcp6       0      0 127.0.0.1:55722         127.0.0.1:44444         TIME_WAIT   -                   
tcp6       0      0 10.30.170.172:2550      10.30.171.233:54320     ESTABLISHED 5751/java           
tcp6       0      0 10.30.170.172:2550      10.30.171.213:53112     ESTABLISHED 5751/java           
tcp6       0      0 10.30.170.172:38236     10.30.171.213:2550      ESTABLISHED 5751/java           
tcp6      32      0 10.30.170.172:36990     199.204.45.87:443       CLOSE_WAIT  5751/java           
tcp6       0      0 10.30.170.172:2550      10.30.171.213:53114     ESTABLISHED 5751/java           
tcp6       0      0 10.30.170.172:45096     10.30.171.233:2550      ESTABLISHED 5751/java           
udp        0      0 10.30.170.172:68        10.30.170.4:67          ESTABLISHED -                   
udp        0      0 0.0.0.0:111             0.0.0.0:*                           -                   
udp        0      0 127.0.0.1:323           0.0.0.0:*                           -                   
udp6       0      0 :::4342                 :::*                                5751/java           
udp6       0      0 :::111                  :::*                                -                   
udp6       0      0 ::1:323                 :::*                                -                   
looking for "BindException: Address already in use" in log file
looking for "server is unhealthy" in log file
+ '[' 0 == 0 ']'
+ seed_index=1
+ dump_controller_threads
++ seq 1 3
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_1_IP
+ echo 'Let'\''s take the karaf thread dump'
Let's take the karaf thread dump
+ ssh 10.30.171.213 'sudo ps aux'
Warning: Permanently added '10.30.171.213' (ECDSA) to the list of known hosts.
++ tr -s ' '
++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-ask-all-calcium/ps_before.log
++ grep -v grep
++ cut -f2 '-d '
+ pid=5751
+ echo 'karaf main: org.apache.karaf.main.Main, pid:5751'
karaf main: org.apache.karaf.main.Main, pid:5751
+ ssh 10.30.171.213 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 5751'
Warning: Permanently added '10.30.171.213' (ECDSA) to the list of known hosts.
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_2_IP
+ echo 'Let'\''s take the karaf thread dump'
Let's take the karaf thread dump
+ ssh 10.30.171.233 'sudo ps aux'
Warning: Permanently added '10.30.171.233' (ECDSA) to the list of known hosts.
++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-ask-all-calcium/ps_before.log
++ cut -f2 '-d '
++ grep -v grep
++ tr -s ' '
+ pid=5744
+ echo 'karaf main: org.apache.karaf.main.Main, pid:5744'
karaf main: org.apache.karaf.main.Main, pid:5744
+ ssh 10.30.171.233 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 5744'
Warning: Permanently added '10.30.171.233' (ECDSA) to the list of known hosts.
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_3_IP
+ echo 'Let'\''s take the karaf thread dump'
Let's take the karaf thread dump
+ ssh 10.30.170.172 'sudo ps aux'
Warning: Permanently added '10.30.170.172' (ECDSA) to the list of known hosts.
++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-ask-all-calcium/ps_before.log
++ grep -v grep
++ tr -s ' '
++ cut -f2 '-d '
+ pid=5751
+ echo 'karaf main: org.apache.karaf.main.Main, pid:5751'
karaf main: org.apache.karaf.main.Main, pid:5751
+ ssh 10.30.170.172 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 5751'
Warning: Permanently added '10.30.170.172' (ECDSA) to the list of known hosts.
+ '[' 0 -gt 0 ']'
+ echo 'Generating controller variables...'
Generating controller variables...
++ seq 1 3
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_1_IP
+ odl_variables=' -v ODL_SYSTEM_1_IP:10.30.171.213'
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_2_IP
+ odl_variables=' -v ODL_SYSTEM_1_IP:10.30.171.213 -v ODL_SYSTEM_2_IP:10.30.171.233'
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_3_IP
+ odl_variables=' -v ODL_SYSTEM_1_IP:10.30.171.213 -v ODL_SYSTEM_2_IP:10.30.171.233 -v ODL_SYSTEM_3_IP:10.30.170.172'
+ echo 'Generating mininet variables...'
Generating mininet variables...
++ seq 1 0
+ get_test_suites SUITES
+ local __suite_list=SUITES
+ echo 'Locating test plan to use...'
Locating test plan to use...
+ testplan_filepath=/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/testplans/controller-clustering-ask-calcium.txt
+ '[' '!' -f /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/testplans/controller-clustering-ask-calcium.txt ']'
+ testplan_filepath=/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/testplans/controller-clustering-ask.txt
+ '[' disabled '!=' disabled ']'
+ echo 'Changing the testplan path...'
Changing the testplan path...
+ sed s:integration:/w/workspace/controller-csit-3node-clustering-ask-all-calcium: /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/testplans/controller-clustering-ask.txt
+ cat testplan.txt
# Place the suites in run order:
/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot
/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence.robot
/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot
/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_partition_and_heal.robot
/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot
/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/action_provider_precedence.robot
/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot
/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/action_provider_partition_and_heal.robot
/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot
/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/master_stability.robot
/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot
/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot
/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot
/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot
/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot
/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_kill.robot
/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot
/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_freeze.robot
/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot
/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_isolate.robot
/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot
/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot
/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot
/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot
/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot
/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot
/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot
/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot
/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot
+ '[' -z '' ']'
++ grep -E -v '(^[[:space:]]*#|^[[:space:]]*$)' testplan.txt
++ tr '\012' ' '
+ suite_list='/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/action_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/action_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_kill.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_freeze.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot '
+ eval 'SUITES='\''/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/action_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/action_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_kill.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_freeze.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot '\'''
++ SUITES='/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/action_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/action_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_kill.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_freeze.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot '
+ echo 'Starting Robot test suites /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/action_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/action_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_kill.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_freeze.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot  ...'
Starting Robot test suites /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/action_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/action_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_kill.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_freeze.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot  ...
+ robot -N controller-clustering-ask.txt --removekeywords wuks -e exclude -e skip_if_calcium -v BUNDLEFOLDER:karaf-0.20.0-SNAPSHOT -v BUNDLE_URL:https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.0-SNAPSHOT/karaf-0.20.0-20240406.205840-97.zip -v CONTROLLER:10.30.171.213 -v CONTROLLER1:10.30.171.233 -v CONTROLLER2:10.30.170.172 -v CONTROLLER_USER:jenkins -v JAVA_HOME:/usr/lib/jvm/java-17-openjdk -v JDKVERSION:openjdk17 -v JENKINS_WORKSPACE:/w/workspace/controller-csit-3node-clustering-ask-all-calcium -v MININET: -v MININET1: -v MININET2: -v MININET_USER:jenkins -v NEXUSURL_PREFIX:https://nexus.opendaylight.org -v NUM_ODL_SYSTEM:3 -v NUM_TOOLS_SYSTEM:0 -v ODL_STREAM:calcium -v ODL_SYSTEM_IP:10.30.171.213 -v ODL_SYSTEM_1_IP:10.30.171.213 -v ODL_SYSTEM_2_IP:10.30.171.233 -v ODL_SYSTEM_3_IP:10.30.170.172 -v ODL_SYSTEM_USER:jenkins -v TOOLS_SYSTEM_IP: -v TOOLS_SYSTEM_USER:jenkins -v USER_HOME:/home/jenkins -v IS_KARAF_APPL:True -v WORKSPACE:/tmp /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/action_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/action_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_kill.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_freeze.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot
==============================================================================
controller-clustering-ask.txt                                                 
==============================================================================
controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te...
==============================================================================
Stop_All_Members :: Stop every odl node.                              | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.233', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-ask.txt.Rpc Provider Precedence :: DOMRpcBroker testi...
==============================================================================
Register_Rpc_On_Each_Node :: Register global rpc on each node of t... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_rpc_provider_precedence_register_rpc_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_precedence_register_rpc_on_each_node&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.171.233', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Invoke_Rpc_On_Each_Node :: Verify that the rpc response comes from... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_rpc_provider_precedence_invoke_rpc_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_precedence_invoke_rpc_on_each_node&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.171.233', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Unregister_Rpc_On_Node :: Unregister the rpc on one of the cluster... | PASS |
------------------------------------------------------------------------------
Invoke_Rpc_On_Node_With_Unregistered_Rpc :: Invoke rcp on the node... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_rpc_provider_precedence_invoke_rpc_on_node_with_unregistered_rpc"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_precedence_invoke_rpc_on_node_with_unregistered_rpc&order=bug_status"

HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/operations/odl-mdsal-lowlevel-target:get-constant
------------------------------------------------------------------------------
Invoke_Rpc_On_Remaining_Nodes :: Verify that the rpc response come... | PASS |
------------------------------------------------------------------------------
Reregister_Rpc_On_Node :: Reregister the rpc.                         | PASS |
------------------------------------------------------------------------------
Invoke_Rpc_On_Each_Node_Again :: Verify that the rpc response come... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_rpc_provider_precedence_invoke_rpc_on_each_node_again"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_precedence_invoke_rpc_on_each_node_again&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.171.233', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Unregister_Rpc_On_Each_Node :: Unregister rpc on every node.          | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_rpc_provider_precedence_unregister_rpc_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_precedence_unregister_rpc_on_each_node&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.171.233', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-ask.txt.Rpc Provider Precedence :: DOMRpcBro... | FAIL |
8 tests, 3 passed, 5 failed
==============================================================================
controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te...
==============================================================================
Stop_All_Members :: Stop every odl node.                              | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.233', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-ask.txt.Rpc Provider Partition And Heal :: DOMRpcBrok...
==============================================================================
Register_Rpc_On_Two_Nodes :: Register rpc on two nodes of the odl ... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_rpc_provider_partition_and_heal_register_rpc_on_two_nodes"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_partition_and_heal_register_rpc_on_two_nodes&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.171.233', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Invoke_Rpc_On_Each_Node :: Invoke get-constant rpc on every node o... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_rpc_provider_partition_and_heal_invoke_rpc_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_partition_and_heal_invoke_rpc_on_each_node&order=bug_status"

Keyword 'Verify_Constant_On_Active_Nodes' failed after retrying for 10 seconds. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.233', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Isolate_One_Node :: Isolate one node with registered rpc. From the... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_rpc_provider_partition_and_heal_isolate_one_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_partition_and_heal_isolate_one_node&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.170.172', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Invoke_Rpc_On_Nonisolated_Nodes :: Invoke rpc on non-islolated nodes. | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_rpc_provider_partition_and_heal_invoke_rpc_on_nonisolated_nodes"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_partition_and_heal_invoke_rpc_on_nonisolated_nodes&order=bug_status"

Keyword 'DrbCommons.Verify_Constant_On_Active_Nodes' failed after retrying for 1 minute. The last error was: Keyword 'Verify_Constant_On_Active_Nodes' failed after retrying for 10 seconds. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.233', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Rejoin_Isolated_Member :: Rejoin isolated node                        | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_rpc_provider_partition_and_heal_rejoin_isolated_member"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_partition_and_heal_rejoin_isolated_member&order=bug_status"

Variable '${isolated_idx}' not found.
------------------------------------------------------------------------------
Invoke_Rpc_On_Each_Node_Again :: Invoke rpc get-constant on every ... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_rpc_provider_partition_and_heal_invoke_rpc_on_each_node_again"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_partition_and_heal_invoke_rpc_on_each_node_again&order=bug_status"

Keyword 'Verify_Constant_On_Active_Nodes' failed after retrying for 10 seconds. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.233', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Unregister_Rpc_On_Each_Node :: Inregister rpc on both nodes.          | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_rpc_provider_partition_and_heal_unregister_rpc_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_partition_and_heal_unregister_rpc_on_each_node&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.171.233', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-ask.txt.Rpc Provider Partition And Heal :: D... | FAIL |
7 tests, 0 passed, 7 failed
==============================================================================
controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te...
==============================================================================
Stop_All_Members :: Stop every odl node.                              | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.233', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-ask.txt.Action Provider Precedence :: DOMRpcBroker te...
==============================================================================
Register_Rpc_On_Each_Node :: Register routed rpc on each node of t... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_action_provider_precedence_register_rpc_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_precedence_register_rpc_on_each_node&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.171.233', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Invoke_Rpc_On_Each_Node :: Verify that the rpc response comes from... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_action_provider_precedence_invoke_rpc_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_precedence_invoke_rpc_on_each_node&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.171.233', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Unregister_Rpc_On_Node :: Unregister the rpc on one of the cluster... | PASS |
------------------------------------------------------------------------------
Invoke_Rpc_On_Node_With_Unregistered_Rpc :: Invoke rcp on the node... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_action_provider_precedence_invoke_rpc_on_node_with_unregistered_rpc"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_precedence_invoke_rpc_on_node_with_unregistered_rpc&order=bug_status"

HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/operations/odl-mdsal-lowlevel-target:get-contexted-constant
------------------------------------------------------------------------------
Invoke_Rpc_On_Remaining_Nodes :: Verify that the rpc response come... | PASS |
------------------------------------------------------------------------------
Reregister_Rpc_On_Node :: Reregister the rpc.                         | PASS |
------------------------------------------------------------------------------
Invoke_Rpc_On_Each_Node_Again :: Verify that the rpc response come... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_action_provider_precedence_invoke_rpc_on_each_node_again"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_precedence_invoke_rpc_on_each_node_again&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.171.233', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Unregister_Rpc_On_Each_Node :: Unregister rpc on every node.          | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_action_provider_precedence_unregister_rpc_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_precedence_unregister_rpc_on_each_node&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.171.233', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-ask.txt.Action Provider Precedence :: DOMRpc... | FAIL |
8 tests, 3 passed, 5 failed
==============================================================================
controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te...
==============================================================================
Stop_All_Members :: Stop every odl node.                              | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.233', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-ask.txt.Action Provider Partition And Heal :: DOMRpcB...
==============================================================================
Register_Rpc_On_Two_Nodes :: Register rpc on two nodes of the odl ... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_action_provider_partition_and_heal_register_rpc_on_two_nodes"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_partition_and_heal_register_rpc_on_two_nodes&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.171.233', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Invoke_Rpc_On_Each_Node :: Invoke get-contexted-constant rpc on ev... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_action_provider_partition_and_heal_invoke_rpc_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_partition_and_heal_invoke_rpc_on_each_node&order=bug_status"

Keyword 'Verify_Contexted_Constant_On_Active_Nodes' failed after retrying for 10 seconds. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.233', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Isolate_One_Node :: Isolate one node with registered rpc.             | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_action_provider_partition_and_heal_isolate_one_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_partition_and_heal_isolate_one_node&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.170.172', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Invoke_Rpc_On_Remaining_Nodes :: Invoke rpc on non-islolated nodes... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_action_provider_partition_and_heal_invoke_rpc_on_remaining_nodes"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_partition_and_heal_invoke_rpc_on_remaining_nodes&order=bug_status"

Keyword 'DrbCommons.Verify_Contexted_Constant_On_Active_Nodes' failed after retrying for 1 minute. The last error was: Keyword 'Verify_Contexted_Constant_On_Active_Nodes' failed after retrying for 10 seconds. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.233', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Rejoin_Isolated_Member :: Rejoin isolated node                        | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_action_provider_partition_and_heal_rejoin_isolated_member"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_partition_and_heal_rejoin_isolated_member&order=bug_status"

Variable '${isolated_idx}' not found.
------------------------------------------------------------------------------
Invoke_Rpc_On_Each_Node_Again :: Invoke rpc get-contexted-constant... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_action_provider_partition_and_heal_invoke_rpc_on_each_node_again"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_partition_and_heal_invoke_rpc_on_each_node_again&order=bug_status"

Keyword 'Verify_Contexted_Constant_On_Active_Nodes' failed after retrying for 10 seconds. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.233', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Unregister_Rpc_On_Each_Node :: Inregister rpc on both nodes.          | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_action_provider_partition_and_heal_unregister_rpc_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_partition_and_heal_unregister_rpc_on_each_node&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.171.233', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-ask.txt.Action Provider Partition And Heal :... | FAIL |
7 tests, 0 passed, 7 failed
==============================================================================
controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te...
==============================================================================
Stop_All_Members :: Stop every odl node.                              | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.233', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-ask.txt.Master Stability :: Cluster Singleton testing...
==============================================================================
Register_Singleton_Constant_On_Each_Node_And_Verify :: Register a ... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_master_stability_register_singleton_constant_on_each_node_and_verify"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_master_stability_register_singleton_constant_on_each_node_and_verify&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.171.233', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Unregister_Singleton_Constant_On_Non_Master_Node :: Unregister the... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_master_stability_unregister_singleton_constant_on_non_master_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_master_stability_unregister_singleton_constant_on_non_master_node&order=bug_status"

Variable '@{cs_candidates}' not found. Did you mean:
    @{cs_exp_candidates}
------------------------------------------------------------------------------
Monitor_Stability_While_Unregistered :: Verify that the owner rema... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_master_stability_monitor_stability_while_unregistered"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_master_stability_monitor_stability_while_unregistered&order=bug_status"

Variable '${cs_owner}' not found.
------------------------------------------------------------------------------
Reregister_Singleton_Constant :: Re-register the unregistered cand... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_master_stability_reregister_singleton_constant"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_master_stability_reregister_singleton_constant&order=bug_status"

Variable '${unregistered_node}' not found.
------------------------------------------------------------------------------
Verify_Stability_After_Reregistration :: Verify that the owner rem... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_master_stability_verify_stability_after_reregistration"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_master_stability_verify_stability_after_reregistration&order=bug_status"

Variable '${cs_owner}' not found.
------------------------------------------------------------------------------
Unregister_Singleton_Constant_On_Each_Node :: Unregister the appli... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_master_stability_unregister_singleton_constant_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_master_stability_unregister_singleton_constant_on_each_node&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.171.233', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-ask.txt.Master Stability :: Cluster Singleto... | FAIL |
6 tests, 0 passed, 6 failed
==============================================================================
controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te...
==============================================================================
Stop_All_Members :: Stop every odl node.                              | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.233', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-ask.txt.Partition And Heal :: Cluster Singleton testi...
==============================================================================
Register_Singleton_Constant_On_Each_Node :: Register a candidate a... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_partition_and_heal_register_singleton_constant_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_partition_and_heal_register_singleton_constant_on_each_node&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.171.233', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Verify_Singleton_Constant_On_Each_Node :: Store the owner and cand... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_partition_and_heal_verify_singleton_constant_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_partition_and_heal_verify_singleton_constant_on_each_node&order=bug_status"

Could not parse owner and candidates for device get-singleton-constant-service']
------------------------------------------------------------------------------
Isolate_Owner_Node :: Isolate the cluster node which is the owner.... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_partition_and_heal_isolate_owner_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_partition_and_heal_isolate_owner_node&order=bug_status"

Variable '${cs_owner}' not found.
------------------------------------------------------------------------------
Monitor_Stability_While_Isolated :: Monitor the stability of the s... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_partition_and_heal_monitor_stability_while_isolated"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_partition_and_heal_monitor_stability_while_isolated&order=bug_status"

Invalid IF condition: Evaluating expression '"${index}" == "${cs_isolated_index}"' failed: Variable '${cs_isolated_index}' not found.
------------------------------------------------------------------------------
Rejoin_Isolated_node :: Rejoin isolated node.                         | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_partition_and_heal_rejoin_isolated_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_partition_and_heal_rejoin_isolated_node&order=bug_status"

Variable '${cs_isolated_index}' not found.
------------------------------------------------------------------------------
Unregister_Singleton_Constant_On_Each_Node :: Unregister the appli... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_partition_and_heal_unregister_singleton_constant_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_partition_and_heal_unregister_singleton_constant_on_each_node&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.171.233', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-ask.txt.Partition And Heal :: Cluster Single... | FAIL |
6 tests, 0 passed, 6 failed
==============================================================================
controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te...
==============================================================================
Stop_All_Members :: Stop every odl node.                              | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.233', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-ask.txt.Chasing The Leader :: Cluster Singleton testi...
==============================================================================
Register_Candidates :: Register a candidate application on each no... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_chasing_the_leader_register_candidates"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_chasing_the_leader_register_candidates&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.171.233', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Do_Nothing :: Do nothing for the time of the test duration, becaus... | PASS |
------------------------------------------------------------------------------
Unregister_Candidates_And_Validate_Criteria :: Unregister the test... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_chasing_the_leader_unregister_candidates_and_validate_criteria"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_chasing_the_leader_unregister_candidates_and_validate_criteria&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.171.233', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-ask.txt.Chasing The Leader :: Cluster Single... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te...
==============================================================================
Stop_All_Members :: Stop every odl node.                              | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.233', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-ask.txt.Global Rpc Kill :: Controller functional HA t...
==============================================================================
Get_Basic_Rpc_Test_Owner :: Find a service owner and successors.      | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Rpc_Before_Stopping_On_Owner :: Run rpc on the service owner.         | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Rpc_Before_Stop_On_Successors :: Run rpc on non owher cluster nodes.  | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Stop_Current_Owner_Member :: Stop cluster node which is the owner.    | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Verify_New_Basic_Rpc_Test_Owner_Elected :: Verify new owner of the... | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Rpc_On_Remained_Cluster_Nodes :: Run rpc on remained cluster nodes.   | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Restart_Stopped_Member :: Restart stopped node                        | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Verify_New_Owner_Remained_After_Rejoin :: Verify no owner change h... | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Rpc_After_Rejoin_On_New_Owner :: Run rpc on the new service owner ... | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Rpc_After_Rejoin_On_Old_Owner :: Run rpc on rejoined cluster node.    | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Rpc_After_Rejoin_On_All :: Run rpc again on all nodes.                | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
controller-clustering-ask.txt.Global Rpc Kill :: Controller functi... | FAIL |
Suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.

11 tests, 0 passed, 11 failed
==============================================================================
controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te...
==============================================================================
Stop_All_Members :: Stop every odl node.                              | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.233', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-ask.txt.Global Rpc Freeze :: Controller functional HA...
==============================================================================
Get_Basic_Rpc_Test_Owner :: Find a service owner and successors.      | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Rpc_Before_Freezing_On_Owner :: Run rpc on the service owner.         | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Rpc_Before_Freeze_On_Successors :: Run rpc on non owher cluster no... | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Freeze_Current_Owner_Member :: Stop cluster node which is the owner.  | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Verify_New_Basic_Rpc_Test_Owner_Elected :: Verify new owner of the... | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Rpc_On_Remained_Cluster_Nodes :: Run rpc on remained cluster nodes.   | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Unfreeze_Frozen_Member :: Restart frozen node                         | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Rpc_After_Rejoin_On_New_Owner :: Run rpc on the new service owner ... | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Rpc_After_Rejoin_On_Old_Owner :: Run rpc on rejoined cluster node.    | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Rpc_After_Rejoin_On_All :: Run rpc again on all nodes.                | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
controller-clustering-ask.txt.Global Rpc Freeze :: Controller func... | FAIL |
Suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.

10 tests, 0 passed, 10 failed
==============================================================================
controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te...
==============================================================================
Stop_All_Members :: Stop every odl node.                              | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.233', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-ask.txt.Global Rpc Isolate :: Controller functional H...
==============================================================================
Get_Basic_Rpc_Test_Owner :: Find a service owner and successors.      | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Rpc_Before_Isolation_On_Owner :: Run rpc on the service owner.        | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Rpc_Before_Isolation_On_Successors :: Run rpc on non owher cluster... | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Isolate_Current_Owner_Member :: Isolating cluster node which is th... | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Verify_New_Basic_Rpc_Test_Owner_Elected :: Verify new owner of the... | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Rpc_On_Isolated_Node :: Run rpc on isolated cluster node.             | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Rpc_On_Non_Isolated_Cluster_Nodes :: Run rpc on remained cluster n... | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Rejoin_Isolated_Member :: Rejoin isolated node                        | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Rpc_After_Rejoin_On_New_Owner :: Run rpc on the new service owner ... | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Rpc_After_Rejoin_On_Old_Owner :: Run rpc on rejoined cluster node.    | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Rpc_After_Rejoin_On_All :: Run rpc again on all nodes.                | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
controller-clustering-ask.txt.Global Rpc Isolate :: Controller fun... | FAIL |
Suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.

11 tests, 0 passed, 11 failed
==============================================================================
controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te...
==============================================================================
Stop_All_Members :: Stop every odl node.                              | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.233', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-ask.txt.Carpeople Crud :: Suite for performing basic ...
==============================================================================
Add_Cars_To_Leader :: Add 30 cars to car Leader by one big PUT.       | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Added_Cars_On_Leader :: GET response from Leader should match ... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Added_Cars_On_Followers :: The same check on other members.       | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Add_People_To_First_Follower :: Add 30 people to people first Foll... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Added_People_On_Leader :: GET response from Leader should matc... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Added_People_On_Followers :: The same check on other members.     | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Leader :: Buy some cars on car-people Leader, loop of ... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Followers :: On each Follower buy corresponding ID seg... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Added_CarPeople_On_Leader :: GET car-person mappings from Lead... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Added_CarPeople_On_Followers :: The same check on other members.  | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_All_CarPeople_On_Leader :: DELETE car-people container. No ... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_All_People_On_Leader :: DELETE people container. No verific... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_All_Cars_On_Leader :: DELETE cars container. No verificatio... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
controller-clustering-ask.txt.Carpeople Crud :: Suite for performi... | FAIL |
Suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig

13 tests, 0 passed, 13 failed
==============================================================================
controller-clustering-ask.txt.Car Failover Crud :: Suite mixing basic opera...
==============================================================================
Add_Original_Cars_On_Old_Leader_And_Verify :: Add initial cars on ... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Stop_Original_Car_Leader :: Stop the car Leader to cause a new lea... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Wait_For_New_Leader :: Wait until new car Leader is elected.          | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Original_Cars_On_New_Leader :: GET cars from new Leader, shoul... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Original_Cars_On_New_Followers :: The same check on other exis... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_Original_Cars_On_New_Leader :: Delete cars on the new Leader.  | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Add_Leader_Cars_On_New_Leader :: Add cars on the new Leader.          | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Leader_Cars_On_New_Leader :: GET cars from new Leader, should ... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Leader_Cars_On_New_Followers :: The same check on other existi... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_Leader_Cars_On_New_First_Follower :: Delete cars in new fir... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Add_Follower_Cars_On_New_First_Follower :: Add cars on the new fir... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Folower_Cars_On_New_Leader :: Get cars from the new Leader, sh... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Follower_Cars_On_New_Followers :: The same check on other exis... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Start_Old_Car_Leader :: Start the stopped member without deleting ... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Folower_Cars_On_Old_Leader :: GET cars from the restarted memb... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_Follower_Cars_On_New_Leader :: Delete cars on the last Leader. | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
controller-clustering-ask.txt.Car Failover Crud :: Suite mixing ba... | FAIL |
Suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig

16 tests, 0 passed, 16 failed
==============================================================================
controller-clustering-ask.txt.Car Persistence Recovery :: This test restart...
==============================================================================
Add_Cars_On_Leader_And_Verify :: Single big PUT to datastore to ad... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Stop_All_Members :: Stop all controllers.                             | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Start_All_Members :: Start all controllers (should restore the per... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Memorize_Leader_And_Followers :: Locate current Leader of car Shard.  | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Cars_On_Leader :: GET cars from Leader, should match the PUT d... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Cars_On_Followers :: The same check on other members.             | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_Cars_On_Leader :: Delete cars on the new Leader.               | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
controller-clustering-ask.txt.Car Persistence Recovery :: This tes... | FAIL |
Suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig

7 tests, 0 passed, 7 failed
==============================================================================
controller-clustering-ask.txt.Buycar Failover :: This test focuses on testi...
==============================================================================
Add_Cars_To_Leader_And_Verify :: Add all needed cars to car Leader... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Add_People_To_First_Follower_And_Verify :: Add all needed people t... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Leader_And_Verify :: Buy some cars on the leader member.  | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Follower_And_Verify :: Buy some cars on the first foll... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Reboot_People_Leader :: Previous people Leader is rebooted. We sho... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Leader_After_Reboot_And_Verify :: Buy some cars on the... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Follower_After_Reboot_And_Verify :: Buy some cars on t... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_All_CarPeople :: DELETE car-people container. No verificati... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_All_People :: DELETE people container. No verification beyo... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_All_Cars :: DELETE cars container. No verification beyond h... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
controller-clustering-ask.txt.Buycar Failover :: This test focuses... | FAIL |
Suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig

10 tests, 0 passed, 10 failed
==============================================================================
controller-clustering-ask.txt.Entity Isolate :: Suite for performing member...
==============================================================================
Check All Shards Before Isolate :: Check all shards in controller.    | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Isolate Entity Leader :: Isolate the entity-ownership Leader to ca... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Check All Shards After Isolate :: Check all shards in controller.     | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Rejoin Entity Leader :: Rejoin the entity-ownership Leader.           | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Check All Shards After Rejoin :: Check all shards in controller.      | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
controller-clustering-ask.txt.Entity Isolate :: Suite for performi... | FAIL |
Suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig

5 tests, 0 passed, 5 failed
==============================================================================
controller-clustering-ask.txt.Buycar Failover Isolation :: This test focuse...
==============================================================================
Add_Cars_To_Leader_And_Verify :: Add all needed cars to car Leader... | FAIL |
Parent suite setup failed:
HTTPError: 409 Client Error: Conflict for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Add_People_To_First_Follower_And_Verify :: Add all needed people t... | FAIL |
Parent suite setup failed:
HTTPError: 409 Client Error: Conflict for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Leader_And_Verify :: Buy some cars on the leader member.  | FAIL |
Parent suite setup failed:
HTTPError: 409 Client Error: Conflict for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Follower_And_Verify :: Buy some cars on the first foll... | FAIL |
Parent suite setup failed:
HTTPError: 409 Client Error: Conflict for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Isolate_and_Rejoin_People_Leader :: Previous people Leader is isol... | FAIL |
Parent suite setup failed:
HTTPError: 409 Client Error: Conflict for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Leader_After_Rejoin_And_Verify :: Buy some cars on the... | FAIL |
Parent suite setup failed:
HTTPError: 409 Client Error: Conflict for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Follower_After_Rejoin_And_Verify :: Buy some cars on t... | FAIL |
Parent suite setup failed:
HTTPError: 409 Client Error: Conflict for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_All_CarPeople :: DELETE car-people container. No verificati... | FAIL |
Parent suite setup failed:
HTTPError: 409 Client Error: Conflict for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_All_People :: DELETE people container. No verification beyo... | FAIL |
Parent suite setup failed:
HTTPError: 409 Client Error: Conflict for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_All_Cars :: DELETE cars container. No verification beyond h... | FAIL |
Parent suite setup failed:
HTTPError: 409 Client Error: Conflict for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
controller-clustering-ask.txt.Buycar Failover Isolation :: This te... | FAIL |
Suite setup failed:
HTTPError: 409 Client Error: Conflict for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig

10 tests, 0 passed, 10 failed
==============================================================================
controller-clustering-ask.txt.Car Failover Crud Isolation :: Suite mixing b...
==============================================================================
Add_Original_Cars_On_Old_Leader_And_Verify :: Add initial cars on ... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Isolate_Original_Car_Leader :: Isolate the car Leader to cause a n... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Wait_For_New_Leader :: Wait until new car Leader is elected.          | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Original_Cars_On_New_Leader :: GET cars from new Leader, shoul... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Original_Cars_On_New_Followers :: The same check on other exis... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_Original_Cars_On_New_Leader :: Delete cars on the new Leader.  | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Add_Leader_Cars_On_New_Leader :: Add cars on the new Leader.          | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Leader_Cars_On_New_Leader :: GET cars from new Leader, should ... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Leader_Cars_On_New_Followers :: The same check on other existi... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_Leader_Cars_On_New_First_Follower :: Delete cars in new fir... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Add_Follower_Cars_On_New_First_Follower :: Add cars on the new fir... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Folower_Cars_On_New_Leader :: Get cars from the new Leader, sh... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Follower_Cars_On_New_Followers :: The same check on other exis... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Rejoin_Old_Car_Leader :: Rejoin the isolated member without deleti... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Folower_Cars_On_Old_Leader :: GET cars from the restarted memb... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_Follower_Cars_On_New_Leader :: Delete cars on the last Leader. | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
controller-clustering-ask.txt.Car Failover Crud Isolation :: Suite... | FAIL |
Suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig

16 tests, 0 passed, 16 failed
==============================================================================
controller-clustering-ask.txt.Car Outage Corners :: Cluster suite for testi...
==============================================================================
Stop_Majority_Of_The_Followers :: Stop half plus one car Follower ... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Attempt_To_Add_Cars_To_Leader :: Adding cars should fail, as major... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Start_Tipping_Follower :: Start one Follower member without persis... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Add_Cars_On_Tipping_Follower :: Add cars on the tipping Follower.     | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Cars_On_Existing_Members :: On each up member: GET cars, shoul... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Start_Other_Followers :: Start other followers without persisted d... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Cars_On_New_Follower_Leader :: GET cars from a new follower to... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_Cars_On_Leader :: Delete cars on Leader.                       | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
controller-clustering-ask.txt.Car Outage Corners :: Cluster suite ... | FAIL |
Suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.213:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig

8 tests, 0 passed, 8 failed
==============================================================================
controller-clustering-ask.txt                                         | FAIL |
195 tests, 18 passed, 177 failed
==============================================================================
Output:  /w/workspace/controller-csit-3node-clustering-ask-all-calcium/output.xml
Log:     /w/workspace/controller-csit-3node-clustering-ask-all-calcium/log.html
Report:  /w/workspace/controller-csit-3node-clustering-ask-all-calcium/report.html
+ true
+ echo 'Examining the files in data/log and checking filesize'
Examining the files in data/log and checking filesize
+ ssh 10.30.171.213 'ls -altr /tmp/karaf-0.20.0-SNAPSHOT/data/log/'
Warning: Permanently added '10.30.171.213' (ECDSA) to the list of known hosts.
total 110468
drwxrwxr-x. 2 jenkins jenkins       48 Apr  6 23:40 .
-rw-rw-r--. 1 jenkins jenkins     1720 Apr  6 23:40 karaf_console.log
drwxrwxr-x. 9 jenkins jenkins      149 Apr  7 03:49 ..
-rw-rw-r--. 1 jenkins jenkins 85115924 Apr  7 04:03 karaf.log
+ ssh 10.30.171.213 'du -hs /tmp/karaf-0.20.0-SNAPSHOT/data/log/*'
Warning: Permanently added '10.30.171.213' (ECDSA) to the list of known hosts.
4.0K	/tmp/karaf-0.20.0-SNAPSHOT/data/log/karaf_console.log
108M	/tmp/karaf-0.20.0-SNAPSHOT/data/log/karaf.log
+ ssh 10.30.171.233 'ls -altr /tmp/karaf-0.20.0-SNAPSHOT/data/log/'
Warning: Permanently added '10.30.171.233' (ECDSA) to the list of known hosts.
total 2804
drwxrwxr-x. 2 jenkins jenkins      48 Apr  6 23:40 .
-rw-rw-r--. 1 jenkins jenkins  116635 Apr  6 23:48 karaf_console.log
drwxrwxr-x. 4 jenkins jenkins      28 Apr  7 03:48 ..
-rw-rw-r--. 1 jenkins jenkins 1740282 Apr  7 04:02 karaf.log
+ ssh 10.30.171.233 'du -hs /tmp/karaf-0.20.0-SNAPSHOT/data/log/*'
Warning: Permanently added '10.30.171.233' (ECDSA) to the list of known hosts.
116K	/tmp/karaf-0.20.0-SNAPSHOT/data/log/karaf_console.log
2.7M	/tmp/karaf-0.20.0-SNAPSHOT/data/log/karaf.log
+ ssh 10.30.170.172 'ls -altr /tmp/karaf-0.20.0-SNAPSHOT/data/log/'
Warning: Permanently added '10.30.170.172' (ECDSA) to the list of known hosts.
total 131172
drwxrwxr-x. 2 jenkins jenkins       48 Apr  6 23:40 .
-rw-rw-r--. 1 jenkins jenkins   165631 Apr  7 00:17 karaf_console.log
drwxrwxr-x. 4 jenkins jenkins       28 Apr  7 03:48 ..
-rw-rw-r--. 1 jenkins jenkins 89605534 Apr  7 04:03 karaf.log
+ ssh 10.30.170.172 'du -hs /tmp/karaf-0.20.0-SNAPSHOT/data/log/*'
Warning: Permanently added '10.30.170.172' (ECDSA) to the list of known hosts.
164K	/tmp/karaf-0.20.0-SNAPSHOT/data/log/karaf_console.log
128M	/tmp/karaf-0.20.0-SNAPSHOT/data/log/karaf.log
+ set +e
++ seq 1 3
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_1_IP
+ echo 'Let'\''s take the karaf thread dump again'
Let's take the karaf thread dump again
+ ssh 10.30.171.213 'sudo ps aux'
Warning: Permanently added '10.30.171.213' (ECDSA) to the list of known hosts.
++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-ask-all-calcium/ps_after.log
++ grep -v grep
++ cut -f2 '-d '
++ tr -s ' '
+ pid=30355
+ echo 'karaf main: org.apache.karaf.main.Main, pid:30355'
karaf main: org.apache.karaf.main.Main, pid:30355
+ ssh 10.30.171.213 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 30355'
Warning: Permanently added '10.30.171.213' (ECDSA) to the list of known hosts.
+ echo 'killing karaf process...'
killing karaf process...
+ ssh 10.30.171.213 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh'
Warning: Permanently added '10.30.171.213' (ECDSA) to the list of known hosts.
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_2_IP
+ echo 'Let'\''s take the karaf thread dump again'
Let's take the karaf thread dump again
+ ssh 10.30.171.233 'sudo ps aux'
Warning: Permanently added '10.30.171.233' (ECDSA) to the list of known hosts.
++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-ask-all-calcium/ps_after.log
++ grep -v grep
++ tr -s ' '
++ cut -f2 '-d '
+ pid=5744
+ echo 'karaf main: org.apache.karaf.main.Main, pid:5744'
karaf main: org.apache.karaf.main.Main, pid:5744
+ ssh 10.30.171.233 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 5744'
Warning: Permanently added '10.30.171.233' (ECDSA) to the list of known hosts.
+ echo 'killing karaf process...'
killing karaf process...
+ ssh 10.30.171.233 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh'
Warning: Permanently added '10.30.171.233' (ECDSA) to the list of known hosts.
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_3_IP
+ echo 'Let'\''s take the karaf thread dump again'
Let's take the karaf thread dump again
+ ssh 10.30.170.172 'sudo ps aux'
Warning: Permanently added '10.30.170.172' (ECDSA) to the list of known hosts.
++ grep -v grep
++ tr -s ' '
++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-ask-all-calcium/ps_after.log
++ cut -f2 '-d '
+ pid=5751
+ echo 'karaf main: org.apache.karaf.main.Main, pid:5751'
karaf main: org.apache.karaf.main.Main, pid:5751
+ ssh 10.30.170.172 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 5751'
Warning: Permanently added '10.30.170.172' (ECDSA) to the list of known hosts.
+ echo 'killing karaf process...'
killing karaf process...
+ ssh 10.30.170.172 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh'
Warning: Permanently added '10.30.170.172' (ECDSA) to the list of known hosts.
+ sleep 5
++ seq 1 3
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_1_IP
+ echo 'Compressing karaf.log 1'
Compressing karaf.log 1
+ ssh 10.30.171.213 gzip --best /tmp/karaf-0.20.0-SNAPSHOT/data/log/karaf.log
Warning: Permanently added '10.30.171.213' (ECDSA) to the list of known hosts.
gzip: /tmp/karaf-0.20.0-SNAPSHOT/data/log/karaf.log: file size changed while zipping
+ echo 'Fetching compressed karaf.log 1'
Fetching compressed karaf.log 1
+ scp 10.30.171.213:/tmp/karaf-0.20.0-SNAPSHOT/data/log/karaf.log.gz odl1_karaf.log.gz
Warning: Permanently added '10.30.171.213' (ECDSA) to the list of known hosts.
+ ssh 10.30.171.213 rm -f /tmp/karaf-0.20.0-SNAPSHOT/data/log/karaf.log.gz
Warning: Permanently added '10.30.171.213' (ECDSA) to the list of known hosts.
+ scp 10.30.171.213:/tmp/karaf-0.20.0-SNAPSHOT/data/log/karaf_console.log odl1_karaf_console.log
Warning: Permanently added '10.30.171.213' (ECDSA) to the list of known hosts.
+ ssh 10.30.171.213 rm -f /tmp/karaf-0.20.0-SNAPSHOT/data/log/karaf_console.log
Warning: Permanently added '10.30.171.213' (ECDSA) to the list of known hosts.
+ echo 'Fetch GC logs'
Fetch GC logs
+ mkdir -p gclogs-1
+ scp '10.30.171.213:/tmp/karaf-0.20.0-SNAPSHOT/data/log/*.log' gclogs-1/
Warning: Permanently added '10.30.171.213' (ECDSA) to the list of known hosts.
scp: /tmp/karaf-0.20.0-SNAPSHOT/data/log/*.log: No such file or directory
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_2_IP
+ echo 'Compressing karaf.log 2'
Compressing karaf.log 2
+ ssh 10.30.171.233 gzip --best /tmp/karaf-0.20.0-SNAPSHOT/data/log/karaf.log
Warning: Permanently added '10.30.171.233' (ECDSA) to the list of known hosts.
+ echo 'Fetching compressed karaf.log 2'
Fetching compressed karaf.log 2
+ scp 10.30.171.233:/tmp/karaf-0.20.0-SNAPSHOT/data/log/karaf.log.gz odl2_karaf.log.gz
Warning: Permanently added '10.30.171.233' (ECDSA) to the list of known hosts.
+ ssh 10.30.171.233 rm -f /tmp/karaf-0.20.0-SNAPSHOT/data/log/karaf.log.gz
Warning: Permanently added '10.30.171.233' (ECDSA) to the list of known hosts.
+ scp 10.30.171.233:/tmp/karaf-0.20.0-SNAPSHOT/data/log/karaf_console.log odl2_karaf_console.log
Warning: Permanently added '10.30.171.233' (ECDSA) to the list of known hosts.
+ ssh 10.30.171.233 rm -f /tmp/karaf-0.20.0-SNAPSHOT/data/log/karaf_console.log
Warning: Permanently added '10.30.171.233' (ECDSA) to the list of known hosts.
+ echo 'Fetch GC logs'
Fetch GC logs
+ mkdir -p gclogs-2
+ scp '10.30.171.233:/tmp/karaf-0.20.0-SNAPSHOT/data/log/*.log' gclogs-2/
Warning: Permanently added '10.30.171.233' (ECDSA) to the list of known hosts.
scp: /tmp/karaf-0.20.0-SNAPSHOT/data/log/*.log: No such file or directory
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_3_IP
+ echo 'Compressing karaf.log 3'
Compressing karaf.log 3
+ ssh 10.30.170.172 gzip --best /tmp/karaf-0.20.0-SNAPSHOT/data/log/karaf.log
Warning: Permanently added '10.30.170.172' (ECDSA) to the list of known hosts.
gzip: /tmp/karaf-0.20.0-SNAPSHOT/data/log/karaf.log: file size changed while zipping
+ echo 'Fetching compressed karaf.log 3'
Fetching compressed karaf.log 3
+ scp 10.30.170.172:/tmp/karaf-0.20.0-SNAPSHOT/data/log/karaf.log.gz odl3_karaf.log.gz
Warning: Permanently added '10.30.170.172' (ECDSA) to the list of known hosts.
+ ssh 10.30.170.172 rm -f /tmp/karaf-0.20.0-SNAPSHOT/data/log/karaf.log.gz
Warning: Permanently added '10.30.170.172' (ECDSA) to the list of known hosts.
+ scp 10.30.170.172:/tmp/karaf-0.20.0-SNAPSHOT/data/log/karaf_console.log odl3_karaf_console.log
Warning: Permanently added '10.30.170.172' (ECDSA) to the list of known hosts.
+ ssh 10.30.170.172 rm -f /tmp/karaf-0.20.0-SNAPSHOT/data/log/karaf_console.log
Warning: Permanently added '10.30.170.172' (ECDSA) to the list of known hosts.
+ echo 'Fetch GC logs'
Fetch GC logs
+ mkdir -p gclogs-3
+ scp '10.30.170.172:/tmp/karaf-0.20.0-SNAPSHOT/data/log/*.log' gclogs-3/
Warning: Permanently added '10.30.170.172' (ECDSA) to the list of known hosts.
scp: /tmp/karaf-0.20.0-SNAPSHOT/data/log/*.log: No such file or directory
+ echo 'Examine copied files'
Examine copied files
+ ls -lt
total 49956
drwxrwxr-x. 2 jenkins jenkins        6 Apr  7 04:03 gclogs-3
-rw-rw-r--. 1 jenkins jenkins   165631 Apr  7 04:03 odl3_karaf_console.log
-rw-rw-r--. 1 jenkins jenkins  1983981 Apr  7 04:03 odl3_karaf.log.gz
drwxrwxr-x. 2 jenkins jenkins        6 Apr  7 04:03 gclogs-2
-rw-rw-r--. 1 jenkins jenkins   116635 Apr  7 04:03 odl2_karaf_console.log
-rw-rw-r--. 1 jenkins jenkins    95099 Apr  7 04:03 odl2_karaf.log.gz
drwxrwxr-x. 2 jenkins jenkins        6 Apr  7 04:03 gclogs-1
-rw-rw-r--. 1 jenkins jenkins     1720 Apr  7 04:03 odl1_karaf_console.log
-rw-rw-r--. 1 jenkins jenkins  2537210 Apr  7 04:03 odl1_karaf.log.gz
-rw-rw-r--. 1 jenkins jenkins   148211 Apr  7 04:03 karaf_3_5751_threads_after.log
-rw-rw-r--. 1 jenkins jenkins    15872 Apr  7 04:03 ps_after.log
-rw-rw-r--. 1 jenkins jenkins   120814 Apr  7 04:03 karaf_2_5744_threads_after.log
-rw-rw-r--. 1 jenkins jenkins   145825 Apr  7 04:03 karaf_1_30355_threads_after.log
-rw-rw-r--. 1 jenkins jenkins   301824 Apr  7 04:03 report.html
-rw-rw-r--. 1 jenkins jenkins  2942883 Apr  7 04:03 log.html
-rw-rw-r--. 1 jenkins jenkins 41973040 Apr  7 04:03 output.xml
-rw-rw-r--. 1 jenkins jenkins     4091 Apr  6 23:41 testplan.txt
-rw-rw-r--. 1 jenkins jenkins   159891 Apr  6 23:41 karaf_3_5751_threads_before.log
-rw-rw-r--. 1 jenkins jenkins    16588 Apr  6 23:41 ps_before.log
-rw-rw-r--. 1 jenkins jenkins   157477 Apr  6 23:41 karaf_2_5744_threads_before.log
-rw-rw-r--. 1 jenkins jenkins   170870 Apr  6 23:41 karaf_1_5751_threads_before.log
-rw-rw-r--. 1 jenkins jenkins     3106 Apr  6 23:40 post-startup-script.sh
-rw-rw-r--. 1 jenkins jenkins      252 Apr  6 23:40 startup-script.sh
-rw-rw-r--. 1 jenkins jenkins     3452 Apr  6 23:40 configuration-script.sh
-rw-rw-r--. 1 jenkins jenkins      695 Apr  6 23:40 custom_shard_config.txt
-rw-rw-r--. 1 jenkins jenkins      134 Apr  6 23:40 scriptplan.txt
-rw-rw-r--. 1 jenkins jenkins      335 Apr  6 23:39 detect_variables.env
-rw-rw-r--. 1 jenkins jenkins     2620 Apr  6 23:39 pom.xml
-rw-rw-r--. 1 jenkins jenkins       86 Apr  6 23:39 set_variables.env
-rw-rw-r--. 1 jenkins jenkins      314 Apr  6 23:39 slave_addresses.txt
-rw-rw-r--. 1 jenkins jenkins      570 Apr  6 23:39 requirements.txt
-rw-rw-r--. 1 jenkins jenkins       26 Apr  6 23:39 env.properties
-rw-rw-r--. 1 jenkins jenkins      335 Apr  6 23:37 stack-parameters.yaml
drwxrwxr-x. 7 jenkins jenkins     4096 Apr  6 23:36 test
drwxrwxr-x. 2 jenkins jenkins        6 Apr  6 23:36 test@tmp
-rw-rw-r--. 1 jenkins jenkins     1404 Apr  6 20:58 maven-metadata.xml
+ true
[controller-csit-3node-clustering-ask-all-calcium] $ /bin/sh /tmp/jenkins17171465827305985677.sh
Cleaning up Robot installation...
$ ssh-agent -k
unset SSH_AUTH_SOCK;
unset SSH_AGENT_PID;
echo Agent pid 5289 killed;
[ssh-agent] Stopped.
Recording plot data
Robot results publisher started...
INFO: Checking test criticality is deprecated and will be dropped in a future release!
-Parsing output xml:
Done!
-Copying log files to build dir:
Done!
-Assigning results to build:
Done!
-Checking thresholds:
Done!
Done publishing Robot results.
Build step 'Publish Robot Framework test results' changed build result to UNSTABLE
[PostBuildScript] - [INFO] Executing post build scripts.
[controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash /tmp/jenkins4512662238622732995.sh
Archiving csit artifacts
mv: cannot stat '*_1.png': No such file or directory
mv: cannot stat '/tmp/odl1_*': No such file or directory
mv: cannot stat '*_2.png': No such file or directory
mv: cannot stat '/tmp/odl2_*': No such file or directory
mv: cannot stat '*_3.png': No such file or directory
mv: cannot stat '/tmp/odl3_*': No such file or directory
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed

  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100 3677k    0 3677k    0     0  4528k      0 --:--:-- --:--:-- --:--:-- 4528k
Archive:  robot-plugin.zip
  inflating: ./archives/robot-plugin/log.html  
  inflating: ./archives/robot-plugin/output.xml  
  inflating: ./archives/robot-plugin/report.html  
mv: cannot stat '*.log.gz': No such file or directory
mv: cannot stat '*.csv': No such file or directory
mv: cannot stat '*.png': No such file or directory
[PostBuildScript] - [INFO] Executing post build scripts.
[controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash /tmp/jenkins4803702627165440116.sh
[PostBuildScript] - [INFO] Executing post build scripts.
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties content 
OS_CLOUD=vex
OS_STACK_NAME=releng-controller-csit-3node-clustering-ask-all-calcium-30

[EnvInject] - Variables injected successfully.
provisioning config files...
copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
[controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash /tmp/jenkins10737203203877163139.sh
---> openstack-stack-delete.sh
Setup pyenv:
  system
  3.8.13
  3.9.13
  3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-ask-all-calcium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-5Vr6 from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes python-heatclient python-openstackclient 
lf-activate-venv(): INFO: Adding /tmp/venv-5Vr6/bin to PATH
INFO: Retrieving stack cost for: releng-controller-csit-3node-clustering-ask-all-calcium-30
DEBUG: Successfully retrieved stack cost: total: 1.6500000000000001
INFO: Deleting stack releng-controller-csit-3node-clustering-ask-all-calcium-30
Waiting for stack to delete...
Successfully deleted stack releng-controller-csit-3node-clustering-ask-all-calcium-30
[PostBuildScript] - [INFO] Executing post build scripts.
[controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash /tmp/jenkins14957939471460248196.sh
---> sysstat.sh
[controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash /tmp/jenkins2535706542664765819.sh
---> package-listing.sh
++ facter osfamily
++ tr '[:upper:]' '[:lower:]'
+ OS_FAMILY=redhat
+ workspace=/w/workspace/controller-csit-3node-clustering-ask-all-calcium
+ START_PACKAGES=/tmp/packages_start.txt
+ END_PACKAGES=/tmp/packages_end.txt
+ DIFF_PACKAGES=/tmp/packages_diff.txt
+ PACKAGES=/tmp/packages_start.txt
+ '[' /w/workspace/controller-csit-3node-clustering-ask-all-calcium ']'
+ PACKAGES=/tmp/packages_end.txt
+ case "${OS_FAMILY}" in
+ rpm -qa
+ sort
+ '[' -f /tmp/packages_start.txt ']'
+ '[' -f /tmp/packages_end.txt ']'
+ diff /tmp/packages_start.txt /tmp/packages_end.txt
+ '[' /w/workspace/controller-csit-3node-clustering-ask-all-calcium ']'
+ mkdir -p /w/workspace/controller-csit-3node-clustering-ask-all-calcium/archives/
+ cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/controller-csit-3node-clustering-ask-all-calcium/archives/
[controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash /tmp/jenkins10818385700508497445.sh
---> capture-instance-metadata.sh
Setup pyenv:
  system
  3.8.13
  3.9.13
  3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-ask-all-calcium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-5Vr6 from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: lftools 
lf-activate-venv(): INFO: Adding /tmp/venv-5Vr6/bin to PATH
INFO: Running in OpenStack, capturing instance metadata
[controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash /tmp/jenkins11843599961006462277.sh
provisioning config files...
Could not find credentials [logs] for controller-csit-3node-clustering-ask-all-calcium #30
copy managed file [jenkins-log-archives-settings] to file:/w/workspace/controller-csit-3node-clustering-ask-all-calcium@tmp/config5976842808090198669tmp
Regular expression run condition: Expression=[^.*logs-s3.*], Label=[odl-logs-s3-cloudfront-index]
Run condition [Regular expression match] enabling perform for step [Provide Configuration files]
provisioning config files...
copy managed file [jenkins-s3-log-ship] to file:/home/jenkins/.aws/credentials
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties content 
SERVER_ID=logs

[EnvInject] - Variables injected successfully.
[controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash /tmp/jenkins17445289972884439010.sh
---> create-netrc.sh
WARN: Log server credential not found.
[controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash /tmp/jenkins3360792706541203110.sh
---> python-tools-install.sh
Setup pyenv:
  system
  3.8.13
  3.9.13
  3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-ask-all-calcium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-5Vr6 from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: lftools 
lf-activate-venv(): INFO: Adding /tmp/venv-5Vr6/bin to PATH
[controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash /tmp/jenkins4867505544096308634.sh
---> sudo-logs.sh
Archiving 'sudo' log..
[controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash /tmp/jenkins9257976220493760891.sh
---> job-cost.sh
Setup pyenv:
  system
  3.8.13
  3.9.13
  3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-ask-all-calcium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-5Vr6 from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 
lf-activate-venv(): INFO: Adding /tmp/venv-5Vr6/bin to PATH
DEBUG: total: 1.6500000000000001
INFO: Retrieving Stack Cost...
INFO: Retrieving Pricing Info for: v3-standard-2
INFO: Archiving Costs
[controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash -l /tmp/jenkins5498519034990490182.sh
---> logs-deploy.sh
Setup pyenv:
  system
  3.8.13
  3.9.13
  3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-ask-all-calcium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-5Vr6 from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: lftools 
lf-activate-venv(): INFO: Adding /tmp/venv-5Vr6/bin to PATH
WARNING: Nexus logging server not set
INFO: S3 path logs/releng/vex-yul-odl-jenkins-1/controller-csit-3node-clustering-ask-all-calcium/30/
INFO: archiving logs to S3
---> uname -a:
Linux prd-centos8-robot-2c-8g-5506.novalocal 4.18.0-547.el8.x86_64 #1 SMP Wed Mar 20 00:35:01 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux


---> lscpu:
Architecture:        x86_64
CPU op-mode(s):      32-bit, 64-bit
Byte Order:          Little Endian
CPU(s):              2
On-line CPU(s) list: 0,1
Thread(s) per core:  1
Core(s) per socket:  1
Socket(s):           2
NUMA node(s):        1
Vendor ID:           AuthenticAMD
CPU family:          23
Model:               49
Model name:          AMD EPYC-Rome Processor
Stepping:            0
CPU MHz:             2800.000
BogoMIPS:            5600.00
Virtualization:      AMD-V
Hypervisor vendor:   KVM
Virtualization type: full
L1d cache:           32K
L1i cache:           32K
L2 cache:            512K
L3 cache:            16384K
NUMA node0 CPU(s):   0,1
Flags:               fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities


---> nproc:
2


---> df -h:
Filesystem      Size  Used Avail Use% Mounted on
devtmpfs        3.8G     0  3.8G   0% /dev
tmpfs           3.8G     0  3.8G   0% /dev/shm
tmpfs           3.8G   17M  3.8G   1% /run
tmpfs           3.8G     0  3.8G   0% /sys/fs/cgroup
/dev/vda1        40G  9.6G   31G  24% /
tmpfs           770M     0  770M   0% /run/user/1001


---> free -m:
              total        used        free      shared  buff/cache   available
Mem:           7697         606        4704          19        2386        6793
Swap:          1023           0        1023


---> ip addr:
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host 
       valid_lft forever preferred_lft forever
2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1458 qdisc mq state UP group default qlen 1000
    link/ether fa:16:3e:eb:6e:68 brd ff:ff:ff:ff:ff:ff
    altname enp0s3
    altname ens3
    inet 10.30.171.214/23 brd 10.30.171.255 scope global dynamic noprefixroute eth0
       valid_lft 70203sec preferred_lft 70203sec
    inet6 fe80::f816:3eff:feeb:6e68/64 scope link 
       valid_lft forever preferred_lft forever


---> sar -b -r -n DEV:
Linux 4.18.0-547.el8.x86_64 (prd-centos8-robot-2c-8g-5506.novalocal) 	04/07/2024 	_x86_64_	(2 CPU)

12:00:01 AM       tps      rtps      wtps   bread/s   bwrtn/s
12:01:01 AM      1.25      0.00      1.25      0.00    206.23
12:02:01 AM      0.45      0.08      0.37      1.87      6.08
12:03:01 AM      0.25      0.00      0.25      0.00      7.78
12:04:01 AM      0.12      0.00      0.12      0.00      4.00
12:05:01 AM      0.13      0.00      0.13      0.00      6.42
12:06:01 AM      0.45      0.00      0.45      0.00      9.73
12:07:01 AM      0.13      0.00      0.13      0.00      2.12
12:08:01 AM      0.43      0.07      0.37      7.60      9.05
12:09:01 AM      0.27      0.00      0.27      0.00      6.82
12:10:01 AM      0.10      0.00      0.10      0.00      0.67
12:11:01 AM      0.30      0.00      0.30      0.00     12.95
12:12:01 AM      0.37      0.00      0.37      0.00     11.41
12:13:01 AM      0.17      0.00      0.17      0.00     15.86
12:14:01 AM      0.23      0.02      0.22      0.13     15.75
12:15:01 AM     34.59     27.31      7.28   1132.02   4719.21
12:16:01 AM      0.70      0.00      0.70      0.00     25.15
12:17:01 AM      0.35      0.00      0.35      0.00     19.09
12:18:01 AM      0.18      0.00      0.18      0.00     20.65
12:19:01 AM      0.12      0.00      0.12      0.00      1.33
12:20:01 AM      0.23      0.00      0.23      0.00      2.52
12:21:01 AM      0.23      0.00      0.23      0.00      3.73
12:22:01 AM      0.37      0.00      0.37      0.00      6.32
12:23:01 AM      0.13      0.00      0.13      0.00      2.52
12:24:01 AM      0.15      0.00      0.15      0.00      1.63
12:25:01 AM      0.15      0.00      0.15      0.00      6.80
12:26:01 AM      0.37      0.00      0.37      0.00      6.18
12:27:01 AM      0.58      0.00      0.58      0.00     11.73
12:28:01 AM      0.32      0.00      0.32      0.00      3.15
12:29:01 AM      0.30      0.00      0.30      0.00      6.82
12:30:01 AM      0.15      0.00      0.15      0.00      1.88
12:31:01 AM      0.18      0.00      0.18      0.00      2.23
12:32:01 AM      0.25      0.00      0.25      0.00      6.31
12:33:01 AM      0.15      0.00      0.15      0.00      2.93
12:34:01 AM      0.28      0.00      0.28      0.00      2.95
12:35:01 AM      0.22      0.00      0.22      0.00      7.25
12:36:01 AM      0.17      0.00      0.17      0.00      2.62
12:37:01 AM      0.23      0.00      0.23      0.00      4.83
12:38:01 AM      0.48      0.30      0.18      6.40      3.45
12:39:01 AM      0.72      0.00      0.72      0.00     20.98
12:40:01 AM      0.27      0.00      0.27      0.00      3.22
12:41:01 AM      0.23      0.00      0.23      0.00      4.67
12:42:01 AM      0.32      0.00      0.32      0.00      8.18
12:43:01 AM      0.12      0.00      0.12      0.00      1.32
12:44:02 AM      0.17      0.00      0.17      0.00     10.63
12:45:01 AM      0.31      0.00      0.31      0.00     17.03
12:46:01 AM      0.17      0.00      0.17      0.00     15.53
12:47:01 AM      0.43      0.00      0.43      0.00     18.78
12:48:01 AM      0.13      0.00      0.13      0.00      7.87
12:49:01 AM      0.15      0.00      0.15      0.00     15.06
12:50:01 AM      0.13      0.00      0.13      0.00     25.72
12:51:01 AM      0.18      0.00      0.18      0.00      4.40
12:52:01 AM      0.33      0.00      0.33      0.00      5.40
12:53:01 AM      0.13      0.00      0.13      0.00      0.92
12:54:01 AM      0.27      0.00      0.27      0.00      4.53
12:55:01 AM      0.15      0.00      0.15      0.00      1.62
12:56:01 AM      0.32      0.00      0.32      0.00      6.78
12:57:01 AM      0.20      0.00      0.20      0.00      2.52
12:58:01 AM      0.13      0.00      0.13      0.00      6.95
12:59:01 AM      0.32      0.00      0.32      0.00      9.65
01:00:01 AM      0.13      0.00      0.13      0.00      1.72
01:01:01 AM      0.50      0.03      0.47      0.27      9.05
01:02:01 AM      0.23      0.00      0.23      0.00      5.53
01:03:01 AM      0.17      0.00      0.17      0.00      5.05
01:04:01 AM      0.13      0.00      0.13      0.00      0.97
01:05:01 AM      0.28      0.00      0.28      0.00      9.11
01:06:01 AM      0.38      0.00      0.38      0.00      9.32
01:07:01 AM      0.15      0.00      0.15      0.00      6.68
01:08:01 AM      0.17      0.00      0.17      0.00      4.95
01:09:01 AM      0.12      0.00      0.12      0.00      1.87
01:10:01 AM      0.17      0.00      0.17      0.00      3.77
01:11:01 AM      0.40      0.00      0.40      0.00      9.45
01:12:01 AM      0.23      0.00      0.23      0.00      3.83
01:13:01 AM      0.23      0.00      0.23      0.00      9.21
01:14:01 AM      0.15      0.00      0.15      0.00     14.70
01:15:01 AM      0.13      0.00      0.13      0.00      8.13
01:16:01 AM      0.30      0.00      0.30      0.00     19.54
01:17:01 AM      0.15      0.00      0.15      0.00     15.34
01:18:01 AM      0.20      0.00      0.20      0.00     14.30
01:19:01 AM      0.40      0.00      0.40      0.00     14.26
01:20:01 AM      0.18      0.00      0.18      0.00     20.15
01:21:01 AM      0.33      0.00      0.33      0.00      6.23
01:22:01 AM      0.13      0.00      0.13      0.00      2.27
01:23:01 AM      0.18      0.00      0.18      0.00      3.20
01:24:01 AM      0.08      0.00      0.08      0.00      0.98
01:25:01 AM      0.15      0.00      0.15      0.00      3.58
01:26:01 AM      0.37      0.00      0.37      0.00      5.48
01:27:01 AM      0.30      0.00      0.30      0.00     10.36
01:28:01 AM      0.22      0.00      0.22      0.00      4.28
01:29:01 AM      0.90      0.00      0.90      0.00     17.86
01:30:01 AM      0.22      0.00      0.22      0.00      3.65
01:31:01 AM      0.28      0.00      0.28      0.00      5.02
01:32:01 AM      0.33      0.00      0.33      0.00      8.90
01:33:01 AM      0.17      0.00      0.17      0.00      2.77
01:34:01 AM      0.15      0.00      0.15      0.00      4.28
01:35:01 AM      0.17      0.00      0.17      0.00      2.13
01:36:01 AM      0.17      0.00      0.17      0.00      3.23
01:37:01 AM      0.23      0.00      0.23      0.00      6.86
01:38:01 AM      0.15      0.00      0.15      0.00      1.83
01:39:01 AM      0.25      0.00      0.25      0.00      4.80
01:40:01 AM      0.20      0.00      0.20      0.00      3.68
01:41:01 AM      0.27      0.00      0.27      0.00      6.10
01:42:01 AM      0.22      0.00      0.22      0.00      3.60
01:43:01 AM      0.15      0.00      0.15      0.00      6.40
01:44:01 AM      0.12      0.00      0.12      0.00      0.90
01:45:01 AM      0.30      0.00      0.30      0.00      8.08
01:46:01 AM      0.32      0.00      0.32      0.00      8.75
01:47:01 AM      0.38      0.00      0.38      0.00     23.11
01:48:01 AM      0.48      0.00      0.48      0.00     15.31
01:49:01 AM      0.52      0.00      0.52      0.00     16.91
01:50:01 AM      0.19      0.00      0.19      0.00     10.03
01:51:01 AM      0.23      0.00      0.23      0.00     14.66
01:52:01 AM      0.32      0.00      0.32      0.00     28.33
01:53:01 AM      0.23      0.00      0.23      0.00      4.92
01:54:01 AM      0.17      0.00      0.17      0.00      2.12
01:55:01 AM      0.12      0.00      0.12      0.00      1.98
01:56:01 AM      0.20      0.00      0.20      0.00      2.35
01:57:01 AM      0.17      0.00      0.17      0.00      2.82
01:58:01 AM      0.13      0.00      0.13      0.00      2.55
01:59:01 AM      0.15      0.00      0.15      0.00      1.45
02:00:01 AM      0.13      0.00      0.13      0.00      7.33
02:01:01 AM      0.30      0.00      0.30      0.00      8.21
02:02:01 AM      0.32      0.00      0.32      0.00      6.03
02:03:01 AM      0.17      0.00      0.17      0.00      1.65
02:04:01 AM      0.18      0.00      0.18      0.00      4.83
02:05:01 AM      0.10      0.00      0.10      0.00      2.67
02:06:01 AM      0.18      0.00      0.18      0.00      4.87
02:07:01 AM      0.45      0.00      0.45      0.00      8.92
02:08:01 AM      0.25      0.00      0.25      0.00      3.60
02:09:01 AM      0.12      0.00      0.12      0.00      5.06
02:10:01 AM      0.17      0.00      0.17      0.00     11.60
02:11:01 AM      0.42      0.00      0.42      0.00     19.71
02:12:01 AM      0.20      0.00      0.20      0.00     15.50
02:13:01 AM      0.28      0.00      0.28      0.00     15.46
02:14:01 AM      0.65      0.00      0.65      0.00     19.28
02:15:01 AM      0.13      0.00      0.13      0.00      9.73
02:16:01 AM      0.32      0.00      0.32      0.00     24.61
02:17:01 AM      0.13      0.00      0.13      0.00      3.45
02:18:01 AM      0.12      0.00      0.12      0.00      0.77
02:19:01 AM      0.12      0.00      0.12      0.00      2.30
02:20:01 AM      0.18      0.00      0.18      0.00      1.77
02:21:01 AM      0.47      0.00      0.47      0.00      9.71
02:22:01 AM      0.28      0.00      0.28      0.00      3.90
02:23:01 AM      0.12      0.00      0.12      0.00      0.78
02:24:01 AM      0.13      0.00      0.13      0.00      8.40
02:25:01 AM      0.13      0.00      0.13      0.00      4.92
02:26:01 AM      0.25      0.00      0.25      0.00      4.23
02:27:01 AM      0.17      0.00      0.17      0.00      2.73
02:28:01 AM      0.17      0.00      0.17      0.00      3.75
02:29:01 AM      0.13      0.00      0.13      0.00      4.95
02:30:01 AM      0.15      0.00      0.15      0.00      2.95
02:31:01 AM      0.48      0.00      0.48      0.00     11.46
02:32:01 AM      0.22      0.00      0.22      0.00      3.23
02:33:01 AM      0.17      0.00      0.17      0.00     10.96
02:34:01 AM      0.12      0.00      0.12      0.00      8.13
02:35:01 AM      0.22      0.00      0.22      0.00     17.31
02:36:01 AM      0.28      0.00      0.28      0.00     18.61
02:37:01 AM      0.10      0.00      0.10      0.00      8.06
02:38:01 AM      0.33      0.00      0.33      0.00     15.73
02:39:01 AM      0.22      0.00      0.22      0.00     16.14
02:40:01 AM      0.17      0.00      0.17      0.00     20.25
02:41:01 AM      0.22      0.00      0.22      0.00      3.00
02:42:01 AM      0.25      0.00      0.25      0.00      3.92
02:43:01 AM      0.17      0.00      0.17      0.00      3.20
02:44:01 AM      0.20      0.00      0.20      0.00      2.90
02:45:01 AM      0.25      0.00      0.25      0.00      4.70
02:46:01 AM      0.25      0.00      0.25      0.00      3.03
02:47:01 AM      0.22      0.00      0.22      0.00      9.50
02:48:01 AM      0.15      0.00      0.15      0.00      6.78
02:49:01 AM      0.15      0.00      0.15      0.00      1.88
02:50:01 AM      0.18      0.00      0.18      0.00      1.92
02:51:01 AM      0.22      0.00      0.22      0.00      3.47
02:52:01 AM      0.37      0.00      0.37      0.00      6.15
02:53:01 AM      0.23      0.00      0.23      0.00      7.08
02:54:01 AM      0.27      0.00      0.27      0.00      4.05
02:55:01 AM      0.17      0.00      0.17      0.00      6.80
02:56:01 AM      0.20      0.00      0.20      0.00      9.96
02:57:01 AM      0.25      0.00      0.25      0.00     15.79
02:58:02 AM      0.15      0.00      0.15      0.00     14.66
02:59:01 AM      0.12      0.00      0.12      0.00      6.91
03:00:01 AM      0.15      0.00      0.15      0.00     16.40
03:01:01 AM      0.33      0.00      0.33      0.00     17.71
03:02:01 AM      0.38      0.00      0.38      0.00     25.62
03:03:01 AM      0.13      0.00      0.13      0.00      2.93
03:04:01 AM      0.13      0.00      0.13      0.00      1.43
03:05:01 AM      0.12      0.00      0.12      0.00      2.12
03:06:01 AM      0.25      0.00      0.25      0.00      3.12
03:07:01 AM      0.28      0.00      0.28      0.00      5.01
03:08:01 AM      0.18      0.00      0.18      0.00      3.35
03:09:01 AM      0.08      0.00      0.08      0.00      0.50
03:10:01 AM      0.13      0.00      0.13      0.00     10.00
03:11:01 AM      0.20      0.00      0.20      0.00      7.95
03:12:01 AM      1.00      0.00      1.00      0.00     27.41
03:13:01 AM      0.40      0.00      0.40      0.00     14.41
03:14:01 AM      0.18      0.00      0.18      0.00     16.01
03:15:01 AM      0.15      0.00      0.15      0.00     14.30
03:16:01 AM      0.15      0.00      0.15      0.00      7.80
03:17:01 AM      0.22      0.00      0.22      0.00     16.16
03:18:01 AM      0.17      0.00      0.17      0.00     20.03
03:19:01 AM      0.22      0.00      0.22      0.00      4.12
03:20:01 AM      0.15      0.00      0.15      0.00      1.85
03:21:01 AM      0.33      0.00      0.33      0.00      7.18
03:22:01 AM      0.15      0.00      0.15      0.00      2.65
03:23:01 AM      0.15      0.00      0.15      0.00      1.08
03:24:01 AM      0.13      0.00      0.13      0.00      3.07
03:25:01 AM      0.13      0.00      0.13      0.00      0.92
03:26:01 AM      0.43      0.00      0.43      0.00     17.81
03:27:01 AM      0.17      0.00      0.17      0.00      3.48
03:28:01 AM      0.17      0.00      0.17      0.00     15.23
03:29:01 AM      0.18      0.00      0.18      0.00     11.88
03:30:01 AM      0.17      0.00      0.17      0.00     14.83
03:31:01 AM      0.63      0.00      0.63      0.00     19.04
03:32:01 AM      0.15      0.00      0.15      0.00     14.26
03:33:01 AM      0.25      0.00      0.25      0.00      9.61
03:34:01 AM      0.20      0.00      0.20      0.00     23.21
03:35:01 AM      0.13      0.00      0.13      0.00      1.98
03:36:01 AM      0.25      0.00      0.25      0.00      4.33
03:37:01 AM      0.13      0.00      0.13      0.00      2.40
03:38:01 AM      0.12      0.00      0.12      0.00      1.17
03:39:01 AM      0.12      0.00      0.12      0.00      2.53
03:40:01 AM      0.15      0.00      0.15      0.00      1.50
03:41:01 AM      0.48      0.00      0.48      0.00      8.40
03:42:01 AM      0.33      0.00      0.33      0.00     14.33
03:43:01 AM      0.15      0.00      0.15      0.00     10.80
03:44:01 AM      0.27      0.00      0.27      0.00     14.15
03:45:01 AM      0.50      0.00      0.50      0.00     15.86
03:46:01 AM      0.53      0.00      0.53      0.00     16.08
03:47:01 AM      0.20      0.00      0.20      0.00     15.19
03:48:01 AM      0.20      0.00      0.20      0.00     12.30
03:49:01 AM      0.12      0.00      0.12      0.00     19.66
03:50:01 AM      0.18      0.00      0.18      0.00      8.23
03:51:01 AM      0.40      0.00      0.40      0.00      6.65
03:52:01 AM      0.25      0.00      0.25      0.00      4.83
03:53:01 AM      0.23      0.00      0.23      0.00      4.05
03:54:01 AM      0.13      0.00      0.13      0.00      1.68
03:55:01 AM      0.15      0.00      0.15      0.00      3.58
03:56:01 AM      0.15      0.00      0.15      0.00      1.50
03:57:01 AM      0.30      0.00      0.30      0.00     10.83
03:58:01 AM      0.37      0.00      0.37      0.00     12.85
03:59:01 AM      0.17      0.00      0.17      0.00     11.45
04:00:01 AM      0.28      0.00      0.28      0.00      7.50
04:01:01 AM      0.35      0.00      0.35      0.00     13.23
04:02:01 AM      0.33      0.00      0.33      0.00     11.36
04:03:01 AM      0.33      0.00      0.33      0.00     10.58
04:04:01 AM      9.36      0.22      9.15     31.99    476.44
04:05:02 AM     23.15      0.42     22.73     48.26   2711.40
Average:         0.52      0.12      0.40      5.02     41.21

12:00:01 AM kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty
12:01:01 AM   4973448   7020760   2908988     36.90      2688   2217060    717884      8.04    269648   2265368         8
12:02:01 AM   4973872   7021296   2908564     36.90      2688   2217172    717884      8.04    269716   2265284        48
12:03:01 AM   4973752   7021292   2908684     36.90      2688   2217288    717884      8.04    269716   2265216         4
12:04:01 AM   4973460   7021132   2908976     36.90      2688   2217420    717884      8.04    269716   2265604        56
12:05:01 AM   4973748   7021536   2908688     36.90      2688   2217536    717884      8.04    269716   2265428         8
12:06:01 AM   4973792   7021668   2908644     36.90      2688   2217624    717884      8.04    269716   2265572         4
12:07:01 AM   4972680   7020560   2909756     36.91      2688   2217628    711488      7.97    269716   2266152         4
12:08:01 AM   4973276   7021576   2909160     36.91      2688   2218048    719588      8.06    269760   2265960        88
12:09:01 AM   4973200   7021500   2909236     36.91      2688   2218048    719588      8.06    269760   2265964         4
12:10:01 AM   4972508   7020912   2909928     36.92      2688   2218152    719588      8.06    269760   2266296       112
12:11:01 AM   4971040   7019616   2911396     36.94      2688   2218324    735344      8.23    269760   2268296        24
12:12:01 AM   4970612   7019536   2911824     36.94      2688   2218672    735344      8.23    269760   2268796       192
12:13:01 AM   4970192   7019464   2912244     36.95      2688   2219020    735344      8.23    269760   2269072       112
12:14:01 AM   4969796   7019428   2912640     36.95      2688   2219380    739012      8.27    269760   2269632        48
12:15:01 AM   4803736   7018528   3078700     39.06      2688   2384304    737028      8.25    356212   2348040       200
12:16:01 AM   4803008   7018164   3079428     39.07      2688   2384660    737028      8.25    356212   2349060       152
12:17:01 AM   4801184   7016852   3081252     39.09      2688   2385172    737028      8.25    356212   2351064       232
12:18:01 AM   4800976   7016976   3081460     39.09      2688   2385504    737028      8.25    356212   2351296         0
12:19:01 AM   4800660   7016664   3081776     39.10      2688   2385508    737028      8.25    356212   2351300         4
12:20:01 AM   4800268   7016272   3082168     39.10      2688   2385516    721764      8.08    356212   2351568        16
12:21:01 AM   4800680   7016736   3081756     39.10      2688   2385552    721764      8.08    356212   2351384         4
12:22:01 AM   4800712   7016768   3081724     39.10      2688   2385552    721764      8.08    356212   2351384         4
12:23:01 AM   4800684   7016788   3081752     39.10      2688   2385600    721764      8.08    356212   2351432         4
12:24:01 AM   4800768   7016876   3081668     39.10      2688   2385604    721764      8.08    356212   2351436         4
12:25:01 AM   4802608   7018896   3079828     39.07      2688   2385784    721764      8.08    356212   2349556        16
12:26:01 AM   4802316   7018740   3080120     39.08      2688   2385936    721764      8.08    356212   2349776       104
12:27:01 AM   4802316   7018760   3080120     39.08      2688   2385940    721764      8.08    356212   2349868         4
12:28:01 AM   4802436   7018880   3080000     39.07      2688   2385940    721764      8.08    356212   2349732         4
12:29:01 AM   4802312   7018892   3080124     39.08      2688   2386076    721764      8.08    356212   2349992        32
12:30:01 AM   4801912   7018492   3080524     39.08      2688   2386076    740840      8.30    356212   2349992         4
12:31:01 AM   4802116   7018756   3080320     39.08      2688   2386132    740840      8.30    356212   2349928        56
12:32:01 AM   4801916   7018608   3080520     39.08      2688   2386184    740840      8.30    356212   2350120        52
12:33:01 AM   4801760   7018456   3080676     39.08      2688   2386188    740840      8.30    356212   2350256         4
12:34:01 AM   4801908   7018652   3080528     39.08      2688   2386236    740840      8.30    356212   2350112        68
12:35:01 AM   4801444   7018284   3080992     39.09      2688   2386332    740840      8.30    356212   2350444         4
12:36:01 AM   4801720   7018564   3080716     39.08      2688   2386336    740840      8.30    356212   2350312         4
12:37:01 AM   4801752   7018652   3080684     39.08      2688   2386392    740840      8.30    356212   2350496         4
12:38:01 AM   4801404   7018644   3081032     39.09      2688   2386732    740840      8.30    356316   2350584       104
12:39:01 AM   4801500   7018744   3080936     39.09      2688   2386736    740840      8.30    356316   2350588         4
12:40:01 AM   4801048   7018348   3081388     39.09      2688   2386792    740840      8.30    356316   2350976        64
12:41:01 AM   4800824   7018224   3081612     39.09      2688   2386892    740840      8.30    356316   2351056       108
12:42:01 AM   4800864   7018264   3081572     39.09      2688   2386892    740840      8.30    356316   2350884        16
12:43:01 AM   4800676   7018208   3081760     39.10      2688   2387024    740840      8.30    356316   2351080       140
12:44:02 AM   4798800   7016592   3083636     39.12      2688   2387292    741268      8.30    356316   2353248       128
12:45:01 AM   4797772   7015924   3084664     39.13      2688   2387644    741268      8.30    356316   2354044        92
12:46:01 AM   4797800   7016284   3084636     39.13      2688   2387984    741268      8.30    356316   2354064        92
12:47:01 AM   4796988   7015832   3085448     39.14      2688   2388352    741268      8.30    356316   2354884        24
12:48:01 AM   4797160   7016364   3085276     39.14      2688   2388704    741268      8.30    356316   2354904       168
12:49:01 AM   4796892   7016444   3085544     39.14      2688   2389060    741268      8.30    356316   2355252       104
12:50:01 AM   4795284   7015500   3087152     39.16      2688   2389724    741268      8.30    356316   2356576        24
12:51:01 AM   4795516   7015812   3086920     39.16      2688   2389796    741268      8.30    356316   2356544         4
12:52:01 AM   4795472   7015772   3086964     39.16      2688   2389800    741268      8.30    356316   2356616         4
12:53:01 AM   4795368   7015708   3087068     39.16      2688   2389840    741268      8.30    356316   2356588        48
12:54:01 AM   4795488   7015828   3086948     39.16      2688   2389840    741268      8.30    356316   2356588         4
12:55:01 AM   4795404   7015796   3087032     39.16      2688   2389892    741268      8.30    356316   2356636        56
12:56:01 AM   4795360   7015752   3087076     39.16      2688   2389892    741268      8.30    356316   2356640         4
12:57:01 AM   4795180   7015572   3087256     39.17      2688   2389892    741268      8.30    356316   2356912         4
12:58:01 AM   4797324   7017908   3085112     39.14      2688   2390080    719104      8.05    356316   2354772        16
12:59:01 AM   4797184   7017916   3085252     39.14      2688   2390228    719104      8.05    356348   2354888         4
01:00:01 AM   4795952   7016680   3086484     39.16      2688   2390228    742588      8.31    356348   2355468         4
01:01:01 AM   4796148   7016928   3086288     39.15      2688   2390280    742588      8.31    356352   2355516        48
01:02:01 AM   4796788   7017676   3085648     39.15      2688   2390384    742588      8.31    356376   2355084        96
01:03:01 AM   4796672   7017564   3085764     39.15      2688   2390388    742588      8.31    356376   2355136         4
01:04:01 AM   4796436   7017384   3086000     39.15      2688   2390444    742588      8.31    356376   2355464        76
01:05:01 AM   4796644   7017784   3085792     39.15      2688   2390636    742588      8.31    356376   2355268       100
01:06:01 AM   4796012   7017204   3086424     39.16      2688   2390692    742588      8.31    356376   2355784        68
01:07:01 AM   4796152   7017548   3086284     39.15      2688   2390896    742588      8.31    356376   2355716       116
01:08:01 AM   4796020   7017416   3086416     39.16      2688   2390896    742588      8.31    356376   2355748        12
01:09:01 AM   4796208   7017604   3086228     39.15      2688   2390896    742588      8.31    356376   2355824         8
01:10:01 AM   4795576   7017116   3086860     39.16      2688   2391040    742588      8.31    356384   2356320        92
01:11:01 AM   4796252   7017792   3086184     39.15      2688   2391040    742588      8.31    356384   2355700         4
01:12:01 AM   4795964   7017644   3086472     39.16      2688   2391180    723764      8.10    356384   2355948       144
01:13:01 AM   4793644   7015508   3088792     39.19      2688   2391372    740212      8.29    356384   2358196       128
01:14:01 AM   4793112   7015328   3089324     39.19      2688   2391716    740212      8.29    356384   2358744        72
01:15:01 AM   4793148   7015716   3089288     39.19      2688   2392068    740212      8.29    356384   2358848       208
01:16:01 AM   4792808   7015736   3089628     39.20      2688   2392428    740212      8.29    356388   2359284       120
01:17:01 AM   4792024   7015304   3090412     39.21      2688   2392780    740212      8.29    356388   2359672        48
01:18:01 AM   4792280   7015916   3090156     39.20      2688   2393132    740212      8.29    356388   2359604        20
01:19:01 AM   4791068   7015416   3091368     39.22      2688   2393844    740212      8.29    356388   2361028       480
01:20:01 AM   4790744   7015176   3091692     39.22      2688   2393928    732372      8.20    356388   2361296         4
01:21:01 AM   4791024   7015460   3091412     39.22      2688   2393932    732372      8.20    356392   2361080         4
01:22:01 AM   4790840   7015320   3091596     39.22      2688   2393976    732372      8.20    356392   2361192        48
01:23:01 AM   4790184   7014668   3092252     39.23      2688   2393980    732372      8.20    356392   2361984        12
01:24:01 AM   4789916   7014400   3092520     39.23      2688   2393988    732372      8.20    356392   2362128        28
01:25:01 AM   4789896   7014428   3092540     39.23      2688   2394028    732372      8.20    356392   2362220         4
01:26:01 AM   4790088   7014624   3092348     39.23      2688   2394032    732372      8.20    356392   2362020         4
01:27:01 AM   4791856   7016572   3090580     39.21      2688   2394212    731624      8.19    356392   2360212        16
01:28:01 AM   4791052   7015920   3091384     39.22      2688   2394364    754048      8.44    356392   2360644       112
01:29:01 AM   4791744   7016620   3090692     39.21      2688   2394368    722332      8.09    365660   2351040         4
01:30:01 AM   4791312   7016228   3091124     39.22      2688   2394408    722444      8.09    365660   2351312        48
01:31:01 AM   4791640   7016672   3090796     39.21      2688   2394524    722444      8.09    365660   2351204       104
01:32:01 AM   4791580   7016612   3090856     39.21      2688   2394524    722444      8.09    365660   2351272         4
01:33:01 AM   4791404   7016480   3091032     39.21      2688   2394568    722444      8.09    365660   2351448        52
01:34:01 AM   4791360   7016488   3091076     39.21      2688   2394620    722444      8.09    365660   2351436        12
01:35:01 AM   4791200   7016328   3091236     39.22      2688   2394620    722444      8.09    365660   2351508        12
01:36:01 AM   4791556   7016740   3090880     39.21      2688   2394676    722444      8.09    365660   2351360         8
01:37:01 AM   4791184   7016468   3091252     39.22      2688   2394776    722444      8.09    365660   2351536         4
01:38:01 AM   4791268   7016552   3091168     39.22      2688   2394776    722444      8.09    365660   2351468         4
01:39:01 AM   4791328   7016716   3091108     39.22      2688   2394880    722444      8.09    365660   2351564        48
01:40:01 AM   4790884   7016380   3091552     39.22      2688   2394988    720908      8.07    365660   2351804       104
01:41:01 AM   4791172   7016672   3091264     39.22      2688   2394992    720908      8.07    365660   2351692         4
01:42:01 AM   4791132   7016696   3091304     39.22      2688   2395056    720908      8.07    365660   2351856        72
01:43:01 AM   4790992   7016652   3091444     39.22      2688   2395152    720908      8.07    365660   2351836         4
01:44:01 AM   4790940   7016600   3091496     39.22      2688   2395152    720908      8.07    365660   2351836         4
01:45:01 AM   4790976   7016772   3091460     39.22      2688   2395288    720908      8.07    365660   2351964        16
01:46:01 AM   4788396   7014508   3094040     39.25      2688   2395604    721808      8.08    365660   2354348       192
01:47:01 AM   4788040   7014504   3094396     39.26      2688   2395964    721808      8.08    365660   2354884         4
01:48:01 AM   4787528   7014332   3094908     39.26      2688   2396304    721808      8.08    365660   2355228        24
01:49:01 AM   4787448   7014616   3094988     39.26      2688   2396668    721808      8.08    365660   2355476        24
01:50:01 AM   4786808   7014332   3095628     39.27      2688   2397016    730824      8.18    365660   2355952       132
01:51:01 AM   4786704   7014576   3095732     39.27      2688   2397364    730824      8.18    365660   2356188       100
01:52:01 AM   4786068   7014572   3096368     39.28      2688   2397996    730824      8.18    365660   2356888        24
01:53:01 AM   4785884   7014452   3096552     39.28      2688   2398052    730824      8.18    365660   2357008         4
01:54:01 AM   4785896   7014468   3096540     39.28      2688   2398056    730824      8.18    365660   2356896         4
01:55:01 AM   4785752   7014360   3096684     39.29      2688   2398092    730824      8.18    365660   2356932         4
01:56:01 AM   4785836   7014444   3096600     39.28      2688   2398092    730824      8.18    365660   2356936         4
01:57:01 AM   4785760   7014420   3096676     39.29      2688   2398144    730824      8.18    365660   2357056        56
01:58:01 AM   4785996   7014656   3096440     39.28      2688   2398144    730824      8.18    365660   2356992         4
01:59:01 AM   4787708   7016480   3094728     39.26      2688   2398264    711424      7.97    365660   2355220       128
02:00:01 AM   4787316   7016204   3095120     39.27      2688   2398372    729656      8.17    365660   2355468        56
02:01:01 AM   4786032   7015028   3096404     39.28      2688   2398476    729656      8.17    365668   2356252         4
02:02:01 AM   4787088   7016092   3095348     39.27      2688   2398484    729656      8.17    365692   2355560         4
02:03:01 AM   4787080   7016132   3095356     39.27      2688   2398532    729656      8.17    365692   2355620        56
02:04:01 AM   4787216   7016364   3095220     39.27      2688   2398628    729656      8.17    365692   2355696        48
02:05:01 AM   4787036   7016252   3095400     39.27      2688   2398696    729656      8.17    365692   2355720        64
02:06:01 AM   4787076   7016420   3095360     39.27      2688   2398840    729656      8.17    365696   2355776       104
02:07:01 AM   4787000   7016360   3095436     39.27      2688   2398840    729656      8.17    365696   2355860         4
02:08:01 AM   4787084   7016448   3095352     39.27      2688   2398844    729656      8.17    365696   2355912         4
02:09:01 AM   4784748   7014320   3097688     39.30      2688   2399052    729656      8.17    365696   2358068        88
02:10:01 AM   4783988   7013912   3098448     39.31      2688   2399412    734508      8.22    365696   2358648       136
02:11:01 AM   4784000   7014292   3098436     39.31      2688   2399772    734508      8.22    365696   2358784        96
02:12:01 AM   4783384   7014028   3099052     39.32      2688   2400124    734508      8.22    365696   2359460        64
02:13:01 AM   4783176   7014160   3099260     39.32      2688   2400472    734508      8.22    365696   2359600        16
02:14:01 AM   4782732   7014080   3099704     39.32      2688   2400828    734508      8.22    365696   2359964         4
02:15:01 AM   4782548   7014252   3099888     39.33      2688   2401180    734508      8.22    365696   2360316        96
02:16:01 AM   4781980   7014232   3100456     39.33      2688   2401728    734508      8.22    365696   2360872        60
02:17:01 AM   4781936   7014188   3100500     39.33      2688   2401728    734508      8.22    365696   2360944         4
02:18:01 AM   4781688   7013940   3100748     39.34      2688   2401728    734508      8.22    365696   2360944         4
02:19:01 AM   4781656   7013952   3100780     39.34      2688   2401772    734508      8.22    365696   2360988         4
02:20:01 AM   4781456   7013752   3100980     39.34      2688   2401772    723876      8.11    365696   2361104         4
02:21:01 AM   4781640   7013984   3100796     39.34      2688   2401820    723876      8.11    365696   2361036         4
02:22:01 AM   4781792   7014140   3100644     39.34      2688   2401824    723876      8.11    365696   2361040         4
02:23:01 AM   4783312   7015836   3099124     39.32      2688   2402000    707488      7.92    365704   2359084       184
02:24:01 AM   4783436   7016024   3099000     39.32      2688   2402064    726192      8.13    365696   2359224        24
02:25:01 AM   4783528   7016208   3098908     39.31      2688   2402156    726192      8.13    365696   2359404         4
02:26:01 AM   4783448   7016128   3098988     39.32      2688   2402156    726192      8.13    365700   2359384         0
02:27:01 AM   4783276   7016064   3099160     39.32      2688   2402264    726192      8.13    365704   2359428        72
02:28:01 AM   4783160   7016016   3099276     39.32      2688   2402332    726192      8.13    365704   2359496        64
02:29:01 AM   4782920   7015880   3099516     39.32      2688   2402436    726192      8.13    365704   2359716        48
02:30:01 AM   4782868   7015924   3099568     39.32      2688   2402532    715684      8.01    365704   2359812        88
02:31:01 AM   4783004   7016064   3099432     39.32      2688   2402536    715684      8.01    365704   2359704         4
02:32:01 AM   4782852   7016048   3099584     39.32      2688   2402672    715684      8.01    365704   2359832       144
02:33:01 AM   4780260   7013664   3102176     39.36      2688   2402880    732556      8.20    365704   2362228        76
02:34:01 AM   4780160   7013916   3102276     39.36      2688   2403232    732556      8.20    365704   2362460       212
02:35:01 AM   4779628   7013736   3102808     39.36      2688   2403584    732556      8.20    365704   2362824       112
02:36:01 AM   4779560   7014012   3102876     39.36      2688   2403936    732556      8.20    365704   2363156        40
02:37:01 AM   4779120   7013900   3103316     39.37      2688   2404264    732556      8.20    365704   2363668       160
02:38:01 AM   4778956   7014096   3103480     39.37      2688   2404624    732556      8.20    365704   2363864       184
02:39:01 AM   4778068   7013904   3104368     39.38      2688   2405308    732556      8.20    365704   2364560       468
02:40:01 AM   4777788   7013712   3104648     39.39      2688   2405396    753292      8.43    365704   2364884         4
02:41:01 AM   4777916   7013844   3104520     39.39      2688   2405400    753292      8.43    365704   2364656         4
02:42:01 AM   4778000   7013964   3104436     39.38      2688   2405436    753292      8.43    365704   2364760        44
02:43:01 AM   4778060   7014024   3104376     39.38      2688   2405436    753292      8.43    365704   2364692         4
02:44:01 AM   4777648   7013616   3104788     39.39      2688   2405448    753292      8.43    365704   2364836        16
02:45:01 AM   4777744   7013760   3104692     39.39      2688   2405488    753292      8.43    365704   2364896         4
02:46:01 AM   4778000   7014020   3104436     39.38      2688   2405492    753292      8.43    365704   2364772         4
02:47:01 AM   4779180   7015388   3103256     39.37      2688   2405680    737528      8.26    365704   2363296        16
02:48:01 AM   4779256   7015604   3103180     39.37      2688   2405820    737528      8.26    365708   2363324         4
02:49:01 AM   4779640   7015988   3102796     39.36      2688   2405820    737528      8.26    365708   2363052         4
02:50:01 AM   4779328   7015720   3103108     39.37      2688   2405864    723872      8.11    365708   2363216        48
02:51:01 AM   4779544   7015948   3102892     39.36      2688   2405876    723872      8.11    365708   2363112         4
02:52:01 AM   4779396   7015852   3103040     39.37      2688   2405928    723872      8.11    365708   2363352        56
02:53:01 AM   4779548   7016096   3102888     39.36      2688   2406020    723872      8.11    365712   2363256         8
02:54:01 AM   4779280   7015828   3103156     39.37      2688   2406020    723872      8.11    365712   2363256         4
02:55:01 AM   4779008   7015704   3103428     39.37      2688   2406168    723872      8.11    365712   2363512         4
02:56:01 AM   4776764   7013792   3105672     39.40      2688   2406508    723872      8.11    365712   2365788       108
02:57:01 AM   4776464   7013836   3105972     39.40      2688   2406844    723872      8.11    365712   2366200        64
02:58:02 AM   4776172   7013896   3106264     39.41      2688   2407204    723872      8.11    365712   2366484        16
02:59:01 AM   4775748   7013820   3106688     39.41      2688   2407552    723872      8.11    365712   2366832       184
03:00:01 AM   4775176   7013604   3107260     39.42      2688   2407908    723860      8.11    365712   2367304        80
03:01:01 AM   4774016   7012800   3108420     39.43      2688   2408256    723860      8.11    365712   2368356        92
03:02:01 AM   4774360   7013728   3108076     39.43      2688   2408848    723860      8.11    365712   2368240        28
03:03:01 AM   4774204   7013620   3108232     39.43      2688   2408888    723860      8.11    365712   2368484         4
03:04:01 AM   4774380   7013800   3108056     39.43      2688   2408892    723860      8.11    365712   2368352         4
03:05:01 AM   4774352   7013812   3108084     39.43      2688   2408932    723860      8.11    365712   2368276         4
03:06:01 AM   4774352   7013812   3108084     39.43      2688   2408932    723860      8.11    365712   2368276         4
03:07:01 AM   4774188   7013700   3108248     39.43      2688   2408984    723860      8.11    365712   2368328        56
03:08:01 AM   4774252   7013764   3108184     39.43      2688   2408984    739240      8.28    365712   2368328         4
03:09:01 AM   4776356   7016016   3106080     39.41      2688   2409132    718172      8.04    365712   2366428       156
03:10:01 AM   4775504   7015304   3106932     39.42      2688   2409296    718172      8.04    365712   2366784        48
03:11:01 AM   4773840   7013856   3108596     39.44      2688   2409488    733004      8.21    365712   2368944        48
03:12:01 AM   4773420   7013792   3109016     39.44      2688   2409848    742332      8.31    366692   2368208        28
03:13:01 AM   4773212   7013928   3109224     39.44      2688   2410192    742332      8.31    366692   2368556       136
03:14:01 AM   4772832   7013908   3109604     39.45      2688   2410544    742332      8.31    366692   2368916        48
03:15:01 AM   4772372   7013808   3110064     39.46      2688   2410904    742332      8.31    366692   2369276         4
03:16:01 AM   4771980   7013752   3110456     39.46      2688   2411248    742332      8.31    366692   2369612       152
03:17:01 AM   4771548   7013940   3110888     39.47      2688   2411868    726452      8.13    366692   2370252       372
03:18:01 AM   4771448   7014044   3110988     39.47      2688   2412072    726452      8.13    366692   2370452         4
03:19:01 AM   4771324   7013980   3111112     39.47      2688   2412124    726452      8.13    366692   2370556         4
03:20:01 AM   4771024   7013680   3111412     39.47      2688   2412124    744180      8.33    366692   2370672         4
03:21:01 AM   4770952   7013652   3111484     39.47      2688   2412168    744180      8.33    366692   2370808         4
03:22:01 AM   4770992   7013692   3111444     39.47      2688   2412168    744180      8.33    366692   2370696         4
03:23:01 AM   4770768   7013516   3111668     39.48      2688   2412216    744180      8.33    366692   2370972        56
03:24:01 AM   4770828   7013580   3111608     39.48      2688   2412220    744180      8.33    366692   2370860         4
03:25:01 AM   4772160   7015048   3110276     39.46      2688   2412364    727132      8.14    366692   2369412       152
03:26:01 AM   4769284   7012348   3113152     39.49      2688   2412532    727132      8.14    366692   2372404        24
03:27:01 AM   4768752   7011964   3113684     39.50      2688   2412688    727132      8.14    366692   2372876       120
03:28:01 AM   4768592   7012164   3113844     39.50      2688   2413040    727132      8.14    366692   2373236        48
03:29:01 AM   4767924   7011844   3114512     39.51      2688   2413396    727132      8.14    366692   2373588       100
03:30:01 AM   4766044   7010312   3116392     39.54      2688   2413744    741988      8.31    366692   2375380        40
03:31:01 AM   4766288   7010920   3116148     39.53      2688   2414104    741988      8.31    366692   2375452        64
03:32:01 AM   4765760   7010736   3116676     39.54      2688   2414440    741988      8.31    366692   2375712         4
03:33:01 AM   4765004   7010452   3117432     39.55      2688   2414912    741988      8.31    366692   2376684       280
03:34:01 AM   4765012   7010848   3117424     39.55      2688   2415300    741988      8.31    366692   2376652        28
03:35:01 AM   4764860   7010696   3117576     39.55      2688   2415300    741988      8.31    366692   2376768         4
03:36:01 AM   4764920   7010768   3117516     39.55      2688   2415312    741988      8.31    366692   2376664        16
03:37:01 AM   4764872   7010752   3117564     39.55      2688   2415344    741988      8.31    366692   2376768         4
03:38:01 AM   4764988   7010868   3117448     39.55      2688   2415344    741988      8.31    366692   2376700         4
03:39:01 AM   4764964   7010896   3117472     39.55      2688   2415396    741988      8.31    366692   2376760         4
03:40:01 AM   4764724   7010656   3117712     39.55      2688   2415396    725988      8.13    366692   2376876         4
03:41:01 AM   4764768   7010876   3117668     39.55      2688   2415576    725988      8.13    366692   2376940       184
03:42:01 AM   4764348   7010620   3118088     39.56      2688   2415740    725988      8.13    366692   2377164        36
03:43:01 AM   4764332   7010876   3118104     39.56      2688   2416012    725988      8.13    366692   2377356        16
03:44:01 AM   4763928   7010832   3118508     39.56      2688   2416376    725988      8.13    366692   2377744        16
03:45:01 AM   4763556   7010804   3118880     39.57      2688   2416720    725988      8.13    366692   2378088        24
03:46:01 AM   4763256   7010860   3119180     39.57      2688   2417076    725988      8.13    366692   2378436        80
03:47:01 AM   4762428   7010380   3120008     39.58      2688   2417416    741604      8.30    366692   2379172        32
03:48:01 AM   4762448   7010752   3119988     39.58      2688   2417776    741604      8.30    366692   2379144        64
03:49:01 AM   4761832   7010772   3120604     39.59      2688   2418404    741604      8.30    366692   2379780       128
03:50:01 AM   4761552   7010568   3120884     39.59      2688   2418480    734180      8.22    366692   2379976         4
03:51:01 AM   4761752   7010768   3120684     39.59      2688   2418480    734180      8.22    366692   2379860         4
03:52:01 AM   4761768   7010824   3120668     39.59      2688   2418520    734180      8.22    366692   2379968        44
03:53:01 AM   4761852   7010908   3120584     39.59      2688   2418520    734180      8.22    366692   2379900         4
03:54:01 AM   4761740   7010844   3120696     39.59      2688   2418568    734180      8.22    366692   2379944        56
03:55:01 AM   4761656   7010764   3120780     39.59      2688   2418572    734180      8.22    366692   2380068         4
03:56:01 AM   4761736   7010844   3120700     39.59      2688   2418572    734180      8.22    366692   2379952         4
03:57:01 AM   4761056   7010484   3121380     39.60      2688   2418900    734180      8.22    366692   2380428       160
03:58:01 AM   4760416   7010044   3122020     39.61      2688   2419092    767908      8.60    366696   2380824        72
03:59:01 AM   4757204   7007040   3125232     39.65      2688   2419300    783372      8.77    366696   2383648         4
04:00:01 AM   4756940   7006976   3125496     39.65      2688   2419492    818968      9.17    366696   2383948        40
04:01:01 AM   4753596   7003860   3128840     39.69      2688   2419720    842264      9.43    366696   2386900         4
04:02:01 AM   4753884   7004340   3128552     39.69      2688   2419912    857668      9.60    366704   2386596        20
04:03:01 AM   4751480   7002132   3130956     39.72      2688   2420108    890548      9.97    366704   2388940        16
04:04:01 AM   4826316   6960732   3056120     38.77      2688   2308672    703092      7.87    424580   2274768     66076
04:05:02 AM   4832488   6970832   3049948     38.69      2688   2313104    702208      7.86    584336   2113356      3788
Average:      4794791   7014705   3087645     39.17      2688   2389454    734205      8.22    358719   2355017       338

12:00:01 AM     IFACE   rxpck/s   txpck/s    rxkB/s    txkB/s   rxcmp/s   txcmp/s  rxmcst/s   %ifutil
12:01:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:01:01 AM      eth0      0.70      0.13      0.15      0.02      0.00      0.00      0.00      0.00
12:02:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:02:01 AM      eth0      3.56      3.05      0.62      0.28      0.00      0.00      0.00      0.00
12:03:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:03:01 AM      eth0      4.57      3.38      0.77      0.32      0.00      0.00      0.00      0.00
12:04:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:04:01 AM      eth0     10.31      8.50      2.12      1.07      0.00      0.00      0.00      0.00
12:05:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:05:01 AM      eth0      4.75      4.32      0.72      0.39      0.00      0.00      0.00      0.00
12:06:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:06:01 AM      eth0      4.97      0.18      0.50      0.02      0.00      0.00      0.00      0.00
12:07:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:07:01 AM      eth0      4.00      0.30      0.64      0.26      0.00      0.00      0.00      0.00
12:08:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:08:01 AM      eth0      4.13      3.90      0.63      0.32      0.00      0.00      0.00      0.00
12:09:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:09:01 AM      eth0      0.42      0.07      0.02      0.00      0.00      0.00      0.00      0.00
12:10:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:10:01 AM      eth0      2.50      2.37      0.49      0.45      0.00      0.00      0.00      0.00
12:11:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:11:01 AM      eth0      9.48      9.25      1.60      1.03      0.00      0.00      0.00      0.00
12:12:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:12:01 AM      eth0      9.97      9.82      2.17      1.87      0.00      0.00      0.00      0.00
12:13:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:13:01 AM      eth0     12.53      9.30      2.17      1.74      0.00      0.00      0.00      0.00
12:14:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:14:01 AM      eth0     10.06      9.72      2.05      1.81      0.00      0.00      0.00      0.00
12:15:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:15:01 AM      eth0     88.77     66.56   1020.88      5.78      0.00      0.00      0.00      0.00
12:16:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:16:01 AM      eth0     11.60     10.06      2.35      2.02      0.00      0.00      0.00      0.00
12:17:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:17:01 AM      eth0     12.80     13.05      2.91      2.53      0.00      0.00      0.00      0.00
12:18:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:18:01 AM      eth0      7.52      6.97      1.61      1.22      0.00      0.00      0.00      0.00
12:19:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:19:01 AM      eth0      0.25      0.05      0.01      0.00      0.00      0.00      0.00      0.00
12:20:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:20:01 AM      eth0      0.33      0.17      0.07      0.01      0.00      0.00      0.00      0.00
12:21:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:21:01 AM      eth0      0.73      0.22      0.11      0.03      0.00      0.00      0.00      0.00
12:22:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:22:01 AM      eth0      0.58      0.17      0.14      0.07      0.00      0.00      0.00      0.00
12:23:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:23:01 AM      eth0      0.50      0.25      0.05      0.03      0.00      0.00      0.00      0.00
12:24:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:24:01 AM      eth0      0.37      0.10      0.07      0.01      0.00      0.00      0.00      0.00
12:25:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:25:01 AM      eth0      7.47      7.42      1.53      0.92      0.00      0.00      0.00      0.00
12:26:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:26:01 AM      eth0      4.55      3.88      0.82      0.42      0.00      0.00      0.00      0.00
12:27:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:27:01 AM      eth0      0.72      0.35      0.34      0.26      0.00      0.00      0.00      0.00
12:28:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:28:01 AM      eth0      0.28      0.10      0.01      0.01      0.00      0.00      0.00      0.00
12:29:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:29:01 AM      eth0      3.65      3.45      0.62      0.30      0.00      0.00      0.00      0.00
12:30:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:30:01 AM      eth0      0.42      0.15      0.08      0.02      0.00      0.00      0.00      0.00
12:31:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:31:01 AM      eth0      3.78      3.32      0.66      0.24      0.00      0.00      0.00      0.00
12:32:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:32:01 AM      eth0      1.58      0.65      0.34      0.21      0.00      0.00      0.00      0.00
12:33:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:33:01 AM      eth0      0.33      0.18      0.25      0.19      0.00      0.00      0.00      0.00
12:34:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:34:01 AM      eth0      5.05      3.98      0.87      0.34      0.00      0.00      0.00      0.00
12:35:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:35:01 AM      eth0      1.03      0.72      0.33      0.28      0.00      0.00      0.00      0.00
12:36:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:36:01 AM      eth0      0.27      0.05      0.01      0.00      0.00      0.00      0.00      0.00
12:37:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:37:01 AM      eth0      4.62      4.47      0.75      0.42      0.00      0.00      0.00      0.00
12:38:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:38:01 AM      eth0      5.15      4.87      0.76      0.39      0.00      0.00      0.00      0.00
12:39:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:39:01 AM      eth0      0.58      0.02      0.10      0.00      0.00      0.00      0.00      0.00
12:40:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:40:01 AM      eth0      4.57      4.33      0.66      0.31      0.00      0.00      0.00      0.00
12:41:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:41:01 AM      eth0      1.42      0.70      0.37      0.27      0.00      0.00      0.00      0.00
12:42:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:42:01 AM      eth0      1.05      0.15      0.24      0.13      0.00      0.00      0.00      0.00
12:43:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:43:01 AM      eth0      8.35      7.85      1.66      0.99      0.00      0.00      0.00      0.00
12:44:02 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:44:02 AM      eth0      7.71      7.10      1.71      1.31      0.00      0.00      0.00      0.00
12:45:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:45:01 AM      eth0     10.05     10.12      2.32      2.04      0.00      0.00      0.00      0.00
12:46:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:46:01 AM      eth0      9.18      9.37      1.94      1.74      0.00      0.00      0.00      0.00
12:47:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:47:01 AM      eth0      9.88      9.95      2.35      2.06      0.00      0.00      0.00      0.00
12:48:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:48:01 AM      eth0      9.47      9.73      2.02      1.81      0.00      0.00      0.00      0.00
12:49:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:49:01 AM      eth0     11.08      9.63      2.13      1.81      0.00      0.00      0.00      0.00
12:50:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:50:01 AM      eth0     16.79     16.63      3.79      3.06      0.00      0.00      0.00      0.00
12:51:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:51:01 AM      eth0      0.55      0.32      0.11      0.05      0.00      0.00      0.00      0.00
12:52:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:52:01 AM      eth0      0.40      0.13      0.09      0.07      0.00      0.00      0.00      0.00
12:53:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:53:01 AM      eth0      1.57      0.25      0.21      0.03      0.00      0.00      0.00      0.00
12:54:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:54:01 AM      eth0      0.18      0.00      0.01      0.00      0.00      0.00      0.00      0.00
12:55:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:55:01 AM      eth0      0.40      0.20      0.05      0.03      0.00      0.00      0.00      0.00
12:56:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:56:01 AM      eth0      0.47      0.08      0.03      0.00      0.00      0.00      0.00      0.00
12:57:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:57:01 AM      eth0      0.92      0.40      0.38      0.26      0.00      0.00      0.00      0.00
12:58:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:58:01 AM      eth0      7.57      7.43      1.57      0.96      0.00      0.00      0.00      0.00
12:59:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:59:01 AM      eth0      3.92      3.82      0.63      0.32      0.00      0.00      0.00      0.00
01:00:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:00:01 AM      eth0      0.27      0.07      0.01      0.00      0.00      0.00      0.00      0.00
01:01:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:01:01 AM      eth0      3.28      3.22      0.55      0.23      0.00      0.00      0.00      0.00
01:02:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:02:01 AM      eth0      0.83      0.62      0.15      0.16      0.00      0.00      0.00      0.00
01:03:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:03:01 AM      eth0      0.33      0.08      0.15      0.00      0.00      0.00      0.00      0.00
01:04:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:04:01 AM      eth0      4.25      3.47      0.90      0.43      0.00      0.00      0.00      0.00
01:05:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:05:01 AM      eth0     10.13      9.23      1.61      0.74      0.00      0.00      0.00      0.00
01:06:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:06:01 AM      eth0      5.35      4.63      0.97      0.54      0.00      0.00      0.00      0.00
01:07:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:07:01 AM      eth0      5.78      5.18      0.98      0.66      0.00      0.00      0.00      0.00
01:08:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:08:01 AM      eth0      3.45      0.32      0.71      0.26      0.00      0.00      0.00      0.00
01:09:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:09:01 AM      eth0      4.87      0.65      1.43      0.76      0.00      0.00      0.00      0.00
01:10:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:10:01 AM      eth0      5.47      5.03      1.20      0.77      0.00      0.00      0.00      0.00
01:11:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:11:01 AM      eth0      1.82      0.00      0.23      0.00      0.00      0.00      0.00      0.00
01:12:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:12:01 AM      eth0     14.96      7.78      2.32      0.95      0.00      0.00      0.00      0.00
01:13:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:13:01 AM      eth0      6.65      5.25      1.30      0.95      0.00      0.00      0.00      0.00
01:14:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:14:01 AM      eth0     10.13      9.75      2.29      1.99      0.00      0.00      0.00      0.00
01:15:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:15:01 AM      eth0      9.35      9.43      1.96      1.75      0.00      0.00      0.00      0.00
01:16:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:16:01 AM      eth0     10.26      9.70      2.09      1.81      0.00      0.00      0.00      0.00
01:17:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:17:01 AM      eth0     11.50      9.86      2.28      1.88      0.00      0.00      0.00      0.00
01:18:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:18:01 AM      eth0     10.10      9.33      2.05      1.76      0.00      0.00      0.00      0.00
01:19:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:19:01 AM      eth0     18.54     18.78      4.11      3.42      0.00      0.00      0.00      0.00
01:20:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:20:01 AM      eth0      0.60      0.28      0.08      0.04      0.00      0.00      0.00      0.00
01:21:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:21:01 AM      eth0      0.35      0.05      0.02      0.00      0.00      0.00      0.00      0.00
01:22:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:22:01 AM      eth0      0.60      0.35      0.13      0.09      0.00      0.00      0.00      0.00
01:23:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:23:01 AM      eth0      1.37      0.15      0.30      0.07      0.00      0.00      0.00      0.00
01:24:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:24:01 AM      eth0      4.65      0.72      1.24      0.65      0.00      0.00      0.00      0.00
01:25:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:25:01 AM      eth0      0.73      0.40      0.30      0.22      0.00      0.00      0.00      0.00
01:26:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:26:01 AM      eth0      0.37      0.03      0.02      0.00      0.00      0.00      0.00      0.00
01:27:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:27:01 AM      eth0      8.18      7.33      1.74      1.05      0.00      0.00      0.00      0.00
01:28:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:28:01 AM      eth0     10.28      4.12      1.51      0.34      0.00      0.00      0.00      0.00
01:29:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:29:01 AM      eth0      0.52      0.00      0.03      0.00      0.00      0.00      0.00      0.00
01:30:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:30:01 AM      eth0      3.52      2.98      0.59      0.22      0.00      0.00      0.00      0.00
01:31:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:31:01 AM      eth0      1.13      0.48      0.17      0.09      0.00      0.00      0.00      0.00
01:32:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:32:01 AM      eth0      1.67      0.15      0.27      0.13      0.00      0.00      0.00      0.00
01:33:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:33:01 AM      eth0      4.18      3.28      0.85      0.42      0.00      0.00      0.00      0.00
01:34:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:34:01 AM      eth0      2.65      0.57      0.47      0.15      0.00      0.00      0.00      0.00
01:35:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:35:01 AM      eth0      0.93      0.33      0.52      0.38      0.00      0.00      0.00      0.00
01:36:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:36:01 AM      eth0      5.01      4.77      0.73      0.38      0.00      0.00      0.00      0.00
01:37:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:37:01 AM      eth0      3.58      0.28      0.52      0.10      0.00      0.00      0.00      0.00
01:38:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:38:01 AM      eth0      0.38      0.05      0.02      0.00      0.00      0.00      0.00      0.00
01:39:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:39:01 AM      eth0      8.83      8.62      1.35      0.65      0.00      0.00      0.00      0.00
01:40:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:40:01 AM      eth0      0.83      0.45      0.08      0.09      0.00      0.00      0.00      0.00
01:41:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:41:01 AM      eth0      0.57      0.00      0.05      0.00      0.00      0.00      0.00      0.00
01:42:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:42:01 AM      eth0      4.60      4.30      0.73      0.36      0.00      0.00      0.00      0.00
01:43:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:43:01 AM      eth0      0.62      0.42      0.07      0.09      0.00      0.00      0.00      0.00
01:44:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:44:01 AM      eth0      0.63      0.07      0.08      0.00      0.00      0.00      0.00      0.00
01:45:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:45:01 AM      eth0      8.41      8.23      1.38      0.84      0.00      0.00      0.00      0.00
01:46:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:46:01 AM      eth0      8.47      8.67      1.77      1.60      0.00      0.00      0.00      0.00
01:47:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:47:01 AM      eth0      9.85     10.08      2.35      2.07      0.00      0.00      0.00      0.00
01:48:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:48:01 AM      eth0      9.26      9.51      2.00      1.79      0.00      0.00      0.00      0.00
01:49:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:49:01 AM      eth0      9.25      9.40      1.96      1.75      0.00      0.00      0.00      0.00
01:50:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:50:01 AM      eth0      9.59      9.85      2.05      1.84      0.00      0.00      0.00      0.00
01:51:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:51:01 AM      eth0      9.13      9.38      1.94      1.74      0.00      0.00      0.00      0.00
01:52:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:52:01 AM      eth0     15.83     15.48      3.59      2.92      0.00      0.00      0.00      0.00
01:53:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:53:01 AM      eth0      0.60      0.27      0.28      0.04      0.00      0.00      0.00      0.00
01:54:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:54:01 AM      eth0      0.55      0.00      0.10      0.00      0.00      0.00      0.00      0.00
01:55:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:55:01 AM      eth0      0.40      0.27      0.04      0.03      0.00      0.00      0.00      0.00
01:56:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:56:01 AM      eth0      0.13      0.05      0.01      0.00      0.00      0.00      0.00      0.00
01:57:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:57:01 AM      eth0      0.47      0.30      0.12      0.09      0.00      0.00      0.00      0.00
01:58:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:58:01 AM      eth0      0.17      0.00      0.01      0.00      0.00      0.00      0.00      0.00
01:59:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:59:01 AM      eth0      2.98      3.05      0.67      0.57      0.00      0.00      0.00      0.00
02:00:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:00:01 AM      eth0      8.83      8.00      1.65      0.64      0.00      0.00      0.00      0.00
02:01:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:01:01 AM      eth0      0.68      0.57      0.07      0.09      0.00      0.00      0.00      0.00
02:02:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:02:01 AM      eth0      1.02      0.23      0.23      0.13      0.00      0.00      0.00      0.00
02:03:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:03:01 AM      eth0      4.67      4.45      0.95      0.54      0.00      0.00      0.00      0.00
02:04:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:04:01 AM      eth0      6.95      6.53      1.19      0.55      0.00      0.00      0.00      0.00
02:05:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:05:01 AM      eth0      5.05      4.87      0.93      0.56      0.00      0.00      0.00      0.00
02:06:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:01 AM      eth0      5.53      5.56      0.78      0.48      0.00      0.00      0.00      0.00
02:07:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:07:01 AM      eth0      0.42      0.18      0.09      0.07      0.00      0.00      0.00      0.00
02:08:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:08:01 AM      eth0      0.20      0.00      0.01      0.00      0.00      0.00      0.00      0.00
02:09:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:09:01 AM      eth0      8.91      9.16      1.67      1.13      0.00      0.00      0.00      0.00
02:10:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:10:01 AM      eth0      9.90     10.16      2.11      1.89      0.00      0.00      0.00      0.00
02:11:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:11:01 AM      eth0      9.55      9.41      1.99      1.74      0.00      0.00      0.00      0.00
02:12:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:12:01 AM      eth0     10.95     11.26      2.42     14.98      0.00      0.00      0.00      0.00
02:13:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:13:01 AM      eth0      9.43      9.67      2.02      1.81      0.00      0.00      0.00      0.00
02:14:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:14:01 AM      eth0      9.08      9.31      1.94      1.74      0.00      0.00      0.00      0.00
02:15:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:15:01 AM      eth0      9.32      9.62      2.01      1.80      0.00      0.00      0.00      0.00
02:16:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:16:01 AM      eth0     12.21     11.93      2.77      2.18      0.00      0.00      0.00      0.00
02:17:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:17:01 AM      eth0      1.05      0.80      0.13      2.00      0.00      0.00      0.00      0.00
02:18:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:18:01 AM      eth0      0.22      0.00      0.01      0.00      0.00      0.00      0.00      0.00
02:19:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:19:01 AM      eth0      0.40      0.30      0.04      0.03      0.00      0.00      0.00      0.00
02:20:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:20:01 AM      eth0      0.20      0.00      0.01      0.00      0.00      0.00      0.00      0.00
02:21:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:21:01 AM      eth0      0.35      0.22      0.04      0.03      0.00      0.00      0.00      0.00
02:22:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:22:01 AM      eth0      0.48      0.27      0.41      0.07      0.00      0.00      0.00      0.00
02:23:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:23:01 AM      eth0      6.75      6.63      1.48      0.87      0.00      0.00      0.00      0.00
02:24:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:24:01 AM      eth0      3.55      3.48      0.65      0.32      0.00      0.00      0.00      0.00
02:25:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:25:01 AM      eth0      0.28      0.17      0.02      0.02      0.00      0.00      0.00      0.00
02:26:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:26:01 AM      eth0      0.13      0.05      0.01      0.00      0.00      0.00      0.00      0.00
02:27:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:27:01 AM      eth0      6.23      6.13      1.17      0.55      0.00      0.00      0.00      0.00
02:28:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:28:01 AM      eth0      4.20      4.15      0.64      0.33      0.00      0.00      0.00      0.00
02:29:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:29:01 AM      eth0      7.87      7.82      1.26      0.64      0.00      0.00      0.00      0.00
02:30:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:30:01 AM      eth0      0.70      0.67      0.07      0.09      0.00      0.00      0.00      0.00
02:31:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:31:01 AM      eth0      0.13      0.03      0.01      0.00      0.00      0.00      0.00      0.00
02:32:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:32:01 AM      eth0      9.50      8.91      1.62      1.00      0.00      0.00      0.00      0.00
02:33:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:33:01 AM      eth0      6.68      5.97      1.78      1.48      0.00      0.00      0.00      0.00
02:34:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:34:01 AM      eth0      9.43      9.73      2.02      1.81      0.00      0.00      0.00      0.00
02:35:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:35:01 AM      eth0      9.27      9.47      2.00      1.79      0.00      0.00      0.00      0.00
02:36:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:36:01 AM      eth0      9.27      9.53      1.96      1.76      0.00      0.00      0.00      0.00
02:37:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:37:01 AM      eth0      8.91      9.11      1.94      1.74      0.00      0.00      0.00      0.00
02:38:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:38:01 AM      eth0      9.40      9.70      2.02      1.81      0.00      0.00      0.00      0.00
02:39:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:39:01 AM      eth0     18.06     17.99      4.04      3.31      0.00      0.00      0.00      0.00
02:40:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:40:01 AM      eth0      0.42      0.30      0.07      0.04      0.00      0.00      0.00      0.00
02:41:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:41:01 AM      eth0      0.17      0.00      0.01      0.00      0.00      0.00      0.00      0.00
02:42:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:42:01 AM      eth0      0.52      0.38      0.12      0.10      0.00      0.00      0.00      0.00
02:43:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:43:01 AM      eth0      0.20      0.00      0.01      0.00      0.00      0.00      0.00      0.00
02:44:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:44:01 AM      eth0      0.78      0.15      0.16      0.07      0.00      0.00      0.00      0.00
02:45:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:45:01 AM      eth0      0.53      0.35      0.29      0.22      0.00      0.00      0.00      0.00
02:46:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:46:01 AM      eth0      0.35      0.08      0.23      0.00      0.00      0.00      0.00      0.00
02:47:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:47:01 AM      eth0      8.75      8.27      2.03      1.32      0.00      0.00      0.00      0.00
02:48:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:48:01 AM      eth0      3.45      3.40      0.79      0.46      0.00      0.00      0.00      0.00
02:49:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:49:01 AM      eth0      0.12      0.00      0.01      0.00      0.00      0.00      0.00      0.00
02:50:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:50:01 AM      eth0      2.53      2.40      0.44      0.17      0.00      0.00      0.00      0.00
02:51:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:51:01 AM      eth0      0.40      0.30      0.05      0.06      0.00      0.00      0.00      0.00
02:52:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:52:01 AM      eth0      4.05      3.88      0.72      0.36      0.00      0.00      0.00      0.00
02:53:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:53:01 AM      eth0      0.77      0.60      0.18      0.09      0.00      0.00      0.00      0.00
02:54:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:54:01 AM      eth0      0.35      0.00      0.06      0.00      0.00      0.00      0.00      0.00
02:55:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:55:01 AM      eth0      7.50      7.63      1.34      0.82      0.00      0.00      0.00      0.00
02:56:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:56:01 AM      eth0      9.18      9.48      1.94      1.75      0.00      0.00      0.00      0.00
02:57:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:57:01 AM      eth0      9.11      9.31      1.99      1.77      0.00      0.00      0.00      0.00
02:58:02 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:58:02 AM      eth0      9.40      9.71      2.02      1.81      0.00      0.00      0.00      0.00
02:59:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:59:01 AM      eth0      9.20      9.45      1.97      1.77      0.00      0.00      0.00      0.00
03:00:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:00:01 AM      eth0      9.58      9.75      2.08      1.81      0.00      0.00      0.00      0.00
03:01:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:01:01 AM      eth0      9.18      9.46      1.99      1.79      0.00      0.00      0.00      0.00
03:02:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:02:01 AM      eth0     15.26     14.13      3.48      2.67      0.00      0.00      0.00      0.00
03:03:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:03:01 AM      eth0      0.70      0.33      0.33      0.22      0.00      0.00      0.00      0.00
03:04:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:04:01 AM      eth0      0.20      0.05      0.01      0.00      0.00      0.00      0.00      0.00
03:05:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:05:01 AM      eth0      0.35      0.27      0.04      0.03      0.00      0.00      0.00      0.00
03:06:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:06:01 AM      eth0      0.10      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:07:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:07:01 AM      eth0      0.45      0.35      0.12      0.09      0.00      0.00      0.00      0.00
03:08:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:08:01 AM      eth0      0.12      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:09:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:09:01 AM      eth0      4.72      4.77      1.00      0.73      0.00      0.00      0.00      0.00
03:10:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:10:01 AM      eth0      6.70      6.30      1.48      0.94      0.00      0.00      0.00      0.00
03:11:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:11:01 AM      eth0      8.70      8.88      1.66      1.10      0.00      0.00      0.00      0.00
03:12:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:12:01 AM      eth0      9.45      9.72      2.09      1.87      0.00      0.00      0.00      0.00
03:13:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:13:01 AM      eth0      9.36      9.65      2.01      1.81      0.00      0.00      0.00      0.00
03:14:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:14:01 AM      eth0      9.05      9.32      1.94      1.74      0.00      0.00      0.00      0.00
03:15:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:15:01 AM      eth0      9.36      9.66      2.01      1.81      0.00      0.00      0.00      0.00
03:16:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:16:01 AM      eth0      9.48      9.65      2.02      1.81      0.00      0.00      0.00      0.00
03:17:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:17:01 AM      eth0     16.14     16.33      3.72      3.05      0.00      0.00      0.00      0.00
03:18:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:18:01 AM      eth0      3.32      3.10      0.64      0.56      0.00      0.00      0.00      0.00
03:19:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:19:01 AM      eth0      0.32      0.22      0.05      0.03      0.00      0.00      0.00      0.00
03:20:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:20:01 AM      eth0      0.13      0.00      0.01      0.00      0.00      0.00      0.00      0.00
03:21:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:21:01 AM      eth0      0.63      0.25      0.11      0.03      0.00      0.00      0.00      0.00
03:22:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:22:01 AM      eth0      0.23      0.12      0.08      0.07      0.00      0.00      0.00      0.00
03:23:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:23:01 AM      eth0      0.32      0.20      0.04      0.03      0.00      0.00      0.00      0.00
03:24:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:24:01 AM      eth0      0.13      0.00      0.01      0.00      0.00      0.00      0.00      0.00
03:25:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:25:01 AM      eth0      3.45      3.47      0.77      0.65      0.00      0.00      0.00      0.00
03:26:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:26:01 AM      eth0      7.68      7.76      1.60      1.01      0.00      0.00      0.00      0.00
03:27:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:27:01 AM      eth0      7.55      7.03      1.61      0.95      0.00      0.00      0.00      0.00
03:28:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:28:01 AM      eth0      9.10      9.30      1.94      1.74      0.00      0.00      0.00      0.00
03:29:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:29:01 AM      eth0      9.32      9.68      2.01      1.81      0.00      0.00      0.00      0.00
03:30:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:30:01 AM      eth0      9.06      9.38      1.96      1.76      0.00      0.00      0.00      0.00
03:31:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:31:01 AM      eth0      9.28      9.58      1.99      1.78      0.00      0.00      0.00      0.00
03:32:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:32:01 AM      eth0     10.11      9.92      2.16      1.88      0.00      0.00      0.00      0.00
03:33:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:33:01 AM      eth0     12.13     12.15      3.13      2.45      0.00      0.00      0.00      0.00
03:34:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:34:01 AM      eth0      8.38      8.12      1.95      1.44      0.00      0.00      0.00      0.00
03:35:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:35:01 AM      eth0      0.10      0.05      0.01      0.00      0.00      0.00      0.00      0.00
03:36:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:36:01 AM      eth0      1.82      0.02      0.20      0.00      0.00      0.00      0.00      0.00
03:37:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:37:01 AM      eth0      0.48      0.33      0.12      0.09      0.00      0.00      0.00      0.00
03:38:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:38:01 AM      eth0      0.15      0.05      0.01      0.00      0.00      0.00      0.00      0.00
03:39:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:39:01 AM      eth0      0.45      0.28      0.05      0.03      0.00      0.00      0.00      0.00
03:40:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:40:01 AM      eth0      0.12      0.00      0.01      0.00      0.00      0.00      0.00      0.00
03:41:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:41:01 AM      eth0      6.81      6.85      1.46      0.88      0.00      0.00      0.00      0.00
03:42:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:42:01 AM      eth0     11.78      8.77      7.45      1.15      0.00      0.00      0.00      0.00
03:43:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:43:01 AM      eth0      8.22      7.42      1.59      1.38      0.00      0.00      0.00      0.00
03:44:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:44:01 AM      eth0      9.40      9.71      2.02      1.81      0.00      0.00      0.00      0.00
03:45:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:45:01 AM      eth0      9.12      9.38      1.94      1.74      0.00      0.00      0.00      0.00
03:46:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:46:01 AM      eth0      9.40      9.67      2.02      1.81      0.00      0.00      0.00      0.00
03:47:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:47:01 AM      eth0      9.68      9.78      2.30      2.03      0.00      0.00      0.00      0.00
03:48:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:48:01 AM      eth0      9.30      9.60      1.99      1.78      0.00      0.00      0.00      0.00
03:49:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:49:01 AM      eth0     15.86     15.86      3.57      2.93      0.00      0.00      0.00      0.00
03:50:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:50:01 AM      eth0      0.32      0.30      0.06      0.04      0.00      0.00      0.00      0.00
03:51:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:51:01 AM      eth0      0.50      0.00      0.09      0.00      0.00      0.00      0.00      0.00
03:52:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:52:01 AM      eth0      0.45      0.43      0.12      0.10      0.00      0.00      0.00      0.00
03:53:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:53:01 AM      eth0      0.10      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:54:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:54:01 AM      eth0      0.27      0.18      0.04      0.03      0.00      0.00      0.00      0.00
03:55:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:55:01 AM      eth0      0.15      0.03      0.01      0.00      0.00      0.00      0.00      0.00
03:56:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:56:01 AM      eth0      0.10      0.05      0.00      0.00      0.00      0.00      0.00      0.00
03:57:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:57:01 AM      eth0     10.66     10.28      2.25      1.58      0.00      0.00      0.00      0.00
03:58:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:58:01 AM      eth0      6.00      5.81      1.26      0.82      0.00      0.00      0.00      0.00
03:59:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:59:01 AM      eth0      9.85      8.73      2.30      1.13      0.00      0.00      0.00      0.00
04:00:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:00:01 AM      eth0      6.23      6.27      1.29      0.82      0.00      0.00      0.00      0.00
04:01:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:01:01 AM      eth0      6.10      6.15      1.46      0.93      0.00      0.00      0.00      0.00
04:02:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:02:01 AM      eth0      5.48      5.28      1.30      0.80      0.00      0.00      0.00      0.00
04:03:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:03:01 AM      eth0      6.43      6.48      1.32      0.90      0.00      0.00      0.00      0.00
04:04:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:04:01 AM      eth0     97.33     68.96    225.74    197.97      0.00      0.00      0.00      0.00
04:05:02 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:05:02 AM      eth0     13.88     13.83     11.86      6.77      0.00      0.00      0.00      0.00
Average:           lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
Average:         eth0      5.71      5.09      6.17      1.67      0.00      0.00      0.00      0.00


---> sar -P ALL:
Linux 4.18.0-547.el8.x86_64 (prd-centos8-robot-2c-8g-5506.novalocal) 	04/07/2024 	_x86_64_	(2 CPU)

12:00:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
12:01:01 AM     all      0.30      0.03      0.23      0.05      0.05     99.34
12:01:01 AM       0      0.45      0.00      0.12      0.00      0.03     99.40
12:01:01 AM       1      0.15      0.05      0.35      0.10      0.07     99.28
12:02:01 AM     all      1.94      0.00      0.22      0.01      0.05     97.78
12:02:01 AM       0      3.72      0.00      0.31      0.02      0.03     95.92
12:02:01 AM       1      0.20      0.00      0.13      0.00      0.07     99.60
12:03:01 AM     all      6.50      0.00      2.62      0.00      0.13     90.75
12:03:01 AM       0     11.88      0.00      4.05      0.00      0.15     83.92
12:03:01 AM       1      1.52      0.00      1.30      0.00      0.12     97.07
12:04:01 AM     all      6.74      0.00      1.35      0.00      0.07     91.83
12:04:01 AM       0     13.43      0.00      2.62      0.00      0.07     83.88
12:04:01 AM       1      0.67      0.00      0.20      0.00      0.07     99.07
12:05:01 AM     all      6.73      0.00      2.54      0.00      0.07     90.66
12:05:01 AM       0      5.17      0.00      2.55      0.00      0.07     92.22
12:05:01 AM       1      8.32      0.00      2.53      0.00      0.07     89.08
12:06:01 AM     all      1.09      0.00      0.08      0.00      0.07     98.76
12:06:01 AM       0      0.63      0.00      0.07      0.00      0.08     99.22
12:06:01 AM       1      1.55      0.00      0.10      0.00      0.05     98.30
12:07:01 AM     all      0.40      0.00      0.08      0.00      0.04     99.48
12:07:01 AM       0      0.62      0.00      0.05      0.00      0.03     99.30
12:07:01 AM       1      0.18      0.00      0.10      0.00      0.05     99.67
12:08:01 AM     all      4.24      0.00      1.35      0.01      0.07     94.34
12:08:01 AM       0      0.57      0.00      0.17      0.00      0.07     99.20
12:08:01 AM       1      8.17      0.00      2.62      0.02      0.07     89.12
12:09:01 AM     all      0.35      0.00      0.06      0.00      0.04     99.55
12:09:01 AM       0      0.67      0.00      0.08      0.00      0.07     99.18
12:09:01 AM       1      0.03      0.00      0.03      0.00      0.02     99.92
12:10:01 AM     all      1.28      0.00      0.12      0.00      0.13     98.48
12:10:01 AM       0      1.67      0.00      0.12      0.00      0.12     98.10
12:10:01 AM       1      0.89      0.00      0.12      0.00      0.13     98.86
12:11:01 AM     all      7.20      0.00      2.56      0.02      0.07     90.15
12:11:01 AM       0     10.84      0.00      4.92      0.00      0.07     84.16
12:11:01 AM       1      3.68      0.00      0.29      0.03      0.07     95.93

12:11:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
12:12:01 AM     all      4.37      0.00      0.34      0.00      0.07     95.22
12:12:01 AM       0      3.45      0.00      0.30      0.00      0.07     96.19
12:12:01 AM       1      5.29      0.00      0.39      0.00      0.07     94.26
12:13:01 AM     all      4.17      0.00      0.32      0.00      0.07     95.45
12:13:01 AM       0      2.07      0.00      0.22      0.00      0.05     97.66
12:13:01 AM       1      6.26      0.00      0.42      0.00      0.08     93.23
12:14:01 AM     all      4.23      0.00      0.36      0.00      0.06     95.35
12:14:01 AM       0      2.32      0.00      0.30      0.00      0.05     97.32
12:14:01 AM       1      6.14      0.00      0.42      0.00      0.07     93.38
12:15:01 AM     all      4.17     13.73      1.12      2.28      0.09     78.61
12:15:01 AM       0      4.23      0.79      0.89      2.01      0.08     92.00
12:15:01 AM       1      4.12     26.69      1.34      2.54      0.10     65.20
12:16:01 AM     all      4.23      0.00      0.33      0.01      0.10     95.33
12:16:01 AM       0      4.60      0.00      0.37      0.02      0.12     94.89
12:16:01 AM       1      3.86      0.00      0.28      0.00      0.08     95.77
12:17:01 AM     all      5.67      0.00      0.38      0.00      0.07     93.89
12:17:01 AM       0      3.45      0.00      0.28      0.00      0.07     96.20
12:17:01 AM       1      7.88      0.00      0.47      0.00      0.07     91.58
12:18:01 AM     all      2.63      0.00      0.18      0.00      0.08     97.11
12:18:01 AM       0      1.39      0.00      0.18      0.00      0.08     98.34
12:18:01 AM       1      3.88      0.00      0.18      0.00      0.07     95.87
12:19:01 AM     all      0.33      0.00      0.06      0.00      0.04     99.57
12:19:01 AM       0      0.13      0.00      0.07      0.00      0.05     99.75
12:19:01 AM       1      0.53      0.00      0.05      0.00      0.03     99.38
12:20:01 AM     all      0.34      0.00      0.07      0.00      0.05     99.54
12:20:01 AM       0      0.17      0.00      0.12      0.00      0.07     99.65
12:20:01 AM       1      0.52      0.00      0.02      0.00      0.03     99.43
12:21:01 AM     all      0.48      0.00      0.08      0.00      0.05     99.39
12:21:01 AM       0      0.32      0.00      0.10      0.00      0.03     99.55
12:21:01 AM       1      0.63      0.00      0.07      0.00      0.07     99.23
12:22:01 AM     all      0.35      0.00      0.06      0.00      0.04     99.55
12:22:01 AM       0      0.08      0.00      0.05      0.00      0.03     99.83
12:22:01 AM       1      0.62      0.00      0.07      0.00      0.05     99.27

12:22:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
12:23:01 AM     all      0.45      0.00      0.09      0.00      0.05     99.41
12:23:01 AM       0      0.13      0.00      0.08      0.00      0.05     99.73
12:23:01 AM       1      0.77      0.00      0.10      0.00      0.05     99.08
12:24:01 AM     all      0.35      0.00      0.04      0.00      0.05     99.56
12:24:01 AM       0      0.12      0.00      0.05      0.00      0.03     99.80
12:24:01 AM       1      0.58      0.00      0.03      0.00      0.07     99.32
12:25:01 AM     all      4.38      0.00      3.53      0.00      0.06     92.03
12:25:01 AM       0      0.62      0.00      0.13      0.00      0.05     99.20
12:25:01 AM       1      8.34      0.00      7.10      0.00      0.07     84.49
12:26:01 AM     all      7.10      0.00      1.46      0.00      0.07     91.37
12:26:01 AM       0      0.70      0.00      0.18      0.00      0.07     99.05
12:26:01 AM       1     14.04      0.00      2.84      0.00      0.07     83.04
12:27:01 AM     all      0.35      0.00      0.08      0.00      0.05     99.52
12:27:01 AM       0      0.63      0.00      0.08      0.00      0.05     99.23
12:27:01 AM       1      0.07      0.00      0.07      0.00      0.05     99.82
12:28:01 AM     all      0.37      0.00      0.05      0.00      0.04     99.54
12:28:01 AM       0      0.57      0.00      0.05      0.00      0.05     99.33
12:28:01 AM       1      0.17      0.00      0.05      0.00      0.03     99.75
12:29:01 AM     all      4.75      0.00      1.45      0.00      0.06     93.75
12:29:01 AM       0      0.60      0.00      0.10      0.00      0.05     99.25
12:29:01 AM       1      9.16      0.00      2.88      0.00      0.07     87.88
12:30:01 AM     all      0.35      0.00      0.07      0.00      0.06     99.52
12:30:01 AM       0      0.60      0.00      0.05      0.00      0.05     99.30
12:30:01 AM       1      0.10      0.00      0.08      0.00      0.07     99.75
12:31:01 AM     all      1.43      0.00      0.15      0.00      0.05     98.37
12:31:01 AM       0      0.55      0.00      0.08      0.00      0.05     99.32
12:31:01 AM       1      2.32      0.00      0.22      0.00      0.05     97.41
12:32:01 AM     all      3.51      0.00      1.26      0.00      0.05     95.18
12:32:01 AM       0      2.57      0.00      0.22      0.00      0.05     97.16
12:32:01 AM       1      4.47      0.00      2.31      0.00      0.05     93.17
12:33:01 AM     all      0.37      0.00      0.06      0.00      0.04     99.53
12:33:01 AM       0      0.10      0.00      0.03      0.00      0.02     99.85
12:33:01 AM       1      0.63      0.00      0.08      0.00      0.07     99.22

12:33:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
12:34:01 AM     all      2.59      0.00      0.65      0.00      0.07     96.70
12:34:01 AM       0      4.10      0.00      1.18      0.00      0.07     94.65
12:34:01 AM       1      1.12      0.00      0.13      0.00      0.07     98.67
12:35:01 AM     all      2.20      0.00      0.88      0.00      0.07     96.85
12:35:01 AM       0      3.91      0.00      1.65      0.00      0.05     94.39
12:35:01 AM       1      0.53      0.00      0.12      0.00      0.08     99.27
12:36:01 AM     all      0.32      0.00      0.08      0.00      0.05     99.55
12:36:01 AM       0      0.10      0.00      0.07      0.00      0.03     99.80
12:36:01 AM       1      0.53      0.00      0.10      0.00      0.07     99.30
12:37:01 AM     all      4.83      0.00      1.40      0.00      0.07     93.70
12:37:01 AM       0      9.16      0.00      2.73      0.00      0.07     88.04
12:37:01 AM       1      0.70      0.00      0.13      0.00      0.07     99.10
12:38:01 AM     all      4.60      0.01      1.31      0.02      0.07     93.99
12:38:01 AM       0      8.86      0.00      2.60      0.04      0.04     88.47
12:38:01 AM       1      0.63      0.02      0.12      0.00      0.10     99.13
12:39:01 AM     all      0.36      0.00      0.08      0.00      0.04     99.52
12:39:01 AM       0      0.07      0.00      0.07      0.00      0.03     99.83
12:39:01 AM       1      0.65      0.00      0.08      0.00      0.05     99.22
12:40:01 AM     all      1.68      0.00      0.14      0.00      0.06     98.12
12:40:01 AM       0      0.27      0.00      0.10      0.00      0.07     99.57
12:40:01 AM       1      3.12      0.00      0.19      0.00      0.05     96.64
12:41:01 AM     all      3.42      0.00      1.16      0.01      0.09     95.32
12:41:01 AM       0      0.18      0.00      0.15      0.00      0.10     99.57
12:41:01 AM       1      6.80      0.00      2.22      0.02      0.09     90.88
12:42:01 AM     all      0.35      0.00      0.08      0.00      0.05     99.52
12:42:01 AM       0      0.17      0.00      0.13      0.00      0.07     99.63
12:42:01 AM       1      0.53      0.00      0.02      0.00      0.03     99.42
12:43:01 AM     all      3.69      0.00      0.27      0.00      0.06     95.98
12:43:01 AM       0      3.12      0.00      0.27      0.00      0.07     96.54
12:43:01 AM       1      4.27      0.00      0.27      0.00      0.05     95.41
12:44:02 AM     all      5.49      0.00      2.53      0.00      0.09     91.90
12:44:02 AM       0      3.43      0.00      0.25      0.00      0.08     96.23
12:44:02 AM       1      7.63      0.00      4.90      0.00      0.09     87.39

12:44:02 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
12:45:01 AM     all      4.39      0.00      0.31      0.00      0.09     95.22
12:45:01 AM       0      3.30      0.00      0.22      0.00      0.09     96.39
12:45:01 AM       1      5.48      0.00      0.39      0.00      0.09     94.05
12:46:01 AM     all      4.18      0.00      0.33      0.01      0.08     95.41
12:46:01 AM       0      3.21      0.00      0.28      0.02      0.07     96.42
12:46:01 AM       1      5.16      0.00      0.37      0.00      0.08     94.39
12:47:01 AM     all      4.27      0.00      0.32      0.00      0.10     95.31
12:47:01 AM       0      2.32      0.00      0.25      0.00      0.08     97.34
12:47:01 AM       1      6.23      0.00      0.39      0.00      0.12     93.27
12:48:01 AM     all      4.27      0.00      0.31      0.00      0.10     95.32
12:48:01 AM       0      2.51      0.00      0.20      0.00      0.08     97.21
12:48:01 AM       1      6.03      0.00      0.42      0.00      0.12     93.44
12:49:01 AM     all      4.31      0.00      0.30      0.00      0.08     95.31
12:49:01 AM       0      5.10      0.00      0.33      0.00      0.08     94.48
12:49:01 AM       1      3.51      0.00      0.27      0.00      0.08     96.14
12:50:01 AM     all      6.35      0.00      0.36      0.00      0.08     93.21
12:50:01 AM       0      3.92      0.00      0.32      0.00      0.08     95.68
12:50:01 AM       1      8.79      0.00      0.40      0.00      0.07     90.74
12:51:01 AM     all      0.54      0.00      0.09      0.00      0.07     99.30
12:51:01 AM       0      0.62      0.00      0.07      0.00      0.07     99.25
12:51:01 AM       1      0.47      0.00      0.12      0.00      0.07     99.35
12:52:01 AM     all      0.35      0.00      0.06      0.00      0.06     99.53
12:52:01 AM       0      0.55      0.00      0.03      0.00      0.03     99.38
12:52:01 AM       1      0.15      0.00      0.08      0.00      0.08     99.68
12:53:01 AM     all      0.44      0.00      0.08      0.00      0.07     99.42
12:53:01 AM       0      0.57      0.00      0.05      0.00      0.05     99.33
12:53:01 AM       1      0.32      0.00      0.10      0.00      0.08     99.50
12:54:01 AM     all      0.31      0.00      0.06      0.00      0.05     99.58
12:54:01 AM       0      0.52      0.00      0.05      0.00      0.05     99.38
12:54:01 AM       1      0.10      0.00      0.07      0.00      0.05     99.78
12:55:01 AM     all      0.33      0.00      0.08      0.00      0.06     99.54
12:55:01 AM       0      0.08      0.00      0.05      0.00      0.03     99.83
12:55:01 AM       1      0.57      0.00      0.10      0.00      0.08     99.25

12:55:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
12:56:01 AM     all      0.33      0.00      0.08      0.00      0.08     99.51
12:56:01 AM       0      0.15      0.00      0.12      0.00      0.08     99.65
12:56:01 AM       1      0.52      0.00      0.05      0.00      0.07     99.37
12:57:01 AM     all      0.18      0.00      0.07      0.00      0.05     99.71
12:57:01 AM       0      0.13      0.00      0.08      0.00      0.05     99.73
12:57:01 AM       1      0.22      0.00      0.05      0.00      0.05     99.68
12:58:01 AM     all      6.44      0.00      4.20      0.00      0.06     89.30
12:58:01 AM       0     11.27      0.00      8.47      0.00      0.05     80.21
12:58:01 AM       1      1.92      0.00      0.18      0.00      0.07     97.83
12:59:01 AM     all      5.02      0.00      1.38      0.00      0.06     93.54
12:59:01 AM       0      3.29      0.00      0.20      0.00      0.07     96.44
12:59:01 AM       1      6.79      0.00      2.59      0.00      0.05     90.56
01:00:01 AM     all      0.38      0.00      0.06      0.00      0.06     99.51
01:00:01 AM       0      0.60      0.00      0.05      0.00      0.05     99.30
01:00:01 AM       1      0.15      0.00      0.07      0.00      0.07     99.72
01:01:01 AM     all      1.48      0.00      0.19      0.00      0.06     98.28
01:01:01 AM       0      0.57      0.00      0.10      0.00      0.03     99.30
01:01:01 AM       1      2.41      0.00      0.27      0.00      0.09     97.23
01:02:01 AM     all      2.89      0.00      1.29      0.00      0.06     95.76
01:02:01 AM       0      0.57      0.00      0.12      0.00      0.07     99.25
01:02:01 AM       1      5.34      0.00      2.53      0.00      0.05     92.08
01:03:01 AM     all      0.25      0.00      0.08      0.00      0.06     99.62
01:03:01 AM       0      0.35      0.00      0.05      0.00      0.05     99.55
01:03:01 AM       1      0.15      0.00      0.10      0.00      0.07     99.68
01:04:01 AM     all      2.91      0.00      0.91      0.00      0.09     96.09
01:04:01 AM       0      4.34      0.00      1.64      0.00      0.07     93.95
01:04:01 AM       1      1.52      0.00      0.20      0.00      0.10     98.18
01:05:01 AM     all      6.87      0.00      1.74      0.00      0.07     91.32
01:05:01 AM       0      8.92      0.00      1.22      0.00      0.09     89.77
01:05:01 AM       1      4.88      0.00      2.24      0.00      0.05     92.83
01:06:01 AM     all      6.34      0.00      1.95      0.00      0.08     91.63
01:06:01 AM       0     12.89      0.00      3.93      0.00      0.07     83.11
01:06:01 AM       1      0.38      0.00      0.15      0.00      0.08     99.38

01:06:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
01:07:01 AM     all      6.41      0.00      1.85      0.00      0.06     91.67
01:07:01 AM       0      3.13      0.00      1.16      0.00      0.05     95.65
01:07:01 AM       1      9.81      0.00      2.57      0.00      0.07     87.55
01:08:01 AM     all      0.42      0.00      0.07      0.00      0.08     99.43
01:08:01 AM       0      0.35      0.00      0.08      0.00      0.07     99.50
01:08:01 AM       1      0.48      0.00      0.05      0.00      0.10     99.37
01:09:01 AM     all      0.42      0.00      0.09      0.00      0.05     99.44
01:09:01 AM       0      0.40      0.00      0.10      0.00      0.05     99.45
01:09:01 AM       1      0.43      0.00      0.08      0.00      0.05     99.43
01:10:01 AM     all      5.05      0.00      1.44      0.00      0.07     93.44
01:10:01 AM       0      1.58      0.00      0.20      0.00      0.07     98.15
01:10:01 AM       1      8.65      0.00      2.73      0.00      0.07     88.55
01:11:01 AM     all      0.37      0.00      0.07      0.00      0.04     99.52
01:11:01 AM       0      0.33      0.00      0.07      0.00      0.05     99.55
01:11:01 AM       1      0.40      0.00      0.07      0.00      0.03     99.50
01:12:01 AM     all      2.44      0.00      0.21      0.00      0.06     97.29
01:12:01 AM       0      1.11      0.00      0.15      0.00      0.07     98.68
01:12:01 AM       1      3.78      0.00      0.27      0.00      0.05     95.90
01:13:01 AM     all      6.56      0.00      2.50      0.00      0.09     90.86
01:13:01 AM       0      4.47      0.00      0.34      0.00      0.07     95.12
01:13:01 AM       1      8.68      0.00      4.69      0.00      0.10     86.52
01:14:01 AM     all      4.35      0.00      0.33      0.00      0.09     95.23
01:14:01 AM       0      3.49      0.00      0.28      0.00      0.10     96.12
01:14:01 AM       1      5.21      0.00      0.37      0.00      0.08     94.33
01:15:01 AM     all      4.32      0.00      0.32      0.00      0.07     95.29
01:15:01 AM       0      5.10      0.00      0.34      0.00      0.05     94.52
01:15:01 AM       1      3.55      0.00      0.30      0.00      0.08     96.07
01:16:01 AM     all      4.45      0.00      0.36      0.00      0.09     95.10
01:16:01 AM       0      4.96      0.00      0.44      0.00      0.08     94.53
01:16:01 AM       1      3.95      0.00      0.28      0.00      0.10     95.67
01:17:01 AM     all      4.32      0.00      0.33      0.00      0.10     95.26
01:17:01 AM       0      4.52      0.00      0.35      0.00      0.10     95.03
01:17:01 AM       1      4.12      0.00      0.30      0.00      0.10     95.48

01:17:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
01:18:01 AM     all      4.22      0.00      0.28      0.00      0.09     95.40
01:18:01 AM       0      2.07      0.00      0.18      0.00      0.08     97.66
01:18:01 AM       1      6.38      0.00      0.39      0.00      0.10     93.13
01:19:01 AM     all      6.91      0.00      0.41      0.00      0.10     92.58
01:19:01 AM       0      6.92      0.00      0.34      0.00      0.08     92.66
01:19:01 AM       1      6.89      0.00      0.49      0.00      0.12     92.50
01:20:01 AM     all      0.63      0.00      0.07      0.00      0.06     99.25
01:20:01 AM       0      0.42      0.00      0.08      0.00      0.05     99.45
01:20:01 AM       1      0.83      0.00      0.05      0.00      0.07     99.05
01:21:01 AM     all      0.35      0.00      0.07      0.01      0.05     99.52
01:21:01 AM       0      0.15      0.00      0.08      0.02      0.07     99.68
01:21:01 AM       1      0.55      0.00      0.05      0.00      0.03     99.37
01:22:01 AM     all      0.46      0.00      0.06      0.00      0.06     99.42
01:22:01 AM       0      0.33      0.00      0.07      0.00      0.07     99.53
01:22:01 AM       1      0.58      0.00      0.05      0.00      0.05     99.32
01:23:01 AM     all      0.33      0.00      0.07      0.00      0.07     99.53
01:23:01 AM       0      0.10      0.00      0.08      0.00      0.07     99.75
01:23:01 AM       1      0.57      0.00      0.05      0.00      0.07     99.32
01:24:01 AM     all      0.39      0.00      0.09      0.00      0.05     99.47
01:24:01 AM       0      0.17      0.00      0.10      0.00      0.05     99.68
01:24:01 AM       1      0.62      0.00      0.08      0.00      0.05     99.25
01:25:01 AM     all      0.46      0.00      0.06      0.00      0.06     99.42
01:25:01 AM       0      0.30      0.00      0.07      0.00      0.07     99.57
01:25:01 AM       1      0.62      0.00      0.05      0.00      0.05     99.28
01:26:01 AM     all      0.33      0.00      0.07      0.00      0.08     99.52
01:26:01 AM       0      0.13      0.00      0.10      0.00      0.08     99.68
01:26:01 AM       1      0.53      0.00      0.03      0.00      0.07     99.37
01:27:01 AM     all      4.41      0.00      2.43      0.00      0.07     93.09
01:27:01 AM       0      6.28      0.00      4.79      0.00      0.07     88.86
01:27:01 AM       1      2.68      0.00      0.25      0.00      0.07     97.00
01:28:01 AM     all      5.38      0.00      1.46      0.00      0.17     92.99
01:28:01 AM       0      1.97      0.00      0.27      0.00      0.19     97.57
01:28:01 AM       1      9.01      0.00      2.73      0.00      0.14     88.11

01:28:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
01:29:01 AM     all      0.35      0.18      0.13      0.04      0.04     99.27
01:29:01 AM       0      0.10      0.02      0.08      0.00      0.05     99.75
01:29:01 AM       1      0.60      0.33      0.17      0.08      0.03     98.78
01:30:01 AM     all      0.77      0.00      0.11      0.00      0.04     99.08
01:30:01 AM       0      0.93      0.00      0.13      0.00      0.03     98.90
01:30:01 AM       1      0.62      0.00      0.08      0.00      0.05     99.25
01:31:01 AM     all      4.08      0.00      1.40      0.04      0.08     94.40
01:31:01 AM       0      2.78      0.00      0.36      0.09      0.09     96.69
01:31:01 AM       1      5.40      0.00      2.46      0.00      0.07     92.07
01:32:01 AM     all      0.38      0.00      0.08      0.00      0.04     99.50
01:32:01 AM       0      0.65      0.00      0.07      0.00      0.03     99.25
01:32:01 AM       1      0.12      0.00      0.08      0.00      0.05     99.75
01:33:01 AM     all      2.03      0.00      0.21      0.00      0.05     97.71
01:33:01 AM       0      0.70      0.00      0.13      0.00      0.03     99.13
01:33:01 AM       1      3.40      0.00      0.29      0.00      0.07     96.23
01:34:01 AM     all      2.57      0.00      1.13      0.00      0.05     96.25
01:34:01 AM       0      0.73      0.00      0.15      0.00      0.07     99.05
01:34:01 AM       1      4.47      0.00      2.15      0.00      0.03     93.34
01:35:01 AM     all      0.20      0.00      0.09      0.00      0.06     99.65
01:35:01 AM       0      0.22      0.00      0.12      0.00      0.05     99.62
01:35:01 AM       1      0.18      0.00      0.07      0.00      0.07     99.68
01:36:01 AM     all      3.32      0.00      1.52      0.00      0.08     95.08
01:36:01 AM       0      0.25      0.00      0.17      0.00      0.07     99.52
01:36:01 AM       1      6.58      0.00      2.95      0.00      0.09     90.38
01:37:01 AM     all      1.27      0.00      0.13      0.00      0.04     98.56
01:37:01 AM       0      0.22      0.00      0.12      0.00      0.07     99.60
01:37:01 AM       1      2.33      0.00      0.15      0.00      0.02     97.50
01:38:01 AM     all      0.37      0.00      0.07      0.00      0.05     99.52
01:38:01 AM       0      0.22      0.00      0.10      0.00      0.07     99.62
01:38:01 AM       1      0.52      0.00      0.03      0.00      0.03     99.42
01:39:01 AM     all      5.10      0.00      1.19      0.00      0.05     93.66
01:39:01 AM       0      0.60      0.00      0.13      0.00      0.05     99.22
01:39:01 AM       1      9.98      0.00      2.33      0.00      0.05     87.64

01:39:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
01:40:01 AM     all      3.99      0.00      1.25      0.00      0.06     94.70
01:40:01 AM       0      0.62      0.00      0.12      0.00      0.05     99.22
01:40:01 AM       1      7.54      0.00      2.44      0.00      0.07     89.94
01:41:01 AM     all      0.36      0.00      0.07      0.00      0.06     99.52
01:41:01 AM       0      0.62      0.00      0.07      0.00      0.05     99.27
01:41:01 AM       1      0.10      0.00      0.07      0.00      0.07     99.77
01:42:01 AM     all      2.75      0.00      0.32      0.00      0.06     96.87
01:42:01 AM       0      0.65      0.00      0.12      0.00      0.05     99.18
01:42:01 AM       1      4.90      0.00      0.53      0.00      0.07     94.50
01:43:01 AM     all      2.18      0.00      0.96      0.00      0.04     96.81
01:43:01 AM       0      0.62      0.00      0.07      0.00      0.05     99.26
01:43:01 AM       1      3.81      0.00      1.89      0.00      0.03     94.27
01:44:01 AM     all      0.35      0.00      0.08      0.00      0.07     99.51
01:44:01 AM       0      0.62      0.00      0.07      0.00      0.07     99.25
01:44:01 AM       1      0.08      0.00      0.08      0.00      0.07     99.77
01:45:01 AM     all      4.64      0.00      0.94      0.00      0.05     94.37
01:45:01 AM       0      5.53      0.00      1.64      0.00      0.05     92.78
01:45:01 AM       1      3.76      0.00      0.25      0.00      0.05     95.93
01:46:01 AM     all      5.13      0.00      1.71      0.00      0.08     93.09
01:46:01 AM       0      6.33      0.00      3.14      0.00      0.07     90.46
01:46:01 AM       1      3.96      0.00      0.32      0.00      0.08     95.64
01:47:01 AM     all      4.28      0.00      0.30      0.00      0.08     95.33
01:47:01 AM       0      2.82      0.00      0.25      0.00      0.07     96.86
01:47:01 AM       1      5.75      0.00      0.35      0.00      0.10     93.80
01:48:01 AM     all      4.30      0.00      0.31      0.00      0.14     95.25
01:48:01 AM       0      4.37      0.00      0.30      0.00      0.13     95.20
01:48:01 AM       1      4.23      0.00      0.32      0.00      0.15     95.30
01:49:01 AM     all      4.16      0.00      0.32      0.00      0.07     95.46
01:49:01 AM       0      3.26      0.00      0.27      0.00      0.05     96.42
01:49:01 AM       1      5.06      0.00      0.37      0.00      0.08     94.49
01:50:01 AM     all      4.36      0.00      0.31      0.00      0.09     95.24
01:50:01 AM       0      5.57      0.00      0.37      0.00      0.10     93.96
01:50:01 AM       1      3.16      0.00      0.24      0.00      0.07     96.53

01:50:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
01:51:01 AM     all      4.14      0.00      0.28      0.01      0.08     95.48
01:51:01 AM       0      2.06      0.00      0.17      0.02      0.07     97.69
01:51:01 AM       1      6.23      0.00      0.40      0.00      0.10     93.27
01:52:01 AM     all      6.06      0.00      0.36      0.00      0.08     93.50
01:52:01 AM       0      3.08      0.00      0.32      0.00      0.08     96.52
01:52:01 AM       1      9.04      0.00      0.40      0.00      0.08     90.48
01:53:01 AM     all      0.43      0.00      0.11      0.00      0.05     99.41
01:53:01 AM       0      0.52      0.00      0.13      0.00      0.05     99.30
01:53:01 AM       1      0.35      0.00      0.08      0.00      0.05     99.52
01:54:01 AM     all      0.31      0.00      0.06      0.00      0.04     99.59
01:54:01 AM       0      0.48      0.00      0.05      0.00      0.03     99.43
01:54:01 AM       1      0.13      0.00      0.07      0.00      0.05     99.75
01:55:01 AM     all      0.28      0.00      0.06      0.00      0.06     99.60
01:55:01 AM       0      0.27      0.00      0.05      0.00      0.07     99.61
01:55:01 AM       1      0.30      0.00      0.07      0.00      0.05     99.58
01:56:01 AM     all      0.21      0.00      0.08      0.00      0.06     99.66
01:56:01 AM       0      0.33      0.00      0.08      0.00      0.07     99.51
01:56:01 AM       1      0.08      0.00      0.07      0.00      0.05     99.80
01:57:01 AM     all      0.45      0.00      0.06      0.00      0.05     99.44
01:57:01 AM       0      0.67      0.00      0.05      0.00      0.05     99.23
01:57:01 AM       1      0.23      0.00      0.07      0.00      0.05     99.65
01:58:01 AM     all      0.30      0.00      0.08      0.00      0.06     99.57
01:58:01 AM       0      0.07      0.00      0.07      0.00      0.05     99.82
01:58:01 AM       1      0.53      0.00      0.08      0.00      0.07     99.32
01:59:01 AM     all      1.48      0.00      0.09      0.00      0.06     98.37
01:59:01 AM       0      0.82      0.00      0.10      0.00      0.08     99.00
01:59:01 AM       1      2.13      0.00      0.08      0.00      0.03     97.75
02:00:01 AM     all      6.06      0.00      4.88      0.00      0.07     89.00
02:00:01 AM       0      8.06      0.00      9.30      0.00      0.07     82.57
02:00:01 AM       1      4.06      0.00      0.46      0.00      0.07     95.40
02:01:01 AM     all      3.26      0.00      1.18      0.01      0.05     95.50
02:01:01 AM       0      5.81      0.00      2.33      0.00      0.07     91.78
02:01:01 AM       1      0.85      0.00      0.08      0.02      0.03     99.02

02:01:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
02:02:01 AM     all      0.36      0.00      0.06      0.00      0.05     99.53
02:02:01 AM       0      0.15      0.00      0.08      0.00      0.07     99.70
02:02:01 AM       1      0.57      0.00      0.03      0.00      0.03     99.37
02:03:01 AM     all      2.81      0.00      0.53      0.00      0.06     96.60
02:03:01 AM       0      4.97      0.00      0.98      0.00      0.07     93.98
02:03:01 AM       1      0.72      0.00      0.10      0.00      0.05     99.13
02:04:01 AM     all      6.42      0.00      1.96      0.00      0.07     91.54
02:04:01 AM       0      3.94      0.00      1.64      0.00      0.07     94.35
02:04:01 AM       1      8.98      0.00      2.30      0.00      0.07     88.65
02:05:01 AM     all      5.76      0.00      1.86      0.00      0.08     92.30
02:05:01 AM       0     11.21      0.00      3.74      0.00      0.07     84.99
02:05:01 AM       1      0.84      0.00      0.17      0.00      0.08     98.91
02:06:01 AM     all      5.71      0.00      2.34      0.00      0.06     91.89
02:06:01 AM       0     11.60      0.00      4.70      0.00      0.06     83.65
02:06:01 AM       1      0.40      0.00      0.22      0.00      0.07     99.32
02:07:01 AM     all      0.34      0.00      0.07      0.00      0.05     99.54
02:07:01 AM       0      0.08      0.00      0.07      0.00      0.03     99.82
02:07:01 AM       1      0.60      0.00      0.07      0.00      0.07     99.27
02:08:01 AM     all      0.28      0.00      0.07      0.00      0.06     99.59
02:08:01 AM       0      0.08      0.00      0.07      0.00      0.05     99.80
02:08:01 AM       1      0.48      0.00      0.07      0.00      0.07     99.38
02:09:01 AM     all      7.03      0.00      2.42      0.00      0.07     90.48
02:09:01 AM       0      1.42      0.00      0.17      0.00      0.07     98.35
02:09:01 AM       1     13.06      0.00      4.85      0.00      0.07     82.02
02:10:01 AM     all      4.50      0.00      0.30      0.00      0.07     95.14
02:10:01 AM       0      2.93      0.00      0.25      0.00      0.07     96.75
02:10:01 AM       1      6.06      0.00      0.35      0.00      0.07     93.53
02:11:01 AM     all      4.06      0.00      0.32      0.00      0.08     95.55
02:11:01 AM       0      2.22      0.00      0.20      0.00      0.05     97.52
02:11:01 AM       1      5.90      0.00      0.44      0.00      0.10     93.57
02:12:01 AM     all      4.24      0.00      0.35      0.00      0.09     95.32
02:12:01 AM       0      3.06      0.00      0.30      0.00      0.08     96.55
02:12:01 AM       1      5.41      0.00      0.40      0.00      0.10     94.09

02:12:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
02:13:01 AM     all      4.19      0.00      0.28      0.00      0.07     95.45
02:13:01 AM       0      3.15      0.00      0.27      0.00      0.07     96.52
02:13:01 AM       1      5.24      0.00      0.30      0.00      0.07     94.39
02:14:01 AM     all      4.04      0.00      0.31      0.02      0.07     95.57
02:14:01 AM       0      3.50      0.00      0.25      0.00      0.07     96.18
02:14:01 AM       1      4.57      0.00      0.37      0.03      0.07     94.96
02:15:01 AM     all      4.21      0.00      0.33      0.00      0.08     95.38
02:15:01 AM       0      2.17      0.00      0.20      0.00      0.08     97.54
02:15:01 AM       1      6.26      0.00      0.45      0.00      0.08     93.20
02:16:01 AM     all      4.55      0.00      0.27      0.00      0.08     95.10
02:16:01 AM       0      1.57      0.00      0.25      0.00      0.08     98.09
02:16:01 AM       1      7.55      0.00      0.29      0.00      0.07     92.10
02:17:01 AM     all      0.30      0.00      0.06      0.00      0.06     99.58
02:17:01 AM       0      0.12      0.00      0.07      0.00      0.05     99.77
02:17:01 AM       1      0.48      0.00      0.05      0.00      0.07     99.40
02:18:01 AM     all      0.38      0.00      0.07      0.00      0.05     99.51
02:18:01 AM       0      0.15      0.00      0.08      0.00      0.07     99.70
02:18:01 AM       1      0.60      0.00      0.05      0.00      0.03     99.32
02:19:01 AM     all      0.51      0.00      0.08      0.00      0.06     99.36
02:19:01 AM       0      0.18      0.00      0.07      0.00      0.07     99.68
02:19:01 AM       1      0.83      0.00      0.08      0.00      0.05     99.03
02:20:01 AM     all      0.33      0.00      0.08      0.00      0.06     99.54
02:20:01 AM       0      0.15      0.00      0.12      0.00      0.08     99.65
02:20:01 AM       1      0.50      0.00      0.03      0.00      0.03     99.43
02:21:01 AM     all      0.46      0.00      0.08      0.00      0.05     99.42
02:21:01 AM       0      0.18      0.00      0.12      0.00      0.07     99.63
02:21:01 AM       1      0.73      0.00      0.03      0.00      0.03     99.20
02:22:01 AM     all      0.33      0.00      0.06      0.00      0.06     99.55
02:22:01 AM       0      0.05      0.00      0.05      0.00      0.05     99.85
02:22:01 AM       1      0.62      0.00      0.07      0.00      0.07     99.25
02:23:01 AM     all      3.75      0.00      2.80      0.00      0.09     93.36
02:23:01 AM       0      3.28      0.00      4.97      0.00      0.10     91.66
02:23:01 AM       1      4.24      0.00      0.58      0.00      0.08     95.10

02:23:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
02:24:01 AM     all      5.94      0.00      2.86      0.00      0.12     91.07
02:24:01 AM       0      2.55      0.00      0.27      0.00      0.08     97.10
02:24:01 AM       1      9.63      0.00      5.69      0.00      0.17     84.51
02:25:01 AM     all      1.47      0.00      0.12      0.00      0.06     98.35
02:25:01 AM       0      0.52      0.00      0.08      0.00      0.05     99.35
02:25:01 AM       1      2.45      0.00      0.15      0.00      0.07     97.33
02:26:01 AM     all      0.27      0.00      0.08      0.01      0.06     99.59
02:26:01 AM       0      0.12      0.00      0.08      0.02      0.07     99.72
02:26:01 AM       1      0.42      0.00      0.07      0.00      0.05     99.47
02:27:01 AM     all      4.95      0.00      1.37      0.00      0.06     93.62
02:27:01 AM       0      4.10      0.00      0.34      0.00      0.07     95.49
02:27:01 AM       1      5.82      0.00      2.42      0.00      0.05     91.70
02:28:01 AM     all      6.43      0.00      1.91      0.00      0.07     91.58
02:28:01 AM       0      5.55      0.00      1.20      0.00      0.07     93.19
02:28:01 AM       1      7.33      0.00      2.64      0.00      0.07     89.96
02:29:01 AM     all      6.93      0.00      2.25      0.00      0.08     90.75
02:29:01 AM       0      8.45      0.00      2.15      0.00      0.07     89.33
02:29:01 AM       1      5.44      0.00      2.34      0.00      0.09     92.13
02:30:01 AM     all      4.54      0.00      1.43      0.00      0.07     93.96
02:30:01 AM       0      8.85      0.00      2.83      0.00      0.07     88.24
02:30:01 AM       1      0.45      0.00      0.10      0.00      0.07     99.38
02:31:01 AM     all      0.34      0.00      0.08      0.00      0.04     99.54
02:31:01 AM       0      0.53      0.00      0.05      0.00      0.03     99.38
02:31:01 AM       1      0.15      0.00      0.10      0.00      0.05     99.70
02:32:01 AM     all      2.65      0.00      0.19      0.00      0.05     97.11
02:32:01 AM       0      1.41      0.00      0.12      0.00      0.03     98.44
02:32:01 AM       1      3.90      0.00      0.25      0.00      0.07     95.78
02:33:01 AM     all      5.90      0.00      2.34      0.00      0.09     91.67
02:33:01 AM       0      4.54      0.00      1.10      0.00      0.10     94.26
02:33:01 AM       1      7.27      0.00      3.58      0.00      0.09     89.06
02:34:01 AM     all      4.23      0.00      0.31      0.00      0.09     95.37
02:34:01 AM       0      4.08      0.00      0.27      0.00      0.08     95.56
02:34:01 AM       1      4.38      0.00      0.35      0.00      0.10     95.17

02:34:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
02:35:01 AM     all      4.18      0.00      0.29      0.03      0.09     95.41
02:35:01 AM       0      3.85      0.00      0.30      0.00      0.08     95.77
02:35:01 AM       1      4.50      0.00      0.28      0.07      0.10     95.05
02:36:01 AM     all      4.07      0.00      0.28      0.00      0.10     95.56
02:36:01 AM       0      1.89      0.00      0.18      0.00      0.10     97.83
02:36:01 AM       1      6.25      0.00      0.37      0.00      0.10     93.28
02:37:01 AM     all      3.97      0.00      0.29      0.00      0.08     95.65
02:37:01 AM       0      2.26      0.00      0.20      0.00      0.07     97.48
02:37:01 AM       1      5.69      0.00      0.38      0.00      0.10     93.83
02:38:01 AM     all      4.31      0.00      0.31      0.00      0.08     95.31
02:38:01 AM       0      4.28      0.00      0.28      0.00      0.07     95.37
02:38:01 AM       1      4.33      0.00      0.33      0.00      0.08     95.25
02:39:01 AM     all      6.82      0.00      0.36      0.00      0.07     92.76
02:39:01 AM       0     10.08      0.00      0.39      0.00      0.08     89.45
02:39:01 AM       1      3.56      0.00      0.33      0.00      0.05     96.05
02:40:01 AM     all      0.55      0.00      0.11      0.00      0.07     99.27
02:40:01 AM       0      0.55      0.00      0.12      0.00      0.07     99.27
02:40:01 AM       1      0.55      0.00      0.10      0.00      0.07     99.28
02:41:01 AM     all      0.13      0.00      0.07      0.00      0.04     99.76
02:41:01 AM       0      0.08      0.00      0.07      0.00      0.05     99.80
02:41:01 AM       1      0.18      0.00      0.07      0.00      0.03     99.72
02:42:01 AM     all      0.45      0.00      0.06      0.00      0.05     99.44
02:42:01 AM       0      0.32      0.00      0.07      0.00      0.05     99.57
02:42:01 AM       1      0.58      0.00      0.05      0.00      0.05     99.32
02:43:01 AM     all      0.33      0.00      0.05      0.00      0.04     99.57
02:43:01 AM       0      0.62      0.00      0.07      0.00      0.05     99.27
02:43:01 AM       1      0.05      0.00      0.03      0.00      0.03     99.88
02:44:01 AM     all      0.35      0.00      0.03      0.00      0.06     99.56
02:44:01 AM       0      0.35      0.00      0.03      0.00      0.07     99.55
02:44:01 AM       1      0.35      0.00      0.03      0.00      0.05     99.57
02:45:01 AM     all      0.44      0.00      0.08      0.00      0.05     99.43
02:45:01 AM       0      0.27      0.00      0.08      0.00      0.03     99.62
02:45:01 AM       1      0.62      0.00      0.07      0.00      0.07     99.25

02:45:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
02:46:01 AM     all      0.33      0.00      0.07      0.00      0.04     99.57
02:46:01 AM       0      0.07      0.00      0.07      0.00      0.05     99.82
02:46:01 AM       1      0.58      0.00      0.07      0.00      0.03     99.32
02:47:01 AM     all      6.05      0.00      5.26      0.00      0.07     88.62
02:47:01 AM       0      6.58      0.00      9.91      0.00      0.07     83.44
02:47:01 AM       1      5.50      0.00      0.41      0.00      0.07     94.02
02:48:01 AM     all      5.13      0.00      1.18      0.00      0.09     93.61
02:48:01 AM       0      1.45      0.00      0.19      0.00      0.08     98.28
02:48:01 AM       1      9.01      0.00      2.22      0.00      0.09     88.67
02:49:01 AM     all      0.34      0.00      0.06      0.00      0.05     99.55
02:49:01 AM       0      0.65      0.00      0.07      0.00      0.08     99.20
02:49:01 AM       1      0.03      0.00      0.05      0.00      0.02     99.90
02:50:01 AM     all      1.19      0.00      0.15      0.00      0.05     98.61
02:50:01 AM       0      0.23      0.00      0.10      0.00      0.05     99.62
02:50:01 AM       1      2.16      0.00      0.20      0.00      0.05     97.58
02:51:01 AM     all      3.53      0.00      1.37      0.00      0.09     95.02
02:51:01 AM       0      5.64      0.00      2.54      0.00      0.09     91.73
02:51:01 AM       1      1.47      0.00      0.22      0.00      0.08     98.23
02:52:01 AM     all      3.24      0.00      1.10      0.00      0.08     95.58
02:52:01 AM       0      0.65      0.00      0.08      0.00      0.07     99.20
02:52:01 AM       1      5.95      0.00      2.17      0.00      0.09     91.79
02:53:01 AM     all      1.88      0.00      0.35      0.00      0.04     97.72
02:53:01 AM       0      0.65      0.00      0.08      0.00      0.05     99.22
02:53:01 AM       1      3.14      0.00      0.63      0.00      0.03     96.20
02:54:01 AM     all      0.35      0.00      0.08      0.00      0.05     99.52
02:54:01 AM       0      0.62      0.00      0.07      0.00      0.05     99.27
02:54:01 AM       1      0.08      0.00      0.08      0.00      0.05     99.78
02:55:01 AM     all      4.97      0.00      2.57      0.00      0.06     92.40
02:55:01 AM       0      6.52      0.00      4.86      0.00      0.05     88.57
02:55:01 AM       1      3.46      0.00      0.34      0.00      0.07     96.13
02:56:01 AM     all      4.92      0.00      0.37      0.00      0.09     94.61
02:56:01 AM       0      4.16      0.00      0.34      0.00      0.09     95.42
02:56:01 AM       1      5.67      0.00      0.40      0.00      0.10     93.83

02:56:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
02:57:01 AM     all      4.02      0.00      0.31      0.00      0.08     95.59
02:57:01 AM       0      1.79      0.00      0.18      0.00      0.07     97.96
02:57:01 AM       1      6.25      0.00      0.44      0.00      0.10     93.22
02:58:02 AM     all      4.32      0.00      0.33      0.00      0.08     95.28
02:58:02 AM       0      2.17      0.00      0.22      0.00      0.07     97.54
02:58:02 AM       1      6.46      0.00      0.44      0.00      0.08     93.02
02:59:01 AM     all      4.20      0.00      0.29      0.00      0.07     95.44
02:59:01 AM       0      3.85      0.00      0.27      0.00      0.07     95.81
02:59:01 AM       1      4.56      0.00      0.31      0.00      0.07     95.07
03:00:01 AM     all      4.29      0.00      0.30      0.00      0.10     95.31
03:00:01 AM       0      4.79      0.00      0.30      0.00      0.08     94.83
03:00:01 AM       1      3.79      0.00      0.30      0.00      0.12     95.80
03:01:01 AM     all      4.32      0.00      0.33      0.00      0.08     95.27
03:01:01 AM       0      2.44      0.00      0.25      0.00      0.08     97.23
03:01:01 AM       1      6.21      0.00      0.42      0.00      0.07     93.30
03:02:01 AM     all      5.40      0.00      0.32      0.00      0.08     94.21
03:02:01 AM       0      3.21      0.00      0.25      0.00      0.07     96.48
03:02:01 AM       1      7.60      0.00      0.39      0.00      0.08     91.93
03:03:01 AM     all      0.43      0.00      0.08      0.00      0.04     99.46
03:03:01 AM       0      0.65      0.00      0.05      0.00      0.02     99.28
03:03:01 AM       1      0.20      0.00      0.10      0.00      0.07     99.63
03:04:01 AM     all      0.34      0.00      0.06      0.00      0.03     99.57
03:04:01 AM       0      0.55      0.00      0.03      0.00      0.02     99.40
03:04:01 AM       1      0.13      0.00      0.08      0.00      0.05     99.73
03:05:01 AM     all      0.44      0.00      0.06      0.00      0.05     99.45
03:05:01 AM       0      0.40      0.00      0.05      0.00      0.03     99.52
03:05:01 AM       1      0.48      0.00      0.07      0.00      0.07     99.38
03:06:01 AM     all      0.35      0.00      0.05      0.00      0.05     99.55
03:06:01 AM       0      0.12      0.00      0.07      0.00      0.05     99.77
03:06:01 AM       1      0.58      0.00      0.03      0.00      0.05     99.33
03:07:01 AM     all      0.36      0.00      0.11      0.00      0.06     99.47
03:07:01 AM       0      0.28      0.00      0.10      0.00      0.05     99.57
03:07:01 AM       1      0.43      0.00      0.12      0.00      0.07     99.38

03:07:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
03:08:01 AM     all      0.18      0.00      0.07      0.00      0.06     99.69
03:08:01 AM       0      0.08      0.00      0.07      0.00      0.07     99.78
03:08:01 AM       1      0.28      0.00      0.07      0.00      0.05     99.60
03:09:01 AM     all      2.57      0.00      0.18      0.00      0.04     97.20
03:09:01 AM       0      3.74      0.00      0.29      0.00      0.05     95.92
03:09:01 AM       1      1.42      0.00      0.08      0.00      0.03     98.47
03:10:01 AM     all      6.37      0.00      4.80      0.00      0.09     88.74
03:10:01 AM       0      2.14      0.00      0.44      0.00      0.09     97.33
03:10:01 AM       1     10.75      0.00      9.32      0.00      0.09     79.84
03:11:01 AM     all      6.42      0.00      2.37      0.02      0.08     91.11
03:11:01 AM       0     11.90      0.00      4.71      0.00      0.07     83.32
03:11:01 AM       1      1.26      0.00      0.17      0.03      0.08     98.46
03:12:01 AM     all      4.28      0.16      0.40      0.02      0.08     95.06
03:12:01 AM       0      3.96      0.00      0.35      0.02      0.08     95.59
03:12:01 AM       1      4.60      0.32      0.45      0.02      0.08     94.53
03:13:01 AM     all      4.27      0.00      0.31      0.00      0.08     95.33
03:13:01 AM       0      3.77      0.00      0.32      0.00      0.10     95.82
03:13:01 AM       1      4.78      0.00      0.30      0.00      0.07     94.85
03:14:01 AM     all      4.17      0.00      0.28      0.00      0.08     95.46
03:14:01 AM       0      1.79      0.00      0.17      0.00      0.07     97.98
03:14:01 AM       1      6.55      0.00      0.40      0.00      0.10     92.94
03:15:01 AM     all      4.33      0.00      0.34      0.00      0.06     95.27
03:15:01 AM       0      4.58      0.00      0.35      0.00      0.07     95.00
03:15:01 AM       1      4.08      0.00      0.34      0.00      0.05     95.54
03:16:01 AM     all      4.24      0.00      0.32      0.22      0.08     95.15
03:16:01 AM       0      5.73      0.00      0.35      0.44      0.07     93.41
03:16:01 AM       1      2.74      0.00      0.28      0.00      0.08     96.89
03:17:01 AM     all      6.40      0.00      0.34      0.00      0.07     93.19
03:17:01 AM       0      6.51      0.00      0.35      0.00      0.07     93.07
03:17:01 AM       1      6.29      0.00      0.34      0.00      0.07     93.30
03:18:01 AM     all      1.56      0.00      0.13      0.00      0.07     98.24
03:18:01 AM       0      0.85      0.00      0.12      0.00      0.05     98.98
03:18:01 AM       1      2.28      0.00      0.13      0.00      0.08     97.51

03:18:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
03:19:01 AM     all      0.48      0.00      0.06      0.00      0.03     99.42
03:19:01 AM       0      0.58      0.00      0.05      0.00      0.03     99.33
03:19:01 AM       1      0.38      0.00      0.07      0.00      0.03     99.52
03:20:01 AM     all      0.33      0.00      0.08      0.00      0.03     99.56
03:20:01 AM       0      0.50      0.00      0.07      0.00      0.03     99.40
03:20:01 AM       1      0.15      0.00      0.10      0.00      0.03     99.72
03:21:01 AM     all      0.47      0.00      0.08      0.00      0.04     99.42
03:21:01 AM       0      0.63      0.00      0.07      0.00      0.05     99.25
03:21:01 AM       1      0.30      0.00      0.08      0.00      0.03     99.58
03:22:01 AM     all      0.33      0.00      0.05      0.00      0.04     99.57
03:22:01 AM       0      0.53      0.00      0.05      0.00      0.03     99.38
03:22:01 AM       1      0.13      0.00      0.05      0.00      0.05     99.77
03:23:01 AM     all      0.46      0.00      0.08      0.00      0.05     99.41
03:23:01 AM       0      0.10      0.00      0.07      0.00      0.05     99.78
03:23:01 AM       1      0.82      0.00      0.10      0.00      0.05     99.03
03:24:01 AM     all      0.36      0.00      0.07      0.00      0.04     99.53
03:24:01 AM       0      0.57      0.00      0.05      0.00      0.03     99.35
03:24:01 AM       1      0.15      0.00      0.08      0.00      0.05     99.72
03:25:01 AM     all      1.93      0.00      0.13      0.00      0.03     97.91
03:25:01 AM       0      2.42      0.00      0.13      0.00      0.02     97.43
03:25:01 AM       1      1.44      0.00      0.13      0.00      0.03     98.40
03:26:01 AM     all      6.77      0.00      4.00      0.01      0.09     89.13
03:26:01 AM       0      2.08      0.00      0.20      0.02      0.07     97.64
03:26:01 AM       1     11.90      0.00      8.16      0.00      0.11     79.82
03:27:01 AM     all      6.92      0.00      2.55      0.00      0.09     90.44
03:27:01 AM       0     12.08      0.00      5.05      0.00      0.09     82.78
03:27:01 AM       1      2.12      0.00      0.23      0.00      0.08     97.56
03:28:01 AM     all      4.19      0.00      0.32      0.00      0.05     95.44
03:28:01 AM       0      2.43      0.00      0.23      0.00      0.05     97.29
03:28:01 AM       1      5.96      0.00      0.40      0.00      0.05     93.59
03:29:01 AM     all      4.26      0.00      0.31      0.00      0.08     95.35
03:29:01 AM       0      5.26      0.00      0.37      0.00      0.08     94.29
03:29:01 AM       1      3.26      0.00      0.25      0.00      0.07     96.42

03:29:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
03:30:01 AM     all      4.24      0.00      0.34      0.00      0.08     95.33
03:30:01 AM       0      3.18      0.00      0.28      0.00      0.08     96.46
03:30:01 AM       1      5.31      0.00      0.40      0.00      0.08     94.21
03:31:01 AM     all      4.34      0.00      0.33      0.01      0.08     95.25
03:31:01 AM       0      4.92      0.00      0.40      0.02      0.10     94.56
03:31:01 AM       1      3.77      0.00      0.25      0.00      0.05     95.93
03:32:01 AM     all      4.40      0.00      0.33      0.00      0.07     95.21
03:32:01 AM       0      4.30      0.00      0.30      0.00      0.05     95.35
03:32:01 AM       1      4.50      0.00      0.35      0.00      0.08     95.07
03:33:01 AM     all      5.32      0.00      0.36      0.00      0.08     94.25
03:33:01 AM       0      4.10      0.00      0.28      0.00      0.07     95.55
03:33:01 AM       1      6.53      0.00      0.44      0.00      0.08     92.95
03:34:01 AM     all      3.13      0.00      0.18      0.00      0.08     96.61
03:34:01 AM       0      0.97      0.00      0.13      0.00      0.10     98.80
03:34:01 AM       1      5.30      0.00      0.22      0.00      0.07     94.41
03:35:01 AM     all      0.36      0.00      0.07      0.00      0.04     99.53
03:35:01 AM       0      0.62      0.00      0.07      0.00      0.03     99.28
03:35:01 AM       1      0.10      0.00      0.07      0.00      0.05     99.78
03:36:01 AM     all      0.37      0.00      0.05      0.00      0.05     99.53
03:36:01 AM       0      0.58      0.00      0.05      0.00      0.03     99.33
03:36:01 AM       1      0.15      0.00      0.05      0.00      0.07     99.73
03:37:01 AM     all      0.44      0.00      0.07      0.00      0.03     99.46
03:37:01 AM       0      0.53      0.00      0.03      0.00      0.02     99.42
03:37:01 AM       1      0.35      0.00      0.10      0.00      0.05     99.50
03:38:01 AM     all      0.38      0.00      0.05      0.00      0.04     99.53
03:38:01 AM       0      0.15      0.00      0.05      0.00      0.05     99.75
03:38:01 AM       1      0.60      0.00      0.05      0.00      0.03     99.32
03:39:01 AM     all      0.46      0.00      0.07      0.00      0.04     99.43
03:39:01 AM       0      0.30      0.00      0.07      0.00      0.03     99.60
03:39:01 AM       1      0.62      0.00      0.07      0.00      0.05     99.27
03:40:01 AM     all      0.28      0.00      0.08      0.00      0.04     99.61
03:40:01 AM       0      0.38      0.00      0.08      0.00      0.05     99.48
03:40:01 AM       1      0.17      0.00      0.07      0.00      0.03     99.73

03:40:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
03:41:01 AM     all      4.54      0.00      3.88      0.03      0.06     91.48
03:41:01 AM       0      2.60      0.00      1.51      0.00      0.05     95.84
03:41:01 AM       1      6.54      0.00      6.33      0.07      0.07     86.99
03:42:01 AM     all      7.74      0.00      0.65      0.00      0.08     91.54
03:42:01 AM       0      3.15      0.00      0.32      0.00      0.05     96.48
03:42:01 AM       1     12.58      0.00      0.99      0.00      0.11     86.32
03:43:01 AM     all      5.57      0.00      2.83      0.00      0.07     91.53
03:43:01 AM       0      1.95      0.00      0.23      0.00      0.05     97.76
03:43:01 AM       1      9.33      0.00      5.52      0.00      0.09     85.07
03:44:01 AM     all      4.37      0.00      0.35      0.00      0.08     95.20
03:44:01 AM       0      4.89      0.00      0.35      0.00      0.07     94.69
03:44:01 AM       1      3.85      0.00      0.35      0.00      0.08     95.71
03:45:01 AM     all      4.31      0.00      0.32      0.00      0.07     95.30
03:45:01 AM       0      5.95      0.00      0.39      0.00      0.07     93.60
03:45:01 AM       1      2.68      0.00      0.25      0.00      0.07     97.00
03:46:01 AM     all      4.39      0.00      0.33      0.00      0.08     95.20
03:46:01 AM       0      3.77      0.00      0.28      0.00      0.05     95.90
03:46:01 AM       1      5.02      0.00      0.39      0.00      0.10     94.49
03:47:01 AM     all      4.42      0.00      0.34      0.00      0.09     95.14
03:47:01 AM       0      5.68      0.00      0.44      0.00      0.12     93.77
03:47:01 AM       1      3.16      0.00      0.25      0.00      0.07     96.52
03:48:01 AM     all      4.48      0.00      0.31      0.00      0.07     95.14
03:48:01 AM       0      3.00      0.00      0.22      0.00      0.07     96.72
03:48:01 AM       1      5.97      0.00      0.40      0.00      0.07     93.57
03:49:01 AM     all      6.47      0.00      0.40      0.00      0.07     93.07
03:49:01 AM       0      6.32      0.00      0.37      0.00      0.05     93.26
03:49:01 AM       1      6.61      0.00      0.42      0.00      0.08     92.88
03:50:01 AM     all      0.46      0.00      0.13      0.00      0.03     99.38
03:50:01 AM       0      0.45      0.00      0.13      0.00      0.03     99.38
03:50:01 AM       1      0.47      0.00      0.12      0.00      0.03     99.38
03:51:01 AM     all      0.36      0.00      0.07      0.00      0.03     99.54
03:51:01 AM       0      0.50      0.00      0.08      0.00      0.03     99.38
03:51:01 AM       1      0.22      0.00      0.05      0.00      0.03     99.70

03:51:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
03:52:01 AM     all      0.37      0.00      0.09      0.00      0.05     99.49
03:52:01 AM       0      0.40      0.00      0.12      0.00      0.05     99.43
03:52:01 AM       1      0.33      0.00      0.07      0.00      0.05     99.55
03:53:01 AM     all      0.31      0.00      0.08      0.00      0.03     99.58
03:53:01 AM       0      0.20      0.00      0.12      0.00      0.03     99.65
03:53:01 AM       1      0.42      0.00      0.05      0.00      0.02     99.52
03:54:01 AM     all      0.49      0.00      0.07      0.00      0.03     99.42
03:54:01 AM       0      0.60      0.00      0.05      0.00      0.02     99.33
03:54:01 AM       1      0.38      0.00      0.08      0.00      0.03     99.50
03:55:01 AM     all      0.33      0.00      0.06      0.00      0.03     99.58
03:55:01 AM       0      0.25      0.00      0.05      0.00      0.03     99.67
03:55:01 AM       1      0.40      0.00      0.07      0.00      0.03     99.50
03:56:01 AM     all      0.32      0.00      0.08      0.05      0.03     99.53
03:56:01 AM       0      0.52      0.00      0.08      0.00      0.03     99.36
03:56:01 AM       1      0.12      0.00      0.07      0.10      0.02     99.70
03:57:01 AM     all      7.76      0.00      4.38      0.00      0.10     87.76
03:57:01 AM       0     13.84      0.00      8.85      0.00      0.13     77.19
03:57:01 AM       1      2.12      0.00      0.23      0.00      0.07     97.58
03:58:01 AM     all      7.14      0.00      4.12      0.00      0.06     88.69
03:58:01 AM       0     12.09      0.00      8.10      0.00      0.09     79.72
03:58:01 AM       1      2.46      0.00      0.36      0.00      0.03     97.15
03:59:01 AM     all      6.96      0.00      5.30      0.00      0.09     87.65
03:59:01 AM       0      8.32      0.00      3.32      0.00      0.09     88.27
03:59:01 AM       1      5.59      0.00      7.29      0.00      0.09     87.03
04:00:01 AM     all      6.59      0.00      5.41      0.00      0.08     87.93
04:00:01 AM       0     12.52      0.00     10.89      0.00      0.11     76.48
04:00:01 AM       1      1.17      0.00      0.40      0.00      0.05     98.38
04:01:01 AM     all      6.84      0.00      4.91      0.03      0.09     88.14
04:01:01 AM       0     10.75      0.00      9.21      0.00      0.09     79.95
04:01:01 AM       1      3.14      0.00      0.85      0.05      0.09     95.86
04:02:01 AM     all      6.69      0.00      4.23      0.00      0.08     89.00
04:02:01 AM       0      3.59      0.00      0.82      0.00      0.09     95.50
04:02:01 AM       1      9.94      0.00      7.80      0.00      0.07     82.19

04:02:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
04:03:01 AM     all      6.53      0.00      3.56      0.00      0.08     89.83
04:03:01 AM       0      0.79      0.00      0.27      0.00      0.05     98.90
04:03:01 AM       1     12.93      0.00      7.22      0.00      0.11     79.73
04:04:01 AM     all     26.26      0.00      2.47      0.18      0.11     70.98
04:04:01 AM       0     28.59      0.00      2.52      0.12      0.10     68.67
04:04:01 AM       1     23.92      0.00      2.43      0.23      0.12     73.30
04:05:02 AM     all     24.46      0.00      2.61      0.70      0.08     72.16
04:05:02 AM       0     17.76      0.00      2.41      0.70      0.07     79.06
04:05:02 AM       1     31.15      0.00      2.81      0.70      0.08     65.26
Average:        all      3.09      0.06      0.76      0.02      0.07     96.01
Average:          0      2.79      0.00      0.76      0.01      0.06     96.37
Average:          1      3.40      0.11      0.75      0.02      0.07     95.65