Started by upstream project "integration-distribution-mri-test-argon" build number 80
originally caused by:
 Started by timer
Running as SYSTEM
[EnvInject] - Loading node environment variables.
Building remotely on prd-centos8-robot-2c-8g-5480 (centos8-robot-2c-8g) in workspace /w/workspace/controller-csit-3node-clustering-tell-all-argon
[ssh-agent] Looking for ssh-agent implementation...
[ssh-agent]   Exec ssh-agent (binary ssh-agent on a remote machine)
$ ssh-agent
SSH_AUTH_SOCK=/tmp/ssh-9xkJJfo8zsR8/agent.5293
SSH_AGENT_PID=5294
[ssh-agent] Started.
Running ssh-add (command line suppressed)
Identity added: /w/workspace/controller-csit-3node-clustering-tell-all-argon@tmp/private_key_6838181209298307080.key (/w/workspace/controller-csit-3node-clustering-tell-all-argon@tmp/private_key_6838181209298307080.key)
[ssh-agent] Using credentials jenkins (Release Engineering Jenkins Key)
The recommended git tool is: NONE
using credential opendaylight-jenkins-ssh
Wiping out workspace first.
Cloning the remote Git repository
Cloning repository git://devvexx.opendaylight.org/mirror/integration/test
 > git init /w/workspace/controller-csit-3node-clustering-tell-all-argon/test # timeout=10
Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test
 > git --version # timeout=10
 > git --version # 'git version 2.43.0'
using GIT_SSH to set credentials Release Engineering Jenkins Key
[INFO] Currently running in a labeled security context
[INFO] Currently SELinux is 'enforcing' on the host
 > /usr/bin/chcon --type=ssh_home_t /w/workspace/controller-csit-3node-clustering-tell-all-argon/test@tmp/jenkins-gitclient-ssh11843472634052213307.key
Verifying host key using known hosts file
You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification.
 > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10
Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test
using GIT_SSH to set credentials Release Engineering Jenkins Key
[INFO] Currently running in a labeled security context
[INFO] Currently SELinux is 'enforcing' on the host
 > /usr/bin/chcon --type=ssh_home_t /w/workspace/controller-csit-3node-clustering-tell-all-argon/test@tmp/jenkins-gitclient-ssh8726218497061674880.key
Verifying host key using known hosts file
You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification.
 > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test master # timeout=10
 > git rev-parse FETCH_HEAD^{commit} # timeout=10
Checking out Revision c88ead2b4a65ba004398ad07cfe033ae1e467b17 (origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f c88ead2b4a65ba004398ad07cfe033ae1e467b17 # timeout=10
Commit message: "Reformat '* On Session' keywords (aaa)"
 > git rev-parse FETCH_HEAD^{commit} # timeout=10
 > git rev-list --no-walk 7df40c8c0ac70da634e98ef506471a9aa0c475be # timeout=10
No emails were triggered.
provisioning config files...
copy managed file [npmrc] to file:/home/jenkins/.npmrc
copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf
copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
[controller-csit-3node-clustering-tell-all-argon] $ /bin/bash /tmp/jenkins8859875366314361991.sh
---> python-tools-install.sh
Setup pyenv:
  system
* 3.8.13 (set by /opt/pyenv/version)
* 3.9.13 (set by /opt/pyenv/version)
* 3.10.13 (set by /opt/pyenv/version)
* 3.11.7 (set by /opt/pyenv/version)
lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-KFYn
lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: lftools 
lf-activate-venv(): INFO: Adding /tmp/venv-KFYn/bin to PATH
Generating Requirements File
Python 3.11.7
pip 24.0 from /tmp/venv-KFYn/lib/python3.11/site-packages/pip (python 3.11)
appdirs==1.4.4
argcomplete==3.2.3
aspy.yaml==1.3.0
attrs==23.2.0
autopage==0.5.2
beautifulsoup4==4.12.3
boto3==1.34.79
botocore==1.34.79
bs4==0.0.2
cachetools==5.3.3
certifi==2024.2.2
cffi==1.16.0
cfgv==3.4.0
chardet==5.2.0
charset-normalizer==3.3.2
click==8.1.7
cliff==4.6.0
cmd2==2.4.3
cryptography==3.3.2
debtcollector==3.0.0
decorator==5.1.1
defusedxml==0.7.1
Deprecated==1.2.14
distlib==0.3.8
dnspython==2.6.1
docker==4.2.2
dogpile.cache==1.3.2
email_validator==2.1.1
filelock==3.13.3
future==1.0.0
gitdb==4.0.11
GitPython==3.1.43
google-auth==2.29.0
httplib2==0.22.0
identify==2.5.35
idna==3.6
importlib-resources==1.5.0
iso8601==2.1.0
Jinja2==3.1.3
jmespath==1.0.1
jsonpatch==1.33
jsonpointer==2.4
jsonschema==4.21.1
jsonschema-specifications==2023.12.1
keystoneauth1==5.6.0
kubernetes==29.0.0
lftools==0.37.10
lxml==5.2.1
MarkupSafe==2.1.5
msgpack==1.0.8
multi_key_dict==2.0.3
munch==4.0.0
netaddr==1.2.1
netifaces==0.11.0
niet==1.4.2
nodeenv==1.8.0
oauth2client==4.1.3
oauthlib==3.2.2
openstacksdk==3.0.0
os-client-config==2.1.0
os-service-types==1.7.0
osc-lib==3.0.1
oslo.config==9.4.0
oslo.context==5.5.0
oslo.i18n==6.3.0
oslo.log==5.5.1
oslo.serialization==5.4.0
oslo.utils==7.1.0
packaging==24.0
pbr==6.0.0
platformdirs==4.2.0
prettytable==3.10.0
pyasn1==0.6.0
pyasn1_modules==0.4.0
pycparser==2.22
pygerrit2==2.0.15
PyGithub==2.3.0
pyinotify==0.9.6
PyJWT==2.8.0
PyNaCl==1.5.0
pyparsing==2.4.7
pyperclip==1.8.2
pyrsistent==0.20.0
python-cinderclient==9.5.0
python-dateutil==2.9.0.post0
python-heatclient==3.5.0
python-jenkins==1.8.2
python-keystoneclient==5.4.0
python-magnumclient==4.4.0
python-novaclient==18.6.0
python-openstackclient==6.6.0
python-swiftclient==4.5.0
PyYAML==6.0.1
referencing==0.34.0
requests==2.31.0
requests-oauthlib==2.0.0
requestsexceptions==1.4.0
rfc3986==2.0.0
rpds-py==0.18.0
rsa==4.9
ruamel.yaml==0.18.6
ruamel.yaml.clib==0.2.8
s3transfer==0.10.1
simplejson==3.19.2
six==1.16.0
smmap==5.0.1
soupsieve==2.5
stevedore==5.2.0
tabulate==0.9.0
toml==0.10.2
tomlkit==0.12.4
tqdm==4.66.2
typing_extensions==4.11.0
tzdata==2024.1
urllib3==1.26.18
virtualenv==20.25.1
wcwidth==0.2.13
websocket-client==1.7.0
wrapt==1.16.0
xdg==6.0.0
xmltodict==0.13.0
yq==3.2.3
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties content 
OS_STACK_TEMPLATE=csit-2-instance-type.yaml
OS_CLOUD=vex
OS_STACK_NAME=releng-controller-csit-3node-clustering-tell-all-argon-80
OS_STACK_TEMPLATE_DIR=openstack-hot

[EnvInject] - Variables injected successfully.
provisioning config files...
copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
[controller-csit-3node-clustering-tell-all-argon] $ /bin/bash /tmp/jenkins6643517780680517407.sh
---> Create parameters file for OpenStack HOT
OpenStack Heat parameters generated
-----------------------------------
parameters:
    vm_0_count: '3'
    vm_0_flavor: 'v3-standard-4'
    vm_0_image: 'ZZCI - CentOS Stream 8 - builder - x86_64 - 20240401-160147.446'
    vm_1_count: '0'
    vm_1_flavor: 'v3-standard-2'
    vm_1_image: 'ZZCI - Ubuntu 18.04 - mininet-ovs-28 - x86_64 - 20230601-180106.003'
    
    job_name: '41374-80'
    silo: 'releng'
[controller-csit-3node-clustering-tell-all-argon] $ /bin/bash -l /tmp/jenkins7123896940755104865.sh
---> Create HEAT stack
+ source /home/jenkins/lf-env.sh
+ lf-activate-venv --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
++ mktemp -d /tmp/venv-XXXX
+ lf_venv=/tmp/venv-ropL
+ local venv_file=/tmp/.os_lf_venv
+ local python=python3
+ local options
+ local set_path=true
+ local install_args=
++ getopt -o np:v: -l no-path,system-site-packages,python:,venv-file: -n lf-activate-venv -- --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
+ options=' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\'''
+ eval set -- ' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\'''
++ set -- --python python3 -- 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
+ true
+ case $1 in
+ python=python3
+ shift 2
+ true
+ case $1 in
+ shift
+ break
+ case $python in
+ local pkg_list=
+ [[ -d /opt/pyenv ]]
+ echo 'Setup pyenv:'
Setup pyenv:
+ export PYENV_ROOT=/opt/pyenv
+ PYENV_ROOT=/opt/pyenv
+ export PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
+ PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
+ pyenv versions
  system
  3.8.13
  3.9.13
  3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-argon/.python-version)
+ command -v pyenv
++ pyenv init - --no-rehash
+ eval 'PATH="$(bash --norc -ec '\''IFS=:; paths=($PATH); 
for i in ${!paths[@]}; do 
if [[ ${paths[i]} == "'\'''\''/opt/pyenv/shims'\'''\''" ]]; then unset '\''\'\'''\''paths[i]'\''\'\'''\''; 
fi; done; 
echo "${paths[*]}"'\'')"
export PATH="/opt/pyenv/shims:${PATH}"
export PYENV_SHELL=bash
source '\''/opt/pyenv/libexec/../completions/pyenv.bash'\''
pyenv() {
  local command
  command="${1:-}"
  if [ "$#" -gt 0 ]; then
    shift
  fi

  case "$command" in
  rehash|shell)
    eval "$(pyenv "sh-$command" "$@")"
    ;;
  *)
    command pyenv "$command" "$@"
    ;;
  esac
}'
+++ bash --norc -ec 'IFS=:; paths=($PATH); 
for i in ${!paths[@]}; do 
if [[ ${paths[i]} == "/opt/pyenv/shims" ]]; then unset '\''paths[i]'\''; 
fi; done; 
echo "${paths[*]}"'
++ PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
++ export PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
++ PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
++ export PYENV_SHELL=bash
++ PYENV_SHELL=bash
++ source /opt/pyenv/libexec/../completions/pyenv.bash
+++ complete -F _pyenv pyenv
++ lf-pyver python3
++ local py_version_xy=python3
++ local py_version_xyz=
++ awk '{ print $1 }'
++ pyenv versions
++ local command
++ command=versions
++ '[' 1 -gt 0 ']'
++ shift
++ case "$command" in
++ command pyenv versions
++ pyenv versions
++ sed 's/^[ *]* //'
++ grep -E '^[0-9.]*[0-9]$'
++ [[ ! -s /tmp/.pyenv_versions ]]
+++ grep '^3' /tmp/.pyenv_versions
+++ tail -n 1
+++ sort -V
++ py_version_xyz=3.11.7
++ [[ -z 3.11.7 ]]
++ echo 3.11.7
++ return 0
+ pyenv local 3.11.7
+ local command
+ command=local
+ '[' 2 -gt 0 ']'
+ shift
+ case "$command" in
+ command pyenv local 3.11.7
+ pyenv local 3.11.7
+ for arg in "$@"
+ case $arg in
+ pkg_list+='lftools[openstack] '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='kubernetes '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='niet '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='python-heatclient '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='python-openstackclient '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='python-magnumclient '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='yq '
+ [[ -f /tmp/.os_lf_venv ]]
++ cat /tmp/.os_lf_venv
+ lf_venv=/tmp/venv-KFYn
+ echo 'lf-activate-venv(): INFO: Reuse venv:/tmp/venv-KFYn from' file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-KFYn from file:/tmp/.os_lf_venv
+ /tmp/venv-KFYn/bin/python3 -m pip install --upgrade --quiet pip virtualenv
+ [[ -z lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq  ]]
+ echo 'lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq '
lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 
+ /tmp/venv-KFYn/bin/python3 -m pip install --upgrade --quiet --upgrade-strategy eager 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
+ type python3
+ true
+ echo 'lf-activate-venv(): INFO: Adding /tmp/venv-KFYn/bin to PATH'
lf-activate-venv(): INFO: Adding /tmp/venv-KFYn/bin to PATH
+ PATH=/tmp/venv-KFYn/bin:/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
+ return 0
+ openstack --os-cloud vex limits show --absolute
+--------------------------+---------+
| Name                     |   Value |
+--------------------------+---------+
| maxTotalInstances        |      -1 |
| maxTotalCores            |     450 |
| maxTotalRAMSize          | 1000000 |
| maxServerMeta            |     128 |
| maxImageMeta             |     128 |
| maxPersonality           |       5 |
| maxPersonalitySize       |   10240 |
| maxTotalKeypairs         |     100 |
| maxServerGroups          |      10 |
| maxServerGroupMembers    |      10 |
| maxTotalFloatingIps      |      -1 |
| maxSecurityGroups        |      -1 |
| maxSecurityGroupRules    |      -1 |
| totalRAMUsed             |  499712 |
| totalCoresUsed           |     122 |
| totalInstancesUsed       |      41 |
| totalFloatingIpsUsed     |       0 |
| totalSecurityGroupsUsed  |       0 |
| totalServerGroupsUsed    |       0 |
| maxTotalVolumes          |      -1 |
| maxTotalSnapshots        |      10 |
| maxTotalVolumeGigabytes  |    4096 |
| maxTotalBackups          |      10 |
| maxTotalBackupGigabytes  |    1000 |
| totalVolumesUsed         |       0 |
| totalGigabytesUsed       |       0 |
| totalSnapshotsUsed       |       0 |
| totalBackupsUsed         |       0 |
| totalBackupGigabytesUsed |       0 |
+--------------------------+---------+
+ pushd /opt/ciman/openstack-hot
/opt/ciman/openstack-hot /w/workspace/controller-csit-3node-clustering-tell-all-argon
+ lftools openstack --os-cloud vex stack create releng-controller-csit-3node-clustering-tell-all-argon-80 csit-2-instance-type.yaml /w/workspace/controller-csit-3node-clustering-tell-all-argon/stack-parameters.yaml
Creating stack releng-controller-csit-3node-clustering-tell-all-argon-80
Waiting to initialize infrastructure...
Stack initialization successful.
------------------------------------
Stack Details
------------------------------------
{'added': None,
 'capabilities': [],
 'created_at': '2024-04-06T23:07:05Z',
 'deleted': None,
 'deleted_at': None,
 'description': 'No description',
 'environment': None,
 'environment_files': None,
 'files': None,
 'files_container': None,
 'id': 'b023a8c4-5f0f-4aa2-8990-68654b1f88fc',
 'is_rollback_disabled': True,
 'links': [{'href': 'https://orchestration.public.mtl1.vexxhost.net/v1/12c36e260d8e4bb2913965203b1b491f/stacks/releng-controller-csit-3node-clustering-tell-all-argon-80/b023a8c4-5f0f-4aa2-8990-68654b1f88fc',
            'rel': 'self'}],
 'location': Munch({'cloud': 'vex', 'region_name': 'ca-ymq-1', 'zone': None, 'project': Munch({'id': '12c36e260d8e4bb2913965203b1b491f', 'name': '61975f2c-7c17-4d69-82fa-c3ae420ad6fd', 'domain_id': None, 'domain_name': 'Default'})}),
 'name': 'releng-controller-csit-3node-clustering-tell-all-argon-80',
 'notification_topics': [],
 'outputs': [{'description': 'IP addresses of the 2nd vm types',
              'output_key': 'vm_1_ips',
              'output_value': []},
             {'description': 'IP addresses of the 1st vm types',
              'output_key': 'vm_0_ips',
              'output_value': ['10.30.171.51',
                               '10.30.170.19',
                               '10.30.171.190']}],
 'owner_id': ****,
 'parameters': {'OS::project_id': '12c36e260d8e4bb2913965203b1b491f',
                'OS::stack_id': 'b023a8c4-5f0f-4aa2-8990-68654b1f88fc',
                'OS::stack_name': 'releng-controller-csit-3node-clustering-tell-all-argon-80',
                'job_name': '41374-80',
                'silo': 'releng',
                'vm_0_count': '3',
                'vm_0_flavor': 'v3-standard-4',
                'vm_0_image': 'ZZCI - CentOS Stream 8 - builder - x86_64 - '
                              '20240401-160147.446',
                'vm_1_count': '0',
                'vm_1_flavor': 'v3-standard-2',
                'vm_1_image': 'ZZCI - Ubuntu 18.04 - mininet-ovs-28 - x86_64 - '
                              '20230601-180106.003'},
 'parent_id': None,
 'replaced': None,
 'status': 'CREATE_COMPLETE',
 'status_reason': 'Stack CREATE completed successfully',
 'tags': [],
 'template': None,
 'template_description': 'No description',
 'template_url': None,
 'timeout_mins': 15,
 'unchanged': None,
 'updated': None,
 'updated_at': None,
 'user_project_id': '3986d192cb674b3f8c1b431c834c8479'}
------------------------------------
+ popd
/w/workspace/controller-csit-3node-clustering-tell-all-argon
[controller-csit-3node-clustering-tell-all-argon] $ /bin/bash -l /tmp/jenkins7499101381760572865.sh
---> Copy SSH public keys to CSIT lab
Setup pyenv:
  system
  3.8.13
  3.9.13
  3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-argon/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-KFYn from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes python-heatclient python-openstackclient 
lf-activate-venv(): INFO: Adding /tmp/venv-KFYn/bin to PATH
SSH not responding on 10.30.170.19. Retrying in 10 seconds...
SSH not responding on 10.30.171.190. Retrying in 10 seconds...
SSH not responding on 10.30.171.51. Retrying in 10 seconds...
Ping to 10.30.171.190 successful.
Ping to 10.30.170.19 successful.
Ping to 10.30.171.51 successful.
SSH not responding on 10.30.170.19. Retrying in 10 seconds...
SSH not responding on 10.30.171.190. Retrying in 10 seconds...
SSH not responding on 10.30.171.51. Retrying in 10 seconds...
Ping to 10.30.170.19 successful.
Ping to 10.30.171.190 successful.
Ping to 10.30.171.51 successful.
SSH not responding on 10.30.171.190. Retrying in 10 seconds...
SSH not responding on 10.30.171.51. Retrying in 10 seconds...
SSH not responding on 10.30.170.19. Retrying in 10 seconds...
Ping to 10.30.171.190 successful.
Ping to 10.30.171.51 successful.
Ping to 10.30.170.19 successful.
Warning: Permanently added '10.30.171.190' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.170.19' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.171.51' (ECDSA) to the list of known hosts.
10.30.171.190 releng-41374-80-0-builder-2.novalocal
Successfully copied public keys to slave 10.30.171.190
10.30.170.19 releng-41374-80-0-builder-1.novalocal
Successfully copied public keys to slave 10.30.170.19
10.30.171.51 releng-41374-80-0-builder-0.novalocal
Successfully copied public keys to slave 10.30.171.51
Process 6706 ready.
Process 6707 ready.
Process 6708 ready.
SSH ready on all stack servers.
[controller-csit-3node-clustering-tell-all-argon] $ /bin/bash -l /tmp/jenkins17830732728697627776.sh
Setup pyenv:
  system
  3.8.13
  3.9.13
  3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-argon/.python-version)
lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-huoQ
lf-activate-venv(): INFO: Save venv in file: /w/workspace/controller-csit-3node-clustering-tell-all-argon/.robot_venv
lf-activate-venv(): INFO: Installing: setuptools wheel 
lf-activate-venv(): INFO: Adding /tmp/venv-huoQ/bin to PATH
+ echo 'Installing Python Requirements'
Installing Python Requirements
+ cat
+ python -m pip install -r requirements.txt
Looking in indexes: https://nexus3.opendaylight.org/repository/PyPi/simple
Collecting docker-py (from -r requirements.txt (line 1))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/docker-py/1.10.6/docker_py-1.10.6-py2.py3-none-any.whl (50 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 50.0/50.0 kB 6.2 MB/s eta 0:00:00
Collecting ipaddr (from -r requirements.txt (line 2))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/ipaddr/2.2.0/ipaddr-2.2.0.tar.gz (26 kB)
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'done'
Collecting netaddr (from -r requirements.txt (line 3))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/netaddr/1.2.1/netaddr-1.2.1-py3-none-any.whl (2.3 MB)
Collecting netifaces (from -r requirements.txt (line 4))
  Using cached netifaces-0.11.0-cp311-cp311-linux_x86_64.whl
Collecting pyhocon (from -r requirements.txt (line 5))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyhocon/0.3.60/pyhocon-0.3.60.tar.gz (158 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 158.8/158.8 kB 14.0 MB/s eta 0:00:00
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'done'
Collecting requests (from -r requirements.txt (line 6))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/requests/2.31.0/requests-2.31.0-py3-none-any.whl (62 kB)
Collecting robotframework (from -r requirements.txt (line 7))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework/7.0/robotframework-7.0-py3-none-any.whl (726 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 726.3/726.3 kB 15.4 MB/s eta 0:00:00
Collecting robotframework-httplibrary (from -r requirements.txt (line 8))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-httplibrary/0.4.2/robotframework-httplibrary-0.4.2.tar.gz (9.1 kB)
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'done'
Collecting robotframework-requests==0.9.3 (from -r requirements.txt (line 9))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-requests/0.9.3/robotframework_requests-0.9.3-py3-none-any.whl (21 kB)
Collecting robotframework-selenium2library (from -r requirements.txt (line 10))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-selenium2library/3.0.0/robotframework_selenium2library-3.0.0-py2.py3-none-any.whl (6.2 kB)
Collecting robotframework-sshlibrary==3.8.0 (from -r requirements.txt (line 11))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-sshlibrary/3.8.0/robotframework-sshlibrary-3.8.0.tar.gz (51 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 51.4/51.4 kB 8.4 MB/s eta 0:00:00
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'done'
Collecting scapy (from -r requirements.txt (line 12))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/scapy/2.5.0/scapy-2.5.0.tar.gz (1.3 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.3/1.3 MB 22.8 MB/s eta 0:00:00
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'done'
Collecting jsonpath-rw (from -r requirements.txt (line 15))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpath-rw/1.4.0/jsonpath-rw-1.4.0.tar.gz (13 kB)
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'done'
Collecting elasticsearch (from -r requirements.txt (line 18))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch/8.13.0/elasticsearch-8.13.0-py3-none-any.whl (451 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 451.0/451.0 kB 11.0 MB/s eta 0:00:00
Collecting elasticsearch-dsl (from -r requirements.txt (line 19))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch-dsl/8.13.0/elasticsearch_dsl-8.13.0-py3-none-any.whl (88 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 88.6/88.6 kB 16.2 MB/s eta 0:00:00
Collecting pyangbind (from -r requirements.txt (line 22))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyangbind/0.8.5/pyangbind-0.8.5-py3-none-any.whl (52 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 52.9/52.9 kB 10.8 MB/s eta 0:00:00
Collecting isodate (from -r requirements.txt (line 25))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/isodate/0.6.1/isodate-0.6.1-py2.py3-none-any.whl (41 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 41.7/41.7 kB 1.8 MB/s eta 0:00:00
Collecting jmespath (from -r requirements.txt (line 28))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jmespath/1.0.1/jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting jsonpatch (from -r requirements.txt (line 31))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpatch/1.33/jsonpatch-1.33-py2.py3-none-any.whl (12 kB)
Collecting paramiko>=1.15.3 (from robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/paramiko/3.4.0/paramiko-3.4.0-py3-none-any.whl (225 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 225.9/225.9 kB 29.3 MB/s eta 0:00:00
Collecting scp>=0.13.0 (from robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/scp/0.14.5/scp-0.14.5-py2.py3-none-any.whl (8.7 kB)
Collecting docker-pycreds>=0.2.1 (from docker-py->-r requirements.txt (line 1))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/docker-pycreds/0.4.0/docker_pycreds-0.4.0-py2.py3-none-any.whl (9.0 kB)
Collecting six>=1.4.0 (from docker-py->-r requirements.txt (line 1))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/six/1.16.0/six-1.16.0-py2.py3-none-any.whl (11 kB)
Collecting websocket-client>=0.32.0 (from docker-py->-r requirements.txt (line 1))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/websocket-client/1.7.0/websocket_client-1.7.0-py3-none-any.whl (58 kB)
Collecting pyparsing<4,>=2 (from pyhocon->-r requirements.txt (line 5))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pyparsing/3.1.2/pyparsing-3.1.2-py3-none-any.whl (103 kB)
Collecting charset-normalizer<4,>=2 (from requests->-r requirements.txt (line 6))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/charset-normalizer/3.3.2/charset_normalizer-3.3.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (140 kB)
Collecting idna<4,>=2.5 (from requests->-r requirements.txt (line 6))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/idna/3.6/idna-3.6-py3-none-any.whl (61 kB)
Collecting urllib3<3,>=1.21.1 (from requests->-r requirements.txt (line 6))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/urllib3/2.2.1/urllib3-2.2.1-py3-none-any.whl (121 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 121.1/121.1 kB 20.4 MB/s eta 0:00:00
Collecting certifi>=2017.4.17 (from requests->-r requirements.txt (line 6))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/certifi/2024.2.2/certifi-2024.2.2-py3-none-any.whl (163 kB)
Collecting webtest>=2.0 (from robotframework-httplibrary->-r requirements.txt (line 8))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/webtest/3.0.0/WebTest-3.0.0-py3-none-any.whl (31 kB)
Collecting jsonpointer (from robotframework-httplibrary->-r requirements.txt (line 8))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpointer/2.4/jsonpointer-2.4-py2.py3-none-any.whl (7.8 kB)
Collecting robotframework-seleniumlibrary>=3.0.0 (from robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-seleniumlibrary/6.2.0/robotframework_seleniumlibrary-6.2.0-py2.py3-none-any.whl (95 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 95.5/95.5 kB 17.8 MB/s eta 0:00:00
Collecting ply (from jsonpath-rw->-r requirements.txt (line 15))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/ply/3.11/ply-3.11-py2.py3-none-any.whl (49 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 49.6/49.6 kB 8.6 MB/s eta 0:00:00
Collecting decorator (from jsonpath-rw->-r requirements.txt (line 15))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/decorator/5.1.1/decorator-5.1.1-py3-none-any.whl (9.1 kB)
Collecting elastic-transport<9,>=8.13 (from elasticsearch->-r requirements.txt (line 18))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elastic-transport/8.13.0/elastic_transport-8.13.0-py3-none-any.whl (64 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 64.3/64.3 kB 7.7 MB/s eta 0:00:00
Collecting python-dateutil (from elasticsearch-dsl->-r requirements.txt (line 19))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/python-dateutil/2.9.0.post0/python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB)
Collecting pyang (from pyangbind->-r requirements.txt (line 22))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyang/2.6.0/pyang-2.6.0-py2.py3-none-any.whl (594 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 594.1/594.1 kB 9.3 MB/s eta 0:00:00
Collecting lxml (from pyangbind->-r requirements.txt (line 22))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/lxml/5.2.1/lxml-5.2.1-cp311-cp311-manylinux_2_28_x86_64.whl (5.0 MB)
Collecting regex (from pyangbind->-r requirements.txt (line 22))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/regex/2023.12.25/regex-2023.12.25-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (785 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 785.1/785.1 kB 28.1 MB/s eta 0:00:00
Collecting enum34 (from pyangbind->-r requirements.txt (line 22))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/enum34/1.1.10/enum34-1.1.10-py3-none-any.whl (11 kB)
Collecting bcrypt>=3.2 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/bcrypt/4.1.2/bcrypt-4.1.2-cp39-abi3-manylinux_2_28_x86_64.whl (698 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 698.9/698.9 kB 6.4 MB/s eta 0:00:00
Collecting cryptography>=3.3 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/cryptography/42.0.5/cryptography-42.0.5-cp39-abi3-manylinux_2_28_x86_64.whl (4.6 MB)
Collecting pynacl>=1.5 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pynacl/1.5.0/PyNaCl-1.5.0-cp36-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.manylinux_2_24_x86_64.whl (856 kB)
Collecting selenium>=4.3.0 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/selenium/4.19.0/selenium-4.19.0-py3-none-any.whl (10.5 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 10.5/10.5 MB 52.8 MB/s eta 0:00:00
Collecting robotframework-pythonlibcore>=3.0.0 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-pythonlibcore/4.4.1/robotframework_pythonlibcore-4.4.1-py2.py3-none-any.whl (12 kB)
Collecting WebOb>=1.2 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/webob/1.8.7/WebOb-1.8.7-py2.py3-none-any.whl (114 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 115.0/115.0 kB 18.4 MB/s eta 0:00:00
Collecting waitress>=0.8.5 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/waitress/3.0.0/waitress-3.0.0-py3-none-any.whl (56 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 56.7/56.7 kB 14.3 MB/s eta 0:00:00
Collecting beautifulsoup4 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/beautifulsoup4/4.12.3/beautifulsoup4-4.12.3-py3-none-any.whl (147 kB)
Collecting cffi>=1.12 (from cryptography>=3.3->paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/cffi/1.16.0/cffi-1.16.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (464 kB)
Collecting trio~=0.17 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/trio/0.25.0/trio-0.25.0-py3-none-any.whl (467 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 467.2/467.2 kB 37.3 MB/s eta 0:00:00
Collecting trio-websocket~=0.9 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/trio-websocket/0.11.1/trio_websocket-0.11.1-py3-none-any.whl (17 kB)
Collecting typing_extensions>=4.9.0 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/typing-extensions/4.11.0/typing_extensions-4.11.0-py3-none-any.whl (34 kB)
Collecting soupsieve>1.2 (from beautifulsoup4->webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/soupsieve/2.5/soupsieve-2.5-py3-none-any.whl (36 kB)
Collecting pycparser (from cffi>=1.12->cryptography>=3.3->paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pycparser/2.22/pycparser-2.22-py3-none-any.whl (117 kB)
Collecting attrs>=23.2.0 (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/attrs/23.2.0/attrs-23.2.0-py3-none-any.whl (60 kB)
Collecting sortedcontainers (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/sortedcontainers/2.4.0/sortedcontainers-2.4.0-py2.py3-none-any.whl (29 kB)
Collecting outcome (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/outcome/1.3.0.post0/outcome-1.3.0.post0-py2.py3-none-any.whl (10 kB)
Collecting sniffio>=1.3.0 (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/sniffio/1.3.1/sniffio-1.3.1-py3-none-any.whl (10 kB)
Collecting wsproto>=0.14 (from trio-websocket~=0.9->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/wsproto/1.2.0/wsproto-1.2.0-py3-none-any.whl (24 kB)
Collecting pysocks!=1.5.7,<2.0,>=1.5.6 (from urllib3[socks]<3,>=1.26->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pysocks/1.7.1/PySocks-1.7.1-py3-none-any.whl (16 kB)
Collecting h11<1,>=0.9.0 (from wsproto>=0.14->trio-websocket~=0.9->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/h11/0.14.0/h11-0.14.0-py3-none-any.whl (58 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 58.3/58.3 kB 3.7 MB/s eta 0:00:00
Building wheels for collected packages: robotframework-sshlibrary, ipaddr, pyhocon, robotframework-httplibrary, scapy, jsonpath-rw
  Building wheel for robotframework-sshlibrary (setup.py): started
  Building wheel for robotframework-sshlibrary (setup.py): finished with status 'done'
  Created wheel for robotframework-sshlibrary: filename=robotframework_sshlibrary-3.8.0-py3-none-any.whl size=55119 sha256=2315756c265d089e9d6936c025c04c96d0d4884b47e94cbe09ade44d5c65eceb
  Stored in directory: /home/jenkins/.cache/pip/wheels/f7/c9/b3/a977b7bcc410d45ae27d240df3d00a12585509180e373ecccc
  Building wheel for ipaddr (setup.py): started
  Building wheel for ipaddr (setup.py): finished with status 'done'
  Created wheel for ipaddr: filename=ipaddr-2.2.0-py3-none-any.whl size=18280 sha256=5be7b8d3187843b3c7ef339015cf7f5e0a1d095a4335b776264b8d55ef06c77f
  Stored in directory: /home/jenkins/.cache/pip/wheels/dc/6c/04/da2d847fa8d45c59af3e1d83e2acc29cb8adcbaf04c0898dbf
  Building wheel for pyhocon (setup.py): started
  Building wheel for pyhocon (setup.py): finished with status 'done'
  Created wheel for pyhocon: filename=pyhocon-0.3.60-py3-none-any.whl size=20865 sha256=ea8785b85c48394d0db111a4fb760a64250ee1ca363456f4e856a2eec7a1a84e
  Stored in directory: /home/jenkins/.cache/pip/wheels/02/09/4e/04a983205b51f96912ae6fc13f56f3050a586c98200fe36725
  Building wheel for robotframework-httplibrary (setup.py): started
  Building wheel for robotframework-httplibrary (setup.py): finished with status 'done'
  Created wheel for robotframework-httplibrary: filename=robotframework_httplibrary-0.4.2-py3-none-any.whl size=9953 sha256=aeaa111d5b0662e2fc024c91093a1bdaa988dacf8d498f26d6ce0a4718ef8718
  Stored in directory: /home/jenkins/.cache/pip/wheels/aa/bc/0d/9a20dd51effef392aae2733cb4c7b66c6fa29fca33d88b57ed
  Building wheel for scapy (setup.py): started
  Building wheel for scapy (setup.py): finished with status 'done'
  Created wheel for scapy: filename=scapy-2.5.0-py2.py3-none-any.whl size=1444327 sha256=0842f658ab06927302c5cd3b7f47ebb85af512b6bfa96bfd794c18a91b41c683
  Stored in directory: /home/jenkins/.cache/pip/wheels/3b/a7/d6/87eeec31fbfcb2bd8ace7dad8172b6d6ebbe1ec6827dbb389a
  Building wheel for jsonpath-rw (setup.py): started
  Building wheel for jsonpath-rw (setup.py): finished with status 'done'
  Created wheel for jsonpath-rw: filename=jsonpath_rw-1.4.0-py3-none-any.whl size=15130 sha256=48f42454305675130e2a0e36b011d4afdde34e36cd74c995047ddf9b08c73c8f
  Stored in directory: /home/jenkins/.cache/pip/wheels/f1/54/63/9a8da38cefae13755097b36cc852decc25d8ef69c37d58d4eb
Successfully built robotframework-sshlibrary ipaddr pyhocon robotframework-httplibrary scapy jsonpath-rw
Installing collected packages: sortedcontainers, ply, netifaces, ipaddr, enum34, websocket-client, WebOb, waitress, urllib3, typing_extensions, soupsieve, sniffio, six, scapy, robotframework-pythonlibcore, robotframework, regex, pysocks, pyparsing, pycparser, netaddr, lxml, jsonpointer, jmespath, idna, h11, decorator, charset-normalizer, certifi, bcrypt, attrs, wsproto, requests, python-dateutil, pyhocon, pyang, outcome, jsonpath-rw, jsonpatch, isodate, elastic-transport, docker-pycreds, cffi, beautifulsoup4, webtest, trio, robotframework-requests, pynacl, pyangbind, elasticsearch, docker-py, cryptography, trio-websocket, robotframework-httplibrary, paramiko, elasticsearch-dsl, selenium, scp, robotframework-sshlibrary, robotframework-seleniumlibrary, robotframework-selenium2library
Successfully installed WebOb-1.8.7 attrs-23.2.0 bcrypt-4.1.2 beautifulsoup4-4.12.3 certifi-2024.2.2 cffi-1.16.0 charset-normalizer-3.3.2 cryptography-42.0.5 decorator-5.1.1 docker-py-1.10.6 docker-pycreds-0.4.0 elastic-transport-8.13.0 elasticsearch-8.13.0 elasticsearch-dsl-8.13.0 enum34-1.1.10 h11-0.14.0 idna-3.6 ipaddr-2.2.0 isodate-0.6.1 jmespath-1.0.1 jsonpatch-1.33 jsonpath-rw-1.4.0 jsonpointer-2.4 lxml-5.2.1 netaddr-1.2.1 netifaces-0.11.0 outcome-1.3.0.post0 paramiko-3.4.0 ply-3.11 pyang-2.6.0 pyangbind-0.8.5 pycparser-2.22 pyhocon-0.3.60 pynacl-1.5.0 pyparsing-3.1.2 pysocks-1.7.1 python-dateutil-2.9.0.post0 regex-2023.12.25 requests-2.31.0 robotframework-7.0 robotframework-httplibrary-0.4.2 robotframework-pythonlibcore-4.4.1 robotframework-requests-0.9.3 robotframework-selenium2library-3.0.0 robotframework-seleniumlibrary-6.2.0 robotframework-sshlibrary-3.8.0 scapy-2.5.0 scp-0.14.5 selenium-4.19.0 six-1.16.0 sniffio-1.3.1 sortedcontainers-2.4.0 soupsieve-2.5 trio-0.25.0 trio-websocket-0.11.1 typing_extensions-4.11.0 urllib3-2.2.1 waitress-3.0.0 websocket-client-1.7.0 webtest-3.0.0 wsproto-1.2.0
+ pip freeze
attrs==23.2.0
bcrypt==4.1.2
beautifulsoup4==4.12.3
certifi==2024.2.2
cffi==1.16.0
charset-normalizer==3.3.2
cryptography==42.0.5
decorator==5.1.1
distlib==0.3.8
docker-py==1.10.6
docker-pycreds==0.4.0
elastic-transport==8.13.0
elasticsearch==8.13.0
elasticsearch-dsl==8.13.0
enum34==1.1.10
filelock==3.13.3
h11==0.14.0
idna==3.6
ipaddr==2.2.0
isodate==0.6.1
jmespath==1.0.1
jsonpatch==1.33
jsonpath-rw==1.4.0
jsonpointer==2.4
lxml==5.2.1
netaddr==1.2.1
netifaces==0.11.0
outcome==1.3.0.post0
paramiko==3.4.0
platformdirs==4.2.0
ply==3.11
pyang==2.6.0
pyangbind==0.8.5
pycparser==2.22
pyhocon==0.3.60
PyNaCl==1.5.0
pyparsing==3.1.2
PySocks==1.7.1
python-dateutil==2.9.0.post0
regex==2023.12.25
requests==2.31.0
robotframework==7.0
robotframework-httplibrary==0.4.2
robotframework-pythonlibcore==4.4.1
robotframework-requests==0.9.3
robotframework-selenium2library==3.0.0
robotframework-seleniumlibrary==6.2.0
robotframework-sshlibrary==3.8.0
scapy==2.5.0
scp==0.14.5
selenium==4.19.0
six==1.16.0
sniffio==1.3.1
sortedcontainers==2.4.0
soupsieve==2.5
trio==0.25.0
trio-websocket==0.11.1
typing_extensions==4.11.0
urllib3==2.2.1
virtualenv==20.25.1
waitress==3.0.0
WebOb==1.8.7
websocket-client==1.7.0
WebTest==3.0.0
wsproto==1.2.0
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties file path 'env.properties'
[EnvInject] - Variables injected successfully.
[controller-csit-3node-clustering-tell-all-argon] $ /bin/bash -l /tmp/jenkins17767099842733410986.sh
Setup pyenv:
  system
  3.8.13
  3.9.13
  3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-argon/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-KFYn from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: python-heatclient python-openstackclient yq 
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
lftools 0.37.10 requires urllib3<2.1.0, but you have urllib3 2.2.1 which is incompatible.
lf-activate-venv(): INFO: Adding /tmp/venv-KFYn/bin to PATH
+ ODL_SYSTEM=()
+ TOOLS_SYSTEM=()
+ OPENSTACK_SYSTEM=()
+ OPENSTACK_CONTROLLERS=()
+ mapfile -t ADDR
++ openstack stack show -f json -c outputs releng-controller-csit-3node-clustering-tell-all-argon-80
++ jq -r '.outputs[] | select(.output_key | match("^vm_[0-9]+_ips$")) | .output_value | .[]'
+ for i in "${ADDR[@]}"
++ ssh 10.30.171.51 hostname -s
Warning: Permanently added '10.30.171.51' (ECDSA) to the list of known hosts.
+ REMHOST=releng-41374-80-0-builder-0
+ case ${REMHOST} in
+ ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}")
+ for i in "${ADDR[@]}"
++ ssh 10.30.170.19 hostname -s
Warning: Permanently added '10.30.170.19' (ECDSA) to the list of known hosts.
+ REMHOST=releng-41374-80-0-builder-1
+ case ${REMHOST} in
+ ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}")
+ for i in "${ADDR[@]}"
++ ssh 10.30.171.190 hostname -s
Warning: Permanently added '10.30.171.190' (ECDSA) to the list of known hosts.
+ REMHOST=releng-41374-80-0-builder-2
+ case ${REMHOST} in
+ ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}")
+ echo NUM_ODL_SYSTEM=3
+ echo NUM_TOOLS_SYSTEM=0
+ '[' '' == yes ']'
+ NUM_OPENSTACK_SYSTEM=0
+ echo NUM_OPENSTACK_SYSTEM=0
+ '[' 0 -eq 2 ']'
+ echo ODL_SYSTEM_IP=10.30.171.51
++ seq 0 2
+ for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 )))
+ echo ODL_SYSTEM_1_IP=10.30.171.51
+ for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 )))
+ echo ODL_SYSTEM_2_IP=10.30.170.19
+ for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 )))
+ echo ODL_SYSTEM_3_IP=10.30.171.190
+ echo TOOLS_SYSTEM_IP=
++ seq 0 -1
+ openstack_index=0
+ NUM_OPENSTACK_CONTROL_NODES=1
+ echo NUM_OPENSTACK_CONTROL_NODES=1
++ seq 0 0
+ for i in $(seq 0 $((NUM_OPENSTACK_CONTROL_NODES - 1)))
+ echo OPENSTACK_CONTROL_NODE_1_IP=
+ NUM_OPENSTACK_COMPUTE_NODES=-1
+ echo NUM_OPENSTACK_COMPUTE_NODES=-1
+ '[' -1 -ge 2 ']'
++ seq 0 -2
+ NUM_OPENSTACK_HAPROXY_NODES=0
+ echo NUM_OPENSTACK_HAPROXY_NODES=0
++ seq 0 -1
+ echo 'Contents of slave_addresses.txt:'
Contents of slave_addresses.txt:
+ cat slave_addresses.txt
NUM_ODL_SYSTEM=3
NUM_TOOLS_SYSTEM=0
NUM_OPENSTACK_SYSTEM=0
ODL_SYSTEM_IP=10.30.171.51
ODL_SYSTEM_1_IP=10.30.171.51
ODL_SYSTEM_2_IP=10.30.170.19
ODL_SYSTEM_3_IP=10.30.171.190
TOOLS_SYSTEM_IP=
NUM_OPENSTACK_CONTROL_NODES=1
OPENSTACK_CONTROL_NODE_1_IP=
NUM_OPENSTACK_COMPUTE_NODES=-1
NUM_OPENSTACK_HAPROXY_NODES=0
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties file path 'slave_addresses.txt'
[EnvInject] - Variables injected successfully.
[controller-csit-3node-clustering-tell-all-argon] $ /bin/sh /tmp/jenkins15665733055631703968.sh
Preparing for JRE Version 17
Karaf artifact is karaf
Karaf project is integration
Java home is /usr/lib/jvm/java-17-openjdk
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties file path 'set_variables.env'
[EnvInject] - Variables injected successfully.
[controller-csit-3node-clustering-tell-all-argon] $ /bin/bash /tmp/jenkins16495925472540178587.sh
--2024-04-06 23:09:00--  http://git.opendaylight.org/gerrit/gitweb?p=integration/distribution.git;a=blob_plain;f=pom.xml;hb=refs/heads/stable/argon
Resolving git.opendaylight.org (git.opendaylight.org)... 13.39.230.180, 35.181.223.58, 52.47.161.242, ...
Connecting to git.opendaylight.org (git.opendaylight.org)|13.39.230.180|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 2620 (2.6K) [text/plain]
Saving to: ‘pom.xml’

     0K ..                                                    100%  232M=0s

2024-04-06 23:09:00 (232 MB/s) - ‘pom.xml’ saved [2620/2620]

Bundle version is 0.18.4-SNAPSHOT
--2024-04-06 23:09:00--  https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/maven-metadata.xml
Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6
Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 1410 (1.4K) [application/xml]
Saving to: ‘maven-metadata.xml’

     0K .                                                     100% 57.4M=0s

2024-04-06 23:09:00 (57.4 MB/s) - ‘maven-metadata.xml’ saved [1410/1410]

<?xml version="1.0" encoding="UTF-8"?>
<metadata modelVersion="1.1.0">
  <groupId>org.opendaylight.integration</groupId>
  <artifactId>karaf</artifactId>
  <version>0.18.4-SNAPSHOT</version>
  <versioning>
    <snapshot>
      <timestamp>20240406.194621</timestamp>
      <buildNumber>101</buildNumber>
    </snapshot>
    <lastUpdated>20240406194621</lastUpdated>
    <snapshotVersions>
      <snapshotVersion>
        <extension>pom</extension>
        <value>0.18.4-20240406.194621-101</value>
        <updated>20240406194621</updated>
      </snapshotVersion>
      <snapshotVersion>
        <extension>tar.gz</extension>
        <value>0.18.4-20240406.194621-101</value>
        <updated>20240406194621</updated>
      </snapshotVersion>
      <snapshotVersion>
        <extension>zip</extension>
        <value>0.18.4-20240406.194621-101</value>
        <updated>20240406194621</updated>
      </snapshotVersion>
      <snapshotVersion>
        <classifier>cyclonedx</classifier>
        <extension>xml</extension>
        <value>0.18.4-20240406.194621-101</value>
        <updated>20240406194621</updated>
      </snapshotVersion>
      <snapshotVersion>
        <classifier>cyclonedx</classifier>
        <extension>json</extension>
        <value>0.18.4-20240406.194621-101</value>
        <updated>20240406194621</updated>
      </snapshotVersion>
    </snapshotVersions>
  </versioning>
</metadata>
Nexus timestamp is 0.18.4-20240406.194621-101
Distribution bundle URL is https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/karaf-0.18.4-20240406.194621-101.zip
Distribution bundle is karaf-0.18.4-20240406.194621-101.zip
Distribution bundle version is 0.18.4-SNAPSHOT
Distribution folder is karaf-0.18.4-SNAPSHOT
Nexus prefix is https://nexus.opendaylight.org
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties file path 'detect_variables.env'
[EnvInject] - Variables injected successfully.
[controller-csit-3node-clustering-tell-all-argon] $ /bin/bash -l /tmp/jenkins14788938686706876317.sh
Setup pyenv:
  system
  3.8.13
  3.9.13
  3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-argon/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-KFYn from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: python-heatclient python-openstackclient 
lf-activate-venv(): INFO: Adding /tmp/venv-KFYn/bin to PATH
Copying common-functions.sh to /tmp
Copying common-functions.sh to 10.30.171.51:/tmp
Warning: Permanently added '10.30.171.51' (ECDSA) to the list of known hosts.
Copying common-functions.sh to 10.30.170.19:/tmp
Warning: Permanently added '10.30.170.19' (ECDSA) to the list of known hosts.
Copying common-functions.sh to 10.30.171.190:/tmp
Warning: Permanently added '10.30.171.190' (ECDSA) to the list of known hosts.
[controller-csit-3node-clustering-tell-all-argon] $ /bin/bash /tmp/jenkins7128934150023765460.sh
common-functions.sh is being sourced
common-functions environment:
MAVENCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
ACTUALFEATURES: 
FEATURESCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
CUSTOMPROP: /tmp/karaf-0.18.4-SNAPSHOT/etc/custom.properties
LOGCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
MEMCONF: /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv
CONTROLLERMEM: 2048m
AKKACONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/akka.conf
MODULESCONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/modules.conf
MODULESHARDSCONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/module-shards.conf
SUITES: 

#################################################
##         Configure Cluster and Start         ##
#################################################
ACTUALFEATURES: odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app
SPACE_SEPARATED_FEATURES: odl-integration-compatible-with-all odl-jolokia odl-restconf odl-clustering-test-app
Locating script plan to use...
script plan exists!!!
Changing the script plan path...
# Place the scripts in run order:
/w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/scripts/car_people_shard.sh
Executing /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/scripts/car_people_shard.sh...
Add car-people shards file
Copy shard config to member-1 with IP address 10.30.171.51
Warning: Permanently added '10.30.171.51' (ECDSA) to the list of known hosts.
Copy shard config to member-2 with IP address 10.30.170.19
Warning: Permanently added '10.30.170.19' (ECDSA) to the list of known hosts.
Copy shard config to member-3 with IP address 10.30.171.190
Warning: Permanently added '10.30.171.190' (ECDSA) to the list of known hosts.
Finished running script plans
Configuring member-1 with IP address 10.30.171.51
Warning: Permanently added '10.30.171.51' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.171.51' (ECDSA) to the list of known hosts.
common-functions.sh is being sourced
+ source /tmp/common-functions.sh karaf-0.18.4-SNAPSHOT
++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]]
++ echo 'common-functions.sh is being sourced'
++ BUNDLEFOLDER=karaf-0.18.4-SNAPSHOT
++ export MAVENCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
++ MAVENCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
++ export FEATURESCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
++ FEATURESCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
++ export CUSTOMPROP=/tmp/karaf-0.18.4-SNAPSHOT/etc/custom.properties
++ CUSTOMPROP=/tmp/karaf-0.18.4-SNAPSHOT/etc/custom.properties
++ export LOGCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
++ LOGCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
++ export MEMCONF=/tmp/karaf-0.18.4-SNAPSHOT/bin/setenv
++ MEMCONF=/tmp/karaf-0.18.4-SNAPSHOT/bin/setenv
++ export CONTROLLERMEM=
++ CONTROLLERMEM=
++ export AKKACONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/akka.conf
++ AKKACONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/akka.conf
++ export MODULESCONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/modules.conf
++ MODULESCONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/modules.conf
++ export MODULESHARDSCONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/module-shards.conf
++ MODULESHARDSCONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/module-shards.conf
++ print_common_env
++ cat
common-functions environment:
MAVENCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
ACTUALFEATURES: 
FEATURESCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
CUSTOMPROP: /tmp/karaf-0.18.4-SNAPSHOT/etc/custom.properties
LOGCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
MEMCONF: /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv
CONTROLLERMEM: 
AKKACONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/akka.conf
MODULESCONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/modules.conf
MODULESHARDSCONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/module-shards.conf
SUITES: 

++ SSH='ssh -t -t'
++ extra_services_cntl='     dnsmasq.service     httpd.service     libvirtd.service     openvswitch.service     ovs-vswitchd.service     ovsdb-server.service     rabbitmq-server.service '
++ extra_services_cmp='     libvirtd.service     openvswitch.service     ovs-vswitchd.service     ovsdb-server.service '
Changing to /tmp
+ echo 'Changing to /tmp'
+ cd /tmp
+ echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/karaf-0.18.4-20240406.194621-101.zip'
Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/karaf-0.18.4-20240406.194621-101.zip
+ wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/karaf-0.18.4-20240406.194621-101.zip
--2024-04-06 23:09:12--  https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/karaf-0.18.4-20240406.194621-101.zip
Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6
Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 260399296 (248M) [application/zip]
Saving to: ‘karaf-0.18.4-20240406.194621-101.zip’

     0K ........ ........ ........ ........ ........ ........  1% 76.9M 3s
  3072K ........ ........ ........ ........ ........ ........  2%  126M 3s
  6144K ........ ........ ........ ........ ........ ........  3%  131M 2s
  9216K ........ ........ ........ ........ ........ ........  4%  147M 2s
 12288K ........ ........ ........ ........ ........ ........  6%  156M 2s
 15360K ........ ........ ........ ........ ........ ........  7%  155M 2s
 18432K ........ ........ ........ ........ ........ ........  8%  213M 2s
 21504K ........ ........ ........ ........ ........ ........  9%  222M 2s
 24576K ........ ........ ........ ........ ........ ........ 10%  264M 2s
 27648K ........ ........ ........ ........ ........ ........ 12%  279M 1s
 30720K ........ ........ ........ ........ ........ ........ 13%  258M 1s
 33792K ........ ........ ........ ........ ........ ........ 14%  196M 1s
 36864K ........ ........ ........ ........ ........ ........ 15%  258M 1s
 39936K ........ ........ ........ ........ ........ ........ 16%  253M 1s
 43008K ........ ........ ........ ........ ........ ........ 18%  196M 1s
 46080K ........ ........ ........ ........ ........ ........ 19%  228M 1s
 49152K ........ ........ ........ ........ ........ ........ 20%  286M 1s
 52224K ........ ........ ........ ........ ........ ........ 21%  280M 1s
 55296K ........ ........ ........ ........ ........ ........ 22%  174M 1s
 58368K ........ ........ ........ ........ ........ ........ 24%  280M 1s
 61440K ........ ........ ........ ........ ........ ........ 25%  296M 1s
 64512K ........ ........ ........ ........ ........ ........ 26%  140M 1s
 67584K ........ ........ ........ ........ ........ ........ 27%  230M 1s
 70656K ........ ........ ........ ........ ........ ........ 28%  158M 1s
 73728K ........ ........ ........ ........ ........ ........ 30%  169M 1s
 76800K ........ ........ ........ ........ ........ ........ 31%  170M 1s
 79872K ........ ........ ........ ........ ........ ........ 32%  159M 1s
 82944K ........ ........ ........ ........ ........ ........ 33%  227M 1s
 86016K ........ ........ ........ ........ ........ ........ 35%  210M 1s
 89088K ........ ........ ........ ........ ........ ........ 36%  238M 1s
 92160K ........ ........ ........ ........ ........ ........ 37%  226M 1s
 95232K ........ ........ ........ ........ ........ ........ 38%  197M 1s
 98304K ........ ........ ........ ........ ........ ........ 39%  263M 1s
101376K ........ ........ ........ ........ ........ ........ 41%  149M 1s
104448K ........ ........ ........ ........ ........ ........ 42%  215M 1s
107520K ........ ........ ........ ........ ........ ........ 43%  140M 1s
110592K ........ ........ ........ ........ ........ ........ 44%  147M 1s
113664K ........ ........ ........ ........ ........ ........ 45%  270M 1s
116736K ........ ........ ........ ........ ........ ........ 47%  232M 1s
119808K ........ ........ ........ ........ ........ ........ 48%  225M 1s
122880K ........ ........ ........ ........ ........ ........ 49%  204M 1s
125952K ........ ........ ........ ........ ........ ........ 50%  197M 1s
129024K ........ ........ ........ ........ ........ ........ 51%  212M 1s
132096K ........ ........ ........ ........ ........ ........ 53%  204M 1s
135168K ........ ........ ........ ........ ........ ........ 54%  169M 1s
138240K ........ ........ ........ ........ ........ ........ 55%  197M 1s
141312K ........ ........ ........ ........ ........ ........ 56%  175M 1s
144384K ........ ........ ........ ........ ........ ........ 57%  257M 1s
147456K ........ ........ ........ ........ ........ ........ 59%  168M 1s
150528K ........ ........ ........ ........ ........ ........ 60%  147M 1s
153600K ........ ........ ........ ........ ........ ........ 61%  189M 1s
156672K ........ ........ ........ ........ ........ ........ 62%  163M 0s
159744K ........ ........ ........ ........ ........ ........ 64%  223M 0s
162816K ........ ........ ........ ........ ........ ........ 65%  160M 0s
165888K ........ ........ ........ ........ ........ ........ 66%  174M 0s
168960K ........ ........ ........ ........ ........ ........ 67%  170M 0s
172032K ........ ........ ........ ........ ........ ........ 68%  181M 0s
175104K ........ ........ ........ ........ ........ ........ 70%  179M 0s
178176K ........ ........ ........ ........ ........ ........ 71%  196M 0s
181248K ........ ........ ........ ........ ........ ........ 72%  181M 0s
184320K ........ ........ ........ ........ ........ ........ 73%  212M 0s
187392K ........ ........ ........ ........ ........ ........ 74%  190M 0s
190464K ........ ........ ........ ........ ........ ........ 76%  200M 0s
193536K ........ ........ ........ ........ ........ ........ 77%  200M 0s
196608K ........ ........ ........ ........ ........ ........ 78%  166M 0s
199680K ........ ........ ........ ........ ........ ........ 79%  210M 0s
202752K ........ ........ ........ ........ ........ ........ 80%  212M 0s
205824K ........ ........ ........ ........ ........ ........ 82%  203M 0s
208896K ........ ........ ........ ........ ........ ........ 83%  212M 0s
211968K ........ ........ ........ ........ ........ ........ 84%  217M 0s
215040K ........ ........ ........ ........ ........ ........ 85%  223M 0s
218112K ........ ........ ........ ........ ........ ........ 86%  216M 0s
221184K ........ ........ ........ ........ ........ ........ 88%  155M 0s
224256K ........ ........ ........ ........ ........ ........ 89%  140M 0s
227328K ........ ........ ........ ........ ........ ........ 90%  207M 0s
230400K ........ ........ ........ ........ ........ ........ 91%  194M 0s
233472K ........ ........ ........ ........ ........ ........ 93%  160M 0s
236544K ........ ........ ........ ........ ........ ........ 94%  161M 0s
239616K ........ ........ ........ ........ ........ ........ 95%  194M 0s
242688K ........ ........ ........ ........ ........ ........ 96% 55.3M 0s
245760K ........ ........ ........ ........ ........ ........ 97%  212M 0s
248832K ........ ........ ........ ........ ........ ........ 99%  200M 0s
251904K ........ ........ ........ ........ ....Extracting the new controller...
.            100%  202M=1.4s

2024-04-06 23:09:14 (183 MB/s) - ‘karaf-0.18.4-20240406.194621-101.zip’ saved [260399296/260399296]

+ echo 'Extracting the new controller...'
+ unzip -q karaf-0.18.4-20240406.194621-101.zip
Adding external repositories...
+ echo 'Adding external repositories...'
+ sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
+ cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
################################################################################
#
#    Licensed to the Apache Software Foundation (ASF) under one or more
#    contributor license agreements.  See the NOTICE file distributed with
#    this work for additional information regarding copyright ownership.
#    The ASF licenses this file to You under the Apache License, Version 2.0
#    (the "License"); you may not use this file except in compliance with
#    the License.  You may obtain a copy of the License at
#
#       http://www.apache.org/licenses/LICENSE-2.0
#
#    Unless required by applicable law or agreed to in writing, software
#    distributed under the License is distributed on an "AS IS" BASIS,
#    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
#    See the License for the specific language governing permissions and
#    limitations under the License.
#
################################################################################

#
# If set to true, the following property will not allow any certificate to be used
# when accessing Maven repositories through SSL
#
#org.ops4j.pax.url.mvn.certificateCheck=

#
# Path to the local Maven settings file.
# The repositories defined in this file will be automatically added to the list
# of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property
# below is not set.
# The following locations are checked for the existence of the settings.xml file
#   * 1. looks for the specified url
#   * 2. if not found looks for ${user.home}/.m2/settings.xml
#   * 3. if not found looks for ${maven.home}/conf/settings.xml
#   * 4. if not found looks for ${M2_HOME}/conf/settings.xml
#
#org.ops4j.pax.url.mvn.settings=

#
# Path to the local Maven repository which is used to avoid downloading
# artifacts when they already exist locally.
# The value of this property will be extracted from the settings.xml file
# above, or defaulted to:
#     System.getProperty( "user.home" ) + "/.m2/repository"
#
org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository}

#
# Default this to false. It's just weird to use undocumented repos
#
org.ops4j.pax.url.mvn.useFallbackRepositories=false

#
# Uncomment if you don't wanna use the proxy settings
# from the Maven conf/settings.xml file
#
# org.ops4j.pax.url.mvn.proxySupport=false

#
# Comma separated list of repositories scanned when resolving an artifact.
# Those repositories will be checked before iterating through the
#    below list of repositories and even before the local repository
# A repository url can be appended with zero or more of the following flags:
#    @snapshots  : the repository contains snaphots
#    @noreleases : the repository does not contain any released artifacts
#
# The following property value will add the system folder as a repo.
#
org.ops4j.pax.url.mvn.defaultRepositories=\
    file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\
    file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\
    file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots

# Use the default local repo (e.g.~/.m2/repository) as a "remote" repo
#org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false

#
# Comma separated list of repositories scanned when resolving an artifact.
# The default list includes the following repositories:
#    http://repo1.maven.org/maven2@id=central
#    http://repository.springsource.com/maven/bundles/release@id=spring.ebr
#    http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external
#    http://zodiac.springsource.com/maven/bundles/release@id=gemini
#    http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases
#    https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases
#    https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
# To add repositories to the default ones, prepend '+' to the list of repositories
# to add.
# A repository url can be appended with zero or more of the following flags:
#    @snapshots  : the repository contains snapshots
#    @noreleases : the repository does not contain any released artifacts
#    @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended
#
org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases

### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.Configuring the startup features...
+ [[ True == \T\r\u\e ]]
+ echo 'Configuring the startup features...'
+ sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
+ FEATURE_TEST_STRING=features-test
+ FEATURE_TEST_VERSION=0.18.4-SNAPSHOT
+ KARAF_VERSION=karaf4
+ [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]]
+ sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.18.4-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
+ [[ ! -z '' ]]
+ cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
################################################################################
#
#    Licensed to the Apache Software Foundation (ASF) under one or more
#    contributor license agreements.  See the NOTICE file distributed with
#    this work for additional information regarding copyright ownership.
#    The ASF licenses this file to You under the Apache License, Version 2.0
#    (the "License"); you may not use this file except in compliance with
#    the License.  You may obtain a copy of the License at
#
#       http://www.apache.org/licenses/LICENSE-2.0
#
#    Unless required by applicable law or agreed to in writing, software
#    distributed under the License is distributed on an "AS IS" BASIS,
#    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
#    See the License for the specific language governing permissions and
#    limitations under the License.
#
################################################################################

#
# Comma separated list of features repositories to register by default
#
featuresRepositories = mvn:org.opendaylight.integration/features-test/0.18.4-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/8a04ff1b-ac3d-412c-bd6f-10a42387a5d8.xml

#
# Comma separated list of features to install at startup
#
featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, 57c24381-3139-498b-8c1d-3df89d3e4465

#
# Resource repositories (OBR) that the features resolver can use
# to resolve requirements/capabilities
#
# The format of the resourceRepositories is 
# resourceRepositories=[xml:url|json:url],...
# for Instance:
#
#resourceRepositories=xml:http://host/path/to/index.xml
# or
#resourceRepositories=json:http://host/path/to/index.json
#

#
# Defines if the boot features are started in asynchronous mode (in a dedicated thread)
#
featuresBootAsynchronous=false

#
# Service requirements enforcement
#
# By default, the feature resolver checks the service requirements/capabilities of
# bundles for new features (xml schema >= 1.3.0) in order to automatically installs
# the required bundles.
# The following flag can have those values:
#   - disable: service requirements are completely ignored
#   - default: service requirements are ignored for old features
#   - enforce: service requirements are always verified
#
#serviceRequirements=default

#
# Store cfg file for config element in feature
#
#configCfgStore=true

#
# Define if the feature service automatically refresh bundles
#
autoRefresh=true

#
# Configuration of features processing mechanism (overrides, blacklisting, modification of features)
# XML file defines instructions related to features processing
# versions.properties may declare properties to resolve placeholders in XML file
# both files are relative to ${karaf.etc}
#
#featureProcessing=org.apache.karaf.features.xml
#featureProcessingVersions=versions.properties
+ configure_karaf_log karaf4 ''
+ local -r karaf_version=karaf4
+ local -r controllerdebugmap=
+ local logapi=log4j
+ grep log4j2 /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
log4j2.rootLogger.level = INFO
#log4j2.rootLogger.type = asyncRoot
#log4j2.rootLogger.includeLocation = false
log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
log4j2.rootLogger.appenderRef.Console.ref = Console
log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
log4j2.logger.spifly.name = org.apache.aries.spifly
log4j2.logger.spifly.level = WARN
log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
log4j2.logger.audit.level = INFO
log4j2.logger.audit.additivity = false
log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
# Console appender not used by default (see log4j2.rootLogger.appenderRefs)
log4j2.appender.console.type = Console
log4j2.appender.console.name = Console
log4j2.appender.console.layout.type = PatternLayout
log4j2.appender.console.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.type = RollingRandomAccessFile
log4j2.appender.rolling.name = RollingFile
log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
#log4j2.appender.rolling.immediateFlush = false
log4j2.appender.rolling.append = true
log4j2.appender.rolling.layout.type = PatternLayout
log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.policies.type = Policies
log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.rolling.policies.size.size = 64MB
log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
log4j2.appender.rolling.strategy.max = 7
log4j2.appender.audit.type = RollingRandomAccessFile
log4j2.appender.audit.name = AuditRollingFile
log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
log4j2.appender.audit.append = true
log4j2.appender.audit.layout.type = PatternLayout
log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
log4j2.appender.audit.policies.type = Policies
log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.audit.policies.size.size = 8MB
log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
log4j2.appender.audit.strategy.max = 7
log4j2.appender.osgi.type = PaxOsgi
log4j2.appender.osgi.name = PaxOsgi
log4j2.appender.osgi.filter = *
#log4j2.logger.aether.name = shaded.org.eclipse.aether
#log4j2.logger.aether.level = TRACE
#log4j2.logger.http-headers.name = shaded.org.apache.http.headers
#log4j2.logger.http-headers.level = DEBUG
#log4j2.logger.maven.name = org.ops4j.pax.url.mvn
#log4j2.logger.maven.level = TRACE
Configuring the karaf log... karaf_version: karaf4, logapi: log4j2
+ logapi=log4j2
+ echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2'
+ '[' log4j2 == log4j2 ']'
+ sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
+ orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver
+ orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver
+ echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN'
+ echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN'
controllerdebugmap: 
cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
+ unset IFS
+ echo 'controllerdebugmap: '
+ '[' -n '' ']'
+ echo 'cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg'
+ cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
################################################################################
#
#    Licensed to the Apache Software Foundation (ASF) under one or more
#    contributor license agreements.  See the NOTICE file distributed with
#    this work for additional information regarding copyright ownership.
#    The ASF licenses this file to You under the Apache License, Version 2.0
#    (the "License"); you may not use this file except in compliance with
#    the License.  You may obtain a copy of the License at
#
#       http://www.apache.org/licenses/LICENSE-2.0
#
#    Unless required by applicable law or agreed to in writing, software
#    distributed under the License is distributed on an "AS IS" BASIS,
#    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
#    See the License for the specific language governing permissions and
#    limitations under the License.
#
################################################################################

# Common pattern layout for appenders
log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n

# Root logger
log4j2.rootLogger.level = INFO
# uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library
#log4j2.rootLogger.type = asyncRoot
#log4j2.rootLogger.includeLocation = false
log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
log4j2.rootLogger.appenderRef.Console.ref = Console
log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}

# Filters for logs marked by org.opendaylight.odlparent.Markers
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL

# Loggers configuration

# Spifly logger
log4j2.logger.spifly.name = org.apache.aries.spifly
log4j2.logger.spifly.level = WARN

# Security audit logger
log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
log4j2.logger.audit.level = INFO
log4j2.logger.audit.additivity = false
log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile

# Appenders configuration

# Console appender not used by default (see log4j2.rootLogger.appenderRefs)
log4j2.appender.console.type = Console
log4j2.appender.console.name = Console
log4j2.appender.console.layout.type = PatternLayout
log4j2.appender.console.layout.pattern = ${log4j2.pattern}

# Rolling file appender
log4j2.appender.rolling.type = RollingRandomAccessFile
log4j2.appender.rolling.name = RollingFile
log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
# uncomment to not force a disk flush
#log4j2.appender.rolling.immediateFlush = false
log4j2.appender.rolling.append = true
log4j2.appender.rolling.layout.type = PatternLayout
log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.policies.type = Policies
log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.rolling.policies.size.size = 1GB
log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
log4j2.appender.rolling.strategy.max = 7

# Audit file appender
log4j2.appender.audit.type = RollingRandomAccessFile
log4j2.appender.audit.name = AuditRollingFile
log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
log4j2.appender.audit.append = true
log4j2.appender.audit.layout.type = PatternLayout
log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
log4j2.appender.audit.policies.type = Policies
log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.audit.policies.size.size = 8MB
log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
log4j2.appender.audit.strategy.max = 7

# OSGi appender
log4j2.appender.osgi.type = PaxOsgi
log4j2.appender.osgi.name = PaxOsgi
log4j2.appender.osgi.filter = *

# help with identification of maven-related problems with pax-url-aether
#log4j2.logger.aether.name = shaded.org.eclipse.aether
#log4j2.logger.aether.level = TRACE
#log4j2.logger.http-headers.name = shaded.org.apache.http.headers
#log4j2.logger.http-headers.level = DEBUG
#log4j2.logger.maven.name = org.ops4j.pax.url.mvn
#log4j2.logger.maven.level = TRACE
log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN
log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN
+ set_java_vars /usr/lib/jvm/java-17-openjdk 3072m /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv
+ local -r java_home=/usr/lib/jvm/java-17-openjdk
+ local -r controllermem=3072m
+ local -r memconf=/tmp/karaf-0.18.4-SNAPSHOT/bin/setenv
Configure
    java home: /usr/lib/jvm/java-17-openjdk
    max memory: 3072m
    memconf: /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv
+ echo Configure
+ echo '    java home: /usr/lib/jvm/java-17-openjdk'
+ echo '    max memory: 3072m'
+ echo '    memconf: /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv'
+ sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk}%g' /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv
+ sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv
cat /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv
+ echo 'cat /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv'
+ cat /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv
#!/bin/sh
#
#    Licensed to the Apache Software Foundation (ASF) under one or more
#    contributor license agreements.  See the NOTICE file distributed with
#    this work for additional information regarding copyright ownership.
#    The ASF licenses this file to You under the Apache License, Version 2.0
#    (the "License"); you may not use this file except in compliance with
#    the License.  You may obtain a copy of the License at
#
#       http://www.apache.org/licenses/LICENSE-2.0
#
#    Unless required by applicable law or agreed to in writing, software
#    distributed under the License is distributed on an "AS IS" BASIS,
#    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
#    See the License for the specific language governing permissions and
#    limitations under the License.
#

#
# handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf
# script: client, instance, shell, start, status, stop, karaf
#
# if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then
#   Actions go here...
# fi

#
# general settings which should be applied for all scripts go here; please keep
# in mind that it is possible that scripts might be executed more than once, e.g.
# in example of the start script where the start script is executed first and the
# karaf script afterwards.
#

#
# The following section shows the possible configuration options for the default 
# karaf scripts
#
export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk} # Location of Java installation
# export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration
# export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options
# export EXTRA_JAVA_OPTS # Additional JVM options
# export KARAF_HOME # Karaf home folder
# export KARAF_DATA # Karaf data folder
# export KARAF_BASE # Karaf base folder
# export KARAF_ETC  # Karaf etc  folder
# export KARAF_LOG  # Karaf log  folder
# export KARAF_SYSTEM_OPTS # First citizen Karaf options
# export KARAF_OPTS # Additional available Karaf options
# export KARAF_DEBUG # Enable debug mode
# export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start
# export KARAF_NOROOT # Prevent execution as root if set to true
Set Java version
+ echo 'Set Java version'
+ sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-17-openjdk/bin/java 1
+ sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-17-openjdk/bin/java
JDK default version ...
+ echo 'JDK default version ...'
+ java -version
openjdk version "17.0.6-ea" 2023-01-17 LTS
OpenJDK Runtime Environment (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS)
OpenJDK 64-Bit Server VM (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS, mixed mode, sharing)
Set JAVA_HOME
+ echo 'Set JAVA_HOME'
+ export JAVA_HOME=/usr/lib/jvm/java-17-openjdk
+ JAVA_HOME=/usr/lib/jvm/java-17-openjdk
++ readlink -e /usr/lib/jvm/java-17-openjdk/bin/java
Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java
+ JAVA_RESOLVED=/usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java
+ echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java'
Listing all open ports on controller system...
+ echo 'Listing all open ports on controller system...'
+ netstat -pnatu
(Not all processes could be identified, non-owned process info
 will not be shown, you would have to be root to see it all.)
Active Internet connections (servers and established)
Proto Recv-Q Send-Q Local Address           Foreign Address         State       PID/Program name    
tcp        0      0 0.0.0.0:22              0.0.0.0:*               LISTEN      -                   
tcp        0      0 0.0.0.0:111             0.0.0.0:*               LISTEN      -                   
tcp        0    164 10.30.171.51:22         10.30.170.206:53622     ESTABLISHED -                   
tcp        0      0 10.30.171.51:49810      199.204.45.87:443       TIME_WAIT   -                   
tcp6       0      0 :::22                   :::*                    LISTEN      -                   
tcp6       0      0 :::111                  :::*                    LISTEN      -                   
tcp6       0      0 :::5555                 :::*                    LISTEN      -                   
udp        0      0 10.30.171.51:68         10.30.170.2:67          ESTABLISHED -                   
udp        0      0 0.0.0.0:111             0.0.0.0:*                           -                   
udp        0      0 127.0.0.1:323           0.0.0.0:*                           -                   
udp6       0      0 :::111                  :::*                                -                   
udp6       0      0 ::1:323                 :::*                                -                   
+ '[' -f /tmp/custom_shard_config.txt ']'
Custom shard config exists!!!
Copying the shard config...
+ echo 'Custom shard config exists!!!'
+ echo 'Copying the shard config...'
+ cp /tmp/custom_shard_config.txt /tmp/karaf-0.18.4-SNAPSHOT/bin/
Configuring cluster
+ echo 'Configuring cluster'
+ /tmp/karaf-0.18.4-SNAPSHOT/bin/configure_cluster.sh 1 10.30.171.51 10.30.170.19 10.30.171.190
################################################
##             Configure Cluster              ##
################################################
 NOTE: Cluster configuration files not found. Copying from
 /tmp/karaf-0.18.4-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/7.0.11
Configuring unique name in akka.conf
Configuring hostname in akka.conf
Configuring data and rpc seed nodes in akka.conf
modules = [
	
	{
		name = "inventory"
		namespace = "urn:opendaylight:inventory"
		shard-strategy = "module"
	},
	{
		name = "topology"
		namespace = "urn:TBD:params:xml:ns:yang:network-topology"
		shard-strategy = "module"
	},
	{
		name = "toaster"
		namespace = "http://netconfcentral.org/ns/toaster"
		shard-strategy = "module"
	},
	{
		name = "car"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
		shard-strategy = "module"
	},
	{
		name = "people"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
		shard-strategy = "module"
	},
	{
		name = "car-people"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
		shard-strategy = "module"
	}
]
Configuring replication type in module-shards.conf
################################################
##   NOTE: Manually restart controller to     ##
##         apply configuration.               ##
################################################
Dump akka.conf
+ echo 'Dump akka.conf'
+ cat /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/akka.conf

odl-cluster-data {
  akka {
    remote {
      artery {
        enabled = on
        transport = tcp
        canonical.hostname = "10.30.171.51"
        canonical.port = 2550
      }
    }

    cluster {
      # Using artery.
      seed-nodes = ["akka://opendaylight-cluster-data@10.30.171.51:2550",
				"akka://opendaylight-cluster-data@10.30.170.19:2550",
				"akka://opendaylight-cluster-data@10.30.171.190:2550"]

      roles = ["member-1"]

      # when under load we might trip a false positive on the failure detector
      # failure-detector {
        # heartbeat-interval = 4 s
        # acceptable-heartbeat-pause = 16s
      # }
    }

    persistence {
      # By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by
      # modifying the following two properties. The directory location specified may be a relative or absolute path. 
      # The relative path is always relative to KARAF_HOME.

      # snapshot-store.local.dir = "target/snapshots"

      # Use lz4 compression for LocalSnapshotStore snapshots
      snapshot-store.local.use-lz4-compression = false
      # Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB
      snapshot-store.local.lz4-blocksize = 256KB
    }
    disable-default-actor-system-quarantined-event-handling = "false"
  }
}
Dump modules.conf
+ echo 'Dump modules.conf'
+ cat /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/modules.conf
modules = [
	
	{
		name = "inventory"
		namespace = "urn:opendaylight:inventory"
		shard-strategy = "module"
	},
	{
		name = "topology"
		namespace = "urn:TBD:params:xml:ns:yang:network-topology"
		shard-strategy = "module"
	},
	{
		name = "toaster"
		namespace = "http://netconfcentral.org/ns/toaster"
		shard-strategy = "module"
	},
	{
		name = "car"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
		shard-strategy = "module"
	},
	{
		name = "people"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
		shard-strategy = "module"
	},
	{
		name = "car-people"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
		shard-strategy = "module"
	}
]
Dump module-shards.conf
+ echo 'Dump module-shards.conf'
+ cat /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/module-shards.conf
module-shards = [
	{
		name = "default"
		shards = [
			{
				name = "default"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "inventory"
		shards = [
			{
				name="inventory"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "topology"
		shards = [
			{
				name="topology"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "toaster"
		shards = [
			{
				name="toaster"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "car"
		shards = [
			{
				name="car"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "people"
		shards = [
			{
				name="people"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "car-people"
		shards = [
			{
				name="car-people"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	}
]
Configuring member-2 with IP address 10.30.170.19
Warning: Permanently added '10.30.170.19' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.170.19' (ECDSA) to the list of known hosts.
+ source /tmp/common-functions.sh karaf-0.18.4-SNAPSHOT
common-functions.sh is being sourced
++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]]
++ echo 'common-functions.sh is being sourced'
++ BUNDLEFOLDER=karaf-0.18.4-SNAPSHOT
++ export MAVENCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
++ MAVENCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
++ export FEATURESCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
++ FEATURESCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
++ export CUSTOMPROP=/tmp/karaf-0.18.4-SNAPSHOT/etc/custom.properties
++ CUSTOMPROP=/tmp/karaf-0.18.4-SNAPSHOT/etc/custom.properties
++ export LOGCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
++ LOGCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
++ export MEMCONF=/tmp/karaf-0.18.4-SNAPSHOT/bin/setenv
++ MEMCONF=/tmp/karaf-0.18.4-SNAPSHOT/bin/setenv
++ export CONTROLLERMEM=
++ CONTROLLERMEM=
++ export AKKACONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/akka.conf
++ AKKACONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/akka.conf
++ export MODULESCONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/modules.conf
++ MODULESCONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/modules.conf
++ export MODULESHARDSCONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/module-shards.conf
++ MODULESHARDSCONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/module-shards.conf
++ print_common_env
++ cat
common-functions environment:
MAVENCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
ACTUALFEATURES: 
FEATURESCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
CUSTOMPROP: /tmp/karaf-0.18.4-SNAPSHOT/etc/custom.properties
LOGCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
MEMCONF: /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv
CONTROLLERMEM: 
AKKACONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/akka.conf
MODULESCONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/modules.conf
MODULESHARDSCONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/module-shards.conf
SUITES: 

++ SSH='ssh -t -t'
++ extra_services_cntl='     dnsmasq.service     httpd.service     libvirtd.service     openvswitch.service     ovs-vswitchd.service     ovsdb-server.service     rabbitmq-server.service '
++ extra_services_cmp='     libvirtd.service     openvswitch.service     ovs-vswitchd.service     ovsdb-server.service '
Changing to /tmp
Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/karaf-0.18.4-20240406.194621-101.zip
+ echo 'Changing to /tmp'
+ cd /tmp
+ echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/karaf-0.18.4-20240406.194621-101.zip'
+ wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/karaf-0.18.4-20240406.194621-101.zip
--2024-04-06 23:09:18--  https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/karaf-0.18.4-20240406.194621-101.zip
Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6
Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 260399296 (248M) [application/zip]
Saving to: ‘karaf-0.18.4-20240406.194621-101.zip’

     0K ........ ........ ........ ........ ........ ........  1%  101M 2s
  3072K ........ ........ ........ ........ ........ ........  2%  129M 2s
  6144K ........ ........ ........ ........ ........ ........  3% 75.3M 2s
  9216K ........ ........ ........ ........ ........ ........  4% 50.5M 3s
 12288K ........ ........ ........ ........ ........ ........  6% 83.0M 3s
 15360K ........ ........ ........ ........ ........ ........  7% 74.1M 3s
 18432K ........ ........ ........ ........ ........ ........  8%  124M 3s
 21504K ........ ........ ........ ........ ........ ........  9%  150M 3s
 24576K ........ ........ ........ ........ ........ ........ 10%  150M 2s
 27648K ........ ........ ........ ........ ........ ........ 12% 80.5M 2s
 30720K ........ ........ ........ ........ ........ ........ 13%  214M 2s
 33792K ........ ........ ........ ........ ........ ........ 14%  210M 2s
 36864K ........ ........ ........ ........ ........ ........ 15%  190M 2s
 39936K ........ ........ ........ ........ ........ ........ 16%  203M 2s
 43008K ........ ........ ........ ........ ........ ........ 18%  209M 2s
 46080K ........ ........ ........ ........ ........ ........ 19%  216M 2s
 49152K ........ ........ ........ ........ ........ ........ 20%  203M 2s
 52224K ........ ........ ........ ........ ........ ........ 21%  164M 2s
 55296K ........ ........ ........ ........ ........ ........ 22%  202M 2s
 58368K ........ ........ ........ ........ ........ ........ 24%  226M 2s
 61440K ........ ........ ........ ........ ........ ........ 25%  255M 1s
 64512K ........ ........ ........ ........ ........ ........ 26%  250M 1s
 67584K ........ ........ ........ ........ ........ ........ 27%  240M 1s
 70656K ........ ........ ........ ........ ........ ........ 28%  250M 1s
 73728K ........ ........ ........ ........ ........ ........ 30%  264M 1s
 76800K ........ ........ ........ ........ ........ ........ 31%  268M 1s
 79872K ........ ........ ........ ........ ........ ........ 32%  250M 1s
 82944K ........ ........ ........ ........ ........ ........ 33%  237M 1s
 86016K ........ ........ ........ ........ ........ ........ 35%  278M 1s
 89088K ........ ........ ........ ........ ........ ........ 36%  157M 1s
 92160K ........ ........ ........ ........ ........ ........ 37%  304M 1s
 95232K ........ ........ ........ ........ ........ ........ 38%  231M 1s
 98304K ........ ........ ........ ........ ........ ........ 39%  223M 1s
101376K ........ ........ ........ ........ ........ ........ 41%  290M 1s
104448K ........ ........ ........ ........ ........ ........ 42%  323M 1s
107520K ........ ........ ........ ........ ........ ........ 43%  312M 1s
110592K ........ ........ ........ ........ ........ ........ 44%  321M 1s
113664K ........ ........ ........ ........ ........ ........ 45%  272M 1s
116736K ........ ........ ........ ........ ........ ........ 47%  309M 1s
119808K ........ ........ ........ ........ ........ ........ 48%  270M 1s
122880K ........ ........ ........ ........ ........ ........ 49%  312M 1s
125952K ........ ........ ........ ........ ........ ........ 50%  303M 1s
129024K ........ ........ ........ ........ ........ ........ 51%  276M 1s
132096K ........ ........ ........ ........ ........ ........ 53%  310M 1s
135168K ........ ........ ........ ........ ........ ........ 54%  269M 1s
138240K ........ ........ ........ ........ ........ ........ 55%  317M 1s
141312K ........ ........ ........ ........ ........ ........ 56%  316M 1s
144384K ........ ........ ........ ........ ........ ........ 57%  302M 1s
147456K ........ ........ ........ ........ ........ ........ 59%  318M 1s
150528K ........ ........ ........ ........ ........ ........ 60%  340M 1s
153600K ........ ........ ........ ........ ........ ........ 61%  325M 1s
156672K ........ ........ ........ ........ ........ ........ 62%  347M 0s
159744K ........ ........ ........ ........ ........ ........ 64%  330M 0s
162816K ........ ........ ........ ........ ........ ........ 65%  336M 0s
165888K ........ ........ ........ ........ ........ ........ 66%  336M 0s
168960K ........ ........ ........ ........ ........ ........ 67%  329M 0s
172032K ........ ........ ........ ........ ........ ........ 68%  339M 0s
175104K ........ ........ ........ ........ ........ ........ 70%  356M 0s
178176K ........ ........ ........ ........ ........ ........ 71%  333M 0s
181248K ........ ........ ........ ........ ........ ........ 72%  336M 0s
184320K ........ ........ ........ ........ ........ ........ 73%  207M 0s
187392K ........ ........ ........ ........ ........ ........ 74%  223M 0s
190464K ........ ........ ........ ........ ........ ........ 76%  297M 0s
193536K ........ ........ ........ ........ ........ ........ 77%  305M 0s
196608K ........ ........ ........ ........ ........ ........ 78%  328M 0s
199680K ........ ........ ........ ........ ........ ........ 79%  306M 0s
202752K ........ ........ ........ ........ ........ ........ 80%  318M 0s
205824K ........ ........ ........ ........ ........ ........ 82%  327M 0s
208896K ........ ........ ........ ........ ........ ........ 83%  331M 0s
211968K ........ ........ ........ ........ ........ ........ 84%  330M 0s
215040K ........ ........ ........ ........ ........ ........ 85%  302M 0s
218112K ........ ........ ........ ........ ........ ........ 86%  313M 0s
221184K ........ ........ ........ ........ ........ ........ 88%  311M 0s
224256K ........ ........ ........ ........ ........ ........ 89%  309M 0s
227328K ........ ........ ........ ........ ........ ........ 90%  323M 0s
230400K ........ ........ ........ ........ ........ ........ 91%  343M 0s
233472K ........ ........ ........ ........ ........ ........ 93%  331M 0s
236544K ........ ........ ........ ........ ........ ........ 94%  329M 0s
239616K ........ ........ ........ ........ ........ ........ 95%  336M 0s
242688K ........ ........ ........ ........ ........ ........ 96%  352M 0s
245760K ........ ........ ........ ........ ........ ........ 97%  336M 0s
248832K ........ ........ ........ ........ ........ ........ 99%  386M 0s
251904K ........ ........ ........ ........ .....            100%  337M=1.1s

2024-04-06 23:09:19 (222 MB/s) - ‘karaf-0.18.4-20240406.194621-101.zip’ saved [260399296/260399296]

Extracting the new controller...
+ echo 'Extracting the new controller...'
+ unzip -q karaf-0.18.4-20240406.194621-101.zip
Adding external repositories...
+ echo 'Adding external repositories...'
+ sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
+ cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
################################################################################
#
#    Licensed to the Apache Software Foundation (ASF) under one or more
#    contributor license agreements.  See the NOTICE file distributed with
#    this work for additional information regarding copyright ownership.
#    The ASF licenses this file to You under the Apache License, Version 2.0
#    (the "License"); you may not use this file except in compliance with
#    the License.  You may obtain a copy of the License at
#
#       http://www.apache.org/licenses/LICENSE-2.0
#
#    Unless required by applicable law or agreed to in writing, software
#    distributed under the License is distributed on an "AS IS" BASIS,
#    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
#    See the License for the specific language governing permissions and
#    limitations under the License.
#
################################################################################

#
# If set to true, the following property will not allow any certificate to be used
# when accessing Maven repositories through SSL
#
#org.ops4j.pax.url.mvn.certificateCheck=

#
# Path to the local Maven settings file.
# The repositories defined in this file will be automatically added to the list
# of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property
# below is not set.
# The following locations are checked for the existence of the settings.xml file
#   * 1. looks for the specified url
#   * 2. if not found looks for ${user.home}/.m2/settings.xml
#   * 3. if not found looks for ${maven.home}/conf/settings.xml
#   * 4. if not found looks for ${M2_HOME}/conf/settings.xml
#
#org.ops4j.pax.url.mvn.settings=

#
# Path to the local Maven repository which is used to avoid downloading
# artifacts when they already exist locally.
# The value of this property will be extracted from the settings.xml file
# above, or defaulted to:
#     System.getProperty( "user.home" ) + "/.m2/repository"
#
org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository}

#
# Default this to false. It's just weird to use undocumented repos
#
org.ops4j.pax.url.mvn.useFallbackRepositories=false

#
# Uncomment if you don't wanna use the proxy settings
# from the Maven conf/settings.xml file
#
# org.ops4j.pax.url.mvn.proxySupport=false

#
# Comma separated list of repositories scanned when resolving an artifact.
# Those repositories will be checked before iterating through the
#    below list of repositories and even before the local repository
# A repository url can be appended with zero or more of the following flags:
#    @snapshots  : the repository contains snaphots
#    @noreleases : the repository does not contain any released artifacts
#
# The following property value will add the system folder as a repo.
#
org.ops4j.pax.url.mvn.defaultRepositories=\
    file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\
    file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\
    file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots

# Use the default local repo (e.g.~/.m2/repository) as a "remote" repo
#org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false

#
# Comma separated list of repositories scanned when resolving an artifact.
# The default list includes the following repositories:
#    http://repo1.maven.org/maven2@id=central
#    http://repository.springsource.com/maven/bundles/release@id=spring.ebr
#    http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external
#    http://zodiac.springsource.com/maven/bundles/release@id=gemini
#    http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases
#    https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases
#    https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
# To add repositories to the default ones, prepend '+' to the list of repositories
# to add.
# A repository url can be appended with zero or more of the following flags:
#    @snapshots  : the repository contains snapshots
#    @noreleases : the repository does not contain any released artifacts
#    @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended
#
org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases

### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.Configuring the startup features...
+ [[ True == \T\r\u\e ]]
+ echo 'Configuring the startup features...'
+ sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
+ FEATURE_TEST_STRING=features-test
+ FEATURE_TEST_VERSION=0.18.4-SNAPSHOT
+ KARAF_VERSION=karaf4
+ [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]]
+ sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.18.4-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
+ [[ ! -z '' ]]
+ cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
################################################################################
#
#    Licensed to the Apache Software Foundation (ASF) under one or more
#    contributor license agreements.  See the NOTICE file distributed with
#    this work for additional information regarding copyright ownership.
#    The ASF licenses this file to You under the Apache License, Version 2.0
#    (the "License"); you may not use this file except in compliance with
#    the License.  You may obtain a copy of the License at
#
#       http://www.apache.org/licenses/LICENSE-2.0
#
#    Unless required by applicable law or agreed to in writing, software
#    distributed under the License is distributed on an "AS IS" BASIS,
#    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
#    See the License for the specific language governing permissions and
#    limitations under the License.
#
################################################################################

#
# Comma separated list of features repositories to register by default
#
featuresRepositories = mvn:org.opendaylight.integration/features-test/0.18.4-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/8a04ff1b-ac3d-412c-bd6f-10a42387a5d8.xml

#
# Comma separated list of features to install at startup
#
featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, 57c24381-3139-498b-8c1d-3df89d3e4465

#
# Resource repositories (OBR) that the features resolver can use
# to resolve requirements/capabilities
#
# The format of the resourceRepositories is 
# resourceRepositories=[xml:url|json:url],...
# for Instance:
#
#resourceRepositories=xml:http://host/path/to/index.xml
# or
#resourceRepositories=json:http://host/path/to/index.json
#

#
# Defines if the boot features are started in asynchronous mode (in a dedicated thread)
#
featuresBootAsynchronous=false

#
# Service requirements enforcement
#
# By default, the feature resolver checks the service requirements/capabilities of
# bundles for new features (xml schema >= 1.3.0) in order to automatically installs
# the required bundles.
# The following flag can have those values:
#   - disable: service requirements are completely ignored
#   - default: service requirements are ignored for old features
#   - enforce: service requirements are always verified
#
#serviceRequirements=default

#
# Store cfg file for config element in feature
#
#configCfgStore=true

#
# Define if the feature service automatically refresh bundles
#
autoRefresh=true

#
# Configuration of features processing mechanism (overrides, blacklisting, modification of features)
# XML file defines instructions related to features processing
# versions.properties may declare properties to resolve placeholders in XML file
# both files are relative to ${karaf.etc}
#
#featureProcessing=org.apache.karaf.features.xml
#featureProcessingVersions=versions.properties
+ configure_karaf_log karaf4 ''
+ local -r karaf_version=karaf4
+ local -r controllerdebugmap=
+ local logapi=log4j
+ grep log4j2 /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
log4j2.rootLogger.level = INFO
#log4j2.rootLogger.type = asyncRoot
#log4j2.rootLogger.includeLocation = false
log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
log4j2.rootLogger.appenderRef.Console.ref = Console
log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
log4j2.logger.spifly.name = org.apache.aries.spifly
log4j2.logger.spifly.level = WARN
log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
log4j2.logger.audit.level = INFO
log4j2.logger.audit.additivity = false
log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
# Console appender not used by default (see log4j2.rootLogger.appenderRefs)
log4j2.appender.console.type = Console
log4j2.appender.console.name = Console
log4j2.appender.console.layout.type = PatternLayout
log4j2.appender.console.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.type = RollingRandomAccessFile
log4j2.appender.rolling.name = RollingFile
log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
#log4j2.appender.rolling.immediateFlush = false
log4j2.appender.rolling.append = true
log4j2.appender.rolling.layout.type = PatternLayout
log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.policies.type = Policies
log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.rolling.policies.size.size = 64MB
log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
log4j2.appender.rolling.strategy.max = 7
log4j2.appender.audit.type = RollingRandomAccessFile
log4j2.appender.audit.name = AuditRollingFile
log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
log4j2.appender.audit.append = true
log4j2.appender.audit.layout.type = PatternLayout
log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
log4j2.appender.audit.policies.type = Policies
log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.audit.policies.size.size = 8MB
log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
log4j2.appender.audit.strategy.max = 7
log4j2.appender.osgi.type = PaxOsgi
log4j2.appender.osgi.name = PaxOsgi
log4j2.appender.osgi.filter = *
#log4j2.logger.aether.name = shaded.org.eclipse.aether
#log4j2.logger.aether.level = TRACE
#log4j2.logger.http-headers.name = shaded.org.apache.http.headers
#log4j2.logger.http-headers.level = DEBUG
#log4j2.logger.maven.name = org.ops4j.pax.url.mvn
#log4j2.logger.maven.level = TRACE
Configuring the karaf log... karaf_version: karaf4, logapi: log4j2
+ logapi=log4j2
+ echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2'
+ '[' log4j2 == log4j2 ']'
+ sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
controllerdebugmap: 
cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
+ orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver
+ orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver
+ echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN'
+ echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN'
+ unset IFS
+ echo 'controllerdebugmap: '
+ '[' -n '' ']'
+ echo 'cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg'
+ cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
################################################################################
#
#    Licensed to the Apache Software Foundation (ASF) under one or more
#    contributor license agreements.  See the NOTICE file distributed with
#    this work for additional information regarding copyright ownership.
#    The ASF licenses this file to You under the Apache License, Version 2.0
#    (the "License"); you may not use this file except in compliance with
#    the License.  You may obtain a copy of the License at
#
#       http://www.apache.org/licenses/LICENSE-2.0
#
#    Unless required by applicable law or agreed to in writing, software
#    distributed under the License is distributed on an "AS IS" BASIS,
#    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
#    See the License for the specific language governing permissions and
#    limitations under the License.
#
################################################################################

# Common pattern layout for appenders
log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n

# Root logger
log4j2.rootLogger.level = INFO
# uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library
#log4j2.rootLogger.type = asyncRoot
#log4j2.rootLogger.includeLocation = false
log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
log4j2.rootLogger.appenderRef.Console.ref = Console
log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}

# Filters for logs marked by org.opendaylight.odlparent.Markers
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL

# Loggers configuration

# Spifly logger
log4j2.logger.spifly.name = org.apache.aries.spifly
log4j2.logger.spifly.level = WARN

# Security audit logger
log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
log4j2.logger.audit.level = INFO
log4j2.logger.audit.additivity = false
log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile

# Appenders configuration

# Console appender not used by default (see log4j2.rootLogger.appenderRefs)
log4j2.appender.console.type = Console
log4j2.appender.console.name = Console
log4j2.appender.console.layout.type = PatternLayout
log4j2.appender.console.layout.pattern = ${log4j2.pattern}

# Rolling file appender
log4j2.appender.rolling.type = RollingRandomAccessFile
log4j2.appender.rolling.name = RollingFile
log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
# uncomment to not force a disk flush
#log4j2.appender.rolling.immediateFlush = false
log4j2.appender.rolling.append = true
log4j2.appender.rolling.layout.type = PatternLayout
log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.policies.type = Policies
log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.rolling.policies.size.size = 1GB
log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
log4j2.appender.rolling.strategy.max = 7

# Audit file appender
log4j2.appender.audit.type = RollingRandomAccessFile
log4j2.appender.audit.name = AuditRollingFile
log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
log4j2.appender.audit.append = true
log4j2.appender.audit.layout.type = PatternLayout
log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
log4j2.appender.audit.policies.type = Policies
log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.audit.policies.size.size = 8MB
log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
log4j2.appender.audit.strategy.max = 7

# OSGi appender
log4j2.appender.osgi.type = PaxOsgi
log4j2.appender.osgi.name = PaxOsgi
log4j2.appender.osgi.filter = *

# help with identification of maven-related problems with pax-url-aether
#log4j2.logger.aether.name = shaded.org.eclipse.aether
#log4j2.logger.aether.level = TRACE
#log4j2.logger.http-headers.name = shaded.org.apache.http.headers
#log4j2.logger.http-headers.level = DEBUG
#log4j2.logger.maven.name = org.ops4j.pax.url.mvn
#log4j2.logger.maven.level = TRACE
log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN
log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN
Configure
    java home: /usr/lib/jvm/java-17-openjdk
    max memory: 3072m
    memconf: /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv
cat /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv
+ set_java_vars /usr/lib/jvm/java-17-openjdk 3072m /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv
+ local -r java_home=/usr/lib/jvm/java-17-openjdk
+ local -r controllermem=3072m
+ local -r memconf=/tmp/karaf-0.18.4-SNAPSHOT/bin/setenv
+ echo Configure
+ echo '    java home: /usr/lib/jvm/java-17-openjdk'
+ echo '    max memory: 3072m'
+ echo '    memconf: /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv'
+ sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk}%g' /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv
+ sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv
+ echo 'cat /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv'
+ cat /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv
#!/bin/sh
#
#    Licensed to the Apache Software Foundation (ASF) under one or more
#    contributor license agreements.  See the NOTICE file distributed with
#    this work for additional information regarding copyright ownership.
#    The ASF licenses this file to You under the Apache License, Version 2.0
#    (the "License"); you may not use this file except in compliance with
#    the License.  You may obtain a copy of the License at
#
#       http://www.apache.org/licenses/LICENSE-2.0
#
#    Unless required by applicable law or agreed to in writing, software
#    distributed under the License is distributed on an "AS IS" BASIS,
#    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
#    See the License for the specific language governing permissions and
#    limitations under the License.
#

#
# handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf
# script: client, instance, shell, start, status, stop, karaf
#
# if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then
#   Actions go here...
# fi

#
# general settings which should be applied for all scripts go here; please keep
# in mind that it is possible that scripts might be executed more than once, e.g.
# in example of the start script where the start script is executed first and the
# karaf script afterwards.
#

#
# The following section shows the possible configuration options for the default 
# karaf scripts
#
export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk} # Location of Java installation
# export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration
# export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options
# export EXTRA_JAVA_OPTS # Additional JVM options
# export KARAF_HOME # Karaf home folder
# export KARAF_DATA # Karaf data folder
# export KARAF_BASE # Karaf base folder
# export KARAF_ETC  # Karaf etc  folder
# export KARAF_LOG  # Karaf log  folder
# export KARAF_SYSTEM_OPTS # First citizen Karaf options
# export KARAF_OPTS # Additional available Karaf options
# export KARAF_DEBUG # Enable debug mode
# export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start
# export KARAF_NOROOT # Prevent execution as root if set to true
Set Java version
+ echo 'Set Java version'
+ sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-17-openjdk/bin/java 1
+ sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-17-openjdk/bin/java
JDK default version ...
+ echo 'JDK default version ...'
+ java -version
openjdk version "17.0.6-ea" 2023-01-17 LTS
OpenJDK Runtime Environment (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS)
OpenJDK 64-Bit Server VM (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS, mixed mode, sharing)
Set JAVA_HOME
+ echo 'Set JAVA_HOME'
+ export JAVA_HOME=/usr/lib/jvm/java-17-openjdk
+ JAVA_HOME=/usr/lib/jvm/java-17-openjdk
++ readlink -e /usr/lib/jvm/java-17-openjdk/bin/java
Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java
Listing all open ports on controller system...
+ JAVA_RESOLVED=/usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java
+ echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java'
+ echo 'Listing all open ports on controller system...'
+ netstat -pnatu
(Not all processes could be identified, non-owned process info
 will not be shown, you would have to be root to see it all.)
Active Internet connections (servers and established)
Proto Recv-Q Send-Q Local Address           Foreign Address         State       PID/Program name    
tcp        0      0 0.0.0.0:22              0.0.0.0:*               LISTEN      -                   
tcp        0      0 0.0.0.0:111             0.0.0.0:*               LISTEN      -                   
tcp        0    164 10.30.170.19:22         10.30.170.206:41172     ESTABLISHED -                   
tcp        0      0 10.30.170.19:50480      199.204.45.87:443       TIME_WAIT   -                   
tcp6       0      0 :::5555                 :::*                    LISTEN      -                   
tcp6       0      0 :::22                   :::*                    LISTEN      -                   
tcp6       0      0 :::111                  :::*                    LISTEN      -                   
udp        0      0 10.30.170.19:68         10.30.170.2:67          ESTABLISHED -                   
udp        0      0 0.0.0.0:111             0.0.0.0:*                           -                   
udp        0      0 127.0.0.1:323           0.0.0.0:*                           -                   
udp6       0      0 :::111                  :::*                                -                   
udp6       0      0 ::1:323                 :::*                                -                   
+ '[' -f /tmp/custom_shard_config.txt ']'
Custom shard config exists!!!
Copying the shard config...
+ echo 'Custom shard config exists!!!'
+ echo 'Copying the shard config...'
+ cp /tmp/custom_shard_config.txt /tmp/karaf-0.18.4-SNAPSHOT/bin/
Configuring cluster
+ echo 'Configuring cluster'
+ /tmp/karaf-0.18.4-SNAPSHOT/bin/configure_cluster.sh 2 10.30.171.51 10.30.170.19 10.30.171.190
################################################
##             Configure Cluster              ##
################################################
 NOTE: Cluster configuration files not found. Copying from
 /tmp/karaf-0.18.4-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/7.0.11
Configuring unique name in akka.conf
Configuring hostname in akka.conf
Configuring data and rpc seed nodes in akka.conf
modules = [
	
	{
		name = "inventory"
		namespace = "urn:opendaylight:inventory"
		shard-strategy = "module"
	},
	{
		name = "topology"
		namespace = "urn:TBD:params:xml:ns:yang:network-topology"
		shard-strategy = "module"
	},
	{
		name = "toaster"
		namespace = "http://netconfcentral.org/ns/toaster"
		shard-strategy = "module"
	},
	{
		name = "car"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
		shard-strategy = "module"
	},
	{
		name = "people"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
		shard-strategy = "module"
	},
	{
		name = "car-people"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
		shard-strategy = "module"
	}
]
Configuring replication type in module-shards.conf
################################################
##   NOTE: Manually restart controller to     ##
##         apply configuration.               ##
################################################
Dump akka.conf
+ echo 'Dump akka.conf'
+ cat /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/akka.conf

odl-cluster-data {
  akka {
    remote {
      artery {
        enabled = on
        transport = tcp
        canonical.hostname = "10.30.170.19"
        canonical.port = 2550
      }
    }

    cluster {
      # Using artery.
      seed-nodes = ["akka://opendaylight-cluster-data@10.30.171.51:2550",
				"akka://opendaylight-cluster-data@10.30.170.19:2550",
				"akka://opendaylight-cluster-data@10.30.171.190:2550"]

      roles = ["member-2"]

      # when under load we might trip a false positive on the failure detector
      # failure-detector {
        # heartbeat-interval = 4 s
        # acceptable-heartbeat-pause = 16s
      # }
    }

    persistence {
      # By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by
      # modifying the following two properties. The directory location specified may be a relative or absolute path. 
      # The relative path is always relative to KARAF_HOME.

      # snapshot-store.local.dir = "target/snapshots"

      # Use lz4 compression for LocalSnapshotStore snapshots
      snapshot-store.local.use-lz4-compression = false
      # Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB
      snapshot-store.local.lz4-blocksize = 256KB
    }
    disable-default-actor-system-quarantined-event-handling = "false"
  }
}
Dump modules.conf
+ echo 'Dump modules.conf'
+ cat /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/modules.conf
modules = [
	
	{
		name = "inventory"
		namespace = "urn:opendaylight:inventory"
		shard-strategy = "module"
	},
	{
		name = "topology"
		namespace = "urn:TBD:params:xml:ns:yang:network-topology"
		shard-strategy = "module"
	},
	{
		name = "toaster"
		namespace = "http://netconfcentral.org/ns/toaster"
		shard-strategy = "module"
	},
	{
		name = "car"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
		shard-strategy = "module"
	},
	{
		name = "people"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
		shard-strategy = "module"
	},
	{
		name = "car-people"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
		shard-strategy = "module"
	}
]
Dump module-shards.conf
+ echo 'Dump module-shards.conf'
+ cat /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/module-shards.conf
module-shards = [
	{
		name = "default"
		shards = [
			{
				name = "default"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "inventory"
		shards = [
			{
				name="inventory"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "topology"
		shards = [
			{
				name="topology"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "toaster"
		shards = [
			{
				name="toaster"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "car"
		shards = [
			{
				name="car"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "people"
		shards = [
			{
				name="people"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "car-people"
		shards = [
			{
				name="car-people"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	}
]
Configuring member-3 with IP address 10.30.171.190
Warning: Permanently added '10.30.171.190' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.171.190' (ECDSA) to the list of known hosts.
common-functions.sh is being sourced
common-functions environment:
MAVENCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
ACTUALFEATURES: 
FEATURESCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
CUSTOMPROP: /tmp/karaf-0.18.4-SNAPSHOT/etc/custom.properties
LOGCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
MEMCONF: /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv
CONTROLLERMEM: 
AKKACONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/akka.conf
MODULESCONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/modules.conf
MODULESHARDSCONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/module-shards.conf
SUITES: 

Changing to /tmp
+ source /tmp/common-functions.sh karaf-0.18.4-SNAPSHOT
++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]]
++ echo 'common-functions.sh is being sourced'
++ BUNDLEFOLDER=karaf-0.18.4-SNAPSHOT
++ export MAVENCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
++ MAVENCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
++ export FEATURESCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
++ FEATURESCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
++ export CUSTOMPROP=/tmp/karaf-0.18.4-SNAPSHOT/etc/custom.properties
++ CUSTOMPROP=/tmp/karaf-0.18.4-SNAPSHOT/etc/custom.properties
++ export LOGCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
++ LOGCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
++ export MEMCONF=/tmp/karaf-0.18.4-SNAPSHOT/bin/setenv
++ MEMCONF=/tmp/karaf-0.18.4-SNAPSHOT/bin/setenv
++ export CONTROLLERMEM=
++ CONTROLLERMEM=
++ export AKKACONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/akka.conf
++ AKKACONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/akka.conf
++ export MODULESCONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/modules.conf
++ MODULESCONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/modules.conf
++ export MODULESHARDSCONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/module-shards.conf
++ MODULESHARDSCONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/module-shards.conf
++ print_common_env
++ cat
++ SSH='ssh -t -t'
++ extra_services_cntl='     dnsmasq.service     httpd.service     libvirtd.service     openvswitch.service     ovs-vswitchd.service     ovsdb-server.service     rabbitmq-server.service '
++ extra_services_cmp='     libvirtd.service     openvswitch.service     ovs-vswitchd.service     ovsdb-server.service '
+ echo 'Changing to /tmp'
+ cd /tmp
Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/karaf-0.18.4-20240406.194621-101.zip
+ echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/karaf-0.18.4-20240406.194621-101.zip'
+ wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/karaf-0.18.4-20240406.194621-101.zip
--2024-04-06 23:09:22--  https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/karaf-0.18.4-20240406.194621-101.zip
Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6
Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 260399296 (248M) [application/zip]
Saving to: ‘karaf-0.18.4-20240406.194621-101.zip’

     0K ........ ........ ........ ........ ........ ........  1% 54.9M 4s
  3072K ........ ........ ........ ........ ........ ........  2% 60.5M 4s
  6144K ........ ........ ........ ........ ........ ........  3% 61.1M 4s
  9216K ........ ........ ........ ........ ........ ........  4% 53.2M 4s
 12288K ........ ........ ........ ........ ........ ........  6% 50.7M 4s
 15360K ........ ........ ........ ........ ........ ........  7% 29.4M 5s
 18432K ........ ........ ........ ........ ........ ........  8% 47.9M 5s
 21504K ........ ........ ........ ........ ........ ........  9% 55.8M 5s
 24576K ........ ........ ........ ........ ........ ........ 10% 62.8M 4s
 27648K ........ ........ ........ ........ ........ ........ 12%  119M 4s
 30720K ........ ........ ........ ........ ........ ........ 13%  130M 4s
 33792K ........ ........ ........ ........ ........ ........ 14%  124M 4s
 36864K ........ ........ ........ ........ ........ ........ 15%  113M 3s
 39936K ........ ........ ........ ........ ........ ........ 16%  125M 3s
 43008K ........ ........ ........ ........ ........ ........ 18% 76.4M 3s
 46080K ........ ........ ........ ........ ........ ........ 19% 95.0M 3s
 49152K ........ ........ ........ ........ ........ ........ 20%  127M 3s
 52224K ........ ........ ........ ........ ........ ........ 21%  145M 3s
 55296K ........ ........ ........ ........ ........ ........ 22%  137M 3s
 58368K ........ ........ ........ ........ ........ ........ 24%  100M 3s
 61440K ........ ........ ........ ........ ........ ........ 25% 94.2M 3s
 64512K ........ ........ ........ ........ ........ ........ 26% 87.7M 2s
 67584K ........ ........ ........ ........ ........ ........ 27%  101M 2s
 70656K ........ ........ ........ ........ ........ ........ 28%  226M 2s
 73728K ........ ........ ........ ........ ........ ........ 30%  232M 2s
 76800K ........ ........ ........ ........ ........ ........ 31%  202M 2s
 79872K ........ ........ ........ ........ ........ ........ 32%  210M 2s
 82944K ........ ........ ........ ........ ........ ........ 33%  204M 2s
 86016K ........ ........ ........ ........ ........ ........ 35%  198M 2s
 89088K ........ ........ ........ ........ ........ ........ 36%  188M 2s
 92160K ........ ........ ........ ........ ........ ........ 37%  164M 2s
 95232K ........ ........ ........ ........ ........ ........ 38%  195M 2s
 98304K ........ ........ ........ ........ ........ ........ 39%  195M 2s
101376K ........ ........ ........ ........ ........ ........ 41%  188M 2s
104448K ........ ........ ........ ........ ........ ........ 42%  189M 2s
107520K ........ ........ ........ ........ ........ ........ 43%  179M 1s
110592K ........ ........ ........ ........ ........ ........ 44%  161M 1s
113664K ........ ........ ........ ........ ........ ........ 45%  160M 1s
116736K ........ ........ ........ ........ ........ ........ 47%  192M 1s
119808K ........ ........ ........ ........ ........ ........ 48%  157M 1s
122880K ........ ........ ........ ........ ........ ........ 49%  170M 1s
125952K ........ ........ ........ ........ ........ ........ 50%  151M 1s
129024K ........ ........ ........ ........ ........ ........ 51%  143M 1s
132096K ........ ........ ........ ........ ........ ........ 53%  124M 1s
135168K ........ ........ ........ ........ ........ ........ 54% 91.8M 1s
138240K ........ ........ ........ ........ ........ ........ 55%  150M 1s
141312K ........ ........ ........ ........ ........ ........ 56%  176M 1s
144384K ........ ........ ........ ........ ........ ........ 57%  104M 1s
147456K ........ ........ ........ ........ ........ ........ 59%  155M 1s
150528K ........ ........ ........ ........ ........ ........ 60%  186M 1s
153600K ........ ........ ........ ........ ........ ........ 61%  181M 1s
156672K ........ ........ ........ ........ ........ ........ 62%  140M 1s
159744K ........ ........ ........ ........ ........ ........ 64%  204M 1s
162816K ........ ........ ........ ........ ........ ........ 65%  188M 1s
165888K ........ ........ ........ ........ ........ ........ 66%  175M 1s
168960K ........ ........ ........ ........ ........ ........ 67%  195M 1s
172032K ........ ........ ........ ........ ........ ........ 68%  171M 1s
175104K ........ ........ ........ ........ ........ ........ 70%  190M 1s
178176K ........ ........ ........ ........ ........ ........ 71%  167M 1s
181248K ........ ........ ........ ........ ........ ........ 72%  187M 1s
184320K ........ ........ ........ ........ ........ ........ 73%  202M 1s
187392K ........ ........ ........ ........ ........ ........ 74%  210M 1s
190464K ........ ........ ........ ........ ........ ........ 76%  175M 1s
193536K ........ ........ ........ ........ ........ ........ 77%  197M 0s
196608K ........ ........ ........ ........ ........ ........ 78%  200M 0s
199680K ........ ........ ........ ........ ........ ........ 79%  188M 0s
202752K ........ ........ ........ ........ ........ ........ 80%  202M 0s
205824K ........ ........ ........ ........ ........ ........ 82%  197M 0s
208896K ........ ........ ........ ........ ........ ........ 83%  201M 0s
211968K ........ ........ ........ ........ ........ ........ 84%  230M 0s
215040K ........ ........ ........ ........ ........ ........ 85%  221M 0s
218112K ........ ........ ........ ........ ........ ........ 86%  205M 0s
221184K ........ ........ ........ ........ ........ ........ 88%  218M 0s
224256K ........ ........ ........ ........ ........ ........ 89%  160M 0s
227328K ........ ........ ........ ........ ........ ........ 90%  163M 0s
230400K ........ ........ ........ ........ ........ ........ 91%  128M 0s
233472K ........ ........ ........ ........ ........ ........ 93%  236M 0s
236544K ........ ........ ........ ........ ........ ........ 94%  219M 0s
239616K ........ ........ ........ ........ ........ ........ 95%  262M 0s
242688K ........ ........ ........ ........ ........ ........ 96%  281M 0s
245760K ........ ........ ........ ........ ........ ........ 97%  189M 0s
248832K ........ ........ ........ ........ ........ ........ 99%  258M 0s
251904K ........ ........ ........ ........ .....            100%  275M=1.9s

2024-04-06 23:09:24 (130 MB/s) - ‘karaf-0.18.4-20240406.194621-101.zip’ saved [260399296/260399296]

Extracting the new controller...
+ echo 'Extracting the new controller...'
+ unzip -q karaf-0.18.4-20240406.194621-101.zip
Adding external repositories...
+ echo 'Adding external repositories...'
+ sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
+ cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
################################################################################
#
#    Licensed to the Apache Software Foundation (ASF) under one or more
#    contributor license agreements.  See the NOTICE file distributed with
#    this work for additional information regarding copyright ownership.
#    The ASF licenses this file to You under the Apache License, Version 2.0
#    (the "License"); you may not use this file except in compliance with
#    the License.  You may obtain a copy of the License at
#
#       http://www.apache.org/licenses/LICENSE-2.0
#
#    Unless required by applicable law or agreed to in writing, software
#    distributed under the License is distributed on an "AS IS" BASIS,
#    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
#    See the License for the specific language governing permissions and
#    limitations under the License.
#
################################################################################

#
# If set to true, the following property will not allow any certificate to be used
# when accessing Maven repositories through SSL
#
#org.ops4j.pax.url.mvn.certificateCheck=

#
# Path to the local Maven settings file.
# The repositories defined in this file will be automatically added to the list
# of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property
# below is not set.
# The following locations are checked for the existence of the settings.xml file
#   * 1. looks for the specified url
#   * 2. if not found looks for ${user.home}/.m2/settings.xml
#   * 3. if not found looks for ${maven.home}/conf/settings.xml
#   * 4. if not found looks for ${M2_HOME}/conf/settings.xml
#
#org.ops4j.pax.url.mvn.settings=

#
# Path to the local Maven repository which is used to avoid downloading
# artifacts when they already exist locally.
# The value of this property will be extracted from the settings.xml file
# above, or defaulted to:
#     System.getProperty( "user.home" ) + "/.m2/repository"
#
org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository}

#
# Default this to false. It's just weird to use undocumented repos
#
org.ops4j.pax.url.mvn.useFallbackRepositories=false

#
# Uncomment if you don't wanna use the proxy settings
# from the Maven conf/settings.xml file
#
# org.ops4j.pax.url.mvn.proxySupport=false

#
# Comma separated list of repositories scanned when resolving an artifact.
# Those repositories will be checked before iterating through the
#    below list of repositories and even before the local repository
# A repository url can be appended with zero or more of the following flags:
#    @snapshots  : the repository contains snaphots
#    @noreleases : the repository does not contain any released artifacts
#
# The following property value will add the system folder as a repo.
#
org.ops4j.pax.url.mvn.defaultRepositories=\
    file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\
    file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\
    file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots

# Use the default local repo (e.g.~/.m2/repository) as a "remote" repo
#org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false

#
# Comma separated list of repositories scanned when resolving an artifact.
# The default list includes the following repositories:
#    http://repo1.maven.org/maven2@id=central
#    http://repository.springsource.com/maven/bundles/release@id=spring.ebr
#    http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external
#    http://zodiac.springsource.com/maven/bundles/release@id=gemini
#    http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases
#    https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases
#    https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
# To add repositories to the default ones, prepend '+' to the list of repositories
# to add.
# A repository url can be appended with zero or more of the following flags:
#    @snapshots  : the repository contains snapshots
#    @noreleases : the repository does not contain any released artifacts
#    @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended
#
org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases

### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.Configuring the startup features...
+ [[ True == \T\r\u\e ]]
+ echo 'Configuring the startup features...'
+ sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
+ FEATURE_TEST_STRING=features-test
+ FEATURE_TEST_VERSION=0.18.4-SNAPSHOT
+ KARAF_VERSION=karaf4
+ [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]]
+ sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.18.4-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
+ [[ ! -z '' ]]
+ cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
################################################################################
#
#    Licensed to the Apache Software Foundation (ASF) under one or more
#    contributor license agreements.  See the NOTICE file distributed with
#    this work for additional information regarding copyright ownership.
#    The ASF licenses this file to You under the Apache License, Version 2.0
#    (the "License"); you may not use this file except in compliance with
#    the License.  You may obtain a copy of the License at
#
#       http://www.apache.org/licenses/LICENSE-2.0
#
#    Unless required by applicable law or agreed to in writing, software
#    distributed under the License is distributed on an "AS IS" BASIS,
#    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
#    See the License for the specific language governing permissions and
#    limitations under the License.
#
################################################################################

#
# Comma separated list of features repositories to register by default
#
featuresRepositories = mvn:org.opendaylight.integration/features-test/0.18.4-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/8a04ff1b-ac3d-412c-bd6f-10a42387a5d8.xml

#
# Comma separated list of features to install at startup
#
featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, 57c24381-3139-498b-8c1d-3df89d3e4465

#
# Resource repositories (OBR) that the features resolver can use
# to resolve requirements/capabilities
#
# The format of the resourceRepositories is 
# resourceRepositories=[xml:url|json:url],...
# for Instance:
#
#resourceRepositories=xml:http://host/path/to/index.xml
# or
#resourceRepositories=json:http://host/path/to/index.json
#

#
# Defines if the boot features are started in asynchronous mode (in a dedicated thread)
#
featuresBootAsynchronous=false

#
# Service requirements enforcement
#
# By default, the feature resolver checks the service requirements/capabilities of
# bundles for new features (xml schema >= 1.3.0) in order to automatically installs
# the required bundles.
# The following flag can have those values:
#   - disable: service requirements are completely ignored
#   - default: service requirements are ignored for old features
#   - enforce: service requirements are always verified
#
#serviceRequirements=default

#
# Store cfg file for config element in feature
#
#configCfgStore=true

#
# Define if the feature service automatically refresh bundles
#
autoRefresh=true

#
# Configuration of features processing mechanism (overrides, blacklisting, modification of features)
# XML file defines instructions related to features processing
# versions.properties may declare properties to resolve placeholders in XML file
# both files are relative to ${karaf.etc}
#
#featureProcessing=org.apache.karaf.features.xml
#featureProcessingVersions=versions.properties
+ configure_karaf_log karaf4 ''
+ local -r karaf_version=karaf4
+ local -r controllerdebugmap=
+ local logapi=log4j
+ grep log4j2 /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
log4j2.rootLogger.level = INFO
#log4j2.rootLogger.type = asyncRoot
#log4j2.rootLogger.includeLocation = false
log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
log4j2.rootLogger.appenderRef.Console.ref = Console
log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
log4j2.logger.spifly.name = org.apache.aries.spifly
log4j2.logger.spifly.level = WARN
log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
log4j2.logger.audit.level = INFO
log4j2.logger.audit.additivity = false
log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
# Console appender not used by default (see log4j2.rootLogger.appenderRefs)
log4j2.appender.console.type = Console
log4j2.appender.console.name = Console
log4j2.appender.console.layout.type = PatternLayout
log4j2.appender.console.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.type = RollingRandomAccessFile
log4j2.appender.rolling.name = RollingFile
log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
#log4j2.appender.rolling.immediateFlush = false
log4j2.appender.rolling.append = true
log4j2.appender.rolling.layout.type = PatternLayout
log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.policies.type = Policies
log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.rolling.policies.size.size = 64MB
log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
log4j2.appender.rolling.strategy.max = 7
log4j2.appender.audit.type = RollingRandomAccessFile
log4j2.appender.audit.name = AuditRollingFile
log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
log4j2.appender.audit.append = true
log4j2.appender.audit.layout.type = PatternLayout
log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
log4j2.appender.audit.policies.type = Policies
log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.audit.policies.size.size = 8MB
log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
log4j2.appender.audit.strategy.max = 7
log4j2.appender.osgi.type = PaxOsgi
log4j2.appender.osgi.name = PaxOsgi
log4j2.appender.osgi.filter = *
#log4j2.logger.aether.name = shaded.org.eclipse.aether
#log4j2.logger.aether.level = TRACE
#log4j2.logger.http-headers.name = shaded.org.apache.http.headers
#log4j2.logger.http-headers.level = DEBUG
#log4j2.logger.maven.name = org.ops4j.pax.url.mvn
#log4j2.logger.maven.level = TRACE
Configuring the karaf log... karaf_version: karaf4, logapi: log4j2
+ logapi=log4j2
+ echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2'
+ '[' log4j2 == log4j2 ']'
+ sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
+ orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver
+ orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver
controllerdebugmap: 
+ echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN'
+ echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN'
+ unset IFS
+ echo 'controllerdebugmap: '
cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
+ '[' -n '' ']'
+ echo 'cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg'
+ cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
################################################################################
#
#    Licensed to the Apache Software Foundation (ASF) under one or more
#    contributor license agreements.  See the NOTICE file distributed with
#    this work for additional information regarding copyright ownership.
#    The ASF licenses this file to You under the Apache License, Version 2.0
#    (the "License"); you may not use this file except in compliance with
#    the License.  You may obtain a copy of the License at
#
#       http://www.apache.org/licenses/LICENSE-2.0
#
#    Unless required by applicable law or agreed to in writing, software
#    distributed under the License is distributed on an "AS IS" BASIS,
#    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
#    See the License for the specific language governing permissions and
#    limitations under the License.
#
################################################################################

# Common pattern layout for appenders
log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n

# Root logger
log4j2.rootLogger.level = INFO
# uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library
#log4j2.rootLogger.type = asyncRoot
#log4j2.rootLogger.includeLocation = false
log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
log4j2.rootLogger.appenderRef.Console.ref = Console
log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}

# Filters for logs marked by org.opendaylight.odlparent.Markers
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL

# Loggers configuration

# Spifly logger
log4j2.logger.spifly.name = org.apache.aries.spifly
log4j2.logger.spifly.level = WARN

# Security audit logger
log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
log4j2.logger.audit.level = INFO
log4j2.logger.audit.additivity = false
log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile

# Appenders configuration

# Console appender not used by default (see log4j2.rootLogger.appenderRefs)
log4j2.appender.console.type = Console
log4j2.appender.console.name = Console
log4j2.appender.console.layout.type = PatternLayout
log4j2.appender.console.layout.pattern = ${log4j2.pattern}

# Rolling file appender
log4j2.appender.rolling.type = RollingRandomAccessFile
log4j2.appender.rolling.name = RollingFile
log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
# uncomment to not force a disk flush
#log4j2.appender.rolling.immediateFlush = false
log4j2.appender.rolling.append = true
log4j2.appender.rolling.layout.type = PatternLayout
log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.policies.type = Policies
log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.rolling.policies.size.size = 1GB
log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
log4j2.appender.rolling.strategy.max = 7

# Audit file appender
log4j2.appender.audit.type = RollingRandomAccessFile
log4j2.appender.audit.name = AuditRollingFile
log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
log4j2.appender.audit.append = true
log4j2.appender.audit.layout.type = PatternLayout
log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
log4j2.appender.audit.policies.type = Policies
log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.audit.policies.size.size = 8MB
log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
log4j2.appender.audit.strategy.max = 7

# OSGi appender
log4j2.appender.osgi.type = PaxOsgi
log4j2.appender.osgi.name = PaxOsgi
log4j2.appender.osgi.filter = *

# help with identification of maven-related problems with pax-url-aether
#log4j2.logger.aether.name = shaded.org.eclipse.aether
#log4j2.logger.aether.level = TRACE
#log4j2.logger.http-headers.name = shaded.org.apache.http.headers
#log4j2.logger.http-headers.level = DEBUG
#log4j2.logger.maven.name = org.ops4j.pax.url.mvn
#log4j2.logger.maven.level = TRACE
log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN
log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN
+ set_java_vars /usr/lib/jvm/java-17-openjdk 3072m /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv
+ local -r java_home=/usr/lib/jvm/java-17-openjdk
+ local -r controllermem=3072m
Configure
    java home: /usr/lib/jvm/java-17-openjdk
+ local -r memconf=/tmp/karaf-0.18.4-SNAPSHOT/bin/setenv
+ echo Configure
+ echo '    java home: /usr/lib/jvm/java-17-openjdk'
    max memory: 3072m
    memconf: /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv
+ echo '    max memory: 3072m'
+ echo '    memconf: /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv'
+ sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk}%g' /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv
+ sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv
cat /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv
+ echo 'cat /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv'
+ cat /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv
#!/bin/sh
#
#    Licensed to the Apache Software Foundation (ASF) under one or more
#    contributor license agreements.  See the NOTICE file distributed with
#    this work for additional information regarding copyright ownership.
#    The ASF licenses this file to You under the Apache License, Version 2.0
#    (the "License"); you may not use this file except in compliance with
#    the License.  You may obtain a copy of the License at
#
#       http://www.apache.org/licenses/LICENSE-2.0
#
#    Unless required by applicable law or agreed to in writing, software
#    distributed under the License is distributed on an "AS IS" BASIS,
#    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
#    See the License for the specific language governing permissions and
#    limitations under the License.
#

#
# handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf
# script: client, instance, shell, start, status, stop, karaf
#
# if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then
#   Actions go here...
# fi

#
# general settings which should be applied for all scripts go here; please keep
# in mind that it is possible that scripts might be executed more than once, e.g.
# in example of the start script where the start script is executed first and the
# karaf script afterwards.
#

#
# The following section shows the possible configuration options for the default 
# karaf scripts
#
export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk} # Location of Java installation
# export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration
# export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options
# export EXTRA_JAVA_OPTS # Additional JVM options
# export KARAF_HOME # Karaf home folder
# export KARAF_DATA # Karaf data folder
# export KARAF_BASE # Karaf base folder
# export KARAF_ETC  # Karaf etc  folder
# export KARAF_LOG  # Karaf log  folder
# export KARAF_SYSTEM_OPTS # First citizen Karaf options
# export KARAF_OPTS # Additional available Karaf options
# export KARAF_DEBUG # Enable debug mode
# export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start
# export KARAF_NOROOT # Prevent execution as root if set to true
Set Java version
+ echo 'Set Java version'
+ sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-17-openjdk/bin/java 1
+ sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-17-openjdk/bin/java
JDK default version ...
+ echo 'JDK default version ...'
+ java -version
openjdk version "17.0.6-ea" 2023-01-17 LTS
OpenJDK Runtime Environment (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS)
OpenJDK 64-Bit Server VM (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS, mixed mode, sharing)
Set JAVA_HOME
+ echo 'Set JAVA_HOME'
+ export JAVA_HOME=/usr/lib/jvm/java-17-openjdk
+ JAVA_HOME=/usr/lib/jvm/java-17-openjdk
++ readlink -e /usr/lib/jvm/java-17-openjdk/bin/java
Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java
+ JAVA_RESOLVED=/usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java
+ echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java'
Listing all open ports on controller system...
+ echo 'Listing all open ports on controller system...'
+ netstat -pnatu
(Not all processes could be identified, non-owned process info
 will not be shown, you would have to be root to see it all.)
Active Internet connections (servers and established)
Proto Recv-Q Send-Q Local Address           Foreign Address         State       PID/Program name    
tcp        0      0 0.0.0.0:111             0.0.0.0:*               LISTEN      -                   
tcp        0      0 0.0.0.0:22              0.0.0.0:*               LISTEN      -                   
tcp        0      0 10.30.171.190:51214     199.204.45.87:443       TIME_WAIT   -                   
tcp        0    364 10.30.171.190:22        10.30.170.206:38554     ESTABLISHED -                   
tcp6       0      0 :::111                  :::*                    LISTEN      -                   
tcp6       0      0 :::5555                 :::*                    LISTEN      -                   
tcp6       0      0 :::22                   :::*                    LISTEN      -                   
udp        0      0 10.30.171.190:68        10.30.170.3:67          ESTABLISHED -                   
udp        0      0 0.0.0.0:111             0.0.0.0:*                           -                   
udp        0      0 127.0.0.1:323           0.0.0.0:*                           -                   
udp6       0      0 :::111                  :::*                                -                   
udp6       0      0 ::1:323                 :::*                                -                   
+ '[' -f /tmp/custom_shard_config.txt ']'
Custom shard config exists!!!
+ echo 'Custom shard config exists!!!'
+ echo 'Copying the shard config...'
Copying the shard config...
+ cp /tmp/custom_shard_config.txt /tmp/karaf-0.18.4-SNAPSHOT/bin/
Configuring cluster
+ echo 'Configuring cluster'
+ /tmp/karaf-0.18.4-SNAPSHOT/bin/configure_cluster.sh 3 10.30.171.51 10.30.170.19 10.30.171.190
################################################
##             Configure Cluster              ##
################################################
 NOTE: Cluster configuration files not found. Copying from
 /tmp/karaf-0.18.4-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/7.0.11
Configuring unique name in akka.conf
Configuring hostname in akka.conf
Configuring data and rpc seed nodes in akka.conf
modules = [
	
	{
		name = "inventory"
		namespace = "urn:opendaylight:inventory"
		shard-strategy = "module"
	},
	{
		name = "topology"
		namespace = "urn:TBD:params:xml:ns:yang:network-topology"
		shard-strategy = "module"
	},
	{
		name = "toaster"
		namespace = "http://netconfcentral.org/ns/toaster"
		shard-strategy = "module"
	},
	{
		name = "car"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
		shard-strategy = "module"
	},
	{
		name = "people"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
		shard-strategy = "module"
	},
	{
		name = "car-people"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
		shard-strategy = "module"
	}
]
Configuring replication type in module-shards.conf
################################################
##   NOTE: Manually restart controller to     ##
##         apply configuration.               ##
################################################
Dump akka.conf
+ echo 'Dump akka.conf'
+ cat /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/akka.conf

odl-cluster-data {
  akka {
    remote {
      artery {
        enabled = on
        transport = tcp
        canonical.hostname = "10.30.171.190"
        canonical.port = 2550
      }
    }

    cluster {
      # Using artery.
      seed-nodes = ["akka://opendaylight-cluster-data@10.30.171.51:2550",
				"akka://opendaylight-cluster-data@10.30.170.19:2550",
				"akka://opendaylight-cluster-data@10.30.171.190:2550"]

      roles = ["member-3"]

      # when under load we might trip a false positive on the failure detector
      # failure-detector {
        # heartbeat-interval = 4 s
        # acceptable-heartbeat-pause = 16s
      # }
    }

    persistence {
      # By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by
      # modifying the following two properties. The directory location specified may be a relative or absolute path. 
      # The relative path is always relative to KARAF_HOME.

      # snapshot-store.local.dir = "target/snapshots"

      # Use lz4 compression for LocalSnapshotStore snapshots
      snapshot-store.local.use-lz4-compression = false
      # Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB
      snapshot-store.local.lz4-blocksize = 256KB
    }
    disable-default-actor-system-quarantined-event-handling = "false"
  }
}
+ echo 'Dump modules.conf'
Dump modules.conf
+ cat /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/modules.conf
modules = [
	
	{
		name = "inventory"
		namespace = "urn:opendaylight:inventory"
		shard-strategy = "module"
	},
	{
		name = "topology"
		namespace = "urn:TBD:params:xml:ns:yang:network-topology"
		shard-strategy = "module"
	},
	{
		name = "toaster"
		namespace = "http://netconfcentral.org/ns/toaster"
		shard-strategy = "module"
	},
	{
		name = "car"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
		shard-strategy = "module"
	},
	{
		name = "people"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
		shard-strategy = "module"
	},
	{
		name = "car-people"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
		shard-strategy = "module"
	}
]
+ echo 'Dump module-shards.conf'
Dump module-shards.conf
+ cat /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/module-shards.conf
module-shards = [
	{
		name = "default"
		shards = [
			{
				name = "default"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "inventory"
		shards = [
			{
				name="inventory"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "topology"
		shards = [
			{
				name="topology"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "toaster"
		shards = [
			{
				name="toaster"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "car"
		shards = [
			{
				name="car"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "people"
		shards = [
			{
				name="people"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "car-people"
		shards = [
			{
				name="car-people"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	}
]
Locating config plan to use...
Finished running config plans
Starting member-1 with IP address 10.30.171.51
Warning: Permanently added '10.30.171.51' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.171.51' (ECDSA) to the list of known hosts.
Redirecting karaf console output to karaf_console.log
Starting controller...
start: Redirecting Karaf output to /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf_console.log
Starting member-2 with IP address 10.30.170.19
Warning: Permanently added '10.30.170.19' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.170.19' (ECDSA) to the list of known hosts.
Redirecting karaf console output to karaf_console.log
Starting controller...
start: Redirecting Karaf output to /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf_console.log
Starting member-3 with IP address 10.30.171.190
Warning: Permanently added '10.30.171.190' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.171.190' (ECDSA) to the list of known hosts.
Redirecting karaf console output to karaf_console.log
Starting controller...
start: Redirecting Karaf output to /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf_console.log
[controller-csit-3node-clustering-tell-all-argon] $ /bin/bash /tmp/jenkins15448767944223881398.sh
common-functions.sh is being sourced
common-functions environment:
MAVENCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
ACTUALFEATURES: 
FEATURESCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
CUSTOMPROP: /tmp/karaf-0.18.4-SNAPSHOT/etc/custom.properties
LOGCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
MEMCONF: /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv
CONTROLLERMEM: 2048m
AKKACONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/akka.conf
MODULESCONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/modules.conf
MODULESHARDSCONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/module-shards.conf
SUITES: 

+ echo '#################################################'
#################################################
+ echo '##         Verify Cluster is UP                ##'
##         Verify Cluster is UP                ##
+ echo '#################################################'
#################################################
+ create_post_startup_script
+ cat
+ copy_and_run_post_startup_script
+ seed_index=1
++ seq 1 3
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_1_IP
+ echo 'Execute the post startup script on controller 10.30.171.51'
Execute the post startup script on controller 10.30.171.51
+ scp /w/workspace/controller-csit-3node-clustering-tell-all-argon/post-startup-script.sh 10.30.171.51:/tmp/
Warning: Permanently added '10.30.171.51' (ECDSA) to the list of known hosts.
+ ssh 10.30.171.51 'bash /tmp/post-startup-script.sh 1'
Warning: Permanently added '10.30.171.51' (ECDSA) to the list of known hosts.
tcp6       0      0 :::8101                 :::*                    LISTEN     
Waiting up to 3 minutes for controller to come up, checking every 5 seconds...
2024-04-06T23:10:21,796 | INFO  | SystemReadyService-0 | SimpleSystemReadyMonitor         | 301 - org.opendaylight.infrautils.ready-api - 5.0.9 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
Controller is UP
2024-04-06T23:10:21,796 | INFO  | SystemReadyService-0 | SimpleSystemReadyMonitor         | 301 - org.opendaylight.infrautils.ready-api - 5.0.9 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
Listing all open ports on controller system...
(Not all processes could be identified, non-owned process info
 will not be shown, you would have to be root to see it all.)
Active Internet connections (servers and established)
Proto Recv-Q Send-Q Local Address           Foreign Address         State       PID/Program name    
tcp        0      0 0.0.0.0:22              0.0.0.0:*               LISTEN      -                   
tcp        0      0 0.0.0.0:111             0.0.0.0:*               LISTEN      -                   
tcp        0      0 10.30.171.51:22         10.30.170.206:41552     ESTABLISHED -                   
tcp6       0      0 :::8181                 :::*                    LISTEN      5776/java           
tcp6       0      0 10.30.171.51:2550       :::*                    LISTEN      5776/java           
tcp6       0      0 :::22                   :::*                    LISTEN      -                   
tcp6       0      0 :::12345                :::*                    LISTEN      5776/java           
tcp6       0      0 127.0.0.1:44444         :::*                    LISTEN      5776/java           
tcp6       0      0 :::6653                 :::*                    LISTEN      5776/java           
tcp6       0      0 :::4189                 :::*                    LISTEN      5776/java           
tcp6       0      0 :::1790                 :::*                    LISTEN      5776/java           
tcp6       0      0 :::8101                 :::*                    LISTEN      5776/java           
tcp6       0      0 :::6633                 :::*                    LISTEN      5776/java           
tcp6       0      0 127.0.0.1:1099          :::*                    LISTEN      5776/java           
tcp6       0      0 :::111                  :::*                    LISTEN      -                   
tcp6       0      0 :::6640                 :::*                    LISTEN      5776/java           
tcp6       0      0 127.0.0.1:33617         :::*                    LISTEN      5776/java           
tcp6       0      0 :::5555                 :::*                    LISTEN      -                   
tcp6       0      0 10.30.171.51:2550       10.30.171.190:33828     ESTABLISHED 5776/java           
tcp6       0      0 10.30.171.51:52962      10.30.171.190:2550      ESTABLISHED 5776/java           
tcp6       0      0 10.30.171.51:52978      10.30.171.190:2550      ESTABLISHED 5776/java           
tcp6       0      0 10.30.171.51:2550       10.30.170.19:59000      ESTABLISHED 5776/java           
tcp6       0      0 127.0.0.1:46922         127.0.0.1:44444         TIME_WAIT   -                   
tcp6       0      0 127.0.0.1:51080         127.0.0.1:1099          TIME_WAIT   -                   
tcp6      32      0 10.30.171.51:39790      199.204.45.87:443       CLOSE_WAIT  5776/java           
tcp6       0      0 10.30.171.51:43458      10.30.170.19:2550       ESTABLISHED 5776/java           
tcp6       0      0 10.30.171.51:2550       10.30.171.190:33826     ESTABLISHED 5776/java           
tcp6       0      0 127.0.0.1:46932         127.0.0.1:44444         TIME_WAIT   -                   
tcp6       0      0 10.30.171.51:43460      10.30.170.19:2550       ESTABLISHED 5776/java           
tcp6       0      0 127.0.0.1:51064         127.0.0.1:1099          TIME_WAIT   -                   
tcp6       0      0 10.30.171.51:2550       10.30.170.19:58988      ESTABLISHED 5776/java           
udp        0      0 10.30.171.51:68         10.30.170.2:67          ESTABLISHED -                   
udp        0      0 0.0.0.0:111             0.0.0.0:*                           -                   
udp        0      0 127.0.0.1:323           0.0.0.0:*                           -                   
udp6       0      0 :::4342                 :::*                                5776/java           
udp6       0      0 :::111                  :::*                                -                   
udp6       0      0 ::1:323                 :::*                                -                   
looking for "BindException: Address already in use" in log file
looking for "server is unhealthy" in log file
+ '[' 1 == 0 ']'
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_2_IP
+ echo 'Execute the post startup script on controller 10.30.170.19'
Execute the post startup script on controller 10.30.170.19
+ scp /w/workspace/controller-csit-3node-clustering-tell-all-argon/post-startup-script.sh 10.30.170.19:/tmp/
Warning: Permanently added '10.30.170.19' (ECDSA) to the list of known hosts.
+ ssh 10.30.170.19 'bash /tmp/post-startup-script.sh 2'
Warning: Permanently added '10.30.170.19' (ECDSA) to the list of known hosts.
tcp6       0      0 :::8101                 :::*                    LISTEN     
Waiting up to 3 minutes for controller to come up, checking every 5 seconds...
2024-04-06T23:10:20,281 | INFO  | SystemReadyService-0 | SimpleSystemReadyMonitor         | 301 - org.opendaylight.infrautils.ready-api - 5.0.9 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
Controller is UP
2024-04-06T23:10:20,281 | INFO  | SystemReadyService-0 | SimpleSystemReadyMonitor         | 301 - org.opendaylight.infrautils.ready-api - 5.0.9 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
Listing all open ports on controller system...
(Not all processes could be identified, non-owned process info
 will not be shown, you would have to be root to see it all.)
Active Internet connections (servers and established)
Proto Recv-Q Send-Q Local Address           Foreign Address         State       PID/Program name    
tcp        0      0 0.0.0.0:22              0.0.0.0:*               LISTEN      -                   
tcp        0      0 0.0.0.0:111             0.0.0.0:*               LISTEN      -                   
tcp        0    164 10.30.170.19:22         10.30.170.206:54784     ESTABLISHED -                   
tcp6       0      0 :::5555                 :::*                    LISTEN      -                   
tcp6       0      0 :::8181                 :::*                    LISTEN      5753/java           
tcp6       0      0 10.30.170.19:2550       :::*                    LISTEN      5753/java           
tcp6       0      0 :::22                   :::*                    LISTEN      -                   
tcp6       0      0 127.0.0.1:44444         :::*                    LISTEN      5753/java           
tcp6       0      0 :::6653                 :::*                    LISTEN      5753/java           
tcp6       0      0 127.0.0.1:39261         :::*                    LISTEN      5753/java           
tcp6       0      0 :::1790                 :::*                    LISTEN      5753/java           
tcp6       0      0 :::8101                 :::*                    LISTEN      5753/java           
tcp6       0      0 :::6633                 :::*                    LISTEN      5753/java           
tcp6       0      0 127.0.0.1:1099          :::*                    LISTEN      5753/java           
tcp6       0      0 :::111                  :::*                    LISTEN      -                   
tcp6       0      0 :::6640                 :::*                    LISTEN      5753/java           
tcp6       0      0 127.0.0.1:38712         127.0.0.1:1099          TIME_WAIT   -                   
tcp6       0      0 10.30.170.19:2550       10.30.171.51:43458      ESTABLISHED 5753/java           
tcp6       0      0 10.30.170.19:58988      10.30.171.51:2550       ESTABLISHED 5753/java           
tcp6       0      0 10.30.170.19:2550       10.30.171.51:43460      ESTABLISHED 5753/java           
tcp6       0      0 127.0.0.1:38698         127.0.0.1:1099          TIME_WAIT   -                   
tcp6       0      0 10.30.170.19:2550       10.30.171.190:60092     ESTABLISHED 5753/java           
tcp6       0      0 127.0.0.1:45910         127.0.0.1:44444         TIME_WAIT   -                   
tcp6       0      0 10.30.170.19:59000      10.30.171.51:2550       ESTABLISHED 5753/java           
tcp6       0      0 10.30.170.19:49208      10.30.171.190:2550      ESTABLISHED 5753/java           
tcp6       0      0 10.30.170.19:49202      10.30.171.190:2550      ESTABLISHED 5753/java           
tcp6       0      0 127.0.0.1:45920         127.0.0.1:44444         TIME_WAIT   -                   
tcp6      32      0 10.30.170.19:60582      199.204.45.87:443       CLOSE_WAIT  5753/java           
tcp6       0      0 10.30.170.19:2550       10.30.171.190:60080     ESTABLISHED 5753/java           
udp        0      0 10.30.170.19:68         10.30.170.2:67          ESTABLISHED -                   
udp        0      0 0.0.0.0:111             0.0.0.0:*                           -                   
udp        0      0 127.0.0.1:323           0.0.0.0:*                           -                   
udp6       0      0 :::111                  :::*                                -                   
udp6       0      0 ::1:323                 :::*                                -                   
udp6       0      0 :::4342                 :::*                                5753/java           
looking for "BindException: Address already in use" in log file
looking for "server is unhealthy" in log file
+ '[' 2 == 0 ']'
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_3_IP
+ echo 'Execute the post startup script on controller 10.30.171.190'
Execute the post startup script on controller 10.30.171.190
+ scp /w/workspace/controller-csit-3node-clustering-tell-all-argon/post-startup-script.sh 10.30.171.190:/tmp/
Warning: Permanently added '10.30.171.190' (ECDSA) to the list of known hosts.
+ ssh 10.30.171.190 'bash /tmp/post-startup-script.sh 3'
Warning: Permanently added '10.30.171.190' (ECDSA) to the list of known hosts.
tcp6       0      0 :::8101                 :::*                    LISTEN     
Waiting up to 3 minutes for controller to come up, checking every 5 seconds...
2024-04-06T23:10:21,164 | INFO  | SystemReadyService-0 | SimpleSystemReadyMonitor         | 301 - org.opendaylight.infrautils.ready-api - 5.0.9 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
Controller is UP
2024-04-06T23:10:21,164 | INFO  | SystemReadyService-0 | SimpleSystemReadyMonitor         | 301 - org.opendaylight.infrautils.ready-api - 5.0.9 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
Listing all open ports on controller system...
(Not all processes could be identified, non-owned process info
 will not be shown, you would have to be root to see it all.)
Active Internet connections (servers and established)
Proto Recv-Q Send-Q Local Address           Foreign Address         State       PID/Program name    
tcp        0      0 0.0.0.0:111             0.0.0.0:*               LISTEN      -                   
tcp        0      0 0.0.0.0:22              0.0.0.0:*               LISTEN      -                   
tcp        0      0 10.30.171.190:22        10.30.170.206:39726     ESTABLISHED -                   
tcp6       0      0 :::6653                 :::*                    LISTEN      5765/java           
tcp6       0      0 :::1790                 :::*                    LISTEN      5765/java           
tcp6       0      0 :::8101                 :::*                    LISTEN      5765/java           
tcp6       0      0 :::6633                 :::*                    LISTEN      5765/java           
tcp6       0      0 127.0.0.1:1099          :::*                    LISTEN      5765/java           
tcp6       0      0 :::111                  :::*                    LISTEN      -                   
tcp6       0      0 :::6640                 :::*                    LISTEN      5765/java           
tcp6       0      0 :::5555                 :::*                    LISTEN      -                   
tcp6       0      0 :::8181                 :::*                    LISTEN      5765/java           
tcp6       0      0 10.30.171.190:2550      :::*                    LISTEN      5765/java           
tcp6       0      0 :::22                   :::*                    LISTEN      -                   
tcp6       0      0 127.0.0.1:43287         :::*                    LISTEN      5765/java           
tcp6       0      0 127.0.0.1:44444         :::*                    LISTEN      5765/java           
tcp6       0      0 127.0.0.1:53474         127.0.0.1:44444         TIME_WAIT   -                   
tcp6       0      0 10.30.171.190:2550      10.30.170.19:49202      ESTABLISHED 5765/java           
tcp6       0      0 10.30.171.190:2550      10.30.170.19:49208      ESTABLISHED 5765/java           
tcp6       0      0 10.30.171.190:33828     10.30.171.51:2550       ESTABLISHED 5765/java           
tcp6       0      0 127.0.0.1:34040         127.0.0.1:1099          TIME_WAIT   -                   
tcp6       0      0 127.0.0.1:53464         127.0.0.1:44444         TIME_WAIT   -                   
tcp6       0      0 10.30.171.190:60080     10.30.170.19:2550       ESTABLISHED 5765/java           
tcp6       0      0 10.30.171.190:60092     10.30.170.19:2550       ESTABLISHED 5765/java           
tcp6       0      0 10.30.171.190:2550      10.30.171.51:52978      ESTABLISHED 5765/java           
tcp6       0      0 10.30.171.190:2550      10.30.171.51:52962      ESTABLISHED 5765/java           
tcp6       0      0 10.30.171.190:33826     10.30.171.51:2550       ESTABLISHED 5765/java           
tcp6      32      0 10.30.171.190:51650     199.204.45.87:443       CLOSE_WAIT  5765/java           
udp        0      0 10.30.171.190:68        10.30.170.3:67          ESTABLISHED -                   
udp        0      0 0.0.0.0:111             0.0.0.0:*                           -                   
udp        0      0 127.0.0.1:323           0.0.0.0:*                           -                   
udp6       0      0 :::111                  :::*                                -                   
udp6       0      0 ::1:323                 :::*                                -                   
udp6       0      0 :::4342                 :::*                                5765/java           
looking for "BindException: Address already in use" in log file
looking for "server is unhealthy" in log file
+ '[' 0 == 0 ']'
+ seed_index=1
+ dump_controller_threads
++ seq 1 3
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_1_IP
+ echo 'Let'\''s take the karaf thread dump'
Let's take the karaf thread dump
+ ssh 10.30.171.51 'sudo ps aux'
Warning: Permanently added '10.30.171.51' (ECDSA) to the list of known hosts.
++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-argon/ps_before.log
++ grep -v grep
++ cut -f2 '-d '
++ tr -s ' '
+ pid=5776
+ echo 'karaf main: org.apache.karaf.main.Main, pid:5776'
karaf main: org.apache.karaf.main.Main, pid:5776
+ ssh 10.30.171.51 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 5776'
Warning: Permanently added '10.30.171.51' (ECDSA) to the list of known hosts.
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_2_IP
+ echo 'Let'\''s take the karaf thread dump'
Let's take the karaf thread dump
+ ssh 10.30.170.19 'sudo ps aux'
Warning: Permanently added '10.30.170.19' (ECDSA) to the list of known hosts.
++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-argon/ps_before.log
++ grep -v grep
++ tr -s ' '
++ cut -f2 '-d '
+ pid=5753
+ echo 'karaf main: org.apache.karaf.main.Main, pid:5753'
karaf main: org.apache.karaf.main.Main, pid:5753
+ ssh 10.30.170.19 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 5753'
Warning: Permanently added '10.30.170.19' (ECDSA) to the list of known hosts.
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_3_IP
+ echo 'Let'\''s take the karaf thread dump'
Let's take the karaf thread dump
+ ssh 10.30.171.190 'sudo ps aux'
Warning: Permanently added '10.30.171.190' (ECDSA) to the list of known hosts.
++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-argon/ps_before.log
++ grep -v grep
++ tr -s ' '
++ cut -f2 '-d '
+ pid=5765
+ echo 'karaf main: org.apache.karaf.main.Main, pid:5765'
karaf main: org.apache.karaf.main.Main, pid:5765
+ ssh 10.30.171.190 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 5765'
Warning: Permanently added '10.30.171.190' (ECDSA) to the list of known hosts.
+ '[' 0 -gt 0 ']'
+ echo 'Generating controller variables...'
Generating controller variables...
++ seq 1 3
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_1_IP
+ odl_variables=' -v ODL_SYSTEM_1_IP:10.30.171.51'
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_2_IP
+ odl_variables=' -v ODL_SYSTEM_1_IP:10.30.171.51 -v ODL_SYSTEM_2_IP:10.30.170.19'
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_3_IP
+ odl_variables=' -v ODL_SYSTEM_1_IP:10.30.171.51 -v ODL_SYSTEM_2_IP:10.30.170.19 -v ODL_SYSTEM_3_IP:10.30.171.190'
+ echo 'Generating mininet variables...'
Generating mininet variables...
++ seq 1 0
+ get_test_suites SUITES
+ local __suite_list=SUITES
+ echo 'Locating test plan to use...'
Locating test plan to use...
+ testplan_filepath=/w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/testplans/controller-clustering-tell-argon.txt
+ '[' '!' -f /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/testplans/controller-clustering-tell-argon.txt ']'
+ testplan_filepath=/w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/testplans/controller-clustering-tell.txt
+ '[' disabled '!=' disabled ']'
+ echo 'Changing the testplan path...'
Changing the testplan path...
+ sed s:integration:/w/workspace/controller-csit-3node-clustering-tell-all-argon: /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/testplans/controller-clustering-tell.txt
+ cat testplan.txt
# Place the suites in run order:

# disabling all "prefix based" suites. This functionality was newly
# introduced with these tests in 2017. The assumption is that
# development stopped in that area, but may continue at a later
# time. Still, the tests are failing and no resources to solve the
# failures at this time. If/When this changes, we can uncomment
# those suites. Note that every suite is commented out with it's
# accompanying "restart_with_tell_based_true" setup suite.


# /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/ddb-sanity-prefix-based.robot
/w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
/w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot
/w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
/w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown_prefbasedshard.robot
/w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
/w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/explicit_leader_movement_prefbasedshard.robot
/w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
/w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/leader_isolation.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/leader_isolation_prefbasedshard.robot
/w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
/w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/client_isolation.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/client_isolation_prefbasedshard.robot
/w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
/w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/listener_stability.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/listener_stability_prefbasedshard.robot
/w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
/w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/cluster_singleton/master_stability.robot
/w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
/w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot
/w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
/w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot
/w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
/w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot
/w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot
/w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot
/w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot
/w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot
/w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot
/w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot
/w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot
+ '[' -z '' ']'
++ grep -E -v '(^[[:space:]]*#|^[[:space:]]*$)' testplan.txt
++ tr '\012' ' '
+ suite_list='/w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot '
+ eval 'SUITES='\''/w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot '\'''
++ SUITES='/w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot '
+ echo 'Starting Robot test suites /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot  ...'
Starting Robot test suites /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot  ...
+ robot -N controller-clustering-tell.txt --removekeywords wuks -e exclude -e skip_if_argon -v BUNDLEFOLDER:karaf-0.18.4-SNAPSHOT -v BUNDLE_URL:https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/karaf-0.18.4-20240406.194621-101.zip -v CONTROLLER:10.30.171.51 -v CONTROLLER1:10.30.170.19 -v CONTROLLER2:10.30.171.190 -v CONTROLLER_USER:jenkins -v JAVA_HOME:/usr/lib/jvm/java-17-openjdk -v JDKVERSION:openjdk17 -v JENKINS_WORKSPACE:/w/workspace/controller-csit-3node-clustering-tell-all-argon -v MININET: -v MININET1: -v MININET2: -v MININET_USER:jenkins -v NEXUSURL_PREFIX:https://nexus.opendaylight.org -v NUM_ODL_SYSTEM:3 -v NUM_TOOLS_SYSTEM:0 -v ODL_STREAM:argon -v ODL_SYSTEM_IP:10.30.171.51 -v ODL_SYSTEM_1_IP:10.30.171.51 -v ODL_SYSTEM_2_IP:10.30.170.19 -v ODL_SYSTEM_3_IP:10.30.171.190 -v ODL_SYSTEM_USER:jenkins -v TOOLS_SYSTEM_IP: -v TOOLS_SYSTEM_USER:jenkins -v USER_HOME:/home/jenkins -v IS_KARAF_APPL:True -v WORKSPACE:/tmp /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot
==============================================================================
controller-clustering-tell.txt                                                
==============================================================================
controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
==============================================================================
Stop_All_Members :: Stop every odl node.                              | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.190', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-tell.txt.Ddb-Sanity-Module-Based :: DOMDataBroker tes...
==============================================================================
Get_Shard_Role :: Get shard role.                                     | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_ddb_sanity_module_based_get_shard_role"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_get_shard_role&order=bug_status"

HTTPError: 404 Client Error: Not Found for url: http://10.30.171.51:8181/restconf/operations/cluster-admin:get-shard-role
------------------------------------------------------------------------------
Subscribe_Listener_To_Leader :: Subscribe listener to leader.         | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_ddb_sanity_module_based_subscribe_listener_to_leader"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_subscribe_listener_to_leader&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.171.190', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Subscribe_Listener_To_Follower :: Subscribe listener to follower.     | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_ddb_sanity_module_based_subscribe_listener_to_follower"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_subscribe_listener_to_follower&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.171.190', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Make_Leader_Local :: Make the loeader local and verify.               | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_ddb_sanity_module_based_make_leader_local"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_make_leader_local&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.171.190', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Remove_Leader_Shard_Replica_And_Add_It_Back :: Remove and add shar... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_ddb_sanity_module_based_remove_leader_shard_replica_and_add_it_back"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_remove_leader_shard_replica_and_add_it_back&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.171.190', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Remove_Follower_Shard_Replica_And_Add_It_Back :: Remove and add sh... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_ddb_sanity_module_based_remove_follower_shard_replica_and_add_it_back"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_remove_follower_shard_replica_and_add_it_back&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.171.190', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Write_Transactions_One_Node_Leader :: Write transactions.             | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_one_node_leader"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_one_node_leader&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.171.190', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Write_Transactions_One_Node_Follower :: Write transactions.           | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_one_node_follower"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_one_node_follower&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.171.190', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Write_Transactions_All_Nodes :: Write transactions.                   | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_all_nodes"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_all_nodes&order=bug_status"

Resolving variable '${response.text}' failed: AttributeError: 'ReadTimeout' object has no attribute 'text'
------------------------------------------------------------------------------
controller-clustering-tell.txt.Ddb-Sanity-Module-Based :: DOMDataB... | FAIL |
9 tests, 0 passed, 9 failed
==============================================================================
controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
==============================================================================
Stop_All_Members :: Stop every odl node.                              | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.190', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-tell.txt.Clean Leader Shutdown :: DOMDataBroker testi...
==============================================================================
Local_Leader_Shutdown :: Shutdown the leader on the same node as t... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_clean_leader_shutdown_local_leader_shutdown"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_clean_leader_shutdown_local_leader_shutdown&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.171.190', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Restart :: Restart odl                                                | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_clean_leader_shutdown_restart"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_clean_leader_shutdown_restart&order=bug_status"

Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Remote_Leader_Shutdown :: Shutdown the leader on different node as... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_clean_leader_shutdown_remote_leader_shutdown"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_clean_leader_shutdown_remote_leader_shutdown&order=bug_status"

ConnectionError: HTTPConnectionPool(host='10.30.171.51', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f5e1c4418d0>: Failed to establish a new connection: [Errno 111] Connection refused'))
------------------------------------------------------------------------------
controller-clustering-tell.txt.Clean Leader Shutdown :: DOMDataBro... | FAIL |
3 tests, 0 passed, 3 failed
==============================================================================
controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
==============================================================================
Stop_All_Members :: Stop every odl node.                              | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.190', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-tell.txt.Explicit Leader Movement :: DOMDataBroker te...
==============================================================================
Local_To_Remote_Movement :: Leader moves from local to remote node... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_explicit_leader_movement_local_to_remote_movement"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_local_to_remote_movement&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.171.190', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Restart1 :: Restart odl                                               | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_explicit_leader_movement_restart1"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_restart1&order=bug_status"

Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Remote_To_Remote_Movement :: Leader moves from one remote to other... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_explicit_leader_movement_remote_to_remote_movement"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_remote_to_remote_movement&order=bug_status"

ConnectionError: HTTPConnectionPool(host='10.30.171.51', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f5e1cc484d0>: Failed to establish a new connection: [Errno 111] Connection refused'))
------------------------------------------------------------------------------
Restart2 :: Restart odl                                               | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_explicit_leader_movement_restart2"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_restart2&order=bug_status"

Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Remote_To_Local_Movement :: Leader moves from remote to local node... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_explicit_leader_movement_remote_to_local_movement"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_remote_to_local_movement&order=bug_status"

ConnectionError: HTTPConnectionPool(host='10.30.171.51', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f5e1edb9710>: Failed to establish a new connection: [Errno 111] Connection refused'))
------------------------------------------------------------------------------
controller-clustering-tell.txt.Explicit Leader Movement :: DOMData... | FAIL |
5 tests, 0 passed, 5 failed
==============================================================================
controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
==============================================================================
Stop_All_Members :: Stop every odl node.                              | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.190', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-tell.txt.Leader Isolation :: DOMDataBroker testing: L...
==============================================================================
Healing_Within_Request_Timeout :: The isolated node (leader) is re... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_leader_isolation_healing_within_request_timeout"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_leader_isolation_healing_within_request_timeout&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.171.190', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Restart :: Restart odl                                                | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_leader_isolation_restart"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_leader_isolation_restart&order=bug_status"

Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Healing_After_Request_Timeout :: The isolated node (leader) is rej... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_leader_isolation_healing_after_request_timeout"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_leader_isolation_healing_after_request_timeout&order=bug_status"

ConnectionError: HTTPConnectionPool(host='10.30.171.51', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f5e1c8c69d0>: Failed to establish a new connection: [Errno 111] Connection refused'))
------------------------------------------------------------------------------
controller-clustering-tell.txt.Leader Isolation :: DOMDataBroker t... | FAIL |
3 tests, 0 passed, 3 failed
==============================================================================
controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
==============================================================================
Stop_All_Members :: Stop every odl node.                              | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.190', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-tell.txt.Client Isolation :: DOMDataBroker testing: C...
==============================================================================
Producer_On_Shard_Leader_Node_ChainedTx :: Client isolation with p... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_client_isolation_producer_on_shard_leader_node_chainedtx"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_producer_on_shard_leader_node_chainedtx&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.171.190', port=8181): Read timed out. (read timeout=125.0)

Also keyword teardown failed:
Several failures occurred:

1) Variable '${client_node_dst}' not found.

2) Variable '${client_node_dst}' not found.

3) Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 1 minute 10 seconds. The last error was: Several failures occurred:

1) ReadTimeout: HTTPConnectionPool(host='10.30.171.190', port=8181): Read timed out. (read timeout=125.0)

2) Resolving variable '${response.text}' failed: AttributeError: 'NoneType' object has no attribute 'text'

3) Resolving variable '${response.status_code}' failed: AttributeError: 'No...
    [ Message content over the limit has been removed. ]

65) Resolving variable '${response.text}' failed: AttributeError: 'NoneType' object has no attribute 'text'

66) Evaluating expression "json.loads('''None''')" failed: JSONDecodeError: Expecting value: line 1 column 1 (char 0)

67) TypeError: Expected argument 1 to be a dictionary, got None instead.

68) TypeError: Expected argument 1 to be a dictionary, got None instead.

69) Unrecognized Raft state: None

70) No leader found.

71) Too many Leaders.

72) IndexError: Given index 0 is out of the range 0--1.

4) KeyError: 'threads'
------------------------------------------------------------------------------
Restart1 :: Restart odl                                               | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_client_isolation_restart1"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_restart1&order=bug_status"

Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Producer_On_Shard_Leader_Node_SimpleTx :: Client isolation with pr... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_client_isolation_producer_on_shard_leader_node_simpletx"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_producer_on_shard_leader_node_simpletx&order=bug_status"

ConnectionError: HTTPConnectionPool(host='10.30.171.51', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f5e1dc14190>: Failed to establish a new connection: [Errno 111] Connection refused'))

Also keyword teardown failed:
Several failures occurred:

1) Variable '${client_node_dst}' not found.

2) Variable '${client_node_dst}' not found.

3) Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 1 minute 10 seconds. The last error was: Several failures occurred:

1) ConnectionError: HTTPConnectionPool(host='10.30.171.51', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f5...
    [ Message content over the limit has been removed. ]

173) Resolving variable '${response.text}' failed: AttributeError: 'NoneType' object has no attribute 'text'

174) Evaluating expression "json.loads('''None''')" failed: JSONDecodeError: Expecting value: line 1 column 1 (char 0)

175) TypeError: Expected argument 1 to be a dictionary, got None instead.

176) TypeError: Expected argument 1 to be a dictionary, got None instead.

177) Unrecognized Raft state: None

178) No leader found.

179) Too many Leaders.

180) IndexError: Given index 0 is out of the range 0--1.

4) KeyError: 'threads'
------------------------------------------------------------------------------
Restart2 :: Restart odl                                               | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_client_isolation_restart2"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_restart2&order=bug_status"

Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Producer_On_Shard_Non_Leader_Node_ChainedTx :: Client isolation wi... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_client_isolation_producer_on_shard_non_leader_node_chainedtx"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_producer_on_shard_non_leader_node_chainedtx&order=bug_status"

ConnectionError: HTTPConnectionPool(host='10.30.171.51', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f5e1da4e3d0>: Failed to establish a new connection: [Errno 111] Connection refused'))

Also keyword teardown failed:
Several failures occurred:

1) Variable '${client_node_dst}' not found.

2) Variable '${client_node_dst}' not found.

3) Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 1 minute 10 seconds. The last error was: Several failures occurred:

1) ConnectionError: HTTPConnectionPool(host='10.30.171.51', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f5...
    [ Message content over the limit has been removed. ]

173) Resolving variable '${response.text}' failed: AttributeError: 'NoneType' object has no attribute 'text'

174) Evaluating expression "json.loads('''None''')" failed: JSONDecodeError: Expecting value: line 1 column 1 (char 0)

175) TypeError: Expected argument 1 to be a dictionary, got None instead.

176) TypeError: Expected argument 1 to be a dictionary, got None instead.

177) Unrecognized Raft state: None

178) No leader found.

179) Too many Leaders.

180) IndexError: Given index 0 is out of the range 0--1.

4) KeyError: 'threads'
------------------------------------------------------------------------------
Restart3 :: Restart odl                                               | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_client_isolation_restart3"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_restart3&order=bug_status"

Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Producer_On_Shard_Non_Leader_Node_SimpleTx :: Client isolation wit... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_client_isolation_producer_on_shard_non_leader_node_simpletx"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_producer_on_shard_non_leader_node_simpletx&order=bug_status"

ConnectionError: HTTPConnectionPool(host='10.30.171.51', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f5e1ccd9810>: Failed to establish a new connection: [Errno 111] Connection refused'))

Also keyword teardown failed:
Several failures occurred:

1) Variable '${client_node_dst}' not found.

2) Variable '${client_node_dst}' not found.

3) Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 1 minute 10 seconds. The last error was: Several failures occurred:

1) ConnectionError: HTTPConnectionPool(host='10.30.171.51', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f5...
    [ Message content over the limit has been removed. ]

173) Resolving variable '${response.text}' failed: AttributeError: 'NoneType' object has no attribute 'text'

174) Evaluating expression "json.loads('''None''')" failed: JSONDecodeError: Expecting value: line 1 column 1 (char 0)

175) TypeError: Expected argument 1 to be a dictionary, got None instead.

176) TypeError: Expected argument 1 to be a dictionary, got None instead.

177) Unrecognized Raft state: None

178) No leader found.

179) Too many Leaders.

180) IndexError: Given index 0 is out of the range 0--1.

4) KeyError: 'threads'
------------------------------------------------------------------------------
controller-clustering-tell.txt.Client Isolation :: DOMDataBroker t... | FAIL |
7 tests, 0 passed, 7 failed
==============================================================================
controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
==============================================================================
Stop_All_Members :: Stop every odl node.                              | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.190', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-tell.txt.Listener Stability :: DOMDataBroker testing:...
==============================================================================
Move_Leader_From_Listener_Local_To_Remote :: Listener runs on lead... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_listener_stability_move_leader_from_listener_local_to_remote"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_listener_stability_move_leader_from_listener_local_to_remote&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.171.190', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Restart_1 :: Restart odl.                                             | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_listener_stability_restart_1"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_listener_stability_restart_1&order=bug_status"

Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Move_Leader_From_Listener_Remote_To_Other_Remote :: Listener runs ... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_listener_stability_move_leader_from_listener_remote_to_other_remote"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_listener_stability_move_leader_from_listener_remote_to_other_remote&order=bug_status"

ConnectionError: HTTPConnectionPool(host='10.30.171.51', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f5e1dd18190>: Failed to establish a new connection: [Errno 111] Connection refused'))
------------------------------------------------------------------------------
Restart_2 :: Restart odl.                                             | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_listener_stability_restart_2"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_listener_stability_restart_2&order=bug_status"

Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Move_Leader_From_Listener_Remote_To_Local :: Listener runs on foll... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_listener_stability_move_leader_from_listener_remote_to_local"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_listener_stability_move_leader_from_listener_remote_to_local&order=bug_status"

ConnectionError: HTTPConnectionPool(host='10.30.171.51', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f5e1dc1a290>: Failed to establish a new connection: [Errno 111] Connection refused'))
------------------------------------------------------------------------------
controller-clustering-tell.txt.Listener Stability :: DOMDataBroker... | FAIL |
5 tests, 0 passed, 5 failed
==============================================================================
controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
==============================================================================
Stop_All_Members :: Stop every odl node.                              | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.190', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-tell.txt.Master Stability :: Cluster Singleton testin...
==============================================================================
Register_Singleton_Constant_On_Each_Node_And_Verify :: Register a ... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_master_stability_register_singleton_constant_on_each_node_and_verify"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_register_singleton_constant_on_each_node_and_verify&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.171.190', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Unregister_Singleton_Constant_On_Non_Master_Node :: Unregister the... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_master_stability_unregister_singleton_constant_on_non_master_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_unregister_singleton_constant_on_non_master_node&order=bug_status"

Variable '@{cs_candidates}' not found. Did you mean:
    @{cs_exp_candidates}
------------------------------------------------------------------------------
Monitor_Stability_While_Unregistered :: Verify that the owner rema... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_master_stability_monitor_stability_while_unregistered"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_monitor_stability_while_unregistered&order=bug_status"

Variable '${cs_owner}' not found.
------------------------------------------------------------------------------
Reregister_Singleton_Constant :: Re-register the unregistered cand... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_master_stability_reregister_singleton_constant"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_reregister_singleton_constant&order=bug_status"

Variable '${unregistered_node}' not found.
------------------------------------------------------------------------------
Verify_Stability_After_Reregistration :: Verify that the owner rem... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_master_stability_verify_stability_after_reregistration"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_verify_stability_after_reregistration&order=bug_status"

Variable '${cs_owner}' not found.
------------------------------------------------------------------------------
Unregister_Singleton_Constant_On_Each_Node :: Unregister the appli... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_master_stability_unregister_singleton_constant_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_unregister_singleton_constant_on_each_node&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.171.190', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-tell.txt.Master Stability :: Cluster Singlet... | FAIL |
6 tests, 0 passed, 6 failed
==============================================================================
controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
==============================================================================
Stop_All_Members :: Stop every odl node.                              | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.190', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-tell.txt.Partition And Heal :: Cluster Singleton test...
==============================================================================
Register_Singleton_Constant_On_Each_Node :: Register a candidate a... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_partition_and_heal_register_singleton_constant_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_register_singleton_constant_on_each_node&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.171.190', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Verify_Singleton_Constant_On_Each_Node :: Store the owner and cand... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_partition_and_heal_verify_singleton_constant_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_verify_singleton_constant_on_each_node&order=bug_status"

Could not parse owner and candidates for device get-singleton-constant-service']
------------------------------------------------------------------------------
Isolate_Owner_Node :: Isolate the cluster node which is the owner.... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_partition_and_heal_isolate_owner_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_isolate_owner_node&order=bug_status"

Variable '${cs_owner}' not found.
------------------------------------------------------------------------------
Monitor_Stability_While_Isolated :: Monitor the stability of the s... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_partition_and_heal_monitor_stability_while_isolated"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_monitor_stability_while_isolated&order=bug_status"

Invalid IF condition: Evaluating expression '"${index}" == "${cs_isolated_index}"' failed: Variable '${cs_isolated_index}' not found.
------------------------------------------------------------------------------
Rejoin_Isolated_node :: Rejoin isolated node.                         | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_partition_and_heal_rejoin_isolated_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_rejoin_isolated_node&order=bug_status"

Variable '${cs_isolated_index}' not found.
------------------------------------------------------------------------------
Unregister_Singleton_Constant_On_Each_Node :: Unregister the appli... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_partition_and_heal_unregister_singleton_constant_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_unregister_singleton_constant_on_each_node&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.171.190', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-tell.txt.Partition And Heal :: Cluster Singl... | FAIL |
6 tests, 0 passed, 6 failed
==============================================================================
controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
==============================================================================
Stop_All_Members :: Stop every odl node.                              | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.190', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-tell.txt.Chasing The Leader :: Cluster Singleton test...
==============================================================================
Register_Candidates :: Register a candidate application on each no... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_chasing_the_leader_register_candidates"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_chasing_the_leader_register_candidates&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.171.190', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Do_Nothing :: Do nothing for the time of the test duration, becaus... | PASS |
------------------------------------------------------------------------------
Unregister_Candidates_And_Validate_Criteria :: Unregister the test... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_chasing_the_leader_unregister_candidates_and_validate_criteria"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_chasing_the_leader_unregister_candidates_and_validate_criteria&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.171.190', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-tell.txt.Chasing The Leader :: Cluster Singl... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
==============================================================================
Stop_All_Members :: Stop every odl node.                              | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.190', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-tell.txt.Carpeople Crud :: Suite for performing basic...
==============================================================================
Add_Cars_To_Leader :: Add 30 cars to car Leader by one big PUT.       | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Added_Cars_On_Leader :: GET response from Leader should match ... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Added_Cars_On_Followers :: The same check on other members.       | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Add_People_To_First_Follower :: Add 30 people to people first Foll... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Added_People_On_Leader :: GET response from Leader should matc... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Added_People_On_Followers :: The same check on other members.     | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Leader :: Buy some cars on car-people Leader, loop of ... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Followers :: On each Follower buy corresponding ID seg... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Added_CarPeople_On_Leader :: GET car-person mappings from Lead... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Added_CarPeople_On_Followers :: The same check on other members.  | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_All_CarPeople_On_Leader :: DELETE car-people container. No ... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_All_People_On_Leader :: DELETE people container. No verific... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_All_Cars_On_Leader :: DELETE cars container. No verificatio... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
controller-clustering-tell.txt.Carpeople Crud :: Suite for perform... | FAIL |
Suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig

13 tests, 0 passed, 13 failed
==============================================================================
controller-clustering-tell.txt.Car Failover Crud :: Suite mixing basic oper...
==============================================================================
Add_Original_Cars_On_Old_Leader_And_Verify :: Add initial cars on ... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Stop_Original_Car_Leader :: Stop the car Leader to cause a new lea... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Wait_For_New_Leader :: Wait until new car Leader is elected.          | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Original_Cars_On_New_Leader :: GET cars from new Leader, shoul... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Original_Cars_On_New_Followers :: The same check on other exis... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_Original_Cars_On_New_Leader :: Delete cars on the new Leader.  | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Add_Leader_Cars_On_New_Leader :: Add cars on the new Leader.          | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Leader_Cars_On_New_Leader :: GET cars from new Leader, should ... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Leader_Cars_On_New_Followers :: The same check on other existi... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_Leader_Cars_On_New_First_Follower :: Delete cars in new fir... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Add_Follower_Cars_On_New_First_Follower :: Add cars on the new fir... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Folower_Cars_On_New_Leader :: Get cars from the new Leader, sh... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Follower_Cars_On_New_Followers :: The same check on other exis... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Start_Old_Car_Leader :: Start the stopped member without deleting ... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Folower_Cars_On_Old_Leader :: GET cars from the restarted memb... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_Follower_Cars_On_New_Leader :: Delete cars on the last Leader. | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
controller-clustering-tell.txt.Car Failover Crud :: Suite mixing b... | FAIL |
Suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig

16 tests, 0 passed, 16 failed
==============================================================================
controller-clustering-tell.txt.Car Persistence Recovery :: This test restar...
==============================================================================
Add_Cars_On_Leader_And_Verify :: Single big PUT to datastore to ad... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Stop_All_Members :: Stop all controllers.                             | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Start_All_Members :: Start all controllers (should restore the per... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Memorize_Leader_And_Followers :: Locate current Leader of car Shard.  | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Cars_On_Leader :: GET cars from Leader, should match the PUT d... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Cars_On_Followers :: The same check on other members.             | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_Cars_On_Leader :: Delete cars on the new Leader.               | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
controller-clustering-tell.txt.Car Persistence Recovery :: This te... | FAIL |
Suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig

7 tests, 0 passed, 7 failed
==============================================================================
controller-clustering-tell.txt.Buycar Failover :: This test focuses on test...
==============================================================================
Add_Cars_To_Leader_And_Verify :: Add all needed cars to car Leader... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Add_People_To_First_Follower_And_Verify :: Add all needed people t... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Leader_And_Verify :: Buy some cars on the leader member.  | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Follower_And_Verify :: Buy some cars on the first foll... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Reboot_People_Leader :: Previous people Leader is rebooted. We sho... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Leader_After_Reboot_And_Verify :: Buy some cars on the... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Follower_After_Reboot_And_Verify :: Buy some cars on t... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_All_CarPeople :: DELETE car-people container. No verificati... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_All_People :: DELETE people container. No verification beyo... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_All_Cars :: DELETE cars container. No verification beyond h... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
controller-clustering-tell.txt.Buycar Failover :: This test focuse... | FAIL |
Suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig

10 tests, 0 passed, 10 failed
==============================================================================
controller-clustering-tell.txt.Entity Isolate :: Suite for performing membe...
==============================================================================
Check All Shards Before Isolate :: Check all shards in controller.    | FAIL |
Parent suite setup failed:
Evaluating expression 'json.loads(\'\'\'{\n "error": "javax.management.InstanceNotFoundException : org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "error_type": "javax.management.InstanceNotFoundException",\n "request": {\n  "mbean": "org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n  "type": "read"\n },\n "stacktrace": "javax.management.InstanceNotFoundException: org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1088)\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1358)\\n\\tat java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:921)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:46)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:41)\\n\\tat org.jolokia.backend.executor.AbstractMBeanServerExecutor.call(AbstractMBeanServerExecutor.java:90)\\n\\tat org.jolokia.handler.ReadHandler.getMBeanInfo(ReadHandler.java:233)\\n\\tat org.jolokia.handler.ReadHandler.getAllAttributesNames(ReadHandler.java:245)\\n\\tat org.jolokia.handler.ReadHandler.resolveAttributes(ReadHandler.java:221)\\n\\tat org.jolokia.handler.ReadHandler.f...
    [ Message content over the limit has been removed. ]
...clipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\\n\\tat org.eclipse.jetty.server.Server.handle(Server.java:516)\\n\\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)\\n\\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)\\n\\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)\\n\\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\\n\\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\\n\\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\\n\\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)\\n\\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\\n\\tat java.base/java.lang.Thread.run(Thread.java:833)\\n",\n "status": 404\n}\n\'\'\')' failed: JSONDecodeError: Invalid control character at: line 8 column 190 (char 619)
------------------------------------------------------------------------------
Isolate Entity Leader :: Isolate the entity-ownership Leader to ca... | FAIL |
Parent suite setup failed:
Evaluating expression 'json.loads(\'\'\'{\n "error": "javax.management.InstanceNotFoundException : org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "error_type": "javax.management.InstanceNotFoundException",\n "request": {\n  "mbean": "org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n  "type": "read"\n },\n "stacktrace": "javax.management.InstanceNotFoundException: org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1088)\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1358)\\n\\tat java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:921)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:46)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:41)\\n\\tat org.jolokia.backend.executor.AbstractMBeanServerExecutor.call(AbstractMBeanServerExecutor.java:90)\\n\\tat org.jolokia.handler.ReadHandler.getMBeanInfo(ReadHandler.java:233)\\n\\tat org.jolokia.handler.ReadHandler.getAllAttributesNames(ReadHandler.java:245)\\n\\tat org.jolokia.handler.ReadHandler.resolveAttributes(ReadHandler.java:221)\\n\\tat org.jolokia.handler.ReadHandler.f...
    [ Message content over the limit has been removed. ]
...clipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\\n\\tat org.eclipse.jetty.server.Server.handle(Server.java:516)\\n\\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)\\n\\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)\\n\\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)\\n\\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\\n\\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\\n\\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\\n\\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)\\n\\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\\n\\tat java.base/java.lang.Thread.run(Thread.java:833)\\n",\n "status": 404\n}\n\'\'\')' failed: JSONDecodeError: Invalid control character at: line 8 column 190 (char 619)
------------------------------------------------------------------------------
Check All Shards After Isolate :: Check all shards in controller.     | FAIL |
Parent suite setup failed:
Evaluating expression 'json.loads(\'\'\'{\n "error": "javax.management.InstanceNotFoundException : org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "error_type": "javax.management.InstanceNotFoundException",\n "request": {\n  "mbean": "org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n  "type": "read"\n },\n "stacktrace": "javax.management.InstanceNotFoundException: org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1088)\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1358)\\n\\tat java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:921)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:46)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:41)\\n\\tat org.jolokia.backend.executor.AbstractMBeanServerExecutor.call(AbstractMBeanServerExecutor.java:90)\\n\\tat org.jolokia.handler.ReadHandler.getMBeanInfo(ReadHandler.java:233)\\n\\tat org.jolokia.handler.ReadHandler.getAllAttributesNames(ReadHandler.java:245)\\n\\tat org.jolokia.handler.ReadHandler.resolveAttributes(ReadHandler.java:221)\\n\\tat org.jolokia.handler.ReadHandler.f...
    [ Message content over the limit has been removed. ]
...clipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\\n\\tat org.eclipse.jetty.server.Server.handle(Server.java:516)\\n\\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)\\n\\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)\\n\\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)\\n\\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\\n\\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\\n\\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\\n\\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)\\n\\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\\n\\tat java.base/java.lang.Thread.run(Thread.java:833)\\n",\n "status": 404\n}\n\'\'\')' failed: JSONDecodeError: Invalid control character at: line 8 column 190 (char 619)
------------------------------------------------------------------------------
Rejoin Entity Leader :: Rejoin the entity-ownership Leader.           | FAIL |
Parent suite setup failed:
Evaluating expression 'json.loads(\'\'\'{\n "error": "javax.management.InstanceNotFoundException : org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "error_type": "javax.management.InstanceNotFoundException",\n "request": {\n  "mbean": "org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n  "type": "read"\n },\n "stacktrace": "javax.management.InstanceNotFoundException: org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1088)\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1358)\\n\\tat java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:921)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:46)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:41)\\n\\tat org.jolokia.backend.executor.AbstractMBeanServerExecutor.call(AbstractMBeanServerExecutor.java:90)\\n\\tat org.jolokia.handler.ReadHandler.getMBeanInfo(ReadHandler.java:233)\\n\\tat org.jolokia.handler.ReadHandler.getAllAttributesNames(ReadHandler.java:245)\\n\\tat org.jolokia.handler.ReadHandler.resolveAttributes(ReadHandler.java:221)\\n\\tat org.jolokia.handler.ReadHandler.f...
    [ Message content over the limit has been removed. ]
...clipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\\n\\tat org.eclipse.jetty.server.Server.handle(Server.java:516)\\n\\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)\\n\\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)\\n\\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)\\n\\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\\n\\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\\n\\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\\n\\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)\\n\\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\\n\\tat java.base/java.lang.Thread.run(Thread.java:833)\\n",\n "status": 404\n}\n\'\'\')' failed: JSONDecodeError: Invalid control character at: line 8 column 190 (char 619)
------------------------------------------------------------------------------
Check All Shards After Rejoin :: Check all shards in controller.      | FAIL |
Parent suite setup failed:
Evaluating expression 'json.loads(\'\'\'{\n "error": "javax.management.InstanceNotFoundException : org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "error_type": "javax.management.InstanceNotFoundException",\n "request": {\n  "mbean": "org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n  "type": "read"\n },\n "stacktrace": "javax.management.InstanceNotFoundException: org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1088)\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1358)\\n\\tat java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:921)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:46)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:41)\\n\\tat org.jolokia.backend.executor.AbstractMBeanServerExecutor.call(AbstractMBeanServerExecutor.java:90)\\n\\tat org.jolokia.handler.ReadHandler.getMBeanInfo(ReadHandler.java:233)\\n\\tat org.jolokia.handler.ReadHandler.getAllAttributesNames(ReadHandler.java:245)\\n\\tat org.jolokia.handler.ReadHandler.resolveAttributes(ReadHandler.java:221)\\n\\tat org.jolokia.handler.ReadHandler.f...
    [ Message content over the limit has been removed. ]
...clipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\\n\\tat org.eclipse.jetty.server.Server.handle(Server.java:516)\\n\\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)\\n\\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)\\n\\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)\\n\\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\\n\\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\\n\\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\\n\\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)\\n\\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\\n\\tat java.base/java.lang.Thread.run(Thread.java:833)\\n",\n "status": 404\n}\n\'\'\')' failed: JSONDecodeError: Invalid control character at: line 8 column 190 (char 619)
------------------------------------------------------------------------------
controller-clustering-tell.txt.Entity Isolate :: Suite for perform... | FAIL |
Suite setup failed:
Evaluating expression 'json.loads(\'\'\'{\n "error": "javax.management.InstanceNotFoundException : org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "error_type": "javax.management.InstanceNotFoundException",\n "request": {\n  "mbean": "org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n  "type": "read"\n },\n "stacktrace": "javax.management.InstanceNotFoundException: org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1088)\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1358)\\n\\tat java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:921)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:46)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:41)\\n\\tat org.jolokia.backend.executor.AbstractMBeanServerExecutor.call(AbstractMBeanServerExecutor.java:90)\\n\\tat org.jolokia.handler.ReadHandler.getMBeanInfo(ReadHandler.java:233)\\n\\tat org.jolokia.handler.ReadHandler.getAllAttributesNames(ReadHandler.java:245)\\n\\tat org.jolokia.handler.ReadHandler.resolveAttributes(ReadHandler.java:221)\\n\\tat org.jolokia.handler.ReadHandler.f...
    [ Message content over the limit has been removed. ]
...clipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\\n\\tat org.eclipse.jetty.server.Server.handle(Server.java:516)\\n\\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)\\n\\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)\\n\\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)\\n\\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\\n\\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\\n\\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\\n\\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)\\n\\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\\n\\tat java.base/java.lang.Thread.run(Thread.java:833)\\n",\n "status": 404\n}\n\'\'\')' failed: JSONDecodeError: Invalid control character at: line 8 column 190 (char 619)

5 tests, 0 passed, 5 failed
==============================================================================
controller-clustering-tell.txt.Buycar Failover Isolation :: This test focus...
==============================================================================
Add_Cars_To_Leader_And_Verify :: Add all needed cars to car Leader... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Add_People_To_First_Follower_And_Verify :: Add all needed people t... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Leader_And_Verify :: Buy some cars on the leader member.  | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Follower_And_Verify :: Buy some cars on the first foll... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Isolate_and_Rejoin_People_Leader :: Previous people Leader is isol... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Leader_After_Rejoin_And_Verify :: Buy some cars on the... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Follower_After_Rejoin_And_Verify :: Buy some cars on t... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_All_CarPeople :: DELETE car-people container. No verificati... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_All_People :: DELETE people container. No verification beyo... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_All_Cars :: DELETE cars container. No verification beyond h... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
controller-clustering-tell.txt.Buycar Failover Isolation :: This t... | FAIL |
Suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig

10 tests, 0 passed, 10 failed
==============================================================================
controller-clustering-tell.txt.Car Failover Crud Isolation :: Suite mixing ...
==============================================================================
Add_Original_Cars_On_Old_Leader_And_Verify :: Add initial cars on ... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Isolate_Original_Car_Leader :: Isolate the car Leader to cause a n... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Wait_For_New_Leader :: Wait until new car Leader is elected.          | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Original_Cars_On_New_Leader :: GET cars from new Leader, shoul... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Original_Cars_On_New_Followers :: The same check on other exis... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_Original_Cars_On_New_Leader :: Delete cars on the new Leader.  | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Add_Leader_Cars_On_New_Leader :: Add cars on the new Leader.          | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Leader_Cars_On_New_Leader :: GET cars from new Leader, should ... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Leader_Cars_On_New_Followers :: The same check on other existi... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_Leader_Cars_On_New_First_Follower :: Delete cars in new fir... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Add_Follower_Cars_On_New_First_Follower :: Add cars on the new fir... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Folower_Cars_On_New_Leader :: Get cars from the new Leader, sh... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Follower_Cars_On_New_Followers :: The same check on other exis... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Rejoin_Old_Car_Leader :: Rejoin the isolated member without deleti... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Folower_Cars_On_Old_Leader :: GET cars from the restarted memb... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_Follower_Cars_On_New_Leader :: Delete cars on the last Leader. | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
controller-clustering-tell.txt.Car Failover Crud Isolation :: Suit... | FAIL |
Suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.51:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig

16 tests, 0 passed, 16 failed
==============================================================================
controller-clustering-tell.txt.Car Outage Corners :: Cluster suite for test...
==============================================================================
Stop_Majority_Of_The_Followers :: Stop half plus one car Follower ... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.19:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Attempt_To_Add_Cars_To_Leader :: Adding cars should fail, as major... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.19:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Start_Tipping_Follower :: Start one Follower member without persis... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.19:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Add_Cars_On_Tipping_Follower :: Add cars on the tipping Follower.     | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.19:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Cars_On_Existing_Members :: On each up member: GET cars, shoul... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.19:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Start_Other_Followers :: Start other followers without persisted d... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.19:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Cars_On_New_Follower_Leader :: GET cars from a new follower to... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.19:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_Cars_On_Leader :: Delete cars on Leader.                       | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.19:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
controller-clustering-tell.txt.Car Outage Corners :: Cluster suite... | FAIL |
Suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.19:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig

8 tests, 0 passed, 8 failed
==============================================================================
controller-clustering-tell.txt                                        | FAIL |
162 tests, 11 passed, 151 failed
==============================================================================
Output:  /w/workspace/controller-csit-3node-clustering-tell-all-argon/output.xml
Log:     /w/workspace/controller-csit-3node-clustering-tell-all-argon/log.html
Report:  /w/workspace/controller-csit-3node-clustering-tell-all-argon/report.html
+ true
+ echo 'Examining the files in data/log and checking filesize'
Examining the files in data/log and checking filesize
+ ssh 10.30.171.51 'ls -altr /tmp/karaf-0.18.4-SNAPSHOT/data/log/'
Warning: Permanently added '10.30.171.51' (ECDSA) to the list of known hosts.
total 64644
drwxrwxr-x. 2 jenkins jenkins       48 Apr  6 23:09 .
-rw-rw-r--. 1 jenkins jenkins     1720 Apr  6 23:09 karaf_console.log
drwxrwxr-x. 9 jenkins jenkins      149 Apr  7 04:46 ..
-rw-rw-r--. 1 jenkins jenkins 64437309 Apr  7 05:00 karaf.log
+ ssh 10.30.171.51 'du -hs /tmp/karaf-0.18.4-SNAPSHOT/data/log/*'
Warning: Permanently added '10.30.171.51' (ECDSA) to the list of known hosts.
4.0K	/tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf_console.log
64M	/tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log
+ ssh 10.30.170.19 'ls -altr /tmp/karaf-0.18.4-SNAPSHOT/data/log/'
Warning: Permanently added '10.30.170.19' (ECDSA) to the list of known hosts.
total 129156
drwxrwxr-x. 2 jenkins jenkins       48 Apr  6 23:09 .
-rw-rw-r--. 1 jenkins jenkins     1720 Apr  6 23:09 karaf_console.log
drwxrwxr-x. 9 jenkins jenkins      149 Apr  7 04:46 ..
-rw-rw-r--. 1 jenkins jenkins 71751308 Apr  7 05:00 karaf.log
+ ssh 10.30.170.19 'du -hs /tmp/karaf-0.18.4-SNAPSHOT/data/log/*'
Warning: Permanently added '10.30.170.19' (ECDSA) to the list of known hosts.
4.0K	/tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf_console.log
127M	/tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log
+ ssh 10.30.171.190 'ls -altr /tmp/karaf-0.18.4-SNAPSHOT/data/log/'
Warning: Permanently added '10.30.171.190' (ECDSA) to the list of known hosts.
total 131200
drwxrwxr-x. 2 jenkins jenkins       48 Apr  6 23:09 .
-rw-rw-r--. 1 jenkins jenkins   194972 Apr  7 00:08 karaf_console.log
drwxrwxr-x. 4 jenkins jenkins       28 Apr  7 04:45 ..
-rw-rw-r--. 1 jenkins jenkins 86551635 Apr  7 05:00 karaf.log
+ ssh 10.30.171.190 'du -hs /tmp/karaf-0.18.4-SNAPSHOT/data/log/*'
Warning: Permanently added '10.30.171.190' (ECDSA) to the list of known hosts.
192K	/tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf_console.log
128M	/tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log
+ set +e
++ seq 1 3
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_1_IP
+ echo 'Let'\''s take the karaf thread dump again'
Let's take the karaf thread dump again
+ ssh 10.30.171.51 'sudo ps aux'
Warning: Permanently added '10.30.171.51' (ECDSA) to the list of known hosts.
++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-argon/ps_after.log
++ grep -v grep
++ cut -f2 '-d '
++ tr -s ' '
+ pid=30496
+ echo 'karaf main: org.apache.karaf.main.Main, pid:30496'
karaf main: org.apache.karaf.main.Main, pid:30496
+ ssh 10.30.171.51 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 30496'
Warning: Permanently added '10.30.171.51' (ECDSA) to the list of known hosts.
+ echo 'killing karaf process...'
killing karaf process...
+ ssh 10.30.171.51 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh'
Warning: Permanently added '10.30.171.51' (ECDSA) to the list of known hosts.
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_2_IP
+ echo 'Let'\''s take the karaf thread dump again'
Let's take the karaf thread dump again
+ ssh 10.30.170.19 'sudo ps aux'
Warning: Permanently added '10.30.170.19' (ECDSA) to the list of known hosts.
++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-argon/ps_after.log
++ grep -v grep
++ cut -f2 '-d '
++ tr -s ' '
+ pid=29358
+ echo 'karaf main: org.apache.karaf.main.Main, pid:29358'
karaf main: org.apache.karaf.main.Main, pid:29358
+ ssh 10.30.170.19 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 29358'
Warning: Permanently added '10.30.170.19' (ECDSA) to the list of known hosts.
+ echo 'killing karaf process...'
killing karaf process...
+ ssh 10.30.170.19 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh'
Warning: Permanently added '10.30.170.19' (ECDSA) to the list of known hosts.
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_3_IP
+ echo 'Let'\''s take the karaf thread dump again'
Let's take the karaf thread dump again
+ ssh 10.30.171.190 'sudo ps aux'
Warning: Permanently added '10.30.171.190' (ECDSA) to the list of known hosts.
++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-argon/ps_after.log
++ grep -v grep
++ cut -f2 '-d '
++ tr -s ' '
+ pid=5765
+ echo 'karaf main: org.apache.karaf.main.Main, pid:5765'
karaf main: org.apache.karaf.main.Main, pid:5765
+ ssh 10.30.171.190 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 5765'
Warning: Permanently added '10.30.171.190' (ECDSA) to the list of known hosts.
+ echo 'killing karaf process...'
killing karaf process...
+ ssh 10.30.171.190 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh'
Warning: Permanently added '10.30.171.190' (ECDSA) to the list of known hosts.
+ sleep 5
++ seq 1 3
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_1_IP
+ echo 'Compressing karaf.log 1'
Compressing karaf.log 1
+ ssh 10.30.171.51 gzip --best /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log
Warning: Permanently added '10.30.171.51' (ECDSA) to the list of known hosts.
gzip: /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log: file size changed while zipping
+ echo 'Fetching compressed karaf.log 1'
Fetching compressed karaf.log 1
+ scp 10.30.171.51:/tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log.gz odl1_karaf.log.gz
Warning: Permanently added '10.30.171.51' (ECDSA) to the list of known hosts.
+ ssh 10.30.171.51 rm -f /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log.gz
Warning: Permanently added '10.30.171.51' (ECDSA) to the list of known hosts.
+ scp 10.30.171.51:/tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf_console.log odl1_karaf_console.log
Warning: Permanently added '10.30.171.51' (ECDSA) to the list of known hosts.
+ ssh 10.30.171.51 rm -f /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf_console.log
Warning: Permanently added '10.30.171.51' (ECDSA) to the list of known hosts.
+ echo 'Fetch GC logs'
Fetch GC logs
+ mkdir -p gclogs-1
+ scp '10.30.171.51:/tmp/karaf-0.18.4-SNAPSHOT/data/log/*.log' gclogs-1/
Warning: Permanently added '10.30.171.51' (ECDSA) to the list of known hosts.
scp: /tmp/karaf-0.18.4-SNAPSHOT/data/log/*.log: No such file or directory
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_2_IP
+ echo 'Compressing karaf.log 2'
Compressing karaf.log 2
+ ssh 10.30.170.19 gzip --best /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log
Warning: Permanently added '10.30.170.19' (ECDSA) to the list of known hosts.
gzip: /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log: file size changed while zipping
+ echo 'Fetching compressed karaf.log 2'
Fetching compressed karaf.log 2
+ scp 10.30.170.19:/tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log.gz odl2_karaf.log.gz
Warning: Permanently added '10.30.170.19' (ECDSA) to the list of known hosts.
+ ssh 10.30.170.19 rm -f /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log.gz
Warning: Permanently added '10.30.170.19' (ECDSA) to the list of known hosts.
+ scp 10.30.170.19:/tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf_console.log odl2_karaf_console.log
Warning: Permanently added '10.30.170.19' (ECDSA) to the list of known hosts.
+ ssh 10.30.170.19 rm -f /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf_console.log
Warning: Permanently added '10.30.170.19' (ECDSA) to the list of known hosts.
+ echo 'Fetch GC logs'
Fetch GC logs
+ mkdir -p gclogs-2
+ scp '10.30.170.19:/tmp/karaf-0.18.4-SNAPSHOT/data/log/*.log' gclogs-2/
Warning: Permanently added '10.30.170.19' (ECDSA) to the list of known hosts.
scp: /tmp/karaf-0.18.4-SNAPSHOT/data/log/*.log: No such file or directory
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_3_IP
+ echo 'Compressing karaf.log 3'
Compressing karaf.log 3
+ ssh 10.30.171.190 gzip --best /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log
Warning: Permanently added '10.30.171.190' (ECDSA) to the list of known hosts.
gzip: /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log: file size changed while zipping
+ echo 'Fetching compressed karaf.log 3'
Fetching compressed karaf.log 3
+ scp 10.30.171.190:/tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log.gz odl3_karaf.log.gz
Warning: Permanently added '10.30.171.190' (ECDSA) to the list of known hosts.
+ ssh 10.30.171.190 rm -f /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log.gz
Warning: Permanently added '10.30.171.190' (ECDSA) to the list of known hosts.
+ scp 10.30.171.190:/tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf_console.log odl3_karaf_console.log
Warning: Permanently added '10.30.171.190' (ECDSA) to the list of known hosts.
+ ssh 10.30.171.190 rm -f /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf_console.log
Warning: Permanently added '10.30.171.190' (ECDSA) to the list of known hosts.
+ echo 'Fetch GC logs'
Fetch GC logs
+ mkdir -p gclogs-3
+ scp '10.30.171.190:/tmp/karaf-0.18.4-SNAPSHOT/data/log/*.log' gclogs-3/
Warning: Permanently added '10.30.171.190' (ECDSA) to the list of known hosts.
scp: /tmp/karaf-0.18.4-SNAPSHOT/data/log/*.log: No such file or directory
+ echo 'Examine copied files'
Examine copied files
+ ls -lt
total 72380
drwxrwxr-x. 2 jenkins jenkins        6 Apr  7 05:00 gclogs-3
-rw-rw-r--. 1 jenkins jenkins   194972 Apr  7 05:00 odl3_karaf_console.log
-rw-rw-r--. 1 jenkins jenkins  1918609 Apr  7 05:00 odl3_karaf.log.gz
drwxrwxr-x. 2 jenkins jenkins        6 Apr  7 05:00 gclogs-2
-rw-rw-r--. 1 jenkins jenkins     1720 Apr  7 05:00 odl2_karaf_console.log
-rw-rw-r--. 1 jenkins jenkins  2482175 Apr  7 05:00 odl2_karaf.log.gz
drwxrwxr-x. 2 jenkins jenkins        6 Apr  7 05:00 gclogs-1
-rw-rw-r--. 1 jenkins jenkins     1720 Apr  7 05:00 odl1_karaf_console.log
-rw-rw-r--. 1 jenkins jenkins  2159359 Apr  7 05:00 odl1_karaf.log.gz
-rw-rw-r--. 1 jenkins jenkins   166952 Apr  7 05:00 karaf_3_5765_threads_after.log
-rw-rw-r--. 1 jenkins jenkins    15965 Apr  7 05:00 ps_after.log
-rw-rw-r--. 1 jenkins jenkins   147334 Apr  7 05:00 karaf_2_29358_threads_after.log
-rw-rw-r--. 1 jenkins jenkins   161868 Apr  7 05:00 karaf_1_30496_threads_after.log
-rw-rw-r--. 1 jenkins jenkins   308521 Apr  7 05:00 report.html
-rw-rw-r--. 1 jenkins jenkins  3489524 Apr  7 05:00 log.html
-rw-rw-r--. 1 jenkins jenkins 62406915 Apr  7 05:00 output.xml
-rw-rw-r--. 1 jenkins jenkins     5952 Apr  6 23:10 testplan.txt
-rw-rw-r--. 1 jenkins jenkins   182443 Apr  6 23:10 karaf_3_5765_threads_before.log
-rw-rw-r--. 1 jenkins jenkins    16419 Apr  6 23:10 ps_before.log
-rw-rw-r--. 1 jenkins jenkins   181254 Apr  6 23:10 karaf_2_5753_threads_before.log
-rw-rw-r--. 1 jenkins jenkins   182679 Apr  6 23:10 karaf_1_5776_threads_before.log
-rw-rw-r--. 1 jenkins jenkins     3106 Apr  6 23:09 post-startup-script.sh
-rw-rw-r--. 1 jenkins jenkins      252 Apr  6 23:09 startup-script.sh
-rw-rw-r--. 1 jenkins jenkins     3453 Apr  6 23:09 configuration-script.sh
-rw-rw-r--. 1 jenkins jenkins      695 Apr  6 23:09 custom_shard_config.txt
-rw-rw-r--. 1 jenkins jenkins      133 Apr  6 23:09 scriptplan.txt
-rw-rw-r--. 1 jenkins jenkins      337 Apr  6 23:09 detect_variables.env
-rw-rw-r--. 1 jenkins jenkins     2620 Apr  6 23:09 pom.xml
-rw-rw-r--. 1 jenkins jenkins       86 Apr  6 23:09 set_variables.env
-rw-rw-r--. 1 jenkins jenkins      311 Apr  6 23:09 slave_addresses.txt
-rw-rw-r--. 1 jenkins jenkins      570 Apr  6 23:08 requirements.txt
-rw-rw-r--. 1 jenkins jenkins       26 Apr  6 23:08 env.properties
-rw-rw-r--. 1 jenkins jenkins      335 Apr  6 23:06 stack-parameters.yaml
drwxrwxr-x. 7 jenkins jenkins     4096 Apr  6 23:05 test
drwxrwxr-x. 2 jenkins jenkins        6 Apr  6 23:05 test@tmp
-rw-rw-r--. 1 jenkins jenkins     1410 Apr  6 19:46 maven-metadata.xml
+ true
[controller-csit-3node-clustering-tell-all-argon] $ /bin/sh /tmp/jenkins5734467912817581981.sh
Cleaning up Robot installation...
$ ssh-agent -k
unset SSH_AUTH_SOCK;
unset SSH_AGENT_PID;
echo Agent pid 5294 killed;
[ssh-agent] Stopped.
Recording plot data
Robot results publisher started...
INFO: Checking test criticality is deprecated and will be dropped in a future release!
-Parsing output xml:
Done!
-Copying log files to build dir:
Done!
-Assigning results to build:
Done!
-Checking thresholds:
Done!
Done publishing Robot results.
Build step 'Publish Robot Framework test results' changed build result to UNSTABLE
[PostBuildScript] - [INFO] Executing post build scripts.
[controller-csit-3node-clustering-tell-all-argon] $ /bin/bash /tmp/jenkins17592144900658746532.sh
Archiving csit artifacts
mv: cannot stat '*_1.png': No such file or directory
mv: cannot stat '/tmp/odl1_*': No such file or directory
mv: cannot stat '*_2.png': No such file or directory
mv: cannot stat '/tmp/odl2_*': No such file or directory
mv: cannot stat '*_3.png': No such file or directory
mv: cannot stat '/tmp/odl3_*': No such file or directory
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed

  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100  392k    0  392k    0     0  3111k      0 --:--:-- --:--:-- --:--:-- 3086k
100 4712k    0 4712k    0     0  4188k      0 --:--:--  0:00:01 --:--:-- 4184k
100 4898k    0 4898k    0     0  4289k      0 --:--:--  0:00:01 --:--:-- 4286k
Archive:  robot-plugin.zip
  inflating: ./archives/robot-plugin/log.html  
  inflating: ./archives/robot-plugin/output.xml  
  inflating: ./archives/robot-plugin/report.html  
mv: cannot stat '*.log.gz': No such file or directory
mv: cannot stat '*.csv': No such file or directory
mv: cannot stat '*.png': No such file or directory
[PostBuildScript] - [INFO] Executing post build scripts.
[controller-csit-3node-clustering-tell-all-argon] $ /bin/bash /tmp/jenkins13028343192657302075.sh
[PostBuildScript] - [INFO] Executing post build scripts.
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties content 
OS_CLOUD=vex
OS_STACK_NAME=releng-controller-csit-3node-clustering-tell-all-argon-80

[EnvInject] - Variables injected successfully.
provisioning config files...
copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
[controller-csit-3node-clustering-tell-all-argon] $ /bin/bash /tmp/jenkins7968793418350525763.sh
---> openstack-stack-delete.sh
Setup pyenv:
  system
  3.8.13
  3.9.13
  3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-argon/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-KFYn from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes python-heatclient python-openstackclient 
lf-activate-venv(): INFO: Adding /tmp/venv-KFYn/bin to PATH
INFO: Retrieving stack cost for: releng-controller-csit-3node-clustering-tell-all-argon-80
DEBUG: Successfully retrieved stack cost: total: 1.98
INFO: Deleting stack releng-controller-csit-3node-clustering-tell-all-argon-80
Successfully deleted stack releng-controller-csit-3node-clustering-tell-all-argon-80
[PostBuildScript] - [INFO] Executing post build scripts.
[controller-csit-3node-clustering-tell-all-argon] $ /bin/bash /tmp/jenkins12021373811122672648.sh
---> sysstat.sh
[controller-csit-3node-clustering-tell-all-argon] $ /bin/bash /tmp/jenkins12755458665365006271.sh
---> package-listing.sh
++ tr '[:upper:]' '[:lower:]'
++ facter osfamily
+ OS_FAMILY=redhat
+ workspace=/w/workspace/controller-csit-3node-clustering-tell-all-argon
+ START_PACKAGES=/tmp/packages_start.txt
+ END_PACKAGES=/tmp/packages_end.txt
+ DIFF_PACKAGES=/tmp/packages_diff.txt
+ PACKAGES=/tmp/packages_start.txt
+ '[' /w/workspace/controller-csit-3node-clustering-tell-all-argon ']'
+ PACKAGES=/tmp/packages_end.txt
+ case "${OS_FAMILY}" in
+ rpm -qa
+ sort
+ '[' -f /tmp/packages_start.txt ']'
+ '[' -f /tmp/packages_end.txt ']'
+ diff /tmp/packages_start.txt /tmp/packages_end.txt
+ '[' /w/workspace/controller-csit-3node-clustering-tell-all-argon ']'
+ mkdir -p /w/workspace/controller-csit-3node-clustering-tell-all-argon/archives/
+ cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/controller-csit-3node-clustering-tell-all-argon/archives/
[controller-csit-3node-clustering-tell-all-argon] $ /bin/bash /tmp/jenkins2375654977795797099.sh
---> capture-instance-metadata.sh
Setup pyenv:
  system
  3.8.13
  3.9.13
  3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-argon/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-KFYn from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: lftools 
lf-activate-venv(): INFO: Adding /tmp/venv-KFYn/bin to PATH
INFO: Running in OpenStack, capturing instance metadata
[controller-csit-3node-clustering-tell-all-argon] $ /bin/bash /tmp/jenkins17215509919256677015.sh
provisioning config files...
Could not find credentials [logs] for controller-csit-3node-clustering-tell-all-argon #80
copy managed file [jenkins-log-archives-settings] to file:/w/workspace/controller-csit-3node-clustering-tell-all-argon@tmp/config10714182694420856591tmp
Regular expression run condition: Expression=[^.*logs-s3.*], Label=[odl-logs-s3-cloudfront-index]
Run condition [Regular expression match] enabling perform for step [Provide Configuration files]
provisioning config files...
copy managed file [jenkins-s3-log-ship] to file:/home/jenkins/.aws/credentials
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties content 
SERVER_ID=logs

[EnvInject] - Variables injected successfully.
[controller-csit-3node-clustering-tell-all-argon] $ /bin/bash /tmp/jenkins1543422461585748969.sh
---> create-netrc.sh
WARN: Log server credential not found.
[controller-csit-3node-clustering-tell-all-argon] $ /bin/bash /tmp/jenkins209873902736488019.sh
---> python-tools-install.sh
Setup pyenv:
  system
  3.8.13
  3.9.13
  3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-argon/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-KFYn from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: lftools 
lf-activate-venv(): INFO: Adding /tmp/venv-KFYn/bin to PATH
[controller-csit-3node-clustering-tell-all-argon] $ /bin/bash /tmp/jenkins8383464318806103252.sh
---> sudo-logs.sh
Archiving 'sudo' log..
[controller-csit-3node-clustering-tell-all-argon] $ /bin/bash /tmp/jenkins1200487332091314788.sh
---> job-cost.sh
Setup pyenv:
  system
  3.8.13
  3.9.13
  3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-argon/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-KFYn from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 
lf-activate-venv(): INFO: Adding /tmp/venv-KFYn/bin to PATH
DEBUG: total: 1.98
INFO: Retrieving Stack Cost...
INFO: Retrieving Pricing Info for: v3-standard-2
INFO: Archiving Costs
[controller-csit-3node-clustering-tell-all-argon] $ /bin/bash -l /tmp/jenkins15522244321936016548.sh
---> logs-deploy.sh
Setup pyenv:
  system
  3.8.13
  3.9.13
  3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-argon/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-KFYn from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: lftools 
lf-activate-venv(): INFO: Adding /tmp/venv-KFYn/bin to PATH
WARNING: Nexus logging server not set
INFO: S3 path logs/releng/vex-yul-odl-jenkins-1/controller-csit-3node-clustering-tell-all-argon/80/
INFO: archiving logs to S3
---> uname -a:
Linux prd-centos8-robot-2c-8g-5480.novalocal 4.18.0-547.el8.x86_64 #1 SMP Wed Mar 20 00:35:01 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux


---> lscpu:
Architecture:        x86_64
CPU op-mode(s):      32-bit, 64-bit
Byte Order:          Little Endian
CPU(s):              2
On-line CPU(s) list: 0,1
Thread(s) per core:  1
Core(s) per socket:  1
Socket(s):           2
NUMA node(s):        1
Vendor ID:           AuthenticAMD
CPU family:          23
Model:               49
Model name:          AMD EPYC-Rome Processor
Stepping:            0
CPU MHz:             2799.998
BogoMIPS:            5599.99
Virtualization:      AMD-V
Hypervisor vendor:   KVM
Virtualization type: full
L1d cache:           32K
L1i cache:           32K
L2 cache:            512K
L3 cache:            16384K
NUMA node0 CPU(s):   0,1
Flags:               fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities


---> nproc:
2


---> df -h:
Filesystem      Size  Used Avail Use% Mounted on
devtmpfs        3.8G     0  3.8G   0% /dev
tmpfs           3.8G     0  3.8G   0% /dev/shm
tmpfs           3.8G   17M  3.8G   1% /run
tmpfs           3.8G     0  3.8G   0% /sys/fs/cgroup
/dev/vda1        40G  9.6G   31G  24% /
tmpfs           770M     0  770M   0% /run/user/1001


---> free -m:
              total        used        free      shared  buff/cache   available
Mem:           7697         615        4654          19        2427        6784
Swap:          1023           0        1023


---> ip addr:
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host 
       valid_lft forever preferred_lft forever
2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1458 qdisc mq state UP group default qlen 1000
    link/ether fa:16:3e:7f:c7:3a brd ff:ff:ff:ff:ff:ff
    altname enp0s3
    altname ens3
    inet 10.30.170.206/23 brd 10.30.171.255 scope global dynamic noprefixroute eth0
       valid_lft 64930sec preferred_lft 64930sec
    inet6 fe80::f816:3eff:fe7f:c73a/64 scope link 
       valid_lft forever preferred_lft forever


---> sar -b -r -n DEV:
Linux 4.18.0-547.el8.x86_64 (prd-centos8-robot-2c-8g-5480.novalocal) 	04/07/2024 	_x86_64_	(2 CPU)

12:00:01 AM       tps      rtps      wtps   bread/s   bwrtn/s
12:01:01 AM      1.12      0.02      1.10      0.13    224.34
12:02:01 AM      0.45      0.07      0.38      1.73      7.41
12:03:01 AM      0.22      0.00      0.22      0.00      4.82
12:04:01 AM      0.10      0.00      0.10      0.00      1.05
12:05:01 AM      0.22      0.00      0.22      0.00      5.17
12:06:01 AM      0.22      0.00      0.22      0.00      2.82
12:07:01 AM      0.25      0.02      0.23      0.53      5.50
12:08:01 AM      0.38      0.05      0.33      7.06      8.81
12:09:01 AM      0.77      0.30      0.47      6.40     12.03
12:10:01 AM      0.95      0.00      0.95      0.00     23.41
12:11:01 AM      0.55      0.00      0.55      0.00      7.82
12:12:01 AM      0.48      0.00      0.48      0.00      6.50
12:13:01 AM      0.38      0.00      0.38      0.00      4.57
12:14:01 AM      0.35      0.00      0.35      0.00      5.07
12:15:01 AM      0.33      0.00      0.33      0.00     10.58
12:16:01 AM      0.25      0.00      0.25      0.00     17.15
12:17:01 AM      0.28      0.00      0.28      0.00     13.88
12:18:01 AM      0.20      0.00      0.20      0.00     11.58
12:19:01 AM      0.13      0.00      0.13      0.00     13.61
12:20:01 AM      0.20      0.00      0.20      0.00     14.35
12:21:01 AM      0.50      0.00      0.50      0.00     15.53
12:22:01 AM      0.15      0.00      0.15      0.00      5.73
12:23:01 AM      0.10      0.00      0.10      0.00      0.68
12:24:01 AM      0.15      0.00      0.15      0.00      1.52
12:25:01 AM      0.20      0.00      0.20      0.00     13.53
12:26:01 AM      0.27      0.00      0.27      0.00     11.26
12:27:01 AM      0.25      0.00      0.25      0.00     17.48
12:28:01 AM      0.15      0.00      0.15      0.00     15.46
12:29:01 AM      0.27      0.00      0.27      0.00      8.53
12:30:01 AM      0.57      0.00      0.57      0.00     23.63
12:31:01 AM      0.60      0.00      0.60      0.00     19.83
12:32:01 AM      0.15      0.00      0.15      0.00     15.73
12:33:01 AM      0.12      0.00      0.12      0.00      1.73
12:34:01 AM      0.32      0.00      0.32      0.00      3.52
12:35:01 AM      0.37      0.00      0.37      0.00      8.92
12:36:01 AM      0.12      0.00      0.12      0.00      1.05
12:37:01 AM      0.17      0.00      0.17      0.00      3.88
12:38:01 AM      0.12      0.00      0.12      0.00      1.17
12:39:01 AM      0.13      0.00      0.13      0.00      6.95
12:40:01 AM      0.53      0.00      0.53      0.00     10.48
12:41:01 AM      0.55      0.00      0.55      0.00      7.85
12:42:01 AM      0.30      0.00      0.30      0.00      4.75
12:43:01 AM      0.33      0.00      0.33      0.00      5.58
12:44:01 AM      0.13      0.00      0.13      0.00     15.61
12:45:01 AM      0.33      0.00      0.33      0.00     17.70
12:46:01 AM      0.18      0.00      0.18      0.00     11.18
12:47:01 AM      0.15      0.00      0.15      0.00     15.73
12:48:01 AM      0.17      0.00      0.17      0.00     13.90
12:49:01 AM      0.13      0.00      0.13      0.00      7.33
12:50:01 AM      0.42      0.00      0.42      0.00     13.61
12:51:01 AM      0.28      0.00      0.28      0.00      7.23
12:52:01 AM      0.20      0.00      0.20      0.00     17.36
12:53:01 AM      0.90      0.00      0.90      0.00     27.21
12:54:01 AM      0.22      0.00      0.22      0.00     11.50
12:55:01 AM      0.33      0.00      0.33      0.00     21.48
12:56:01 AM      0.32      0.00      0.32      0.00     14.28
12:57:01 AM      0.18      0.00      0.18      0.00     11.58
12:58:02 AM      0.15      0.00      0.15      0.00     11.46
12:59:01 AM      0.12      0.00      0.12      0.00      8.20
01:00:01 AM      0.28      0.03      0.25      0.27     18.03
01:01:01 AM      0.47      0.00      0.47      0.00     20.41
01:02:01 AM      0.28      0.00      0.28      0.00     14.71
01:03:01 AM      0.12      0.00      0.12      0.00      8.13
01:04:01 AM      0.32      0.00      0.32      0.00     18.64
01:05:01 AM      0.37      0.00      0.37      0.00     24.75
01:06:01 AM      0.37      0.00      0.37      0.00      6.86
01:07:01 AM      0.38      0.00      0.38      0.00      4.42
01:08:01 AM      0.32      0.00      0.32      0.00      6.66
01:09:01 AM      0.17      0.00      0.17      0.00      1.98
01:10:01 AM      0.12      0.00      0.12      0.00      1.38
01:11:01 AM      0.48      0.00      0.48      0.00      8.32
01:12:01 AM      0.38      0.00      0.38      0.00      7.86
01:13:01 AM      0.37      0.00      0.37      0.00      7.90
01:14:01 AM      0.33      0.00      0.33      0.00      6.00
01:15:01 AM      0.38      0.00      0.38      0.00      4.05
01:16:01 AM      0.42      0.00      0.42      0.00      7.47
01:17:01 AM      0.28      0.00      0.28      0.00     14.55
01:18:01 AM      0.48      0.00      0.48      0.00     16.01
01:19:01 AM      0.53      0.00      0.53      0.00     16.94
01:20:01 AM      0.65      0.00      0.65      0.00     18.49
01:21:01 AM      0.58      0.00      0.58      0.00     15.33
01:22:01 AM      0.17      0.00      0.17      0.00     14.43
01:23:01 AM      0.13      0.00      0.13      0.00     11.33
01:24:01 AM      0.13      0.00      0.13      0.00      7.90
01:25:01 AM      0.35      0.00      0.35      0.00     14.36
01:26:01 AM      0.32      0.00      0.32      0.00     17.25
01:27:01 AM      0.22      0.00      0.22      0.00     13.31
01:28:01 AM      0.22      0.00      0.22      0.00      9.30
01:29:01 AM      0.18      0.00      0.18      0.00     14.81
01:30:01 AM      0.17      0.00      0.17      0.00     14.10
01:31:01 AM      0.30      0.00      0.30      0.00     15.88
01:32:01 AM      0.17      0.00      0.17      0.00     13.33
01:33:01 AM      0.15      0.00      0.15      0.00      1.87
01:34:01 AM      0.13      0.00      0.13      0.00      3.73
01:35:01 AM      0.25      0.00      0.25      0.00      3.25
01:36:01 AM      0.30      0.00      0.30      0.00      4.48
01:37:01 AM      0.23      0.00      0.23      0.00      5.23
01:38:01 AM      0.10      0.00      0.10      0.00      0.77
01:39:01 AM      0.13      0.00      0.13      0.00      8.00
01:40:01 AM      0.15      0.00      0.15      0.00      3.52
01:41:01 AM      0.23      0.00      0.23      0.00      3.55
01:42:01 AM      0.32      0.00      0.32      0.00      4.03
01:43:01 AM      0.22      0.00      0.22      0.00      4.83
01:44:01 AM      0.10      0.00      0.10      0.00      0.78
01:45:01 AM      0.32      0.00      0.32      0.00      7.96
01:46:01 AM      0.12      0.00      0.12      0.00      0.92
01:47:01 AM      0.15      0.00      0.15      0.00      4.65
01:48:01 AM      0.15      0.00      0.15      0.00      1.10
01:49:01 AM      0.17      0.00      0.17      0.00      4.55
01:50:01 AM      0.25      0.00      0.25      0.00      4.33
01:51:01 AM      0.27      0.00      0.27      0.00      5.50
01:52:01 AM      0.25      0.00      0.25      0.00      3.62
01:53:01 AM      0.13      0.00      0.13      0.00      3.62
01:54:01 AM      0.15      0.00      0.15      0.00      1.48
01:55:01 AM      1.10      0.00      1.10      0.00     21.93
01:56:01 AM      0.38      0.00      0.38      0.00     21.81
01:57:01 AM      0.28      0.00      0.28      0.00     14.55
01:58:01 AM      0.20      0.00      0.20      0.00     10.68
01:59:01 AM      0.13      0.00      0.13      0.00     15.06
02:00:01 AM      0.30      0.00      0.30      0.00     17.19
02:01:01 AM      0.30      0.00      0.30      0.00     10.53
02:02:02 AM      0.25      0.00      0.25      0.00     10.76
02:03:01 AM      0.19      0.00      0.19      0.00      5.97
02:04:01 AM      0.12      0.00      0.12      0.00      0.77
02:05:01 AM      0.28      0.00      0.28      0.00      7.97
02:06:01 AM      0.17      0.00      0.17      0.00      2.12
02:07:01 AM      0.15      0.00      0.15      0.00      4.15
02:08:01 AM      0.15      0.00      0.15      0.00      1.47
02:09:01 AM      0.25      0.00      0.25      0.00      5.88
02:10:01 AM      0.28      0.00      0.28      0.00      4.18
02:11:01 AM      0.27      0.00      0.27      0.00      7.36
02:12:01 AM      0.22      0.00      0.22      0.00      3.78
02:13:01 AM      0.22      0.00      0.22      0.00      5.85
02:14:01 AM      0.15      0.00      0.15      0.00      1.62
02:15:01 AM      0.18      0.00      0.18      0.00      2.22
02:16:01 AM      0.35      0.00      0.35      0.00     17.86
02:17:01 AM      0.25      0.00      0.25      0.00     14.68
02:18:01 AM      0.13      0.00      0.13      0.00      9.20
02:19:01 AM      0.13      0.00      0.13      0.00     14.13
02:20:01 AM      0.22      0.00      0.22      0.00     15.60
02:21:01 AM      0.28      0.00      0.28      0.00     16.34
02:22:01 AM      0.17      0.00      0.17      0.00      8.27
02:23:01 AM      0.22      0.00      0.22      0.00      5.98
02:24:01 AM      0.20      0.00      0.20      0.00      2.43
02:25:01 AM      0.17      0.00      0.17      0.00      4.75
02:26:01 AM      0.23      0.00      0.23      0.00      3.48
02:27:01 AM      0.15      0.00      0.15      0.00      4.52
02:28:01 AM      0.12      0.00      0.12      0.00      1.18
02:29:01 AM      0.22      0.00      0.22      0.00      5.60
02:30:01 AM      0.20      0.00      0.20      0.00      2.37
02:31:01 AM      0.37      0.00      0.37      0.00      8.70
02:32:01 AM      0.25      0.00      0.25      0.00      3.50
02:33:01 AM      0.12      0.00      0.12      0.00      4.25
02:34:01 AM      0.13      0.00      0.13      0.00      1.58
02:35:01 AM      0.15      0.00      0.15      0.00      1.10
02:36:01 AM      0.23      0.00      0.23      0.00     14.86
02:37:01 AM      0.15      0.00      0.15      0.00     14.28
02:38:01 AM      0.17      0.00      0.17      0.00     14.95
02:39:01 AM      0.10      0.00      0.10      0.00      7.60
02:40:01 AM      0.27      0.00      0.27      0.00     15.24
02:41:01 AM      0.30      0.00      0.30      0.00     17.83
02:42:01 AM      0.20      0.00      0.20      0.00      9.88
02:43:01 AM      0.13      0.00      0.13      0.00      5.05
02:44:01 AM      0.10      0.00      0.10      0.00      0.63
02:45:01 AM      0.17      0.00      0.17      0.00      4.98
02:46:01 AM      0.22      0.00      0.22      0.00      3.37
02:47:01 AM      0.28      0.00      0.28      0.00      6.80
02:48:01 AM      0.18      0.00      0.18      0.00      2.42
02:49:01 AM      0.17      0.00      0.17      0.00      4.28
02:50:01 AM      0.18      0.00      0.18      0.00      2.05
02:51:01 AM      0.22      0.00      0.22      0.00      6.33
02:52:01 AM      0.17      0.00      0.17      0.00      2.50
02:53:01 AM      0.17      0.00      0.17      0.00      4.82
02:54:01 AM      0.25      0.00      0.25      0.00      3.07
02:55:01 AM      0.20      0.00      0.20      0.00      9.78
02:56:01 AM      0.33      0.00      0.33      0.00     13.88
02:57:01 AM      0.13      0.00      0.13      0.00      8.13
02:58:01 AM      0.22      0.00      0.22      0.00     18.81
02:59:01 AM      0.18      0.00      0.18      0.00      7.40
03:00:01 AM      0.30      0.00      0.30      0.00     17.33
03:01:01 AM      0.32      0.00      0.32      0.00     17.76
03:02:01 AM      0.25      0.00      0.25      0.00     25.74
03:03:01 AM      0.12      0.00      0.12      0.00      4.55
03:04:01 AM      0.17      0.00      0.17      0.00      1.58
03:05:01 AM      0.27      0.00      0.27      0.00      7.15
03:06:01 AM      0.37      0.00      0.37      0.00      4.13
03:07:01 AM      0.33      0.00      0.33      0.00      5.83
03:08:01 AM      0.22      0.00      0.22      0.00      2.90
03:09:01 AM      0.15      0.00      0.15      0.00      1.45
03:10:01 AM      0.30      0.00      0.30      0.00     10.61
03:11:02 AM      0.17      0.00      0.17      0.00      5.40
03:12:01 AM      0.20      0.00      0.20      0.00      2.69
03:13:01 AM      0.10      0.00      0.10      0.00      0.78
03:14:01 AM      0.13      0.00      0.13      0.00     11.33
03:15:01 AM      0.42      0.00      0.42      0.00     19.58
03:16:01 AM      0.18      0.00      0.18      0.00      8.95
03:17:01 AM      0.18      0.00      0.18      0.00     16.00
03:18:01 AM      0.13      0.00      0.13      0.00     13.06
03:19:01 AM      0.23      0.00      0.23      0.00     14.13
03:20:01 AM      0.58      0.00      0.58      0.00     15.08
03:21:01 AM      0.42      0.00      0.42      0.00      8.18
03:22:01 AM      0.58      0.00      0.58      0.00     14.65
03:23:01 AM      0.47      0.00      0.47      0.00     15.66
03:24:01 AM      0.20      0.00      0.20      0.00     10.68
03:25:01 AM      0.22      0.00      0.22      0.00     15.28
03:26:01 AM      0.23      0.00      0.23      0.00     10.95
03:27:01 AM      0.18      0.00      0.18      0.00     15.98
03:28:01 AM      0.17      0.00      0.17      0.00     12.11
03:29:01 AM      0.12      0.00      0.12      0.00      8.80
03:30:01 AM      0.17      0.00      0.17      0.00     11.93
03:31:01 AM      0.42      0.00      0.42      0.00     20.53
03:32:01 AM      0.25      0.00      0.25      0.00     16.43
03:33:01 AM      0.20      0.00      0.20      0.00     12.25
03:34:01 AM      0.15      0.00      0.15      0.00     15.50
03:35:01 AM      0.22      0.00      0.22      0.00      9.43
03:36:01 AM      0.23      0.00      0.23      0.00     24.74
03:37:01 AM      3.52      0.07      3.45      3.33   1632.76
03:38:01 AM      0.67      0.00      0.67      0.00    147.61
03:39:01 AM      0.30      0.00      0.30      0.00      6.25
03:40:01 AM      0.22      0.00      0.22      0.00      2.07
03:41:01 AM      0.23      0.00      0.23      0.00      5.93
03:42:01 AM      0.20      0.00      0.20      0.00      2.70
03:43:01 AM      0.15      0.00      0.15      0.00      1.47
03:44:01 AM      0.23      0.00      0.23      0.00     10.38
03:45:01 AM      0.22      0.00      0.22      0.00      7.56
03:46:01 AM      0.17      0.00      0.17      0.00      3.07
03:47:01 AM      0.12      0.00      0.12      0.00      3.10
03:48:01 AM      0.17      0.00      0.17      0.00      3.08
03:49:01 AM      0.13      0.00      0.13      0.00      4.40
03:50:01 AM      0.15      0.00      0.15      0.00      3.15
03:51:01 AM      0.35      0.00      0.35      0.00     10.06
03:52:01 AM      0.27      0.00      0.27      0.00      3.73
03:53:01 AM      0.13      0.00      0.13      0.00     10.66
03:54:01 AM      0.17      0.00      0.17      0.00      9.98
03:55:01 AM      0.23      0.00      0.23      0.00     14.73
03:56:01 AM      0.25      0.00      0.25      0.00     17.39
03:57:01 AM      0.20      0.00      0.20      0.00     15.75
03:58:01 AM      0.12      0.00      0.12      0.00      7.10
03:59:01 AM      0.18      0.00      0.18      0.00     15.11
04:00:01 AM      0.18      0.00      0.18      0.00     21.65
04:01:01 AM      0.30      0.00      0.30      0.00      5.23
04:02:01 AM      0.20      0.00      0.20      0.00      2.65
04:03:01 AM      0.12      0.00      0.12      0.00      3.60
04:04:01 AM      0.12      0.00      0.12      0.00      1.17
04:05:01 AM      0.23      0.00      0.23      0.00      5.23
04:06:01 AM      0.28      0.00      0.28      0.00      4.33
04:07:01 AM      0.12      0.00      0.12      0.00      6.38
04:08:01 AM      0.15      0.00      0.15      0.00      2.70
04:09:01 AM      0.25      0.00      0.25      0.00      7.48
04:10:01 AM      0.47      0.00      0.47      0.00      5.43
04:11:01 AM      0.43      0.00      0.43      0.00      8.93
04:12:01 AM      0.52      0.00      0.52      0.00      8.37
04:13:01 AM      0.42      0.00      0.42      0.00      7.47
04:14:01 AM      0.37      0.00      0.37      0.00      8.68
04:15:01 AM      0.47      0.00      0.47      0.00      6.12
04:16:01 AM      0.25      0.00      0.25      0.00      6.50
04:17:01 AM      0.17      0.00      0.17      0.00     11.46
04:18:02 AM      0.13      0.00      0.13      0.00      8.00
04:19:01 AM      0.24      0.00      0.24      0.00     17.10
04:20:01 AM      0.30      0.00      0.30      0.00     17.86
04:21:01 AM      0.25      0.00      0.25      0.00     10.41
04:22:01 AM      0.27      0.00      0.27      0.00     18.53
04:23:01 AM      0.18      0.00      0.18      0.00     27.06
04:24:01 AM      0.12      0.00      0.12      0.00      4.67
04:25:01 AM      0.25      0.00      0.25      0.00      4.62
04:26:01 AM      0.15      0.00      0.15      0.00      1.35
04:27:01 AM      0.18      0.00      0.18      0.00      4.40
04:28:01 AM      0.10      0.00      0.10      0.00      0.65
04:29:01 AM      0.23      0.00      0.23      0.00      5.70
04:30:01 AM      0.30      0.00      0.30      0.00      5.02
04:31:01 AM      0.17      0.00      0.17      0.00      6.97
04:32:01 AM      0.18      0.00      0.18      0.00      8.55
04:33:01 AM      0.30      0.00      0.30      0.00      4.22
04:34:01 AM      0.37      0.00      0.37      0.00      5.32
04:35:01 AM      0.38      0.00      0.38      0.00      4.55
04:36:01 AM      0.37      0.00      0.37      0.00      6.12
04:37:01 AM      0.32      0.00      0.32      0.00      9.67
04:38:01 AM      0.20      0.00      0.20      0.00      3.05
04:39:01 AM      0.15      0.00      0.15      0.00      6.37
04:40:01 AM      0.22      0.00      0.22      0.00     13.66
04:41:01 AM      0.32      0.00      0.32      0.00     15.53
04:42:01 AM      0.35      0.00      0.35      0.00     15.06
04:43:01 AM      0.53      0.00      0.53      0.00     15.31
04:44:01 AM      0.55      0.00      0.55      0.00     18.00
04:45:01 AM      0.55      0.00      0.55      0.00     16.84
04:46:01 AM      0.43      0.00      0.43      0.00     24.88
04:47:01 AM      0.28      0.00      0.28      0.00      7.85
04:48:01 AM      0.18      0.00      0.18      0.00      2.33
04:49:01 AM      0.13      0.00      0.13      0.00      0.93
04:50:01 AM      0.18      0.00      0.18      0.00      4.72
04:51:01 AM      0.37      0.00      0.37      0.00      5.40
04:52:01 AM      0.22      0.00      0.22      0.00      5.50
04:53:01 AM      0.15      0.00      0.15      0.00      1.45
04:54:01 AM      0.13      0.00      0.13      0.00      7.46
04:55:01 AM      0.40      0.00      0.40      0.00     15.56
04:56:01 AM      0.18      0.00      0.18      0.00      4.43
04:57:01 AM      0.12      0.00      0.12      0.00      6.67
04:58:01 AM      0.15      0.00      0.15      0.00     20.39
04:59:01 AM      0.20      0.00      0.20      0.00      8.13
05:00:01 AM      0.37      0.00      0.37      0.00     12.01
05:01:01 AM      8.46      0.20      8.26     31.06    390.84
05:02:01 AM     26.72      0.43     26.28     49.17   3695.00
Average:         0.39      0.00      0.38      0.33     29.17

12:00:01 AM kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty
12:01:01 AM   4801856   7014588   3080576     39.08      2688   2381944    717488      8.03    355788   2348368        24
12:02:01 AM   4802360   7015264   3080072     39.08      2688   2382116    717488      8.03    355860   2348088        80
12:03:01 AM   4802676   7015580   3079756     39.07      2688   2382116    717488      8.03    355860   2347972         4
12:04:01 AM   4802084   7015068   3080348     39.08      2688   2382196    717488      8.03    355860   2348324        88
12:05:01 AM   4802280   7015268   3080152     39.08      2688   2382200    717488      8.03    355860   2348132         4
12:06:01 AM   4802240   7015304   3080192     39.08      2688   2382276    717488      8.03    355860   2348332        88
12:07:01 AM   4801696   7014760   3080736     39.08      2688   2382276    708684      7.94    355860   2348708         4
12:08:01 AM   4801984   7015388   3080448     39.08      2688   2382624    710524      7.96    355944   2348436         4
12:09:01 AM   4799644   7013264   3082788     39.11      2688   2382956    710524      7.96    355944   2350820        40
12:10:01 AM   4799260   7013148   3083172     39.11      2688   2383108    716900      8.03    356068   2350988         4
12:11:01 AM   4799380   7013280   3083052     39.11      2688   2383116    716900      8.03    356068   2350960         4
12:12:01 AM   4799532   7013448   3082900     39.11      2688   2383132    716900      8.03    356068   2350904         4
12:13:01 AM   4799484   7013412   3082948     39.11      2688   2383144    716900      8.03    356068   2350916         4
12:14:01 AM   4799332   7013300   3083100     39.11      2688   2383184    716900      8.03    356068   2350956         4
12:15:01 AM   4799064   7013308   3083368     39.12      2688   2383460    716900      8.03    356068   2351272        72
12:16:01 AM   4798220   7012824   3084212     39.13      2688   2383820    732648      8.20    356068   2351948        32
12:17:01 AM   4798092   7013044   3084340     39.13      2688   2384176    732648      8.20    356068   2352144        64
12:18:01 AM   4798068   7013340   3084364     39.13      2688   2384488    716232      8.02    356068   2352360        96
12:19:01 AM   4797408   7013028   3085024     39.14      2688   2384836    716232      8.02    356068   2352868        64
12:20:01 AM   4796780   7012752   3085652     39.15      2688   2385196    716852      8.03    356068   2353340        40
12:21:01 AM   4796836   7013100   3085596     39.15      2688   2385480    716852      8.03    356180   2353492        84
12:22:01 AM   4796836   7013164   3085596     39.15      2688   2385544    716852      8.03    356180   2353492         4
12:23:01 AM   4796896   7013232   3085536     39.14      2688   2385552    716852      8.03    356180   2353504        16
12:24:01 AM   4796148   7012688   3086284     39.15      2688   2385756    716852      8.03    356180   2354060       208
12:25:01 AM   4795048   7011780   3087384     39.17      2688   2385948    716852      8.03    356180   2354932        40
12:26:01 AM   4793500   7010588   3088932     39.19      2688   2386304    716852      8.03    356180   2356584       168
12:27:01 AM   4792636   7010080   3089796     39.20      2688   2386668    716852      8.03    356180   2357540        96
12:28:01 AM   4792400   7010204   3090032     39.20      2688   2387020    716852      8.03    356180   2357624        16
12:29:01 AM   4792320   7010440   3090112     39.20      2688   2387336    716852      8.03    356208   2357972       176
12:30:01 AM   4791292   7009760   3091140     39.22      2688   2387688    737856      8.26    356208   2358684         0
12:31:01 AM   4791048   7010200   3091384     39.22      2688   2388380    737856      8.26    356208   2359100       328
12:32:01 AM   4790828   7010108   3091604     39.22      2688   2388500    737856      8.26    356208   2359420        16
12:33:01 AM   4790736   7010020   3091696     39.22      2688   2388504    737856      8.26    356208   2359376         4
12:34:01 AM   4790708   7010068   3091724     39.22      2688   2388580    737856      8.26    356212   2359364        92
12:35:01 AM   4790648   7010008   3091784     39.22      2688   2388580    737856      8.26    356208   2359572         4
12:36:01 AM   4790616   7009980   3091816     39.22      2688   2388592    737856      8.26    356208   2359436        16
12:37:01 AM   4790704   7010148   3091728     39.22      2688   2388664    737856      8.26    356208   2359432         4
12:38:01 AM   4790740   7010184   3091692     39.22      2688   2388664    737856      8.26    356208   2359452         4
12:39:01 AM   4790728   7010360   3091704     39.22      2688   2388852    737856      8.26    356208   2359536        16
12:40:01 AM   4790172   7009904   3092260     39.23      2688   2388952    737856      8.26    356212   2359688         4
12:41:01 AM   4789936   7009676   3092496     39.23      2688   2388956    737856      8.26    356208   2360060         4
12:42:01 AM   4790164   7009952   3092268     39.23      2688   2389004    737856      8.26    356208   2359964        16
12:43:01 AM   4789904   7009876   3092528     39.23      2688   2389196    737856      8.26    356208   2360332       144
12:44:01 AM   4789836   7010172   3092596     39.23      2688   2389552    737856      8.26    356208   2360388        72
12:45:01 AM   4789276   7009952   3093156     39.24      2688   2389892    721792      8.08    356208   2360800        32
12:46:01 AM   4788948   7009976   3093484     39.25      2688   2390252    721792      8.08    356208   2361268       120
12:47:01 AM   4788324   7009708   3094108     39.25      2688   2390600    721792      8.08    356208   2361660        40
12:48:01 AM   4788548   7010280   3093884     39.25      2688   2390948    721792      8.08    356208   2361804         4
12:49:01 AM   4788608   7010676   3093824     39.25      2688   2391284    721792      8.08    356204   2361864       164
12:50:01 AM   4788068   7010276   3094364     39.26      2688   2391424    737524      8.26    356204   2362120        96
12:51:01 AM   4788080   7010520   3094352     39.26      2688   2391656    737524      8.26    356204   2362304       232
12:52:01 AM   4787692   7010484   3094740     39.26      2688   2392008    737524      8.26    356204   2362596       128
12:53:01 AM   4787192   7010328   3095240     39.27      2688   2392360    721100      8.07    365164   2353992        56
12:54:01 AM   4786888   7010384   3095544     39.27      2688   2392712    721100      8.07    365164   2354348       192
12:55:01 AM   4786396   7010240   3096036     39.28      2688   2393060    721100      8.07    365164   2354696        32
12:56:01 AM   4786300   7010496   3096132     39.28      2688   2393420    721100      8.07    365164   2355116        64
12:57:01 AM   4785772   7010272   3096660     39.29      2688   2393716    721100      8.07    365164   2355556        88
12:58:02 AM   4785920   7010660   3096512     39.28      2688   2393956    721100      8.07    365164   2355576        16
12:59:01 AM   4785580   7010648   3096852     39.29      2688   2394284    721100      8.07    365164   2355904       128
01:00:01 AM   4783788   7009200   3098644     39.31      2688   2394628    717500      8.03    365164   2357064        24
01:01:01 AM   4783444   7009220   3098988     39.32      2688   2394988    717500      8.03    365168   2357484         4
01:02:01 AM   4784268   7010396   3098164     39.30      2688   2395348    717500      8.03    365176   2356948        64
01:03:01 AM   4783964   7010384   3098468     39.31      2688   2395632    717500      8.03    365176   2357360       128
01:04:01 AM   4783348   7010108   3099084     39.32      2688   2395972    717500      8.03    365176   2357856        16
01:05:01 AM   4783352   7010720   3099080     39.32      2688   2396580    717500      8.03    365176   2358196         4
01:06:01 AM   4782848   7010284   3099584     39.32      2688   2396652    717500      8.03    365176   2358596         4
01:07:01 AM   4782852   7010292   3099580     39.32      2688   2396656    717500      8.03    365176   2358524         4
01:08:01 AM   4782628   7010148   3099804     39.33      2688   2396736    717500      8.03    365176   2358616         4
01:09:01 AM   4782320   7009840   3100112     39.33      2688   2396736    717500      8.03    365176   2358688        16
01:10:01 AM   4782240   7009840   3100192     39.33      2688   2396816    717500      8.03    365176   2358896        84
01:11:01 AM   4782832   7010436   3099600     39.32      2688   2396816    700644      7.85    365176   2358576         4
01:12:01 AM   4782604   7010344   3099828     39.33      2688   2396952    700644      7.85    365176   2358648        56
01:13:01 AM   4782604   7010428   3099828     39.33      2688   2397036    700644      7.85    365176   2358740         4
01:14:01 AM   4782312   7010204   3100120     39.33      2688   2397104    700644      7.85    365176   2359012         4
01:15:01 AM   4782408   7010300   3100024     39.33      2688   2397104    700644      7.85    365176   2358928         4
01:16:01 AM   4782336   7010296   3100096     39.33      2688   2397172    700644      7.85    365176   2358948         8
01:17:01 AM   4782188   7010508   3100244     39.33      2688   2397540    717840      8.04    365176   2359240        24
01:18:01 AM   4781872   7010548   3100560     39.34      2688   2397896    717840      8.04    365176   2359596        24
01:19:01 AM   4781388   7010428   3101044     39.34      2688   2398252    717840      8.04    365176   2359964        24
01:20:01 AM   4780808   7010192   3101624     39.35      2688   2398596    719684      8.06    365176   2360448        32
01:21:01 AM   4780736   7010472   3101696     39.35      2688   2398956    719684      8.06    365176   2360752       184
01:22:01 AM   4780216   7010312   3102216     39.36      2688   2399308    719684      8.06    365176   2361044       136
01:23:01 AM   4780000   7010280   3102432     39.36      2688   2399492    719684      8.06    365176   2361364        12
01:24:01 AM   4781656   7012204   3100776     39.34      2688   2399756    719684      8.06    365176   2359720        80
01:25:01 AM   4781076   7011912   3101356     39.35      2688   2400052    719684      8.06    365176   2360008        56
01:26:01 AM   4781028   7012224   3101404     39.35      2688   2400404    719684      8.06    365176   2360232        16
01:27:01 AM   4780832   7012348   3101600     39.35      2688   2400724    719684      8.06    365176   2360484        80
01:28:01 AM   4780360   7012212   3102072     39.35      2688   2401068    719684      8.06    365176   2360820       144
01:29:01 AM   4779988   7012168   3102444     39.36      2688   2401396    719684      8.06    365176   2361264        80
01:30:01 AM   4779312   7011836   3103120     39.37      2688   2401732    735376      8.23    365176   2361840        32
01:31:01 AM   4779272   7012388   3103160     39.37      2688   2402332    714612      8.00    365176   2362152       288
01:32:01 AM   4778888   7012084   3103544     39.37      2688   2402404    714612      8.00    365176   2362304        16
01:33:01 AM   4778980   7012176   3103452     39.37      2688   2402404    714612      8.00    365176   2362380         4
01:34:01 AM   4778920   7012200   3103512     39.37      2688   2402488    714612      8.00    365176   2362416        16
01:35:01 AM   4778768   7012052   3103664     39.37      2688   2402492    714612      8.00    365176   2362488        12
01:36:01 AM   4778832   7012196   3103600     39.37      2688   2402572    714612      8.00    365176   2362548        92
01:37:01 AM   4778944   7012308   3103488     39.37      2688   2402572    714612      8.00    365176   2362364         4
01:38:01 AM   4778896   7012380   3103536     39.37      2688   2402708    714612      8.00    365176   2362488       140
01:39:01 AM   4776696   7010276   3105736     39.40      2688   2402788    729992      8.17    365176   2364632         4
01:40:01 AM   4776108   7009760   3106324     39.41      2688   2402860    719948      8.06    365176   2364936         4
01:41:01 AM   4776392   7010048   3106040     39.40      2688   2402864    719948      8.06    365176   2364780         4
01:42:01 AM   4776360   7010088   3106072     39.40      2688   2402936    719948      8.06    365180   2364832        80
01:43:01 AM   4776540   7010268   3105892     39.40      2688   2402936    719948      8.06    365176   2364796         4
01:44:01 AM   4776324   7010132   3106108     39.41      2688   2403016    719948      8.06    365176   2364956        84
01:45:01 AM   4776360   7010168   3106072     39.40      2688   2403016    719948      8.06    365176   2364856         4
01:46:01 AM   4776288   7010176   3106144     39.41      2688   2403096    719948      8.06    365180   2365068        88
01:47:01 AM   4775784   7009676   3106648     39.41      2688   2403100    719948      8.06    365176   2365372         4
01:48:01 AM   4776268   7010248   3106164     39.41      2688   2403188    719948      8.06    365176   2365132        96
01:49:01 AM   4776316   7010296   3106116     39.41      2688   2403188    719948      8.06    365176   2365052         4
01:50:01 AM   4776104   7010164   3106328     39.41      2688   2403268    740884      8.30    365176   2365240        84
01:51:01 AM   4775908   7009968   3106524     39.41      2688   2403268    740884      8.30    365176   2365324         4
01:52:01 AM   4775980   7010124   3106452     39.41      2688   2403352    740884      8.30    365176   2365336        88
01:53:01 AM   4776096   7010240   3106336     39.41      2688   2403352    740884      8.30    365176   2365228         4
01:54:01 AM   4775968   7010112   3106464     39.41      2688   2403352    740884      8.30    365176   2365228         4
01:55:01 AM   4775808   7010192   3106624     39.41      2688   2403592    712100      7.97    366288   2364340       160
01:56:01 AM   4775512   7010252   3106920     39.42      2688   2403952    712100      7.97    366288   2364812        64
01:57:01 AM   4774832   7009920   3107600     39.42      2688   2404292    712100      7.97    366288   2365328        56
01:58:01 AM   4774512   7009932   3107920     39.43      2688   2404624    712100      7.97    366288   2365652       136
01:59:01 AM   4774276   7010048   3108156     39.43      2688   2404976    712100      7.97    366288   2366000        64
02:00:01 AM   4773736   7009860   3108696     39.44      2688   2405332    712452      7.98    366288   2366468        40
02:01:01 AM   4772344   7008828   3110088     39.46      2688   2405680    712452      7.98    366288   2367592       192
02:02:02 AM   4773056   7009692   3109376     39.45      2688   2405832    712452      7.98    366288   2366892       112
02:03:01 AM   4772980   7009620   3109452     39.45      2688   2405836    712452      7.98    366288   2366988         4
02:04:01 AM   4773188   7009828   3109244     39.45      2688   2405836    712452      7.98    366288   2366904         4
02:05:01 AM   4772996   7009728   3109436     39.45      2688   2405928    712452      7.98    366288   2367132        16
02:06:01 AM   4773368   7010104   3109064     39.44      2688   2405932    712452      7.98    366288   2366952         8
02:07:01 AM   4773292   7010120   3109140     39.44      2688   2406024    712452      7.98    366288   2366976         4
02:08:01 AM   4773404   7010232   3109028     39.44      2688   2406024    728268      8.15    366288   2366976         4
02:09:01 AM   4773032   7009956   3109400     39.45      2688   2406120    728268      8.15    366288   2367196         4
02:10:01 AM   4772948   7009872   3109484     39.45      2688   2406120    722152      8.09    366288   2367196         4
02:11:01 AM   4772360   7009380   3110072     39.46      2688   2406220    722152      8.09    366288   2367660         4
02:12:01 AM   4772068   7009088   3110364     39.46      2688   2406220    722152      8.09    366288   2367976         4
02:13:01 AM   4771136   7008248   3111296     39.47      2688   2406312    722152      8.09    366288   2368848         4
02:14:01 AM   4771224   7008340   3111208     39.47      2688   2406316    722152      8.09    366288   2368852         4
02:15:01 AM   4771008   7008236   3111424     39.47      2688   2406428    722152      8.09    366288   2369164       116
02:16:01 AM   4768696   7006268   3113736     39.50      2688   2406780    722152      8.09    366288   2371392        96
02:17:01 AM   4768316   7006176   3114116     39.51      2688   2407060    722152      8.09    366288   2371912        40
02:18:01 AM   4767944   7006164   3114488     39.51      2688   2407420    722152      8.09    366288   2372272       156
02:19:01 AM   4767604   7006160   3114828     39.52      2688   2407764    722152      8.09    366288   2372612       104
02:20:01 AM   4767024   7005940   3115408     39.52      2688   2408124    722152      8.09    366288   2373088        68
02:21:01 AM   4766796   7006056   3115636     39.53      2688   2408460    722152      8.09    366288   2373392        16
02:22:01 AM   4766456   7005988   3115976     39.53      2688   2408732    722152      8.09    366288   2373608       112
02:23:01 AM   4766364   7005900   3116068     39.53      2688   2408736    722152      8.09    366288   2373728         4
02:24:01 AM   4766340   7005876   3116092     39.53      2688   2408736    722152      8.09    366288   2373728         4
02:25:01 AM   4766540   7006168   3115892     39.53      2688   2408828    722152      8.09    366288   2373704         4
02:26:01 AM   4766468   7006100   3115964     39.53      2688   2408832    722152      8.09    366288   2373776         4
02:27:01 AM   4766440   7006164   3115992     39.53      2688   2408924    722152      8.09    366288   2373800         4
02:28:01 AM   4766472   7006196   3115960     39.53      2688   2408924    705368      7.90    366288   2373800         4
02:29:01 AM   4766444   7006264   3115988     39.53      2688   2409020    705368      7.90    366288   2373896         4
02:30:01 AM   4766080   7005900   3116352     39.54      2688   2409020    715676      8.01    366288   2374016         4
02:31:01 AM   4766108   7006028   3116324     39.54      2688   2409116    715676      8.01    366288   2374180         4
02:32:01 AM   4765916   7005836   3116516     39.54      2688   2409116    715676      8.01    366288   2374124        12
02:33:01 AM   4765624   7005636   3116808     39.54      2688   2409208    715676      8.01    366288   2374292         4
02:34:01 AM   4765836   7005852   3116596     39.54      2688   2409212    715676      8.01    366288   2374236         4
02:35:01 AM   4766036   7006160   3116396     39.54      2688   2409320    715676      8.01    366288   2374196       116
02:36:01 AM   4765608   7006108   3116824     39.54      2688   2409696    715676      8.01    366288   2374652       144
02:37:01 AM   4765392   7006244   3117040     39.54      2688   2410056    715676      8.01    366288   2374936       108
02:38:01 AM   4764896   7006092   3117536     39.55      2688   2410400    715676      8.01    366288   2375280        40
02:39:01 AM   4764364   7005920   3118068     39.56      2688   2410752    715676      8.01    366288   2375640       184
02:40:01 AM   4763852   7005752   3118580     39.56      2688   2411096    731704      8.19    366288   2376100       156
02:41:01 AM   4763648   7005904   3118784     39.57      2688   2411460    731704      8.19    366288   2376524       104
02:42:01 AM   4763528   7006036   3118904     39.57      2688   2411704    731704      8.19    366288   2376716       120
02:43:01 AM   4763304   7005812   3119128     39.57      2688   2411704    731704      8.19    366288   2376716         4
02:44:01 AM   4763232   7005832   3119200     39.57      2688   2411796    731704      8.19    366288   2376828       112
02:45:01 AM   4763096   7005700   3119336     39.57      2688   2411800    731704      8.19    366288   2376968         4
02:46:01 AM   4763528   7006132   3118904     39.57      2688   2411800    715936      8.02    366288   2376772         4
02:47:01 AM   4762984   7005680   3119448     39.57      2688   2411892    715936      8.02    366288   2377084         4
02:48:01 AM   4762852   7005552   3119580     39.58      2688   2411896    715936      8.02    366288   2377028         4
02:49:01 AM   4763140   7005932   3119292     39.57      2688   2411988    715936      8.02    366288   2377032         4
02:50:01 AM   4762932   7005724   3119500     39.58      2688   2411988    715680      8.01    366292   2377060         4
02:51:01 AM   4763088   7005980   3119344     39.57      2688   2412084    715680      8.01    366288   2377204         4
02:52:01 AM   4763036   7005928   3119396     39.57      2688   2412084    715680      8.01    366288   2377020         4
02:53:01 AM   4763040   7006028   3119392     39.57      2688   2412180    715680      8.01    366288   2377080         4
02:54:01 AM   4763044   7006032   3119388     39.57      2688   2412180    715680      8.01    366292   2377156         4
02:55:01 AM   4762872   7006096   3119560     39.58      2688   2412416    715680      8.01    366288   2377348         4
02:56:01 AM   4762400   7005928   3120032     39.58      2688   2412728    715680      8.01    366288   2377724        40
02:57:01 AM   4762096   7005984   3120336     39.59      2688   2413080    715680      8.01    366288   2378096       176
02:58:01 AM   4761932   7006152   3120500     39.59      2688   2413420    715680      8.01    366288   2378464        24
02:59:01 AM   4761720   7006296   3120712     39.59      2688   2413768    715680      8.01    366288   2378704       188
03:00:01 AM   4760972   7005908   3121460     39.60      2688   2414124    714044      8.00    366288   2379188       160
03:01:01 AM   4759688   7004972   3122744     39.62      2688   2414476    714044      8.00    366288   2380168        80
03:02:01 AM   4760084   7005988   3122348     39.61      2688   2415096    714044      8.00    366292   2380272        24
03:03:01 AM   4759656   7005652   3122776     39.62      2688   2415180    714044      8.00    366292   2380332         4
03:04:01 AM   4759816   7005812   3122616     39.61      2688   2415180    714044      8.00    366292   2380244         4
03:05:01 AM   4759956   7006036   3122476     39.61      2688   2415264    714044      8.00    366292   2380212         4
03:06:01 AM   4759804   7005884   3122628     39.62      2688   2415264    714044      8.00    366292   2380280         4
03:07:01 AM   4759892   7006048   3122540     39.61      2688   2415340    714044      8.00    366292   2380288         4
03:08:01 AM   4759892   7006052   3122540     39.61      2688   2415344    714044      8.00    366292   2380292         4
03:09:01 AM   4759708   7005988   3122724     39.62      2688   2415464    714044      8.00    366292   2380408       128
03:10:01 AM   4759340   7005716   3123092     39.62      2688   2415560    717296      8.03    366292   2380636        56
03:11:02 AM   4759456   7005904   3122976     39.62      2688   2415632    717296      8.03    366292   2380664         4
03:12:01 AM   4759312   7005760   3123120     39.62      2688   2415632    717296      8.03    366292   2380596         4
03:13:01 AM   4759328   7005844   3123104     39.62      2688   2415700    717296      8.03    366292   2380660        72
03:14:01 AM   4757288   7004116   3125144     39.65      2688   2416012    717296      8.03    366292   2382796        72
03:15:01 AM   4756872   7004048   3125560     39.65      2688   2416360    717296      8.03    366292   2383260        24
03:16:01 AM   4756608   7004132   3125824     39.66      2688   2416708    717296      8.03    366292   2383560       160
03:17:01 AM   4756236   7004104   3126196     39.66      2688   2417052    717296      8.03    366292   2383836        64
03:18:01 AM   4755880   7004080   3126552     39.66      2688   2417392    717296      8.03    366292   2384168        40
03:19:01 AM   4755564   7004112   3126868     39.67      2688   2417740    717296      8.03    366292   2384632        16
03:20:01 AM   4755328   7004136   3127104     39.67      2688   2417996    715732      8.01    366292   2384900         4
03:21:01 AM   4755052   7003976   3127380     39.68      2688   2418108    715732      8.01    366292   2385080         4
03:22:01 AM   4754848   7004036   3127584     39.68      2688   2418372    715732      8.01    366292   2385160        24
03:23:01 AM   4754608   7004148   3127824     39.68      2688   2418732    715732      8.01    366292   2385512        24
03:24:01 AM   4754188   7004088   3128244     39.69      2688   2419092    715732      8.01    366292   2385872       108
03:25:01 AM   4753900   7004164   3128532     39.69      2688   2419444    731220      8.19    366292   2386236        64
03:26:01 AM   4753460   7004068   3128972     39.70      2688   2419788    731220      8.19    366292   2386680       192
03:27:01 AM   4753324   7004284   3129108     39.70      2688   2420148    731220      8.19    366292   2386964       136
03:28:01 AM   4752828   7004076   3129604     39.70      2688   2420444    731220      8.19    366292   2387236       128
03:29:01 AM   4752636   7004116   3129796     39.71      2688   2420660    731220      8.19    366292   2387480       104
03:30:01 AM   4752232   7004056   3130200     39.71      2688   2421012    731220      8.19    366292   2387932       136
03:31:01 AM   4751760   7003944   3130672     39.72      2688   2421372    731220      8.19    366292   2388248        96
03:32:01 AM   4751328   7003872   3131104     39.72      2688   2421728    731220      8.19    366292   2388536        64
03:33:01 AM   4750852   7003752   3131580     39.73      2688   2422084    731220      8.19    366292   2389164       132
03:34:01 AM   4750800   7004044   3131632     39.73      2688   2422428    731220      8.19    366292   2389236        48
03:35:01 AM   4750444   7004048   3131988     39.73      2688   2422780    731220      8.19    366292   2389596       176
03:36:01 AM   4747544   7001716   3134888     39.77      2688   2423348    725900      8.13    366292   2392324        92
03:37:01 AM   4749064   7003364   3133368     39.75      2688   2423456    704588      7.89    377064   2379508      4076
03:38:01 AM   4748888   7003188   3133544     39.75      2688   2423456    704588      7.89    377064   2379624         4
03:39:01 AM   4749072   7003460   3133360     39.75      2688   2423544    704588      7.89    377064   2379596         4
03:40:01 AM   4748768   7003156   3133664     39.76      2688   2423544    709536      7.94    377064   2379712         4
03:41:01 AM   4749092   7003568   3133340     39.75      2688   2423628    709536      7.94    377064   2379752         4
03:42:01 AM   4749204   7003680   3133228     39.75      2688   2423628    709536      7.94    377064   2379684         4
03:43:01 AM   4749400   7004044   3133032     39.75      2688   2423796    709536      7.94    377064   2379856       176
03:44:01 AM   4749076   7003788   3133356     39.75      2688   2423864    709536      7.94    377064   2380044        24
03:45:01 AM   4749096   7003944   3133336     39.75      2688   2424000    709536      7.94    377072   2380064         4
03:46:01 AM   4749064   7003912   3133368     39.75      2688   2424000    709536      7.94    377072   2380132         4
03:47:01 AM   4748208   7003152   3134224     39.76      2688   2424096    709536      7.94    377072   2380876        48
03:48:01 AM   4748808   7003816   3133624     39.75      2688   2424160    709536      7.94    377072   2380416        56
03:49:01 AM   4748656   7003760   3133776     39.76      2688   2424256    709536      7.94    377072   2380512        48
03:50:01 AM   4747984   7003240   3134448     39.76      2688   2424408    725644      8.12    377076   2380892       136
03:51:01 AM   4748260   7003520   3134172     39.76      2688   2424412    725644      8.12    377076   2380732         4
03:52:01 AM   4748328   7003720   3134104     39.76      2688   2424544    725644      8.12    377076   2380788       136
03:53:01 AM   4748132   7003744   3134300     39.76      2688   2424764    725644      8.12    377076   2381132        64
03:54:01 AM   4747744   7003692   3134688     39.77      2688   2425108    725644      8.12    377076   2381352       168
03:55:01 AM   4747520   7003832   3134912     39.77      2688   2425472    725644      8.12    377076   2381836       168
03:56:01 AM   4747052   7003720   3135380     39.78      2688   2425820    725644      8.12    377076   2382140        88
03:57:01 AM   4746876   7003904   3135556     39.78      2688   2426180    725644      8.12    377076   2382432        32
03:58:01 AM   4746336   7003704   3136096     39.79      2688   2426528    725644      8.12    377076   2382852       192
03:59:01 AM   4745244   7003324   3137188     39.80      2688   2427240    725644      8.12    377076   2383916       500
04:00:01 AM   4745348   7003552   3137084     39.80      2688   2427356    724004      8.11    377080   2383796         4
04:01:01 AM   4744492   7002700   3137940     39.81      2688   2427360    724004      8.11    377076   2384364         4
04:02:01 AM   4745420   7003708   3137012     39.80      2688   2427440    724004      8.11    377076   2383832        88
04:03:01 AM   4745348   7003640   3137084     39.80      2688   2427444    724004      8.11    377076   2383724         4
04:04:01 AM   4745472   7003764   3136960     39.80      2688   2427444    724004      8.11    377076   2383724         4
04:05:01 AM   4745304   7003672   3137128     39.80      2688   2427520    724004      8.11    377076   2383764         4
04:06:01 AM   4745392   7003764   3137040     39.80      2688   2427524    724004      8.11    377076   2383872         4
04:07:01 AM   4744948   7003496   3137484     39.80      2688   2427700    724004      8.11    377076   2384100        16
04:08:01 AM   4744928   7003604   3137504     39.80      2688   2427844    724004      8.11    377076   2384120       112
04:09:01 AM   4744788   7003532   3137644     39.81      2688   2427896    724004      8.11    377076   2384192         8
04:10:01 AM   4744564   7003308   3137868     39.81      2688   2427896    724020      8.11    377076   2384308         4
04:11:01 AM   4744772   7003632   3137660     39.81      2688   2428012    724020      8.11    377084   2384360         4
04:12:01 AM   4744508   7003432   3137924     39.81      2688   2428076    724020      8.11    377084   2384472         4
04:13:01 AM   4744440   7003468   3137992     39.81      2688   2428180    724020      8.11    377084   2384460         4
04:14:01 AM   4744236   7003404   3138196     39.81      2688   2428320    724020      8.11    377084   2384736         4
04:15:01 AM   4744296   7003468   3138136     39.81      2688   2428324    724020      8.11    377084   2384744         4
04:16:01 AM   4744276   7003584   3138156     39.81      2688   2428460    724020      8.11    377084   2384816        40
04:17:01 AM   4743792   7003372   3138640     39.82      2688   2428732    724020      8.11    377084   2385272         4
04:18:02 AM   4743612   7003544   3138820     39.82      2688   2429092    724020      8.11    377084   2385420       160
04:19:01 AM   4743376   7003656   3139056     39.82      2688   2429440    724020      8.11    377084   2385752        80
04:20:01 AM   4742468   7003108   3139964     39.83      2688   2429800    724020      8.11    377084   2386480        52
04:21:01 AM   4742196   7003196   3140236     39.84      2688   2430152    724020      8.11    377084   2386716       184
04:22:01 AM   4742056   7003412   3140376     39.84      2688   2430512    724020      8.11    377088   2387152       120
04:23:01 AM   4741668   7003692   3140764     39.85      2688   2431172    724020      8.11    377084   2387616         4
04:24:01 AM   4741496   7003636   3140936     39.85      2688   2431288    724020      8.11    377084   2387736         4
04:25:01 AM   4741476   7003616   3140956     39.85      2688   2431288    724020      8.11    377084   2387736         4
04:26:01 AM   4741272   7003496   3141160     39.85      2688   2431372    724020      8.11    377084   2387888        88
04:27:01 AM   4741472   7003696   3140960     39.85      2688   2431372    724020      8.11    377084   2387820         4
04:28:01 AM   4741372   7003596   3141060     39.85      2688   2431380    724020      8.11    377084   2387816        16
04:29:01 AM   4741004   7003312   3141428     39.85      2688   2431456    724020      8.11    377084   2388020         4
04:30:01 AM   4740892   7003200   3141540     39.85      2688   2431456    724000      8.11    377084   2388020         4
04:31:01 AM   4742968   7005464   3139464     39.83      2688   2431640    724000      8.11    377084   2386116        24
04:32:01 AM   4740604   7003280   3141828     39.86      2688   2431820    724000      8.11    377088   2388272         4
04:33:01 AM   4740540   7003216   3141892     39.86      2688   2431820    724000      8.11    377088   2388576         4
04:34:01 AM   4740332   7003052   3142100     39.86      2688   2431864    724000      8.11    377088   2388564         4
04:35:01 AM   4740412   7003148   3142020     39.86      2688   2431880    724000      8.11    377088   2388596         4
04:36:01 AM   4740468   7003252   3141964     39.86      2688   2431928    724000      8.11    377088   2388512        28
04:37:01 AM   4740380   7003304   3142052     39.86      2688   2432068    724000      8.11    377092   2388580         4
04:38:01 AM   4740476   7003400   3141956     39.86      2688   2432068    724000      8.11    377092   2388696         4
04:39:01 AM   4742392   7005460   3140040     39.84      2688   2432212    703788      7.88    377092   2386676        16
04:40:01 AM   4739864   7003288   3142568     39.87      2688   2432568    722940      8.09    377092   2389188        24
04:41:01 AM   4739608   7003380   3142824     39.87      2688   2432924    722940      8.09    377092   2389488        24
04:42:01 AM   4739276   7003380   3143156     39.88      2688   2433256    722940      8.09    377092   2389868        40
04:43:01 AM   4739008   7003456   3143424     39.88      2688   2433600    722940      8.09    377092   2390096        40
04:44:01 AM   4738536   7003336   3143896     39.88      2688   2433944    722940      8.09    377092   2390576         4
04:45:01 AM   4738428   7003588   3144004     39.89      2688   2434312    722940      8.09    377092   2390808        24
04:46:01 AM   4737476   7003252   3144956     39.90      2688   2434916    722940      8.09    377092   2391604        40
04:47:01 AM   4737336   7003200   3145096     39.90      2688   2435004    722940      8.09    377092   2391784         4
04:48:01 AM   4737768   7003636   3144664     39.89      2688   2435008    722940      8.09    377092   2391516         4
04:49:01 AM   4737680   7003624   3144752     39.90      2688   2435084    722940      8.09    377092   2391592        84
04:50:01 AM   4737348   7003292   3145084     39.90      2688   2435084    739160      8.28    377092   2391708         4
04:51:01 AM   4737268   7003300   3145164     39.90      2688   2435168    739160      8.28    377092   2391748        88
04:52:01 AM   4737468   7003500   3144964     39.90      2688   2435168    739160      8.28    377092   2391680         4
04:53:01 AM   4737124   7003172   3145308     39.90      2688   2435184    739160      8.28    377092   2391848        36
04:54:01 AM   4736332   7002692   3146100     39.91      2688   2435496    723160      8.10    377092   2392408       164
04:55:01 AM   4736172   7002724   3146260     39.91      2688   2435688    757716      8.48    377096   2392592        16
04:56:01 AM   4733580   7000344   3148852     39.95      2688   2435892    774148      8.67    377096   2394992       176
04:57:01 AM   4733004   6999956   3149428     39.96      2688   2436080    806872      9.03    377096   2395348       184
04:58:01 AM   4730124   6997488   3152308     39.99      2688   2436492    822924      9.21    377096   2397976        16
04:59:01 AM   4729620   6997164   3152812     40.00      2688   2436672    854884      9.57    377096   2398256         4
05:00:01 AM   4728852   6996592   3153580     40.01      2688   2436868    907404     10.16    377096   2398804         4
05:01:01 AM   4723776   6918956   3158656     40.07      2688   2369208    741356      8.30    446008   2355232     95768
05:02:01 AM   4803376   6984144   3079056     39.06      2688   2355400    677968      7.59    614116   2111708     16024
Average:      4766540   7006920   3115892     39.53      2688   2409604    722800      8.09    368395   2371526       436

12:00:01 AM     IFACE   rxpck/s   txpck/s    rxkB/s    txkB/s   rxcmp/s   txcmp/s  rxmcst/s   %ifutil
12:01:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:01:01 AM      eth0     16.41     16.03      3.72      3.00      0.00      0.00      0.00      0.00
12:02:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:02:01 AM      eth0      0.87      0.48      0.11      0.07      0.00      0.00      0.00      0.00
12:03:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:03:01 AM      eth0      1.32      0.07      0.12      0.00      0.00      0.00      0.00      0.00
12:04:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:04:01 AM      eth0      2.85      0.87      0.97      0.50      0.00      0.00      0.00      0.00
12:05:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:05:01 AM      eth0      0.50      0.00      0.03      0.00      0.00      0.00      0.00      0.00
12:06:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:06:01 AM      eth0      5.12      0.35      0.62      0.10      0.00      0.00      0.00      0.00
12:07:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:07:01 AM      eth0      4.13      0.30      0.58      0.20      0.00      0.00      0.00      0.00
12:08:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:08:01 AM      eth0      0.38      0.07      0.02      0.00      0.00      0.00      0.00      0.00
12:09:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:09:01 AM      eth0     10.80     10.68      2.07      1.18      0.00      0.00      0.00      0.00
12:10:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:10:01 AM      eth0      0.98      0.72      0.14      0.10      0.00      0.00      0.00      0.00
12:11:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:11:01 AM      eth0      0.77      0.22      0.16      0.07      0.00      0.00      0.00      0.00
12:12:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:12:01 AM      eth0      0.55      0.18      0.03      0.01      0.00      0.00      0.00      0.00
12:13:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:13:01 AM      eth0      3.55      0.00      0.23      0.00      0.00      0.00      0.00      0.00
12:14:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:14:01 AM      eth0      2.73      2.02      0.45      0.15      0.00      0.00      0.00      0.00
12:15:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:15:01 AM      eth0     11.91      7.71      1.97      1.43      0.00      0.00      0.00      0.00
12:16:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:16:01 AM      eth0     11.68      9.88      2.43      2.02      0.00      0.00      0.00      0.00
12:17:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:17:01 AM      eth0      9.60      9.63      2.05      1.81      0.00      0.00      0.00      0.00
12:18:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:18:01 AM      eth0      8.65      8.70      1.85      1.60      0.00      0.00      0.00      0.00
12:19:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:19:01 AM      eth0      9.28      9.47      1.98      1.75      0.00      0.00      0.00      0.00
12:20:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:20:01 AM      eth0      9.45      9.73      2.02      1.81      0.00      0.00      0.00      0.00
12:21:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:21:01 AM      eth0      7.08      6.75      1.53      1.32      0.00      0.00      0.00      0.00
12:22:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:22:01 AM      eth0      0.83      0.48      0.12      0.07      0.00      0.00      0.00      0.00
12:23:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:23:01 AM      eth0      0.23      0.00      0.01      0.00      0.00      0.00      0.00      0.00
12:24:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:24:01 AM      eth0      2.12      1.97      0.41      0.35      0.00      0.00      0.00      0.00
12:25:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:25:01 AM      eth0      5.96      5.65      1.20      1.03      0.00      0.00      0.00      0.00
12:26:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:26:01 AM      eth0     10.05      9.60      2.20      1.91      0.00      0.00      0.00      0.00
12:27:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:27:01 AM      eth0      9.60      9.63      2.24      1.95      0.00      0.00      0.00      0.00
12:28:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:28:01 AM      eth0      9.50      9.76      2.02      1.81      0.00      0.00      0.00      0.00
12:29:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:29:01 AM      eth0      8.62      8.85      1.83      1.62      0.00      0.00      0.00      0.00
12:30:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:30:01 AM      eth0      9.65      9.77      2.09      1.81      0.00      0.00      0.00      0.00
12:31:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:31:01 AM      eth0     18.13     18.08      4.13      3.38      0.00      0.00      0.00      0.00
12:32:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:32:01 AM      eth0      1.27      0.60      0.24      0.14      0.00      0.00      0.00      0.00
12:33:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:33:01 AM      eth0      0.47      0.35      0.26      0.24      0.00      0.00      0.00      0.00
12:34:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:34:01 AM      eth0      1.53      0.48      0.32      0.12      0.00      0.00      0.00      0.00
12:35:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:35:01 AM      eth0      0.60      0.17      0.27      0.19      0.00      0.00      0.00      0.00
12:36:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:36:01 AM      eth0      0.40      0.12      0.09      0.06      0.00      0.00      0.00      0.00
12:37:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:37:01 AM      eth0      0.45      0.35      0.07      0.05      0.00      0.00      0.00      0.00
12:38:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:38:01 AM      eth0      0.47      0.07      0.05      0.00      0.00      0.00      0.00      0.00
12:39:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:39:01 AM      eth0      8.35      8.20      1.60      1.01      0.00      0.00      0.00      0.00
12:40:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:40:01 AM      eth0      2.92      2.80      0.61      0.25      0.00      0.00      0.00      0.00
12:41:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:41:01 AM      eth0      1.20      0.30      0.40      0.26      0.00      0.00      0.00      0.00
12:42:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:42:01 AM      eth0      1.97      1.22      0.54      0.20      0.00      0.00      0.00      0.00
12:43:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:43:01 AM      eth0      5.80      5.53      1.44      1.15      0.00      0.00      0.00      0.00
12:44:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:44:01 AM      eth0     10.26      9.75      2.24      1.81      0.00      0.00      0.00      0.00
12:45:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:45:01 AM      eth0      9.58      9.72      2.26      1.96      0.00      0.00      0.00      0.00
12:46:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:46:01 AM      eth0      9.75      9.83      2.10      1.88      0.00      0.00      0.00      0.00
12:47:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:47:01 AM      eth0      9.48      9.63      2.22      1.98      0.00      0.00      0.00      0.00
12:48:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:48:01 AM      eth0      9.23      9.47      1.98      1.76      0.00      0.00      0.00      0.00
12:49:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:49:01 AM      eth0      8.48      8.57      1.79      1.61      0.00      0.00      0.00      0.00
12:50:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:50:01 AM      eth0      1.55      0.90      0.26      0.13      0.00      0.00      0.00      0.00
12:51:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:51:01 AM      eth0      6.60      6.40      1.39      1.22      0.00      0.00      0.00      0.00
12:52:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:52:01 AM      eth0      9.43      9.60      2.01      1.80      0.00      0.00      0.00      0.00
12:53:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:53:01 AM      eth0     10.36      9.50      2.15      1.79      0.00      0.00      0.00      0.00
12:54:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:54:01 AM      eth0      9.32      9.53      1.99      1.76      0.00      0.00      0.00      0.00
12:55:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:55:01 AM      eth0      9.20      9.33      1.97      1.74      0.00      0.00      0.00      0.00
12:56:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:56:01 AM      eth0      9.98      9.81      2.14      1.87      0.00      0.00      0.00      0.00
12:57:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:57:01 AM      eth0      6.65      6.60      1.57      1.38      0.00      0.00      0.00      0.00
12:58:02 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:58:02 AM      eth0      2.57      2.18      0.42      0.41      0.00      0.00      0.00      0.00
12:59:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:59:01 AM      eth0      8.90      9.12      1.88      1.69      0.00      0.00      0.00      0.00
01:00:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:00:01 AM      eth0      9.43      9.58      2.01      1.80      0.00      0.00      0.00      0.00
01:01:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:01:01 AM      eth0      9.30      9.56      2.03      1.81      0.00      0.00      0.00      0.00
01:02:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:02:01 AM      eth0      9.46      9.63      2.02      1.80      0.00      0.00      0.00      0.00
01:03:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:03:01 AM      eth0      7.65      7.88      1.62      1.47      0.00      0.00      0.00      0.00
01:04:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:04:01 AM      eth0     10.01      9.63      2.45      1.96      0.00      0.00      0.00      0.00
01:05:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:05:01 AM      eth0     15.26     14.56      3.42      2.68      0.00      0.00      0.00      0.00
01:06:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:06:01 AM      eth0      1.20      0.57      0.44      0.30      0.00      0.00      0.00      0.00
01:07:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:07:01 AM      eth0      0.77      0.13      0.16      0.07      0.00      0.00      0.00      0.00
01:08:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:08:01 AM      eth0      3.82      0.75      0.83      0.33      0.00      0.00      0.00      0.00
01:09:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:09:01 AM      eth0      4.68      0.63      1.42      0.76      0.00      0.00      0.00      0.00
01:10:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:10:01 AM      eth0      1.05      0.60      0.58      0.42      0.00      0.00      0.00      0.00
01:11:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:11:01 AM      eth0      1.92      0.08      0.30      0.06      0.00      0.00      0.00      0.00
01:12:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:12:01 AM      eth0     10.71      3.43      1.68      0.65      0.00      0.00      0.00      0.00
01:13:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:13:01 AM      eth0      8.07      6.53      1.49      0.49      0.00      0.00      0.00      0.00
01:14:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:14:01 AM      eth0      1.55      0.83      0.41      0.29      0.00      0.00      0.00      0.00
01:15:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:15:01 AM      eth0      0.53      0.23      0.02      0.01      0.00      0.00      0.00      0.00
01:16:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:16:01 AM      eth0      3.45      2.47      0.60      0.28      0.00      0.00      0.00      0.00
01:17:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:17:01 AM      eth0     11.41      9.83      2.20      1.82      0.00      0.00      0.00      0.00
01:18:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:18:01 AM      eth0     10.43      9.57      2.10      1.80      0.00      0.00      0.00      0.00
01:19:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:19:01 AM      eth0      9.91      9.73      2.11      1.81      0.00      0.00      0.00      0.00
01:20:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:20:01 AM      eth0      9.56      9.61      2.02      1.80      0.00      0.00      0.00      0.00
01:21:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:21:01 AM      eth0      9.45      9.45      2.03      1.81      0.00      0.00      0.00      0.00
01:22:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:22:01 AM      eth0      9.48      9.65      2.02      1.81      0.00      0.00      0.00      0.00
01:23:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:23:01 AM      eth0      4.75      3.80      1.03      0.75      0.00      0.00      0.00      0.00
01:24:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:24:01 AM      eth0      6.90      2.88      1.66      1.06      0.00      0.00      0.00      0.00
01:25:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:25:01 AM      eth0      8.71      8.70      2.02      1.78      0.00      0.00      0.00      0.00
01:26:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:26:01 AM      eth0      9.32      9.32      2.02      1.80      0.00      0.00      0.00      0.00
01:27:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:27:01 AM      eth0      9.66      8.70      2.00      1.61      0.00      0.00      0.00      0.00
01:28:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:28:01 AM      eth0     15.26      9.43      2.81      1.75      0.00      0.00      0.00      0.00
01:29:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:29:01 AM      eth0      9.13      9.05      1.90      1.68      0.00      0.00      0.00      0.00
01:30:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:30:01 AM      eth0      9.45      9.25      1.96      1.73      0.00      0.00      0.00      0.00
01:31:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:31:01 AM      eth0     15.11     14.83      3.42      2.75      0.00      0.00      0.00      0.00
01:32:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:32:01 AM      eth0      1.93      0.58      0.29      0.16      0.00      0.00      0.00      0.00
01:33:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:33:01 AM      eth0      1.12      0.13      0.30      0.19      0.00      0.00      0.00      0.00
01:34:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:34:01 AM      eth0      2.63      0.60      0.49      0.13      0.00      0.00      0.00      0.00
01:35:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:35:01 AM      eth0      0.98      0.38      0.53      0.39      0.00      0.00      0.00      0.00
01:36:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:36:01 AM      eth0      0.72      0.38      0.15      0.11      0.00      0.00      0.00      0.00
01:37:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:37:01 AM      eth0      3.32      0.05      0.43      0.00      0.00      0.00      0.00      0.00
01:38:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:38:01 AM      eth0      3.70      3.47      0.79      0.65      0.00      0.00      0.00      0.00
01:39:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:39:01 AM      eth0      7.75      7.57      1.34      0.55      0.00      0.00      0.00      0.00
01:40:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:40:01 AM      eth0      0.93      0.55      0.14      0.09      0.00      0.00      0.00      0.00
01:41:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:41:01 AM      eth0      0.82      0.20      0.13      0.07      0.00      0.00      0.00      0.00
01:42:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:42:01 AM      eth0      0.52      0.22      0.08      0.03      0.00      0.00      0.00      0.00
01:43:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:43:01 AM      eth0      0.42      0.00      0.03      0.00      0.00      0.00      0.00      0.00
01:44:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:44:01 AM      eth0      0.62      0.27      0.09      0.03      0.00      0.00      0.00      0.00
01:45:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:45:01 AM      eth0      0.38      0.00      0.02      0.00      0.00      0.00      0.00      0.00
01:46:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:46:01 AM      eth0      0.62      0.35      0.16      0.09      0.00      0.00      0.00      0.00
01:47:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:47:01 AM      eth0      0.47      0.23      0.26      0.19      0.00      0.00      0.00      0.00
01:48:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:48:01 AM      eth0      0.40      0.30      0.08      0.03      0.00      0.00      0.00      0.00
01:49:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:49:01 AM      eth0      0.18      0.00      0.01      0.00      0.00      0.00      0.00      0.00
01:50:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:50:01 AM      eth0      0.40      0.25      0.08      0.03      0.00      0.00      0.00      0.00
01:51:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:51:01 AM      eth0      0.37      0.13      0.09      0.07      0.00      0.00      0.00      0.00
01:52:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:52:01 AM      eth0      0.50      0.17      0.12      0.03      0.00      0.00      0.00      0.00
01:53:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:53:01 AM      eth0      0.72      0.20      0.27      0.01      0.00      0.00      0.00      0.00
01:54:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:54:01 AM      eth0      1.15      0.05      0.08      0.00      0.00      0.00      0.00      0.00
01:55:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:55:01 AM      eth0      6.48      6.53      1.30      0.98      0.00      0.00      0.00      0.00
01:56:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:56:01 AM      eth0      9.53      9.70      2.10      1.87      0.00      0.00      0.00      0.00
01:57:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:57:01 AM      eth0      9.17      9.43      1.98      1.78      0.00      0.00      0.00      0.00
01:58:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:58:01 AM      eth0      8.90      9.16      1.91      1.69      0.00      0.00      0.00      0.00
01:59:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:59:01 AM      eth0      9.35      9.45      2.01      1.75      0.00      0.00      0.00      0.00
02:00:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:00:01 AM      eth0      9.90      9.68      2.14      1.81      0.00      0.00      0.00      0.00
02:01:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:01:01 AM      eth0      8.95      9.10      1.95      1.75      0.00      0.00      0.00      0.00
02:02:02 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:02:02 AM      eth0      1.40      0.77      0.22      0.16      0.00      0.00      0.00      0.00
02:03:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:03:01 AM      eth0      0.37      0.24      0.26      0.20      0.00      0.00      0.00      0.00
02:04:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:04:01 AM      eth0      0.53      0.03      0.05      0.00      0.00      0.00      0.00      0.00
02:05:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:05:01 AM      eth0      0.70      0.42      0.27      0.21      0.00      0.00      0.00      0.00
02:06:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:01 AM      eth0      0.20      0.05      0.08      0.06      0.00      0.00      0.00      0.00
02:07:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:07:01 AM      eth0      0.35      0.17      0.02      0.01      0.00      0.00      0.00      0.00
02:08:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:08:01 AM      eth0      0.23      0.05      0.01      0.00      0.00      0.00      0.00      0.00
02:09:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:09:01 AM      eth0      0.33      0.20      0.02      0.02      0.00      0.00      0.00      0.00
02:10:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:10:01 AM      eth0      0.17      0.00      0.01      0.00      0.00      0.00      0.00      0.00
02:11:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:11:01 AM      eth0      0.90      0.37      0.14      0.08      0.00      0.00      0.00      0.00
02:12:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:12:01 AM      eth0      0.53      0.28      0.26      0.20      0.00      0.00      0.00      0.00
02:13:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:13:01 AM      eth0      0.32      0.22      0.02      0.02      0.00      0.00      0.00      0.00
02:14:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:14:01 AM      eth0      0.15      0.00      0.01      0.00      0.00      0.00      0.00      0.00
02:15:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:15:01 AM      eth0      0.60      0.55      0.10      0.12      0.00      0.00      0.00      0.00
02:16:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:16:01 AM      eth0     10.06      9.88      2.15      1.93      0.00      0.00      0.00      0.00
02:17:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:17:01 AM      eth0      7.88      8.08      1.75      1.56      0.00      0.00      0.00      0.00
02:18:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:18:01 AM      eth0      9.36      9.55      1.99      1.78      0.00      0.00      0.00      0.00
02:19:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:19:01 AM      eth0      9.32      9.57      2.00      1.79      0.00      0.00      0.00      0.00
02:20:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:20:01 AM      eth0      9.18      9.38      1.96      1.75      0.00      0.00      0.00      0.00
02:21:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:21:01 AM      eth0      9.58      9.85      2.09      1.88      0.00      0.00      0.00      0.00
02:22:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:22:01 AM      eth0      3.12      3.07      0.90      0.55      0.00      0.00      0.00      0.00
02:23:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:23:01 AM      eth0      0.57      0.00      0.10      0.00      0.00      0.00      0.00      0.00
02:24:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:24:01 AM      eth0      0.17      0.10      0.01      0.01      0.00      0.00      0.00      0.00
02:25:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:25:01 AM      eth0      0.28      0.13      0.01      0.01      0.00      0.00      0.00      0.00
02:26:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:26:01 AM      eth0      0.25      0.13      0.09      0.07      0.00      0.00      0.00      0.00
02:27:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:27:01 AM      eth0      0.33      0.20      0.02      0.02      0.00      0.00      0.00      0.00
02:28:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:28:01 AM      eth0      0.08      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:29:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:29:01 AM      eth0      0.33      0.23      0.02      0.02      0.00      0.00      0.00      0.00
02:30:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:30:01 AM      eth0      0.10      0.05      0.00      0.00      0.00      0.00      0.00      0.00
02:31:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:31:01 AM      eth0      0.43      0.30      0.09      0.08      0.00      0.00      0.00      0.00
02:32:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:32:01 AM      eth0      0.87      0.13      0.16      0.07      0.00      0.00      0.00      0.00
02:33:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:33:01 AM      eth0      1.42      0.52      0.43      0.28      0.00      0.00      0.00      0.00
02:34:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:34:01 AM      eth0      0.35      0.20      0.25      0.20      0.00      0.00      0.00      0.00
02:35:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:35:01 AM      eth0      0.68      0.55      0.07      0.12      0.00      0.00      0.00      0.00
02:36:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:36:01 AM      eth0     10.03     10.20      2.18      1.95      0.00      0.00      0.00      0.00
02:37:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:37:01 AM      eth0      9.47      9.75      2.02      1.81      0.00      0.00      0.00      0.00
02:38:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:38:01 AM      eth0      9.15      9.38      1.95      1.79      0.00      0.00      0.00      0.00
02:39:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:39:01 AM      eth0     10.03      9.70      2.15      1.81      0.00      0.00      0.00      0.00
02:40:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:40:01 AM      eth0      9.50      9.50      2.01      1.79      0.00      0.00      0.00      0.00
02:41:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:41:01 AM      eth0      9.50      9.61      2.07      1.84      0.00      0.00      0.00      0.00
02:42:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:42:01 AM      eth0      2.65      2.62      0.49      0.47      0.00      0.00      0.00      0.00
02:43:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:43:01 AM      eth0      0.20      0.00      0.01      0.00      0.00      0.00      0.00      0.00
02:44:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:44:01 AM      eth0      0.88      0.27      0.17      0.08      0.00      0.00      0.00      0.00
02:45:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:45:01 AM      eth0      0.43      0.22      0.26      0.19      0.00      0.00      0.00      0.00
02:46:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:46:01 AM      eth0      0.53      0.20      0.36      0.07      0.00      0.00      0.00      0.00
02:47:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:47:01 AM      eth0      1.48      0.62      0.53      0.29      0.00      0.00      0.00      0.00
02:48:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:48:01 AM      eth0      0.37      0.17      0.26      0.19      0.00      0.00      0.00      0.00
02:49:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:49:01 AM      eth0      0.30      0.20      0.02      0.02      0.00      0.00      0.00      0.00
02:50:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:50:01 AM      eth0      0.20      0.00      0.01      0.00      0.00      0.00      0.00      0.00
02:51:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:51:01 AM      eth0      0.47      0.27      0.09      0.08      0.00      0.00      0.00      0.00
02:52:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:52:01 AM      eth0      0.17      0.00      0.01      0.00      0.00      0.00      0.00      0.00
02:53:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:53:01 AM      eth0      0.53      0.23      0.08      0.02      0.00      0.00      0.00      0.00
02:54:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:54:01 AM      eth0      0.35      0.00      0.06      0.00      0.00      0.00      0.00      0.00
02:55:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:55:01 AM      eth0      2.05      1.85      0.36      0.37      0.00      0.00      0.00      0.00
02:56:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:56:01 AM      eth0      8.31      8.48      1.78      1.63      0.00      0.00      0.00      0.00
02:57:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:57:01 AM      eth0      9.48      9.72      2.02      1.81      0.00      0.00      0.00      0.00
02:58:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:58:01 AM      eth0      8.65      8.96      1.88      1.67      0.00      0.00      0.00      0.00
02:59:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:59:01 AM      eth0      9.38      9.68      2.02      1.81      0.00      0.00      0.00      0.00
03:00:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:00:01 AM      eth0      9.45      9.63      2.04      1.80      0.00      0.00      0.00      0.00
03:01:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:01:01 AM      eth0      9.36      9.61      2.06      1.82      0.00      0.00      0.00      0.00
03:02:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:02:01 AM      eth0     16.44     15.29      3.69      2.87      0.00      0.00      0.00      0.00
03:03:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:03:01 AM      eth0      0.68      0.57      0.33      0.25      0.00      0.00      0.00      0.00
03:04:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:04:01 AM      eth0      0.18      0.05      0.01      0.00      0.00      0.00      0.00      0.00
03:05:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:05:01 AM      eth0      0.37      0.32      0.07      0.04      0.00      0.00      0.00      0.00
03:06:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:06:01 AM      eth0      0.30      0.18      0.11      0.07      0.00      0.00      0.00      0.00
03:07:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:07:01 AM      eth0      0.40      0.30      0.07      0.04      0.00      0.00      0.00      0.00
03:08:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:08:01 AM      eth0      0.13      0.00      0.01      0.00      0.00      0.00      0.00      0.00
03:09:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:09:01 AM      eth0      3.00      2.77      0.68      0.51      0.00      0.00      0.00      0.00
03:10:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:10:01 AM      eth0      7.77      7.37      1.54      0.66      0.00      0.00      0.00      0.00
03:11:02 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:11:02 AM      eth0      0.78      0.72      0.20      0.16      0.00      0.00      0.00      0.00
03:12:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:12:01 AM      eth0      0.19      0.10      0.01      0.00      0.00      0.00      0.00      0.00
03:13:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:13:01 AM      eth0      1.88      1.82      0.40      0.14      0.00      0.00      0.00      0.00
03:14:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:14:01 AM      eth0      8.27      8.52      1.75      1.58      0.00      0.00      0.00      0.00
03:15:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:15:01 AM      eth0      9.46      9.76      2.02      1.81      0.00      0.00      0.00      0.00
03:16:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:16:01 AM      eth0      9.40      9.65      2.05      1.85      0.00      0.00      0.00      0.00
03:17:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:17:01 AM      eth0      9.35      9.18      2.01      1.69      0.00      0.00      0.00      0.00
03:18:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:18:01 AM      eth0      9.31      9.28      1.99      1.74      0.00      0.00      0.00      0.00
03:19:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:19:01 AM      eth0      9.16      9.46      1.97      1.77      0.00      0.00      0.00      0.00
03:20:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:20:01 AM      eth0      5.35      5.48      1.11      1.01      0.00      0.00      0.00      0.00
03:21:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:21:01 AM      eth0      0.77      0.58      0.15      0.16      0.00      0.00      0.00      0.00
03:22:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:22:01 AM      eth0      7.37      7.60      1.58      1.40      0.00      0.00      0.00      0.00
03:23:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:23:01 AM      eth0      9.38      9.68      2.02      1.81      0.00      0.00      0.00      0.00
03:24:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:24:01 AM      eth0      9.37      9.62      2.02      1.80      0.00      0.00      0.00      0.00
03:25:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:25:01 AM      eth0      9.72      9.72      2.08      1.81      0.00      0.00      0.00      0.00
03:26:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:26:01 AM      eth0      9.38      9.63      2.07      1.86      0.00      0.00      0.00      0.00
03:27:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:27:01 AM      eth0      9.15      9.42      1.96      1.75      0.00      0.00      0.00      0.00
03:28:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:28:01 AM      eth0      5.01      4.97      1.00      0.93      0.00      0.00      0.00      0.00
03:29:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:29:01 AM      eth0      3.13      3.23      0.61      0.58      0.00      0.00      0.00      0.00
03:30:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:30:01 AM      eth0      9.23      9.53      2.00      1.79      0.00      0.00      0.00      0.00
03:31:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:31:01 AM      eth0      9.26      9.51      2.03      1.81      0.00      0.00      0.00      0.00
03:32:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:32:01 AM      eth0      9.88      9.61      2.08      1.80      0.00      0.00      0.00      0.00
03:33:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:33:01 AM      eth0     10.28      9.93      2.72      2.01      0.00      0.00      0.00      0.00
03:34:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:34:01 AM      eth0      9.38      9.58      2.01      1.80      0.00      0.00      0.00      0.00
03:35:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:35:01 AM      eth0      8.97      9.28      1.94      1.74      0.00      0.00      0.00      0.00
03:36:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:36:01 AM      eth0     12.06     11.90      2.79      2.20      0.00      0.00      0.00      0.00
03:37:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:37:01 AM      eth0    102.20     73.94    285.78      5.96      0.00      0.00      0.00      0.00
03:38:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:38:01 AM      eth0      0.15      0.05      0.01      0.00      0.00      0.00      0.00      0.00
03:39:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:39:01 AM      eth0      0.48      0.38      0.08      0.05      0.00      0.00      0.00      0.00
03:40:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:40:01 AM      eth0      0.12      0.00      0.01      0.00      0.00      0.00      0.00      0.00
03:41:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:41:01 AM      eth0      0.72      0.43      0.17      0.11      0.00      0.00      0.00      0.00
03:42:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:42:01 AM      eth0      3.22      0.00      5.69      0.00      0.00      0.00      0.00      0.00
03:43:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:43:01 AM      eth0      7.17      7.22      1.48      0.90      0.00      0.00      0.00      0.00
03:44:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:44:01 AM      eth0      3.42      3.40      0.67      0.32      0.00      0.00      0.00      0.00
03:45:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:45:01 AM      eth0      0.38      0.27      0.03      0.04      0.00      0.00      0.00      0.00
03:46:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:46:01 AM      eth0      0.38      0.27      0.09      0.07      0.00      0.00      0.00      0.00
03:47:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:47:01 AM      eth0      5.03      4.90      1.31      0.58      0.00      0.00      0.00      0.00
03:48:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:48:01 AM      eth0      3.33      3.32      0.57      0.27      0.00      0.00      0.00      0.00
03:49:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:49:01 AM      eth0      8.27      8.25      1.31      0.66      0.00      0.00      0.00      0.00
03:50:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:50:01 AM      eth0      0.97      0.73      0.11      0.10      0.00      0.00      0.00      0.00
03:51:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:51:01 AM      eth0      0.33      0.15      0.08      0.07      0.00      0.00      0.00      0.00
03:52:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:52:01 AM      eth0      7.51      7.61      1.32      0.80      0.00      0.00      0.00      0.00
03:53:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:53:01 AM      eth0      5.73      5.88      1.19      1.09      0.00      0.00      0.00      0.00
03:54:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:54:01 AM      eth0      9.38      9.68      2.02      1.81      0.00      0.00      0.00      0.00
03:55:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:55:01 AM      eth0      9.38      9.73      2.01      1.81      0.00      0.00      0.00      0.00
03:56:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:56:01 AM      eth0      9.16      9.41      2.02      1.80      0.00      0.00      0.00      0.00
03:57:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:57:01 AM      eth0      9.67      9.70      2.08      1.81      0.00      0.00      0.00      0.00
03:58:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:58:01 AM      eth0      9.28      9.47      1.97      1.75      0.00      0.00      0.00      0.00
03:59:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:59:01 AM      eth0     19.48     18.63      4.50      3.62      0.00      0.00      0.00      0.00
04:00:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:00:01 AM      eth0      0.45      0.43      0.09      0.06      0.00      0.00      0.00      0.00
04:01:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:01:01 AM      eth0      0.38      0.22      0.10      0.10      0.00      0.00      0.00      0.00
04:02:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:02:01 AM      eth0      0.40      0.25      0.07      0.04      0.00      0.00      0.00      0.00
04:03:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:03:01 AM      eth0      0.17      0.07      0.01      0.00      0.00      0.00      0.00      0.00
04:04:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:04:01 AM      eth0      0.30      0.12      0.34      0.01      0.00      0.00      0.00      0.00
04:05:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:05:01 AM      eth0      0.43      0.32      0.07      0.04      0.00      0.00      0.00      0.00
04:06:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:06:01 AM      eth0      0.17      0.07      0.08      0.06      0.00      0.00      0.00      0.00
04:07:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:07:01 AM      eth0      7.53      7.60      1.51      0.93      0.00      0.00      0.00      0.00
04:08:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:08:01 AM      eth0      2.72      2.72      0.61      0.32      0.00      0.00      0.00      0.00
04:09:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:09:01 AM      eth0      0.17      0.15      0.01      0.02      0.00      0.00      0.00      0.00
04:10:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:10:01 AM      eth0      0.18      0.10      0.01      0.00      0.00      0.00      0.00      0.00
04:11:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:11:01 AM      eth0      4.75      4.70      1.08      0.46      0.00      0.00      0.00      0.00
04:12:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:12:01 AM      eth0      3.87      3.80      0.66      0.35      0.00      0.00      0.00      0.00
04:13:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:13:01 AM      eth0      7.18      7.15      1.18      0.55      0.00      0.00      0.00      0.00
04:14:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:14:01 AM      eth0      1.15      0.70      0.20      0.16      0.00      0.00      0.00      0.00
04:15:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:15:01 AM      eth0      0.33      0.17      0.25      0.19      0.00      0.00      0.00      0.00
04:16:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:16:01 AM      eth0      7.58      7.21      1.41      0.83      0.00      0.00      0.00      0.00
04:17:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:17:01 AM      eth0      7.40      7.58      1.76      1.57      0.00      0.00      0.00      0.00
04:18:02 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:18:02 AM      eth0      9.45      9.66      2.03      1.81      0.00      0.00      0.00      0.00
04:19:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:19:01 AM      eth0      9.88      9.44      2.06      1.76      0.00      0.00      0.00      0.00
04:20:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:20:01 AM      eth0     15.76      9.80      2.82      1.88      0.00      0.00      0.00      0.00
04:21:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:21:01 AM      eth0     11.15     10.13      2.91      2.26      0.00      0.00      0.00      0.00
04:22:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:22:01 AM      eth0      9.83      9.88      2.28      2.00      0.00      0.00      0.00      0.00
04:23:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:23:01 AM      eth0     21.45     17.08      4.47      3.15      0.00      0.00      0.00      0.00
04:24:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:24:01 AM      eth0      6.00      0.47      0.74      0.06      0.00      0.00      0.00      0.00
04:25:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:25:01 AM      eth0      0.75      0.00      0.04      0.00      0.00      0.00      0.00      0.00
04:26:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:26:01 AM      eth0      0.98      0.50      0.17      0.11      0.00      0.00      0.00      0.00
04:27:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:27:01 AM      eth0      0.30      0.00      0.02      0.00      0.00      0.00      0.00      0.00
04:28:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:28:01 AM      eth0      1.42      0.05      0.11      0.00      0.00      0.00      0.00      0.00
04:29:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:29:01 AM      eth0      1.68      0.37      0.22      0.05      0.00      0.00      0.00      0.00
04:30:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:30:01 AM      eth0      0.70      0.03      0.05      0.00      0.00      0.00      0.00      0.00
04:31:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:31:01 AM      eth0      8.35      8.37      1.73      1.15      0.00      0.00      0.00      0.00
04:32:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:32:01 AM      eth0      2.02      1.38      0.50      0.16      0.00      0.00      0.00      0.00
04:33:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:33:01 AM      eth0      2.07      0.27      0.43      0.20      0.00      0.00      0.00      0.00
04:34:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:34:01 AM      eth0      4.82      2.37      1.02      0.42      0.00      0.00      0.00      0.00
04:35:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:35:01 AM      eth0      1.23      0.75      0.57      0.45      0.00      0.00      0.00      0.00
04:36:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:36:01 AM      eth0      2.93      2.65      0.63      0.24      0.00      0.00      0.00      0.00
04:37:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:37:01 AM      eth0      7.83      0.48      1.01      0.09      0.00      0.00      0.00      0.00
04:38:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:38:01 AM      eth0      1.25      0.00      0.09      0.00      0.00      0.00      0.00      0.00
04:39:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:39:01 AM      eth0      6.75      6.32      1.38      0.72      0.00      0.00      0.00      0.00
04:40:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:40:01 AM      eth0      9.68      9.78      2.01      1.81      0.00      0.00      0.00      0.00
04:41:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:41:01 AM      eth0     10.15      9.78      2.13      1.87      0.00      0.00      0.00      0.00
04:42:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:42:01 AM      eth0      9.25      9.27      1.98      1.72      0.00      0.00      0.00      0.00
04:43:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:43:01 AM      eth0      9.30      9.33      1.94      1.72      0.00      0.00      0.00      0.00
04:44:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:44:01 AM      eth0      9.78      9.65      2.05      1.81      0.00      0.00      0.00      0.00
04:45:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:45:01 AM      eth0     10.00      9.60      2.06      1.80      0.00      0.00      0.00      0.00
04:46:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:46:01 AM      eth0     15.13     15.06      3.45      2.79      0.00      0.00      0.00      0.00
04:47:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:47:01 AM      eth0      0.83      0.65      0.34      0.25      0.00      0.00      0.00      0.00
04:48:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:48:01 AM      eth0      0.42      0.05      0.06      0.00      0.00      0.00      0.00      0.00
04:49:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:49:01 AM      eth0      0.48      0.38      0.07      0.05      0.00      0.00      0.00      0.00
04:50:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:50:01 AM      eth0      0.18      0.00      0.01      0.00      0.00      0.00      0.00      0.00
04:51:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:51:01 AM      eth0      0.72      0.48      0.16      0.11      0.00      0.00      0.00      0.00
04:52:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:52:01 AM      eth0      0.22      0.00      0.01      0.00      0.00      0.00      0.00      0.00
04:53:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:53:01 AM      eth0      2.08      1.32      0.62      0.28      0.00      0.00      0.00      0.00
04:54:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:54:01 AM      eth0      9.68      9.11      2.12      1.49      0.00      0.00      0.00      0.00
04:55:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:55:01 AM      eth0      8.10      7.98      1.64      0.97      0.00      0.00      0.00      0.00
04:56:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:56:01 AM      eth0      8.95      8.95      1.74      1.02      0.00      0.00      0.00      0.00
04:57:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:57:01 AM      eth0      6.07      6.05      1.24      0.79      0.00      0.00      0.00      0.00
04:58:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:58:01 AM      eth0      9.16      9.20      3.20      1.42      0.00      0.00      0.00      0.00
04:59:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
04:59:01 AM      eth0      8.87      8.48      1.58      1.03      0.00      0.00      0.00      0.00
05:00:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
05:00:01 AM      eth0      9.33      8.95      1.67      1.16      0.00      0.00      0.00      0.00
05:01:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
05:01:01 AM      eth0    101.30     80.17    276.65    311.25      0.00      0.00      0.00      0.00
05:02:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
05:02:01 AM      eth0     17.12     17.09     14.57      7.91      0.00      0.00      0.00      0.00
Average:           lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
Average:         eth0      5.81      5.19      3.01      1.92      0.00      0.00      0.00      0.00


---> sar -P ALL:
Linux 4.18.0-547.el8.x86_64 (prd-centos8-robot-2c-8g-5480.novalocal) 	04/07/2024 	_x86_64_	(2 CPU)

12:00:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
12:01:01 AM     all      6.25      0.04      0.50      0.05      0.06     93.09
12:01:01 AM       0      2.88      0.03      0.30      0.07      0.05     96.67
12:01:01 AM       1      9.64      0.05      0.70      0.03      0.07     89.50
12:02:01 AM     all      0.58      0.00      0.10      0.00      0.03     99.30
12:02:01 AM       0      0.60      0.00      0.08      0.00      0.03     99.28
12:02:01 AM       1      0.55      0.00      0.12      0.00      0.02     99.32
12:03:01 AM     all      0.35      0.00      0.06      0.00      0.04     99.55
12:03:01 AM       0      0.53      0.00      0.02      0.00      0.03     99.42
12:03:01 AM       1      0.17      0.00      0.10      0.00      0.05     99.68
12:04:01 AM     all      0.49      0.00      0.09      0.00      0.03     99.39
12:04:01 AM       0      0.57      0.00      0.08      0.00      0.03     99.32
12:04:01 AM       1      0.42      0.00      0.10      0.00      0.02     99.47
12:05:01 AM     all      0.33      0.00      0.07      0.00      0.03     99.57
12:05:01 AM       0      0.60      0.00      0.10      0.00      0.03     99.27
12:05:01 AM       1      0.07      0.00      0.03      0.00      0.02     99.88
12:06:01 AM     all      0.52      0.00      0.08      0.00      0.04     99.36
12:06:01 AM       0      0.55      0.00      0.03      0.00      0.02     99.40
12:06:01 AM       1      0.48      0.00      0.13      0.00      0.07     99.32
12:07:01 AM     all      0.35      0.00      0.11      0.00      0.03     99.52
12:07:01 AM       0      0.58      0.00      0.08      0.00      0.03     99.30
12:07:01 AM       1      0.12      0.00      0.13      0.00      0.02     99.73
12:08:01 AM     all      0.35      0.00      0.09      0.00      0.03     99.53
12:08:01 AM       0      0.10      0.00      0.13      0.00      0.02     99.75
12:08:01 AM       1      0.60      0.00      0.05      0.00      0.03     99.32
12:09:01 AM     all      7.47      0.00      2.66      0.01      0.07     89.79
12:09:01 AM       0     11.10      0.00      5.12      0.02      0.07     83.70
12:09:01 AM       1      4.04      0.00      0.34      0.00      0.07     95.56
12:10:01 AM     all      4.62      0.00      1.35      0.01      0.07     93.96
12:10:01 AM       0      9.30      0.00      2.65      0.00      0.09     87.96
12:10:01 AM       1      0.20      0.00      0.12      0.02      0.05     99.62
12:11:01 AM     all      0.20      0.00      0.09      0.00      0.03     99.68
12:11:01 AM       0      0.32      0.00      0.12      0.00      0.03     99.53
12:11:01 AM       1      0.08      0.00      0.07      0.00      0.02     99.83

12:11:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
12:12:01 AM     all      0.38      0.00      0.08      0.00      0.04     99.49
12:12:01 AM       0      0.13      0.00      0.08      0.00      0.05     99.73
12:12:01 AM       1      0.63      0.00      0.08      0.00      0.03     99.25
12:13:01 AM     all      0.51      0.00      0.11      0.00      0.03     99.35
12:13:01 AM       0      0.40      0.00      0.17      0.00      0.05     99.38
12:13:01 AM       1      0.62      0.00      0.05      0.00      0.02     99.32
12:14:01 AM     all      2.41      0.00      0.20      0.00      0.05     97.33
12:14:01 AM       0      0.49      0.00      0.10      0.00      0.05     99.36
12:14:01 AM       1      4.38      0.00      0.31      0.00      0.05     95.26
12:15:01 AM     all      6.06      0.00      1.47      0.00      0.06     92.41
12:15:01 AM       0      7.72      0.00      2.79      0.00      0.07     89.43
12:15:01 AM       1      4.45      0.00      0.20      0.00      0.05     95.30
12:16:01 AM     all      4.31      0.00      0.21      0.00      0.06     95.42
12:16:01 AM       0      1.50      0.00      0.20      0.00      0.05     98.25
12:16:01 AM       1      7.12      0.00      0.22      0.00      0.07     92.60
12:17:01 AM     all      4.40      0.00      0.19      0.00      0.06     95.35
12:17:01 AM       0      3.36      0.00      0.17      0.00      0.05     96.42
12:17:01 AM       1      5.44      0.00      0.22      0.00      0.07     94.28
12:18:01 AM     all      3.84      0.00      0.18      0.00      0.06     95.92
12:18:01 AM       0      1.61      0.00      0.13      0.00      0.05     98.21
12:18:01 AM       1      6.08      0.00      0.22      0.00      0.07     93.63
12:19:01 AM     all      4.22      0.00      0.19      0.00      0.07     95.52
12:19:01 AM       0      2.56      0.00      0.13      0.00      0.07     97.24
12:19:01 AM       1      5.89      0.00      0.25      0.00      0.07     93.79
12:20:01 AM     all      4.37      0.00      0.18      0.00      0.05     95.41
12:20:01 AM       0      1.67      0.00      0.15      0.00      0.03     98.14
12:20:01 AM       1      7.07      0.00      0.20      0.00      0.07     92.66
12:21:01 AM     all      5.27      0.00      0.31      0.00      0.06     94.36
12:21:01 AM       0      8.93      0.00      0.43      0.00      0.07     90.57
12:21:01 AM       1      1.74      0.00      0.18      0.00      0.05     98.03
12:22:01 AM     all      4.48      0.00      1.67      0.00      0.07     93.78
12:22:01 AM       0      8.56      0.00      3.32      0.00      0.07     88.05
12:22:01 AM       1      0.65      0.00      0.12      0.00      0.07     99.17

12:22:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
12:23:01 AM     all      0.49      0.00      0.10      0.00      0.05     99.36
12:23:01 AM       0      0.35      0.00      0.15      0.00      0.07     99.43
12:23:01 AM       1      0.63      0.00      0.05      0.00      0.03     99.28
12:24:01 AM     all      2.68      0.00      0.20      0.00      0.06     97.06
12:24:01 AM       0      3.88      0.00      0.27      0.00      0.05     95.79
12:24:01 AM       1      1.49      0.00      0.13      0.00      0.07     98.31
12:25:01 AM     all      6.62      0.00      2.59      0.00      0.06     90.73
12:25:01 AM       0      9.98      0.00      4.99      0.00      0.07     84.96
12:25:01 AM       1      3.44      0.00      0.32      0.00      0.05     96.19
12:26:01 AM     all      4.28      0.00      0.28      0.00      0.05     95.38
12:26:01 AM       0      4.22      0.00      0.30      0.00      0.05     95.43
12:26:01 AM       1      4.35      0.00      0.27      0.00      0.05     95.33
12:27:01 AM     all      4.24      0.00      0.32      0.00      0.07     95.38
12:27:01 AM       0      6.16      0.00      0.40      0.00      0.08     93.35
12:27:01 AM       1      2.32      0.00      0.23      0.00      0.05     97.39
12:28:01 AM     all      4.36      0.00      0.33      0.00      0.06     95.26
12:28:01 AM       0      4.24      0.00      0.28      0.00      0.07     95.41
12:28:01 AM       1      4.48      0.00      0.37      0.00      0.05     95.10
12:29:01 AM     all      3.87      0.00      0.31      0.00      0.06     95.76
12:29:01 AM       0      3.61      0.00      0.32      0.00      0.05     96.02
12:29:01 AM       1      4.13      0.00      0.30      0.00      0.07     95.50
12:30:01 AM     all      4.37      0.00      0.33      0.01      0.06     95.23
12:30:01 AM       0      4.50      0.00      0.37      0.02      0.07     95.05
12:30:01 AM       1      4.25      0.00      0.28      0.00      0.05     95.42
12:31:01 AM     all      6.98      0.00      0.35      0.00      0.07     92.60
12:31:01 AM       0      7.30      0.00      0.37      0.00      0.07     92.26
12:31:01 AM       1      6.67      0.00      0.34      0.00      0.07     92.93
12:32:01 AM     all      0.68      0.00      0.11      0.00      0.06     99.16
12:32:01 AM       0      0.83      0.00      0.08      0.00      0.05     99.03
12:32:01 AM       1      0.52      0.00      0.13      0.00      0.07     99.28
12:33:01 AM     all      0.34      0.00      0.05      0.00      0.03     99.58
12:33:01 AM       0      0.13      0.00      0.05      0.00      0.03     99.78
12:33:01 AM       1      0.55      0.00      0.05      0.00      0.02     99.38

12:33:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
12:34:01 AM     all      0.51      0.00      0.07      0.00      0.04     99.38
12:34:01 AM       0      0.17      0.00      0.08      0.00      0.05     99.70
12:34:01 AM       1      0.85      0.00      0.05      0.00      0.03     99.07
12:35:01 AM     all      0.35      0.00      0.06      0.00      0.03     99.57
12:35:01 AM       0      0.57      0.00      0.07      0.00      0.03     99.33
12:35:01 AM       1      0.13      0.00      0.05      0.00      0.02     99.80
12:36:01 AM     all      0.34      0.00      0.05      0.00      0.03     99.57
12:36:01 AM       0      0.57      0.00      0.03      0.00      0.03     99.37
12:36:01 AM       1      0.12      0.00      0.07      0.00      0.03     99.78
12:37:01 AM     all      0.48      0.00      0.07      0.00      0.03     99.42
12:37:01 AM       0      0.60      0.00      0.07      0.00      0.03     99.30
12:37:01 AM       1      0.37      0.00      0.07      0.00      0.02     99.55
12:38:01 AM     all      0.33      0.00      0.07      0.00      0.03     99.57
12:38:01 AM       0      0.47      0.00      0.05      0.00      0.03     99.45
12:38:01 AM       1      0.20      0.00      0.08      0.00      0.03     99.68
12:39:01 AM     all      6.26      0.00      2.51      0.00      0.07     91.16
12:39:01 AM       0     10.40      0.00      4.99      0.00      0.09     84.53
12:39:01 AM       1      2.35      0.00      0.17      0.00      0.05     97.43
12:40:01 AM     all      5.84      0.00      1.55      0.01      0.06     92.54
12:40:01 AM       0     11.47      0.00      3.04      0.00      0.07     85.42
12:40:01 AM       1      0.62      0.00      0.17      0.02      0.05     99.15
12:41:01 AM     all      0.38      0.00      0.08      0.00      0.03     99.51
12:41:01 AM       0      0.22      0.00      0.08      0.00      0.02     99.68
12:41:01 AM       1      0.55      0.00      0.08      0.00      0.03     99.33
12:42:01 AM     all      0.97      0.00      0.13      0.00      0.04     98.86
12:42:01 AM       0      0.58      0.00      0.07      0.00      0.03     99.32
12:42:01 AM       1      1.36      0.00      0.18      0.00      0.05     98.40
12:43:01 AM     all      6.29      0.00      1.37      0.00      0.06     92.27
12:43:01 AM       0      2.11      0.00      0.17      0.00      0.03     97.68
12:43:01 AM       1     10.71      0.00      2.65      0.00      0.09     86.55
12:44:01 AM     all      4.37      0.00      0.17      0.00      0.06     95.41
12:44:01 AM       0      6.32      0.00      0.20      0.00      0.07     93.41
12:44:01 AM       1      2.42      0.00      0.13      0.00      0.05     97.39

12:44:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
12:45:01 AM     all      4.24      0.00      0.18      0.00      0.06     95.51
12:45:01 AM       0      4.18      0.00      0.17      0.00      0.07     95.59
12:45:01 AM       1      4.31      0.00      0.20      0.00      0.05     95.44
12:46:01 AM     all      4.33      0.00      0.19      0.00      0.06     95.42
12:46:01 AM       0      6.08      0.00      0.23      0.00      0.05     93.64
12:46:01 AM       1      2.59      0.00      0.15      0.00      0.07     97.19
12:47:01 AM     all      4.34      0.00      0.18      0.00      0.07     95.41
12:47:01 AM       0      4.12      0.00      0.17      0.00      0.07     95.65
12:47:01 AM       1      4.57      0.00      0.20      0.00      0.07     95.17
12:48:01 AM     all      4.29      0.00      0.20      0.00      0.07     95.44
12:48:01 AM       0      3.21      0.00      0.18      0.00      0.07     96.54
12:48:01 AM       1      5.37      0.00      0.22      0.00      0.07     94.34
12:49:01 AM     all      4.99      0.00      0.26      0.00      0.08     94.66
12:49:01 AM       0      6.56      0.00      0.30      0.00      0.08     93.05
12:49:01 AM       1      3.44      0.00      0.22      0.00      0.08     96.26
12:50:01 AM     all      6.59      0.00      1.58      4.41      0.09     87.34
12:50:01 AM       0      9.19      0.00      2.80      0.00      0.11     87.90
12:50:01 AM       1      4.08      0.00      0.39      8.66      0.07     86.79
12:51:01 AM     all      6.47      0.00      1.43      0.00      0.06     92.03
12:51:01 AM       0      3.30      0.00      0.15      0.00      0.05     96.50
12:51:01 AM       1      9.82      0.00      2.78      0.00      0.07     87.34
12:52:01 AM     all      4.33      0.00      0.18      0.00      0.07     95.42
12:52:01 AM       0      4.00      0.00      0.17      0.00      0.07     95.77
12:52:01 AM       1      4.67      0.00      0.20      0.00      0.07     95.07
12:53:01 AM     all      4.34      0.17      0.26      0.00      0.05     95.18
12:53:01 AM       0      2.96      0.28      0.25      0.00      0.05     96.45
12:53:01 AM       1      5.72      0.05      0.27      0.00      0.05     93.91
12:54:01 AM     all      4.29      0.00      0.19      0.00      0.08     95.44
12:54:01 AM       0      6.35      0.00      0.22      0.00      0.08     93.35
12:54:01 AM       1      2.24      0.00      0.17      0.00      0.07     97.53
12:55:01 AM     all      4.17      0.00      0.19      0.00      0.06     95.58
12:55:01 AM       0      2.46      0.00      0.17      0.00      0.07     97.31
12:55:01 AM       1      5.89      0.00      0.22      0.00      0.05     93.84

12:55:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
12:56:01 AM     all      4.34      0.00      0.18      0.00      0.06     95.42
12:56:01 AM       0      3.31      0.00      0.17      0.00      0.05     96.47
12:56:01 AM       1      5.37      0.00      0.20      0.00      0.07     94.36
12:57:01 AM     all      5.29      0.00      0.54      0.01      0.05     94.11
12:57:01 AM       0      7.14      0.00      0.90      0.02      0.05     91.89
12:57:01 AM       1      3.51      0.00      0.18      0.00      0.05     96.25
12:58:02 AM     all      6.52      0.00      2.13      0.00      0.07     91.29
12:58:02 AM       0      5.21      0.00      2.10      0.00      0.07     92.62
12:58:02 AM       1      7.86      0.00      2.16      0.00      0.07     89.91
12:59:01 AM     all      5.40      0.00      1.60      0.00      0.05     92.95
12:59:01 AM       0      2.55      0.00      0.22      0.00      0.05     97.18
12:59:01 AM       1      8.34      0.00      3.02      0.00      0.05     88.59
01:00:01 AM     all      4.32      0.00      0.32      0.00      0.05     95.31
01:00:01 AM       0      2.96      0.00      0.27      0.00      0.03     96.74
01:00:01 AM       1      5.68      0.00      0.37      0.00      0.07     93.89
01:01:01 AM     all      4.24      0.00      0.35      0.00      0.06     95.35
01:01:01 AM       0      4.45      0.00      0.37      0.00      0.07     95.12
01:01:01 AM       1      4.03      0.00      0.33      0.00      0.05     95.58
01:02:01 AM     all      4.31      0.00      0.32      0.00      0.06     95.32
01:02:01 AM       0      5.46      0.00      0.37      0.00      0.05     94.12
01:02:01 AM       1      3.16      0.00      0.27      0.00      0.07     96.51
01:03:01 AM     all      3.60      0.00      0.24      0.00      0.06     96.10
01:03:01 AM       0      3.40      0.00      0.22      0.00      0.05     96.34
01:03:01 AM       1      3.80      0.00      0.27      0.00      0.07     95.87
01:04:01 AM     all      4.21      0.00      0.31      0.00      0.05     95.43
01:04:01 AM       0      6.45      0.00      0.42      0.00      0.07     93.06
01:04:01 AM       1      1.97      0.00      0.20      0.00      0.03     97.79
01:05:01 AM     all      5.74      0.00      0.31      0.00      0.07     93.88
01:05:01 AM       0      6.75      0.00      0.30      0.00      0.07     92.88
01:05:01 AM       1      4.73      0.00      0.32      0.00      0.07     94.88
01:06:01 AM     all      0.50      0.00      0.05      0.00      0.03     99.42
01:06:01 AM       0      0.68      0.00      0.05      0.00      0.03     99.23
01:06:01 AM       1      0.32      0.00      0.05      0.00      0.03     99.60

01:06:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
01:07:01 AM     all      0.33      0.00      0.06      0.00      0.03     99.57
01:07:01 AM       0      0.62      0.00      0.07      0.00      0.05     99.27
01:07:01 AM       1      0.05      0.00      0.05      0.00      0.02     99.88
01:08:01 AM     all      0.52      0.00      0.09      0.00      0.04     99.35
01:08:01 AM       0      0.30      0.00      0.09      0.00      0.05     99.56
01:08:01 AM       1      0.73      0.00      0.09      0.00      0.04     99.14
01:09:01 AM     all      0.33      0.00      0.10      0.00      0.03     99.54
01:09:01 AM       0      0.12      0.00      0.08      0.00      0.03     99.77
01:09:01 AM       1      0.55      0.00      0.12      0.00      0.02     99.32
01:10:01 AM     all      0.48      0.00      0.08      0.00      0.04     99.40
01:10:01 AM       0      0.47      0.00      0.10      0.00      0.03     99.40
01:10:01 AM       1      0.48      0.00      0.07      0.00      0.05     99.40
01:11:01 AM     all      0.32      0.00      0.08      0.00      0.03     99.58
01:11:01 AM       0      0.55      0.00      0.05      0.00      0.02     99.38
01:11:01 AM       1      0.08      0.00      0.10      0.00      0.03     99.78
01:12:01 AM     all      2.47      0.00      0.16      0.00      0.04     97.33
01:12:01 AM       0      2.47      0.00      0.08      0.00      0.03     97.41
01:12:01 AM       1      2.47      0.00      0.24      0.00      0.05     97.24
01:13:01 AM     all      6.72      0.00      2.68      0.00      0.07     90.54
01:13:01 AM       0     12.90      0.00      5.42      0.00      0.09     81.59
01:13:01 AM       1      1.09      0.00      0.18      0.00      0.05     98.68
01:14:01 AM     all      2.87      0.00      1.28      0.00      0.04     95.81
01:14:01 AM       0      5.18      0.00      2.51      0.00      0.05     92.26
01:14:01 AM       1      0.63      0.00      0.08      0.00      0.03     99.25
01:15:01 AM     all      0.34      0.00      0.09      0.00      0.03     99.54
01:15:01 AM       0      0.08      0.00      0.08      0.00      0.02     99.82
01:15:01 AM       1      0.60      0.00      0.10      0.00      0.03     99.27
01:16:01 AM     all      4.18      0.00      1.74      0.00      0.07     94.01
01:16:01 AM       0      0.27      0.00      0.15      0.00      0.05     99.53
01:16:01 AM       1      8.25      0.00      3.40      0.00      0.09     88.27
01:17:01 AM     all      5.50      0.00      0.24      0.00      0.07     94.18
01:17:01 AM       0      3.66      0.00      0.27      0.00      0.07     96.00
01:17:01 AM       1      7.33      0.00      0.22      0.00      0.07     92.38

01:17:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
01:18:01 AM     all      4.54      0.00      0.19      0.00      0.05     95.22
01:18:01 AM       0      3.97      0.00      0.20      0.00      0.05     95.78
01:18:01 AM       1      5.11      0.00      0.18      0.00      0.05     94.66
01:19:01 AM     all      4.54      0.00      0.21      0.00      0.05     95.20
01:19:01 AM       0      1.91      0.00      0.18      0.00      0.03     97.88
01:19:01 AM       1      7.18      0.00      0.23      0.00      0.07     92.52
01:20:01 AM     all      4.50      0.00      0.18      0.01      0.06     95.25
01:20:01 AM       0      1.99      0.00      0.17      0.00      0.05     97.79
01:20:01 AM       1      7.01      0.00      0.18      0.02      0.07     92.72
01:21:01 AM     all      4.28      0.00      0.23      0.00      0.06     95.44
01:21:01 AM       0      2.81      0.00      0.23      0.00      0.05     96.90
01:21:01 AM       1      5.75      0.00      0.22      0.00      0.07     93.97
01:22:01 AM     all      4.49      0.00      0.20      0.00      0.05     95.25
01:22:01 AM       0      2.76      0.00      0.18      0.00      0.05     97.01
01:22:01 AM       1      6.23      0.00      0.22      0.00      0.05     93.50
01:23:01 AM     all      6.68      0.00      0.47      0.00      0.08     92.77
01:23:01 AM       0      5.32      0.00      0.43      0.00      0.07     94.18
01:23:01 AM       1      8.05      0.00      0.52      0.00      0.09     91.35
01:24:01 AM     all      7.00      0.00      2.07      0.00      0.10     90.83
01:24:01 AM       0      6.17      0.00      3.02      0.00      0.09     90.72
01:24:01 AM       1      7.84      0.00      1.11      0.00      0.11     90.95
01:25:01 AM     all      5.71      0.00      2.30      0.00      0.08     91.91
01:25:01 AM       0      2.86      0.00      0.22      0.00      0.07     96.85
01:25:01 AM       1      8.64      0.00      4.45      0.00      0.10     86.81
01:26:01 AM     all      4.27      0.00      0.32      0.00      0.07     95.35
01:26:01 AM       0      3.66      0.00      0.30      0.00      0.05     95.99
01:26:01 AM       1      4.87      0.00      0.33      0.00      0.08     94.71
01:27:01 AM     all      3.94      0.00      0.29      0.00      0.08     95.68
01:27:01 AM       0      5.78      0.00      0.40      0.00      0.10     93.72
01:27:01 AM       1      2.11      0.00      0.18      0.00      0.07     97.64
01:28:01 AM     all      4.25      0.00      0.34      0.00      0.06     95.35
01:28:01 AM       0      5.50      0.00      0.44      0.00      0.05     94.02
01:28:01 AM       1      3.01      0.00      0.25      0.00      0.07     96.67

01:28:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
01:29:01 AM     all      4.15      0.00      0.32      0.00      0.07     95.47
01:29:01 AM       0      4.71      0.00      0.36      0.00      0.09     94.85
01:29:01 AM       1      3.60      0.00      0.27      0.00      0.05     96.08
01:30:01 AM     all      4.30      0.00      0.33      0.01      0.07     95.29
01:30:01 AM       0      4.52      0.00      0.35      0.02      0.07     95.04
01:30:01 AM       1      4.08      0.00      0.32      0.00      0.07     95.54
01:31:01 AM     all      5.62      0.00      0.29      0.00      0.66     93.43
01:31:01 AM       0      4.77      0.00      0.25      0.00      0.05     94.93
01:31:01 AM       1      6.46      0.00      0.33      0.00      1.26     91.95
01:32:01 AM     all      0.51      0.00      0.11      0.00      0.03     99.35
01:32:01 AM       0      0.90      0.00      0.08      0.00      0.03     98.98
01:32:01 AM       1      0.12      0.00      0.13      0.00      0.03     99.72
01:33:01 AM     all      0.34      0.00      0.07      0.00      0.03     99.56
01:33:01 AM       0      0.23      0.00      0.08      0.00      0.03     99.65
01:33:01 AM       1      0.45      0.00      0.05      0.00      0.03     99.47
01:34:01 AM     all      0.53      0.00      0.08      0.00      0.04     99.36
01:34:01 AM       0      0.47      0.00      0.10      0.00      0.05     99.38
01:34:01 AM       1      0.58      0.00      0.05      0.00      0.03     99.33
01:35:01 AM     all      0.38      0.00      0.06      0.00      0.03     99.54
01:35:01 AM       0      0.53      0.00      0.07      0.00      0.03     99.37
01:35:01 AM       1      0.22      0.00      0.05      0.00      0.02     99.72
01:36:01 AM     all      0.49      0.00      0.07      0.00      0.03     99.41
01:36:01 AM       0      0.28      0.00      0.05      0.00      0.03     99.63
01:36:01 AM       1      0.70      0.00      0.08      0.00      0.03     99.18
01:37:01 AM     all      0.31      0.00      0.08      0.00      0.03     99.59
01:37:01 AM       0      0.35      0.00      0.07      0.00      0.03     99.55
01:37:01 AM       1      0.27      0.00      0.08      0.00      0.02     99.63
01:38:01 AM     all      2.07      0.00      0.13      0.00      0.03     97.77
01:38:01 AM       0      0.32      0.00      0.08      0.00      0.02     99.58
01:38:01 AM       1      3.84      0.00      0.17      0.00      0.05     95.94
01:39:01 AM     all      7.37      0.00      3.15      0.00      0.10     89.39
01:39:01 AM       0      0.77      0.00      0.22      0.00      0.07     98.95
01:39:01 AM       1     14.62      0.00      6.37      0.00      0.13     78.88

01:39:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
01:40:01 AM     all      3.18      0.00      1.42      0.00      0.05     95.35
01:40:01 AM       0      2.69      0.00      0.24      0.00      0.03     97.03
01:40:01 AM       1      3.67      0.00      2.62      0.00      0.07     93.64
01:41:01 AM     all      0.23      0.00      0.09      0.00      0.03     99.64
01:41:01 AM       0      0.07      0.00      0.07      0.00      0.03     99.83
01:41:01 AM       1      0.40      0.00      0.12      0.00      0.03     99.45
01:42:01 AM     all      0.51      0.00      0.11      0.00      0.03     99.36
01:42:01 AM       0      0.40      0.00      0.10      0.00      0.02     99.48
01:42:01 AM       1      0.62      0.00      0.12      0.00      0.03     99.23
01:43:01 AM     all      0.35      0.00      0.06      0.00      0.03     99.56
01:43:01 AM       0      0.57      0.00      0.05      0.00      0.02     99.37
01:43:01 AM       1      0.13      0.00      0.07      0.00      0.05     99.75
01:44:01 AM     all      0.40      0.00      0.10      0.00      0.03     99.47
01:44:01 AM       0      0.63      0.00      0.10      0.00      0.03     99.23
01:44:01 AM       1      0.17      0.00      0.10      0.00      0.03     99.70
01:45:01 AM     all      0.36      0.00      0.07      0.00      0.04     99.53
01:45:01 AM       0      0.17      0.00      0.10      0.00      0.05     99.68
01:45:01 AM       1      0.55      0.00      0.03      0.00      0.03     99.38
01:46:01 AM     all      0.51      0.00      0.08      0.00      0.04     99.37
01:46:01 AM       0      0.43      0.00      0.10      0.00      0.03     99.43
01:46:01 AM       1      0.58      0.00      0.05      0.00      0.05     99.32
01:47:01 AM     all      0.36      0.00      0.08      0.00      0.03     99.53
01:47:01 AM       0      0.13      0.00      0.10      0.00      0.03     99.73
01:47:01 AM       1      0.58      0.00      0.05      0.00      0.03     99.33
01:48:01 AM     all      0.47      0.00      0.07      0.00      0.03     99.43
01:48:01 AM       0      0.33      0.00      0.08      0.00      0.03     99.55
01:48:01 AM       1      0.60      0.00      0.05      0.00      0.03     99.32
01:49:01 AM     all      0.34      0.00      0.07      0.00      0.03     99.56
01:49:01 AM       0      0.12      0.00      0.07      0.00      0.03     99.78
01:49:01 AM       1      0.57      0.00      0.07      0.00      0.03     99.33
01:50:01 AM     all      0.47      0.00      0.08      0.00      0.04     99.41
01:50:01 AM       0      0.32      0.00      0.08      0.00      0.03     99.57
01:50:01 AM       1      0.62      0.00      0.08      0.00      0.05     99.25

01:50:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
01:51:01 AM     all      0.25      0.00      0.09      0.00      0.04     99.62
01:51:01 AM       0      0.05      0.00      0.05      0.00      0.03     99.87
01:51:01 AM       1      0.45      0.00      0.13      0.00      0.05     99.36
01:52:01 AM     all      0.48      0.00      0.07      0.00      0.05     99.41
01:52:01 AM       0      0.35      0.00      0.08      0.00      0.05     99.52
01:52:01 AM       1      0.60      0.00      0.05      0.00      0.05     99.30
01:53:01 AM     all      0.36      0.00      0.08      0.00      0.03     99.52
01:53:01 AM       0      0.12      0.00      0.12      0.00      0.03     99.73
01:53:01 AM       1      0.60      0.00      0.05      0.00      0.03     99.32
01:54:01 AM     all      0.35      0.00      0.05      0.00      0.04     99.56
01:54:01 AM       0      0.17      0.00      0.07      0.00      0.05     99.72
01:54:01 AM       1      0.53      0.00      0.03      0.00      0.03     99.40
01:55:01 AM     all      6.40      0.15      1.61      0.01      0.06     91.78
01:55:01 AM       0      5.75      0.29      0.53      0.02      0.05     93.36
01:55:01 AM       1      7.05      0.00      2.69      0.00      0.07     90.19
01:56:01 AM     all      4.33      0.00      0.17      0.00      0.06     95.45
01:56:01 AM       0      5.65      0.00      0.18      0.00      0.07     94.10
01:56:01 AM       1      3.01      0.00      0.15      0.00      0.05     96.79
01:57:01 AM     all      4.23      0.00      0.19      0.00      0.06     95.52
01:57:01 AM       0      2.68      0.00      0.17      0.00      0.05     97.11
01:57:01 AM       1      5.79      0.00      0.22      0.00      0.07     93.92
01:58:01 AM     all      3.95      0.00      0.18      0.00      0.08     95.80
01:58:01 AM       0      2.14      0.00      0.17      0.00      0.07     97.63
01:58:01 AM       1      5.75      0.00      0.18      0.00      0.08     93.98
01:59:01 AM     all      4.20      0.00      0.19      0.00      0.07     95.54
01:59:01 AM       0      2.64      0.00      0.18      0.00      0.07     97.11
01:59:01 AM       1      5.76      0.00      0.20      0.00      0.07     93.97
02:00:01 AM     all      4.33      0.00      0.20      0.00      0.06     95.41
02:00:01 AM       0      1.55      0.00      0.17      0.00      0.05     98.23
02:00:01 AM       1      7.12      0.00      0.23      0.00      0.07     92.58
02:01:01 AM     all      4.64      0.00      0.25      0.00      0.07     95.04
02:01:01 AM       0      3.87      0.00      0.22      0.00      0.07     95.85
02:01:01 AM       1      5.42      0.00      0.29      0.00      0.07     94.23

02:01:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
02:02:02 AM     all      6.33      0.00      1.61      0.00      0.06     92.00
02:02:02 AM       0      0.63      0.00      0.12      0.00      0.07     99.18
02:02:02 AM       1     12.55      0.00      3.25      0.00      0.05     84.15
02:03:01 AM     all      0.33      0.00      0.05      0.00      0.03     99.58
02:03:01 AM       0      0.61      0.00      0.07      0.00      0.05     99.27
02:03:01 AM       1      0.05      0.00      0.03      0.00      0.02     99.90
02:04:01 AM     all      0.32      0.00      0.05      0.00      0.03     99.60
02:04:01 AM       0      0.55      0.00      0.03      0.00      0.03     99.38
02:04:01 AM       1      0.08      0.00      0.07      0.00      0.03     99.82
02:05:01 AM     all      0.46      0.00      0.07      0.00      0.03     99.44
02:05:01 AM       0      0.63      0.00      0.05      0.00      0.03     99.28
02:05:01 AM       1      0.28      0.00      0.08      0.00      0.03     99.60
02:06:01 AM     all      0.33      0.00      0.07      0.00      0.04     99.57
02:06:01 AM       0      0.58      0.00      0.07      0.00      0.03     99.32
02:06:01 AM       1      0.07      0.00      0.07      0.00      0.05     99.82
02:07:01 AM     all      0.44      0.00      0.07      0.00      0.04     99.45
02:07:01 AM       0      0.58      0.00      0.07      0.00      0.05     99.30
02:07:01 AM       1      0.30      0.00      0.07      0.00      0.03     99.60
02:08:01 AM     all      0.22      0.00      0.09      0.00      0.03     99.67
02:08:01 AM       0      0.22      0.00      0.13      0.00      0.03     99.62
02:08:01 AM       1      0.22      0.00      0.05      0.00      0.02     99.72
02:09:01 AM     all      0.47      0.00      0.06      0.00      0.04     99.43
02:09:01 AM       0      0.15      0.00      0.07      0.00      0.07     99.72
02:09:01 AM       1      0.78      0.00      0.05      0.00      0.02     99.15
02:10:01 AM     all      0.25      0.00      0.08      0.01      0.03     99.63
02:10:01 AM       0      0.13      0.00      0.10      0.00      0.05     99.72
02:10:01 AM       1      0.37      0.00      0.05      0.02      0.02     99.55
02:11:01 AM     all      0.42      0.00      0.06      0.00      0.03     99.50
02:11:01 AM       0      0.15      0.00      0.08      0.00      0.05     99.72
02:11:01 AM       1      0.68      0.00      0.03      0.00      0.00     99.28
02:12:01 AM     all      0.33      0.00      0.05      0.00      0.03     99.60
02:12:01 AM       0      0.27      0.00      0.07      0.00      0.03     99.63
02:12:01 AM       1      0.38      0.00      0.03      0.00      0.02     99.57

02:12:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
02:13:01 AM     all      0.44      0.00      0.07      0.00      0.03     99.47
02:13:01 AM       0      0.38      0.00      0.05      0.00      0.03     99.53
02:13:01 AM       1      0.50      0.00      0.08      0.00      0.02     99.40
02:14:01 AM     all      0.22      0.00      0.07      0.00      0.04     99.67
02:14:01 AM       0      0.33      0.00      0.05      0.00      0.03     99.58
02:14:01 AM       1      0.10      0.00      0.08      0.00      0.05     99.77
02:15:01 AM     all      3.73      0.00      1.57      0.00      0.04     94.66
02:15:01 AM       0      0.47      0.00      0.08      0.00      0.03     99.42
02:15:01 AM       1      7.12      0.00      3.13      0.00      0.05     89.70
02:16:01 AM     all      5.23      0.00      0.25      0.00      0.07     94.45
02:16:01 AM       0      1.94      0.00      0.15      0.00      0.05     97.86
02:16:01 AM       1      8.58      0.00      0.36      0.00      0.08     90.98
02:17:01 AM     all      3.56      0.00      1.28      0.00      1.02     94.14
02:17:01 AM       0      2.86      0.00      2.46      0.00      0.05     94.63
02:17:01 AM       1      4.25      0.00      0.11      0.00      1.97     93.66
02:18:01 AM     all      4.31      0.00      0.19      0.00      0.07     95.43
02:18:01 AM       0      2.88      0.00      0.15      0.00      0.08     96.89
02:18:01 AM       1      5.74      0.00      0.23      0.00      0.05     93.97
02:19:01 AM     all      4.39      0.00      0.18      0.00      0.06     95.37
02:19:01 AM       0      2.46      0.00      0.17      0.00      0.05     97.32
02:19:01 AM       1      6.33      0.00      0.20      0.00      0.07     93.40
02:20:01 AM     all      4.43      0.00      0.20      0.00      0.07     95.30
02:20:01 AM       0      2.59      0.00      0.17      0.00      0.07     97.17
02:20:01 AM       1      6.27      0.00      0.23      0.00      0.07     93.43
02:21:01 AM     all      4.39      0.00      0.19      0.00      0.04     95.37
02:21:01 AM       0      2.11      0.00      0.15      0.00      0.03     97.71
02:21:01 AM       1      6.68      0.00      0.23      0.00      0.05     93.03
02:22:01 AM     all      5.64      0.00      1.53      0.00      0.07     92.76
02:22:01 AM       0      0.80      0.00      0.13      0.00      0.05     99.01
02:22:01 AM       1     10.82      0.00      3.02      0.00      0.09     86.08
02:23:01 AM     all      0.23      0.00      0.08      0.00      0.03     99.67
02:23:01 AM       0      0.17      0.00      0.07      0.00      0.03     99.73
02:23:01 AM       1      0.28      0.00      0.08      0.00      0.02     99.62

02:23:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
02:24:01 AM     all      0.46      0.00      0.04      0.00      0.03     99.47
02:24:01 AM       0      0.08      0.00      0.05      0.00      0.03     99.83
02:24:01 AM       1      0.83      0.00      0.03      0.00      0.03     99.10
02:25:01 AM     all      0.36      0.00      0.06      0.00      0.03     99.56
02:25:01 AM       0      0.53      0.00      0.07      0.00      0.03     99.37
02:25:01 AM       1      0.18      0.00      0.05      0.00      0.02     99.75
02:26:01 AM     all      0.33      0.00      0.05      0.00      0.03     99.59
02:26:01 AM       0      0.52      0.00      0.03      0.00      0.03     99.42
02:26:01 AM       1      0.13      0.00      0.07      0.00      0.03     99.77
02:27:01 AM     all      0.47      0.00      0.08      0.00      0.03     99.43
02:27:01 AM       0      0.60      0.00      0.07      0.00      0.03     99.30
02:27:01 AM       1      0.33      0.00      0.08      0.00      0.02     99.57
02:28:01 AM     all      0.33      0.00      0.05      0.00      0.03     99.59
02:28:01 AM       0      0.53      0.00      0.03      0.00      0.03     99.40
02:28:01 AM       1      0.12      0.00      0.07      0.00      0.03     99.78
02:29:01 AM     all      0.31      0.00      0.08      0.00      0.02     99.59
02:29:01 AM       0      0.25      0.00      0.07      0.00      0.02     99.67
02:29:01 AM       1      0.37      0.00      0.10      0.00      0.02     99.52
02:30:01 AM     all      0.36      0.00      0.07      0.00      0.05     99.52
02:30:01 AM       0      0.17      0.00      0.07      0.00      0.05     99.72
02:30:01 AM       1      0.55      0.00      0.07      0.00      0.05     99.33
02:31:01 AM     all      0.49      0.00      0.08      0.01      0.03     99.38
02:31:01 AM       0      0.32      0.00      0.08      0.00      0.03     99.57
02:31:01 AM       1      0.67      0.00      0.08      0.02      0.03     99.20
02:32:01 AM     all      0.34      0.00      0.05      0.00      0.03     99.58
02:32:01 AM       0      0.10      0.00      0.05      0.00      0.02     99.83
02:32:01 AM       1      0.58      0.00      0.05      0.00      0.03     99.33
02:33:01 AM     all      0.51      0.00      0.09      0.00      0.02     99.38
02:33:01 AM       0      0.50      0.00      0.10      0.00      0.02     99.38
02:33:01 AM       1      0.52      0.00      0.08      0.00      0.02     99.38
02:34:01 AM     all      0.28      0.00      0.07      0.00      0.03     99.62
02:34:01 AM       0      0.47      0.00      0.08      0.00      0.03     99.41
02:34:01 AM       1      0.10      0.00      0.05      0.00      0.02     99.83

02:34:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
02:35:01 AM     all      4.39      0.00      1.57      0.01      0.05     93.98
02:35:01 AM       0      3.77      0.00      2.71      0.00      0.05     93.46
02:35:01 AM       1      5.03      0.00      0.40      0.02      0.05     94.51
02:36:01 AM     all      5.39      0.00      0.26      0.00      0.06     94.29
02:36:01 AM       0      6.46      0.00      0.30      0.00      0.05     93.19
02:36:01 AM       1      4.33      0.00      0.22      0.00      0.07     95.38
02:37:01 AM     all      4.80      0.00      0.21      0.00      0.07     94.93
02:37:01 AM       0      4.00      0.00      0.18      0.00      0.07     95.75
02:37:01 AM       1      5.59      0.00      0.23      0.00      0.07     94.11
02:38:01 AM     all      4.77      0.00      0.22      0.00      0.08     94.93
02:38:01 AM       0      3.11      0.00      0.20      0.00      0.08     96.60
02:38:01 AM       1      6.43      0.00      0.23      0.00      0.08     93.25
02:39:01 AM     all      4.60      0.00      0.19      0.00      0.05     95.16
02:39:01 AM       0      1.57      0.00      0.15      0.00      0.03     98.24
02:39:01 AM       1      7.63      0.00      0.23      0.00      0.07     92.07
02:40:01 AM     all      4.36      0.00      0.18      0.01      0.05     95.41
02:40:01 AM       0      2.44      0.00      0.17      0.00      0.05     97.34
02:40:01 AM       1      6.28      0.00      0.18      0.02      0.05     93.47
02:41:01 AM     all      4.34      0.00      0.22      0.00      0.04     95.40
02:41:01 AM       0      2.86      0.00      0.20      0.00      0.03     96.90
02:41:01 AM       1      5.82      0.00      0.23      0.00      0.05     93.89
02:42:01 AM     all      5.55      0.00      1.39      0.00      0.06     93.00
02:42:01 AM       0      0.67      0.00      0.15      0.00      0.05     99.13
02:42:01 AM       1     10.77      0.00      2.71      0.00      0.07     86.45
02:43:01 AM     all      0.17      0.00      0.06      0.00      0.02     99.76
02:43:01 AM       0      0.30      0.00      0.08      0.00      0.03     99.58
02:43:01 AM       1      0.03      0.00      0.03      0.00      0.00     99.93
02:44:01 AM     all      0.44      0.00      0.07      0.00      0.03     99.47
02:44:01 AM       0      0.58      0.00      0.07      0.00      0.03     99.32
02:44:01 AM       1      0.30      0.00      0.07      0.00      0.02     99.62
02:45:01 AM     all      0.33      0.00      0.06      0.00      0.03     99.58
02:45:01 AM       0      0.57      0.00      0.05      0.00      0.02     99.37
02:45:01 AM       1      0.10      0.00      0.07      0.00      0.03     99.80

02:45:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
02:46:01 AM     all      0.23      0.00      0.07      0.00      0.03     99.67
02:46:01 AM       0      0.37      0.00      0.05      0.00      0.03     99.55
02:46:01 AM       1      0.10      0.00      0.08      0.00      0.03     99.78
02:47:01 AM     all      0.44      0.00      0.07      0.00      0.02     99.47
02:47:01 AM       0      0.47      0.00      0.05      0.00      0.02     99.47
02:47:01 AM       1      0.42      0.00      0.08      0.00      0.02     99.48
02:48:01 AM     all      0.33      0.00      0.06      0.00      0.03     99.58
02:48:01 AM       0      0.52      0.00      0.03      0.00      0.02     99.43
02:48:01 AM       1      0.15      0.00      0.08      0.00      0.03     99.73
02:49:01 AM     all      0.48      0.00      0.07      0.00      0.03     99.42
02:49:01 AM       0      0.60      0.00      0.07      0.00      0.05     99.28
02:49:01 AM       1      0.35      0.00      0.07      0.00      0.02     99.57
02:50:01 AM     all      0.31      0.00      0.07      0.00      0.02     99.61
02:50:01 AM       0      0.53      0.00      0.03      0.00      0.02     99.42
02:50:01 AM       1      0.08      0.00      0.10      0.00      0.02     99.80
02:51:01 AM     all      0.46      0.00      0.08      0.00      0.03     99.44
02:51:01 AM       0      0.57      0.00      0.05      0.00      0.02     99.37
02:51:01 AM       1      0.35      0.00      0.10      0.00      0.03     99.52
02:52:01 AM     all      0.23      0.00      0.06      0.00      0.03     99.68
02:52:01 AM       0      0.38      0.00      0.08      0.00      0.05     99.48
02:52:01 AM       1      0.07      0.00      0.03      0.00      0.02     99.88
02:53:01 AM     all      0.39      0.00      0.08      0.00      0.03     99.50
02:53:01 AM       0      0.27      0.00      0.07      0.00      0.03     99.63
02:53:01 AM       1      0.52      0.00      0.08      0.00      0.03     99.37
02:54:01 AM     all      0.31      0.00      0.06      0.00      0.03     99.61
02:54:01 AM       0      0.50      0.00      0.05      0.00      0.02     99.43
02:54:01 AM       1      0.12      0.00      0.07      0.00      0.03     99.78
02:55:01 AM     all      4.43      0.00      0.30      0.00      0.06     95.21
02:55:01 AM       0      8.46      0.00      0.47      0.00      0.07     91.00
02:55:01 AM       1      0.58      0.00      0.13      0.00      0.05     99.23
02:56:01 AM     all      5.70      0.00      2.39      0.00      0.05     91.86
02:56:01 AM       0      8.44      0.00      4.62      0.00      0.05     86.89
02:56:01 AM       1      3.06      0.00      0.23      0.00      0.05     96.66

02:56:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
02:57:01 AM     all      4.34      0.00      0.33      0.00      0.06     95.27
02:57:01 AM       0      6.04      0.00      0.44      0.00      0.07     93.45
02:57:01 AM       1      2.64      0.00      0.23      0.00      0.05     97.07
02:58:01 AM     all      4.03      0.00      0.29      0.00      0.05     95.63
02:58:01 AM       0      2.84      0.00      0.30      0.00      0.03     96.82
02:58:01 AM       1      5.22      0.00      0.28      0.00      0.07     94.43
02:59:01 AM     all      4.49      0.00      0.34      0.00      0.06     95.11
02:59:01 AM       0      2.96      0.00      0.25      0.00      0.05     96.74
02:59:01 AM       1      6.02      0.00      0.43      0.00      0.07     93.48
03:00:01 AM     all      4.45      0.00      0.33      0.03      0.04     95.14
03:00:01 AM       0      3.75      0.00      0.30      0.07      0.05     95.83
03:00:01 AM       1      5.15      0.00      0.37      0.00      0.03     94.44
03:01:01 AM     all      4.49      0.00      0.33      0.02      0.06     95.10
03:01:01 AM       0      3.53      0.00      0.28      0.03      0.05     96.10
03:01:01 AM       1      5.44      0.00      0.38      0.00      0.07     94.11
03:02:01 AM     all      6.24      0.00      0.34      0.00      0.06     93.36
03:02:01 AM       0      2.77      0.00      0.25      0.00      0.05     96.92
03:02:01 AM       1      9.71      0.00      0.44      0.00      0.07     89.79
03:03:01 AM     all      0.56      0.00      0.08      0.00      0.03     99.33
03:03:01 AM       0      0.58      0.00      0.07      0.00      0.03     99.32
03:03:01 AM       1      0.53      0.00      0.08      0.00      0.03     99.35
03:04:01 AM     all      0.34      0.00      0.06      0.00      0.02     99.58
03:04:01 AM       0      0.25      0.00      0.07      0.00      0.02     99.67
03:04:01 AM       1      0.43      0.00      0.05      0.00      0.02     99.50
03:05:01 AM     all      0.49      0.00      0.09      0.00      0.03     99.38
03:05:01 AM       0      0.40      0.00      0.07      0.00      0.03     99.50
03:05:01 AM       1      0.58      0.00      0.12      0.00      0.03     99.27
03:06:01 AM     all      0.36      0.00      0.08      0.00      0.03     99.54
03:06:01 AM       0      0.10      0.00      0.08      0.00      0.02     99.80
03:06:01 AM       1      0.62      0.00      0.07      0.00      0.03     99.28
03:07:01 AM     all      0.51      0.00      0.05      0.00      0.03     99.42
03:07:01 AM       0      0.28      0.00      0.08      0.00      0.03     99.60
03:07:01 AM       1      0.73      0.00      0.02      0.00      0.02     99.23

03:07:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
03:08:01 AM     all      0.33      0.00      0.06      0.00      0.03     99.58
03:08:01 AM       0      0.13      0.00      0.08      0.00      0.03     99.75
03:08:01 AM       1      0.53      0.00      0.03      0.00      0.02     99.42
03:09:01 AM     all      1.59      0.00      0.09      0.00      0.03     98.29
03:09:01 AM       0      0.25      0.00      0.10      0.00      0.03     99.62
03:09:01 AM       1      2.92      0.00      0.08      0.00      0.03     96.96
03:10:01 AM     all      7.07      0.00      2.66      0.00      0.07     90.20
03:10:01 AM       0      0.67      0.00      0.13      0.00      0.05     99.15
03:10:01 AM       1     14.06      0.00      5.42      0.00      0.09     80.43
03:11:02 AM     all      4.09      0.00      1.27      0.00      0.05     94.60
03:11:02 AM       0      0.58      0.00      0.10      0.00      0.05     99.27
03:11:02 AM       1      7.76      0.00      2.49      0.00      0.05     89.70
03:12:01 AM     all      0.31      0.00      0.08      0.00      0.03     99.58
03:12:01 AM       0      0.49      0.00      0.05      0.00      0.03     99.42
03:12:01 AM       1      0.12      0.00      0.10      0.00      0.03     99.75
03:13:01 AM     all      2.70      0.00      0.35      0.00      0.04     96.90
03:13:01 AM       0      5.27      0.00      0.57      0.00      0.03     94.12
03:13:01 AM       1      0.22      0.00      0.13      0.00      0.05     99.60
03:14:01 AM     all      5.58      0.00      1.46      0.00      0.06     92.90
03:14:01 AM       0      9.23      0.00      2.75      0.00      0.07     87.95
03:14:01 AM       1      2.04      0.00      0.20      0.00      0.05     97.71
03:15:01 AM     all      4.37      0.00      0.19      0.03      0.06     95.36
03:15:01 AM       0      4.45      0.00      0.17      0.05      0.05     95.28
03:15:01 AM       1      4.28      0.00      0.22      0.00      0.07     95.43
03:16:01 AM     all      4.35      0.00      0.18      0.00      0.05     95.42
03:16:01 AM       0      5.61      0.00      0.15      0.00      0.05     94.19
03:16:01 AM       1      3.09      0.00      0.20      0.00      0.05     96.66
03:17:01 AM     all      4.12      0.00      0.17      0.00      0.05     95.66
03:17:01 AM       0      2.71      0.00      0.13      0.00      0.05     97.11
03:17:01 AM       1      5.54      0.00      0.20      0.00      0.05     94.21
03:18:01 AM     all      4.18      0.00      0.17      0.00      0.05     95.61
03:18:01 AM       0      1.15      0.00      0.15      0.00      0.05     98.65
03:18:01 AM       1      7.21      0.00      0.18      0.00      0.05     92.56

03:18:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
03:19:01 AM     all      4.26      0.00      0.18      0.00      0.07     95.49
03:19:01 AM       0      3.38      0.00      0.18      0.00      0.07     96.37
03:19:01 AM       1      5.14      0.00      0.18      0.00      0.07     94.61
03:20:01 AM     all      5.62      0.00      0.32      0.00      0.05     94.00
03:20:01 AM       0      1.42      0.00      0.17      0.00      0.03     98.38
03:20:01 AM       1     10.02      0.00      0.49      0.00      0.07     89.42
03:21:01 AM     all      7.08      0.00      2.59      0.00      0.07     90.26
03:21:01 AM       0      0.63      0.00      0.17      0.00      0.05     99.15
03:21:01 AM       1     14.13      0.00      5.24      0.00      0.09     80.53
03:22:01 AM     all      4.44      0.00      0.47      0.00      0.05     95.04
03:22:01 AM       0      0.97      0.00      0.13      0.00      0.05     98.85
03:22:01 AM       1      7.98      0.00      0.82      0.00      0.05     91.15
03:23:01 AM     all      4.37      0.00      0.18      0.00      0.07     95.37
03:23:01 AM       0      1.59      0.00      0.17      0.00      0.05     98.20
03:23:01 AM       1      7.17      0.00      0.20      0.00      0.08     92.55
03:24:01 AM     all      4.33      0.00      0.21      0.00      0.07     95.39
03:24:01 AM       0      2.61      0.00      0.17      0.00      0.07     97.16
03:24:01 AM       1      6.06      0.00      0.25      0.00      0.07     93.62
03:25:01 AM     all      4.32      0.00      0.21      0.00      0.07     95.40
03:25:01 AM       0      2.86      0.00      0.18      0.00      0.07     96.89
03:25:01 AM       1      5.79      0.00      0.23      0.00      0.07     93.91
03:26:01 AM     all      4.28      0.00      0.18      0.00      0.06     95.47
03:26:01 AM       0      3.25      0.00      0.17      0.00      0.05     96.54
03:26:01 AM       1      5.32      0.00      0.20      0.00      0.07     94.41
03:27:01 AM     all      4.23      0.00      0.18      0.00      0.07     95.52
03:27:01 AM       0      4.79      0.00      0.22      0.00      0.07     94.93
03:27:01 AM       1      3.68      0.00      0.15      0.00      0.07     96.10
03:28:01 AM     all      6.52      0.00      1.37      0.00      0.06     92.05
03:28:01 AM       0     11.71      0.00      2.68      0.00      0.07     85.55
03:28:01 AM       1      1.67      0.00      0.15      0.00      0.05     98.13
03:29:01 AM     all      7.08      0.00      2.72      0.00      0.07     90.13
03:29:01 AM       0      3.81      0.00      0.27      0.00      0.07     95.86
03:29:01 AM       1     10.51      0.00      5.28      0.00      0.07     84.14

03:29:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
03:30:01 AM     all      4.31      0.00      0.31      0.00      0.06     95.32
03:30:01 AM       0      4.08      0.00      0.30      0.00      0.05     95.56
03:30:01 AM       1      4.53      0.00      0.32      0.00      0.07     95.08
03:31:01 AM     all      4.24      0.00      0.30      0.00      0.07     95.39
03:31:01 AM       0      2.99      0.00      0.22      0.00      0.07     96.72
03:31:01 AM       1      5.49      0.00      0.38      0.00      0.07     94.06
03:32:01 AM     all      4.33      0.00      0.28      0.00      0.05     95.33
03:32:01 AM       0      5.09      0.00      0.32      0.00      0.05     94.54
03:32:01 AM       1      3.58      0.00      0.25      0.00      0.05     96.12
03:33:01 AM     all      4.35      0.00      0.33      0.00      0.07     95.26
03:33:01 AM       0      4.23      0.00      0.32      0.00      0.05     95.40
03:33:01 AM       1      4.47      0.00      0.33      0.00      0.08     95.11
03:34:01 AM     all      4.34      0.00      0.34      0.00      0.06     95.26
03:34:01 AM       0      3.66      0.00      0.30      0.00      0.07     95.97
03:34:01 AM       1      5.02      0.00      0.38      0.00      0.05     94.55
03:35:01 AM     all      4.15      0.00      0.29      0.01      0.06     95.49
03:35:01 AM       0      4.39      0.00      0.32      0.00      0.05     95.24
03:35:01 AM       1      3.91      0.00      0.27      0.02      0.07     95.74
03:36:01 AM     all      4.68      0.01      0.24      0.00      0.06     95.02
03:36:01 AM       0      4.55      0.00      0.25      0.00      0.05     95.15
03:36:01 AM       1      4.80      0.02      0.23      0.00      0.07     94.88
03:37:01 AM     all      0.32      5.75      0.55      0.42      0.04     92.93
03:37:01 AM       0      0.28     10.45      0.63      0.23      0.05     88.35
03:37:01 AM       1      0.35      1.04      0.47      0.60      0.03     97.51
03:38:01 AM     all      0.17      0.00      0.06      0.07      0.03     99.68
03:38:01 AM       0      0.03      0.00      0.02      0.13      0.02     99.80
03:38:01 AM       1      0.30      0.00      0.10      0.00      0.03     99.56
03:39:01 AM     all      0.51      0.00      0.07      0.00      0.04     99.38
03:39:01 AM       0      0.10      0.00      0.08      0.00      0.05     99.77
03:39:01 AM       1      0.92      0.00      0.05      0.00      0.03     99.00
03:40:01 AM     all      0.33      0.00      0.06      0.00      0.03     99.58
03:40:01 AM       0      0.08      0.00      0.05      0.00      0.03     99.83
03:40:01 AM       1      0.57      0.00      0.07      0.00      0.03     99.33

03:40:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
03:41:01 AM     all      0.51      0.00      0.07      0.00      0.03     99.39
03:41:01 AM       0      0.40      0.00      0.07      0.00      0.05     99.48
03:41:01 AM       1      0.62      0.00      0.07      0.00      0.02     99.30
03:42:01 AM     all      0.28      0.00      0.07      0.00      0.03     99.62
03:42:01 AM       0      0.52      0.00      0.08      0.00      0.02     99.38
03:42:01 AM       1      0.05      0.00      0.05      0.00      0.03     99.87
03:43:01 AM     all      3.46      0.00      2.25      0.00      0.04     94.25
03:43:01 AM       0      0.69      0.00      0.12      0.00      0.03     99.16
03:43:01 AM       1      6.32      0.00      4.44      0.00      0.05     89.18
03:44:01 AM     all      6.59      0.00      3.02      0.00      0.05     90.33
03:44:01 AM       0      2.27      0.00      2.01      0.00      0.05     95.67
03:44:01 AM       1     11.19      0.00      4.08      0.00      0.05     84.67
03:45:01 AM     all      1.94      0.00      0.15      0.01      0.04     97.86
03:45:01 AM       0      3.50      0.00      0.24      0.00      0.05     96.21
03:45:01 AM       1      0.40      0.00      0.07      0.02      0.03     99.48
03:46:01 AM     all      0.37      0.00      0.05      0.00      0.03     99.56
03:46:01 AM       0      0.57      0.00      0.03      0.00      0.02     99.38
03:46:01 AM       1      0.17      0.00      0.07      0.00      0.03     99.73
03:47:01 AM     all      4.73      0.00      1.57      0.00      0.06     93.64
03:47:01 AM       0      1.19      0.00      0.15      0.00      0.03     98.62
03:47:01 AM       1      8.49      0.00      3.09      0.00      0.09     88.34
03:48:01 AM     all      6.44      0.00      2.19      0.00      0.06     91.30
03:48:01 AM       0      5.96      0.00      3.21      0.00      0.07     90.76
03:48:01 AM       1      6.94      0.00      1.16      0.00      0.05     91.85
03:49:01 AM     all      7.28      0.00      2.56      0.00      0.07     90.09
03:49:01 AM       0     14.14      0.00      5.14      0.00      0.09     80.63
03:49:01 AM       1      0.92      0.00      0.18      0.00      0.05     98.84
03:50:01 AM     all      5.13      0.00      1.63      0.00      0.04     93.20
03:50:01 AM       0      0.37      0.00      0.17      0.00      0.03     99.43
03:50:01 AM       1     10.13      0.00      3.15      0.00      0.05     86.66
03:51:01 AM     all      0.35      0.00      0.07      0.00      0.03     99.55
03:51:01 AM       0      0.57      0.00      0.05      0.00      0.02     99.37
03:51:01 AM       1      0.13      0.00      0.08      0.00      0.05     99.73

03:51:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
03:52:01 AM     all      2.85      0.00      0.23      0.00      0.04     96.88
03:52:01 AM       0      1.71      0.00      0.15      0.00      0.03     98.11
03:52:01 AM       1      3.99      0.00      0.30      0.00      0.05     95.65
03:53:01 AM     all      6.72      0.00      2.48      0.00      0.06     90.74
03:53:01 AM       0      8.38      0.00      0.50      0.00      0.07     91.05
03:53:01 AM       1      5.08      0.00      4.45      0.00      0.05     90.43
03:54:01 AM     all      4.32      0.00      0.29      0.00      0.05     95.34
03:54:01 AM       0      3.92      0.00      0.28      0.00      0.05     95.75
03:54:01 AM       1      4.72      0.00      0.30      0.00      0.05     94.93
03:55:01 AM     all      4.31      0.00      0.28      0.00      0.06     95.35
03:55:01 AM       0      6.89      0.00      0.39      0.00      0.07     92.66
03:55:01 AM       1      1.74      0.00      0.18      0.00      0.05     98.03
03:56:01 AM     all      4.21      0.00      0.29      0.00      0.06     95.44
03:56:01 AM       0      5.76      0.00      0.37      0.00      0.07     93.80
03:56:01 AM       1      2.66      0.00      0.22      0.00      0.05     97.08
03:57:01 AM     all      4.26      0.00      0.33      0.00      0.05     95.36
03:57:01 AM       0      4.38      0.00      0.30      0.00      0.05     95.26
03:57:01 AM       1      4.14      0.00      0.35      0.00      0.05     95.46
03:58:01 AM     all      4.23      0.00      0.28      0.00      0.06     95.42
03:58:01 AM       0      1.37      0.00      0.15      0.00      0.05     98.43
03:58:01 AM       1      7.10      0.00      0.42      0.00      0.07     92.41
03:59:01 AM     all      7.36      0.00      0.41      0.00      0.05     92.18
03:59:01 AM       0      6.46      0.00      0.42      0.00      0.05     93.07
03:59:01 AM       1      8.25      0.00      0.40      0.00      0.05     91.29
04:00:01 AM     all      0.63      0.00      0.08      0.00      0.04     99.24
04:00:01 AM       0      0.72      0.00      0.05      0.00      0.03     99.20
04:00:01 AM       1      0.55      0.00      0.12      0.00      0.05     99.28
04:01:01 AM     all      0.34      0.00      0.06      0.00      0.03     99.57
04:01:01 AM       0      0.12      0.00      0.03      0.00      0.02     99.83
04:01:01 AM       1      0.57      0.00      0.08      0.00      0.03     99.32
04:02:01 AM     all      0.40      0.00      0.09      0.00      0.03     99.48
04:02:01 AM       0      0.37      0.00      0.08      0.00      0.02     99.53
04:02:01 AM       1      0.43      0.00      0.10      0.00      0.03     99.43

04:02:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
04:03:01 AM     all      0.32      0.00      0.05      0.00      0.03     99.60
04:03:01 AM       0      0.02      0.00      0.02      0.00      0.03     99.93
04:03:01 AM       1      0.62      0.00      0.08      0.00      0.03     99.27
04:04:01 AM     all      0.33      0.00      0.05      0.00      0.03     99.58
04:04:01 AM       0      0.10      0.00      0.07      0.00      0.03     99.80
04:04:01 AM       1      0.57      0.00      0.03      0.00      0.03     99.37
04:05:01 AM     all      0.51      0.00      0.07      0.01      0.03     99.39
04:05:01 AM       0      0.42      0.00      0.07      0.02      0.02     99.48
04:05:01 AM       1      0.60      0.00      0.07      0.00      0.03     99.30
04:06:01 AM     all      0.33      0.00      0.06      0.00      0.03     99.57
04:06:01 AM       0      0.07      0.00      0.03      0.00      0.02     99.88
04:06:01 AM       1      0.60      0.00      0.08      0.00      0.05     99.27
04:07:01 AM     all      4.52      0.00      3.44      0.00      0.04     91.99
04:07:01 AM       0      1.05      0.00      0.18      0.00      0.03     98.73
04:07:01 AM       1      8.27      0.00      6.95      0.00      0.05     84.73
04:08:01 AM     all      7.30      0.00      1.64      0.00      0.06     91.00
04:08:01 AM       0      3.55      0.00      0.27      0.00      0.05     96.13
04:08:01 AM       1     11.28      0.00      3.09      0.00      0.07     85.56
04:09:01 AM     all      0.51      0.00      0.07      0.00      0.03     99.40
04:09:01 AM       0      0.38      0.00      0.05      0.00      0.02     99.55
04:09:01 AM       1      0.63      0.00      0.08      0.00      0.03     99.25
04:10:01 AM     all      0.34      0.00      0.05      0.00      0.03     99.57
04:10:01 AM       0      0.17      0.00      0.08      0.00      0.05     99.70
04:10:01 AM       1      0.52      0.00      0.02      0.00      0.02     99.45
04:11:01 AM     all      6.38      0.00      1.58      0.00      0.06     91.98
04:11:01 AM       0      1.35      0.00      0.19      0.00      0.05     98.42
04:11:01 AM       1     11.73      0.00      3.06      0.00      0.07     85.14
04:12:01 AM     all      6.90      0.00      2.90      0.00      0.06     90.14
04:12:01 AM       0      8.04      0.00      3.24      0.00      0.05     88.66
04:12:01 AM       1      5.76      0.00      2.56      0.00      0.07     91.61
04:13:01 AM     all      6.97      0.00      1.61      0.00      0.07     91.36
04:13:01 AM       0      1.99      0.00      0.22      0.00      0.07     97.72
04:13:01 AM       1     12.31      0.00      3.09      0.00      0.07     84.53

04:13:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
04:14:01 AM     all      3.79      0.00      1.40      0.00      0.05     94.76
04:14:01 AM       0      0.63      0.00      0.08      0.00      0.03     99.25
04:14:01 AM       1      7.07      0.00      2.78      0.00      0.07     90.09
04:15:01 AM     all      0.38      0.00      0.06      0.00      0.03     99.53
04:15:01 AM       0      0.65      0.00      0.07      0.00      0.05     99.23
04:15:01 AM       1      0.10      0.00      0.05      0.00      0.02     99.83
04:16:01 AM     all      3.82      0.00      0.29      0.00      0.04     95.84
04:16:01 AM       0      0.70      0.00      0.12      0.00      0.03     99.15
04:16:01 AM       1      7.06      0.00      0.47      0.00      0.05     92.42
04:17:01 AM     all      5.79      0.00      2.60      0.00      0.06     91.55
04:17:01 AM       0      1.40      0.00      0.17      0.00      0.03     98.40
04:17:01 AM       1     10.37      0.00      5.13      0.00      0.09     84.41
04:18:02 AM     all      4.26      0.00      0.33      0.00      0.05     95.35
04:18:02 AM       0      2.79      0.00      0.25      0.00      0.05     96.90
04:18:02 AM       1      5.73      0.00      0.42      0.00      0.05     93.80
04:19:01 AM     all      4.20      0.00      0.32      0.00      0.05     95.44
04:19:01 AM       0      4.26      0.00      0.32      0.00      0.05     95.37
04:19:01 AM       1      4.14      0.00      0.31      0.00      0.05     95.50
04:20:01 AM     all      4.41      0.00      0.33      0.00      0.06     95.20
04:20:01 AM       0      3.36      0.00      0.25      0.00      0.05     96.34
04:20:01 AM       1      5.46      0.00      0.42      0.00      0.07     94.06
04:21:01 AM     all      4.43      0.00      0.34      0.00      0.04     95.18
04:21:01 AM       0      1.87      0.00      0.20      0.00      0.03     97.90
04:21:01 AM       1      7.00      0.00      0.49      0.00      0.05     92.46
04:22:01 AM     all      4.37      0.00      0.31      0.00      0.07     95.26
04:22:01 AM       0      2.59      0.00      0.22      0.00      0.05     97.14
04:22:01 AM       1      6.15      0.00      0.40      0.00      0.08     93.37
04:23:01 AM     all      6.79      0.00      0.38      0.00      0.05     92.78
04:23:01 AM       0      6.84      0.00      0.40      0.00      0.05     92.71
04:23:01 AM       1      6.74      0.00      0.35      0.00      0.05     92.86
04:24:01 AM     all      0.66      0.00      0.09      0.00      0.04     99.21
04:24:01 AM       0      0.70      0.00      0.13      0.00      0.05     99.11
04:24:01 AM       1      0.62      0.00      0.05      0.00      0.03     99.30

04:24:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
04:25:01 AM     all      0.33      0.00      0.05      0.00      0.03     99.60
04:25:01 AM       0      0.08      0.00      0.07      0.00      0.03     99.82
04:25:01 AM       1      0.57      0.00      0.03      0.00      0.02     99.38
04:26:01 AM     all      0.51      0.00      0.07      0.00      0.03     99.40
04:26:01 AM       0      0.12      0.00      0.07      0.00      0.02     99.80
04:26:01 AM       1      0.90      0.00      0.07      0.00      0.03     99.00
04:27:01 AM     all      0.27      0.00      0.05      0.00      0.03     99.65
04:27:01 AM       0      0.10      0.00      0.07      0.00      0.05     99.78
04:27:01 AM       1      0.43      0.00      0.03      0.00      0.02     99.52
04:28:01 AM     all      0.34      0.00      0.05      0.00      0.03     99.57
04:28:01 AM       0      0.15      0.00      0.08      0.00      0.05     99.72
04:28:01 AM       1      0.53      0.00      0.02      0.00      0.02     99.43
04:29:01 AM     all      0.50      0.00      0.06      0.00      0.03     99.42
04:29:01 AM       0      0.27      0.00      0.08      0.00      0.03     99.62
04:29:01 AM       1      0.73      0.00      0.03      0.00      0.02     99.22
04:30:01 AM     all      0.33      0.00      0.07      0.00      0.03     99.57
04:30:01 AM       0      0.12      0.00      0.07      0.00      0.03     99.78
04:30:01 AM       1      0.55      0.00      0.07      0.00      0.02     99.37
04:31:01 AM     all      5.98      0.00      3.80      0.00      0.06     90.16
04:31:01 AM       0      1.89      0.00      0.25      0.00      0.05     97.81
04:31:01 AM       1     10.34      0.00      7.57      0.00      0.07     82.02
04:32:01 AM     all      5.83      0.00      1.51      0.00      0.05     92.61
04:32:01 AM       0      1.55      0.00      0.19      0.00      0.03     98.23
04:32:01 AM       1     10.32      0.00      2.90      0.00      0.07     86.70
04:33:01 AM     all      0.31      0.00      0.08      0.00      0.03     99.58
04:33:01 AM       0      0.52      0.00      0.08      0.00      0.03     99.37
04:33:01 AM       1      0.10      0.00      0.07      0.00      0.03     99.80
04:34:01 AM     all      1.25      0.00      0.13      0.00      0.03     98.58
04:34:01 AM       0      2.17      0.00      0.13      0.00      0.02     97.67
04:34:01 AM       1      0.33      0.00      0.13      0.00      0.05     99.48
04:35:01 AM     all      3.82      0.00      1.34      0.00      0.06     94.78
04:35:01 AM       0      5.27      0.00      2.46      0.00      0.05     92.22
04:35:01 AM       1      2.39      0.00      0.25      0.00      0.07     97.29

04:35:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
04:36:01 AM     all      3.32      0.00      1.17      0.00      0.06     95.45
04:36:01 AM       0      0.25      0.00      0.12      0.00      0.03     99.60
04:36:01 AM       1      6.50      0.00      2.27      0.00      0.09     91.14
04:37:01 AM     all      2.02      0.00      0.50      0.00      0.03     97.45
04:37:01 AM       0      3.07      0.00      0.19      0.00      0.03     96.71
04:37:01 AM       1      0.98      0.00      0.81      0.00      0.03     98.18
04:38:01 AM     all      0.25      0.00      0.08      0.00      0.03     99.64
04:38:01 AM       0      0.33      0.00      0.05      0.00      0.03     99.58
04:38:01 AM       1      0.17      0.00      0.10      0.00      0.03     99.70
04:39:01 AM     all      5.28      0.00      2.22      0.00      0.05     92.44
04:39:01 AM       0      6.86      0.00      4.23      0.00      0.05     88.86
04:39:01 AM       1      3.75      0.00      0.27      0.00      0.05     95.93
04:40:01 AM     all      5.42      0.00      0.65      0.02      0.06     93.86
04:40:01 AM       0      5.83      0.00      0.90      0.00      0.07     93.20
04:40:01 AM       1      5.02      0.00      0.40      0.03      0.05     94.50
04:41:01 AM     all      4.42      0.00      0.33      0.00      0.06     95.20
04:41:01 AM       0      3.76      0.00      0.30      0.00      0.05     95.88
04:41:01 AM       1      5.07      0.00      0.35      0.00      0.07     94.52
04:42:01 AM     all      4.03      0.00      0.28      0.00      0.05     95.63
04:42:01 AM       0      3.48      0.00      0.27      0.00      0.05     96.20
04:42:01 AM       1      4.59      0.00      0.30      0.00      0.05     95.06
04:43:01 AM     all      4.19      0.00      0.28      0.00      0.06     95.47
04:43:01 AM       0      3.76      0.00      0.25      0.00      0.07     95.92
04:43:01 AM       1      4.62      0.00      0.30      0.00      0.05     95.03
04:44:01 AM     all      4.31      0.00      0.31      0.00      0.07     95.31
04:44:01 AM       0      3.58      0.00      0.27      0.00      0.07     96.08
04:44:01 AM       1      5.04      0.00      0.35      0.00      0.07     94.54
04:45:01 AM     all      4.34      0.00      0.33      0.00      0.06     95.27
04:45:01 AM       0      2.64      0.00      0.25      0.00      0.05     97.06
04:45:01 AM       1      6.04      0.00      0.42      0.00      0.07     93.47
04:46:01 AM     all      5.88      0.00      0.30      0.00      0.06     93.76
04:46:01 AM       0      3.73      0.00      0.22      0.00      0.07     95.98
04:46:01 AM       1      8.03      0.00      0.39      0.00      0.05     91.54

04:46:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
04:47:01 AM     all      0.55      0.00      0.07      0.00      0.03     99.35
04:47:01 AM       0      0.45      0.00      0.08      0.00      0.03     99.43
04:47:01 AM       1      0.65      0.00      0.05      0.00      0.03     99.27
04:48:01 AM     all      0.24      0.00      0.06      0.00      0.04     99.66
04:48:01 AM       0      0.42      0.00      0.08      0.00      0.05     99.45
04:48:01 AM       1      0.07      0.00      0.03      0.00      0.03     99.87
04:49:01 AM     all      0.52      0.00      0.08      0.00      0.03     99.37
04:49:01 AM       0      0.50      0.00      0.05      0.00      0.03     99.42
04:49:01 AM       1      0.53      0.00      0.10      0.00      0.03     99.33
04:50:01 AM     all      0.26      0.00      0.10      0.01      0.03     99.60
04:50:01 AM       0      0.08      0.00      0.08      0.02      0.03     99.78
04:50:01 AM       1      0.43      0.00      0.12      0.00      0.03     99.42
04:51:01 AM     all      0.30      0.00      0.08      0.00      0.03     99.59
04:51:01 AM       0      0.30      0.00      0.08      0.00      0.05     99.57
04:51:01 AM       1      0.30      0.00      0.07      0.00      0.02     99.61
04:52:01 AM     all      0.33      0.00      0.05      0.00      0.03     99.59
04:52:01 AM       0      0.13      0.00      0.08      0.00      0.03     99.75
04:52:01 AM       1      0.52      0.00      0.02      0.00      0.03     99.43
04:53:01 AM     all      0.77      0.00      0.05      0.00      0.03     99.15
04:53:01 AM       0      0.22      0.00      0.08      0.00      0.05     99.65
04:53:01 AM       1      1.32      0.00      0.02      0.00      0.02     98.65
04:54:01 AM     all      6.96      0.00      4.12      0.00      0.06     88.86
04:54:01 AM       0      0.85      0.00      0.20      0.00      0.05     98.90
04:54:01 AM       1     13.67      0.00      8.43      0.00      0.07     77.82
04:55:01 AM     all      7.18      0.00      4.07      0.00      0.07     88.68
04:55:01 AM       0      0.43      0.00      0.25      0.00      0.05     99.26
04:55:01 AM       1     14.53      0.00      8.23      0.00      0.09     77.14
04:56:01 AM     all      6.75      0.00      4.61      0.00      0.07     88.57
04:56:01 AM       0     13.76      0.00      9.48      0.00      0.09     76.66
04:56:01 AM       1      0.48      0.00      0.27      0.00      0.05     99.20
04:57:01 AM     all      6.56      0.00      4.05      0.00      0.08     89.31
04:57:01 AM       0      6.52      0.00      7.64      0.00      0.07     85.77
04:57:01 AM       1      6.60      0.00      0.69      0.00      0.09     92.62

04:57:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
04:58:01 AM     all      6.84      0.00      3.97      0.00      0.06     89.13
04:58:01 AM       0     11.78      0.00      8.14      0.00      0.09     79.99
04:58:01 AM       1      2.44      0.00      0.27      0.00      0.03     97.26
04:59:01 AM     all      6.38      0.00      3.43      0.00      0.07     90.12
04:59:01 AM       0      9.77      0.00      6.65      0.00      0.07     83.50
04:59:01 AM       1      3.26      0.00      0.46      0.00      0.07     96.21
05:00:01 AM     all      6.57      0.00      3.66      0.00      0.07     89.71
05:00:01 AM       0     12.09      0.00      7.28      0.00      0.09     80.54
05:00:01 AM       1      1.62      0.00      0.42      0.00      0.05     97.91
05:01:01 AM     all     25.12      0.00      2.30      0.09      0.08     72.41
05:01:01 AM       0      7.25      0.00      1.63      0.05      0.08     90.98
05:01:01 AM       1     42.86      0.00      2.96      0.13      0.08     53.96
05:02:01 AM     all     31.92      0.00      3.50      0.68      0.08     63.82
05:02:01 AM       0     31.48      0.00      3.55      0.75      0.08     64.13
05:02:01 AM       1     32.36      0.00      3.45      0.60      0.08     63.50
Average:        all      3.15      0.02      0.57      0.02      0.05     96.18
Average:          0      2.65      0.04      0.53      0.01      0.05     96.72
Average:          1      3.64      0.00      0.61      0.03      0.06     95.65