Started by upstream project "integration-distribution-mri-test-calcium" build number 32
originally caused by:
 Started by timer
Running as SYSTEM
[EnvInject] - Loading node environment variables.
Building remotely on prd-centos8-robot-2c-8g-9657 (centos8-robot-2c-8g) in workspace /w/workspace/controller-csit-3node-clustering-ask-all-calcium
[ssh-agent] Looking for ssh-agent implementation...
[ssh-agent]   Exec ssh-agent (binary ssh-agent on a remote machine)
$ ssh-agent
SSH_AUTH_SOCK=/tmp/ssh-5I8XqtteUjES/agent.5283
SSH_AGENT_PID=5284
[ssh-agent] Started.
Running ssh-add (command line suppressed)
Identity added: /w/workspace/controller-csit-3node-clustering-ask-all-calcium@tmp/private_key_16132615153198023229.key (/w/workspace/controller-csit-3node-clustering-ask-all-calcium@tmp/private_key_16132615153198023229.key)
[ssh-agent] Using credentials jenkins (Release Engineering Jenkins Key)
The recommended git tool is: NONE
using credential opendaylight-jenkins-ssh
Wiping out workspace first.
Cloning the remote Git repository
Cloning repository git://devvexx.opendaylight.org/mirror/integration/test
 > git init /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test # timeout=10
Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test
 > git --version # timeout=10
 > git --version # 'git version 2.43.0'
using GIT_SSH to set credentials Release Engineering Jenkins Key
[INFO] Currently running in a labeled security context
[INFO] Currently SELinux is 'enforcing' on the host
 > /usr/bin/chcon --type=ssh_home_t /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test@tmp/jenkins-gitclient-ssh6918147093349354464.key
Verifying host key using known hosts file
You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification.
 > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10
Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test
using GIT_SSH to set credentials Release Engineering Jenkins Key
[INFO] Currently running in a labeled security context
[INFO] Currently SELinux is 'enforcing' on the host
 > /usr/bin/chcon --type=ssh_home_t /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test@tmp/jenkins-gitclient-ssh15783633717585457386.key
Verifying host key using known hosts file
You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification.
 > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test master # timeout=10
 > git rev-parse FETCH_HEAD^{commit} # timeout=10
Checking out Revision 02dd570f7544c8cd6eb17bda775de9bccc89f923 (origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 02dd570f7544c8cd6eb17bda775de9bccc89f923 # timeout=10
Commit message: "Migrate Get Requests invocations(libraries)"
 > git rev-parse FETCH_HEAD^{commit} # timeout=10
 > git rev-list --no-walk c88ead2b4a65ba004398ad07cfe033ae1e467b17 # timeout=10
No emails were triggered.
provisioning config files...
copy managed file [npmrc] to file:/home/jenkins/.npmrc
copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf
copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
[controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash /tmp/jenkins1408649765212049618.sh
---> python-tools-install.sh
Setup pyenv:
  system
* 3.8.13 (set by /opt/pyenv/version)
* 3.9.13 (set by /opt/pyenv/version)
* 3.10.13 (set by /opt/pyenv/version)
* 3.11.7 (set by /opt/pyenv/version)
lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-fQDw
lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: lftools 
lf-activate-venv(): INFO: Adding /tmp/venv-fQDw/bin to PATH
Generating Requirements File
Python 3.11.7
pip 24.0 from /tmp/venv-fQDw/lib/python3.11/site-packages/pip (python 3.11)
appdirs==1.4.4
argcomplete==3.3.0
aspy.yaml==1.3.0
attrs==23.2.0
autopage==0.5.2
beautifulsoup4==4.12.3
boto3==1.34.88
botocore==1.34.88
bs4==0.0.2
cachetools==5.3.3
certifi==2024.2.2
cffi==1.16.0
cfgv==3.4.0
chardet==5.2.0
charset-normalizer==3.3.2
click==8.1.7
cliff==4.6.0
cmd2==2.4.3
cryptography==3.3.2
debtcollector==3.0.0
decorator==5.1.1
defusedxml==0.7.1
Deprecated==1.2.14
distlib==0.3.8
dnspython==2.6.1
docker==4.2.2
dogpile.cache==1.3.2
email_validator==2.1.1
filelock==3.13.4
future==1.0.0
gitdb==4.0.11
GitPython==3.1.43
google-auth==2.29.0
httplib2==0.22.0
identify==2.5.36
idna==3.7
importlib-resources==1.5.0
iso8601==2.1.0
Jinja2==3.1.3
jmespath==1.0.1
jsonpatch==1.33
jsonpointer==2.4
jsonschema==4.21.1
jsonschema-specifications==2023.12.1
keystoneauth1==5.6.0
kubernetes==29.0.0
lftools==0.37.10
lxml==5.2.1
MarkupSafe==2.1.5
msgpack==1.0.8
multi_key_dict==2.0.3
munch==4.0.0
netaddr==1.2.1
netifaces==0.11.0
niet==1.4.2
nodeenv==1.8.0
oauth2client==4.1.3
oauthlib==3.2.2
openstacksdk==3.1.0
os-client-config==2.1.0
os-service-types==1.7.0
osc-lib==3.0.1
oslo.config==9.4.0
oslo.context==5.5.0
oslo.i18n==6.3.0
oslo.log==5.5.1
oslo.serialization==5.4.0
oslo.utils==7.1.0
packaging==24.0
pbr==6.0.0
platformdirs==4.2.0
prettytable==3.10.0
pyasn1==0.6.0
pyasn1_modules==0.4.0
pycparser==2.22
pygerrit2==2.0.15
PyGithub==2.3.0
pyinotify==0.9.6
PyJWT==2.8.0
PyNaCl==1.5.0
pyparsing==2.4.7
pyperclip==1.8.2
pyrsistent==0.20.0
python-cinderclient==9.5.0
python-dateutil==2.9.0.post0
python-heatclient==3.5.0
python-jenkins==1.8.2
python-keystoneclient==5.4.0
python-magnumclient==4.4.0
python-novaclient==18.6.0
python-openstackclient==6.6.0
python-swiftclient==4.5.0
PyYAML==6.0.1
referencing==0.34.0
requests==2.31.0
requests-oauthlib==2.0.0
requestsexceptions==1.4.0
rfc3986==2.0.0
rpds-py==0.18.0
rsa==4.9
ruamel.yaml==0.18.6
ruamel.yaml.clib==0.2.8
s3transfer==0.10.1
simplejson==3.19.2
six==1.16.0
smmap==5.0.1
soupsieve==2.5
stevedore==5.2.0
tabulate==0.9.0
toml==0.10.2
tomlkit==0.12.4
tqdm==4.66.2
typing_extensions==4.11.0
tzdata==2024.1
urllib3==1.26.18
virtualenv==20.25.3
wcwidth==0.2.13
websocket-client==1.7.0
wrapt==1.16.0
xdg==6.0.0
xmltodict==0.13.0
yq==3.4.1
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties content 
OS_STACK_TEMPLATE=csit-2-instance-type.yaml
OS_CLOUD=vex
OS_STACK_NAME=releng-controller-csit-3node-clustering-ask-all-calcium-32
OS_STACK_TEMPLATE_DIR=openstack-hot

[EnvInject] - Variables injected successfully.
provisioning config files...
copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
[controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash /tmp/jenkins798135165450947822.sh
---> Create parameters file for OpenStack HOT
OpenStack Heat parameters generated
-----------------------------------
parameters:
    vm_0_count: '3'
    vm_0_flavor: 'v3-standard-4'
    vm_0_image: 'ZZCI - CentOS Stream 8 - builder - x86_64 - 20240401-160147.446'
    vm_1_count: '0'
    vm_1_flavor: 'v3-standard-2'
    vm_1_image: 'ZZCI - Ubuntu 18.04 - mininet-ovs-28 - x86_64 - 20230601-180106.003'
    
    job_name: '37733-32'
    silo: 'releng'
[controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash -l /tmp/jenkins5439004554978714151.sh
---> Create HEAT stack
+ source /home/jenkins/lf-env.sh
+ lf-activate-venv --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
++ mktemp -d /tmp/venv-XXXX
+ lf_venv=/tmp/venv-CHrG
+ local venv_file=/tmp/.os_lf_venv
+ local python=python3
+ local options
+ local set_path=true
+ local install_args=
++ getopt -o np:v: -l no-path,system-site-packages,python:,venv-file: -n lf-activate-venv -- --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
+ options=' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\'''
+ eval set -- ' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\'''
++ set -- --python python3 -- 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
+ true
+ case $1 in
+ python=python3
+ shift 2
+ true
+ case $1 in
+ shift
+ break
+ case $python in
+ local pkg_list=
+ [[ -d /opt/pyenv ]]
+ echo 'Setup pyenv:'
Setup pyenv:
+ export PYENV_ROOT=/opt/pyenv
+ PYENV_ROOT=/opt/pyenv
+ export PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
+ PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
+ pyenv versions
  system
  3.8.13
  3.9.13
  3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-ask-all-calcium/.python-version)
+ command -v pyenv
++ pyenv init - --no-rehash
+ eval 'PATH="$(bash --norc -ec '\''IFS=:; paths=($PATH); 
for i in ${!paths[@]}; do 
if [[ ${paths[i]} == "'\'''\''/opt/pyenv/shims'\'''\''" ]]; then unset '\''\'\'''\''paths[i]'\''\'\'''\''; 
fi; done; 
echo "${paths[*]}"'\'')"
export PATH="/opt/pyenv/shims:${PATH}"
export PYENV_SHELL=bash
source '\''/opt/pyenv/libexec/../completions/pyenv.bash'\''
pyenv() {
  local command
  command="${1:-}"
  if [ "$#" -gt 0 ]; then
    shift
  fi

  case "$command" in
  rehash|shell)
    eval "$(pyenv "sh-$command" "$@")"
    ;;
  *)
    command pyenv "$command" "$@"
    ;;
  esac
}'
+++ bash --norc -ec 'IFS=:; paths=($PATH); 
for i in ${!paths[@]}; do 
if [[ ${paths[i]} == "/opt/pyenv/shims" ]]; then unset '\''paths[i]'\''; 
fi; done; 
echo "${paths[*]}"'
++ PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
++ export PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
++ PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
++ export PYENV_SHELL=bash
++ PYENV_SHELL=bash
++ source /opt/pyenv/libexec/../completions/pyenv.bash
+++ complete -F _pyenv pyenv
++ lf-pyver python3
++ local py_version_xy=python3
++ local py_version_xyz=
++ awk '{ print $1 }'
++ pyenv versions
++ local command
++ command=versions
++ '[' 1 -gt 0 ']'
++ shift
++ case "$command" in
++ command pyenv versions
++ pyenv versions
++ sed 's/^[ *]* //'
++ grep -E '^[0-9.]*[0-9]$'
++ [[ ! -s /tmp/.pyenv_versions ]]
+++ grep '^3' /tmp/.pyenv_versions
+++ tail -n 1
+++ sort -V
++ py_version_xyz=3.11.7
++ [[ -z 3.11.7 ]]
++ echo 3.11.7
++ return 0
+ pyenv local 3.11.7
+ local command
+ command=local
+ '[' 2 -gt 0 ']'
+ shift
+ case "$command" in
+ command pyenv local 3.11.7
+ pyenv local 3.11.7
+ for arg in "$@"
+ case $arg in
+ pkg_list+='lftools[openstack] '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='kubernetes '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='niet '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='python-heatclient '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='python-openstackclient '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='python-magnumclient '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='yq '
+ [[ -f /tmp/.os_lf_venv ]]
++ cat /tmp/.os_lf_venv
+ lf_venv=/tmp/venv-fQDw
+ echo 'lf-activate-venv(): INFO: Reuse venv:/tmp/venv-fQDw from' file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-fQDw from file:/tmp/.os_lf_venv
+ /tmp/venv-fQDw/bin/python3 -m pip install --upgrade --quiet pip virtualenv
+ [[ -z lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq  ]]
+ echo 'lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq '
lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 
+ /tmp/venv-fQDw/bin/python3 -m pip install --upgrade --quiet --upgrade-strategy eager 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
+ type python3
+ true
+ echo 'lf-activate-venv(): INFO: Adding /tmp/venv-fQDw/bin to PATH'
lf-activate-venv(): INFO: Adding /tmp/venv-fQDw/bin to PATH
+ PATH=/tmp/venv-fQDw/bin:/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
+ return 0
+ openstack --os-cloud vex limits show --absolute
+--------------------------+---------+
| Name                     |   Value |
+--------------------------+---------+
| maxTotalInstances        |      -1 |
| maxTotalCores            |     450 |
| maxTotalRAMSize          | 1000000 |
| maxServerMeta            |     128 |
| maxImageMeta             |     128 |
| maxPersonality           |       5 |
| maxPersonalitySize       |   10240 |
| maxTotalKeypairs         |     100 |
| maxServerGroups          |      10 |
| maxServerGroupMembers    |      10 |
| maxTotalFloatingIps      |      -1 |
| maxSecurityGroups        |      -1 |
| maxSecurityGroupRules    |      -1 |
| totalRAMUsed             |  655360 |
| totalCoresUsed           |     160 |
| totalInstancesUsed       |      52 |
| totalFloatingIpsUsed     |       0 |
| totalSecurityGroupsUsed  |       0 |
| totalServerGroupsUsed    |       0 |
| maxTotalVolumes          |      -1 |
| maxTotalSnapshots        |      10 |
| maxTotalVolumeGigabytes  |    4096 |
| maxTotalBackups          |      10 |
| maxTotalBackupGigabytes  |    1000 |
| totalVolumesUsed         |       0 |
| totalGigabytesUsed       |       0 |
| totalSnapshotsUsed       |       0 |
| totalBackupsUsed         |       0 |
| totalBackupGigabytesUsed |       0 |
+--------------------------+---------+
+ pushd /opt/ciman/openstack-hot
/opt/ciman/openstack-hot /w/workspace/controller-csit-3node-clustering-ask-all-calcium
+ lftools openstack --os-cloud vex stack create releng-controller-csit-3node-clustering-ask-all-calcium-32 csit-2-instance-type.yaml /w/workspace/controller-csit-3node-clustering-ask-all-calcium/stack-parameters.yaml
Creating stack releng-controller-csit-3node-clustering-ask-all-calcium-32
Waiting to initialize infrastructure...
Stack initialization successful.
------------------------------------
Stack Details
------------------------------------
{'added': None,
 'capabilities': [],
 'created_at': '2024-04-20T23:45:41Z',
 'deleted': None,
 'deleted_at': None,
 'description': 'No description',
 'environment': None,
 'environment_files': None,
 'files': None,
 'files_container': None,
 'id': '0ad78205-ddb3-4052-aca1-849f980369bb',
 'is_rollback_disabled': True,
 'links': [{'href': 'https://orchestration.public.mtl1.vexxhost.net/v1/12c36e260d8e4bb2913965203b1b491f/stacks/releng-controller-csit-3node-clustering-ask-all-calcium-32/0ad78205-ddb3-4052-aca1-849f980369bb',
            'rel': 'self'}],
 'location': Munch({'cloud': 'vex', 'region_name': 'ca-ymq-1', 'zone': None, 'project': Munch({'id': '12c36e260d8e4bb2913965203b1b491f', 'name': '61975f2c-7c17-4d69-82fa-c3ae420ad6fd', 'domain_id': None, 'domain_name': 'Default'})}),
 'name': 'releng-controller-csit-3node-clustering-ask-all-calcium-32',
 'notification_topics': [],
 'outputs': [{'description': 'IP addresses of the 2nd vm types',
              'output_key': 'vm_1_ips',
              'output_value': []},
             {'description': 'IP addresses of the 1st vm types',
              'output_key': 'vm_0_ips',
              'output_value': ['10.30.171.102',
                               '10.30.171.170',
                               '10.30.171.45']}],
 'owner_id': ****,
 'parameters': {'OS::project_id': '12c36e260d8e4bb2913965203b1b491f',
                'OS::stack_id': '0ad78205-ddb3-4052-aca1-849f980369bb',
                'OS::stack_name': 'releng-controller-csit-3node-clustering-ask-all-calcium-32',
                'job_name': '37733-32',
                'silo': 'releng',
                'vm_0_count': '3',
                'vm_0_flavor': 'v3-standard-4',
                'vm_0_image': 'ZZCI - CentOS Stream 8 - builder - x86_64 - '
                              '20240401-160147.446',
                'vm_1_count': '0',
                'vm_1_flavor': 'v3-standard-2',
                'vm_1_image': 'ZZCI - Ubuntu 18.04 - mininet-ovs-28 - x86_64 - '
                              '20230601-180106.003'},
 'parent_id': None,
 'replaced': None,
 'status': 'CREATE_COMPLETE',
 'status_reason': 'Stack CREATE completed successfully',
 'tags': [],
 'template': None,
 'template_description': 'No description',
 'template_url': None,
 'timeout_mins': 15,
 'unchanged': None,
 'updated': None,
 'updated_at': None,
 'user_project_id': 'a23cd633775744739987fbd5501702cd'}
------------------------------------
+ popd
/w/workspace/controller-csit-3node-clustering-ask-all-calcium
[controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash -l /tmp/jenkins204974449796896989.sh
---> Copy SSH public keys to CSIT lab
Setup pyenv:
  system
  3.8.13
  3.9.13
  3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-ask-all-calcium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-fQDw from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes python-heatclient python-openstackclient 
lf-activate-venv(): INFO: Adding /tmp/venv-fQDw/bin to PATH
SSH not responding on 10.30.171.170. Retrying in 10 seconds...
SSH not responding on 10.30.171.102. Retrying in 10 seconds...
SSH not responding on 10.30.171.45. Retrying in 10 seconds...
Ping to 10.30.171.170 successful.
Ping to 10.30.171.102 successful.
Ping to 10.30.171.45 successful.
SSH not responding on 10.30.171.170. Retrying in 10 seconds...
SSH not responding on 10.30.171.102. Retrying in 10 seconds...
SSH not responding on 10.30.171.45. Retrying in 10 seconds...
Ping to 10.30.171.170 successful.
Ping to 10.30.171.102 successful.
Ping to 10.30.171.45 successful.
SSH not responding on 10.30.171.102. Retrying in 10 seconds...
SSH not responding on 10.30.171.45. Retrying in 10 seconds...
Warning: Permanently added '10.30.171.170' (ECDSA) to the list of known hosts.
10.30.171.170 releng-37733-32-0-builder-1.novalocal
Successfully copied public keys to slave 10.30.171.170
Ping to 10.30.171.102 successful.
Ping to 10.30.171.45 successful.
SSH not responding on 10.30.171.102. Retrying in 10 seconds...
Warning: Permanently added '10.30.171.45' (ECDSA) to the list of known hosts.
10.30.171.45 releng-37733-32-0-builder-2.novalocal
Successfully copied public keys to slave 10.30.171.45
Ping to 10.30.171.102 successful.
Warning: Permanently added '10.30.171.102' (ECDSA) to the list of known hosts.
10.30.171.102 releng-37733-32-0-builder-0.novalocal
Successfully copied public keys to slave 10.30.171.102
Process 6696 ready.
Process 6697 ready.
Process 6698 ready.
SSH ready on all stack servers.
[controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash -l /tmp/jenkins15846041322683195807.sh
Setup pyenv:
  system
  3.8.13
  3.9.13
  3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-ask-all-calcium/.python-version)
lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-Q2QY
lf-activate-venv(): INFO: Save venv in file: /w/workspace/controller-csit-3node-clustering-ask-all-calcium/.robot_venv
lf-activate-venv(): INFO: Installing: setuptools wheel 
lf-activate-venv(): INFO: Adding /tmp/venv-Q2QY/bin to PATH
+ echo 'Installing Python Requirements'
Installing Python Requirements
+ cat
+ python -m pip install -r requirements.txt
Looking in indexes: https://nexus3.opendaylight.org/repository/PyPi/simple
Collecting docker-py (from -r requirements.txt (line 1))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/docker-py/1.10.6/docker_py-1.10.6-py2.py3-none-any.whl (50 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 50.0/50.0 kB 9.2 MB/s eta 0:00:00
Collecting ipaddr (from -r requirements.txt (line 2))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/ipaddr/2.2.0/ipaddr-2.2.0.tar.gz (26 kB)
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'done'
Collecting netaddr (from -r requirements.txt (line 3))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/netaddr/1.2.1/netaddr-1.2.1-py3-none-any.whl (2.3 MB)
Collecting netifaces (from -r requirements.txt (line 4))
  Using cached netifaces-0.11.0-cp311-cp311-linux_x86_64.whl
Collecting pyhocon (from -r requirements.txt (line 5))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyhocon/0.3.60/pyhocon-0.3.60.tar.gz (158 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 158.8/158.8 kB 12.8 MB/s eta 0:00:00
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'done'
Collecting requests (from -r requirements.txt (line 6))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/requests/2.31.0/requests-2.31.0-py3-none-any.whl (62 kB)
Collecting robotframework (from -r requirements.txt (line 7))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework/7.0/robotframework-7.0-py3-none-any.whl (726 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 726.3/726.3 kB 12.0 MB/s eta 0:00:00
Collecting robotframework-httplibrary (from -r requirements.txt (line 8))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-httplibrary/0.4.2/robotframework-httplibrary-0.4.2.tar.gz (9.1 kB)
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'done'
Collecting robotframework-requests==0.9.3 (from -r requirements.txt (line 9))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-requests/0.9.3/robotframework_requests-0.9.3-py3-none-any.whl (21 kB)
Collecting robotframework-selenium2library (from -r requirements.txt (line 10))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-selenium2library/3.0.0/robotframework_selenium2library-3.0.0-py2.py3-none-any.whl (6.2 kB)
Collecting robotframework-sshlibrary==3.8.0 (from -r requirements.txt (line 11))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-sshlibrary/3.8.0/robotframework-sshlibrary-3.8.0.tar.gz (51 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 51.4/51.4 kB 5.6 MB/s eta 0:00:00
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'done'
Collecting scapy (from -r requirements.txt (line 12))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/scapy/2.5.0/scapy-2.5.0.tar.gz (1.3 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.3/1.3 MB 50.3 MB/s eta 0:00:00
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'done'
Collecting jsonpath-rw (from -r requirements.txt (line 15))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpath-rw/1.4.0/jsonpath-rw-1.4.0.tar.gz (13 kB)
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'done'
Collecting elasticsearch (from -r requirements.txt (line 18))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch/8.13.0/elasticsearch-8.13.0-py3-none-any.whl (451 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 451.0/451.0 kB 12.3 MB/s eta 0:00:00
Collecting elasticsearch-dsl (from -r requirements.txt (line 19))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch-dsl/8.13.0/elasticsearch_dsl-8.13.0-py3-none-any.whl (88 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 88.6/88.6 kB 11.8 MB/s eta 0:00:00
Collecting pyangbind (from -r requirements.txt (line 22))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyangbind/0.8.5/pyangbind-0.8.5-py3-none-any.whl (52 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 52.9/52.9 kB 8.9 MB/s eta 0:00:00
Collecting isodate (from -r requirements.txt (line 25))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/isodate/0.6.1/isodate-0.6.1-py2.py3-none-any.whl (41 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 41.7/41.7 kB 8.2 MB/s eta 0:00:00
Collecting jmespath (from -r requirements.txt (line 28))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jmespath/1.0.1/jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting jsonpatch (from -r requirements.txt (line 31))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpatch/1.33/jsonpatch-1.33-py2.py3-none-any.whl (12 kB)
Collecting paramiko>=1.15.3 (from robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/paramiko/3.4.0/paramiko-3.4.0-py3-none-any.whl (225 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 225.9/225.9 kB 23.6 MB/s eta 0:00:00
Collecting scp>=0.13.0 (from robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/scp/0.14.5/scp-0.14.5-py2.py3-none-any.whl (8.7 kB)
Collecting docker-pycreds>=0.2.1 (from docker-py->-r requirements.txt (line 1))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/docker-pycreds/0.4.0/docker_pycreds-0.4.0-py2.py3-none-any.whl (9.0 kB)
Collecting six>=1.4.0 (from docker-py->-r requirements.txt (line 1))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/six/1.16.0/six-1.16.0-py2.py3-none-any.whl (11 kB)
Collecting websocket-client>=0.32.0 (from docker-py->-r requirements.txt (line 1))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/websocket-client/1.7.0/websocket_client-1.7.0-py3-none-any.whl (58 kB)
Collecting pyparsing<4,>=2 (from pyhocon->-r requirements.txt (line 5))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pyparsing/3.1.2/pyparsing-3.1.2-py3-none-any.whl (103 kB)
Collecting charset-normalizer<4,>=2 (from requests->-r requirements.txt (line 6))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/charset-normalizer/3.3.2/charset_normalizer-3.3.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (140 kB)
Collecting idna<4,>=2.5 (from requests->-r requirements.txt (line 6))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/idna/3.7/idna-3.7-py3-none-any.whl (66 kB)
Collecting urllib3<3,>=1.21.1 (from requests->-r requirements.txt (line 6))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/urllib3/2.2.1/urllib3-2.2.1-py3-none-any.whl (121 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 121.1/121.1 kB 15.6 MB/s eta 0:00:00
Collecting certifi>=2017.4.17 (from requests->-r requirements.txt (line 6))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/certifi/2024.2.2/certifi-2024.2.2-py3-none-any.whl (163 kB)
Collecting webtest>=2.0 (from robotframework-httplibrary->-r requirements.txt (line 8))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/webtest/3.0.0/WebTest-3.0.0-py3-none-any.whl (31 kB)
Collecting jsonpointer (from robotframework-httplibrary->-r requirements.txt (line 8))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpointer/2.4/jsonpointer-2.4-py2.py3-none-any.whl (7.8 kB)
Collecting robotframework-seleniumlibrary>=3.0.0 (from robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-seleniumlibrary/6.3.0/robotframework_seleniumlibrary-6.3.0-py2.py3-none-any.whl (97 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 97.6/97.6 kB 19.0 MB/s eta 0:00:00
Collecting ply (from jsonpath-rw->-r requirements.txt (line 15))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/ply/3.11/ply-3.11-py2.py3-none-any.whl (49 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 49.6/49.6 kB 12.2 MB/s eta 0:00:00
Collecting decorator (from jsonpath-rw->-r requirements.txt (line 15))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/decorator/5.1.1/decorator-5.1.1-py3-none-any.whl (9.1 kB)
Collecting elastic-transport<9,>=8.13 (from elasticsearch->-r requirements.txt (line 18))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elastic-transport/8.13.0/elastic_transport-8.13.0-py3-none-any.whl (64 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 64.3/64.3 kB 9.9 MB/s eta 0:00:00
Collecting python-dateutil (from elasticsearch-dsl->-r requirements.txt (line 19))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/python-dateutil/2.9.0.post0/python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB)
Collecting pyang (from pyangbind->-r requirements.txt (line 22))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyang/2.6.0/pyang-2.6.0-py2.py3-none-any.whl (594 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 594.1/594.1 kB 13.7 MB/s eta 0:00:00
Collecting lxml (from pyangbind->-r requirements.txt (line 22))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/lxml/5.2.1/lxml-5.2.1-cp311-cp311-manylinux_2_28_x86_64.whl (5.0 MB)
Collecting regex (from pyangbind->-r requirements.txt (line 22))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/regex/2024.4.16/regex-2024.4.16-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (785 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 785.1/785.1 kB 19.0 MB/s eta 0:00:00
Collecting enum34 (from pyangbind->-r requirements.txt (line 22))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/enum34/1.1.10/enum34-1.1.10-py3-none-any.whl (11 kB)
Collecting bcrypt>=3.2 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/bcrypt/4.1.2/bcrypt-4.1.2-cp39-abi3-manylinux_2_28_x86_64.whl (698 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 698.9/698.9 kB 50.6 MB/s eta 0:00:00
Collecting cryptography>=3.3 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/cryptography/42.0.5/cryptography-42.0.5-cp39-abi3-manylinux_2_28_x86_64.whl (4.6 MB)
Collecting pynacl>=1.5 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pynacl/1.5.0/PyNaCl-1.5.0-cp36-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.manylinux_2_24_x86_64.whl (856 kB)
Collecting selenium>=4.3.0 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/selenium/4.19.0/selenium-4.19.0-py3-none-any.whl (10.5 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 10.5/10.5 MB 68.9 MB/s eta 0:00:00
Collecting robotframework-pythonlibcore>=3.0.0 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-pythonlibcore/4.4.1/robotframework_pythonlibcore-4.4.1-py2.py3-none-any.whl (12 kB)
Collecting WebOb>=1.2 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/webob/1.8.7/WebOb-1.8.7-py2.py3-none-any.whl (114 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 115.0/115.0 kB 18.6 MB/s eta 0:00:00
Collecting waitress>=0.8.5 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/waitress/3.0.0/waitress-3.0.0-py3-none-any.whl (56 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 56.7/56.7 kB 13.2 MB/s eta 0:00:00
Collecting beautifulsoup4 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/beautifulsoup4/4.12.3/beautifulsoup4-4.12.3-py3-none-any.whl (147 kB)
Collecting cffi>=1.12 (from cryptography>=3.3->paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/cffi/1.16.0/cffi-1.16.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (464 kB)
Collecting trio~=0.17 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/trio/0.25.0/trio-0.25.0-py3-none-any.whl (467 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 467.2/467.2 kB 37.9 MB/s eta 0:00:00
Collecting trio-websocket~=0.9 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/trio-websocket/0.11.1/trio_websocket-0.11.1-py3-none-any.whl (17 kB)
Collecting typing_extensions>=4.9.0 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/typing-extensions/4.11.0/typing_extensions-4.11.0-py3-none-any.whl (34 kB)
Collecting soupsieve>1.2 (from beautifulsoup4->webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/soupsieve/2.5/soupsieve-2.5-py3-none-any.whl (36 kB)
Collecting pycparser (from cffi>=1.12->cryptography>=3.3->paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pycparser/2.22/pycparser-2.22-py3-none-any.whl (117 kB)
Collecting attrs>=23.2.0 (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/attrs/23.2.0/attrs-23.2.0-py3-none-any.whl (60 kB)
Collecting sortedcontainers (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/sortedcontainers/2.4.0/sortedcontainers-2.4.0-py2.py3-none-any.whl (29 kB)
Collecting outcome (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/outcome/1.3.0.post0/outcome-1.3.0.post0-py2.py3-none-any.whl (10 kB)
Collecting sniffio>=1.3.0 (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/sniffio/1.3.1/sniffio-1.3.1-py3-none-any.whl (10 kB)
Collecting wsproto>=0.14 (from trio-websocket~=0.9->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/wsproto/1.2.0/wsproto-1.2.0-py3-none-any.whl (24 kB)
Collecting pysocks!=1.5.7,<2.0,>=1.5.6 (from urllib3[socks]<3,>=1.26->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pysocks/1.7.1/PySocks-1.7.1-py3-none-any.whl (16 kB)
Collecting h11<1,>=0.9.0 (from wsproto>=0.14->trio-websocket~=0.9->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/h11/0.14.0/h11-0.14.0-py3-none-any.whl (58 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 58.3/58.3 kB 7.7 MB/s eta 0:00:00
Building wheels for collected packages: robotframework-sshlibrary, ipaddr, pyhocon, robotframework-httplibrary, scapy, jsonpath-rw
  Building wheel for robotframework-sshlibrary (setup.py): started
  Building wheel for robotframework-sshlibrary (setup.py): finished with status 'done'
  Created wheel for robotframework-sshlibrary: filename=robotframework_sshlibrary-3.8.0-py3-none-any.whl size=55119 sha256=1ad05ff013e09c2192a0b12b18eda323734041d49c6521d2968f8b12283a406a
  Stored in directory: /home/jenkins/.cache/pip/wheels/f7/c9/b3/a977b7bcc410d45ae27d240df3d00a12585509180e373ecccc
  Building wheel for ipaddr (setup.py): started
  Building wheel for ipaddr (setup.py): finished with status 'done'
  Created wheel for ipaddr: filename=ipaddr-2.2.0-py3-none-any.whl size=18280 sha256=594e40865cea72110f0fa00098b556eee5819cb660733b9cbc9e8b215b4d56df
  Stored in directory: /home/jenkins/.cache/pip/wheels/dc/6c/04/da2d847fa8d45c59af3e1d83e2acc29cb8adcbaf04c0898dbf
  Building wheel for pyhocon (setup.py): started
  Building wheel for pyhocon (setup.py): finished with status 'done'
  Created wheel for pyhocon: filename=pyhocon-0.3.60-py3-none-any.whl size=20865 sha256=6edf1166b1145637286f2bc7e5080f80135a8fb15a651b84b8c490485aac7bff
  Stored in directory: /home/jenkins/.cache/pip/wheels/02/09/4e/04a983205b51f96912ae6fc13f56f3050a586c98200fe36725
  Building wheel for robotframework-httplibrary (setup.py): started
  Building wheel for robotframework-httplibrary (setup.py): finished with status 'done'
  Created wheel for robotframework-httplibrary: filename=robotframework_httplibrary-0.4.2-py3-none-any.whl size=9953 sha256=0979ecdce203df352db2840dc2234ab832dfb394048b1b8addd7bff7bc2b5072
  Stored in directory: /home/jenkins/.cache/pip/wheels/aa/bc/0d/9a20dd51effef392aae2733cb4c7b66c6fa29fca33d88b57ed
  Building wheel for scapy (setup.py): started
  Building wheel for scapy (setup.py): finished with status 'done'
  Created wheel for scapy: filename=scapy-2.5.0-py2.py3-none-any.whl size=1444327 sha256=cfcf492f1bd36d27694c872a2a45ff5394d2ff773863caca173e5fb67b43d88f
  Stored in directory: /home/jenkins/.cache/pip/wheels/3b/a7/d6/87eeec31fbfcb2bd8ace7dad8172b6d6ebbe1ec6827dbb389a
  Building wheel for jsonpath-rw (setup.py): started
  Building wheel for jsonpath-rw (setup.py): finished with status 'done'
  Created wheel for jsonpath-rw: filename=jsonpath_rw-1.4.0-py3-none-any.whl size=15130 sha256=426fe8383f436299e7c8d2279c2c488773264eec56d7e11528f1f2817af95a2c
  Stored in directory: /home/jenkins/.cache/pip/wheels/f1/54/63/9a8da38cefae13755097b36cc852decc25d8ef69c37d58d4eb
Successfully built robotframework-sshlibrary ipaddr pyhocon robotframework-httplibrary scapy jsonpath-rw
Installing collected packages: sortedcontainers, ply, netifaces, ipaddr, enum34, websocket-client, WebOb, waitress, urllib3, typing_extensions, soupsieve, sniffio, six, scapy, robotframework-pythonlibcore, robotframework, regex, pysocks, pyparsing, pycparser, netaddr, lxml, jsonpointer, jmespath, idna, h11, decorator, charset-normalizer, certifi, bcrypt, attrs, wsproto, requests, python-dateutil, pyhocon, pyang, outcome, jsonpath-rw, jsonpatch, isodate, elastic-transport, docker-pycreds, cffi, beautifulsoup4, webtest, trio, robotframework-requests, pynacl, pyangbind, elasticsearch, docker-py, cryptography, trio-websocket, robotframework-httplibrary, paramiko, elasticsearch-dsl, selenium, scp, robotframework-sshlibrary, robotframework-seleniumlibrary, robotframework-selenium2library
Successfully installed WebOb-1.8.7 attrs-23.2.0 bcrypt-4.1.2 beautifulsoup4-4.12.3 certifi-2024.2.2 cffi-1.16.0 charset-normalizer-3.3.2 cryptography-42.0.5 decorator-5.1.1 docker-py-1.10.6 docker-pycreds-0.4.0 elastic-transport-8.13.0 elasticsearch-8.13.0 elasticsearch-dsl-8.13.0 enum34-1.1.10 h11-0.14.0 idna-3.7 ipaddr-2.2.0 isodate-0.6.1 jmespath-1.0.1 jsonpatch-1.33 jsonpath-rw-1.4.0 jsonpointer-2.4 lxml-5.2.1 netaddr-1.2.1 netifaces-0.11.0 outcome-1.3.0.post0 paramiko-3.4.0 ply-3.11 pyang-2.6.0 pyangbind-0.8.5 pycparser-2.22 pyhocon-0.3.60 pynacl-1.5.0 pyparsing-3.1.2 pysocks-1.7.1 python-dateutil-2.9.0.post0 regex-2024.4.16 requests-2.31.0 robotframework-7.0 robotframework-httplibrary-0.4.2 robotframework-pythonlibcore-4.4.1 robotframework-requests-0.9.3 robotframework-selenium2library-3.0.0 robotframework-seleniumlibrary-6.3.0 robotframework-sshlibrary-3.8.0 scapy-2.5.0 scp-0.14.5 selenium-4.19.0 six-1.16.0 sniffio-1.3.1 sortedcontainers-2.4.0 soupsieve-2.5 trio-0.25.0 trio-websocket-0.11.1 typing_extensions-4.11.0 urllib3-2.2.1 waitress-3.0.0 websocket-client-1.7.0 webtest-3.0.0 wsproto-1.2.0
+ pip freeze
attrs==23.2.0
bcrypt==4.1.2
beautifulsoup4==4.12.3
certifi==2024.2.2
cffi==1.16.0
charset-normalizer==3.3.2
cryptography==42.0.5
decorator==5.1.1
distlib==0.3.8
docker-py==1.10.6
docker-pycreds==0.4.0
elastic-transport==8.13.0
elasticsearch==8.13.0
elasticsearch-dsl==8.13.0
enum34==1.1.10
filelock==3.13.4
h11==0.14.0
idna==3.7
ipaddr==2.2.0
isodate==0.6.1
jmespath==1.0.1
jsonpatch==1.33
jsonpath-rw==1.4.0
jsonpointer==2.4
lxml==5.2.1
netaddr==1.2.1
netifaces==0.11.0
outcome==1.3.0.post0
paramiko==3.4.0
platformdirs==4.2.0
ply==3.11
pyang==2.6.0
pyangbind==0.8.5
pycparser==2.22
pyhocon==0.3.60
PyNaCl==1.5.0
pyparsing==3.1.2
PySocks==1.7.1
python-dateutil==2.9.0.post0
regex==2024.4.16
requests==2.31.0
robotframework==7.0
robotframework-httplibrary==0.4.2
robotframework-pythonlibcore==4.4.1
robotframework-requests==0.9.3
robotframework-selenium2library==3.0.0
robotframework-seleniumlibrary==6.3.0
robotframework-sshlibrary==3.8.0
scapy==2.5.0
scp==0.14.5
selenium==4.19.0
six==1.16.0
sniffio==1.3.1
sortedcontainers==2.4.0
soupsieve==2.5
trio==0.25.0
trio-websocket==0.11.1
typing_extensions==4.11.0
urllib3==2.2.1
virtualenv==20.25.3
waitress==3.0.0
WebOb==1.8.7
websocket-client==1.7.0
WebTest==3.0.0
wsproto==1.2.0
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties file path 'env.properties'
[EnvInject] - Variables injected successfully.
[controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash -l /tmp/jenkins8933959949607785317.sh
Setup pyenv:
  system
  3.8.13
  3.9.13
  3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-ask-all-calcium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-fQDw from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: python-heatclient python-openstackclient yq 
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
lftools 0.37.10 requires urllib3<2.1.0, but you have urllib3 2.2.1 which is incompatible.
lf-activate-venv(): INFO: Adding /tmp/venv-fQDw/bin to PATH
+ ODL_SYSTEM=()
+ TOOLS_SYSTEM=()
+ OPENSTACK_SYSTEM=()
+ OPENSTACK_CONTROLLERS=()
+ mapfile -t ADDR
++ openstack stack show -f json -c outputs releng-controller-csit-3node-clustering-ask-all-calcium-32
++ jq -r '.outputs[] | select(.output_key | match("^vm_[0-9]+_ips$")) | .output_value | .[]'
+ for i in "${ADDR[@]}"
++ ssh 10.30.171.102 hostname -s
Warning: Permanently added '10.30.171.102' (ECDSA) to the list of known hosts.
+ REMHOST=releng-37733-32-0-builder-0
+ case ${REMHOST} in
+ ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}")
+ for i in "${ADDR[@]}"
++ ssh 10.30.171.170 hostname -s
Warning: Permanently added '10.30.171.170' (ECDSA) to the list of known hosts.
+ REMHOST=releng-37733-32-0-builder-1
+ case ${REMHOST} in
+ ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}")
+ for i in "${ADDR[@]}"
++ ssh 10.30.171.45 hostname -s
Warning: Permanently added '10.30.171.45' (ECDSA) to the list of known hosts.
+ REMHOST=releng-37733-32-0-builder-2
+ case ${REMHOST} in
+ ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}")
+ echo NUM_ODL_SYSTEM=3
+ echo NUM_TOOLS_SYSTEM=0
+ '[' '' == yes ']'
+ NUM_OPENSTACK_SYSTEM=0
+ echo NUM_OPENSTACK_SYSTEM=0
+ '[' 0 -eq 2 ']'
+ echo ODL_SYSTEM_IP=10.30.171.102
++ seq 0 2
+ for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 )))
+ echo ODL_SYSTEM_1_IP=10.30.171.102
+ for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 )))
+ echo ODL_SYSTEM_2_IP=10.30.171.170
+ for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 )))
+ echo ODL_SYSTEM_3_IP=10.30.171.45
+ echo TOOLS_SYSTEM_IP=
++ seq 0 -1
+ openstack_index=0
+ NUM_OPENSTACK_CONTROL_NODES=1
+ echo NUM_OPENSTACK_CONTROL_NODES=1
++ seq 0 0
+ for i in $(seq 0 $((NUM_OPENSTACK_CONTROL_NODES - 1)))
+ echo OPENSTACK_CONTROL_NODE_1_IP=
+ NUM_OPENSTACK_COMPUTE_NODES=-1
+ echo NUM_OPENSTACK_COMPUTE_NODES=-1
+ '[' -1 -ge 2 ']'
++ seq 0 -2
+ NUM_OPENSTACK_HAPROXY_NODES=0
+ echo NUM_OPENSTACK_HAPROXY_NODES=0
++ seq 0 -1
+ echo 'Contents of slave_addresses.txt:'
Contents of slave_addresses.txt:
+ cat slave_addresses.txt
NUM_ODL_SYSTEM=3
NUM_TOOLS_SYSTEM=0
NUM_OPENSTACK_SYSTEM=0
ODL_SYSTEM_IP=10.30.171.102
ODL_SYSTEM_1_IP=10.30.171.102
ODL_SYSTEM_2_IP=10.30.171.170
ODL_SYSTEM_3_IP=10.30.171.45
TOOLS_SYSTEM_IP=
NUM_OPENSTACK_CONTROL_NODES=1
OPENSTACK_CONTROL_NODE_1_IP=
NUM_OPENSTACK_COMPUTE_NODES=-1
NUM_OPENSTACK_HAPROXY_NODES=0
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties file path 'slave_addresses.txt'
[EnvInject] - Variables injected successfully.
[controller-csit-3node-clustering-ask-all-calcium] $ /bin/sh /tmp/jenkins5995576393837854457.sh
Preparing for JRE Version 17
Karaf artifact is karaf
Karaf project is integration
Java home is /usr/lib/jvm/java-17-openjdk
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties file path 'set_variables.env'
[EnvInject] - Variables injected successfully.
[controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash /tmp/jenkins12122790143441197008.sh
--2024-04-20 23:47:48--  http://git.opendaylight.org/gerrit/gitweb?p=integration/distribution.git;a=blob_plain;f=pom.xml;hb=refs/heads/stable/calcium
Resolving git.opendaylight.org (git.opendaylight.org)... 13.39.230.180, 35.181.223.58, 52.47.161.242, ...
Connecting to git.opendaylight.org (git.opendaylight.org)|13.39.230.180|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 2620 (2.6K) [text/plain]
Saving to: ‘pom.xml’

     0K ..                                                    100%  281M=0s

2024-04-20 23:47:48 (281 MB/s) - ‘pom.xml’ saved [2620/2620]

Bundle version is 0.20.1-SNAPSHOT
--2024-04-20 23:47:48--  https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.1-SNAPSHOT/maven-metadata.xml
Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6
Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 963 [application/xml]
Saving to: ‘maven-metadata.xml’

     0K                                                       100% 44.8M=0s

2024-04-20 23:47:48 (44.8 MB/s) - ‘maven-metadata.xml’ saved [963/963]

<?xml version="1.0" encoding="UTF-8"?>
<metadata modelVersion="1.1.0">
  <groupId>org.opendaylight.integration</groupId>
  <artifactId>karaf</artifactId>
  <version>0.20.1-SNAPSHOT</version>
  <versioning>
    <snapshot>
      <timestamp>20240418.235143</timestamp>
      <buildNumber>1</buildNumber>
    </snapshot>
    <lastUpdated>20240418235143</lastUpdated>
    <snapshotVersions>
      <snapshotVersion>
        <extension>pom</extension>
        <value>0.20.1-20240418.235143-1</value>
        <updated>20240418235143</updated>
      </snapshotVersion>
      <snapshotVersion>
        <extension>tar.gz</extension>
        <value>0.20.1-20240418.235143-1</value>
        <updated>20240418235143</updated>
      </snapshotVersion>
      <snapshotVersion>
        <extension>zip</extension>
        <value>0.20.1-20240418.235143-1</value>
        <updated>20240418235143</updated>
      </snapshotVersion>
    </snapshotVersions>
  </versioning>
</metadata>
Nexus timestamp is 0.20.1-20240418.235143-1
Distribution bundle URL is https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.1-SNAPSHOT/karaf-0.20.1-20240418.235143-1.zip
Distribution bundle is karaf-0.20.1-20240418.235143-1.zip
Distribution bundle version is 0.20.1-SNAPSHOT
Distribution folder is karaf-0.20.1-SNAPSHOT
Nexus prefix is https://nexus.opendaylight.org
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties file path 'detect_variables.env'
[EnvInject] - Variables injected successfully.
[controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash -l /tmp/jenkins12520892222572332814.sh
Setup pyenv:
  system
  3.8.13
  3.9.13
  3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-ask-all-calcium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-fQDw from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: python-heatclient python-openstackclient 
lf-activate-venv(): INFO: Adding /tmp/venv-fQDw/bin to PATH
Copying common-functions.sh to /tmp
Copying common-functions.sh to 10.30.171.102:/tmp
Warning: Permanently added '10.30.171.102' (ECDSA) to the list of known hosts.
Copying common-functions.sh to 10.30.171.170:/tmp
Warning: Permanently added '10.30.171.170' (ECDSA) to the list of known hosts.
Copying common-functions.sh to 10.30.171.45:/tmp
Warning: Permanently added '10.30.171.45' (ECDSA) to the list of known hosts.
[controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash /tmp/jenkins3975652527548372435.sh
common-functions.sh is being sourced
common-functions environment:
MAVENCONF: /tmp/karaf-0.20.1-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
ACTUALFEATURES: 
FEATURESCONF: /tmp/karaf-0.20.1-SNAPSHOT/etc/org.apache.karaf.features.cfg
CUSTOMPROP: /tmp/karaf-0.20.1-SNAPSHOT/etc/custom.properties
LOGCONF: /tmp/karaf-0.20.1-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
MEMCONF: /tmp/karaf-0.20.1-SNAPSHOT/bin/setenv
CONTROLLERMEM: 2048m
AKKACONF: /tmp/karaf-0.20.1-SNAPSHOT/configuration/initial/akka.conf
MODULESCONF: /tmp/karaf-0.20.1-SNAPSHOT/configuration/initial/modules.conf
MODULESHARDSCONF: /tmp/karaf-0.20.1-SNAPSHOT/configuration/initial/module-shards.conf
SUITES: 

#################################################
##         Configure Cluster and Start         ##
#################################################
ACTUALFEATURES: odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app
SPACE_SEPARATED_FEATURES: odl-integration-compatible-with-all odl-jolokia odl-restconf odl-clustering-test-app
Locating script plan to use...
script plan exists!!!
Changing the script plan path...
# Place the scripts in run order:
/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/scripts/car_people_shard.sh
Executing /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/scripts/car_people_shard.sh...
Add car-people shards file
Copy shard config to member-1 with IP address 10.30.171.102
Warning: Permanently added '10.30.171.102' (ECDSA) to the list of known hosts.
Copy shard config to member-2 with IP address 10.30.171.170
Warning: Permanently added '10.30.171.170' (ECDSA) to the list of known hosts.
Copy shard config to member-3 with IP address 10.30.171.45
Warning: Permanently added '10.30.171.45' (ECDSA) to the list of known hosts.
Finished running script plans
Configuring member-1 with IP address 10.30.171.102
Warning: Permanently added '10.30.171.102' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.171.102' (ECDSA) to the list of known hosts.
common-functions.sh is being sourced
+ source /tmp/common-functions.sh karaf-0.20.1-SNAPSHOT
++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]]
++ echo 'common-functions.sh is being sourced'
++ BUNDLEFOLDER=karaf-0.20.1-SNAPSHOT
++ export MAVENCONF=/tmp/karaf-0.20.1-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
++ MAVENCONF=/tmp/karaf-0.20.1-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
++ export FEATURESCONF=/tmp/karaf-0.20.1-SNAPSHOT/etc/org.apache.karaf.features.cfg
++ FEATURESCONF=/tmp/karaf-0.20.1-SNAPSHOT/etc/org.apache.karaf.features.cfg
++ export CUSTOMPROP=/tmp/karaf-0.20.1-SNAPSHOT/etc/custom.properties
++ CUSTOMPROP=/tmp/karaf-0.20.1-SNAPSHOT/etc/custom.properties
++ export LOGCONF=/tmp/karaf-0.20.1-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
++ LOGCONF=/tmp/karaf-0.20.1-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
++ export MEMCONF=/tmp/karaf-0.20.1-SNAPSHOT/bin/setenv
++ MEMCONF=/tmp/karaf-0.20.1-SNAPSHOT/bin/setenv
++ export CONTROLLERMEM=
++ CONTROLLERMEM=
++ export AKKACONF=/tmp/karaf-0.20.1-SNAPSHOT/configuration/initial/akka.conf
++ AKKACONF=/tmp/karaf-0.20.1-SNAPSHOT/configuration/initial/akka.conf
++ export MODULESCONF=/tmp/karaf-0.20.1-SNAPSHOT/configuration/initial/modules.conf
++ MODULESCONF=/tmp/karaf-0.20.1-SNAPSHOT/configuration/initial/modules.conf
++ export MODULESHARDSCONF=/tmp/karaf-0.20.1-SNAPSHOT/configuration/initial/module-shards.conf
++ MODULESHARDSCONF=/tmp/karaf-0.20.1-SNAPSHOT/configuration/initial/module-shards.conf
++ print_common_env
++ cat
common-functions environment:
MAVENCONF: /tmp/karaf-0.20.1-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
ACTUALFEATURES: 
FEATURESCONF: /tmp/karaf-0.20.1-SNAPSHOT/etc/org.apache.karaf.features.cfg
CUSTOMPROP: /tmp/karaf-0.20.1-SNAPSHOT/etc/custom.properties
LOGCONF: /tmp/karaf-0.20.1-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
MEMCONF: /tmp/karaf-0.20.1-SNAPSHOT/bin/setenv
CONTROLLERMEM: 
AKKACONF: /tmp/karaf-0.20.1-SNAPSHOT/configuration/initial/akka.conf
MODULESCONF: /tmp/karaf-0.20.1-SNAPSHOT/configuration/initial/modules.conf
MODULESHARDSCONF: /tmp/karaf-0.20.1-SNAPSHOT/configuration/initial/module-shards.conf
SUITES: 

Changing to /tmp
Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.1-SNAPSHOT/karaf-0.20.1-20240418.235143-1.zip
++ SSH='ssh -t -t'
++ extra_services_cntl='     dnsmasq.service     httpd.service     libvirtd.service     openvswitch.service     ovs-vswitchd.service     ovsdb-server.service     rabbitmq-server.service '
++ extra_services_cmp='     libvirtd.service     openvswitch.service     ovs-vswitchd.service     ovsdb-server.service '
+ echo 'Changing to /tmp'
+ cd /tmp
+ echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.1-SNAPSHOT/karaf-0.20.1-20240418.235143-1.zip'
+ wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.1-SNAPSHOT/karaf-0.20.1-20240418.235143-1.zip
--2024-04-20 23:48:00--  https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.1-SNAPSHOT/karaf-0.20.1-20240418.235143-1.zip
Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6
Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 289547889 (276M) [application/zip]
Saving to: ‘karaf-0.20.1-20240418.235143-1.zip’

     0K ........ ........ ........ ........ ........ ........  1% 57.7M 5s
  3072K ........ ........ ........ ........ ........ ........  2% 87.9M 4s
  6144K ........ ........ ........ ........ ........ ........  3%  136M 3s
  9216K ........ ........ ........ ........ ........ ........  4%  177M 3s
 12288K ........ ........ ........ ........ ........ ........  5%  147M 3s
 15360K ........ ........ ........ ........ ........ ........  6%  164M 2s
 18432K ........ ........ ........ ........ ........ ........  7%  223M 2s
 21504K ........ ........ ........ ........ ........ ........  8%  215M 2s
 24576K ........ ........ ........ ........ ........ ........  9%  247M 2s
 27648K ........ ........ ........ ........ ........ ........ 10%  253M 2s
 30720K ........ ........ ........ ........ ........ ........ 11%  117M 2s
 33792K ........ ........ ........ ........ ........ ........ 13%  160M 2s
 36864K ........ ........ ........ ........ ........ ........ 14%  270M 2s
 39936K ........ ........ ........ ........ ........ ........ 15%  262M 2s
 43008K ........ ........ ........ ........ ........ ........ 16%  295M 2s
 46080K ........ ........ ........ ........ ........ ........ 17%  331M 1s
 49152K ........ ........ ........ ........ ........ ........ 18%  339M 1s
 52224K ........ ........ ........ ........ ........ ........ 19%  329M 1s
 55296K ........ ........ ........ ........ ........ ........ 20%  125M 1s
 58368K ........ ........ ........ ........ ........ ........ 21%  280M 1s
 61440K ........ ........ ........ ........ ........ ........ 22%  286M 1s
 64512K ........ ........ ........ ........ ........ ........ 23%  273M 1s
 67584K ........ ........ ........ ........ ........ ........ 24%  257M 1s
 70656K ........ ........ ........ ........ ........ ........ 26%  200M 1s
 73728K ........ ........ ........ ........ ........ ........ 27% 76.0M 1s
 76800K ........ ........ ........ ........ ........ ........ 28% 93.4M 1s
 79872K ........ ........ ........ ........ ........ ........ 29%  133M 1s
 82944K ........ ........ ........ ........ ........ ........ 30%  245M 1s
 86016K ........ ........ ........ ........ ........ ........ 31%  326M 1s
 89088K ........ ........ ........ ........ ........ ........ 32%  342M 1s
 92160K ........ ........ ........ ........ ........ ........ 33%  295M 1s
 95232K ........ ........ ........ ........ ........ ........ 34%  297M 1s
 98304K ........ ........ ........ ........ ........ ........ 35%  259M 1s
101376K ........ ........ ........ ........ ........ ........ 36%  138M 1s
104448K ........ ........ ........ ........ ........ ........ 38%  176M 1s
107520K ........ ........ ........ ........ ........ ........ 39% 79.0M 1s
110592K ........ ........ ........ ........ ........ ........ 40%  152M 1s
113664K ........ ........ ........ ........ ........ ........ 41%  254M 1s
116736K ........ ........ ........ ........ ........ ........ 42%  283M 1s
119808K ........ ........ ........ ........ ........ ........ 43%  270M 1s
122880K ........ ........ ........ ........ ........ ........ 44%  290M 1s
125952K ........ ........ ........ ........ ........ ........ 45%  281M 1s
129024K ........ ........ ........ ........ ........ ........ 46%  280M 1s
132096K ........ ........ ........ ........ ........ ........ 47%  276M 1s
135168K ........ ........ ........ ........ ........ ........ 48%  274M 1s
138240K ........ ........ ........ ........ ........ ........ 49%  272M 1s
141312K ........ ........ ........ ........ ........ ........ 51%  277M 1s
144384K ........ ........ ........ ........ ........ ........ 52%  261M 1s
147456K ........ ........ ........ ........ ........ ........ 53%  265M 1s
150528K ........ ........ ........ ........ ........ ........ 54%  256M 1s
153600K ........ ........ ........ ........ ........ ........ 55%  271M 1s
156672K ........ ........ ........ ........ ........ ........ 56%  275M 1s
159744K ........ ........ ........ ........ ........ ........ 57%  269M 1s
162816K ........ ........ ........ ........ ........ ........ 58%  265M 1s
165888K ........ ........ ........ ........ ........ ........ 59%  279M 1s
168960K ........ ........ ........ ........ ........ ........ 60%  267M 1s
172032K ........ ........ ........ ........ ........ ........ 61%  268M 1s
175104K ........ ........ ........ ........ ........ ........ 63%  268M 1s
178176K ........ ........ ........ ........ ........ ........ 64%  287M 1s
181248K ........ ........ ........ ........ ........ ........ 65%  259M 0s
184320K ........ ........ ........ ........ ........ ........ 66%  258M 0s
187392K ........ ........ ........ ........ ........ ........ 67%  271M 0s
190464K ........ ........ ........ ........ ........ ........ 68%  266M 0s
193536K ........ ........ ........ ........ ........ ........ 69%  264M 0s
196608K ........ ........ ........ ........ ........ ........ 70%  275M 0s
199680K ........ ........ ........ ........ ........ ........ 71%  277M 0s
202752K ........ ........ ........ ........ ........ ........ 72%  276M 0s
205824K ........ ........ ........ ........ ........ ........ 73%  265M 0s
208896K ........ ........ ........ ........ ........ ........ 74%  275M 0s
211968K ........ ........ ........ ........ ........ ........ 76%  262M 0s
215040K ........ ........ ........ ........ ........ ........ 77%  285M 0s
218112K ........ ........ ........ ........ ........ ........ 78%  275M 0s
221184K ........ ........ ........ ........ ........ ........ 79%  258M 0s
224256K ........ ........ ........ ........ ........ ........ 80%  276M 0s
227328K ........ ........ ........ ........ ........ ........ 81%  272M 0s
230400K ........ ........ ........ ........ ........ ........ 82%  276M 0s
233472K ........ ........ ........ ........ ........ ........ 83%  272M 0s
236544K ........ ........ ........ ........ ........ ........ 84%  273M 0s
239616K ........ ........ ........ ........ ........ ........ 85%  274M 0s
242688K ........ ........ ........ ........ ........ ........ 86%  268M 0s
245760K ........ ........ ........ ........ ........ ........ 88%  278M 0s
248832K ........ ........ ........ ........ ........ ........ 89%  270M 0s
251904K ........ ........ ........ ........ ........ ........ 90%  263M 0s
254976K ........ ........ ........ ........ ........ ........ 91%  250M 0s
258048K ........ ........ ........ ........ ........ ........ 92%  274M 0s
261120K ........ ........ ........ ........ ........ ........ 93%  263M 0s
264192K ........ ........ ........ ........ ........ ........ 94%  263M 0s
267264K ........ ........ ........ ........ ........ ........ 95%  260M 0s
270336K ........ ........ ........ ........ ........ ........ 96%  267M 0s
273408K ........ ........ ........ ........ ........ ........ 97%  253M 0s
276480K ........ ........ ........ ........ ........ ........ 98%  263M 0s
279552K ........ ........ ........ ........ ........ ........ 99%  236M 0s
282624K ..                                                   100%  385M=1.3s

2024-04-20 23:48:01 (218 MB/s) - ‘karaf-0.20.1-20240418.235143-1.zip’ saved [289547889/289547889]

Extracting the new controller...
+ echo 'Extracting the new controller...'
+ unzip -q karaf-0.20.1-20240418.235143-1.zip
Adding external repositories...
+ echo 'Adding external repositories...'
+ sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.20.1-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
+ cat /tmp/karaf-0.20.1-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
################################################################################
#
#    Licensed to the Apache Software Foundation (ASF) under one or more
#    contributor license agreements.  See the NOTICE file distributed with
#    this work for additional information regarding copyright ownership.
#    The ASF licenses this file to You under the Apache License, Version 2.0
#    (the "License"); you may not use this file except in compliance with
#    the License.  You may obtain a copy of the License at
#
#       http://www.apache.org/licenses/LICENSE-2.0
#
#    Unless required by applicable law or agreed to in writing, software
#    distributed under the License is distributed on an "AS IS" BASIS,
#    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
#    See the License for the specific language governing permissions and
#    limitations under the License.
#
################################################################################

#
# If set to true, the following property will not allow any certificate to be used
# when accessing Maven repositories through SSL
#
#org.ops4j.pax.url.mvn.certificateCheck=

#
# Path to the local Maven settings file.
# The repositories defined in this file will be automatically added to the list
# of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property
# below is not set.
# The following locations are checked for the existence of the settings.xml file
#   * 1. looks for the specified url
#   * 2. if not found looks for ${user.home}/.m2/settings.xml
#   * 3. if not found looks for ${maven.home}/conf/settings.xml
#   * 4. if not found looks for ${M2_HOME}/conf/settings.xml
#
#org.ops4j.pax.url.mvn.settings=

#
# Path to the local Maven repository which is used to avoid downloading
# artifacts when they already exist locally.
# The value of this property will be extracted from the settings.xml file
# above, or defaulted to:
#     System.getProperty( "user.home" ) + "/.m2/repository"
#
org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository}

#
# Default this to false. It's just weird to use undocumented repos
#
org.ops4j.pax.url.mvn.useFallbackRepositories=false

#
# Uncomment if you don't wanna use the proxy settings
# from the Maven conf/settings.xml file
#
# org.ops4j.pax.url.mvn.proxySupport=false

#
# Comma separated list of repositories scanned when resolving an artifact.
# Those repositories will be checked before iterating through the
#    below list of repositories and even before the local repository
# A repository url can be appended with zero or more of the following flags:
#    @snapshots  : the repository contains snaphots
#    @noreleases : the repository does not contain any released artifacts
#
# The following property value will add the system folder as a repo.
#
org.ops4j.pax.url.mvn.defaultRepositories=\
    file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\
    file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\
    file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots

# Use the default local repo (e.g.~/.m2/repository) as a "remote" repo
#org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false

#
# Comma separated list of repositories scanned when resolving an artifact.
# The default list includes the following repositories:
#    http://repo1.maven.org/maven2@id=central
#    http://repository.springsource.com/maven/bundles/release@id=spring.ebr
#    http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external
#    http://zodiac.springsource.com/maven/bundles/release@id=gemini
#    http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases
#    https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases
#    https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
# To add repositories to the default ones, prepend '+' to the list of repositories
# to add.
# A repository url can be appended with zero or more of the following flags:
#    @snapshots  : the repository contains snapshots
#    @noreleases : the repository does not contain any released artifacts
#    @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended
#
org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases

### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.Configuring the startup features...
+ [[ True == \T\r\u\e ]]
+ echo 'Configuring the startup features...'
+ sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.20.1-SNAPSHOT/etc/org.apache.karaf.features.cfg
+ FEATURE_TEST_STRING=features-test
+ FEATURE_TEST_VERSION=0.20.1-SNAPSHOT
+ KARAF_VERSION=karaf4
+ [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]]
+ sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.20.1-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.20.1-SNAPSHOT/etc/org.apache.karaf.features.cfg
+ [[ ! -z '' ]]
+ cat /tmp/karaf-0.20.1-SNAPSHOT/etc/org.apache.karaf.features.cfg
################################################################################
#
#    Licensed to the Apache Software Foundation (ASF) under one or more
#    contributor license agreements.  See the NOTICE file distributed with
#    this work for additional information regarding copyright ownership.
#    The ASF licenses this file to You under the Apache License, Version 2.0
#    (the "License"); you may not use this file except in compliance with
#    the License.  You may obtain a copy of the License at
#
#       http://www.apache.org/licenses/LICENSE-2.0
#
#    Unless required by applicable law or agreed to in writing, software
#    distributed under the License is distributed on an "AS IS" BASIS,
#    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
#    See the License for the specific language governing permissions and
#    limitations under the License.
#
################################################################################

#
# Comma separated list of features repositories to register by default
#
featuresRepositories = mvn:org.opendaylight.integration/features-test/0.20.1-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/f672b964-93a9-490b-99c4-29d2472ec2ef.xml

#
# Comma separated list of features to install at startup
#
featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, eadc6530-6f9b-43f4-8562-a6b121b5b3a3

#
# Resource repositories (OBR) that the features resolver can use
# to resolve requirements/capabilities
#
# The format of the resourceRepositories is 
# resourceRepositories=[xml:url|json:url],...
# for Instance:
#
#resourceRepositories=xml:http://host/path/to/index.xml
# or
#resourceRepositories=json:http://host/path/to/index.json
#

#
# Defines if the boot features are started in asynchronous mode (in a dedicated thread)
#
featuresBootAsynchronous=false

#
# Service requirements enforcement
#
# By default, the feature resolver checks the service requirements/capabilities of
# bundles for new features (xml schema >= 1.3.0) in order to automatically installs
# the required bundles.
# The following flag can have those values:
#   - disable: service requirements are completely ignored
#   - default: service requirements are ignored for old features
#   - enforce: service requirements are always verified
#
#serviceRequirements=default

#
# Store cfg file for config element in feature
#
#configCfgStore=true

#
# Define if the feature service automatically refresh bundles
#
autoRefresh=true

#
# Configuration of features processing mechanism (overrides, blacklisting, modification of features)
# XML file defines instructions related to features processing
# versions.properties may declare properties to resolve placeholders in XML file
# both files are relative to ${karaf.etc}
#
#featureProcessing=org.apache.karaf.features.xml
#featureProcessingVersions=versions.properties
+ configure_karaf_log karaf4 ''
+ local -r karaf_version=karaf4
+ local -r controllerdebugmap=
+ local logapi=log4j
+ grep log4j2 /tmp/karaf-0.20.1-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
log4j2.rootLogger.level = INFO
#log4j2.rootLogger.type = asyncRoot
#log4j2.rootLogger.includeLocation = false
log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
log4j2.rootLogger.appenderRef.Console.ref = Console
log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
log4j2.logger.spifly.name = org.apache.aries.spifly
log4j2.logger.spifly.level = WARN
log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
log4j2.logger.audit.level = INFO
log4j2.logger.audit.additivity = false
log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
# Console appender not used by default (see log4j2.rootLogger.appenderRefs)
log4j2.appender.console.type = Console
log4j2.appender.console.name = Console
log4j2.appender.console.layout.type = PatternLayout
log4j2.appender.console.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.type = RollingRandomAccessFile
log4j2.appender.rolling.name = RollingFile
log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
#log4j2.appender.rolling.immediateFlush = false
log4j2.appender.rolling.append = true
log4j2.appender.rolling.layout.type = PatternLayout
log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.policies.type = Policies
log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.rolling.policies.size.size = 64MB
log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
log4j2.appender.rolling.strategy.max = 7
log4j2.appender.audit.type = RollingRandomAccessFile
log4j2.appender.audit.name = AuditRollingFile
log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
log4j2.appender.audit.append = true
log4j2.appender.audit.layout.type = PatternLayout
log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
log4j2.appender.audit.policies.type = Policies
log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.audit.policies.size.size = 8MB
log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
log4j2.appender.audit.strategy.max = 7
log4j2.appender.osgi.type = PaxOsgi
log4j2.appender.osgi.name = PaxOsgi
log4j2.appender.osgi.filter = *
#log4j2.logger.aether.name = shaded.org.eclipse.aether
#log4j2.logger.aether.level = TRACE
#log4j2.logger.http-headers.name = shaded.org.apache.http.headers
#log4j2.logger.http-headers.level = DEBUG
#log4j2.logger.maven.name = org.ops4j.pax.url.mvn
#log4j2.logger.maven.level = TRACE
+ logapi=log4j2
+ echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2'
Configuring the karaf log... karaf_version: karaf4, logapi: log4j2
+ '[' log4j2 == log4j2 ']'
+ sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.20.1-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
+ orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver
+ orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver
+ echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN'
controllerdebugmap: 
cat /tmp/karaf-0.20.1-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
+ echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN'
+ unset IFS
+ echo 'controllerdebugmap: '
+ '[' -n '' ']'
+ echo 'cat /tmp/karaf-0.20.1-SNAPSHOT/etc/org.ops4j.pax.logging.cfg'
+ cat /tmp/karaf-0.20.1-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
################################################################################
#
#    Licensed to the Apache Software Foundation (ASF) under one or more
#    contributor license agreements.  See the NOTICE file distributed with
#    this work for additional information regarding copyright ownership.
#    The ASF licenses this file to You under the Apache License, Version 2.0
#    (the "License"); you may not use this file except in compliance with
#    the License.  You may obtain a copy of the License at
#
#       http://www.apache.org/licenses/LICENSE-2.0
#
#    Unless required by applicable law or agreed to in writing, software
#    distributed under the License is distributed on an "AS IS" BASIS,
#    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
#    See the License for the specific language governing permissions and
#    limitations under the License.
#
################################################################################

# Common pattern layout for appenders
log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n

# Root logger
log4j2.rootLogger.level = INFO
# uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library
#log4j2.rootLogger.type = asyncRoot
#log4j2.rootLogger.includeLocation = false
log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
log4j2.rootLogger.appenderRef.Console.ref = Console
log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}

# Filters for logs marked by org.opendaylight.odlparent.Markers
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL

# Loggers configuration

# Spifly logger
log4j2.logger.spifly.name = org.apache.aries.spifly
log4j2.logger.spifly.level = WARN

# Security audit logger
log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
log4j2.logger.audit.level = INFO
log4j2.logger.audit.additivity = false
log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile

# Appenders configuration

# Console appender not used by default (see log4j2.rootLogger.appenderRefs)
log4j2.appender.console.type = Console
log4j2.appender.console.name = Console
log4j2.appender.console.layout.type = PatternLayout
log4j2.appender.console.layout.pattern = ${log4j2.pattern}

# Rolling file appender
log4j2.appender.rolling.type = RollingRandomAccessFile
log4j2.appender.rolling.name = RollingFile
log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
# uncomment to not force a disk flush
#log4j2.appender.rolling.immediateFlush = false
log4j2.appender.rolling.append = true
log4j2.appender.rolling.layout.type = PatternLayout
log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.policies.type = Policies
log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.rolling.policies.size.size = 1GB
log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
log4j2.appender.rolling.strategy.max = 7

# Audit file appender
log4j2.appender.audit.type = RollingRandomAccessFile
log4j2.appender.audit.name = AuditRollingFile
log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
log4j2.appender.audit.append = true
log4j2.appender.audit.layout.type = PatternLayout
log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
log4j2.appender.audit.policies.type = Policies
log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.audit.policies.size.size = 8MB
log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
log4j2.appender.audit.strategy.max = 7

# OSGi appender
log4j2.appender.osgi.type = PaxOsgi
log4j2.appender.osgi.name = PaxOsgi
log4j2.appender.osgi.filter = *

# help with identification of maven-related problems with pax-url-aether
#log4j2.logger.aether.name = shaded.org.eclipse.aether
#log4j2.logger.aether.level = TRACE
#log4j2.logger.http-headers.name = shaded.org.apache.http.headers
#log4j2.logger.http-headers.level = DEBUG
#log4j2.logger.maven.name = org.ops4j.pax.url.mvn
#log4j2.logger.maven.level = TRACE
log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN
log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN
Configure
    java home: /usr/lib/jvm/java-17-openjdk
    max memory: 3072m
    memconf: /tmp/karaf-0.20.1-SNAPSHOT/bin/setenv
+ set_java_vars /usr/lib/jvm/java-17-openjdk 3072m /tmp/karaf-0.20.1-SNAPSHOT/bin/setenv
+ local -r java_home=/usr/lib/jvm/java-17-openjdk
+ local -r controllermem=3072m
+ local -r memconf=/tmp/karaf-0.20.1-SNAPSHOT/bin/setenv
+ echo Configure
+ echo '    java home: /usr/lib/jvm/java-17-openjdk'
+ echo '    max memory: 3072m'
+ echo '    memconf: /tmp/karaf-0.20.1-SNAPSHOT/bin/setenv'
+ sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk}%g' /tmp/karaf-0.20.1-SNAPSHOT/bin/setenv
+ sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.20.1-SNAPSHOT/bin/setenv
cat /tmp/karaf-0.20.1-SNAPSHOT/bin/setenv
+ echo 'cat /tmp/karaf-0.20.1-SNAPSHOT/bin/setenv'
+ cat /tmp/karaf-0.20.1-SNAPSHOT/bin/setenv
#!/bin/sh
#
#    Licensed to the Apache Software Foundation (ASF) under one or more
#    contributor license agreements.  See the NOTICE file distributed with
#    this work for additional information regarding copyright ownership.
#    The ASF licenses this file to You under the Apache License, Version 2.0
#    (the "License"); you may not use this file except in compliance with
#    the License.  You may obtain a copy of the License at
#
#       http://www.apache.org/licenses/LICENSE-2.0
#
#    Unless required by applicable law or agreed to in writing, software
#    distributed under the License is distributed on an "AS IS" BASIS,
#    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
#    See the License for the specific language governing permissions and
#    limitations under the License.
#

#
# handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf
# script: client, instance, shell, start, status, stop, karaf
#
# if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then
#   Actions go here...
# fi

#
# general settings which should be applied for all scripts go here; please keep
# in mind that it is possible that scripts might be executed more than once, e.g.
# in example of the start script where the start script is executed first and the
# karaf script afterwards.
#

#
# The following section shows the possible configuration options for the default 
# karaf scripts
#
export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk} # Location of Java installation
# export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration
# export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options
# export EXTRA_JAVA_OPTS # Additional JVM options
# export KARAF_HOME # Karaf home folder
# export KARAF_DATA # Karaf data folder
# export KARAF_BASE # Karaf base folder
# export KARAF_ETC  # Karaf etc  folder
# export KARAF_LOG  # Karaf log  folder
# export KARAF_SYSTEM_OPTS # First citizen Karaf options
# export KARAF_OPTS # Additional available Karaf options
# export KARAF_DEBUG # Enable debug mode
# export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start
# export KARAF_NOROOT # Prevent execution as root if set to true
Set Java version
+ echo 'Set Java version'
+ sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-17-openjdk/bin/java 1
+ sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-17-openjdk/bin/java
JDK default version ...
+ echo 'JDK default version ...'
+ java -version
openjdk version "17.0.6-ea" 2023-01-17 LTS
OpenJDK Runtime Environment (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS)
OpenJDK 64-Bit Server VM (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS, mixed mode, sharing)
Set JAVA_HOME
+ echo 'Set JAVA_HOME'
+ export JAVA_HOME=/usr/lib/jvm/java-17-openjdk
+ JAVA_HOME=/usr/lib/jvm/java-17-openjdk
++ readlink -e /usr/lib/jvm/java-17-openjdk/bin/java
+ JAVA_RESOLVED=/usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java
+ echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java'
Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java
Listing all open ports on controller system...
+ echo 'Listing all open ports on controller system...'
+ netstat -pnatu
(Not all processes could be identified, non-owned process info
 will not be shown, you would have to be root to see it all.)
Active Internet connections (servers and established)
Proto Recv-Q Send-Q Local Address           Foreign Address         State       PID/Program name    
tcp        0      0 0.0.0.0:111             0.0.0.0:*               LISTEN      -                   
tcp        0      0 0.0.0.0:22              0.0.0.0:*               LISTEN      -                   
tcp        0      0 10.30.171.102:22        10.30.170.150:56290     ESTABLISHED -                   
tcp        0      0 10.30.171.102:47758     199.204.45.87:443       TIME_WAIT   -                   
tcp6       0      0 :::111                  :::*                    LISTEN      -                   
tcp6       0      0 :::5555                 :::*                    LISTEN      -                   
tcp6       0      0 :::22                   :::*                    LISTEN      -                   
udp        0      0 10.30.171.102:68        10.30.170.2:67          ESTABLISHED -                   
udp        0      0 0.0.0.0:111             0.0.0.0:*                           -                   
udp        0      0 127.0.0.1:323           0.0.0.0:*                           -                   
udp6       0      0 :::111                  :::*                                -                   
udp6       0      0 ::1:323                 :::*                                -                   
Custom shard config exists!!!
Copying the shard config...
+ '[' -f /tmp/custom_shard_config.txt ']'
+ echo 'Custom shard config exists!!!'
+ echo 'Copying the shard config...'
+ cp /tmp/custom_shard_config.txt /tmp/karaf-0.20.1-SNAPSHOT/bin/
Configuring cluster
+ echo 'Configuring cluster'
+ /tmp/karaf-0.20.1-SNAPSHOT/bin/configure_cluster.sh 1 10.30.171.102 10.30.171.170 10.30.171.45
################################################
##             Configure Cluster              ##
################################################
 NOTE: Cluster configuration files not found. Copying from
 /tmp/karaf-0.20.1-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/9.0.2
Configuring unique name in akka.conf
Configuring hostname in akka.conf
Configuring data and rpc seed nodes in akka.conf
modules = [
	
	{
		name = "inventory"
		namespace = "urn:opendaylight:inventory"
		shard-strategy = "module"
	},
	{
		name = "topology"
		namespace = "urn:TBD:params:xml:ns:yang:network-topology"
		shard-strategy = "module"
	},
	{
		name = "toaster"
		namespace = "http://netconfcentral.org/ns/toaster"
		shard-strategy = "module"
	},
	{
		name = "car"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
		shard-strategy = "module"
	},
	{
		name = "people"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
		shard-strategy = "module"
	},
	{
		name = "car-people"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
		shard-strategy = "module"
	}
]
Configuring replication type in module-shards.conf
################################################
##   NOTE: Manually restart controller to     ##
##         apply configuration.               ##
################################################
Dump akka.conf
+ echo 'Dump akka.conf'
+ cat /tmp/karaf-0.20.1-SNAPSHOT/configuration/initial/akka.conf

odl-cluster-data {
  akka {
    remote {
      artery {
        enabled = on
        transport = tcp
        canonical.hostname = "10.30.171.102"
        canonical.port = 2550
      }
    }

    cluster {
      # Using artery.
      seed-nodes = ["akka://opendaylight-cluster-data@10.30.171.102:2550",
				"akka://opendaylight-cluster-data@10.30.171.170:2550",
				"akka://opendaylight-cluster-data@10.30.171.45:2550"]

      roles = ["member-1"]

      # when under load we might trip a false positive on the failure detector
      # failure-detector {
        # heartbeat-interval = 4 s
        # acceptable-heartbeat-pause = 16s
      # }
    }

    persistence {
      # By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by
      # modifying the following two properties. The directory location specified may be a relative or absolute path. 
      # The relative path is always relative to KARAF_HOME.

      # snapshot-store.local.dir = "target/snapshots"

      # Use lz4 compression for LocalSnapshotStore snapshots
      snapshot-store.local.use-lz4-compression = false
      # Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB
      snapshot-store.local.lz4-blocksize = 256KB
    }
    disable-default-actor-system-quarantined-event-handling = "false"
  }
}
Dump modules.conf
+ echo 'Dump modules.conf'
+ cat /tmp/karaf-0.20.1-SNAPSHOT/configuration/initial/modules.conf
modules = [
	
	{
		name = "inventory"
		namespace = "urn:opendaylight:inventory"
		shard-strategy = "module"
	},
	{
		name = "topology"
		namespace = "urn:TBD:params:xml:ns:yang:network-topology"
		shard-strategy = "module"
	},
	{
		name = "toaster"
		namespace = "http://netconfcentral.org/ns/toaster"
		shard-strategy = "module"
	},
	{
		name = "car"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
		shard-strategy = "module"
	},
	{
		name = "people"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
		shard-strategy = "module"
	},
	{
		name = "car-people"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
		shard-strategy = "module"
	}
]
Dump module-shards.conf
+ echo 'Dump module-shards.conf'
+ cat /tmp/karaf-0.20.1-SNAPSHOT/configuration/initial/module-shards.conf
module-shards = [
	{
		name = "default"
		shards = [
			{
				name = "default"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "inventory"
		shards = [
			{
				name="inventory"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "topology"
		shards = [
			{
				name="topology"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "toaster"
		shards = [
			{
				name="toaster"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "car"
		shards = [
			{
				name="car"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "people"
		shards = [
			{
				name="people"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "car-people"
		shards = [
			{
				name="car-people"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	}
]
Configuring member-2 with IP address 10.30.171.170
Warning: Permanently added '10.30.171.170' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.171.170' (ECDSA) to the list of known hosts.
+ source /tmp/common-functions.sh karaf-0.20.1-SNAPSHOT
++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]]
common-functions.sh is being sourced
++ echo 'common-functions.sh is being sourced'
++ BUNDLEFOLDER=karaf-0.20.1-SNAPSHOT
++ export MAVENCONF=/tmp/karaf-0.20.1-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
++ MAVENCONF=/tmp/karaf-0.20.1-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
++ export FEATURESCONF=/tmp/karaf-0.20.1-SNAPSHOT/etc/org.apache.karaf.features.cfg
++ FEATURESCONF=/tmp/karaf-0.20.1-SNAPSHOT/etc/org.apache.karaf.features.cfg
++ export CUSTOMPROP=/tmp/karaf-0.20.1-SNAPSHOT/etc/custom.properties
++ CUSTOMPROP=/tmp/karaf-0.20.1-SNAPSHOT/etc/custom.properties
++ export LOGCONF=/tmp/karaf-0.20.1-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
++ LOGCONF=/tmp/karaf-0.20.1-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
++ export MEMCONF=/tmp/karaf-0.20.1-SNAPSHOT/bin/setenv
++ MEMCONF=/tmp/karaf-0.20.1-SNAPSHOT/bin/setenv
++ export CONTROLLERMEM=
++ CONTROLLERMEM=
++ export AKKACONF=/tmp/karaf-0.20.1-SNAPSHOT/configuration/initial/akka.conf
++ AKKACONF=/tmp/karaf-0.20.1-SNAPSHOT/configuration/initial/akka.conf
++ export MODULESCONF=/tmp/karaf-0.20.1-SNAPSHOT/configuration/initial/modules.conf
++ MODULESCONF=/tmp/karaf-0.20.1-SNAPSHOT/configuration/initial/modules.conf
++ export MODULESHARDSCONF=/tmp/karaf-0.20.1-SNAPSHOT/configuration/initial/module-shards.conf
++ MODULESHARDSCONF=/tmp/karaf-0.20.1-SNAPSHOT/configuration/initial/module-shards.conf
++ print_common_env
++ cat
common-functions environment:
MAVENCONF: /tmp/karaf-0.20.1-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
ACTUALFEATURES: 
FEATURESCONF: /tmp/karaf-0.20.1-SNAPSHOT/etc/org.apache.karaf.features.cfg
CUSTOMPROP: /tmp/karaf-0.20.1-SNAPSHOT/etc/custom.properties
LOGCONF: /tmp/karaf-0.20.1-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
MEMCONF: /tmp/karaf-0.20.1-SNAPSHOT/bin/setenv
CONTROLLERMEM: 
AKKACONF: /tmp/karaf-0.20.1-SNAPSHOT/configuration/initial/akka.conf
MODULESCONF: /tmp/karaf-0.20.1-SNAPSHOT/configuration/initial/modules.conf
MODULESHARDSCONF: /tmp/karaf-0.20.1-SNAPSHOT/configuration/initial/module-shards.conf
SUITES: 

++ SSH='ssh -t -t'
++ extra_services_cntl='     dnsmasq.service     httpd.service     libvirtd.service     openvswitch.service     ovs-vswitchd.service     ovsdb-server.service     rabbitmq-server.service '
++ extra_services_cmp='     libvirtd.service     openvswitch.service     ovs-vswitchd.service     ovsdb-server.service '
Changing to /tmp
Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.1-SNAPSHOT/karaf-0.20.1-20240418.235143-1.zip
+ echo 'Changing to /tmp'
+ cd /tmp
+ echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.1-SNAPSHOT/karaf-0.20.1-20240418.235143-1.zip'
+ wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.1-SNAPSHOT/karaf-0.20.1-20240418.235143-1.zip
--2024-04-20 23:48:05--  https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.1-SNAPSHOT/karaf-0.20.1-20240418.235143-1.zip
Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6
Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 289547889 (276M) [application/zip]
Saving to: ‘karaf-0.20.1-20240418.235143-1.zip’

     0K ........ ........ ........ ........ ........ ........  1% 91.7M 3s
  3072K ........ ........ ........ ........ ........ ........  2%  163M 2s
  6144K ........ ........ ........ ........ ........ ........  3%  190M 2s
  9216K ........ ........ ........ ........ ........ ........  4%  182M 2s
 12288K ........ ........ ........ ........ ........ ........  5%  209M 2s
 15360K ........ ........ ........ ........ ........ ........  6%  253M 2s
 18432K ........ ........ ........ ........ ........ ........  7%  245M 1s
 21504K ........ ........ ........ ........ ........ ........  8%  238M 1s
 24576K ........ ........ ........ ........ ........ ........  9%  260M 1s
 27648K ........ ........ ........ ........ ........ ........ 10%  291M 1s
 30720K ........ ........ ........ ........ ........ ........ 11%  247M 1s
 33792K ........ ........ ........ ........ ........ ........ 13%  307M 1s
 36864K ........ ........ ........ ........ ........ ........ 14%  318M 1s
 39936K ........ ........ ........ ........ ........ ........ 15%  334M 1s
 43008K ........ ........ ........ ........ ........ ........ 16%  323M 1s
 46080K ........ ........ ........ ........ ........ ........ 17%  327M 1s
 49152K ........ ........ ........ ........ ........ ........ 18%  318M 1s
 52224K ........ ........ ........ ........ ........ ........ 19%  280M 1s
 55296K ........ ........ ........ ........ ........ ........ 20%  262M 1s
 58368K ........ ........ ........ ........ ........ ........ 21%  197M 1s
 61440K ........ ........ ........ ........ ........ ........ 22%  303M 1s
 64512K ........ ........ ........ ........ ........ ........ 23%  297M 1s
 67584K ........ ........ ........ ........ ........ ........ 24%  315M 1s
 70656K ........ ........ ........ ........ ........ ........ 26%  306M 1s
 73728K ........ ........ ........ ........ ........ ........ 27%  325M 1s
 76800K ........ ........ ........ ........ ........ ........ 28%  321M 1s
 79872K ........ ........ ........ ........ ........ ........ 29%  320M 1s
 82944K ........ ........ ........ ........ ........ ........ 30%  318M 1s
 86016K ........ ........ ........ ........ ........ ........ 31%  322M 1s
 89088K ........ ........ ........ ........ ........ ........ 32%  245M 1s
 92160K ........ ........ ........ ........ ........ ........ 33%  243M 1s
 95232K ........ ........ ........ ........ ........ ........ 34%  316M 1s
 98304K ........ ........ ........ ........ ........ ........ 35%  329M 1s
101376K ........ ........ ........ ........ ........ ........ 36%  313M 1s
104448K ........ ........ ........ ........ ........ ........ 38%  325M 1s
107520K ........ ........ ........ ........ ........ ........ 39%  308M 1s
110592K ........ ........ ........ ........ ........ ........ 40%  308M 1s
113664K ........ ........ ........ ........ ........ ........ 41%  321M 1s
116736K ........ ........ ........ ........ ........ ........ 42%  299M 1s
119808K ........ ........ ........ ........ ........ ........ 43%  298M 1s
122880K ........ ........ ........ ........ ........ ........ 44%  294M 1s
125952K ........ ........ ........ ........ ........ ........ 45%  299M 1s
129024K ........ ........ ........ ........ ........ ........ 46%  312M 1s
132096K ........ ........ ........ ........ ........ ........ 47%  308M 1s
135168K ........ ........ ........ ........ ........ ........ 48%  319M 1s
138240K ........ ........ ........ ........ ........ ........ 49%  312M 1s
141312K ........ ........ ........ ........ ........ ........ 51%  325M 1s
144384K ........ ........ ........ ........ ........ ........ 52%  294M 0s
147456K ........ ........ ........ ........ ........ ........ 53%  298M 0s
150528K ........ ........ ........ ........ ........ ........ 54%  316M 0s
153600K ........ ........ ........ ........ ........ ........ 55%  304M 0s
156672K ........ ........ ........ ........ ........ ........ 56%  314M 0s
159744K ........ ........ ........ ........ ........ ........ 57%  323M 0s
162816K ........ ........ ........ ........ ........ ........ 58%  307M 0s
165888K ........ ........ ........ ........ ........ ........ 59%  323M 0s
168960K ........ ........ ........ ........ ........ ........ 60%  312M 0s
172032K ........ ........ ........ ........ ........ ........ 61%  322M 0s
175104K ........ ........ ........ ........ ........ ........ 63%  312M 0s
178176K ........ ........ ........ ........ ........ ........ 64%  291M 0s
181248K ........ ........ ........ ........ ........ ........ 65%  267M 0s
184320K ........ ........ ........ ........ ........ ........ 66%  292M 0s
187392K ........ ........ ........ ........ ........ ........ 67%  305M 0s
190464K ........ ........ ........ ........ ........ ........ 68%  316M 0s
193536K ........ ........ ........ ........ ........ ........ 69%  332M 0s
196608K ........ ........ ........ ........ ........ ........ 70%  327M 0s
199680K ........ ........ ........ ........ ........ ........ 71%  352M 0s
202752K ........ ........ ........ ........ ........ ........ 72%  305M 0s
205824K ........ ........ ........ ........ ........ ........ 73%  296M 0s
208896K ........ ........ ........ ........ ........ ........ 74%  274M 0s
211968K ........ ........ ........ ........ ........ ........ 76%  250M 0s
215040K ........ ........ ........ ........ ........ ........ 77%  311M 0s
218112K ........ ........ ........ ........ ........ ........ 78%  304M 0s
221184K ........ ........ ........ ........ ........ ........ 79%  322M 0s
224256K ........ ........ ........ ........ ........ ........ 80%  314M 0s
227328K ........ ........ ........ ........ ........ ........ 81%  310M 0s
230400K ........ ........ ........ ........ ........ ........ 82%  312M 0s
233472K ........ ........ ........ ........ ........ ........ 83%  313M 0s
236544K ........ ........ ........ ........ ........ ........ 84%  322M 0s
239616K ........ ........ ........ ........ ........ ........ 85%  330M 0s
242688K ........ ........ ........ ........ ........ ........ 86%  324M 0s
245760K ........ ........ ........ ........ ........ ........ 88%  323M 0s
248832K ........ ........ ........ ........ ........ ........ 89%  318M 0s
251904K ........ ........ ........ ........ ........ ........ 90%  308M 0s
254976K ........ ........ ........ ........ ........ ........ 91%  313M 0s
258048K ........ ........ ........ ........ ........ ........ 92%  284M 0s
261120K ........ ........ ........ ........ ........ ........ 93%  301M 0s
264192K ........ ........ ........ ........ ........ ........ 94%  328M 0s
267264K ........ ........ ........ ........ ........ ........ 95%  296M 0s
270336K ........ ........ ........ ........ ........ ........ 96%  339M 0s
273408K ........ ........ ........ ........ ........ ........ 97%  309M 0s
276480K ........ ........ ........ ........ ........ ........ 98%  317M 0s
279552K ........ ........ ........ ........ ........ ........ 99%  354M 0s
282624K ..                                                   100%  327M=1.0s

2024-04-20 23:48:06 (287 MB/s) - ‘karaf-0.20.1-20240418.235143-1.zip’ saved [289547889/289547889]

Extracting the new controller...
+ echo 'Extracting the new controller...'
+ unzip -q karaf-0.20.1-20240418.235143-1.zip
Adding external repositories...
+ echo 'Adding external repositories...'
+ sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.20.1-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
+ cat /tmp/karaf-0.20.1-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
################################################################################
#
#    Licensed to the Apache Software Foundation (ASF) under one or more
#    contributor license agreements.  See the NOTICE file distributed with
#    this work for additional information regarding copyright ownership.
#    The ASF licenses this file to You under the Apache License, Version 2.0
#    (the "License"); you may not use this file except in compliance with
#    the License.  You may obtain a copy of the License at
#
#       http://www.apache.org/licenses/LICENSE-2.0
#
#    Unless required by applicable law or agreed to in writing, software
#    distributed under the License is distributed on an "AS IS" BASIS,
#    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
#    See the License for the specific language governing permissions and
#    limitations under the License.
#
################################################################################

#
# If set to true, the following property will not allow any certificate to be used
# when accessing Maven repositories through SSL
#
#org.ops4j.pax.url.mvn.certificateCheck=

#
# Path to the local Maven settings file.
# The repositories defined in this file will be automatically added to the list
# of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property
# below is not set.
# The following locations are checked for the existence of the settings.xml file
#   * 1. looks for the specified url
#   * 2. if not found looks for ${user.home}/.m2/settings.xml
#   * 3. if not found looks for ${maven.home}/conf/settings.xml
#   * 4. if not found looks for ${M2_HOME}/conf/settings.xml
#
#org.ops4j.pax.url.mvn.settings=

#
# Path to the local Maven repository which is used to avoid downloading
# artifacts when they already exist locally.
# The value of this property will be extracted from the settings.xml file
# above, or defaulted to:
#     System.getProperty( "user.home" ) + "/.m2/repository"
#
org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository}

#
# Default this to false. It's just weird to use undocumented repos
#
org.ops4j.pax.url.mvn.useFallbackRepositories=false

#
# Uncomment if you don't wanna use the proxy settings
# from the Maven conf/settings.xml file
#
# org.ops4j.pax.url.mvn.proxySupport=false

#
# Comma separated list of repositories scanned when resolving an artifact.
# Those repositories will be checked before iterating through the
#    below list of repositories and even before the local repository
# A repository url can be appended with zero or more of the following flags:
#    @snapshots  : the repository contains snaphots
#    @noreleases : the repository does not contain any released artifacts
#
# The following property value will add the system folder as a repo.
#
org.ops4j.pax.url.mvn.defaultRepositories=\
    file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\
    file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\
    file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots

# Use the default local repo (e.g.~/.m2/repository) as a "remote" repo
#org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false

#
# Comma separated list of repositories scanned when resolving an artifact.
# The default list includes the following repositories:
#    http://repo1.maven.org/maven2@id=central
#    http://repository.springsource.com/maven/bundles/release@id=spring.ebr
#    http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external
#    http://zodiac.springsource.com/maven/bundles/release@id=gemini
#    http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases
#    https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases
#    https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
# To add repositories to the default ones, prepend '+' to the list of repositories
# to add.
# A repository url can be appended with zero or more of the following flags:
#    @snapshots  : the repository contains snapshots
#    @noreleases : the repository does not contain any released artifacts
#    @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended
#
org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases

### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.Configuring the startup features...
+ [[ True == \T\r\u\e ]]
+ echo 'Configuring the startup features...'
+ sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.20.1-SNAPSHOT/etc/org.apache.karaf.features.cfg
+ FEATURE_TEST_STRING=features-test
+ FEATURE_TEST_VERSION=0.20.1-SNAPSHOT
+ KARAF_VERSION=karaf4
+ [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]]
+ sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.20.1-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.20.1-SNAPSHOT/etc/org.apache.karaf.features.cfg
+ [[ ! -z '' ]]
+ cat /tmp/karaf-0.20.1-SNAPSHOT/etc/org.apache.karaf.features.cfg
################################################################################
#
#    Licensed to the Apache Software Foundation (ASF) under one or more
#    contributor license agreements.  See the NOTICE file distributed with
#    this work for additional information regarding copyright ownership.
#    The ASF licenses this file to You under the Apache License, Version 2.0
#    (the "License"); you may not use this file except in compliance with
#    the License.  You may obtain a copy of the License at
#
#       http://www.apache.org/licenses/LICENSE-2.0
#
#    Unless required by applicable law or agreed to in writing, software
#    distributed under the License is distributed on an "AS IS" BASIS,
#    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
#    See the License for the specific language governing permissions and
#    limitations under the License.
#
################################################################################

#
# Comma separated list of features repositories to register by default
#
featuresRepositories = mvn:org.opendaylight.integration/features-test/0.20.1-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/f672b964-93a9-490b-99c4-29d2472ec2ef.xml

#
# Comma separated list of features to install at startup
#
featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, eadc6530-6f9b-43f4-8562-a6b121b5b3a3

#
# Resource repositories (OBR) that the features resolver can use
# to resolve requirements/capabilities
#
# The format of the resourceRepositories is 
# resourceRepositories=[xml:url|json:url],...
# for Instance:
#
#resourceRepositories=xml:http://host/path/to/index.xml
# or
#resourceRepositories=json:http://host/path/to/index.json
#

#
# Defines if the boot features are started in asynchronous mode (in a dedicated thread)
#
featuresBootAsynchronous=false

#
# Service requirements enforcement
#
# By default, the feature resolver checks the service requirements/capabilities of
# bundles for new features (xml schema >= 1.3.0) in order to automatically installs
# the required bundles.
# The following flag can have those values:
#   - disable: service requirements are completely ignored
#   - default: service requirements are ignored for old features
#   - enforce: service requirements are always verified
#
#serviceRequirements=default

#
# Store cfg file for config element in feature
#
#configCfgStore=true

#
# Define if the feature service automatically refresh bundles
#
autoRefresh=true

#
# Configuration of features processing mechanism (overrides, blacklisting, modification of features)
# XML file defines instructions related to features processing
# versions.properties may declare properties to resolve placeholders in XML file
# both files are relative to ${karaf.etc}
#
#featureProcessing=org.apache.karaf.features.xml
#featureProcessingVersions=versions.properties
+ configure_karaf_log karaf4 ''
+ local -r karaf_version=karaf4
+ local -r controllerdebugmap=
+ local logapi=log4j
+ grep log4j2 /tmp/karaf-0.20.1-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
log4j2.rootLogger.level = INFO
#log4j2.rootLogger.type = asyncRoot
#log4j2.rootLogger.includeLocation = false
log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
log4j2.rootLogger.appenderRef.Console.ref = Console
log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
log4j2.logger.spifly.name = org.apache.aries.spifly
log4j2.logger.spifly.level = WARN
log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
log4j2.logger.audit.level = INFO
log4j2.logger.audit.additivity = false
log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
# Console appender not used by default (see log4j2.rootLogger.appenderRefs)
log4j2.appender.console.type = Console
log4j2.appender.console.name = Console
log4j2.appender.console.layout.type = PatternLayout
log4j2.appender.console.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.type = RollingRandomAccessFile
log4j2.appender.rolling.name = RollingFile
log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
#log4j2.appender.rolling.immediateFlush = false
log4j2.appender.rolling.append = true
log4j2.appender.rolling.layout.type = PatternLayout
log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.policies.type = Policies
log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.rolling.policies.size.size = 64MB
log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
log4j2.appender.rolling.strategy.max = 7
log4j2.appender.audit.type = RollingRandomAccessFile
log4j2.appender.audit.name = AuditRollingFile
log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
log4j2.appender.audit.append = true
log4j2.appender.audit.layout.type = PatternLayout
log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
log4j2.appender.audit.policies.type = Policies
log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.audit.policies.size.size = 8MB
log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
log4j2.appender.audit.strategy.max = 7
log4j2.appender.osgi.type = PaxOsgi
log4j2.appender.osgi.name = PaxOsgi
log4j2.appender.osgi.filter = *
#log4j2.logger.aether.name = shaded.org.eclipse.aether
#log4j2.logger.aether.level = TRACE
#log4j2.logger.http-headers.name = shaded.org.apache.http.headers
#log4j2.logger.http-headers.level = DEBUG
#log4j2.logger.maven.name = org.ops4j.pax.url.mvn
#log4j2.logger.maven.level = TRACE
Configuring the karaf log... karaf_version: karaf4, logapi: log4j2
+ logapi=log4j2
+ echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2'
+ '[' log4j2 == log4j2 ']'
+ sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.20.1-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
+ orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver
+ orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver
+ echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN'
+ echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN'
controllerdebugmap: 
+ unset IFS
+ echo 'controllerdebugmap: '
cat /tmp/karaf-0.20.1-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
+ '[' -n '' ']'
+ echo 'cat /tmp/karaf-0.20.1-SNAPSHOT/etc/org.ops4j.pax.logging.cfg'
+ cat /tmp/karaf-0.20.1-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
################################################################################
#
#    Licensed to the Apache Software Foundation (ASF) under one or more
#    contributor license agreements.  See the NOTICE file distributed with
#    this work for additional information regarding copyright ownership.
#    The ASF licenses this file to You under the Apache License, Version 2.0
#    (the "License"); you may not use this file except in compliance with
#    the License.  You may obtain a copy of the License at
#
#       http://www.apache.org/licenses/LICENSE-2.0
#
#    Unless required by applicable law or agreed to in writing, software
#    distributed under the License is distributed on an "AS IS" BASIS,
#    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
#    See the License for the specific language governing permissions and
#    limitations under the License.
#
################################################################################

# Common pattern layout for appenders
log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n

# Root logger
log4j2.rootLogger.level = INFO
# uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library
#log4j2.rootLogger.type = asyncRoot
#log4j2.rootLogger.includeLocation = false
log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
log4j2.rootLogger.appenderRef.Console.ref = Console
log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}

# Filters for logs marked by org.opendaylight.odlparent.Markers
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL

# Loggers configuration

# Spifly logger
log4j2.logger.spifly.name = org.apache.aries.spifly
log4j2.logger.spifly.level = WARN

# Security audit logger
log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
log4j2.logger.audit.level = INFO
log4j2.logger.audit.additivity = false
log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile

# Appenders configuration

# Console appender not used by default (see log4j2.rootLogger.appenderRefs)
log4j2.appender.console.type = Console
log4j2.appender.console.name = Console
log4j2.appender.console.layout.type = PatternLayout
log4j2.appender.console.layout.pattern = ${log4j2.pattern}

# Rolling file appender
log4j2.appender.rolling.type = RollingRandomAccessFile
log4j2.appender.rolling.name = RollingFile
log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
# uncomment to not force a disk flush
#log4j2.appender.rolling.immediateFlush = false
log4j2.appender.rolling.append = true
log4j2.appender.rolling.layout.type = PatternLayout
log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.policies.type = Policies
log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.rolling.policies.size.size = 1GB
log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
log4j2.appender.rolling.strategy.max = 7

# Audit file appender
log4j2.appender.audit.type = RollingRandomAccessFile
log4j2.appender.audit.name = AuditRollingFile
log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
log4j2.appender.audit.append = true
log4j2.appender.audit.layout.type = PatternLayout
log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
log4j2.appender.audit.policies.type = Policies
log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.audit.policies.size.size = 8MB
log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
log4j2.appender.audit.strategy.max = 7

# OSGi appender
log4j2.appender.osgi.type = PaxOsgi
log4j2.appender.osgi.name = PaxOsgi
log4j2.appender.osgi.filter = *

# help with identification of maven-related problems with pax-url-aether
#log4j2.logger.aether.name = shaded.org.eclipse.aether
#log4j2.logger.aether.level = TRACE
#log4j2.logger.http-headers.name = shaded.org.apache.http.headers
#log4j2.logger.http-headers.level = DEBUG
#log4j2.logger.maven.name = org.ops4j.pax.url.mvn
#log4j2.logger.maven.level = TRACE
log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN
log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN
Configure
+ set_java_vars /usr/lib/jvm/java-17-openjdk 3072m /tmp/karaf-0.20.1-SNAPSHOT/bin/setenv
+ local -r java_home=/usr/lib/jvm/java-17-openjdk
+ local -r controllermem=3072m
+ local -r memconf=/tmp/karaf-0.20.1-SNAPSHOT/bin/setenv
+ echo Configure
    java home: /usr/lib/jvm/java-17-openjdk
+ echo '    java home: /usr/lib/jvm/java-17-openjdk'
+ echo '    max memory: 3072m'
    max memory: 3072m
    memconf: /tmp/karaf-0.20.1-SNAPSHOT/bin/setenv
+ echo '    memconf: /tmp/karaf-0.20.1-SNAPSHOT/bin/setenv'
+ sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk}%g' /tmp/karaf-0.20.1-SNAPSHOT/bin/setenv
+ sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.20.1-SNAPSHOT/bin/setenv
cat /tmp/karaf-0.20.1-SNAPSHOT/bin/setenv
+ echo 'cat /tmp/karaf-0.20.1-SNAPSHOT/bin/setenv'
+ cat /tmp/karaf-0.20.1-SNAPSHOT/bin/setenv
#!/bin/sh
#
#    Licensed to the Apache Software Foundation (ASF) under one or more
#    contributor license agreements.  See the NOTICE file distributed with
#    this work for additional information regarding copyright ownership.
#    The ASF licenses this file to You under the Apache License, Version 2.0
#    (the "License"); you may not use this file except in compliance with
#    the License.  You may obtain a copy of the License at
#
#       http://www.apache.org/licenses/LICENSE-2.0
#
#    Unless required by applicable law or agreed to in writing, software
#    distributed under the License is distributed on an "AS IS" BASIS,
#    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
#    See the License for the specific language governing permissions and
#    limitations under the License.
#

#
# handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf
# script: client, instance, shell, start, status, stop, karaf
#
# if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then
#   Actions go here...
# fi

#
# general settings which should be applied for all scripts go here; please keep
# in mind that it is possible that scripts might be executed more than once, e.g.
# in example of the start script where the start script is executed first and the
# karaf script afterwards.
#

#
# The following section shows the possible configuration options for the default 
# karaf scripts
#
export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk} # Location of Java installation
# export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration
# export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options
# export EXTRA_JAVA_OPTS # Additional JVM options
# export KARAF_HOME # Karaf home folder
# export KARAF_DATA # Karaf data folder
# export KARAF_BASE # Karaf base folder
# export KARAF_ETC  # Karaf etc  folder
# export KARAF_LOG  # Karaf log  folder
# export KARAF_SYSTEM_OPTS # First citizen Karaf options
# export KARAF_OPTS # Additional available Karaf options
# export KARAF_DEBUG # Enable debug mode
# export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start
# export KARAF_NOROOT # Prevent execution as root if set to true
Set Java version
+ echo 'Set Java version'
+ sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-17-openjdk/bin/java 1
+ sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-17-openjdk/bin/java
JDK default version ...
+ echo 'JDK default version ...'
+ java -version
openjdk version "17.0.6-ea" 2023-01-17 LTS
OpenJDK Runtime Environment (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS)
OpenJDK 64-Bit Server VM (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS, mixed mode, sharing)
Set JAVA_HOME
+ echo 'Set JAVA_HOME'
+ export JAVA_HOME=/usr/lib/jvm/java-17-openjdk
+ JAVA_HOME=/usr/lib/jvm/java-17-openjdk
++ readlink -e /usr/lib/jvm/java-17-openjdk/bin/java
Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java
+ JAVA_RESOLVED=/usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java
+ echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java'
Listing all open ports on controller system...
+ echo 'Listing all open ports on controller system...'
+ netstat -pnatu
(Not all processes could be identified, non-owned process info
 will not be shown, you would have to be root to see it all.)
Active Internet connections (servers and established)
Proto Recv-Q Send-Q Local Address           Foreign Address         State       PID/Program name    
tcp        0      0 0.0.0.0:111             0.0.0.0:*               LISTEN      -                   
tcp        0      0 0.0.0.0:22              0.0.0.0:*               LISTEN      -                   
tcp        0    164 10.30.171.170:22        10.30.170.150:59100     ESTABLISHED -                   
tcp        0      0 10.30.171.170:47082     199.204.45.87:443       TIME_WAIT   -                   
tcp6       0      0 :::111                  :::*                    LISTEN      -                   
tcp6       0      0 :::5555                 :::*                    LISTEN      -                   
tcp6       0      0 :::22                   :::*                    LISTEN      -                   
udp        0      0 10.30.171.170:68        10.30.170.3:67          ESTABLISHED -                   
udp        0      0 0.0.0.0:111             0.0.0.0:*                           -                   
udp        0      0 127.0.0.1:323           0.0.0.0:*                           -                   
udp6       0      0 :::111                  :::*                                -                   
udp6       0      0 ::1:323                 :::*                                -                   
Custom shard config exists!!!
+ '[' -f /tmp/custom_shard_config.txt ']'
+ echo 'Custom shard config exists!!!'
Copying the shard config...
+ echo 'Copying the shard config...'
+ cp /tmp/custom_shard_config.txt /tmp/karaf-0.20.1-SNAPSHOT/bin/
Configuring cluster
+ echo 'Configuring cluster'
+ /tmp/karaf-0.20.1-SNAPSHOT/bin/configure_cluster.sh 2 10.30.171.102 10.30.171.170 10.30.171.45
################################################
##             Configure Cluster              ##
################################################
 NOTE: Cluster configuration files not found. Copying from
 /tmp/karaf-0.20.1-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/9.0.2
Configuring unique name in akka.conf
Configuring hostname in akka.conf
Configuring data and rpc seed nodes in akka.conf
modules = [
	
	{
		name = "inventory"
		namespace = "urn:opendaylight:inventory"
		shard-strategy = "module"
	},
	{
		name = "topology"
		namespace = "urn:TBD:params:xml:ns:yang:network-topology"
		shard-strategy = "module"
	},
	{
		name = "toaster"
		namespace = "http://netconfcentral.org/ns/toaster"
		shard-strategy = "module"
	},
	{
		name = "car"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
		shard-strategy = "module"
	},
	{
		name = "people"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
		shard-strategy = "module"
	},
	{
		name = "car-people"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
		shard-strategy = "module"
	}
]
Configuring replication type in module-shards.conf
################################################
##   NOTE: Manually restart controller to     ##
##         apply configuration.               ##
################################################
+ echo 'Dump akka.conf'
Dump akka.conf
+ cat /tmp/karaf-0.20.1-SNAPSHOT/configuration/initial/akka.conf

odl-cluster-data {
  akka {
    remote {
      artery {
        enabled = on
        transport = tcp
        canonical.hostname = "10.30.171.170"
        canonical.port = 2550
      }
    }

    cluster {
      # Using artery.
      seed-nodes = ["akka://opendaylight-cluster-data@10.30.171.102:2550",
				"akka://opendaylight-cluster-data@10.30.171.170:2550",
				"akka://opendaylight-cluster-data@10.30.171.45:2550"]

      roles = ["member-2"]

      # when under load we might trip a false positive on the failure detector
      # failure-detector {
        # heartbeat-interval = 4 s
        # acceptable-heartbeat-pause = 16s
      # }
    }

    persistence {
      # By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by
      # modifying the following two properties. The directory location specified may be a relative or absolute path. 
      # The relative path is always relative to KARAF_HOME.

      # snapshot-store.local.dir = "target/snapshots"

      # Use lz4 compression for LocalSnapshotStore snapshots
      snapshot-store.local.use-lz4-compression = false
      # Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB
      snapshot-store.local.lz4-blocksize = 256KB
    }
    disable-default-actor-system-quarantined-event-handling = "false"
  }
}
Dump modules.conf
+ echo 'Dump modules.conf'
+ cat /tmp/karaf-0.20.1-SNAPSHOT/configuration/initial/modules.conf
modules = [
	
	{
		name = "inventory"
		namespace = "urn:opendaylight:inventory"
		shard-strategy = "module"
	},
	{
		name = "topology"
		namespace = "urn:TBD:params:xml:ns:yang:network-topology"
		shard-strategy = "module"
	},
	{
		name = "toaster"
		namespace = "http://netconfcentral.org/ns/toaster"
		shard-strategy = "module"
	},
	{
		name = "car"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
		shard-strategy = "module"
	},
	{
		name = "people"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
		shard-strategy = "module"
	},
	{
		name = "car-people"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
		shard-strategy = "module"
	}
]
Dump module-shards.conf
+ echo 'Dump module-shards.conf'
+ cat /tmp/karaf-0.20.1-SNAPSHOT/configuration/initial/module-shards.conf
module-shards = [
	{
		name = "default"
		shards = [
			{
				name = "default"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "inventory"
		shards = [
			{
				name="inventory"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "topology"
		shards = [
			{
				name="topology"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "toaster"
		shards = [
			{
				name="toaster"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "car"
		shards = [
			{
				name="car"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "people"
		shards = [
			{
				name="people"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "car-people"
		shards = [
			{
				name="car-people"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	}
]
Configuring member-3 with IP address 10.30.171.45
Warning: Permanently added '10.30.171.45' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.171.45' (ECDSA) to the list of known hosts.
common-functions.sh is being sourced
+ source /tmp/common-functions.sh karaf-0.20.1-SNAPSHOT
++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]]
++ echo 'common-functions.sh is being sourced'
++ BUNDLEFOLDER=karaf-0.20.1-SNAPSHOT
++ export MAVENCONF=/tmp/karaf-0.20.1-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
++ MAVENCONF=/tmp/karaf-0.20.1-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
++ export FEATURESCONF=/tmp/karaf-0.20.1-SNAPSHOT/etc/org.apache.karaf.features.cfg
++ FEATURESCONF=/tmp/karaf-0.20.1-SNAPSHOT/etc/org.apache.karaf.features.cfg
++ export CUSTOMPROP=/tmp/karaf-0.20.1-SNAPSHOT/etc/custom.properties
++ CUSTOMPROP=/tmp/karaf-0.20.1-SNAPSHOT/etc/custom.properties
++ export LOGCONF=/tmp/karaf-0.20.1-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
++ LOGCONF=/tmp/karaf-0.20.1-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
++ export MEMCONF=/tmp/karaf-0.20.1-SNAPSHOT/bin/setenv
++ MEMCONF=/tmp/karaf-0.20.1-SNAPSHOT/bin/setenv
++ export CONTROLLERMEM=
++ CONTROLLERMEM=
++ export AKKACONF=/tmp/karaf-0.20.1-SNAPSHOT/configuration/initial/akka.conf
++ AKKACONF=/tmp/karaf-0.20.1-SNAPSHOT/configuration/initial/akka.conf
++ export MODULESCONF=/tmp/karaf-0.20.1-SNAPSHOT/configuration/initial/modules.conf
++ MODULESCONF=/tmp/karaf-0.20.1-SNAPSHOT/configuration/initial/modules.conf
++ export MODULESHARDSCONF=/tmp/karaf-0.20.1-SNAPSHOT/configuration/initial/module-shards.conf
++ MODULESHARDSCONF=/tmp/karaf-0.20.1-SNAPSHOT/configuration/initial/module-shards.conf
++ print_common_env
++ cat
common-functions environment:
MAVENCONF: /tmp/karaf-0.20.1-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
ACTUALFEATURES: 
FEATURESCONF: /tmp/karaf-0.20.1-SNAPSHOT/etc/org.apache.karaf.features.cfg
CUSTOMPROP: /tmp/karaf-0.20.1-SNAPSHOT/etc/custom.properties
LOGCONF: /tmp/karaf-0.20.1-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
MEMCONF: /tmp/karaf-0.20.1-SNAPSHOT/bin/setenv
CONTROLLERMEM: 
AKKACONF: /tmp/karaf-0.20.1-SNAPSHOT/configuration/initial/akka.conf
MODULESCONF: /tmp/karaf-0.20.1-SNAPSHOT/configuration/initial/modules.conf
MODULESHARDSCONF: /tmp/karaf-0.20.1-SNAPSHOT/configuration/initial/module-shards.conf
SUITES: 

Changing to /tmp
Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.1-SNAPSHOT/karaf-0.20.1-20240418.235143-1.zip
++ SSH='ssh -t -t'
++ extra_services_cntl='     dnsmasq.service     httpd.service     libvirtd.service     openvswitch.service     ovs-vswitchd.service     ovsdb-server.service     rabbitmq-server.service '
++ extra_services_cmp='     libvirtd.service     openvswitch.service     ovs-vswitchd.service     ovsdb-server.service '
+ echo 'Changing to /tmp'
+ cd /tmp
+ echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.1-SNAPSHOT/karaf-0.20.1-20240418.235143-1.zip'
+ wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.1-SNAPSHOT/karaf-0.20.1-20240418.235143-1.zip
--2024-04-20 23:48:09--  https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.1-SNAPSHOT/karaf-0.20.1-20240418.235143-1.zip
Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6
Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 289547889 (276M) [application/zip]
Saving to: ‘karaf-0.20.1-20240418.235143-1.zip’

     0K ........ ........ ........ ........ ........ ........  1% 72.0M 4s
  3072K ........ ........ ........ ........ ........ ........  2%  128M 3s
  6144K ........ ........ ........ ........ ........ ........  3%  152M 3s
  9216K ........ ........ ........ ........ ........ ........  4%  134M 2s
 12288K ........ ........ ........ ........ ........ ........  5%  156M 2s
 15360K ........ ........ ........ ........ ........ ........  6%  199M 2s
 18432K ........ ........ ........ ........ ........ ........  7%  235M 2s
 21504K ........ ........ ........ ........ ........ ........  8%  215M 2s
 24576K ........ ........ ........ ........ ........ ........  9%  247M 2s
 27648K ........ ........ ........ ........ ........ ........ 10%  245M 2s
 30720K ........ ........ ........ ........ ........ ........ 11%  268M 2s
 33792K ........ ........ ........ ........ ........ ........ 13%  267M 1s
 36864K ........ ........ ........ ........ ........ ........ 14%  156M 1s
 39936K ........ ........ ........ ........ ........ ........ 15%  333M 1s
 43008K ........ ........ ........ ........ ........ ........ 16%  289M 1s
 46080K ........ ........ ........ ........ ........ ........ 17%  272M 1s
 49152K ........ ........ ........ ........ ........ ........ 18%  256M 1s
 52224K ........ ........ ........ ........ ........ ........ 19%  211M 1s
 55296K ........ ........ ........ ........ ........ ........ 20%  285M 1s
 58368K ........ ........ ........ ........ ........ ........ 21%  396M 1s
 61440K ........ ........ ........ ........ ........ ........ 22%  293M 1s
 64512K ........ ........ ........ ........ ........ ........ 23%  239M 1s
 67584K ........ ........ ........ ........ ........ ........ 24%  276M 1s
 70656K ........ ........ ........ ........ ........ ........ 26%  287M 1s
 73728K ........ ........ ........ ........ ........ ........ 27%  278M 1s
 76800K ........ ........ ........ ........ ........ ........ 28%  271M 1s
 79872K ........ ........ ........ ........ ........ ........ 29%  273M 1s
 82944K ........ ........ ........ ........ ........ ........ 30%  278M 1s
 86016K ........ ........ ........ ........ ........ ........ 31%  250M 1s
 89088K ........ ........ ........ ........ ........ ........ 32%  199M 1s
 92160K ........ ........ ........ ........ ........ ........ 33%  203M 1s
 95232K ........ ........ ........ ........ ........ ........ 34%  193M 1s
 98304K ........ ........ ........ ........ ........ ........ 35%  207M 1s
101376K ........ ........ ........ ........ ........ ........ 36%  203M 1s
104448K ........ ........ ........ ........ ........ ........ 38%  192M 1s
107520K ........ ........ ........ ........ ........ ........ 39%  191M 1s
110592K ........ ........ ........ ........ ........ ........ 40%  186M 1s
113664K ........ ........ ........ ........ ........ ........ 41%  198M 1s
116736K ........ ........ ........ ........ ........ ........ 42%  197M 1s
119808K ........ ........ ........ ........ ........ ........ 43%  203M 1s
122880K ........ ........ ........ ........ ........ ........ 44%  199M 1s
125952K ........ ........ ........ ........ ........ ........ 45%  205M 1s
129024K ........ ........ ........ ........ ........ ........ 46%  210M 1s
132096K ........ ........ ........ ........ ........ ........ 47%  218M 1s
135168K ........ ........ ........ ........ ........ ........ 48%  198M 1s
138240K ........ ........ ........ ........ ........ ........ 49%  204M 1s
141312K ........ ........ ........ ........ ........ ........ 51% 97.9M 1s
144384K ........ ........ ........ ........ ........ ........ 52%  152M 1s
147456K ........ ........ ........ ........ ........ ........ 53%  200M 1s
150528K ........ ........ ........ ........ ........ ........ 54%  209M 1s
153600K ........ ........ ........ ........ ........ ........ 55%  205M 1s
156672K ........ ........ ........ ........ ........ ........ 56%  205M 1s
159744K ........ ........ ........ ........ ........ ........ 57%  196M 1s
162816K ........ ........ ........ ........ ........ ........ 58%  206M 1s
165888K ........ ........ ........ ........ ........ ........ 59%  209M 1s
168960K ........ ........ ........ ........ ........ ........ 60%  209M 1s
172032K ........ ........ ........ ........ ........ ........ 61%  204M 1s
175104K ........ ........ ........ ........ ........ ........ 63%  215M 1s
178176K ........ ........ ........ ........ ........ ........ 64%  251M 0s
181248K ........ ........ ........ ........ ........ ........ 65%  243M 0s
184320K ........ ........ ........ ........ ........ ........ 66%  206M 0s
187392K ........ ........ ........ ........ ........ ........ 67%  207M 0s
190464K ........ ........ ........ ........ ........ ........ 68%  210M 0s
193536K ........ ........ ........ ........ ........ ........ 69%  211M 0s
196608K ........ ........ ........ ........ ........ ........ 70%  211M 0s
199680K ........ ........ ........ ........ ........ ........ 71%  212M 0s
202752K ........ ........ ........ ........ ........ ........ 72%  204M 0s
205824K ........ ........ ........ ........ ........ ........ 73%  199M 0s
208896K ........ ........ ........ ........ ........ ........ 74%  195M 0s
211968K ........ ........ ........ ........ ........ ........ 76%  203M 0s
215040K ........ ........ ........ ........ ........ ........ 77%  211M 0s
218112K ........ ........ ........ ........ ........ ........ 78%  216M 0s
221184K ........ ........ ........ ........ ........ ........ 79%  213M 0s
224256K ........ ........ ........ ........ ........ ........ 80%  207M 0s
227328K ........ ........ ........ ........ ........ ........ 81%  211M 0s
230400K ........ ........ ........ ........ ........ ........ 82%  205M 0s
233472K ........ ........ ........ ........ ........ ........ 83%  201M 0s
236544K ........ ........ ........ ........ ........ ........ 84%  198M 0s
239616K ........ ........ ........ ........ ........ ........ 85%  193M 0s
242688K ........ ........ ........ ........ ........ ........ 86%  218M 0s
245760K ........ ........ ........ ........ ........ ........ 88%  197M 0s
248832K ........ ........ ........ ........ ........ ........ 89%  203M 0s
251904K ........ ........ ........ ........ ........ ........ 90%  201M 0s
254976K ........ ........ ........ ........ ........ ........ 91%  211M 0s
258048K ........ ........ ........ ........ ........ ........ 92%  201M 0s
261120K ........ ........ ........ ........ ........ ........ 93%  215M 0s
264192K ........ ........ ........ ........ ........ ........ 94%  195M 0s
267264K ........ ........ ........ ........ ........ ........ 95%  211M 0s
270336K ........ ........ ........ ........ ........ ........ 96%  210M 0s
273408K ........ ........ ........ ........ ........ ........ 97%  215M 0s
276480K ........ ........ ........ ........ ........ ........ 98%  204M 0s
279552K ........ ........ ........ ........ ........ ........ 99%  199M 0s
282624K ..                                                   100%  285M=1.4s

2024-04-20 23:48:11 (204 MB/s) - ‘karaf-0.20.1-20240418.235143-1.zip’ saved [289547889/289547889]

Extracting the new controller...
+ echo 'Extracting the new controller...'
+ unzip -q karaf-0.20.1-20240418.235143-1.zip
Adding external repositories...
+ echo 'Adding external repositories...'
+ sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.20.1-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
+ cat /tmp/karaf-0.20.1-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
################################################################################
#
#    Licensed to the Apache Software Foundation (ASF) under one or more
#    contributor license agreements.  See the NOTICE file distributed with
#    this work for additional information regarding copyright ownership.
#    The ASF licenses this file to You under the Apache License, Version 2.0
#    (the "License"); you may not use this file except in compliance with
#    the License.  You may obtain a copy of the License at
#
#       http://www.apache.org/licenses/LICENSE-2.0
#
#    Unless required by applicable law or agreed to in writing, software
#    distributed under the License is distributed on an "AS IS" BASIS,
#    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
#    See the License for the specific language governing permissions and
#    limitations under the License.
#
################################################################################

#
# If set to true, the following property will not allow any certificate to be used
# when accessing Maven repositories through SSL
#
#org.ops4j.pax.url.mvn.certificateCheck=

#
# Path to the local Maven settings file.
# The repositories defined in this file will be automatically added to the list
# of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property
# below is not set.
# The following locations are checked for the existence of the settings.xml file
#   * 1. looks for the specified url
#   * 2. if not found looks for ${user.home}/.m2/settings.xml
#   * 3. if not found looks for ${maven.home}/conf/settings.xml
#   * 4. if not found looks for ${M2_HOME}/conf/settings.xml
#
#org.ops4j.pax.url.mvn.settings=

#
# Path to the local Maven repository which is used to avoid downloading
# artifacts when they already exist locally.
# The value of this property will be extracted from the settings.xml file
# above, or defaulted to:
#     System.getProperty( "user.home" ) + "/.m2/repository"
#
org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository}

#
# Default this to false. It's just weird to use undocumented repos
#
org.ops4j.pax.url.mvn.useFallbackRepositories=false

#
# Uncomment if you don't wanna use the proxy settings
# from the Maven conf/settings.xml file
#
# org.ops4j.pax.url.mvn.proxySupport=false

#
# Comma separated list of repositories scanned when resolving an artifact.
# Those repositories will be checked before iterating through the
#    below list of repositories and even before the local repository
# A repository url can be appended with zero or more of the following flags:
#    @snapshots  : the repository contains snaphots
#    @noreleases : the repository does not contain any released artifacts
#
# The following property value will add the system folder as a repo.
#
org.ops4j.pax.url.mvn.defaultRepositories=\
    file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\
    file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\
    file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots

# Use the default local repo (e.g.~/.m2/repository) as a "remote" repo
#org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false

#
# Comma separated list of repositories scanned when resolving an artifact.
# The default list includes the following repositories:
#    http://repo1.maven.org/maven2@id=central
#    http://repository.springsource.com/maven/bundles/release@id=spring.ebr
#    http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external
#    http://zodiac.springsource.com/maven/bundles/release@id=gemini
#    http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases
#    https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases
#    https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
# To add repositories to the default ones, prepend '+' to the list of repositories
# to add.
# A repository url can be appended with zero or more of the following flags:
#    @snapshots  : the repository contains snapshots
#    @noreleases : the repository does not contain any released artifacts
#    @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended
#
org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases

### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.Configuring the startup features...
+ [[ True == \T\r\u\e ]]
+ echo 'Configuring the startup features...'
+ sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.20.1-SNAPSHOT/etc/org.apache.karaf.features.cfg
+ FEATURE_TEST_STRING=features-test
+ FEATURE_TEST_VERSION=0.20.1-SNAPSHOT
+ KARAF_VERSION=karaf4
+ [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]]
+ sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.20.1-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.20.1-SNAPSHOT/etc/org.apache.karaf.features.cfg
+ [[ ! -z '' ]]
+ cat /tmp/karaf-0.20.1-SNAPSHOT/etc/org.apache.karaf.features.cfg
################################################################################
#
#    Licensed to the Apache Software Foundation (ASF) under one or more
#    contributor license agreements.  See the NOTICE file distributed with
#    this work for additional information regarding copyright ownership.
#    The ASF licenses this file to You under the Apache License, Version 2.0
#    (the "License"); you may not use this file except in compliance with
#    the License.  You may obtain a copy of the License at
#
#       http://www.apache.org/licenses/LICENSE-2.0
#
#    Unless required by applicable law or agreed to in writing, software
#    distributed under the License is distributed on an "AS IS" BASIS,
#    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
#    See the License for the specific language governing permissions and
#    limitations under the License.
#
################################################################################

#
# Comma separated list of features repositories to register by default
#
featuresRepositories = mvn:org.opendaylight.integration/features-test/0.20.1-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/f672b964-93a9-490b-99c4-29d2472ec2ef.xml

#
# Comma separated list of features to install at startup
#
featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, eadc6530-6f9b-43f4-8562-a6b121b5b3a3

#
# Resource repositories (OBR) that the features resolver can use
# to resolve requirements/capabilities
#
# The format of the resourceRepositories is 
# resourceRepositories=[xml:url|json:url],...
# for Instance:
#
#resourceRepositories=xml:http://host/path/to/index.xml
# or
#resourceRepositories=json:http://host/path/to/index.json
#

#
# Defines if the boot features are started in asynchronous mode (in a dedicated thread)
#
featuresBootAsynchronous=false

#
# Service requirements enforcement
#
# By default, the feature resolver checks the service requirements/capabilities of
# bundles for new features (xml schema >= 1.3.0) in order to automatically installs
# the required bundles.
# The following flag can have those values:
#   - disable: service requirements are completely ignored
#   - default: service requirements are ignored for old features
#   - enforce: service requirements are always verified
#
#serviceRequirements=default

#
# Store cfg file for config element in feature
#
#configCfgStore=true

#
# Define if the feature service automatically refresh bundles
#
autoRefresh=true

#
# Configuration of features processing mechanism (overrides, blacklisting, modification of features)
# XML file defines instructions related to features processing
# versions.properties may declare properties to resolve placeholders in XML file
# both files are relative to ${karaf.etc}
#
#featureProcessing=org.apache.karaf.features.xml
#featureProcessingVersions=versions.properties
+ configure_karaf_log karaf4 ''
+ local -r karaf_version=karaf4
+ local -r controllerdebugmap=
+ local logapi=log4j
+ grep log4j2 /tmp/karaf-0.20.1-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
log4j2.rootLogger.level = INFO
#log4j2.rootLogger.type = asyncRoot
#log4j2.rootLogger.includeLocation = false
log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
log4j2.rootLogger.appenderRef.Console.ref = Console
log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
log4j2.logger.spifly.name = org.apache.aries.spifly
log4j2.logger.spifly.level = WARN
log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
log4j2.logger.audit.level = INFO
log4j2.logger.audit.additivity = false
log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
# Console appender not used by default (see log4j2.rootLogger.appenderRefs)
log4j2.appender.console.type = Console
log4j2.appender.console.name = Console
log4j2.appender.console.layout.type = PatternLayout
log4j2.appender.console.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.type = RollingRandomAccessFile
log4j2.appender.rolling.name = RollingFile
log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
#log4j2.appender.rolling.immediateFlush = false
log4j2.appender.rolling.append = true
log4j2.appender.rolling.layout.type = PatternLayout
log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.policies.type = Policies
log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.rolling.policies.size.size = 64MB
log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
log4j2.appender.rolling.strategy.max = 7
log4j2.appender.audit.type = RollingRandomAccessFile
log4j2.appender.audit.name = AuditRollingFile
log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
log4j2.appender.audit.append = true
log4j2.appender.audit.layout.type = PatternLayout
log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
log4j2.appender.audit.policies.type = Policies
log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.audit.policies.size.size = 8MB
log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
log4j2.appender.audit.strategy.max = 7
log4j2.appender.osgi.type = PaxOsgi
log4j2.appender.osgi.name = PaxOsgi
log4j2.appender.osgi.filter = *
#log4j2.logger.aether.name = shaded.org.eclipse.aether
#log4j2.logger.aether.level = TRACE
#log4j2.logger.http-headers.name = shaded.org.apache.http.headers
#log4j2.logger.http-headers.level = DEBUG
#log4j2.logger.maven.name = org.ops4j.pax.url.mvn
#log4j2.logger.maven.level = TRACE
+ logapi=log4j2
+ echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2'
Configuring the karaf log... karaf_version: karaf4, logapi: log4j2
+ '[' log4j2 == log4j2 ']'
+ sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.20.1-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
+ orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver
+ orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver
+ echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN'
controllerdebugmap: 
cat /tmp/karaf-0.20.1-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
+ echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN'
+ unset IFS
+ echo 'controllerdebugmap: '
+ '[' -n '' ']'
+ echo 'cat /tmp/karaf-0.20.1-SNAPSHOT/etc/org.ops4j.pax.logging.cfg'
+ cat /tmp/karaf-0.20.1-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
################################################################################
#
#    Licensed to the Apache Software Foundation (ASF) under one or more
#    contributor license agreements.  See the NOTICE file distributed with
#    this work for additional information regarding copyright ownership.
#    The ASF licenses this file to You under the Apache License, Version 2.0
#    (the "License"); you may not use this file except in compliance with
#    the License.  You may obtain a copy of the License at
#
#       http://www.apache.org/licenses/LICENSE-2.0
#
#    Unless required by applicable law or agreed to in writing, software
#    distributed under the License is distributed on an "AS IS" BASIS,
#    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
#    See the License for the specific language governing permissions and
#    limitations under the License.
#
################################################################################

# Common pattern layout for appenders
log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n

# Root logger
log4j2.rootLogger.level = INFO
# uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library
#log4j2.rootLogger.type = asyncRoot
#log4j2.rootLogger.includeLocation = false
log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
log4j2.rootLogger.appenderRef.Console.ref = Console
log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}

# Filters for logs marked by org.opendaylight.odlparent.Markers
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL

# Loggers configuration

# Spifly logger
log4j2.logger.spifly.name = org.apache.aries.spifly
log4j2.logger.spifly.level = WARN

# Security audit logger
log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
log4j2.logger.audit.level = INFO
log4j2.logger.audit.additivity = false
log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile

# Appenders configuration

# Console appender not used by default (see log4j2.rootLogger.appenderRefs)
log4j2.appender.console.type = Console
log4j2.appender.console.name = Console
log4j2.appender.console.layout.type = PatternLayout
log4j2.appender.console.layout.pattern = ${log4j2.pattern}

# Rolling file appender
log4j2.appender.rolling.type = RollingRandomAccessFile
log4j2.appender.rolling.name = RollingFile
log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
# uncomment to not force a disk flush
#log4j2.appender.rolling.immediateFlush = false
log4j2.appender.rolling.append = true
log4j2.appender.rolling.layout.type = PatternLayout
log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.policies.type = Policies
log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.rolling.policies.size.size = 1GB
log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
log4j2.appender.rolling.strategy.max = 7

# Audit file appender
log4j2.appender.audit.type = RollingRandomAccessFile
log4j2.appender.audit.name = AuditRollingFile
log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
log4j2.appender.audit.append = true
log4j2.appender.audit.layout.type = PatternLayout
log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
log4j2.appender.audit.policies.type = Policies
log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.audit.policies.size.size = 8MB
log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
log4j2.appender.audit.strategy.max = 7

# OSGi appender
log4j2.appender.osgi.type = PaxOsgi
log4j2.appender.osgi.name = PaxOsgi
log4j2.appender.osgi.filter = *

# help with identification of maven-related problems with pax-url-aether
#log4j2.logger.aether.name = shaded.org.eclipse.aether
#log4j2.logger.aether.level = TRACE
#log4j2.logger.http-headers.name = shaded.org.apache.http.headers
#log4j2.logger.http-headers.level = DEBUG
#log4j2.logger.maven.name = org.ops4j.pax.url.mvn
#log4j2.logger.maven.level = TRACE
log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN
log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN
+ set_java_vars /usr/lib/jvm/java-17-openjdk 3072m /tmp/karaf-0.20.1-SNAPSHOT/bin/setenv
+ local -r java_home=/usr/lib/jvm/java-17-openjdk
+ local -r controllermem=3072m
+ local -r memconf=/tmp/karaf-0.20.1-SNAPSHOT/bin/setenv
Configure
    java home: /usr/lib/jvm/java-17-openjdk
    max memory: 3072m
    memconf: /tmp/karaf-0.20.1-SNAPSHOT/bin/setenv
+ echo Configure
+ echo '    java home: /usr/lib/jvm/java-17-openjdk'
+ echo '    max memory: 3072m'
+ echo '    memconf: /tmp/karaf-0.20.1-SNAPSHOT/bin/setenv'
+ sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk}%g' /tmp/karaf-0.20.1-SNAPSHOT/bin/setenv
+ sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.20.1-SNAPSHOT/bin/setenv
cat /tmp/karaf-0.20.1-SNAPSHOT/bin/setenv
+ echo 'cat /tmp/karaf-0.20.1-SNAPSHOT/bin/setenv'
+ cat /tmp/karaf-0.20.1-SNAPSHOT/bin/setenv
#!/bin/sh
#
#    Licensed to the Apache Software Foundation (ASF) under one or more
#    contributor license agreements.  See the NOTICE file distributed with
#    this work for additional information regarding copyright ownership.
#    The ASF licenses this file to You under the Apache License, Version 2.0
#    (the "License"); you may not use this file except in compliance with
#    the License.  You may obtain a copy of the License at
#
#       http://www.apache.org/licenses/LICENSE-2.0
#
#    Unless required by applicable law or agreed to in writing, software
#    distributed under the License is distributed on an "AS IS" BASIS,
#    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
#    See the License for the specific language governing permissions and
#    limitations under the License.
#

#
# handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf
# script: client, instance, shell, start, status, stop, karaf
#
# if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then
#   Actions go here...
# fi

#
# general settings which should be applied for all scripts go here; please keep
# in mind that it is possible that scripts might be executed more than once, e.g.
# in example of the start script where the start script is executed first and the
# karaf script afterwards.
#

#
# The following section shows the possible configuration options for the default 
# karaf scripts
#
export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk} # Location of Java installation
# export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration
# export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options
# export EXTRA_JAVA_OPTS # Additional JVM options
# export KARAF_HOME # Karaf home folder
# export KARAF_DATA # Karaf data folder
# export KARAF_BASE # Karaf base folder
# export KARAF_ETC  # Karaf etc  folder
# export KARAF_LOG  # Karaf log  folder
# export KARAF_SYSTEM_OPTS # First citizen Karaf options
# export KARAF_OPTS # Additional available Karaf options
# export KARAF_DEBUG # Enable debug mode
# export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start
# export KARAF_NOROOT # Prevent execution as root if set to true
+ echo 'Set Java version'
Set Java version
+ sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-17-openjdk/bin/java 1
+ sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-17-openjdk/bin/java
JDK default version ...
+ echo 'JDK default version ...'
+ java -version
openjdk version "17.0.6-ea" 2023-01-17 LTS
OpenJDK Runtime Environment (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS)
OpenJDK 64-Bit Server VM (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS, mixed mode, sharing)
Set JAVA_HOME
+ echo 'Set JAVA_HOME'
+ export JAVA_HOME=/usr/lib/jvm/java-17-openjdk
+ JAVA_HOME=/usr/lib/jvm/java-17-openjdk
++ readlink -e /usr/lib/jvm/java-17-openjdk/bin/java
Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java
+ JAVA_RESOLVED=/usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java
+ echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java'
Listing all open ports on controller system...
+ echo 'Listing all open ports on controller system...'
+ netstat -pnatu
(Not all processes could be identified, non-owned process info
 will not be shown, you would have to be root to see it all.)
Active Internet connections (servers and established)
Proto Recv-Q Send-Q Local Address           Foreign Address         State       PID/Program name    
tcp        0      0 0.0.0.0:111             0.0.0.0:*               LISTEN      -                   
tcp        0      0 0.0.0.0:22              0.0.0.0:*               LISTEN      -                   
tcp        0    164 10.30.171.45:22         10.30.170.150:35166     ESTABLISHED -                   
tcp        0      0 10.30.171.45:55108      199.204.45.87:443       TIME_WAIT   -                   
tcp6       0      0 :::111                  :::*                    LISTEN      -                   
tcp6       0      0 :::5555                 :::*                    LISTEN      -                   
tcp6       0      0 :::22                   :::*                    LISTEN      -                   
udp        0      0 10.30.171.45:68         10.30.170.3:67          ESTABLISHED -                   
udp        0      0 0.0.0.0:111             0.0.0.0:*                           -                   
udp        0      0 127.0.0.1:323           0.0.0.0:*                           -                   
udp6       0      0 :::111                  :::*                                -                   
udp6       0      0 ::1:323                 :::*                                -                   
+ '[' -f /tmp/custom_shard_config.txt ']'
Custom shard config exists!!!
Copying the shard config...
+ echo 'Custom shard config exists!!!'
+ echo 'Copying the shard config...'
+ cp /tmp/custom_shard_config.txt /tmp/karaf-0.20.1-SNAPSHOT/bin/
Configuring cluster
+ echo 'Configuring cluster'
+ /tmp/karaf-0.20.1-SNAPSHOT/bin/configure_cluster.sh 3 10.30.171.102 10.30.171.170 10.30.171.45
################################################
##             Configure Cluster              ##
################################################
 NOTE: Cluster configuration files not found. Copying from
 /tmp/karaf-0.20.1-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/9.0.2
Configuring unique name in akka.conf
Configuring hostname in akka.conf
Configuring data and rpc seed nodes in akka.conf
modules = [
	
	{
		name = "inventory"
		namespace = "urn:opendaylight:inventory"
		shard-strategy = "module"
	},
	{
		name = "topology"
		namespace = "urn:TBD:params:xml:ns:yang:network-topology"
		shard-strategy = "module"
	},
	{
		name = "toaster"
		namespace = "http://netconfcentral.org/ns/toaster"
		shard-strategy = "module"
	},
	{
		name = "car"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
		shard-strategy = "module"
	},
	{
		name = "people"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
		shard-strategy = "module"
	},
	{
		name = "car-people"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
		shard-strategy = "module"
	}
]
Configuring replication type in module-shards.conf
################################################
##   NOTE: Manually restart controller to     ##
##         apply configuration.               ##
################################################
Dump akka.conf
+ echo 'Dump akka.conf'
+ cat /tmp/karaf-0.20.1-SNAPSHOT/configuration/initial/akka.conf

odl-cluster-data {
  akka {
    remote {
      artery {
        enabled = on
        transport = tcp
        canonical.hostname = "10.30.171.45"
        canonical.port = 2550
      }
    }

    cluster {
      # Using artery.
      seed-nodes = ["akka://opendaylight-cluster-data@10.30.171.102:2550",
				"akka://opendaylight-cluster-data@10.30.171.170:2550",
				"akka://opendaylight-cluster-data@10.30.171.45:2550"]

      roles = ["member-3"]

      # when under load we might trip a false positive on the failure detector
      # failure-detector {
        # heartbeat-interval = 4 s
        # acceptable-heartbeat-pause = 16s
      # }
    }

    persistence {
      # By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by
      # modifying the following two properties. The directory location specified may be a relative or absolute path. 
      # The relative path is always relative to KARAF_HOME.

      # snapshot-store.local.dir = "target/snapshots"

      # Use lz4 compression for LocalSnapshotStore snapshots
      snapshot-store.local.use-lz4-compression = false
      # Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB
      snapshot-store.local.lz4-blocksize = 256KB
    }
    disable-default-actor-system-quarantined-event-handling = "false"
  }
}
Dump modules.conf
+ echo 'Dump modules.conf'
+ cat /tmp/karaf-0.20.1-SNAPSHOT/configuration/initial/modules.conf
modules = [
	
	{
		name = "inventory"
		namespace = "urn:opendaylight:inventory"
		shard-strategy = "module"
	},
	{
		name = "topology"
		namespace = "urn:TBD:params:xml:ns:yang:network-topology"
		shard-strategy = "module"
	},
	{
		name = "toaster"
		namespace = "http://netconfcentral.org/ns/toaster"
		shard-strategy = "module"
	},
	{
		name = "car"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
		shard-strategy = "module"
	},
	{
		name = "people"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
		shard-strategy = "module"
	},
	{
		name = "car-people"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
		shard-strategy = "module"
	}
]
Dump module-shards.conf
+ echo 'Dump module-shards.conf'
+ cat /tmp/karaf-0.20.1-SNAPSHOT/configuration/initial/module-shards.conf
module-shards = [
	{
		name = "default"
		shards = [
			{
				name = "default"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "inventory"
		shards = [
			{
				name="inventory"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "topology"
		shards = [
			{
				name="topology"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "toaster"
		shards = [
			{
				name="toaster"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "car"
		shards = [
			{
				name="car"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "people"
		shards = [
			{
				name="people"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "car-people"
		shards = [
			{
				name="car-people"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	}
]
Locating config plan to use...
Finished running config plans
Starting member-1 with IP address 10.30.171.102
Warning: Permanently added '10.30.171.102' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.171.102' (ECDSA) to the list of known hosts.
Redirecting karaf console output to karaf_console.log
Starting controller...
start: Redirecting Karaf output to /tmp/karaf-0.20.1-SNAPSHOT/data/log/karaf_console.log
Starting member-2 with IP address 10.30.171.170
Warning: Permanently added '10.30.171.170' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.171.170' (ECDSA) to the list of known hosts.
Redirecting karaf console output to karaf_console.log
Starting controller...
start: Redirecting Karaf output to /tmp/karaf-0.20.1-SNAPSHOT/data/log/karaf_console.log
Starting member-3 with IP address 10.30.171.45
Warning: Permanently added '10.30.171.45' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.171.45' (ECDSA) to the list of known hosts.
Redirecting karaf console output to karaf_console.log
Starting controller...
start: Redirecting Karaf output to /tmp/karaf-0.20.1-SNAPSHOT/data/log/karaf_console.log
[controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash /tmp/jenkins10995275229769818082.sh
common-functions.sh is being sourced
common-functions environment:
MAVENCONF: /tmp/karaf-0.20.1-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
ACTUALFEATURES: 
FEATURESCONF: /tmp/karaf-0.20.1-SNAPSHOT/etc/org.apache.karaf.features.cfg
CUSTOMPROP: /tmp/karaf-0.20.1-SNAPSHOT/etc/custom.properties
LOGCONF: /tmp/karaf-0.20.1-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
MEMCONF: /tmp/karaf-0.20.1-SNAPSHOT/bin/setenv
CONTROLLERMEM: 2048m
AKKACONF: /tmp/karaf-0.20.1-SNAPSHOT/configuration/initial/akka.conf
MODULESCONF: /tmp/karaf-0.20.1-SNAPSHOT/configuration/initial/modules.conf
MODULESHARDSCONF: /tmp/karaf-0.20.1-SNAPSHOT/configuration/initial/module-shards.conf
SUITES: 

+ echo '#################################################'
#################################################
+ echo '##         Verify Cluster is UP                ##'
##         Verify Cluster is UP                ##
+ echo '#################################################'
#################################################
+ create_post_startup_script
+ cat
+ copy_and_run_post_startup_script
+ seed_index=1
++ seq 1 3
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_1_IP
+ echo 'Execute the post startup script on controller 10.30.171.102'
Execute the post startup script on controller 10.30.171.102
+ scp /w/workspace/controller-csit-3node-clustering-ask-all-calcium/post-startup-script.sh 10.30.171.102:/tmp/
Warning: Permanently added '10.30.171.102' (ECDSA) to the list of known hosts.
+ ssh 10.30.171.102 'bash /tmp/post-startup-script.sh 1'
Warning: Permanently added '10.30.171.102' (ECDSA) to the list of known hosts.
tcp6       0      0 :::8101                 :::*                    LISTEN     
Waiting up to 3 minutes for controller to come up, checking every 5 seconds...
2024-04-20T23:49:14,126 | INFO  | SystemReadyService-0 | SimpleSystemReadyMonitor         | 300 - org.opendaylight.infrautils.ready-api - 6.0.6 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
Controller is UP
2024-04-20T23:49:14,126 | INFO  | SystemReadyService-0 | SimpleSystemReadyMonitor         | 300 - org.opendaylight.infrautils.ready-api - 6.0.6 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
Listing all open ports on controller system...
(Not all processes could be identified, non-owned process info
 will not be shown, you would have to be root to see it all.)
Active Internet connections (servers and established)
Proto Recv-Q Send-Q Local Address           Foreign Address         State       PID/Program name    
tcp        0      0 0.0.0.0:111             0.0.0.0:*               LISTEN      -                   
tcp        0      0 0.0.0.0:22              0.0.0.0:*               LISTEN      -                   
tcp        0      0 10.30.171.102:22        10.30.170.150:42690     ESTABLISHED -                   
tcp6       0      0 :::6633                 :::*                    LISTEN      5760/java           
tcp6       0      0 127.0.0.1:1099          :::*                    LISTEN      5760/java           
tcp6       0      0 127.0.0.1:42221         :::*                    LISTEN      5760/java           
tcp6       0      0 :::111                  :::*                    LISTEN      -                   
tcp6       0      0 :::6640                 :::*                    LISTEN      5760/java           
tcp6       0      0 :::5555                 :::*                    LISTEN      -                   
tcp6       0      0 :::8181                 :::*                    LISTEN      5760/java           
tcp6       0      0 10.30.171.102:2550      :::*                    LISTEN      5760/java           
tcp6       0      0 :::22                   :::*                    LISTEN      -                   
tcp6       0      0 127.0.0.1:44444         :::*                    LISTEN      5760/java           
tcp6       0      0 :::6653                 :::*                    LISTEN      5760/java           
tcp6       0      0 :::4189                 :::*                    LISTEN      5760/java           
tcp6       0      0 :::1790                 :::*                    LISTEN      5760/java           
tcp6       0      0 :::8101                 :::*                    LISTEN      5760/java           
tcp6       0      0 127.0.0.1:47174         127.0.0.1:44444         TIME_WAIT   -                   
tcp6       0      0 10.30.171.102:2550      10.30.171.45:50728      ESTABLISHED 5760/java           
tcp6       0      0 10.30.171.102:2550      10.30.171.45:50726      ESTABLISHED 5760/java           
tcp6       0      0 127.0.0.1:47190         127.0.0.1:44444         TIME_WAIT   -                   
tcp6       0      0 10.30.171.102:59108     10.30.171.45:2550       ESTABLISHED 5760/java           
tcp6       0      0 10.30.171.102:2550      10.30.171.170:34746     ESTABLISHED 5760/java           
tcp6       0      0 10.30.171.102:59752     10.30.171.170:2550      ESTABLISHED 5760/java           
tcp6      32      0 10.30.171.102:44382     199.204.45.87:443       CLOSE_WAIT  5760/java           
tcp6       0      0 10.30.171.102:2550      10.30.171.170:34744     ESTABLISHED 5760/java           
tcp6       0      0 10.30.171.102:59092     10.30.171.45:2550       ESTABLISHED 5760/java           
tcp6       0      0 10.30.171.102:59756     10.30.171.170:2550      ESTABLISHED 5760/java           
tcp6       0      0 127.0.0.1:52764         127.0.0.1:1099          TIME_WAIT   -                   
udp        0      0 10.30.171.102:68        10.30.170.2:67          ESTABLISHED -                   
udp        0      0 0.0.0.0:111             0.0.0.0:*                           -                   
udp        0      0 127.0.0.1:323           0.0.0.0:*                           -                   
udp6       0      0 :::111                  :::*                                -                   
udp6       0      0 ::1:323                 :::*                                -                   
udp6       0      0 :::4342                 :::*                                5760/java           
looking for "BindException: Address already in use" in log file
looking for "server is unhealthy" in log file
+ '[' 1 == 0 ']'
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_2_IP
+ echo 'Execute the post startup script on controller 10.30.171.170'
Execute the post startup script on controller 10.30.171.170
+ scp /w/workspace/controller-csit-3node-clustering-ask-all-calcium/post-startup-script.sh 10.30.171.170:/tmp/
Warning: Permanently added '10.30.171.170' (ECDSA) to the list of known hosts.
+ ssh 10.30.171.170 'bash /tmp/post-startup-script.sh 2'
Warning: Permanently added '10.30.171.170' (ECDSA) to the list of known hosts.
tcp6       0      0 :::8101                 :::*                    LISTEN     
Waiting up to 3 minutes for controller to come up, checking every 5 seconds...
2024-04-20T23:49:13,167 | INFO  | SystemReadyService-0 | SimpleSystemReadyMonitor         | 300 - org.opendaylight.infrautils.ready-api - 6.0.6 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
Controller is UP
2024-04-20T23:49:13,167 | INFO  | SystemReadyService-0 | SimpleSystemReadyMonitor         | 300 - org.opendaylight.infrautils.ready-api - 6.0.6 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
Listing all open ports on controller system...
(Not all processes could be identified, non-owned process info
 will not be shown, you would have to be root to see it all.)
Active Internet connections (servers and established)
Proto Recv-Q Send-Q Local Address           Foreign Address         State       PID/Program name    
tcp        0      0 0.0.0.0:111             0.0.0.0:*               LISTEN      -                   
tcp        0      0 0.0.0.0:22              0.0.0.0:*               LISTEN      -                   
tcp        0      0 10.30.171.170:22        10.30.170.150:43332     ESTABLISHED -                   
tcp6       0      0 127.0.0.1:44444         :::*                    LISTEN      5753/java           
tcp6       0      0 :::6653                 :::*                    LISTEN      5753/java           
tcp6       0      0 :::1790                 :::*                    LISTEN      5753/java           
tcp6       0      0 :::8101                 :::*                    LISTEN      5753/java           
tcp6       0      0 127.0.0.1:43495         :::*                    LISTEN      5753/java           
tcp6       0      0 :::6633                 :::*                    LISTEN      5753/java           
tcp6       0      0 127.0.0.1:1099          :::*                    LISTEN      5753/java           
tcp6       0      0 :::111                  :::*                    LISTEN      -                   
tcp6       0      0 :::6640                 :::*                    LISTEN      5753/java           
tcp6       0      0 :::5555                 :::*                    LISTEN      -                   
tcp6       0      0 :::8181                 :::*                    LISTEN      5753/java           
tcp6       0      0 10.30.171.170:2550      :::*                    LISTEN      5753/java           
tcp6       0      0 :::22                   :::*                    LISTEN      -                   
tcp6       0      0 10.30.171.170:51068     10.30.171.45:2550       ESTABLISHED 5753/java           
tcp6       0      0 127.0.0.1:47382         127.0.0.1:1099          TIME_WAIT   -                   
tcp6       0      0 10.30.171.170:51082     10.30.171.45:2550       ESTABLISHED 5753/java           
tcp6       0      0 127.0.0.1:50702         127.0.0.1:44444         TIME_WAIT   -                   
tcp6       0      0 127.0.0.1:47370         127.0.0.1:1099          TIME_WAIT   -                   
tcp6       0      0 10.30.171.170:34744     10.30.171.102:2550      ESTABLISHED 5753/java           
tcp6       0      0 10.30.171.170:2550      10.30.171.45:49236      ESTABLISHED 5753/java           
tcp6      32      0 10.30.171.170:45136     199.204.45.87:443       CLOSE_WAIT  5753/java           
tcp6       0      0 10.30.171.170:2550      10.30.171.102:59756     ESTABLISHED 5753/java           
tcp6       0      0 10.30.171.170:34746     10.30.171.102:2550      ESTABLISHED 5753/java           
tcp6       0      0 127.0.0.1:41998         127.0.0.1:44444         TIME_WAIT   -                   
tcp6       0      0 10.30.171.170:2550      10.30.171.102:59752     ESTABLISHED 5753/java           
tcp6       0      0 10.30.171.170:2550      10.30.171.45:49244      ESTABLISHED 5753/java           
udp        0      0 10.30.171.170:68        10.30.170.3:67          ESTABLISHED -                   
udp        0      0 0.0.0.0:111             0.0.0.0:*                           -                   
udp        0      0 127.0.0.1:323           0.0.0.0:*                           -                   
udp6       0      0 :::111                  :::*                                -                   
udp6       0      0 ::1:323                 :::*                                -                   
udp6       0      0 :::4342                 :::*                                5753/java           
looking for "BindException: Address already in use" in log file
looking for "server is unhealthy" in log file
+ '[' 2 == 0 ']'
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_3_IP
+ echo 'Execute the post startup script on controller 10.30.171.45'
Execute the post startup script on controller 10.30.171.45
+ scp /w/workspace/controller-csit-3node-clustering-ask-all-calcium/post-startup-script.sh 10.30.171.45:/tmp/
Warning: Permanently added '10.30.171.45' (ECDSA) to the list of known hosts.
+ ssh 10.30.171.45 'bash /tmp/post-startup-script.sh 3'
Warning: Permanently added '10.30.171.45' (ECDSA) to the list of known hosts.
tcp6       0      0 :::8101                 :::*                    LISTEN     
Waiting up to 3 minutes for controller to come up, checking every 5 seconds...
2024-04-20T23:49:12,690 | INFO  | SystemReadyService-0 | SimpleSystemReadyMonitor         | 300 - org.opendaylight.infrautils.ready-api - 6.0.6 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
Controller is UP
2024-04-20T23:49:12,690 | INFO  | SystemReadyService-0 | SimpleSystemReadyMonitor         | 300 - org.opendaylight.infrautils.ready-api - 6.0.6 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
Listing all open ports on controller system...
(Not all processes could be identified, non-owned process info
 will not be shown, you would have to be root to see it all.)
Active Internet connections (servers and established)
Proto Recv-Q Send-Q Local Address           Foreign Address         State       PID/Program name    
tcp        0      0 0.0.0.0:111             0.0.0.0:*               LISTEN      -                   
tcp        0      0 0.0.0.0:22              0.0.0.0:*               LISTEN      -                   
tcp        0      0 10.30.171.45:22         10.30.170.150:57480     ESTABLISHED -                   
tcp6       0      0 :::12345                :::*                    LISTEN      5760/java           
tcp6       0      0 127.0.0.1:44444         :::*                    LISTEN      5760/java           
tcp6       0      0 :::6653                 :::*                    LISTEN      5760/java           
tcp6       0      0 :::1790                 :::*                    LISTEN      5760/java           
tcp6       0      0 :::8101                 :::*                    LISTEN      5760/java           
tcp6       0      0 :::6633                 :::*                    LISTEN      5760/java           
tcp6       0      0 127.0.0.1:40745         :::*                    LISTEN      5760/java           
tcp6       0      0 127.0.0.1:1099          :::*                    LISTEN      5760/java           
tcp6       0      0 :::111                  :::*                    LISTEN      -                   
tcp6       0      0 :::6640                 :::*                    LISTEN      5760/java           
tcp6       0      0 :::5555                 :::*                    LISTEN      -                   
tcp6       0      0 :::8181                 :::*                    LISTEN      5760/java           
tcp6       0      0 10.30.171.45:2550       :::*                    LISTEN      5760/java           
tcp6       0      0 :::22                   :::*                    LISTEN      -                   
tcp6       0      0 10.30.171.45:50728      10.30.171.102:2550      ESTABLISHED 5760/java           
tcp6      32      0 10.30.171.45:46984      199.204.45.87:443       CLOSE_WAIT  5760/java           
tcp6       0      0 10.30.171.45:50726      10.30.171.102:2550      ESTABLISHED 5760/java           
tcp6       0      0 10.30.171.45:49236      10.30.171.170:2550      ESTABLISHED 5760/java           
tcp6       0      0 10.30.171.45:2550       10.30.171.102:59092     ESTABLISHED 5760/java           
tcp6       0      0 10.30.171.45:2550       10.30.171.170:51082     ESTABLISHED 5760/java           
tcp6       0      0 127.0.0.1:59512         127.0.0.1:1099          TIME_WAIT   -                   
tcp6       0      0 127.0.0.1:36858         127.0.0.1:44444         TIME_WAIT   -                   
tcp6       0      0 127.0.0.1:36866         127.0.0.1:44444         TIME_WAIT   -                   
tcp6       0      0 10.30.171.45:49244      10.30.171.170:2550      ESTABLISHED 5760/java           
tcp6       0      0 10.30.171.45:2550       10.30.171.102:59108     ESTABLISHED 5760/java           
tcp6       0      0 10.30.171.45:2550       10.30.171.170:51068     ESTABLISHED 5760/java           
udp        0      0 10.30.171.45:68         10.30.170.3:67          ESTABLISHED -                   
udp        0      0 0.0.0.0:111             0.0.0.0:*                           -                   
udp        0      0 127.0.0.1:323           0.0.0.0:*                           -                   
udp6       0      0 :::4342                 :::*                                5760/java           
udp6       0      0 :::111                  :::*                                -                   
udp6       0      0 ::1:323                 :::*                                -                   
looking for "BindException: Address already in use" in log file
looking for "server is unhealthy" in log file
+ '[' 0 == 0 ']'
+ seed_index=1
+ dump_controller_threads
++ seq 1 3
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_1_IP
+ echo 'Let'\''s take the karaf thread dump'
Let's take the karaf thread dump
+ ssh 10.30.171.102 'sudo ps aux'
Warning: Permanently added '10.30.171.102' (ECDSA) to the list of known hosts.
++ tr -s ' '
++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-ask-all-calcium/ps_before.log
++ cut -f2 '-d '
++ grep -v grep
+ pid=5760
+ echo 'karaf main: org.apache.karaf.main.Main, pid:5760'
karaf main: org.apache.karaf.main.Main, pid:5760
+ ssh 10.30.171.102 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 5760'
Warning: Permanently added '10.30.171.102' (ECDSA) to the list of known hosts.
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_2_IP
+ echo 'Let'\''s take the karaf thread dump'
Let's take the karaf thread dump
+ ssh 10.30.171.170 'sudo ps aux'
Warning: Permanently added '10.30.171.170' (ECDSA) to the list of known hosts.
++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-ask-all-calcium/ps_before.log
++ grep -v grep
++ tr -s ' '
++ cut -f2 '-d '
+ pid=5753
+ echo 'karaf main: org.apache.karaf.main.Main, pid:5753'
karaf main: org.apache.karaf.main.Main, pid:5753
+ ssh 10.30.171.170 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 5753'
Warning: Permanently added '10.30.171.170' (ECDSA) to the list of known hosts.
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_3_IP
+ echo 'Let'\''s take the karaf thread dump'
Let's take the karaf thread dump
+ ssh 10.30.171.45 'sudo ps aux'
Warning: Permanently added '10.30.171.45' (ECDSA) to the list of known hosts.
++ tr -s ' '
++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-ask-all-calcium/ps_before.log
++ cut -f2 '-d '
++ grep -v grep
+ pid=5760
+ echo 'karaf main: org.apache.karaf.main.Main, pid:5760'
karaf main: org.apache.karaf.main.Main, pid:5760
+ ssh 10.30.171.45 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 5760'
Warning: Permanently added '10.30.171.45' (ECDSA) to the list of known hosts.
+ '[' 0 -gt 0 ']'
+ echo 'Generating controller variables...'
Generating controller variables...
++ seq 1 3
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_1_IP
+ odl_variables=' -v ODL_SYSTEM_1_IP:10.30.171.102'
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_2_IP
+ odl_variables=' -v ODL_SYSTEM_1_IP:10.30.171.102 -v ODL_SYSTEM_2_IP:10.30.171.170'
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_3_IP
+ odl_variables=' -v ODL_SYSTEM_1_IP:10.30.171.102 -v ODL_SYSTEM_2_IP:10.30.171.170 -v ODL_SYSTEM_3_IP:10.30.171.45'
+ echo 'Generating mininet variables...'
Generating mininet variables...
++ seq 1 0
+ get_test_suites SUITES
+ local __suite_list=SUITES
+ echo 'Locating test plan to use...'
Locating test plan to use...
+ testplan_filepath=/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/testplans/controller-clustering-ask-calcium.txt
+ '[' '!' -f /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/testplans/controller-clustering-ask-calcium.txt ']'
+ testplan_filepath=/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/testplans/controller-clustering-ask.txt
+ '[' disabled '!=' disabled ']'
+ echo 'Changing the testplan path...'
Changing the testplan path...
+ sed s:integration:/w/workspace/controller-csit-3node-clustering-ask-all-calcium: /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/testplans/controller-clustering-ask.txt
+ cat testplan.txt
# Place the suites in run order:
/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot
/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence.robot
/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot
/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_partition_and_heal.robot
/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot
/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/action_provider_precedence.robot
/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot
/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/action_provider_partition_and_heal.robot
/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot
/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/master_stability.robot
/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot
/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot
/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot
/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot
/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot
/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_kill.robot
/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot
/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_freeze.robot
/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot
/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_isolate.robot
/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot
/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot
/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot
/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot
/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot
/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot
/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot
/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot
/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot
+ '[' -z '' ']'
++ grep -E -v '(^[[:space:]]*#|^[[:space:]]*$)' testplan.txt
++ tr '\012' ' '
+ suite_list='/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/action_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/action_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_kill.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_freeze.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot '
+ eval 'SUITES='\''/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/action_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/action_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_kill.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_freeze.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot '\'''
++ SUITES='/w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/action_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/action_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_kill.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_freeze.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot '
+ echo 'Starting Robot test suites /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/action_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/action_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_kill.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_freeze.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot  ...'
Starting Robot test suites /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/action_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/action_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_kill.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_freeze.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot  ...
+ robot -N controller-clustering-ask.txt --removekeywords wuks -e exclude -e skip_if_calcium -v BUNDLEFOLDER:karaf-0.20.1-SNAPSHOT -v BUNDLE_URL:https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.1-SNAPSHOT/karaf-0.20.1-20240418.235143-1.zip -v CONTROLLER:10.30.171.102 -v CONTROLLER1:10.30.171.170 -v CONTROLLER2:10.30.171.45 -v CONTROLLER_USER:jenkins -v JAVA_HOME:/usr/lib/jvm/java-17-openjdk -v JDKVERSION:openjdk17 -v JENKINS_WORKSPACE:/w/workspace/controller-csit-3node-clustering-ask-all-calcium -v MININET: -v MININET1: -v MININET2: -v MININET_USER:jenkins -v NEXUSURL_PREFIX:https://nexus.opendaylight.org -v NUM_ODL_SYSTEM:3 -v NUM_TOOLS_SYSTEM:0 -v ODL_STREAM:calcium -v ODL_SYSTEM_IP:10.30.171.102 -v ODL_SYSTEM_1_IP:10.30.171.102 -v ODL_SYSTEM_2_IP:10.30.171.170 -v ODL_SYSTEM_3_IP:10.30.171.45 -v ODL_SYSTEM_USER:jenkins -v TOOLS_SYSTEM_IP: -v TOOLS_SYSTEM_USER:jenkins -v USER_HOME:/home/jenkins -v IS_KARAF_APPL:True -v WORKSPACE:/tmp /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/action_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/action_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_kill.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_freeze.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot
==============================================================================
controller-clustering-ask.txt                                                 
==============================================================================
controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te...
==============================================================================
Stop_All_Members :: Stop every odl node.                              | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.45', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-ask.txt.Rpc Provider Precedence :: DOMRpcBroker testi...
==============================================================================
Register_Rpc_On_Each_Node :: Register global rpc on each node of t... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_rpc_provider_precedence_register_rpc_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_precedence_register_rpc_on_each_node&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.171.45', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Invoke_Rpc_On_Each_Node :: Verify that the rpc response comes from... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_rpc_provider_precedence_invoke_rpc_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_precedence_invoke_rpc_on_each_node&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.171.45', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Unregister_Rpc_On_Node :: Unregister the rpc on one of the cluster... | PASS |
------------------------------------------------------------------------------
Invoke_Rpc_On_Node_With_Unregistered_Rpc :: Invoke rcp on the node... | PASS |
------------------------------------------------------------------------------
Invoke_Rpc_On_Remaining_Nodes :: Verify that the rpc response come... | PASS |
------------------------------------------------------------------------------
Reregister_Rpc_On_Node :: Reregister the rpc.                         | PASS |
------------------------------------------------------------------------------
Invoke_Rpc_On_Each_Node_Again :: Verify that the rpc response come... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_rpc_provider_precedence_invoke_rpc_on_each_node_again"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_precedence_invoke_rpc_on_each_node_again&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.171.45', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Unregister_Rpc_On_Each_Node :: Unregister rpc on every node.          | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_rpc_provider_precedence_unregister_rpc_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_precedence_unregister_rpc_on_each_node&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.171.45', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-ask.txt.Rpc Provider Precedence :: DOMRpcBro... | FAIL |
8 tests, 4 passed, 4 failed
==============================================================================
controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te...
==============================================================================
Stop_All_Members :: Stop every odl node.                              | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.45', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-ask.txt.Rpc Provider Partition And Heal :: DOMRpcBrok...
==============================================================================
Register_Rpc_On_Two_Nodes :: Register rpc on two nodes of the odl ... | PASS |
------------------------------------------------------------------------------
Invoke_Rpc_On_Each_Node :: Invoke get-constant rpc on every node o... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_rpc_provider_partition_and_heal_invoke_rpc_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_partition_and_heal_invoke_rpc_on_each_node&order=bug_status"

Keyword 'Verify_Constant_On_Active_Nodes' failed after retrying for 10 seconds. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.45', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Isolate_One_Node :: Isolate one node with registered rpc. From the... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_rpc_provider_partition_and_heal_isolate_one_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_partition_and_heal_isolate_one_node&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.171.45', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Invoke_Rpc_On_Nonisolated_Nodes :: Invoke rpc on non-islolated nodes. | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_rpc_provider_partition_and_heal_invoke_rpc_on_nonisolated_nodes"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_partition_and_heal_invoke_rpc_on_nonisolated_nodes&order=bug_status"

Keyword 'DrbCommons.Verify_Constant_On_Active_Nodes' failed after retrying for 1 minute. The last error was: Keyword 'Verify_Constant_On_Active_Nodes' failed after retrying for 10 seconds. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.45', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Rejoin_Isolated_Member :: Rejoin isolated node                        | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_rpc_provider_partition_and_heal_rejoin_isolated_member"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_partition_and_heal_rejoin_isolated_member&order=bug_status"

Variable '${isolated_idx}' not found.
------------------------------------------------------------------------------
Invoke_Rpc_On_Each_Node_Again :: Invoke rpc get-constant on every ... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_rpc_provider_partition_and_heal_invoke_rpc_on_each_node_again"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_partition_and_heal_invoke_rpc_on_each_node_again&order=bug_status"

Keyword 'Verify_Constant_On_Active_Nodes' failed after retrying for 10 seconds. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.45', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Unregister_Rpc_On_Each_Node :: Inregister rpc on both nodes.          | PASS |
------------------------------------------------------------------------------
controller-clustering-ask.txt.Rpc Provider Partition And Heal :: D... | FAIL |
7 tests, 2 passed, 5 failed
==============================================================================
controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te...
==============================================================================
Stop_All_Members :: Stop every odl node.                              | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.45', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-ask.txt.Action Provider Precedence :: DOMRpcBroker te...
==============================================================================
Register_Rpc_On_Each_Node :: Register routed rpc on each node of t... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_action_provider_precedence_register_rpc_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_precedence_register_rpc_on_each_node&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.171.45', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Invoke_Rpc_On_Each_Node :: Verify that the rpc response comes from... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_action_provider_precedence_invoke_rpc_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_precedence_invoke_rpc_on_each_node&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.171.45', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Unregister_Rpc_On_Node :: Unregister the rpc on one of the cluster... | PASS |
------------------------------------------------------------------------------
Invoke_Rpc_On_Node_With_Unregistered_Rpc :: Invoke rcp on the node... | PASS |
------------------------------------------------------------------------------
Invoke_Rpc_On_Remaining_Nodes :: Verify that the rpc response come... | PASS |
------------------------------------------------------------------------------
Reregister_Rpc_On_Node :: Reregister the rpc.                         | PASS |
------------------------------------------------------------------------------
Invoke_Rpc_On_Each_Node_Again :: Verify that the rpc response come... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_action_provider_precedence_invoke_rpc_on_each_node_again"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_precedence_invoke_rpc_on_each_node_again&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.171.45', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Unregister_Rpc_On_Each_Node :: Unregister rpc on every node.          | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_action_provider_precedence_unregister_rpc_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_precedence_unregister_rpc_on_each_node&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.171.45', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-ask.txt.Action Provider Precedence :: DOMRpc... | FAIL |
8 tests, 4 passed, 4 failed
==============================================================================
controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te...
==============================================================================
Stop_All_Members :: Stop every odl node.                              | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.45', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-ask.txt.Action Provider Partition And Heal :: DOMRpcB...
==============================================================================
Register_Rpc_On_Two_Nodes :: Register rpc on two nodes of the odl ... | PASS |
------------------------------------------------------------------------------
Invoke_Rpc_On_Each_Node :: Invoke get-contexted-constant rpc on ev... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_action_provider_partition_and_heal_invoke_rpc_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_partition_and_heal_invoke_rpc_on_each_node&order=bug_status"

Keyword 'Verify_Contexted_Constant_On_Active_Nodes' failed after retrying for 10 seconds. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.45', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Isolate_One_Node :: Isolate one node with registered rpc.             | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_action_provider_partition_and_heal_isolate_one_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_partition_and_heal_isolate_one_node&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.171.45', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Invoke_Rpc_On_Remaining_Nodes :: Invoke rpc on non-islolated nodes... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_action_provider_partition_and_heal_invoke_rpc_on_remaining_nodes"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_partition_and_heal_invoke_rpc_on_remaining_nodes&order=bug_status"

Keyword 'DrbCommons.Verify_Contexted_Constant_On_Active_Nodes' failed after retrying for 1 minute. The last error was: Keyword 'Verify_Contexted_Constant_On_Active_Nodes' failed after retrying for 10 seconds. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.45', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Rejoin_Isolated_Member :: Rejoin isolated node                        | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_action_provider_partition_and_heal_rejoin_isolated_member"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_partition_and_heal_rejoin_isolated_member&order=bug_status"

Variable '${isolated_idx}' not found.
------------------------------------------------------------------------------
Invoke_Rpc_On_Each_Node_Again :: Invoke rpc get-contexted-constant... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_action_provider_partition_and_heal_invoke_rpc_on_each_node_again"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_partition_and_heal_invoke_rpc_on_each_node_again&order=bug_status"

Keyword 'Verify_Contexted_Constant_On_Active_Nodes' failed after retrying for 10 seconds. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.45', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Unregister_Rpc_On_Each_Node :: Inregister rpc on both nodes.          | PASS |
------------------------------------------------------------------------------
controller-clustering-ask.txt.Action Provider Partition And Heal :... | FAIL |
7 tests, 2 passed, 5 failed
==============================================================================
controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te...
==============================================================================
Stop_All_Members :: Stop every odl node.                              | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.45', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-ask.txt.Master Stability :: Cluster Singleton testing...
==============================================================================
Register_Singleton_Constant_On_Each_Node_And_Verify :: Register a ... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_master_stability_register_singleton_constant_on_each_node_and_verify"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_master_stability_register_singleton_constant_on_each_node_and_verify&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.171.45', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Unregister_Singleton_Constant_On_Non_Master_Node :: Unregister the... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_master_stability_unregister_singleton_constant_on_non_master_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_master_stability_unregister_singleton_constant_on_non_master_node&order=bug_status"

Variable '@{cs_candidates}' not found. Did you mean:
    @{cs_exp_candidates}
------------------------------------------------------------------------------
Monitor_Stability_While_Unregistered :: Verify that the owner rema... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_master_stability_monitor_stability_while_unregistered"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_master_stability_monitor_stability_while_unregistered&order=bug_status"

Variable '${cs_owner}' not found.
------------------------------------------------------------------------------
Reregister_Singleton_Constant :: Re-register the unregistered cand... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_master_stability_reregister_singleton_constant"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_master_stability_reregister_singleton_constant&order=bug_status"

Variable '${unregistered_node}' not found.
------------------------------------------------------------------------------
Verify_Stability_After_Reregistration :: Verify that the owner rem... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_master_stability_verify_stability_after_reregistration"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_master_stability_verify_stability_after_reregistration&order=bug_status"

Variable '${cs_owner}' not found.
------------------------------------------------------------------------------
Unregister_Singleton_Constant_On_Each_Node :: Unregister the appli... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_master_stability_unregister_singleton_constant_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_master_stability_unregister_singleton_constant_on_each_node&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.171.45', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-ask.txt.Master Stability :: Cluster Singleto... | FAIL |
6 tests, 0 passed, 6 failed
==============================================================================
controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te...
==============================================================================
Stop_All_Members :: Stop every odl node.                              | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.170:8181/jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore
------------------------------------------------------------------------------
controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-ask.txt.Partition And Heal :: Cluster Singleton testi...
==============================================================================
Register_Singleton_Constant_On_Each_Node :: Register a candidate a... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_partition_and_heal_register_singleton_constant_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_partition_and_heal_register_singleton_constant_on_each_node&order=bug_status"

HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.170:8181/rests/operations/odl-mdsal-lowlevel-control:register-singleton-constant
------------------------------------------------------------------------------
Verify_Singleton_Constant_On_Each_Node :: Store the owner and cand... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_partition_and_heal_verify_singleton_constant_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_partition_and_heal_verify_singleton_constant_on_each_node&order=bug_status"

Could not parse owner and candidates for device get-singleton-constant-service']
------------------------------------------------------------------------------
Isolate_Owner_Node :: Isolate the cluster node which is the owner.... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_partition_and_heal_isolate_owner_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_partition_and_heal_isolate_owner_node&order=bug_status"

Variable '${cs_owner}' not found.
------------------------------------------------------------------------------
Monitor_Stability_While_Isolated :: Monitor the stability of the s... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_partition_and_heal_monitor_stability_while_isolated"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_partition_and_heal_monitor_stability_while_isolated&order=bug_status"

Invalid IF condition: Evaluating expression '"${index}" == "${cs_isolated_index}"' failed: Variable '${cs_isolated_index}' not found.
------------------------------------------------------------------------------
Rejoin_Isolated_node :: Rejoin isolated node.                         | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_partition_and_heal_rejoin_isolated_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_partition_and_heal_rejoin_isolated_node&order=bug_status"

Variable '${cs_isolated_index}' not found.
------------------------------------------------------------------------------
Unregister_Singleton_Constant_On_Each_Node :: Unregister the appli... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_partition_and_heal_unregister_singleton_constant_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_partition_and_heal_unregister_singleton_constant_on_each_node&order=bug_status"

HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.170:8181/rests/operations/odl-mdsal-lowlevel-control:unregister-singleton-constant
------------------------------------------------------------------------------
controller-clustering-ask.txt.Partition And Heal :: Cluster Single... | FAIL |
6 tests, 0 passed, 6 failed
==============================================================================
controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te...
==============================================================================
Stop_All_Members :: Stop every odl node.                              | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.45', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-ask.txt.Chasing The Leader :: Cluster Singleton testi...
==============================================================================
Register_Candidates :: Register a candidate application on each no... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_chasing_the_leader_register_candidates"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_chasing_the_leader_register_candidates&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.171.45', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Do_Nothing :: Do nothing for the time of the test duration, becaus... | PASS |
------------------------------------------------------------------------------
Unregister_Candidates_And_Validate_Criteria :: Unregister the test... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_chasing_the_leader_unregister_candidates_and_validate_criteria"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_chasing_the_leader_unregister_candidates_and_validate_criteria&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.171.45', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-ask.txt.Chasing The Leader :: Cluster Single... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te...
==============================================================================
Stop_All_Members :: Stop every odl node.                              | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.45', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-ask.txt.Global Rpc Kill :: Controller functional HA t...
==============================================================================
Get_Basic_Rpc_Test_Owner :: Find a service owner and successors.      | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_global_rpc_kill_get_basic_rpc_test_owner"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_global_rpc_kill_get_basic_rpc_test_owner&order=bug_status"

Could not parse owner and candidates for device Basic-rpc-test']
------------------------------------------------------------------------------
Rpc_Before_Stopping_On_Owner :: Run rpc on the service owner.         | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_global_rpc_kill_rpc_before_stopping_on_owner"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_global_rpc_kill_rpc_before_stopping_on_owner&order=bug_status"

Variable '${brt_owner}' not found.
------------------------------------------------------------------------------
Rpc_Before_Stop_On_Successors :: Run rpc on non owher cluster nodes.  | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_global_rpc_kill_rpc_before_stop_on_successors"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_global_rpc_kill_rpc_before_stop_on_successors&order=bug_status"

Variable '@{brt_successors}' not found.
------------------------------------------------------------------------------
Stop_Current_Owner_Member :: Stop cluster node which is the owner.    | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_global_rpc_kill_stop_current_owner_member"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_global_rpc_kill_stop_current_owner_member&order=bug_status"

Variable '${brt_owner}' not found.
------------------------------------------------------------------------------
Verify_New_Basic_Rpc_Test_Owner_Elected :: Verify new owner of the... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_global_rpc_kill_verify_new_basic_rpc_test_owner_elected"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_global_rpc_kill_verify_new_basic_rpc_test_owner_elected&order=bug_status"

Variable '${old_brt_successors}' not found.
------------------------------------------------------------------------------
Rpc_On_Remained_Cluster_Nodes :: Run rpc on remained cluster nodes.   | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_global_rpc_kill_rpc_on_remained_cluster_nodes"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_global_rpc_kill_rpc_on_remained_cluster_nodes&order=bug_status"

Variable '@{old_brt_successors}' not found.
------------------------------------------------------------------------------
Restart_Stopped_Member :: Restart stopped node                        | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_global_rpc_kill_restart_stopped_member"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_global_rpc_kill_restart_stopped_member&order=bug_status"

Variable '${old_brt_owner}' not found.
------------------------------------------------------------------------------
Verify_New_Owner_Remained_After_Rejoin :: Verify no owner change h... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_global_rpc_kill_verify_new_owner_remained_after_rejoin"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_global_rpc_kill_verify_new_owner_remained_after_rejoin&order=bug_status"

Variable '${brt_owner}' not found.
------------------------------------------------------------------------------
Rpc_After_Rejoin_On_New_Owner :: Run rpc on the new service owner ... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_global_rpc_kill_rpc_after_rejoin_on_new_owner"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_global_rpc_kill_rpc_after_rejoin_on_new_owner&order=bug_status"

Variable '${brt_owner}' not found.
------------------------------------------------------------------------------
Rpc_After_Rejoin_On_Old_Owner :: Run rpc on rejoined cluster node.    | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_global_rpc_kill_rpc_after_rejoin_on_old_owner"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_global_rpc_kill_rpc_after_rejoin_on_old_owner&order=bug_status"

Variable '${old_brt_owner}' not found.
------------------------------------------------------------------------------
Rpc_After_Rejoin_On_All :: Run rpc again on all nodes.                | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_global_rpc_kill_rpc_after_rejoin_on_all"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_global_rpc_kill_rpc_after_rejoin_on_all&order=bug_status"

Variable '${brt_owner}' not found.
------------------------------------------------------------------------------
controller-clustering-ask.txt.Global Rpc Kill :: Controller functi... | FAIL |
11 tests, 0 passed, 11 failed
==============================================================================
controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te...
==============================================================================
Stop_All_Members :: Stop every odl node.                              | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.45', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-ask.txt.Global Rpc Freeze :: Controller functional HA...
==============================================================================
Get_Basic_Rpc_Test_Owner :: Find a service owner and successors.      | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_global_rpc_freeze_get_basic_rpc_test_owner"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_global_rpc_freeze_get_basic_rpc_test_owner&order=bug_status"

Could not parse owner and candidates for device Basic-rpc-test']
------------------------------------------------------------------------------
Rpc_Before_Freezing_On_Owner :: Run rpc on the service owner.         | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_global_rpc_freeze_rpc_before_freezing_on_owner"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_global_rpc_freeze_rpc_before_freezing_on_owner&order=bug_status"

Variable '${brt_owner}' not found.
------------------------------------------------------------------------------
Rpc_Before_Freeze_On_Successors :: Run rpc on non owher cluster no... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_global_rpc_freeze_rpc_before_freeze_on_successors"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_global_rpc_freeze_rpc_before_freeze_on_successors&order=bug_status"

Variable '@{brt_successors}' not found.
------------------------------------------------------------------------------
Freeze_Current_Owner_Member :: Stop cluster node which is the owner.  | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_global_rpc_freeze_freeze_current_owner_member"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_global_rpc_freeze_freeze_current_owner_member&order=bug_status"

Variable '${brt_owner}' not found.
------------------------------------------------------------------------------
Verify_New_Basic_Rpc_Test_Owner_Elected :: Verify new owner of the... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_global_rpc_freeze_verify_new_basic_rpc_test_owner_elected"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_global_rpc_freeze_verify_new_basic_rpc_test_owner_elected&order=bug_status"

Variable '${old_brt_successors}' not found.
------------------------------------------------------------------------------
Rpc_On_Remained_Cluster_Nodes :: Run rpc on remained cluster nodes.   | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_global_rpc_freeze_rpc_on_remained_cluster_nodes"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_global_rpc_freeze_rpc_on_remained_cluster_nodes&order=bug_status"

Variable '@{old_brt_successors}' not found.
------------------------------------------------------------------------------
Unfreeze_Frozen_Member :: Restart frozen node                         | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_global_rpc_freeze_unfreeze_frozen_member"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_global_rpc_freeze_unfreeze_frozen_member&order=bug_status"

Variable '${old_brt_owner}' not found.
------------------------------------------------------------------------------
Rpc_After_Rejoin_On_New_Owner :: Run rpc on the new service owner ... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_global_rpc_freeze_rpc_after_rejoin_on_new_owner"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_global_rpc_freeze_rpc_after_rejoin_on_new_owner&order=bug_status"

Variable '${brt_owner}' not found.
------------------------------------------------------------------------------
Rpc_After_Rejoin_On_Old_Owner :: Run rpc on rejoined cluster node.    | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_global_rpc_freeze_rpc_after_rejoin_on_old_owner"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_global_rpc_freeze_rpc_after_rejoin_on_old_owner&order=bug_status"

Variable '${old_brt_owner}' not found.
------------------------------------------------------------------------------
Rpc_After_Rejoin_On_All :: Run rpc again on all nodes.                | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_global_rpc_freeze_rpc_after_rejoin_on_all"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_global_rpc_freeze_rpc_after_rejoin_on_all&order=bug_status"

Variable '${brt_owner}' not found.
------------------------------------------------------------------------------
controller-clustering-ask.txt.Global Rpc Freeze :: Controller func... | FAIL |
10 tests, 0 passed, 10 failed
==============================================================================
controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te...
==============================================================================
Stop_All_Members :: Stop every odl node.                              | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.45', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-ask.txt.Global Rpc Isolate :: Controller functional H...
==============================================================================
Get_Basic_Rpc_Test_Owner :: Find a service owner and successors.      | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_global_rpc_isolate_get_basic_rpc_test_owner"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_global_rpc_isolate_get_basic_rpc_test_owner&order=bug_status"

Could not parse owner and candidates for device Basic-rpc-test']
------------------------------------------------------------------------------
Rpc_Before_Isolation_On_Owner :: Run rpc on the service owner.        | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_global_rpc_isolate_rpc_before_isolation_on_owner"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_global_rpc_isolate_rpc_before_isolation_on_owner&order=bug_status"

Variable '${brt_owner}' not found.
------------------------------------------------------------------------------
Rpc_Before_Isolation_On_Successors :: Run rpc on non owher cluster... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_global_rpc_isolate_rpc_before_isolation_on_successors"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_global_rpc_isolate_rpc_before_isolation_on_successors&order=bug_status"

Variable '@{brt_successors}' not found.
------------------------------------------------------------------------------
Isolate_Current_Owner_Member :: Isolating cluster node which is th... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_global_rpc_isolate_isolate_current_owner_member"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_global_rpc_isolate_isolate_current_owner_member&order=bug_status"

Variable '${brt_owner}' not found.
------------------------------------------------------------------------------
Verify_New_Basic_Rpc_Test_Owner_Elected :: Verify new owner of the... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_global_rpc_isolate_verify_new_basic_rpc_test_owner_elected"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_global_rpc_isolate_verify_new_basic_rpc_test_owner_elected&order=bug_status"

Variable '${old_brt_successors}' not found.
------------------------------------------------------------------------------
Rpc_On_Isolated_Node :: Run rpc on isolated cluster node.             | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_global_rpc_isolate_rpc_on_isolated_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_global_rpc_isolate_rpc_on_isolated_node&order=bug_status"

Variable '${old_brt_owner}' not found.
------------------------------------------------------------------------------
Rpc_On_Non_Isolated_Cluster_Nodes :: Run rpc on remained cluster n... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_global_rpc_isolate_rpc_on_non_isolated_cluster_nodes"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_global_rpc_isolate_rpc_on_non_isolated_cluster_nodes&order=bug_status"

Variable '@{old_brt_successors}' not found.
------------------------------------------------------------------------------
Rejoin_Isolated_Member :: Rejoin isolated node                        | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_global_rpc_isolate_rejoin_isolated_member"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_global_rpc_isolate_rejoin_isolated_member&order=bug_status"

Variable '${old_brt_owner}' not found.
------------------------------------------------------------------------------
Rpc_After_Rejoin_On_New_Owner :: Run rpc on the new service owner ... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_global_rpc_isolate_rpc_after_rejoin_on_new_owner"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_global_rpc_isolate_rpc_after_rejoin_on_new_owner&order=bug_status"

Variable '${brt_owner}' not found.
------------------------------------------------------------------------------
Rpc_After_Rejoin_On_Old_Owner :: Run rpc on rejoined cluster node.    | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_global_rpc_isolate_rpc_after_rejoin_on_old_owner"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_global_rpc_isolate_rpc_after_rejoin_on_old_owner&order=bug_status"

Variable '${old_brt_owner}' not found.
------------------------------------------------------------------------------
Rpc_After_Rejoin_On_All :: Run rpc again on all nodes.                | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_global_rpc_isolate_rpc_after_rejoin_on_all"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_global_rpc_isolate_rpc_after_rejoin_on_all&order=bug_status"

Variable '${brt_owner}' not found.
------------------------------------------------------------------------------
controller-clustering-ask.txt.Global Rpc Isolate :: Controller fun... | FAIL |
11 tests, 0 passed, 11 failed
==============================================================================
controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te...
==============================================================================
Stop_All_Members :: Stop every odl node.                              | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.45', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-ask.txt.Carpeople Crud :: Suite for performing basic ...
==============================================================================
Add_Cars_To_Leader :: Add 30 cars to car Leader by one big PUT.       | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Added_Cars_On_Leader :: GET response from Leader should match ... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Added_Cars_On_Followers :: The same check on other members.       | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Add_People_To_First_Follower :: Add 30 people to people first Foll... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Added_People_On_Leader :: GET response from Leader should matc... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Added_People_On_Followers :: The same check on other members.     | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Leader :: Buy some cars on car-people Leader, loop of ... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Followers :: On each Follower buy corresponding ID seg... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Added_CarPeople_On_Leader :: GET car-person mappings from Lead... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Added_CarPeople_On_Followers :: The same check on other members.  | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_All_CarPeople_On_Leader :: DELETE car-people container. No ... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_All_People_On_Leader :: DELETE people container. No verific... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_All_Cars_On_Leader :: DELETE cars container. No verificatio... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
controller-clustering-ask.txt.Carpeople Crud :: Suite for performi... | FAIL |
Suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig

13 tests, 0 passed, 13 failed
==============================================================================
controller-clustering-ask.txt.Car Failover Crud :: Suite mixing basic opera...
==============================================================================
Add_Original_Cars_On_Old_Leader_And_Verify :: Add initial cars on ... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Stop_Original_Car_Leader :: Stop the car Leader to cause a new lea... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Wait_For_New_Leader :: Wait until new car Leader is elected.          | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Original_Cars_On_New_Leader :: GET cars from new Leader, shoul... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Original_Cars_On_New_Followers :: The same check on other exis... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_Original_Cars_On_New_Leader :: Delete cars on the new Leader.  | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Add_Leader_Cars_On_New_Leader :: Add cars on the new Leader.          | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Leader_Cars_On_New_Leader :: GET cars from new Leader, should ... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Leader_Cars_On_New_Followers :: The same check on other existi... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_Leader_Cars_On_New_First_Follower :: Delete cars in new fir... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Add_Follower_Cars_On_New_First_Follower :: Add cars on the new fir... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Folower_Cars_On_New_Leader :: Get cars from the new Leader, sh... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Follower_Cars_On_New_Followers :: The same check on other exis... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Start_Old_Car_Leader :: Start the stopped member without deleting ... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Folower_Cars_On_Old_Leader :: GET cars from the restarted memb... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_Follower_Cars_On_New_Leader :: Delete cars on the last Leader. | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
controller-clustering-ask.txt.Car Failover Crud :: Suite mixing ba... | FAIL |
Suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig

16 tests, 0 passed, 16 failed
==============================================================================
controller-clustering-ask.txt.Car Persistence Recovery :: This test restart...
==============================================================================
Add_Cars_On_Leader_And_Verify :: Single big PUT to datastore to ad... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Stop_All_Members :: Stop all controllers.                             | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Start_All_Members :: Start all controllers (should restore the per... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Memorize_Leader_And_Followers :: Locate current Leader of car Shard.  | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Cars_On_Leader :: GET cars from Leader, should match the PUT d... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Cars_On_Followers :: The same check on other members.             | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_Cars_On_Leader :: Delete cars on the new Leader.               | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
controller-clustering-ask.txt.Car Persistence Recovery :: This tes... | FAIL |
Suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig

7 tests, 0 passed, 7 failed
==============================================================================
controller-clustering-ask.txt.Buycar Failover :: This test focuses on testi...
==============================================================================
Add_Cars_To_Leader_And_Verify :: Add all needed cars to car Leader... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Add_People_To_First_Follower_And_Verify :: Add all needed people t... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Leader_And_Verify :: Buy some cars on the leader member.  | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Follower_And_Verify :: Buy some cars on the first foll... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Reboot_People_Leader :: Previous people Leader is rebooted. We sho... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Leader_After_Reboot_And_Verify :: Buy some cars on the... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Follower_After_Reboot_And_Verify :: Buy some cars on t... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_All_CarPeople :: DELETE car-people container. No verificati... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_All_People :: DELETE people container. No verification beyo... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_All_Cars :: DELETE cars container. No verification beyond h... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
controller-clustering-ask.txt.Buycar Failover :: This test focuses... | FAIL |
Suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig

10 tests, 0 passed, 10 failed
==============================================================================
controller-clustering-ask.txt.Entity Isolate :: Suite for performing member...
==============================================================================
Check All Shards Before Isolate :: Check all shards in controller.    | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Isolate Entity Leader :: Isolate the entity-ownership Leader to ca... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Check All Shards After Isolate :: Check all shards in controller.     | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Rejoin Entity Leader :: Rejoin the entity-ownership Leader.           | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Check All Shards After Rejoin :: Check all shards in controller.      | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
controller-clustering-ask.txt.Entity Isolate :: Suite for performi... | FAIL |
Suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig

5 tests, 0 passed, 5 failed
==============================================================================
controller-clustering-ask.txt.Buycar Failover Isolation :: This test focuse...
==============================================================================
Add_Cars_To_Leader_And_Verify :: Add all needed cars to car Leader... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.170:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Add_People_To_First_Follower_And_Verify :: Add all needed people t... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.170:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Leader_And_Verify :: Buy some cars on the leader member.  | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.170:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Follower_And_Verify :: Buy some cars on the first foll... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.170:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Isolate_and_Rejoin_People_Leader :: Previous people Leader is isol... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.170:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Leader_After_Rejoin_And_Verify :: Buy some cars on the... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.170:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Follower_After_Rejoin_And_Verify :: Buy some cars on t... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.170:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_All_CarPeople :: DELETE car-people container. No verificati... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.170:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_All_People :: DELETE people container. No verification beyo... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.170:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_All_Cars :: DELETE cars container. No verification beyond h... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.170:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
controller-clustering-ask.txt.Buycar Failover Isolation :: This te... | FAIL |
Suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.170:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig

10 tests, 0 passed, 10 failed
==============================================================================
controller-clustering-ask.txt.Car Failover Crud Isolation :: Suite mixing b...
==============================================================================
Add_Original_Cars_On_Old_Leader_And_Verify :: Add initial cars on ... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Isolate_Original_Car_Leader :: Isolate the car Leader to cause a n... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Wait_For_New_Leader :: Wait until new car Leader is elected.          | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Original_Cars_On_New_Leader :: GET cars from new Leader, shoul... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Original_Cars_On_New_Followers :: The same check on other exis... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_Original_Cars_On_New_Leader :: Delete cars on the new Leader.  | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Add_Leader_Cars_On_New_Leader :: Add cars on the new Leader.          | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Leader_Cars_On_New_Leader :: GET cars from new Leader, should ... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Leader_Cars_On_New_Followers :: The same check on other existi... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_Leader_Cars_On_New_First_Follower :: Delete cars in new fir... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Add_Follower_Cars_On_New_First_Follower :: Add cars on the new fir... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Folower_Cars_On_New_Leader :: Get cars from the new Leader, sh... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Follower_Cars_On_New_Followers :: The same check on other exis... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Rejoin_Old_Car_Leader :: Rejoin the isolated member without deleti... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Folower_Cars_On_Old_Leader :: GET cars from the restarted memb... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_Follower_Cars_On_New_Leader :: Delete cars on the last Leader. | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
controller-clustering-ask.txt.Car Failover Crud Isolation :: Suite... | FAIL |
Suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig

16 tests, 0 passed, 16 failed
==============================================================================
controller-clustering-ask.txt.Car Outage Corners :: Cluster suite for testi...
==============================================================================
Stop_Majority_Of_The_Followers :: Stop half plus one car Follower ... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.170:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Attempt_To_Add_Cars_To_Leader :: Adding cars should fail, as major... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.170:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Start_Tipping_Follower :: Start one Follower member without persis... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.170:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Add_Cars_On_Tipping_Follower :: Add cars on the tipping Follower.     | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.170:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Cars_On_Existing_Members :: On each up member: GET cars, shoul... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.170:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Start_Other_Followers :: Start other followers without persisted d... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.170:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Cars_On_New_Follower_Leader :: GET cars from a new follower to... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.170:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_Cars_On_Leader :: Delete cars on Leader.                       | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.170:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
controller-clustering-ask.txt.Car Outage Corners :: Cluster suite ... | FAIL |
Suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.170:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig

8 tests, 0 passed, 8 failed
==============================================================================
controller-clustering-ask.txt                                         | FAIL |
195 tests, 24 passed, 171 failed
==============================================================================
Output:  /w/workspace/controller-csit-3node-clustering-ask-all-calcium/output.xml
Log:     /w/workspace/controller-csit-3node-clustering-ask-all-calcium/log.html
Report:  /w/workspace/controller-csit-3node-clustering-ask-all-calcium/report.html
+ true
+ echo 'Examining the files in data/log and checking filesize'
Examining the files in data/log and checking filesize
+ ssh 10.30.171.102 'ls -altr /tmp/karaf-0.20.1-SNAPSHOT/data/log/'
Warning: Permanently added '10.30.171.102' (ECDSA) to the list of known hosts.
total 37072
drwxrwxr-x. 2 jenkins jenkins       48 Apr 20 23:48 .
-rw-rw-r--. 1 jenkins jenkins     1720 Apr 20 23:48 karaf_console.log
-rw-rw-r--. 1 jenkins jenkins 37954855 Apr 21 02:57 karaf.log
drwxrwxr-x. 8 jenkins jenkins      133 Apr 21 02:58 ..
+ ssh 10.30.171.102 'du -hs /tmp/karaf-0.20.1-SNAPSHOT/data/log/*'
Warning: Permanently added '10.30.171.102' (ECDSA) to the list of known hosts.
4.0K	/tmp/karaf-0.20.1-SNAPSHOT/data/log/karaf_console.log
37M	/tmp/karaf-0.20.1-SNAPSHOT/data/log/karaf.log
+ ssh 10.30.171.170 'ls -altr /tmp/karaf-0.20.1-SNAPSHOT/data/log/'
Warning: Permanently added '10.30.171.170' (ECDSA) to the list of known hosts.
total 122884
drwxrwxr-x. 2 jenkins jenkins       48 Apr 20 23:48 .
-rw-rw-r--. 1 jenkins jenkins     1720 Apr 20 23:48 karaf_console.log
drwxrwxr-x. 9 jenkins jenkins      149 Apr 21 02:58 ..
-rw-rw-r--. 1 jenkins jenkins 63661124 Apr 21 03:05 karaf.log
+ ssh 10.30.171.170 'du -hs /tmp/karaf-0.20.1-SNAPSHOT/data/log/*'
Warning: Permanently added '10.30.171.170' (ECDSA) to the list of known hosts.
4.0K	/tmp/karaf-0.20.1-SNAPSHOT/data/log/karaf_console.log
120M	/tmp/karaf-0.20.1-SNAPSHOT/data/log/karaf.log
+ ssh 10.30.171.45 'ls -altr /tmp/karaf-0.20.1-SNAPSHOT/data/log/'
Warning: Permanently added '10.30.171.45' (ECDSA) to the list of known hosts.
total 13008
drwxrwxr-x. 2 jenkins jenkins      48 Apr 20 23:48 .
-rw-rw-r--. 1 jenkins jenkins  145046 Apr 20 23:56 karaf_console.log
drwxrwxr-x. 4 jenkins jenkins      28 Apr 21 02:57 ..
-rw-rw-r--. 1 jenkins jenkins 9054644 Apr 21 03:05 karaf.log
+ ssh 10.30.171.45 'du -hs /tmp/karaf-0.20.1-SNAPSHOT/data/log/*'
Warning: Permanently added '10.30.171.45' (ECDSA) to the list of known hosts.
144K	/tmp/karaf-0.20.1-SNAPSHOT/data/log/karaf_console.log
13M	/tmp/karaf-0.20.1-SNAPSHOT/data/log/karaf.log
+ set +e
++ seq 1 3
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_1_IP
+ echo 'Let'\''s take the karaf thread dump again'
Let's take the karaf thread dump again
+ ssh 10.30.171.102 'sudo ps aux'
Warning: Permanently added '10.30.171.102' (ECDSA) to the list of known hosts.
++ tr -s ' '
++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-ask-all-calcium/ps_after.log
++ grep -v grep
++ cut -f2 '-d '
+ pid=30800
+ echo 'karaf main: org.apache.karaf.main.Main, pid:30800'
karaf main: org.apache.karaf.main.Main, pid:30800
+ ssh 10.30.171.102 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 30800'
Warning: Permanently added '10.30.171.102' (ECDSA) to the list of known hosts.
+ echo 'killing karaf process...'
killing karaf process...
+ ssh 10.30.171.102 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh'
Warning: Permanently added '10.30.171.102' (ECDSA) to the list of known hosts.
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_2_IP
+ echo 'Let'\''s take the karaf thread dump again'
Let's take the karaf thread dump again
+ ssh 10.30.171.170 'sudo ps aux'
Warning: Permanently added '10.30.171.170' (ECDSA) to the list of known hosts.
++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-ask-all-calcium/ps_after.log
++ grep -v grep
++ cut -f2 '-d '
++ tr -s ' '
+ pid=38641
+ echo 'karaf main: org.apache.karaf.main.Main, pid:38641'
karaf main: org.apache.karaf.main.Main, pid:38641
+ ssh 10.30.171.170 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 38641'
Warning: Permanently added '10.30.171.170' (ECDSA) to the list of known hosts.
+ echo 'killing karaf process...'
killing karaf process...
+ ssh 10.30.171.170 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh'
Warning: Permanently added '10.30.171.170' (ECDSA) to the list of known hosts.
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_3_IP
+ echo 'Let'\''s take the karaf thread dump again'
Let's take the karaf thread dump again
+ ssh 10.30.171.45 'sudo ps aux'
Warning: Permanently added '10.30.171.45' (ECDSA) to the list of known hosts.
++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-ask-all-calcium/ps_after.log
++ grep -v grep
++ cut -f2 '-d '
++ tr -s ' '
+ pid=5760
+ echo 'karaf main: org.apache.karaf.main.Main, pid:5760'
karaf main: org.apache.karaf.main.Main, pid:5760
+ ssh 10.30.171.45 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 5760'
Warning: Permanently added '10.30.171.45' (ECDSA) to the list of known hosts.
+ echo 'killing karaf process...'
killing karaf process...
+ ssh 10.30.171.45 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh'
Warning: Permanently added '10.30.171.45' (ECDSA) to the list of known hosts.
+ sleep 5
++ seq 1 3
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_1_IP
+ echo 'Compressing karaf.log 1'
Compressing karaf.log 1
+ ssh 10.30.171.102 gzip --best /tmp/karaf-0.20.1-SNAPSHOT/data/log/karaf.log
Warning: Permanently added '10.30.171.102' (ECDSA) to the list of known hosts.
+ echo 'Fetching compressed karaf.log 1'
Fetching compressed karaf.log 1
+ scp 10.30.171.102:/tmp/karaf-0.20.1-SNAPSHOT/data/log/karaf.log.gz odl1_karaf.log.gz
Warning: Permanently added '10.30.171.102' (ECDSA) to the list of known hosts.
+ ssh 10.30.171.102 rm -f /tmp/karaf-0.20.1-SNAPSHOT/data/log/karaf.log.gz
Warning: Permanently added '10.30.171.102' (ECDSA) to the list of known hosts.
+ scp 10.30.171.102:/tmp/karaf-0.20.1-SNAPSHOT/data/log/karaf_console.log odl1_karaf_console.log
Warning: Permanently added '10.30.171.102' (ECDSA) to the list of known hosts.
+ ssh 10.30.171.102 rm -f /tmp/karaf-0.20.1-SNAPSHOT/data/log/karaf_console.log
Warning: Permanently added '10.30.171.102' (ECDSA) to the list of known hosts.
+ echo 'Fetch GC logs'
Fetch GC logs
+ mkdir -p gclogs-1
+ scp '10.30.171.102:/tmp/karaf-0.20.1-SNAPSHOT/data/log/*.log' gclogs-1/
Warning: Permanently added '10.30.171.102' (ECDSA) to the list of known hosts.
scp: /tmp/karaf-0.20.1-SNAPSHOT/data/log/*.log: No such file or directory
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_2_IP
+ echo 'Compressing karaf.log 2'
Compressing karaf.log 2
+ ssh 10.30.171.170 gzip --best /tmp/karaf-0.20.1-SNAPSHOT/data/log/karaf.log
Warning: Permanently added '10.30.171.170' (ECDSA) to the list of known hosts.
gzip: /tmp/karaf-0.20.1-SNAPSHOT/data/log/karaf.log: file size changed while zipping
+ echo 'Fetching compressed karaf.log 2'
Fetching compressed karaf.log 2
+ scp 10.30.171.170:/tmp/karaf-0.20.1-SNAPSHOT/data/log/karaf.log.gz odl2_karaf.log.gz
Warning: Permanently added '10.30.171.170' (ECDSA) to the list of known hosts.
+ ssh 10.30.171.170 rm -f /tmp/karaf-0.20.1-SNAPSHOT/data/log/karaf.log.gz
Warning: Permanently added '10.30.171.170' (ECDSA) to the list of known hosts.
+ scp 10.30.171.170:/tmp/karaf-0.20.1-SNAPSHOT/data/log/karaf_console.log odl2_karaf_console.log
Warning: Permanently added '10.30.171.170' (ECDSA) to the list of known hosts.
+ ssh 10.30.171.170 rm -f /tmp/karaf-0.20.1-SNAPSHOT/data/log/karaf_console.log
Warning: Permanently added '10.30.171.170' (ECDSA) to the list of known hosts.
+ echo 'Fetch GC logs'
Fetch GC logs
+ mkdir -p gclogs-2
+ scp '10.30.171.170:/tmp/karaf-0.20.1-SNAPSHOT/data/log/*.log' gclogs-2/
Warning: Permanently added '10.30.171.170' (ECDSA) to the list of known hosts.
scp: /tmp/karaf-0.20.1-SNAPSHOT/data/log/*.log: No such file or directory
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_3_IP
+ echo 'Compressing karaf.log 3'
Compressing karaf.log 3
+ ssh 10.30.171.45 gzip --best /tmp/karaf-0.20.1-SNAPSHOT/data/log/karaf.log
Warning: Permanently added '10.30.171.45' (ECDSA) to the list of known hosts.
+ echo 'Fetching compressed karaf.log 3'
Fetching compressed karaf.log 3
+ scp 10.30.171.45:/tmp/karaf-0.20.1-SNAPSHOT/data/log/karaf.log.gz odl3_karaf.log.gz
Warning: Permanently added '10.30.171.45' (ECDSA) to the list of known hosts.
+ ssh 10.30.171.45 rm -f /tmp/karaf-0.20.1-SNAPSHOT/data/log/karaf.log.gz
Warning: Permanently added '10.30.171.45' (ECDSA) to the list of known hosts.
+ scp 10.30.171.45:/tmp/karaf-0.20.1-SNAPSHOT/data/log/karaf_console.log odl3_karaf_console.log
Warning: Permanently added '10.30.171.45' (ECDSA) to the list of known hosts.
+ ssh 10.30.171.45 rm -f /tmp/karaf-0.20.1-SNAPSHOT/data/log/karaf_console.log
Warning: Permanently added '10.30.171.45' (ECDSA) to the list of known hosts.
+ echo 'Fetch GC logs'
Fetch GC logs
+ mkdir -p gclogs-3
+ scp '10.30.171.45:/tmp/karaf-0.20.1-SNAPSHOT/data/log/*.log' gclogs-3/
Warning: Permanently added '10.30.171.45' (ECDSA) to the list of known hosts.
scp: /tmp/karaf-0.20.1-SNAPSHOT/data/log/*.log: No such file or directory
+ echo 'Examine copied files'
Examine copied files
+ ls -lt
total 54268
drwxrwxr-x. 2 jenkins jenkins        6 Apr 21 03:06 gclogs-3
-rw-rw-r--. 1 jenkins jenkins   145046 Apr 21 03:06 odl3_karaf_console.log
-rw-rw-r--. 1 jenkins jenkins   311449 Apr 21 03:06 odl3_karaf.log.gz
drwxrwxr-x. 2 jenkins jenkins        6 Apr 21 03:06 gclogs-2
-rw-rw-r--. 1 jenkins jenkins     1720 Apr 21 03:06 odl2_karaf_console.log
-rw-rw-r--. 1 jenkins jenkins  2135198 Apr 21 03:06 odl2_karaf.log.gz
drwxrwxr-x. 2 jenkins jenkins        6 Apr 21 03:06 gclogs-1
-rw-rw-r--. 1 jenkins jenkins     1720 Apr 21 03:06 odl1_karaf_console.log
-rw-rw-r--. 1 jenkins jenkins  1194129 Apr 21 03:06 odl1_karaf.log.gz
-rw-rw-r--. 1 jenkins jenkins   144663 Apr 21 03:05 karaf_3_5760_threads_after.log
-rw-rw-r--. 1 jenkins jenkins    16199 Apr 21 03:05 ps_after.log
-rw-rw-r--. 1 jenkins jenkins   141050 Apr 21 03:05 karaf_2_38641_threads_after.log
-rw-rw-r--. 1 jenkins jenkins   139705 Apr 21 03:05 karaf_1_30800_threads_after.log
-rw-rw-r--. 1 jenkins jenkins   310678 Apr 21 03:05 report.html
-rw-rw-r--. 1 jenkins jenkins  3385211 Apr 21 03:05 log.html
-rw-rw-r--. 1 jenkins jenkins 47035314 Apr 21 03:05 output.xml
-rw-rw-r--. 1 jenkins jenkins     4091 Apr 20 23:49 testplan.txt
-rw-rw-r--. 1 jenkins jenkins   156764 Apr 20 23:49 karaf_3_5760_threads_before.log
-rw-rw-r--. 1 jenkins jenkins    16852 Apr 20 23:49 ps_before.log
-rw-rw-r--. 1 jenkins jenkins   167321 Apr 20 23:49 karaf_2_5753_threads_before.log
-rw-rw-r--. 1 jenkins jenkins   166439 Apr 20 23:49 karaf_1_5760_threads_before.log
-rw-rw-r--. 1 jenkins jenkins     3106 Apr 20 23:48 post-startup-script.sh
-rw-rw-r--. 1 jenkins jenkins      252 Apr 20 23:47 startup-script.sh
-rw-rw-r--. 1 jenkins jenkins     3448 Apr 20 23:47 configuration-script.sh
-rw-rw-r--. 1 jenkins jenkins      695 Apr 20 23:47 custom_shard_config.txt
-rw-rw-r--. 1 jenkins jenkins      134 Apr 20 23:47 scriptplan.txt
-rw-rw-r--. 1 jenkins jenkins      333 Apr 20 23:47 detect_variables.env
-rw-rw-r--. 1 jenkins jenkins     2620 Apr 20 23:47 pom.xml
-rw-rw-r--. 1 jenkins jenkins       86 Apr 20 23:47 set_variables.env
-rw-rw-r--. 1 jenkins jenkins      313 Apr 20 23:47 slave_addresses.txt
-rw-rw-r--. 1 jenkins jenkins      570 Apr 20 23:47 requirements.txt
-rw-rw-r--. 1 jenkins jenkins       26 Apr 20 23:47 env.properties
-rw-rw-r--. 1 jenkins jenkins      335 Apr 20 23:45 stack-parameters.yaml
drwxrwxr-x. 7 jenkins jenkins     4096 Apr 20 23:43 test
drwxrwxr-x. 2 jenkins jenkins        6 Apr 20 23:43 test@tmp
-rw-rw-r--. 1 jenkins jenkins      963 Apr 19 00:02 maven-metadata.xml
+ true
[controller-csit-3node-clustering-ask-all-calcium] $ /bin/sh /tmp/jenkins4462150703439608214.sh
Cleaning up Robot installation...
$ ssh-agent -k
unset SSH_AUTH_SOCK;
unset SSH_AGENT_PID;
echo Agent pid 5284 killed;
[ssh-agent] Stopped.
Recording plot data
Robot results publisher started...
INFO: Checking test criticality is deprecated and will be dropped in a future release!
-Parsing output xml:
Done!
-Copying log files to build dir:
Done!
-Assigning results to build:
Done!
-Checking thresholds:
Done!
Done publishing Robot results.
Build step 'Publish Robot Framework test results' changed build result to UNSTABLE
[PostBuildScript] - [INFO] Executing post build scripts.
[controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash /tmp/jenkins1856428822394361204.sh
Archiving csit artifacts
mv: cannot stat '*_1.png': No such file or directory
mv: cannot stat '/tmp/odl1_*': No such file or directory
mv: cannot stat '*_2.png': No such file or directory
mv: cannot stat '/tmp/odl2_*': No such file or directory
mv: cannot stat '*_3.png': No such file or directory
mv: cannot stat '/tmp/odl3_*': No such file or directory
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed

  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100  6886    0  6886    0     0   216k      0 --:--:-- --:--:-- --:--:--  210k
100 4238k    0 4238k    0     0  4475k      0 --:--:-- --:--:-- --:--:-- 4470k
Archive:  robot-plugin.zip
  inflating: ./archives/robot-plugin/log.html  
  inflating: ./archives/robot-plugin/output.xml  
  inflating: ./archives/robot-plugin/report.html  
mv: cannot stat '*.log.gz': No such file or directory
mv: cannot stat '*.csv': No such file or directory
mv: cannot stat '*.png': No such file or directory
[PostBuildScript] - [INFO] Executing post build scripts.
[controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash /tmp/jenkins7924136009695242756.sh
[PostBuildScript] - [INFO] Executing post build scripts.
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties content 
OS_CLOUD=vex
OS_STACK_NAME=releng-controller-csit-3node-clustering-ask-all-calcium-32

[EnvInject] - Variables injected successfully.
provisioning config files...
copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
[controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash /tmp/jenkins12645100826604571368.sh
---> openstack-stack-delete.sh
Setup pyenv:
  system
  3.8.13
  3.9.13
  3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-ask-all-calcium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-fQDw from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes python-heatclient python-openstackclient 
lf-activate-venv(): INFO: Adding /tmp/venv-fQDw/bin to PATH
INFO: Retrieving stack cost for: releng-controller-csit-3node-clustering-ask-all-calcium-32
DEBUG: Successfully retrieved stack cost: total: 1.32
INFO: Deleting stack releng-controller-csit-3node-clustering-ask-all-calcium-32
Successfully deleted stack releng-controller-csit-3node-clustering-ask-all-calcium-32
[PostBuildScript] - [INFO] Executing post build scripts.
[controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash /tmp/jenkins13773599601406424101.sh
---> sysstat.sh
[controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash /tmp/jenkins10647730652496205480.sh
---> package-listing.sh
++ facter osfamily
++ tr '[:upper:]' '[:lower:]'
+ OS_FAMILY=redhat
+ workspace=/w/workspace/controller-csit-3node-clustering-ask-all-calcium
+ START_PACKAGES=/tmp/packages_start.txt
+ END_PACKAGES=/tmp/packages_end.txt
+ DIFF_PACKAGES=/tmp/packages_diff.txt
+ PACKAGES=/tmp/packages_start.txt
+ '[' /w/workspace/controller-csit-3node-clustering-ask-all-calcium ']'
+ PACKAGES=/tmp/packages_end.txt
+ case "${OS_FAMILY}" in
+ rpm -qa
+ sort
+ '[' -f /tmp/packages_start.txt ']'
+ '[' -f /tmp/packages_end.txt ']'
+ diff /tmp/packages_start.txt /tmp/packages_end.txt
+ '[' /w/workspace/controller-csit-3node-clustering-ask-all-calcium ']'
+ mkdir -p /w/workspace/controller-csit-3node-clustering-ask-all-calcium/archives/
+ cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/controller-csit-3node-clustering-ask-all-calcium/archives/
[controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash /tmp/jenkins6553323650806072904.sh
---> capture-instance-metadata.sh
Setup pyenv:
  system
  3.8.13
  3.9.13
  3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-ask-all-calcium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-fQDw from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: lftools 
lf-activate-venv(): INFO: Adding /tmp/venv-fQDw/bin to PATH
INFO: Running in OpenStack, capturing instance metadata
[controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash /tmp/jenkins18274070197742814852.sh
provisioning config files...
Could not find credentials [logs] for controller-csit-3node-clustering-ask-all-calcium #32
copy managed file [jenkins-log-archives-settings] to file:/w/workspace/controller-csit-3node-clustering-ask-all-calcium@tmp/config11298775291493432538tmp
Regular expression run condition: Expression=[^.*logs-s3.*], Label=[odl-logs-s3-cloudfront-index]
Run condition [Regular expression match] enabling perform for step [Provide Configuration files]
provisioning config files...
copy managed file [jenkins-s3-log-ship] to file:/home/jenkins/.aws/credentials
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties content 
SERVER_ID=logs

[EnvInject] - Variables injected successfully.
[controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash /tmp/jenkins4920063073567170715.sh
---> create-netrc.sh
WARN: Log server credential not found.
[controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash /tmp/jenkins6103617808305602691.sh
---> python-tools-install.sh
Setup pyenv:
  system
  3.8.13
  3.9.13
  3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-ask-all-calcium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-fQDw from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: lftools 
lf-activate-venv(): INFO: Adding /tmp/venv-fQDw/bin to PATH
[controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash /tmp/jenkins3783236665753715225.sh
---> sudo-logs.sh
Archiving 'sudo' log..
[controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash /tmp/jenkins5869681018570786524.sh
---> job-cost.sh
Setup pyenv:
  system
  3.8.13
  3.9.13
  3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-ask-all-calcium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-fQDw from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 
lf-activate-venv(): INFO: Adding /tmp/venv-fQDw/bin to PATH
DEBUG: total: 1.32
INFO: Retrieving Stack Cost...
INFO: Retrieving Pricing Info for: v3-standard-2
INFO: Archiving Costs
[controller-csit-3node-clustering-ask-all-calcium] $ /bin/bash -l /tmp/jenkins13692876681415229004.sh
---> logs-deploy.sh
Setup pyenv:
  system
  3.8.13
  3.9.13
  3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-ask-all-calcium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-fQDw from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: lftools 
lf-activate-venv(): INFO: Adding /tmp/venv-fQDw/bin to PATH
WARNING: Nexus logging server not set
INFO: S3 path logs/releng/vex-yul-odl-jenkins-1/controller-csit-3node-clustering-ask-all-calcium/32/
INFO: archiving logs to S3
---> uname -a:
Linux prd-centos8-robot-2c-8g-9657.novalocal 4.18.0-547.el8.x86_64 #1 SMP Wed Mar 20 00:35:01 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux


---> lscpu:
Architecture:        x86_64
CPU op-mode(s):      32-bit, 64-bit
Byte Order:          Little Endian
CPU(s):              2
On-line CPU(s) list: 0,1
Thread(s) per core:  1
Core(s) per socket:  1
Socket(s):           2
NUMA node(s):        1
Vendor ID:           AuthenticAMD
CPU family:          23
Model:               49
Model name:          AMD EPYC-Rome Processor
Stepping:            0
CPU MHz:             2799.996
BogoMIPS:            5599.99
Virtualization:      AMD-V
Hypervisor vendor:   KVM
Virtualization type: full
L1d cache:           32K
L1i cache:           32K
L2 cache:            512K
L3 cache:            16384K
NUMA node0 CPU(s):   0,1
Flags:               fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities


---> nproc:
2


---> df -h:
Filesystem      Size  Used Avail Use% Mounted on
devtmpfs        3.8G     0  3.8G   0% /dev
tmpfs           3.8G     0  3.8G   0% /dev/shm
tmpfs           3.8G   17M  3.8G   1% /run
tmpfs           3.8G     0  3.8G   0% /sys/fs/cgroup
/dev/vda1        40G  9.6G   31G  24% /
tmpfs           770M     0  770M   0% /run/user/1001


---> free -m:
              total        used        free      shared  buff/cache   available
Mem:           7697         677        4584          19        2436        6723
Swap:          1023           0        1023


---> ip addr:
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host 
       valid_lft forever preferred_lft forever
2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1458 qdisc mq state UP group default qlen 1000
    link/ether fa:16:3e:a8:0f:7e brd ff:ff:ff:ff:ff:ff
    altname enp0s3
    altname ens3
    inet 10.30.170.150/23 brd 10.30.171.255 scope global dynamic noprefixroute eth0
       valid_lft 74104sec preferred_lft 74104sec
    inet6 fe80::f816:3eff:fea8:f7e/64 scope link 
       valid_lft forever preferred_lft forever


---> sar -b -r -n DEV:
Linux 4.18.0-547.el8.x86_64 (prd-centos8-robot-2c-8g-9657.novalocal) 	04/21/2024 	_x86_64_	(2 CPU)

12:00:01 AM       tps      rtps      wtps   bread/s   bwrtn/s
12:01:01 AM      1.02      0.02      1.00      0.13    197.12
12:02:02 AM      0.48      0.07      0.42      1.73      8.64
12:03:01 AM      0.27      0.00      0.27      0.00      3.13
12:04:01 AM     10.48      6.58      3.90    566.88   2798.37
12:05:01 AM     15.71     10.25      5.47    150.77   3260.22
12:06:01 AM      0.68      0.02      0.67      0.13     11.08
12:07:01 AM      0.45      0.00      0.45      0.00     10.83
12:08:01 AM      0.75      0.07      0.68      7.60     29.22
12:09:01 AM      0.68      0.00      0.68      0.00      8.76
12:10:01 AM      0.53      0.00      0.53      0.00     11.06
12:11:01 AM      0.30      0.00      0.30      0.00      3.62
12:12:01 AM      0.25      0.00      0.25      0.00      3.20
12:13:01 AM      0.17      0.00      0.17      0.00     17.61
12:14:01 AM      0.37      0.00      0.37      0.00     18.41
12:15:01 AM      0.17      0.00      0.17      0.00      8.42
12:16:01 AM      0.22      0.00      0.22      0.00     17.63
12:17:01 AM      0.40      0.00      0.40      0.00     14.58
12:18:01 AM      0.35      0.00      0.35      0.00     15.44
12:19:01 AM      0.37      0.00      0.37      0.00     25.33
12:20:01 AM      0.27      0.00      0.27      0.00      6.63
12:21:01 AM      0.22      0.00      0.22      0.00      2.30
12:22:01 AM      0.22      0.00      0.22      0.00      5.08
12:23:01 AM      0.15      0.00      0.15      0.00      1.57
12:24:01 AM      0.28      0.00      0.28      0.00      4.67
12:25:01 AM      0.18      0.00      0.18      0.00      4.67
12:26:01 AM      0.13      0.00      0.13      0.00      0.92
12:27:01 AM      0.30      0.00      0.30      0.00     20.16
12:28:01 AM      0.22      0.00      0.22      0.00      2.00
12:29:01 AM      0.38      0.00      0.38      0.00      8.63
12:30:01 AM      0.15      0.00      0.15      0.00      1.47
12:31:01 AM      0.32      0.00      0.32      0.00      8.88
12:32:01 AM      1.62      0.30      1.32      6.40     25.12
12:33:01 AM      0.30      0.00      0.30      0.00     11.33
12:34:01 AM      0.28      0.00      0.28      0.00      4.50
12:35:01 AM      0.15      0.00      0.15      0.00     19.09
12:36:01 AM      0.17      0.00      0.17      0.00     14.01
12:37:01 AM      0.22      0.00      0.22      0.00      9.78
12:38:01 AM      0.22      0.00      0.22      0.00     16.26
12:39:01 AM      0.32      0.00      0.32      0.00     17.63
12:40:01 AM      0.35      0.00      0.35      0.00     15.21
12:41:01 AM      0.22      0.00      0.22      0.00      8.33
12:42:01 AM      0.20      0.00      0.20      0.00     21.91
12:43:01 AM      0.13      0.00      0.13      0.00      1.70
12:44:01 AM      0.18      0.00      0.18      0.00      2.28
12:45:01 AM      0.27      0.00      0.27      0.00      6.98
12:46:01 AM      0.17      0.00      0.17      0.00      2.75
12:47:01 AM      0.28      0.00      0.28      0.00      6.96
12:48:01 AM      0.27      0.00      0.27      0.00      3.58
12:49:01 AM      0.20      0.00      0.20      0.00     14.98
12:50:01 AM      0.25      0.00      0.25      0.00      4.72
12:51:01 AM      0.17      0.00      0.17      0.00      7.50
12:52:01 AM      0.47      0.00      0.47      0.00      8.81
12:53:01 AM      0.22      0.00      0.22      0.00     21.28
12:54:01 AM      0.32      0.00      0.32      0.00      4.23
12:55:01 AM      0.25      0.00      0.25      0.00      4.17
12:56:01 AM      0.20      0.00      0.20      0.00      8.42
12:57:01 AM      0.10      0.00      0.10      0.00      0.65
12:58:01 AM      0.15      0.00      0.15      0.00     20.13
12:59:01 AM      0.18      0.00      0.18      0.00     14.86
01:00:01 AM      0.25      0.00      0.25      0.00     10.33
01:01:01 AM      0.34      0.03      0.30      0.27     16.71
01:02:01 AM      0.28      0.00      0.28      0.00     17.76
01:03:01 AM      0.23      0.00      0.23      0.00     13.23
01:04:01 AM      0.32      0.00      0.32      0.00     25.31
01:05:01 AM      0.22      0.00      0.22      0.00      3.17
01:06:01 AM      0.22      0.00      0.22      0.00      2.57
01:07:01 AM      0.12      0.00      0.12      0.00      3.62
01:08:01 AM      0.17      0.00      0.17      0.00      1.72
01:09:01 AM      0.32      0.00      0.32      0.00      8.50
01:10:01 AM      0.15      0.00      0.15      0.00      1.70
01:11:01 AM      0.17      0.00      0.17      0.00     18.46
01:12:01 AM      0.43      0.00      0.43      0.00      7.53
01:13:01 AM      0.18      0.00      0.18      0.00      1.75
01:14:01 AM      0.32      0.00      0.32      0.00      8.53
01:15:01 AM      0.10      0.00      0.10      0.00      1.18
01:16:01 AM      0.27      0.00      0.27      0.00      9.13
01:17:01 AM      0.38      0.00      0.38      0.00     11.91
01:18:01 AM      0.15      0.00      0.15      0.00      1.62
01:19:01 AM      0.48      0.00      0.48      0.00      8.02
01:20:01 AM      0.20      0.00      0.20      0.00     25.89
01:21:01 AM      0.20      0.00      0.20      0.00     10.58
01:22:01 AM      0.20      0.00      0.20      0.00     15.34
01:23:01 AM      0.30      0.00      0.30      0.00     15.74
01:24:01 AM      0.82      0.00      0.82      0.00     21.74
01:25:01 AM      0.62      0.00      0.62      0.00     17.05
01:26:01 AM      0.37      0.00      0.37      0.00     22.21
01:27:01 AM      0.17      0.00      0.17      0.00      4.92
01:28:01 AM      0.12      0.00      0.12      0.00      1.57
01:29:01 AM      0.30      0.00      0.30      0.00      7.70
01:30:01 AM      0.15      0.00      0.15      0.00      1.77
01:31:01 AM      0.28      0.00      0.28      0.00      5.13
01:32:01 AM      0.20      0.00      0.20      0.00      3.00
01:33:01 AM      1.02      0.00      1.02      0.00     16.66
01:34:01 AM      0.45      0.00      0.45      0.00     18.90
01:35:01 AM      0.40      0.00      0.40      0.00     15.64
01:36:01 AM      0.13      0.00      0.13      0.00      1.77
01:37:01 AM      0.15      0.00      0.15      0.00      1.45
01:38:01 AM      0.12      0.00      0.12      0.00     12.68
01:39:01 AM      0.43      0.00      0.43      0.00     20.00
01:40:01 AM      0.32      0.00      0.32      0.00     19.76
01:41:01 AM      0.15      0.00      0.15      0.00      7.92
01:42:01 AM      0.23      0.00      0.23      0.00     15.76
01:43:01 AM      0.15      0.00      0.15      0.00     14.78
01:44:01 AM      0.28      0.00      0.28      0.00     24.39
01:45:01 AM      0.15      0.00      0.15      0.00      7.33
01:46:01 AM      0.23      0.00      0.23      0.00     15.06
01:47:01 AM      0.15      0.00      0.15      0.00      7.88
01:48:01 AM      0.15      0.00      0.15      0.00     14.00
01:49:01 AM      0.28      0.00      0.28      0.00     11.18
01:50:01 AM      0.15      0.00      0.15      0.00     41.19
01:51:01 AM      0.20      0.00      0.20      0.00     14.45
01:52:01 AM      0.18      0.00      0.18      0.00      9.50
01:53:01 AM      0.27      0.00      0.27      0.00     16.95
01:54:01 AM      0.38      0.00      0.38      0.00     19.60
01:55:01 AM      0.13      0.00      0.13      0.00      9.33
01:56:01 AM      0.15      0.00      0.15      0.00     16.00
01:57:01 AM      0.12      0.00      0.12      0.00     18.33
01:58:02 AM      0.13      0.00      0.13      0.00      1.98
01:59:01 AM      0.17      0.00      0.17      0.00      2.22
02:00:01 AM      0.28      0.00      0.28      0.00      7.25
02:01:01 AM      0.30      0.00      0.30      0.00      3.77
02:02:01 AM      0.30      0.00      0.30      0.00      6.80
02:03:01 AM      0.25      0.00      0.25      0.00      3.75
02:04:01 AM      0.22      0.00      0.22      0.00     13.45
02:05:01 AM      0.27      0.00      0.27      0.00      4.72
02:06:01 AM      0.12      0.00      0.12      0.00      1.32
02:07:01 AM      0.28      0.00      0.28      0.00      4.85
02:08:01 AM      0.50      0.00      0.50      0.00     10.95
02:09:01 AM      0.50      0.00      0.50      0.00     14.16
02:10:01 AM      0.43      0.00      0.43      0.00     15.54
02:11:01 AM      0.22      0.00      0.22      0.00     15.13
02:12:01 AM      0.20      0.00      0.20      0.00     14.80
02:13:01 AM      0.17      0.00      0.17      0.00      9.73
02:14:01 AM      0.30      0.00      0.30      0.00     16.11
02:15:01 AM      0.32      0.00      0.32      0.00     10.60
02:16:01 AM      0.23      0.00      0.23      0.00     23.46
02:17:01 AM      0.15      0.00      0.15      0.00      7.35
02:18:01 AM      0.22      0.00      0.22      0.00      2.98
02:19:01 AM      0.30      0.00      0.30      0.00      5.17
02:20:01 AM      0.15      0.00      0.15      0.00      4.00
02:21:01 AM      0.40      0.00      0.40      0.00      5.40
02:22:01 AM      0.22      0.00      0.22      0.00      4.95
02:23:01 AM      0.18      0.00      0.18      0.00      1.88
02:24:01 AM      0.32      0.00      0.32      0.00     39.05
02:25:01 AM      0.22      0.00      0.22      0.00      9.91
02:26:01 AM      0.18      0.00      0.18      0.00     16.45
02:27:01 AM      0.25      0.00      0.25      0.00     15.63
02:28:01 AM      0.20      0.00      0.20      0.00     15.21
02:29:01 AM      0.32      0.00      0.32      0.00     12.51
02:30:01 AM      0.15      0.00      0.15      0.00     22.26
02:31:01 AM      0.30      0.00      0.30      0.00     12.70
02:32:01 AM      0.23      0.00      0.23      0.00      3.33
02:33:01 AM      0.12      0.00      0.12      0.00      1.32
02:34:01 AM      0.32      0.00      0.32      0.00      8.90
02:35:01 AM      0.18      0.00      0.18      0.00      1.75
02:36:01 AM      0.15      0.00      0.15      0.00      3.63
02:37:01 AM      0.22      0.00      0.22      0.00      2.28
02:38:01 AM      0.30      0.00      0.30      0.00     34.84
02:39:01 AM      0.37      0.00      0.37      0.00     17.19
02:40:01 AM      0.17      0.00      0.17      0.00     14.53
02:41:01 AM      0.20      0.00      0.20      0.00     14.29
02:42:01 AM      0.18      0.00      0.18      0.00      9.07
02:43:01 AM      0.17      0.00      0.17      0.00     13.20
02:44:01 AM      0.32      0.00      0.32      0.00     25.57
02:45:01 AM      0.25      0.00      0.25      0.00     11.98
02:46:01 AM      0.17      0.00      0.17      0.00      2.03
02:47:01 AM      0.17      0.00      0.17      0.00      2.15
02:48:01 AM      0.25      0.00      0.25      0.00      5.28
02:49:01 AM      0.32      0.00      0.32      0.00      5.57
02:50:01 AM      0.15      0.00      0.15      0.00      3.87
02:51:01 AM      0.18      0.00      0.18      0.00      2.00
02:52:01 AM      0.28      0.00      0.28      0.00     37.19
02:53:01 AM      0.22      0.00      0.22      0.00     16.28
02:54:01 AM      0.28      0.00      0.28      0.00     11.61
02:55:01 AM      0.20      0.00      0.20      0.00     15.25
02:56:01 AM      0.25      0.00      0.25      0.00     17.71
02:57:01 AM      0.20      0.00      0.20      0.00     11.18
02:58:01 AM      0.17      0.00      0.17      0.00     26.80
02:59:01 AM      0.32      0.00      0.32      0.00      8.10
03:00:01 AM      0.15      0.00      0.15      0.00      3.05
03:01:02 AM      0.27      0.00      0.27      0.00      2.82
03:02:01 AM      0.25      0.00      0.25      0.00      6.23
03:03:01 AM      0.12      0.00      0.12      0.00      1.18
03:04:01 AM      0.48      0.00      0.48      0.00      9.30
03:05:01 AM      0.50      0.00      0.50      0.00      4.88
03:06:01 AM      0.87      0.00      0.87      0.00     75.00
03:07:01 AM     13.26      0.22     13.05     31.99   2538.38
03:08:01 AM     24.28      0.42     23.86     48.25    927.26
Average:         0.61      0.10      0.52      4.33     62.64

12:00:01 AM kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty
12:01:01 AM   4958140   7007512   2924296     37.10      2688   2218992    725168      8.12    269448   2280812         8
12:02:02 AM   4958244   7007764   2924192     37.10      2688   2219140    725168      8.12    269540   2280672        12
12:03:01 AM   4958124   7007644   2924312     37.10      2688   2219140    725168      8.12    269540   2280672         8
12:04:01 AM   4599460   6818308   3282976     41.65      2688   2388248    926304     10.37    343960   2561640     70852
12:05:01 AM   4763484   7004812   3118952     39.57      2688   2410660    727976      8.15    383064   2360072        16
12:06:01 AM   4763576   7005084   3118860     39.57      2688   2410840    727976      8.15    383068   2359988       184
12:07:01 AM   4763004   7004512   3119432     39.57      2688   2410840    718740      8.05    383068   2360600         8
12:08:01 AM   4763480   7005812   3118956     39.57      2688   2411656    721324      8.08    383100   2361024        12
12:09:01 AM   4763556   7005888   3118880     39.57      2688   2411656    721324      8.08    383100   2361092         4
12:10:01 AM   4763244   7005748   3119192     39.57      2688   2411828    718740      8.05    383104   2361328         8
12:11:01 AM   4763408   7005916   3119028     39.57      2688   2411832    718740      8.05    383104   2361188         8
12:12:01 AM   4763512   7006084   3118924     39.57      2688   2411896    718740      8.05    383104   2361368        76
12:13:01 AM   4763012   7006060   3119424     39.57      2688   2412380    736716      8.25    383104   2361792        68
12:14:01 AM   4762572   7005960   3119864     39.58      2688   2412720    736716      8.25    383104   2362120        28
12:15:01 AM   4762256   7006008   3120180     39.58      2688   2413084    736716      8.25    383104   2362432       172
12:16:01 AM   4761744   7005852   3120692     39.59      2688   2413432    736716      8.25    383104   2362744        44
12:17:01 AM   4761572   7006020   3120864     39.59      2688   2413780    736716      8.25    383104   2363084        68
12:18:01 AM   4761220   7006036   3121216     39.60      2688   2414140    736716      8.25    383104   2363468        68
12:19:01 AM   4760504   7005876   3121932     39.61      2688   2414704    736716      8.25    383104   2364192        48
12:20:01 AM   4760088   7005536   3122348     39.61      2688   2414772    736716      8.25    383104   2364560        12
12:21:01 AM   4760400   7005844   3122036     39.61      2688   2414776    736716      8.25    383104   2364408         8
12:22:01 AM   4760012   7005536   3122424     39.61      2688   2414856    736716      8.25    383104   2364604        12
12:23:01 AM   4760332   7005856   3122104     39.61      2688   2414856    736716      8.25    383104   2364296         8
12:24:01 AM   4760192   7005796   3122244     39.61      2688   2414936    736716      8.25    383104   2364444        96
12:25:01 AM   4760256   7005860   3122180     39.61      2688   2414936    736716      8.25    383104   2364376         8
12:26:01 AM   4759524   7005624   3122912     39.62      2688   2415432    736716      8.25    383104   2365132       508
12:27:01 AM   4759616   7005720   3122820     39.62      2688   2415436    736716      8.25    383104   2365144         8
12:28:01 AM   4759652   7005804   3122784     39.62      2688   2415520    736716      8.25    383104   2365184        96
12:29:01 AM   4759360   7005548   3123076     39.62      2688   2415520    736716      8.25    383104   2365288         8
12:30:01 AM   4759076   7005264   3123360     39.62      2688   2415520    718936      8.05    383104   2365684         8
12:31:01 AM   4759120   7005500   3123316     39.62      2688   2415708    718936      8.05    383104   2365500         4
12:32:01 AM   4758792   7005368   3123644     39.63      2688   2415904    718936      8.05    383208   2365668         8
12:33:01 AM   4758508   7005320   3123928     39.63      2688   2416140    718936      8.05    383208   2365912         8
12:34:01 AM   4758364   7005176   3124072     39.63      2688   2416140    718936      8.05    383208   2366120        16
12:35:01 AM   4758000   7005400   3124436     39.64      2688   2416728    734320      8.22    383208   2366592        68
12:36:01 AM   4757560   7005312   3124876     39.64      2688   2417080    734320      8.22    383208   2366964        36
12:37:01 AM   4757288   7005384   3125148     39.65      2688   2417432    734320      8.22    383208   2367232       140
12:38:01 AM   4756840   7005296   3125596     39.65      2688   2417792    734320      8.22    383208   2367748        60
12:39:01 AM   4756388   7005196   3126048     39.66      2688   2418136    734320      8.22    383208   2368152        28
12:40:01 AM   4755772   7004940   3126664     39.67      2688   2418496    738392      8.27    383208   2368784        36
12:41:01 AM   4755316   7005128   3127120     39.67      2688   2419136    738392      8.27    383220   2369380       484
12:42:01 AM   4754416   7004332   3128020     39.68      2688   2419240    738392      8.27    383220   2369912         8
12:43:01 AM   4754612   7004528   3127824     39.68      2688   2419240    738392      8.27    383220   2369780         4
12:44:01 AM   4754856   7004852   3127580     39.68      2688   2419320    738392      8.27    383220   2369792        96
12:45:01 AM   4754552   7004548   3127884     39.68      2688   2419320    738392      8.27    383220   2369780        16
12:46:01 AM   4755000   7005076   3127436     39.68      2688   2419400    738392      8.27    383220   2369504        96
12:47:01 AM   4754336   7004416   3128100     39.68      2688   2419404    738392      8.27    383220   2370164         8
12:48:01 AM   4754704   7004788   3127732     39.68      2688   2419404    738392      8.27    383224   2369752         8
12:49:01 AM   4754408   7004856   3128028     39.68      2688   2419768    738392      8.27    383232   2370172        16
12:50:01 AM   4754064   7004516   3128372     39.69      2688   2419772    721256      8.08    383232   2370464         8
12:51:01 AM   4753960   7004604   3128476     39.69      2688   2419960    721256      8.08    383240   2370500         4
12:52:01 AM   4754100   7004748   3128336     39.69      2688   2419964    721256      8.08    383268   2370280         4
12:53:01 AM   4753392   7004592   3129044     39.70      2688   2420516    721256      8.08    383268   2370844         8
12:54:01 AM   4753284   7004484   3129152     39.70      2688   2420516    721256      8.08    383268   2371028        12
12:55:01 AM   4753364   7004760   3129072     39.70      2688   2420712    721256      8.08    383276   2371040       208
12:56:01 AM   4753440   7004836   3128996     39.70      2688   2420712    721256      8.08    383276   2371040         4
12:57:01 AM   4752908   7004628   3129528     39.70      2688   2421036    739872      8.28    383276   2371508       340
12:58:01 AM   4752524   7004584   3129912     39.71      2688   2421384    739872      8.28    383276   2371956       112
12:59:01 AM   4752392   7004812   3130044     39.71      2688   2421744    739872      8.28    383276   2372180        80
01:00:01 AM   4751076   7003836   3131360     39.73      2688   2422076    728928      8.16    383276   2373148       204
01:01:01 AM   4750596   7003704   3131840     39.73      2688   2422424    728928      8.16    383280   2373520       168
01:02:01 AM   4750848   7004308   3131588     39.73      2688   2422776    728928      8.16    383284   2373496       104
01:03:01 AM   4750404   7004468   3132032     39.73      2688   2423388    728928      8.16    383284   2373844       364
01:04:01 AM   4750284   7004592   3132152     39.74      2688   2423624    728928      8.16    383284   2374156        12
01:05:01 AM   4750144   7004452   3132292     39.74      2688   2423624    728928      8.16    383284   2374360         4
01:06:01 AM   4750496   7004812   3131940     39.73      2688   2423632    728928      8.16    383284   2374092        16
01:07:01 AM   4750196   7004588   3132240     39.74      2688   2423708    728928      8.16    383284   2374308        12
01:08:01 AM   4750292   7004684   3132144     39.74      2688   2423708    728928      8.16    383284   2374308         8
01:09:01 AM   4749896   7004364   3132540     39.74      2688   2423784    728928      8.16    383284   2374636         8
01:10:01 AM   4749900   7004372   3132536     39.74      2688   2423788    727412      8.14    383284   2374600         4
01:11:01 AM   4749568   7004556   3132868     39.74      2688   2424304    727412      8.14    383284   2374964         4
01:12:01 AM   4749588   7004572   3132848     39.74      2688   2424308    727412      8.14    383280   2374808         4
01:13:01 AM   4749888   7004960   3132548     39.74      2688   2424396    727412      8.14    383280   2374684        96
01:14:01 AM   4749524   7004596   3132912     39.75      2688   2424396    727412      8.14    383280   2374888        16
01:15:01 AM   4749896   7005172   3132540     39.74      2688   2424600    727412      8.14    383280   2374784       212
01:16:01 AM   4749856   7005132   3132580     39.74      2688   2424600    727412      8.14    383280   2374784         4
01:17:01 AM   4749600   7005112   3132836     39.74      2688   2424836    727412      8.14    383280   2375028         4
01:18:01 AM   4749480   7004996   3132956     39.75      2688   2424840    727412      8.14    383280   2375032         4
01:19:01 AM   4746928   7002788   3135508     39.78      2688   2425192    742800      8.32    383280   2377496       360
01:20:01 AM   4748428   7004664   3134008     39.76      2688   2425560    715028      8.01    383280   2376128         4
01:21:01 AM   4748232   7004824   3134204     39.76      2688   2425920    730420      8.18    383280   2376328        96
01:22:01 AM   4747940   7004896   3134496     39.77      2688   2426272    730420      8.18    383280   2376612        64
01:23:01 AM   4747728   7005024   3134708     39.77      2688   2426612    730420      8.18    383280   2376968        16
01:24:01 AM   4746984   7004644   3135452     39.78      2688   2426976    730420      8.18    383280   2377480         0
01:25:01 AM   4746864   7004884   3135572     39.78      2688   2427336    730420      8.18    383280   2377836        40
01:26:01 AM   4746548   7005084   3135888     39.78      2688   2427852    730420      8.18    383280   2378276        24
01:27:01 AM   4746252   7004860   3136184     39.79      2688   2427924    730420      8.18    383280   2378216         4
01:28:01 AM   4746096   7004704   3136340     39.79      2688   2427924    730420      8.18    383280   2378620         4
01:29:01 AM   4746332   7005020   3136104     39.79      2688   2428004    730420      8.18    383280   2378516        12
01:30:01 AM   4745812   7004508   3136624     39.79      2688   2428012    726892      8.14    383280   2378688         8
01:31:01 AM   4745828   7004600   3136608     39.79      2688   2428088    726892      8.14    383280   2378628         4
01:32:01 AM   4745788   7004564   3136648     39.79      2688   2428092    721196      8.08    392424   2369648       252
01:33:01 AM   4745004   7004132   3137432     39.80      2688   2428444    721196      8.08    392432   2370096       360
01:34:01 AM   4745264   7004392   3137172     39.80      2688   2428444    721196      8.08    392432   2369916         4
01:35:01 AM   4745372   7004864   3137064     39.80      2688   2428808    721196      8.08    392436   2370056         4
01:36:01 AM   4745456   7004948   3136980     39.80      2688   2428808    721196      8.08    392436   2369976         4
01:37:01 AM   4745380   7004968   3137056     39.80      2688   2428904    721196      8.08    392436   2370072       104
01:38:01 AM   4742900   7002932   3139536     39.83      2688   2429356    721196      8.08    392436   2372600       200
01:39:01 AM   4742148   7002528   3140288     39.84      2688   2429696    721196      8.08    392436   2373136       160
01:40:01 AM   4741572   7002304   3140864     39.85      2688   2430048    753332      8.44    392436   2373676        24
01:41:01 AM   4741536   7002620   3140900     39.85      2688   2430412    733868      8.22    392436   2374048       184
01:42:01 AM   4741128   7002552   3141308     39.85      2688   2430752    733868      8.22    392436   2374316       136
01:43:01 AM   4740792   7002576   3141644     39.86      2688   2431104    733868      8.22    392436   2374480        88
01:44:01 AM   4740424   7002748   3142012     39.86      2688   2431644    733868      8.22    392436   2375120        56
01:45:01 AM   4740268   7002864   3142168     39.86      2688   2431924    733868      8.22    392436   2375440       148
01:46:01 AM   4739908   7002788   3142528     39.87      2688   2432208    733868      8.22    392436   2375608        56
01:47:01 AM   4739172   7002336   3143264     39.88      2688   2432492    733868      8.22    392436   2376352       160
01:48:01 AM   4739152   7002600   3143284     39.88      2688   2432776    733868      8.22    392436   2376296        56
01:49:01 AM   4738964   7002692   3143472     39.88      2688   2433056    733868      8.22    392436   2376528       156
01:50:01 AM   4739476   7004320   3142960     39.87      2688   2434164    730636      8.18    392444   2375884        60
01:51:01 AM   4739316   7004516   3143120     39.87      2688   2434520    730636      8.18    392444   2376108        24
01:52:01 AM   4739172   7004728   3143264     39.88      2688   2434884    730636      8.18    392444   2376308       168
01:53:01 AM   4738540   7004456   3143896     39.88      2688   2435236    730636      8.18    392444   2376820        96
01:54:01 AM   4738304   7004580   3144132     39.89      2688   2435592    730636      8.18    392444   2377172        40
01:55:01 AM   4737760   7004400   3144676     39.89      2688   2435956    730636      8.18    392444   2377468       156
01:56:01 AM   4737316   7004660   3145120     39.90      2688   2436668    730636      8.18    392444   2378172       416
01:57:01 AM   4737136   7004604   3145300     39.90      2688   2436784    730636      8.18    392444   2378308         8
01:58:02 AM   4737140   7004612   3145296     39.90      2688   2436788    730636      8.18    392444   2378428         4
01:59:01 AM   4737008   7004560   3145428     39.90      2688   2436868    730636      8.18    392444   2378468        96
02:00:01 AM   4736856   7004408   3145580     39.91      2688   2436868    727280      8.14    392444   2378752         8
02:01:01 AM   4735868   7003424   3146568     39.92      2688   2436872    727280      8.14    392444   2379312         8
02:02:01 AM   4736580   7004212   3145856     39.91      2688   2436948    727280      8.14    392452   2378836        12
02:03:01 AM   4736360   7003996   3146076     39.91      2688   2436952    727280      8.14    392452   2378896         4
02:04:01 AM   4735380   7003360   3147056     39.92      2688   2437296    727280      8.14    392456   2379924        16
02:05:01 AM   4735480   7003460   3146956     39.92      2688   2437296    727280      8.14    392456   2379996        12
02:06:01 AM   4735240   7003280   3147196     39.93      2688   2437356    727280      8.14    392456   2380064        68
02:07:01 AM   4734936   7003148   3147500     39.93      2688   2437528    727280      8.14    392460   2380392       180
02:08:01 AM   4735016   7003228   3147420     39.93      2688   2437528    727280      8.14    392460   2380276         8
02:09:01 AM   4734792   7003316   3147644     39.93      2688   2437848    743668      8.33    392460   2380664        52
02:10:01 AM   4734048   7002936   3148388     39.94      2688   2438212    718032      8.04    392460   2381308       120
02:11:01 AM   4733452   7002700   3148984     39.95      2688   2438564    718032      8.04    392460   2381792        68
02:12:01 AM   4733232   7002800   3149204     39.95      2688   2438884    718032      8.04    392460   2382076         8
02:13:01 AM   4733328   7003248   3149108     39.95      2688   2439236    718032      8.04    392460   2382128       108
02:14:01 AM   4732928   7003144   3149508     39.96      2688   2439540    718032      8.04    392460   2382492        32
02:15:01 AM   4732300   7003124   3150136     39.96      2688   2440140    718032      8.04    392460   2382920       444
02:16:01 AM   4732180   7003264   3150256     39.97      2688   2440408    718032      8.04    392460   2383184        60
02:17:01 AM   4732072   7003336   3150364     39.97      2688   2440580    733832      8.22    392460   2383368        44
02:18:01 AM   4731960   7003224   3150476     39.97      2688   2440580    733832      8.22    392460   2383368         8
02:19:01 AM   4731892   7003236   3150544     39.97      2688   2440660    733832      8.22    392460   2383516        92
02:20:01 AM   4731444   7002792   3150992     39.97      2688   2440664    732760      8.20    392460   2383800         8
02:21:01 AM   4731636   7002992   3150800     39.97      2688   2440676    732760      8.20    392460   2383772        20
02:22:01 AM   4731888   7003320   3150548     39.97      2688   2440744    732760      8.20    392460   2383532         8
02:23:01 AM   4731636   7003072   3150800     39.97      2688   2440748    732760      8.20    392460   2383652         8
02:24:01 AM   4730464   7003008   3151972     39.99      2688   2441856    732760      8.20    392460   2384868       116
02:25:01 AM   4730276   7003164   3152160     39.99      2688   2442196    732760      8.20    392460   2384996       212
02:26:01 AM   4730036   7003280   3152400     39.99      2688   2442560    732760      8.20    392460   2385352       124
02:27:01 AM   4729516   7003104   3152920     40.00      2688   2442904    732760      8.20    392460   2385696        68
02:28:01 AM   4729304   7003248   3153132     40.00      2688   2443252    732760      8.20    392460   2386052         8
02:29:01 AM   4728744   7003052   3153692     40.01      2688   2443616    732760      8.20    392460   2386668       164
02:30:01 AM   4727388   7002356   3155048     40.03      2688   2444276    728840      8.16    392460   2387704       196
02:31:01 AM   4728128   7003200   3154308     40.02      2688   2444380    728840      8.16    392460   2387428         8
02:32:01 AM   4727604   7002676   3154832     40.02      2688   2444380    728840      8.16    392460   2387568        16
02:33:01 AM   4727408   7002560   3155028     40.03      2688   2444460    728840      8.16    392460   2387800       100
02:34:01 AM   4727540   7002696   3154896     40.02      2688   2444464    728840      8.16    392460   2387892         8
02:35:01 AM   4727852   7003016   3154584     40.02      2688   2444472    728840      8.16    392460   2387488        20
02:36:01 AM   4727716   7002948   3154720     40.02      2688   2444540    728840      8.16    392460   2387560        12
02:37:01 AM   4727988   7003224   3154448     40.02      2688   2444544    728840      8.16    392460   2387448         8
02:38:01 AM   4726780   7003092   3155656     40.03      2688   2445628    726432      8.13    392460   2388540       140
02:39:01 AM   4726324   7002952   3156112     40.04      2688   2445936    726432      8.13    392460   2389040       104
02:40:01 AM   4725504   7002488   3156932     40.05      2688   2446292    741844      8.31    392460   2389448        60
02:41:01 AM   4725588   7002928   3156848     40.05      2688   2446644    741844      8.31    392460   2389776        28
02:42:01 AM   4725320   7003004   3157116     40.05      2688   2446988    741844      8.31    392460   2390116       164
02:43:01 AM   4724980   7003016   3157456     40.06      2688   2447340    741844      8.31    392460   2390256       156
02:44:01 AM   4724268   7002932   3158168     40.07      2688   2447964    741844      8.31    392460   2391140       164
02:45:01 AM   4723904   7002688   3158532     40.07      2688   2448084    741844      8.31    392460   2391336         8
02:46:01 AM   4723760   7002544   3158676     40.07      2688   2448084    741844      8.31    392460   2391404         8
02:47:01 AM   4723896   7002760   3158540     40.07      2688   2448164    741844      8.31    392460   2391484        92
02:48:01 AM   4723556   7002424   3158880     40.07      2688   2448168    741844      8.31    392460   2391608         8
02:49:01 AM   4723896   7002764   3158540     40.07      2688   2448176    741844      8.31    392460   2391352        20
02:50:01 AM   4723448   7002396   3158988     40.08      2688   2448248    741844      8.31    392460   2391852         8
02:51:01 AM   4724160   7003112   3158276     40.07      2688   2448252    741844      8.31    392460   2391308         8
02:52:01 AM   4722668   7002708   3159768     40.09      2688   2449348    741844      8.31    392460   2392512       108
02:53:01 AM   4722516   7002920   3159920     40.09      2688   2449712    725740      8.13    392460   2392760        44
02:54:01 AM   4722000   7002764   3160436     40.09      2688   2450064    725740      8.13    392460   2393196       200
02:55:01 AM   4721460   7002568   3160976     40.10      2688   2450408    725740      8.13    392460   2393700       144
02:56:01 AM   4720812   7002272   3161624     40.11      2688   2450768    725740      8.13    392460   2394236        56
02:57:01 AM   4720576   7002396   3161860     40.11      2688   2451120    725740      8.13    392460   2394592       140
02:58:01 AM   4720348   7002808   3162088     40.12      2688   2451760    725740      8.13    392460   2394848         8
02:59:01 AM   4720288   7002868   3162148     40.12      2688   2451880    725740      8.13    392460   2395040        52
03:00:01 AM   4719912   7002496   3162524     40.12      2688   2451884    724400      8.11    392460   2395440         8
03:01:02 AM   4718396   7001060   3164040     40.14      2688   2451960    724400      8.11    392460   2395972        88
03:02:01 AM   4719700   7002368   3162736     40.12      2688   2451964    724400      8.11    392460   2395280         8
03:03:01 AM   4719036   7001704   3163400     40.13      2688   2451972    724400      8.11    392460   2395696        20
03:04:01 AM   4719868   7002620   3162568     40.12      2688   2452044    724400      8.11    392460   2395216         8
03:05:01 AM   4719672   7002428   3162764     40.12      2688   2452048    724400      8.11    392460   2395156         8
03:06:01 AM   4765260   7055128   3117176     39.55      2688   2459136    632124      7.08    393344   2348148      5224
03:07:01 AM   4773412   6945420   3109024     39.44      2688   2346808    707872      7.93    456940   2296900     13200
03:08:01 AM   4758644   6935780   3123792     39.63      2688   2352084    745996      8.35    614600   2156664     16148
Average:      4745841   7002733   3136595     39.79      2688   2426274    730629      8.18    387485   2374635       630

12:00:01 AM     IFACE   rxpck/s   txpck/s    rxkB/s    txkB/s   rxcmp/s   txcmp/s  rxmcst/s   %ifutil
12:01:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:01:01 AM      eth0      0.68      0.15      0.06      0.02      0.00      0.00      0.00      0.00
12:02:02 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:02:02 AM      eth0      0.95      0.47      0.12      0.05      0.00      0.00      0.00      0.00
12:03:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:03:01 AM      eth0      0.88      0.08      0.17      0.01      0.00      0.00      0.00      0.00
12:04:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:04:01 AM      eth0    151.82    119.61   1373.65      8.49      0.00      0.00      0.00      0.00
12:05:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:05:01 AM      eth0      1.32      0.35      0.42      0.27      0.00      0.00      0.00      0.00
12:06:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:06:01 AM      eth0      3.90      3.63      0.75      0.27      0.00      0.00      0.00      0.00
12:07:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:07:01 AM      eth0      0.45      0.15      0.02      0.01      0.00      0.00      0.00      0.00
12:08:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:08:01 AM      eth0     25.72     25.92      4.27      1.82      0.00      0.00      0.00      0.00
12:09:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:09:01 AM      eth0      0.42      0.17      0.09      0.07      0.00      0.00      0.00      0.00
12:10:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:10:01 AM      eth0      5.10      4.93      0.84      0.36      0.00      0.00      0.00      0.00
12:11:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:11:01 AM      eth0      0.33      0.05      0.04      0.00      0.00      0.00      0.00      0.00
12:12:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:12:01 AM      eth0      2.10      2.17      0.43      0.39      0.00      0.00      0.00      0.00
12:13:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:13:01 AM      eth0     16.85     17.10      3.48      2.49      0.00      0.00      0.00      0.00
12:14:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:14:01 AM      eth0      9.75      9.83      2.11      1.88      0.00      0.00      0.00      0.00
12:15:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:15:01 AM      eth0      9.28      9.47      1.97      1.77      0.00      0.00      0.00      0.00
12:16:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:16:01 AM      eth0      9.25      9.50      1.98      1.75      0.00      0.00      0.00      0.00
12:17:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:17:01 AM      eth0      9.65      9.65      2.05      1.78      0.00      0.00      0.00      0.00
12:18:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:18:01 AM      eth0      9.45      9.73      2.02      1.81      0.00      0.00      0.00      0.00
12:19:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:19:01 AM      eth0     13.75     13.73      3.13      2.53      0.00      0.00      0.00      0.00
12:20:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:20:01 AM      eth0      0.58      0.37      0.08      0.05      0.00      0.00      0.00      0.00
12:21:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:21:01 AM      eth0      0.17      0.03      0.01      0.00      0.00      0.00      0.00      0.00
12:22:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:22:01 AM      eth0      0.58      0.37      0.08      0.05      0.00      0.00      0.00      0.00
12:23:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:23:01 AM      eth0      0.20      0.03      0.01      0.00      0.00      0.00      0.00      0.00
12:24:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:24:01 AM      eth0      0.73      0.43      0.15      0.11      0.00      0.00      0.00      0.00
12:25:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:25:01 AM      eth0      0.23      0.02      0.01      0.00      0.00      0.00      0.00      0.00
12:26:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:26:01 AM      eth0     19.83     20.03      3.69      1.79      0.00      0.00      0.00      0.00
12:27:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:27:01 AM      eth0      0.60      0.02      0.11      0.00      0.00      0.00      0.00      0.00
12:28:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:28:01 AM      eth0      5.12      4.93      0.84      0.35      0.00      0.00      0.00      0.00
12:29:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:29:01 AM      eth0      0.55      0.23      0.10      0.07      0.00      0.00      0.00      0.00
12:30:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:30:01 AM      eth0      0.18      0.05      0.01      0.00      0.00      0.00      0.00      0.00
12:31:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:31:01 AM      eth0      4.58      4.50      0.87      0.34      0.00      0.00      0.00      0.00
12:32:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:32:01 AM      eth0      0.77      0.12      0.15      0.07      0.00      0.00      0.00      0.00
12:33:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:33:01 AM      eth0     15.46     12.15      2.36      1.04      0.00      0.00      0.00      0.00
12:34:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:34:01 AM      eth0      1.65      0.28      0.45      0.26      0.00      0.00      0.00      0.00
12:35:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:35:01 AM      eth0     24.24     24.53      5.03      3.10      0.00      0.00      0.00      0.00
12:36:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:36:01 AM      eth0      9.55      9.60      2.04      1.80      0.00      0.00      0.00      0.00
12:37:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:37:01 AM      eth0      9.06      9.21      1.94      1.73      0.00      0.00      0.00      0.00
12:38:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:38:01 AM      eth0      9.35      9.65      2.01      1.81      0.00      0.00      0.00      0.00
12:39:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:39:01 AM      eth0      9.53      9.68      2.09      1.86      0.00      0.00      0.00      0.00
12:40:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:40:01 AM      eth0      9.18      9.45      1.97      1.77      0.00      0.00      0.00      0.00
12:41:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:41:01 AM      eth0     16.71     16.08      3.68      2.96      0.00      0.00      0.00      0.00
12:42:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:42:01 AM      eth0      1.47      0.63      0.50      0.32      0.00      0.00      0.00      0.00
12:43:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:43:01 AM      eth0      0.47      0.17      0.26      0.19      0.00      0.00      0.00      0.00
12:44:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:44:01 AM      eth0      1.67      1.70      0.47      5.08      0.00      0.00      0.00      0.00
12:45:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:45:01 AM      eth0      1.60      0.27      0.52      0.26      0.00      0.00      0.00      0.00
12:46:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:46:01 AM      eth0      0.55      0.25      0.12      0.04      0.00      0.00      0.00      0.00
12:47:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:47:01 AM      eth0      0.57      0.27      0.27      0.20      0.00      0.00      0.00      0.00
12:48:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:48:01 AM      eth0      0.20      0.05      0.01      0.00      0.00      0.00      0.00      0.00
12:49:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:49:01 AM      eth0     11.90     12.03      2.65      1.31      0.00      0.00      0.00      0.00
12:50:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:50:01 AM      eth0      0.12      0.02      0.01      0.00      0.00      0.00      0.00      0.00
12:51:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:51:01 AM      eth0      4.43      4.38      0.80      0.34      0.00      0.00      0.00      0.00
12:52:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:52:01 AM      eth0      0.32      0.12      0.02      0.01      0.00      0.00      0.00      0.00
12:53:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:53:01 AM      eth0     20.25     20.36      3.98      1.49      0.00      0.00      0.00      0.00
12:54:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:54:01 AM      eth0      0.55      0.12      0.16      0.06      0.00      0.00      0.00      0.00
12:55:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:55:01 AM      eth0      5.93      5.88      0.91      0.44      0.00      0.00      0.00      0.00
12:56:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:56:01 AM      eth0      0.15      0.05      0.01      0.00      0.00      0.00      0.00      0.00
12:57:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:57:01 AM      eth0     13.08     12.81      2.91      1.96      0.00      0.00      0.00      0.00
12:58:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:58:01 AM      eth0      9.46      9.56      2.10      1.90      0.00      0.00      0.00      0.00
12:59:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:59:01 AM      eth0      9.68      9.78      2.10      1.87      0.00      0.00      0.00      0.00
01:00:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:00:01 AM      eth0      9.08      9.38      1.94      1.74      0.00      0.00      0.00      0.00
01:01:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:01:01 AM      eth0      9.76      9.40      2.27      1.75      0.00      0.00      0.00      0.00
01:02:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:02:01 AM      eth0      9.50      9.65      2.22      1.95      0.00      0.00      0.00      0.00
01:03:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:03:01 AM      eth0     16.56     16.29      3.71      3.02      0.00      0.00      0.00      0.00
01:04:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:04:01 AM      eth0      5.17      3.23      1.06      0.68      0.00      0.00      0.00      0.00
01:05:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:05:01 AM      eth0      0.77      0.30      0.51      0.38      0.00      0.00      0.00      0.00
01:06:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:06:01 AM      eth0      0.55      0.05      0.06      0.00      0.00      0.00      0.00      0.00
01:07:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:07:01 AM      eth0      1.60      0.38      0.33      0.11      0.00      0.00      0.00      0.00
01:08:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:08:01 AM      eth0      6.38      0.27      1.01      0.26      0.00      0.00      0.00      0.00
01:09:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:09:01 AM      eth0      1.65      0.85      0.97      0.68      0.00      0.00      0.00      0.00
01:10:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:10:01 AM      eth0      0.30      0.05      0.02      0.00      0.00      0.00      0.00      0.00
01:11:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:11:01 AM      eth0     24.58     17.89      4.53      1.68      0.00      0.00      0.00      0.00
01:12:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:12:01 AM      eth0      1.35      0.08      0.13      0.00      0.00      0.00      0.00      0.00
01:13:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:13:01 AM      eth0      4.65      3.65      0.84      0.27      0.00      0.00      0.00      0.00
01:14:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:14:01 AM      eth0      1.17      0.47      0.40      0.34      0.00      0.00      0.00      0.00
01:15:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:15:01 AM      eth0      5.05      4.67      0.90      0.36      0.00      0.00      0.00      0.00
01:16:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:16:01 AM      eth0      1.57      0.00      0.23      0.00      0.00      0.00      0.00      0.00
01:17:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:17:01 AM      eth0     10.35      9.63      1.82      0.71      0.00      0.00      0.00      0.00
01:18:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:18:01 AM      eth0      0.32      0.02      0.02      0.00      0.00      0.00      0.00      0.00
01:19:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:19:01 AM      eth0     16.11     16.21      3.01      1.65      0.00      0.00      0.00      0.00
01:20:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:20:01 AM      eth0     10.03     10.13      2.11      1.88      0.00      0.00      0.00      0.00
01:21:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:21:01 AM      eth0      9.62      9.70      2.03      1.81      0.00      0.00      0.00      0.00
01:22:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:22:01 AM      eth0      9.35      9.60      2.01      1.80      0.00      0.00      0.00      0.00
01:23:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:23:01 AM      eth0     11.11      9.33      2.22      1.80      0.00      0.00      0.00      0.00
01:24:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:24:01 AM      eth0     12.95     10.06      2.94      2.25      0.00      0.00      0.00      0.00
01:25:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:25:01 AM      eth0     10.45     10.21      2.71      2.21      0.00      0.00      0.00      0.00
01:26:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:26:01 AM      eth0     12.60     12.53      2.82      2.26      0.00      0.00      0.00      0.00
01:27:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:27:01 AM      eth0      8.63      0.33      1.18      0.04      0.00      0.00      0.00      0.00
01:28:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:28:01 AM      eth0      1.62      0.18      0.33      0.19      0.00      0.00      0.00      0.00
01:29:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:29:01 AM      eth0      1.02      0.45      0.17      0.11      0.00      0.00      0.00      0.00
01:30:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:30:01 AM      eth0      0.42      0.05      0.02      0.00      0.00      0.00      0.00      0.00
01:31:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:31:01 AM      eth0      1.05      0.33      0.10      0.04      0.00      0.00      0.00      0.00
01:32:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:32:01 AM      eth0      0.98      0.10      0.17      0.07      0.00      0.00      0.00      0.00
01:33:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:33:01 AM      eth0     14.10     13.66      3.08      1.54      0.00      0.00      0.00      0.00
01:34:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:34:01 AM      eth0      0.28      0.20      0.11      0.08      0.00      0.00      0.00      0.00
01:35:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:35:01 AM      eth0     22.61     22.33      4.13      1.59      0.00      0.00      0.00      0.00
01:36:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:36:01 AM      eth0      0.35      0.08      0.02      0.00      0.00      0.00      0.00      0.00
01:37:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:37:01 AM      eth0      2.23      2.27      0.46      0.42      0.00      0.00      0.00      0.00
01:38:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:38:01 AM      eth0     16.96     17.20      3.51      2.47      0.00      0.00      0.00      0.00
01:39:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:39:01 AM      eth0      9.40      9.65      2.05      1.84      0.00      0.00      0.00      0.00
01:40:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:40:01 AM      eth0      9.45      9.58      2.00      1.78      0.00      0.00      0.00      0.00
01:41:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:41:01 AM      eth0     10.18      9.87      2.26      1.82      0.00      0.00      0.00      0.00
01:42:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:42:01 AM      eth0      9.16      9.30      1.95      1.74      0.00      0.00      0.00      0.00
01:43:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:43:01 AM      eth0      9.48      9.63      2.03      1.81      0.00      0.00      0.00      0.00
01:44:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:44:01 AM      eth0     13.13     12.46      3.01      2.35      0.00      0.00      0.00      0.00
01:45:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:45:01 AM      eth0      0.75      0.70      0.19      0.14      0.00      0.00      0.00      0.00
01:46:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:46:01 AM      eth0      0.57      0.60      0.18      0.13      0.00      0.00      0.00      0.00
01:47:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:47:01 AM      eth0      0.97      0.83      0.44      0.33      0.00      0.00      0.00      0.00
01:48:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:48:01 AM      eth0      0.63      0.60      0.18      0.13      0.00      0.00      0.00      0.00
01:49:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:49:01 AM      eth0      0.83      0.80      0.27      0.20      0.00      0.00      0.00      0.00
01:50:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:50:01 AM      eth0     47.47     48.53      9.36      4.73      0.00      0.00      0.00      0.00
01:51:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:51:01 AM      eth0      9.37      9.62      2.02      1.80      0.00      0.00      0.00      0.00
01:52:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:52:01 AM      eth0      9.46      9.73      2.02      1.81      0.00      0.00      0.00      0.00
01:53:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:53:01 AM      eth0      9.45      9.70      2.02      1.81      0.00      0.00      0.00      0.00
01:54:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:54:01 AM      eth0      9.52      9.73      2.09      1.87      0.00      0.00      0.00      0.00
01:55:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:55:01 AM      eth0      9.50      9.68      2.02      1.81      0.00      0.00      0.00      0.00
01:56:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:56:01 AM      eth0     18.58     18.45      4.14      3.42      0.00      0.00      0.00      0.00
01:57:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:57:01 AM      eth0      0.57      0.43      0.10      0.06      0.00      0.00      0.00      0.00
01:58:02 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:58:02 AM      eth0      0.12      0.00      0.01      0.00      0.00      0.00      0.00      0.00
01:59:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:59:01 AM      eth0      0.46      0.37      0.14      0.11      0.00      0.00      0.00      0.00
02:00:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:00:01 AM      eth0      0.22      0.07      0.01      0.00      0.00      0.00      0.00      0.00
02:01:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:01:01 AM      eth0      0.18      0.03      0.01      0.00      0.00      0.00      0.00      0.00
02:02:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:02:01 AM      eth0      1.05      0.42      0.21      0.11      0.00      0.00      0.00      0.00
02:03:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:03:01 AM      eth0      0.33      0.13      0.25      0.19      0.00      0.00      0.00      0.00
02:04:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:04:01 AM      eth0     13.40     13.13      2.78      1.44      0.00      0.00      0.00      0.00
02:05:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:05:01 AM      eth0      0.97      0.27      0.39      0.26      0.00      0.00      0.00      0.00
02:06:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:01 AM      eth0      3.15      2.98      1.12      0.39      0.00      0.00      0.00      0.00
02:07:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:07:01 AM      eth0      4.07      4.02      0.82      0.30      0.00      0.00      0.00      0.00
02:08:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:08:01 AM      eth0      0.10      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:09:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:09:01 AM      eth0     12.65     13.10      2.67      1.78      0.00      0.00      0.00      0.00
02:10:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:10:01 AM      eth0      9.38      9.68      2.02      1.81      0.00      0.00      0.00      0.00
02:11:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:11:01 AM      eth0     10.18      9.85      2.17      1.88      0.00      0.00      0.00      0.00
02:12:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:12:01 AM      eth0      8.83      9.07      2.09      1.86      0.00      0.00      0.00      0.00
02:13:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:13:01 AM      eth0      9.31      9.51      1.96      1.75      0.00      0.00      0.00      0.00
02:14:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:14:01 AM      eth0      8.30      8.53      1.79      1.70      0.00      0.00      0.00      0.00
02:15:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:15:01 AM      eth0     16.11     16.19      3.67      2.99      0.00      0.00      0.00      0.00
02:16:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:16:01 AM      eth0      3.42      3.27      0.69      0.59      0.00      0.00      0.00      0.00
02:17:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:17:01 AM      eth0      0.57      0.47      0.15      0.09      0.00      0.00      0.00      0.00
02:18:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:18:01 AM      eth0      0.35      0.00      0.06      0.00      0.00      0.00      0.00      0.00
02:19:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:19:01 AM      eth0      0.73      0.58      0.17      0.12      0.00      0.00      0.00      0.00
02:20:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:20:01 AM      eth0      0.08      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:21:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:21:01 AM      eth0      0.15      0.02      0.01      0.00      0.00      0.00      0.00      0.00
02:22:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:22:01 AM      eth0      0.45      0.40      0.07      0.05      0.00      0.00      0.00      0.00
02:23:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:23:01 AM      eth0      0.22      0.00      0.01      0.00      0.00      0.00      0.00      0.00
02:24:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:24:01 AM      eth0     73.18     73.91     14.47      7.10      0.00      0.00      0.00      0.00
02:25:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:25:01 AM      eth0      9.05      9.36      1.94      1.74      0.00      0.00      0.00      0.00
02:26:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:26:01 AM      eth0      9.38      9.65      2.02      1.81      0.00      0.00      0.00      0.00
02:27:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:27:01 AM      eth0      9.41      9.75      2.02      1.81      0.00      0.00      0.00      0.00
02:28:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:28:01 AM      eth0      9.00      9.35      1.94      1.74      0.00      0.00      0.00      0.00
02:29:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:29:01 AM      eth0     11.56      9.88      2.43      1.94      0.00      0.00      0.00      0.00
02:30:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:30:01 AM      eth0     17.01     17.06      4.00      3.28      0.00      0.00      0.00      0.00
02:31:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:31:01 AM      eth0      0.57      0.42      0.10      0.06      0.00      0.00      0.00      0.00
02:32:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:32:01 AM      eth0      6.35      0.18      0.81      0.07      0.00      0.00      0.00      0.00
02:33:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:33:01 AM      eth0      2.05      0.95      0.77      0.56      0.00      0.00      0.00      0.00
02:34:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:34:01 AM      eth0      1.32      0.43      0.76      0.44      0.00      0.00      0.00      0.00
02:35:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:35:01 AM      eth0      0.17      0.05      0.01      0.00      0.00      0.00      0.00      0.00
02:36:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:36:01 AM      eth0      3.52      0.37      0.50      0.05      0.00      0.00      0.00      0.00
02:37:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:37:01 AM      eth0      4.80      0.00      0.56      0.00      0.00      0.00      0.00      0.00
02:38:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:38:01 AM      eth0     64.40     64.68     12.97      6.24      0.00      0.00      0.00      0.00
02:39:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:39:01 AM      eth0      8.86      8.75      1.88      1.66      0.00      0.00      0.00      0.00
02:40:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:40:01 AM      eth0      9.52      9.48      2.01      1.79      0.00      0.00      0.00      0.00
02:41:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:41:01 AM      eth0      9.51      9.43      1.97      1.75      0.00      0.00      0.00      0.00
02:42:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:42:01 AM      eth0     10.18      9.53      2.08      1.79      0.00      0.00      0.00      0.00
02:43:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:43:01 AM      eth0     10.61      9.46      2.17      1.75      0.00      0.00      0.00      0.00
02:44:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:44:01 AM      eth0     18.34     16.46      3.91      3.14      0.00      0.00      0.00      0.00
02:45:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:45:01 AM      eth0      1.40      0.67      0.41      0.26      0.00      0.00      0.00      0.00
02:46:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:46:01 AM      eth0      0.55      0.17      0.27      0.19      0.00      0.00      0.00      0.00
02:47:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:47:01 AM      eth0      1.88      0.63      0.52      0.30      0.00      0.00      0.00      0.00
02:48:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:48:01 AM      eth0      1.70      0.23      0.42      0.19      0.00      0.00      0.00      0.00
02:49:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:49:01 AM      eth0      1.30      0.25      0.25      0.13      0.00      0.00      0.00      0.00
02:50:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:50:01 AM      eth0      0.95      0.47      0.38      0.23      0.00      0.00      0.00      0.00
02:51:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:51:01 AM      eth0      0.48      0.08      0.14      0.00      0.00      0.00      0.00      0.00
02:52:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:52:01 AM      eth0     79.32     78.62     14.57      7.11      0.00      0.00      0.00      0.00
02:53:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:53:01 AM      eth0      9.40      9.53      1.98      1.76      0.00      0.00      0.00      0.00
02:54:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:54:01 AM      eth0     11.90      9.75      2.34      1.87      0.00      0.00      0.00      0.00
02:55:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:55:01 AM      eth0     11.25      9.78      2.83      2.31      0.00      0.00      0.00      0.00
02:56:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:56:01 AM      eth0      9.85      9.88      2.28      2.00      0.00      0.00      0.00      0.00
02:57:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:57:01 AM      eth0     13.68      9.82      2.80      2.00      0.00      0.00      0.00      0.00
02:58:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:58:01 AM      eth0     19.26     16.73      3.92      3.07      0.00      0.00      0.00      0.00
02:59:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:59:01 AM      eth0      1.68      0.57      0.25      0.13      0.00      0.00      0.00      0.00
03:00:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:00:01 AM      eth0      0.48      0.00      0.02      0.00      0.00      0.00      0.00      0.00
03:01:02 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:01:02 AM      eth0      2.70      0.42     15.30      0.05      0.00      0.00      0.00      0.00
03:02:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:02:01 AM      eth0      0.81      0.00      0.08      0.00      0.00      0.00      0.00      0.00
03:03:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:03:01 AM      eth0      0.67      0.18      0.38      0.19      0.00      0.00      0.00      0.00
03:04:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:04:01 AM      eth0      1.10      0.47      0.24      0.11      0.00      0.00      0.00      0.00
03:05:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:05:01 AM      eth0      0.47      0.02      0.05      0.00      0.00      0.00      0.00      0.00
03:06:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:06:01 AM      eth0     67.90     65.97     46.44      8.81      0.00      0.00      0.00      0.00
03:07:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:07:01 AM      eth0     78.05     60.76    187.64    228.60      0.00      0.00      0.00      0.00
03:08:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:08:01 AM      eth0     15.86     16.29     13.13      8.10      0.00      0.00      0.00      0.00
Average:           lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
Average:         eth0      8.89      8.09     10.20      2.39      0.00      0.00      0.00      0.00


---> sar -P ALL:
Linux 4.18.0-547.el8.x86_64 (prd-centos8-robot-2c-8g-9657.novalocal) 	04/21/2024 	_x86_64_	(2 CPU)

12:00:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
12:01:01 AM     all      0.38      0.03      0.32      0.07      0.04     99.16
12:01:01 AM       0      0.48      0.05      0.43      0.02      0.03     98.98
12:01:01 AM       1      0.27      0.02      0.20      0.12      0.05     99.35
12:02:02 AM     all      0.51      0.00      0.10      0.00      0.04     99.35
12:02:02 AM       0      0.45      0.00      0.12      0.00      0.05     99.38
12:02:02 AM       1      0.57      0.00      0.08      0.00      0.03     99.32
12:03:01 AM     all      0.32      0.00      0.06      0.00      0.04     99.58
12:03:01 AM       0      0.15      0.00      0.08      0.00      0.05     99.71
12:03:01 AM       1      0.49      0.00      0.03      0.00      0.03     99.44
12:04:01 AM     all      2.44     12.55      1.11      0.80      0.05     83.06
12:04:01 AM       0      3.62     10.51      1.22      1.14      0.05     83.46
12:04:01 AM       1      1.26     14.58      0.99      0.47      0.05     82.66
12:05:01 AM     all      0.35      4.26      0.27      1.09      0.07     93.96
12:05:01 AM       0      0.20      0.12      0.20      0.62      0.07     98.80
12:05:01 AM       1      0.50      8.41      0.33      1.57      0.07     89.12
12:06:01 AM     all      0.97      0.00      0.10      0.01      0.03     98.89
12:06:01 AM       0      1.30      0.00      0.12      0.02      0.03     98.53
12:06:01 AM       1      0.63      0.00      0.08      0.00      0.03     99.25
12:07:01 AM     all      0.36      0.00      0.07      0.00      0.04     99.53
12:07:01 AM       0      0.05      0.00      0.05      0.00      0.03     99.87
12:07:01 AM       1      0.67      0.00      0.08      0.00      0.05     99.20
12:08:01 AM     all      1.99      0.00      0.22      0.00      0.04     97.75
12:08:01 AM       0      3.14      0.00      0.18      0.00      0.03     96.64
12:08:01 AM       1      0.84      0.00      0.25      0.00      0.05     98.86
12:09:01 AM     all      0.41      0.00      0.08      0.00      0.04     99.47
12:09:01 AM       0      0.12      0.00      0.07      0.00      0.03     99.78
12:09:01 AM       1      0.70      0.00      0.10      0.00      0.05     99.15
12:10:01 AM     all      0.99      0.00      0.12      0.00      0.04     98.85
12:10:01 AM       0      0.40      0.00      0.13      0.00      0.05     99.42
12:10:01 AM       1      1.59      0.00      0.10      0.00      0.03     98.28
12:11:01 AM     all      0.40      0.00      0.09      0.01      0.04     99.46
12:11:01 AM       0      0.63      0.00      0.08      0.00      0.03     99.25
12:11:01 AM       1      0.17      0.00      0.10      0.02      0.05     99.67

12:11:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
12:12:01 AM     all      1.12      0.00      0.08      0.00      0.04     98.76
12:12:01 AM       0      1.12      0.00      0.05      0.00      0.03     98.80
12:12:01 AM       1      1.12      0.00      0.12      0.00      0.05     98.71
12:13:01 AM     all      5.06      0.00      0.33      0.00      0.07     94.54
12:13:01 AM       0      4.47      0.00      0.28      0.00      0.07     95.18
12:13:01 AM       1      5.66      0.00      0.37      0.00      0.07     93.90
12:14:01 AM     all      4.31      0.00      0.32      0.00      0.08     95.29
12:14:01 AM       0      4.62      0.00      0.30      0.00      0.08     95.00
12:14:01 AM       1      4.01      0.00      0.33      0.00      0.07     95.59
12:15:01 AM     all      4.18      0.00      0.28      0.00      0.10     95.44
12:15:01 AM       0      6.12      0.00      0.33      0.00      0.12     93.42
12:15:01 AM       1      2.24      0.00      0.22      0.00      0.08     97.46
12:16:01 AM     all      4.31      0.00      0.28      0.00      0.07     95.34
12:16:01 AM       0      6.23      0.00      0.39      0.00      0.07     93.32
12:16:01 AM       1      2.39      0.00      0.18      0.00      0.07     97.36
12:17:01 AM     all      4.32      0.00      0.34      0.00      0.07     95.27
12:17:01 AM       0      6.01      0.00      0.44      0.00      0.08     93.47
12:17:01 AM       1      2.63      0.00      0.25      0.00      0.05     97.07
12:18:01 AM     all      4.34      0.00      0.33      0.00      0.07     95.26
12:18:01 AM       0      3.44      0.00      0.28      0.00      0.07     96.20
12:18:01 AM       1      5.24      0.00      0.37      0.00      0.07     94.32
12:19:01 AM     all      5.14      0.00      0.28      0.01      0.08     94.48
12:19:01 AM       0      2.39      0.00      0.20      0.00      0.07     97.34
12:19:01 AM       1      7.90      0.00      0.37      0.02      0.10     91.62
12:20:01 AM     all      0.49      0.00      0.07      0.00      0.04     99.40
12:20:01 AM       0      0.38      0.00      0.07      0.00      0.03     99.52
12:20:01 AM       1      0.60      0.00      0.07      0.00      0.05     99.28
12:21:01 AM     all      0.33      0.00      0.07      0.00      0.04     99.56
12:21:01 AM       0      0.07      0.00      0.08      0.00      0.03     99.82
12:21:01 AM       1      0.60      0.00      0.05      0.00      0.05     99.30
12:22:01 AM     all      0.47      0.00      0.08      0.00      0.04     99.42
12:22:01 AM       0      0.40      0.00      0.05      0.00      0.03     99.52
12:22:01 AM       1      0.53      0.00      0.10      0.00      0.05     99.32

12:22:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
12:23:01 AM     all      0.26      0.00      0.06      0.00      0.04     99.64
12:23:01 AM       0      0.05      0.00      0.07      0.00      0.03     99.85
12:23:01 AM       1      0.47      0.00      0.05      0.00      0.05     99.43
12:24:01 AM     all      0.51      0.00      0.07      0.01      0.03     99.38
12:24:01 AM       0      0.40      0.00      0.07      0.02      0.03     99.48
12:24:01 AM       1      0.62      0.00      0.07      0.00      0.03     99.28
12:25:01 AM     all      0.35      0.00      0.06      0.00      0.03     99.56
12:25:01 AM       0      0.13      0.00      0.07      0.00      0.03     99.77
12:25:01 AM       1      0.57      0.00      0.05      0.00      0.03     99.35
12:26:01 AM     all      2.80      0.00      0.40      0.00      0.05     96.75
12:26:01 AM       0      4.74      0.00      0.62      0.00      0.05     94.59
12:26:01 AM       1      0.87      0.00      0.18      0.00      0.05     98.90
12:27:01 AM     all      0.33      0.00      0.07      0.00      0.05     99.56
12:27:01 AM       0      0.08      0.00      0.05      0.00      0.03     99.83
12:27:01 AM       1      0.57      0.00      0.08      0.00      0.07     99.28
12:28:01 AM     all      0.65      0.00      0.10      0.00      0.03     99.22
12:28:01 AM       0      0.30      0.00      0.12      0.00      0.03     99.55
12:28:01 AM       1      1.00      0.00      0.08      0.00      0.03     98.88
12:29:01 AM     all      0.34      0.00      0.08      0.00      0.04     99.54
12:29:01 AM       0      0.63      0.00      0.10      0.00      0.05     99.22
12:29:01 AM       1      0.05      0.00      0.05      0.00      0.03     99.87
12:30:01 AM     all      0.38      0.00      0.08      0.00      0.04     99.51
12:30:01 AM       0      0.62      0.00      0.07      0.00      0.03     99.28
12:30:01 AM       1      0.13      0.00      0.08      0.00      0.05     99.73
12:31:01 AM     all      0.85      0.00      0.10      0.00      0.03     99.01
12:31:01 AM       0      1.12      0.00      0.10      0.00      0.03     98.75
12:31:01 AM       1      0.59      0.00      0.10      0.00      0.03     99.28
12:32:01 AM     all      0.32      0.00      0.09      0.01      0.03     99.55
12:32:01 AM       0      0.15      0.00      0.10      0.00      0.03     99.72
12:32:01 AM       1      0.48      0.00      0.08      0.02      0.03     99.38
12:33:01 AM     all      1.09      0.00      0.11      0.00      0.04     98.76
12:33:01 AM       0      0.75      0.00      0.12      0.00      0.05     99.08
12:33:01 AM       1      1.42      0.00      0.10      0.00      0.03     98.45

12:33:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
12:34:01 AM     all      0.38      0.00      0.08      0.01      0.04     99.50
12:34:01 AM       0      0.58      0.00      0.07      0.00      0.05     99.30
12:34:01 AM       1      0.17      0.00      0.08      0.02      0.03     99.70
12:35:01 AM     all      4.94      0.00      0.32      0.00      0.06     94.69
12:35:01 AM       0      6.53      0.00      0.35      0.00      0.05     93.07
12:35:01 AM       1      3.35      0.00      0.28      0.00      0.07     96.30
12:36:01 AM     all      4.27      0.00      0.32      0.00      0.07     95.35
12:36:01 AM       0      4.45      0.00      0.28      0.00      0.07     95.20
12:36:01 AM       1      4.08      0.00      0.35      0.00      0.07     95.50
12:37:01 AM     all      4.12      0.00      0.31      0.00      0.08     95.49
12:37:01 AM       0      5.60      0.00      0.40      0.00      0.08     93.92
12:37:01 AM       1      2.64      0.00      0.22      0.00      0.07     97.07
12:38:01 AM     all      4.24      0.00      0.30      0.00      0.08     95.38
12:38:01 AM       0      5.58      0.00      0.39      0.00      0.08     93.96
12:38:01 AM       1      2.91      0.00      0.22      0.00      0.07     96.81
12:39:01 AM     all      4.26      0.00      0.31      0.00      0.06     95.37
12:39:01 AM       0      5.87      0.00      0.40      0.00      0.07     93.66
12:39:01 AM       1      2.64      0.00      0.22      0.00      0.05     97.09
12:40:01 AM     all      4.13      0.00      0.31      0.00      0.07     95.50
12:40:01 AM       0      5.51      0.00      0.37      0.00      0.07     94.05
12:40:01 AM       1      2.74      0.00      0.25      0.00      0.07     96.94
12:41:01 AM     all      6.26      0.00      0.38      0.00      0.07     93.30
12:41:01 AM       0      5.62      0.00      0.38      0.00      0.07     93.93
12:41:01 AM       1      6.90      0.00      0.37      0.00      0.07     92.67
12:42:01 AM     all      0.59      0.00      0.08      0.00      0.06     99.27
12:42:01 AM       0      0.72      0.00      0.08      0.00      0.07     99.13
12:42:01 AM       1      0.47      0.00      0.07      0.00      0.05     99.42
12:43:01 AM     all      0.36      0.00      0.06      0.00      0.04     99.54
12:43:01 AM       0      0.57      0.00      0.03      0.00      0.03     99.37
12:43:01 AM       1      0.15      0.00      0.08      0.00      0.05     99.72
12:44:01 AM     all      0.58      0.00      0.08      0.00      0.04     99.30
12:44:01 AM       0      0.58      0.00      0.08      0.00      0.02     99.32
12:44:01 AM       1      0.58      0.00      0.07      0.00      0.07     99.28

12:44:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
12:45:01 AM     all      0.32      0.00      0.08      0.00      0.03     99.57
12:45:01 AM       0      0.13      0.00      0.07      0.00      0.03     99.77
12:45:01 AM       1      0.50      0.00      0.10      0.00      0.03     99.36
12:46:01 AM     all      0.53      0.00      0.08      0.00      0.04     99.35
12:46:01 AM       0      0.18      0.00      0.07      0.00      0.05     99.70
12:46:01 AM       1      0.87      0.00      0.10      0.00      0.03     99.00
12:47:01 AM     all      0.35      0.00      0.08      0.00      0.03     99.54
12:47:01 AM       0      0.30      0.00      0.08      0.00      0.02     99.60
12:47:01 AM       1      0.40      0.00      0.08      0.00      0.03     99.48
12:48:01 AM     all      0.13      0.00      0.05      0.00      0.04     99.77
12:48:01 AM       0      0.18      0.00      0.03      0.00      0.03     99.75
12:48:01 AM       1      0.08      0.00      0.07      0.00      0.05     99.80
12:49:01 AM     all      2.46      0.00      0.33      0.00      0.04     97.16
12:49:01 AM       0      3.05      0.00      0.45      0.00      0.05     96.45
12:49:01 AM       1      1.87      0.00      0.22      0.00      0.03     97.88
12:50:01 AM     all      0.40      0.00      0.08      0.00      0.05     99.47
12:50:01 AM       0      0.65      0.00      0.08      0.00      0.05     99.22
12:50:01 AM       1      0.15      0.00      0.07      0.00      0.05     99.73
12:51:01 AM     all      0.99      0.00      0.13      0.00      0.04     98.83
12:51:01 AM       0      1.40      0.00      0.17      0.00      0.05     98.38
12:51:01 AM       1      0.59      0.00      0.10      0.00      0.03     99.28
12:52:01 AM     all      0.40      0.00      0.08      0.03      0.03     99.46
12:52:01 AM       0      0.17      0.00      0.12      0.02      0.03     99.67
12:52:01 AM       1      0.63      0.00      0.05      0.03      0.03     99.25
12:53:01 AM     all      2.28      0.00      0.19      0.00      0.06     97.47
12:53:01 AM       0      3.19      0.00      0.18      0.00      0.05     96.57
12:53:01 AM       1      1.37      0.00      0.20      0.00      0.07     98.36
12:54:01 AM     all      0.38      0.00      0.08      0.03      0.03     99.49
12:54:01 AM       0      0.12      0.00      0.07      0.00      0.03     99.78
12:54:01 AM       1      0.63      0.00      0.08      0.05      0.03     99.20
12:55:01 AM     all      0.91      0.00      0.10      0.00      0.04     98.95
12:55:01 AM       0      0.92      0.00      0.08      0.00      0.03     98.96
12:55:01 AM       1      0.90      0.00      0.12      0.00      0.05     98.93

12:55:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
12:56:01 AM     all      0.27      0.00      0.08      0.00      0.03     99.62
12:56:01 AM       0      0.15      0.00      0.10      0.00      0.03     99.72
12:56:01 AM       1      0.38      0.00      0.05      0.00      0.03     99.53
12:57:01 AM     all      3.51      0.00      0.24      0.00      0.06     96.19
12:57:01 AM       0      4.20      0.00      0.30      0.00      0.05     95.45
12:57:01 AM       1      2.83      0.00      0.18      0.00      0.07     96.92
12:58:01 AM     all      4.27      0.00      0.32      0.00      0.08     95.34
12:58:01 AM       0      7.02      0.00      0.44      0.00      0.08     92.46
12:58:01 AM       1      1.54      0.00      0.20      0.00      0.07     98.20
12:59:01 AM     all      4.36      0.00      0.33      0.00      0.06     95.26
12:59:01 AM       0      7.14      0.00      0.49      0.00      0.07     92.30
12:59:01 AM       1      1.57      0.00      0.17      0.00      0.05     98.21
01:00:01 AM     all      4.26      0.00      0.28      0.00      0.06     95.39
01:00:01 AM       0      3.25      0.00      0.25      0.00      0.07     96.43
01:00:01 AM       1      5.28      0.00      0.32      0.00      0.05     94.35
01:01:01 AM     all      4.36      0.00      0.33      0.06      0.08     95.17
01:01:01 AM       0      4.62      0.00      0.37      0.12      0.08     94.80
01:01:01 AM       1      4.10      0.00      0.29      0.00      0.08     95.53
01:02:01 AM     all      4.37      0.00      0.34      0.00      0.07     95.22
01:02:01 AM       0      4.52      0.00      0.38      0.00      0.07     95.03
01:02:01 AM       1      4.21      0.00      0.30      0.00      0.07     95.42
01:03:01 AM     all      6.61      0.00      0.42      0.00      0.08     92.90
01:03:01 AM       0      8.08      0.00      0.47      0.00      0.08     91.37
01:03:01 AM       1      5.14      0.00      0.37      0.00      0.07     94.42
01:04:01 AM     all      1.68      0.00      0.15      0.00      0.08     98.10
01:04:01 AM       0      1.64      0.00      0.15      0.00      0.08     98.13
01:04:01 AM       1      1.72      0.00      0.15      0.00      0.07     98.06
01:05:01 AM     all      0.39      0.00      0.10      0.00      0.03     99.47
01:05:01 AM       0      0.38      0.00      0.05      0.00      0.02     99.55
01:05:01 AM       1      0.40      0.00      0.15      0.00      0.05     99.40
01:06:01 AM     all      0.39      0.00      0.08      0.00      0.03     99.50
01:06:01 AM       0      0.65      0.00      0.07      0.00      0.03     99.25
01:06:01 AM       1      0.13      0.00      0.08      0.00      0.03     99.75

01:06:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
01:07:01 AM     all      0.50      0.00      0.10      0.00      0.04     99.36
01:07:01 AM       0      0.40      0.00      0.12      0.00      0.05     99.43
01:07:01 AM       1      0.60      0.00      0.08      0.00      0.03     99.28
01:08:01 AM     all      0.37      0.00      0.06      0.00      0.04     99.53
01:08:01 AM       0      0.13      0.00      0.05      0.00      0.05     99.77
01:08:01 AM       1      0.60      0.00      0.07      0.00      0.03     99.30
01:09:01 AM     all      0.48      0.00      0.09      0.00      0.05     99.38
01:09:01 AM       0      0.42      0.00      0.08      0.00      0.03     99.47
01:09:01 AM       1      0.53      0.00      0.10      0.00      0.07     99.30
01:10:01 AM     all      0.28      0.00      0.08      0.00      0.04     99.59
01:10:01 AM       0      0.13      0.00      0.10      0.00      0.05     99.72
01:10:01 AM       1      0.43      0.00      0.07      0.00      0.03     99.47
01:11:01 AM     all      2.82      0.00      0.42      0.00      0.05     96.71
01:11:01 AM       0      2.76      0.00      0.28      0.00      0.07     96.88
01:11:01 AM       1      2.88      0.00      0.55      0.00      0.03     96.53
01:12:01 AM     all      0.40      0.00      0.10      0.00      0.05     99.45
01:12:01 AM       0      0.62      0.00      0.08      0.00      0.05     99.25
01:12:01 AM       1      0.18      0.00      0.12      0.00      0.05     99.65
01:13:01 AM     all      0.60      0.00      0.11      0.00      0.03     99.26
01:13:01 AM       0      0.43      0.00      0.12      0.00      0.03     99.42
01:13:01 AM       1      0.77      0.00      0.10      0.00      0.03     99.10
01:14:01 AM     all      0.44      0.00      0.11      0.00      0.04     99.41
01:14:01 AM       0      0.57      0.00      0.07      0.00      0.03     99.33
01:14:01 AM       1      0.32      0.00      0.15      0.00      0.05     99.48
01:15:01 AM     all      1.04      0.00      0.11      0.00      0.03     98.82
01:15:01 AM       0      1.34      0.00      0.13      0.00      0.03     98.50
01:15:01 AM       1      0.73      0.00      0.08      0.00      0.03     99.15
01:16:01 AM     all      0.43      0.00      0.11      0.00      0.06     99.41
01:16:01 AM       0      0.52      0.00      0.10      0.00      0.07     99.32
01:16:01 AM       1      0.33      0.00      0.12      0.00      0.05     99.50
01:17:01 AM     all      1.09      0.00      0.12      0.00      0.04     98.76
01:17:01 AM       0      1.72      0.00      0.10      0.00      0.03     98.15
01:17:01 AM       1      0.45      0.00      0.13      0.00      0.05     99.37

01:17:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
01:18:01 AM     all      0.34      0.00      0.08      0.00      0.05     99.53
01:18:01 AM       0      0.12      0.00      0.08      0.00      0.05     99.75
01:18:01 AM       1      0.57      0.00      0.07      0.00      0.05     99.32
01:19:01 AM     all      2.31      0.00      0.15      0.00      0.04     97.50
01:19:01 AM       0      2.88      0.00      0.20      0.00      0.05     96.87
01:19:01 AM       1      1.74      0.00      0.10      0.00      0.03     98.13
01:20:01 AM     all      4.40      0.00      0.32      0.00      0.08     95.21
01:20:01 AM       0      2.32      0.00      0.23      0.00      0.07     97.38
01:20:01 AM       1      6.48      0.00      0.40      0.00      0.08     93.03
01:21:01 AM     all      4.32      0.00      0.33      0.01      0.08     95.25
01:21:01 AM       0      3.70      0.00      0.30      0.02      0.08     95.90
01:21:01 AM       1      4.95      0.00      0.37      0.00      0.08     94.60
01:22:01 AM     all      4.46      0.00      0.33      0.00      0.06     95.15
01:22:01 AM       0      1.92      0.00      0.18      0.00      0.05     97.84
01:22:01 AM       1      7.01      0.00      0.47      0.00      0.07     92.46
01:23:01 AM     all      4.53      0.00      0.36      0.00      0.08     95.03
01:23:01 AM       0      3.04      0.00      0.27      0.00      0.07     96.62
01:23:01 AM       1      6.03      0.00      0.45      0.00      0.08     93.44
01:24:01 AM     all      4.41      0.00      0.33      0.00      0.07     95.20
01:24:01 AM       0      3.98      0.00      0.32      0.00      0.07     95.63
01:24:01 AM       1      4.84      0.00      0.33      0.00      0.07     94.76
01:25:01 AM     all      4.39      0.00      0.35      0.00      0.07     95.19
01:25:01 AM       0      3.04      0.00      0.25      0.00      0.07     96.64
01:25:01 AM       1      5.74      0.00      0.45      0.00      0.07     93.74
01:26:01 AM     all      5.05      0.00      0.29      0.01      0.07     94.58
01:26:01 AM       0      4.65      0.00      0.30      0.00      0.07     94.98
01:26:01 AM       1      5.44      0.00      0.28      0.02      0.07     94.19
01:27:01 AM     all      0.55      0.00      0.09      0.00      0.03     99.32
01:27:01 AM       0      0.40      0.00      0.12      0.00      0.03     99.45
01:27:01 AM       1      0.70      0.00      0.07      0.00      0.03     99.20
01:28:01 AM     all      0.37      0.00      0.10      0.00      0.03     99.50
01:28:01 AM       0      0.43      0.00      0.13      0.00      0.05     99.38
01:28:01 AM       1      0.30      0.00      0.07      0.00      0.02     99.62

01:28:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
01:29:01 AM     all      0.54      0.00      0.09      0.00      0.03     99.33
01:29:01 AM       0      0.57      0.00      0.08      0.00      0.03     99.32
01:29:01 AM       1      0.52      0.00      0.10      0.00      0.03     99.35
01:30:01 AM     all      0.36      0.00      0.08      0.00      0.03     99.53
01:30:01 AM       0      0.57      0.00      0.05      0.00      0.03     99.35
01:30:01 AM       1      0.15      0.00      0.10      0.00      0.03     99.72
01:31:01 AM     all      0.53      0.00      0.08      0.00      0.03     99.35
01:31:01 AM       0      0.55      0.00      0.05      0.00      0.02     99.38
01:31:01 AM       1      0.52      0.00      0.12      0.00      0.05     99.32
01:32:01 AM     all      0.38      0.17      0.13      0.00      0.04     99.27
01:32:01 AM       0      0.13      0.28      0.15      0.00      0.05     99.38
01:32:01 AM       1      0.63      0.05      0.12      0.00      0.03     99.17
01:33:01 AM     all      2.30      0.00      0.29      0.00      0.03     97.37
01:33:01 AM       0      1.80      0.00      0.42      0.00      0.03     97.74
01:33:01 AM       1      2.80      0.00      0.17      0.00      0.03     97.00
01:34:01 AM     all      0.43      0.00      0.09      0.00      0.04     99.44
01:34:01 AM       0      0.17      0.00      0.07      0.00      0.03     99.73
01:34:01 AM       1      0.68      0.00      0.12      0.00      0.05     99.15
01:35:01 AM     all      1.50      0.00      0.16      0.00      0.03     98.30
01:35:01 AM       0      2.02      0.00      0.15      0.00      0.03     97.79
01:35:01 AM       1      0.99      0.00      0.17      0.00      0.03     98.81
01:36:01 AM     all      0.37      0.00      0.07      0.00      0.05     99.52
01:36:01 AM       0      0.15      0.00      0.07      0.00      0.07     99.72
01:36:01 AM       1      0.58      0.00      0.07      0.00      0.03     99.32
01:37:01 AM     all      1.09      0.00      0.10      0.00      0.03     98.78
01:37:01 AM       0      1.57      0.00      0.12      0.00      0.03     98.28
01:37:01 AM       1      0.60      0.00      0.08      0.00      0.03     99.28
01:38:01 AM     all      4.89      0.00      0.32      0.00      0.08     94.72
01:38:01 AM       0      6.21      0.00      0.35      0.00      0.07     93.37
01:38:01 AM       1      3.56      0.00      0.28      0.00      0.08     96.07
01:39:01 AM     all      4.14      0.00      0.31      0.00      0.07     95.48
01:39:01 AM       0      3.10      0.00      0.27      0.00      0.07     96.56
01:39:01 AM       1      5.18      0.00      0.35      0.00      0.07     94.41

01:39:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
01:40:01 AM     all      4.21      0.00      0.32      0.00      0.07     95.41
01:40:01 AM       0      3.76      0.00      0.33      0.00      0.07     95.84
01:40:01 AM       1      4.66      0.00      0.30      0.00      0.07     94.97
01:41:01 AM     all      4.27      0.00      0.32      0.00      0.08     95.33
01:41:01 AM       0      5.12      0.00      0.35      0.00      0.08     94.44
01:41:01 AM       1      3.43      0.00      0.28      0.00      0.07     96.22
01:42:01 AM     all      4.13      0.00      0.30      0.00      0.08     95.49
01:42:01 AM       0      2.74      0.00      0.25      0.00      0.07     96.94
01:42:01 AM       1      5.52      0.00      0.35      0.00      0.08     94.04
01:43:01 AM     all      4.34      0.00      0.32      0.00      0.07     95.27
01:43:01 AM       0      2.27      0.00      0.23      0.00      0.05     97.44
01:43:01 AM       1      6.41      0.00      0.40      0.00      0.08     93.10
01:44:01 AM     all      4.84      0.00      0.24      0.00      0.06     94.86
01:44:01 AM       0      4.10      0.00      0.23      0.00      0.05     95.62
01:44:01 AM       1      5.58      0.00      0.25      0.00      0.07     94.10
01:45:01 AM     all      1.03      0.00      0.10      0.00      0.08     98.80
01:45:01 AM       0      0.62      0.00      0.08      0.00      0.07     99.23
01:45:01 AM       1      1.44      0.00      0.12      0.00      0.08     98.36
01:46:01 AM     all      0.95      0.00      0.14      0.00      0.07     98.84
01:46:01 AM       0      0.82      0.00      0.10      0.00      0.05     99.03
01:46:01 AM       1      1.09      0.00      0.18      0.00      0.08     98.65
01:47:01 AM     all      0.95      0.00      0.13      0.00      0.06     98.86
01:47:01 AM       0      1.07      0.00      0.17      0.00      0.07     98.70
01:47:01 AM       1      0.84      0.00      0.10      0.00      0.05     99.01
01:48:01 AM     all      0.92      0.00      0.11      0.00      0.07     98.91
01:48:01 AM       0      1.05      0.00      0.13      0.00      0.08     98.73
01:48:01 AM       1      0.78      0.00      0.08      0.00      0.05     99.08
01:49:01 AM     all      0.99      0.00      0.11      0.00      0.07     98.84
01:49:01 AM       0      1.35      0.00      0.15      0.00      0.07     98.43
01:49:01 AM       1      0.62      0.00      0.07      0.00      0.07     99.25
01:50:01 AM     all      6.36      0.00      0.51      0.00      0.08     93.05
01:50:01 AM       0      6.70      0.00      0.59      0.00      0.07     92.65
01:50:01 AM       1      6.03      0.00      0.44      0.00      0.08     93.45

01:50:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
01:51:01 AM     all      4.21      0.00      0.30      0.00      0.07     95.42
01:51:01 AM       0      5.17      0.00      0.32      0.00      0.08     94.43
01:51:01 AM       1      3.26      0.00      0.28      0.00      0.05     96.41
01:52:01 AM     all      4.24      0.00      0.31      0.00      0.07     95.38
01:52:01 AM       0      6.27      0.00      0.44      0.00      0.07     93.23
01:52:01 AM       1      2.22      0.00      0.18      0.00      0.07     97.53
01:53:01 AM     all      4.37      0.00      0.30      0.00      0.06     95.27
01:53:01 AM       0      5.69      0.00      0.39      0.00      0.07     93.86
01:53:01 AM       1      3.04      0.00      0.22      0.00      0.05     96.69
01:54:01 AM     all      4.27      0.00      0.28      0.00      0.08     95.38
01:54:01 AM       0      4.58      0.00      0.27      0.00      0.07     95.08
01:54:01 AM       1      3.95      0.00      0.28      0.00      0.08     95.68
01:55:01 AM     all      4.28      0.00      0.26      0.00      0.07     95.39
01:55:01 AM       0      7.30      0.00      0.37      0.00      0.08     92.24
01:55:01 AM       1      1.27      0.00      0.15      0.00      0.05     98.53
01:56:01 AM     all      7.25      0.00      0.39      0.00      0.07     92.29
01:56:01 AM       0     10.24      0.00      0.50      0.00      0.08     89.17
01:56:01 AM       1      4.26      0.00      0.28      0.00      0.05     95.40
01:57:01 AM     all      0.56      0.00      0.10      0.00      0.05     99.29
01:57:01 AM       0      0.42      0.00      0.10      0.00      0.02     99.47
01:57:01 AM       1      0.70      0.00      0.10      0.00      0.08     99.11
01:58:02 AM     all      0.23      0.00      0.06      0.00      0.03     99.68
01:58:02 AM       0      0.02      0.00      0.02      0.00      0.02     99.95
01:58:02 AM       1      0.44      0.00      0.10      0.00      0.05     99.41
01:59:01 AM     all      0.49      0.00      0.05      0.00      0.03     99.42
01:59:01 AM       0      0.44      0.00      0.07      0.00      0.03     99.46
01:59:01 AM       1      0.54      0.00      0.03      0.00      0.03     99.39
02:00:01 AM     all      0.34      0.00      0.06      0.00      0.03     99.57
02:00:01 AM       0      0.10      0.00      0.07      0.00      0.03     99.80
02:00:01 AM       1      0.58      0.00      0.05      0.00      0.03     99.33
02:01:01 AM     all      0.32      0.00      0.08      0.01      0.03     99.57
02:01:01 AM       0      0.12      0.00      0.12      0.00      0.07     99.70
02:01:01 AM       1      0.52      0.00      0.03      0.02      0.00     99.43

02:01:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
02:02:01 AM     all      0.52      0.00      0.09      0.00      0.03     99.36
02:02:01 AM       0      0.57      0.00      0.07      0.00      0.03     99.33
02:02:01 AM       1      0.47      0.00      0.12      0.00      0.03     99.38
02:03:01 AM     all      0.33      0.00      0.07      0.00      0.03     99.57
02:03:01 AM       0      0.55      0.00      0.05      0.00      0.03     99.37
02:03:01 AM       1      0.12      0.00      0.08      0.00      0.03     99.77
02:04:01 AM     all      2.26      0.00      0.28      0.00      0.04     97.43
02:04:01 AM       0      2.39      0.00      0.40      0.00      0.03     97.17
02:04:01 AM       1      2.12      0.00      0.15      0.00      0.05     97.68
02:05:01 AM     all      0.35      0.00      0.08      0.00      0.04     99.53
02:05:01 AM       0      0.53      0.00      0.05      0.00      0.03     99.38
02:05:01 AM       1      0.17      0.00      0.10      0.00      0.05     99.68
02:06:01 AM     all      0.55      0.00      0.08      0.00      0.04     99.32
02:06:01 AM       0      0.63      0.00      0.05      0.00      0.02     99.30
02:06:01 AM       1      0.47      0.00      0.12      0.00      0.07     99.35
02:07:01 AM     all      1.01      0.00      0.10      0.00      0.06     98.83
02:07:01 AM       0      1.52      0.00      0.05      0.00      0.03     98.40
02:07:01 AM       1      0.50      0.00      0.15      0.00      0.08     99.26
02:08:01 AM     all      0.33      0.00      0.08      0.00      0.03     99.57
02:08:01 AM       0      0.12      0.00      0.10      0.00      0.02     99.77
02:08:01 AM       1      0.55      0.00      0.05      0.00      0.03     99.37
02:09:01 AM     all      3.02      0.00      0.22      0.00      0.06     96.70
02:09:01 AM       0      4.49      0.00      0.23      0.00      0.07     95.21
02:09:01 AM       1      1.55      0.00      0.20      0.00      0.05     98.20
02:10:01 AM     all      4.32      0.00      0.29      0.00      0.07     95.32
02:10:01 AM       0      5.84      0.00      0.35      0.00      0.07     93.74
02:10:01 AM       1      2.79      0.00      0.23      0.00      0.07     96.91
02:11:01 AM     all      4.30      0.00      0.32      0.00      0.07     95.32
02:11:01 AM       0      4.40      0.00      0.33      0.00      0.07     95.20
02:11:01 AM       1      4.20      0.00      0.30      0.00      0.07     95.43
02:12:01 AM     all      3.99      0.00      0.32      0.00      0.04     95.65
02:12:01 AM       0      3.18      0.00      0.27      0.00      0.03     96.52
02:12:01 AM       1      4.81      0.00      0.37      0.00      0.05     94.77

02:12:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
02:13:01 AM     all      4.18      0.00      0.32      0.00      0.08     95.43
02:13:01 AM       0      2.42      0.00      0.23      0.00      0.08     97.26
02:13:01 AM       1      5.93      0.00      0.40      0.00      0.07     93.60
02:14:01 AM     all      3.75      0.00      0.31      0.00      0.07     95.87
02:14:01 AM       0      4.87      0.00      0.35      0.00      0.07     94.71
02:14:01 AM       1      2.64      0.00      0.27      0.00      0.07     97.03
02:15:01 AM     all      6.46      0.00      0.36      0.00      0.07     93.11
02:15:01 AM       0      7.26      0.00      0.39      0.00      0.07     92.28
02:15:01 AM       1      5.65      0.00      0.34      0.00      0.07     93.94
02:16:01 AM     all      1.68      0.00      0.15      0.00      0.06     98.11
02:16:01 AM       0      1.65      0.00      0.12      0.00      0.05     98.18
02:16:01 AM       1      1.71      0.00      0.18      0.00      0.07     98.04
02:17:01 AM     all      0.76      0.00      0.08      0.00      0.06     99.10
02:17:01 AM       0      0.83      0.00      0.08      0.00      0.08     99.00
02:17:01 AM       1      0.68      0.00      0.08      0.00      0.03     99.20
02:18:01 AM     all      0.33      0.00      0.07      0.00      0.04     99.56
02:18:01 AM       0      0.08      0.00      0.10      0.00      0.05     99.77
02:18:01 AM       1      0.58      0.00      0.03      0.00      0.03     99.35
02:19:01 AM     all      0.50      0.00      0.07      0.01      0.07     99.36
02:19:01 AM       0      0.22      0.00      0.05      0.02      0.03     99.68
02:19:01 AM       1      0.77      0.00      0.08      0.00      0.10     99.04
02:20:01 AM     all      0.27      0.00      0.08      0.00      0.03     99.62
02:20:01 AM       0      0.45      0.00      0.12      0.00      0.03     99.40
02:20:01 AM       1      0.08      0.00      0.05      0.00      0.02     99.85
02:21:01 AM     all      0.38      0.00      0.08      0.00      0.03     99.51
02:21:01 AM       0      0.60      0.00      0.07      0.00      0.02     99.32
02:21:01 AM       1      0.17      0.00      0.08      0.00      0.05     99.70
02:22:01 AM     all      0.58      0.00      0.07      0.00      0.04     99.32
02:22:01 AM       0      0.68      0.00      0.07      0.00      0.07     99.18
02:22:01 AM       1      0.47      0.00      0.07      0.00      0.02     99.45
02:23:01 AM     all      0.35      0.00      0.06      0.00      0.03     99.57
02:23:01 AM       0      0.38      0.00      0.05      0.00      0.02     99.55
02:23:01 AM       1      0.32      0.00      0.07      0.00      0.03     99.58

02:23:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
02:24:01 AM     all      7.59      0.00      0.75      0.00      0.07     91.60
02:24:01 AM       0      9.00      0.00      0.79      0.00      0.07     90.14
02:24:01 AM       1      6.18      0.00      0.70      0.00      0.07     93.05
02:25:01 AM     all      4.86      0.00      0.41      0.00      0.08     94.65
02:25:01 AM       0      3.87      0.00      0.35      0.00      0.07     95.71
02:25:01 AM       1      5.86      0.00      0.47      0.00      0.08     93.59
02:26:01 AM     all      4.38      0.00      0.33      0.00      0.06     95.23
02:26:01 AM       0      2.12      0.00      0.23      0.00      0.05     97.59
02:26:01 AM       1      6.64      0.00      0.44      0.00      0.07     92.86
02:27:01 AM     all      4.37      0.00      0.33      0.00      0.05     95.25
02:27:01 AM       0      6.34      0.00      0.42      0.00      0.05     93.19
02:27:01 AM       1      2.41      0.00      0.23      0.00      0.05     97.31
02:28:01 AM     all      4.32      0.00      0.31      0.00      0.07     95.30
02:28:01 AM       0      3.75      0.00      0.27      0.00      0.05     95.93
02:28:01 AM       1      4.89      0.00      0.35      0.00      0.08     94.68
02:29:01 AM     all      4.37      0.00      0.33      0.00      0.08     95.22
02:29:01 AM       0      2.97      0.00      0.27      0.00      0.07     96.69
02:29:01 AM       1      5.78      0.00      0.39      0.00      0.08     93.75
02:30:01 AM     all      6.61      0.00      0.35      0.00      0.07     92.97
02:30:01 AM       0      7.36      0.00      0.39      0.00      0.07     92.19
02:30:01 AM       1      5.86      0.00      0.32      0.00      0.07     93.75
02:31:01 AM     all      0.56      0.00      0.12      0.00      0.03     99.29
02:31:01 AM       0      0.62      0.00      0.12      0.00      0.03     99.23
02:31:01 AM       1      0.50      0.00      0.12      0.00      0.03     99.35
02:32:01 AM     all      0.23      0.00      0.08      0.00      0.03     99.65
02:32:01 AM       0      0.17      0.00      0.10      0.00      0.03     99.70
02:32:01 AM       1      0.30      0.00      0.07      0.00      0.03     99.60
02:33:01 AM     all      0.63      0.00      0.10      0.00      0.04     99.22
02:33:01 AM       0      0.30      0.00      0.10      0.00      0.03     99.57
02:33:01 AM       1      0.97      0.00      0.10      0.00      0.05     98.88
02:34:01 AM     all      0.55      0.00      0.13      0.01      0.03     99.29
02:34:01 AM       0      0.68      0.00      0.10      0.02      0.02     99.18
02:34:01 AM       1      0.42      0.00      0.15      0.00      0.03     99.40

02:34:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
02:35:01 AM     all      0.35      0.00      0.10      0.00      0.03     99.52
02:35:01 AM       0      0.35      0.00      0.08      0.00      0.03     99.53
02:35:01 AM       1      0.35      0.00      0.12      0.00      0.02     99.51
02:36:01 AM     all      0.56      0.00      0.08      0.00      0.03     99.33
02:36:01 AM       0      0.63      0.00      0.05      0.00      0.03     99.28
02:36:01 AM       1      0.48      0.00      0.10      0.00      0.03     99.38
02:37:01 AM     all      0.35      0.00      0.07      0.00      0.03     99.56
02:37:01 AM       0      0.60      0.00      0.07      0.00      0.02     99.32
02:37:01 AM       1      0.10      0.00      0.07      0.00      0.03     99.80
02:38:01 AM     all      7.84      0.00      0.74      0.00      0.10     91.31
02:38:01 AM       0     11.83      0.00      0.92      0.00      0.08     87.17
02:38:01 AM       1      3.91      0.00      0.57      0.00      0.12     95.41
02:39:01 AM     all      5.01      0.00      0.34      0.00      0.16     94.49
02:39:01 AM       0      4.96      0.00      0.34      0.00      0.12     94.59
02:39:01 AM       1      5.07      0.00      0.35      0.00      0.20     94.38
02:40:01 AM     all      5.31      0.00      0.34      0.00      0.13     94.22
02:40:01 AM       0      7.92      0.00      0.44      0.00      0.15     91.49
02:40:01 AM       1      2.71      0.00      0.25      0.00      0.10     96.94
02:41:01 AM     all      4.47      0.00      0.33      0.00      0.06     95.15
02:41:01 AM       0      6.77      0.00      0.44      0.00      0.07     92.73
02:41:01 AM       1      2.18      0.00      0.22      0.00      0.05     97.56
02:42:01 AM     all      4.42      0.00      0.34      0.00      0.06     95.18
02:42:01 AM       0      6.05      0.00      0.40      0.00      0.07     93.48
02:42:01 AM       1      2.78      0.00      0.29      0.00      0.05     96.88
02:43:01 AM     all      4.84      0.00      0.39      0.00      0.08     94.69
02:43:01 AM       0      5.64      0.00      0.40      0.00      0.07     93.89
02:43:01 AM       1      4.03      0.00      0.39      0.00      0.08     95.50
02:44:01 AM     all      6.69      0.00      0.39      0.00      0.05     92.87
02:44:01 AM       0      9.74      0.00      0.49      0.00      0.05     89.72
02:44:01 AM       1      3.63      0.00      0.30      0.00      0.05     96.02
02:45:01 AM     all      0.72      0.00      0.10      0.00      0.05     99.13
02:45:01 AM       0      0.73      0.00      0.10      0.00      0.05     99.12
02:45:01 AM       1      0.70      0.00      0.10      0.00      0.05     99.15

02:45:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
02:46:01 AM     all      0.42      0.00      0.06      0.00      0.02     99.51
02:46:01 AM       0      0.20      0.00      0.05      0.00      0.02     99.73
02:46:01 AM       1      0.63      0.00      0.07      0.00      0.02     99.28
02:47:01 AM     all      0.56      0.00      0.10      0.00      0.03     99.32
02:47:01 AM       0      0.62      0.00      0.12      0.00      0.03     99.23
02:47:01 AM       1      0.50      0.00      0.08      0.00      0.02     99.40
02:48:01 AM     all      0.29      0.00      0.08      0.00      0.02     99.62
02:48:01 AM       0      0.20      0.00      0.10      0.00      0.02     99.68
02:48:01 AM       1      0.38      0.00      0.05      0.00      0.02     99.55
02:49:01 AM     all      0.36      0.00      0.09      0.00      0.03     99.52
02:49:01 AM       0      0.15      0.00      0.08      0.00      0.03     99.73
02:49:01 AM       1      0.57      0.00      0.10      0.00      0.03     99.30
02:50:01 AM     all      0.54      0.00      0.08      0.00      0.03     99.35
02:50:01 AM       0      0.48      0.00      0.07      0.00      0.02     99.43
02:50:01 AM       1      0.60      0.00      0.08      0.00      0.05     99.27
02:51:01 AM     all      0.28      0.00      0.07      0.00      0.02     99.64
02:51:01 AM       0      0.15      0.00      0.07      0.00      0.02     99.77
02:51:01 AM       1      0.40      0.00      0.07      0.00      0.02     99.52
02:52:01 AM     all      7.48      0.00      0.77      0.00      0.06     91.70
02:52:01 AM       0      8.86      0.00      0.98      0.00      0.07     90.09
02:52:01 AM       1      6.09      0.00      0.55      0.00      0.05     93.30
02:53:01 AM     all      4.31      0.00      0.32      0.00      0.05     95.32
02:53:01 AM       0      6.17      0.00      0.39      0.00      0.05     93.39
02:53:01 AM       1      2.46      0.00      0.25      0.00      0.05     97.24
02:54:01 AM     all      4.68      0.00      0.35      0.00      0.06     94.91
02:54:01 AM       0      6.63      0.00      0.45      0.00      0.07     92.85
02:54:01 AM       1      2.73      0.00      0.25      0.00      0.05     96.97
02:55:01 AM     all      4.40      0.00      0.31      0.00      0.07     95.22
02:55:01 AM       0      5.86      0.00      0.30      0.00      0.05     93.78
02:55:01 AM       1      2.94      0.00      0.32      0.00      0.08     96.66
02:56:01 AM     all      4.62      0.00      0.33      0.02      0.05     94.98
02:56:01 AM       0      6.22      0.00      0.40      0.00      0.05     93.33
02:56:01 AM       1      3.03      0.00      0.25      0.03      0.05     96.64

02:56:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
02:57:01 AM     all      4.45      0.00      0.33      0.00      0.05     95.17
02:57:01 AM       0      5.02      0.00      0.33      0.00      0.05     94.59
02:57:01 AM       1      3.88      0.00      0.32      0.00      0.05     95.75
02:58:01 AM     all      7.59      0.00      0.40      0.00      0.12     91.89
02:58:01 AM       0      9.11      0.00      0.44      0.00      0.10     90.35
02:58:01 AM       1      6.06      0.00      0.37      0.00      0.13     93.43
02:59:01 AM     all      0.63      0.00      0.10      0.03      0.03     99.21
02:59:01 AM       0      0.59      0.00      0.12      0.00      0.05     99.25
02:59:01 AM       1      0.67      0.00      0.08      0.07      0.02     99.16
03:00:01 AM     all      0.38      0.00      0.08      0.00      0.02     99.52
03:00:01 AM       0      0.10      0.00      0.08      0.00      0.02     99.80
03:00:01 AM       1      0.65      0.00      0.08      0.00      0.02     99.25
03:01:02 AM     all      0.59      0.00      0.11      0.03      0.06     99.21
03:01:02 AM       0      0.33      0.00      0.08      0.05      0.05     99.48
03:01:02 AM       1      0.85      0.00      0.13      0.00      0.07     98.95
03:02:01 AM     all      0.43      0.00      0.09      0.00      0.02     99.46
03:02:01 AM       0      0.42      0.00      0.08      0.00      0.02     99.47
03:02:01 AM       1      0.44      0.00      0.10      0.00      0.02     99.44
03:03:01 AM     all      0.47      0.00      0.12      0.00      0.04     99.37
03:03:01 AM       0      0.63      0.00      0.10      0.00      0.03     99.23
03:03:01 AM       1      0.30      0.00      0.13      0.00      0.05     99.51
03:04:01 AM     all      0.64      0.00      0.11      0.00      0.03     99.22
03:04:01 AM       0      1.02      0.00      0.13      0.00      0.03     98.82
03:04:01 AM       1      0.27      0.00      0.08      0.00      0.02     99.63
03:05:01 AM     all      0.39      0.00      0.10      0.00      0.03     99.48
03:05:01 AM       0      0.37      0.00      0.12      0.00      0.03     99.48
03:05:01 AM       1      0.42      0.00      0.08      0.00      0.02     99.48
03:06:01 AM     all     19.74      0.00      2.67      0.43      0.14     77.02
03:06:01 AM       0     13.76      0.00      2.49      0.52      0.10     83.12
03:06:01 AM       1     25.70      0.00      2.84      0.34      0.18     70.94
03:07:01 AM     all     21.22      0.00      2.40      8.43      0.10     67.84
03:07:01 AM       0     19.97      0.00      2.30      4.79      0.12     72.82
03:07:01 AM       1     22.47      0.00      2.50     12.07      0.08     62.87

03:07:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
03:08:01 AM     all     31.40      0.00      3.43      1.32      0.08     63.76
03:08:01 AM       0     42.16      0.00      3.87      2.19      0.08     51.70
03:08:01 AM       1     20.61      0.00      2.99      0.45      0.08     75.86
Average:        all      2.59      0.09      0.24      0.07      0.05     96.96
Average:          0      2.85      0.06      0.26      0.05      0.05     96.74
Average:          1      2.34      0.12      0.23      0.08      0.05     97.18