Started by upstream project "integration-distribution-mri-test-argon" build number 80
originally caused by:
 Started by timer
Running as SYSTEM
[EnvInject] - Loading node environment variables.
Building remotely on prd-centos8-robot-2c-8g-5479 (centos8-robot-2c-8g) in workspace /w/workspace/controller-csit-3node-clustering-ask-all-argon
[ssh-agent] Looking for ssh-agent implementation...
[ssh-agent]   Exec ssh-agent (binary ssh-agent on a remote machine)
$ ssh-agent
SSH_AUTH_SOCK=/tmp/ssh-V4MdypeXBp8M/agent.5302
SSH_AGENT_PID=5303
[ssh-agent] Started.
Running ssh-add (command line suppressed)
Identity added: /w/workspace/controller-csit-3node-clustering-ask-all-argon@tmp/private_key_7995842296338506004.key (/w/workspace/controller-csit-3node-clustering-ask-all-argon@tmp/private_key_7995842296338506004.key)
[ssh-agent] Using credentials jenkins (Release Engineering Jenkins Key)
The recommended git tool is: NONE
using credential opendaylight-jenkins-ssh
Wiping out workspace first.
Cloning the remote Git repository
Cloning repository git://devvexx.opendaylight.org/mirror/integration/test
 > git init /w/workspace/controller-csit-3node-clustering-ask-all-argon/test # timeout=10
Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test
 > git --version # timeout=10
 > git --version # 'git version 2.43.0'
using GIT_SSH to set credentials Release Engineering Jenkins Key
[INFO] Currently running in a labeled security context
[INFO] Currently SELinux is 'enforcing' on the host
 > /usr/bin/chcon --type=ssh_home_t /w/workspace/controller-csit-3node-clustering-ask-all-argon/test@tmp/jenkins-gitclient-ssh7451355471394787096.key
Verifying host key using known hosts file
You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification.
 > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10
Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test
using GIT_SSH to set credentials Release Engineering Jenkins Key
[INFO] Currently running in a labeled security context
[INFO] Currently SELinux is 'enforcing' on the host
 > /usr/bin/chcon --type=ssh_home_t /w/workspace/controller-csit-3node-clustering-ask-all-argon/test@tmp/jenkins-gitclient-ssh15500088674567508652.key
Verifying host key using known hosts file
You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification.
 > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test master # timeout=10
 > git rev-parse FETCH_HEAD^{commit} # timeout=10
Checking out Revision c88ead2b4a65ba004398ad07cfe033ae1e467b17 (origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f c88ead2b4a65ba004398ad07cfe033ae1e467b17 # timeout=10
Commit message: "Reformat '* On Session' keywords (aaa)"
 > git rev-parse FETCH_HEAD^{commit} # timeout=10
 > git rev-list --no-walk 7df40c8c0ac70da634e98ef506471a9aa0c475be # timeout=10
No emails were triggered.
provisioning config files...
copy managed file [npmrc] to file:/home/jenkins/.npmrc
copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf
copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
[controller-csit-3node-clustering-ask-all-argon] $ /bin/bash /tmp/jenkins12769597321712779081.sh
---> python-tools-install.sh
Setup pyenv:
  system
* 3.8.13 (set by /opt/pyenv/version)
* 3.9.13 (set by /opt/pyenv/version)
* 3.10.13 (set by /opt/pyenv/version)
* 3.11.7 (set by /opt/pyenv/version)
lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-geSN
lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: lftools 
lf-activate-venv(): INFO: Adding /tmp/venv-geSN/bin to PATH
Generating Requirements File
Python 3.11.7
pip 24.0 from /tmp/venv-geSN/lib/python3.11/site-packages/pip (python 3.11)
appdirs==1.4.4
argcomplete==3.2.3
aspy.yaml==1.3.0
attrs==23.2.0
autopage==0.5.2
beautifulsoup4==4.12.3
boto3==1.34.79
botocore==1.34.79
bs4==0.0.2
cachetools==5.3.3
certifi==2024.2.2
cffi==1.16.0
cfgv==3.4.0
chardet==5.2.0
charset-normalizer==3.3.2
click==8.1.7
cliff==4.6.0
cmd2==2.4.3
cryptography==3.3.2
debtcollector==3.0.0
decorator==5.1.1
defusedxml==0.7.1
Deprecated==1.2.14
distlib==0.3.8
dnspython==2.6.1
docker==4.2.2
dogpile.cache==1.3.2
email_validator==2.1.1
filelock==3.13.3
future==1.0.0
gitdb==4.0.11
GitPython==3.1.43
google-auth==2.29.0
httplib2==0.22.0
identify==2.5.35
idna==3.6
importlib-resources==1.5.0
iso8601==2.1.0
Jinja2==3.1.3
jmespath==1.0.1
jsonpatch==1.33
jsonpointer==2.4
jsonschema==4.21.1
jsonschema-specifications==2023.12.1
keystoneauth1==5.6.0
kubernetes==29.0.0
lftools==0.37.10
lxml==5.2.1
MarkupSafe==2.1.5
msgpack==1.0.8
multi_key_dict==2.0.3
munch==4.0.0
netaddr==1.2.1
netifaces==0.11.0
niet==1.4.2
nodeenv==1.8.0
oauth2client==4.1.3
oauthlib==3.2.2
openstacksdk==3.0.0
os-client-config==2.1.0
os-service-types==1.7.0
osc-lib==3.0.1
oslo.config==9.4.0
oslo.context==5.5.0
oslo.i18n==6.3.0
oslo.log==5.5.1
oslo.serialization==5.4.0
oslo.utils==7.1.0
packaging==24.0
pbr==6.0.0
platformdirs==4.2.0
prettytable==3.10.0
pyasn1==0.6.0
pyasn1_modules==0.4.0
pycparser==2.22
pygerrit2==2.0.15
PyGithub==2.3.0
pyinotify==0.9.6
PyJWT==2.8.0
PyNaCl==1.5.0
pyparsing==2.4.7
pyperclip==1.8.2
pyrsistent==0.20.0
python-cinderclient==9.5.0
python-dateutil==2.9.0.post0
python-heatclient==3.5.0
python-jenkins==1.8.2
python-keystoneclient==5.4.0
python-magnumclient==4.4.0
python-novaclient==18.6.0
python-openstackclient==6.6.0
python-swiftclient==4.5.0
PyYAML==6.0.1
referencing==0.34.0
requests==2.31.0
requests-oauthlib==2.0.0
requestsexceptions==1.4.0
rfc3986==2.0.0
rpds-py==0.18.0
rsa==4.9
ruamel.yaml==0.18.6
ruamel.yaml.clib==0.2.8
s3transfer==0.10.1
simplejson==3.19.2
six==1.16.0
smmap==5.0.1
soupsieve==2.5
stevedore==5.2.0
tabulate==0.9.0
toml==0.10.2
tomlkit==0.12.4
tqdm==4.66.2
typing_extensions==4.11.0
tzdata==2024.1
urllib3==1.26.18
virtualenv==20.25.1
wcwidth==0.2.13
websocket-client==1.7.0
wrapt==1.16.0
xdg==6.0.0
xmltodict==0.13.0
yq==3.2.3
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties content 
OS_STACK_TEMPLATE=csit-2-instance-type.yaml
OS_CLOUD=vex
OS_STACK_NAME=releng-controller-csit-3node-clustering-ask-all-argon-80
OS_STACK_TEMPLATE_DIR=openstack-hot

[EnvInject] - Variables injected successfully.
provisioning config files...
copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
[controller-csit-3node-clustering-ask-all-argon] $ /bin/bash /tmp/jenkins13781856012972250237.sh
---> Create parameters file for OpenStack HOT
OpenStack Heat parameters generated
-----------------------------------
parameters:
    vm_0_count: '3'
    vm_0_flavor: 'v3-standard-4'
    vm_0_image: 'ZZCI - CentOS Stream 8 - builder - x86_64 - 20240401-160147.446'
    vm_1_count: '0'
    vm_1_flavor: 'v3-standard-2'
    vm_1_image: 'ZZCI - Ubuntu 18.04 - mininet-ovs-28 - x86_64 - 20230601-180106.003'
    
    job_name: '11311-80'
    silo: 'releng'
[controller-csit-3node-clustering-ask-all-argon] $ /bin/bash -l /tmp/jenkins16163133269273051037.sh
---> Create HEAT stack
+ source /home/jenkins/lf-env.sh
+ lf-activate-venv --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
++ mktemp -d /tmp/venv-XXXX
+ lf_venv=/tmp/venv-9NhH
+ local venv_file=/tmp/.os_lf_venv
+ local python=python3
+ local options
+ local set_path=true
+ local install_args=
++ getopt -o np:v: -l no-path,system-site-packages,python:,venv-file: -n lf-activate-venv -- --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
+ options=' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\'''
+ eval set -- ' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\'''
++ set -- --python python3 -- 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
+ true
+ case $1 in
+ python=python3
+ shift 2
+ true
+ case $1 in
+ shift
+ break
+ case $python in
+ local pkg_list=
+ [[ -d /opt/pyenv ]]
+ echo 'Setup pyenv:'
Setup pyenv:
+ export PYENV_ROOT=/opt/pyenv
+ PYENV_ROOT=/opt/pyenv
+ export PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
+ PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
+ pyenv versions
  system
  3.8.13
  3.9.13
  3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-ask-all-argon/.python-version)
+ command -v pyenv
++ pyenv init - --no-rehash
+ eval 'PATH="$(bash --norc -ec '\''IFS=:; paths=($PATH); 
for i in ${!paths[@]}; do 
if [[ ${paths[i]} == "'\'''\''/opt/pyenv/shims'\'''\''" ]]; then unset '\''\'\'''\''paths[i]'\''\'\'''\''; 
fi; done; 
echo "${paths[*]}"'\'')"
export PATH="/opt/pyenv/shims:${PATH}"
export PYENV_SHELL=bash
source '\''/opt/pyenv/libexec/../completions/pyenv.bash'\''
pyenv() {
  local command
  command="${1:-}"
  if [ "$#" -gt 0 ]; then
    shift
  fi

  case "$command" in
  rehash|shell)
    eval "$(pyenv "sh-$command" "$@")"
    ;;
  *)
    command pyenv "$command" "$@"
    ;;
  esac
}'
+++ bash --norc -ec 'IFS=:; paths=($PATH); 
for i in ${!paths[@]}; do 
if [[ ${paths[i]} == "/opt/pyenv/shims" ]]; then unset '\''paths[i]'\''; 
fi; done; 
echo "${paths[*]}"'
++ PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
++ export PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
++ PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
++ export PYENV_SHELL=bash
++ PYENV_SHELL=bash
++ source /opt/pyenv/libexec/../completions/pyenv.bash
+++ complete -F _pyenv pyenv
++ lf-pyver python3
++ local py_version_xy=python3
++ local py_version_xyz=
++ awk '{ print $1 }'
++ pyenv versions
++ local command
++ command=versions
++ '[' 1 -gt 0 ']'
++ shift
++ case "$command" in
++ command pyenv versions
++ pyenv versions
++ sed 's/^[ *]* //'
++ grep -E '^[0-9.]*[0-9]$'
++ [[ ! -s /tmp/.pyenv_versions ]]
+++ grep '^3' /tmp/.pyenv_versions
+++ sort -V
+++ tail -n 1
++ py_version_xyz=3.11.7
++ [[ -z 3.11.7 ]]
++ echo 3.11.7
++ return 0
+ pyenv local 3.11.7
+ local command
+ command=local
+ '[' 2 -gt 0 ']'
+ shift
+ case "$command" in
+ command pyenv local 3.11.7
+ pyenv local 3.11.7
+ for arg in "$@"
+ case $arg in
+ pkg_list+='lftools[openstack] '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='kubernetes '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='niet '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='python-heatclient '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='python-openstackclient '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='python-magnumclient '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='yq '
+ [[ -f /tmp/.os_lf_venv ]]
++ cat /tmp/.os_lf_venv
+ lf_venv=/tmp/venv-geSN
+ echo 'lf-activate-venv(): INFO: Reuse venv:/tmp/venv-geSN from' file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-geSN from file:/tmp/.os_lf_venv
+ /tmp/venv-geSN/bin/python3 -m pip install --upgrade --quiet pip virtualenv
+ [[ -z lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq  ]]
+ echo 'lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq '
lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 
+ /tmp/venv-geSN/bin/python3 -m pip install --upgrade --quiet --upgrade-strategy eager 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
+ type python3
+ true
+ echo 'lf-activate-venv(): INFO: Adding /tmp/venv-geSN/bin to PATH'
lf-activate-venv(): INFO: Adding /tmp/venv-geSN/bin to PATH
+ PATH=/tmp/venv-geSN/bin:/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
+ return 0
+ openstack --os-cloud vex limits show --absolute
+--------------------------+---------+
| Name                     |   Value |
+--------------------------+---------+
| maxTotalInstances        |      -1 |
| maxTotalCores            |     450 |
| maxTotalRAMSize          | 1000000 |
| maxServerMeta            |     128 |
| maxImageMeta             |     128 |
| maxPersonality           |       5 |
| maxPersonalitySize       |   10240 |
| maxTotalKeypairs         |     100 |
| maxServerGroups          |      10 |
| maxServerGroupMembers    |      10 |
| maxTotalFloatingIps      |      -1 |
| maxSecurityGroups        |      -1 |
| maxSecurityGroupRules    |      -1 |
| totalRAMUsed             |  450560 |
| totalCoresUsed           |     110 |
| totalInstancesUsed       |      38 |
| totalFloatingIpsUsed     |       0 |
| totalSecurityGroupsUsed  |       0 |
| totalServerGroupsUsed    |       0 |
| maxTotalVolumes          |      -1 |
| maxTotalSnapshots        |      10 |
| maxTotalVolumeGigabytes  |    4096 |
| maxTotalBackups          |      10 |
| maxTotalBackupGigabytes  |    1000 |
| totalVolumesUsed         |       0 |
| totalGigabytesUsed       |       0 |
| totalSnapshotsUsed       |       0 |
| totalBackupsUsed         |       0 |
| totalBackupGigabytesUsed |       0 |
+--------------------------+---------+
+ pushd /opt/ciman/openstack-hot
/opt/ciman/openstack-hot /w/workspace/controller-csit-3node-clustering-ask-all-argon
+ lftools openstack --os-cloud vex stack create releng-controller-csit-3node-clustering-ask-all-argon-80 csit-2-instance-type.yaml /w/workspace/controller-csit-3node-clustering-ask-all-argon/stack-parameters.yaml
Creating stack releng-controller-csit-3node-clustering-ask-all-argon-80
Waiting to initialize infrastructure...
Stack initialization successful.
------------------------------------
Stack Details
------------------------------------
{'added': None,
 'capabilities': [],
 'created_at': '2024-04-06T23:06:48Z',
 'deleted': None,
 'deleted_at': None,
 'description': 'No description',
 'environment': None,
 'environment_files': None,
 'files': None,
 'files_container': None,
 'id': 'c6e22164-cea3-40c9-898c-4b4d9617583d',
 'is_rollback_disabled': True,
 'links': [{'href': 'https://orchestration.public.mtl1.vexxhost.net/v1/12c36e260d8e4bb2913965203b1b491f/stacks/releng-controller-csit-3node-clustering-ask-all-argon-80/c6e22164-cea3-40c9-898c-4b4d9617583d',
            'rel': 'self'}],
 'location': Munch({'cloud': 'vex', 'region_name': 'ca-ymq-1', 'zone': None, 'project': Munch({'id': '12c36e260d8e4bb2913965203b1b491f', 'name': '61975f2c-7c17-4d69-82fa-c3ae420ad6fd', 'domain_id': None, 'domain_name': 'Default'})}),
 'name': 'releng-controller-csit-3node-clustering-ask-all-argon-80',
 'notification_topics': [],
 'outputs': [{'description': 'IP addresses of the 2nd vm types',
              'output_key': 'vm_1_ips',
              'output_value': []},
             {'description': 'IP addresses of the 1st vm types',
              'output_key': 'vm_0_ips',
              'output_value': ['10.30.171.96',
                               '10.30.171.151',
                               '10.30.170.132']}],
 'owner_id': ****,
 'parameters': {'OS::project_id': '12c36e260d8e4bb2913965203b1b491f',
                'OS::stack_id': 'c6e22164-cea3-40c9-898c-4b4d9617583d',
                'OS::stack_name': 'releng-controller-csit-3node-clustering-ask-all-argon-80',
                'job_name': '11311-80',
                'silo': 'releng',
                'vm_0_count': '3',
                'vm_0_flavor': 'v3-standard-4',
                'vm_0_image': 'ZZCI - CentOS Stream 8 - builder - x86_64 - '
                              '20240401-160147.446',
                'vm_1_count': '0',
                'vm_1_flavor': 'v3-standard-2',
                'vm_1_image': 'ZZCI - Ubuntu 18.04 - mininet-ovs-28 - x86_64 - '
                              '20230601-180106.003'},
 'parent_id': None,
 'replaced': None,
 'status': 'CREATE_COMPLETE',
 'status_reason': 'Stack CREATE completed successfully',
 'tags': [],
 'template': None,
 'template_description': 'No description',
 'template_url': None,
 'timeout_mins': 15,
 'unchanged': None,
 'updated': None,
 'updated_at': None,
 'user_project_id': 'ec663c88b6774a3ab2985d69e7ec56e5'}
------------------------------------
+ popd
/w/workspace/controller-csit-3node-clustering-ask-all-argon
[controller-csit-3node-clustering-ask-all-argon] $ /bin/bash -l /tmp/jenkins3480409208053702902.sh
---> Copy SSH public keys to CSIT lab
Setup pyenv:
  system
  3.8.13
  3.9.13
  3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-ask-all-argon/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-geSN from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes python-heatclient python-openstackclient 
lf-activate-venv(): INFO: Adding /tmp/venv-geSN/bin to PATH
SSH not responding on 10.30.171.151. Retrying in 10 seconds...
SSH not responding on 10.30.170.132. Retrying in 10 seconds...
SSH not responding on 10.30.171.96. Retrying in 10 seconds...
Ping to 10.30.171.151 successful.
Ping to 10.30.170.132 successful.
Ping to 10.30.171.96 successful.
SSH not responding on 10.30.171.96. Retrying in 10 seconds...
SSH not responding on 10.30.171.151. Retrying in 10 seconds...
SSH not responding on 10.30.170.132. Retrying in 10 seconds...
Ping to 10.30.171.96 successful.
Ping to 10.30.171.151 successful.
Ping to 10.30.170.132 successful.
SSH not responding on 10.30.171.96. Retrying in 10 seconds...
SSH not responding on 10.30.171.151. Retrying in 10 seconds...
Warning: Permanently added '10.30.170.132' (ECDSA) to the list of known hosts.
10.30.170.132 releng-11311-80-0-builder-2.novalocal
Successfully copied public keys to slave 10.30.170.132
Ping to 10.30.171.96 successful.
Ping to 10.30.171.151 successful.
Warning: Permanently added '10.30.171.151' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.171.96' (ECDSA) to the list of known hosts.
10.30.171.151 releng-11311-80-0-builder-1.novalocal
Successfully copied public keys to slave 10.30.171.151
10.30.171.96 releng-11311-80-0-builder-0.novalocal
Successfully copied public keys to slave 10.30.171.96
Process 6718 ready.
Process 6719 ready.
Process 6720 ready.
SSH ready on all stack servers.
[controller-csit-3node-clustering-ask-all-argon] $ /bin/bash -l /tmp/jenkins4670011453196078803.sh
Setup pyenv:
  system
  3.8.13
  3.9.13
  3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-ask-all-argon/.python-version)
lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-8Rxy
lf-activate-venv(): INFO: Save venv in file: /w/workspace/controller-csit-3node-clustering-ask-all-argon/.robot_venv
lf-activate-venv(): INFO: Installing: setuptools wheel 
lf-activate-venv(): INFO: Adding /tmp/venv-8Rxy/bin to PATH
+ echo 'Installing Python Requirements'
Installing Python Requirements
+ cat
+ python -m pip install -r requirements.txt
Looking in indexes: https://nexus3.opendaylight.org/repository/PyPi/simple
Collecting docker-py (from -r requirements.txt (line 1))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/docker-py/1.10.6/docker_py-1.10.6-py2.py3-none-any.whl (50 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 50.0/50.0 kB 6.8 MB/s eta 0:00:00
Collecting ipaddr (from -r requirements.txt (line 2))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/ipaddr/2.2.0/ipaddr-2.2.0.tar.gz (26 kB)
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'done'
Collecting netaddr (from -r requirements.txt (line 3))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/netaddr/1.2.1/netaddr-1.2.1-py3-none-any.whl (2.3 MB)
Collecting netifaces (from -r requirements.txt (line 4))
  Using cached netifaces-0.11.0-cp311-cp311-linux_x86_64.whl
Collecting pyhocon (from -r requirements.txt (line 5))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyhocon/0.3.60/pyhocon-0.3.60.tar.gz (158 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 158.8/158.8 kB 18.5 MB/s eta 0:00:00
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'done'
Collecting requests (from -r requirements.txt (line 6))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/requests/2.31.0/requests-2.31.0-py3-none-any.whl (62 kB)
Collecting robotframework (from -r requirements.txt (line 7))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework/7.0/robotframework-7.0-py3-none-any.whl (726 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 726.3/726.3 kB 39.3 MB/s eta 0:00:00
Collecting robotframework-httplibrary (from -r requirements.txt (line 8))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-httplibrary/0.4.2/robotframework-httplibrary-0.4.2.tar.gz (9.1 kB)
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'done'
Collecting robotframework-requests==0.9.3 (from -r requirements.txt (line 9))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-requests/0.9.3/robotframework_requests-0.9.3-py3-none-any.whl (21 kB)
Collecting robotframework-selenium2library (from -r requirements.txt (line 10))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-selenium2library/3.0.0/robotframework_selenium2library-3.0.0-py2.py3-none-any.whl (6.2 kB)
Collecting robotframework-sshlibrary==3.8.0 (from -r requirements.txt (line 11))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-sshlibrary/3.8.0/robotframework-sshlibrary-3.8.0.tar.gz (51 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 51.4/51.4 kB 5.6 MB/s eta 0:00:00
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'done'
Collecting scapy (from -r requirements.txt (line 12))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/scapy/2.5.0/scapy-2.5.0.tar.gz (1.3 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.3/1.3 MB 30.1 MB/s eta 0:00:00
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'done'
Collecting jsonpath-rw (from -r requirements.txt (line 15))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpath-rw/1.4.0/jsonpath-rw-1.4.0.tar.gz (13 kB)
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'done'
Collecting elasticsearch (from -r requirements.txt (line 18))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch/8.13.0/elasticsearch-8.13.0-py3-none-any.whl (451 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 451.0/451.0 kB 21.3 MB/s eta 0:00:00
Collecting elasticsearch-dsl (from -r requirements.txt (line 19))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch-dsl/8.13.0/elasticsearch_dsl-8.13.0-py3-none-any.whl (88 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 88.6/88.6 kB 4.9 MB/s eta 0:00:00
Collecting pyangbind (from -r requirements.txt (line 22))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyangbind/0.8.5/pyangbind-0.8.5-py3-none-any.whl (52 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 52.9/52.9 kB 600.6 kB/s eta 0:00:00
Collecting isodate (from -r requirements.txt (line 25))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/isodate/0.6.1/isodate-0.6.1-py2.py3-none-any.whl (41 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 41.7/41.7 kB 608.2 kB/s eta 0:00:00
Collecting jmespath (from -r requirements.txt (line 28))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jmespath/1.0.1/jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting jsonpatch (from -r requirements.txt (line 31))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpatch/1.33/jsonpatch-1.33-py2.py3-none-any.whl (12 kB)
Collecting paramiko>=1.15.3 (from robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/paramiko/3.4.0/paramiko-3.4.0-py3-none-any.whl (225 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 225.9/225.9 kB 9.4 MB/s eta 0:00:00
Collecting scp>=0.13.0 (from robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/scp/0.14.5/scp-0.14.5-py2.py3-none-any.whl (8.7 kB)
Collecting docker-pycreds>=0.2.1 (from docker-py->-r requirements.txt (line 1))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/docker-pycreds/0.4.0/docker_pycreds-0.4.0-py2.py3-none-any.whl (9.0 kB)
Collecting six>=1.4.0 (from docker-py->-r requirements.txt (line 1))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/six/1.16.0/six-1.16.0-py2.py3-none-any.whl (11 kB)
Collecting websocket-client>=0.32.0 (from docker-py->-r requirements.txt (line 1))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/websocket-client/1.7.0/websocket_client-1.7.0-py3-none-any.whl (58 kB)
Collecting pyparsing<4,>=2 (from pyhocon->-r requirements.txt (line 5))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pyparsing/3.1.2/pyparsing-3.1.2-py3-none-any.whl (103 kB)
Collecting charset-normalizer<4,>=2 (from requests->-r requirements.txt (line 6))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/charset-normalizer/3.3.2/charset_normalizer-3.3.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (140 kB)
Collecting idna<4,>=2.5 (from requests->-r requirements.txt (line 6))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/idna/3.6/idna-3.6-py3-none-any.whl (61 kB)
Collecting urllib3<3,>=1.21.1 (from requests->-r requirements.txt (line 6))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/urllib3/2.2.1/urllib3-2.2.1-py3-none-any.whl (121 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 121.1/121.1 kB 13.0 MB/s eta 0:00:00
Collecting certifi>=2017.4.17 (from requests->-r requirements.txt (line 6))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/certifi/2024.2.2/certifi-2024.2.2-py3-none-any.whl (163 kB)
Collecting webtest>=2.0 (from robotframework-httplibrary->-r requirements.txt (line 8))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/webtest/3.0.0/WebTest-3.0.0-py3-none-any.whl (31 kB)
Collecting jsonpointer (from robotframework-httplibrary->-r requirements.txt (line 8))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpointer/2.4/jsonpointer-2.4-py2.py3-none-any.whl (7.8 kB)
Collecting robotframework-seleniumlibrary>=3.0.0 (from robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-seleniumlibrary/6.2.0/robotframework_seleniumlibrary-6.2.0-py2.py3-none-any.whl (95 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 95.5/95.5 kB 13.0 MB/s eta 0:00:00
Collecting ply (from jsonpath-rw->-r requirements.txt (line 15))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/ply/3.11/ply-3.11-py2.py3-none-any.whl (49 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 49.6/49.6 kB 6.5 MB/s eta 0:00:00
Collecting decorator (from jsonpath-rw->-r requirements.txt (line 15))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/decorator/5.1.1/decorator-5.1.1-py3-none-any.whl (9.1 kB)
Collecting elastic-transport<9,>=8.13 (from elasticsearch->-r requirements.txt (line 18))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elastic-transport/8.13.0/elastic_transport-8.13.0-py3-none-any.whl (64 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 64.3/64.3 kB 8.7 MB/s eta 0:00:00
Collecting python-dateutil (from elasticsearch-dsl->-r requirements.txt (line 19))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/python-dateutil/2.9.0.post0/python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB)
Collecting pyang (from pyangbind->-r requirements.txt (line 22))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyang/2.6.0/pyang-2.6.0-py2.py3-none-any.whl (594 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 594.1/594.1 kB 16.4 MB/s eta 0:00:00
Collecting lxml (from pyangbind->-r requirements.txt (line 22))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/lxml/5.2.1/lxml-5.2.1-cp311-cp311-manylinux_2_28_x86_64.whl (5.0 MB)
Collecting regex (from pyangbind->-r requirements.txt (line 22))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/regex/2023.12.25/regex-2023.12.25-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (785 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 785.1/785.1 kB 20.4 MB/s eta 0:00:00
Collecting enum34 (from pyangbind->-r requirements.txt (line 22))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/enum34/1.1.10/enum34-1.1.10-py3-none-any.whl (11 kB)
Collecting bcrypt>=3.2 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/bcrypt/4.1.2/bcrypt-4.1.2-cp39-abi3-manylinux_2_28_x86_64.whl (698 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 698.9/698.9 kB 16.1 MB/s eta 0:00:00
Collecting cryptography>=3.3 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/cryptography/42.0.5/cryptography-42.0.5-cp39-abi3-manylinux_2_28_x86_64.whl (4.6 MB)
Collecting pynacl>=1.5 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pynacl/1.5.0/PyNaCl-1.5.0-cp36-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.manylinux_2_24_x86_64.whl (856 kB)
Collecting selenium>=4.3.0 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/selenium/4.19.0/selenium-4.19.0-py3-none-any.whl (10.5 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 10.5/10.5 MB 53.8 MB/s eta 0:00:00
Collecting robotframework-pythonlibcore>=3.0.0 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-pythonlibcore/4.4.1/robotframework_pythonlibcore-4.4.1-py2.py3-none-any.whl (12 kB)
Collecting WebOb>=1.2 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/webob/1.8.7/WebOb-1.8.7-py2.py3-none-any.whl (114 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 115.0/115.0 kB 14.4 MB/s eta 0:00:00
Collecting waitress>=0.8.5 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/waitress/3.0.0/waitress-3.0.0-py3-none-any.whl (56 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 56.7/56.7 kB 7.9 MB/s eta 0:00:00
Collecting beautifulsoup4 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/beautifulsoup4/4.12.3/beautifulsoup4-4.12.3-py3-none-any.whl (147 kB)
Collecting cffi>=1.12 (from cryptography>=3.3->paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/cffi/1.16.0/cffi-1.16.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (464 kB)
Collecting trio~=0.17 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/trio/0.25.0/trio-0.25.0-py3-none-any.whl (467 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 467.2/467.2 kB 15.3 MB/s eta 0:00:00
Collecting trio-websocket~=0.9 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/trio-websocket/0.11.1/trio_websocket-0.11.1-py3-none-any.whl (17 kB)
Collecting typing_extensions>=4.9.0 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/typing-extensions/4.11.0/typing_extensions-4.11.0-py3-none-any.whl (34 kB)
Collecting soupsieve>1.2 (from beautifulsoup4->webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/soupsieve/2.5/soupsieve-2.5-py3-none-any.whl (36 kB)
Collecting pycparser (from cffi>=1.12->cryptography>=3.3->paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pycparser/2.22/pycparser-2.22-py3-none-any.whl (117 kB)
Collecting attrs>=23.2.0 (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/attrs/23.2.0/attrs-23.2.0-py3-none-any.whl (60 kB)
Collecting sortedcontainers (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/sortedcontainers/2.4.0/sortedcontainers-2.4.0-py2.py3-none-any.whl (29 kB)
Collecting outcome (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/outcome/1.3.0.post0/outcome-1.3.0.post0-py2.py3-none-any.whl (10 kB)
Collecting sniffio>=1.3.0 (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/sniffio/1.3.1/sniffio-1.3.1-py3-none-any.whl (10 kB)
Collecting wsproto>=0.14 (from trio-websocket~=0.9->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/wsproto/1.2.0/wsproto-1.2.0-py3-none-any.whl (24 kB)
Collecting pysocks!=1.5.7,<2.0,>=1.5.6 (from urllib3[socks]<3,>=1.26->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pysocks/1.7.1/PySocks-1.7.1-py3-none-any.whl (16 kB)
Collecting h11<1,>=0.9.0 (from wsproto>=0.14->trio-websocket~=0.9->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/h11/0.14.0/h11-0.14.0-py3-none-any.whl (58 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 58.3/58.3 kB 6.8 MB/s eta 0:00:00
Building wheels for collected packages: robotframework-sshlibrary, ipaddr, pyhocon, robotframework-httplibrary, scapy, jsonpath-rw
  Building wheel for robotframework-sshlibrary (setup.py): started
  Building wheel for robotframework-sshlibrary (setup.py): finished with status 'done'
  Created wheel for robotframework-sshlibrary: filename=robotframework_sshlibrary-3.8.0-py3-none-any.whl size=55119 sha256=0b5a3ba09835ec2d115619a155a66f789e85feeaf443614d3130735e74050e3c
  Stored in directory: /home/jenkins/.cache/pip/wheels/f7/c9/b3/a977b7bcc410d45ae27d240df3d00a12585509180e373ecccc
  Building wheel for ipaddr (setup.py): started
  Building wheel for ipaddr (setup.py): finished with status 'done'
  Created wheel for ipaddr: filename=ipaddr-2.2.0-py3-none-any.whl size=18280 sha256=c620889fbb5033cdcd85863655f6052ff599766296c5fe1be6c179f7ae0f5d2e
  Stored in directory: /home/jenkins/.cache/pip/wheels/dc/6c/04/da2d847fa8d45c59af3e1d83e2acc29cb8adcbaf04c0898dbf
  Building wheel for pyhocon (setup.py): started
  Building wheel for pyhocon (setup.py): finished with status 'done'
  Created wheel for pyhocon: filename=pyhocon-0.3.60-py3-none-any.whl size=20865 sha256=4f9f63f8136fe27da351ce0e53fdf32ec97043774144b0b97a77748f8afe9613
  Stored in directory: /home/jenkins/.cache/pip/wheels/02/09/4e/04a983205b51f96912ae6fc13f56f3050a586c98200fe36725
  Building wheel for robotframework-httplibrary (setup.py): started
  Building wheel for robotframework-httplibrary (setup.py): finished with status 'done'
  Created wheel for robotframework-httplibrary: filename=robotframework_httplibrary-0.4.2-py3-none-any.whl size=9953 sha256=bb34249de66b2b23de78c03c999bf29b85b656d296c81cb109b080ba76a96ba0
  Stored in directory: /home/jenkins/.cache/pip/wheels/aa/bc/0d/9a20dd51effef392aae2733cb4c7b66c6fa29fca33d88b57ed
  Building wheel for scapy (setup.py): started
  Building wheel for scapy (setup.py): finished with status 'done'
  Created wheel for scapy: filename=scapy-2.5.0-py2.py3-none-any.whl size=1444327 sha256=aaa59cfe5a2c6de0a3af7068e5344a6def442857ee7fc5d7565f8ce7ff20bd72
  Stored in directory: /home/jenkins/.cache/pip/wheels/3b/a7/d6/87eeec31fbfcb2bd8ace7dad8172b6d6ebbe1ec6827dbb389a
  Building wheel for jsonpath-rw (setup.py): started
  Building wheel for jsonpath-rw (setup.py): finished with status 'done'
  Created wheel for jsonpath-rw: filename=jsonpath_rw-1.4.0-py3-none-any.whl size=15130 sha256=8c6ac7334514c320e96d6356cf6a6f90c0652c0340ba14b2f3ae90a997f151fb
  Stored in directory: /home/jenkins/.cache/pip/wheels/f1/54/63/9a8da38cefae13755097b36cc852decc25d8ef69c37d58d4eb
Successfully built robotframework-sshlibrary ipaddr pyhocon robotframework-httplibrary scapy jsonpath-rw
Installing collected packages: sortedcontainers, ply, netifaces, ipaddr, enum34, websocket-client, WebOb, waitress, urllib3, typing_extensions, soupsieve, sniffio, six, scapy, robotframework-pythonlibcore, robotframework, regex, pysocks, pyparsing, pycparser, netaddr, lxml, jsonpointer, jmespath, idna, h11, decorator, charset-normalizer, certifi, bcrypt, attrs, wsproto, requests, python-dateutil, pyhocon, pyang, outcome, jsonpath-rw, jsonpatch, isodate, elastic-transport, docker-pycreds, cffi, beautifulsoup4, webtest, trio, robotframework-requests, pynacl, pyangbind, elasticsearch, docker-py, cryptography, trio-websocket, robotframework-httplibrary, paramiko, elasticsearch-dsl, selenium, scp, robotframework-sshlibrary, robotframework-seleniumlibrary, robotframework-selenium2library
Successfully installed WebOb-1.8.7 attrs-23.2.0 bcrypt-4.1.2 beautifulsoup4-4.12.3 certifi-2024.2.2 cffi-1.16.0 charset-normalizer-3.3.2 cryptography-42.0.5 decorator-5.1.1 docker-py-1.10.6 docker-pycreds-0.4.0 elastic-transport-8.13.0 elasticsearch-8.13.0 elasticsearch-dsl-8.13.0 enum34-1.1.10 h11-0.14.0 idna-3.6 ipaddr-2.2.0 isodate-0.6.1 jmespath-1.0.1 jsonpatch-1.33 jsonpath-rw-1.4.0 jsonpointer-2.4 lxml-5.2.1 netaddr-1.2.1 netifaces-0.11.0 outcome-1.3.0.post0 paramiko-3.4.0 ply-3.11 pyang-2.6.0 pyangbind-0.8.5 pycparser-2.22 pyhocon-0.3.60 pynacl-1.5.0 pyparsing-3.1.2 pysocks-1.7.1 python-dateutil-2.9.0.post0 regex-2023.12.25 requests-2.31.0 robotframework-7.0 robotframework-httplibrary-0.4.2 robotframework-pythonlibcore-4.4.1 robotframework-requests-0.9.3 robotframework-selenium2library-3.0.0 robotframework-seleniumlibrary-6.2.0 robotframework-sshlibrary-3.8.0 scapy-2.5.0 scp-0.14.5 selenium-4.19.0 six-1.16.0 sniffio-1.3.1 sortedcontainers-2.4.0 soupsieve-2.5 trio-0.25.0 trio-websocket-0.11.1 typing_extensions-4.11.0 urllib3-2.2.1 waitress-3.0.0 websocket-client-1.7.0 webtest-3.0.0 wsproto-1.2.0
+ pip freeze
attrs==23.2.0
bcrypt==4.1.2
beautifulsoup4==4.12.3
certifi==2024.2.2
cffi==1.16.0
charset-normalizer==3.3.2
cryptography==42.0.5
decorator==5.1.1
distlib==0.3.8
docker-py==1.10.6
docker-pycreds==0.4.0
elastic-transport==8.13.0
elasticsearch==8.13.0
elasticsearch-dsl==8.13.0
enum34==1.1.10
filelock==3.13.3
h11==0.14.0
idna==3.6
ipaddr==2.2.0
isodate==0.6.1
jmespath==1.0.1
jsonpatch==1.33
jsonpath-rw==1.4.0
jsonpointer==2.4
lxml==5.2.1
netaddr==1.2.1
netifaces==0.11.0
outcome==1.3.0.post0
paramiko==3.4.0
platformdirs==4.2.0
ply==3.11
pyang==2.6.0
pyangbind==0.8.5
pycparser==2.22
pyhocon==0.3.60
PyNaCl==1.5.0
pyparsing==3.1.2
PySocks==1.7.1
python-dateutil==2.9.0.post0
regex==2023.12.25
requests==2.31.0
robotframework==7.0
robotframework-httplibrary==0.4.2
robotframework-pythonlibcore==4.4.1
robotframework-requests==0.9.3
robotframework-selenium2library==3.0.0
robotframework-seleniumlibrary==6.2.0
robotframework-sshlibrary==3.8.0
scapy==2.5.0
scp==0.14.5
selenium==4.19.0
six==1.16.0
sniffio==1.3.1
sortedcontainers==2.4.0
soupsieve==2.5
trio==0.25.0
trio-websocket==0.11.1
typing_extensions==4.11.0
urllib3==2.2.1
virtualenv==20.25.1
waitress==3.0.0
WebOb==1.8.7
websocket-client==1.7.0
WebTest==3.0.0
wsproto==1.2.0
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties file path 'env.properties'
[EnvInject] - Variables injected successfully.
[controller-csit-3node-clustering-ask-all-argon] $ /bin/bash -l /tmp/jenkins14446246421224727681.sh
Setup pyenv:
  system
  3.8.13
  3.9.13
  3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-ask-all-argon/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-geSN from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: python-heatclient python-openstackclient yq 
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
lftools 0.37.10 requires urllib3<2.1.0, but you have urllib3 2.2.1 which is incompatible.
lf-activate-venv(): INFO: Adding /tmp/venv-geSN/bin to PATH
+ ODL_SYSTEM=()
+ TOOLS_SYSTEM=()
+ OPENSTACK_SYSTEM=()
+ OPENSTACK_CONTROLLERS=()
+ mapfile -t ADDR
++ openstack stack show -f json -c outputs releng-controller-csit-3node-clustering-ask-all-argon-80
++ jq -r '.outputs[] | select(.output_key | match("^vm_[0-9]+_ips$")) | .output_value | .[]'
+ for i in "${ADDR[@]}"
++ ssh 10.30.171.96 hostname -s
Warning: Permanently added '10.30.171.96' (ECDSA) to the list of known hosts.
+ REMHOST=releng-11311-80-0-builder-0
+ case ${REMHOST} in
+ ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}")
+ for i in "${ADDR[@]}"
++ ssh 10.30.171.151 hostname -s
Warning: Permanently added '10.30.171.151' (ECDSA) to the list of known hosts.
+ REMHOST=releng-11311-80-0-builder-1
+ case ${REMHOST} in
+ ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}")
+ for i in "${ADDR[@]}"
++ ssh 10.30.170.132 hostname -s
Warning: Permanently added '10.30.170.132' (ECDSA) to the list of known hosts.
+ REMHOST=releng-11311-80-0-builder-2
+ case ${REMHOST} in
+ ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}")
+ echo NUM_ODL_SYSTEM=3
+ echo NUM_TOOLS_SYSTEM=0
+ '[' '' == yes ']'
+ NUM_OPENSTACK_SYSTEM=0
+ echo NUM_OPENSTACK_SYSTEM=0
+ '[' 0 -eq 2 ']'
+ echo ODL_SYSTEM_IP=10.30.171.96
++ seq 0 2
+ for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 )))
+ echo ODL_SYSTEM_1_IP=10.30.171.96
+ for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 )))
+ echo ODL_SYSTEM_2_IP=10.30.171.151
+ for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 )))
+ echo ODL_SYSTEM_3_IP=10.30.170.132
+ echo TOOLS_SYSTEM_IP=
++ seq 0 -1
+ openstack_index=0
+ NUM_OPENSTACK_CONTROL_NODES=1
+ echo NUM_OPENSTACK_CONTROL_NODES=1
++ seq 0 0
+ for i in $(seq 0 $((NUM_OPENSTACK_CONTROL_NODES - 1)))
+ echo OPENSTACK_CONTROL_NODE_1_IP=
+ NUM_OPENSTACK_COMPUTE_NODES=-1
+ echo NUM_OPENSTACK_COMPUTE_NODES=-1
+ '[' -1 -ge 2 ']'
++ seq 0 -2
+ NUM_OPENSTACK_HAPROXY_NODES=0
+ echo NUM_OPENSTACK_HAPROXY_NODES=0
++ seq 0 -1
+ echo 'Contents of slave_addresses.txt:'
Contents of slave_addresses.txt:
+ cat slave_addresses.txt
NUM_ODL_SYSTEM=3
NUM_TOOLS_SYSTEM=0
NUM_OPENSTACK_SYSTEM=0
ODL_SYSTEM_IP=10.30.171.96
ODL_SYSTEM_1_IP=10.30.171.96
ODL_SYSTEM_2_IP=10.30.171.151
ODL_SYSTEM_3_IP=10.30.170.132
TOOLS_SYSTEM_IP=
NUM_OPENSTACK_CONTROL_NODES=1
OPENSTACK_CONTROL_NODE_1_IP=
NUM_OPENSTACK_COMPUTE_NODES=-1
NUM_OPENSTACK_HAPROXY_NODES=0
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties file path 'slave_addresses.txt'
[EnvInject] - Variables injected successfully.
[controller-csit-3node-clustering-ask-all-argon] $ /bin/sh /tmp/jenkins12826283819383724020.sh
Preparing for JRE Version 17
Karaf artifact is karaf
Karaf project is integration
Java home is /usr/lib/jvm/java-17-openjdk
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties file path 'set_variables.env'
[EnvInject] - Variables injected successfully.
[controller-csit-3node-clustering-ask-all-argon] $ /bin/bash /tmp/jenkins9782190915874720554.sh
--2024-04-06 23:08:49--  http://git.opendaylight.org/gerrit/gitweb?p=integration/distribution.git;a=blob_plain;f=pom.xml;hb=refs/heads/stable/argon
Resolving git.opendaylight.org (git.opendaylight.org)... 13.39.230.180, 52.47.161.242, 35.181.223.58, ...
Connecting to git.opendaylight.org (git.opendaylight.org)|13.39.230.180|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 2620 (2.6K) [text/plain]
Saving to: ‘pom.xml’

     0K ..                                                    100%  275M=0s

2024-04-06 23:08:49 (275 MB/s) - ‘pom.xml’ saved [2620/2620]

Bundle version is 0.18.4-SNAPSHOT
--2024-04-06 23:08:49--  https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/maven-metadata.xml
Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6
Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 1410 (1.4K) [application/xml]
Saving to: ‘maven-metadata.xml’

     0K .                                                     100% 59.5M=0s

2024-04-06 23:08:49 (59.5 MB/s) - ‘maven-metadata.xml’ saved [1410/1410]

<?xml version="1.0" encoding="UTF-8"?>
<metadata modelVersion="1.1.0">
  <groupId>org.opendaylight.integration</groupId>
  <artifactId>karaf</artifactId>
  <version>0.18.4-SNAPSHOT</version>
  <versioning>
    <snapshot>
      <timestamp>20240406.194621</timestamp>
      <buildNumber>101</buildNumber>
    </snapshot>
    <lastUpdated>20240406194621</lastUpdated>
    <snapshotVersions>
      <snapshotVersion>
        <extension>pom</extension>
        <value>0.18.4-20240406.194621-101</value>
        <updated>20240406194621</updated>
      </snapshotVersion>
      <snapshotVersion>
        <extension>tar.gz</extension>
        <value>0.18.4-20240406.194621-101</value>
        <updated>20240406194621</updated>
      </snapshotVersion>
      <snapshotVersion>
        <extension>zip</extension>
        <value>0.18.4-20240406.194621-101</value>
        <updated>20240406194621</updated>
      </snapshotVersion>
      <snapshotVersion>
        <classifier>cyclonedx</classifier>
        <extension>xml</extension>
        <value>0.18.4-20240406.194621-101</value>
        <updated>20240406194621</updated>
      </snapshotVersion>
      <snapshotVersion>
        <classifier>cyclonedx</classifier>
        <extension>json</extension>
        <value>0.18.4-20240406.194621-101</value>
        <updated>20240406194621</updated>
      </snapshotVersion>
    </snapshotVersions>
  </versioning>
</metadata>
Nexus timestamp is 0.18.4-20240406.194621-101
Distribution bundle URL is https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/karaf-0.18.4-20240406.194621-101.zip
Distribution bundle is karaf-0.18.4-20240406.194621-101.zip
Distribution bundle version is 0.18.4-SNAPSHOT
Distribution folder is karaf-0.18.4-SNAPSHOT
Nexus prefix is https://nexus.opendaylight.org
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties file path 'detect_variables.env'
[EnvInject] - Variables injected successfully.
[controller-csit-3node-clustering-ask-all-argon] $ /bin/bash -l /tmp/jenkins1826994586702079763.sh
Setup pyenv:
  system
  3.8.13
  3.9.13
  3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-ask-all-argon/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-geSN from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: python-heatclient python-openstackclient 
lf-activate-venv(): INFO: Adding /tmp/venv-geSN/bin to PATH
Copying common-functions.sh to /tmp
Copying common-functions.sh to 10.30.171.96:/tmp
Warning: Permanently added '10.30.171.96' (ECDSA) to the list of known hosts.
Copying common-functions.sh to 10.30.171.151:/tmp
Warning: Permanently added '10.30.171.151' (ECDSA) to the list of known hosts.
Copying common-functions.sh to 10.30.170.132:/tmp
Warning: Permanently added '10.30.170.132' (ECDSA) to the list of known hosts.
[controller-csit-3node-clustering-ask-all-argon] $ /bin/bash /tmp/jenkins16738068042249684246.sh
common-functions.sh is being sourced
common-functions environment:
MAVENCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
ACTUALFEATURES: 
FEATURESCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
CUSTOMPROP: /tmp/karaf-0.18.4-SNAPSHOT/etc/custom.properties
LOGCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
MEMCONF: /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv
CONTROLLERMEM: 2048m
AKKACONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/akka.conf
MODULESCONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/modules.conf
MODULESHARDSCONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/module-shards.conf
SUITES: 

#################################################
##         Configure Cluster and Start         ##
#################################################
ACTUALFEATURES: odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app
SPACE_SEPARATED_FEATURES: odl-integration-compatible-with-all odl-jolokia odl-restconf odl-clustering-test-app
Locating script plan to use...
script plan exists!!!
Changing the script plan path...
# Place the scripts in run order:
/w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/scripts/car_people_shard.sh
Executing /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/scripts/car_people_shard.sh...
Add car-people shards file
Copy shard config to member-1 with IP address 10.30.171.96
Warning: Permanently added '10.30.171.96' (ECDSA) to the list of known hosts.
Copy shard config to member-2 with IP address 10.30.171.151
Warning: Permanently added '10.30.171.151' (ECDSA) to the list of known hosts.
Copy shard config to member-3 with IP address 10.30.170.132
Warning: Permanently added '10.30.170.132' (ECDSA) to the list of known hosts.
Finished running script plans
Configuring member-1 with IP address 10.30.171.96
Warning: Permanently added '10.30.171.96' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.171.96' (ECDSA) to the list of known hosts.
+ source /tmp/common-functions.sh karaf-0.18.4-SNAPSHOT
common-functions.sh is being sourced
++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]]
++ echo 'common-functions.sh is being sourced'
++ BUNDLEFOLDER=karaf-0.18.4-SNAPSHOT
++ export MAVENCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
++ MAVENCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
++ export FEATURESCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
++ FEATURESCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
++ export CUSTOMPROP=/tmp/karaf-0.18.4-SNAPSHOT/etc/custom.properties
++ CUSTOMPROP=/tmp/karaf-0.18.4-SNAPSHOT/etc/custom.properties
++ export LOGCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
++ LOGCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
++ export MEMCONF=/tmp/karaf-0.18.4-SNAPSHOT/bin/setenv
++ MEMCONF=/tmp/karaf-0.18.4-SNAPSHOT/bin/setenv
++ export CONTROLLERMEM=
++ CONTROLLERMEM=
++ export AKKACONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/akka.conf
++ AKKACONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/akka.conf
++ export MODULESCONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/modules.conf
++ MODULESCONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/modules.conf
++ export MODULESHARDSCONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/module-shards.conf
++ MODULESHARDSCONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/module-shards.conf
++ print_common_env
++ cat
common-functions environment:
MAVENCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
ACTUALFEATURES: 
FEATURESCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
CUSTOMPROP: /tmp/karaf-0.18.4-SNAPSHOT/etc/custom.properties
LOGCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
MEMCONF: /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv
CONTROLLERMEM: 
AKKACONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/akka.conf
MODULESCONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/modules.conf
MODULESHARDSCONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/module-shards.conf
SUITES: 

Changing to /tmp
Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/karaf-0.18.4-20240406.194621-101.zip
++ SSH='ssh -t -t'
++ extra_services_cntl='     dnsmasq.service     httpd.service     libvirtd.service     openvswitch.service     ovs-vswitchd.service     ovsdb-server.service     rabbitmq-server.service '
++ extra_services_cmp='     libvirtd.service     openvswitch.service     ovs-vswitchd.service     ovsdb-server.service '
+ echo 'Changing to /tmp'
+ cd /tmp
+ echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/karaf-0.18.4-20240406.194621-101.zip'
+ wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/karaf-0.18.4-20240406.194621-101.zip
--2024-04-06 23:09:00--  https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/karaf-0.18.4-20240406.194621-101.zip
Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6
Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 260399296 (248M) [application/zip]
Saving to: ‘karaf-0.18.4-20240406.194621-101.zip’

     0K ........ ........ ........ ........ ........ ........  1% 31.7M 8s
  3072K ........ ........ ........ ........ ........ ........  2% 54.1M 6s
  6144K ........ ........ ........ ........ ........ ........  3%  113M 5s
  9216K ........ ........ ........ ........ ........ ........  4% 63.1M 4s
 12288K ........ ........ ........ ........ ........ ........  6% 47.3M 4s
 15360K ........ ........ ........ ........ ........ ........  7% 50.9M 4s
 18432K ........ ........ ........ ........ ........ ........  8% 59.2M 4s
 21504K ........ ........ ........ ........ ........ ........  9% 52.5M 4s
 24576K ........ ........ ........ ........ ........ ........ 10% 74.3M 4s
 27648K ........ ........ ........ ........ ........ ........ 12% 91.3M 4s
 30720K ........ ........ ........ ........ ........ ........ 13% 67.0M 4s
 33792K ........ ........ ........ ........ ........ ........ 14% 73.7M 4s
 36864K ........ ........ ........ ........ ........ ........ 15% 77.3M 3s
 39936K ........ ........ ........ ........ ........ ........ 16% 92.3M 3s
 43008K ........ ........ ........ ........ ........ ........ 18% 70.8M 3s
 46080K ........ ........ ........ ........ ........ ........ 19% 78.4M 3s
 49152K ........ ........ ........ ........ ........ ........ 20% 85.7M 3s
 52224K ........ ........ ........ ........ ........ ........ 21%  118M 3s
 55296K ........ ........ ........ ........ ........ ........ 22%  172M 3s
 58368K ........ ........ ........ ........ ........ ........ 24%  183M 3s
 61440K ........ ........ ........ ........ ........ ........ 25%  190M 3s
 64512K ........ ........ ........ ........ ........ ........ 26%  214M 2s
 67584K ........ ........ ........ ........ ........ ........ 27%  189M 2s
 70656K ........ ........ ........ ........ ........ ........ 28%  201M 2s
 73728K ........ ........ ........ ........ ........ ........ 30%  184M 2s
 76800K ........ ........ ........ ........ ........ ........ 31%  189M 2s
 79872K ........ ........ ........ ........ ........ ........ 32%  183M 2s
 82944K ........ ........ ........ ........ ........ ........ 33%  183M 2s
 86016K ........ ........ ........ ........ ........ ........ 35%  203M 2s
 89088K ........ ........ ........ ........ ........ ........ 36%  184M 2s
 92160K ........ ........ ........ ........ ........ ........ 37%  201M 2s
 95232K ........ ........ ........ ........ ........ ........ 38%  197M 2s
 98304K ........ ........ ........ ........ ........ ........ 39%  208M 2s
101376K ........ ........ ........ ........ ........ ........ 41%  222M 2s
104448K ........ ........ ........ ........ ........ ........ 42%  232M 1s
107520K ........ ........ ........ ........ ........ ........ 43%  243M 1s
110592K ........ ........ ........ ........ ........ ........ 44%  252M 1s
113664K ........ ........ ........ ........ ........ ........ 45%  233M 1s
116736K ........ ........ ........ ........ ........ ........ 47%  278M 1s
119808K ........ ........ ........ ........ ........ ........ 48%  226M 1s
122880K ........ ........ ........ ........ ........ ........ 49%  241M 1s
125952K ........ ........ ........ ........ ........ ........ 50%  243M 1s
129024K ........ ........ ........ ........ ........ ........ 51%  257M 1s
132096K ........ ........ ........ ........ ........ ........ 53%  249M 1s
135168K ........ ........ ........ ........ ........ ........ 54%  289M 1s
138240K ........ ........ ........ ........ ........ ........ 55%  275M 1s
141312K ........ ........ ........ ........ ........ ........ 56%  285M 1s
144384K ........ ........ ........ ........ ........ ........ 57%  293M 1s
147456K ........ ........ ........ ........ ........ ........ 59%  266M 1s
150528K ........ ........ ........ ........ ........ ........ 60%  286M 1s
153600K ........ ........ ........ ........ ........ ........ 61%  314M 1s
156672K ........ ........ ........ ........ ........ ........ 62%  300M 1s
159744K ........ ........ ........ ........ ........ ........ 64%  304M 1s
162816K ........ ........ ........ ........ ........ ........ 65%  318M 1s
165888K ........ ........ ........ ........ ........ ........ 66%  311M 1s
168960K ........ ........ ........ ........ ........ ........ 67%  322M 1s
172032K ........ ........ ........ ........ ........ ........ 68%  311M 1s
175104K ........ ........ ........ ........ ........ ........ 70%  331M 1s
178176K ........ ........ ........ ........ ........ ........ 71%  360M 1s
181248K ........ ........ ........ ........ ........ ........ 72%  344M 1s
184320K ........ ........ ........ ........ ........ ........ 73%  241M 0s
187392K ........ ........ ........ ........ ........ ........ 74%  301M 0s
190464K ........ ........ ........ ........ ........ ........ 76%  298M 0s
193536K ........ ........ ........ ........ ........ ........ 77%  339M 0s
196608K ........ ........ ........ ........ ........ ........ 78%  358M 0s
199680K ........ ........ ........ ........ ........ ........ 79%  357M 0s
202752K ........ ........ ........ ........ ........ ........ 80%  363M 0s
205824K ........ ........ ........ ........ ........ ........ 82%  356M 0s
208896K ........ ........ ........ ........ ........ ........ 83%  345M 0s
211968K ........ ........ ........ ........ ........ ........ 84%  300M 0s
215040K ........ ........ ........ ........ ........ ........ 85%  351M 0s
218112K ........ ........ ........ ........ ........ ........ 86%  348M 0s
221184K ........ ........ ........ ........ ........ ........ 88%  373M 0s
224256K ........ ........ ........ ........ ........ ........ 89%  349M 0s
227328K ........ ........ ........ ........ ........ ........ 90%  378M 0s
230400K ........ ........ ........ ........ ........ ........ 91%  333M 0s
233472K ........ ........ ........ ........ ........ ........ 93%  361M 0s
236544K ........ ........ ........ ........ ........ ........ 94%  348M 0s
239616K ........ ........ ........ ........ ........ ........ 95%  365M 0s
242688K ........ ........ ........ ........ ........ ........ 96%  330M 0s
245760K ........ ........ ........ ........ ........ ........ 97%  373M 0s
248832K ........ ........ ........ ........ ........ ........ 99%  353M 0s
251904K ........ ........ ........ ........ .....            100%  351M=1.6s

2024-04-06 23:09:01 (160 MB/s) - ‘karaf-0.18.4-20240406.194621-101.zip’ saved [260399296/260399296]

Extracting the new controller...
+ echo 'Extracting the new controller...'
+ unzip -q karaf-0.18.4-20240406.194621-101.zip
Adding external repositories...
+ echo 'Adding external repositories...'
+ sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
+ cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
################################################################################
#
#    Licensed to the Apache Software Foundation (ASF) under one or more
#    contributor license agreements.  See the NOTICE file distributed with
#    this work for additional information regarding copyright ownership.
#    The ASF licenses this file to You under the Apache License, Version 2.0
#    (the "License"); you may not use this file except in compliance with
#    the License.  You may obtain a copy of the License at
#
#       http://www.apache.org/licenses/LICENSE-2.0
#
#    Unless required by applicable law or agreed to in writing, software
#    distributed under the License is distributed on an "AS IS" BASIS,
#    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
#    See the License for the specific language governing permissions and
#    limitations under the License.
#
################################################################################

#
# If set to true, the following property will not allow any certificate to be used
# when accessing Maven repositories through SSL
#
#org.ops4j.pax.url.mvn.certificateCheck=

#
# Path to the local Maven settings file.
# The repositories defined in this file will be automatically added to the list
# of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property
# below is not set.
# The following locations are checked for the existence of the settings.xml file
#   * 1. looks for the specified url
#   * 2. if not found looks for ${user.home}/.m2/settings.xml
#   * 3. if not found looks for ${maven.home}/conf/settings.xml
#   * 4. if not found looks for ${M2_HOME}/conf/settings.xml
#
#org.ops4j.pax.url.mvn.settings=

#
# Path to the local Maven repository which is used to avoid downloading
# artifacts when they already exist locally.
# The value of this property will be extracted from the settings.xml file
# above, or defaulted to:
#     System.getProperty( "user.home" ) + "/.m2/repository"
#
org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository}

#
# Default this to false. It's just weird to use undocumented repos
#
org.ops4j.pax.url.mvn.useFallbackRepositories=false

#
# Uncomment if you don't wanna use the proxy settings
# from the Maven conf/settings.xml file
#
# org.ops4j.pax.url.mvn.proxySupport=false

#
# Comma separated list of repositories scanned when resolving an artifact.
# Those repositories will be checked before iterating through the
#    below list of repositories and even before the local repository
# A repository url can be appended with zero or more of the following flags:
#    @snapshots  : the repository contains snaphots
#    @noreleases : the repository does not contain any released artifacts
#
# The following property value will add the system folder as a repo.
#
org.ops4j.pax.url.mvn.defaultRepositories=\
    file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\
    file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\
    file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots

# Use the default local repo (e.g.~/.m2/repository) as a "remote" repo
#org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false

#
# Comma separated list of repositories scanned when resolving an artifact.
# The default list includes the following repositories:
#    http://repo1.maven.org/maven2@id=central
#    http://repository.springsource.com/maven/bundles/release@id=spring.ebr
#    http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external
#    http://zodiac.springsource.com/maven/bundles/release@id=gemini
#    http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases
#    https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases
#    https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
# To add repositories to the default ones, prepend '+' to the list of repositories
# to add.
# A repository url can be appended with zero or more of the following flags:
#    @snapshots  : the repository contains snapshots
#    @noreleases : the repository does not contain any released artifacts
#    @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended
#
org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases

### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.Configuring the startup features...
+ [[ True == \T\r\u\e ]]
+ echo 'Configuring the startup features...'
+ sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
+ FEATURE_TEST_STRING=features-test
+ FEATURE_TEST_VERSION=0.18.4-SNAPSHOT
+ KARAF_VERSION=karaf4
+ [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]]
+ sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.18.4-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
+ [[ ! -z '' ]]
+ cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
################################################################################
#
#    Licensed to the Apache Software Foundation (ASF) under one or more
#    contributor license agreements.  See the NOTICE file distributed with
#    this work for additional information regarding copyright ownership.
#    The ASF licenses this file to You under the Apache License, Version 2.0
#    (the "License"); you may not use this file except in compliance with
#    the License.  You may obtain a copy of the License at
#
#       http://www.apache.org/licenses/LICENSE-2.0
#
#    Unless required by applicable law or agreed to in writing, software
#    distributed under the License is distributed on an "AS IS" BASIS,
#    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
#    See the License for the specific language governing permissions and
#    limitations under the License.
#
################################################################################

#
# Comma separated list of features repositories to register by default
#
featuresRepositories = mvn:org.opendaylight.integration/features-test/0.18.4-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/8a04ff1b-ac3d-412c-bd6f-10a42387a5d8.xml

#
# Comma separated list of features to install at startup
#
featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, 57c24381-3139-498b-8c1d-3df89d3e4465

#
# Resource repositories (OBR) that the features resolver can use
# to resolve requirements/capabilities
#
# The format of the resourceRepositories is 
# resourceRepositories=[xml:url|json:url],...
# for Instance:
#
#resourceRepositories=xml:http://host/path/to/index.xml
# or
#resourceRepositories=json:http://host/path/to/index.json
#

#
# Defines if the boot features are started in asynchronous mode (in a dedicated thread)
#
featuresBootAsynchronous=false

#
# Service requirements enforcement
#
# By default, the feature resolver checks the service requirements/capabilities of
# bundles for new features (xml schema >= 1.3.0) in order to automatically installs
# the required bundles.
# The following flag can have those values:
#   - disable: service requirements are completely ignored
#   - default: service requirements are ignored for old features
#   - enforce: service requirements are always verified
#
#serviceRequirements=default

#
# Store cfg file for config element in feature
#
#configCfgStore=true

#
# Define if the feature service automatically refresh bundles
#
autoRefresh=true

#
# Configuration of features processing mechanism (overrides, blacklisting, modification of features)
# XML file defines instructions related to features processing
# versions.properties may declare properties to resolve placeholders in XML file
# both files are relative to ${karaf.etc}
#
#featureProcessing=org.apache.karaf.features.xml
#featureProcessingVersions=versions.properties
+ configure_karaf_log karaf4 ''
+ local -r karaf_version=karaf4
+ local -r controllerdebugmap=
+ local logapi=log4j
+ grep log4j2 /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
log4j2.rootLogger.level = INFO
#log4j2.rootLogger.type = asyncRoot
#log4j2.rootLogger.includeLocation = false
log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
log4j2.rootLogger.appenderRef.Console.ref = Console
log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
log4j2.logger.spifly.name = org.apache.aries.spifly
log4j2.logger.spifly.level = WARN
log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
log4j2.logger.audit.level = INFO
log4j2.logger.audit.additivity = false
log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
# Console appender not used by default (see log4j2.rootLogger.appenderRefs)
log4j2.appender.console.type = Console
log4j2.appender.console.name = Console
log4j2.appender.console.layout.type = PatternLayout
log4j2.appender.console.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.type = RollingRandomAccessFile
log4j2.appender.rolling.name = RollingFile
log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
#log4j2.appender.rolling.immediateFlush = false
log4j2.appender.rolling.append = true
log4j2.appender.rolling.layout.type = PatternLayout
log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.policies.type = Policies
log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.rolling.policies.size.size = 64MB
log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
log4j2.appender.rolling.strategy.max = 7
log4j2.appender.audit.type = RollingRandomAccessFile
log4j2.appender.audit.name = AuditRollingFile
log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
log4j2.appender.audit.append = true
log4j2.appender.audit.layout.type = PatternLayout
log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
log4j2.appender.audit.policies.type = Policies
log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.audit.policies.size.size = 8MB
log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
log4j2.appender.audit.strategy.max = 7
log4j2.appender.osgi.type = PaxOsgi
log4j2.appender.osgi.name = PaxOsgi
log4j2.appender.osgi.filter = *
#log4j2.logger.aether.name = shaded.org.eclipse.aether
#log4j2.logger.aether.level = TRACE
#log4j2.logger.http-headers.name = shaded.org.apache.http.headers
#log4j2.logger.http-headers.level = DEBUG
#log4j2.logger.maven.name = org.ops4j.pax.url.mvn
#log4j2.logger.maven.level = TRACE
Configuring the karaf log... karaf_version: karaf4, logapi: log4j2
+ logapi=log4j2
+ echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2'
+ '[' log4j2 == log4j2 ']'
+ sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
+ orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver
+ orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver
+ echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN'
+ echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN'
controllerdebugmap: 
+ unset IFS
+ echo 'controllerdebugmap: '
cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
+ '[' -n '' ']'
+ echo 'cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg'
+ cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
################################################################################
#
#    Licensed to the Apache Software Foundation (ASF) under one or more
#    contributor license agreements.  See the NOTICE file distributed with
#    this work for additional information regarding copyright ownership.
#    The ASF licenses this file to You under the Apache License, Version 2.0
#    (the "License"); you may not use this file except in compliance with
#    the License.  You may obtain a copy of the License at
#
#       http://www.apache.org/licenses/LICENSE-2.0
#
#    Unless required by applicable law or agreed to in writing, software
#    distributed under the License is distributed on an "AS IS" BASIS,
#    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
#    See the License for the specific language governing permissions and
#    limitations under the License.
#
################################################################################

# Common pattern layout for appenders
log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n

# Root logger
log4j2.rootLogger.level = INFO
# uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library
#log4j2.rootLogger.type = asyncRoot
#log4j2.rootLogger.includeLocation = false
log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
log4j2.rootLogger.appenderRef.Console.ref = Console
log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}

# Filters for logs marked by org.opendaylight.odlparent.Markers
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL

# Loggers configuration

# Spifly logger
log4j2.logger.spifly.name = org.apache.aries.spifly
log4j2.logger.spifly.level = WARN

# Security audit logger
log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
log4j2.logger.audit.level = INFO
log4j2.logger.audit.additivity = false
log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile

# Appenders configuration

# Console appender not used by default (see log4j2.rootLogger.appenderRefs)
log4j2.appender.console.type = Console
log4j2.appender.console.name = Console
log4j2.appender.console.layout.type = PatternLayout
log4j2.appender.console.layout.pattern = ${log4j2.pattern}

# Rolling file appender
log4j2.appender.rolling.type = RollingRandomAccessFile
log4j2.appender.rolling.name = RollingFile
log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
# uncomment to not force a disk flush
#log4j2.appender.rolling.immediateFlush = false
log4j2.appender.rolling.append = true
log4j2.appender.rolling.layout.type = PatternLayout
log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.policies.type = Policies
log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.rolling.policies.size.size = 1GB
log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
log4j2.appender.rolling.strategy.max = 7

# Audit file appender
log4j2.appender.audit.type = RollingRandomAccessFile
log4j2.appender.audit.name = AuditRollingFile
log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
log4j2.appender.audit.append = true
log4j2.appender.audit.layout.type = PatternLayout
log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
log4j2.appender.audit.policies.type = Policies
log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.audit.policies.size.size = 8MB
log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
log4j2.appender.audit.strategy.max = 7

# OSGi appender
log4j2.appender.osgi.type = PaxOsgi
log4j2.appender.osgi.name = PaxOsgi
log4j2.appender.osgi.filter = *

# help with identification of maven-related problems with pax-url-aether
#log4j2.logger.aether.name = shaded.org.eclipse.aether
#log4j2.logger.aether.level = TRACE
#log4j2.logger.http-headers.name = shaded.org.apache.http.headers
#log4j2.logger.http-headers.level = DEBUG
#log4j2.logger.maven.name = org.ops4j.pax.url.mvn
#log4j2.logger.maven.level = TRACE
log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN
log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN
+ set_java_vars /usr/lib/jvm/java-17-openjdk 3072m /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv
Configure
+ local -r java_home=/usr/lib/jvm/java-17-openjdk
+ local -r controllermem=3072m
+ local -r memconf=/tmp/karaf-0.18.4-SNAPSHOT/bin/setenv
+ echo Configure
    java home: /usr/lib/jvm/java-17-openjdk
    max memory: 3072m
    memconf: /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv
+ echo '    java home: /usr/lib/jvm/java-17-openjdk'
+ echo '    max memory: 3072m'
+ echo '    memconf: /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv'
+ sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk}%g' /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv
+ sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv
cat /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv
+ echo 'cat /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv'
+ cat /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv
#!/bin/sh
#
#    Licensed to the Apache Software Foundation (ASF) under one or more
#    contributor license agreements.  See the NOTICE file distributed with
#    this work for additional information regarding copyright ownership.
#    The ASF licenses this file to You under the Apache License, Version 2.0
#    (the "License"); you may not use this file except in compliance with
#    the License.  You may obtain a copy of the License at
#
#       http://www.apache.org/licenses/LICENSE-2.0
#
#    Unless required by applicable law or agreed to in writing, software
#    distributed under the License is distributed on an "AS IS" BASIS,
#    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
#    See the License for the specific language governing permissions and
#    limitations under the License.
#

#
# handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf
# script: client, instance, shell, start, status, stop, karaf
#
# if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then
#   Actions go here...
# fi

#
# general settings which should be applied for all scripts go here; please keep
# in mind that it is possible that scripts might be executed more than once, e.g.
# in example of the start script where the start script is executed first and the
# karaf script afterwards.
#

#
# The following section shows the possible configuration options for the default 
# karaf scripts
#
export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk} # Location of Java installation
# export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration
# export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options
# export EXTRA_JAVA_OPTS # Additional JVM options
# export KARAF_HOME # Karaf home folder
# export KARAF_DATA # Karaf data folder
# export KARAF_BASE # Karaf base folder
# export KARAF_ETC  # Karaf etc  folder
# export KARAF_LOG  # Karaf log  folder
# export KARAF_SYSTEM_OPTS # First citizen Karaf options
# export KARAF_OPTS # Additional available Karaf options
# export KARAF_DEBUG # Enable debug mode
# export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start
# export KARAF_NOROOT # Prevent execution as root if set to true
Set Java version
+ echo 'Set Java version'
+ sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-17-openjdk/bin/java 1
+ sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-17-openjdk/bin/java
JDK default version ...
+ echo 'JDK default version ...'
+ java -version
openjdk version "17.0.6-ea" 2023-01-17 LTS
OpenJDK Runtime Environment (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS)
OpenJDK 64-Bit Server VM (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS, mixed mode, sharing)
Set JAVA_HOME
+ echo 'Set JAVA_HOME'
+ export JAVA_HOME=/usr/lib/jvm/java-17-openjdk
+ JAVA_HOME=/usr/lib/jvm/java-17-openjdk
++ readlink -e /usr/lib/jvm/java-17-openjdk/bin/java
Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java
Listing all open ports on controller system...
+ JAVA_RESOLVED=/usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java
+ echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java'
+ echo 'Listing all open ports on controller system...'
+ netstat -pnatu
(Not all processes could be identified, non-owned process info
 will not be shown, you would have to be root to see it all.)
Active Internet connections (servers and established)
Proto Recv-Q Send-Q Local Address           Foreign Address         State       PID/Program name    
tcp        0      0 0.0.0.0:111             0.0.0.0:*               LISTEN      -                   
tcp        0      0 0.0.0.0:22              0.0.0.0:*               LISTEN      -                   
tcp        0      0 10.30.171.96:50664      199.204.45.87:443       TIME_WAIT   -                   
tcp        0    164 10.30.171.96:22         10.30.171.62:51494      ESTABLISHED -                   
tcp6       0      0 :::111                  :::*                    LISTEN      -                   
tcp6       0      0 :::5555                 :::*                    LISTEN      -                   
tcp6       0      0 :::22                   :::*                    LISTEN      -                   
udp        0      0 10.30.171.96:68         10.30.170.4:67          ESTABLISHED -                   
udp        0      0 0.0.0.0:111             0.0.0.0:*                           -                   
udp        0      0 127.0.0.1:323           0.0.0.0:*                           -                   
udp6       0      0 :::111                  :::*                                -                   
udp6       0      0 ::1:323                 :::*                                -                   
+ '[' -f /tmp/custom_shard_config.txt ']'
Custom shard config exists!!!
Copying the shard config...
+ echo 'Custom shard config exists!!!'
+ echo 'Copying the shard config...'
+ cp /tmp/custom_shard_config.txt /tmp/karaf-0.18.4-SNAPSHOT/bin/
Configuring cluster
+ echo 'Configuring cluster'
+ /tmp/karaf-0.18.4-SNAPSHOT/bin/configure_cluster.sh 1 10.30.171.96 10.30.171.151 10.30.170.132
################################################
##             Configure Cluster              ##
################################################
 NOTE: Cluster configuration files not found. Copying from
 /tmp/karaf-0.18.4-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/7.0.11
Configuring unique name in akka.conf
Configuring hostname in akka.conf
Configuring data and rpc seed nodes in akka.conf
modules = [
	
	{
		name = "inventory"
		namespace = "urn:opendaylight:inventory"
		shard-strategy = "module"
	},
	{
		name = "topology"
		namespace = "urn:TBD:params:xml:ns:yang:network-topology"
		shard-strategy = "module"
	},
	{
		name = "toaster"
		namespace = "http://netconfcentral.org/ns/toaster"
		shard-strategy = "module"
	},
	{
		name = "car"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
		shard-strategy = "module"
	},
	{
		name = "people"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
		shard-strategy = "module"
	},
	{
		name = "car-people"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
		shard-strategy = "module"
	}
]
Configuring replication type in module-shards.conf
################################################
##   NOTE: Manually restart controller to     ##
##         apply configuration.               ##
################################################
Dump akka.conf
+ echo 'Dump akka.conf'
+ cat /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/akka.conf

odl-cluster-data {
  akka {
    remote {
      artery {
        enabled = on
        transport = tcp
        canonical.hostname = "10.30.171.96"
        canonical.port = 2550
      }
    }

    cluster {
      # Using artery.
      seed-nodes = ["akka://opendaylight-cluster-data@10.30.171.96:2550",
				"akka://opendaylight-cluster-data@10.30.171.151:2550",
				"akka://opendaylight-cluster-data@10.30.170.132:2550"]

      roles = ["member-1"]

      # when under load we might trip a false positive on the failure detector
      # failure-detector {
        # heartbeat-interval = 4 s
        # acceptable-heartbeat-pause = 16s
      # }
    }

    persistence {
      # By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by
      # modifying the following two properties. The directory location specified may be a relative or absolute path. 
      # The relative path is always relative to KARAF_HOME.

      # snapshot-store.local.dir = "target/snapshots"

      # Use lz4 compression for LocalSnapshotStore snapshots
      snapshot-store.local.use-lz4-compression = false
      # Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB
      snapshot-store.local.lz4-blocksize = 256KB
    }
    disable-default-actor-system-quarantined-event-handling = "false"
  }
}
Dump modules.conf
+ echo 'Dump modules.conf'
+ cat /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/modules.conf
modules = [
	
	{
		name = "inventory"
		namespace = "urn:opendaylight:inventory"
		shard-strategy = "module"
	},
	{
		name = "topology"
		namespace = "urn:TBD:params:xml:ns:yang:network-topology"
		shard-strategy = "module"
	},
	{
		name = "toaster"
		namespace = "http://netconfcentral.org/ns/toaster"
		shard-strategy = "module"
	},
	{
		name = "car"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
		shard-strategy = "module"
	},
	{
		name = "people"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
		shard-strategy = "module"
	},
	{
		name = "car-people"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
		shard-strategy = "module"
	}
]
Dump module-shards.conf
+ echo 'Dump module-shards.conf'
+ cat /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/module-shards.conf
module-shards = [
	{
		name = "default"
		shards = [
			{
				name = "default"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "inventory"
		shards = [
			{
				name="inventory"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "topology"
		shards = [
			{
				name="topology"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "toaster"
		shards = [
			{
				name="toaster"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "car"
		shards = [
			{
				name="car"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "people"
		shards = [
			{
				name="people"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "car-people"
		shards = [
			{
				name="car-people"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	}
]
Configuring member-2 with IP address 10.30.171.151
Warning: Permanently added '10.30.171.151' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.171.151' (ECDSA) to the list of known hosts.
common-functions.sh is being sourced
+ source /tmp/common-functions.sh karaf-0.18.4-SNAPSHOT
++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]]
++ echo 'common-functions.sh is being sourced'
++ BUNDLEFOLDER=karaf-0.18.4-SNAPSHOT
++ export MAVENCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
++ MAVENCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
++ export FEATURESCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
++ FEATURESCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
++ export CUSTOMPROP=/tmp/karaf-0.18.4-SNAPSHOT/etc/custom.properties
++ CUSTOMPROP=/tmp/karaf-0.18.4-SNAPSHOT/etc/custom.properties
++ export LOGCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
++ LOGCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
++ export MEMCONF=/tmp/karaf-0.18.4-SNAPSHOT/bin/setenv
++ MEMCONF=/tmp/karaf-0.18.4-SNAPSHOT/bin/setenv
++ export CONTROLLERMEM=
++ CONTROLLERMEM=
++ export AKKACONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/akka.conf
++ AKKACONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/akka.conf
++ export MODULESCONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/modules.conf
++ MODULESCONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/modules.conf
++ export MODULESHARDSCONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/module-shards.conf
++ MODULESHARDSCONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/module-shards.conf
++ print_common_env
++ cat
common-functions environment:
MAVENCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
ACTUALFEATURES: 
FEATURESCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
CUSTOMPROP: /tmp/karaf-0.18.4-SNAPSHOT/etc/custom.properties
LOGCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
MEMCONF: /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv
CONTROLLERMEM: 
AKKACONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/akka.conf
MODULESCONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/modules.conf
MODULESHARDSCONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/module-shards.conf
SUITES: 

++ SSH='ssh -t -t'
++ extra_services_cntl='     dnsmasq.service     httpd.service     libvirtd.service     openvswitch.service     ovs-vswitchd.service     ovsdb-server.service     rabbitmq-server.service '
++ extra_services_cmp='     libvirtd.service     openvswitch.service     ovs-vswitchd.service     ovsdb-server.service '
Changing to /tmp
Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/karaf-0.18.4-20240406.194621-101.zip
+ echo 'Changing to /tmp'
+ cd /tmp
+ echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/karaf-0.18.4-20240406.194621-101.zip'
+ wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/karaf-0.18.4-20240406.194621-101.zip
--2024-04-06 23:09:05--  https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/karaf-0.18.4-20240406.194621-101.zip
Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6
Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 260399296 (248M) [application/zip]
Saving to: ‘karaf-0.18.4-20240406.194621-101.zip’

     0K ........ ........ ........ ........ ........ ........  1% 34.4M 7s
  3072K ........ ........ ........ ........ ........ ........  2% 55.0M 6s
  6144K ........ ........ ........ ........ ........ ........  3%  133M 4s
  9216K ........ ........ ........ ........ ........ ........  4%  147M 4s
 12288K ........ ........ ........ ........ ........ ........  6%  141M 3s
 15360K ........ ........ ........ ........ ........ ........  7%  133M 3s
 18432K ........ ........ ........ ........ ........ ........  8%  164M 3s
 21504K ........ ........ ........ ........ ........ ........  9%  169M 2s
 24576K ........ ........ ........ ........ ........ ........ 10%  174M 2s
 27648K ........ ........ ........ ........ ........ ........ 12%  207M 2s
 30720K ........ ........ ........ ........ ........ ........ 13%  198M 2s
 33792K ........ ........ ........ ........ ........ ........ 14%  154M 2s
 36864K ........ ........ ........ ........ ........ ........ 15%  220M 2s
 39936K ........ ........ ........ ........ ........ ........ 16%  214M 2s
 43008K ........ ........ ........ ........ ........ ........ 18%  216M 2s
 46080K ........ ........ ........ ........ ........ ........ 19%  208M 2s
 49152K ........ ........ ........ ........ ........ ........ 20%  220M 2s
 52224K ........ ........ ........ ........ ........ ........ 21%  197M 1s
 55296K ........ ........ ........ ........ ........ ........ 22%  113M 1s
 58368K ........ ........ ........ ........ ........ ........ 24%  218M 1s
 61440K ........ ........ ........ ........ ........ ........ 25%  211M 1s
 64512K ........ ........ ........ ........ ........ ........ 26%  209M 1s
 67584K ........ ........ ........ ........ ........ ........ 27%  215M 1s
 70656K ........ ........ ........ ........ ........ ........ 28%  273M 1s
 73728K ........ ........ ........ ........ ........ ........ 30%  279M 1s
 76800K ........ ........ ........ ........ ........ ........ 31%  284M 1s
 79872K ........ ........ ........ ........ ........ ........ 32%  295M 1s
 82944K ........ ........ ........ ........ ........ ........ 33%  280M 1s
 86016K ........ ........ ........ ........ ........ ........ 35%  284M 1s
 89088K ........ ........ ........ ........ ........ ........ 36%  282M 1s
 92160K ........ ........ ........ ........ ........ ........ 37%  253M 1s
 95232K ........ ........ ........ ........ ........ ........ 38%  136M 1s
 98304K ........ ........ ........ ........ ........ ........ 39%  180M 1s
101376K ........ ........ ........ ........ ........ ........ 41%  300M 1s
104448K ........ ........ ........ ........ ........ ........ 42%  291M 1s
107520K ........ ........ ........ ........ ........ ........ 43%  285M 1s
110592K ........ ........ ........ ........ ........ ........ 44%  286M 1s
113664K ........ ........ ........ ........ ........ ........ 45%  289M 1s
116736K ........ ........ ........ ........ ........ ........ 47%  286M 1s
119808K ........ ........ ........ ........ ........ ........ 48%  282M 1s
122880K ........ ........ ........ ........ ........ ........ 49%  282M 1s
125952K ........ ........ ........ ........ ........ ........ 50%  286M 1s
129024K ........ ........ ........ ........ ........ ........ 51%  271M 1s
132096K ........ ........ ........ ........ ........ ........ 53%  283M 1s
135168K ........ ........ ........ ........ ........ ........ 54%  284M 1s
138240K ........ ........ ........ ........ ........ ........ 55%  282M 1s
141312K ........ ........ ........ ........ ........ ........ 56%  282M 1s
144384K ........ ........ ........ ........ ........ ........ 57%  290M 1s
147456K ........ ........ ........ ........ ........ ........ 59%  279M 1s
150528K ........ ........ ........ ........ ........ ........ 60%  278M 1s
153600K ........ ........ ........ ........ ........ ........ 61%  283M 1s
156672K ........ ........ ........ ........ ........ ........ 62%  281M 0s
159744K ........ ........ ........ ........ ........ ........ 64%  265M 0s
162816K ........ ........ ........ ........ ........ ........ 65%  288M 0s
165888K ........ ........ ........ ........ ........ ........ 66%  281M 0s
168960K ........ ........ ........ ........ ........ ........ 67%  278M 0s
172032K ........ ........ ........ ........ ........ ........ 68%  279M 0s
175104K ........ ........ ........ ........ ........ ........ 70%  276M 0s
178176K ........ ........ ........ ........ ........ ........ 71%  277M 0s
181248K ........ ........ ........ ........ ........ ........ 72%  276M 0s
184320K ........ ........ ........ ........ ........ ........ 73%  282M 0s
187392K ........ ........ ........ ........ ........ ........ 74%  219M 0s
190464K ........ ........ ........ ........ ........ ........ 76%  317M 0s
193536K ........ ........ ........ ........ ........ ........ 77%  314M 0s
196608K ........ ........ ........ ........ ........ ........ 78%  284M 0s
199680K ........ ........ ........ ........ ........ ........ 79%  281M 0s
202752K ........ ........ ........ ........ ........ ........ 80%  284M 0s
205824K ........ ........ ........ ........ ........ ........ 82%  280M 0s
208896K ........ ........ ........ ........ ........ ........ 83%  272M 0s
211968K ........ ........ ........ ........ ........ ........ 84%  293M 0s
215040K ........ ........ ........ ........ ........ ........ 85%  281M 0s
218112K ........ ........ ........ ........ ........ ........ 86%  271M 0s
221184K ........ ........ ........ ........ ........ ........ 88%  271M 0s
224256K ........ ........ ........ ........ ........ ........ 89%  284M 0s
227328K ........ ........ ........ ........ ........ ........ 90%  284M 0s
230400K ........ ........ ........ ........ ........ ........ 91%  274M 0s
233472K ........ ........ ........ ........ ........ ........ 93%  282M 0s
236544K ........ ........ ........ ........ ........ ........ 94%  281M 0s
239616K ........ ........ ........ ........ ........ ........ 95%  282M 0s
242688K ........ ........ ........ ........ ........ ........ 96%  281M 0s
245760K ........ ........ ........ ........ ........ ........ 97%  282M 0s
248832K ........ ........ ........ ........ ........ ........ 99%  274M 0s
251904K ........ ........ ........ ........ .....            100%  285M=1.2s

2024-04-06 23:09:06 (215 MB/s) - ‘karaf-0.18.4-20240406.194621-101.zip’ saved [260399296/260399296]

Extracting the new controller...
+ echo 'Extracting the new controller...'
+ unzip -q karaf-0.18.4-20240406.194621-101.zip
Adding external repositories...
+ echo 'Adding external repositories...'
+ sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
+ cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
################################################################################
#
#    Licensed to the Apache Software Foundation (ASF) under one or more
#    contributor license agreements.  See the NOTICE file distributed with
#    this work for additional information regarding copyright ownership.
#    The ASF licenses this file to You under the Apache License, Version 2.0
#    (the "License"); you may not use this file except in compliance with
#    the License.  You may obtain a copy of the License at
#
#       http://www.apache.org/licenses/LICENSE-2.0
#
#    Unless required by applicable law or agreed to in writing, software
#    distributed under the License is distributed on an "AS IS" BASIS,
#    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
#    See the License for the specific language governing permissions and
#    limitations under the License.
#
################################################################################

#
# If set to true, the following property will not allow any certificate to be used
# when accessing Maven repositories through SSL
#
#org.ops4j.pax.url.mvn.certificateCheck=

#
# Path to the local Maven settings file.
# The repositories defined in this file will be automatically added to the list
# of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property
# below is not set.
# The following locations are checked for the existence of the settings.xml file
#   * 1. looks for the specified url
#   * 2. if not found looks for ${user.home}/.m2/settings.xml
#   * 3. if not found looks for ${maven.home}/conf/settings.xml
#   * 4. if not found looks for ${M2_HOME}/conf/settings.xml
#
#org.ops4j.pax.url.mvn.settings=

#
# Path to the local Maven repository which is used to avoid downloading
# artifacts when they already exist locally.
# The value of this property will be extracted from the settings.xml file
# above, or defaulted to:
#     System.getProperty( "user.home" ) + "/.m2/repository"
#
org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository}

#
# Default this to false. It's just weird to use undocumented repos
#
org.ops4j.pax.url.mvn.useFallbackRepositories=false

#
# Uncomment if you don't wanna use the proxy settings
# from the Maven conf/settings.xml file
#
# org.ops4j.pax.url.mvn.proxySupport=false

#
# Comma separated list of repositories scanned when resolving an artifact.
# Those repositories will be checked before iterating through the
#    below list of repositories and even before the local repository
# A repository url can be appended with zero or more of the following flags:
#    @snapshots  : the repository contains snaphots
#    @noreleases : the repository does not contain any released artifacts
#
# The following property value will add the system folder as a repo.
#
org.ops4j.pax.url.mvn.defaultRepositories=\
    file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\
    file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\
    file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots

# Use the default local repo (e.g.~/.m2/repository) as a "remote" repo
#org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false

#
# Comma separated list of repositories scanned when resolving an artifact.
# The default list includes the following repositories:
#    http://repo1.maven.org/maven2@id=central
#    http://repository.springsource.com/maven/bundles/release@id=spring.ebr
#    http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external
#    http://zodiac.springsource.com/maven/bundles/release@id=gemini
#    http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases
#    https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases
#    https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
# To add repositories to the default ones, prepend '+' to the list of repositories
# to add.
# A repository url can be appended with zero or more of the following flags:
#    @snapshots  : the repository contains snapshots
#    @noreleases : the repository does not contain any released artifacts
#    @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended
#
org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases

### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.+ [[ True == \T\r\u\e ]]
+ echo 'Configuring the startup features...'
Configuring the startup features...
+ sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
+ FEATURE_TEST_STRING=features-test
+ FEATURE_TEST_VERSION=0.18.4-SNAPSHOT
+ KARAF_VERSION=karaf4
+ [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]]
+ sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.18.4-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
+ [[ ! -z '' ]]
+ cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
################################################################################
#
#    Licensed to the Apache Software Foundation (ASF) under one or more
#    contributor license agreements.  See the NOTICE file distributed with
#    this work for additional information regarding copyright ownership.
#    The ASF licenses this file to You under the Apache License, Version 2.0
#    (the "License"); you may not use this file except in compliance with
#    the License.  You may obtain a copy of the License at
#
#       http://www.apache.org/licenses/LICENSE-2.0
#
#    Unless required by applicable law or agreed to in writing, software
#    distributed under the License is distributed on an "AS IS" BASIS,
#    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
#    See the License for the specific language governing permissions and
#    limitations under the License.
#
################################################################################

#
# Comma separated list of features repositories to register by default
#
featuresRepositories = mvn:org.opendaylight.integration/features-test/0.18.4-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/8a04ff1b-ac3d-412c-bd6f-10a42387a5d8.xml

#
# Comma separated list of features to install at startup
#
featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, 57c24381-3139-498b-8c1d-3df89d3e4465

#
# Resource repositories (OBR) that the features resolver can use
# to resolve requirements/capabilities
#
# The format of the resourceRepositories is 
# resourceRepositories=[xml:url|json:url],...
# for Instance:
#
#resourceRepositories=xml:http://host/path/to/index.xml
# or
#resourceRepositories=json:http://host/path/to/index.json
#

#
# Defines if the boot features are started in asynchronous mode (in a dedicated thread)
#
featuresBootAsynchronous=false

#
# Service requirements enforcement
#
# By default, the feature resolver checks the service requirements/capabilities of
# bundles for new features (xml schema >= 1.3.0) in order to automatically installs
# the required bundles.
# The following flag can have those values:
#   - disable: service requirements are completely ignored
#   - default: service requirements are ignored for old features
#   - enforce: service requirements are always verified
#
#serviceRequirements=default

#
# Store cfg file for config element in feature
#
#configCfgStore=true

#
# Define if the feature service automatically refresh bundles
#
autoRefresh=true

#
# Configuration of features processing mechanism (overrides, blacklisting, modification of features)
# XML file defines instructions related to features processing
# versions.properties may declare properties to resolve placeholders in XML file
# both files are relative to ${karaf.etc}
#
#featureProcessing=org.apache.karaf.features.xml
#featureProcessingVersions=versions.properties
+ configure_karaf_log karaf4 ''
+ local -r karaf_version=karaf4
+ local -r controllerdebugmap=
+ local logapi=log4j
+ grep log4j2 /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
log4j2.rootLogger.level = INFO
#log4j2.rootLogger.type = asyncRoot
#log4j2.rootLogger.includeLocation = false
log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
log4j2.rootLogger.appenderRef.Console.ref = Console
log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
log4j2.logger.spifly.name = org.apache.aries.spifly
log4j2.logger.spifly.level = WARN
log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
log4j2.logger.audit.level = INFO
log4j2.logger.audit.additivity = false
log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
# Console appender not used by default (see log4j2.rootLogger.appenderRefs)
log4j2.appender.console.type = Console
log4j2.appender.console.name = Console
log4j2.appender.console.layout.type = PatternLayout
log4j2.appender.console.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.type = RollingRandomAccessFile
log4j2.appender.rolling.name = RollingFile
log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
#log4j2.appender.rolling.immediateFlush = false
log4j2.appender.rolling.append = true
log4j2.appender.rolling.layout.type = PatternLayout
log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.policies.type = Policies
log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.rolling.policies.size.size = 64MB
log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
log4j2.appender.rolling.strategy.max = 7
log4j2.appender.audit.type = RollingRandomAccessFile
log4j2.appender.audit.name = AuditRollingFile
log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
log4j2.appender.audit.append = true
log4j2.appender.audit.layout.type = PatternLayout
log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
log4j2.appender.audit.policies.type = Policies
log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.audit.policies.size.size = 8MB
log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
log4j2.appender.audit.strategy.max = 7
log4j2.appender.osgi.type = PaxOsgi
log4j2.appender.osgi.name = PaxOsgi
log4j2.appender.osgi.filter = *
#log4j2.logger.aether.name = shaded.org.eclipse.aether
#log4j2.logger.aether.level = TRACE
#log4j2.logger.http-headers.name = shaded.org.apache.http.headers
#log4j2.logger.http-headers.level = DEBUG
#log4j2.logger.maven.name = org.ops4j.pax.url.mvn
#log4j2.logger.maven.level = TRACE
Configuring the karaf log... karaf_version: karaf4, logapi: log4j2
+ logapi=log4j2
+ echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2'
+ '[' log4j2 == log4j2 ']'
+ sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
+ orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver
+ orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver
+ echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN'
+ echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN'
+ unset IFS
controllerdebugmap: 
+ echo 'controllerdebugmap: '
+ '[' -n '' ']'
+ echo 'cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg'
cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
+ cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
################################################################################
#
#    Licensed to the Apache Software Foundation (ASF) under one or more
#    contributor license agreements.  See the NOTICE file distributed with
#    this work for additional information regarding copyright ownership.
#    The ASF licenses this file to You under the Apache License, Version 2.0
#    (the "License"); you may not use this file except in compliance with
#    the License.  You may obtain a copy of the License at
#
#       http://www.apache.org/licenses/LICENSE-2.0
#
#    Unless required by applicable law or agreed to in writing, software
#    distributed under the License is distributed on an "AS IS" BASIS,
#    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
#    See the License for the specific language governing permissions and
#    limitations under the License.
#
################################################################################

# Common pattern layout for appenders
log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n

# Root logger
log4j2.rootLogger.level = INFO
# uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library
#log4j2.rootLogger.type = asyncRoot
#log4j2.rootLogger.includeLocation = false
log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
log4j2.rootLogger.appenderRef.Console.ref = Console
log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}

# Filters for logs marked by org.opendaylight.odlparent.Markers
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL

# Loggers configuration

# Spifly logger
log4j2.logger.spifly.name = org.apache.aries.spifly
log4j2.logger.spifly.level = WARN

# Security audit logger
log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
log4j2.logger.audit.level = INFO
log4j2.logger.audit.additivity = false
log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile

# Appenders configuration

# Console appender not used by default (see log4j2.rootLogger.appenderRefs)
log4j2.appender.console.type = Console
log4j2.appender.console.name = Console
log4j2.appender.console.layout.type = PatternLayout
log4j2.appender.console.layout.pattern = ${log4j2.pattern}

# Rolling file appender
log4j2.appender.rolling.type = RollingRandomAccessFile
log4j2.appender.rolling.name = RollingFile
log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
# uncomment to not force a disk flush
#log4j2.appender.rolling.immediateFlush = false
log4j2.appender.rolling.append = true
log4j2.appender.rolling.layout.type = PatternLayout
log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.policies.type = Policies
log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.rolling.policies.size.size = 1GB
log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
log4j2.appender.rolling.strategy.max = 7

# Audit file appender
log4j2.appender.audit.type = RollingRandomAccessFile
log4j2.appender.audit.name = AuditRollingFile
log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
log4j2.appender.audit.append = true
log4j2.appender.audit.layout.type = PatternLayout
log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
log4j2.appender.audit.policies.type = Policies
log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.audit.policies.size.size = 8MB
log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
log4j2.appender.audit.strategy.max = 7

# OSGi appender
log4j2.appender.osgi.type = PaxOsgi
log4j2.appender.osgi.name = PaxOsgi
log4j2.appender.osgi.filter = *

# help with identification of maven-related problems with pax-url-aether
#log4j2.logger.aether.name = shaded.org.eclipse.aether
#log4j2.logger.aether.level = TRACE
#log4j2.logger.http-headers.name = shaded.org.apache.http.headers
#log4j2.logger.http-headers.level = DEBUG
#log4j2.logger.maven.name = org.ops4j.pax.url.mvn
#log4j2.logger.maven.level = TRACE
log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN
log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN
Configure
+ set_java_vars /usr/lib/jvm/java-17-openjdk 3072m /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv
+ local -r java_home=/usr/lib/jvm/java-17-openjdk
+ local -r controllermem=3072m
+ local -r memconf=/tmp/karaf-0.18.4-SNAPSHOT/bin/setenv
+ echo Configure
+ echo '    java home: /usr/lib/jvm/java-17-openjdk'
    java home: /usr/lib/jvm/java-17-openjdk
    max memory: 3072m
    memconf: /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv
+ echo '    max memory: 3072m'
+ echo '    memconf: /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv'
+ sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk}%g' /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv
+ sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv
cat /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv
+ echo 'cat /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv'
+ cat /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv
#!/bin/sh
#
#    Licensed to the Apache Software Foundation (ASF) under one or more
#    contributor license agreements.  See the NOTICE file distributed with
#    this work for additional information regarding copyright ownership.
#    The ASF licenses this file to You under the Apache License, Version 2.0
#    (the "License"); you may not use this file except in compliance with
#    the License.  You may obtain a copy of the License at
#
#       http://www.apache.org/licenses/LICENSE-2.0
#
#    Unless required by applicable law or agreed to in writing, software
#    distributed under the License is distributed on an "AS IS" BASIS,
#    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
#    See the License for the specific language governing permissions and
#    limitations under the License.
#

#
# handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf
# script: client, instance, shell, start, status, stop, karaf
#
# if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then
#   Actions go here...
# fi

#
# general settings which should be applied for all scripts go here; please keep
# in mind that it is possible that scripts might be executed more than once, e.g.
# in example of the start script where the start script is executed first and the
# karaf script afterwards.
#

#
# The following section shows the possible configuration options for the default 
# karaf scripts
#
export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk} # Location of Java installation
# export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration
# export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options
# export EXTRA_JAVA_OPTS # Additional JVM options
# export KARAF_HOME # Karaf home folder
# export KARAF_DATA # Karaf data folder
# export KARAF_BASE # Karaf base folder
# export KARAF_ETC  # Karaf etc  folder
# export KARAF_LOG  # Karaf log  folder
# export KARAF_SYSTEM_OPTS # First citizen Karaf options
# export KARAF_OPTS # Additional available Karaf options
# export KARAF_DEBUG # Enable debug mode
# export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start
# export KARAF_NOROOT # Prevent execution as root if set to true
Set Java version
+ echo 'Set Java version'
+ sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-17-openjdk/bin/java 1
+ sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-17-openjdk/bin/java
JDK default version ...
+ echo 'JDK default version ...'
+ java -version
openjdk version "17.0.6-ea" 2023-01-17 LTS
OpenJDK Runtime Environment (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS)
OpenJDK 64-Bit Server VM (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS, mixed mode, sharing)
Set JAVA_HOME
+ echo 'Set JAVA_HOME'
+ export JAVA_HOME=/usr/lib/jvm/java-17-openjdk
+ JAVA_HOME=/usr/lib/jvm/java-17-openjdk
++ readlink -e /usr/lib/jvm/java-17-openjdk/bin/java
Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java
+ JAVA_RESOLVED=/usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java
+ echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java'
Listing all open ports on controller system...
+ echo 'Listing all open ports on controller system...'
+ netstat -pnatu
(Not all processes could be identified, non-owned process info
 will not be shown, you would have to be root to see it all.)
Active Internet connections (servers and established)
Proto Recv-Q Send-Q Local Address           Foreign Address         State       PID/Program name    
tcp        0      0 0.0.0.0:22              0.0.0.0:*               LISTEN      -                   
tcp        0      0 0.0.0.0:111             0.0.0.0:*               LISTEN      -                   
tcp        0      0 10.30.171.151:22        10.30.171.62:34660      ESTABLISHED -                   
tcp        0      0 10.30.171.151:53674     199.204.45.87:443       TIME_WAIT   -                   
tcp6       0      0 :::22                   :::*                    LISTEN      -                   
tcp6       0      0 :::111                  :::*                    LISTEN      -                   
tcp6       0      0 :::5555                 :::*                    LISTEN      -                   
udp        0      0 10.30.171.151:68        10.30.170.4:67          ESTABLISHED -                   
udp        0      0 0.0.0.0:111             0.0.0.0:*                           -                   
udp        0      0 127.0.0.1:323           0.0.0.0:*                           -                   
udp6       0      0 :::111                  :::*                                -                   
udp6       0      0 ::1:323                 :::*                                -                   
Custom shard config exists!!!
Copying the shard config...
+ '[' -f /tmp/custom_shard_config.txt ']'
+ echo 'Custom shard config exists!!!'
+ echo 'Copying the shard config...'
+ cp /tmp/custom_shard_config.txt /tmp/karaf-0.18.4-SNAPSHOT/bin/
Configuring cluster
+ echo 'Configuring cluster'
+ /tmp/karaf-0.18.4-SNAPSHOT/bin/configure_cluster.sh 2 10.30.171.96 10.30.171.151 10.30.170.132
################################################
##             Configure Cluster              ##
################################################
 NOTE: Cluster configuration files not found. Copying from
 /tmp/karaf-0.18.4-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/7.0.11
Configuring unique name in akka.conf
Configuring hostname in akka.conf
Configuring data and rpc seed nodes in akka.conf
modules = [
	
	{
		name = "inventory"
		namespace = "urn:opendaylight:inventory"
		shard-strategy = "module"
	},
	{
		name = "topology"
		namespace = "urn:TBD:params:xml:ns:yang:network-topology"
		shard-strategy = "module"
	},
	{
		name = "toaster"
		namespace = "http://netconfcentral.org/ns/toaster"
		shard-strategy = "module"
	},
	{
		name = "car"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
		shard-strategy = "module"
	},
	{
		name = "people"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
		shard-strategy = "module"
	},
	{
		name = "car-people"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
		shard-strategy = "module"
	}
]
Configuring replication type in module-shards.conf
################################################
##   NOTE: Manually restart controller to     ##
##         apply configuration.               ##
################################################
Dump akka.conf
+ echo 'Dump akka.conf'
+ cat /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/akka.conf

odl-cluster-data {
  akka {
    remote {
      artery {
        enabled = on
        transport = tcp
        canonical.hostname = "10.30.171.151"
        canonical.port = 2550
      }
    }

    cluster {
      # Using artery.
      seed-nodes = ["akka://opendaylight-cluster-data@10.30.171.96:2550",
				"akka://opendaylight-cluster-data@10.30.171.151:2550",
				"akka://opendaylight-cluster-data@10.30.170.132:2550"]

      roles = ["member-2"]

      # when under load we might trip a false positive on the failure detector
      # failure-detector {
        # heartbeat-interval = 4 s
        # acceptable-heartbeat-pause = 16s
      # }
    }

    persistence {
      # By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by
      # modifying the following two properties. The directory location specified may be a relative or absolute path. 
      # The relative path is always relative to KARAF_HOME.

      # snapshot-store.local.dir = "target/snapshots"

      # Use lz4 compression for LocalSnapshotStore snapshots
      snapshot-store.local.use-lz4-compression = false
      # Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB
      snapshot-store.local.lz4-blocksize = 256KB
    }
    disable-default-actor-system-quarantined-event-handling = "false"
  }
}
Dump modules.conf
+ echo 'Dump modules.conf'
+ cat /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/modules.conf
modules = [
	
	{
		name = "inventory"
		namespace = "urn:opendaylight:inventory"
		shard-strategy = "module"
	},
	{
		name = "topology"
		namespace = "urn:TBD:params:xml:ns:yang:network-topology"
		shard-strategy = "module"
	},
	{
		name = "toaster"
		namespace = "http://netconfcentral.org/ns/toaster"
		shard-strategy = "module"
	},
	{
		name = "car"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
		shard-strategy = "module"
	},
	{
		name = "people"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
		shard-strategy = "module"
	},
	{
		name = "car-people"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
		shard-strategy = "module"
	}
]
Dump module-shards.conf
+ echo 'Dump module-shards.conf'
+ cat /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/module-shards.conf
module-shards = [
	{
		name = "default"
		shards = [
			{
				name = "default"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "inventory"
		shards = [
			{
				name="inventory"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "topology"
		shards = [
			{
				name="topology"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "toaster"
		shards = [
			{
				name="toaster"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "car"
		shards = [
			{
				name="car"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "people"
		shards = [
			{
				name="people"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "car-people"
		shards = [
			{
				name="car-people"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	}
]
Configuring member-3 with IP address 10.30.170.132
Warning: Permanently added '10.30.170.132' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.170.132' (ECDSA) to the list of known hosts.
common-functions.sh is being sourced
+ source /tmp/common-functions.sh karaf-0.18.4-SNAPSHOT
++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]]
++ echo 'common-functions.sh is being sourced'
++ BUNDLEFOLDER=karaf-0.18.4-SNAPSHOT
++ export MAVENCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
++ MAVENCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
++ export FEATURESCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
++ FEATURESCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
++ export CUSTOMPROP=/tmp/karaf-0.18.4-SNAPSHOT/etc/custom.properties
++ CUSTOMPROP=/tmp/karaf-0.18.4-SNAPSHOT/etc/custom.properties
++ export LOGCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
++ LOGCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
++ export MEMCONF=/tmp/karaf-0.18.4-SNAPSHOT/bin/setenv
++ MEMCONF=/tmp/karaf-0.18.4-SNAPSHOT/bin/setenv
++ export CONTROLLERMEM=
++ CONTROLLERMEM=
++ export AKKACONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/akka.conf
++ AKKACONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/akka.conf
++ export MODULESCONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/modules.conf
++ MODULESCONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/modules.conf
++ export MODULESHARDSCONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/module-shards.conf
++ MODULESHARDSCONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/module-shards.conf
++ print_common_env
++ cat
common-functions environment:
MAVENCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
ACTUALFEATURES: 
FEATURESCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
CUSTOMPROP: /tmp/karaf-0.18.4-SNAPSHOT/etc/custom.properties
LOGCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
MEMCONF: /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv
CONTROLLERMEM: 
AKKACONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/akka.conf
MODULESCONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/modules.conf
MODULESHARDSCONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/module-shards.conf
SUITES: 

++ SSH='ssh -t -t'
++ extra_services_cntl='     dnsmasq.service     httpd.service     libvirtd.service     openvswitch.service     ovs-vswitchd.service     ovsdb-server.service     rabbitmq-server.service '
++ extra_services_cmp='     libvirtd.service     openvswitch.service     ovs-vswitchd.service     ovsdb-server.service '
Changing to /tmp
Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/karaf-0.18.4-20240406.194621-101.zip
+ echo 'Changing to /tmp'
+ cd /tmp
+ echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/karaf-0.18.4-20240406.194621-101.zip'
+ wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/karaf-0.18.4-20240406.194621-101.zip
--2024-04-06 23:09:10--  https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/karaf-0.18.4-20240406.194621-101.zip
Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6
Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 260399296 (248M) [application/zip]
Saving to: ‘karaf-0.18.4-20240406.194621-101.zip’

     0K ........ ........ ........ ........ ........ ........  1%  104M 2s
  3072K ........ ........ ........ ........ ........ ........  2%  149M 2s
  6144K ........ ........ ........ ........ ........ ........  3%  150M 2s
  9216K ........ ........ ........ ........ ........ ........  4%  166M 2s
 12288K ........ ........ ........ ........ ........ ........  6%  151M 2s
 15360K ........ ........ ........ ........ ........ ........  7%  160M 2s
 18432K ........ ........ ........ ........ ........ ........  8%  205M 2s
 21504K ........ ........ ........ ........ ........ ........  9%  230M 1s
 24576K ........ ........ ........ ........ ........ ........ 10%  227M 1s
 27648K ........ ........ ........ ........ ........ ........ 12%  246M 1s
 30720K ........ ........ ........ ........ ........ ........ 13%  250M 1s
 33792K ........ ........ ........ ........ ........ ........ 14%  251M 1s
 36864K ........ ........ ........ ........ ........ ........ 15%  249M 1s
 39936K ........ ........ ........ ........ ........ ........ 16%  261M 1s
 43008K ........ ........ ........ ........ ........ ........ 18%  251M 1s
 46080K ........ ........ ........ ........ ........ ........ 19%  253M 1s
 49152K ........ ........ ........ ........ ........ ........ 20%  219M 1s
 52224K ........ ........ ........ ........ ........ ........ 21%  295M 1s
 55296K ........ ........ ........ ........ ........ ........ 22%  252M 1s
 58368K ........ ........ ........ ........ ........ ........ 24%  247M 1s
 61440K ........ ........ ........ ........ ........ ........ 25%  272M 1s
 64512K ........ ........ ........ ........ ........ ........ 26%  205M 1s
 67584K ........ ........ ........ ........ ........ ........ 27%  300M 1s
 70656K ........ ........ ........ ........ ........ ........ 28%  288M 1s
 73728K ........ ........ ........ ........ ........ ........ 30%  276M 1s
 76800K ........ ........ ........ ........ ........ ........ 31%  259M 1s
 79872K ........ ........ ........ ........ ........ ........ 32%  238M 1s
 82944K ........ ........ ........ ........ ........ ........ 33%  277M 1s
 86016K ........ ........ ........ ........ ........ ........ 35%  227M 1s
 89088K ........ ........ ........ ........ ........ ........ 36%  270M 1s
 92160K ........ ........ ........ ........ ........ ........ 37%  228M 1s
 95232K ........ ........ ........ ........ ........ ........ 38%  279M 1s
 98304K ........ ........ ........ ........ ........ ........ 39%  314M 1s
101376K ........ ........ ........ ........ ........ ........ 41%  218M 1s
104448K ........ ........ ........ ........ ........ ........ 42%  293M 1s
107520K ........ ........ ........ ........ ........ ........ 43%  317M 1s
110592K ........ ........ ........ ........ ........ ........ 44%  229M 1s
113664K ........ ........ ........ ........ ........ ........ 45%  263M 1s
116736K ........ ........ ........ ........ ........ ........ 47%  256M 1s
119808K ........ ........ ........ ........ ........ ........ 48%  256M 1s
122880K ........ ........ ........ ........ ........ ........ 49%  254M 1s
125952K ........ ........ ........ ........ ........ ........ 50%  184M 1s
129024K ........ ........ ........ ........ ........ ........ 51%  257M 1s
132096K ........ ........ ........ ........ ........ ........ 53%  265M 1s
135168K ........ ........ ........ ........ ........ ........ 54%  264M 0s
138240K ........ ........ ........ ........ ........ ........ 55%  286M 0s
141312K ........ ........ ........ ........ ........ ........ 56%  254M 0s
144384K ........ ........ ........ ........ ........ ........ 57%  284M 0s
147456K ........ ........ ........ ........ ........ ........ 59%  198M 0s
150528K ........ ........ ........ ........ ........ ........ 60%  256M 0s
153600K ........ ........ ........ ........ ........ ........ 61%  245M 0s
156672K ........ ........ ........ ........ ........ ........ 62%  299M 0s
159744K ........ ........ ........ ........ ........ ........ 64%  346M 0s
162816K ........ ........ ........ ........ ........ ........ 65%  346M 0s
165888K ........ ........ ........ ........ ........ ........ 66%  234M 0s
168960K ........ ........ ........ ........ ........ ........ 67%  320M 0s
172032K ........ ........ ........ ........ ........ ........ 68%  239M 0s
175104K ........ ........ ........ ........ ........ ........ 70%  258M 0s
178176K ........ ........ ........ ........ ........ ........ 71%  290M 0s
181248K ........ ........ ........ ........ ........ ........ 72%  221M 0s
184320K ........ ........ ........ ........ ........ ........ 73%  263M 0s
187392K ........ ........ ........ ........ ........ ........ 74%  297M 0s
190464K ........ ........ ........ ........ ........ ........ 76%  212M 0s
193536K ........ ........ ........ ........ ........ ........ 77%  289M 0s
196608K ........ ........ ........ ........ ........ ........ 78%  267M 0s
199680K ........ ........ ........ ........ ........ ........ 79%  239M 0s
202752K ........ ........ ........ ........ ........ ........ 80%  278M 0s
205824K ........ ........ ........ ........ ........ ........ 82%  290M 0s
208896K ........ ........ ........ ........ ........ ........ 83%  216M 0s
211968K ........ ........ ........ ........ ........ ........ 84%  274M 0s
215040K ........ ........ ........ ........ ........ ........ 85%  242M 0s
218112K ........ ........ ........ ........ ........ ........ 86%  296M 0s
221184K ........ ........ ........ ........ ........ ........ 88%  274M 0s
224256K ........ ........ ........ ........ ........ ........ 89%  233M 0s
227328K ........ ........ ........ ........ ........ ........ 90%  322M 0s
230400K ........ ........ ........ ........ ........ ........ 91%  193M 0s
233472K ........ ........ ........ ........ ........ ........ 93%  348M 0s
236544K ........ ........ ........ ........ ........ ........ 94%  269M 0s
239616K ........ ........ ........ ........ ........ ........ 95%  252M 0s
242688K ........ ........ ........ ........ ........ ........ 96%  243M 0s
245760K ........ ........ ........ ........ ........ ........ 97%  280M 0s
248832K ........ ........ ........ ........ ........ ........ 99%  266M 0s
251904K ........ ........ ........ ........ .....            100%  244M=1.0s

2024-04-06 23:09:11 (243 MB/s) - ‘karaf-0.18.4-20240406.194621-101.zip’ saved [260399296/260399296]

Extracting the new controller...
+ echo 'Extracting the new controller...'
+ unzip -q karaf-0.18.4-20240406.194621-101.zip
Adding external repositories...
+ echo 'Adding external repositories...'
+ sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
+ cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
################################################################################
#
#    Licensed to the Apache Software Foundation (ASF) under one or more
#    contributor license agreements.  See the NOTICE file distributed with
#    this work for additional information regarding copyright ownership.
#    The ASF licenses this file to You under the Apache License, Version 2.0
#    (the "License"); you may not use this file except in compliance with
#    the License.  You may obtain a copy of the License at
#
#       http://www.apache.org/licenses/LICENSE-2.0
#
#    Unless required by applicable law or agreed to in writing, software
#    distributed under the License is distributed on an "AS IS" BASIS,
#    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
#    See the License for the specific language governing permissions and
#    limitations under the License.
#
################################################################################

#
# If set to true, the following property will not allow any certificate to be used
# when accessing Maven repositories through SSL
#
#org.ops4j.pax.url.mvn.certificateCheck=

#
# Path to the local Maven settings file.
# The repositories defined in this file will be automatically added to the list
# of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property
# below is not set.
# The following locations are checked for the existence of the settings.xml file
#   * 1. looks for the specified url
#   * 2. if not found looks for ${user.home}/.m2/settings.xml
#   * 3. if not found looks for ${maven.home}/conf/settings.xml
#   * 4. if not found looks for ${M2_HOME}/conf/settings.xml
#
#org.ops4j.pax.url.mvn.settings=

#
# Path to the local Maven repository which is used to avoid downloading
# artifacts when they already exist locally.
# The value of this property will be extracted from the settings.xml file
# above, or defaulted to:
#     System.getProperty( "user.home" ) + "/.m2/repository"
#
org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository}

#
# Default this to false. It's just weird to use undocumented repos
#
org.ops4j.pax.url.mvn.useFallbackRepositories=false

#
# Uncomment if you don't wanna use the proxy settings
# from the Maven conf/settings.xml file
#
# org.ops4j.pax.url.mvn.proxySupport=false

#
# Comma separated list of repositories scanned when resolving an artifact.
# Those repositories will be checked before iterating through the
#    below list of repositories and even before the local repository
# A repository url can be appended with zero or more of the following flags:
#    @snapshots  : the repository contains snaphots
#    @noreleases : the repository does not contain any released artifacts
#
# The following property value will add the system folder as a repo.
#
org.ops4j.pax.url.mvn.defaultRepositories=\
    file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\
    file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\
    file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots

# Use the default local repo (e.g.~/.m2/repository) as a "remote" repo
#org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false

#
# Comma separated list of repositories scanned when resolving an artifact.
# The default list includes the following repositories:
#    http://repo1.maven.org/maven2@id=central
#    http://repository.springsource.com/maven/bundles/release@id=spring.ebr
#    http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external
#    http://zodiac.springsource.com/maven/bundles/release@id=gemini
#    http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases
#    https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases
#    https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
# To add repositories to the default ones, prepend '+' to the list of repositories
# to add.
# A repository url can be appended with zero or more of the following flags:
#    @snapshots  : the repository contains snapshots
#    @noreleases : the repository does not contain any released artifacts
#    @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended
#
org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases

### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.Configuring the startup features...
+ [[ True == \T\r\u\e ]]
+ echo 'Configuring the startup features...'
+ sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
+ FEATURE_TEST_STRING=features-test
+ FEATURE_TEST_VERSION=0.18.4-SNAPSHOT
+ KARAF_VERSION=karaf4
+ [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]]
+ sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.18.4-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
+ [[ ! -z '' ]]
+ cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
################################################################################
#
#    Licensed to the Apache Software Foundation (ASF) under one or more
#    contributor license agreements.  See the NOTICE file distributed with
#    this work for additional information regarding copyright ownership.
#    The ASF licenses this file to You under the Apache License, Version 2.0
#    (the "License"); you may not use this file except in compliance with
#    the License.  You may obtain a copy of the License at
#
#       http://www.apache.org/licenses/LICENSE-2.0
#
#    Unless required by applicable law or agreed to in writing, software
#    distributed under the License is distributed on an "AS IS" BASIS,
#    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
#    See the License for the specific language governing permissions and
#    limitations under the License.
#
################################################################################

#
# Comma separated list of features repositories to register by default
#
featuresRepositories = mvn:org.opendaylight.integration/features-test/0.18.4-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/8a04ff1b-ac3d-412c-bd6f-10a42387a5d8.xml

#
# Comma separated list of features to install at startup
#
featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, 57c24381-3139-498b-8c1d-3df89d3e4465

#
# Resource repositories (OBR) that the features resolver can use
# to resolve requirements/capabilities
#
# The format of the resourceRepositories is 
# resourceRepositories=[xml:url|json:url],...
# for Instance:
#
#resourceRepositories=xml:http://host/path/to/index.xml
# or
#resourceRepositories=json:http://host/path/to/index.json
#

#
# Defines if the boot features are started in asynchronous mode (in a dedicated thread)
#
featuresBootAsynchronous=false

#
# Service requirements enforcement
#
# By default, the feature resolver checks the service requirements/capabilities of
# bundles for new features (xml schema >= 1.3.0) in order to automatically installs
# the required bundles.
# The following flag can have those values:
#   - disable: service requirements are completely ignored
#   - default: service requirements are ignored for old features
#   - enforce: service requirements are always verified
#
#serviceRequirements=default

#
# Store cfg file for config element in feature
#
#configCfgStore=true

#
# Define if the feature service automatically refresh bundles
#
autoRefresh=true

#
# Configuration of features processing mechanism (overrides, blacklisting, modification of features)
# XML file defines instructions related to features processing
# versions.properties may declare properties to resolve placeholders in XML file
# both files are relative to ${karaf.etc}
#
#featureProcessing=org.apache.karaf.features.xml
#featureProcessingVersions=versions.properties
+ configure_karaf_log karaf4 ''
+ local -r karaf_version=karaf4
+ local -r controllerdebugmap=
+ local logapi=log4j
+ grep log4j2 /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
log4j2.rootLogger.level = INFO
#log4j2.rootLogger.type = asyncRoot
#log4j2.rootLogger.includeLocation = false
log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
log4j2.rootLogger.appenderRef.Console.ref = Console
log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
log4j2.logger.spifly.name = org.apache.aries.spifly
log4j2.logger.spifly.level = WARN
log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
log4j2.logger.audit.level = INFO
log4j2.logger.audit.additivity = false
log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
# Console appender not used by default (see log4j2.rootLogger.appenderRefs)
log4j2.appender.console.type = Console
log4j2.appender.console.name = Console
log4j2.appender.console.layout.type = PatternLayout
log4j2.appender.console.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.type = RollingRandomAccessFile
log4j2.appender.rolling.name = RollingFile
log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
#log4j2.appender.rolling.immediateFlush = false
log4j2.appender.rolling.append = true
log4j2.appender.rolling.layout.type = PatternLayout
log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.policies.type = Policies
log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.rolling.policies.size.size = 64MB
log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
log4j2.appender.rolling.strategy.max = 7
log4j2.appender.audit.type = RollingRandomAccessFile
log4j2.appender.audit.name = AuditRollingFile
log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
log4j2.appender.audit.append = true
log4j2.appender.audit.layout.type = PatternLayout
log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
log4j2.appender.audit.policies.type = Policies
log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.audit.policies.size.size = 8MB
log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
log4j2.appender.audit.strategy.max = 7
log4j2.appender.osgi.type = PaxOsgi
log4j2.appender.osgi.name = PaxOsgi
log4j2.appender.osgi.filter = *
#log4j2.logger.aether.name = shaded.org.eclipse.aether
#log4j2.logger.aether.level = TRACE
#log4j2.logger.http-headers.name = shaded.org.apache.http.headers
#log4j2.logger.http-headers.level = DEBUG
#log4j2.logger.maven.name = org.ops4j.pax.url.mvn
#log4j2.logger.maven.level = TRACE
Configuring the karaf log... karaf_version: karaf4, logapi: log4j2
+ logapi=log4j2
+ echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2'
+ '[' log4j2 == log4j2 ']'
+ sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
controllerdebugmap: 
+ orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver
+ orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver
+ echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN'
+ echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN'
+ unset IFS
+ echo 'controllerdebugmap: '
+ '[' -n '' ']'
cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
+ echo 'cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg'
+ cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
################################################################################
#
#    Licensed to the Apache Software Foundation (ASF) under one or more
#    contributor license agreements.  See the NOTICE file distributed with
#    this work for additional information regarding copyright ownership.
#    The ASF licenses this file to You under the Apache License, Version 2.0
#    (the "License"); you may not use this file except in compliance with
#    the License.  You may obtain a copy of the License at
#
#       http://www.apache.org/licenses/LICENSE-2.0
#
#    Unless required by applicable law or agreed to in writing, software
#    distributed under the License is distributed on an "AS IS" BASIS,
#    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
#    See the License for the specific language governing permissions and
#    limitations under the License.
#
################################################################################

# Common pattern layout for appenders
log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n

# Root logger
log4j2.rootLogger.level = INFO
# uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library
#log4j2.rootLogger.type = asyncRoot
#log4j2.rootLogger.includeLocation = false
log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
log4j2.rootLogger.appenderRef.Console.ref = Console
log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}

# Filters for logs marked by org.opendaylight.odlparent.Markers
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL

# Loggers configuration

# Spifly logger
log4j2.logger.spifly.name = org.apache.aries.spifly
log4j2.logger.spifly.level = WARN

# Security audit logger
log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
log4j2.logger.audit.level = INFO
log4j2.logger.audit.additivity = false
log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile

# Appenders configuration

# Console appender not used by default (see log4j2.rootLogger.appenderRefs)
log4j2.appender.console.type = Console
log4j2.appender.console.name = Console
log4j2.appender.console.layout.type = PatternLayout
log4j2.appender.console.layout.pattern = ${log4j2.pattern}

# Rolling file appender
log4j2.appender.rolling.type = RollingRandomAccessFile
log4j2.appender.rolling.name = RollingFile
log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
# uncomment to not force a disk flush
#log4j2.appender.rolling.immediateFlush = false
log4j2.appender.rolling.append = true
log4j2.appender.rolling.layout.type = PatternLayout
log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.policies.type = Policies
log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.rolling.policies.size.size = 1GB
log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
log4j2.appender.rolling.strategy.max = 7

# Audit file appender
log4j2.appender.audit.type = RollingRandomAccessFile
log4j2.appender.audit.name = AuditRollingFile
log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
log4j2.appender.audit.append = true
log4j2.appender.audit.layout.type = PatternLayout
log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
log4j2.appender.audit.policies.type = Policies
log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.audit.policies.size.size = 8MB
log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
log4j2.appender.audit.strategy.max = 7

# OSGi appender
log4j2.appender.osgi.type = PaxOsgi
log4j2.appender.osgi.name = PaxOsgi
log4j2.appender.osgi.filter = *

# help with identification of maven-related problems with pax-url-aether
#log4j2.logger.aether.name = shaded.org.eclipse.aether
#log4j2.logger.aether.level = TRACE
#log4j2.logger.http-headers.name = shaded.org.apache.http.headers
#log4j2.logger.http-headers.level = DEBUG
#log4j2.logger.maven.name = org.ops4j.pax.url.mvn
#log4j2.logger.maven.level = TRACE
log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN
log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN
+ set_java_vars /usr/lib/jvm/java-17-openjdk 3072m /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv
Configure
    java home: /usr/lib/jvm/java-17-openjdk
+ local -r java_home=/usr/lib/jvm/java-17-openjdk
+ local -r controllermem=3072m
+ local -r memconf=/tmp/karaf-0.18.4-SNAPSHOT/bin/setenv
+ echo Configure
+ echo '    java home: /usr/lib/jvm/java-17-openjdk'
+ echo '    max memory: 3072m'
    max memory: 3072m
    memconf: /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv
+ echo '    memconf: /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv'
+ sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk}%g' /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv
+ sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv
cat /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv
+ echo 'cat /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv'
+ cat /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv
#!/bin/sh
#
#    Licensed to the Apache Software Foundation (ASF) under one or more
#    contributor license agreements.  See the NOTICE file distributed with
#    this work for additional information regarding copyright ownership.
#    The ASF licenses this file to You under the Apache License, Version 2.0
#    (the "License"); you may not use this file except in compliance with
#    the License.  You may obtain a copy of the License at
#
#       http://www.apache.org/licenses/LICENSE-2.0
#
#    Unless required by applicable law or agreed to in writing, software
#    distributed under the License is distributed on an "AS IS" BASIS,
#    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
#    See the License for the specific language governing permissions and
#    limitations under the License.
#

#
# handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf
# script: client, instance, shell, start, status, stop, karaf
#
# if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then
#   Actions go here...
# fi

#
# general settings which should be applied for all scripts go here; please keep
# in mind that it is possible that scripts might be executed more than once, e.g.
# in example of the start script where the start script is executed first and the
# karaf script afterwards.
#

#
# The following section shows the possible configuration options for the default 
# karaf scripts
#
export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk} # Location of Java installation
# export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration
# export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options
# export EXTRA_JAVA_OPTS # Additional JVM options
# export KARAF_HOME # Karaf home folder
# export KARAF_DATA # Karaf data folder
# export KARAF_BASE # Karaf base folder
# export KARAF_ETC  # Karaf etc  folder
# export KARAF_LOG  # Karaf log  folder
# export KARAF_SYSTEM_OPTS # First citizen Karaf options
# export KARAF_OPTS # Additional available Karaf options
# export KARAF_DEBUG # Enable debug mode
# export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start
# export KARAF_NOROOT # Prevent execution as root if set to true
Set Java version
+ echo 'Set Java version'
+ sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-17-openjdk/bin/java 1
+ sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-17-openjdk/bin/java
JDK default version ...
+ echo 'JDK default version ...'
+ java -version
openjdk version "17.0.6-ea" 2023-01-17 LTS
OpenJDK Runtime Environment (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS)
OpenJDK 64-Bit Server VM (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS, mixed mode, sharing)
Set JAVA_HOME
+ echo 'Set JAVA_HOME'
+ export JAVA_HOME=/usr/lib/jvm/java-17-openjdk
+ JAVA_HOME=/usr/lib/jvm/java-17-openjdk
++ readlink -e /usr/lib/jvm/java-17-openjdk/bin/java
Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java
Listing all open ports on controller system...
+ JAVA_RESOLVED=/usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java
+ echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java'
+ echo 'Listing all open ports on controller system...'
+ netstat -pnatu
(Not all processes could be identified, non-owned process info
 will not be shown, you would have to be root to see it all.)
Active Internet connections (servers and established)
Proto Recv-Q Send-Q Local Address           Foreign Address         State       PID/Program name    
tcp        0      0 0.0.0.0:22              0.0.0.0:*               LISTEN      -                   
tcp        0      0 0.0.0.0:111             0.0.0.0:*               LISTEN      -                   
tcp        0    232 10.30.170.132:22        10.30.171.62:34160      ESTABLISHED -                   
tcp        0      0 10.30.170.132:58040     199.204.45.87:443       TIME_WAIT   -                   
tcp6       0      0 :::5555                 :::*                    LISTEN      -                   
tcp6       0      0 :::22                   :::*                    LISTEN      -                   
tcp6       0      0 :::111                  :::*                    LISTEN      -                   
udp        0      0 10.30.170.132:68        10.30.170.2:67          ESTABLISHED -                   
udp        0      0 0.0.0.0:111             0.0.0.0:*                           -                   
udp        0      0 127.0.0.1:323           0.0.0.0:*                           -                   
udp6       0      0 :::111                  :::*                                -                   
udp6       0      0 ::1:323                 :::*                                -                   
Custom shard config exists!!!
Copying the shard config...
+ '[' -f /tmp/custom_shard_config.txt ']'
+ echo 'Custom shard config exists!!!'
+ echo 'Copying the shard config...'
+ cp /tmp/custom_shard_config.txt /tmp/karaf-0.18.4-SNAPSHOT/bin/
Configuring cluster
+ echo 'Configuring cluster'
+ /tmp/karaf-0.18.4-SNAPSHOT/bin/configure_cluster.sh 3 10.30.171.96 10.30.171.151 10.30.170.132
################################################
##             Configure Cluster              ##
################################################
 NOTE: Cluster configuration files not found. Copying from
 /tmp/karaf-0.18.4-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/7.0.11
Configuring unique name in akka.conf
Configuring hostname in akka.conf
Configuring data and rpc seed nodes in akka.conf
modules = [
	
	{
		name = "inventory"
		namespace = "urn:opendaylight:inventory"
		shard-strategy = "module"
	},
	{
		name = "topology"
		namespace = "urn:TBD:params:xml:ns:yang:network-topology"
		shard-strategy = "module"
	},
	{
		name = "toaster"
		namespace = "http://netconfcentral.org/ns/toaster"
		shard-strategy = "module"
	},
	{
		name = "car"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
		shard-strategy = "module"
	},
	{
		name = "people"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
		shard-strategy = "module"
	},
	{
		name = "car-people"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
		shard-strategy = "module"
	}
]
Configuring replication type in module-shards.conf
################################################
##   NOTE: Manually restart controller to     ##
##         apply configuration.               ##
################################################
Dump akka.conf
+ echo 'Dump akka.conf'
+ cat /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/akka.conf

odl-cluster-data {
  akka {
    remote {
      artery {
        enabled = on
        transport = tcp
        canonical.hostname = "10.30.170.132"
        canonical.port = 2550
      }
    }

    cluster {
      # Using artery.
      seed-nodes = ["akka://opendaylight-cluster-data@10.30.171.96:2550",
				"akka://opendaylight-cluster-data@10.30.171.151:2550",
				"akka://opendaylight-cluster-data@10.30.170.132:2550"]

      roles = ["member-3"]

      # when under load we might trip a false positive on the failure detector
      # failure-detector {
        # heartbeat-interval = 4 s
        # acceptable-heartbeat-pause = 16s
      # }
    }

    persistence {
      # By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by
      # modifying the following two properties. The directory location specified may be a relative or absolute path. 
      # The relative path is always relative to KARAF_HOME.

      # snapshot-store.local.dir = "target/snapshots"

      # Use lz4 compression for LocalSnapshotStore snapshots
      snapshot-store.local.use-lz4-compression = false
      # Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB
      snapshot-store.local.lz4-blocksize = 256KB
    }
    disable-default-actor-system-quarantined-event-handling = "false"
  }
}
Dump modules.conf
+ echo 'Dump modules.conf'
+ cat /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/modules.conf
modules = [
	
	{
		name = "inventory"
		namespace = "urn:opendaylight:inventory"
		shard-strategy = "module"
	},
	{
		name = "topology"
		namespace = "urn:TBD:params:xml:ns:yang:network-topology"
		shard-strategy = "module"
	},
	{
		name = "toaster"
		namespace = "http://netconfcentral.org/ns/toaster"
		shard-strategy = "module"
	},
	{
		name = "car"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
		shard-strategy = "module"
	},
	{
		name = "people"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
		shard-strategy = "module"
	},
	{
		name = "car-people"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
		shard-strategy = "module"
	}
]
Dump module-shards.conf
+ echo 'Dump module-shards.conf'
+ cat /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/module-shards.conf
module-shards = [
	{
		name = "default"
		shards = [
			{
				name = "default"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "inventory"
		shards = [
			{
				name="inventory"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "topology"
		shards = [
			{
				name="topology"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "toaster"
		shards = [
			{
				name="toaster"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "car"
		shards = [
			{
				name="car"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "people"
		shards = [
			{
				name="people"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "car-people"
		shards = [
			{
				name="car-people"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	}
]
Locating config plan to use...
Finished running config plans
Starting member-1 with IP address 10.30.171.96
Warning: Permanently added '10.30.171.96' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.171.96' (ECDSA) to the list of known hosts.
Redirecting karaf console output to karaf_console.log
Starting controller...
start: Redirecting Karaf output to /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf_console.log
Starting member-2 with IP address 10.30.171.151
Warning: Permanently added '10.30.171.151' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.171.151' (ECDSA) to the list of known hosts.
Redirecting karaf console output to karaf_console.log
Starting controller...
start: Redirecting Karaf output to /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf_console.log
Starting member-3 with IP address 10.30.170.132
Warning: Permanently added '10.30.170.132' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.170.132' (ECDSA) to the list of known hosts.
Redirecting karaf console output to karaf_console.log
Starting controller...
start: Redirecting Karaf output to /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf_console.log
[controller-csit-3node-clustering-ask-all-argon] $ /bin/bash /tmp/jenkins17386159139019029900.sh
common-functions.sh is being sourced
common-functions environment:
MAVENCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
ACTUALFEATURES: 
FEATURESCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
CUSTOMPROP: /tmp/karaf-0.18.4-SNAPSHOT/etc/custom.properties
LOGCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
MEMCONF: /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv
CONTROLLERMEM: 2048m
AKKACONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/akka.conf
MODULESCONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/modules.conf
MODULESHARDSCONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/module-shards.conf
SUITES: 

+ echo '#################################################'
#################################################
+ echo '##         Verify Cluster is UP                ##'
##         Verify Cluster is UP                ##
+ echo '#################################################'
#################################################
+ create_post_startup_script
+ cat
+ copy_and_run_post_startup_script
+ seed_index=1
++ seq 1 3
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_1_IP
+ echo 'Execute the post startup script on controller 10.30.171.96'
Execute the post startup script on controller 10.30.171.96
+ scp /w/workspace/controller-csit-3node-clustering-ask-all-argon/post-startup-script.sh 10.30.171.96:/tmp/
Warning: Permanently added '10.30.171.96' (ECDSA) to the list of known hosts.
+ ssh 10.30.171.96 'bash /tmp/post-startup-script.sh 1'
Warning: Permanently added '10.30.171.96' (ECDSA) to the list of known hosts.
tcp6       0      0 :::8101                 :::*                    LISTEN     
Waiting up to 3 minutes for controller to come up, checking every 5 seconds...
2024-04-06T23:10:07,004 | INFO  | SystemReadyService-0 | SimpleSystemReadyMonitor         | 301 - org.opendaylight.infrautils.ready-api - 5.0.9 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
Controller is UP
2024-04-06T23:10:07,004 | INFO  | SystemReadyService-0 | SimpleSystemReadyMonitor         | 301 - org.opendaylight.infrautils.ready-api - 5.0.9 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
Listing all open ports on controller system...
(Not all processes could be identified, non-owned process info
 will not be shown, you would have to be root to see it all.)
Active Internet connections (servers and established)
Proto Recv-Q Send-Q Local Address           Foreign Address         State       PID/Program name    
tcp        0      0 0.0.0.0:111             0.0.0.0:*               LISTEN      -                   
tcp        0      0 0.0.0.0:22              0.0.0.0:*               LISTEN      -                   
tcp        0    164 10.30.171.96:22         10.30.171.62:60626      ESTABLISHED -                   
tcp6       0      0 :::8101                 :::*                    LISTEN      5754/java           
tcp6       0      0 :::6633                 :::*                    LISTEN      5754/java           
tcp6       0      0 127.0.0.1:1099          :::*                    LISTEN      5754/java           
tcp6       0      0 :::111                  :::*                    LISTEN      -                   
tcp6       0      0 :::6640                 :::*                    LISTEN      5754/java           
tcp6       0      0 :::5555                 :::*                    LISTEN      -                   
tcp6       0      0 :::8181                 :::*                    LISTEN      5754/java           
tcp6       0      0 10.30.171.96:2550       :::*                    LISTEN      5754/java           
tcp6       0      0 :::22                   :::*                    LISTEN      -                   
tcp6       0      0 127.0.0.1:44475         :::*                    LISTEN      5754/java           
tcp6       0      0 127.0.0.1:44444         :::*                    LISTEN      5754/java           
tcp6       0      0 :::6653                 :::*                    LISTEN      5754/java           
tcp6       0      0 :::4189                 :::*                    LISTEN      5754/java           
tcp6       0      0 :::1790                 :::*                    LISTEN      5754/java           
tcp6       0      0 10.30.171.96:36118      10.30.171.151:2550      ESTABLISHED 5754/java           
tcp6       0      0 10.30.171.96:2550       10.30.170.132:44338     ESTABLISHED 5754/java           
tcp6       0      0 10.30.171.96:36132      10.30.171.151:2550      ESTABLISHED 5754/java           
tcp6       0      0 127.0.0.1:36868         127.0.0.1:44444         TIME_WAIT   -                   
tcp6       0      0 10.30.171.96:2550       10.30.171.151:52546     ESTABLISHED 5754/java           
tcp6       0      0 127.0.0.1:42796         127.0.0.1:1099          TIME_WAIT   -                   
tcp6      32      0 10.30.171.96:57330      199.204.45.87:443       CLOSE_WAIT  5754/java           
tcp6       0      0 10.30.171.96:39730      10.30.170.132:2550      ESTABLISHED 5754/java           
tcp6       0      0 10.30.171.96:2550       10.30.171.151:52550     ESTABLISHED 5754/java           
tcp6       0      0 127.0.0.1:46410         127.0.0.1:44444         TIME_WAIT   -                   
tcp6       0      0 10.30.171.96:2550       10.30.170.132:44324     ESTABLISHED 5754/java           
tcp6       0      0 10.30.171.96:39716      10.30.170.132:2550      ESTABLISHED 5754/java           
udp        0      0 10.30.171.96:68         10.30.170.4:67          ESTABLISHED -                   
udp        0      0 0.0.0.0:111             0.0.0.0:*                           -                   
udp        0      0 127.0.0.1:323           0.0.0.0:*                           -                   
udp6       0      0 :::111                  :::*                                -                   
udp6       0      0 ::1:323                 :::*                                -                   
udp6       0      0 :::4342                 :::*                                5754/java           
looking for "BindException: Address already in use" in log file
looking for "server is unhealthy" in log file
+ '[' 1 == 0 ']'
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_2_IP
+ echo 'Execute the post startup script on controller 10.30.171.151'
Execute the post startup script on controller 10.30.171.151
+ scp /w/workspace/controller-csit-3node-clustering-ask-all-argon/post-startup-script.sh 10.30.171.151:/tmp/
Warning: Permanently added '10.30.171.151' (ECDSA) to the list of known hosts.
+ ssh 10.30.171.151 'bash /tmp/post-startup-script.sh 2'
Warning: Permanently added '10.30.171.151' (ECDSA) to the list of known hosts.
tcp6       0      0 :::8101                 :::*                    LISTEN     
Waiting up to 3 minutes for controller to come up, checking every 5 seconds...
2024-04-06T23:10:06,763 | INFO  | SystemReadyService-0 | SimpleSystemReadyMonitor         | 301 - org.opendaylight.infrautils.ready-api - 5.0.9 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
Controller is UP
2024-04-06T23:10:06,763 | INFO  | SystemReadyService-0 | SimpleSystemReadyMonitor         | 301 - org.opendaylight.infrautils.ready-api - 5.0.9 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
Listing all open ports on controller system...
(Not all processes could be identified, non-owned process info
 will not be shown, you would have to be root to see it all.)
Active Internet connections (servers and established)
Proto Recv-Q Send-Q Local Address           Foreign Address         State       PID/Program name    
tcp        0      0 0.0.0.0:22              0.0.0.0:*               LISTEN      -                   
tcp        0      0 0.0.0.0:111             0.0.0.0:*               LISTEN      -                   
tcp        0    164 10.30.171.151:22        10.30.171.62:46782      ESTABLISHED -                   
tcp6       0      0 :::8181                 :::*                    LISTEN      5733/java           
tcp6       0      0 10.30.171.151:2550      :::*                    LISTEN      5733/java           
tcp6       0      0 :::22                   :::*                    LISTEN      -                   
tcp6       0      0 :::12345                :::*                    LISTEN      5733/java           
tcp6       0      0 127.0.0.1:44444         :::*                    LISTEN      5733/java           
tcp6       0      0 :::6653                 :::*                    LISTEN      5733/java           
tcp6       0      0 :::1790                 :::*                    LISTEN      5733/java           
tcp6       0      0 127.0.0.1:46431         :::*                    LISTEN      5733/java           
tcp6       0      0 :::8101                 :::*                    LISTEN      5733/java           
tcp6       0      0 :::6633                 :::*                    LISTEN      5733/java           
tcp6       0      0 127.0.0.1:1099          :::*                    LISTEN      5733/java           
tcp6       0      0 :::111                  :::*                    LISTEN      -                   
tcp6       0      0 :::6640                 :::*                    LISTEN      5733/java           
tcp6       0      0 :::5555                 :::*                    LISTEN      -                   
tcp6       0      0 10.30.171.151:2550      10.30.171.96:36118      ESTABLISHED 5733/java           
tcp6       0      0 127.0.0.1:60864         127.0.0.1:1099          TIME_WAIT   -                   
tcp6       0      0 127.0.0.1:45370         127.0.0.1:44444         TIME_WAIT   -                   
tcp6       0      0 10.30.171.151:52546     10.30.171.96:2550       ESTABLISHED 5733/java           
tcp6       0      0 10.30.171.151:2550      10.30.170.132:39138     ESTABLISHED 5733/java           
tcp6      32      0 10.30.171.151:40198     199.204.45.87:443       CLOSE_WAIT  5733/java           
tcp6       0      0 127.0.0.1:45368         127.0.0.1:44444         TIME_WAIT   -                   
tcp6       0      0 10.30.171.151:2550      10.30.170.132:39128     ESTABLISHED 5733/java           
tcp6       0      0 10.30.171.151:39930     10.30.170.132:2550      ESTABLISHED 5733/java           
tcp6       0      0 10.30.171.151:2550      10.30.171.96:36132      ESTABLISHED 5733/java           
tcp6       0      0 10.30.171.151:39942     10.30.170.132:2550      ESTABLISHED 5733/java           
tcp6       0      0 10.30.171.151:52550     10.30.171.96:2550       ESTABLISHED 5733/java           
udp        0      0 10.30.171.151:68        10.30.170.4:67          ESTABLISHED -                   
udp        0      0 0.0.0.0:111             0.0.0.0:*                           -                   
udp        0      0 127.0.0.1:323           0.0.0.0:*                           -                   
udp6       0      0 :::4342                 :::*                                5733/java           
udp6       0      0 :::111                  :::*                                -                   
udp6       0      0 ::1:323                 :::*                                -                   
looking for "BindException: Address already in use" in log file
looking for "server is unhealthy" in log file
+ '[' 2 == 0 ']'
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_3_IP
+ echo 'Execute the post startup script on controller 10.30.170.132'
Execute the post startup script on controller 10.30.170.132
+ scp /w/workspace/controller-csit-3node-clustering-ask-all-argon/post-startup-script.sh 10.30.170.132:/tmp/
Warning: Permanently added '10.30.170.132' (ECDSA) to the list of known hosts.
+ ssh 10.30.170.132 'bash /tmp/post-startup-script.sh 3'
Warning: Permanently added '10.30.170.132' (ECDSA) to the list of known hosts.
tcp6       0      0 :::8101                 :::*                    LISTEN     
Waiting up to 3 minutes for controller to come up, checking every 5 seconds...
2024-04-06T23:10:06,503 | INFO  | SystemReadyService-0 | SimpleSystemReadyMonitor         | 301 - org.opendaylight.infrautils.ready-api - 5.0.9 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
Controller is UP
2024-04-06T23:10:06,503 | INFO  | SystemReadyService-0 | SimpleSystemReadyMonitor         | 301 - org.opendaylight.infrautils.ready-api - 5.0.9 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
Listing all open ports on controller system...
(Not all processes could be identified, non-owned process info
 will not be shown, you would have to be root to see it all.)
Active Internet connections (servers and established)
Proto Recv-Q Send-Q Local Address           Foreign Address         State       PID/Program name    
tcp        0      0 0.0.0.0:22              0.0.0.0:*               LISTEN      -                   
tcp        0      0 0.0.0.0:111             0.0.0.0:*               LISTEN      -                   
tcp        0    164 10.30.170.132:22        10.30.171.62:55284      ESTABLISHED -                   
tcp6       0      0 :::5555                 :::*                    LISTEN      -                   
tcp6       0      0 :::8181                 :::*                    LISTEN      5727/java           
tcp6       0      0 10.30.170.132:2550      :::*                    LISTEN      5727/java           
tcp6       0      0 :::22                   :::*                    LISTEN      -                   
tcp6       0      0 127.0.0.1:44444         :::*                    LISTEN      5727/java           
tcp6       0      0 :::6653                 :::*                    LISTEN      5727/java           
tcp6       0      0 :::1790                 :::*                    LISTEN      5727/java           
tcp6       0      0 :::8101                 :::*                    LISTEN      5727/java           
tcp6       0      0 :::6633                 :::*                    LISTEN      5727/java           
tcp6       0      0 127.0.0.1:46153         :::*                    LISTEN      5727/java           
tcp6       0      0 127.0.0.1:1099          :::*                    LISTEN      5727/java           
tcp6       0      0 :::111                  :::*                    LISTEN      -                   
tcp6       0      0 :::6640                 :::*                    LISTEN      5727/java           
tcp6       0      0 10.30.170.132:2550      10.30.171.151:39942     ESTABLISHED 5727/java           
tcp6       0      0 127.0.0.1:54024         127.0.0.1:44444         TIME_WAIT   -                   
tcp6      32      0 10.30.170.132:42354     199.204.45.87:443       CLOSE_WAIT  5727/java           
tcp6       0      0 10.30.170.132:2550      10.30.171.96:39716      ESTABLISHED 5727/java           
tcp6       0      0 10.30.170.132:39138     10.30.171.151:2550      ESTABLISHED 5727/java           
tcp6       0      0 10.30.170.132:2550      10.30.171.151:39930     ESTABLISHED 5727/java           
tcp6       0      0 127.0.0.1:54032         127.0.0.1:44444         TIME_WAIT   -                   
tcp6       0      0 127.0.0.1:36428         127.0.0.1:1099          TIME_WAIT   -                   
tcp6       0      0 10.30.170.132:39128     10.30.171.151:2550      ESTABLISHED 5727/java           
tcp6       0      0 10.30.170.132:2550      10.30.171.96:39730      ESTABLISHED 5727/java           
tcp6       0      0 10.30.170.132:44338     10.30.171.96:2550       ESTABLISHED 5727/java           
tcp6       0      0 10.30.170.132:44324     10.30.171.96:2550       ESTABLISHED 5727/java           
udp        0      0 10.30.170.132:68        10.30.170.2:67          ESTABLISHED -                   
udp        0      0 0.0.0.0:111             0.0.0.0:*                           -                   
udp        0      0 127.0.0.1:323           0.0.0.0:*                           -                   
udp6       0      0 :::4342                 :::*                                5727/java           
udp6       0      0 :::111                  :::*                                -                   
udp6       0      0 ::1:323                 :::*                                -                   
looking for "BindException: Address already in use" in log file
looking for "server is unhealthy" in log file
+ '[' 0 == 0 ']'
+ seed_index=1
+ dump_controller_threads
++ seq 1 3
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_1_IP
+ echo 'Let'\''s take the karaf thread dump'
Let's take the karaf thread dump
+ ssh 10.30.171.96 'sudo ps aux'
Warning: Permanently added '10.30.171.96' (ECDSA) to the list of known hosts.
++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-ask-all-argon/ps_before.log
++ grep -v grep
++ cut -f2 '-d '
++ tr -s ' '
+ pid=5754
+ echo 'karaf main: org.apache.karaf.main.Main, pid:5754'
karaf main: org.apache.karaf.main.Main, pid:5754
+ ssh 10.30.171.96 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 5754'
Warning: Permanently added '10.30.171.96' (ECDSA) to the list of known hosts.
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_2_IP
+ echo 'Let'\''s take the karaf thread dump'
Let's take the karaf thread dump
+ ssh 10.30.171.151 'sudo ps aux'
Warning: Permanently added '10.30.171.151' (ECDSA) to the list of known hosts.
++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-ask-all-argon/ps_before.log
++ cut -f2 '-d '
++ grep -v grep
++ tr -s ' '
+ pid=5733
+ echo 'karaf main: org.apache.karaf.main.Main, pid:5733'
karaf main: org.apache.karaf.main.Main, pid:5733
+ ssh 10.30.171.151 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 5733'
Warning: Permanently added '10.30.171.151' (ECDSA) to the list of known hosts.
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_3_IP
+ echo 'Let'\''s take the karaf thread dump'
Let's take the karaf thread dump
+ ssh 10.30.170.132 'sudo ps aux'
Warning: Permanently added '10.30.170.132' (ECDSA) to the list of known hosts.
++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-ask-all-argon/ps_before.log
++ grep -v grep
++ cut -f2 '-d '
++ tr -s ' '
+ pid=5727
+ echo 'karaf main: org.apache.karaf.main.Main, pid:5727'
karaf main: org.apache.karaf.main.Main, pid:5727
+ ssh 10.30.170.132 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 5727'
Warning: Permanently added '10.30.170.132' (ECDSA) to the list of known hosts.
+ '[' 0 -gt 0 ']'
+ echo 'Generating controller variables...'
Generating controller variables...
++ seq 1 3
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_1_IP
+ odl_variables=' -v ODL_SYSTEM_1_IP:10.30.171.96'
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_2_IP
+ odl_variables=' -v ODL_SYSTEM_1_IP:10.30.171.96 -v ODL_SYSTEM_2_IP:10.30.171.151'
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_3_IP
+ odl_variables=' -v ODL_SYSTEM_1_IP:10.30.171.96 -v ODL_SYSTEM_2_IP:10.30.171.151 -v ODL_SYSTEM_3_IP:10.30.170.132'
+ echo 'Generating mininet variables...'
Generating mininet variables...
++ seq 1 0
+ get_test_suites SUITES
+ local __suite_list=SUITES
+ echo 'Locating test plan to use...'
Locating test plan to use...
+ testplan_filepath=/w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/testplans/controller-clustering-ask-argon.txt
+ '[' '!' -f /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/testplans/controller-clustering-ask-argon.txt ']'
+ testplan_filepath=/w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/testplans/controller-clustering-ask.txt
+ '[' disabled '!=' disabled ']'
+ echo 'Changing the testplan path...'
Changing the testplan path...
+ sed s:integration:/w/workspace/controller-csit-3node-clustering-ask-all-argon: /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/testplans/controller-clustering-ask.txt
+ cat testplan.txt
# Place the suites in run order:
/w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot
/w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence.robot
/w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot
/w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_rpc_broker/rpc_provider_partition_and_heal.robot
/w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot
/w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_rpc_broker/action_provider_precedence.robot
/w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot
/w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_rpc_broker/action_provider_partition_and_heal.robot
/w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot
/w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/cluster_singleton/master_stability.robot
/w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot
/w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot
/w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot
/w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot
/w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot
/w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/singleton_service/global_rpc_kill.robot
/w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot
/w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/singleton_service/global_rpc_freeze.robot
/w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot
/w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/singleton_service/global_rpc_isolate.robot
/w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot
/w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot
/w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot
/w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot
/w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot
/w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot
/w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot
/w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot
/w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot
+ '[' -z '' ']'
++ grep -E -v '(^[[:space:]]*#|^[[:space:]]*$)' testplan.txt
++ tr '\012' ' '
+ suite_list='/w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_rpc_broker/rpc_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_rpc_broker/action_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_rpc_broker/action_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/singleton_service/global_rpc_kill.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/singleton_service/global_rpc_freeze.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/singleton_service/global_rpc_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot '
+ eval 'SUITES='\''/w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_rpc_broker/rpc_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_rpc_broker/action_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_rpc_broker/action_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/singleton_service/global_rpc_kill.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/singleton_service/global_rpc_freeze.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/singleton_service/global_rpc_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot '\'''
++ SUITES='/w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_rpc_broker/rpc_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_rpc_broker/action_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_rpc_broker/action_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/singleton_service/global_rpc_kill.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/singleton_service/global_rpc_freeze.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/singleton_service/global_rpc_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot '
+ echo 'Starting Robot test suites /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_rpc_broker/rpc_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_rpc_broker/action_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_rpc_broker/action_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/singleton_service/global_rpc_kill.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/singleton_service/global_rpc_freeze.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/singleton_service/global_rpc_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot  ...'
Starting Robot test suites /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_rpc_broker/rpc_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_rpc_broker/action_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_rpc_broker/action_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/singleton_service/global_rpc_kill.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/singleton_service/global_rpc_freeze.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/singleton_service/global_rpc_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot  ...
+ robot -N controller-clustering-ask.txt --removekeywords wuks -e exclude -e skip_if_argon -v BUNDLEFOLDER:karaf-0.18.4-SNAPSHOT -v BUNDLE_URL:https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/karaf-0.18.4-20240406.194621-101.zip -v CONTROLLER:10.30.171.96 -v CONTROLLER1:10.30.171.151 -v CONTROLLER2:10.30.170.132 -v CONTROLLER_USER:jenkins -v JAVA_HOME:/usr/lib/jvm/java-17-openjdk -v JDKVERSION:openjdk17 -v JENKINS_WORKSPACE:/w/workspace/controller-csit-3node-clustering-ask-all-argon -v MININET: -v MININET1: -v MININET2: -v MININET_USER:jenkins -v NEXUSURL_PREFIX:https://nexus.opendaylight.org -v NUM_ODL_SYSTEM:3 -v NUM_TOOLS_SYSTEM:0 -v ODL_STREAM:argon -v ODL_SYSTEM_IP:10.30.171.96 -v ODL_SYSTEM_1_IP:10.30.171.96 -v ODL_SYSTEM_2_IP:10.30.171.151 -v ODL_SYSTEM_3_IP:10.30.170.132 -v ODL_SYSTEM_USER:jenkins -v TOOLS_SYSTEM_IP: -v TOOLS_SYSTEM_USER:jenkins -v USER_HOME:/home/jenkins -v IS_KARAF_APPL:True -v WORKSPACE:/tmp /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_rpc_broker/rpc_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_rpc_broker/action_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_rpc_broker/action_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/singleton_service/global_rpc_kill.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/singleton_service/global_rpc_freeze.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/singleton_service/global_rpc_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-argon/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot
==============================================================================
controller-clustering-ask.txt                                                 
==============================================================================
controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te...
==============================================================================
Stop_All_Members :: Stop every odl node.                              | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-ask.txt.Rpc Provider Precedence :: DOMRpcBroker testi...
==============================================================================
Register_Rpc_On_Each_Node :: Register global rpc on each node of t... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_rpc_provider_precedence_register_rpc_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_precedence_register_rpc_on_each_node&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Invoke_Rpc_On_Each_Node :: Verify that the rpc response comes from... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_rpc_provider_precedence_invoke_rpc_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_precedence_invoke_rpc_on_each_node&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Unregister_Rpc_On_Node :: Unregister the rpc on one of the cluster... | PASS |
------------------------------------------------------------------------------
Invoke_Rpc_On_Node_With_Unregistered_Rpc :: Invoke rcp on the node... | PASS |
------------------------------------------------------------------------------
Invoke_Rpc_On_Remaining_Nodes :: Verify that the rpc response come... | PASS |
------------------------------------------------------------------------------
Reregister_Rpc_On_Node :: Reregister the rpc.                         | PASS |
------------------------------------------------------------------------------
Invoke_Rpc_On_Each_Node_Again :: Verify that the rpc response come... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_rpc_provider_precedence_invoke_rpc_on_each_node_again"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_precedence_invoke_rpc_on_each_node_again&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Unregister_Rpc_On_Each_Node :: Unregister rpc on every node.          | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_rpc_provider_precedence_unregister_rpc_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_precedence_unregister_rpc_on_each_node&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-ask.txt.Rpc Provider Precedence :: DOMRpcBro... | FAIL |
8 tests, 4 passed, 4 failed
==============================================================================
controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te...
==============================================================================
Stop_All_Members :: Stop every odl node.                              | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-ask.txt.Rpc Provider Partition And Heal :: DOMRpcBrok...
==============================================================================
Register_Rpc_On_Two_Nodes :: Register rpc on two nodes of the odl ... | PASS |
------------------------------------------------------------------------------
Invoke_Rpc_On_Each_Node :: Invoke get-constant rpc on every node o... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_rpc_provider_partition_and_heal_invoke_rpc_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_partition_and_heal_invoke_rpc_on_each_node&order=bug_status"

Keyword 'Verify_Constant_On_Active_Nodes' failed after retrying for 10 seconds. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Isolate_One_Node :: Isolate one node with registered rpc. From the... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_rpc_provider_partition_and_heal_isolate_one_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_partition_and_heal_isolate_one_node&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Invoke_Rpc_On_Nonisolated_Nodes :: Invoke rpc on non-islolated nodes. | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_rpc_provider_partition_and_heal_invoke_rpc_on_nonisolated_nodes"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_partition_and_heal_invoke_rpc_on_nonisolated_nodes&order=bug_status"

Keyword 'DrbCommons.Verify_Constant_On_Active_Nodes' failed after retrying for 1 minute. The last error was: Keyword 'Verify_Constant_On_Active_Nodes' failed after retrying for 10 seconds. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Rejoin_Isolated_Member :: Rejoin isolated node                        | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_rpc_provider_partition_and_heal_rejoin_isolated_member"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_partition_and_heal_rejoin_isolated_member&order=bug_status"

Variable '${isolated_idx}' not found.
------------------------------------------------------------------------------
Invoke_Rpc_On_Each_Node_Again :: Invoke rpc get-constant on every ... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_rpc_provider_partition_and_heal_invoke_rpc_on_each_node_again"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_partition_and_heal_invoke_rpc_on_each_node_again&order=bug_status"

Keyword 'Verify_Constant_On_Active_Nodes' failed after retrying for 10 seconds. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Unregister_Rpc_On_Each_Node :: Inregister rpc on both nodes.          | PASS |
------------------------------------------------------------------------------
controller-clustering-ask.txt.Rpc Provider Partition And Heal :: D... | FAIL |
7 tests, 2 passed, 5 failed
==============================================================================
controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te...
==============================================================================
Stop_All_Members :: Stop every odl node.                              | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-ask.txt.Action Provider Precedence :: DOMRpcBroker te...
==============================================================================
Register_Rpc_On_Each_Node :: Register routed rpc on each node of t... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_action_provider_precedence_register_rpc_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_precedence_register_rpc_on_each_node&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Invoke_Rpc_On_Each_Node :: Verify that the rpc response comes from... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_action_provider_precedence_invoke_rpc_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_precedence_invoke_rpc_on_each_node&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Unregister_Rpc_On_Node :: Unregister the rpc on one of the cluster... | PASS |
------------------------------------------------------------------------------
Invoke_Rpc_On_Node_With_Unregistered_Rpc :: Invoke rcp on the node... | PASS |
------------------------------------------------------------------------------
Invoke_Rpc_On_Remaining_Nodes :: Verify that the rpc response come... | PASS |
------------------------------------------------------------------------------
Reregister_Rpc_On_Node :: Reregister the rpc.                         | PASS |
------------------------------------------------------------------------------
Invoke_Rpc_On_Each_Node_Again :: Verify that the rpc response come... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_action_provider_precedence_invoke_rpc_on_each_node_again"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_precedence_invoke_rpc_on_each_node_again&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Unregister_Rpc_On_Each_Node :: Unregister rpc on every node.          | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_action_provider_precedence_unregister_rpc_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_precedence_unregister_rpc_on_each_node&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-ask.txt.Action Provider Precedence :: DOMRpc... | FAIL |
8 tests, 4 passed, 4 failed
==============================================================================
controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te...
==============================================================================
Stop_All_Members :: Stop every odl node.                              | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-ask.txt.Action Provider Partition And Heal :: DOMRpcB...
==============================================================================
Register_Rpc_On_Two_Nodes :: Register rpc on two nodes of the odl ... | PASS |
------------------------------------------------------------------------------
Invoke_Rpc_On_Each_Node :: Invoke get-contexted-constant rpc on ev... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_action_provider_partition_and_heal_invoke_rpc_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_partition_and_heal_invoke_rpc_on_each_node&order=bug_status"

Keyword 'Verify_Contexted_Constant_On_Active_Nodes' failed after retrying for 10 seconds. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Isolate_One_Node :: Isolate one node with registered rpc.             | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_action_provider_partition_and_heal_isolate_one_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_partition_and_heal_isolate_one_node&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Invoke_Rpc_On_Remaining_Nodes :: Invoke rpc on non-islolated nodes... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_action_provider_partition_and_heal_invoke_rpc_on_remaining_nodes"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_partition_and_heal_invoke_rpc_on_remaining_nodes&order=bug_status"

Keyword 'DrbCommons.Verify_Contexted_Constant_On_Active_Nodes' failed after retrying for 1 minute. The last error was: Keyword 'Verify_Contexted_Constant_On_Active_Nodes' failed after retrying for 10 seconds. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Rejoin_Isolated_Member :: Rejoin isolated node                        | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_action_provider_partition_and_heal_rejoin_isolated_member"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_partition_and_heal_rejoin_isolated_member&order=bug_status"

Variable '${isolated_idx}' not found.
------------------------------------------------------------------------------
Invoke_Rpc_On_Each_Node_Again :: Invoke rpc get-contexted-constant... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_action_provider_partition_and_heal_invoke_rpc_on_each_node_again"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_partition_and_heal_invoke_rpc_on_each_node_again&order=bug_status"

Keyword 'Verify_Contexted_Constant_On_Active_Nodes' failed after retrying for 10 seconds. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Unregister_Rpc_On_Each_Node :: Inregister rpc on both nodes.          | PASS |
------------------------------------------------------------------------------
controller-clustering-ask.txt.Action Provider Partition And Heal :... | FAIL |
7 tests, 2 passed, 5 failed
==============================================================================
controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te...
==============================================================================
Stop_All_Members :: Stop every odl node.                              | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-ask.txt.Master Stability :: Cluster Singleton testing...
==============================================================================
Register_Singleton_Constant_On_Each_Node_And_Verify :: Register a ... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_master_stability_register_singleton_constant_on_each_node_and_verify"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_master_stability_register_singleton_constant_on_each_node_and_verify&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Unregister_Singleton_Constant_On_Non_Master_Node :: Unregister the... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_master_stability_unregister_singleton_constant_on_non_master_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_master_stability_unregister_singleton_constant_on_non_master_node&order=bug_status"

Variable '@{cs_candidates}' not found. Did you mean:
    @{cs_exp_candidates}
------------------------------------------------------------------------------
Monitor_Stability_While_Unregistered :: Verify that the owner rema... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_master_stability_monitor_stability_while_unregistered"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_master_stability_monitor_stability_while_unregistered&order=bug_status"

Variable '${cs_owner}' not found.
------------------------------------------------------------------------------
Reregister_Singleton_Constant :: Re-register the unregistered cand... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_master_stability_reregister_singleton_constant"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_master_stability_reregister_singleton_constant&order=bug_status"

Variable '${unregistered_node}' not found.
------------------------------------------------------------------------------
Verify_Stability_After_Reregistration :: Verify that the owner rem... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_master_stability_verify_stability_after_reregistration"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_master_stability_verify_stability_after_reregistration&order=bug_status"

Variable '${cs_owner}' not found.
------------------------------------------------------------------------------
Unregister_Singleton_Constant_On_Each_Node :: Unregister the appli... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_master_stability_unregister_singleton_constant_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_master_stability_unregister_singleton_constant_on_each_node&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-ask.txt.Master Stability :: Cluster Singleto... | FAIL |
6 tests, 0 passed, 6 failed
==============================================================================
controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te...
==============================================================================
Stop_All_Members :: Stop every odl node.                              | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-ask.txt.Partition And Heal :: Cluster Singleton testi...
==============================================================================
Register_Singleton_Constant_On_Each_Node :: Register a candidate a... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_partition_and_heal_register_singleton_constant_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_partition_and_heal_register_singleton_constant_on_each_node&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Verify_Singleton_Constant_On_Each_Node :: Store the owner and cand... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_partition_and_heal_verify_singleton_constant_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_partition_and_heal_verify_singleton_constant_on_each_node&order=bug_status"

Could not parse owner and candidates for device get-singleton-constant-service']
------------------------------------------------------------------------------
Isolate_Owner_Node :: Isolate the cluster node which is the owner.... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_partition_and_heal_isolate_owner_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_partition_and_heal_isolate_owner_node&order=bug_status"

Variable '${cs_owner}' not found.
------------------------------------------------------------------------------
Monitor_Stability_While_Isolated :: Monitor the stability of the s... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_partition_and_heal_monitor_stability_while_isolated"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_partition_and_heal_monitor_stability_while_isolated&order=bug_status"

Invalid IF condition: Evaluating expression '"${index}" == "${cs_isolated_index}"' failed: Variable '${cs_isolated_index}' not found.
------------------------------------------------------------------------------
Rejoin_Isolated_node :: Rejoin isolated node.                         | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_partition_and_heal_rejoin_isolated_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_partition_and_heal_rejoin_isolated_node&order=bug_status"

Variable '${cs_isolated_index}' not found.
------------------------------------------------------------------------------
Unregister_Singleton_Constant_On_Each_Node :: Unregister the appli... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_partition_and_heal_unregister_singleton_constant_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_partition_and_heal_unregister_singleton_constant_on_each_node&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-ask.txt.Partition And Heal :: Cluster Single... | FAIL |
6 tests, 0 passed, 6 failed
==============================================================================
controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te...
==============================================================================
Stop_All_Members :: Stop every odl node.                              | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-ask.txt.Chasing The Leader :: Cluster Singleton testi...
==============================================================================
Register_Candidates :: Register a candidate application on each no... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_chasing_the_leader_register_candidates"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_chasing_the_leader_register_candidates&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Do_Nothing :: Do nothing for the time of the test duration, becaus... | PASS |
------------------------------------------------------------------------------
Unregister_Candidates_And_Validate_Criteria :: Unregister the test... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_chasing_the_leader_unregister_candidates_and_validate_criteria"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_chasing_the_leader_unregister_candidates_and_validate_criteria&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-ask.txt.Chasing The Leader :: Cluster Single... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te...
==============================================================================
Stop_All_Members :: Stop every odl node.                              | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-ask.txt.Global Rpc Kill :: Controller functional HA t...
==============================================================================
Get_Basic_Rpc_Test_Owner :: Find a service owner and successors.      | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Rpc_Before_Stopping_On_Owner :: Run rpc on the service owner.         | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Rpc_Before_Stop_On_Successors :: Run rpc on non owher cluster nodes.  | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Stop_Current_Owner_Member :: Stop cluster node which is the owner.    | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Verify_New_Basic_Rpc_Test_Owner_Elected :: Verify new owner of the... | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Rpc_On_Remained_Cluster_Nodes :: Run rpc on remained cluster nodes.   | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Restart_Stopped_Member :: Restart stopped node                        | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Verify_New_Owner_Remained_After_Rejoin :: Verify no owner change h... | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Rpc_After_Rejoin_On_New_Owner :: Run rpc on the new service owner ... | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Rpc_After_Rejoin_On_Old_Owner :: Run rpc on rejoined cluster node.    | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Rpc_After_Rejoin_On_All :: Run rpc again on all nodes.                | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
controller-clustering-ask.txt.Global Rpc Kill :: Controller functi... | FAIL |
Suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.

11 tests, 0 passed, 11 failed
==============================================================================
controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te...
==============================================================================
Stop_All_Members :: Stop every odl node.                              | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-ask.txt.Global Rpc Freeze :: Controller functional HA...
==============================================================================
Get_Basic_Rpc_Test_Owner :: Find a service owner and successors.      | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Rpc_Before_Freezing_On_Owner :: Run rpc on the service owner.         | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Rpc_Before_Freeze_On_Successors :: Run rpc on non owher cluster no... | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Freeze_Current_Owner_Member :: Stop cluster node which is the owner.  | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Verify_New_Basic_Rpc_Test_Owner_Elected :: Verify new owner of the... | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Rpc_On_Remained_Cluster_Nodes :: Run rpc on remained cluster nodes.   | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Unfreeze_Frozen_Member :: Restart frozen node                         | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Rpc_After_Rejoin_On_New_Owner :: Run rpc on the new service owner ... | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Rpc_After_Rejoin_On_Old_Owner :: Run rpc on rejoined cluster node.    | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Rpc_After_Rejoin_On_All :: Run rpc again on all nodes.                | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
controller-clustering-ask.txt.Global Rpc Freeze :: Controller func... | FAIL |
Suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.

10 tests, 0 passed, 10 failed
==============================================================================
controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te...
==============================================================================
Stop_All_Members :: Stop every odl node.                              | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-ask.txt.Global Rpc Isolate :: Controller functional H...
==============================================================================
Get_Basic_Rpc_Test_Owner :: Find a service owner and successors.      | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Rpc_Before_Isolation_On_Owner :: Run rpc on the service owner.        | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Rpc_Before_Isolation_On_Successors :: Run rpc on non owher cluster... | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Isolate_Current_Owner_Member :: Isolating cluster node which is th... | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Verify_New_Basic_Rpc_Test_Owner_Elected :: Verify new owner of the... | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Rpc_On_Isolated_Node :: Run rpc on isolated cluster node.             | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Rpc_On_Non_Isolated_Cluster_Nodes :: Run rpc on remained cluster n... | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Rejoin_Isolated_Member :: Rejoin isolated node                        | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Rpc_After_Rejoin_On_New_Owner :: Run rpc on the new service owner ... | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Rpc_After_Rejoin_On_Old_Owner :: Run rpc on rejoined cluster node.    | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Rpc_After_Rejoin_On_All :: Run rpc again on all nodes.                | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
controller-clustering-ask.txt.Global Rpc Isolate :: Controller fun... | FAIL |
Suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.

11 tests, 0 passed, 11 failed
==============================================================================
controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te...
==============================================================================
Stop_All_Members :: Stop every odl node.                              | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-ask.txt.Carpeople Crud :: Suite for performing basic ...
==============================================================================
Add_Cars_To_Leader :: Add 30 cars to car Leader by one big PUT.       | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
See_Added_Cars_On_Leader :: GET response from Leader should match ... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
See_Added_Cars_On_Followers :: The same check on other members.       | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Add_People_To_First_Follower :: Add 30 people to people first Foll... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
See_Added_People_On_Leader :: GET response from Leader should matc... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
See_Added_People_On_Followers :: The same check on other members.     | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Buy_Cars_On_Leader :: Buy some cars on car-people Leader, loop of ... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Buy_Cars_On_Followers :: On each Follower buy corresponding ID seg... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
See_Added_CarPeople_On_Leader :: GET car-person mappings from Lead... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
See_Added_CarPeople_On_Followers :: The same check on other members.  | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Delete_All_CarPeople_On_Leader :: DELETE car-people container. No ... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Delete_All_People_On_Leader :: DELETE people container. No verific... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Delete_All_Cars_On_Leader :: DELETE cars container. No verificatio... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
controller-clustering-ask.txt.Carpeople Crud :: Suite for performi... | FAIL |
Suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)

13 tests, 0 passed, 13 failed
==============================================================================
controller-clustering-ask.txt.Car Failover Crud :: Suite mixing basic opera...
==============================================================================
Add_Original_Cars_On_Old_Leader_And_Verify :: Add initial cars on ... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Stop_Original_Car_Leader :: Stop the car Leader to cause a new lea... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Wait_For_New_Leader :: Wait until new car Leader is elected.          | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
See_Original_Cars_On_New_Leader :: GET cars from new Leader, shoul... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
See_Original_Cars_On_New_Followers :: The same check on other exis... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Delete_Original_Cars_On_New_Leader :: Delete cars on the new Leader.  | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Add_Leader_Cars_On_New_Leader :: Add cars on the new Leader.          | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
See_Leader_Cars_On_New_Leader :: GET cars from new Leader, should ... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
See_Leader_Cars_On_New_Followers :: The same check on other existi... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Delete_Leader_Cars_On_New_First_Follower :: Delete cars in new fir... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Add_Follower_Cars_On_New_First_Follower :: Add cars on the new fir... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
See_Folower_Cars_On_New_Leader :: Get cars from the new Leader, sh... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
See_Follower_Cars_On_New_Followers :: The same check on other exis... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Start_Old_Car_Leader :: Start the stopped member without deleting ... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
See_Folower_Cars_On_Old_Leader :: GET cars from the restarted memb... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Delete_Follower_Cars_On_New_Leader :: Delete cars on the last Leader. | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
controller-clustering-ask.txt.Car Failover Crud :: Suite mixing ba... | FAIL |
Suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)

16 tests, 0 passed, 16 failed
==============================================================================
controller-clustering-ask.txt.Car Persistence Recovery :: This test restart...
==============================================================================
Add_Cars_On_Leader_And_Verify :: Single big PUT to datastore to ad... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Stop_All_Members :: Stop all controllers.                             | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Start_All_Members :: Start all controllers (should restore the per... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Memorize_Leader_And_Followers :: Locate current Leader of car Shard.  | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
See_Cars_On_Leader :: GET cars from Leader, should match the PUT d... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
See_Cars_On_Followers :: The same check on other members.             | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Delete_Cars_On_Leader :: Delete cars on the new Leader.               | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
controller-clustering-ask.txt.Car Persistence Recovery :: This tes... | FAIL |
Suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)

7 tests, 0 passed, 7 failed
==============================================================================
controller-clustering-ask.txt.Buycar Failover :: This test focuses on testi...
==============================================================================
Add_Cars_To_Leader_And_Verify :: Add all needed cars to car Leader... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Add_People_To_First_Follower_And_Verify :: Add all needed people t... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Buy_Cars_On_Leader_And_Verify :: Buy some cars on the leader member.  | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Buy_Cars_On_Follower_And_Verify :: Buy some cars on the first foll... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Reboot_People_Leader :: Previous people Leader is rebooted. We sho... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Buy_Cars_On_Leader_After_Reboot_And_Verify :: Buy some cars on the... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Buy_Cars_On_Follower_After_Reboot_And_Verify :: Buy some cars on t... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Delete_All_CarPeople :: DELETE car-people container. No verificati... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Delete_All_People :: DELETE people container. No verification beyo... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Delete_All_Cars :: DELETE cars container. No verification beyond h... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
controller-clustering-ask.txt.Buycar Failover :: This test focuses... | FAIL |
Suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)

10 tests, 0 passed, 10 failed
==============================================================================
controller-clustering-ask.txt.Entity Isolate :: Suite for performing member...
==============================================================================
Check All Shards Before Isolate :: Check all shards in controller.    | FAIL |
Parent suite setup failed:
Evaluating expression 'json.loads(\'\'\'{\n "error": "javax.management.InstanceNotFoundException : org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "error_type": "javax.management.InstanceNotFoundException",\n "request": {\n  "mbean": "org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n  "type": "read"\n },\n "stacktrace": "javax.management.InstanceNotFoundException: org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1088)\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1358)\\n\\tat java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:921)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:46)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:41)\\n\\tat org.jolokia.backend.executor.AbstractMBeanServerExecutor.call(AbstractMBeanServerExecutor.java:90)\\n\\tat org.jolokia.handler.ReadHandler.getMBeanInfo(ReadHandler.java:233)\\n\\tat org.jolokia.handler.ReadHandler.getAllAttributesNames(ReadHandler.java:245)\\n\\tat org.jolokia.handler.ReadHandler.resolveAttributes(ReadHandler.java:221)\\n\\tat org.jolokia.handler.ReadHandler.f...
    [ Message content over the limit has been removed. ]
...clipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\\n\\tat org.eclipse.jetty.server.Server.handle(Server.java:516)\\n\\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)\\n\\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)\\n\\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)\\n\\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\\n\\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\\n\\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\\n\\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)\\n\\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\\n\\tat java.base/java.lang.Thread.run(Thread.java:833)\\n",\n "status": 404\n}\n\'\'\')' failed: JSONDecodeError: Invalid control character at: line 8 column 190 (char 619)
------------------------------------------------------------------------------
Isolate Entity Leader :: Isolate the entity-ownership Leader to ca... | FAIL |
Parent suite setup failed:
Evaluating expression 'json.loads(\'\'\'{\n "error": "javax.management.InstanceNotFoundException : org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "error_type": "javax.management.InstanceNotFoundException",\n "request": {\n  "mbean": "org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n  "type": "read"\n },\n "stacktrace": "javax.management.InstanceNotFoundException: org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1088)\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1358)\\n\\tat java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:921)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:46)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:41)\\n\\tat org.jolokia.backend.executor.AbstractMBeanServerExecutor.call(AbstractMBeanServerExecutor.java:90)\\n\\tat org.jolokia.handler.ReadHandler.getMBeanInfo(ReadHandler.java:233)\\n\\tat org.jolokia.handler.ReadHandler.getAllAttributesNames(ReadHandler.java:245)\\n\\tat org.jolokia.handler.ReadHandler.resolveAttributes(ReadHandler.java:221)\\n\\tat org.jolokia.handler.ReadHandler.f...
    [ Message content over the limit has been removed. ]
...clipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\\n\\tat org.eclipse.jetty.server.Server.handle(Server.java:516)\\n\\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)\\n\\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)\\n\\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)\\n\\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\\n\\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\\n\\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\\n\\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)\\n\\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\\n\\tat java.base/java.lang.Thread.run(Thread.java:833)\\n",\n "status": 404\n}\n\'\'\')' failed: JSONDecodeError: Invalid control character at: line 8 column 190 (char 619)
------------------------------------------------------------------------------
Check All Shards After Isolate :: Check all shards in controller.     | FAIL |
Parent suite setup failed:
Evaluating expression 'json.loads(\'\'\'{\n "error": "javax.management.InstanceNotFoundException : org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "error_type": "javax.management.InstanceNotFoundException",\n "request": {\n  "mbean": "org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n  "type": "read"\n },\n "stacktrace": "javax.management.InstanceNotFoundException: org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1088)\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1358)\\n\\tat java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:921)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:46)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:41)\\n\\tat org.jolokia.backend.executor.AbstractMBeanServerExecutor.call(AbstractMBeanServerExecutor.java:90)\\n\\tat org.jolokia.handler.ReadHandler.getMBeanInfo(ReadHandler.java:233)\\n\\tat org.jolokia.handler.ReadHandler.getAllAttributesNames(ReadHandler.java:245)\\n\\tat org.jolokia.handler.ReadHandler.resolveAttributes(ReadHandler.java:221)\\n\\tat org.jolokia.handler.ReadHandler.f...
    [ Message content over the limit has been removed. ]
...clipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\\n\\tat org.eclipse.jetty.server.Server.handle(Server.java:516)\\n\\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)\\n\\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)\\n\\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)\\n\\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\\n\\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\\n\\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\\n\\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)\\n\\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\\n\\tat java.base/java.lang.Thread.run(Thread.java:833)\\n",\n "status": 404\n}\n\'\'\')' failed: JSONDecodeError: Invalid control character at: line 8 column 190 (char 619)
------------------------------------------------------------------------------
Rejoin Entity Leader :: Rejoin the entity-ownership Leader.           | FAIL |
Parent suite setup failed:
Evaluating expression 'json.loads(\'\'\'{\n "error": "javax.management.InstanceNotFoundException : org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "error_type": "javax.management.InstanceNotFoundException",\n "request": {\n  "mbean": "org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n  "type": "read"\n },\n "stacktrace": "javax.management.InstanceNotFoundException: org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1088)\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1358)\\n\\tat java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:921)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:46)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:41)\\n\\tat org.jolokia.backend.executor.AbstractMBeanServerExecutor.call(AbstractMBeanServerExecutor.java:90)\\n\\tat org.jolokia.handler.ReadHandler.getMBeanInfo(ReadHandler.java:233)\\n\\tat org.jolokia.handler.ReadHandler.getAllAttributesNames(ReadHandler.java:245)\\n\\tat org.jolokia.handler.ReadHandler.resolveAttributes(ReadHandler.java:221)\\n\\tat org.jolokia.handler.ReadHandler.f...
    [ Message content over the limit has been removed. ]
...clipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\\n\\tat org.eclipse.jetty.server.Server.handle(Server.java:516)\\n\\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)\\n\\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)\\n\\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)\\n\\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\\n\\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\\n\\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\\n\\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)\\n\\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\\n\\tat java.base/java.lang.Thread.run(Thread.java:833)\\n",\n "status": 404\n}\n\'\'\')' failed: JSONDecodeError: Invalid control character at: line 8 column 190 (char 619)
------------------------------------------------------------------------------
Check All Shards After Rejoin :: Check all shards in controller.      | FAIL |
Parent suite setup failed:
Evaluating expression 'json.loads(\'\'\'{\n "error": "javax.management.InstanceNotFoundException : org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "error_type": "javax.management.InstanceNotFoundException",\n "request": {\n  "mbean": "org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n  "type": "read"\n },\n "stacktrace": "javax.management.InstanceNotFoundException: org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1088)\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1358)\\n\\tat java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:921)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:46)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:41)\\n\\tat org.jolokia.backend.executor.AbstractMBeanServerExecutor.call(AbstractMBeanServerExecutor.java:90)\\n\\tat org.jolokia.handler.ReadHandler.getMBeanInfo(ReadHandler.java:233)\\n\\tat org.jolokia.handler.ReadHandler.getAllAttributesNames(ReadHandler.java:245)\\n\\tat org.jolokia.handler.ReadHandler.resolveAttributes(ReadHandler.java:221)\\n\\tat org.jolokia.handler.ReadHandler.f...
    [ Message content over the limit has been removed. ]
...clipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\\n\\tat org.eclipse.jetty.server.Server.handle(Server.java:516)\\n\\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)\\n\\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)\\n\\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)\\n\\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\\n\\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\\n\\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\\n\\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)\\n\\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\\n\\tat java.base/java.lang.Thread.run(Thread.java:833)\\n",\n "status": 404\n}\n\'\'\')' failed: JSONDecodeError: Invalid control character at: line 8 column 190 (char 619)
------------------------------------------------------------------------------
controller-clustering-ask.txt.Entity Isolate :: Suite for performi... | FAIL |
Suite setup failed:
Evaluating expression 'json.loads(\'\'\'{\n "error": "javax.management.InstanceNotFoundException : org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "error_type": "javax.management.InstanceNotFoundException",\n "request": {\n  "mbean": "org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n  "type": "read"\n },\n "stacktrace": "javax.management.InstanceNotFoundException: org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1088)\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1358)\\n\\tat java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:921)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:46)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:41)\\n\\tat org.jolokia.backend.executor.AbstractMBeanServerExecutor.call(AbstractMBeanServerExecutor.java:90)\\n\\tat org.jolokia.handler.ReadHandler.getMBeanInfo(ReadHandler.java:233)\\n\\tat org.jolokia.handler.ReadHandler.getAllAttributesNames(ReadHandler.java:245)\\n\\tat org.jolokia.handler.ReadHandler.resolveAttributes(ReadHandler.java:221)\\n\\tat org.jolokia.handler.ReadHandler.f...
    [ Message content over the limit has been removed. ]
...clipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\\n\\tat org.eclipse.jetty.server.Server.handle(Server.java:516)\\n\\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)\\n\\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)\\n\\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)\\n\\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\\n\\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\\n\\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\\n\\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)\\n\\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\\n\\tat java.base/java.lang.Thread.run(Thread.java:833)\\n",\n "status": 404\n}\n\'\'\')' failed: JSONDecodeError: Invalid control character at: line 8 column 190 (char 619)

5 tests, 0 passed, 5 failed
==============================================================================
controller-clustering-ask.txt.Buycar Failover Isolation :: This test focuse...
==============================================================================
Add_Cars_To_Leader_And_Verify :: Add all needed cars to car Leader... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Add_People_To_First_Follower_And_Verify :: Add all needed people t... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Buy_Cars_On_Leader_And_Verify :: Buy some cars on the leader member.  | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Buy_Cars_On_Follower_And_Verify :: Buy some cars on the first foll... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Isolate_and_Rejoin_People_Leader :: Previous people Leader is isol... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Buy_Cars_On_Leader_After_Rejoin_And_Verify :: Buy some cars on the... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Buy_Cars_On_Follower_After_Rejoin_And_Verify :: Buy some cars on t... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Delete_All_CarPeople :: DELETE car-people container. No verificati... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Delete_All_People :: DELETE people container. No verification beyo... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Delete_All_Cars :: DELETE cars container. No verification beyond h... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
controller-clustering-ask.txt.Buycar Failover Isolation :: This te... | FAIL |
Suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)

10 tests, 0 passed, 10 failed
==============================================================================
controller-clustering-ask.txt.Car Failover Crud Isolation :: Suite mixing b...
==============================================================================
Add_Original_Cars_On_Old_Leader_And_Verify :: Add initial cars on ... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Isolate_Original_Car_Leader :: Isolate the car Leader to cause a n... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Wait_For_New_Leader :: Wait until new car Leader is elected.          | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
See_Original_Cars_On_New_Leader :: GET cars from new Leader, shoul... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
See_Original_Cars_On_New_Followers :: The same check on other exis... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Delete_Original_Cars_On_New_Leader :: Delete cars on the new Leader.  | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Add_Leader_Cars_On_New_Leader :: Add cars on the new Leader.          | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
See_Leader_Cars_On_New_Leader :: GET cars from new Leader, should ... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
See_Leader_Cars_On_New_Followers :: The same check on other existi... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Delete_Leader_Cars_On_New_First_Follower :: Delete cars in new fir... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Add_Follower_Cars_On_New_First_Follower :: Add cars on the new fir... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
See_Folower_Cars_On_New_Leader :: Get cars from the new Leader, sh... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
See_Follower_Cars_On_New_Followers :: The same check on other exis... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Rejoin_Old_Car_Leader :: Rejoin the isolated member without deleti... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
See_Folower_Cars_On_Old_Leader :: GET cars from the restarted memb... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Delete_Follower_Cars_On_New_Leader :: Delete cars on the last Leader. | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
controller-clustering-ask.txt.Car Failover Crud Isolation :: Suite... | FAIL |
Suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)

16 tests, 0 passed, 16 failed
==============================================================================
controller-clustering-ask.txt.Car Outage Corners :: Cluster suite for testi...
==============================================================================
Stop_Majority_Of_The_Followers :: Stop half plus one car Follower ... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Attempt_To_Add_Cars_To_Leader :: Adding cars should fail, as major... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Start_Tipping_Follower :: Start one Follower member without persis... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Add_Cars_On_Tipping_Follower :: Add cars on the tipping Follower.     | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
See_Cars_On_Existing_Members :: On each up member: GET cars, shoul... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Start_Other_Followers :: Start other followers without persisted d... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
See_Cars_On_New_Follower_Leader :: GET cars from a new follower to... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Delete_Cars_On_Leader :: Delete cars on Leader.                       | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
controller-clustering-ask.txt.Car Outage Corners :: Cluster suite ... | FAIL |
Suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.170.132', port=8181): Read timed out. (read timeout=5.0)

8 tests, 0 passed, 8 failed
==============================================================================
controller-clustering-ask.txt                                         | FAIL |
195 tests, 24 passed, 171 failed
==============================================================================
Output:  /w/workspace/controller-csit-3node-clustering-ask-all-argon/output.xml
Log:     /w/workspace/controller-csit-3node-clustering-ask-all-argon/log.html
Report:  /w/workspace/controller-csit-3node-clustering-ask-all-argon/report.html
+ true
+ echo 'Examining the files in data/log and checking filesize'
Examining the files in data/log and checking filesize
+ ssh 10.30.171.96 'ls -altr /tmp/karaf-0.18.4-SNAPSHOT/data/log/'
Warning: Permanently added '10.30.171.96' (ECDSA) to the list of known hosts.
total 55364
drwxrwxr-x. 2 jenkins jenkins       48 Apr  6 23:09 .
-rw-rw-r--. 1 jenkins jenkins     1720 Apr  6 23:09 karaf_console.log
drwxrwxr-x. 9 jenkins jenkins      149 Apr  7 03:10 ..
-rw-rw-r--. 1 jenkins jenkins 52229936 Apr  7 03:25 karaf.log
+ ssh 10.30.171.96 'du -hs /tmp/karaf-0.18.4-SNAPSHOT/data/log/*'
Warning: Permanently added '10.30.171.96' (ECDSA) to the list of known hosts.
4.0K	/tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf_console.log
55M	/tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log
+ ssh 10.30.171.151 'ls -altr /tmp/karaf-0.18.4-SNAPSHOT/data/log/'
Warning: Permanently added '10.30.171.151' (ECDSA) to the list of known hosts.
total 81604
drwxrwxr-x. 2 jenkins jenkins       48 Apr  6 23:09 .
-rw-rw-r--. 1 jenkins jenkins     1720 Apr  6 23:09 karaf_console.log
drwxrwxr-x. 9 jenkins jenkins      149 Apr  7 03:10 ..
-rw-rw-r--. 1 jenkins jenkins 54680186 Apr  7 03:25 karaf.log
+ ssh 10.30.171.151 'du -hs /tmp/karaf-0.18.4-SNAPSHOT/data/log/*'
Warning: Permanently added '10.30.171.151' (ECDSA) to the list of known hosts.
4.0K	/tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf_console.log
80M	/tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log
+ ssh 10.30.170.132 'ls -altr /tmp/karaf-0.18.4-SNAPSHOT/data/log/'
Warning: Permanently added '10.30.170.132' (ECDSA) to the list of known hosts.
total 65660
drwxrwxr-x. 2 jenkins jenkins       48 Apr  6 23:09 .
-rw-rw-r--. 1 jenkins jenkins   189458 Apr  6 23:46 karaf_console.log
drwxrwxr-x. 4 jenkins jenkins       28 Apr  7 03:10 ..
-rw-rw-r--. 1 jenkins jenkins 61986744 Apr  7 03:25 karaf.log
+ ssh 10.30.170.132 'du -hs /tmp/karaf-0.18.4-SNAPSHOT/data/log/*'
Warning: Permanently added '10.30.170.132' (ECDSA) to the list of known hosts.
188K	/tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf_console.log
64M	/tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log
+ set +e
++ seq 1 3
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_1_IP
+ echo 'Let'\''s take the karaf thread dump again'
Let's take the karaf thread dump again
+ ssh 10.30.171.96 'sudo ps aux'
Warning: Permanently added '10.30.171.96' (ECDSA) to the list of known hosts.
++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-ask-all-argon/ps_after.log
++ grep -v grep
++ tr -s ' '
++ cut -f2 '-d '
+ pid=30430
+ echo 'karaf main: org.apache.karaf.main.Main, pid:30430'
karaf main: org.apache.karaf.main.Main, pid:30430
+ ssh 10.30.171.96 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 30430'
Warning: Permanently added '10.30.171.96' (ECDSA) to the list of known hosts.
+ echo 'killing karaf process...'
killing karaf process...
+ ssh 10.30.171.96 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh'
Warning: Permanently added '10.30.171.96' (ECDSA) to the list of known hosts.
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_2_IP
+ echo 'Let'\''s take the karaf thread dump again'
Let's take the karaf thread dump again
+ ssh 10.30.171.151 'sudo ps aux'
Warning: Permanently added '10.30.171.151' (ECDSA) to the list of known hosts.
++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-ask-all-argon/ps_after.log
++ cut -f2 '-d '
++ grep -v grep
++ tr -s ' '
+ pid=29477
+ echo 'karaf main: org.apache.karaf.main.Main, pid:29477'
karaf main: org.apache.karaf.main.Main, pid:29477
+ ssh 10.30.171.151 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 29477'
Warning: Permanently added '10.30.171.151' (ECDSA) to the list of known hosts.
+ echo 'killing karaf process...'
killing karaf process...
+ ssh 10.30.171.151 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh'
Warning: Permanently added '10.30.171.151' (ECDSA) to the list of known hosts.
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_3_IP
+ echo 'Let'\''s take the karaf thread dump again'
Let's take the karaf thread dump again
+ ssh 10.30.170.132 'sudo ps aux'
Warning: Permanently added '10.30.170.132' (ECDSA) to the list of known hosts.
++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-ask-all-argon/ps_after.log
++ grep -v grep
++ tr -s ' '
++ cut -f2 '-d '
+ pid=5727
+ echo 'karaf main: org.apache.karaf.main.Main, pid:5727'
karaf main: org.apache.karaf.main.Main, pid:5727
+ ssh 10.30.170.132 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 5727'
Warning: Permanently added '10.30.170.132' (ECDSA) to the list of known hosts.
+ echo 'killing karaf process...'
killing karaf process...
+ ssh 10.30.170.132 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh'
Warning: Permanently added '10.30.170.132' (ECDSA) to the list of known hosts.
+ sleep 5
++ seq 1 3
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_1_IP
+ echo 'Compressing karaf.log 1'
Compressing karaf.log 1
+ ssh 10.30.171.96 gzip --best /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log
Warning: Permanently added '10.30.171.96' (ECDSA) to the list of known hosts.
gzip: /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log: file size changed while zipping
+ echo 'Fetching compressed karaf.log 1'
Fetching compressed karaf.log 1
+ scp 10.30.171.96:/tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log.gz odl1_karaf.log.gz
Warning: Permanently added '10.30.171.96' (ECDSA) to the list of known hosts.
+ ssh 10.30.171.96 rm -f /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log.gz
Warning: Permanently added '10.30.171.96' (ECDSA) to the list of known hosts.
+ scp 10.30.171.96:/tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf_console.log odl1_karaf_console.log
Warning: Permanently added '10.30.171.96' (ECDSA) to the list of known hosts.
+ ssh 10.30.171.96 rm -f /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf_console.log
Warning: Permanently added '10.30.171.96' (ECDSA) to the list of known hosts.
+ echo 'Fetch GC logs'
Fetch GC logs
+ mkdir -p gclogs-1
+ scp '10.30.171.96:/tmp/karaf-0.18.4-SNAPSHOT/data/log/*.log' gclogs-1/
Warning: Permanently added '10.30.171.96' (ECDSA) to the list of known hosts.
scp: /tmp/karaf-0.18.4-SNAPSHOT/data/log/*.log: No such file or directory
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_2_IP
+ echo 'Compressing karaf.log 2'
Compressing karaf.log 2
+ ssh 10.30.171.151 gzip --best /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log
Warning: Permanently added '10.30.171.151' (ECDSA) to the list of known hosts.
gzip: /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log: file size changed while zipping
+ echo 'Fetching compressed karaf.log 2'
Fetching compressed karaf.log 2
+ scp 10.30.171.151:/tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log.gz odl2_karaf.log.gz
Warning: Permanently added '10.30.171.151' (ECDSA) to the list of known hosts.
+ ssh 10.30.171.151 rm -f /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log.gz
Warning: Permanently added '10.30.171.151' (ECDSA) to the list of known hosts.
+ scp 10.30.171.151:/tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf_console.log odl2_karaf_console.log
Warning: Permanently added '10.30.171.151' (ECDSA) to the list of known hosts.
+ ssh 10.30.171.151 rm -f /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf_console.log
Warning: Permanently added '10.30.171.151' (ECDSA) to the list of known hosts.
+ echo 'Fetch GC logs'
Fetch GC logs
+ mkdir -p gclogs-2
+ scp '10.30.171.151:/tmp/karaf-0.18.4-SNAPSHOT/data/log/*.log' gclogs-2/
Warning: Permanently added '10.30.171.151' (ECDSA) to the list of known hosts.
scp: /tmp/karaf-0.18.4-SNAPSHOT/data/log/*.log: No such file or directory
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_3_IP
+ echo 'Compressing karaf.log 3'
Compressing karaf.log 3
+ ssh 10.30.170.132 gzip --best /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log
Warning: Permanently added '10.30.170.132' (ECDSA) to the list of known hosts.
gzip: /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log: file size changed while zipping
+ echo 'Fetching compressed karaf.log 3'
Fetching compressed karaf.log 3
+ scp 10.30.170.132:/tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log.gz odl3_karaf.log.gz
Warning: Permanently added '10.30.170.132' (ECDSA) to the list of known hosts.
+ ssh 10.30.170.132 rm -f /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log.gz
Warning: Permanently added '10.30.170.132' (ECDSA) to the list of known hosts.
+ scp 10.30.170.132:/tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf_console.log odl3_karaf_console.log
Warning: Permanently added '10.30.170.132' (ECDSA) to the list of known hosts.
+ ssh 10.30.170.132 rm -f /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf_console.log
Warning: Permanently added '10.30.170.132' (ECDSA) to the list of known hosts.
+ echo 'Fetch GC logs'
Fetch GC logs
+ mkdir -p gclogs-3
+ scp '10.30.170.132:/tmp/karaf-0.18.4-SNAPSHOT/data/log/*.log' gclogs-3/
Warning: Permanently added '10.30.170.132' (ECDSA) to the list of known hosts.
scp: /tmp/karaf-0.18.4-SNAPSHOT/data/log/*.log: No such file or directory
+ echo 'Examine copied files'
Examine copied files
+ ls -lt
total 55552
drwxrwxr-x. 2 jenkins jenkins        6 Apr  7 03:25 gclogs-3
-rw-rw-r--. 1 jenkins jenkins   189458 Apr  7 03:25 odl3_karaf_console.log
-rw-rw-r--. 1 jenkins jenkins  1458942 Apr  7 03:25 odl3_karaf.log.gz
drwxrwxr-x. 2 jenkins jenkins        6 Apr  7 03:25 gclogs-2
-rw-rw-r--. 1 jenkins jenkins     1720 Apr  7 03:25 odl2_karaf_console.log
-rw-rw-r--. 1 jenkins jenkins  1765665 Apr  7 03:25 odl2_karaf.log.gz
drwxrwxr-x. 2 jenkins jenkins        6 Apr  7 03:25 gclogs-1
-rw-rw-r--. 1 jenkins jenkins     1720 Apr  7 03:25 odl1_karaf_console.log
-rw-rw-r--. 1 jenkins jenkins  1644003 Apr  7 03:25 odl1_karaf.log.gz
-rw-rw-r--. 1 jenkins jenkins   169306 Apr  7 03:25 karaf_3_5727_threads_after.log
-rw-rw-r--. 1 jenkins jenkins    15760 Apr  7 03:25 ps_after.log
-rw-rw-r--. 1 jenkins jenkins   161720 Apr  7 03:25 karaf_2_29477_threads_after.log
-rw-rw-r--. 1 jenkins jenkins   155939 Apr  7 03:25 karaf_1_30430_threads_after.log
-rw-rw-r--. 1 jenkins jenkins   300964 Apr  7 03:25 report.html
-rw-rw-r--. 1 jenkins jenkins  3417519 Apr  7 03:25 log.html
-rw-rw-r--. 1 jenkins jenkins 46929634 Apr  7 03:24 output.xml
-rw-rw-r--. 1 jenkins jenkins     4033 Apr  6 23:10 testplan.txt
-rw-rw-r--. 1 jenkins jenkins   181500 Apr  6 23:10 karaf_3_5727_threads_before.log
-rw-rw-r--. 1 jenkins jenkins    16470 Apr  6 23:10 ps_before.log
-rw-rw-r--. 1 jenkins jenkins   180748 Apr  6 23:10 karaf_2_5733_threads_before.log
-rw-rw-r--. 1 jenkins jenkins   187649 Apr  6 23:10 karaf_1_5754_threads_before.log
-rw-rw-r--. 1 jenkins jenkins     3106 Apr  6 23:09 post-startup-script.sh
-rw-rw-r--. 1 jenkins jenkins      252 Apr  6 23:08 startup-script.sh
-rw-rw-r--. 1 jenkins jenkins     3454 Apr  6 23:08 configuration-script.sh
-rw-rw-r--. 1 jenkins jenkins      695 Apr  6 23:08 custom_shard_config.txt
-rw-rw-r--. 1 jenkins jenkins      132 Apr  6 23:08 scriptplan.txt
-rw-rw-r--. 1 jenkins jenkins      337 Apr  6 23:08 detect_variables.env
-rw-rw-r--. 1 jenkins jenkins     2620 Apr  6 23:08 pom.xml
-rw-rw-r--. 1 jenkins jenkins       86 Apr  6 23:08 set_variables.env
-rw-rw-r--. 1 jenkins jenkins      312 Apr  6 23:08 slave_addresses.txt
-rw-rw-r--. 1 jenkins jenkins      570 Apr  6 23:08 requirements.txt
-rw-rw-r--. 1 jenkins jenkins       26 Apr  6 23:08 env.properties
-rw-rw-r--. 1 jenkins jenkins      335 Apr  6 23:06 stack-parameters.yaml
drwxrwxr-x. 7 jenkins jenkins     4096 Apr  6 23:04 test
drwxrwxr-x. 2 jenkins jenkins        6 Apr  6 23:04 test@tmp
-rw-rw-r--. 1 jenkins jenkins     1410 Apr  6 19:46 maven-metadata.xml
+ true
[controller-csit-3node-clustering-ask-all-argon] $ /bin/sh /tmp/jenkins14730142561878758573.sh
Cleaning up Robot installation...
$ ssh-agent -k
unset SSH_AUTH_SOCK;
unset SSH_AGENT_PID;
echo Agent pid 5303 killed;
[ssh-agent] Stopped.
Recording plot data
Robot results publisher started...
INFO: Checking test criticality is deprecated and will be dropped in a future release!
-Parsing output xml:
Done!
-Copying log files to build dir:
Done!
-Assigning results to build:
Done!
-Checking thresholds:
Done!
Done publishing Robot results.
Build step 'Publish Robot Framework test results' changed build result to UNSTABLE
[PostBuildScript] - [INFO] Executing post build scripts.
[controller-csit-3node-clustering-ask-all-argon] $ /bin/bash /tmp/jenkins8437151406749827705.sh
Archiving csit artifacts
mv: cannot stat '*_1.png': No such file or directory
mv: cannot stat '/tmp/odl1_*': No such file or directory
mv: cannot stat '*_2.png': No such file or directory
mv: cannot stat '/tmp/odl2_*': No such file or directory
mv: cannot stat '*_3.png': No such file or directory
mv: cannot stat '/tmp/odl3_*': No such file or directory
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed

  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100 2696k    0 2696k    0     0  4048k      0 --:--:-- --:--:-- --:--:-- 4041k
100 4309k    0 4309k    0     0  4424k      0 --:--:-- --:--:-- --:--:-- 4424k
Archive:  robot-plugin.zip
  inflating: ./archives/robot-plugin/log.html  
  inflating: ./archives/robot-plugin/output.xml  
  inflating: ./archives/robot-plugin/report.html  
mv: cannot stat '*.log.gz': No such file or directory
mv: cannot stat '*.csv': No such file or directory
mv: cannot stat '*.png': No such file or directory
[PostBuildScript] - [INFO] Executing post build scripts.
[controller-csit-3node-clustering-ask-all-argon] $ /bin/bash /tmp/jenkins16915170276796044076.sh
[PostBuildScript] - [INFO] Executing post build scripts.
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties content 
OS_CLOUD=vex
OS_STACK_NAME=releng-controller-csit-3node-clustering-ask-all-argon-80

[EnvInject] - Variables injected successfully.
provisioning config files...
copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
[controller-csit-3node-clustering-ask-all-argon] $ /bin/bash /tmp/jenkins16262671960987958858.sh
---> openstack-stack-delete.sh
Setup pyenv:
  system
  3.8.13
  3.9.13
  3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-ask-all-argon/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-geSN from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes python-heatclient python-openstackclient 
lf-activate-venv(): INFO: Adding /tmp/venv-geSN/bin to PATH
INFO: Retrieving stack cost for: releng-controller-csit-3node-clustering-ask-all-argon-80
DEBUG: Successfully retrieved stack cost: total: 1.6500000000000001
INFO: Deleting stack releng-controller-csit-3node-clustering-ask-all-argon-80
Waiting for stack to delete...
Successfully deleted stack releng-controller-csit-3node-clustering-ask-all-argon-80
[PostBuildScript] - [INFO] Executing post build scripts.
[controller-csit-3node-clustering-ask-all-argon] $ /bin/bash /tmp/jenkins11724262526327322374.sh
---> sysstat.sh
[controller-csit-3node-clustering-ask-all-argon] $ /bin/bash /tmp/jenkins1492819939369719647.sh
---> package-listing.sh
++ facter osfamily
++ tr '[:upper:]' '[:lower:]'
+ OS_FAMILY=redhat
+ workspace=/w/workspace/controller-csit-3node-clustering-ask-all-argon
+ START_PACKAGES=/tmp/packages_start.txt
+ END_PACKAGES=/tmp/packages_end.txt
+ DIFF_PACKAGES=/tmp/packages_diff.txt
+ PACKAGES=/tmp/packages_start.txt
+ '[' /w/workspace/controller-csit-3node-clustering-ask-all-argon ']'
+ PACKAGES=/tmp/packages_end.txt
+ case "${OS_FAMILY}" in
+ rpm -qa
+ sort
+ '[' -f /tmp/packages_start.txt ']'
+ '[' -f /tmp/packages_end.txt ']'
+ diff /tmp/packages_start.txt /tmp/packages_end.txt
+ '[' /w/workspace/controller-csit-3node-clustering-ask-all-argon ']'
+ mkdir -p /w/workspace/controller-csit-3node-clustering-ask-all-argon/archives/
+ cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/controller-csit-3node-clustering-ask-all-argon/archives/
[controller-csit-3node-clustering-ask-all-argon] $ /bin/bash /tmp/jenkins17470755756069126892.sh
---> capture-instance-metadata.sh
Setup pyenv:
  system
  3.8.13
  3.9.13
  3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-ask-all-argon/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-geSN from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: lftools 
lf-activate-venv(): INFO: Adding /tmp/venv-geSN/bin to PATH
INFO: Running in OpenStack, capturing instance metadata
[controller-csit-3node-clustering-ask-all-argon] $ /bin/bash /tmp/jenkins14852423602678618816.sh
provisioning config files...
Could not find credentials [logs] for controller-csit-3node-clustering-ask-all-argon #80
copy managed file [jenkins-log-archives-settings] to file:/w/workspace/controller-csit-3node-clustering-ask-all-argon@tmp/config18418652556323945221tmp
Regular expression run condition: Expression=[^.*logs-s3.*], Label=[odl-logs-s3-cloudfront-index]
Run condition [Regular expression match] enabling perform for step [Provide Configuration files]
provisioning config files...
copy managed file [jenkins-s3-log-ship] to file:/home/jenkins/.aws/credentials
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties content 
SERVER_ID=logs

[EnvInject] - Variables injected successfully.
[controller-csit-3node-clustering-ask-all-argon] $ /bin/bash /tmp/jenkins9311539067619231885.sh
---> create-netrc.sh
WARN: Log server credential not found.
[controller-csit-3node-clustering-ask-all-argon] $ /bin/bash /tmp/jenkins15987220093784819290.sh
---> python-tools-install.sh
Setup pyenv:
  system
  3.8.13
  3.9.13
  3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-ask-all-argon/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-geSN from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: lftools 
lf-activate-venv(): INFO: Adding /tmp/venv-geSN/bin to PATH
[controller-csit-3node-clustering-ask-all-argon] $ /bin/bash /tmp/jenkins4971202171212076333.sh
---> sudo-logs.sh
Archiving 'sudo' log..
[controller-csit-3node-clustering-ask-all-argon] $ /bin/bash /tmp/jenkins5482144924289918676.sh
---> job-cost.sh
Setup pyenv:
  system
  3.8.13
  3.9.13
  3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-ask-all-argon/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-geSN from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 
lf-activate-venv(): INFO: Adding /tmp/venv-geSN/bin to PATH
DEBUG: total: 1.6500000000000001
INFO: Retrieving Stack Cost...
INFO: Retrieving Pricing Info for: v3-standard-2
INFO: Archiving Costs
[controller-csit-3node-clustering-ask-all-argon] $ /bin/bash -l /tmp/jenkins10372614904997958595.sh
---> logs-deploy.sh
Setup pyenv:
  system
  3.8.13
  3.9.13
  3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-ask-all-argon/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-geSN from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: lftools 
lf-activate-venv(): INFO: Adding /tmp/venv-geSN/bin to PATH
WARNING: Nexus logging server not set
INFO: S3 path logs/releng/vex-yul-odl-jenkins-1/controller-csit-3node-clustering-ask-all-argon/80/
INFO: archiving logs to S3
---> uname -a:
Linux prd-centos8-robot-2c-8g-5479.novalocal 4.18.0-547.el8.x86_64 #1 SMP Wed Mar 20 00:35:01 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux


---> lscpu:
Architecture:        x86_64
CPU op-mode(s):      32-bit, 64-bit
Byte Order:          Little Endian
CPU(s):              2
On-line CPU(s) list: 0,1
Thread(s) per core:  1
Core(s) per socket:  1
Socket(s):           2
NUMA node(s):        1
Vendor ID:           AuthenticAMD
CPU family:          23
Model:               49
Model name:          AMD EPYC-Rome Processor
Stepping:            0
CPU MHz:             2799.998
BogoMIPS:            5599.99
Virtualization:      AMD-V
Hypervisor vendor:   KVM
Virtualization type: full
L1d cache:           32K
L1i cache:           32K
L2 cache:            512K
L3 cache:            16384K
NUMA node0 CPU(s):   0,1
Flags:               fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities


---> nproc:
2


---> df -h:
Filesystem      Size  Used Avail Use% Mounted on
devtmpfs        3.8G     0  3.8G   0% /dev
tmpfs           3.8G     0  3.8G   0% /dev/shm
tmpfs           3.8G   17M  3.8G   1% /run
tmpfs           3.8G     0  3.8G   0% /sys/fs/cgroup
/dev/vda1        40G  9.6G   31G  24% /
tmpfs           770M     0  770M   0% /run/user/1001


---> free -m:
              total        used        free      shared  buff/cache   available
Mem:           7697         607        4692          19        2398        6793
Swap:          1023           0        1023


---> ip addr:
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host 
       valid_lft forever preferred_lft forever
2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1458 qdisc mq state UP group default qlen 1000
    link/ether fa:16:3e:7f:3b:3d brd ff:ff:ff:ff:ff:ff
    altname enp0s3
    altname ens3
    inet 10.30.171.62/23 brd 10.30.171.255 scope global dynamic noprefixroute eth0
       valid_lft 70595sec preferred_lft 70595sec
    inet6 fe80::f816:3eff:fe7f:3b3d/64 scope link 
       valid_lft forever preferred_lft forever


---> sar -b -r -n DEV:
Linux 4.18.0-547.el8.x86_64 (prd-centos8-robot-2c-8g-5479.novalocal) 	04/07/2024 	_x86_64_	(2 CPU)

12:00:01 AM       tps      rtps      wtps   bread/s   bwrtn/s
12:01:01 AM      1.05      0.00      1.05      0.00    199.67
12:02:01 AM      0.58      0.08      0.50      1.87     11.76
12:03:01 AM      0.17      0.00      0.17      0.00      2.02
12:04:01 AM      0.22      0.00      0.22      0.00      4.27
12:05:01 AM      0.35      0.00      0.35      0.00      7.75
12:06:01 AM      0.18      0.00      0.18      0.00      6.40
12:07:01 AM      0.12      0.00      0.12      0.00      0.78
12:08:01 AM      0.37      0.07      0.30      7.60     17.70
12:09:01 AM      0.33      0.00      0.33      0.00     10.21
12:10:01 AM      0.32      0.00      0.32      0.00     20.76
12:11:01 AM      0.27      0.00      0.27      0.00     14.01
12:12:01 AM      0.38      0.00      0.38      0.00     16.23
12:13:01 AM      0.17      0.00      0.17      0.00     15.45
12:14:01 AM      0.32      0.00      0.32      0.00     14.86
12:15:01 AM      0.37      0.00      0.37      0.00     18.19
12:16:01 AM      0.30      0.00      0.30      0.00     14.81
12:17:01 AM      0.37      0.00      0.37      0.00      3.67
12:18:01 AM      0.42      0.00      0.42      0.00      7.55
12:19:02 AM      0.37      0.00      0.37      0.00      4.03
12:20:01 AM      0.24      0.00      0.24      0.00      3.08
12:21:01 AM      0.27      0.00      0.27      0.00      5.98
12:22:01 AM      0.23      0.00      0.23      0.00      2.93
12:23:01 AM      0.12      0.00      0.12      0.00      6.40
12:24:01 AM      0.13      0.00      0.13      0.00      8.30
12:25:01 AM      0.30      0.00      0.30      0.00      3.90
12:26:01 AM      0.28      0.00      0.28      0.00      4.47
12:27:01 AM      0.15      0.00      0.15      0.00      8.31
12:28:01 AM      0.22      0.00      0.22      0.00      2.42
12:29:01 AM      0.12      0.00      0.12      0.00      2.65
12:30:01 AM      0.30      0.00      0.30      0.00      8.55
12:31:01 AM      0.23      0.00      0.23      0.00      9.25
12:32:01 AM      0.40      0.00      0.40      0.00     12.90
12:33:01 AM      0.40      0.00      0.40      0.00      5.22
12:34:01 AM      0.32      0.00      0.32      0.00      3.45
12:35:01 AM      0.32      0.00      0.32      0.00     11.53
12:36:01 AM      0.13      0.00      0.13      0.00      1.47
12:37:01 AM      0.15      0.00      0.15      0.00      1.08
12:38:01 AM      0.15      0.00      0.15      0.00      5.90
12:39:01 AM      0.20      0.00      0.20      0.00     16.45
12:40:01 AM      0.92      0.00      0.92      0.00     28.24
12:41:01 AM      0.38      0.00      0.38      0.00     14.41
12:42:01 AM      0.33      0.00      0.33      0.00     18.56
12:43:01 AM      0.17      0.00      0.17      0.00     15.86
12:44:01 AM      0.15      0.00      0.15      0.00     26.14
12:45:01 AM      0.42      0.00      0.42      0.00     10.38
12:46:01 AM      0.23      0.00      0.23      0.00      2.97
12:47:01 AM      1.08      0.30      0.78      6.40     19.23
12:48:01 AM      0.20      0.00      0.20      0.00      4.42
12:49:01 AM      0.10      0.00      0.10      0.00      0.63
12:50:01 AM      0.30      0.00      0.30      0.00      7.97
12:51:01 AM      0.30      0.00      0.30      0.00      3.48
12:52:01 AM      0.18      0.00      0.18      0.00      8.15
12:53:01 AM      0.13      0.00      0.13      0.00      7.87
12:54:01 AM      0.25      0.00      0.25      0.00      7.90
12:55:01 AM      0.32      0.00      0.32      0.00      5.47
12:56:01 AM      0.20      0.00      0.20      0.00      1.88
12:57:01 AM      0.17      0.00      0.17      0.00      5.10
12:58:01 AM      0.23      0.00      0.23      0.00      3.03
12:59:01 AM      0.18      0.00      0.18      0.00      3.67
01:00:01 AM      0.40      0.00      0.40      0.00     10.63
01:01:01 AM      0.28      0.03      0.25      0.27      4.78
01:02:01 AM      0.25      0.00      0.25      0.00      4.95
01:03:01 AM      0.22      0.00      0.22      0.00      8.83
01:04:01 AM      0.13      0.00      0.13      0.00      1.72
01:05:01 AM      0.27      0.00      0.27      0.00      6.08
01:06:01 AM      0.17      0.00      0.17      0.00      9.35
01:07:01 AM      0.30      0.00      0.30      0.00     16.95
01:08:01 AM      0.53      0.00      0.53      0.00     18.39
01:09:01 AM      0.68      0.00      0.68      0.00     20.13
01:10:01 AM      0.33      0.00      0.33      0.00     11.55
01:11:01 AM      0.20      0.00      0.20      0.00     13.10
01:12:01 AM      0.38      0.00      0.38      0.00     17.98
01:13:01 AM      0.20      0.00      0.20      0.00     23.75
01:14:01 AM      0.12      0.00      0.12      0.00      4.13
01:15:01 AM      0.25      0.00      0.25      0.00      4.72
01:16:01 AM      0.23      0.00      0.23      0.00      5.05
01:17:01 AM      0.17      0.00      0.17      0.00      2.25
01:18:01 AM      0.30      0.00      0.30      0.00      3.87
01:19:01 AM      0.28      0.00      0.28      0.00      5.95
01:20:01 AM      0.25      0.00      0.25      0.00      4.07
01:21:01 AM      0.17      0.00      0.17      0.00      8.83
01:22:01 AM      0.18      0.00      0.18      0.00      7.62
01:23:01 AM      0.22      0.00      0.22      0.00      2.93
01:24:01 AM      0.17      0.00      0.17      0.00      2.10
01:25:01 AM      0.42      0.00      0.42      0.00      9.07
01:26:01 AM      0.43      0.00      0.43      0.00      6.70
01:27:01 AM      0.45      0.00      0.45      0.00     11.46
01:28:02 AM      0.30      0.00      0.30      0.00      3.07
01:29:01 AM      0.39      0.00      0.39      0.00      5.68
01:30:01 AM      0.45      0.00      0.45      0.00      9.80
01:31:01 AM      0.32      0.00      0.32      0.00     11.66
01:32:01 AM      0.18      0.00      0.18      0.00     15.33
01:33:01 AM      0.13      0.00      0.13      0.00     15.46
01:34:01 AM      0.15      0.00      0.15      0.00     13.91
01:35:01 AM      0.20      0.00      0.20      0.00      9.18
01:36:01 AM      0.25      0.00      0.25      0.00     18.03
01:37:01 AM      0.28      0.00      0.28      0.00     24.65
01:38:01 AM      0.18      0.00      0.18      0.00      4.02
01:39:01 AM      0.12      0.00      0.12      0.00      1.20
01:40:01 AM      0.33      0.00      0.33      0.00      8.25
01:41:01 AM      0.23      0.00      0.23      0.00      2.20
01:42:01 AM      0.13      0.00      0.13      0.00      4.38
01:43:01 AM      0.15      0.00      0.15      0.00      1.62
01:44:01 AM      0.20      0.00      0.20      0.00      2.23
01:45:01 AM      0.57      0.00      0.57      0.00     15.20
01:46:01 AM      0.22      0.00      0.22      0.00      7.05
01:47:01 AM      0.13      0.00      0.13      0.00      1.70
01:48:01 AM      0.17      0.00      0.17      0.00      3.23
01:49:01 AM      0.15      0.00      0.15      0.00      3.63
01:50:01 AM      0.30      0.00      0.30      0.00      8.67
01:51:01 AM      0.27      0.00      0.27      0.00      4.97
01:52:01 AM      0.25      0.00      0.25      0.00      7.88
01:53:01 AM      0.12      0.00      0.12      0.00      1.17
01:54:01 AM      0.13      0.00      0.13      0.00     10.70
01:55:01 AM      0.32      0.00      0.32      0.00     12.11
01:56:01 AM      0.15      0.00      0.15      0.00     13.80
01:57:01 AM      0.43      0.00      0.43      0.00     20.30
01:58:01 AM      0.53      0.00      0.53      0.00     16.93
01:59:01 AM      0.47      0.00      0.47      0.00     15.71
02:00:01 AM      0.63      0.00      0.63      0.00     26.12
02:01:01 AM      0.50      0.00      0.50      0.00     15.96
02:02:01 AM      0.32      0.00      0.32      0.00      3.45
02:03:01 AM      0.38      0.00      0.38      0.00      6.38
02:04:01 AM      0.28      0.00      0.28      0.00      2.93
02:05:01 AM      0.65      0.00      0.65      0.00      9.03
02:06:01 AM      0.23      0.00      0.23      0.00      5.33
02:07:01 AM      0.12      0.00      0.12      0.00      0.90
02:08:01 AM      0.12      0.00      0.12      0.00      6.53
02:09:01 AM      0.13      0.00      0.13      0.00      7.35
02:10:01 AM      0.28      0.00      0.28      0.00      5.00
02:11:01 AM      0.22      0.00      0.22      0.00      2.18
02:12:01 AM      0.88      0.00      0.88      0.00     15.08
02:13:01 AM      0.32      0.00      0.32      0.00      5.25
02:14:01 AM      0.23      0.00      0.23      0.00      9.07
02:15:01 AM      0.25      0.00      0.25      0.00      4.10
02:16:01 AM      0.20      0.00      0.20      0.00      6.45
02:17:01 AM      0.22      0.00      0.22      0.00      9.43
02:18:01 AM      0.23      0.00      0.23      0.00     15.84
02:19:01 AM      0.18      0.00      0.18      0.00     14.55
02:20:01 AM      0.30      0.00      0.30      0.00     17.33
02:21:01 AM      0.52      0.00      0.52      0.00     16.93
02:22:01 AM      0.53      0.00      0.53      0.00     16.80
02:23:01 AM      0.48      0.00      0.48      0.00     25.73
02:24:01 AM      0.37      0.00      0.37      0.00      6.77
02:25:01 AM      0.53      0.00      0.53      0.00      7.11
02:26:01 AM      0.35      0.00      0.35      0.00      5.85
02:27:01 AM      0.47      0.00      0.47      0.00      6.00
02:28:01 AM      0.35      0.00      0.35      0.00      6.18
02:29:01 AM      0.35      0.00      0.35      0.00      3.83
02:30:01 AM      0.43      0.00      0.43      0.00      9.02
02:31:01 AM      0.48      0.00      0.48      0.00      8.98
02:32:01 AM      0.50      0.00      0.50      0.00     12.08
02:33:01 AM      0.53      0.00      0.53      0.00     18.15
02:34:01 AM      0.43      0.00      0.43      0.00     13.61
02:35:01 AM      0.30      0.00      0.30      0.00     17.43
02:36:01 AM      0.13      0.00      0.13      0.00     14.06
02:37:01 AM      0.19      0.00      0.19      0.00     10.23
02:38:01 AM      0.17      0.00      0.17      0.00     15.18
02:39:01 AM      0.12      0.00      0.12      0.00     19.08
02:40:01 AM      0.23      0.00      0.23      0.00      6.45
02:41:01 AM      0.43      0.00      0.43      0.00      7.58
02:42:01 AM      0.23      0.00      0.23      0.00      6.03
02:43:01 AM      0.32      0.00      0.32      0.00      3.57
02:44:01 AM      0.28      0.00      0.28      0.00      5.56
02:45:01 AM      0.25      0.00      0.25      0.00      3.45
02:46:01 AM      0.20      0.00      0.20      0.00      2.53
02:47:01 AM      0.13      0.00      0.13      0.00      8.45
02:48:01 AM      0.22      0.00      0.22      0.00     10.96
02:49:01 AM      0.23      0.00      0.23      0.00      8.81
02:50:01 AM      0.22      0.00      0.22      0.00     16.46
02:51:01 AM      0.28      0.00      0.28      0.00     17.40
02:52:01 AM      0.15      0.00      0.15      0.00      9.07
02:53:01 AM      0.15      0.00      0.15      0.00     17.06
02:54:01 AM      0.13      0.00      0.13      0.00     12.93
02:55:01 AM      0.35      0.00      0.35      0.00     24.23
02:56:01 AM      0.45      0.00      0.45      0.00      6.60
02:57:01 AM      0.30      0.00      0.30      0.00      3.02
02:58:01 AM      0.45      0.00      0.45      0.00      7.01
02:59:01 AM      0.35      0.00      0.35      0.00      4.12
03:00:01 AM      0.45      0.00      0.45      0.00      8.61
03:01:01 AM      0.43      0.00      0.43      0.00      5.61
03:02:01 AM      0.45      0.00      0.45      0.00     11.15
03:03:01 AM      0.33      0.00      0.33      0.00      6.95
03:04:01 AM      0.18      0.00      0.18      0.00      7.62
03:05:01 AM      0.28      0.00      0.28      0.00     18.65
03:06:01 AM      0.17      0.00      0.17      0.00     10.31
03:07:01 AM      0.20      0.00      0.20      0.00     14.81
03:08:01 AM      0.13      0.00      0.13      0.00     14.68
03:09:01 AM      0.15      0.00      0.15      0.00      7.23
03:10:01 AM      0.47      0.00      0.47      0.00     21.50
03:11:01 AM      0.28      0.00      0.28      0.00     21.66
03:12:01 AM      0.35      0.00      0.35      0.00      4.75
03:13:01 AM      0.30      0.00      0.30      0.00      5.70
03:14:01 AM      0.33      0.00      0.33      0.00      3.73
03:15:01 AM      0.47      0.00      0.47      0.00      6.26
03:16:01 AM      0.35      0.00      0.35      0.00      6.13
03:17:01 AM      0.42      0.00      0.42      0.00      4.87
03:18:01 AM      0.40      0.00      0.40      0.00     10.55
03:19:01 AM      0.23      0.00      0.23      0.00     18.91
03:20:01 AM      0.32      0.00      0.32      0.00     20.50
03:21:01 AM      0.25      0.00      0.25      0.00     19.23
03:22:01 AM      0.13      0.00      0.13      0.00     16.66
03:23:01 AM      0.13      0.00      0.13      0.00     14.80
03:24:01 AM      0.30      0.00      0.30      0.00     30.11
03:25:01 AM      0.35      0.00      0.35      0.00     10.65
03:26:01 AM     14.83      0.22     14.61     31.99   2674.88
03:27:01 AM     16.40      0.22     16.18     20.66    777.54
Average:         0.44      0.00      0.44      0.33     27.19

12:00:01 AM kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty
12:01:01 AM   4802500   7019780   3079928     39.07      2688   2386656    714764      8.00    354400   2349336        16
12:02:01 AM   4802220   7019708   3080208     39.08      2688   2386864    714764      8.00    354556   2349432         4
12:03:01 AM   4802268   7019756   3080160     39.08      2688   2386864    714764      8.00    354556   2349432         4
12:04:01 AM   4801664   7019244   3080764     39.08      2688   2386956    730372      8.18    354556   2349724        56
12:05:01 AM   4802240   7019976   3080188     39.08      2688   2387112    730372      8.18    354556   2349424       152
12:06:01 AM   4802356   7020092   3080072     39.08      2688   2387112    730372      8.18    354556   2349356         8
12:07:01 AM   4801512   7019304   3080916     39.09      2688   2387168    722016      8.08    354556   2350188        76
12:08:01 AM   4801396   7019776   3081032     39.09      2688   2387756    723700      8.10    354648   2350100        16
12:09:01 AM   4801216   7019928   3081212     39.09      2688   2388096    723700      8.10    354648   2350440       200
12:10:01 AM   4800288   7019344   3082140     39.10      2688   2388432    723700      8.10    354648   2351028        48
12:11:01 AM   4800396   7019812   3082032     39.10      2688   2388796    723700      8.10    354648   2351144        48
12:12:01 AM   4800264   7020040   3082164     39.10      2688   2389156    723700      8.10    354648   2351504        80
12:13:01 AM   4799824   7019964   3082604     39.11      2688   2389512    723700      8.10    354648   2351868        32
12:14:01 AM   4799304   7019784   3083124     39.11      2688   2389852    723700      8.10    354648   2352328        24
12:15:01 AM   4798580   7019688   3083848     39.12      2688   2390488    723700      8.10    354648   2352828       232
12:16:01 AM   4798400   7019604   3084028     39.13      2688   2390576    723700      8.10    354648   2353252         4
12:17:01 AM   4798800   7020004   3083628     39.12      2688   2390576    723700      8.10    354648   2352864         4
12:18:01 AM   4798664   7019948   3083764     39.12      2688   2390656    723700      8.10    354648   2352944         4
12:19:02 AM   4798728   7020016   3083700     39.12      2688   2390660    723700      8.10    354648   2352948         4
12:20:01 AM   4798028   7019396   3084400     39.13      2688   2390740    729088      8.16    354648   2353444        92
12:21:01 AM   4798320   7019696   3084108     39.13      2688   2390744    729088      8.16    354648   2353208         8
12:22:01 AM   4798260   7019660   3084168     39.13      2688   2390768    729088      8.16    354648   2353348        32
12:23:01 AM   4798164   7019764   3084264     39.13      2688   2390968    729088      8.16    354648   2353428        64
12:24:01 AM   4798220   7019984   3084208     39.13      2688   2391132    729088      8.16    354656   2353408         4
12:25:01 AM   4797980   7019744   3084448     39.13      2688   2391132    729088      8.16    354656   2353476        16
12:26:01 AM   4798016   7019820   3084412     39.13      2688   2391172    729088      8.16    354656   2353584        60
12:27:01 AM   4797556   7019520   3084872     39.14      2688   2391332    729088      8.16    354664   2353804         4
12:28:01 AM   4797796   7019760   3084632     39.13      2688   2391332    729088      8.16    354664   2353600         4
12:29:01 AM   4797988   7020008   3084440     39.13      2688   2391388    729088      8.16    354664   2353656         4
12:30:01 AM   4797348   7019552   3085080     39.14      2688   2391572    713792      7.99    354664   2354140        96
12:31:01 AM   4797428   7019744   3085000     39.14      2688   2391688    713792      7.99    354664   2354160        20
12:32:01 AM   4797008   7019572   3085420     39.14      2688   2391936    713792      7.99    354664   2354532         4
12:33:01 AM   4796828   7019396   3085600     39.15      2688   2391940    729172      8.16    354664   2354616         4
12:34:01 AM   4797036   7019640   3085392     39.14      2688   2391976    729172      8.16    354664   2354388        44
12:35:01 AM   4796868   7019624   3085560     39.14      2688   2392128    729172      8.16    354672   2354672         8
12:36:01 AM   4797004   7019764   3085424     39.14      2688   2392132    729172      8.16    354672   2354540         8
12:37:01 AM   4796948   7019844   3085480     39.14      2688   2392268    729172      8.16    354672   2354668       144
12:38:01 AM   4796696   7019808   3085732     39.15      2688   2392484    729172      8.16    354672   2354916       216
12:39:01 AM   4796480   7019944   3085948     39.15      2688   2392844    729172      8.16    354672   2355316       136
12:40:01 AM   4795272   7019096   3087156     39.17      2688   2393208    722016      8.08    364388   2346504        56
12:41:01 AM   4794768   7018956   3087660     39.17      2688   2393564    722016      8.08    364388   2347020       184
12:42:01 AM   4794868   7019404   3087560     39.17      2688   2393912    722016      8.08    364388   2347112       124
12:43:01 AM   4794540   7019420   3087888     39.17      2688   2394264    722016      8.08    364388   2347224        40
12:44:01 AM   4794076   7019680   3088352     39.18      2688   2394980    722016      8.08    364388   2347832        80
12:45:01 AM   4793556   7019264   3088872     39.19      2688   2395084    722016      8.08    364388   2348228         4
12:46:01 AM   4793832   7019540   3088596     39.18      2688   2395084    722016      8.08    364388   2347956         4
12:47:01 AM   4793364   7019348   3089064     39.19      2688   2395360    722016      8.08    364484   2348384        84
12:48:01 AM   4793672   7019656   3088756     39.19      2688   2395360    722016      8.08    364484   2348180         4
12:49:01 AM   4793476   7019468   3088952     39.19      2688   2395368    722016      8.08    364484   2348300        16
12:50:01 AM   4792988   7019056   3089440     39.19      2688   2395444    738128      8.26    364484   2348680         4
12:51:01 AM   4793224   7019292   3089204     39.19      2688   2395444    738128      8.26    364484   2348440         8
12:52:01 AM   4793168   7019420   3089260     39.19      2688   2395628    738128      8.26    364484   2348564        24
12:53:01 AM   4792920   7019364   3089508     39.19      2688   2395820    738128      8.26    364484   2348640         4
12:54:01 AM   4792552   7019156   3089876     39.20      2688   2395980    738128      8.26    364484   2348924         4
12:55:01 AM   4792764   7019372   3089664     39.20      2688   2395984    738128      8.26    364484   2348844         4
12:56:01 AM   4792952   7019616   3089476     39.19      2688   2396040    738128      8.26    364484   2348976        64
12:57:01 AM   4792180   7018892   3090248     39.20      2688   2396088    738128      8.26    364484   2349252         4
12:58:01 AM   4792696   7019412   3089732     39.20      2688   2396092    738128      8.26    364484   2348916         4
12:59:01 AM   4792688   7019604   3089740     39.20      2688   2396292    738128      8.26    364484   2349128       148
01:00:01 AM   4791280   7018196   3091148     39.22      2688   2396292    737456      8.26    364484   2350124         4
01:01:01 AM   4791504   7018432   3090924     39.21      2688   2396304    737456      8.26    364488   2350056         8
01:02:01 AM   4792424   7019448   3090004     39.20      2688   2396400    737456      8.26    364504   2349224        48
01:03:01 AM   4792244   7019432   3090184     39.20      2688   2396564    737456      8.26    364504   2349404         8
01:04:01 AM   4791824   7019012   3090604     39.21      2688   2396564    737456      8.26    364504   2349748         4
01:05:01 AM   4791976   7019228   3090452     39.21      2688   2396628    737456      8.26    364504   2349524        12
01:06:01 AM   4791504   7018992   3090924     39.21      2688   2396864    721780      8.08    364504   2349960        16
01:07:01 AM   4791456   7019356   3090972     39.21      2688   2397276    722956      8.09    364532   2350228        60
01:08:01 AM   4790900   7019148   3091528     39.22      2688   2397632    722956      8.09    364532   2350756        24
01:09:01 AM   4790664   7019280   3091764     39.22      2688   2397992    722956      8.09    364532   2351120         4
01:10:01 AM   4789724   7018680   3092704     39.24      2688   2398332    743048      8.32    364532   2351856       148
01:11:01 AM   4790064   7019372   3092364     39.23      2688   2398688    723592      8.10    364532   2351584       156
01:12:01 AM   4789772   7019444   3092656     39.23      2688   2399044    723592      8.10    364532   2351980       104
01:13:01 AM   4789104   7019344   3093324     39.24      2688   2399612    723592      8.10    364532   2352652        24
01:14:01 AM   4788564   7018876   3093864     39.25      2688   2399684    723592      8.10    364532   2353024         4
01:15:01 AM   4788996   7019312   3093432     39.24      2688   2399688    723592      8.10    364532   2352804         4
01:16:01 AM   4788948   7019340   3093480     39.25      2688   2399764    723592      8.10    364532   2352696         4
01:17:01 AM   4788956   7019348   3093472     39.25      2688   2399764    723592      8.10    364532   2352696         8
01:18:01 AM   4788864   7019340   3093564     39.25      2688   2399848    723592      8.10    364532   2352788        88
01:19:01 AM   4788896   7019372   3093532     39.25      2688   2399848    723592      8.10    364532   2352788         4
01:20:01 AM   4788308   7018924   3094120     39.25      2688   2399984    728968      8.16    364532   2353340       144
01:21:01 AM   4788544   7019240   3093884     39.25      2688   2400064    728968      8.16    364532   2353196         8
01:22:01 AM   4788176   7019024   3094252     39.26      2688   2400216    712536      7.98    364540   2353340         4
01:23:01 AM   4788196   7019048   3094232     39.25      2688   2400220    712536      7.98    364540   2353412        12
01:24:01 AM   4788096   7019004   3094332     39.26      2688   2400276    712536      7.98    364540   2353608        72
01:25:01 AM   4788008   7019012   3094420     39.26      2688   2400372    728380      8.16    364540   2353580         4
01:26:01 AM   4788464   7019536   3093964     39.25      2688   2400440    728380      8.16    364536   2353252        12
01:27:01 AM   4788568   7019824   3093860     39.25      2688   2400624    728380      8.16    364540   2353296         4
01:28:02 AM   4788448   7019704   3093980     39.25      2688   2400624    728380      8.16    364540   2353296         4
01:29:01 AM   4788268   7019632   3094160     39.25      2688   2400732    712956      7.98    364540   2353400        56
01:30:01 AM   4787520   7019044   3094908     39.26      2688   2400892    731140      8.19    364540   2354104        56
01:31:01 AM   4787660   7019544   3094768     39.26      2688   2401252    731140      8.19    364540   2354124       208
01:32:01 AM   4787324   7019560   3095104     39.27      2688   2401612    731140      8.19    364540   2354612       176
01:33:01 AM   4786796   7019384   3095632     39.27      2688   2401964    731140      8.19    364540   2355032       104
01:34:01 AM   4786480   7019432   3095948     39.28      2688   2402320    715592      8.01    364540   2355136        84
01:35:01 AM   4786268   7019572   3096160     39.28      2688   2402672    715592      8.01    364540   2355596       216
01:36:01 AM   4785976   7019616   3096452     39.28      2688   2403016    715592      8.01    364540   2355864       108
01:37:01 AM   4785588   7019800   3096840     39.29      2688   2403580    715592      8.01    364540   2356328        16
01:38:01 AM   4785492   7019764   3096936     39.29      2688   2403640    715592      8.01    364540   2356392         4
01:39:01 AM   4785760   7020032   3096668     39.29      2688   2403640    715592      8.01    364540   2356392         4
01:40:01 AM   4784872   7019228   3097556     39.30      2688   2403724    713488      7.99    364540   2356892         4
01:41:01 AM   4785244   7019600   3097184     39.29      2688   2403724    713488      7.99    364540   2356644         8
01:42:01 AM   4785052   7019488   3097376     39.29      2688   2403804    713488      7.99    364540   2356724         4
01:43:01 AM   4784972   7019412   3097456     39.30      2688   2403808    713488      7.99    364540   2356728         4
01:44:01 AM   4786984   7021588   3095444     39.27      2688   2403972    713488      7.99    364540   2354680       172
01:45:01 AM   4784848   7019516   3097580     39.30      2688   2404036    713488      7.99    364540   2356976         4
01:46:01 AM   4784408   7019216   3098020     39.30      2688   2404176    713488      7.99    364540   2357548         4
01:47:01 AM   4783748   7018556   3098680     39.31      2688   2404176    713488      7.99    364540   2357972         4
01:48:01 AM   4783616   7018480   3098812     39.31      2688   2404248    713488      7.99    364540   2358044        24
01:49:01 AM   4783656   7018636   3098772     39.31      2688   2404348    713488      7.99    364548   2358152        48
01:50:01 AM   4782964   7018016   3099464     39.32      2688   2404420    713516      7.99    364548   2358640         4
01:51:01 AM   4783012   7018260   3099416     39.32      2688   2404616    713516      7.99    364548   2358716       140
01:52:01 AM   4782860   7018108   3099568     39.32      2688   2404616    713516      7.99    364548   2358716         4
01:53:01 AM   4785260   7020636   3097168     39.29      2688   2404744    713516      7.99    364548   2356616       136
01:54:01 AM   4782840   7018412   3099588     39.32      2688   2404940    715204      8.01    364548   2358852        40
01:55:01 AM   4782352   7018284   3100076     39.33      2688   2405300    715204      8.01    364548   2359164       192
01:56:01 AM   4782340   7018620   3100088     39.33      2688   2405648    715204      8.01    364548   2359560       156
01:57:01 AM   4782120   7018756   3100308     39.33      2688   2406012    715204      8.01    364548   2359804        24
01:58:01 AM   4781700   7018696   3100728     39.34      2688   2406364    715204      8.01    364548   2360188        16
01:59:01 AM   4781292   7018632   3101136     39.34      2688   2406704    715204      8.01    364548   2360524        16
02:00:01 AM   4780072   7018044   3102356     39.36      2688   2407336    714640      8.00    364548   2361680        72
02:01:01 AM   4778924   7017116   3103504     39.37      2688   2407556    714640      8.00    364548   2362384         4
02:02:01 AM   4779776   7017972   3102652     39.36      2688   2407560    714640      8.00    364548   2361832         4
02:03:01 AM   4780016   7018292   3102412     39.36      2688   2407640    714640      8.00    364548   2361712         4
02:04:01 AM   4780244   7018520   3102184     39.36      2688   2407640    714640      8.00    364548   2361576         4
02:05:01 AM   4780060   7018348   3102368     39.36      2688   2407652    714640      8.00    364548   2361856         4
02:06:01 AM   4780144   7018500   3102284     39.36      2688   2407720    714640      8.00    364548   2361660        12
02:07:01 AM   4780372   7018728   3102056     39.35      2688   2407720    714640      8.00    364548   2361660         4
02:08:01 AM   4779900   7018444   3102528     39.36      2688   2407908    714640      8.00    364548   2361836        24
02:09:01 AM   4779552   7018276   3102876     39.36      2688   2408088    730024      8.17    364552   2362020         4
02:10:01 AM   4779052   7017776   3103376     39.37      2688   2408088    729212      8.16    364552   2362400         4
02:11:01 AM   4779304   7018072   3103124     39.37      2688   2408136    720320      8.07    364916   2361912       292
02:12:01 AM   4779252   7018052   3103176     39.37      2688   2408160    720320      8.07    364916   2362056        20
02:13:01 AM   4779696   7018540   3102732     39.36      2688   2408204    720320      8.07    364916   2361796        48
02:14:01 AM   4779164   7018144   3103264     39.37      2688   2408340    720320      8.07    364920   2362028         4
02:15:01 AM   4779076   7018060   3103352     39.37      2688   2408344    720320      8.07    364920   2362108         4
02:16:01 AM   4779280   7018412   3103148     39.37      2688   2408492    720320      8.07    364920   2362064         4
02:17:01 AM   4779132   7018616   3103296     39.37      2688   2408844    720320      8.07    364920   2362428       136
02:18:01 AM   4778480   7018304   3103948     39.38      2688   2409184    720320      8.07    364920   2362768        76
02:19:01 AM   4778328   7018508   3104100     39.38      2688   2409548    720320      8.07    364920   2363240        56
02:20:01 AM   4777188   7017728   3105240     39.39      2688   2409900    722820      8.09    364920   2363980        16
02:21:01 AM   4777292   7018188   3105136     39.39      2688   2410256    722820      8.09    364920   2364160        32
02:22:01 AM   4777180   7018416   3105248     39.39      2688   2410604    722820      8.09    364920   2364304        24
02:23:01 AM   4776616   7018480   3105812     39.40      2688   2411224    722820      8.09    364920   2364816         4
02:24:01 AM   4776452   7018400   3105976     39.40      2688   2411308    722820      8.09    364920   2365020         4
02:25:01 AM   4776312   7018264   3106116     39.41      2688   2411312    722820      8.09    364920   2365092         4
02:26:01 AM   4776460   7018492   3105968     39.40      2688   2411392    722820      8.09    364920   2364988         4
02:27:01 AM   4776452   7018488   3105976     39.40      2688   2411392    722820      8.09    364920   2364988         4
02:28:01 AM   4776232   7018348   3106196     39.41      2688   2411472    722820      8.09    364920   2365048         4
02:29:01 AM   4776152   7018268   3106276     39.41      2688   2411472    722820      8.09    364920   2365068         4
02:30:01 AM   4775716   7017944   3106712     39.41      2688   2411600    721104      8.07    364920   2365580        32
02:31:01 AM   4775628   7017964   3106800     39.41      2688   2411684    721104      8.07    364920   2365404         4
02:32:01 AM   4775528   7018096   3106900     39.42      2688   2411908    721104      8.07    364920   2365660        48
02:33:01 AM   4775040   7017976   3107388     39.42      2688   2412276    721104      8.07    364920   2366100        36
02:34:01 AM   4775032   7018328   3107396     39.42      2688   2412636    721104      8.07    364920   2366264       116
02:35:01 AM   4774272   7017920   3108156     39.43      2688   2412984    721104      8.07    364920   2366804        68
02:36:01 AM   4774276   7018272   3108152     39.43      2688   2413332    721104      8.07    364920   2366964        24
02:37:01 AM   4774060   7018400   3108368     39.43      2688   2413676    721104      8.07    364920   2367308       104
02:38:01 AM   4773488   7018176   3108940     39.44      2688   2414032    721104      8.07    364920   2367656        64
02:39:01 AM   4773268   7018496   3109160     39.44      2688   2414572    721104      8.07    364920   2368196        56
02:40:01 AM   4772488   7017792   3109940     39.45      2688   2414640    719208      8.05    364920   2368576        12
02:41:01 AM   4772944   7018252   3109484     39.45      2688   2414644    719208      8.05    364920   2368280         4
02:42:01 AM   4772732   7018120   3109696     39.45      2688   2414724    719208      8.05    364920   2368480         4
02:43:01 AM   4772812   7018200   3109616     39.45      2688   2414724    719208      8.05    364920   2368368         4
02:44:01 AM   4772576   7018044   3109852     39.45      2688   2414804    719208      8.05    364920   2368700        16
02:45:01 AM   4772560   7018028   3109868     39.45      2688   2414804    719208      8.05    364920   2368856         4
02:46:01 AM   4774644   7020232   3107784     39.43      2688   2414940    719208      8.05    364920   2366664       144
02:47:01 AM   4772008   7017784   3110420     39.46      2688   2415112    723724      8.10    364920   2369112       104
02:48:01 AM   4771848   7017816   3110580     39.46      2688   2415304    723724      8.10    364920   2369292        16
02:49:01 AM   4771952   7018260   3110476     39.46      2688   2415644    723724      8.10    364920   2369392       176
02:50:01 AM   4771268   7017932   3111160     39.47      2688   2416008    723300      8.10    364920   2369944       120
02:51:01 AM   4770828   7017836   3111600     39.48      2688   2416352    723300      8.10    364920   2370308        40
02:52:01 AM   4770656   7018024   3111772     39.48      2688   2416712    723300      8.10    364920   2370668       184
02:53:01 AM   4770360   7018088   3112068     39.48      2688   2417064    723300      8.10    364920   2371028        56
02:54:01 AM   4769884   7017984   3112544     39.49      2688   2417432    723300      8.10    364920   2371328        64
02:55:01 AM   4769424   7018032   3113004     39.49      2688   2417940    723300      8.10    364920   2371856         4
02:56:01 AM   4769372   7018012   3113056     39.49      2688   2417972    723300      8.10    364920   2371820         4
02:57:01 AM   4769428   7018068   3113000     39.49      2688   2417972    723300      8.10    364920   2371820         4
02:58:01 AM   4769328   7018052   3113100     39.49      2688   2418056    723300      8.10    364920   2372020         4
02:59:01 AM   4769136   7017864   3113292     39.50      2688   2418060    723300      8.10    364920   2372044         4
03:00:01 AM   4768788   7017592   3113640     39.50      2688   2418136    724572      8.11    364920   2372372         4
03:01:01 AM   4767956   7016768   3114472     39.51      2688   2418144    724572      8.11    364920   2373064         4
03:02:01 AM   4768432   7017404   3113996     39.51      2688   2418312    724572      8.11    364924   2372532         0
03:03:01 AM   4768544   7017692   3113884     39.50      2688   2418480    707836      7.93    364924   2372776        72
03:04:01 AM   4768492   7017852   3113936     39.50      2688   2418692    730512      8.18    364924   2372620        96
03:05:01 AM   4768152   7017868   3114276     39.51      2688   2419048    730512      8.18    364924   2373048        40
03:06:01 AM   4767792   7017860   3114636     39.51      2688   2419400    730512      8.18    364924   2373328       124
03:07:01 AM   4767688   7018116   3114740     39.51      2688   2419760    730512      8.18    364924   2373668        92
03:08:01 AM   4767076   7017848   3115352     39.52      2688   2420104    730512      8.18    364924   2374160        24
03:09:01 AM   4764956   7016080   3117472     39.55      2688   2420456    730512      8.18    364924   2376416       192
03:10:01 AM   4763648   7015488   3118780     39.57      2688   2421176    730512      8.18    364924   2377544       476
03:11:01 AM   4763912   7015864   3118516     39.56      2688   2421280    730512      8.18    364924   2377428         4
03:12:01 AM   4763792   7015748   3118636     39.56      2688   2421284    730512      8.18    364924   2377548         4
03:13:01 AM   4763836   7015872   3118592     39.56      2688   2421364    730512      8.18    364924   2377492         4
03:14:01 AM   4763796   7015832   3118632     39.56      2688   2421364    730512      8.18    364924   2377448         4
03:15:01 AM   4763832   7015872   3118596     39.56      2688   2421376    730512      8.18    364924   2377524         4
03:16:01 AM   4763908   7016024   3118520     39.56      2688   2421444    730512      8.18    364924   2377388         4
03:17:01 AM   4763944   7016060   3118484     39.56      2688   2421444    730512      8.18    364924   2377536         4
03:18:01 AM   4763484   7015788   3118944     39.57      2688   2421632    713872      7.99    364924   2377612         4
03:19:01 AM   4762140   7014924   3120288     39.59      2688   2422112    750636      8.40    364928   2378808         4
03:20:01 AM   4759292   7012556   3123136     39.62      2688   2422592    767936      8.60    364928   2381384         4
03:21:01 AM   4758224   7012308   3124204     39.64      2688   2423404    789652      8.84    364928   2382364       348
03:22:01 AM   4754968   7009532   3127460     39.68      2688   2423892    822684      9.21    364928   2385396       360
03:23:01 AM   4753868   7008924   3128560     39.69      2688   2424392    846232      9.48    364928   2386192       448
03:24:01 AM   4753324   7008876   3129104     39.70      2688   2424880    869468      9.74    364928   2386512       124
03:25:01 AM   4584548   6840516   3297880     41.84      2688   2425280   1052156     11.78    364928   2555048       368
03:26:01 AM   4815540   6961584   3066888     38.91      2688   2320424    702992      7.87    429468   2279340     13200
03:27:01 AM   4792416   6939808   3090012     39.20      2688   2322096    716756      8.03    586344   2149228        32
Average:      4782971   7017040   3099457     39.32      2688   2403480    727361      8.14    364187   2359219       117

12:00:01 AM     IFACE   rxpck/s   txpck/s    rxkB/s    txkB/s   rxcmp/s   txcmp/s  rxmcst/s   %ifutil
12:01:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:01:01 AM      eth0      4.60      4.12      0.79      0.34      0.00      0.00      0.00      0.00
12:02:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:02:01 AM      eth0      0.70      0.28      0.04      0.03      0.00      0.00      0.00      0.00
12:03:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:03:01 AM      eth0      1.25      0.00      0.12      0.00      0.00      0.00      0.00      0.00
12:04:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:04:01 AM      eth0      9.07      7.17      2.09      0.99      0.00      0.00      0.00      0.00
12:05:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:05:01 AM      eth0      1.20      0.72      0.22      0.16      0.00      0.00      0.00      0.00
12:06:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:06:01 AM      eth0      4.88      0.00      0.50      0.00      0.00      0.00      0.00      0.00
12:07:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:07:01 AM      eth0      7.63      4.22      1.12      0.48      0.00      0.00      0.00      0.00
12:08:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:08:01 AM      eth0      8.50      8.40      1.41      0.89      0.00      0.00      0.00      0.00
12:09:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:09:01 AM      eth0      9.35      9.38      1.93      1.74      0.00      0.00      0.00      0.00
12:10:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:10:01 AM      eth0      9.48      9.51      2.05      1.83      0.00      0.00      0.00      0.00
12:11:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:11:01 AM      eth0      9.75      9.65      2.07      1.78      0.00      0.00      0.00      0.00
12:12:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:12:01 AM      eth0      9.60      9.63      2.03      1.81      0.00      0.00      0.00      0.00
12:13:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:13:01 AM      eth0     12.83      9.68      2.25      1.81      0.00      0.00      0.00      0.00
12:14:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:14:01 AM      eth0      9.95      9.58      2.03      1.80      0.00      0.00      0.00      0.00
12:15:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:15:01 AM      eth0     19.68     15.36      3.85      2.87      0.00      0.00      0.00      0.00
12:16:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:16:01 AM      eth0      2.67      0.53      0.47      0.24      0.00      0.00      0.00      0.00
12:17:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:17:01 AM      eth0      0.37      0.05      0.04      0.00      0.00      0.00      0.00      0.00
12:18:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:18:01 AM      eth0      0.60      0.30      0.08      0.04      0.00      0.00      0.00      0.00
12:19:02 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:19:02 AM      eth0      0.25      0.05      0.01      0.00      0.00      0.00      0.00      0.00
12:20:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:20:01 AM      eth0      0.58      0.44      0.15      0.11      0.00      0.00      0.00      0.00
12:21:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:21:01 AM      eth0      0.42      0.07      0.08      0.00      0.00      0.00      0.00      0.00
12:22:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:22:01 AM      eth0      0.88      0.55      0.19      0.10      0.00      0.00      0.00      0.00
12:23:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:23:01 AM      eth0     10.55     10.53      1.99      1.11      0.00      0.00      0.00      0.00
12:24:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:24:01 AM      eth0      0.72      0.55      0.08      0.11      0.00      0.00      0.00      0.00
12:25:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:25:01 AM      eth0      0.88      0.27      0.16      0.07      0.00      0.00      0.00      0.00
12:26:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:26:01 AM      eth0      3.75      3.08      0.69      0.29      0.00      0.00      0.00      0.00
12:27:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:27:01 AM      eth0      0.92      0.62      0.32      0.29      0.00      0.00      0.00      0.00
12:28:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:28:01 AM      eth0      0.23      0.05      0.01      0.00      0.00      0.00      0.00      0.00
12:29:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:29:01 AM      eth0      2.97      2.78      0.56      0.24      0.00      0.00      0.00      0.00
12:30:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:30:01 AM      eth0      6.86      6.66      1.34      0.59      0.00      0.00      0.00      0.00
12:31:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:31:01 AM      eth0      4.80      4.42      0.84      0.40      0.00      0.00      0.00      0.00
12:32:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:32:01 AM      eth0      5.50      4.90      0.87      0.48      0.00      0.00      0.00      0.00
12:33:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:33:01 AM      eth0      0.30      0.18      0.25      0.19      0.00      0.00      0.00      0.00
12:34:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:34:01 AM      eth0      3.83      2.77      0.77      0.26      0.00      0.00      0.00      0.00
12:35:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:35:01 AM      eth0      1.27      0.92      0.40      0.37      0.00      0.00      0.00      0.00
12:36:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:36:01 AM      eth0      0.25      0.00      0.01      0.00      0.00      0.00      0.00      0.00
12:37:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:37:01 AM      eth0      8.31      8.36      1.36      0.84      0.00      0.00      0.00      0.00
12:38:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:38:01 AM      eth0      6.38      6.25      1.31      1.16      0.00      0.00      0.00      0.00
12:39:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:39:01 AM      eth0      9.33      9.47      1.98      1.78      0.00      0.00      0.00      0.00
12:40:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:40:01 AM      eth0      9.55      9.63      2.07      1.83      0.00      0.00      0.00      0.00
12:41:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:41:01 AM      eth0     10.30      9.85      2.33      2.00      0.00      0.00      0.00      0.00
12:42:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:42:01 AM      eth0     10.18      9.78      2.18      1.88      0.00      0.00      0.00      0.00
12:43:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:43:01 AM      eth0     10.06      9.77      2.34      1.99      0.00      0.00      0.00      0.00
12:44:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:44:01 AM      eth0     18.83     18.29      4.25      3.37      0.00      0.00      0.00      0.00
12:45:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:45:01 AM      eth0      1.10      0.73      0.42      0.32      0.00      0.00      0.00      0.00
12:46:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:46:01 AM      eth0      0.23      0.00      0.01      0.00      0.00      0.00      0.00      0.00
12:47:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:47:01 AM      eth0      0.68      0.50      0.32      0.24      0.00      0.00      0.00      0.00
12:48:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:48:01 AM      eth0      0.18      0.05      0.01      0.00      0.00      0.00      0.00      0.00
12:49:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:49:01 AM      eth0      0.32      0.05      0.01      0.00      0.00      0.00      0.00      0.00
12:50:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:50:01 AM      eth0      1.22      0.43      0.38      0.11      0.00      0.00      0.00      0.00
12:51:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:51:01 AM      eth0      0.47      0.00      0.04      0.00      0.00      0.00      0.00      0.00
12:52:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:52:01 AM      eth0      8.68      8.62      1.64      1.04      0.00      0.00      0.00      0.00
12:53:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:53:01 AM      eth0      6.55      5.33      1.29      0.44      0.00      0.00      0.00      0.00
12:54:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:54:01 AM      eth0      0.68      0.53      0.08      0.10      0.00      0.00      0.00      0.00
12:55:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:55:01 AM      eth0      0.47      0.18      0.09      0.07      0.00      0.00      0.00      0.00
12:56:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:56:01 AM      eth0      4.05      3.68      0.61      0.26      0.00      0.00      0.00      0.00
12:57:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:57:01 AM      eth0      1.10      0.60      0.35      0.27      0.00      0.00      0.00      0.00
12:58:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:58:01 AM      eth0      0.32      0.00      0.01      0.00      0.00      0.00      0.00      0.00
12:59:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:59:01 AM      eth0      4.20      4.13      0.68      0.36      0.00      0.00      0.00      0.00
01:00:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:00:01 AM      eth0      0.45      0.17      0.09      0.07      0.00      0.00      0.00      0.00
01:01:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:01:01 AM      eth0      0.13      0.00      0.01      0.00      0.00      0.00      0.00      0.00
01:02:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:02:01 AM      eth0      7.88      7.73      1.28      0.59      0.00      0.00      0.00      0.00
01:03:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:03:01 AM      eth0      0.62      0.50      0.07      0.10      0.00      0.00      0.00      0.00
01:04:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:04:01 AM      eth0      1.08      0.42      0.46      0.21      0.00      0.00      0.00      0.00
01:05:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:05:01 AM      eth0      5.17      4.37      0.91      0.41      0.00      0.00      0.00      0.00
01:06:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:06:01 AM      eth0      9.31      8.95      1.71      1.12      0.00      0.00      0.00      0.00
01:07:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:07:01 AM      eth0     11.33     11.15      2.43      2.11      0.00      0.00      0.00      0.00
01:08:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:08:01 AM      eth0     12.75      9.86      2.73      2.06      0.00      0.00      0.00      0.00
01:09:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:09:01 AM      eth0     14.00     10.28      3.43      2.57      0.00      0.00      0.00      0.00
01:10:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:10:01 AM      eth0      9.95      9.68      2.54      2.21      0.00      0.00      0.00      0.00
01:11:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:11:01 AM      eth0     11.15      9.73      2.24      1.81      0.00      0.00      0.00      0.00
01:12:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:12:01 AM      eth0     16.38      9.48      2.89      1.79      0.00      0.00      0.00      0.00
01:13:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:13:01 AM      eth0     14.93     13.75      3.26      2.48      0.00      0.00      0.00      0.00
01:14:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:14:01 AM      eth0      1.22      0.45      0.35      0.23      0.00      0.00      0.00      0.00
01:15:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:15:01 AM      eth0      0.47      0.10      0.09      0.06      0.00      0.00      0.00      0.00
01:16:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:16:01 AM      eth0      1.23      0.27      0.14      0.04      0.00      0.00      0.00      0.00
01:17:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:17:01 AM      eth0      1.98      0.03      0.18      0.00      0.00      0.00      0.00      0.00
01:18:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:18:01 AM      eth0      1.47      0.32      0.15      0.04      0.00      0.00      0.00      0.00
01:19:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:19:01 AM      eth0      0.58      0.03      0.09      0.00      0.00      0.00      0.00      0.00
01:20:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:20:01 AM      eth0      3.97      3.60      0.88      0.72      0.00      0.00      0.00      0.00
01:21:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:21:01 AM      eth0      7.56      7.33      1.36      0.54      0.00      0.00      0.00      0.00
01:22:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:22:01 AM      eth0      0.78      0.60      0.08      0.10      0.00      0.00      0.00      0.00
01:23:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:23:01 AM      eth0      1.45      0.35      0.30      0.08      0.00      0.00      0.00      0.00
01:24:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:24:01 AM      eth0      7.45      3.45      1.82      0.90      0.00      0.00      0.00      0.00
01:25:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:25:01 AM      eth0      4.80      4.37      1.32      0.61      0.00      0.00      0.00      0.00
01:26:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:26:01 AM      eth0      4.35      4.07      0.65      0.32      0.00      0.00      0.00      0.00
01:27:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:27:01 AM      eth0      6.63      5.30      0.94      0.49      0.00      0.00      0.00      0.00
01:28:02 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:28:02 AM      eth0      6.08      0.00      0.79      0.00      0.00      0.00      0.00      0.00
01:29:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:29:01 AM      eth0      3.30      2.41      0.63      0.45      0.00      0.00      0.00      0.00
01:30:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:30:01 AM      eth0      8.91      8.55      1.59      1.02      0.00      0.00      0.00      0.00
01:31:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:31:01 AM      eth0     10.26      9.98      2.18      1.85      0.00      0.00      0.00      0.00
01:32:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:32:01 AM      eth0     10.81      9.80      2.21      1.88      0.00      0.00      0.00      0.00
01:33:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:33:01 AM      eth0     10.18      9.70      2.29      1.98      0.00      0.00      0.00      0.00
01:34:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:34:01 AM      eth0     11.25      9.65      2.35      1.83      0.00      0.00      0.00      0.00
01:35:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:35:01 AM      eth0     10.65     10.18      2.65      2.26      0.00      0.00      0.00      0.00
01:36:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:36:01 AM      eth0      9.42      9.52      2.01      1.79      0.00      0.00      0.00      0.00
01:37:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:37:01 AM      eth0     15.38     12.41      3.19      2.23      0.00      0.00      0.00      0.00
01:38:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:38:01 AM      eth0      0.48      0.15      0.05      0.02      0.00      0.00      0.00      0.00
01:39:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:39:01 AM      eth0      0.27      0.00      0.02      0.00      0.00      0.00      0.00      0.00
01:40:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:40:01 AM      eth0      0.85      0.45      0.16      0.11      0.00      0.00      0.00      0.00
01:41:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:41:01 AM      eth0      0.57      0.00      0.05      0.00      0.00      0.00      0.00      0.00
01:42:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:42:01 AM      eth0      0.60      0.33      0.09      0.05      0.00      0.00      0.00      0.00
01:43:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:43:01 AM      eth0      0.28      0.00      0.01      0.00      0.00      0.00      0.00      0.00
01:44:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:44:01 AM      eth0      6.83      6.41      1.50      0.86      0.00      0.00      0.00      0.00
01:45:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:45:01 AM      eth0      3.70      3.37      0.69      0.33      0.00      0.00      0.00      0.00
01:46:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:46:01 AM      eth0      0.75      0.60      0.08      0.10      0.00      0.00      0.00      0.00
01:47:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:47:01 AM      eth0      0.53      0.33      0.26      0.20      0.00      0.00      0.00      0.00
01:48:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:48:01 AM      eth0      4.02      3.98      0.95      0.35      0.00      0.00      0.00      0.00
01:49:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:49:01 AM      eth0      4.60      4.48      0.67      0.35      0.00      0.00      0.00      0.00
01:50:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:50:01 AM      eth0      3.77      3.63      0.68      0.40      0.00      0.00      0.00      0.00
01:51:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:51:01 AM      eth0      5.05      4.93      0.72      0.40      0.00      0.00      0.00      0.00
01:52:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:52:01 AM      eth0      0.38      0.05      0.06      0.00      0.00      0.00      0.00      0.00
01:53:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:53:01 AM      eth0      7.87      7.60      1.56      0.79      0.00      0.00      0.00      0.00
01:54:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:54:01 AM      eth0      6.37      5.50      1.18      1.02      0.00      0.00      0.00      0.00
01:55:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:55:01 AM      eth0      9.36      9.56      2.05      1.85      0.00      0.00      0.00      0.00
01:56:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:56:01 AM      eth0      9.23      9.55      1.98      1.76      0.00      0.00      0.00      0.00
01:57:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:57:01 AM      eth0      9.47      9.73      2.02      1.81      0.00      0.00      0.00      0.00
01:58:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:58:01 AM      eth0      9.43      9.68      2.02      1.81      0.00      0.00      0.00      0.00
01:59:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:59:01 AM      eth0      9.55      9.58      2.06      1.80      0.00      0.00      0.00      0.00
02:00:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:00:01 AM      eth0     16.54     16.36      3.78      3.07      0.00      0.00      0.00      0.00
02:01:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:01:01 AM      eth0      3.15      3.05      0.62      0.55      0.00      0.00      0.00      0.00
02:02:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:02:01 AM      eth0      0.83      0.08      0.15      0.07      0.00      0.00      0.00      0.00
02:03:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:03:01 AM      eth0      0.68      0.55      0.32      0.24      0.00      0.00      0.00      0.00
02:04:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:04:01 AM      eth0      0.52      0.00      0.05      0.00      0.00      0.00      0.00      0.00
02:05:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:05:01 AM      eth0      0.62      0.37      0.34      0.27      0.00      0.00      0.00      0.00
02:06:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:01 AM      eth0      0.35      0.27      0.07      0.04      0.00      0.00      0.00      0.00
02:07:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:07:01 AM      eth0      0.20      0.00      0.01      0.00      0.00      0.00      0.00      0.00
02:08:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:08:01 AM      eth0      7.48      7.52      1.53      0.97      0.00      0.00      0.00      0.00
02:09:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:09:01 AM      eth0      2.73      2.73      0.52      0.25      0.00      0.00      0.00      0.00
02:10:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:10:01 AM      eth0      0.33      0.12      0.08      0.06      0.00      0.00      0.00      0.00
02:11:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:11:01 AM      eth0      3.22      2.72      0.50      0.19      0.00      0.00      0.00      0.00
02:12:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:12:01 AM      eth0      0.78      0.48      0.31      0.25      0.00      0.00      0.00      0.00
02:13:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:13:01 AM      eth0      2.82      2.65      0.55      0.19      0.00      0.00      0.00      0.00
02:14:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:14:01 AM      eth0      0.60      0.47      0.07      0.09      0.00      0.00      0.00      0.00
02:15:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:15:01 AM      eth0      0.28      0.15      0.08      0.07      0.00      0.00      0.00      0.00
02:16:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:16:01 AM      eth0      6.28      5.83      1.29      0.68      0.00      0.00      0.00      0.00
02:17:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:17:01 AM      eth0      9.40      9.66      1.99      1.80      0.00      0.00      0.00      0.00
02:18:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:18:01 AM      eth0      9.23      9.40      1.98      1.76      0.00      0.00      0.00      0.00
02:19:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:19:01 AM      eth0      9.33      9.48      1.99      1.77      0.00      0.00      0.00      0.00
02:20:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:20:01 AM      eth0      9.61      9.78      2.10      1.87      0.00      0.00      0.00      0.00
02:21:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:21:01 AM      eth0      9.36      9.60      2.01      1.80      0.00      0.00      0.00      0.00
02:22:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:22:01 AM      eth0      9.30      9.55      2.27      1.75      0.00      0.00      0.00      0.00
02:23:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:23:01 AM      eth0     15.66     15.26      3.52      2.81      0.00      0.00      0.00      0.00
02:24:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:24:01 AM      eth0      0.45      0.37      0.08      0.05      0.00      0.00      0.00      0.00
02:25:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:25:01 AM      eth0      0.30      0.12      0.08      0.06      0.00      0.00      0.00      0.00
02:26:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:26:01 AM      eth0      0.43      0.43      0.07      0.05      0.00      0.00      0.00      0.00
02:27:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:27:01 AM      eth0      0.15      0.00      0.01      0.00      0.00      0.00      0.00      0.00
02:28:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:28:01 AM      eth0      0.38      0.37      0.07      0.05      0.00      0.00      0.00      0.00
02:29:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:29:01 AM      eth0      0.15      0.05      0.01      0.00      0.00      0.00      0.00      0.00
02:30:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:30:01 AM      eth0      3.25      3.28      0.78      0.66      0.00      0.00      0.00      0.00
02:31:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:31:01 AM      eth0      5.30      5.37      1.13      0.56      0.00      0.00      0.00      0.00
02:32:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:32:01 AM      eth0      8.00      7.41      1.82      1.21      0.00      0.00      0.00      0.00
02:33:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:33:01 AM      eth0     11.41     10.66      2.78      2.34      0.00      0.00      0.00      0.00
02:34:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:34:01 AM      eth0      9.40      9.66      2.02      1.81      0.00      0.00      0.00      0.00
02:35:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:35:01 AM      eth0      9.63      9.80      2.10      1.87      0.00      0.00      0.00      0.00
02:36:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:36:01 AM      eth0      9.16      9.33      1.95      1.74      0.00      0.00      0.00      0.00
02:37:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:37:01 AM      eth0      9.23      9.44      1.97      1.76      0.00      0.00      0.00      0.00
02:38:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:38:01 AM      eth0      9.41      9.66      2.02      1.81      0.00      0.00      0.00      0.00
02:39:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:39:01 AM      eth0     13.16     12.80      2.97      2.31      0.00      0.00      0.00      0.00
02:40:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:40:01 AM      eth0      0.80      0.43      0.18      0.11      0.00      0.00      0.00      0.00
02:41:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:41:01 AM      eth0      0.17      0.00      0.01      0.00      0.00      0.00      0.00      0.00
02:42:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:42:01 AM      eth0      0.42      0.33      0.07      0.05      0.00      0.00      0.00      0.00
02:43:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:43:01 AM      eth0      0.20      0.00      0.01      0.00      0.00      0.00      0.00      0.00
02:44:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:44:01 AM      eth0      1.18      0.60      0.23      0.12      0.00      0.00      0.00      0.00
02:45:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:45:01 AM      eth0      0.63      0.42      0.35      0.32      0.00      0.00      0.00      0.00
02:46:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:46:01 AM      eth0      3.78      3.60      1.06      0.66      0.00      0.00      0.00      0.00
02:47:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:47:01 AM      eth0      9.37      8.67      2.11      1.32      0.00      0.00      0.00      0.00
02:48:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:48:01 AM      eth0      7.26      7.23      1.80      1.17      0.00      0.00      0.00      0.00
02:49:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:49:01 AM      eth0      9.63     10.26      2.00      8.46      0.00      0.00      0.00      0.00
02:50:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:50:01 AM      eth0     11.08     11.09      2.17      8.34      0.00      0.00      0.00      0.00
02:51:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:51:01 AM      eth0      9.15      9.42      1.98      1.78      0.00      0.00      0.00      0.00
02:52:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:52:01 AM      eth0      9.30      9.57      1.97      1.76      0.00      0.00      0.00      0.00
02:53:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:53:01 AM      eth0      9.63      9.77      2.08      1.81      0.00      0.00      0.00      0.00
02:54:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:54:01 AM      eth0      9.70      9.93      2.09      1.88      0.00      0.00      0.00      0.00
02:55:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:55:01 AM      eth0     11.71     11.25      2.64      8.31      0.00      0.00      0.00      0.00
02:56:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:56:01 AM      eth0      0.30      0.17      0.04      0.02      0.00      0.00      0.00      0.00
02:57:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:57:01 AM      eth0      0.15      0.00      0.01      0.00      0.00      0.00      0.00      0.00
02:58:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:58:01 AM      eth0      0.42      0.32      0.07      0.04      0.00      0.00      0.00      0.00
02:59:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:59:01 AM      eth0      0.12      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:00:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:00:01 AM      eth0      1.28      1.38      0.30      3.13      0.00      0.00      0.00      0.00
03:01:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:01:01 AM      eth0      0.13      0.03      0.01      0.00      0.00      0.00      0.00      0.00
03:02:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:02:01 AM      eth0      9.55      8.31      1.89      1.04      0.00      0.00      0.00      0.00
03:03:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:03:01 AM      eth0      7.53      7.30      1.90      1.18      0.00      0.00      0.00      0.00
03:04:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:04:01 AM      eth0      5.87      5.97      1.20      1.09      0.00      0.00      0.00      0.00
03:05:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:05:01 AM      eth0      9.48      9.78      2.08      1.87      0.00      0.00      0.00      0.00
03:06:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:06:01 AM      eth0      9.16      9.43      1.95      1.75      0.00      0.00      0.00      0.00
03:07:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:07:01 AM      eth0      9.31      9.56      2.01      1.80      0.00      0.00      0.00      0.00
03:08:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:08:01 AM      eth0      9.06      9.38      1.96      1.76      0.00      0.00      0.00      0.00
03:09:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:09:01 AM      eth0      9.50      9.50      2.04      1.77      0.00      0.00      0.00      0.00
03:10:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:10:01 AM      eth0     18.88     18.78      4.26      3.54      0.00      0.00      0.00      0.00
03:11:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:11:01 AM      eth0      0.52      0.42      0.09      0.06      0.00      0.00      0.00      0.00
03:12:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:12:01 AM      eth0      0.10      0.00      0.01      0.00      0.00      0.00      0.00      0.00
03:13:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:13:01 AM      eth0      0.40      0.32      0.07      0.04      0.00      0.00      0.00      0.00
03:14:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:14:01 AM      eth0      0.13      0.02      0.01      0.00      0.00      0.00      0.00      0.00
03:15:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:15:01 AM      eth0      0.35      0.15      0.09      0.07      0.00      0.00      0.00      0.00
03:16:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:16:01 AM      eth0      0.40      0.28      0.08      0.04      0.00      0.00      0.00      0.00
03:17:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:17:01 AM      eth0      0.58      0.00      0.11      0.00      0.00      0.00      0.00      0.00
03:18:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:18:01 AM      eth0      7.73      7.65      1.57      0.97      0.00      0.00      0.00      0.00
03:19:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:19:01 AM      eth0      6.80      6.58      4.36      0.95      0.00      0.00      0.00      0.00
03:20:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:20:01 AM      eth0      6.80      6.37      4.56      1.09      0.00      0.00      0.00      0.00
03:21:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:21:01 AM      eth0      7.71      7.78      7.28      0.93      0.00      0.00      0.00      0.00
03:22:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:22:01 AM      eth0      8.63      8.58      3.40      1.66      0.00      0.00      0.00      0.00
03:23:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:23:01 AM      eth0      7.62      7.43      4.53      1.07      0.00      0.00      0.00      0.00
03:24:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:24:01 AM      eth0      9.87      9.50      4.76      1.28      0.00      0.00      0.00      0.00
03:25:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:25:01 AM      eth0      6.10      5.61      4.06      0.62      0.00      0.00      0.00      0.00
03:26:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:26:01 AM      eth0    105.06     79.09    240.64    212.40      0.00      0.00      0.00      0.00
03:27:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:27:01 AM      eth0      9.87     10.31      8.32      5.03      0.00      0.00      0.00      0.00
Average:           lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
Average:         eth0      5.81      5.22      2.40      1.97      0.00      0.00      0.00      0.00


---> sar -P ALL:
Linux 4.18.0-547.el8.x86_64 (prd-centos8-robot-2c-8g-5479.novalocal) 	04/07/2024 	_x86_64_	(2 CPU)

12:00:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
12:01:01 AM     all      3.56      0.03      1.76      0.06      0.05     94.54
12:01:01 AM       0      0.72      0.00      0.15      0.10      0.05     98.98
12:01:01 AM       1      6.53      0.05      3.44      0.02      0.05     89.91
12:02:01 AM     all      1.65      0.00      0.19      0.00      0.03     98.13
12:02:01 AM       0      0.33      0.00      0.17      0.00      0.03     99.47
12:02:01 AM       1      2.99      0.00      0.20      0.00      0.03     96.78
12:03:01 AM     all      0.25      0.00      0.08      0.00      0.03     99.65
12:03:01 AM       0      0.15      0.00      0.08      0.00      0.02     99.75
12:03:01 AM       1      0.35      0.00      0.07      0.00      0.03     99.55
12:04:01 AM     all      5.15      0.00      1.58      0.00      0.05     93.21
12:04:01 AM       0      1.38      0.00      0.22      0.00      0.05     98.35
12:04:01 AM       1      9.15      0.00      3.02      0.00      0.05     87.77
12:05:01 AM     all      4.61      0.00      1.46      0.00      0.05     93.88
12:05:01 AM       0      9.07      0.00      2.84      0.00      0.05     88.03
12:05:01 AM       1      0.35      0.00      0.15      0.00      0.05     99.45
12:06:01 AM     all      0.39      0.00      0.07      0.00      0.03     99.51
12:06:01 AM       0      0.18      0.00      0.07      0.00      0.03     99.72
12:06:01 AM       1      0.60      0.00      0.07      0.00      0.03     99.30
12:07:01 AM     all      2.43      0.00      0.24      0.00      0.04     97.29
12:07:01 AM       0      4.36      0.00      0.33      0.00      0.05     95.26
12:07:01 AM       1      0.55      0.00      0.15      0.00      0.03     99.26
12:08:01 AM     all      7.56      0.00      2.90      0.00      0.05     89.49
12:08:01 AM       0      6.36      0.00      2.88      0.00      0.03     90.73
12:08:01 AM       1      8.79      0.00      2.92      0.00      0.07     88.22
12:09:01 AM     all      5.41      0.00      1.26      0.00      0.06     93.27
12:09:01 AM       0      6.66      0.00      2.23      0.00      0.07     91.05
12:09:01 AM       1      4.19      0.00      0.32      0.00      0.05     95.44
12:10:01 AM     all      4.29      0.00      0.31      0.00      0.03     95.37
12:10:01 AM       0      4.57      0.00      0.32      0.00      0.03     95.08
12:10:01 AM       1      4.00      0.00      0.30      0.00      0.03     95.67
12:11:01 AM     all      4.22      0.00      0.37      0.00      0.05     95.36
12:11:01 AM       0      3.02      0.00      0.32      0.00      0.05     96.61
12:11:01 AM       1      5.43      0.00      0.42      0.00      0.05     94.11

12:11:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
12:12:01 AM     all      4.33      0.00      0.31      0.00      0.04     95.32
12:12:01 AM       0      4.73      0.00      0.30      0.00      0.03     94.93
12:12:01 AM       1      3.92      0.00      0.32      0.00      0.05     95.72
12:13:01 AM     all      4.32      0.00      0.33      0.00      0.06     95.30
12:13:01 AM       0      6.90      0.00      0.47      0.00      0.07     92.57
12:13:01 AM       1      1.74      0.00      0.18      0.00      0.05     98.03
12:14:01 AM     all      4.29      0.00      0.30      0.00      0.05     95.36
12:14:01 AM       0      5.39      0.00      0.35      0.00      0.05     94.21
12:14:01 AM       1      3.20      0.00      0.25      0.00      0.05     96.50
12:15:01 AM     all      6.03      0.00      0.35      0.03      0.05     93.54
12:15:01 AM       0      9.49      0.00      0.44      0.00      0.05     90.03
12:15:01 AM       1      2.58      0.00      0.27      0.05      0.05     97.06
12:16:01 AM     all      0.57      0.00      0.08      0.00      0.02     99.33
12:16:01 AM       0      0.65      0.00      0.12      0.00      0.02     99.22
12:16:01 AM       1      0.48      0.00      0.05      0.00      0.02     99.45
12:17:01 AM     all      0.35      0.00      0.04      0.00      0.03     99.58
12:17:01 AM       0      0.13      0.00      0.07      0.00      0.03     99.77
12:17:01 AM       1      0.57      0.00      0.02      0.00      0.02     99.40
12:18:01 AM     all      0.50      0.00      0.09      0.00      0.03     99.38
12:18:01 AM       0      0.47      0.00      0.08      0.00      0.02     99.43
12:18:01 AM       1      0.53      0.00      0.10      0.00      0.03     99.33
12:19:02 AM     all      0.34      0.00      0.06      0.00      0.03     99.57
12:19:02 AM       0      0.22      0.00      0.07      0.00      0.03     99.68
12:19:02 AM       1      0.47      0.00      0.05      0.00      0.02     99.47
12:20:01 AM     all      0.50      0.00      0.09      0.00      0.03     99.38
12:20:01 AM       0      0.51      0.00      0.10      0.00      0.02     99.37
12:20:01 AM       1      0.49      0.00      0.08      0.00      0.03     99.39
12:21:01 AM     all      0.33      0.00      0.08      0.00      0.03     99.56
12:21:01 AM       0      0.58      0.00      0.07      0.00      0.03     99.32
12:21:01 AM       1      0.08      0.00      0.08      0.00      0.03     99.80
12:22:01 AM     all      0.50      0.00      0.07      0.00      0.02     99.42
12:22:01 AM       0      0.55      0.00      0.07      0.00      0.02     99.37
12:22:01 AM       1      0.45      0.00      0.07      0.00      0.02     99.47

12:22:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
12:23:01 AM     all      7.55      0.00      5.18      0.00      0.08     87.20
12:23:01 AM       0     13.45      0.00     10.21      0.00      0.09     76.25
12:23:01 AM       1      1.80      0.00      0.27      0.00      0.07     97.86
12:24:01 AM     all      4.31      0.00      1.26      0.00      0.03     94.40
12:24:01 AM       0      0.22      0.00      0.15      0.00      0.03     99.60
12:24:01 AM       1      8.66      0.00      2.43      0.00      0.04     88.88
12:25:01 AM     all      0.36      0.00      0.07      0.00      0.03     99.54
12:25:01 AM       0      0.17      0.00      0.10      0.00      0.05     99.68
12:25:01 AM       1      0.55      0.00      0.03      0.00      0.02     99.40
12:26:01 AM     all      2.10      0.00      0.20      0.00      0.03     97.67
12:26:01 AM       0      0.18      0.00      0.12      0.00      0.02     99.68
12:26:01 AM       1      4.08      0.00      0.29      0.00      0.03     95.60
12:27:01 AM     all      3.06      0.00      1.45      0.00      0.03     95.45
12:27:01 AM       0      5.63      0.00      2.79      0.00      0.03     91.55
12:27:01 AM       1      0.57      0.00      0.15      0.00      0.03     99.25
12:28:01 AM     all      0.37      0.00      0.07      0.00      0.04     99.52
12:28:01 AM       0      0.18      0.00      0.12      0.00      0.07     99.63
12:28:01 AM       1      0.55      0.00      0.02      0.00      0.02     99.42
12:29:01 AM     all      4.10      0.00      1.56      0.00      0.04     94.29
12:29:01 AM       0      7.67      0.00      3.07      0.00      0.05     89.21
12:29:01 AM       1      0.68      0.00      0.12      0.00      0.03     99.16
12:30:01 AM     all      7.42      0.00      1.52      0.00      0.05     91.01
12:30:01 AM       0     11.97      0.00      2.80      0.00      0.07     85.16
12:30:01 AM       1      3.12      0.00      0.31      0.00      0.03     96.54
12:31:01 AM     all      6.93      0.00      2.79      0.00      0.08     90.20
12:31:01 AM       0      0.52      0.00      0.18      0.00      0.03     99.27
12:31:01 AM       1     13.98      0.00      5.65      0.00      0.13     80.24
12:32:01 AM     all      5.88      0.00      1.53      0.00      0.04     92.55
12:32:01 AM       0      0.32      0.00      0.15      0.00      0.03     99.50
12:32:01 AM       1     11.92      0.00      3.02      0.00      0.05     85.01
12:33:01 AM     all      0.33      0.00      0.07      0.00      0.04     99.56
12:33:01 AM       0      0.48      0.00      0.05      0.00      0.03     99.43
12:33:01 AM       1      0.18      0.00      0.08      0.00      0.05     99.68

12:33:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
12:34:01 AM     all      0.89      0.00      0.13      0.00      0.02     98.97
12:34:01 AM       0      0.65      0.00      0.08      0.00      0.02     99.25
12:34:01 AM       1      1.13      0.00      0.17      0.00      0.02     98.69
12:35:01 AM     all      4.47      0.00      1.49      0.00      0.04     94.00
12:35:01 AM       0      0.53      0.00      0.12      0.00      0.03     99.32
12:35:01 AM       1      8.63      0.00      2.95      0.00      0.05     88.38
12:36:01 AM     all      0.38      0.00      0.08      0.00      0.03     99.52
12:36:01 AM       0      0.18      0.00      0.08      0.00      0.03     99.70
12:36:01 AM       1      0.57      0.00      0.07      0.00      0.02     99.35
12:37:01 AM     all      2.61      0.00      0.19      0.00      0.03     97.16
12:37:01 AM       0      1.10      0.00      0.12      0.00      0.03     98.75
12:37:01 AM       1      4.16      0.00      0.28      0.00      0.03     95.53
12:38:01 AM     all      6.23      0.00      2.75      0.00      0.05     90.97
12:38:01 AM       0      3.53      0.00      0.23      0.00      0.03     96.20
12:38:01 AM       1      9.07      0.00      5.41      0.00      0.07     85.44
12:39:01 AM     all      4.29      0.00      0.29      0.00      0.06     95.36
12:39:01 AM       0      3.88      0.00      0.30      0.00      0.05     95.77
12:39:01 AM       1      4.71      0.00      0.28      0.00      0.07     94.94
12:40:01 AM     all      4.20      0.16      0.38      0.00      0.05     95.22
12:40:01 AM       0      5.02      0.30      0.38      0.00      0.05     94.24
12:40:01 AM       1      3.38      0.02      0.37      0.00      0.05     96.19
12:41:01 AM     all      4.35      0.00      0.33      0.00      0.05     95.26
12:41:01 AM       0      6.16      0.00      0.45      0.00      0.05     93.34
12:41:01 AM       1      2.54      0.00      0.22      0.00      0.05     97.19
12:42:01 AM     all      4.36      0.00      0.29      0.00      0.05     95.30
12:42:01 AM       0      5.83      0.00      0.37      0.00      0.07     93.74
12:42:01 AM       1      2.89      0.00      0.22      0.00      0.03     96.85
12:43:01 AM     all      4.37      0.00      0.32      0.01      0.05     95.26
12:43:01 AM       0      5.91      0.00      0.39      0.02      0.05     93.64
12:43:01 AM       1      2.83      0.00      0.25      0.00      0.05     96.87
12:44:01 AM     all      7.19      0.00      0.40      0.00      0.06     92.35
12:44:01 AM       0     11.70      0.00      0.55      0.00      0.07     87.68
12:44:01 AM       1      2.68      0.00      0.25      0.00      0.05     97.02

12:44:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
12:45:01 AM     all      0.60      0.00      0.09      0.00      0.03     99.28
12:45:01 AM       0      0.67      0.00      0.07      0.00      0.02     99.25
12:45:01 AM       1      0.54      0.00      0.12      0.00      0.03     99.31
12:46:01 AM     all      0.33      0.00      0.05      0.00      0.03     99.59
12:46:01 AM       0      0.58      0.00      0.07      0.00      0.03     99.32
12:46:01 AM       1      0.07      0.00      0.03      0.00      0.03     99.87
12:47:01 AM     all      0.53      0.00      0.11      0.06      0.02     99.29
12:47:01 AM       0      0.70      0.00      0.08      0.00      0.02     99.20
12:47:01 AM       1      0.35      0.00      0.13      0.12      0.02     99.38
12:48:01 AM     all      0.35      0.00      0.05      0.00      0.03     99.57
12:48:01 AM       0      0.27      0.00      0.08      0.00      0.03     99.62
12:48:01 AM       1      0.43      0.00      0.02      0.00      0.02     99.53
12:49:01 AM     all      0.34      0.00      0.07      0.00      0.03     99.57
12:49:01 AM       0      0.12      0.00      0.07      0.00      0.03     99.78
12:49:01 AM       1      0.57      0.00      0.07      0.00      0.02     99.35
12:50:01 AM     all      0.49      0.00      0.07      0.03      0.03     99.39
12:50:01 AM       0      0.45      0.00      0.08      0.05      0.02     99.40
12:50:01 AM       1      0.53      0.00      0.05      0.00      0.03     99.38
12:51:01 AM     all      0.33      0.00      0.08      0.09      0.02     99.48
12:51:01 AM       0      0.60      0.00      0.07      0.00      0.02     99.32
12:51:01 AM       1      0.07      0.00      0.08      0.18      0.02     99.65
12:52:01 AM     all      6.29      0.00      4.10      0.00      0.07     89.54
12:52:01 AM       0     11.80      0.00      8.29      0.00      0.09     79.82
12:52:01 AM       1      1.20      0.00      0.22      0.00      0.05     98.53
12:53:01 AM     all      7.03      0.00      1.47      0.00      0.06     91.44
12:53:01 AM       0      5.34      0.00      2.35      0.00      0.05     92.26
12:53:01 AM       1      8.74      0.00      0.58      0.00      0.07     90.61
12:54:01 AM     all      3.26      0.00      1.43      0.00      0.03     95.28
12:54:01 AM       0      0.38      0.00      0.07      0.00      0.03     99.52
12:54:01 AM       1      6.24      0.00      2.84      0.00      0.03     90.89
12:55:01 AM     all      0.35      0.00      0.08      0.03      0.03     99.52
12:55:01 AM       0      0.57      0.00      0.07      0.00      0.02     99.35
12:55:01 AM       1      0.13      0.00      0.08      0.07      0.03     99.68

12:55:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
12:56:01 AM     all      3.59      0.00      1.29      0.00      0.03     95.09
12:56:01 AM       0      0.70      0.00      0.15      0.00      0.03     99.12
12:56:01 AM       1      6.62      0.00      2.49      0.00      0.04     90.85
12:57:01 AM     all      1.59      0.00      0.19      0.00      0.03     98.19
12:57:01 AM       0      0.30      0.00      0.08      0.00      0.03     99.58
12:57:01 AM       1      2.90      0.00      0.29      0.00      0.03     96.78
12:58:01 AM     all      0.37      0.00      0.08      0.00      0.03     99.52
12:58:01 AM       0      0.47      0.00      0.08      0.00      0.03     99.42
12:58:01 AM       1      0.27      0.00      0.07      0.00      0.03     99.63
12:59:01 AM     all      5.21      0.00      1.56      0.00      0.04     93.19
12:59:01 AM       0      0.62      0.00      0.17      0.00      0.03     99.18
12:59:01 AM       1     10.11      0.00      3.04      0.00      0.05     86.79
01:00:01 AM     all      0.40      0.00      0.08      0.00      0.03     99.49
01:00:01 AM       0      0.65      0.00      0.08      0.00      0.05     99.22
01:00:01 AM       1      0.15      0.00      0.07      0.00      0.02     99.77
01:01:01 AM     all      0.38      0.00      0.10      0.01      0.03     99.49
01:01:01 AM       0      0.60      0.00      0.08      0.00      0.02     99.30
01:01:01 AM       1      0.15      0.00      0.12      0.02      0.03     99.68
01:02:01 AM     all      7.08      0.00      1.51      0.00      0.07     91.34
01:02:01 AM       0      4.65      0.00      0.41      0.00      0.07     94.87
01:02:01 AM       1      9.58      0.00      2.66      0.00      0.07     87.69
01:03:01 AM     all      3.19      0.00      1.22      0.00      0.05     95.54
01:03:01 AM       0      6.31      0.00      2.35      0.00      0.03     91.31
01:03:01 AM       1      0.17      0.00      0.13      0.00      0.07     99.63
01:04:01 AM     all      0.34      0.00      0.09      0.00      0.03     99.53
01:04:01 AM       0      0.55      0.00      0.08      0.00      0.03     99.33
01:04:01 AM       1      0.13      0.00      0.10      0.00      0.03     99.73
01:05:01 AM     all      3.76      0.00      1.38      0.00      0.03     94.83
01:05:01 AM       0      0.72      0.00      0.07      0.00      0.02     99.20
01:05:01 AM       1      6.95      0.00      2.76      0.00      0.05     90.24
01:06:01 AM     all      7.77      0.00      2.65      0.00      0.06     89.52
01:06:01 AM       0      3.85      0.00      0.29      0.00      0.05     95.81
01:06:01 AM       1     11.93      0.00      5.15      0.00      0.07     82.85

01:06:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
01:07:01 AM     all      4.99      0.00      0.33      0.00      0.05     94.62
01:07:01 AM       0      6.55      0.00      0.37      0.00      0.05     93.03
01:07:01 AM       1      3.43      0.00      0.30      0.00      0.05     96.22
01:08:01 AM     all      4.34      0.00      0.36      0.00      0.06     95.24
01:08:01 AM       0      6.86      0.00      0.52      0.00      0.07     92.56
01:08:01 AM       1      1.82      0.00      0.20      0.00      0.05     97.93
01:09:01 AM     all      4.48      0.00      0.33      0.00      0.05     95.14
01:09:01 AM       0      5.77      0.00      0.38      0.00      0.05     93.80
01:09:01 AM       1      3.20      0.00      0.27      0.00      0.05     96.48
01:10:01 AM     all      4.23      0.00      0.33      0.00      0.05     95.40
01:10:01 AM       0      5.25      0.00      0.37      0.00      0.07     94.31
01:10:01 AM       1      3.20      0.00      0.28      0.00      0.03     96.49
01:11:01 AM     all      4.42      0.00      0.33      0.00      0.05     95.19
01:11:01 AM       0      6.91      0.00      0.49      0.00      0.05     92.55
01:11:01 AM       1      1.94      0.00      0.18      0.00      0.05     97.83
01:12:01 AM     all      4.39      0.00      0.33      0.00      0.05     95.24
01:12:01 AM       0      4.54      0.00      0.28      0.00      0.05     95.13
01:12:01 AM       1      4.24      0.00      0.37      0.00      0.05     95.35
01:13:01 AM     all      5.23      0.00      0.30      0.00      0.06     94.41
01:13:01 AM       0      7.09      0.00      0.39      0.00      0.05     92.48
01:13:01 AM       1      3.38      0.00      0.22      0.00      0.07     96.34
01:14:01 AM     all      0.51      0.00      0.08      0.00      0.03     99.38
01:14:01 AM       0      0.48      0.00      0.08      0.00      0.02     99.42
01:14:01 AM       1      0.53      0.00      0.08      0.00      0.03     99.35
01:15:01 AM     all      0.34      0.00      0.05      0.00      0.03     99.58
01:15:01 AM       0      0.13      0.00      0.07      0.00      0.02     99.78
01:15:01 AM       1      0.55      0.00      0.03      0.00      0.03     99.38
01:16:01 AM     all      0.49      0.00      0.08      0.00      0.03     99.41
01:16:01 AM       0      0.42      0.00      0.12      0.00      0.03     99.43
01:16:01 AM       1      0.57      0.00      0.03      0.00      0.02     99.38
01:17:01 AM     all      0.33      0.00      0.06      0.00      0.03     99.59
01:17:01 AM       0      0.12      0.00      0.08      0.00      0.03     99.77
01:17:01 AM       1      0.53      0.00      0.03      0.00      0.02     99.42

01:17:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
01:18:01 AM     all      0.50      0.00      0.08      0.00      0.03     99.39
01:18:01 AM       0      0.47      0.00      0.10      0.00      0.05     99.38
01:18:01 AM       1      0.53      0.00      0.05      0.00      0.02     99.40
01:19:01 AM     all      0.33      0.00      0.05      0.00      0.03     99.58
01:19:01 AM       0      0.13      0.00      0.07      0.00      0.03     99.77
01:19:01 AM       1      0.53      0.00      0.03      0.00      0.03     99.40
01:20:01 AM     all      2.41      0.00      0.19      0.00      0.04     97.35
01:20:01 AM       0      4.14      0.00      0.29      0.00      0.05     95.52
01:20:01 AM       1      0.70      0.00      0.10      0.00      0.03     99.17
01:21:01 AM     all      6.43      0.00      4.28      0.02      0.05     89.22
01:21:01 AM       0      0.77      0.00      0.23      0.00      0.03     98.96
01:21:01 AM       1     12.53      0.00      8.64      0.04      0.07     78.72
01:22:01 AM     all      3.15      0.00      1.34      0.00      0.04     95.47
01:22:01 AM       0      0.63      0.00      0.08      0.00      0.05     99.23
01:22:01 AM       1      5.74      0.00      2.64      0.00      0.03     91.58
01:23:01 AM     all      0.35      0.00      0.08      0.00      0.04     99.53
01:23:01 AM       0      0.60      0.00      0.07      0.00      0.03     99.30
01:23:01 AM       1      0.10      0.00      0.08      0.00      0.05     99.77
01:24:01 AM     all      3.40      0.00      1.45      0.00      0.04     95.10
01:24:01 AM       0      0.58      0.00      0.12      0.00      0.03     99.27
01:24:01 AM       1      6.37      0.00      2.86      0.00      0.05     90.72
01:25:01 AM     all      7.16      0.00      1.74      0.00      0.06     91.04
01:25:01 AM       0      3.01      0.00      0.32      0.00      0.05     96.62
01:25:01 AM       1     11.54      0.00      3.23      0.00      0.07     85.15
01:26:01 AM     all      7.18      0.00      2.74      0.01      0.06     90.01
01:26:01 AM       0      7.55      0.00      2.78      0.00      0.05     89.62
01:26:01 AM       1      6.81      0.00      2.70      0.02      0.07     90.41
01:27:01 AM     all      5.83      0.00      1.51      0.00      0.05     92.60
01:27:01 AM       0      2.75      0.00      0.31      0.00      0.03     96.91
01:27:01 AM       1      9.09      0.00      2.79      0.00      0.07     88.05
01:28:02 AM     all      0.27      0.00      0.09      0.00      0.03     99.61
01:28:02 AM       0      0.33      0.00      0.08      0.00      0.05     99.53
01:28:02 AM       1      0.20      0.00      0.10      0.00      0.02     99.68

01:28:02 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
01:29:01 AM     all      1.21      0.00      0.08      0.00      0.03     98.67
01:29:01 AM       0      0.25      0.00      0.12      0.00      0.03     99.59
01:29:01 AM       1      2.16      0.00      0.05      0.00      0.03     97.76
01:30:01 AM     all      6.95      0.00      2.48      0.00      0.06     90.51
01:30:01 AM       0      2.12      0.00      0.22      0.00      0.07     97.60
01:30:01 AM       1     12.17      0.00      4.92      0.00      0.05     82.86
01:31:01 AM     all      4.49      0.00      0.31      0.00      0.05     95.15
01:31:01 AM       0      4.50      0.00      0.28      0.00      0.05     95.16
01:31:01 AM       1      4.47      0.00      0.33      0.00      0.05     95.14
01:32:01 AM     all      4.42      0.00      0.29      0.00      0.06     95.23
01:32:01 AM       0      6.40      0.00      0.40      0.00      0.05     93.15
01:32:01 AM       1      2.44      0.00      0.18      0.00      0.07     97.31
01:33:01 AM     all      4.36      0.00      0.29      0.00      0.08     95.27
01:33:01 AM       0      4.18      0.00      0.30      0.00      0.08     95.43
01:33:01 AM       1      4.54      0.00      0.28      0.00      0.07     95.11
01:34:01 AM     all      4.24      0.00      0.30      0.00      0.05     95.41
01:34:01 AM       0      3.08      0.00      0.28      0.00      0.05     96.59
01:34:01 AM       1      5.41      0.00      0.32      0.00      0.05     94.22
01:35:01 AM     all      4.44      0.00      0.30      0.00      0.05     95.21
01:35:01 AM       0      4.38      0.00      0.30      0.00      0.05     95.26
01:35:01 AM       1      4.49      0.00      0.30      0.00      0.05     95.16
01:36:01 AM     all      4.29      0.00      0.33      0.00      0.05     95.32
01:36:01 AM       0      3.98      0.00      0.28      0.00      0.03     95.70
01:36:01 AM       1      4.60      0.00      0.39      0.00      0.07     94.94
01:37:01 AM     all      4.78      0.00      0.29      0.00      0.07     94.86
01:37:01 AM       0      5.25      0.00      0.30      0.00      0.07     94.38
01:37:01 AM       1      4.30      0.00      0.28      0.00      0.07     95.34
01:38:01 AM     all      0.41      0.00      0.08      0.00      0.03     99.49
01:38:01 AM       0      0.17      0.00      0.10      0.00      0.03     99.70
01:38:01 AM       1      0.65      0.00      0.05      0.00      0.02     99.28
01:39:01 AM     all      0.31      0.00      0.07      0.00      0.02     99.61
01:39:01 AM       0      0.13      0.00      0.10      0.00      0.03     99.73
01:39:01 AM       1      0.48      0.00      0.03      0.00      0.00     99.48

01:39:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
01:40:01 AM     all      0.45      0.00      0.08      0.00      0.04     99.43
01:40:01 AM       0      0.47      0.00      0.07      0.00      0.05     99.42
01:40:01 AM       1      0.43      0.00      0.08      0.00      0.03     99.45
01:41:01 AM     all      0.33      0.00      0.08      0.00      0.03     99.57
01:41:01 AM       0      0.33      0.00      0.08      0.00      0.02     99.57
01:41:01 AM       1      0.32      0.00      0.08      0.00      0.03     99.57
01:42:01 AM     all      0.49      0.00      0.07      0.00      0.04     99.40
01:42:01 AM       0      0.42      0.00      0.07      0.00      0.03     99.48
01:42:01 AM       1      0.57      0.00      0.07      0.00      0.05     99.31
01:43:01 AM     all      0.33      0.00      0.07      0.00      0.03     99.57
01:43:01 AM       0      0.08      0.00      0.08      0.00      0.03     99.80
01:43:01 AM       1      0.57      0.00      0.05      0.00      0.03     99.35
01:44:01 AM     all      3.41      0.00      1.88      0.00      0.03     94.68
01:44:01 AM       0      4.52      0.00      0.41      0.00      0.03     95.04
01:44:01 AM       1      2.30      0.00      3.35      0.00      0.03     94.31
01:45:01 AM     all      6.40      0.00      3.16      0.00      0.07     90.38
01:45:01 AM       0      6.10      0.00      2.28      0.00      0.07     91.55
01:45:01 AM       1      6.70      0.00      4.05      0.00      0.07     89.18
01:46:01 AM     all      1.92      0.00      0.38      0.00      0.05     97.65
01:46:01 AM       0      3.47      0.00      0.68      0.00      0.05     95.80
01:46:01 AM       1      0.40      0.00      0.08      0.00      0.05     99.46
01:47:01 AM     all      0.23      0.00      0.08      0.00      0.03     99.65
01:47:01 AM       0      0.12      0.00      0.07      0.00      0.03     99.78
01:47:01 AM       1      0.35      0.00      0.10      0.00      0.03     99.51
01:48:01 AM     all      4.77      0.00      1.64      0.00      0.06     93.52
01:48:01 AM       0      0.83      0.00      0.13      0.00      0.05     98.98
01:48:01 AM       1      8.97      0.00      3.26      0.00      0.07     87.70
01:49:01 AM     all      6.88      0.00      1.82      0.00      0.05     91.25
01:49:01 AM       0      5.18      0.00      0.39      0.00      0.05     94.37
01:49:01 AM       1      8.63      0.00      3.29      0.00      0.05     88.03
01:50:01 AM     all      6.92      0.00      2.63      0.00      0.07     90.37
01:50:01 AM       0     13.86      0.00      5.28      0.00      0.07     80.79
01:50:01 AM       1      0.58      0.00      0.22      0.00      0.07     99.13

01:50:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
01:51:01 AM     all      5.27      0.00      1.57      0.06      0.08     93.02
01:51:01 AM       0      1.18      0.00      0.13      0.12      0.07     98.50
01:51:01 AM       1      9.62      0.00      3.10      0.00      0.09     87.20
01:52:01 AM     all      0.37      0.00      0.07      0.00      0.03     99.54
01:52:01 AM       0      0.18      0.00      0.10      0.00      0.03     99.68
01:52:01 AM       1      0.55      0.00      0.03      0.00      0.02     99.40
01:53:01 AM     all      2.38      0.00      0.18      0.00      0.03     97.41
01:53:01 AM       0      4.18      0.00      0.27      0.00      0.05     95.49
01:53:01 AM       1      0.62      0.00      0.08      0.00      0.02     99.28
01:54:01 AM     all      6.82      0.00      2.71      0.00      0.06     90.41
01:54:01 AM       0     10.53      0.00      5.28      0.00      0.07     84.12
01:54:01 AM       1      3.29      0.00      0.27      0.00      0.05     96.39
01:55:01 AM     all      4.39      0.00      0.29      0.00      0.07     95.25
01:55:01 AM       0      4.18      0.00      0.27      0.00      0.07     95.49
01:55:01 AM       1      4.60      0.00      0.32      0.00      0.07     95.01
01:56:01 AM     all      4.15      0.00      0.32      0.00      0.06     95.47
01:56:01 AM       0      5.34      0.00      0.39      0.00      0.07     94.21
01:56:01 AM       1      2.96      0.00      0.25      0.00      0.05     96.74
01:57:01 AM     all      4.30      0.00      0.29      0.00      0.06     95.35
01:57:01 AM       0      3.53      0.00      0.25      0.00      0.05     96.17
01:57:01 AM       1      5.07      0.00      0.33      0.00      0.07     94.52
01:58:01 AM     all      4.34      0.00      0.33      0.00      0.06     95.27
01:58:01 AM       0      6.60      0.00      0.44      0.00      0.07     92.90
01:58:01 AM       1      2.09      0.00      0.22      0.00      0.05     97.64
01:59:01 AM     all      4.29      0.00      0.33      0.00      0.06     95.31
01:59:01 AM       0      4.72      0.00      0.35      0.00      0.07     94.86
01:59:01 AM       1      3.87      0.00      0.32      0.00      0.05     95.77
02:00:01 AM     all      6.51      0.00      0.38      0.00      0.06     93.06
02:00:01 AM       0      6.31      0.00      0.33      0.00      0.05     93.31
02:00:01 AM       1      6.70      0.00      0.42      0.00      0.07     92.81
02:01:01 AM     all      1.62      0.00      0.13      0.00      0.04     98.21
02:01:01 AM       0      2.57      0.00      0.12      0.00      0.05     97.26
02:01:01 AM       1      0.67      0.00      0.13      0.00      0.03     99.16

02:01:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
02:02:01 AM     all      0.35      0.00      0.08      0.00      0.03     99.55
02:02:01 AM       0      0.12      0.00      0.08      0.00      0.02     99.78
02:02:01 AM       1      0.58      0.00      0.07      0.00      0.03     99.32
02:03:01 AM     all      0.32      0.00      0.08      0.00      0.03     99.57
02:03:01 AM       0      0.40      0.00      0.07      0.00      0.03     99.50
02:03:01 AM       1      0.23      0.00      0.08      0.00      0.03     99.65
02:04:01 AM     all      0.34      0.00      0.08      0.00      0.03     99.56
02:04:01 AM       0      0.13      0.00      0.10      0.00      0.03     99.73
02:04:01 AM       1      0.55      0.00      0.05      0.00      0.02     99.38
02:05:01 AM     all      0.36      0.00      0.07      0.00      0.03     99.55
02:05:01 AM       0      0.18      0.00      0.10      0.00      0.03     99.68
02:05:01 AM       1      0.53      0.00      0.03      0.00      0.02     99.42
02:06:01 AM     all      0.50      0.00      0.06      0.00      0.03     99.41
02:06:01 AM       0      0.15      0.00      0.08      0.00      0.05     99.72
02:06:01 AM       1      0.85      0.00      0.03      0.00      0.02     99.10
02:07:01 AM     all      0.33      0.00      0.05      0.00      0.04     99.57
02:07:01 AM       0      0.13      0.00      0.07      0.00      0.05     99.75
02:07:01 AM       1      0.53      0.00      0.03      0.00      0.03     99.40
02:08:01 AM     all      5.62      0.00      3.89      0.00      0.05     90.44
02:08:01 AM       0      0.73      0.00      0.22      0.00      0.05     99.00
02:08:01 AM       1     10.85      0.00      7.82      0.00      0.05     81.27
02:09:01 AM     all      5.69      0.00      1.37      0.00      0.04     92.90
02:09:01 AM       0      8.95      0.00      2.58      0.00      0.05     88.42
02:09:01 AM       1      2.60      0.00      0.22      0.00      0.03     97.15
02:10:01 AM     all      0.37      0.00      0.06      0.00      0.04     99.53
02:10:01 AM       0      0.60      0.00      0.03      0.00      0.03     99.33
02:10:01 AM       1      0.13      0.00      0.08      0.00      0.05     99.73
02:11:01 AM     all      1.12      0.16      0.18      0.00      0.04     98.49
02:11:01 AM       0      0.67      0.13      0.13      0.00      0.03     99.03
02:11:01 AM       1      1.59      0.19      0.24      0.00      0.05     97.94
02:12:01 AM     all      4.02      0.00      1.43      0.01      0.06     94.48
02:12:01 AM       0      0.73      0.00      0.10      0.00      0.05     99.12
02:12:01 AM       1      7.48      0.00      2.84      0.02      0.07     89.59

02:12:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
02:13:01 AM     all      3.12      0.00      1.11      0.00      0.06     95.71
02:13:01 AM       0      6.07      0.00      2.05      0.00      0.07     91.81
02:13:01 AM       1      0.28      0.00      0.20      0.00      0.05     99.47
02:14:01 AM     all      2.32      0.00      0.73      0.00      0.03     96.92
02:14:01 AM       0      0.67      0.00      0.10      0.00      0.02     99.22
02:14:01 AM       1      4.00      0.00      1.38      0.00      0.05     94.56
02:15:01 AM     all      0.37      0.00      0.08      0.00      0.03     99.52
02:15:01 AM       0      0.57      0.00      0.05      0.00      0.03     99.35
02:15:01 AM       1      0.17      0.00      0.10      0.00      0.03     99.70
02:16:01 AM     all      5.21      0.00      2.06      0.00      0.04     92.69
02:16:01 AM       0      3.94      0.00      0.29      0.00      0.03     95.74
02:16:01 AM       1      6.52      0.00      3.88      0.00      0.05     89.55
02:17:01 AM     all      5.58      0.00      0.86      0.00      0.08     93.48
02:17:01 AM       0      5.66      0.00      0.40      0.00      0.05     93.89
02:17:01 AM       1      5.50      0.00      1.33      0.00      0.10     93.07
02:18:01 AM     all      4.37      0.00      0.30      0.00      0.07     95.26
02:18:01 AM       0      5.89      0.00      0.32      0.00      0.07     93.72
02:18:01 AM       1      2.84      0.00      0.28      0.00      0.07     96.80
02:19:01 AM     all      4.39      0.00      0.34      0.00      0.05     95.21
02:19:01 AM       0      6.56      0.00      0.49      0.00      0.07     92.89
02:19:01 AM       1      2.23      0.00      0.20      0.00      0.03     97.54
02:20:01 AM     all      4.63      0.00      0.36      0.00      0.08     94.93
02:20:01 AM       0      7.18      0.00      0.49      0.00      0.08     92.25
02:20:01 AM       1      2.09      0.00      0.23      0.00      0.07     97.61
02:21:01 AM     all      4.35      0.00      0.33      0.01      0.05     95.26
02:21:01 AM       0      6.41      0.00      0.44      0.02      0.05     93.09
02:21:01 AM       1      2.29      0.00      0.22      0.00      0.05     97.44
02:22:01 AM     all      4.50      0.00      0.30      0.00      0.05     95.15
02:22:01 AM       0      6.57      0.00      0.42      0.00      0.05     92.97
02:22:01 AM       1      2.43      0.00      0.18      0.00      0.05     97.34
02:23:01 AM     all      6.13      0.00      0.33      0.00      0.07     93.48
02:23:01 AM       0      8.00      0.00      0.37      0.00      0.07     91.56
02:23:01 AM       1      4.25      0.00      0.28      0.00      0.07     95.40

02:23:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
02:24:01 AM     all      0.56      0.00      0.08      0.00      0.03     99.33
02:24:01 AM       0      0.62      0.00      0.07      0.00      0.03     99.28
02:24:01 AM       1      0.50      0.00      0.08      0.00      0.03     99.38
02:25:01 AM     all      0.37      0.00      0.07      0.00      0.04     99.52
02:25:01 AM       0      0.62      0.00      0.05      0.00      0.03     99.30
02:25:01 AM       1      0.12      0.00      0.08      0.00      0.05     99.75
02:26:01 AM     all      0.68      0.00      0.10      0.00      0.14     99.07
02:26:01 AM       0      0.60      0.00      0.10      0.00      0.15     99.15
02:26:01 AM       1      0.77      0.00      0.10      0.00      0.13     99.00
02:27:01 AM     all      0.16      0.00      0.08      0.00      0.03     99.73
02:27:01 AM       0      0.20      0.00      0.10      0.00      0.03     99.67
02:27:01 AM       1      0.12      0.00      0.07      0.00      0.02     99.80
02:28:01 AM     all      0.55      0.00      0.08      0.00      0.03     99.34
02:28:01 AM       0      0.48      0.00      0.08      0.00      0.03     99.40
02:28:01 AM       1      0.62      0.00      0.07      0.00      0.03     99.28
02:29:01 AM     all      0.25      0.00      0.10      0.00      0.02     99.63
02:29:01 AM       0      0.22      0.00      0.07      0.00      0.00     99.72
02:29:01 AM       1      0.28      0.00      0.13      0.00      0.03     99.55
02:30:01 AM     all      1.50      0.00      0.13      0.00      0.04     98.33
02:30:01 AM       0      1.90      0.00      0.15      0.00      0.03     97.91
02:30:01 AM       1      1.10      0.00      0.10      0.00      0.05     98.75
02:31:01 AM     all      6.83      0.00      4.66      0.01      0.07     88.43
02:31:01 AM       0      9.08      0.00      8.96      0.00      0.07     81.88
02:31:01 AM       1      4.60      0.00      0.43      0.02      0.07     94.88
02:32:01 AM     all      7.48      0.00      2.67      0.00      0.08     89.77
02:32:01 AM       0      2.57      0.00      0.20      0.00      0.07     97.16
02:32:01 AM       1     12.82      0.00      5.36      0.00      0.09     81.73
02:33:01 AM     all      4.50      0.00      0.33      0.00      0.04     95.13
02:33:01 AM       0      7.23      0.00      0.47      0.00      0.05     92.25
02:33:01 AM       1      1.77      0.00      0.18      0.00      0.03     98.01
02:34:01 AM     all      4.37      0.00      0.32      0.00      0.07     95.25
02:34:01 AM       0      3.88      0.00      0.28      0.00      0.07     95.77
02:34:01 AM       1      4.86      0.00      0.35      0.00      0.07     94.73

02:34:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
02:35:01 AM     all      4.76      0.00      0.35      0.01      0.05     94.83
02:35:01 AM       0      7.59      0.00      0.44      0.02      0.05     91.91
02:35:01 AM       1      1.94      0.00      0.27      0.00      0.05     97.74
02:36:01 AM     all      4.32      0.00      0.34      0.00      0.06     95.28
02:36:01 AM       0      4.72      0.00      0.39      0.00      0.05     94.84
02:36:01 AM       1      3.91      0.00      0.30      0.00      0.07     95.72
02:37:01 AM     all      4.20      0.00      0.31      0.00      0.09     95.41
02:37:01 AM       0      2.70      0.00      0.22      0.00      0.08     96.99
02:37:01 AM       1      5.71      0.00      0.39      0.00      0.09     93.81
02:38:01 AM     all      4.28      0.00      0.29      0.00      0.08     95.35
02:38:01 AM       0      6.08      0.00      0.40      0.00      0.08     93.44
02:38:01 AM       1      2.49      0.00      0.18      0.00      0.07     97.26
02:39:01 AM     all      4.92      0.00      0.28      0.00      0.07     94.73
02:39:01 AM       0      5.87      0.00      0.35      0.00      0.08     93.69
02:39:01 AM       1      3.96      0.00      0.22      0.00      0.05     95.77
02:40:01 AM     all      0.51      0.00      0.07      0.03      0.16     99.23
02:40:01 AM       0      0.45      0.00      0.05      0.07      0.10     99.33
02:40:01 AM       1      0.57      0.00      0.08      0.00      0.22     99.13
02:41:01 AM     all      0.40      0.00      0.08      0.00      0.04     99.47
02:41:01 AM       0      0.57      0.00      0.07      0.00      0.03     99.33
02:41:01 AM       1      0.23      0.00      0.10      0.00      0.05     99.62
02:42:01 AM     all      0.48      0.00      0.08      0.00      0.03     99.41
02:42:01 AM       0      0.40      0.00      0.10      0.00      0.02     99.48
02:42:01 AM       1      0.55      0.00      0.07      0.00      0.05     99.33
02:43:01 AM     all      0.38      0.00      0.08      0.00      0.09     99.44
02:43:01 AM       0      0.58      0.00      0.08      0.00      0.12     99.22
02:43:01 AM       1      0.18      0.00      0.08      0.00      0.07     99.67
02:44:01 AM     all      0.59      0.00      0.10      0.00      0.06     99.26
02:44:01 AM       0      0.77      0.00      0.10      0.00      0.03     99.10
02:44:01 AM       1      0.40      0.00      0.10      0.00      0.08     99.41
02:45:01 AM     all      0.44      0.00      0.10      0.03      0.05     99.38
02:45:01 AM       0      0.55      0.00      0.08      0.00      0.03     99.33
02:45:01 AM       1      0.33      0.00      0.12      0.05      0.07     99.43

02:45:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
02:46:01 AM     all      2.31      0.00      0.19      0.00      0.06     97.43
02:46:01 AM       0      1.69      0.00      0.15      0.00      0.07     98.10
02:46:01 AM       1      2.95      0.00      0.24      0.00      0.05     96.76
02:47:01 AM     all      7.68      0.00      4.63      0.00      0.10     87.59
02:47:01 AM       0     12.43      0.00      8.29      0.00      0.11     79.18
02:47:01 AM       1      3.08      0.00      1.09      0.00      0.09     95.74
02:48:01 AM     all      7.70      0.00      2.94      0.00      0.08     89.28
02:48:01 AM       0      2.79      0.00      0.28      0.00      0.05     96.87
02:48:01 AM       1     13.04      0.00      5.83      0.00      0.11     81.03
02:49:01 AM     all      4.38      0.00      0.33      0.00      0.08     95.21
02:49:01 AM       0      4.69      0.00      0.35      0.00      0.08     94.88
02:49:01 AM       1      4.07      0.00      0.30      0.00      0.08     95.55
02:50:01 AM     all      4.51      0.00      0.39      0.02      0.07     95.01
02:50:01 AM       0      6.07      0.00      0.45      0.00      0.07     93.41
02:50:01 AM       1      2.95      0.00      0.33      0.03      0.07     96.62
02:51:01 AM     all      4.69      0.00      0.33      0.08      0.07     94.83
02:51:01 AM       0      7.41      0.00      0.45      0.00      0.07     92.07
02:51:01 AM       1      1.97      0.00      0.20      0.17      0.07     97.59
02:52:01 AM     all      3.89      0.00      0.29      0.00      0.08     95.74
02:52:01 AM       0      6.73      0.00      0.45      0.00      0.10     92.71
02:52:01 AM       1      1.05      0.00      0.13      0.00      0.05     98.76
02:53:01 AM     all      3.96      0.00      0.30      0.00      0.08     95.66
02:53:01 AM       0      6.03      0.00      0.42      0.00      0.08     93.47
02:53:01 AM       1      1.89      0.00      0.18      0.00      0.08     97.84
02:54:01 AM     all      4.44      0.00      0.32      0.00      0.08     95.16
02:54:01 AM       0      7.67      0.00      0.45      0.00      0.10     91.78
02:54:01 AM       1      1.22      0.00      0.18      0.00      0.07     98.53
02:55:01 AM     all      4.00      0.00      0.23      0.00      0.05     95.73
02:55:01 AM       0      6.24      0.00      0.20      0.00      0.05     93.51
02:55:01 AM       1      1.76      0.00      0.25      0.00      0.05     97.94
02:56:01 AM     all      0.18      0.00      0.06      0.01      0.04     99.71
02:56:01 AM       0      0.18      0.00      0.05      0.00      0.03     99.73
02:56:01 AM       1      0.18      0.00      0.07      0.02      0.05     99.68

02:56:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
02:57:01 AM     all      0.08      0.00      0.06      0.00      0.05     99.81
02:57:01 AM       0      0.08      0.00      0.07      0.00      0.05     99.80
02:57:01 AM       1      0.08      0.00      0.05      0.00      0.05     99.82
02:58:01 AM     all      0.25      0.00      0.06      0.00      0.04     99.65
02:58:01 AM       0      0.38      0.00      0.05      0.00      0.03     99.53
02:58:01 AM       1      0.12      0.00      0.07      0.00      0.05     99.77
02:59:01 AM     all      0.12      0.00      0.05      0.00      0.05     99.78
02:59:01 AM       0      0.07      0.00      0.05      0.00      0.05     99.83
02:59:01 AM       1      0.17      0.00      0.05      0.00      0.05     99.73
03:00:01 AM     all      0.26      0.00      0.08      0.00      0.05     99.62
03:00:01 AM       0      0.12      0.00      0.07      0.00      0.07     99.75
03:00:01 AM       1      0.40      0.00      0.08      0.00      0.03     99.48
03:01:01 AM     all      0.21      0.00      0.08      0.00      0.03     99.67
03:01:01 AM       0      0.28      0.00      0.10      0.00      0.03     99.58
03:01:01 AM       1      0.13      0.00      0.07      0.00      0.03     99.77
03:02:01 AM     all      3.62      0.00      1.74      0.00      0.06     94.58
03:02:01 AM       0      2.32      0.00      3.14      0.00      0.05     94.50
03:02:01 AM       1      4.94      0.00      0.32      0.00      0.07     94.67
03:03:01 AM     all      7.39      0.00      2.74      0.00      0.09     89.79
03:03:01 AM       0     13.88      0.00      5.46      0.00      0.09     80.57
03:03:01 AM       1      1.33      0.00      0.20      0.00      0.08     98.39
03:04:01 AM     all      6.39      0.00      2.44      0.00      0.07     91.10
03:04:01 AM       0      2.84      0.00      0.27      0.00      0.07     96.83
03:04:01 AM       1     10.15      0.00      4.75      0.00      0.07     85.04
03:05:01 AM     all      4.26      0.00      0.30      0.01      0.07     95.36
03:05:01 AM       0      6.06      0.00      0.39      0.02      0.07     93.47
03:05:01 AM       1      2.46      0.00      0.22      0.00      0.07     97.26
03:06:01 AM     all      4.31      0.00      0.35      0.00      0.08     95.25
03:06:01 AM       0      6.58      0.00      0.47      0.00      0.08     92.86
03:06:01 AM       1      2.04      0.00      0.23      0.00      0.08     97.64
03:07:01 AM     all      4.48      0.00      0.30      0.00      0.08     95.13
03:07:01 AM       0      2.24      0.00      0.20      0.00      0.07     97.49
03:07:01 AM       1      6.73      0.00      0.40      0.00      0.10     92.77

03:07:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
03:08:01 AM     all      4.59      0.00      0.30      0.00      0.07     95.04
03:08:01 AM       0      5.42      0.00      0.33      0.00      0.07     94.17
03:08:01 AM       1      3.77      0.00      0.27      0.00      0.07     95.90
03:09:01 AM     all      4.17      0.00      0.33      0.00      0.08     95.42
03:09:01 AM       0      5.42      0.00      0.38      0.00      0.08     94.11
03:09:01 AM       1      2.93      0.00      0.27      0.00      0.08     96.72
03:10:01 AM     all      7.44      0.00      0.43      0.00      0.08     92.06
03:10:01 AM       0      9.87      0.00      0.50      0.00      0.10     89.52
03:10:01 AM       1      5.01      0.00      0.35      0.00      0.05     94.59
03:11:01 AM     all      0.63      0.00      0.09      0.00      0.07     99.22
03:11:01 AM       0      0.57      0.00      0.07      0.00      0.07     99.30
03:11:01 AM       1      0.68      0.00      0.12      0.00      0.07     99.13
03:12:01 AM     all      0.34      0.00      0.08      0.00      0.03     99.55
03:12:01 AM       0      0.30      0.00      0.05      0.00      0.03     99.62
03:12:01 AM       1      0.38      0.00      0.10      0.00      0.03     99.48
03:13:01 AM     all      0.53      0.00      0.08      0.00      0.06     99.34
03:13:01 AM       0      0.40      0.00      0.08      0.00      0.05     99.47
03:13:01 AM       1      0.65      0.00      0.07      0.00      0.07     99.22
03:14:01 AM     all      0.24      0.00      0.06      0.00      0.03     99.67
03:14:01 AM       0      0.15      0.00      0.05      0.00      0.03     99.77
03:14:01 AM       1      0.33      0.00      0.07      0.00      0.03     99.57
03:15:01 AM     all      0.34      0.00      0.06      0.03      0.08     99.49
03:15:01 AM       0      0.53      0.00      0.07      0.00      0.10     99.30
03:15:01 AM       1      0.15      0.00      0.05      0.05      0.07     99.68
03:16:01 AM     all      0.48      0.00      0.07      0.00      0.05     99.40
03:16:01 AM       0      0.38      0.00      0.07      0.00      0.05     99.50
03:16:01 AM       1      0.58      0.00      0.07      0.00      0.05     99.30
03:17:01 AM     all      0.31      0.00      0.05      0.00      0.03     99.62
03:17:01 AM       0      0.32      0.00      0.05      0.00      0.02     99.62
03:17:01 AM       1      0.30      0.00      0.05      0.00      0.03     99.62
03:18:01 AM     all      5.70      0.00      3.04      0.00      0.12     91.13
03:18:01 AM       0      3.98      0.00      0.30      0.00      0.07     95.65
03:18:01 AM       1      7.56      0.00      5.99      0.00      0.18     86.27

03:18:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
03:19:01 AM     all      6.26      0.00      5.03      0.00      0.08     88.63
03:19:01 AM       0      7.92      0.00      9.41      0.00      0.10     82.56
03:19:01 AM       1      4.63      0.00      0.73      0.00      0.05     94.59
03:20:01 AM     all      6.53      0.00      4.36      0.02      0.13     88.96
03:20:01 AM       0      5.33      0.00      5.42      0.00      0.09     89.17
03:20:01 AM       1      7.74      0.00      3.30      0.03      0.17     88.75
03:21:01 AM     all      6.91      0.00      4.70      0.03      0.08     88.29
03:21:01 AM       0     10.35      0.00      8.55      0.05      0.09     80.96
03:21:01 AM       1      3.57      0.00      0.98      0.00      0.07     95.38
03:22:01 AM     all      7.23      0.00      4.52      0.00      0.08     88.16
03:22:01 AM       0      4.60      0.00      1.80      0.00      0.07     93.54
03:22:01 AM       1     10.01      0.00      7.40      0.00      0.09     82.51
03:23:01 AM     all      6.22      0.00      3.90      0.00      0.08     89.80
03:23:01 AM       0      3.81      0.00      0.79      0.00      0.08     95.31
03:23:01 AM       1      8.81      0.00      7.25      0.00      0.07     83.87
03:24:01 AM     all      6.68      0.00      5.13      0.00      0.08     88.11
03:24:01 AM       0     12.57      0.00      9.16      0.00      0.07     78.20
03:24:01 AM       1      1.07      0.00      1.29      0.00      0.08     97.56
03:25:01 AM     all     10.36      0.00      4.34      0.01      0.08     85.21
03:25:01 AM       0     17.40      0.00      8.25      0.00      0.07     74.27
03:25:01 AM       1      3.53      0.00      0.55      0.02      0.09     95.82
03:26:01 AM     all     22.75      0.00      2.32      1.57      0.11     73.26
03:26:01 AM       0     26.35      0.00      2.36      0.79      0.10     70.40
03:26:01 AM       1     19.15      0.00      2.28      2.34      0.12     76.12
03:27:01 AM     all     16.74      0.00      1.68      4.57      0.08     76.93
03:27:01 AM       0     14.50      0.00      1.48      2.99      0.08     80.94
03:27:01 AM       1     18.99      0.00      1.87      6.16      0.07     72.92
Average:        all      3.35      0.00      0.83      0.03      0.05     95.74
Average:          0      3.50      0.00      0.80      0.02      0.05     95.63
Average:          1      3.20      0.00      0.86      0.05      0.05     95.84