Started by upstream project "integration-distribution-mri-test-titanium" build number 43
originally caused by:
 Started by timer
Running as SYSTEM
[EnvInject] - Loading node environment variables.
Building remotely on prd-centos8-robot-2c-8g-40223 (centos8-robot-2c-8g) in workspace /w/workspace/controller-csit-3node-clustering-ask-all-titanium
[ssh-agent] Looking for ssh-agent implementation...
[ssh-agent]   Exec ssh-agent (binary ssh-agent on a remote machine)
$ ssh-agent
SSH_AUTH_SOCK=/tmp/ssh-GwwzSZUMh51d/agent.5281
SSH_AGENT_PID=5282
[ssh-agent] Started.
Running ssh-add (command line suppressed)
Identity added: /w/workspace/controller-csit-3node-clustering-ask-all-titanium@tmp/private_key_8341165253289108717.key (/w/workspace/controller-csit-3node-clustering-ask-all-titanium@tmp/private_key_8341165253289108717.key)
[ssh-agent] Using credentials jenkins (Release Engineering Jenkins Key)
The recommended git tool is: NONE
using credential opendaylight-jenkins-ssh
Wiping out workspace first.
Cloning the remote Git repository
Cloning repository git://devvexx.opendaylight.org/mirror/integration/test
 > git init /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test # timeout=10
Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test
 > git --version # timeout=10
 > git --version # 'git version 2.43.0'
using GIT_SSH to set credentials Release Engineering Jenkins Key
[INFO] Currently running in a labeled security context
[INFO] Currently SELinux is 'enforcing' on the host
 > /usr/bin/chcon --type=ssh_home_t /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test@tmp/jenkins-gitclient-ssh4351970436004871323.key
Verifying host key using known hosts file
You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification.
 > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10
Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test
using GIT_SSH to set credentials Release Engineering Jenkins Key
[INFO] Currently running in a labeled security context
[INFO] Currently SELinux is 'enforcing' on the host
 > /usr/bin/chcon --type=ssh_home_t /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test@tmp/jenkins-gitclient-ssh5552872876239181153.key
Verifying host key using known hosts file
You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification.
 > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test master # timeout=10
 > git rev-parse FETCH_HEAD^{commit} # timeout=10
Checking out Revision 074069f5d4a1380883ffe1b3642610e77516dcc9 (origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 074069f5d4a1380883ffe1b3642610e77516dcc9 # timeout=10
Commit message: "Update car perf tests for RFC8040 compliance"
 > git rev-parse FETCH_HEAD^{commit} # timeout=10
 > git rev-list --no-walk 7a5ac501dd6c185ea1e99b3d109765d08b47774f # timeout=10
No emails were triggered.
provisioning config files...
copy managed file [npmrc] to file:/home/jenkins/.npmrc
copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf
copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
[controller-csit-3node-clustering-ask-all-titanium] $ /bin/bash /tmp/jenkins11398626021306204914.sh
---> python-tools-install.sh
Setup pyenv:
  system
* 3.8.13 (set by /opt/pyenv/version)
* 3.9.13 (set by /opt/pyenv/version)
* 3.10.13 (set by /opt/pyenv/version)
* 3.11.7 (set by /opt/pyenv/version)
lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-O8Kc
lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: lftools 
lf-activate-venv(): INFO: Adding /tmp/venv-O8Kc/bin to PATH
Generating Requirements File
Python 3.11.7
pip 25.1.1 from /tmp/venv-O8Kc/lib/python3.11/site-packages/pip (python 3.11)
appdirs==1.4.4
argcomplete==3.6.2
aspy.yaml==1.3.0
attrs==25.3.0
autopage==0.5.2
beautifulsoup4==4.13.4
boto3==1.39.3
botocore==1.39.3
bs4==0.0.2
cachetools==5.5.2
certifi==2025.6.15
cffi==1.17.1
cfgv==3.4.0
chardet==5.2.0
charset-normalizer==3.4.2
click==8.2.1
cliff==4.10.0
cmd2==2.7.0
cryptography==3.3.2
debtcollector==3.0.0
decorator==5.2.1
defusedxml==0.7.1
Deprecated==1.2.18
distlib==0.3.9
dnspython==2.7.0
docker==7.1.0
dogpile.cache==1.4.0
durationpy==0.10
email_validator==2.2.0
filelock==3.18.0
future==1.0.0
gitdb==4.0.12
GitPython==3.1.44
google-auth==2.40.3
httplib2==0.22.0
identify==2.6.12
idna==3.10
importlib-resources==1.5.0
iso8601==2.1.0
Jinja2==3.1.6
jmespath==1.0.1
jsonpatch==1.33
jsonpointer==3.0.0
jsonschema==4.24.0
jsonschema-specifications==2025.4.1
keystoneauth1==5.11.1
kubernetes==33.1.0
lftools==0.37.13
lxml==6.0.0
markdown-it-py==3.0.0
MarkupSafe==3.0.2
mdurl==0.1.2
msgpack==1.1.1
multi_key_dict==2.0.3
munch==4.0.0
netaddr==1.3.0
niet==1.4.2
nodeenv==1.9.1
oauth2client==4.1.3
oauthlib==3.3.1
openstacksdk==4.6.0
os-client-config==2.1.0
os-service-types==1.7.0
osc-lib==4.0.2
oslo.config==9.8.0
oslo.context==6.0.0
oslo.i18n==6.5.1
oslo.log==7.1.0
oslo.serialization==5.7.0
oslo.utils==9.0.0
packaging==25.0
pbr==6.1.1
platformdirs==4.3.8
prettytable==3.16.0
psutil==7.0.0
pyasn1==0.6.1
pyasn1_modules==0.4.2
pycparser==2.22
pygerrit2==2.0.15
PyGithub==2.6.1
Pygments==2.19.2
PyJWT==2.10.1
PyNaCl==1.5.0
pyparsing==2.4.7
pyperclip==1.9.0
pyrsistent==0.20.0
python-cinderclient==9.7.0
python-dateutil==2.9.0.post0
python-heatclient==4.2.0
python-jenkins==1.8.2
python-keystoneclient==5.6.0
python-magnumclient==4.8.1
python-openstackclient==8.1.0
python-swiftclient==4.8.0
PyYAML==6.0.2
referencing==0.36.2
requests==2.32.4
requests-oauthlib==2.0.0
requestsexceptions==1.4.0
rfc3986==2.0.0
rich==14.0.0
rich-argparse==1.7.1
rpds-py==0.26.0
rsa==4.9.1
ruamel.yaml==0.18.14
ruamel.yaml.clib==0.2.12
s3transfer==0.13.0
simplejson==3.20.1
six==1.17.0
smmap==5.0.2
soupsieve==2.7
stevedore==5.4.1
tabulate==0.9.0
toml==0.10.2
tomlkit==0.13.3
tqdm==4.67.1
typing_extensions==4.14.1
tzdata==2025.2
urllib3==1.26.20
virtualenv==20.31.2
wcwidth==0.2.13
websocket-client==1.8.0
wrapt==1.17.2
xdg==6.0.0
xmltodict==0.14.2
yq==3.4.3
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties content 
OS_STACK_TEMPLATE=csit-2-instance-type.yaml
OS_CLOUD=vex
OS_STACK_NAME=releng-controller-csit-3node-clustering-ask-all-titanium-43
OS_STACK_TEMPLATE_DIR=openstack-hot

[EnvInject] - Variables injected successfully.
provisioning config files...
copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
[controller-csit-3node-clustering-ask-all-titanium] $ /bin/bash /tmp/jenkins15044336845380925844.sh
---> Create parameters file for OpenStack HOT
OpenStack Heat parameters generated
-----------------------------------
parameters:
    vm_0_count: '3'
    vm_0_flavor: 'v3-standard-4'
    vm_0_image: 'ZZCI - Ubuntu 22.04 - builder - x86_64 - 20250201-010426.857'
    vm_1_count: '0'
    vm_1_flavor: 'v3-standard-2'
    vm_1_image: 'ZZCI - Ubuntu 22.04 - mininet-ovs-217 - x86_64 - 20250201-060151.911'
    
    job_name: '19183-43'
    silo: 'releng'
[controller-csit-3node-clustering-ask-all-titanium] $ /bin/bash -l /tmp/jenkins6792573015075160599.sh
---> Create HEAT stack
+ source /home/jenkins/lf-env.sh
+ lf-activate-venv --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
++ mktemp -d /tmp/venv-XXXX
+ lf_venv=/tmp/venv-WWy5
+ local venv_file=/tmp/.os_lf_venv
+ local python=python3
+ local options
+ local set_path=true
+ local install_args=
++ getopt -o np:v: -l no-path,system-site-packages,python:,venv-file: -n lf-activate-venv -- --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
+ options=' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\'''
+ eval set -- ' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\'''
++ set -- --python python3 -- 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
+ true
+ case $1 in
+ python=python3
+ shift 2
+ true
+ case $1 in
+ shift
+ break
+ case $python in
+ local pkg_list=
+ [[ -d /opt/pyenv ]]
+ echo 'Setup pyenv:'
Setup pyenv:
+ export PYENV_ROOT=/opt/pyenv
+ PYENV_ROOT=/opt/pyenv
+ export PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
+ PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
+ pyenv versions
  system
  3.8.13
  3.9.13
  3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-ask-all-titanium/.python-version)
+ command -v pyenv
++ pyenv init - --no-rehash
+ eval 'PATH="$(bash --norc -ec '\''IFS=:; paths=($PATH); 
for i in ${!paths[@]}; do 
if [[ ${paths[i]} == "'\'''\''/opt/pyenv/shims'\'''\''" ]]; then unset '\''\'\'''\''paths[i]'\''\'\'''\''; 
fi; done; 
echo "${paths[*]}"'\'')"
export PATH="/opt/pyenv/shims:${PATH}"
export PYENV_SHELL=bash
source '\''/opt/pyenv/libexec/../completions/pyenv.bash'\''
pyenv() {
  local command
  command="${1:-}"
  if [ "$#" -gt 0 ]; then
    shift
  fi

  case "$command" in
  rehash|shell)
    eval "$(pyenv "sh-$command" "$@")"
    ;;
  *)
    command pyenv "$command" "$@"
    ;;
  esac
}'
+++ bash --norc -ec 'IFS=:; paths=($PATH); 
for i in ${!paths[@]}; do 
if [[ ${paths[i]} == "/opt/pyenv/shims" ]]; then unset '\''paths[i]'\''; 
fi; done; 
echo "${paths[*]}"'
++ PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
++ export PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
++ PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
++ export PYENV_SHELL=bash
++ PYENV_SHELL=bash
++ source /opt/pyenv/libexec/../completions/pyenv.bash
+++ complete -F _pyenv pyenv
++ lf-pyver python3
++ local py_version_xy=python3
++ local py_version_xyz=
++ awk '{ print $1 }'
++ pyenv versions
++ local command
++ command=versions
++ '[' 1 -gt 0 ']'
++ shift
++ case "$command" in
++ command pyenv versions
++ pyenv versions
++ sed 's/^[ *]* //'
++ grep -E '^[0-9.]*[0-9]$'
++ [[ ! -s /tmp/.pyenv_versions ]]
+++ tail -n 1
+++ grep '^3' /tmp/.pyenv_versions
+++ sort -V
++ py_version_xyz=3.11.7
++ [[ -z 3.11.7 ]]
++ echo 3.11.7
++ return 0
+ pyenv local 3.11.7
+ local command
+ command=local
+ '[' 2 -gt 0 ']'
+ shift
+ case "$command" in
+ command pyenv local 3.11.7
+ pyenv local 3.11.7
+ for arg in "$@"
+ case $arg in
+ pkg_list+='lftools[openstack] '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='kubernetes '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='niet '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='python-heatclient '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='python-openstackclient '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='python-magnumclient '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='yq '
+ [[ -f /tmp/.os_lf_venv ]]
++ cat /tmp/.os_lf_venv
+ lf_venv=/tmp/venv-O8Kc
+ echo 'lf-activate-venv(): INFO: Reuse venv:/tmp/venv-O8Kc from' file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-O8Kc from file:/tmp/.os_lf_venv
+ /tmp/venv-O8Kc/bin/python3 -m pip install --upgrade --quiet pip 'setuptools<66' virtualenv
+ [[ -z lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq  ]]
+ echo 'lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq '
lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 
+ /tmp/venv-O8Kc/bin/python3 -m pip install --upgrade --quiet --upgrade-strategy eager 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
+ type python3
+ true
+ echo 'lf-activate-venv(): INFO: Adding /tmp/venv-O8Kc/bin to PATH'
lf-activate-venv(): INFO: Adding /tmp/venv-O8Kc/bin to PATH
+ PATH=/tmp/venv-O8Kc/bin:/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
+ return 0
+ openstack --os-cloud vex limits show --absolute
+--------------------------+---------+
| Name                     |   Value |
+--------------------------+---------+
| maxTotalInstances        |      -1 |
| maxTotalCores            |     450 |
| maxTotalRAMSize          | 1000000 |
| maxServerMeta            |     128 |
| maxImageMeta             |     128 |
| maxPersonality           |       5 |
| maxPersonalitySize       |   10240 |
| maxTotalKeypairs         |     100 |
| maxServerGroups          |      10 |
| maxServerGroupMembers    |      10 |
| maxTotalFloatingIps      |      -1 |
| maxSecurityGroups        |      -1 |
| maxSecurityGroupRules    |      -1 |
| totalRAMUsed             |  606208 |
| totalCoresUsed           |     148 |
| totalInstancesUsed       |      52 |
| totalFloatingIpsUsed     |       0 |
| totalSecurityGroupsUsed  |       0 |
| totalServerGroupsUsed    |       0 |
| maxTotalVolumes          |      -1 |
| maxTotalSnapshots        |      10 |
| maxTotalVolumeGigabytes  |    4096 |
| maxTotalBackups          |      10 |
| maxTotalBackupGigabytes  |    1000 |
| totalVolumesUsed         |       3 |
| totalGigabytesUsed       |      60 |
| totalSnapshotsUsed       |       0 |
| totalBackupsUsed         |       0 |
| totalBackupGigabytesUsed |       0 |
+--------------------------+---------+
+ pushd /opt/ciman/openstack-hot
/opt/ciman/openstack-hot /w/workspace/controller-csit-3node-clustering-ask-all-titanium
+ lftools openstack --os-cloud vex stack create releng-controller-csit-3node-clustering-ask-all-titanium-43 csit-2-instance-type.yaml /w/workspace/controller-csit-3node-clustering-ask-all-titanium/stack-parameters.yaml
Creating stack releng-controller-csit-3node-clustering-ask-all-titanium-43
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Stack initialization successful.
------------------------------------
Stack Details
------------------------------------
{'added': None,
 'capabilities': [],
 'created_at': '2025-07-06T22:53:51Z',
 'deleted': None,
 'deleted_at': None,
 'description': 'No description',
 'environment': None,
 'environment_files': None,
 'files': None,
 'files_container': None,
 'id': 'bf1e00b3-cf7c-4e67-a1a1-ff3ea3fcd447',
 'is_rollback_disabled': True,
 'links': [{'href': 'https://orchestration.public.mtl1.vexxhost.net/v1/12c36e260d8e4bb2913965203b1b491f/stacks/releng-controller-csit-3node-clustering-ask-all-titanium-43/bf1e00b3-cf7c-4e67-a1a1-ff3ea3fcd447',
            'rel': 'self'}],
 'location': Munch({'cloud': 'vex', 'region_name': 'ca-ymq-1', 'zone': None, 'project': Munch({'id': '12c36e260d8e4bb2913965203b1b491f', 'name': '61975f2c-7c17-4d69-82fa-c3ae420ad6fd', 'domain_id': None, 'domain_name': 'Default'})}),
 'name': 'releng-controller-csit-3node-clustering-ask-all-titanium-43',
 'notification_topics': [],
 'outputs': [{'description': 'IP addresses of the 2nd vm types',
              'output_key': 'vm_1_ips',
              'output_value': []},
             {'description': 'IP addresses of the 1st vm types',
              'output_key': 'vm_0_ips',
              'output_value': ['10.30.171.74',
                               '10.30.171.47',
                               '10.30.170.239']}],
 'owner_id': ****,
 'parameters': {'OS::project_id': '12c36e260d8e4bb2913965203b1b491f',
                'OS::stack_id': 'bf1e00b3-cf7c-4e67-a1a1-ff3ea3fcd447',
                'OS::stack_name': 'releng-controller-csit-3node-clustering-ask-all-titanium-43',
                'job_name': '19183-43',
                'silo': 'releng',
                'vm_0_count': '3',
                'vm_0_flavor': 'v3-standard-4',
                'vm_0_image': 'ZZCI - Ubuntu 22.04 - builder - x86_64 - '
                              '20250201-010426.857',
                'vm_1_count': '0',
                'vm_1_flavor': 'v3-standard-2',
                'vm_1_image': 'ZZCI - Ubuntu 22.04 - mininet-ovs-217 - x86_64 '
                              '- 20250201-060151.911'},
 'parent_id': None,
 'replaced': None,
 'status': 'CREATE_COMPLETE',
 'status_reason': 'Stack CREATE completed successfully',
 'tags': [],
 'template': None,
 'template_description': 'No description',
 'template_url': None,
 'timeout_mins': 15,
 'unchanged': None,
 'updated': None,
 'updated_at': None,
 'user_project_id': '80965dc3d3394249a0da60b921e5062c'}
------------------------------------
+ popd
/w/workspace/controller-csit-3node-clustering-ask-all-titanium
[controller-csit-3node-clustering-ask-all-titanium] $ /bin/bash -l /tmp/jenkins16836458815214137145.sh
---> Copy SSH public keys to CSIT lab
Setup pyenv:
  system
  3.8.13
  3.9.13
  3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-ask-all-titanium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-O8Kc from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes python-heatclient python-openstackclient 
lf-activate-venv(): INFO: Adding /tmp/venv-O8Kc/bin to PATH
SSH not responding on 10.30.170.239. Retrying in 10 seconds...
SSH not responding on 10.30.171.74. Retrying in 10 seconds...
Warning: Permanently added '10.30.171.47' (ECDSA) to the list of known hosts.
 releng-19183-43-0-builder-1
Successfully copied public keys to slave 10.30.171.47
Ping to 10.30.170.239 successful.
Ping to 10.30.171.74 successful.
SSH not responding on 10.30.171.74. Retrying in 10 seconds...
SSH not responding on 10.30.170.239. Retrying in 10 seconds...
Ping to 10.30.171.74 successful.
Ping to 10.30.170.239 successful.
Warning: Permanently added '10.30.170.239' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.171.74' (ECDSA) to the list of known hosts.
 releng-19183-43-0-builder-2
Successfully copied public keys to slave 10.30.170.239
 releng-19183-43-0-builder-0
Successfully copied public keys to slave 10.30.171.74
Process 6502 ready.
Process 6503 ready.
Process 6504 ready.
SSH ready on all stack servers.
[controller-csit-3node-clustering-ask-all-titanium] $ /bin/bash -l /tmp/jenkins920279604637295968.sh
Setup pyenv:
  system
  3.8.13
  3.9.13
  3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-ask-all-titanium/.python-version)
lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-Lm7U
lf-activate-venv(): INFO: Save venv in file: /w/workspace/controller-csit-3node-clustering-ask-all-titanium/.robot_venv
lf-activate-venv(): INFO: Installing: setuptools wheel 
lf-activate-venv(): INFO: Adding /tmp/venv-Lm7U/bin to PATH
+ echo 'Installing Python Requirements'
Installing Python Requirements
+ cat
+ python -m pip install -r requirements.txt
Looking in indexes: https://nexus3.opendaylight.org/repository/PyPi/simple
Collecting docker-py (from -r requirements.txt (line 1))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/docker-py/1.10.6/docker_py-1.10.6-py2.py3-none-any.whl (50 kB)
Collecting ipaddr (from -r requirements.txt (line 2))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/ipaddr/2.2.0/ipaddr-2.2.0.tar.gz (26 kB)
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'done'
Collecting netaddr (from -r requirements.txt (line 3))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/netaddr/1.3.0/netaddr-1.3.0-py3-none-any.whl (2.3 MB)
Collecting netifaces (from -r requirements.txt (line 4))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/netifaces/0.11.0/netifaces-0.11.0.tar.gz (30 kB)
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'done'
Collecting pyhocon (from -r requirements.txt (line 5))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyhocon/0.3.61/pyhocon-0.3.61-py3-none-any.whl (25 kB)
Collecting requests (from -r requirements.txt (line 6))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/requests/2.32.4/requests-2.32.4-py3-none-any.whl (64 kB)
Collecting robotframework (from -r requirements.txt (line 7))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework/7.3.2/robotframework-7.3.2-py3-none-any.whl (795 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 795.1/795.1 kB 13.3 MB/s eta 0:00:00
Collecting robotframework-httplibrary (from -r requirements.txt (line 8))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-httplibrary/0.4.2/robotframework-httplibrary-0.4.2.tar.gz (9.1 kB)
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'done'
Collecting robotframework-requests==0.9.7 (from -r requirements.txt (line 9))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-requests/0.9.7/robotframework_requests-0.9.7-py3-none-any.whl (21 kB)
Collecting robotframework-selenium2library (from -r requirements.txt (line 10))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-selenium2library/3.0.0/robotframework_selenium2library-3.0.0-py2.py3-none-any.whl (6.2 kB)
Collecting robotframework-sshlibrary==3.8.0 (from -r requirements.txt (line 11))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-sshlibrary/3.8.0/robotframework-sshlibrary-3.8.0.tar.gz (51 kB)
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'done'
Collecting scapy (from -r requirements.txt (line 12))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/scapy/2.6.1/scapy-2.6.1-py3-none-any.whl (2.4 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.4/2.4 MB 2.8 MB/s eta 0:00:00
Collecting jsonpath-rw (from -r requirements.txt (line 15))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpath-rw/1.4.0/jsonpath-rw-1.4.0.tar.gz (13 kB)
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'done'
Collecting elasticsearch (from -r requirements.txt (line 18))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch/9.0.2/elasticsearch-9.0.2-py3-none-any.whl (914 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 914.3/914.3 kB 17.2 MB/s eta 0:00:00
Collecting elasticsearch-dsl (from -r requirements.txt (line 19))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch-dsl/8.18.0/elasticsearch_dsl-8.18.0-py3-none-any.whl (10 kB)
Collecting pyangbind (from -r requirements.txt (line 22))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyangbind/0.8.6/pyangbind-0.8.6-py3-none-any.whl (52 kB)
Collecting isodate (from -r requirements.txt (line 25))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/isodate/0.7.2/isodate-0.7.2-py3-none-any.whl (22 kB)
Collecting jmespath (from -r requirements.txt (line 28))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jmespath/1.0.1/jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting jsonpatch (from -r requirements.txt (line 31))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpatch/1.33/jsonpatch-1.33-py2.py3-none-any.whl (12 kB)
Collecting paramiko>=1.15.3 (from robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/paramiko/3.5.1/paramiko-3.5.1-py3-none-any.whl (227 kB)
Collecting scp>=0.13.0 (from robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/scp/0.15.0/scp-0.15.0-py2.py3-none-any.whl (8.8 kB)
Collecting docker-pycreds>=0.2.1 (from docker-py->-r requirements.txt (line 1))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/docker-pycreds/0.4.0/docker_pycreds-0.4.0-py2.py3-none-any.whl (9.0 kB)
Collecting six>=1.4.0 (from docker-py->-r requirements.txt (line 1))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/six/1.17.0/six-1.17.0-py2.py3-none-any.whl (11 kB)
Collecting websocket-client>=0.32.0 (from docker-py->-r requirements.txt (line 1))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/websocket-client/1.8.0/websocket_client-1.8.0-py3-none-any.whl (58 kB)
Collecting pyparsing<4,>=2 (from pyhocon->-r requirements.txt (line 5))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pyparsing/3.2.3/pyparsing-3.2.3-py3-none-any.whl (111 kB)
Collecting charset_normalizer<4,>=2 (from requests->-r requirements.txt (line 6))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/charset-normalizer/3.4.2/charset_normalizer-3.4.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (147 kB)
Collecting idna<4,>=2.5 (from requests->-r requirements.txt (line 6))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/idna/3.10/idna-3.10-py3-none-any.whl (70 kB)
Collecting urllib3<3,>=1.21.1 (from requests->-r requirements.txt (line 6))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/urllib3/2.5.0/urllib3-2.5.0-py3-none-any.whl (129 kB)
Collecting certifi>=2017.4.17 (from requests->-r requirements.txt (line 6))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/certifi/2025.6.15/certifi-2025.6.15-py3-none-any.whl (157 kB)
Collecting webtest>=2.0 (from robotframework-httplibrary->-r requirements.txt (line 8))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/webtest/3.0.6/webtest-3.0.6-py3-none-any.whl (32 kB)
Collecting jsonpointer (from robotframework-httplibrary->-r requirements.txt (line 8))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpointer/3.0.0/jsonpointer-3.0.0-py2.py3-none-any.whl (7.6 kB)
Collecting robotframework-seleniumlibrary>=3.0.0 (from robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-seleniumlibrary/6.7.1/robotframework_seleniumlibrary-6.7.1-py2.py3-none-any.whl (104 kB)
Collecting ply (from jsonpath-rw->-r requirements.txt (line 15))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/ply/3.11/ply-3.11-py2.py3-none-any.whl (49 kB)
Collecting decorator (from jsonpath-rw->-r requirements.txt (line 15))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/decorator/5.2.1/decorator-5.2.1-py3-none-any.whl (9.2 kB)
Collecting elastic-transport<9,>=8.15.1 (from elasticsearch->-r requirements.txt (line 18))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elastic-transport/8.17.1/elastic_transport-8.17.1-py3-none-any.whl (64 kB)
Collecting python-dateutil (from elasticsearch->-r requirements.txt (line 18))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/python-dateutil/2.9.0.post0/python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB)
Collecting typing-extensions (from elasticsearch->-r requirements.txt (line 18))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/typing-extensions/4.14.1/typing_extensions-4.14.1-py3-none-any.whl (43 kB)
Collecting elasticsearch (from -r requirements.txt (line 18))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch/8.18.1/elasticsearch-8.18.1-py3-none-any.whl (906 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 906.3/906.3 kB 16.4 MB/s eta 0:00:00
Collecting pyang (from pyangbind->-r requirements.txt (line 22))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyang/2.6.1/pyang-2.6.1-py2.py3-none-any.whl (594 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 594.7/594.7 kB 7.6 MB/s eta 0:00:00
Collecting lxml (from pyangbind->-r requirements.txt (line 22))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/lxml/6.0.0/lxml-6.0.0-cp311-cp311-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl (5.2 MB)
Collecting regex (from pyangbind->-r requirements.txt (line 22))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/regex/2024.11.6/regex-2024.11.6-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (792 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 792.7/792.7 kB 43.1 MB/s eta 0:00:00
Collecting enum34 (from pyangbind->-r requirements.txt (line 22))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/enum34/1.1.10/enum34-1.1.10-py3-none-any.whl (11 kB)
Collecting bcrypt>=3.2 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/bcrypt/4.3.0/bcrypt-4.3.0-cp39-abi3-manylinux_2_28_x86_64.whl (284 kB)
Collecting cryptography>=3.3 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/cryptography/45.0.5/cryptography-45.0.5-cp311-abi3-manylinux_2_28_x86_64.whl (4.5 MB)
Collecting pynacl>=1.5 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pynacl/1.5.0/PyNaCl-1.5.0-cp36-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.manylinux_2_24_x86_64.whl (856 kB)
Collecting cffi>=1.14 (from cryptography>=3.3->paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/cffi/1.17.1/cffi-1.17.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (467 kB)
Collecting pycparser (from cffi>=1.14->cryptography>=3.3->paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pycparser/2.22/pycparser-2.22-py3-none-any.whl (117 kB)
Collecting selenium>=4.3.0 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/selenium/4.34.0/selenium-4.34.0-py3-none-any.whl (9.4 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 9.4/9.4 MB 44.0 MB/s eta 0:00:00
Collecting robotframework-pythonlibcore>=4.4.1 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-pythonlibcore/4.4.1/robotframework_pythonlibcore-4.4.1-py2.py3-none-any.whl (12 kB)
Collecting click>=8.0 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/click/8.2.1/click-8.2.1-py3-none-any.whl (102 kB)
Collecting urllib3<3,>=1.21.1 (from requests->-r requirements.txt (line 6))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/urllib3/2.4.0/urllib3-2.4.0-py3-none-any.whl (128 kB)
Collecting trio~=0.30.0 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/trio/0.30.0/trio-0.30.0-py3-none-any.whl (499 kB)
Collecting trio-websocket~=0.12.2 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/trio-websocket/0.12.2/trio_websocket-0.12.2-py3-none-any.whl (21 kB)
Collecting attrs>=23.2.0 (from trio~=0.30.0->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/attrs/25.3.0/attrs-25.3.0-py3-none-any.whl (63 kB)
Collecting sortedcontainers (from trio~=0.30.0->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/sortedcontainers/2.4.0/sortedcontainers-2.4.0-py2.py3-none-any.whl (29 kB)
Collecting outcome (from trio~=0.30.0->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/outcome/1.3.0.post0/outcome-1.3.0.post0-py2.py3-none-any.whl (10 kB)
Collecting sniffio>=1.3.0 (from trio~=0.30.0->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/sniffio/1.3.1/sniffio-1.3.1-py3-none-any.whl (10 kB)
Collecting wsproto>=0.14 (from trio-websocket~=0.12.2->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/wsproto/1.2.0/wsproto-1.2.0-py3-none-any.whl (24 kB)
Collecting pysocks!=1.5.7,<2.0,>=1.5.6 (from urllib3[socks]~=2.4.0->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pysocks/1.7.1/PySocks-1.7.1-py3-none-any.whl (16 kB)
Collecting WebOb>=1.2 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/webob/1.8.9/WebOb-1.8.9-py2.py3-none-any.whl (115 kB)
Collecting waitress>=3.0.2 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/waitress/3.0.2/waitress-3.0.2-py3-none-any.whl (56 kB)
Collecting beautifulsoup4 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/beautifulsoup4/4.13.4/beautifulsoup4-4.13.4-py3-none-any.whl (187 kB)
Collecting h11<1,>=0.9.0 (from wsproto>=0.14->trio-websocket~=0.12.2->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
  Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/h11/0.16.0/h11-0.16.0-py3-none-any.whl (37 kB)
Collecting soupsieve>1.2 (from beautifulsoup4->webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
  Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/soupsieve/2.7/soupsieve-2.7-py3-none-any.whl (36 kB)
Building wheels for collected packages: robotframework-sshlibrary, ipaddr, netifaces, robotframework-httplibrary, jsonpath-rw
  DEPRECATION: Building 'robotframework-sshlibrary' using the legacy setup.py bdist_wheel mechanism, which will be removed in a future version. pip 25.3 will enforce this behaviour change. A possible replacement is to use the standardized build interface by setting the `--use-pep517` option, (possibly combined with `--no-build-isolation`), or adding a `pyproject.toml` file to the source tree of 'robotframework-sshlibrary'. Discussion can be found at https://github.com/pypa/pip/issues/6334
  Building wheel for robotframework-sshlibrary (setup.py): started
  Building wheel for robotframework-sshlibrary (setup.py): finished with status 'done'
  Created wheel for robotframework-sshlibrary: filename=robotframework_sshlibrary-3.8.0-py3-none-any.whl size=55205 sha256=07cc9ca347e130c1d2cc0b7f91846441c8c27982cd8e395f244425d186346bd0
  Stored in directory: /home/jenkins/.cache/pip/wheels/f7/c9/b3/a977b7bcc410d45ae27d240df3d00a12585509180e373ecccc
  DEPRECATION: Building 'ipaddr' using the legacy setup.py bdist_wheel mechanism, which will be removed in a future version. pip 25.3 will enforce this behaviour change. A possible replacement is to use the standardized build interface by setting the `--use-pep517` option, (possibly combined with `--no-build-isolation`), or adding a `pyproject.toml` file to the source tree of 'ipaddr'. Discussion can be found at https://github.com/pypa/pip/issues/6334
  Building wheel for ipaddr (setup.py): started
  Building wheel for ipaddr (setup.py): finished with status 'done'
  Created wheel for ipaddr: filename=ipaddr-2.2.0-py3-none-any.whl size=18353 sha256=ffe6939a639636f6b9271b285f3de3ec3699f0407c40f779f2aa3a80e7126f80
  Stored in directory: /home/jenkins/.cache/pip/wheels/dc/6c/04/da2d847fa8d45c59af3e1d83e2acc29cb8adcbaf04c0898dbf
  DEPRECATION: Building 'netifaces' using the legacy setup.py bdist_wheel mechanism, which will be removed in a future version. pip 25.3 will enforce this behaviour change. A possible replacement is to use the standardized build interface by setting the `--use-pep517` option, (possibly combined with `--no-build-isolation`), or adding a `pyproject.toml` file to the source tree of 'netifaces'. Discussion can be found at https://github.com/pypa/pip/issues/6334
  Building wheel for netifaces (setup.py): started
  Building wheel for netifaces (setup.py): finished with status 'done'
  Created wheel for netifaces: filename=netifaces-0.11.0-cp311-cp311-linux_x86_64.whl size=41081 sha256=9553c56b64d9c946aa00b04546a6f666da4e476b5e5ca2f313644ce685f36ff8
  Stored in directory: /home/jenkins/.cache/pip/wheels/f8/18/88/e61d54b995bea304bdb1d040a92b72228a1bf72ca2a3eba7c9
  DEPRECATION: Building 'robotframework-httplibrary' using the legacy setup.py bdist_wheel mechanism, which will be removed in a future version. pip 25.3 will enforce this behaviour change. A possible replacement is to use the standardized build interface by setting the `--use-pep517` option, (possibly combined with `--no-build-isolation`), or adding a `pyproject.toml` file to the source tree of 'robotframework-httplibrary'. Discussion can be found at https://github.com/pypa/pip/issues/6334
  Building wheel for robotframework-httplibrary (setup.py): started
  Building wheel for robotframework-httplibrary (setup.py): finished with status 'done'
  Created wheel for robotframework-httplibrary: filename=robotframework_httplibrary-0.4.2-py3-none-any.whl size=10014 sha256=04f4da98ef3e8a6ed38424d7135556de00572493cbfcfa57ac7e8036952b6d5c
  Stored in directory: /home/jenkins/.cache/pip/wheels/aa/bc/0d/9a20dd51effef392aae2733cb4c7b66c6fa29fca33d88b57ed
  DEPRECATION: Building 'jsonpath-rw' using the legacy setup.py bdist_wheel mechanism, which will be removed in a future version. pip 25.3 will enforce this behaviour change. A possible replacement is to use the standardized build interface by setting the `--use-pep517` option, (possibly combined with `--no-build-isolation`), or adding a `pyproject.toml` file to the source tree of 'jsonpath-rw'. Discussion can be found at https://github.com/pypa/pip/issues/6334
  Building wheel for jsonpath-rw (setup.py): started
  Building wheel for jsonpath-rw (setup.py): finished with status 'done'
  Created wheel for jsonpath-rw: filename=jsonpath_rw-1.4.0-py3-none-any.whl size=15176 sha256=52f7b6dbda92703922239b3abe89290109a32e50f23924bf69fad312641b250d
  Stored in directory: /home/jenkins/.cache/pip/wheels/f1/54/63/9a8da38cefae13755097b36cc852decc25d8ef69c37d58d4eb
Successfully built robotframework-sshlibrary ipaddr netifaces robotframework-httplibrary jsonpath-rw
Installing collected packages: sortedcontainers, ply, netifaces, ipaddr, enum34, websocket-client, WebOb, waitress, urllib3, typing-extensions, soupsieve, sniffio, six, scapy, robotframework-pythonlibcore, robotframework, regex, pysocks, pyparsing, pycparser, netaddr, lxml, jsonpointer, jmespath, isodate, idna, h11, decorator, click, charset_normalizer, certifi, bcrypt, attrs, wsproto, requests, python-dateutil, pyhocon, pyang, outcome, jsonpath-rw, jsonpatch, elastic-transport, docker-pycreds, cffi, beautifulsoup4, webtest, trio, robotframework-requests, pynacl, pyangbind, elasticsearch, docker-py, cryptography, trio-websocket, robotframework-httplibrary, paramiko, elasticsearch-dsl, selenium, scp, robotframework-sshlibrary, robotframework-seleniumlibrary, robotframework-selenium2library

Successfully installed WebOb-1.8.9 attrs-25.3.0 bcrypt-4.3.0 beautifulsoup4-4.13.4 certifi-2025.6.15 cffi-1.17.1 charset_normalizer-3.4.2 click-8.2.1 cryptography-45.0.5 decorator-5.2.1 docker-py-1.10.6 docker-pycreds-0.4.0 elastic-transport-8.17.1 elasticsearch-8.18.1 elasticsearch-dsl-8.18.0 enum34-1.1.10 h11-0.16.0 idna-3.10 ipaddr-2.2.0 isodate-0.7.2 jmespath-1.0.1 jsonpatch-1.33 jsonpath-rw-1.4.0 jsonpointer-3.0.0 lxml-6.0.0 netaddr-1.3.0 netifaces-0.11.0 outcome-1.3.0.post0 paramiko-3.5.1 ply-3.11 pyang-2.6.1 pyangbind-0.8.6 pycparser-2.22 pyhocon-0.3.61 pynacl-1.5.0 pyparsing-3.2.3 pysocks-1.7.1 python-dateutil-2.9.0.post0 regex-2024.11.6 requests-2.32.4 robotframework-7.3.2 robotframework-httplibrary-0.4.2 robotframework-pythonlibcore-4.4.1 robotframework-requests-0.9.7 robotframework-selenium2library-3.0.0 robotframework-seleniumlibrary-6.7.1 robotframework-sshlibrary-3.8.0 scapy-2.6.1 scp-0.15.0 selenium-4.34.0 six-1.17.0 sniffio-1.3.1 sortedcontainers-2.4.0 soupsieve-2.7 trio-0.30.0 trio-websocket-0.12.2 typing-extensions-4.14.1 urllib3-2.4.0 waitress-3.0.2 websocket-client-1.8.0 webtest-3.0.6 wsproto-1.2.0
+ pip freeze
attrs==25.3.0
bcrypt==4.3.0
beautifulsoup4==4.13.4
certifi==2025.6.15
cffi==1.17.1
charset-normalizer==3.4.2
click==8.2.1
cryptography==45.0.5
decorator==5.2.1
distlib==0.3.9
docker-py==1.10.6
docker-pycreds==0.4.0
elastic-transport==8.17.1
elasticsearch==8.18.1
elasticsearch-dsl==8.18.0
enum34==1.1.10
filelock==3.18.0
h11==0.16.0
idna==3.10
ipaddr==2.2.0
isodate==0.7.2
jmespath==1.0.1
jsonpatch==1.33
jsonpath-rw==1.4.0
jsonpointer==3.0.0
lxml==6.0.0
netaddr==1.3.0
netifaces==0.11.0
outcome==1.3.0.post0
paramiko==3.5.1
platformdirs==4.3.8
ply==3.11
pyang==2.6.1
pyangbind==0.8.6
pycparser==2.22
pyhocon==0.3.61
PyNaCl==1.5.0
pyparsing==3.2.3
PySocks==1.7.1
python-dateutil==2.9.0.post0
regex==2024.11.6
requests==2.32.4
robotframework==7.3.2
robotframework-httplibrary==0.4.2
robotframework-pythonlibcore==4.4.1
robotframework-requests==0.9.7
robotframework-selenium2library==3.0.0
robotframework-seleniumlibrary==6.7.1
robotframework-sshlibrary==3.8.0
scapy==2.6.1
scp==0.15.0
selenium==4.34.0
six==1.17.0
sniffio==1.3.1
sortedcontainers==2.4.0
soupsieve==2.7
trio==0.30.0
trio-websocket==0.12.2
typing_extensions==4.14.1
urllib3==2.4.0
virtualenv==20.31.2
waitress==3.0.2
WebOb==1.8.9
websocket-client==1.8.0
WebTest==3.0.6
wsproto==1.2.0
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties file path 'env.properties'
[EnvInject] - Variables injected successfully.
[controller-csit-3node-clustering-ask-all-titanium] $ /bin/bash -l /tmp/jenkins13237553805228281400.sh
Setup pyenv:
  system
  3.8.13
  3.9.13
  3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-ask-all-titanium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-O8Kc from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: python-heatclient python-openstackclient yq 
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
lftools 0.37.13 requires urllib3<2.1.0, but you have urllib3 2.5.0 which is incompatible.
lf-activate-venv(): INFO: Adding /tmp/venv-O8Kc/bin to PATH
+ ODL_SYSTEM=()
+ TOOLS_SYSTEM=()
+ OPENSTACK_SYSTEM=()
+ OPENSTACK_CONTROLLERS=()
+ mapfile -t ADDR
++ openstack stack show -f json -c outputs releng-controller-csit-3node-clustering-ask-all-titanium-43
++ jq -r '.outputs[] | select(.output_key | match("^vm_[0-9]+_ips$")) | .output_value | .[]'
+ for i in "${ADDR[@]}"
++ ssh 10.30.171.74 hostname -s
Warning: Permanently added '10.30.171.74' (ECDSA) to the list of known hosts.
+ REMHOST=releng-19183-43-0-builder-0
+ case ${REMHOST} in
+ ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}")
+ for i in "${ADDR[@]}"
++ ssh 10.30.171.47 hostname -s
Warning: Permanently added '10.30.171.47' (ECDSA) to the list of known hosts.
+ REMHOST=releng-19183-43-0-builder-1
+ case ${REMHOST} in
+ ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}")
+ for i in "${ADDR[@]}"
++ ssh 10.30.170.239 hostname -s
Warning: Permanently added '10.30.170.239' (ECDSA) to the list of known hosts.
+ REMHOST=releng-19183-43-0-builder-2
+ case ${REMHOST} in
+ ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}")
+ echo NUM_ODL_SYSTEM=3
+ echo NUM_TOOLS_SYSTEM=0
+ '[' '' == yes ']'
+ NUM_OPENSTACK_SYSTEM=0
+ echo NUM_OPENSTACK_SYSTEM=0
+ '[' 0 -eq 2 ']'
+ echo ODL_SYSTEM_IP=10.30.171.74
++ seq 0 2
+ for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 )))
+ echo ODL_SYSTEM_1_IP=10.30.171.74
+ for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 )))
+ echo ODL_SYSTEM_2_IP=10.30.171.47
+ for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 )))
+ echo ODL_SYSTEM_3_IP=10.30.170.239
+ echo TOOLS_SYSTEM_IP=
++ seq 0 -1
+ openstack_index=0
+ NUM_OPENSTACK_CONTROL_NODES=1
+ echo NUM_OPENSTACK_CONTROL_NODES=1
++ seq 0 0
+ for i in $(seq 0 $((NUM_OPENSTACK_CONTROL_NODES - 1)))
+ echo OPENSTACK_CONTROL_NODE_1_IP=
+ NUM_OPENSTACK_COMPUTE_NODES=-1
+ echo NUM_OPENSTACK_COMPUTE_NODES=-1
+ '[' -1 -ge 2 ']'
++ seq 0 -2
+ NUM_OPENSTACK_HAPROXY_NODES=0
+ echo NUM_OPENSTACK_HAPROXY_NODES=0
++ seq 0 -1
+ echo 'Contents of slave_addresses.txt:'
Contents of slave_addresses.txt:
+ cat slave_addresses.txt
NUM_ODL_SYSTEM=3
NUM_TOOLS_SYSTEM=0
NUM_OPENSTACK_SYSTEM=0
ODL_SYSTEM_IP=10.30.171.74
ODL_SYSTEM_1_IP=10.30.171.74
ODL_SYSTEM_2_IP=10.30.171.47
ODL_SYSTEM_3_IP=10.30.170.239
TOOLS_SYSTEM_IP=
NUM_OPENSTACK_CONTROL_NODES=1
OPENSTACK_CONTROL_NODE_1_IP=
NUM_OPENSTACK_COMPUTE_NODES=-1
NUM_OPENSTACK_HAPROXY_NODES=0
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties file path 'slave_addresses.txt'
[EnvInject] - Variables injected successfully.
[controller-csit-3node-clustering-ask-all-titanium] $ /bin/sh /tmp/jenkins13277231651248702649.sh
Preparing for JRE Version 21
Karaf artifact is karaf
Karaf project is integration
Java home is /usr/lib/jvm/java-21-openjdk-amd64
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties file path 'set_variables.env'
[EnvInject] - Variables injected successfully.
[controller-csit-3node-clustering-ask-all-titanium] $ /bin/bash /tmp/jenkins835775643319548593.sh
2025-07-06 22:55:51 URL:https://raw.githubusercontent.com/opendaylight/integration-distribution/master/pom.xml [2619/2619] -> "pom.xml" [1]
Bundle version is 0.22.0-SNAPSHOT
--2025-07-06 22:55:51--  https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.22.0-SNAPSHOT/maven-metadata.xml
Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6
Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 1398 (1.4K) [application/xml]
Saving to: ‘maven-metadata.xml’

     0K .                                                     100% 45.7M=0s

2025-07-06 22:55:51 (45.7 MB/s) - ‘maven-metadata.xml’ saved [1398/1398]

<?xml version="1.0" encoding="UTF-8"?>
<metadata modelVersion="1.1.0">
  <groupId>org.opendaylight.integration</groupId>
  <artifactId>karaf</artifactId>
  <version>0.22.0-SNAPSHOT</version>
  <versioning>
    <snapshot>
      <timestamp>20250706.175225</timestamp>
      <buildNumber>1</buildNumber>
    </snapshot>
    <lastUpdated>20250706175225</lastUpdated>
    <snapshotVersions>
      <snapshotVersion>
        <extension>pom</extension>
        <value>0.22.0-20250706.175225-1</value>
        <updated>20250706175225</updated>
      </snapshotVersion>
      <snapshotVersion>
        <extension>tar.gz</extension>
        <value>0.22.0-20250706.175225-1</value>
        <updated>20250706175225</updated>
      </snapshotVersion>
      <snapshotVersion>
        <extension>zip</extension>
        <value>0.22.0-20250706.175225-1</value>
        <updated>20250706175225</updated>
      </snapshotVersion>
      <snapshotVersion>
        <classifier>cyclonedx</classifier>
        <extension>xml</extension>
        <value>0.22.0-20250706.175225-1</value>
        <updated>20250706175225</updated>
      </snapshotVersion>
      <snapshotVersion>
        <classifier>cyclonedx</classifier>
        <extension>json</extension>
        <value>0.22.0-20250706.175225-1</value>
        <updated>20250706175225</updated>
      </snapshotVersion>
    </snapshotVersions>
  </versioning>
</metadata>
Nexus timestamp is 0.22.0-20250706.175225-1
Distribution bundle URL is https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.22.0-SNAPSHOT/karaf-0.22.0-20250706.175225-1.zip
Distribution bundle is karaf-0.22.0-20250706.175225-1.zip
Distribution bundle version is 0.22.0-SNAPSHOT
Distribution folder is karaf-0.22.0-SNAPSHOT
Nexus prefix is https://nexus.opendaylight.org
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties file path 'detect_variables.env'
[EnvInject] - Variables injected successfully.
[controller-csit-3node-clustering-ask-all-titanium] $ /bin/bash -l /tmp/jenkins14710930990707265759.sh
Setup pyenv:
  system
  3.8.13
  3.9.13
  3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-ask-all-titanium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-O8Kc from file:/tmp/.os_lf_venv
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
lftools 0.37.13 requires urllib3<2.1.0, but you have urllib3 2.5.0 which is incompatible.
lf-activate-venv(): INFO: Installing: python-heatclient python-openstackclient 
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
lftools 0.37.13 requires urllib3<2.1.0, but you have urllib3 2.5.0 which is incompatible.
lf-activate-venv(): INFO: Adding /tmp/venv-O8Kc/bin to PATH
Copying common-functions.sh to /tmp
Copying common-functions.sh to 10.30.171.74:/tmp
Warning: Permanently added '10.30.171.74' (ECDSA) to the list of known hosts.
Copying common-functions.sh to 10.30.171.47:/tmp
Warning: Permanently added '10.30.171.47' (ECDSA) to the list of known hosts.
Copying common-functions.sh to 10.30.170.239:/tmp
Warning: Permanently added '10.30.170.239' (ECDSA) to the list of known hosts.
[controller-csit-3node-clustering-ask-all-titanium] $ /bin/bash /tmp/jenkins15231018112170623887.sh
common-functions.sh is being sourced
common-functions environment:
MAVENCONF: /tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
ACTUALFEATURES: 
FEATURESCONF: /tmp/karaf-0.22.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
CUSTOMPROP: /tmp/karaf-0.22.0-SNAPSHOT/etc/custom.properties
LOGCONF: /tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
MEMCONF: /tmp/karaf-0.22.0-SNAPSHOT/bin/setenv
CONTROLLERMEM: 2048m
AKKACONF: /tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/pekko.conf
MODULESCONF: /tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/modules.conf
MODULESHARDSCONF: /tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/module-shards.conf
SUITES: 

#################################################
##         Configure Cluster and Start         ##
#################################################
ACTUALFEATURES: odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app
SPACE_SEPARATED_FEATURES: odl-integration-compatible-with-all odl-jolokia odl-restconf odl-clustering-test-app
Locating script plan to use...
script plan exists!!!
Changing the script plan path...
# Place the scripts in run order:
/w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/scripts/car_people_shard.sh
Executing /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/scripts/car_people_shard.sh...
Add car-people shards file
Copy shard config to member-1 with IP address 10.30.171.74
Warning: Permanently added '10.30.171.74' (ECDSA) to the list of known hosts.
Copy shard config to member-2 with IP address 10.30.171.47
Warning: Permanently added '10.30.171.47' (ECDSA) to the list of known hosts.
Copy shard config to member-3 with IP address 10.30.170.239
Warning: Permanently added '10.30.170.239' (ECDSA) to the list of known hosts.
Finished running script plans
Configuring member-1 with IP address 10.30.171.74
Warning: Permanently added '10.30.171.74' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.171.74' (ECDSA) to the list of known hosts.
+ source /tmp/common-functions.sh karaf-0.22.0-SNAPSHOT
++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]]
common-functions.sh is being sourced
++ echo 'common-functions.sh is being sourced'
++ BUNDLEFOLDER=karaf-0.22.0-SNAPSHOT
++ export MAVENCONF=/tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
++ MAVENCONF=/tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
++ export FEATURESCONF=/tmp/karaf-0.22.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
++ FEATURESCONF=/tmp/karaf-0.22.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
++ export CUSTOMPROP=/tmp/karaf-0.22.0-SNAPSHOT/etc/custom.properties
++ CUSTOMPROP=/tmp/karaf-0.22.0-SNAPSHOT/etc/custom.properties
++ export LOGCONF=/tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
++ LOGCONF=/tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
++ export MEMCONF=/tmp/karaf-0.22.0-SNAPSHOT/bin/setenv
++ MEMCONF=/tmp/karaf-0.22.0-SNAPSHOT/bin/setenv
++ export CONTROLLERMEM=
++ CONTROLLERMEM=
++ '[' '' = calcium ']'
++ CLUSTER_SYSTEM=pekko
++ export AKKACONF=/tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/pekko.conf
++ AKKACONF=/tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/pekko.conf
++ export MODULESCONF=/tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/modules.conf
++ MODULESCONF=/tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/modules.conf
++ export MODULESHARDSCONF=/tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/module-shards.conf
++ MODULESHARDSCONF=/tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/module-shards.conf
++ print_common_env
++ cat
common-functions environment:
MAVENCONF: /tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
ACTUALFEATURES: 
FEATURESCONF: /tmp/karaf-0.22.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
CUSTOMPROP: /tmp/karaf-0.22.0-SNAPSHOT/etc/custom.properties
LOGCONF: /tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
MEMCONF: /tmp/karaf-0.22.0-SNAPSHOT/bin/setenv
CONTROLLERMEM: 
AKKACONF: /tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/pekko.conf
MODULESCONF: /tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/modules.conf
MODULESHARDSCONF: /tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/module-shards.conf
SUITES: 

Changing to /tmp
Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.22.0-SNAPSHOT/karaf-0.22.0-20250706.175225-1.zip
++ SSH='ssh -t -t'
++ extra_services_cntl='     dnsmasq.service     httpd.service     libvirtd.service     openvswitch.service     ovs-vswitchd.service     ovsdb-server.service     rabbitmq-server.service '
++ extra_services_cmp='     libvirtd.service     openvswitch.service     ovs-vswitchd.service     ovsdb-server.service '
+ echo 'Changing to /tmp'
+ cd /tmp
+ echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.22.0-SNAPSHOT/karaf-0.22.0-20250706.175225-1.zip'
+ wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.22.0-SNAPSHOT/karaf-0.22.0-20250706.175225-1.zip
--2025-07-06 22:56:03--  https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.22.0-SNAPSHOT/karaf-0.22.0-20250706.175225-1.zip
Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6
Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 236095914 (225M) [application/zip]
Saving to: ‘karaf-0.22.0-20250706.175225-1.zip’

     0K ........ ........ ........ ........ ........ ........  1% 47.7M 5s
  3072K ........ ........ ........ ........ ........ ........  2% 77.9M 4s
  6144K ........ ........ ........ ........ ........ ........  3%  137M 3s
  9216K ........ ........ ........ ........ ........ ........  5%  169M 3s
 12288K ........ ........ ........ ........ ........ ........  6%  185M 2s
 15360K ........ ........ ........ ........ ........ ........  7%  129M 2s
 18432K ........ ........ ........ ........ ........ ........  9%  154M 2s
 21504K ........ ........ ........ ........ ........ ........ 10%  193M 2s
 24576K ........ ........ ........ ........ ........ ........ 11%  164M 2s
 27648K ........ ........ ........ ........ ........ ........ 13%  186M 2s
 30720K ........ ........ ........ ........ ........ ........ 14%  220M 2s
 33792K ........ ........ ........ ........ ........ ........ 15%  186M 1s
 36864K ........ ........ ........ ........ ........ ........ 17%  169M 1s
 39936K ........ ........ ........ ........ ........ ........ 18%  187M 1s
 43008K ........ ........ ........ ........ ........ ........ 19%  197M 1s
 46080K ........ ........ ........ ........ ........ ........ 21%  216M 1s
 49152K ........ ........ ........ ........ ........ ........ 22%  256M 1s
 52224K ........ ........ ........ ........ ........ ........ 23%  239M 1s
 55296K ........ ........ ........ ........ ........ ........ 25%  146M 1s
 58368K ........ ........ ........ ........ ........ ........ 26%  112M 1s
 61440K ........ ........ ........ ........ ........ ........ 27% 97.6M 1s
 64512K ........ ........ ........ ........ ........ ........ 29%  126M 1s
 67584K ........ ........ ........ ........ ........ ........ 30% 94.4M 1s
 70656K ........ ........ ........ ........ ........ ........ 31%  179M 1s
 73728K ........ ........ ........ ........ ........ ........ 33%  247M 1s
 76800K ........ ........ ........ ........ ........ ........ 34%  244M 1s
 79872K ........ ........ ........ ........ ........ ........ 35%  251M 1s
 82944K ........ ........ ........ ........ ........ ........ 37%  304M 1s
 86016K ........ ........ ........ ........ ........ ........ 38%  291M 1s
 89088K ........ ........ ........ ........ ........ ........ 39%  294M 1s
 92160K ........ ........ ........ ........ ........ ........ 41%  269M 1s
 95232K ........ ........ ........ ........ ........ ........ 42%  272M 1s
 98304K ........ ........ ........ ........ ........ ........ 43%  256M 1s
101376K ........ ........ ........ ........ ........ ........ 45%  258M 1s
104448K ........ ........ ........ ........ ........ ........ 46%  203M 1s
107520K ........ ........ ........ ........ ........ ........ 47%  277M 1s
110592K ........ ........ ........ ........ ........ ........ 49%  278M 1s
113664K ........ ........ ........ ........ ........ ........ 50%  263M 1s
116736K ........ ........ ........ ........ ........ ........ 51%  340M 1s
119808K ........ ........ ........ ........ ........ ........ 53%  284M 1s
122880K ........ ........ ........ ........ ........ ........ 54%  297M 1s
125952K ........ ........ ........ ........ ........ ........ 55%  310M 1s
129024K ........ ........ ........ ........ ........ ........ 57%  288M 1s
132096K ........ ........ ........ ........ ........ ........ 58%  304M 1s
135168K ........ ........ ........ ........ ........ ........ 59%  288M 0s
138240K ........ ........ ........ ........ ........ ........ 61%  303M 0s
141312K ........ ........ ........ ........ ........ ........ 62%  210M 0s
144384K ........ ........ ........ ........ ........ ........ 63%  407M 0s
147456K ........ ........ ........ ........ ........ ........ 65%  282M 0s
150528K ........ ........ ........ ........ ........ ........ 66%  274M 0s
153600K ........ ........ ........ ........ ........ ........ 67%  311M 0s
156672K ........ ........ ........ ........ ........ ........ 69%  259M 0s
159744K ........ ........ ........ ........ ........ ........ 70%  272M 0s
162816K ........ ........ ........ ........ ........ ........ 71%  254M 0s
165888K ........ ........ ........ ........ ........ ........ 73%  274M 0s
168960K ........ ........ ........ ........ ........ ........ 74%  299M 0s
172032K ........ ........ ........ ........ ........ ........ 75%  293M 0s
175104K ........ ........ ........ ........ ........ ........ 77%  264M 0s
178176K ........ ........ ........ ........ ........ ........ 78%  329M 0s
181248K ........ ........ ........ ........ ........ ........ 79%  287M 0s
184320K ........ ........ ........ ........ ........ ........ 81%  304M 0s
187392K ........ ........ ........ ........ ........ ........ 82%  273M 0s
190464K ........ ........ ........ ........ ........ ........ 83%  282M 0s
193536K ........ ........ ........ ........ ........ ........ 85%  325M 0s
196608K ........ ........ ........ ........ ........ ........ 86%  303M 0s
199680K ........ ........ ........ ........ ........ ........ 87%  304M 0s
202752K ........ ........ ........ ........ ........ ........ 89%  285M 0s
205824K ........ ........ ........ ........ ........ ........ 90%  297M 0s
208896K ........ ........ ........ ........ ........ ........ 91%  297M 0s
211968K ........ ........ ........ ........ ........ ........ 93%  298M 0s
215040K ........ ........ ........ ........ ........ ........ 94%  290M 0s
218112K ........ ........ ........ ........ ........ ........ 95%  273M 0s
221184K ........ ........ ........ ........ ........ ........ 97%  288M 0s
224256K ........ ........ ........ ........ ........ ........ 98%  338M 0s
227328K ........ ........ ........ ........ ........ ........ 99%  352M 0s
230400K ..                                                   100%  341M=1.1s

2025-07-06 22:56:04 (213 MB/s) - ‘karaf-0.22.0-20250706.175225-1.zip’ saved [236095914/236095914]

Extracting the new controller...
+ echo 'Extracting the new controller...'
+ unzip -q karaf-0.22.0-20250706.175225-1.zip
Adding external repositories...
+ echo 'Adding external repositories...'
+ sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
+ cat /tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
################################################################################
#
#    Licensed to the Apache Software Foundation (ASF) under one or more
#    contributor license agreements.  See the NOTICE file distributed with
#    this work for additional information regarding copyright ownership.
#    The ASF licenses this file to You under the Apache License, Version 2.0
#    (the "License"); you may not use this file except in compliance with
#    the License.  You may obtain a copy of the License at
#
#       http://www.apache.org/licenses/LICENSE-2.0
#
#    Unless required by applicable law or agreed to in writing, software
#    distributed under the License is distributed on an "AS IS" BASIS,
#    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
#    See the License for the specific language governing permissions and
#    limitations under the License.
#
################################################################################

#
# If set to true, the following property will not allow any certificate to be used
# when accessing Maven repositories through SSL
#
#org.ops4j.pax.url.mvn.certificateCheck=

#
# Path to the local Maven settings file.
# The repositories defined in this file will be automatically added to the list
# of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property
# below is not set.
# The following locations are checked for the existence of the settings.xml file
#   * 1. looks for the specified url
#   * 2. if not found looks for ${user.home}/.m2/settings.xml
#   * 3. if not found looks for ${maven.home}/conf/settings.xml
#   * 4. if not found looks for ${M2_HOME}/conf/settings.xml
#
#org.ops4j.pax.url.mvn.settings=

#
# Path to the local Maven repository which is used to avoid downloading
# artifacts when they already exist locally.
# The value of this property will be extracted from the settings.xml file
# above, or defaulted to:
#     System.getProperty( "user.home" ) + "/.m2/repository"
#
org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository}

#
# Default this to false. It's just weird to use undocumented repos
#
org.ops4j.pax.url.mvn.useFallbackRepositories=false

#
# Uncomment if you don't wanna use the proxy settings
# from the Maven conf/settings.xml file
#
# org.ops4j.pax.url.mvn.proxySupport=false

#
# Comma separated list of repositories scanned when resolving an artifact.
# Those repositories will be checked before iterating through the
#    below list of repositories and even before the local repository
# A repository url can be appended with zero or more of the following flags:
#    @snapshots  : the repository contains snaphots
#    @noreleases : the repository does not contain any released artifacts
#
# The following property value will add the system folder as a repo.
#
org.ops4j.pax.url.mvn.defaultRepositories=\
    file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\
    file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\
    file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots

# Use the default local repo (e.g.~/.m2/repository) as a "remote" repo
#org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false

#
# Comma separated list of repositories scanned when resolving an artifact.
# The default list includes the following repositories:
#    http://repo1.maven.org/maven2@id=central
#    http://repository.springsource.com/maven/bundles/release@id=spring.ebr
#    http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external
#    http://zodiac.springsource.com/maven/bundles/release@id=gemini
#    http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases
#    https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases
#    https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
# To add repositories to the default ones, prepend '+' to the list of repositories
# to add.
# A repository url can be appended with zero or more of the following flags:
#    @snapshots  : the repository contains snapshots
#    @noreleases : the repository does not contain any released artifacts
#    @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended
#
org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases

### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.+ [[ True == \T\r\u\e ]]
+ echo 'Configuring the startup features...'
Configuring the startup features...
+ sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.22.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
+ FEATURE_TEST_STRING=features-test
+ FEATURE_TEST_VERSION=0.22.0-SNAPSHOT
+ KARAF_VERSION=karaf4
+ [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]]
+ sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.22.0-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.22.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
+ [[ ! -z '' ]]
+ cat /tmp/karaf-0.22.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
################################################################################
#
#    Licensed to the Apache Software Foundation (ASF) under one or more
#    contributor license agreements.  See the NOTICE file distributed with
#    this work for additional information regarding copyright ownership.
#    The ASF licenses this file to You under the Apache License, Version 2.0
#    (the "License"); you may not use this file except in compliance with
#    the License.  You may obtain a copy of the License at
#
#       http://www.apache.org/licenses/LICENSE-2.0
#
#    Unless required by applicable law or agreed to in writing, software
#    distributed under the License is distributed on an "AS IS" BASIS,
#    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
#    See the License for the specific language governing permissions and
#    limitations under the License.
#
################################################################################

#
# Comma separated list of features repositories to register by default
#
featuresRepositories = mvn:org.opendaylight.integration/features-test/0.22.0-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/c056c0cc-5de5-4ccd-abcf-b0dd849f05a0.xml

#
# Comma separated list of features to install at startup
#
featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, 3e26bb56-8d29-423d-969e-201ab79f7500

#
# Resource repositories (OBR) that the features resolver can use
# to resolve requirements/capabilities
#
# The format of the resourceRepositories is 
# resourceRepositories=[xml:url|json:url],...
# for Instance:
#
#resourceRepositories=xml:http://host/path/to/index.xml
# or
#resourceRepositories=json:http://host/path/to/index.json
#

#
# Defines if the boot features are started in asynchronous mode (in a dedicated thread)
#
featuresBootAsynchronous=false

#
# Service requirements enforcement
#
# By default, the feature resolver checks the service requirements/capabilities of
# bundles for new features (xml schema >= 1.3.0) in order to automatically installs
# the required bundles.
# The following flag can have those values:
#   - disable: service requirements are completely ignored
#   - default: service requirements are ignored for old features
#   - enforce: service requirements are always verified
#
#serviceRequirements=default

#
# Store cfg file for config element in feature
#
#configCfgStore=true

#
# Define if the feature service automatically refresh bundles
#
autoRefresh=true

#
# Configuration of features processing mechanism (overrides, blacklisting, modification of features)
# XML file defines instructions related to features processing
# versions.properties may declare properties to resolve placeholders in XML file
# both files are relative to ${karaf.etc}
#
#featureProcessing=org.apache.karaf.features.xml
#featureProcessingVersions=versions.properties
+ configure_karaf_log karaf4 ''
+ local -r karaf_version=karaf4
+ local -r controllerdebugmap=
+ local logapi=log4j
+ grep log4j2 /tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
log4j2.rootLogger.level = INFO
#log4j2.rootLogger.type = asyncRoot
#log4j2.rootLogger.includeLocation = false
log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
log4j2.rootLogger.appenderRef.Console.ref = Console
log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
log4j2.logger.spifly.name = org.apache.aries.spifly
log4j2.logger.spifly.level = WARN
log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
log4j2.logger.audit.level = INFO
log4j2.logger.audit.additivity = false
log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
# Console appender not used by default (see log4j2.rootLogger.appenderRefs)
log4j2.appender.console.type = Console
log4j2.appender.console.name = Console
log4j2.appender.console.layout.type = PatternLayout
log4j2.appender.console.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.type = RollingRandomAccessFile
log4j2.appender.rolling.name = RollingFile
log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
#log4j2.appender.rolling.immediateFlush = false
log4j2.appender.rolling.append = true
log4j2.appender.rolling.layout.type = PatternLayout
log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.policies.type = Policies
log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.rolling.policies.size.size = 64MB
log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
log4j2.appender.rolling.strategy.max = 7
log4j2.appender.audit.type = RollingRandomAccessFile
log4j2.appender.audit.name = AuditRollingFile
log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
log4j2.appender.audit.append = true
log4j2.appender.audit.layout.type = PatternLayout
log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
log4j2.appender.audit.policies.type = Policies
log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.audit.policies.size.size = 8MB
log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
log4j2.appender.audit.strategy.max = 7
log4j2.appender.osgi.type = PaxOsgi
log4j2.appender.osgi.name = PaxOsgi
log4j2.appender.osgi.filter = *
#log4j2.logger.aether.name = shaded.org.eclipse.aether
#log4j2.logger.aether.level = TRACE
#log4j2.logger.http-headers.name = shaded.org.apache.http.headers
#log4j2.logger.http-headers.level = DEBUG
#log4j2.logger.maven.name = org.ops4j.pax.url.mvn
#log4j2.logger.maven.level = TRACE
+ logapi=log4j2
Configuring the karaf log... karaf_version: karaf4, logapi: log4j2
+ echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2'
+ '[' log4j2 == log4j2 ']'
+ sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
+ orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver
+ orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver
+ echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN'
+ echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN'
controllerdebugmap: 
cat /tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
+ unset IFS
+ echo 'controllerdebugmap: '
+ '[' -n '' ']'
+ echo 'cat /tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg'
+ cat /tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
################################################################################
#
#    Licensed to the Apache Software Foundation (ASF) under one or more
#    contributor license agreements.  See the NOTICE file distributed with
#    this work for additional information regarding copyright ownership.
#    The ASF licenses this file to You under the Apache License, Version 2.0
#    (the "License"); you may not use this file except in compliance with
#    the License.  You may obtain a copy of the License at
#
#       http://www.apache.org/licenses/LICENSE-2.0
#
#    Unless required by applicable law or agreed to in writing, software
#    distributed under the License is distributed on an "AS IS" BASIS,
#    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
#    See the License for the specific language governing permissions and
#    limitations under the License.
#
################################################################################

# Common pattern layout for appenders
log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n

# Root logger
log4j2.rootLogger.level = INFO
# uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library
#log4j2.rootLogger.type = asyncRoot
#log4j2.rootLogger.includeLocation = false
log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
log4j2.rootLogger.appenderRef.Console.ref = Console
log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}

# Filters for logs marked by org.opendaylight.odlparent.Markers
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL

# Loggers configuration

# Spifly logger
log4j2.logger.spifly.name = org.apache.aries.spifly
log4j2.logger.spifly.level = WARN

# Security audit logger
log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
log4j2.logger.audit.level = INFO
log4j2.logger.audit.additivity = false
log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile

# Appenders configuration

# Console appender not used by default (see log4j2.rootLogger.appenderRefs)
log4j2.appender.console.type = Console
log4j2.appender.console.name = Console
log4j2.appender.console.layout.type = PatternLayout
log4j2.appender.console.layout.pattern = ${log4j2.pattern}

# Rolling file appender
log4j2.appender.rolling.type = RollingRandomAccessFile
log4j2.appender.rolling.name = RollingFile
log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
# uncomment to not force a disk flush
#log4j2.appender.rolling.immediateFlush = false
log4j2.appender.rolling.append = true
log4j2.appender.rolling.layout.type = PatternLayout
log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.policies.type = Policies
log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.rolling.policies.size.size = 1GB
log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
log4j2.appender.rolling.strategy.max = 7

# Audit file appender
log4j2.appender.audit.type = RollingRandomAccessFile
log4j2.appender.audit.name = AuditRollingFile
log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
log4j2.appender.audit.append = true
log4j2.appender.audit.layout.type = PatternLayout
log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
log4j2.appender.audit.policies.type = Policies
log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.audit.policies.size.size = 8MB
log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
log4j2.appender.audit.strategy.max = 7

# OSGi appender
log4j2.appender.osgi.type = PaxOsgi
log4j2.appender.osgi.name = PaxOsgi
log4j2.appender.osgi.filter = *

# help with identification of maven-related problems with pax-url-aether
#log4j2.logger.aether.name = shaded.org.eclipse.aether
#log4j2.logger.aether.level = TRACE
#log4j2.logger.http-headers.name = shaded.org.apache.http.headers
#log4j2.logger.http-headers.level = DEBUG
#log4j2.logger.maven.name = org.ops4j.pax.url.mvn
#log4j2.logger.maven.level = TRACE
log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN
log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN
+ set_java_vars /usr/lib/jvm/java-21-openjdk-amd64 3072m /tmp/karaf-0.22.0-SNAPSHOT/bin/setenv
Configure
    java home: /usr/lib/jvm/java-21-openjdk-amd64
    max memory: 3072m
    memconf: /tmp/karaf-0.22.0-SNAPSHOT/bin/setenv
+ local -r java_home=/usr/lib/jvm/java-21-openjdk-amd64
+ local -r controllermem=3072m
+ local -r memconf=/tmp/karaf-0.22.0-SNAPSHOT/bin/setenv
+ echo Configure
+ echo '    java home: /usr/lib/jvm/java-21-openjdk-amd64'
+ echo '    max memory: 3072m'
+ echo '    memconf: /tmp/karaf-0.22.0-SNAPSHOT/bin/setenv'
+ sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64}%g' /tmp/karaf-0.22.0-SNAPSHOT/bin/setenv
+ sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.22.0-SNAPSHOT/bin/setenv
cat /tmp/karaf-0.22.0-SNAPSHOT/bin/setenv
+ echo 'cat /tmp/karaf-0.22.0-SNAPSHOT/bin/setenv'
+ cat /tmp/karaf-0.22.0-SNAPSHOT/bin/setenv
#!/bin/sh
#
#    Licensed to the Apache Software Foundation (ASF) under one or more
#    contributor license agreements.  See the NOTICE file distributed with
#    this work for additional information regarding copyright ownership.
#    The ASF licenses this file to You under the Apache License, Version 2.0
#    (the "License"); you may not use this file except in compliance with
#    the License.  You may obtain a copy of the License at
#
#       http://www.apache.org/licenses/LICENSE-2.0
#
#    Unless required by applicable law or agreed to in writing, software
#    distributed under the License is distributed on an "AS IS" BASIS,
#    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
#    See the License for the specific language governing permissions and
#    limitations under the License.
#

#
# handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf
# script: client, instance, shell, start, status, stop, karaf
#
# if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then
#   Actions go here...
# fi

#
# general settings which should be applied for all scripts go here; please keep
# in mind that it is possible that scripts might be executed more than once, e.g.
# in example of the start script where the start script is executed first and the
# karaf script afterwards.
#

#
# The following section shows the possible configuration options for the default 
# karaf scripts
#
export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64} # Location of Java installation
# export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration
# export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options
# export EXTRA_JAVA_OPTS # Additional JVM options
# export KARAF_HOME # Karaf home folder
# export KARAF_DATA # Karaf data folder
# export KARAF_BASE # Karaf base folder
# export KARAF_ETC  # Karaf etc  folder
# export KARAF_LOG  # Karaf log  folder
# export KARAF_SYSTEM_OPTS # First citizen Karaf options
# export KARAF_OPTS # Additional available Karaf options
# export KARAF_DEBUG # Enable debug mode
# export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start
# export KARAF_NOROOT # Prevent execution as root if set to true
Set Java version
+ echo 'Set Java version'
+ sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-21-openjdk-amd64/bin/java 1
sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper
sudo: a password is required
+ sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-21-openjdk-amd64/bin/java
sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper
sudo: a password is required
JDK default version ...
+ echo 'JDK default version ...'
+ java -version
openjdk version "21.0.5" 2024-10-15
OpenJDK Runtime Environment (build 21.0.5+11-Ubuntu-1ubuntu122.04)
OpenJDK 64-Bit Server VM (build 21.0.5+11-Ubuntu-1ubuntu122.04, mixed mode, sharing)
Set JAVA_HOME
+ echo 'Set JAVA_HOME'
+ export JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64
+ JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64
++ readlink -e /usr/lib/jvm/java-21-openjdk-amd64/bin/java
+ JAVA_RESOLVED=/usr/lib/jvm/java-21-openjdk-amd64/bin/java
Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java
Listing all open ports on controller system...
+ echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java'
+ echo 'Listing all open ports on controller system...'
+ netstat -pnatu
/tmp/configuration-script.sh: line 40: netstat: command not found
+ '[' -f /tmp/custom_shard_config.txt ']'
Custom shard config exists!!!
Copying the shard config...
+ echo 'Custom shard config exists!!!'
+ echo 'Copying the shard config...'
+ cp /tmp/custom_shard_config.txt /tmp/karaf-0.22.0-SNAPSHOT/bin/
Configuring cluster
+ echo 'Configuring cluster'
+ /tmp/karaf-0.22.0-SNAPSHOT/bin/configure_cluster.sh 1 10.30.171.74 10.30.171.47 10.30.170.239
################################################
##             Configure Cluster              ##
################################################
 NOTE: Cluster configuration files not found. Copying from
 /tmp/karaf-0.22.0-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/10.0.2
Configuring unique name in akka.conf
Configuring hostname in akka.conf
Configuring data and rpc seed nodes in akka.conf
modules = [
	
	{
		name = "inventory"
		namespace = "urn:opendaylight:inventory"
		shard-strategy = "module"
	},
	{
		name = "topology"
		namespace = "urn:TBD:params:xml:ns:yang:network-topology"
		shard-strategy = "module"
	},
	{
		name = "toaster"
		namespace = "http://netconfcentral.org/ns/toaster"
		shard-strategy = "module"
	},
	{
		name = "car"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
		shard-strategy = "module"
	},
	{
		name = "people"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
		shard-strategy = "module"
	},
	{
		name = "car-people"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
		shard-strategy = "module"
	}
]
Configuring replication type in module-shards.conf
################################################
##   NOTE: Manually restart controller to     ##
##         apply configuration.               ##
################################################
Dump pekko.conf
+ echo 'Dump pekko.conf'
+ cat /tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/pekko.conf
cat: /tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/pekko.conf: No such file or directory
Dump modules.conf
+ echo 'Dump modules.conf'
+ cat /tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/modules.conf
modules = [
	
	{
		name = "inventory"
		namespace = "urn:opendaylight:inventory"
		shard-strategy = "module"
	},
	{
		name = "topology"
		namespace = "urn:TBD:params:xml:ns:yang:network-topology"
		shard-strategy = "module"
	},
	{
		name = "toaster"
		namespace = "http://netconfcentral.org/ns/toaster"
		shard-strategy = "module"
	},
	{
		name = "car"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
		shard-strategy = "module"
	},
	{
		name = "people"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
		shard-strategy = "module"
	},
	{
		name = "car-people"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
		shard-strategy = "module"
	}
]
Dump module-shards.conf
+ echo 'Dump module-shards.conf'
+ cat /tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/module-shards.conf
module-shards = [
	{
		name = "default"
		shards = [
			{
				name = "default"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "inventory"
		shards = [
			{
				name="inventory"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "topology"
		shards = [
			{
				name="topology"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "toaster"
		shards = [
			{
				name="toaster"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "car"
		shards = [
			{
				name="car"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "people"
		shards = [
			{
				name="people"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "car-people"
		shards = [
			{
				name="car-people"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	}
]
Configuring member-2 with IP address 10.30.171.47
Warning: Permanently added '10.30.171.47' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.171.47' (ECDSA) to the list of known hosts.
+ source /tmp/common-functions.sh karaf-0.22.0-SNAPSHOT
common-functions.sh is being sourced
++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]]
++ echo 'common-functions.sh is being sourced'
++ BUNDLEFOLDER=karaf-0.22.0-SNAPSHOT
++ export MAVENCONF=/tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
++ MAVENCONF=/tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
++ export FEATURESCONF=/tmp/karaf-0.22.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
++ FEATURESCONF=/tmp/karaf-0.22.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
++ export CUSTOMPROP=/tmp/karaf-0.22.0-SNAPSHOT/etc/custom.properties
++ CUSTOMPROP=/tmp/karaf-0.22.0-SNAPSHOT/etc/custom.properties
++ export LOGCONF=/tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
++ LOGCONF=/tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
++ export MEMCONF=/tmp/karaf-0.22.0-SNAPSHOT/bin/setenv
++ MEMCONF=/tmp/karaf-0.22.0-SNAPSHOT/bin/setenv
++ export CONTROLLERMEM=
++ CONTROLLERMEM=
++ '[' '' = calcium ']'
++ CLUSTER_SYSTEM=pekko
++ export AKKACONF=/tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/pekko.conf
++ AKKACONF=/tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/pekko.conf
++ export MODULESCONF=/tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/modules.conf
++ MODULESCONF=/tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/modules.conf
++ export MODULESHARDSCONF=/tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/module-shards.conf
++ MODULESHARDSCONF=/tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/module-shards.conf
++ print_common_env
++ cat
common-functions environment:
MAVENCONF: /tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
ACTUALFEATURES: 
FEATURESCONF: /tmp/karaf-0.22.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
CUSTOMPROP: /tmp/karaf-0.22.0-SNAPSHOT/etc/custom.properties
LOGCONF: /tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
MEMCONF: /tmp/karaf-0.22.0-SNAPSHOT/bin/setenv
CONTROLLERMEM: 
AKKACONF: /tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/pekko.conf
MODULESCONF: /tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/modules.conf
MODULESHARDSCONF: /tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/module-shards.conf
SUITES: 

++ SSH='ssh -t -t'
++ extra_services_cntl='     dnsmasq.service     httpd.service     libvirtd.service     openvswitch.service     ovs-vswitchd.service     ovsdb-server.service     rabbitmq-server.service '
++ extra_services_cmp='     libvirtd.service     openvswitch.service     ovs-vswitchd.service     ovsdb-server.service '
Changing to /tmp
Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.22.0-SNAPSHOT/karaf-0.22.0-20250706.175225-1.zip
+ echo 'Changing to /tmp'
+ cd /tmp
+ echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.22.0-SNAPSHOT/karaf-0.22.0-20250706.175225-1.zip'
+ wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.22.0-SNAPSHOT/karaf-0.22.0-20250706.175225-1.zip
--2025-07-06 22:56:07--  https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.22.0-SNAPSHOT/karaf-0.22.0-20250706.175225-1.zip
Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6
Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 236095914 (225M) [application/zip]
Saving to: ‘karaf-0.22.0-20250706.175225-1.zip’

     0K ........ ........ ........ ........ ........ ........  1% 50.9M 4s
  3072K ........ ........ ........ ........ ........ ........  2% 79.2M 4s
  6144K ........ ........ ........ ........ ........ ........  3%  115M 3s
  9216K ........ ........ ........ ........ ........ ........  5%  141M 3s
 12288K ........ ........ ........ ........ ........ ........  6%  154M 2s
 15360K ........ ........ ........ ........ ........ ........  7%  147M 2s
 18432K ........ ........ ........ ........ ........ ........  9%  173M 2s
 21504K ........ ........ ........ ........ ........ ........ 10%  171M 2s
 24576K ........ ........ ........ ........ ........ ........ 11%  196M 2s
 27648K ........ ........ ........ ........ ........ ........ 13%  189M 2s
 30720K ........ ........ ........ ........ ........ ........ 14%  216M 2s
 33792K ........ ........ ........ ........ ........ ........ 15%  252M 1s
 36864K ........ ........ ........ ........ ........ ........ 17%  236M 1s
 39936K ........ ........ ........ ........ ........ ........ 18%  188M 1s
 43008K ........ ........ ........ ........ ........ ........ 19%  259M 1s
 46080K ........ ........ ........ ........ ........ ........ 21%  224M 1s
 49152K ........ ........ ........ ........ ........ ........ 22%  245M 1s
 52224K ........ ........ ........ ........ ........ ........ 23%  268M 1s
 55296K ........ ........ ........ ........ ........ ........ 25%  255M 1s
 58368K ........ ........ ........ ........ ........ ........ 26%  257M 1s
 61440K ........ ........ ........ ........ ........ ........ 27%  217M 1s
 64512K ........ ........ ........ ........ ........ ........ 29%  240M 1s
 67584K ........ ........ ........ ........ ........ ........ 30%  257M 1s
 70656K ........ ........ ........ ........ ........ ........ 31%  202M 1s
 73728K ........ ........ ........ ........ ........ ........ 33%  187M 1s
 76800K ........ ........ ........ ........ ........ ........ 34%  191M 1s
 79872K ........ ........ ........ ........ ........ ........ 35%  229M 1s
 82944K ........ ........ ........ ........ ........ ........ 37%  305M 1s
 86016K ........ ........ ........ ........ ........ ........ 38%  250M 1s
 89088K ........ ........ ........ ........ ........ ........ 39%  193M 1s
 92160K ........ ........ ........ ........ ........ ........ 41%  242M 1s
 95232K ........ ........ ........ ........ ........ ........ 42%  170M 1s
 98304K ........ ........ ........ ........ ........ ........ 43%  220M 1s
101376K ........ ........ ........ ........ ........ ........ 45%  266M 1s
104448K ........ ........ ........ ........ ........ ........ 46%  257M 1s
107520K ........ ........ ........ ........ ........ ........ 47%  293M 1s
110592K ........ ........ ........ ........ ........ ........ 49%  231M 1s
113664K ........ ........ ........ ........ ........ ........ 50%  262M 1s
116736K ........ ........ ........ ........ ........ ........ 51%  293M 1s
119808K ........ ........ ........ ........ ........ ........ 53%  285M 1s
122880K ........ ........ ........ ........ ........ ........ 54%  304M 1s
125952K ........ ........ ........ ........ ........ ........ 55%  184M 1s
129024K ........ ........ ........ ........ ........ ........ 57%  195M 1s
132096K ........ ........ ........ ........ ........ ........ 58%  239M 0s
135168K ........ ........ ........ ........ ........ ........ 59%  251M 0s
138240K ........ ........ ........ ........ ........ ........ 61%  211M 0s
141312K ........ ........ ........ ........ ........ ........ 62%  256M 0s
144384K ........ ........ ........ ........ ........ ........ 63%  214M 0s
147456K ........ ........ ........ ........ ........ ........ 65%  236M 0s
150528K ........ ........ ........ ........ ........ ........ 66%  209M 0s
153600K ........ ........ ........ ........ ........ ........ 67%  264M 0s
156672K ........ ........ ........ ........ ........ ........ 69%  283M 0s
159744K ........ ........ ........ ........ ........ ........ 70%  210M 0s
162816K ........ ........ ........ ........ ........ ........ 71%  256M 0s
165888K ........ ........ ........ ........ ........ ........ 73%  241M 0s
168960K ........ ........ ........ ........ ........ ........ 74%  280M 0s
172032K ........ ........ ........ ........ ........ ........ 75%  298M 0s
175104K ........ ........ ........ ........ ........ ........ 77%  231M 0s
178176K ........ ........ ........ ........ ........ ........ 78%  254M 0s
181248K ........ ........ ........ ........ ........ ........ 79%  240M 0s
184320K ........ ........ ........ ........ ........ ........ 81%  253M 0s
187392K ........ ........ ........ ........ ........ ........ 82%  269M 0s
190464K ........ ........ ........ ........ ........ ........ 83%  235M 0s
193536K ........ ........ ........ ........ ........ ........ 85%  270M 0s
196608K ........ ........ ........ ........ ........ ........ 86%  298M 0s
199680K ........ ........ ........ ........ ........ ........ 87%  214M 0s
202752K ........ ........ ........ ........ ........ ........ 89%  226M 0s
205824K ........ ........ ........ ........ ........ ........ 90%  235M 0s
208896K ........ ........ ........ ........ ........ ........ 91%  206M 0s
211968K ........ ........ ........ ........ ........ ........ 93%  280M 0s
215040K ........ ........ ........ ........ ........ ........ 94%  268M 0s
218112K ........ ........ ........ ........ ........ ........ 95%  285M 0s
221184K ........ ........ ........ ........ ........ ........ 97%  185M 0s
224256K ........ ........ ........ ........ ........ ........ 98%  301M 0s
227328K ........ ........ ........ ........ ........ ........ 99%  277M 0s
230400K ..                                                   100%  464M=1.1s

2025-07-06 22:56:08 (211 MB/s) - ‘karaf-0.22.0-20250706.175225-1.zip’ saved [236095914/236095914]

Extracting the new controller...
+ echo 'Extracting the new controller...'
+ unzip -q karaf-0.22.0-20250706.175225-1.zip
Adding external repositories...
+ echo 'Adding external repositories...'
+ sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
+ cat /tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
################################################################################
#
#    Licensed to the Apache Software Foundation (ASF) under one or more
#    contributor license agreements.  See the NOTICE file distributed with
#    this work for additional information regarding copyright ownership.
#    The ASF licenses this file to You under the Apache License, Version 2.0
#    (the "License"); you may not use this file except in compliance with
#    the License.  You may obtain a copy of the License at
#
#       http://www.apache.org/licenses/LICENSE-2.0
#
#    Unless required by applicable law or agreed to in writing, software
#    distributed under the License is distributed on an "AS IS" BASIS,
#    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
#    See the License for the specific language governing permissions and
#    limitations under the License.
#
################################################################################

#
# If set to true, the following property will not allow any certificate to be used
# when accessing Maven repositories through SSL
#
#org.ops4j.pax.url.mvn.certificateCheck=

#
# Path to the local Maven settings file.
# The repositories defined in this file will be automatically added to the list
# of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property
# below is not set.
# The following locations are checked for the existence of the settings.xml file
#   * 1. looks for the specified url
#   * 2. if not found looks for ${user.home}/.m2/settings.xml
#   * 3. if not found looks for ${maven.home}/conf/settings.xml
#   * 4. if not found looks for ${M2_HOME}/conf/settings.xml
#
#org.ops4j.pax.url.mvn.settings=

#
# Path to the local Maven repository which is used to avoid downloading
# artifacts when they already exist locally.
# The value of this property will be extracted from the settings.xml file
# above, or defaulted to:
#     System.getProperty( "user.home" ) + "/.m2/repository"
#
org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository}

#
# Default this to false. It's just weird to use undocumented repos
#
org.ops4j.pax.url.mvn.useFallbackRepositories=false

#
# Uncomment if you don't wanna use the proxy settings
# from the Maven conf/settings.xml file
#
# org.ops4j.pax.url.mvn.proxySupport=false

#
# Comma separated list of repositories scanned when resolving an artifact.
# Those repositories will be checked before iterating through the
#    below list of repositories and even before the local repository
# A repository url can be appended with zero or more of the following flags:
#    @snapshots  : the repository contains snaphots
#    @noreleases : the repository does not contain any released artifacts
#
# The following property value will add the system folder as a repo.
#
org.ops4j.pax.url.mvn.defaultRepositories=\
    file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\
    file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\
    file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots

# Use the default local repo (e.g.~/.m2/repository) as a "remote" repo
#org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false

#
# Comma separated list of repositories scanned when resolving an artifact.
# The default list includes the following repositories:
#    http://repo1.maven.org/maven2@id=central
#    http://repository.springsource.com/maven/bundles/release@id=spring.ebr
#    http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external
#    http://zodiac.springsource.com/maven/bundles/release@id=gemini
#    http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases
#    https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases
#    https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
# To add repositories to the default ones, prepend '+' to the list of repositories
# to add.
# A repository url can be appended with zero or more of the following flags:
#    @snapshots  : the repository contains snapshots
#    @noreleases : the repository does not contain any released artifacts
#    @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended
#
org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases

### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.Configuring the startup features...
+ [[ True == \T\r\u\e ]]
+ echo 'Configuring the startup features...'
+ sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.22.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
+ FEATURE_TEST_STRING=features-test
+ FEATURE_TEST_VERSION=0.22.0-SNAPSHOT
+ KARAF_VERSION=karaf4
+ [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]]
+ sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.22.0-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.22.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
+ [[ ! -z '' ]]
+ cat /tmp/karaf-0.22.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
################################################################################
#
#    Licensed to the Apache Software Foundation (ASF) under one or more
#    contributor license agreements.  See the NOTICE file distributed with
#    this work for additional information regarding copyright ownership.
#    The ASF licenses this file to You under the Apache License, Version 2.0
#    (the "License"); you may not use this file except in compliance with
#    the License.  You may obtain a copy of the License at
#
#       http://www.apache.org/licenses/LICENSE-2.0
#
#    Unless required by applicable law or agreed to in writing, software
#    distributed under the License is distributed on an "AS IS" BASIS,
#    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
#    See the License for the specific language governing permissions and
#    limitations under the License.
#
################################################################################

#
# Comma separated list of features repositories to register by default
#
featuresRepositories = mvn:org.opendaylight.integration/features-test/0.22.0-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/c056c0cc-5de5-4ccd-abcf-b0dd849f05a0.xml

#
# Comma separated list of features to install at startup
#
featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, 3e26bb56-8d29-423d-969e-201ab79f7500

#
# Resource repositories (OBR) that the features resolver can use
# to resolve requirements/capabilities
#
# The format of the resourceRepositories is 
# resourceRepositories=[xml:url|json:url],...
# for Instance:
#
#resourceRepositories=xml:http://host/path/to/index.xml
# or
#resourceRepositories=json:http://host/path/to/index.json
#

#
# Defines if the boot features are started in asynchronous mode (in a dedicated thread)
#
featuresBootAsynchronous=false

#
# Service requirements enforcement
#
# By default, the feature resolver checks the service requirements/capabilities of
# bundles for new features (xml schema >= 1.3.0) in order to automatically installs
# the required bundles.
# The following flag can have those values:
#   - disable: service requirements are completely ignored
#   - default: service requirements are ignored for old features
#   - enforce: service requirements are always verified
#
#serviceRequirements=default

#
# Store cfg file for config element in feature
#
#configCfgStore=true

#
# Define if the feature service automatically refresh bundles
#
autoRefresh=true

#
# Configuration of features processing mechanism (overrides, blacklisting, modification of features)
# XML file defines instructions related to features processing
# versions.properties may declare properties to resolve placeholders in XML file
# both files are relative to ${karaf.etc}
#
#featureProcessing=org.apache.karaf.features.xml
#featureProcessingVersions=versions.properties
+ configure_karaf_log karaf4 ''
+ local -r karaf_version=karaf4
+ local -r controllerdebugmap=
+ local logapi=log4j
+ grep log4j2 /tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
log4j2.rootLogger.level = INFO
#log4j2.rootLogger.type = asyncRoot
#log4j2.rootLogger.includeLocation = false
log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
log4j2.rootLogger.appenderRef.Console.ref = Console
log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
log4j2.logger.spifly.name = org.apache.aries.spifly
log4j2.logger.spifly.level = WARN
log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
log4j2.logger.audit.level = INFO
log4j2.logger.audit.additivity = false
log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
# Console appender not used by default (see log4j2.rootLogger.appenderRefs)
log4j2.appender.console.type = Console
log4j2.appender.console.name = Console
log4j2.appender.console.layout.type = PatternLayout
log4j2.appender.console.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.type = RollingRandomAccessFile
log4j2.appender.rolling.name = RollingFile
log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
#log4j2.appender.rolling.immediateFlush = false
log4j2.appender.rolling.append = true
log4j2.appender.rolling.layout.type = PatternLayout
log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.policies.type = Policies
log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.rolling.policies.size.size = 64MB
log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
log4j2.appender.rolling.strategy.max = 7
log4j2.appender.audit.type = RollingRandomAccessFile
log4j2.appender.audit.name = AuditRollingFile
log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
log4j2.appender.audit.append = true
log4j2.appender.audit.layout.type = PatternLayout
log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
log4j2.appender.audit.policies.type = Policies
log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.audit.policies.size.size = 8MB
log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
log4j2.appender.audit.strategy.max = 7
log4j2.appender.osgi.type = PaxOsgi
log4j2.appender.osgi.name = PaxOsgi
log4j2.appender.osgi.filter = *
#log4j2.logger.aether.name = shaded.org.eclipse.aether
#log4j2.logger.aether.level = TRACE
#log4j2.logger.http-headers.name = shaded.org.apache.http.headers
#log4j2.logger.http-headers.level = DEBUG
#log4j2.logger.maven.name = org.ops4j.pax.url.mvn
#log4j2.logger.maven.level = TRACE
Configuring the karaf log... karaf_version: karaf4, logapi: log4j2
+ logapi=log4j2
+ echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2'
+ '[' log4j2 == log4j2 ']'
+ sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
controllerdebugmap: 
+ orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver
+ orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver
+ echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN'
+ echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN'
+ unset IFS
+ echo 'controllerdebugmap: '
cat /tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
+ '[' -n '' ']'
+ echo 'cat /tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg'
+ cat /tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
################################################################################
#
#    Licensed to the Apache Software Foundation (ASF) under one or more
#    contributor license agreements.  See the NOTICE file distributed with
#    this work for additional information regarding copyright ownership.
#    The ASF licenses this file to You under the Apache License, Version 2.0
#    (the "License"); you may not use this file except in compliance with
#    the License.  You may obtain a copy of the License at
#
#       http://www.apache.org/licenses/LICENSE-2.0
#
#    Unless required by applicable law or agreed to in writing, software
#    distributed under the License is distributed on an "AS IS" BASIS,
#    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
#    See the License for the specific language governing permissions and
#    limitations under the License.
#
################################################################################

# Common pattern layout for appenders
log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n

# Root logger
log4j2.rootLogger.level = INFO
# uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library
#log4j2.rootLogger.type = asyncRoot
#log4j2.rootLogger.includeLocation = false
log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
log4j2.rootLogger.appenderRef.Console.ref = Console
log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}

# Filters for logs marked by org.opendaylight.odlparent.Markers
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL

# Loggers configuration

# Spifly logger
log4j2.logger.spifly.name = org.apache.aries.spifly
log4j2.logger.spifly.level = WARN

# Security audit logger
log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
log4j2.logger.audit.level = INFO
log4j2.logger.audit.additivity = false
log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile

# Appenders configuration

# Console appender not used by default (see log4j2.rootLogger.appenderRefs)
log4j2.appender.console.type = Console
log4j2.appender.console.name = Console
log4j2.appender.console.layout.type = PatternLayout
log4j2.appender.console.layout.pattern = ${log4j2.pattern}

# Rolling file appender
log4j2.appender.rolling.type = RollingRandomAccessFile
log4j2.appender.rolling.name = RollingFile
log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
# uncomment to not force a disk flush
#log4j2.appender.rolling.immediateFlush = false
log4j2.appender.rolling.append = true
log4j2.appender.rolling.layout.type = PatternLayout
log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.policies.type = Policies
log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.rolling.policies.size.size = 1GB
log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
log4j2.appender.rolling.strategy.max = 7

# Audit file appender
log4j2.appender.audit.type = RollingRandomAccessFile
log4j2.appender.audit.name = AuditRollingFile
log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
log4j2.appender.audit.append = true
log4j2.appender.audit.layout.type = PatternLayout
log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
log4j2.appender.audit.policies.type = Policies
log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.audit.policies.size.size = 8MB
log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
log4j2.appender.audit.strategy.max = 7

# OSGi appender
log4j2.appender.osgi.type = PaxOsgi
log4j2.appender.osgi.name = PaxOsgi
log4j2.appender.osgi.filter = *

# help with identification of maven-related problems with pax-url-aether
#log4j2.logger.aether.name = shaded.org.eclipse.aether
#log4j2.logger.aether.level = TRACE
#log4j2.logger.http-headers.name = shaded.org.apache.http.headers
#log4j2.logger.http-headers.level = DEBUG
#log4j2.logger.maven.name = org.ops4j.pax.url.mvn
#log4j2.logger.maven.level = TRACE
log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN
log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN
+ set_java_vars /usr/lib/jvm/java-21-openjdk-amd64 3072m /tmp/karaf-0.22.0-SNAPSHOT/bin/setenv
+ local -r java_home=/usr/lib/jvm/java-21-openjdk-amd64
+ local -r controllermem=3072m
Configure
    java home: /usr/lib/jvm/java-21-openjdk-amd64
+ local -r memconf=/tmp/karaf-0.22.0-SNAPSHOT/bin/setenv
+ echo Configure
+ echo '    java home: /usr/lib/jvm/java-21-openjdk-amd64'
    max memory: 3072m
    memconf: /tmp/karaf-0.22.0-SNAPSHOT/bin/setenv
+ echo '    max memory: 3072m'
+ echo '    memconf: /tmp/karaf-0.22.0-SNAPSHOT/bin/setenv'
+ sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64}%g' /tmp/karaf-0.22.0-SNAPSHOT/bin/setenv
+ sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.22.0-SNAPSHOT/bin/setenv
cat /tmp/karaf-0.22.0-SNAPSHOT/bin/setenv
+ echo 'cat /tmp/karaf-0.22.0-SNAPSHOT/bin/setenv'
+ cat /tmp/karaf-0.22.0-SNAPSHOT/bin/setenv
#!/bin/sh
#
#    Licensed to the Apache Software Foundation (ASF) under one or more
#    contributor license agreements.  See the NOTICE file distributed with
#    this work for additional information regarding copyright ownership.
#    The ASF licenses this file to You under the Apache License, Version 2.0
#    (the "License"); you may not use this file except in compliance with
#    the License.  You may obtain a copy of the License at
#
#       http://www.apache.org/licenses/LICENSE-2.0
#
#    Unless required by applicable law or agreed to in writing, software
#    distributed under the License is distributed on an "AS IS" BASIS,
#    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
#    See the License for the specific language governing permissions and
#    limitations under the License.
#

#
# handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf
# script: client, instance, shell, start, status, stop, karaf
#
# if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then
#   Actions go here...
# fi

#
# general settings which should be applied for all scripts go here; please keep
# in mind that it is possible that scripts might be executed more than once, e.g.
# in example of the start script where the start script is executed first and the
# karaf script afterwards.
#

#
# The following section shows the possible configuration options for the default 
# karaf scripts
#
export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64} # Location of Java installation
# export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration
# export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options
# export EXTRA_JAVA_OPTS # Additional JVM options
# export KARAF_HOME # Karaf home folder
# export KARAF_DATA # Karaf data folder
# export KARAF_BASE # Karaf base folder
# export KARAF_ETC  # Karaf etc  folder
# export KARAF_LOG  # Karaf log  folder
# export KARAF_SYSTEM_OPTS # First citizen Karaf options
# export KARAF_OPTS # Additional available Karaf options
# export KARAF_DEBUG # Enable debug mode
# export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start
# export KARAF_NOROOT # Prevent execution as root if set to true
Set Java version
+ echo 'Set Java version'
+ sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-21-openjdk-amd64/bin/java 1
sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper
sudo: a password is required
+ sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-21-openjdk-amd64/bin/java
sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper
sudo: a password is required
JDK default version ...
+ echo 'JDK default version ...'
+ java -version
openjdk version "21.0.5" 2024-10-15
OpenJDK Runtime Environment (build 21.0.5+11-Ubuntu-1ubuntu122.04)
OpenJDK 64-Bit Server VM (build 21.0.5+11-Ubuntu-1ubuntu122.04, mixed mode, sharing)
Set JAVA_HOME
+ echo 'Set JAVA_HOME'
+ export JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64
+ JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64
++ readlink -e /usr/lib/jvm/java-21-openjdk-amd64/bin/java
Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java
+ JAVA_RESOLVED=/usr/lib/jvm/java-21-openjdk-amd64/bin/java
+ echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java'
Listing all open ports on controller system...
+ echo 'Listing all open ports on controller system...'
+ netstat -pnatu
/tmp/configuration-script.sh: line 40: netstat: command not found
Custom shard config exists!!!
Copying the shard config...
+ '[' -f /tmp/custom_shard_config.txt ']'
+ echo 'Custom shard config exists!!!'
+ echo 'Copying the shard config...'
+ cp /tmp/custom_shard_config.txt /tmp/karaf-0.22.0-SNAPSHOT/bin/
Configuring cluster
+ echo 'Configuring cluster'
+ /tmp/karaf-0.22.0-SNAPSHOT/bin/configure_cluster.sh 2 10.30.171.74 10.30.171.47 10.30.170.239
################################################
##             Configure Cluster              ##
################################################
 NOTE: Cluster configuration files not found. Copying from
 /tmp/karaf-0.22.0-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/10.0.2
Configuring unique name in akka.conf
Configuring hostname in akka.conf
Configuring data and rpc seed nodes in akka.conf
modules = [
	
	{
		name = "inventory"
		namespace = "urn:opendaylight:inventory"
		shard-strategy = "module"
	},
	{
		name = "topology"
		namespace = "urn:TBD:params:xml:ns:yang:network-topology"
		shard-strategy = "module"
	},
	{
		name = "toaster"
		namespace = "http://netconfcentral.org/ns/toaster"
		shard-strategy = "module"
	},
	{
		name = "car"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
		shard-strategy = "module"
	},
	{
		name = "people"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
		shard-strategy = "module"
	},
	{
		name = "car-people"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
		shard-strategy = "module"
	}
]
Configuring replication type in module-shards.conf
################################################
##   NOTE: Manually restart controller to     ##
##         apply configuration.               ##
################################################
+ echo 'Dump pekko.conf'
Dump pekko.conf
+ cat /tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/pekko.conf
cat: /tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/pekko.conf: No such file or directory
Dump modules.conf
+ echo 'Dump modules.conf'
+ cat /tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/modules.conf
modules = [
	
	{
		name = "inventory"
		namespace = "urn:opendaylight:inventory"
		shard-strategy = "module"
	},
	{
		name = "topology"
		namespace = "urn:TBD:params:xml:ns:yang:network-topology"
		shard-strategy = "module"
	},
	{
		name = "toaster"
		namespace = "http://netconfcentral.org/ns/toaster"
		shard-strategy = "module"
	},
	{
		name = "car"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
		shard-strategy = "module"
	},
	{
		name = "people"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
		shard-strategy = "module"
	},
	{
		name = "car-people"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
		shard-strategy = "module"
	}
]
Dump module-shards.conf
+ echo 'Dump module-shards.conf'
+ cat /tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/module-shards.conf
module-shards = [
	{
		name = "default"
		shards = [
			{
				name = "default"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "inventory"
		shards = [
			{
				name="inventory"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "topology"
		shards = [
			{
				name="topology"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "toaster"
		shards = [
			{
				name="toaster"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "car"
		shards = [
			{
				name="car"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "people"
		shards = [
			{
				name="people"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "car-people"
		shards = [
			{
				name="car-people"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	}
]
Configuring member-3 with IP address 10.30.170.239
Warning: Permanently added '10.30.170.239' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.170.239' (ECDSA) to the list of known hosts.
+ source /tmp/common-functions.sh karaf-0.22.0-SNAPSHOT
++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]]
++ echo 'common-functions.sh is being sourced'
common-functions.sh is being sourced
++ BUNDLEFOLDER=karaf-0.22.0-SNAPSHOT
++ export MAVENCONF=/tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
++ MAVENCONF=/tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
++ export FEATURESCONF=/tmp/karaf-0.22.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
++ FEATURESCONF=/tmp/karaf-0.22.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
++ export CUSTOMPROP=/tmp/karaf-0.22.0-SNAPSHOT/etc/custom.properties
++ CUSTOMPROP=/tmp/karaf-0.22.0-SNAPSHOT/etc/custom.properties
++ export LOGCONF=/tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
++ LOGCONF=/tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
++ export MEMCONF=/tmp/karaf-0.22.0-SNAPSHOT/bin/setenv
++ MEMCONF=/tmp/karaf-0.22.0-SNAPSHOT/bin/setenv
++ export CONTROLLERMEM=
++ CONTROLLERMEM=
++ '[' '' = calcium ']'
++ CLUSTER_SYSTEM=pekko
++ export AKKACONF=/tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/pekko.conf
++ AKKACONF=/tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/pekko.conf
++ export MODULESCONF=/tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/modules.conf
++ MODULESCONF=/tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/modules.conf
++ export MODULESHARDSCONF=/tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/module-shards.conf
++ MODULESHARDSCONF=/tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/module-shards.conf
++ print_common_env
++ cat
common-functions environment:
MAVENCONF: /tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
ACTUALFEATURES: 
FEATURESCONF: /tmp/karaf-0.22.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
CUSTOMPROP: /tmp/karaf-0.22.0-SNAPSHOT/etc/custom.properties
LOGCONF: /tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
MEMCONF: /tmp/karaf-0.22.0-SNAPSHOT/bin/setenv
CONTROLLERMEM: 
AKKACONF: /tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/pekko.conf
MODULESCONF: /tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/modules.conf
MODULESHARDSCONF: /tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/module-shards.conf
SUITES: 

++ SSH='ssh -t -t'
++ extra_services_cntl='     dnsmasq.service     httpd.service     libvirtd.service     openvswitch.service     ovs-vswitchd.service     ovsdb-server.service     rabbitmq-server.service '
++ extra_services_cmp='     libvirtd.service     openvswitch.service     ovs-vswitchd.service     ovsdb-server.service '
Changing to /tmp
Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.22.0-SNAPSHOT/karaf-0.22.0-20250706.175225-1.zip
+ echo 'Changing to /tmp'
+ cd /tmp
+ echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.22.0-SNAPSHOT/karaf-0.22.0-20250706.175225-1.zip'
+ wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.22.0-SNAPSHOT/karaf-0.22.0-20250706.175225-1.zip
--2025-07-06 22:56:12--  https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.22.0-SNAPSHOT/karaf-0.22.0-20250706.175225-1.zip
Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6
Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 236095914 (225M) [application/zip]
Saving to: ‘karaf-0.22.0-20250706.175225-1.zip’

     0K ........ ........ ........ ........ ........ ........  1% 70.0M 3s
  3072K ........ ........ ........ ........ ........ ........  2%  102M 3s
  6144K ........ ........ ........ ........ ........ ........  3%  107M 2s
  9216K ........ ........ ........ ........ ........ ........  5%  175M 2s
 12288K ........ ........ ........ ........ ........ ........  6%  171M 2s
 15360K ........ ........ ........ ........ ........ ........  7%  161M 2s
 18432K ........ ........ ........ ........ ........ ........  9%  171M 2s
 21504K ........ ........ ........ ........ ........ ........ 10%  190M 2s
 24576K ........ ........ ........ ........ ........ ........ 11%  208M 1s
 27648K ........ ........ ........ ........ ........ ........ 13%  220M 1s
 30720K ........ ........ ........ ........ ........ ........ 14%  221M 1s
 33792K ........ ........ ........ ........ ........ ........ 15%  216M 1s
 36864K ........ ........ ........ ........ ........ ........ 17%  226M 1s
 39936K ........ ........ ........ ........ ........ ........ 18%  243M 1s
 43008K ........ ........ ........ ........ ........ ........ 19%  276M 1s
 46080K ........ ........ ........ ........ ........ ........ 21%  249M 1s
 49152K ........ ........ ........ ........ ........ ........ 22%  233M 1s
 52224K ........ ........ ........ ........ ........ ........ 23%  265M 1s
 55296K ........ ........ ........ ........ ........ ........ 25%  250M 1s
 58368K ........ ........ ........ ........ ........ ........ 26%  251M 1s
 61440K ........ ........ ........ ........ ........ ........ 27%  254M 1s
 64512K ........ ........ ........ ........ ........ ........ 29%  235M 1s
 67584K ........ ........ ........ ........ ........ ........ 30%  228M 1s
 70656K ........ ........ ........ ........ ........ ........ 31%  254M 1s
 73728K ........ ........ ........ ........ ........ ........ 33%  250M 1s
 76800K ........ ........ ........ ........ ........ ........ 34%  242M 1s
 79872K ........ ........ ........ ........ ........ ........ 35%  239M 1s
 82944K ........ ........ ........ ........ ........ ........ 37%  259M 1s
 86016K ........ ........ ........ ........ ........ ........ 38%  224M 1s
 89088K ........ ........ ........ ........ ........ ........ 39%  249M 1s
 92160K ........ ........ ........ ........ ........ ........ 41%  264M 1s
 95232K ........ ........ ........ ........ ........ ........ 42%  248M 1s
 98304K ........ ........ ........ ........ ........ ........ 43%  220M 1s
101376K ........ ........ ........ ........ ........ ........ 45%  256M 1s
104448K ........ ........ ........ ........ ........ ........ 46%  250M 1s
107520K ........ ........ ........ ........ ........ ........ 47%  248M 1s
110592K ........ ........ ........ ........ ........ ........ 49%  277M 1s
113664K ........ ........ ........ ........ ........ ........ 50%  244M 1s
116736K ........ ........ ........ ........ ........ ........ 51%  250M 1s
119808K ........ ........ ........ ........ ........ ........ 53%  232M 1s
122880K ........ ........ ........ ........ ........ ........ 54%  254M 0s
125952K ........ ........ ........ ........ ........ ........ 55%  254M 0s
129024K ........ ........ ........ ........ ........ ........ 57%  241M 0s
132096K ........ ........ ........ ........ ........ ........ 58%  245M 0s
135168K ........ ........ ........ ........ ........ ........ 59%  250M 0s
138240K ........ ........ ........ ........ ........ ........ 61%  258M 0s
141312K ........ ........ ........ ........ ........ ........ 62%  259M 0s
144384K ........ ........ ........ ........ ........ ........ 63%  233M 0s
147456K ........ ........ ........ ........ ........ ........ 65%  255M 0s
150528K ........ ........ ........ ........ ........ ........ 66%  211M 0s
153600K ........ ........ ........ ........ ........ ........ 67%  265M 0s
156672K ........ ........ ........ ........ ........ ........ 69%  268M 0s
159744K ........ ........ ........ ........ ........ ........ 70%  245M 0s
162816K ........ ........ ........ ........ ........ ........ 71%  258M 0s
165888K ........ ........ ........ ........ ........ ........ 73%  272M 0s
168960K ........ ........ ........ ........ ........ ........ 74%  241M 0s
172032K ........ ........ ........ ........ ........ ........ 75%  261M 0s
175104K ........ ........ ........ ........ ........ ........ 77%  265M 0s
178176K ........ ........ ........ ........ ........ ........ 78%  256M 0s
181248K ........ ........ ........ ........ ........ ........ 79%  267M 0s
184320K ........ ........ ........ ........ ........ ........ 81%  239M 0s
187392K ........ ........ ........ ........ ........ ........ 82%  223M 0s
190464K ........ ........ ........ ........ ........ ........ 83%  260M 0s
193536K ........ ........ ........ ........ ........ ........ 85%  276M 0s
196608K ........ ........ ........ ........ ........ ........ 86%  253M 0s
199680K ........ ........ ........ ........ ........ ........ 87%  250M 0s
202752K ........ ........ ........ ........ ........ ........ 89%  253M 0s
205824K ........ ........ ........ ........ ........ ........ 90%  238M 0s
208896K ........ ........ ........ ........ ........ ........ 91%  245M 0s
211968K ........ ........ ........ ........ ........ ........ 93%  250M 0s
215040K ........ ........ ........ ........ ........ ........ 94%  225M 0s
218112K ........ ........ ........ ........ ........ ........ 95%  233M 0s
221184K ........ ........ ........ ........ ........ ........ 97%  237M 0s
224256K ........ ........ ........ ........ ........ ........ 98%  224M 0s
227328K ........ ........ ........ ........ ........ ........ 99%  257M 0s
230400K ..                                                   100%  280M=1.0s

2025-07-06 22:56:13 (224 MB/s) - ‘karaf-0.22.0-20250706.175225-1.zip’ saved [236095914/236095914]

Extracting the new controller...
+ echo 'Extracting the new controller...'
+ unzip -q karaf-0.22.0-20250706.175225-1.zip
Adding external repositories...
+ echo 'Adding external repositories...'
+ sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
+ cat /tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
################################################################################
#
#    Licensed to the Apache Software Foundation (ASF) under one or more
#    contributor license agreements.  See the NOTICE file distributed with
#    this work for additional information regarding copyright ownership.
#    The ASF licenses this file to You under the Apache License, Version 2.0
#    (the "License"); you may not use this file except in compliance with
#    the License.  You may obtain a copy of the License at
#
#       http://www.apache.org/licenses/LICENSE-2.0
#
#    Unless required by applicable law or agreed to in writing, software
#    distributed under the License is distributed on an "AS IS" BASIS,
#    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
#    See the License for the specific language governing permissions and
#    limitations under the License.
#
################################################################################

#
# If set to true, the following property will not allow any certificate to be used
# when accessing Maven repositories through SSL
#
#org.ops4j.pax.url.mvn.certificateCheck=

#
# Path to the local Maven settings file.
# The repositories defined in this file will be automatically added to the list
# of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property
# below is not set.
# The following locations are checked for the existence of the settings.xml file
#   * 1. looks for the specified url
#   * 2. if not found looks for ${user.home}/.m2/settings.xml
#   * 3. if not found looks for ${maven.home}/conf/settings.xml
#   * 4. if not found looks for ${M2_HOME}/conf/settings.xml
#
#org.ops4j.pax.url.mvn.settings=

#
# Path to the local Maven repository which is used to avoid downloading
# artifacts when they already exist locally.
# The value of this property will be extracted from the settings.xml file
# above, or defaulted to:
#     System.getProperty( "user.home" ) + "/.m2/repository"
#
org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository}

#
# Default this to false. It's just weird to use undocumented repos
#
org.ops4j.pax.url.mvn.useFallbackRepositories=false

#
# Uncomment if you don't wanna use the proxy settings
# from the Maven conf/settings.xml file
#
# org.ops4j.pax.url.mvn.proxySupport=false

#
# Comma separated list of repositories scanned when resolving an artifact.
# Those repositories will be checked before iterating through the
#    below list of repositories and even before the local repository
# A repository url can be appended with zero or more of the following flags:
#    @snapshots  : the repository contains snaphots
#    @noreleases : the repository does not contain any released artifacts
#
# The following property value will add the system folder as a repo.
#
org.ops4j.pax.url.mvn.defaultRepositories=\
    file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\
    file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\
    file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots

# Use the default local repo (e.g.~/.m2/repository) as a "remote" repo
#org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false

#
# Comma separated list of repositories scanned when resolving an artifact.
# The default list includes the following repositories:
#    http://repo1.maven.org/maven2@id=central
#    http://repository.springsource.com/maven/bundles/release@id=spring.ebr
#    http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external
#    http://zodiac.springsource.com/maven/bundles/release@id=gemini
#    http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases
#    https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases
#    https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
# To add repositories to the default ones, prepend '+' to the list of repositories
# to add.
# A repository url can be appended with zero or more of the following flags:
#    @snapshots  : the repository contains snapshots
#    @noreleases : the repository does not contain any released artifacts
#    @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended
#
org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases

### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.Configuring the startup features...
+ [[ True == \T\r\u\e ]]
+ echo 'Configuring the startup features...'
+ sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.22.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
+ FEATURE_TEST_STRING=features-test
+ FEATURE_TEST_VERSION=0.22.0-SNAPSHOT
+ KARAF_VERSION=karaf4
+ [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]]
+ sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.22.0-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.22.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
+ [[ ! -z '' ]]
+ cat /tmp/karaf-0.22.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
################################################################################
#
#    Licensed to the Apache Software Foundation (ASF) under one or more
#    contributor license agreements.  See the NOTICE file distributed with
#    this work for additional information regarding copyright ownership.
#    The ASF licenses this file to You under the Apache License, Version 2.0
#    (the "License"); you may not use this file except in compliance with
#    the License.  You may obtain a copy of the License at
#
#       http://www.apache.org/licenses/LICENSE-2.0
#
#    Unless required by applicable law or agreed to in writing, software
#    distributed under the License is distributed on an "AS IS" BASIS,
#    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
#    See the License for the specific language governing permissions and
#    limitations under the License.
#
################################################################################

#
# Comma separated list of features repositories to register by default
#
featuresRepositories = mvn:org.opendaylight.integration/features-test/0.22.0-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/c056c0cc-5de5-4ccd-abcf-b0dd849f05a0.xml

#
# Comma separated list of features to install at startup
#
featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, 3e26bb56-8d29-423d-969e-201ab79f7500

#
# Resource repositories (OBR) that the features resolver can use
# to resolve requirements/capabilities
#
# The format of the resourceRepositories is 
# resourceRepositories=[xml:url|json:url],...
# for Instance:
#
#resourceRepositories=xml:http://host/path/to/index.xml
# or
#resourceRepositories=json:http://host/path/to/index.json
#

#
# Defines if the boot features are started in asynchronous mode (in a dedicated thread)
#
featuresBootAsynchronous=false

#
# Service requirements enforcement
#
# By default, the feature resolver checks the service requirements/capabilities of
# bundles for new features (xml schema >= 1.3.0) in order to automatically installs
# the required bundles.
# The following flag can have those values:
#   - disable: service requirements are completely ignored
#   - default: service requirements are ignored for old features
#   - enforce: service requirements are always verified
#
#serviceRequirements=default

#
# Store cfg file for config element in feature
#
#configCfgStore=true

#
# Define if the feature service automatically refresh bundles
#
autoRefresh=true

#
# Configuration of features processing mechanism (overrides, blacklisting, modification of features)
# XML file defines instructions related to features processing
# versions.properties may declare properties to resolve placeholders in XML file
# both files are relative to ${karaf.etc}
#
#featureProcessing=org.apache.karaf.features.xml
#featureProcessingVersions=versions.properties
+ configure_karaf_log karaf4 ''
+ local -r karaf_version=karaf4
+ local -r controllerdebugmap=
+ local logapi=log4j
+ grep log4j2 /tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
log4j2.rootLogger.level = INFO
#log4j2.rootLogger.type = asyncRoot
#log4j2.rootLogger.includeLocation = false
log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
log4j2.rootLogger.appenderRef.Console.ref = Console
log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
log4j2.logger.spifly.name = org.apache.aries.spifly
log4j2.logger.spifly.level = WARN
log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
log4j2.logger.audit.level = INFO
log4j2.logger.audit.additivity = false
log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
# Console appender not used by default (see log4j2.rootLogger.appenderRefs)
log4j2.appender.console.type = Console
log4j2.appender.console.name = Console
log4j2.appender.console.layout.type = PatternLayout
log4j2.appender.console.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.type = RollingRandomAccessFile
log4j2.appender.rolling.name = RollingFile
log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
#log4j2.appender.rolling.immediateFlush = false
log4j2.appender.rolling.append = true
log4j2.appender.rolling.layout.type = PatternLayout
log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.policies.type = Policies
log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.rolling.policies.size.size = 64MB
log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
log4j2.appender.rolling.strategy.max = 7
log4j2.appender.audit.type = RollingRandomAccessFile
log4j2.appender.audit.name = AuditRollingFile
log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
log4j2.appender.audit.append = true
log4j2.appender.audit.layout.type = PatternLayout
log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
log4j2.appender.audit.policies.type = Policies
log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.audit.policies.size.size = 8MB
log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
log4j2.appender.audit.strategy.max = 7
log4j2.appender.osgi.type = PaxOsgi
log4j2.appender.osgi.name = PaxOsgi
log4j2.appender.osgi.filter = *
#log4j2.logger.aether.name = shaded.org.eclipse.aether
#log4j2.logger.aether.level = TRACE
#log4j2.logger.http-headers.name = shaded.org.apache.http.headers
#log4j2.logger.http-headers.level = DEBUG
#log4j2.logger.maven.name = org.ops4j.pax.url.mvn
#log4j2.logger.maven.level = TRACE
+ logapi=log4j2
+ echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2'
Configuring the karaf log... karaf_version: karaf4, logapi: log4j2
+ '[' log4j2 == log4j2 ']'
+ sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
+ orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver
+ orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver
+ echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN'
+ echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN'
controllerdebugmap: 
cat /tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
+ unset IFS
+ echo 'controllerdebugmap: '
+ '[' -n '' ']'
+ echo 'cat /tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg'
+ cat /tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
################################################################################
#
#    Licensed to the Apache Software Foundation (ASF) under one or more
#    contributor license agreements.  See the NOTICE file distributed with
#    this work for additional information regarding copyright ownership.
#    The ASF licenses this file to You under the Apache License, Version 2.0
#    (the "License"); you may not use this file except in compliance with
#    the License.  You may obtain a copy of the License at
#
#       http://www.apache.org/licenses/LICENSE-2.0
#
#    Unless required by applicable law or agreed to in writing, software
#    distributed under the License is distributed on an "AS IS" BASIS,
#    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
#    See the License for the specific language governing permissions and
#    limitations under the License.
#
################################################################################

# Common pattern layout for appenders
log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n

# Root logger
log4j2.rootLogger.level = INFO
# uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library
#log4j2.rootLogger.type = asyncRoot
#log4j2.rootLogger.includeLocation = false
log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
log4j2.rootLogger.appenderRef.Console.ref = Console
log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}

# Filters for logs marked by org.opendaylight.odlparent.Markers
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL

# Loggers configuration

# Spifly logger
log4j2.logger.spifly.name = org.apache.aries.spifly
log4j2.logger.spifly.level = WARN

# Security audit logger
log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
log4j2.logger.audit.level = INFO
log4j2.logger.audit.additivity = false
log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile

# Appenders configuration

# Console appender not used by default (see log4j2.rootLogger.appenderRefs)
log4j2.appender.console.type = Console
log4j2.appender.console.name = Console
log4j2.appender.console.layout.type = PatternLayout
log4j2.appender.console.layout.pattern = ${log4j2.pattern}

# Rolling file appender
log4j2.appender.rolling.type = RollingRandomAccessFile
log4j2.appender.rolling.name = RollingFile
log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
# uncomment to not force a disk flush
#log4j2.appender.rolling.immediateFlush = false
log4j2.appender.rolling.append = true
log4j2.appender.rolling.layout.type = PatternLayout
log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.policies.type = Policies
log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.rolling.policies.size.size = 1GB
log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
log4j2.appender.rolling.strategy.max = 7

# Audit file appender
log4j2.appender.audit.type = RollingRandomAccessFile
log4j2.appender.audit.name = AuditRollingFile
log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
log4j2.appender.audit.append = true
log4j2.appender.audit.layout.type = PatternLayout
log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
log4j2.appender.audit.policies.type = Policies
log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.audit.policies.size.size = 8MB
log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
log4j2.appender.audit.strategy.max = 7

# OSGi appender
log4j2.appender.osgi.type = PaxOsgi
log4j2.appender.osgi.name = PaxOsgi
log4j2.appender.osgi.filter = *

# help with identification of maven-related problems with pax-url-aether
#log4j2.logger.aether.name = shaded.org.eclipse.aether
#log4j2.logger.aether.level = TRACE
#log4j2.logger.http-headers.name = shaded.org.apache.http.headers
#log4j2.logger.http-headers.level = DEBUG
#log4j2.logger.maven.name = org.ops4j.pax.url.mvn
#log4j2.logger.maven.level = TRACE
log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN
log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN
+ set_java_vars /usr/lib/jvm/java-21-openjdk-amd64 3072m /tmp/karaf-0.22.0-SNAPSHOT/bin/setenv
Configure
    java home: /usr/lib/jvm/java-21-openjdk-amd64
+ local -r java_home=/usr/lib/jvm/java-21-openjdk-amd64
+ local -r controllermem=3072m
+ local -r memconf=/tmp/karaf-0.22.0-SNAPSHOT/bin/setenv
+ echo Configure
+ echo '    java home: /usr/lib/jvm/java-21-openjdk-amd64'
+ echo '    max memory: 3072m'
    max memory: 3072m
    memconf: /tmp/karaf-0.22.0-SNAPSHOT/bin/setenv
+ echo '    memconf: /tmp/karaf-0.22.0-SNAPSHOT/bin/setenv'
+ sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64}%g' /tmp/karaf-0.22.0-SNAPSHOT/bin/setenv
+ sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.22.0-SNAPSHOT/bin/setenv
cat /tmp/karaf-0.22.0-SNAPSHOT/bin/setenv
+ echo 'cat /tmp/karaf-0.22.0-SNAPSHOT/bin/setenv'
+ cat /tmp/karaf-0.22.0-SNAPSHOT/bin/setenv
#!/bin/sh
#
#    Licensed to the Apache Software Foundation (ASF) under one or more
#    contributor license agreements.  See the NOTICE file distributed with
#    this work for additional information regarding copyright ownership.
#    The ASF licenses this file to You under the Apache License, Version 2.0
#    (the "License"); you may not use this file except in compliance with
#    the License.  You may obtain a copy of the License at
#
#       http://www.apache.org/licenses/LICENSE-2.0
#
#    Unless required by applicable law or agreed to in writing, software
#    distributed under the License is distributed on an "AS IS" BASIS,
#    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
#    See the License for the specific language governing permissions and
#    limitations under the License.
#

#
# handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf
# script: client, instance, shell, start, status, stop, karaf
#
# if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then
#   Actions go here...
# fi

#
# general settings which should be applied for all scripts go here; please keep
# in mind that it is possible that scripts might be executed more than once, e.g.
# in example of the start script where the start script is executed first and the
# karaf script afterwards.
#

#
# The following section shows the possible configuration options for the default 
# karaf scripts
#
export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64} # Location of Java installation
# export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration
# export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options
# export EXTRA_JAVA_OPTS # Additional JVM options
# export KARAF_HOME # Karaf home folder
# export KARAF_DATA # Karaf data folder
# export KARAF_BASE # Karaf base folder
# export KARAF_ETC  # Karaf etc  folder
# export KARAF_LOG  # Karaf log  folder
# export KARAF_SYSTEM_OPTS # First citizen Karaf options
# export KARAF_OPTS # Additional available Karaf options
# export KARAF_DEBUG # Enable debug mode
# export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start
# export KARAF_NOROOT # Prevent execution as root if set to true
Set Java version
+ echo 'Set Java version'
+ sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-21-openjdk-amd64/bin/java 1
sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper
sudo: a password is required
+ sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-21-openjdk-amd64/bin/java
sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper
sudo: a password is required
JDK default version ...
+ echo 'JDK default version ...'
+ java -version
openjdk version "21.0.5" 2024-10-15
OpenJDK Runtime Environment (build 21.0.5+11-Ubuntu-1ubuntu122.04)
OpenJDK 64-Bit Server VM (build 21.0.5+11-Ubuntu-1ubuntu122.04, mixed mode, sharing)
Set JAVA_HOME
+ echo 'Set JAVA_HOME'
+ export JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64
+ JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64
++ readlink -e /usr/lib/jvm/java-21-openjdk-amd64/bin/java
Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java
+ JAVA_RESOLVED=/usr/lib/jvm/java-21-openjdk-amd64/bin/java
+ echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java'
Listing all open ports on controller system...
+ echo 'Listing all open ports on controller system...'
+ netstat -pnatu
/tmp/configuration-script.sh: line 40: netstat: command not found
Custom shard config exists!!!
Copying the shard config...
+ '[' -f /tmp/custom_shard_config.txt ']'
+ echo 'Custom shard config exists!!!'
+ echo 'Copying the shard config...'
+ cp /tmp/custom_shard_config.txt /tmp/karaf-0.22.0-SNAPSHOT/bin/
Configuring cluster
+ echo 'Configuring cluster'
+ /tmp/karaf-0.22.0-SNAPSHOT/bin/configure_cluster.sh 3 10.30.171.74 10.30.171.47 10.30.170.239
################################################
##             Configure Cluster              ##
################################################
 NOTE: Cluster configuration files not found. Copying from
 /tmp/karaf-0.22.0-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/10.0.2
Configuring unique name in akka.conf
Configuring hostname in akka.conf
Configuring data and rpc seed nodes in akka.conf
modules = [
	
	{
		name = "inventory"
		namespace = "urn:opendaylight:inventory"
		shard-strategy = "module"
	},
	{
		name = "topology"
		namespace = "urn:TBD:params:xml:ns:yang:network-topology"
		shard-strategy = "module"
	},
	{
		name = "toaster"
		namespace = "http://netconfcentral.org/ns/toaster"
		shard-strategy = "module"
	},
	{
		name = "car"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
		shard-strategy = "module"
	},
	{
		name = "people"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
		shard-strategy = "module"
	},
	{
		name = "car-people"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
		shard-strategy = "module"
	}
]
Configuring replication type in module-shards.conf
################################################
##   NOTE: Manually restart controller to     ##
##         apply configuration.               ##
################################################
Dump pekko.conf
+ echo 'Dump pekko.conf'
+ cat /tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/pekko.conf
cat: /tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/pekko.conf: No such file or directory
Dump modules.conf
+ echo 'Dump modules.conf'
+ cat /tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/modules.conf
modules = [
	
	{
		name = "inventory"
		namespace = "urn:opendaylight:inventory"
		shard-strategy = "module"
	},
	{
		name = "topology"
		namespace = "urn:TBD:params:xml:ns:yang:network-topology"
		shard-strategy = "module"
	},
	{
		name = "toaster"
		namespace = "http://netconfcentral.org/ns/toaster"
		shard-strategy = "module"
	},
	{
		name = "car"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
		shard-strategy = "module"
	},
	{
		name = "people"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
		shard-strategy = "module"
	},
	{
		name = "car-people"
		namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
		shard-strategy = "module"
	}
]
Dump module-shards.conf
+ echo 'Dump module-shards.conf'
+ cat /tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/module-shards.conf
module-shards = [
	{
		name = "default"
		shards = [
			{
				name = "default"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "inventory"
		shards = [
			{
				name="inventory"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "topology"
		shards = [
			{
				name="topology"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "toaster"
		shards = [
			{
				name="toaster"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "car"
		shards = [
			{
				name="car"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "people"
		shards = [
			{
				name="people"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	},
	{
		name = "car-people"
		shards = [
			{
				name="car-people"
				replicas = ["member-1",
				"member-2",
				"member-3"]
			}
		]
	}
]
Locating config plan to use...
Finished running config plans
Starting member-1 with IP address 10.30.171.74
Warning: Permanently added '10.30.171.74' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.171.74' (ECDSA) to the list of known hosts.
Redirecting karaf console output to karaf_console.log
Starting controller...
start: Redirecting Karaf output to /tmp/karaf-0.22.0-SNAPSHOT/data/log/karaf_console.log
Starting member-2 with IP address 10.30.171.47
Warning: Permanently added '10.30.171.47' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.171.47' (ECDSA) to the list of known hosts.
Redirecting karaf console output to karaf_console.log
Starting controller...
start: Redirecting Karaf output to /tmp/karaf-0.22.0-SNAPSHOT/data/log/karaf_console.log
Starting member-3 with IP address 10.30.170.239
Warning: Permanently added '10.30.170.239' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.170.239' (ECDSA) to the list of known hosts.
Redirecting karaf console output to karaf_console.log
Starting controller...
start: Redirecting Karaf output to /tmp/karaf-0.22.0-SNAPSHOT/data/log/karaf_console.log
[controller-csit-3node-clustering-ask-all-titanium] $ /bin/bash /tmp/jenkins15416506884460740059.sh
common-functions.sh is being sourced
common-functions environment:
MAVENCONF: /tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
ACTUALFEATURES: 
FEATURESCONF: /tmp/karaf-0.22.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
CUSTOMPROP: /tmp/karaf-0.22.0-SNAPSHOT/etc/custom.properties
LOGCONF: /tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
MEMCONF: /tmp/karaf-0.22.0-SNAPSHOT/bin/setenv
CONTROLLERMEM: 2048m
AKKACONF: /tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/pekko.conf
MODULESCONF: /tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/modules.conf
MODULESHARDSCONF: /tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/module-shards.conf
SUITES: 

+ echo '#################################################'
#################################################
+ echo '##         Verify Cluster is UP                ##'
##         Verify Cluster is UP                ##
+ echo '#################################################'
#################################################
+ create_post_startup_script
+ cat
+ copy_and_run_post_startup_script
+ seed_index=1
++ seq 1 3
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_1_IP
+ echo 'Execute the post startup script on controller 10.30.171.74'
Execute the post startup script on controller 10.30.171.74
+ scp /w/workspace/controller-csit-3node-clustering-ask-all-titanium/post-startup-script.sh 10.30.171.74:/tmp/
Warning: Permanently added '10.30.171.74' (ECDSA) to the list of known hosts.
+ ssh 10.30.171.74 'bash /tmp/post-startup-script.sh 1'
Warning: Permanently added '10.30.171.74' (ECDSA) to the list of known hosts.
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
Waiting up to 3 minutes for controller to come up, checking every 5 seconds...
2025-07-06T22:57:11,075 | INFO  | SystemReadyService-0 | SimpleSystemReadyMonitor         | 292 - org.opendaylight.infrautils.ready-api - 7.0.3 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
Controller is UP
2025-07-06T22:57:11,075 | INFO  | SystemReadyService-0 | SimpleSystemReadyMonitor         | 292 - org.opendaylight.infrautils.ready-api - 7.0.3 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
Listing all open ports on controller system...
/tmp/post-startup-script.sh: line 51: netstat: command not found
looking for "BindException: Address already in use" in log file
looking for "server is unhealthy" in log file
+ '[' 1 == 0 ']'
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_2_IP
+ echo 'Execute the post startup script on controller 10.30.171.47'
Execute the post startup script on controller 10.30.171.47
+ scp /w/workspace/controller-csit-3node-clustering-ask-all-titanium/post-startup-script.sh 10.30.171.47:/tmp/
Warning: Permanently added '10.30.171.47' (ECDSA) to the list of known hosts.
+ ssh 10.30.171.47 'bash /tmp/post-startup-script.sh 2'
Warning: Permanently added '10.30.171.47' (ECDSA) to the list of known hosts.
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
Waiting up to 3 minutes for controller to come up, checking every 5 seconds...
2025-07-06T22:57:11,067 | INFO  | SystemReadyService-0 | SimpleSystemReadyMonitor         | 292 - org.opendaylight.infrautils.ready-api - 7.0.3 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
Controller is UP
2025-07-06T22:57:11,067 | INFO  | SystemReadyService-0 | SimpleSystemReadyMonitor         | 292 - org.opendaylight.infrautils.ready-api - 7.0.3 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
Listing all open ports on controller system...
/tmp/post-startup-script.sh: line 51: netstat: command not found
looking for "BindException: Address already in use" in log file
looking for "server is unhealthy" in log file
+ '[' 2 == 0 ']'
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_3_IP
+ echo 'Execute the post startup script on controller 10.30.170.239'
Execute the post startup script on controller 10.30.170.239
+ scp /w/workspace/controller-csit-3node-clustering-ask-all-titanium/post-startup-script.sh 10.30.170.239:/tmp/
Warning: Permanently added '10.30.170.239' (ECDSA) to the list of known hosts.
+ ssh 10.30.170.239 'bash /tmp/post-startup-script.sh 3'
Warning: Permanently added '10.30.170.239' (ECDSA) to the list of known hosts.
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
Waiting up to 3 minutes for controller to come up, checking every 5 seconds...
2025-07-06T22:57:11,465 | INFO  | SystemReadyService-0 | SimpleSystemReadyMonitor         | 292 - org.opendaylight.infrautils.ready-api - 7.0.3 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
Controller is UP
2025-07-06T22:57:11,465 | INFO  | SystemReadyService-0 | SimpleSystemReadyMonitor         | 292 - org.opendaylight.infrautils.ready-api - 7.0.3 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
Listing all open ports on controller system...
/tmp/post-startup-script.sh: line 51: netstat: command not found
looking for "BindException: Address already in use" in log file
looking for "server is unhealthy" in log file
+ '[' 0 == 0 ']'
+ seed_index=1
+ dump_controller_threads
++ seq 1 3
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_1_IP
+ echo 'Let'\''s take the karaf thread dump'
Let's take the karaf thread dump
+ ssh 10.30.171.74 'sudo ps aux'
Warning: Permanently added '10.30.171.74' (ECDSA) to the list of known hosts.
++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-ask-all-titanium/ps_before.log
++ cut -f2 '-d '
++ grep -v grep
++ tr -s ' '
+ pid=2083
+ echo 'karaf main: org.apache.karaf.main.Main, pid:2083'
karaf main: org.apache.karaf.main.Main, pid:2083
+ ssh 10.30.171.74 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 2083'
Warning: Permanently added '10.30.171.74' (ECDSA) to the list of known hosts.
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_2_IP
+ echo 'Let'\''s take the karaf thread dump'
Let's take the karaf thread dump
+ ssh 10.30.171.47 'sudo ps aux'
Warning: Permanently added '10.30.171.47' (ECDSA) to the list of known hosts.
++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-ask-all-titanium/ps_before.log
++ grep -v grep
++ tr -s ' '
++ cut -f2 '-d '
+ pid=2078
+ echo 'karaf main: org.apache.karaf.main.Main, pid:2078'
karaf main: org.apache.karaf.main.Main, pid:2078
+ ssh 10.30.171.47 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 2078'
Warning: Permanently added '10.30.171.47' (ECDSA) to the list of known hosts.
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_3_IP
+ echo 'Let'\''s take the karaf thread dump'
Let's take the karaf thread dump
+ ssh 10.30.170.239 'sudo ps aux'
Warning: Permanently added '10.30.170.239' (ECDSA) to the list of known hosts.
++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-ask-all-titanium/ps_before.log
++ grep -v grep
++ tr -s ' '
++ cut -f2 '-d '
+ pid=2083
+ echo 'karaf main: org.apache.karaf.main.Main, pid:2083'
karaf main: org.apache.karaf.main.Main, pid:2083
+ ssh 10.30.170.239 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 2083'
Warning: Permanently added '10.30.170.239' (ECDSA) to the list of known hosts.
+ '[' 0 -gt 0 ']'
+ echo 'Generating controller variables...'
Generating controller variables...
++ seq 1 3
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_1_IP
+ odl_variables=' -v ODL_SYSTEM_1_IP:10.30.171.74'
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_2_IP
+ odl_variables=' -v ODL_SYSTEM_1_IP:10.30.171.74 -v ODL_SYSTEM_2_IP:10.30.171.47'
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_3_IP
+ odl_variables=' -v ODL_SYSTEM_1_IP:10.30.171.74 -v ODL_SYSTEM_2_IP:10.30.171.47 -v ODL_SYSTEM_3_IP:10.30.170.239'
+ echo 'Generating mininet variables...'
Generating mininet variables...
++ seq 1 0
+ get_test_suites SUITES
+ local __suite_list=SUITES
+ echo 'Locating test plan to use...'
Locating test plan to use...
+ testplan_filepath=/w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/testplans/controller-clustering-ask-titanium.txt
+ '[' '!' -f /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/testplans/controller-clustering-ask-titanium.txt ']'
+ testplan_filepath=/w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/testplans/controller-clustering-ask.txt
+ '[' disabled '!=' disabled ']'
+ echo 'Changing the testplan path...'
Changing the testplan path...
+ sed s:integration:/w/workspace/controller-csit-3node-clustering-ask-all-titanium: /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/testplans/controller-clustering-ask.txt
+ cat testplan.txt
# Place the suites in run order:
/w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot
/w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence.robot
/w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot
/w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_partition_and_heal.robot
/w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot
/w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_rpc_broker/action_provider_precedence.robot
/w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot
/w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_rpc_broker/action_provider_partition_and_heal.robot
/w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot
/w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/cluster_singleton/master_stability.robot
/w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot
/w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot
/w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot
/w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot
/w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot
/w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/singleton_service/global_rpc_kill.robot
/w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot
/w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/singleton_service/global_rpc_freeze.robot
/w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot
/w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/singleton_service/global_rpc_isolate.robot
/w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot
/w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot
/w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot
/w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot
/w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot
/w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot
/w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot
/w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot
/w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot
+ '[' -z '' ']'
++ grep -E -v '(^[[:space:]]*#|^[[:space:]]*$)' testplan.txt
++ tr '\012' ' '
+ suite_list='/w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_rpc_broker/action_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_rpc_broker/action_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/singleton_service/global_rpc_kill.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/singleton_service/global_rpc_freeze.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/singleton_service/global_rpc_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot '
+ eval 'SUITES='\''/w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_rpc_broker/action_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_rpc_broker/action_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/singleton_service/global_rpc_kill.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/singleton_service/global_rpc_freeze.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/singleton_service/global_rpc_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot '\'''
++ SUITES='/w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_rpc_broker/action_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_rpc_broker/action_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/singleton_service/global_rpc_kill.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/singleton_service/global_rpc_freeze.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/singleton_service/global_rpc_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot '
+ echo 'Starting Robot test suites /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_rpc_broker/action_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_rpc_broker/action_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/singleton_service/global_rpc_kill.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/singleton_service/global_rpc_freeze.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/singleton_service/global_rpc_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot  ...'
Starting Robot test suites /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_rpc_broker/action_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_rpc_broker/action_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/singleton_service/global_rpc_kill.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/singleton_service/global_rpc_freeze.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/singleton_service/global_rpc_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot  ...
+ robot -N controller-clustering-ask.txt --removekeywords wuks -e exclude -e skip_if_titanium -v BUNDLEFOLDER:karaf-0.22.0-SNAPSHOT -v BUNDLE_URL:https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.22.0-SNAPSHOT/karaf-0.22.0-20250706.175225-1.zip -v CONTROLLER:10.30.171.74 -v CONTROLLER1:10.30.171.47 -v CONTROLLER2:10.30.170.239 -v CONTROLLER_USER:jenkins -v JAVA_HOME:/usr/lib/jvm/java-21-openjdk-amd64 -v JDKVERSION:openjdk21 -v JENKINS_WORKSPACE:/w/workspace/controller-csit-3node-clustering-ask-all-titanium -v MININET: -v MININET1: -v MININET2: -v MININET_USER:jenkins -v NEXUSURL_PREFIX:https://nexus.opendaylight.org -v NUM_ODL_SYSTEM:3 -v NUM_TOOLS_SYSTEM:0 -v ODL_STREAM:titanium -v ODL_SYSTEM_IP:10.30.171.74 -v ODL_SYSTEM_1_IP:10.30.171.74 -v ODL_SYSTEM_2_IP:10.30.171.47 -v ODL_SYSTEM_3_IP:10.30.170.239 -v ODL_SYSTEM_USER:jenkins -v TOOLS_SYSTEM_IP: -v TOOLS_SYSTEM_USER:jenkins -v USER_HOME:/home/jenkins -v IS_KARAF_APPL:True -v WORKSPACE:/tmp /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_rpc_broker/action_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_rpc_broker/action_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/singleton_service/global_rpc_kill.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/singleton_service/global_rpc_freeze.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/singleton_service/global_rpc_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot
==============================================================================
controller-clustering-ask.txt                                                 
==============================================================================
controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te...
==============================================================================
Stop_All_Members :: Stop every odl node.                              | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.239', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-ask.txt.Rpc Provider Precedence :: DOMRpcBroker testi...
==============================================================================
Register_Rpc_On_Each_Node :: Register global rpc on each node of t... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_rpc_provider_precedence_register_rpc_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_precedence_register_rpc_on_each_node&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.170.239', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Invoke_Rpc_On_Each_Node :: Verify that the rpc response comes from... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_rpc_provider_precedence_invoke_rpc_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_precedence_invoke_rpc_on_each_node&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.170.239', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Unregister_Rpc_On_Node :: Unregister the rpc on one of the cluster... | PASS |
------------------------------------------------------------------------------
Invoke_Rpc_On_Node_With_Unregistered_Rpc :: Invoke rcp on the node... | PASS |
------------------------------------------------------------------------------
Invoke_Rpc_On_Remaining_Nodes :: Verify that the rpc response come... | PASS |
------------------------------------------------------------------------------
Reregister_Rpc_On_Node :: Reregister the rpc.                         | PASS |
------------------------------------------------------------------------------
Invoke_Rpc_On_Each_Node_Again :: Verify that the rpc response come... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_rpc_provider_precedence_invoke_rpc_on_each_node_again"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_precedence_invoke_rpc_on_each_node_again&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.170.239', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Unregister_Rpc_On_Each_Node :: Unregister rpc on every node.          | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_rpc_provider_precedence_unregister_rpc_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_precedence_unregister_rpc_on_each_node&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.170.239', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-ask.txt.Rpc Provider Precedence :: DOMRpcBro... | FAIL |
8 tests, 4 passed, 4 failed
==============================================================================
controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te...
==============================================================================
Stop_All_Members :: Stop every odl node.                              | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.239', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-ask.txt.Rpc Provider Partition And Heal :: DOMRpcBrok...
==============================================================================
Register_Rpc_On_Two_Nodes :: Register rpc on two nodes of the odl ... | PASS |
------------------------------------------------------------------------------
Invoke_Rpc_On_Each_Node :: Invoke get-constant rpc on every node o... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_rpc_provider_partition_and_heal_invoke_rpc_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_partition_and_heal_invoke_rpc_on_each_node&order=bug_status"

Keyword 'Verify_Constant_On_Active_Nodes' failed after retrying for 10 seconds. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.239', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Isolate_One_Node :: Isolate one node with registered rpc. From the... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_rpc_provider_partition_and_heal_isolate_one_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_partition_and_heal_isolate_one_node&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.170.239', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Invoke_Rpc_On_Nonisolated_Nodes :: Invoke rpc on non-islolated nodes. | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_rpc_provider_partition_and_heal_invoke_rpc_on_nonisolated_nodes"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_partition_and_heal_invoke_rpc_on_nonisolated_nodes&order=bug_status"

Keyword 'DrbCommons.Verify_Constant_On_Active_Nodes' failed after retrying for 1 minute. The last error was: Keyword 'Verify_Constant_On_Active_Nodes' failed after retrying for 10 seconds. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.239', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Rejoin_Isolated_Member :: Rejoin isolated node                        | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_rpc_provider_partition_and_heal_rejoin_isolated_member"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_partition_and_heal_rejoin_isolated_member&order=bug_status"

Variable '${isolated_idx}' not found.
------------------------------------------------------------------------------
Invoke_Rpc_On_Each_Node_Again :: Invoke rpc get-constant on every ... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_rpc_provider_partition_and_heal_invoke_rpc_on_each_node_again"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_partition_and_heal_invoke_rpc_on_each_node_again&order=bug_status"

Keyword 'Verify_Constant_On_Active_Nodes' failed after retrying for 10 seconds. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.239', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Unregister_Rpc_On_Each_Node :: Inregister rpc on both nodes.          | PASS |
------------------------------------------------------------------------------
controller-clustering-ask.txt.Rpc Provider Partition And Heal :: D... | FAIL |
7 tests, 2 passed, 5 failed
==============================================================================
controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te...
==============================================================================
Stop_All_Members :: Stop every odl node.                              | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.239', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-ask.txt.Action Provider Precedence :: DOMRpcBroker te...
==============================================================================
Register_Rpc_On_Each_Node :: Register routed rpc on each node of t... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_action_provider_precedence_register_rpc_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_precedence_register_rpc_on_each_node&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.170.239', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Invoke_Rpc_On_Each_Node :: Verify that the rpc response comes from... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_action_provider_precedence_invoke_rpc_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_precedence_invoke_rpc_on_each_node&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.170.239', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Unregister_Rpc_On_Node :: Unregister the rpc on one of the cluster... | PASS |
------------------------------------------------------------------------------
Invoke_Rpc_On_Node_With_Unregistered_Rpc :: Invoke rcp on the node... | PASS |
------------------------------------------------------------------------------
Invoke_Rpc_On_Remaining_Nodes :: Verify that the rpc response come... | PASS |
------------------------------------------------------------------------------
Reregister_Rpc_On_Node :: Reregister the rpc.                         | PASS |
------------------------------------------------------------------------------
Invoke_Rpc_On_Each_Node_Again :: Verify that the rpc response come... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_action_provider_precedence_invoke_rpc_on_each_node_again"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_precedence_invoke_rpc_on_each_node_again&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.170.239', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Unregister_Rpc_On_Each_Node :: Unregister rpc on every node.          | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_action_provider_precedence_unregister_rpc_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_precedence_unregister_rpc_on_each_node&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.170.239', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-ask.txt.Action Provider Precedence :: DOMRpc... | FAIL |
8 tests, 4 passed, 4 failed
==============================================================================
controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te...
==============================================================================
Stop_All_Members :: Stop every odl node.                              | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.239', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-ask.txt.Action Provider Partition And Heal :: DOMRpcB...
==============================================================================
Register_Rpc_On_Two_Nodes :: Register rpc on two nodes of the odl ... | PASS |
------------------------------------------------------------------------------
Invoke_Rpc_On_Each_Node :: Invoke get-contexted-constant rpc on ev... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_action_provider_partition_and_heal_invoke_rpc_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_partition_and_heal_invoke_rpc_on_each_node&order=bug_status"

Keyword 'Verify_Contexted_Constant_On_Active_Nodes' failed after retrying for 10 seconds. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.239', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Isolate_One_Node :: Isolate one node with registered rpc.             | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_action_provider_partition_and_heal_isolate_one_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_partition_and_heal_isolate_one_node&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.170.239', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Invoke_Rpc_On_Remaining_Nodes :: Invoke rpc on non-islolated nodes... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_action_provider_partition_and_heal_invoke_rpc_on_remaining_nodes"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_partition_and_heal_invoke_rpc_on_remaining_nodes&order=bug_status"

Keyword 'DrbCommons.Verify_Contexted_Constant_On_Active_Nodes' failed after retrying for 1 minute. The last error was: Keyword 'Verify_Contexted_Constant_On_Active_Nodes' failed after retrying for 10 seconds. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.239', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Rejoin_Isolated_Member :: Rejoin isolated node                        | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_action_provider_partition_and_heal_rejoin_isolated_member"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_partition_and_heal_rejoin_isolated_member&order=bug_status"

Variable '${isolated_idx}' not found.
------------------------------------------------------------------------------
Invoke_Rpc_On_Each_Node_Again :: Invoke rpc get-contexted-constant... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_action_provider_partition_and_heal_invoke_rpc_on_each_node_again"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_partition_and_heal_invoke_rpc_on_each_node_again&order=bug_status"

Keyword 'Verify_Contexted_Constant_On_Active_Nodes' failed after retrying for 10 seconds. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.239', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Unregister_Rpc_On_Each_Node :: Inregister rpc on both nodes.          | PASS |
------------------------------------------------------------------------------
controller-clustering-ask.txt.Action Provider Partition And Heal :... | FAIL |
7 tests, 2 passed, 5 failed
==============================================================================
controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te...
==============================================================================
Stop_All_Members :: Stop every odl node.                              | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.239', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-ask.txt.Master Stability :: Cluster Singleton testing...
==============================================================================
Register_Singleton_Constant_On_Each_Node_And_Verify :: Register a ... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_master_stability_register_singleton_constant_on_each_node_and_verify"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_master_stability_register_singleton_constant_on_each_node_and_verify&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.170.239', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Unregister_Singleton_Constant_On_Non_Master_Node :: Unregister the... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_master_stability_unregister_singleton_constant_on_non_master_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_master_stability_unregister_singleton_constant_on_non_master_node&order=bug_status"

Variable '@{cs_candidates}' not found. Did you mean:
    @{cs_exp_candidates}
------------------------------------------------------------------------------
Monitor_Stability_While_Unregistered :: Verify that the owner rema... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_master_stability_monitor_stability_while_unregistered"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_master_stability_monitor_stability_while_unregistered&order=bug_status"

Variable '${cs_owner}' not found.
------------------------------------------------------------------------------
Reregister_Singleton_Constant :: Re-register the unregistered cand... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_master_stability_reregister_singleton_constant"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_master_stability_reregister_singleton_constant&order=bug_status"

Variable '${unregistered_node}' not found.
------------------------------------------------------------------------------
Verify_Stability_After_Reregistration :: Verify that the owner rem... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_master_stability_verify_stability_after_reregistration"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_master_stability_verify_stability_after_reregistration&order=bug_status"

Variable '${cs_owner}' not found.
------------------------------------------------------------------------------
Unregister_Singleton_Constant_On_Each_Node :: Unregister the appli... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_master_stability_unregister_singleton_constant_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_master_stability_unregister_singleton_constant_on_each_node&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.170.239', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-ask.txt.Master Stability :: Cluster Singleto... | FAIL |
6 tests, 0 passed, 6 failed
==============================================================================
controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te...
==============================================================================
Stop_All_Members :: Stop every odl node.                              | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.47:8181/jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore
------------------------------------------------------------------------------
controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-ask.txt.Partition And Heal :: Cluster Singleton testi...
==============================================================================
Register_Singleton_Constant_On_Each_Node :: Register a candidate a... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_partition_and_heal_register_singleton_constant_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_partition_and_heal_register_singleton_constant_on_each_node&order=bug_status"

HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.47:8181/rests/operations/odl-mdsal-lowlevel-control:register-singleton-constant
------------------------------------------------------------------------------
Verify_Singleton_Constant_On_Each_Node :: Store the owner and cand... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_partition_and_heal_verify_singleton_constant_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_partition_and_heal_verify_singleton_constant_on_each_node&order=bug_status"

Could not parse owner and candidates for device get-singleton-constant-service']
------------------------------------------------------------------------------
Isolate_Owner_Node :: Isolate the cluster node which is the owner.... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_partition_and_heal_isolate_owner_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_partition_and_heal_isolate_owner_node&order=bug_status"

Variable '${cs_owner}' not found.
------------------------------------------------------------------------------
Monitor_Stability_While_Isolated :: Monitor the stability of the s... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_partition_and_heal_monitor_stability_while_isolated"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_partition_and_heal_monitor_stability_while_isolated&order=bug_status"

Invalid IF condition: Evaluating expression '"${index}" == "${cs_isolated_index}"' failed: Variable '${cs_isolated_index}' not found.
------------------------------------------------------------------------------
Rejoin_Isolated_node :: Rejoin isolated node.                         | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_partition_and_heal_rejoin_isolated_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_partition_and_heal_rejoin_isolated_node&order=bug_status"

Variable '${cs_isolated_index}' not found.
------------------------------------------------------------------------------
Unregister_Singleton_Constant_On_Each_Node :: Unregister the appli... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_partition_and_heal_unregister_singleton_constant_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_partition_and_heal_unregister_singleton_constant_on_each_node&order=bug_status"

ConnectionError: HTTPConnectionPool(host='10.30.171.47', port=8181): Max retries exceeded with url: /rests/operations/odl-mdsal-lowlevel-control:unregister-singleton-constant (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fce737e7c10>: Failed to establish a new connection: [Errno 111] Connection refused'))
------------------------------------------------------------------------------
controller-clustering-ask.txt.Partition And Heal :: Cluster Single... | FAIL |
6 tests, 0 passed, 6 failed
==============================================================================
controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te...
==============================================================================
Stop_All_Members :: Stop every odl node.                              | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.239', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-ask.txt.Chasing The Leader :: Cluster Singleton testi...
==============================================================================
Register_Candidates :: Register a candidate application on each no... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_chasing_the_leader_register_candidates"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_chasing_the_leader_register_candidates&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.170.239', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Do_Nothing :: Do nothing for the time of the test duration, becaus... | PASS |
------------------------------------------------------------------------------
Unregister_Candidates_And_Validate_Criteria :: Unregister the test... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_ask_txt_chasing_the_leader_unregister_candidates_and_validate_criteria"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_chasing_the_leader_unregister_candidates_and_validate_criteria&order=bug_status"

ReadTimeout: HTTPConnectionPool(host='10.30.170.239', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-ask.txt.Chasing The Leader :: Cluster Single... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te...
==============================================================================
Stop_All_Members :: Stop every odl node.                              | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.239', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-ask.txt.Global Rpc Kill :: Controller functional HA t...
==============================================================================
Get_Basic_Rpc_Test_Owner :: Find a service owner and successors.      | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Rpc_Before_Stopping_On_Owner :: Run rpc on the service owner.         | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Rpc_Before_Stop_On_Successors :: Run rpc on non owher cluster nodes.  | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Stop_Current_Owner_Member :: Stop cluster node which is the owner.    | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Verify_New_Basic_Rpc_Test_Owner_Elected :: Verify new owner of the... | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Rpc_On_Remained_Cluster_Nodes :: Run rpc on remained cluster nodes.   | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Restart_Stopped_Member :: Restart stopped node                        | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Verify_New_Owner_Remained_After_Rejoin :: Verify no owner change h... | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Rpc_After_Rejoin_On_New_Owner :: Run rpc on the new service owner ... | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Rpc_After_Rejoin_On_Old_Owner :: Run rpc on rejoined cluster node.    | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Rpc_After_Rejoin_On_All :: Run rpc again on all nodes.                | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
controller-clustering-ask.txt.Global Rpc Kill :: Controller functi... | FAIL |
Suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.

11 tests, 0 passed, 11 failed
==============================================================================
controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te...
==============================================================================
Stop_All_Members :: Stop every odl node.                              | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.239', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-ask.txt.Global Rpc Freeze :: Controller functional HA...
==============================================================================
Get_Basic_Rpc_Test_Owner :: Find a service owner and successors.      | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Rpc_Before_Freezing_On_Owner :: Run rpc on the service owner.         | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Rpc_Before_Freeze_On_Successors :: Run rpc on non owher cluster no... | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Freeze_Current_Owner_Member :: Stop cluster node which is the owner.  | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Verify_New_Basic_Rpc_Test_Owner_Elected :: Verify new owner of the... | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Rpc_On_Remained_Cluster_Nodes :: Run rpc on remained cluster nodes.   | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Unfreeze_Frozen_Member :: Restart frozen node                         | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Rpc_After_Rejoin_On_New_Owner :: Run rpc on the new service owner ... | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Rpc_After_Rejoin_On_Old_Owner :: Run rpc on rejoined cluster node.    | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Rpc_After_Rejoin_On_All :: Run rpc again on all nodes.                | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
controller-clustering-ask.txt.Global Rpc Freeze :: Controller func... | FAIL |
Suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.

10 tests, 0 passed, 10 failed
==============================================================================
controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te...
==============================================================================
Stop_All_Members :: Stop every odl node.                              | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.239', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-ask.txt.Global Rpc Isolate :: Controller functional H...
==============================================================================
Get_Basic_Rpc_Test_Owner :: Find a service owner and successors.      | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Rpc_Before_Isolation_On_Owner :: Run rpc on the service owner.        | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Rpc_Before_Isolation_On_Successors :: Run rpc on non owher cluster... | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Isolate_Current_Owner_Member :: Isolating cluster node which is th... | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Verify_New_Basic_Rpc_Test_Owner_Elected :: Verify new owner of the... | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Rpc_On_Isolated_Node :: Run rpc on isolated cluster node.             | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Rpc_On_Non_Isolated_Cluster_Nodes :: Run rpc on remained cluster n... | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Rejoin_Isolated_Member :: Rejoin isolated node                        | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Rpc_After_Rejoin_On_New_Owner :: Run rpc on the new service owner ... | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Rpc_After_Rejoin_On_Old_Owner :: Run rpc on rejoined cluster node.    | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
Rpc_After_Rejoin_On_All :: Run rpc again on all nodes.                | FAIL |
Parent suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.
------------------------------------------------------------------------------
controller-clustering-ask.txt.Global Rpc Isolate :: Controller fun... | FAIL |
Suite setup failed:
No match found for 'opendaylight-user' in 10 seconds
Output:
.

11 tests, 0 passed, 11 failed
==============================================================================
controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te...
==============================================================================
Stop_All_Members :: Stop every odl node.                              | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync.            | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.239', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-ask.txt.Carpeople Crud :: Suite for performing basic ...
==============================================================================
Add_Cars_To_Leader :: Add 30 cars to car Leader by one big PUT.       | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Added_Cars_On_Leader :: GET response from Leader should match ... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Added_Cars_On_Followers :: The same check on other members.       | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Add_People_To_First_Follower :: Add 30 people to people first Foll... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Added_People_On_Leader :: GET response from Leader should matc... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Added_People_On_Followers :: The same check on other members.     | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Leader :: Buy some cars on car-people Leader, loop of ... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Followers :: On each Follower buy corresponding ID seg... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Added_CarPeople_On_Leader :: GET car-person mappings from Lead... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Added_CarPeople_On_Followers :: The same check on other members.  | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_All_CarPeople_On_Leader :: DELETE car-people container. No ... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_All_People_On_Leader :: DELETE people container. No verific... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_All_Cars_On_Leader :: DELETE cars container. No verificatio... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
controller-clustering-ask.txt.Carpeople Crud :: Suite for performi... | FAIL |
Suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig

13 tests, 0 passed, 13 failed
==============================================================================
controller-clustering-ask.txt.Car Failover Crud :: Suite mixing basic opera...
==============================================================================
Add_Original_Cars_On_Old_Leader_And_Verify :: Add initial cars on ... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Stop_Original_Car_Leader :: Stop the car Leader to cause a new lea... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Wait_For_New_Leader :: Wait until new car Leader is elected.          | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Original_Cars_On_New_Leader :: GET cars from new Leader, shoul... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Original_Cars_On_New_Followers :: The same check on other exis... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_Original_Cars_On_New_Leader :: Delete cars on the new Leader.  | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Add_Leader_Cars_On_New_Leader :: Add cars on the new Leader.          | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Leader_Cars_On_New_Leader :: GET cars from new Leader, should ... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Leader_Cars_On_New_Followers :: The same check on other existi... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_Leader_Cars_On_New_First_Follower :: Delete cars in new fir... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Add_Follower_Cars_On_New_First_Follower :: Add cars on the new fir... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Folower_Cars_On_New_Leader :: Get cars from the new Leader, sh... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Follower_Cars_On_New_Followers :: The same check on other exis... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Start_Old_Car_Leader :: Start the stopped member without deleting ... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Folower_Cars_On_Old_Leader :: GET cars from the restarted memb... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_Follower_Cars_On_New_Leader :: Delete cars on the last Leader. | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
controller-clustering-ask.txt.Car Failover Crud :: Suite mixing ba... | FAIL |
Suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig

16 tests, 0 passed, 16 failed
==============================================================================
controller-clustering-ask.txt.Car Persistence Recovery :: This test restart...
==============================================================================
Add_Cars_On_Leader_And_Verify :: Single big PUT to datastore to ad... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Stop_All_Members :: Stop all controllers.                             | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Start_All_Members :: Start all controllers (should restore the per... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Memorize_Leader_And_Followers :: Locate current Leader of car Shard.  | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Cars_On_Leader :: GET cars from Leader, should match the PUT d... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Cars_On_Followers :: The same check on other members.             | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_Cars_On_Leader :: Delete cars on the new Leader.               | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
controller-clustering-ask.txt.Car Persistence Recovery :: This tes... | FAIL |
Suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig

7 tests, 0 passed, 7 failed
==============================================================================
controller-clustering-ask.txt.Buycar Failover :: This test focuses on testi...
==============================================================================
Add_Cars_To_Leader_And_Verify :: Add all needed cars to car Leader... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Add_People_To_First_Follower_And_Verify :: Add all needed people t... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Leader_And_Verify :: Buy some cars on the leader member.  | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Follower_And_Verify :: Buy some cars on the first foll... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Reboot_People_Leader :: Previous people Leader is rebooted. We sho... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Leader_After_Reboot_And_Verify :: Buy some cars on the... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Follower_After_Reboot_And_Verify :: Buy some cars on t... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_All_CarPeople :: DELETE car-people container. No verificati... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_All_People :: DELETE people container. No verification beyo... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_All_Cars :: DELETE cars container. No verification beyond h... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
controller-clustering-ask.txt.Buycar Failover :: This test focuses... | FAIL |
Suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.74:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig

10 tests, 0 passed, 10 failed
==============================================================================
controller-clustering-ask.txt.Entity Isolate :: Suite for performing member...
==============================================================================
Check All Shards Before Isolate :: Check all shards in controller.    | FAIL |
Parent suite setup failed:
Evaluating expression 'json.loads(\'\'\'{\n "error": "javax.management.InstanceNotFoundException : org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "error_type": "javax.management.InstanceNotFoundException",\n "request": {\n  "mbean": "org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n  "type": "read"\n },\n "stacktrace": "javax.management.InstanceNotFoundException: org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1073)\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1343)\\n\\tat java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:921)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:46)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:41)\\n\\tat org.jolokia.backend.executor.AbstractMBeanServerExecutor.call(AbstractMBeanServerExecutor.java:90)\\n\\tat org.jolokia.handler.ReadHandler.getMBeanInfo(ReadHandler.java:233)\\n\\tat org.jolokia.handler.ReadHandler.getAllAttributesNames(ReadHandler.java:245)\\n\\tat org.jolokia.handler.ReadHandler.resolveAttributes(ReadHandler.java:221)\\n\\tat org.jolokia.handler.ReadHandler.f...
    [ Message content over the limit has been removed. ]
...lipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\\n\\tat org.eclipse.jetty.server.Server.handle(Server.java:516)\\n\\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)\\n\\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)\\n\\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)\\n\\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\\n\\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\\n\\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\\n\\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)\\n\\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\\n\\tat java.base/java.lang.Thread.run(Thread.java:1583)\\n",\n "status": 404\n}\n\'\'\')' failed: JSONDecodeError: Invalid control character at: line 8 column 190 (char 619)
------------------------------------------------------------------------------
Isolate Entity Leader :: Isolate the entity-ownership Leader to ca... | FAIL |
Parent suite setup failed:
Evaluating expression 'json.loads(\'\'\'{\n "error": "javax.management.InstanceNotFoundException : org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "error_type": "javax.management.InstanceNotFoundException",\n "request": {\n  "mbean": "org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n  "type": "read"\n },\n "stacktrace": "javax.management.InstanceNotFoundException: org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1073)\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1343)\\n\\tat java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:921)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:46)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:41)\\n\\tat org.jolokia.backend.executor.AbstractMBeanServerExecutor.call(AbstractMBeanServerExecutor.java:90)\\n\\tat org.jolokia.handler.ReadHandler.getMBeanInfo(ReadHandler.java:233)\\n\\tat org.jolokia.handler.ReadHandler.getAllAttributesNames(ReadHandler.java:245)\\n\\tat org.jolokia.handler.ReadHandler.resolveAttributes(ReadHandler.java:221)\\n\\tat org.jolokia.handler.ReadHandler.f...
    [ Message content over the limit has been removed. ]
...lipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\\n\\tat org.eclipse.jetty.server.Server.handle(Server.java:516)\\n\\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)\\n\\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)\\n\\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)\\n\\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\\n\\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\\n\\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\\n\\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)\\n\\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\\n\\tat java.base/java.lang.Thread.run(Thread.java:1583)\\n",\n "status": 404\n}\n\'\'\')' failed: JSONDecodeError: Invalid control character at: line 8 column 190 (char 619)
------------------------------------------------------------------------------
Check All Shards After Isolate :: Check all shards in controller.     | FAIL |
Parent suite setup failed:
Evaluating expression 'json.loads(\'\'\'{\n "error": "javax.management.InstanceNotFoundException : org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "error_type": "javax.management.InstanceNotFoundException",\n "request": {\n  "mbean": "org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n  "type": "read"\n },\n "stacktrace": "javax.management.InstanceNotFoundException: org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1073)\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1343)\\n\\tat java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:921)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:46)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:41)\\n\\tat org.jolokia.backend.executor.AbstractMBeanServerExecutor.call(AbstractMBeanServerExecutor.java:90)\\n\\tat org.jolokia.handler.ReadHandler.getMBeanInfo(ReadHandler.java:233)\\n\\tat org.jolokia.handler.ReadHandler.getAllAttributesNames(ReadHandler.java:245)\\n\\tat org.jolokia.handler.ReadHandler.resolveAttributes(ReadHandler.java:221)\\n\\tat org.jolokia.handler.ReadHandler.f...
    [ Message content over the limit has been removed. ]
...lipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\\n\\tat org.eclipse.jetty.server.Server.handle(Server.java:516)\\n\\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)\\n\\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)\\n\\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)\\n\\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\\n\\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\\n\\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\\n\\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)\\n\\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\\n\\tat java.base/java.lang.Thread.run(Thread.java:1583)\\n",\n "status": 404\n}\n\'\'\')' failed: JSONDecodeError: Invalid control character at: line 8 column 190 (char 619)
------------------------------------------------------------------------------
Rejoin Entity Leader :: Rejoin the entity-ownership Leader.           | FAIL |
Parent suite setup failed:
Evaluating expression 'json.loads(\'\'\'{\n "error": "javax.management.InstanceNotFoundException : org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "error_type": "javax.management.InstanceNotFoundException",\n "request": {\n  "mbean": "org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n  "type": "read"\n },\n "stacktrace": "javax.management.InstanceNotFoundException: org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1073)\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1343)\\n\\tat java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:921)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:46)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:41)\\n\\tat org.jolokia.backend.executor.AbstractMBeanServerExecutor.call(AbstractMBeanServerExecutor.java:90)\\n\\tat org.jolokia.handler.ReadHandler.getMBeanInfo(ReadHandler.java:233)\\n\\tat org.jolokia.handler.ReadHandler.getAllAttributesNames(ReadHandler.java:245)\\n\\tat org.jolokia.handler.ReadHandler.resolveAttributes(ReadHandler.java:221)\\n\\tat org.jolokia.handler.ReadHandler.f...
    [ Message content over the limit has been removed. ]
...lipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\\n\\tat org.eclipse.jetty.server.Server.handle(Server.java:516)\\n\\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)\\n\\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)\\n\\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)\\n\\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\\n\\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\\n\\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\\n\\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)\\n\\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\\n\\tat java.base/java.lang.Thread.run(Thread.java:1583)\\n",\n "status": 404\n}\n\'\'\')' failed: JSONDecodeError: Invalid control character at: line 8 column 190 (char 619)
------------------------------------------------------------------------------
Check All Shards After Rejoin :: Check all shards in controller.      | FAIL |
Parent suite setup failed:
Evaluating expression 'json.loads(\'\'\'{\n "error": "javax.management.InstanceNotFoundException : org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "error_type": "javax.management.InstanceNotFoundException",\n "request": {\n  "mbean": "org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n  "type": "read"\n },\n "stacktrace": "javax.management.InstanceNotFoundException: org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1073)\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1343)\\n\\tat java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:921)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:46)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:41)\\n\\tat org.jolokia.backend.executor.AbstractMBeanServerExecutor.call(AbstractMBeanServerExecutor.java:90)\\n\\tat org.jolokia.handler.ReadHandler.getMBeanInfo(ReadHandler.java:233)\\n\\tat org.jolokia.handler.ReadHandler.getAllAttributesNames(ReadHandler.java:245)\\n\\tat org.jolokia.handler.ReadHandler.resolveAttributes(ReadHandler.java:221)\\n\\tat org.jolokia.handler.ReadHandler.f...
    [ Message content over the limit has been removed. ]
...lipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\\n\\tat org.eclipse.jetty.server.Server.handle(Server.java:516)\\n\\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)\\n\\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)\\n\\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)\\n\\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\\n\\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\\n\\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\\n\\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)\\n\\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\\n\\tat java.base/java.lang.Thread.run(Thread.java:1583)\\n",\n "status": 404\n}\n\'\'\')' failed: JSONDecodeError: Invalid control character at: line 8 column 190 (char 619)
------------------------------------------------------------------------------
controller-clustering-ask.txt.Entity Isolate :: Suite for performi... | FAIL |
Suite setup failed:
Evaluating expression 'json.loads(\'\'\'{\n "error": "javax.management.InstanceNotFoundException : org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "error_type": "javax.management.InstanceNotFoundException",\n "request": {\n  "mbean": "org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n  "type": "read"\n },\n "stacktrace": "javax.management.InstanceNotFoundException: org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1073)\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1343)\\n\\tat java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:921)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:46)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:41)\\n\\tat org.jolokia.backend.executor.AbstractMBeanServerExecutor.call(AbstractMBeanServerExecutor.java:90)\\n\\tat org.jolokia.handler.ReadHandler.getMBeanInfo(ReadHandler.java:233)\\n\\tat org.jolokia.handler.ReadHandler.getAllAttributesNames(ReadHandler.java:245)\\n\\tat org.jolokia.handler.ReadHandler.resolveAttributes(ReadHandler.java:221)\\n\\tat org.jolokia.handler.ReadHandler.f...
    [ Message content over the limit has been removed. ]
...lipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\\n\\tat org.eclipse.jetty.server.Server.handle(Server.java:516)\\n\\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)\\n\\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)\\n\\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)\\n\\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\\n\\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\\n\\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\\n\\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)\\n\\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\\n\\tat java.base/java.lang.Thread.run(Thread.java:1583)\\n",\n "status": 404\n}\n\'\'\')' failed: JSONDecodeError: Invalid control character at: line 8 column 190 (char 619)

5 tests, 0 passed, 5 failed
==============================================================================
controller-clustering-ask.txt.Buycar Failover Isolation :: This test focuse...
==============================================================================
Add_Cars_To_Leader_And_Verify :: Add all needed cars to car Leader... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.47:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Add_People_To_First_Follower_And_Verify :: Add all needed people t... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.47:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Leader_And_Verify :: Buy some cars on the leader member.  | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.47:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Follower_And_Verify :: Buy some cars on the first foll... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.47:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Isolate_and_Rejoin_People_Leader :: Previous people Leader is isol... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.47:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Leader_After_Rejoin_And_Verify :: Buy some cars on the... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.47:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Follower_After_Rejoin_And_Verify :: Buy some cars on t... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.47:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_All_CarPeople :: DELETE car-people container. No verificati... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.47:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_All_People :: DELETE people container. No verification beyo... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.47:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_All_Cars :: DELETE cars container. No verification beyond h... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.47:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
controller-clustering-ask.txt.Buycar Failover Isolation :: This te... | FAIL |
Suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.47:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig

10 tests, 0 passed, 10 failed
==============================================================================
controller-clustering-ask.txt.Car Failover Crud Isolation :: Suite mixing b...
==============================================================================
Add_Original_Cars_On_Old_Leader_And_Verify :: Add initial cars on ... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.47:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Isolate_Original_Car_Leader :: Isolate the car Leader to cause a n... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.47:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Wait_For_New_Leader :: Wait until new car Leader is elected.          | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.47:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Original_Cars_On_New_Leader :: GET cars from new Leader, shoul... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.47:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Original_Cars_On_New_Followers :: The same check on other exis... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.47:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_Original_Cars_On_New_Leader :: Delete cars on the new Leader.  | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.47:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Add_Leader_Cars_On_New_Leader :: Add cars on the new Leader.          | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.47:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Leader_Cars_On_New_Leader :: GET cars from new Leader, should ... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.47:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Leader_Cars_On_New_Followers :: The same check on other existi... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.47:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_Leader_Cars_On_New_First_Follower :: Delete cars in new fir... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.47:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Add_Follower_Cars_On_New_First_Follower :: Add cars on the new fir... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.47:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Folower_Cars_On_New_Leader :: Get cars from the new Leader, sh... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.47:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Follower_Cars_On_New_Followers :: The same check on other exis... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.47:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Rejoin_Old_Car_Leader :: Rejoin the isolated member without deleti... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.47:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Folower_Cars_On_Old_Leader :: GET cars from the restarted memb... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.47:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_Follower_Cars_On_New_Leader :: Delete cars on the last Leader. | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.47:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
controller-clustering-ask.txt.Car Failover Crud Isolation :: Suite... | FAIL |
Suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.47:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig

16 tests, 0 passed, 16 failed
==============================================================================
controller-clustering-ask.txt.Car Outage Corners :: Cluster suite for testi...
==============================================================================
Stop_Majority_Of_The_Followers :: Stop half plus one car Follower ... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.47:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Attempt_To_Add_Cars_To_Leader :: Adding cars should fail, as major... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.47:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Start_Tipping_Follower :: Start one Follower member without persis... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.47:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Add_Cars_On_Tipping_Follower :: Add cars on the tipping Follower.     | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.47:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Cars_On_Existing_Members :: On each up member: GET cars, shoul... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.47:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Start_Other_Followers :: Start other followers without persisted d... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.47:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Cars_On_New_Follower_Leader :: GET cars from a new follower to... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.47:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_Cars_On_Leader :: Delete cars on Leader.                       | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.47:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
controller-clustering-ask.txt.Car Outage Corners :: Cluster suite ... | FAIL |
Suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.47:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig

8 tests, 0 passed, 8 failed
==============================================================================
controller-clustering-ask.txt                                         | FAIL |
195 tests, 24 passed, 171 failed
==============================================================================
Output:  /w/workspace/controller-csit-3node-clustering-ask-all-titanium/output.xml
Log:     /w/workspace/controller-csit-3node-clustering-ask-all-titanium/log.html
Report:  /w/workspace/controller-csit-3node-clustering-ask-all-titanium/report.html
+ true
+ echo 'Examining the files in data/log and checking filesize'
Examining the files in data/log and checking filesize
+ ssh 10.30.171.74 'ls -altr /tmp/karaf-0.22.0-SNAPSHOT/data/log/'
Warning: Permanently added '10.30.171.74' (ECDSA) to the list of known hosts.
total 28284
drwxrwxr-x 2 jenkins jenkins     4096 Jul  6 22:56 .
-rw-rw-r-- 1 jenkins jenkins     1720 Jul  6 22:56 karaf_console.log
drwxrwxr-x 8 jenkins jenkins     4096 Jul  7 02:55 ..
-rw-rw-r-- 1 jenkins jenkins 28944494 Jul  7 03:09 karaf.log
+ ssh 10.30.171.74 'du -hs /tmp/karaf-0.22.0-SNAPSHOT/data/log/*'
Warning: Permanently added '10.30.171.74' (ECDSA) to the list of known hosts.
28M	/tmp/karaf-0.22.0-SNAPSHOT/data/log/karaf.log
4.0K	/tmp/karaf-0.22.0-SNAPSHOT/data/log/karaf_console.log
+ ssh 10.30.171.47 'ls -altr /tmp/karaf-0.22.0-SNAPSHOT/data/log/'
Warning: Permanently added '10.30.171.47' (ECDSA) to the list of known hosts.
total 45524
drwxrwxr-x 2 jenkins jenkins     4096 Jul  6 22:56 .
-rw-rw-r-- 1 jenkins jenkins     1720 Jul  6 22:56 karaf_console.log
drwxrwxr-x 9 jenkins jenkins     4096 Jul  7 02:55 ..
-rw-rw-r-- 1 jenkins jenkins 46598175 Jul  7 03:08 karaf.log
+ ssh 10.30.171.47 'du -hs /tmp/karaf-0.22.0-SNAPSHOT/data/log/*'
Warning: Permanently added '10.30.171.47' (ECDSA) to the list of known hosts.
45M	/tmp/karaf-0.22.0-SNAPSHOT/data/log/karaf.log
4.0K	/tmp/karaf-0.22.0-SNAPSHOT/data/log/karaf_console.log
+ ssh 10.30.170.239 'ls -altr /tmp/karaf-0.22.0-SNAPSHOT/data/log/'
Warning: Permanently added '10.30.170.239' (ECDSA) to the list of known hosts.
total 11940
drwxrwxr-x 2 jenkins jenkins     4096 Jul  6 22:56 .
-rw-rw-r-- 1 jenkins jenkins   168177 Jul  6 23:06 karaf_console.log
drwxrwxr-x 4 jenkins jenkins     4096 Jul  7 02:54 ..
-rw-rw-r-- 1 jenkins jenkins 12045112 Jul  7 03:09 karaf.log
+ ssh 10.30.170.239 'du -hs /tmp/karaf-0.22.0-SNAPSHOT/data/log/*'
Warning: Permanently added '10.30.170.239' (ECDSA) to the list of known hosts.
12M	/tmp/karaf-0.22.0-SNAPSHOT/data/log/karaf.log
168K	/tmp/karaf-0.22.0-SNAPSHOT/data/log/karaf_console.log
+ set +e
++ seq 1 3
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_1_IP
+ echo 'Let'\''s take the karaf thread dump again'
Let's take the karaf thread dump again
+ ssh 10.30.171.74 'sudo ps aux'
Warning: Permanently added '10.30.171.74' (ECDSA) to the list of known hosts.
++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-ask-all-titanium/ps_after.log
++ grep -v grep
++ tr -s ' '
++ cut -f2 '-d '
+ pid=29673
+ echo 'karaf main: org.apache.karaf.main.Main, pid:29673'
karaf main: org.apache.karaf.main.Main, pid:29673
+ ssh 10.30.171.74 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 29673'
Warning: Permanently added '10.30.171.74' (ECDSA) to the list of known hosts.
+ echo 'killing karaf process...'
killing karaf process...
+ ssh 10.30.171.74 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh'
Warning: Permanently added '10.30.171.74' (ECDSA) to the list of known hosts.
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_2_IP
+ echo 'Let'\''s take the karaf thread dump again'
Let's take the karaf thread dump again
+ ssh 10.30.171.47 'sudo ps aux'
Warning: Permanently added '10.30.171.47' (ECDSA) to the list of known hosts.
++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-ask-all-titanium/ps_after.log
++ grep -v grep
++ cut -f2 '-d '
++ tr -s ' '
+ pid=38083
+ echo 'karaf main: org.apache.karaf.main.Main, pid:38083'
karaf main: org.apache.karaf.main.Main, pid:38083
+ ssh 10.30.171.47 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 38083'
Warning: Permanently added '10.30.171.47' (ECDSA) to the list of known hosts.
+ echo 'killing karaf process...'
killing karaf process...
+ ssh 10.30.171.47 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh'
Warning: Permanently added '10.30.171.47' (ECDSA) to the list of known hosts.
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_3_IP
+ echo 'Let'\''s take the karaf thread dump again'
Let's take the karaf thread dump again
+ ssh 10.30.170.239 'sudo ps aux'
Warning: Permanently added '10.30.170.239' (ECDSA) to the list of known hosts.
++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-ask-all-titanium/ps_after.log
++ grep -v grep
++ cut -f2 '-d '
++ tr -s ' '
+ pid=2083
+ echo 'karaf main: org.apache.karaf.main.Main, pid:2083'
karaf main: org.apache.karaf.main.Main, pid:2083
+ ssh 10.30.170.239 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 2083'
Warning: Permanently added '10.30.170.239' (ECDSA) to the list of known hosts.
+ echo 'killing karaf process...'
killing karaf process...
+ ssh 10.30.170.239 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh'
Warning: Permanently added '10.30.170.239' (ECDSA) to the list of known hosts.
+ sleep 5
++ seq 1 3
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_1_IP
+ echo 'Compressing karaf.log 1'
Compressing karaf.log 1
+ ssh 10.30.171.74 gzip --best /tmp/karaf-0.22.0-SNAPSHOT/data/log/karaf.log
Warning: Permanently added '10.30.171.74' (ECDSA) to the list of known hosts.
+ echo 'Fetching compressed karaf.log 1'
Fetching compressed karaf.log 1
+ scp 10.30.171.74:/tmp/karaf-0.22.0-SNAPSHOT/data/log/karaf.log.gz odl1_karaf.log.gz
Warning: Permanently added '10.30.171.74' (ECDSA) to the list of known hosts.
+ ssh 10.30.171.74 rm -f /tmp/karaf-0.22.0-SNAPSHOT/data/log/karaf.log.gz
Warning: Permanently added '10.30.171.74' (ECDSA) to the list of known hosts.
+ scp 10.30.171.74:/tmp/karaf-0.22.0-SNAPSHOT/data/log/karaf_console.log odl1_karaf_console.log
Warning: Permanently added '10.30.171.74' (ECDSA) to the list of known hosts.
+ ssh 10.30.171.74 rm -f /tmp/karaf-0.22.0-SNAPSHOT/data/log/karaf_console.log
Warning: Permanently added '10.30.171.74' (ECDSA) to the list of known hosts.
+ echo 'Fetch GC logs'
Fetch GC logs
+ mkdir -p gclogs-1
+ scp '10.30.171.74:/tmp/karaf-0.22.0-SNAPSHOT/data/log/*.log' gclogs-1/
Warning: Permanently added '10.30.171.74' (ECDSA) to the list of known hosts.
scp: /tmp/karaf-0.22.0-SNAPSHOT/data/log/*.log: No such file or directory
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_2_IP
+ echo 'Compressing karaf.log 2'
Compressing karaf.log 2
+ ssh 10.30.171.47 gzip --best /tmp/karaf-0.22.0-SNAPSHOT/data/log/karaf.log
Warning: Permanently added '10.30.171.47' (ECDSA) to the list of known hosts.
+ echo 'Fetching compressed karaf.log 2'
Fetching compressed karaf.log 2
+ scp 10.30.171.47:/tmp/karaf-0.22.0-SNAPSHOT/data/log/karaf.log.gz odl2_karaf.log.gz
Warning: Permanently added '10.30.171.47' (ECDSA) to the list of known hosts.
+ ssh 10.30.171.47 rm -f /tmp/karaf-0.22.0-SNAPSHOT/data/log/karaf.log.gz
Warning: Permanently added '10.30.171.47' (ECDSA) to the list of known hosts.
+ scp 10.30.171.47:/tmp/karaf-0.22.0-SNAPSHOT/data/log/karaf_console.log odl2_karaf_console.log
Warning: Permanently added '10.30.171.47' (ECDSA) to the list of known hosts.
+ ssh 10.30.171.47 rm -f /tmp/karaf-0.22.0-SNAPSHOT/data/log/karaf_console.log
Warning: Permanently added '10.30.171.47' (ECDSA) to the list of known hosts.
+ echo 'Fetch GC logs'
Fetch GC logs
+ mkdir -p gclogs-2
+ scp '10.30.171.47:/tmp/karaf-0.22.0-SNAPSHOT/data/log/*.log' gclogs-2/
Warning: Permanently added '10.30.171.47' (ECDSA) to the list of known hosts.
scp: /tmp/karaf-0.22.0-SNAPSHOT/data/log/*.log: No such file or directory
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_3_IP
+ echo 'Compressing karaf.log 3'
Compressing karaf.log 3
+ ssh 10.30.170.239 gzip --best /tmp/karaf-0.22.0-SNAPSHOT/data/log/karaf.log
Warning: Permanently added '10.30.170.239' (ECDSA) to the list of known hosts.
+ echo 'Fetching compressed karaf.log 3'
Fetching compressed karaf.log 3
+ scp 10.30.170.239:/tmp/karaf-0.22.0-SNAPSHOT/data/log/karaf.log.gz odl3_karaf.log.gz
Warning: Permanently added '10.30.170.239' (ECDSA) to the list of known hosts.
+ ssh 10.30.170.239 rm -f /tmp/karaf-0.22.0-SNAPSHOT/data/log/karaf.log.gz
Warning: Permanently added '10.30.170.239' (ECDSA) to the list of known hosts.
+ scp 10.30.170.239:/tmp/karaf-0.22.0-SNAPSHOT/data/log/karaf_console.log odl3_karaf_console.log
Warning: Permanently added '10.30.170.239' (ECDSA) to the list of known hosts.
+ ssh 10.30.170.239 rm -f /tmp/karaf-0.22.0-SNAPSHOT/data/log/karaf_console.log
Warning: Permanently added '10.30.170.239' (ECDSA) to the list of known hosts.
+ echo 'Fetch GC logs'
Fetch GC logs
+ mkdir -p gclogs-3
+ scp '10.30.170.239:/tmp/karaf-0.22.0-SNAPSHOT/data/log/*.log' gclogs-3/
Warning: Permanently added '10.30.170.239' (ECDSA) to the list of known hosts.
scp: /tmp/karaf-0.22.0-SNAPSHOT/data/log/*.log: No such file or directory
+ echo 'Examine copied files'
Examine copied files
+ ls -lt
total 55760
drwxrwxr-x. 2 jenkins jenkins        6 Jul  7 03:09 gclogs-3
-rw-rw-r--. 1 jenkins jenkins   168177 Jul  7 03:09 odl3_karaf_console.log
-rw-rw-r--. 1 jenkins jenkins   389042 Jul  7 03:09 odl3_karaf.log.gz
drwxrwxr-x. 2 jenkins jenkins        6 Jul  7 03:09 gclogs-2
-rw-rw-r--. 1 jenkins jenkins     1720 Jul  7 03:09 odl2_karaf_console.log
-rw-rw-r--. 1 jenkins jenkins  1479163 Jul  7 03:09 odl2_karaf.log.gz
drwxrwxr-x. 2 jenkins jenkins        6 Jul  7 03:09 gclogs-1
-rw-rw-r--. 1 jenkins jenkins     1720 Jul  7 03:09 odl1_karaf_console.log
-rw-rw-r--. 1 jenkins jenkins  1364332 Jul  7 03:09 odl1_karaf.log.gz
-rw-rw-r--. 1 jenkins jenkins   171912 Jul  7 03:09 karaf_3_2083_threads_after.log
-rw-rw-r--. 1 jenkins jenkins    13640 Jul  7 03:09 ps_after.log
-rw-rw-r--. 1 jenkins jenkins   149369 Jul  7 03:09 karaf_2_38083_threads_after.log
-rw-rw-r--. 1 jenkins jenkins   147011 Jul  7 03:09 karaf_1_29673_threads_after.log
-rw-rw-r--. 1 jenkins jenkins   301817 Jul  7 03:09 report.html
-rw-rw-r--. 1 jenkins jenkins  3628117 Jul  7 03:09 log.html
-rw-rw-r--. 1 jenkins jenkins 48757272 Jul  7 03:09 output.xml
-rw-rw-r--. 1 jenkins jenkins     4120 Jul  6 22:59 testplan.txt
-rw-rw-r--. 1 jenkins jenkins   135717 Jul  6 22:59 karaf_3_2083_threads_before.log
-rw-rw-r--. 1 jenkins jenkins    14070 Jul  6 22:59 ps_before.log
-rw-rw-r--. 1 jenkins jenkins   135801 Jul  6 22:59 karaf_2_2078_threads_before.log
-rw-rw-r--. 1 jenkins jenkins   136675 Jul  6 22:59 karaf_1_2083_threads_before.log
-rw-rw-r--. 1 jenkins jenkins     3106 Jul  6 22:56 post-startup-script.sh
-rw-rw-r--. 1 jenkins jenkins      252 Jul  6 22:56 startup-script.sh
-rw-rw-r--. 1 jenkins jenkins     3455 Jul  6 22:56 configuration-script.sh
-rw-rw-r--. 1 jenkins jenkins      695 Jul  6 22:56 custom_shard_config.txt
-rw-rw-r--. 1 jenkins jenkins      135 Jul  6 22:56 scriptplan.txt
-rw-rw-r--. 1 jenkins jenkins      333 Jul  6 22:55 detect_variables.env
-rw-rw-r--. 1 jenkins jenkins     2619 Jul  6 22:55 pom.xml
-rw-rw-r--. 1 jenkins jenkins       92 Jul  6 22:55 set_variables.env
-rw-rw-r--. 1 jenkins jenkins      311 Jul  6 22:55 slave_addresses.txt
-rw-rw-r--. 1 jenkins jenkins      570 Jul  6 22:55 requirements.txt
-rw-rw-r--. 1 jenkins jenkins       26 Jul  6 22:55 env.properties
-rw-rw-r--. 1 jenkins jenkins      333 Jul  6 22:53 stack-parameters.yaml
drwxrwxr-x. 7 jenkins jenkins     4096 Jul  6 22:52 test
drwxrwxr-x. 2 jenkins jenkins        6 Jul  6 22:52 test@tmp
-rw-rw-r--. 1 jenkins jenkins     1398 Jul  6 17:52 maven-metadata.xml
+ true
[controller-csit-3node-clustering-ask-all-titanium] $ /bin/sh /tmp/jenkins12844329473175489396.sh
Cleaning up Robot installation...
$ ssh-agent -k
unset SSH_AUTH_SOCK;
unset SSH_AGENT_PID;
echo Agent pid 5282 killed;
[ssh-agent] Stopped.
Recording plot data
Robot results publisher started...
INFO: Checking test criticality is deprecated and will be dropped in a future release!
-Parsing output xml:
Done!
-Copying log files to build dir:
Done!
-Assigning results to build:
Done!
-Checking thresholds:
Done!
Done publishing Robot results.
Build step 'Publish Robot Framework test results' changed build result to UNSTABLE
[PostBuildScript] - [INFO] Executing post build scripts.
[controller-csit-3node-clustering-ask-all-titanium] $ /bin/bash /tmp/jenkins8147852823130183532.sh
Archiving csit artifacts
mv: cannot stat '*_1.png': No such file or directory
mv: cannot stat '/tmp/odl1_*': No such file or directory
mv: cannot stat '*_2.png': No such file or directory
mv: cannot stat '/tmp/odl2_*': No such file or directory
mv: cannot stat '*_3.png': No such file or directory
mv: cannot stat '/tmp/odl3_*': No such file or directory
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed

  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100 3176k    0 3176k    0     0  5089k      0 --:--:-- --:--:-- --:--:-- 5081k
100 4433k    0 4433k    0     0  5155k      0 --:--:-- --:--:-- --:--:-- 5149k
Archive:  robot-plugin.zip
  inflating: ./archives/robot-plugin/log.html  
  inflating: ./archives/robot-plugin/output.xml  
  inflating: ./archives/robot-plugin/report.html  
mv: cannot stat '*.log.gz': No such file or directory
mv: cannot stat '*.csv': No such file or directory
mv: cannot stat '*.png': No such file or directory
[PostBuildScript] - [INFO] Executing post build scripts.
[controller-csit-3node-clustering-ask-all-titanium] $ /bin/bash /tmp/jenkins1275090468009951683.sh
[PostBuildScript] - [INFO] Executing post build scripts.
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties content 
OS_CLOUD=vex
OS_STACK_NAME=releng-controller-csit-3node-clustering-ask-all-titanium-43

[EnvInject] - Variables injected successfully.
provisioning config files...
copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
[controller-csit-3node-clustering-ask-all-titanium] $ /bin/bash /tmp/jenkins168820683278847550.sh
---> openstack-stack-delete.sh
Setup pyenv:
  system
  3.8.13
  3.9.13
  3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-ask-all-titanium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-O8Kc from file:/tmp/.os_lf_venv
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
lftools 0.37.13 requires urllib3<2.1.0, but you have urllib3 2.5.0 which is incompatible.
lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes python-heatclient python-openstackclient 
lf-activate-venv(): INFO: Adding /tmp/venv-O8Kc/bin to PATH
INFO: Retrieving stack cost for: releng-controller-csit-3node-clustering-ask-all-titanium-43
DEBUG: Successfully retrieved stack cost: total: 1.6500000000000001
INFO: Deleting stack releng-controller-csit-3node-clustering-ask-all-titanium-43
Successfully deleted stack releng-controller-csit-3node-clustering-ask-all-titanium-43
[PostBuildScript] - [INFO] Executing post build scripts.
[controller-csit-3node-clustering-ask-all-titanium] $ /bin/bash /tmp/jenkins8355477146197964688.sh
---> sysstat.sh
[controller-csit-3node-clustering-ask-all-titanium] $ /bin/bash /tmp/jenkins16646077118971554381.sh
---> package-listing.sh
++ facter osfamily
++ tr '[:upper:]' '[:lower:]'
+ OS_FAMILY=redhat
+ workspace=/w/workspace/controller-csit-3node-clustering-ask-all-titanium
+ START_PACKAGES=/tmp/packages_start.txt
+ END_PACKAGES=/tmp/packages_end.txt
+ DIFF_PACKAGES=/tmp/packages_diff.txt
+ PACKAGES=/tmp/packages_start.txt
+ '[' /w/workspace/controller-csit-3node-clustering-ask-all-titanium ']'
+ PACKAGES=/tmp/packages_end.txt
+ case "${OS_FAMILY}" in
+ rpm -qa
+ sort
+ '[' -f /tmp/packages_start.txt ']'
+ '[' -f /tmp/packages_end.txt ']'
+ diff /tmp/packages_start.txt /tmp/packages_end.txt
+ '[' /w/workspace/controller-csit-3node-clustering-ask-all-titanium ']'
+ mkdir -p /w/workspace/controller-csit-3node-clustering-ask-all-titanium/archives/
+ cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/controller-csit-3node-clustering-ask-all-titanium/archives/
[controller-csit-3node-clustering-ask-all-titanium] $ /bin/bash /tmp/jenkins4048532323830203729.sh
---> capture-instance-metadata.sh
Setup pyenv:
  system
  3.8.13
  3.9.13
  3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-ask-all-titanium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-O8Kc from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: lftools 
lf-activate-venv(): INFO: Adding /tmp/venv-O8Kc/bin to PATH
INFO: Running in OpenStack, capturing instance metadata
[controller-csit-3node-clustering-ask-all-titanium] $ /bin/bash /tmp/jenkins4060539489631861207.sh
provisioning config files...
Could not find credentials [logs] for controller-csit-3node-clustering-ask-all-titanium #43
copy managed file [jenkins-log-archives-settings] to file:/w/workspace/controller-csit-3node-clustering-ask-all-titanium@tmp/config9496475970810333552tmp
Regular expression run condition: Expression=[^.*logs-s3.*], Label=[odl-logs-s3-cloudfront-index]
Run condition [Regular expression match] enabling perform for step [Provide Configuration files]
provisioning config files...
copy managed file [jenkins-s3-log-ship] to file:/home/jenkins/.aws/credentials
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties content 
SERVER_ID=logs

[EnvInject] - Variables injected successfully.
[controller-csit-3node-clustering-ask-all-titanium] $ /bin/bash /tmp/jenkins7890980124101047755.sh
---> create-netrc.sh
WARN: Log server credential not found.
[controller-csit-3node-clustering-ask-all-titanium] $ /bin/bash /tmp/jenkins479073464826857916.sh
---> python-tools-install.sh
Setup pyenv:
  system
  3.8.13
  3.9.13
  3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-ask-all-titanium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-O8Kc from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: lftools 
lf-activate-venv(): INFO: Adding /tmp/venv-O8Kc/bin to PATH
[controller-csit-3node-clustering-ask-all-titanium] $ /bin/bash /tmp/jenkins2124806738334019593.sh
---> sudo-logs.sh
Archiving 'sudo' log..
[controller-csit-3node-clustering-ask-all-titanium] $ /bin/bash /tmp/jenkins16712686412278091382.sh
---> job-cost.sh
Setup pyenv:
  system
  3.8.13
  3.9.13
  3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-ask-all-titanium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-O8Kc from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 
lf-activate-venv(): INFO: Adding /tmp/venv-O8Kc/bin to PATH
DEBUG: total: 1.6500000000000001
INFO: Retrieving Stack Cost...
INFO: Retrieving Pricing Info for: v3-standard-2
INFO: Archiving Costs
[controller-csit-3node-clustering-ask-all-titanium] $ /bin/bash -l /tmp/jenkins10958768486015002711.sh
---> logs-deploy.sh
Setup pyenv:
  system
  3.8.13
  3.9.13
  3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-ask-all-titanium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-O8Kc from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: lftools 
lf-activate-venv(): INFO: Adding /tmp/venv-O8Kc/bin to PATH
WARNING: Nexus logging server not set
INFO: S3 path logs/releng/vex-yul-odl-jenkins-1/controller-csit-3node-clustering-ask-all-titanium/43/
INFO: archiving logs to S3
---> uname -a:
Linux prd-centos8-robot-2c-8g-40223.novalocal 4.18.0-553.5.1.el8.x86_64 #1 SMP Tue May 21 05:46:01 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux


---> lscpu:
Architecture:        x86_64
CPU op-mode(s):      32-bit, 64-bit
Byte Order:          Little Endian
CPU(s):              2
On-line CPU(s) list: 0,1
Thread(s) per core:  1
Core(s) per socket:  1
Socket(s):           2
NUMA node(s):        1
Vendor ID:           AuthenticAMD
CPU family:          23
Model:               49
Model name:          AMD EPYC-Rome Processor
Stepping:            0
CPU MHz:             2799.998
BogoMIPS:            5599.99
Virtualization:      AMD-V
Hypervisor vendor:   KVM
Virtualization type: full
L1d cache:           32K
L1i cache:           32K
L2 cache:            512K
L3 cache:            16384K
NUMA node0 CPU(s):   0,1
Flags:               fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities


---> nproc:
2


---> df -h:
Filesystem      Size  Used Avail Use% Mounted on
devtmpfs        3.8G     0  3.8G   0% /dev
tmpfs           3.8G     0  3.8G   0% /dev/shm
tmpfs           3.8G   17M  3.8G   1% /run
tmpfs           3.8G     0  3.8G   0% /sys/fs/cgroup
/dev/vda1        40G  8.4G   32G  21% /
tmpfs           770M     0  770M   0% /run/user/1001


---> free -m:
              total        used        free      shared  buff/cache   available
Mem:           7697         687        4712          19        2297        6711
Swap:          1023           0        1023


---> ip addr:
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host 
       valid_lft forever preferred_lft forever
2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1458 qdisc mq state UP group default qlen 1000
    link/ether fa:16:3e:7e:11:62 brd ff:ff:ff:ff:ff:ff
    altname enp0s3
    altname ens3
    inet 10.30.171.55/23 brd 10.30.171.255 scope global dynamic noprefixroute eth0
       valid_lft 70808sec preferred_lft 70808sec
    inet6 fe80::f816:3eff:fe7e:1162/64 scope link 
       valid_lft forever preferred_lft forever


---> sar -b -r -n DEV:
Linux 4.18.0-553.5.1.el8.x86_64 (prd-centos8-robot-2c-8g-40223.novalocal) 	07/07/2025 	_x86_64_	(2 CPU)

12:00:01 AM       tps      rtps      wtps   bread/s   bwrtn/s
12:01:01 AM      1.00      0.00      1.00      0.00    203.78
12:02:01 AM      0.42      0.00      0.42      0.00     19.47
12:03:01 AM      0.33      0.00      0.33      0.00     18.86
12:04:01 AM      0.30      0.00      0.30      0.00     16.73
12:05:01 AM      0.37      0.00      0.37      0.00     24.94
12:06:01 AM      0.33      0.00      0.33      0.00      3.70
12:07:01 AM      0.38      0.00      0.38      0.00      3.90
12:08:01 AM      0.60      0.07      0.53      7.60     17.63
12:09:01 AM      0.13      0.00      0.13      0.00      1.33
12:10:01 AM      0.15      0.00      0.15      0.00      3.37
12:11:01 AM      0.22      0.00      0.22      0.00      2.07
12:12:01 AM      0.40      0.00      0.40      0.00      5.97
12:13:01 AM      0.13      0.00      0.13      0.00      9.22
12:14:01 AM      0.20      0.00      0.20      0.00      7.75
12:15:01 AM      0.25      0.00      0.25      0.00      3.08
12:16:01 AM      0.18      0.00      0.18      0.00      4.10
12:17:01 AM      0.40      0.00      0.40      0.00     11.43
12:18:01 AM      0.12      0.00      0.12      0.00      0.92
12:19:01 AM      0.13      0.00      0.13      0.00      2.97
12:20:01 AM      0.18      0.00      0.18      0.00      8.81
12:21:01 AM      0.43      0.00      0.43      0.00     10.96
12:22:01 AM      0.70      0.00      0.70      0.00     14.86
12:23:01 AM      0.30      0.00      0.30      0.00      3.42
12:24:01 AM      0.40      0.00      0.40      0.00      6.28
12:25:01 AM      0.12      0.00      0.12      0.00      5.53
12:26:01 AM      0.12      0.00      0.12      0.00      1.98
12:27:01 AM      0.28      0.00      0.28      0.00      8.01
12:28:01 AM      0.32      0.00      0.32      0.00     12.33
12:29:01 AM      0.20      0.00      0.20      0.00     20.53
12:30:02 AM      0.17      0.00      0.17      0.00      7.73
12:31:01 AM      0.27      0.00      0.27      0.00     18.37
12:32:01 AM      0.37      0.00      0.37      0.00     20.25
12:33:01 AM      0.27      0.00      0.27      0.00     11.50
12:34:01 AM      0.20      0.00      0.20      0.00     26.55
12:35:01 AM      0.13      0.00      0.13      0.00      5.33
12:36:01 AM      0.13      0.00      0.13      0.00      1.63
12:37:01 AM      0.28      0.00      0.28      0.00      5.53
12:38:01 AM      0.22      0.00      0.22      0.00      3.62
12:39:01 AM      0.22      0.00      0.22      0.00      2.55
12:40:01 AM      0.23      0.00      0.23      0.00      5.75
12:41:01 AM      0.15      0.00      0.15      0.00      1.38
12:42:01 AM      0.32      0.00      0.32      0.00     11.41
12:43:01 AM      0.23      0.00      0.23      0.00      8.70
12:44:01 AM      0.15      0.00      0.15      0.00      6.42
12:45:01 AM      0.17      0.00      0.17      0.00      1.58
12:46:01 AM      0.22      0.00      0.22      0.00      4.30
12:47:01 AM      0.30      0.00      0.30      0.00      5.42
12:48:01 AM      0.20      0.00      0.20      0.00      3.50
12:49:01 AM      0.17      0.00      0.17      0.00      3.10
12:50:01 AM      0.28      0.00      0.28      0.00      7.60
12:51:01 AM      0.37      0.00      0.37      0.00      5.58
12:52:01 AM      0.45      0.00      0.45      0.00      7.03
12:53:01 AM      0.58      0.00      0.58      0.00     13.18
12:54:01 AM      0.33      0.00      0.33      0.00      3.37
12:55:01 AM      0.40      0.00      0.40      0.00     13.51
12:56:01 AM      0.43      0.00      0.43      0.00     12.11
12:57:01 AM      0.58      0.00      0.58      0.00     18.36
12:58:01 AM      0.58      0.00      0.58      0.00     19.75
12:59:01 AM      0.47      0.00      0.47      0.00     16.78
01:00:01 AM      0.22      0.00      0.22      0.00     16.51
01:01:01 AM      0.25      0.00      0.25      0.00     10.30
01:02:01 AM      0.30      0.00      0.30      0.00     17.45
01:03:01 AM      0.27      0.00      0.27      0.00     22.69
01:04:01 AM      0.15      0.00      0.15      0.00      3.98
01:05:01 AM      0.20      0.00      0.20      0.00      2.67
01:06:01 AM      0.22      0.00      0.22      0.00      4.72
01:07:01 AM      0.22      0.00      0.22      0.00      2.30
01:08:01 AM      0.22      0.00      0.22      0.00      6.03
01:09:01 AM      0.13      0.00      0.13      0.00      1.30
01:10:01 AM      0.12      0.00      0.12      0.00      6.91
01:11:01 AM      0.18      0.00      0.18      0.00      3.63
01:12:01 AM      1.07      0.00      1.07      0.00     22.30
01:13:01 AM      0.23      0.00      0.23      0.00      3.07
01:14:01 AM      0.25      0.00      0.25      0.00      5.22
01:15:01 AM      0.42      0.00      0.42      0.00      6.53
01:16:01 AM      0.37      0.00      0.37      0.00      6.30
01:17:01 AM      0.48      0.00      0.48      0.00      9.85
01:18:01 AM      0.63      0.00      0.63      0.00      9.62
01:19:01 AM      0.37      0.00      0.37      0.00      8.38
01:20:01 AM      0.13      0.00      0.13      0.00     11.73
01:21:01 AM      0.17      0.00      0.17      0.00      8.96
01:22:01 AM      0.23      0.00      0.23      0.00     18.08
01:23:01 AM      0.27      0.00      0.27      0.00     18.30
01:24:01 AM      0.13      0.00      0.13      0.00      7.46
01:25:01 AM      0.38      0.00      0.38      0.00     24.36
01:26:01 AM      0.18      0.00      0.18      0.00     24.51
01:27:01 AM      0.30      0.00      0.30      0.00      7.83
01:28:01 AM      0.18      0.00      0.18      0.00     16.00
01:29:01 AM      0.23      0.00      0.23      0.00     10.41
01:30:01 AM      0.12      0.00      0.12      0.00      7.07
01:31:01 AM      0.17      0.00      0.17      0.00     12.30
01:32:01 AM      0.52      0.00      0.52      0.00     16.11
01:33:01 AM      0.18      0.00      0.18      0.00     11.11
01:34:01 AM      0.17      0.00      0.17      0.00      3.02
01:35:01 AM      0.15      0.00      0.15      0.00      7.41
01:36:01 AM      0.15      0.00      0.15      0.00      4.12
01:37:01 AM      0.28      0.00      0.28      0.00      6.87
01:38:01 AM      0.53      0.00      0.53      0.00     15.68
01:39:01 AM      0.38      0.00      0.38      0.00     10.71
01:40:01 AM      0.20      0.00      0.20      0.00     13.06
01:41:01 AM      0.28      0.00      0.28      0.00     10.76
01:42:01 AM      0.32      0.00      0.32      0.00     20.23
01:43:01 AM      0.33      0.00      0.33      0.00     19.78
01:44:01 AM      0.17      0.00      0.17      0.00      9.58
01:45:01 AM      0.15      0.00      0.15      0.00     18.40
01:46:01 AM      0.22      0.00      0.22      0.00     22.25
01:47:01 AM      0.18      0.00      0.18      0.00      2.18
01:48:01 AM      0.18      0.00      0.18      0.00      3.20
01:49:01 AM      0.23      0.00      0.23      0.00      5.33
01:50:01 AM      0.17      0.00      0.17      0.00      1.98
01:51:01 AM      0.15      0.00      0.15      0.00      3.93
01:52:01 AM      0.23      0.00      0.23      0.00      2.98
01:53:01 AM      0.25      0.00      0.25      0.00      8.95
01:54:01 AM      0.13      0.00      0.13      0.00      2.67
01:55:01 AM      0.15      0.00      0.15      0.00      6.28
01:56:01 AM      0.22      0.00      0.22      0.00      2.77
01:57:01 AM      0.22      0.00      0.22      0.00      4.23
01:58:01 AM      0.23      0.00      0.23      0.00      4.02
01:59:01 AM      0.15      0.00      0.15      0.00      7.21
02:00:01 AM      0.12      0.00      0.12      0.00      1.35
02:01:01 AM      0.18      0.00      0.18      0.00      1.77
02:02:01 AM      0.53      0.00      0.53      0.00     15.54
02:03:01 AM      0.27      0.00      0.27      0.00     19.50
02:04:01 AM      0.17      0.00      0.17      0.00     16.39
02:05:01 AM      0.12      0.00      0.12      0.00      8.67
02:06:01 AM      0.17      0.00      0.17      0.00     18.80
02:07:01 AM      0.22      0.00      0.22      0.00      9.55
02:08:01 AM      0.33      0.00      0.33      0.00     24.03
02:09:01 AM      0.20      0.00      0.20      0.00     17.08
02:10:01 AM      0.12      0.00      0.12      0.00      1.18
02:11:01 AM      0.13      0.00      0.13      0.00      1.22
02:12:01 AM      0.25      0.00      0.25      0.00      6.61
02:13:01 AM      0.22      0.00      0.22      0.00      3.00
02:14:01 AM      0.18      0.00      0.18      0.00      4.03
02:15:01 AM      0.25      0.00      0.25      0.00      3.05
02:16:01 AM      0.17      0.00      0.17      0.00      7.48
02:17:01 AM      0.18      0.00      0.18      0.00      7.27
02:18:01 AM      0.20      0.00      0.20      0.00     10.96
02:19:01 AM      0.15      0.00      0.15      0.00     16.53
02:20:01 AM      0.13      0.00      0.13      0.00     16.53
02:21:01 AM      0.18      0.00      0.18      0.00     15.25
02:22:01 AM      0.68      0.00      0.68      0.00     21.63
02:23:01 AM      0.63      0.00      0.63      0.00     19.83
02:24:01 AM      0.33      0.00      0.33      0.00     22.96
02:25:01 AM      0.12      0.00      0.12      0.00      3.62
02:26:01 AM      0.15      0.00      0.15      0.00      1.48
02:27:01 AM      0.22      0.00      0.22      0.00      5.25
02:28:01 AM      0.37      0.00      0.37      0.00      6.10
02:29:01 AM      0.12      0.00      0.12      0.00      0.78
02:30:01 AM      0.17      0.00      0.17      0.00      4.28
02:31:01 AM      0.28      0.00      0.28      0.00      4.17
02:32:01 AM      0.28      0.00      0.28      0.00     10.10
02:33:01 AM      0.27      0.00      0.27      0.00     13.66
02:34:01 AM      0.15      0.00      0.15      0.00      7.73
02:35:01 AM      0.13      0.00      0.13      0.00     16.31
02:36:01 AM      0.20      0.00      0.20      0.00     16.86
02:37:01 AM      0.35      0.00      0.35      0.00     13.96
02:38:01 AM      0.22      0.00      0.22      0.00     19.71
02:39:02 AM      0.92      0.00      0.92      0.00     26.43
02:40:01 AM      0.41      0.00      0.41      0.00     25.75
02:41:01 AM      0.40      0.00      0.40      0.00      4.82
02:42:01 AM      0.67      0.00      0.67      0.00      9.70
02:43:01 AM      0.42      0.00      0.42      0.00      6.82
02:44:01 AM      0.33      0.00      0.33      0.00      3.47
02:45:01 AM      0.27      0.00      0.27      0.00      5.83
02:46:01 AM      0.10      0.00      0.10      0.00      0.63
02:47:01 AM      0.28      0.00      0.28      0.00     10.48
02:48:01 AM      0.12      0.00      0.12      0.00      3.17
02:49:01 AM      0.18      0.00      0.18      0.00     10.78
02:50:01 AM      0.17      0.00      0.17      0.00     17.44
02:51:01 AM      0.33      0.00      0.33      0.00     12.78
02:52:01 AM      0.28      0.00      0.28      0.00     19.20
02:53:01 AM      0.32      0.00      0.32      0.00     19.26
02:54:01 AM      0.18      0.00      0.18      0.00     15.31
02:55:01 AM      0.18      0.00      0.18      0.00      9.90
02:56:01 AM      0.18      0.00      0.18      0.00     22.73
02:57:01 AM      0.42      0.00      0.42      0.00      4.83
02:58:01 AM      0.43      0.00      0.43      0.00      8.28
02:59:01 AM      0.38      0.00      0.38      0.00      3.88
03:00:01 AM      0.40      0.00      0.40      0.00      4.55
03:01:01 AM      0.42      0.00      0.42      0.00      7.00
03:02:01 AM      0.50      0.00      0.50      0.00      6.83
03:03:01 AM      0.42      0.00      0.42      0.00     11.33
03:04:01 AM      0.23      0.00      0.23      0.00      9.45
03:05:01 AM      0.13      0.00      0.13      0.00      7.20
03:06:01 AM      0.30      0.00      0.30      0.00     13.65
03:07:01 AM      0.48      0.00      0.48      0.00     19.03
03:08:01 AM      0.47      0.00      0.47      0.00     16.98
03:09:01 AM      0.28      0.00      0.28      0.00     13.18
03:10:01 AM      5.25      0.28      4.97     33.86    172.22
03:11:01 AM     34.58      0.43     34.14     49.17   3510.79
Average:         0.49      0.00      0.48      0.47     30.14

12:00:01 AM kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty
12:01:01 AM   4823752   6945752   3058680     38.80      2688   2289884    798676      8.94    273060   2405444       188
12:02:01 AM   4824332   6946712   3058100     38.80      2688   2290264    798676      8.94    273096   2405020       160
12:03:01 AM   4823844   6946600   3058588     38.80      2688   2290640    798676      8.94    273096   2405628       112
12:04:01 AM   4823440   6946636   3058992     38.81      2688   2291072    798676      8.94    273096   2406160       124
12:05:01 AM   4822648   6946356   3059784     38.82      2688   2291584    798676      8.94    273096   2406872         4
12:06:01 AM   4822936   6946644   3059496     38.81      2688   2291584    798676      8.94    273096   2406588         4
12:07:01 AM   4822624   6946340   3059808     38.82      2688   2291592    796560      8.92    273096   2406812         4
12:08:01 AM   4822480   6946644   3059952     38.82      2688   2292040    799792      8.96    273204   2407116         4
12:09:01 AM   4822428   6946592   3060004     38.82      2688   2292040    799792      8.96    273204   2407048         4
12:10:01 AM   4822008   6946240   3060424     38.83      2688   2292108    798280      8.94    273204   2407348         4
12:11:01 AM   4822564   6946804   3059868     38.82      2688   2292116    798280      8.94    273204   2407016         4
12:12:01 AM   4822116   6946532   3060316     38.82      2688   2292292    798280      8.94    273204   2407284       184
12:13:01 AM   4822176   6946668   3060256     38.82      2688   2292368    798280      8.94    273204   2407456        24
12:14:01 AM   4822092   6946728   3060340     38.82      2688   2292512    798280      8.94    273212   2407528         4
12:15:01 AM   4821848   6946484   3060584     38.83      2688   2292512    798280      8.94    273212   2407412         4
12:16:01 AM   4821784   6946620   3060648     38.83      2688   2292712    798280      8.94    273220   2407604       152
12:17:01 AM   4821700   6946536   3060732     38.83      2688   2292712    798280      8.94    273220   2407604         4
12:18:01 AM   4821640   6946516   3060792     38.83      2688   2292752    798280      8.94    273220   2407712        48
12:19:01 AM   4821440   6946432   3060992     38.83      2688   2292868    798280      8.94    273220   2408136       116
12:20:01 AM   4821088   6946268   3061344     38.84      2688   2293056    796592      8.92    273220   2408296        96
12:21:01 AM   4821396   6946688   3061036     38.83      2688   2293172    796592      8.92    273220   2408068        16
12:22:01 AM   4821152   6946596   3061280     38.84      2688   2293324    796592      8.92    273220   2408220         4
12:23:01 AM   4821156   6946600   3061276     38.84      2688   2293324    796592      8.92    273220   2408296         4
12:24:01 AM   4820852   6946332   3061580     38.84      2688   2293384    796592      8.92    273220   2408492         4
12:25:01 AM   4821004   6946624   3061428     38.84      2688   2293524    796592      8.92    273228   2408420         4
12:26:01 AM   4820808   6946428   3061624     38.84      2688   2293524    796592      8.92    273228   2408808         4
12:27:01 AM   4820880   6946648   3061552     38.84      2688   2293672    812440      9.10    273228   2408568        16
12:28:01 AM   4820316   6946492   3062116     38.85      2688   2294088    812440      9.10    273228   2409224       204
12:29:01 AM   4819924   6946480   3062508     38.85      2688   2294464    812440      9.10    273228   2409464         4
12:30:02 AM   4819440   6946372   3062992     38.86      2688   2294840    811908      9.09    273228   2409956       188
12:31:01 AM   4819292   6946596   3063140     38.86      2688   2295220    811908      9.09    273228   2410220       112
12:32:01 AM   4818968   6946648   3063464     38.86      2688   2295596    811908      9.09    273228   2410480        36
12:33:01 AM   4818116   6946184   3064316     38.88      2688   2295976    811908      9.09    273228   2411168       204
12:34:01 AM   4817908   6946572   3064524     38.88      2688   2296576    811908      9.09    273228   2411532        56
12:35:01 AM   4817644   6946388   3064788     38.88      2688   2296648    796352      8.92    273228   2411820         4
12:36:01 AM   4818004   6946756   3064428     38.88      2688   2296656    796352      8.92    273228   2411624         8
12:37:01 AM   4817896   6946724   3064536     38.88      2688   2296732    796352      8.92    273228   2411700         4
12:38:01 AM   4817828   6946656   3064604     38.88      2688   2296732    796352      8.92    273228   2411768         4
12:39:01 AM   4817776   6946688   3064656     38.88      2688   2296816    796352      8.92    273228   2411784        88
12:40:01 AM   4817124   6946036   3065308     38.89      2688   2296816    788432      8.83    273228   2412224         4
12:41:01 AM   4817516   6946576   3064916     38.88      2688   2296968    788432      8.83    273228   2411932       152
12:42:01 AM   4817360   6946496   3065072     38.88      2688   2297044    788432      8.83    273228   2412124         4
12:43:01 AM   4817004   6946316   3065428     38.89      2688   2297220    788432      8.83    273228   2412400        24
12:44:01 AM   4817092   6946552   3065340     38.89      2688   2297368    788432      8.83    273228   2412352         4
12:45:01 AM   4817184   6946644   3065248     38.89      2688   2297368    788432      8.83    273228   2412468         4
12:46:01 AM   4816916   6946472   3065516     38.89      2688   2297464    788432      8.83    273228   2412440        48
12:47:01 AM   4816912   6946472   3065520     38.89      2688   2297468    788432      8.83    273228   2412444         4
12:48:01 AM   4816720   6946328   3065712     38.89      2688   2297516    803988      9.00    273228   2412632        56
12:49:01 AM   4816812   6946576   3065620     38.89      2688   2297672    803988      9.00    273228   2412660       156
12:50:01 AM   4816440   6946208   3065992     38.90      2688   2297676    796608      8.92    273228   2412896         4
12:51:01 AM   4816660   6946476   3065772     38.89      2688   2297724    796608      8.92    273228   2412712         4
12:52:01 AM   4816700   6946584   3065732     38.89      2688   2297792    796608      8.92    273228   2412928         4
12:53:01 AM   4816388   6946416   3066044     38.90      2688   2297936    796608      8.92    273228   2413020         4
12:54:01 AM   4816232   6946260   3066200     38.90      2688   2297936    796608      8.92    273228   2412952         4
12:55:01 AM   4815896   6946184   3066536     38.90      2688   2298200    796608      8.92    273228   2413548         4
12:56:01 AM   4815952   6946472   3066480     38.90      2688   2298440    797348      8.93    273228   2413608        24
12:57:01 AM   4815544   6946440   3066888     38.91      2688   2298816    797348      8.93    273228   2413912         4
12:58:01 AM   4814812   6946088   3067620     38.92      2688   2299196    797348      8.93    273228   2414736        40
12:59:01 AM   4814516   6946168   3067916     38.92      2688   2299572    797348      8.93    273228   2414952        56
01:00:01 AM   4813936   6945964   3068496     38.93      2688   2299948    788432      8.83    273228   2415356         4
01:01:01 AM   4813224   6945636   3069208     38.94      2688   2300328    788432      8.83    273228   2415968       160
01:02:01 AM   4813296   6946420   3069136     38.94      2688   2301032    788432      8.83    273248   2416200       456
01:03:01 AM   4812912   6946232   3069520     38.94      2688   2301228    788432      8.83    273248   2416464        72
01:04:01 AM   4812544   6945864   3069888     38.95      2688   2301228    788432      8.83    273248   2416656         4
01:05:01 AM   4812876   6946272   3069556     38.94      2688   2301304    788432      8.83    273248   2416592        88
01:06:01 AM   4813052   6946448   3069380     38.94      2688   2301304    788432      8.83    273248   2416488         4
01:07:01 AM   4812576   6945976   3069856     38.95      2688   2301308    788432      8.83    273248   2416716        12
01:08:01 AM   4813000   6946480   3069432     38.94      2688   2301388    788432      8.83    273248   2416656         4
01:09:01 AM   4812888   6946368   3069544     38.94      2688   2301388    788432      8.83    273248   2416796        16
01:10:01 AM   4812772   6946440   3069660     38.94      2688   2301576    780288      8.74    273248   2416776        28
01:11:01 AM   4810668   6944508   3071764     38.97      2688   2301764    801932      8.98    273256   2418456       156
01:12:01 AM   4812276   6946140   3070156     38.95      2688   2301772    811836      9.09    282584   2407760         4
01:13:01 AM   4812196   6946060   3070236     38.95      2688   2301772    811836      9.09    282584   2407876         4
01:14:01 AM   4811940   6945904   3070492     38.95      2688   2301872    811836      9.09    282584   2407980         4
01:15:01 AM   4812052   6946088   3070380     38.95      2688   2301940    811836      9.09    282584   2407936         4
01:16:01 AM   4811824   6945956   3070608     38.96      2688   2302036    811836      9.09    282584   2408292        16
01:17:01 AM   4811720   6945996   3070712     38.96      2688   2302180    811836      9.09    282588   2408312         4
01:18:01 AM   4811872   6946152   3070560     38.95      2688   2302184    811836      9.09    282588   2408268         4
01:19:01 AM   4811748   6946164   3070684     38.96      2688   2302320    793632      8.89    282588   2408360        52
01:20:01 AM   4811324   6946040   3071108     38.96      2688   2302628    814420      9.12    282588   2408772        40
01:21:01 AM   4811032   6946136   3071400     38.97      2688   2303004    814420      9.12    282588   2408928       180
01:22:01 AM   4810600   6946080   3071832     38.97      2688   2303380    814420      9.12    282588   2409516       100
01:23:01 AM   4810136   6945992   3072296     38.98      2688   2303764    814420      9.12    282588   2409884        36
01:24:01 AM   4810188   6946428   3072244     38.98      2688   2304148    814420      9.12    282588   2410084       224
01:25:01 AM   4809508   6946128   3072924     38.98      2688   2304528    797816      8.93    282588   2410464        24
01:26:01 AM   4808876   6946176   3073556     38.99      2688   2305200    797816      8.93    282588   2411288        24
01:27:01 AM   4808576   6946088   3073856     39.00      2688   2305412    797816      8.93    282588   2411592       164
01:28:01 AM   4808144   6945940   3074288     39.00      2688   2305696    797816      8.93    282588   2412096         4
01:29:01 AM   4807252   6945332   3075180     39.01      2688   2305980    797816      8.93    282588   2412892        56
01:30:01 AM   4806604   6944960   3075828     39.02      2688   2306264    797664      8.93    282588   2413400       152
01:31:01 AM   4806768   6945408   3075664     39.02      2688   2306548    797664      8.93    282588   2413572       104
01:32:01 AM   4806268   6945276   3076164     39.03      2688   2306908    797664      8.93    282588   2413800       228
01:33:01 AM   4805976   6945040   3076456     39.03      2688   2306964    797664      8.93    282664   2414048        16
01:34:01 AM   4806136   6945260   3076296     39.03      2688   2307024    797664      8.93    282664   2413900        24
01:35:01 AM   4805896   6945180   3076536     39.03      2688   2307184    797664      8.93    282700   2414348         4
01:36:01 AM   4805920   6945332   3076512     39.03      2688   2307312    797664      8.93    282708   2414152        56
01:37:01 AM   4805920   6945424   3076512     39.03      2688   2307404    797664      8.93    282708   2414244         4
01:38:01 AM   4805412   6945192   3077020     39.04      2688   2307680    797664      8.93    282708   2414588         4
01:39:01 AM   4805280   6945284   3077152     39.04      2688   2307912    797664      8.93    282708   2414888         4
01:40:01 AM   4804440   6944828   3077992     39.05      2688   2308296    797712      8.93    282708   2415520        68
01:41:01 AM   4803976   6944756   3078456     39.05      2688   2308684    797712      8.93    282708   2415856       236
01:42:01 AM   4803580   6944744   3078852     39.06      2688   2309064    797712      8.93    282708   2416348       144
01:43:01 AM   4803244   6944800   3079188     39.06      2688   2309448    797712      8.93    282708   2416696        68
01:44:01 AM   4802832   6944764   3079600     39.07      2688   2309832    797712      8.93    282708   2416992       224
01:45:01 AM   4802256   6944848   3080176     39.08      2688   2310484    797712      8.93    282708   2417632       356
01:46:01 AM   4801992   6944848   3080440     39.08      2688   2310748    797712      8.93    282708   2418012         4
01:47:01 AM   4802056   6944912   3080376     39.08      2688   2310748    797712      8.93    282708   2417896         4
01:48:01 AM   4802004   6944868   3080428     39.08      2688   2310756    797712      8.93    282708   2417968        16
01:49:01 AM   4801852   6944792   3080580     39.08      2688   2310832    797712      8.93    282708   2417980         4
01:50:01 AM   4801672   6944612   3080760     39.08      2688   2310832    797860      8.93    282708   2418096         4
01:51:01 AM   4801876   6944908   3080556     39.08      2688   2310916    797860      8.93    282708   2418180         4
01:52:01 AM   4801900   6944932   3080532     39.08      2688   2310916    797860      8.93    282708   2418064         4
01:53:01 AM   4801688   6944900   3080744     39.08      2688   2311096    797860      8.93    282708   2418424        16
01:54:01 AM   4801564   6944952   3080868     39.09      2688   2311288    797860      8.93    282712   2418424       152
01:55:01 AM   4801456   6944860   3080976     39.09      2688   2311288    797860      8.93    282712   2418440         4
01:56:01 AM   4801572   6944976   3080860     39.09      2688   2311288    797860      8.93    282712   2418440         4
01:57:01 AM   4801348   6944816   3081084     39.09      2688   2311352    797860      8.93    282712   2418504         4
01:58:01 AM   4801284   6944784   3081148     39.09      2688   2311384    797860      8.93    282712   2418628        44
01:59:01 AM   4801040   6944692   3081392     39.09      2688   2311536    797860      8.93    282716   2418824         4
02:00:01 AM   4800708   6944364   3081724     39.10      2688   2311540    813904      9.11    282716   2418944         4
02:01:01 AM   4800048   6943848   3082384     39.10      2688   2311676    813904      9.11    282720   2419532       144
02:02:01 AM   4800484   6944592   3081948     39.10      2688   2311992    797548      8.93    282720   2419356       236
02:03:01 AM   4800112   6944604   3082320     39.10      2688   2312372    797548      8.93    282720   2419600       132
02:04:01 AM   4799840   6944708   3082592     39.11      2688   2312740    797548      8.93    282720   2419908        40
02:05:01 AM   4799636   6944880   3082796     39.11      2688   2313124    797548      8.93    282720   2420284       188
02:06:01 AM   4798620   6944256   3083812     39.12      2688   2313508    797548      8.93    282720   2421112        56
02:07:01 AM   4798764   6944772   3083668     39.12      2688   2313888    797548      8.93    282720   2421076       208
02:08:01 AM   4798132   6944852   3084300     39.13      2688   2314604    797548      8.93    282720   2421936       364
02:09:01 AM   4798008   6944836   3084424     39.13      2688   2314700    812932      9.10    282720   2421912         4
02:10:01 AM   4797556   6944384   3084876     39.14      2688   2314700    812932      9.10    282720   2422376         4
02:11:01 AM   4797828   6944740   3084604     39.13      2688   2314784    812932      9.10    282720   2421964        88
02:12:01 AM   4797564   6944476   3084868     39.14      2688   2314784    812932      9.10    282720   2422212         4
02:13:01 AM   4797700   6944696   3084732     39.13      2688   2314868    812932      9.10    282720   2422156        92
02:14:01 AM   4797812   6944808   3084620     39.13      2688   2314868    812932      9.10    282720   2422092         4
02:15:01 AM   4797972   6944968   3084460     39.13      2688   2314868    812932      9.10    282720   2422092         4
02:16:01 AM   4797420   6944600   3085012     39.14      2688   2315052    789828      8.84    282720   2422276        16
02:17:01 AM   4797344   6944700   3085088     39.14      2688   2315228    789828      8.84    282720   2422452        16
02:18:01 AM   4796936   6944712   3085496     39.14      2688   2315648    789828      8.84    282720   2422936       208
02:19:01 AM   4796212   6944372   3086220     39.15      2688   2316032    789828      8.84    282720   2423544       140
02:20:01 AM   4795728   6944284   3086704     39.16      2688   2316428    812540      9.10    282720   2423888        72
02:21:01 AM   4795764   6944712   3086668     39.16      2688   2316816    812540      9.10    282720   2424044        40
02:22:01 AM   4795460   6944784   3086972     39.16      2688   2317200    812540      9.10    282720   2424420        24
02:23:01 AM   4795120   6944832   3087312     39.17      2688   2317580    812540      9.10    282720   2424876         4
02:24:01 AM   4794328   6944632   3088104     39.18      2688   2318188    812540      9.10    282720   2425520        24
02:25:01 AM   4794272   6944660   3088160     39.18      2688   2318256    812540      9.10    282720   2425608         4
02:26:01 AM   4794304   6944692   3088128     39.18      2688   2318256    812540      9.10    282720   2425608         4
02:27:01 AM   4793916   6944384   3088516     39.18      2688   2318336    812540      9.10    282720   2425980         8
02:28:01 AM   4794076   6944548   3088356     39.18      2688   2318340    812540      9.10    282720   2425780         4
02:29:01 AM   4794200   6944752   3088232     39.18      2688   2318420    812540      9.10    282720   2425792        88
02:30:01 AM   4793524   6944076   3088908     39.19      2688   2318420    828036      9.27    282720   2426140         4
02:31:01 AM   4793768   6944464   3088664     39.18      2688   2318564    798060      8.94    282720   2425940       148
02:32:01 AM   4793144   6944008   3089288     39.19      2688   2318732    798060      8.94    282720   2426540       116
02:33:01 AM   4793356   6944424   3089076     39.19      2688   2318944    798060      8.94    282720   2426484        28
02:34:01 AM   4793012   6944460   3089420     39.19      2688   2319324    798060      8.94    282720   2426732       204
02:35:01 AM   4792588   6944408   3089844     39.20      2688   2319696    798060      8.94    282720   2427100       116
02:36:01 AM   4792188   6944408   3090244     39.20      2688   2320096    798060      8.94    282720   2427500        56
02:37:01 AM   4791764   6944364   3090668     39.21      2688   2320476    798060      8.94    282720   2428100       204
02:38:01 AM   4789048   6942032   3093384     39.24      2688   2320860    789948      8.85    282720   2430736        72
02:39:02 AM   4790676   6944168   3091756     39.22      2688   2321356    790004      8.85    283388   2428228       168
02:40:01 AM   4790012   6943940   3092420     39.23      2688   2321792    809996      9.07    283388   2428896         4
02:41:01 AM   4790424   6944364   3092008     39.23      2688   2321796    809996      9.07    283388   2428560         4
02:42:01 AM   4790116   6944056   3092316     39.23      2688   2321804    809996      9.07    283388   2428976         4
02:43:01 AM   4790432   6944452   3092000     39.23      2688   2321876    809996      9.07    283388   2428724         4
02:44:01 AM   4790560   6944584   3091872     39.22      2688   2321880    793192      8.88    283388   2428660         4
02:45:01 AM   4790436   6944540   3091996     39.23      2688   2321960    793192      8.88    283388   2428740         4
02:46:01 AM   4790384   6944488   3092048     39.23      2688   2321960    793192      8.88    283388   2428740         4
02:47:01 AM   4790084   6944368   3092348     39.23      2688   2322140    793192      8.88    283388   2429028         4
02:48:01 AM   4789712   6944160   3092720     39.24      2688   2322304    793192      8.88    283388   2429404       108
02:49:01 AM   4789628   6944352   3092804     39.24      2688   2322588    793192      8.88    283388   2429364       116
02:50:01 AM   4788984   6944096   3093448     39.24      2688   2322972    813124      9.10    283388   2429976        36
02:51:01 AM   4789140   6944652   3093292     39.24      2688   2323372    813124      9.10    283388   2430148       204
02:52:01 AM   4788296   6944196   3094136     39.25      2688   2323760    813124      9.10    283388   2430652       132
02:53:01 AM   4788084   6944364   3094348     39.26      2688   2324140    813124      9.10    283388   2430984        68
02:54:01 AM   4787752   6944412   3094680     39.26      2688   2324520    797744      8.93    283388   2431296        52
02:55:01 AM   4787032   6944404   3095400     39.27      2688   2325240    797744      8.93    283388   2432008       540
02:56:01 AM   4787096   6944592   3095336     39.27      2688   2325348    797744      8.93    283388   2432136         4
02:57:01 AM   4786888   6944384   3095544     39.27      2688   2325348    797744      8.93    283388   2432136         4
02:58:01 AM   4786780   6944356   3095652     39.27      2688   2325428    797744      8.93    283388   2432284         4
02:59:01 AM   4786908   6944488   3095524     39.27      2688   2325432    797744      8.93    283388   2432220         4
03:00:01 AM   4786524   6944112   3095908     39.28      2688   2325440    789912      8.84    283388   2432456         4
03:01:01 AM   4785908   6943572   3096524     39.28      2688   2325516    789912      8.84    283388   2433000         4
03:02:01 AM   4786516   6944180   3095916     39.28      2688   2325516    789912      8.84    283404   2432556         4
03:03:01 AM   4785548   6943392   3096884     39.29      2688   2325696    808728      9.06    283404   2433340         4
03:04:01 AM   4784988   6943028   3097444     39.30      2688   2325892    826564      9.25    283404   2433640         4
03:05:01 AM   4782088   6940456   3100344     39.33      2688   2326228    860360      9.63    283408   2436496       172
03:06:01 AM   4781340   6939940   3101092     39.34      2688   2326444    881520      9.87    283408   2436840        40
03:07:01 AM   4778080   6937080   3104352     39.38      2688   2326844    914852     10.24    283408   2439932         4
03:08:01 AM   4777832   6937164   3104600     39.39      2688   2327176    931408     10.43    283408   2440012         4
03:09:01 AM   4776596   6936276   3105836     39.40      2688   2327524    954228     10.68    283408   2440712        48
03:10:01 AM   4832272   6877360   3050160     38.70      2688   2216724    782120      8.76    325056   2361560     76376
03:11:01 AM   4845268   6890528   3037164     38.53      2688   2218308    773948      8.67    526832   2153476     11960
Average:      4805856   6944588   3076576     39.03      2688   2306665    802977      8.99    280779   2416145       523

12:00:01 AM     IFACE   rxpck/s   txpck/s    rxkB/s    txkB/s   rxcmp/s   txcmp/s  rxmcst/s   %ifutil
12:01:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:01:01 AM      eth0     11.73      9.31      2.78      1.83      0.00      0.00      0.00      0.00
12:02:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:02:01 AM      eth0     11.13      9.03      2.70      1.80      0.00      0.00      0.00      0.00
12:03:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:03:01 AM      eth0     11.46      9.27      2.79      1.87      0.00      0.00      0.00      0.00
12:04:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:04:01 AM      eth0     12.96     10.50      3.15      2.10      0.00      0.00      0.00      0.00
12:05:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:05:01 AM      eth0     12.25      9.90      3.12      1.98      0.00      0.00      0.00      0.00
12:06:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:06:01 AM      eth0      0.17      0.00      0.01      0.00      0.00      0.00      0.00      0.00
12:07:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:07:01 AM      eth0      0.40      0.02      0.02      0.00      0.00      0.00      0.00      0.00
12:08:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:08:01 AM      eth0      0.67      0.38      0.20      0.11      0.00      0.00      0.00      0.00
12:09:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:09:01 AM      eth0      0.43      0.00      0.02      0.00      0.00      0.00      0.00      0.00
12:10:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:10:01 AM      eth0      0.77      0.37      0.13      0.05      0.00      0.00      0.00      0.00
12:11:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:11:01 AM      eth0      0.55      0.05      0.03      0.00      0.00      0.00      0.00      0.00
12:12:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:12:01 AM      eth0     10.36      9.73      1.80      1.08      0.00      0.00      0.00      0.00
12:13:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:13:01 AM      eth0      5.73      5.35      0.88      0.50      0.00      0.00      0.00      0.00
12:14:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:14:01 AM      eth0      0.48      0.25      0.04      0.05      0.00      0.00      0.00      0.00
12:15:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:15:01 AM      eth0      0.55      0.10      0.02      0.00      0.00      0.00      0.00      0.00
12:16:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:16:01 AM      eth0      5.10      5.02      0.71      0.42      0.00      0.00      0.00      0.00
12:17:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:17:01 AM      eth0      0.40      0.00      0.02      0.00      0.00      0.00      0.00      0.00
12:18:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:18:01 AM      eth0      4.62      4.35      0.75      0.36      0.00      0.00      0.00      0.00
12:19:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:19:01 AM      eth0      6.00      5.53      1.03      0.61      0.00      0.00      0.00      0.00
12:20:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:20:01 AM      eth0      9.78      9.36      1.48      0.75      0.00      0.00      0.00      0.00
12:21:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:21:01 AM      eth0      5.48      5.08      0.74      0.40      0.00      0.00      0.00      0.00
12:22:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:22:01 AM      eth0      0.70      0.53      0.08      0.10      0.00      0.00      0.00      0.00
12:23:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:23:01 AM      eth0      0.73      0.15      0.16      0.07      0.00      0.00      0.00      0.00
12:24:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:24:01 AM      eth0      5.35      4.88      0.98      0.56      0.00      0.00      0.00      0.00
12:25:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:25:01 AM      eth0      1.05      0.27      0.09      0.05      0.00      0.00      0.00      0.00
12:26:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:26:01 AM      eth0      0.47      0.17      0.26      0.19      0.00      0.00      0.00      0.00
12:27:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:27:01 AM      eth0      9.71      8.93      1.58      0.93      0.00      0.00      0.00      0.00
12:28:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:28:01 AM      eth0     12.95     10.51      3.43      2.29      0.00      0.00      0.00      0.00
12:29:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:29:01 AM      eth0     11.85      9.13      2.79      1.81      0.00      0.00      0.00      0.00
12:30:02 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:30:02 AM      eth0     11.20      9.30      2.72      1.82      0.00      0.00      0.00      0.00
12:31:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:31:01 AM      eth0     11.88      9.30      2.81      1.82      0.00      0.00      0.00      0.00
12:32:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:32:01 AM      eth0     12.03      9.05      2.83      1.80      0.00      0.00      0.00      0.00
12:33:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:33:01 AM      eth0     11.71      9.41      3.30      2.25      0.00      0.00      0.00      0.00
12:34:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:34:01 AM      eth0     15.98     13.31      3.97      2.54      0.00      0.00      0.00      0.00
12:35:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:35:01 AM      eth0      1.57      0.75      0.67      0.47      0.00      0.00      0.00      0.00
12:36:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:36:01 AM      eth0      0.25      0.00      0.01      0.00      0.00      0.00      0.00      0.00
12:37:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:37:01 AM      eth0      0.63      0.33      0.08      0.04      0.00      0.00      0.00      0.00
12:38:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:38:01 AM      eth0      0.63      0.17      0.18      0.07      0.00      0.00      0.00      0.00
12:39:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:39:01 AM      eth0      1.00      0.30      0.12      0.04      0.00      0.00      0.00      0.00
12:40:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:40:01 AM      eth0      0.63      0.25      0.31      0.23      0.00      0.00      0.00      0.00
12:41:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:41:01 AM      eth0      3.87      3.37      0.86      0.66      0.00      0.00      0.00      0.00
12:42:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:42:01 AM      eth0     12.26     11.75      1.71      0.83      0.00      0.00      0.00      0.00
12:43:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:43:01 AM      eth0      6.18      5.71      1.19      0.74      0.00      0.00      0.00      0.00
12:44:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:44:01 AM      eth0      0.63      0.32      0.05      0.06      0.00      0.00      0.00      0.00
12:45:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:45:01 AM      eth0      0.43      0.00      0.02      0.00      0.00      0.00      0.00      0.00
12:46:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:46:01 AM      eth0      5.11      5.08      0.71      0.41      0.00      0.00      0.00      0.00
12:47:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:47:01 AM      eth0      0.47      0.00      0.02      0.00      0.00      0.00      0.00      0.00
12:48:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:48:01 AM      eth0      5.77      5.17      1.12      0.59      0.00      0.00      0.00      0.00
12:49:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:49:01 AM      eth0      0.92      0.62      0.09      0.11      0.00      0.00      0.00      0.00
12:50:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:50:01 AM      eth0      0.13      0.00      0.01      0.00      0.00      0.00      0.00      0.00
12:51:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:51:01 AM      eth0      5.50      4.78      0.73      0.33      0.00      0.00      0.00      0.00
12:52:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:52:01 AM      eth0      6.08      5.77      1.11      0.70      0.00      0.00      0.00      0.00
12:53:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:53:01 AM      eth0      0.87      0.38      0.18      0.12      0.00      0.00      0.00      0.00
12:54:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:54:01 AM      eth0      0.68      0.05      0.10      0.00      0.00      0.00      0.00      0.00
12:55:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:55:01 AM      eth0     12.93     11.80      2.24      7.61      0.00      0.00      0.00      0.00
12:56:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:56:01 AM      eth0      9.48      8.50      2.11      6.52      0.00      0.00      0.00      0.00
12:57:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:57:01 AM      eth0     17.15      9.18      3.40      1.81      0.00      0.00      0.00      0.00
12:58:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:58:01 AM      eth0     13.00     10.15      4.21      2.87      0.00      0.00      0.00      0.00
12:59:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
12:59:01 AM      eth0     12.46      9.25      3.13      2.03      0.00      0.00      0.00      0.00
01:00:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:00:01 AM      eth0     15.51      9.00      3.23      1.80      0.00      0.00      0.00      0.00
01:01:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:01:01 AM      eth0     11.53      9.21      2.71      1.84      0.00      0.00      0.00      0.00
01:02:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:02:01 AM      eth0     20.55     16.95      5.11      3.28      0.00      0.00      0.00      0.00
01:03:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:03:01 AM      eth0      2.97      2.02      0.67      0.41      0.00      0.00      0.00      0.00
01:04:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:04:01 AM      eth0      1.67      0.30      0.35      0.20      0.00      0.00      0.00      0.00
01:05:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:05:01 AM      eth0      1.58      0.23      0.16      0.04      0.00      0.00      0.00      0.00
01:06:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:06:01 AM      eth0      2.97      0.03      0.31      0.00      0.00      0.00      0.00      0.00
01:07:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:07:01 AM      eth0      1.42      0.40      0.64      0.42      0.00      0.00      0.00      0.00
01:08:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:08:01 AM      eth0      2.07      0.42      0.38      0.11      0.00      0.00      0.00      0.00
01:09:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:09:01 AM      eth0      2.68      0.25      0.50      0.20      0.00      0.00      0.00      0.00
01:10:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:10:01 AM      eth0     10.51      9.46      1.80      1.06      0.00      0.00      0.00      0.00
01:11:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:11:01 AM      eth0      6.38      5.95      0.86      0.50      0.00      0.00      0.00      0.00
01:12:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:12:01 AM      eth0      0.42      0.07      0.02      0.00      0.00      0.00      0.00      0.00
01:13:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:13:01 AM      eth0      0.90      0.22      0.16      0.07      0.00      0.00      0.00      0.00
01:14:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:14:01 AM      eth0      9.87      9.63      1.38      0.71      0.00      0.00      0.00      0.00
01:15:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:15:01 AM      eth0      5.15      4.75      0.72      0.41      0.00      0.00      0.00      0.00
01:16:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:16:01 AM      eth0     11.35      9.60      1.78      0.89      0.00      0.00      0.00      0.00
01:17:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:17:01 AM      eth0      1.92      0.90      0.65      0.47      0.00      0.00      0.00      0.00
01:18:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:18:01 AM      eth0      1.62      0.18      0.34      0.07      0.00      0.00      0.00      0.00
01:19:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:19:01 AM      eth0     10.81      8.88      1.87      1.06      0.00      0.00      0.00      0.00
01:20:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:20:01 AM      eth0      9.20      7.32      2.20      1.45      0.00      0.00      0.00      0.00
01:21:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:21:01 AM      eth0     11.60      8.96      2.78      1.80      0.00      0.00      0.00      0.00
01:22:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:22:01 AM      eth0     11.51      9.43      3.08      2.04      0.00      0.00      0.00      0.00
01:23:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:23:01 AM      eth0     10.81      8.75      2.73      1.80      0.00      0.00      0.00      0.00
01:24:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:24:01 AM      eth0     11.16      9.05      2.80      1.80      0.00      0.00      0.00      0.00
01:25:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:25:01 AM      eth0     10.95      8.93      2.72      1.80      0.00      0.00      0.00      0.00
01:26:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:26:01 AM      eth0     18.40     15.40      4.65      2.94      0.00      0.00      0.00      0.00
01:27:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:27:01 AM      eth0      1.73      0.82      0.47      0.30      0.00      0.00      0.00      0.00
01:28:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:28:01 AM      eth0      0.97      0.80      0.32      0.20      0.00      0.00      0.00      0.00
01:29:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:29:01 AM      eth0      1.02      0.65      0.20      0.13      0.00      0.00      0.00      0.00
01:30:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:30:01 AM      eth0      0.82      0.60      0.19      0.13      0.00      0.00      0.00      0.00
01:31:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:31:01 AM      eth0      0.95      0.60      0.20      0.13      0.00      0.00      0.00      0.00
01:32:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:32:01 AM      eth0      4.70      3.68      1.05      0.72      0.00      0.00      0.00      0.00
01:33:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:33:01 AM      eth0      4.57      3.97      0.98      0.62      0.00      0.00      0.00      0.00
01:34:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:34:01 AM      eth0      3.69      3.19      0.50      0.30      0.00      0.00      0.00      0.00
01:35:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:35:01 AM      eth0      3.98      3.43      0.77      0.55      0.00      0.00      0.00      0.00
01:36:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:36:01 AM      eth0      5.18      4.97      0.70      0.42      0.00      0.00      0.00      0.00
01:37:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:37:01 AM      eth0      3.08      2.72      0.41      0.28      0.00      0.00      0.00      0.00
01:38:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:38:01 AM      eth0      5.28      5.07      1.02      0.72      0.00      0.00      0.00      0.00
01:39:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:39:01 AM      eth0      8.88      7.82      1.76      1.10      0.00      0.00      0.00      0.00
01:40:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:40:01 AM      eth0     10.33      8.83      2.65      1.79      0.00      0.00      0.00      0.00
01:41:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:41:01 AM      eth0     12.43      9.25      3.11      2.00      0.00      0.00      0.00      0.00
01:42:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:42:01 AM      eth0     11.40      9.30      3.06      2.03      0.00      0.00      0.00      0.00
01:43:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:43:01 AM      eth0     11.70      9.36      2.95      1.90      0.00      0.00      0.00      0.00
01:44:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:44:01 AM      eth0     10.98      9.03      2.75      1.80      0.00      0.00      0.00      0.00
01:45:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:45:01 AM      eth0     17.31     14.70      4.63      2.89      0.00      0.00      0.00      0.00
01:46:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:46:01 AM      eth0      5.80      4.63      1.18      0.81      0.00      0.00      0.00      0.00
01:47:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:47:01 AM      eth0      0.47      0.05      0.02      0.00      0.00      0.00      0.00      0.00
01:48:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:48:01 AM      eth0      0.65      0.25      0.16      0.07      0.00      0.00      0.00      0.00
01:49:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:49:01 AM      eth0      0.67      0.27      0.08      0.04      0.00      0.00      0.00      0.00
01:50:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:50:01 AM      eth0      0.20      0.00      0.01      0.00      0.00      0.00      0.00      0.00
01:51:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:51:01 AM      eth0      0.67      0.30      0.08      0.04      0.00      0.00      0.00      0.00
01:52:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:52:01 AM      eth0      0.22      0.00      0.01      0.00      0.00      0.00      0.00      0.00
01:53:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:53:01 AM      eth0     10.45      9.63      1.92      1.13      0.00      0.00      0.00      0.00
01:54:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:54:01 AM      eth0      5.11      4.86      0.70      0.42      0.00      0.00      0.00      0.00
01:55:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:55:01 AM      eth0      0.37      0.07      0.02      0.00      0.00      0.00      0.00      0.00
01:56:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:56:01 AM      eth0      0.43      0.12      0.02      0.01      0.00      0.00      0.00      0.00
01:57:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:57:01 AM      eth0      4.32      4.12      0.59      0.33      0.00      0.00      0.00      0.00
01:58:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:58:01 AM      eth0      5.35      5.00      0.84      0.40      0.00      0.00      0.00      0.00
01:59:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
01:59:01 AM      eth0      0.93      0.47      0.12      0.09      0.00      0.00      0.00      0.00
02:00:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:00:01 AM      eth0      0.18      0.00      0.01      0.00      0.00      0.00      0.00      0.00
02:01:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:01:01 AM      eth0      9.43      8.86      1.55      0.89      0.00      0.00      0.00      0.00
02:02:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:02:01 AM      eth0      9.18      7.56      2.38      1.64      0.00      0.00      0.00      0.00
02:03:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:03:01 AM      eth0     11.05      9.15      2.84      1.87      0.00      0.00      0.00      0.00
02:04:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:04:01 AM      eth0     10.55      8.98      2.70      1.80      0.00      0.00      0.00      0.00
02:05:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:05:01 AM      eth0     11.03      8.92      2.73      1.80      0.00      0.00      0.00      0.00
02:06:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:06:01 AM      eth0     11.41      9.30      3.01      2.00      0.00      0.00      0.00      0.00
02:07:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:07:01 AM      eth0     10.93      9.03      2.74      1.80      0.00      0.00      0.00      0.00
02:08:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:08:01 AM      eth0     20.36     16.41      5.38      3.35      0.00      0.00      0.00      0.00
02:09:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:09:01 AM      eth0      1.25      0.40      0.19      0.06      0.00      0.00      0.00      0.00
02:10:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:10:01 AM      eth0      0.27      0.05      0.01      0.00      0.00      0.00      0.00      0.00
02:11:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:11:01 AM      eth0      5.55      0.30      0.68      0.04      0.00      0.00      0.00      0.00
02:12:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:12:01 AM      eth0      1.73      0.40      0.62      0.41      0.00      0.00      0.00      0.00
02:13:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:13:01 AM      eth0      0.97      0.35      0.22      0.10      0.00      0.00      0.00      0.00
02:14:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:14:01 AM      eth0      6.83      0.07      0.89      0.00      0.00      0.00      0.00      0.00
02:15:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:15:01 AM      eth0      1.08      0.00      0.06      0.00      0.00      0.00      0.00      0.00
02:16:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:16:01 AM      eth0     10.61      9.70      1.82      1.12      0.00      0.00      0.00      0.00
02:17:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:17:01 AM      eth0     11.08     10.83      1.92      1.25      0.00      0.00      0.00      0.00
02:18:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:18:01 AM      eth0     12.95     10.45      3.24      2.08      0.00      0.00      0.00      0.00
02:19:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:19:01 AM      eth0     12.36      9.40      3.07      2.02      0.00      0.00      0.00      0.00
02:20:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:20:01 AM      eth0     12.45      9.16      2.87      1.82      0.00      0.00      0.00      0.00
02:21:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:21:01 AM      eth0     14.16      9.13      2.93      1.81      0.00      0.00      0.00      0.00
02:22:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:22:01 AM      eth0     12.65      9.10      2.79      1.81      0.00      0.00      0.00      0.00
02:23:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:23:01 AM      eth0     11.76      9.18      2.91      1.87      0.00      0.00      0.00      0.00
02:24:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:24:01 AM      eth0     16.08     13.35      4.06      2.53      0.00      0.00      0.00      0.00
02:25:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:25:01 AM      eth0      0.63      0.27      0.08      0.04      0.00      0.00      0.00      0.00
02:26:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:26:01 AM      eth0      2.77      0.00      0.30      0.00      0.00      0.00      0.00      0.00
02:27:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:27:01 AM      eth0      1.42      0.68      0.59      0.43      0.00      0.00      0.00      0.00
02:28:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:28:01 AM      eth0      3.42      0.12      0.58      0.06      0.00      0.00      0.00      0.00
02:29:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:29:01 AM      eth0      3.32      0.30      0.35      0.04      0.00      0.00      0.00      0.00
02:30:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:30:01 AM      eth0      0.77      0.00      0.04      0.00      0.00      0.00      0.00      0.00
02:31:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:31:01 AM      eth0      4.48      3.40      0.93      0.66      0.00      0.00      0.00      0.00
02:32:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:32:01 AM      eth0     11.65     10.30      2.22      1.39      0.00      0.00      0.00      0.00
02:33:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:33:01 AM      eth0     12.18     10.63      2.46      1.47      0.00      0.00      0.00      0.00
02:34:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:34:01 AM      eth0     11.30      9.00      2.78      1.80      0.00      0.00      0.00      0.00
02:35:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:35:01 AM      eth0     11.63      9.08      2.80      1.81      0.00      0.00      0.00      0.00
02:36:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:36:01 AM      eth0     12.68      9.15      3.04      1.81      0.00      0.00      0.00      0.00
02:37:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:37:01 AM      eth0     12.71      9.37      3.23      2.03      0.00      0.00      0.00      0.00
02:38:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:38:01 AM      eth0     11.56      9.43      3.17      2.07      0.00      0.00      0.00      0.00
02:39:02 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:39:02 AM      eth0     16.25     11.45      3.79      2.30      0.00      0.00      0.00      0.00
02:40:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:40:01 AM      eth0     13.91      8.37     57.06      1.53      0.00      0.00      0.00      0.00
02:41:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:41:01 AM      eth0      0.92      0.00      0.05      0.00      0.00      0.00      0.00      0.00
02:42:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:42:01 AM      eth0      1.07      0.22      0.31      0.20      0.00      0.00      0.00      0.00
02:43:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:43:01 AM      eth0      1.07      0.47      0.22      0.11      0.00      0.00      0.00      0.00
02:44:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:44:01 AM      eth0      0.42      0.00      0.02      0.00      0.00      0.00      0.00      0.00
02:45:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:45:01 AM      eth0      0.85      0.38      0.10      0.05      0.00      0.00      0.00      0.00
02:46:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:46:01 AM      eth0      0.60      0.00      0.03      0.00      0.00      0.00      0.00      0.00
02:47:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:47:01 AM      eth0     10.85      9.55      1.88      1.07      0.00      0.00      0.00      0.00
02:48:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:48:01 AM      eth0     11.15     10.73      2.31      1.48      0.00      0.00      0.00      0.00
02:49:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:49:01 AM      eth0      7.97      6.80      1.90      1.35      0.00      0.00      0.00      0.00
02:50:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:50:01 AM      eth0     11.23      9.05      2.78      1.81      0.00      0.00      0.00      0.00
02:51:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:51:01 AM      eth0     12.15      9.05      2.95      1.80      0.00      0.00      0.00      0.00
02:52:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:52:01 AM      eth0     10.81      9.00      2.72      1.80      0.00      0.00      0.00      0.00
02:53:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:53:01 AM      eth0     11.06      9.16      2.83      1.87      0.00      0.00      0.00      0.00
02:54:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:54:01 AM      eth0     11.70      9.05      2.89      1.80      0.00      0.00      0.00      0.00
02:55:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:55:01 AM      eth0     19.91     16.98      5.00      3.25      0.00      0.00      0.00      0.00
02:56:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:56:01 AM      eth0      0.78      0.48      0.13      0.07      0.00      0.00      0.00      0.00
02:57:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:57:01 AM      eth0      0.53      0.02      0.02      0.00      0.00      0.00      0.00      0.00
02:58:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:58:01 AM      eth0      0.78      0.52      0.22      0.11      0.00      0.00      0.00      0.00
02:59:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:59:01 AM      eth0      0.42      0.00      0.02      0.00      0.00      0.00      0.00      0.00
03:00:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:00:01 AM      eth0      0.15      0.02      0.01      0.00      0.00      0.00      0.00      0.00
03:01:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:01:01 AM      eth0      0.82      0.33      0.11      0.06      0.00      0.00      0.00      0.00
03:02:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:02:01 AM      eth0      0.20      0.05      0.01      0.00      0.00      0.00      0.00      0.00
03:03:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:03:01 AM      eth0     10.80      9.95      1.98      1.19      0.00      0.00      0.00      0.00
03:04:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:04:01 AM      eth0      9.12      8.87      1.55      1.02      0.00      0.00      0.00      0.00
03:05:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:05:01 AM      eth0     12.05     11.28      2.18      1.52      0.00      0.00      0.00      0.00
03:06:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:06:01 AM      eth0     13.18     13.03      2.25      1.27      0.00      0.00      0.00      0.00
03:07:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:07:01 AM      eth0     10.56      9.93      3.32      1.47      0.00      0.00      0.00      0.00
03:08:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:08:01 AM      eth0      8.72      8.25      3.04      1.02      0.00      0.00      0.00      0.00
03:09:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:09:01 AM      eth0      9.78      9.30      3.04      1.14      0.00      0.00      0.00      0.00
03:10:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:10:01 AM      eth0    129.80     87.57    218.20    229.66      0.00      0.00      0.00      0.00
03:11:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
03:11:01 AM      eth0     17.84     17.19     15.80      8.47      0.00      0.00      0.00      0.00
Average:           lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
Average:         eth0      7.27      5.68      2.94      2.19      0.00      0.00      0.00      0.00


---> sar -P ALL:
Linux 4.18.0-553.5.1.el8.x86_64 (prd-centos8-robot-2c-8g-40223.novalocal) 	07/07/2025 	_x86_64_	(2 CPU)

12:00:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
12:01:01 AM     all      4.38      0.03      0.49      0.07      0.07     94.97
12:01:01 AM       0      5.26      0.03      0.62      0.00      0.07     94.02
12:01:01 AM       1      3.49      0.02      0.37      0.13      0.07     95.92
12:02:01 AM     all      4.35      0.00      0.33      0.00      0.07     95.25
12:02:01 AM       0      4.35      0.00      0.33      0.00      0.07     95.25
12:02:01 AM       1      4.36      0.00      0.33      0.00      0.07     95.24
12:03:01 AM     all      4.33      0.00      0.34      0.00      0.07     95.26
12:03:01 AM       0      3.81      0.00      0.30      0.00      0.07     95.82
12:03:01 AM       1      4.85      0.00      0.38      0.00      0.07     94.70
12:04:01 AM     all      4.99      0.00      0.35      0.00      0.08     94.58
12:04:01 AM       0      4.14      0.00      0.33      0.00      0.08     95.44
12:04:01 AM       1      5.83      0.00      0.37      0.00      0.08     93.72
12:05:01 AM     all      3.77      0.00      0.22      0.00      0.05     95.96
12:05:01 AM       0      5.25      0.00      0.28      0.00      0.07     94.40
12:05:01 AM       1      2.29      0.00      0.15      0.00      0.03     97.53
12:06:01 AM     all      0.31      0.00      0.05      0.00      0.03     99.61
12:06:01 AM       0      0.10      0.00      0.07      0.00      0.03     99.80
12:06:01 AM       1      0.52      0.00      0.03      0.00      0.03     99.42
12:07:01 AM     all      0.28      0.00      0.08      0.00      0.03     99.61
12:07:01 AM       0      0.15      0.00      0.10      0.00      0.05     99.70
12:07:01 AM       1      0.42      0.00      0.05      0.00      0.02     99.52
12:08:01 AM     all      0.48      0.00      0.13      0.01      0.03     99.37
12:08:01 AM       0      0.67      0.00      0.12      0.02      0.02     99.18
12:08:01 AM       1      0.28      0.00      0.13      0.00      0.03     99.55
12:09:01 AM     all      0.34      0.00      0.05      0.00      0.04     99.57
12:09:01 AM       0      0.55      0.00      0.03      0.00      0.03     99.38
12:09:01 AM       1      0.13      0.00      0.07      0.00      0.05     99.75
12:10:01 AM     all      0.48      0.00      0.08      0.00      0.03     99.42
12:10:01 AM       0      0.60      0.00      0.08      0.00      0.03     99.28
12:10:01 AM       1      0.35      0.00      0.07      0.00      0.02     99.57
12:11:01 AM     all      0.19      0.00      0.08      0.00      0.04     99.69
12:11:01 AM       0      0.30      0.00      0.07      0.00      0.03     99.60
12:11:01 AM       1      0.08      0.00      0.08      0.00      0.05     99.78

12:11:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
12:12:01 AM     all      4.08      0.00      3.08      0.00      0.05     92.79
12:12:01 AM       0      3.24      0.00      0.37      0.00      0.05     96.34
12:12:01 AM       1      4.91      0.00      5.78      0.00      0.05     89.26
12:13:01 AM     all      7.36      0.00      2.38      0.00      0.07     90.19
12:13:01 AM       0      0.68      0.00      0.15      0.00      0.07     99.10
12:13:01 AM       1     14.44      0.00      4.74      0.00      0.07     80.75
12:14:01 AM     all      1.27      0.00      0.11      0.00      0.04     98.58
12:14:01 AM       0      1.00      0.00      0.05      0.00      0.02     98.93
12:14:01 AM       1      1.54      0.00      0.17      0.00      0.07     98.22
12:15:01 AM     all      0.34      0.00      0.06      0.00      0.03     99.57
12:15:01 AM       0      0.57      0.00      0.03      0.00      0.02     99.38
12:15:01 AM       1      0.12      0.00      0.08      0.00      0.03     99.77
12:16:01 AM     all      5.37      0.00      1.76      0.00      0.06     92.81
12:16:01 AM       0      0.73      0.00      0.07      0.00      0.05     99.15
12:16:01 AM       1     10.21      0.00      3.54      0.00      0.07     86.18
12:17:01 AM     all      0.20      0.00      0.08      0.00      0.04     99.67
12:17:01 AM       0      0.30      0.00      0.10      0.00      0.05     99.55
12:17:01 AM       1      0.10      0.00      0.07      0.00      0.03     99.80
12:18:01 AM     all      0.74      0.00      0.08      0.00      0.03     99.15
12:18:01 AM       0      1.16      0.00      0.10      0.00      0.03     98.71
12:18:01 AM       1      0.32      0.00      0.07      0.00      0.03     99.58
12:19:01 AM     all      7.46      0.00      1.87      0.00      0.07     90.60
12:19:01 AM       0      8.99      0.00      2.71      0.00      0.07     88.23
12:19:01 AM       1      5.97      0.00      1.06      0.00      0.07     92.90
12:20:01 AM     all      7.24      0.00      2.85      0.00      0.05     89.86
12:20:01 AM       0      0.18      0.00      0.15      0.00      0.05     99.62
12:20:01 AM       1     14.79      0.00      5.72      0.00      0.05     79.44
12:21:01 AM     all      7.01      0.00      1.88      0.00      0.07     91.05
12:21:01 AM       0      4.64      0.00      0.52      0.00      0.07     94.77
12:21:01 AM       1      9.41      0.00      3.26      0.00      0.07     87.27
12:22:01 AM     all      2.88      0.00      1.40      0.00      0.05     95.67
12:22:01 AM       0      0.32      0.00      0.10      0.00      0.05     99.53
12:22:01 AM       1      5.48      0.00      2.72      0.00      0.05     91.75

12:22:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
12:23:01 AM     all      0.33      0.00      0.05      0.00      0.03     99.58
12:23:01 AM       0      0.15      0.00      0.05      0.00      0.05     99.75
12:23:01 AM       1      0.52      0.00      0.05      0.00      0.02     99.42
12:24:01 AM     all      4.11      0.00      1.48      0.00      0.05     94.36
12:24:01 AM       0      7.79      0.00      2.91      0.00      0.05     89.24
12:24:01 AM       1      0.60      0.00      0.12      0.00      0.05     99.23
12:25:01 AM     all      1.40      0.00      0.11      0.00      0.05     98.44
12:25:01 AM       0      0.38      0.00      0.08      0.00      0.03     99.50
12:25:01 AM       1      2.42      0.00      0.13      0.00      0.07     97.38
12:26:01 AM     all      0.38      0.00      0.07      0.00      0.03     99.52
12:26:01 AM       0      0.18      0.00      0.08      0.00      0.05     99.68
12:26:01 AM       1      0.57      0.00      0.05      0.00      0.02     99.37
12:27:01 AM     all      6.23      0.00      2.70      0.00      0.08     91.00
12:27:01 AM       0      7.17      0.00      5.09      0.00      0.09     87.66
12:27:01 AM       1      5.30      0.00      0.36      0.00      0.07     94.27
12:28:01 AM     all      5.17      0.00      0.37      0.00      0.08     94.38
12:28:01 AM       0      2.92      0.00      0.23      0.00      0.07     96.78
12:28:01 AM       1      7.44      0.00      0.50      0.00      0.08     91.98
12:29:01 AM     all      4.38      0.00      0.33      0.00      0.08     95.21
12:29:01 AM       0      3.34      0.00      0.25      0.00      0.08     96.33
12:29:01 AM       1      5.42      0.00      0.40      0.00      0.08     94.10
12:30:02 AM     all      4.41      0.00      0.31      0.00      0.06     95.22
12:30:02 AM       0      1.74      0.00      0.18      0.00      0.05     98.03
12:30:02 AM       1      7.09      0.00      0.43      0.00      0.07     92.41
12:31:01 AM     all      4.55      0.00      0.32      0.00      0.06     95.07
12:31:01 AM       0      5.17      0.00      0.34      0.00      0.05     94.44
12:31:01 AM       1      3.93      0.00      0.31      0.00      0.07     95.70
12:32:01 AM     all      4.38      0.00      0.33      0.00      0.08     95.20
12:32:01 AM       0      5.05      0.00      0.37      0.00      0.08     94.50
12:32:01 AM       1      3.71      0.00      0.30      0.00      0.08     95.91
12:33:01 AM     all      4.49      0.00      0.32      0.00      0.07     95.13
12:33:01 AM       0      5.42      0.00      0.40      0.00      0.07     94.12
12:33:01 AM       1      3.56      0.00      0.23      0.00      0.07     96.14

12:33:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
12:34:01 AM     all      5.37      0.00      0.28      0.00      0.06     94.29
12:34:01 AM       0      6.64      0.00      0.32      0.00      0.07     92.98
12:34:01 AM       1      4.11      0.00      0.25      0.00      0.05     95.59
12:35:01 AM     all      0.55      0.00      0.09      0.00      0.04     99.32
12:35:01 AM       0      0.50      0.00      0.12      0.00      0.03     99.35
12:35:01 AM       1      0.60      0.00      0.07      0.00      0.05     99.28
12:36:01 AM     all      0.35      0.00      0.07      0.00      0.03     99.56
12:36:01 AM       0      0.18      0.00      0.07      0.00      0.02     99.73
12:36:01 AM       1      0.52      0.00      0.07      0.00      0.03     99.38
12:37:01 AM     all      0.47      0.00      0.06      0.00      0.04     99.43
12:37:01 AM       0      0.42      0.00      0.08      0.00      0.03     99.47
12:37:01 AM       1      0.52      0.00      0.03      0.00      0.05     99.40
12:38:01 AM     all      0.32      0.00      0.06      0.00      0.03     99.60
12:38:01 AM       0      0.08      0.00      0.07      0.00      0.03     99.82
12:38:01 AM       1      0.55      0.00      0.05      0.00      0.02     99.38
12:39:01 AM     all      0.53      0.00      0.08      0.00      0.04     99.36
12:39:01 AM       0      0.47      0.00      0.07      0.00      0.03     99.43
12:39:01 AM       1      0.58      0.00      0.08      0.00      0.05     99.28
12:40:01 AM     all      0.36      0.00      0.06      0.00      0.03     99.55
12:40:01 AM       0      0.57      0.00      0.02      0.00      0.02     99.40
12:40:01 AM       1      0.15      0.00      0.10      0.00      0.05     99.70
12:41:01 AM     all      3.17      0.00      0.19      0.00      0.05     96.59
12:41:01 AM       0      2.30      0.00      0.18      0.00      0.05     97.46
12:41:01 AM       1      4.03      0.00      0.20      0.00      0.05     95.72
12:42:01 AM     all      6.86      0.00      3.56      0.00      0.05     89.53
12:42:01 AM       0      0.67      0.00      0.12      0.00      0.05     99.17
12:42:01 AM       1     13.47      0.00      7.25      0.00      0.05     79.23
12:43:01 AM     all      6.98      0.00      2.85      0.00      0.06     90.11
12:43:01 AM       0      8.79      0.00      2.63      0.00      0.07     88.51
12:43:01 AM       1      5.21      0.00      3.08      0.00      0.05     91.66
12:44:01 AM     all      1.16      0.00      0.20      0.00      0.03     98.60
12:44:01 AM       0      1.17      0.00      0.23      0.00      0.03     98.57
12:44:01 AM       1      1.16      0.00      0.17      0.00      0.03     98.64

12:44:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
12:45:01 AM     all      0.34      0.00      0.06      0.00      0.04     99.56
12:45:01 AM       0      0.60      0.00      0.03      0.00      0.03     99.33
12:45:01 AM       1      0.08      0.00      0.08      0.00      0.05     99.78
12:46:01 AM     all      4.72      0.00      1.74      0.00      0.07     93.47
12:46:01 AM       0      9.54      0.00      3.43      0.00      0.07     86.96
12:46:01 AM       1      0.13      0.00      0.13      0.00      0.07     99.67
12:47:01 AM     all      0.15      0.00      0.07      0.00      0.03     99.75
12:47:01 AM       0      0.08      0.00      0.05      0.00      0.02     99.85
12:47:01 AM       1      0.22      0.00      0.08      0.00      0.05     99.65
12:48:01 AM     all      0.96      0.00      0.13      0.00      0.04     98.88
12:48:01 AM       0      1.40      0.00      0.15      0.00      0.05     98.40
12:48:01 AM       1      0.52      0.00      0.10      0.00      0.03     99.35
12:49:01 AM     all      4.44      0.00      1.38      0.00      0.06     94.13
12:49:01 AM       0      8.42      0.00      2.68      0.00      0.07     88.83
12:49:01 AM       1      0.65      0.00      0.13      0.00      0.05     99.17
12:50:01 AM     all      0.35      0.00      0.07      0.00      0.04     99.54
12:50:01 AM       0      0.12      0.00      0.07      0.00      0.03     99.78
12:50:01 AM       1      0.58      0.00      0.07      0.00      0.05     99.30
12:51:01 AM     all      2.65      0.00      0.22      0.00      0.05     97.08
12:51:01 AM       0      4.68      0.00      0.34      0.00      0.05     94.92
12:51:01 AM       1      0.67      0.00      0.10      0.00      0.05     99.18
12:52:01 AM     all      7.07      0.00      3.10      0.00      0.06     89.77
12:52:01 AM       0      5.48      0.00      2.65      0.00      0.07     91.80
12:52:01 AM       1      8.64      0.00      3.54      0.00      0.05     87.77
12:53:01 AM     all      0.90      0.00      0.07      0.00      0.03     99.00
12:53:01 AM       0      1.20      0.00      0.07      0.00      0.03     98.70
12:53:01 AM       1      0.60      0.00      0.07      0.00      0.03     99.30
12:54:01 AM     all      0.33      0.00      0.07      0.00      0.03     99.57
12:54:01 AM       0      0.12      0.00      0.07      0.00      0.03     99.78
12:54:01 AM       1      0.55      0.00      0.07      0.00      0.03     99.35
12:55:01 AM     all      6.92      0.00      1.46      0.00      0.06     91.57
12:55:01 AM       0     11.11      0.00      2.77      0.00      0.07     86.05
12:55:01 AM       1      2.91      0.00      0.20      0.00      0.05     96.84

12:55:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
12:56:01 AM     all      6.47      0.00      2.55      0.00      0.08     90.90
12:56:01 AM       0     12.26      0.00      5.08      0.00      0.09     82.57
12:56:01 AM       1      1.00      0.00      0.17      0.00      0.07     98.76
12:57:01 AM     all      4.52      0.00      0.33      0.00      0.07     95.09
12:57:01 AM       0      4.46      0.00      0.32      0.00      0.07     95.15
12:57:01 AM       1      4.57      0.00      0.33      0.00      0.07     95.03
12:58:01 AM     all      4.45      0.00      0.30      0.00      0.06     95.20
12:58:01 AM       0      2.86      0.00      0.22      0.00      0.05     96.88
12:58:01 AM       1      6.03      0.00      0.38      0.00      0.07     93.52
12:59:01 AM     all      4.40      0.00      0.30      0.00      0.06     95.24
12:59:01 AM       0      2.22      0.00      0.20      0.00      0.05     97.53
12:59:01 AM       1      6.58      0.00      0.40      0.00      0.07     92.95
01:00:01 AM     all      4.30      0.00      0.32      0.00      0.07     95.31
01:00:01 AM       0      5.84      0.00      0.42      0.00      0.07     93.68
01:00:01 AM       1      2.77      0.00      0.22      0.00      0.07     96.94
01:01:01 AM     all      4.39      0.00      0.32      0.01      0.07     95.21
01:01:01 AM       0      5.15      0.00      0.37      0.00      0.08     94.40
01:01:01 AM       1      3.64      0.00      0.27      0.02      0.05     96.02
01:02:01 AM     all      7.12      0.00      0.41      0.00      0.08     92.40
01:02:01 AM       0      4.14      0.00      0.30      0.00      0.07     95.49
01:02:01 AM       1     10.09      0.00      0.52      0.00      0.08     89.31
01:03:01 AM     all      1.17      0.00      0.13      0.00      0.05     98.66
01:03:01 AM       0      1.55      0.00      0.17      0.00      0.05     98.23
01:03:01 AM       1      0.79      0.00      0.08      0.00      0.05     99.08
01:04:01 AM     all      0.23      0.00      0.06      0.00      0.03     99.68
01:04:01 AM       0      0.13      0.00      0.03      0.00      0.03     99.80
01:04:01 AM       1      0.32      0.00      0.08      0.00      0.03     99.57
01:05:01 AM     all      0.47      0.00      0.06      0.00      0.04     99.43
01:05:01 AM       0      0.38      0.00      0.07      0.00      0.05     99.50
01:05:01 AM       1      0.55      0.00      0.05      0.00      0.03     99.37
01:06:01 AM     all      0.26      0.00      0.06      0.00      0.03     99.65
01:06:01 AM       0      0.18      0.00      0.02      0.00      0.02     99.78
01:06:01 AM       1      0.33      0.00      0.10      0.00      0.05     99.52

01:06:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
01:07:01 AM     all      0.29      0.00      0.08      0.00      0.03     99.59
01:07:01 AM       0      0.45      0.00      0.03      0.00      0.02     99.50
01:07:01 AM       1      0.13      0.00      0.13      0.00      0.05     99.68
01:08:01 AM     all      0.45      0.00      0.09      0.00      0.03     99.42
01:08:01 AM       0      0.52      0.00      0.05      0.00      0.03     99.40
01:08:01 AM       1      0.39      0.00      0.13      0.00      0.03     99.45
01:09:01 AM     all      0.29      0.00      0.08      0.00      0.03     99.60
01:09:01 AM       0      0.13      0.00      0.10      0.00      0.05     99.72
01:09:01 AM       1      0.45      0.00      0.05      0.00      0.02     99.48
01:10:01 AM     all      4.76      0.00      2.68      0.00      0.05     92.51
01:10:01 AM       0      8.04      0.00      5.39      0.00      0.05     86.52
01:10:01 AM       1      1.70      0.00      0.17      0.00      0.05     98.08
01:11:01 AM     all      7.02      0.01      1.53      0.00      0.07     91.36
01:11:01 AM       0     13.96      0.02      3.07      0.00      0.07     82.88
01:11:01 AM       1      0.62      0.00      0.12      0.00      0.07     99.20
01:12:01 AM     all      0.34      0.15      0.12      0.01      0.03     99.35
01:12:01 AM       0      0.08      0.30      0.15      0.02      0.03     99.42
01:12:01 AM       1      0.60      0.00      0.08      0.00      0.03     99.28
01:13:01 AM     all      0.23      0.00      0.08      0.00      0.05     99.64
01:13:01 AM       0      0.12      0.00      0.07      0.00      0.03     99.78
01:13:01 AM       1      0.35      0.00      0.08      0.00      0.07     99.50
01:14:01 AM     all      7.77      0.00      1.79      0.00      0.05     90.39
01:14:01 AM       0      0.25      0.00      0.13      0.00      0.03     99.58
01:14:01 AM       1     15.62      0.00      3.52      0.00      0.07     80.79
01:15:01 AM     all      7.27      0.00      2.74      0.00      0.08     89.91
01:15:01 AM       0      4.31      0.00      2.04      0.00      0.09     93.56
01:15:01 AM       1     10.27      0.00      3.45      0.00      0.07     86.21
01:16:01 AM     all      7.00      0.00      1.55      0.00      0.08     91.37
01:16:01 AM       0     13.97      0.00      3.07      0.00      0.07     82.89
01:16:01 AM       1      0.60      0.00      0.15      0.00      0.08     99.17
01:17:01 AM     all      3.08      0.00      1.44      0.00      0.05     95.43
01:17:01 AM       0      5.83      0.00      2.83      0.00      0.03     91.31
01:17:01 AM       1      0.40      0.00      0.10      0.00      0.07     99.43

01:17:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
01:18:01 AM     all      0.35      0.00      0.08      0.00      0.04     99.53
01:18:01 AM       0      0.07      0.00      0.08      0.00      0.03     99.82
01:18:01 AM       1      0.63      0.00      0.07      0.00      0.05     99.25
01:19:01 AM     all      4.57      0.00      0.30      0.00      0.05     95.09
01:19:01 AM       0      5.18      0.00      0.31      0.00      0.07     94.45
01:19:01 AM       1      3.97      0.00      0.28      0.00      0.03     95.71
01:20:01 AM     all      5.67      0.00      2.43      0.00      0.07     91.83
01:20:01 AM       0      7.95      0.00      4.69      0.00      0.07     87.29
01:20:01 AM       1      3.47      0.00      0.25      0.00      0.07     96.21
01:21:01 AM     all      4.49      0.00      0.39      0.00      0.06     95.06
01:21:01 AM       0      2.92      0.00      0.33      0.00      0.05     96.69
01:21:01 AM       1      6.05      0.00      0.45      0.00      0.07     93.43
01:22:01 AM     all      4.54      0.00      0.34      0.00      0.07     95.05
01:22:01 AM       0      5.18      0.00      0.38      0.00      0.07     94.37
01:22:01 AM       1      3.90      0.00      0.30      0.00      0.07     95.74
01:23:01 AM     all      4.30      0.00      0.30      0.00      0.07     95.33
01:23:01 AM       0      6.86      0.00      0.42      0.00      0.08     92.64
01:23:01 AM       1      1.75      0.00      0.18      0.00      0.05     98.01
01:24:01 AM     all      4.37      0.00      0.31      0.00      0.06     95.26
01:24:01 AM       0      3.16      0.00      0.25      0.00      0.05     96.54
01:24:01 AM       1      5.59      0.00      0.37      0.00      0.07     93.98
01:25:01 AM     all      4.44      0.00      0.35      0.00      0.07     95.14
01:25:01 AM       0      6.37      0.00      0.43      0.00      0.07     93.13
01:25:01 AM       1      2.51      0.00      0.27      0.00      0.07     97.16
01:26:01 AM     all      6.38      0.00      0.38      0.00      0.08     93.16
01:26:01 AM       0      5.90      0.00      0.33      0.00      0.07     93.70
01:26:01 AM       1      6.86      0.00      0.43      0.00      0.08     92.63
01:27:01 AM     all      0.83      0.00      0.10      0.00      0.05     99.02
01:27:01 AM       0      0.78      0.00      0.08      0.00      0.03     99.10
01:27:01 AM       1      0.87      0.00      0.12      0.00      0.07     98.95
01:28:01 AM     all      0.93      0.00      0.12      0.00      0.08     98.87
01:28:01 AM       0      0.62      0.00      0.10      0.00      0.08     99.20
01:28:01 AM       1      1.24      0.00      0.13      0.00      0.08     98.55

01:28:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
01:29:01 AM     all      0.96      0.00      0.10      0.00      0.08     98.86
01:29:01 AM       0      1.20      0.00      0.12      0.00      0.07     98.61
01:29:01 AM       1      0.72      0.00      0.08      0.00      0.08     99.11
01:30:01 AM     all      0.94      0.00      0.12      0.00      0.06     98.88
01:30:01 AM       0      0.94      0.00      0.12      0.00      0.07     98.88
01:30:01 AM       1      0.95      0.00      0.12      0.00      0.05     98.88
01:31:01 AM     all      0.92      0.00      0.12      0.00      0.07     98.90
01:31:01 AM       0      0.80      0.00      0.08      0.00      0.05     99.06
01:31:01 AM       1      1.04      0.00      0.15      0.00      0.08     98.73
01:32:01 AM     all      2.81      0.00      0.23      0.00      0.07     96.89
01:32:01 AM       0      4.56      0.00      0.29      0.00      0.07     95.08
01:32:01 AM       1      1.09      0.00      0.17      0.00      0.07     98.68
01:33:01 AM     all      6.17      0.00      5.00      0.00      0.07     88.76
01:33:01 AM       0     12.22      0.00     10.35      0.00      0.07     77.36
01:33:01 AM       1      0.65      0.00      0.12      0.00      0.07     99.17
01:34:01 AM     all      7.41      0.00      1.46      0.00      0.07     91.05
01:34:01 AM       0      5.31      0.00      0.42      0.00      0.07     94.20
01:34:01 AM       1      9.53      0.00      2.52      0.00      0.07     87.88
01:35:01 AM     all      7.73      0.00      2.31      0.00      0.07     89.89
01:35:01 AM       0      0.23      0.00      0.18      0.00      0.05     99.53
01:35:01 AM       1     15.67      0.00      4.55      0.00      0.09     79.69
01:36:01 AM     all      7.74      0.00      2.16      0.00      0.08     90.02
01:36:01 AM       0      0.62      0.00      0.12      0.00      0.07     99.20
01:36:01 AM       1     15.28      0.00      4.32      0.00      0.09     80.31
01:37:01 AM     all      6.78      0.00      2.80      0.00      0.07     90.36
01:37:01 AM       0     12.03      0.00      5.58      0.00      0.09     82.29
01:37:01 AM       1      1.91      0.00      0.22      0.00      0.05     97.82
01:38:01 AM     all      7.48      0.00      1.46      0.00      0.08     90.97
01:38:01 AM       0     14.77      0.00      2.88      0.00      0.09     82.26
01:38:01 AM       1      0.73      0.00      0.15      0.00      0.07     99.05
01:39:01 AM     all      6.58      0.00      2.27      0.00      0.08     91.08
01:39:01 AM       0     12.77      0.00      4.56      0.00      0.09     82.58
01:39:01 AM       1      0.78      0.00      0.12      0.00      0.07     99.03

01:39:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
01:40:01 AM     all      4.44      0.00      0.31      0.00      0.07     95.19
01:40:01 AM       0      6.43      0.00      0.37      0.00      0.07     93.14
01:40:01 AM       1      2.44      0.00      0.25      0.00      0.07     97.24
01:41:01 AM     all      4.32      0.00      0.32      0.01      0.07     95.29
01:41:01 AM       0      7.36      0.00      0.47      0.00      0.08     92.09
01:41:01 AM       1      1.29      0.00      0.17      0.02      0.05     98.48
01:42:01 AM     all      4.45      0.00      0.31      0.00      0.07     95.18
01:42:01 AM       0      6.87      0.00      0.42      0.00      0.07     92.64
01:42:01 AM       1      2.02      0.00      0.20      0.00      0.07     97.71
01:43:01 AM     all      4.64      0.00      0.33      0.00      0.07     94.97
01:43:01 AM       0      7.82      0.00      0.45      0.00      0.08     91.65
01:43:01 AM       1      1.45      0.00      0.20      0.00      0.05     98.30
01:44:01 AM     all      4.49      0.00      0.33      0.00      0.08     95.11
01:44:01 AM       0      6.56      0.00      0.47      0.00      0.08     92.89
01:44:01 AM       1      2.42      0.00      0.18      0.00      0.07     97.33
01:45:01 AM     all      6.54      0.00      0.38      0.00      0.08     93.00
01:45:01 AM       0      8.64      0.00      0.42      0.00      0.08     90.86
01:45:01 AM       1      4.45      0.00      0.35      0.00      0.07     95.14
01:46:01 AM     all      1.84      0.00      0.15      0.00      0.05     97.96
01:46:01 AM       0      2.56      0.00      0.17      0.00      0.05     97.23
01:46:01 AM       1      1.12      0.00      0.13      0.00      0.05     98.70
01:47:01 AM     all      0.22      0.00      0.07      0.00      0.04     99.67
01:47:01 AM       0      0.37      0.00      0.08      0.00      0.07     99.48
01:47:01 AM       1      0.07      0.00      0.05      0.00      0.02     99.87
01:48:01 AM     all      0.35      0.00      0.05      0.00      0.03     99.57
01:48:01 AM       0      0.57      0.00      0.03      0.00      0.03     99.37
01:48:01 AM       1      0.13      0.00      0.07      0.00      0.03     99.77
01:49:01 AM     all      0.47      0.00      0.07      0.00      0.04     99.42
01:49:01 AM       0      0.37      0.00      0.08      0.00      0.03     99.52
01:49:01 AM       1      0.57      0.00      0.05      0.00      0.05     99.33
01:50:01 AM     all      0.33      0.00      0.06      0.00      0.03     99.58
01:50:01 AM       0      0.07      0.00      0.08      0.00      0.03     99.82
01:50:01 AM       1      0.58      0.00      0.03      0.00      0.03     99.35

01:50:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
01:51:01 AM     all      0.50      0.00      0.07      0.00      0.03     99.40
01:51:01 AM       0      0.40      0.00      0.07      0.00      0.03     99.50
01:51:01 AM       1      0.60      0.00      0.07      0.00      0.03     99.30
01:52:01 AM     all      0.33      0.00      0.04      0.00      0.04     99.58
01:52:01 AM       0      0.10      0.00      0.05      0.00      0.03     99.82
01:52:01 AM       1      0.57      0.00      0.03      0.00      0.05     99.35
01:53:01 AM     all      4.67      0.00      3.21      0.00      0.05     92.07
01:53:01 AM       0      1.87      0.00      0.17      0.00      0.05     97.91
01:53:01 AM       1      7.59      0.00      6.37      0.00      0.05     85.98
01:54:01 AM     all      7.57      0.00      1.40      0.00      0.06     90.97
01:54:01 AM       0     10.27      0.00      2.44      0.00      0.07     87.22
01:54:01 AM       1      4.98      0.00      0.39      0.00      0.05     94.58
01:55:01 AM     all      0.38      0.00      0.07      0.00      0.04     99.52
01:55:01 AM       0      0.15      0.00      0.08      0.00      0.07     99.70
01:55:01 AM       1      0.60      0.00      0.05      0.00      0.02     99.33
01:56:01 AM     all      0.33      0.00      0.08      0.00      0.04     99.54
01:56:01 AM       0      0.13      0.00      0.08      0.00      0.03     99.75
01:56:01 AM       1      0.53      0.00      0.08      0.00      0.05     99.33
01:57:01 AM     all      4.64      0.00      1.49      0.00      0.07     93.81
01:57:01 AM       0      8.81      0.00      2.95      0.00      0.09     88.15
01:57:01 AM       1      0.70      0.00      0.10      0.00      0.05     99.15
01:58:01 AM     all      2.21      0.00      0.19      0.00      0.07     97.54
01:58:01 AM       0      0.63      0.00      0.07      0.00      0.05     99.25
01:58:01 AM       1      3.80      0.00      0.31      0.00      0.08     95.81
01:59:01 AM     all      3.57      0.00      1.49      0.00      0.04     94.90
01:59:01 AM       0      0.98      0.00      0.08      0.00      0.03     98.90
01:59:01 AM       1      6.22      0.00      2.93      0.00      0.05     90.79
02:00:01 AM     all      0.36      0.00      0.08      0.00      0.04     99.52
02:00:01 AM       0      0.15      0.00      0.07      0.00      0.05     99.73
02:00:01 AM       1      0.57      0.00      0.08      0.00      0.03     99.32
02:01:01 AM     all      3.97      0.00      0.30      0.00      0.05     95.69
02:01:01 AM       0      6.99      0.00      0.48      0.00      0.05     92.47
02:01:01 AM       1      1.04      0.00      0.12      0.00      0.05     98.80

02:01:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
02:02:01 AM     all      6.16      0.00      2.66      0.00      0.08     91.11
02:02:01 AM       0      3.16      0.00      0.28      0.00      0.08     96.47
02:02:01 AM       1      9.22      0.00      5.09      0.00      0.07     85.62
02:03:01 AM     all      4.42      0.00      0.33      0.00      0.07     95.19
02:03:01 AM       0      7.46      0.00      0.47      0.00      0.08     91.99
02:03:01 AM       1      1.37      0.00      0.18      0.00      0.05     98.39
02:04:01 AM     all      4.41      0.00      0.31      0.00      0.08     95.20
02:04:01 AM       0      1.85      0.00      0.18      0.00      0.07     97.90
02:04:01 AM       1      6.97      0.00      0.43      0.00      0.08     92.51
02:05:01 AM     all      4.40      0.00      0.32      0.00      0.07     95.22
02:05:01 AM       0      5.55      0.00      0.40      0.00      0.07     93.98
02:05:01 AM       1      3.24      0.00      0.23      0.00      0.07     96.46
02:06:01 AM     all      4.32      0.00      0.30      0.00      0.08     95.30
02:06:01 AM       0      2.39      0.00      0.20      0.00      0.07     97.34
02:06:01 AM       1      6.26      0.00      0.40      0.00      0.08     93.26
02:07:01 AM     all      4.44      0.00      0.33      0.00      0.06     95.16
02:07:01 AM       0      3.76      0.00      0.28      0.00      0.05     95.91
02:07:01 AM       1      5.13      0.00      0.38      0.00      0.07     94.42
02:08:01 AM     all      6.64      0.00      0.38      0.00      0.08     92.90
02:08:01 AM       0      7.24      0.00      0.45      0.00      0.08     92.23
02:08:01 AM       1      6.05      0.00      0.32      0.00      0.07     93.56
02:09:01 AM     all      0.58      0.00      0.08      0.00      0.04     99.30
02:09:01 AM       0      0.53      0.00      0.10      0.00      0.05     99.32
02:09:01 AM       1      0.63      0.00      0.05      0.00      0.03     99.28
02:10:01 AM     all      0.25      0.00      0.04      0.00      0.03     99.67
02:10:01 AM       0      0.42      0.00      0.05      0.00      0.03     99.50
02:10:01 AM       1      0.08      0.00      0.03      0.00      0.03     99.85
02:11:01 AM     all      0.49      0.00      0.08      0.00      0.04     99.39
02:11:01 AM       0      0.58      0.00      0.07      0.00      0.05     99.30
02:11:01 AM       1      0.40      0.00      0.08      0.00      0.03     99.48
02:12:01 AM     all      0.38      0.00      0.07      0.00      0.03     99.52
02:12:01 AM       0      0.60      0.00      0.05      0.00      0.03     99.32
02:12:01 AM       1      0.15      0.00      0.08      0.00      0.03     99.73

02:12:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
02:13:01 AM     all      0.48      0.00      0.08      0.00      0.03     99.41
02:13:01 AM       0      0.83      0.00      0.07      0.00      0.03     99.07
02:13:01 AM       1      0.13      0.00      0.08      0.00      0.03     99.75
02:14:01 AM     all      0.29      0.00      0.06      0.00      0.04     99.61
02:14:01 AM       0      0.45      0.00      0.03      0.00      0.03     99.48
02:14:01 AM       1      0.13      0.00      0.08      0.00      0.05     99.73
02:15:01 AM     all      0.28      0.00      0.05      0.00      0.04     99.62
02:15:01 AM       0      0.48      0.00      0.05      0.00      0.05     99.42
02:15:01 AM       1      0.08      0.00      0.05      0.00      0.03     99.83
02:16:01 AM     all      6.23      0.00      2.60      0.00      0.06     91.12
02:16:01 AM       0     12.65      0.00      5.22      0.00      0.07     82.06
02:16:01 AM       1      0.42      0.00      0.22      0.00      0.05     99.32
02:17:01 AM     all      7.89      0.00      2.75      0.00      0.09     89.28
02:17:01 AM       0      1.37      0.00      0.18      0.00      0.08     98.36
02:17:01 AM       1     14.82      0.00      5.47      0.00      0.09     79.62
02:18:01 AM     all      5.28      0.00      0.38      0.00      0.06     94.29
02:18:01 AM       0      3.88      0.00      0.28      0.00      0.05     95.79
02:18:01 AM       1      6.68      0.00      0.47      0.00      0.07     92.78
02:19:01 AM     all      4.65      0.00      0.33      0.00      0.05     94.97
02:19:01 AM       0      2.29      0.00      0.22      0.00      0.05     97.44
02:19:01 AM       1      7.01      0.00      0.45      0.00      0.05     92.49
02:20:01 AM     all      4.35      0.00      0.33      0.00      0.06     95.25
02:20:01 AM       0      5.25      0.00      0.38      0.00      0.05     94.32
02:20:01 AM       1      3.46      0.00      0.28      0.00      0.07     96.19
02:21:01 AM     all      4.45      0.00      0.34      0.00      0.08     95.14
02:21:01 AM       0      2.77      0.00      0.25      0.00      0.07     96.91
02:21:01 AM       1      6.12      0.00      0.43      0.00      0.08     93.36
02:22:01 AM     all      4.42      0.00      0.32      0.01      0.08     95.18
02:22:01 AM       0      3.96      0.00      0.28      0.02      0.08     95.66
02:22:01 AM       1      4.88      0.00      0.35      0.00      0.07     94.70
02:23:01 AM     all      4.44      0.00      0.33      0.00      0.06     95.17
02:23:01 AM       0      4.88      0.00      0.40      0.00      0.05     94.67
02:23:01 AM       1      4.00      0.00      0.27      0.00      0.07     95.67

02:23:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
02:24:01 AM     all      5.60      0.00      0.33      0.00      0.07     94.01
02:24:01 AM       0      3.41      0.00      0.27      0.00      0.07     96.26
02:24:01 AM       1      7.79      0.00      0.38      0.00      0.07     91.76
02:25:01 AM     all      0.48      0.00      0.07      0.00      0.04     99.42
02:25:01 AM       0      0.67      0.00      0.07      0.00      0.03     99.23
02:25:01 AM       1      0.28      0.00      0.07      0.00      0.05     99.60
02:26:01 AM     all      0.28      0.00      0.06      0.00      0.03     99.62
02:26:01 AM       0      0.47      0.00      0.03      0.00      0.03     99.47
02:26:01 AM       1      0.10      0.00      0.08      0.00      0.03     99.78
02:27:01 AM     all      0.50      0.00      0.08      0.00      0.04     99.37
02:27:01 AM       0      0.38      0.00      0.08      0.00      0.03     99.50
02:27:01 AM       1      0.62      0.00      0.08      0.00      0.05     99.25
02:28:01 AM     all      0.29      0.00      0.08      0.00      0.04     99.59
02:28:01 AM       0      0.10      0.00      0.10      0.00      0.05     99.75