Started by upstream project "integration-distribution-mri-test-scandium" build number 91
originally caused by:
Started by timer
Running as SYSTEM
[EnvInject] - Loading node environment variables.
Building remotely on prd-centos8-robot-2c-8g-4727 (centos8-robot-2c-8g) in workspace /w/workspace/controller-csit-3node-clustering-tell-all-scandium
[ssh-agent] Looking for ssh-agent implementation...
[ssh-agent] Exec ssh-agent (binary ssh-agent on a remote machine)
$ ssh-agent
SSH_AUTH_SOCK=/tmp/ssh-nmeVQybPd1x8/agent.5280
SSH_AGENT_PID=5281
[ssh-agent] Started.
Running ssh-add (command line suppressed)
Identity added: /w/workspace/controller-csit-3node-clustering-tell-all-scandium@tmp/private_key_18415438800864658793.key (/w/workspace/controller-csit-3node-clustering-tell-all-scandium@tmp/private_key_18415438800864658793.key)
[ssh-agent] Using credentials jenkins (Release Engineering Jenkins Key)
The recommended git tool is: NONE
using credential opendaylight-jenkins-ssh
Wiping out workspace first.
Cloning the remote Git repository
Cloning repository git://devvexx.opendaylight.org/mirror/integration/test
> git init /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test # timeout=10
Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test
> git --version # timeout=10
> git --version # 'git version 2.43.0'
using GIT_SSH to set credentials Release Engineering Jenkins Key
[INFO] Currently running in a labeled security context
[INFO] Currently SELinux is 'enforcing' on the host
> /usr/bin/chcon --type=ssh_home_t /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test@tmp/jenkins-gitclient-ssh1937374769675526302.key
Verifying host key using known hosts file
You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification.
> git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10
Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test
using GIT_SSH to set credentials Release Engineering Jenkins Key
[INFO] Currently running in a labeled security context
[INFO] Currently SELinux is 'enforcing' on the host
> /usr/bin/chcon --type=ssh_home_t /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test@tmp/jenkins-gitclient-ssh9008114861548221077.key
Verifying host key using known hosts file
You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification.
> git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test master # timeout=10
> git rev-parse FETCH_HEAD^{commit} # timeout=10
Checking out Revision cc140aba40d20c279ad305eb08204917e9a97348 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f cc140aba40d20c279ad305eb08204917e9a97348 # timeout=10
Commit message: "Add bgpcep variables for vanadium"
> git rev-parse FETCH_HEAD^{commit} # timeout=10
> git rev-list --no-walk 2791c5dea1951b0af9405c9ac43be0884a2c5414 # timeout=10
No emails were triggered.
provisioning config files...
copy managed file [npmrc] to file:/home/jenkins/.npmrc
copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf
copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
[controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins12855053118418203097.sh
---> python-tools-install.sh
Setup pyenv:
system
* 3.8.13 (set by /opt/pyenv/version)
* 3.9.13 (set by /opt/pyenv/version)
* 3.10.13 (set by /opt/pyenv/version)
* 3.11.7 (set by /opt/pyenv/version)
lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-DjjA
lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
lf-activate-venv(): INFO: Attempting to install with network-safe options...
lf-activate-venv(): INFO: Base packages installed successfully
lf-activate-venv(): INFO: Installing additional packages: lftools
lf-activate-venv(): INFO: Adding /tmp/venv-DjjA/bin to PATH
Generating Requirements File
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
httplib2 0.30.2 requires pyparsing<4,>=3.0.4, but you have pyparsing 2.4.7 which is incompatible.
Python 3.11.7
pip 25.3 from /tmp/venv-DjjA/lib/python3.11/site-packages/pip (python 3.11)
appdirs==1.4.4
argcomplete==3.6.3
aspy.yaml==1.3.0
attrs==25.4.0
autopage==0.5.2
beautifulsoup4==4.14.3
boto3==1.42.35
botocore==1.42.35
bs4==0.0.2
certifi==2026.1.4
cffi==2.0.0
cfgv==3.5.0
chardet==5.2.0
charset-normalizer==3.4.4
click==8.3.1
cliff==4.13.1
cmd2==3.1.0
cryptography==3.3.2
debtcollector==3.0.0
decorator==5.2.1
defusedxml==0.7.1
Deprecated==1.3.1
distlib==0.4.0
dnspython==2.8.0
docker==7.1.0
dogpile.cache==1.5.0
durationpy==0.10
email-validator==2.3.0
filelock==3.20.3
future==1.0.0
gitdb==4.0.12
GitPython==3.1.46
httplib2==0.30.2
identify==2.6.16
idna==3.11
importlib-resources==1.5.0
iso8601==2.1.0
Jinja2==3.1.6
jmespath==1.1.0
jsonpatch==1.33
jsonpointer==3.0.0
jsonschema==4.26.0
jsonschema-specifications==2025.9.1
keystoneauth1==5.13.0
kubernetes==35.0.0
lftools==0.37.21
lxml==6.0.2
markdown-it-py==4.0.0
MarkupSafe==3.0.3
mdurl==0.1.2
msgpack==1.1.2
multi_key_dict==2.0.3
munch==4.0.0
netaddr==1.3.0
niet==1.4.2
nodeenv==1.10.0
oauth2client==4.1.3
oauthlib==3.3.1
openstacksdk==4.9.0
os-service-types==1.8.2
osc-lib==4.3.0
oslo.config==10.2.0
oslo.context==6.2.0
oslo.i18n==6.7.1
oslo.log==8.0.0
oslo.serialization==5.9.0
oslo.utils==9.2.0
packaging==26.0
pbr==7.0.3
platformdirs==4.5.1
prettytable==3.17.0
psutil==7.2.1
pyasn1==0.6.2
pyasn1_modules==0.4.2
pycparser==3.0
pygerrit2==2.0.15
PyGithub==2.8.1
Pygments==2.19.2
PyJWT==2.10.1
PyNaCl==1.6.2
pyparsing==2.4.7
pyperclip==1.11.0
pyrsistent==0.20.0
python-cinderclient==9.8.0
python-dateutil==2.9.0.post0
python-heatclient==5.0.0
python-jenkins==1.8.3
python-keystoneclient==5.7.0
python-magnumclient==4.9.0
python-openstackclient==8.3.0
python-swiftclient==4.9.0
PyYAML==6.0.3
referencing==0.37.0
requests==2.32.5
requests-oauthlib==2.0.0
requestsexceptions==1.4.0
rfc3986==2.0.0
rich==14.3.1
rich-argparse==1.7.2
rpds-py==0.30.0
rsa==4.9.1
ruamel.yaml==0.19.1
ruamel.yaml.clib==0.2.15
s3transfer==0.16.0
simplejson==3.20.2
six==1.17.0
smmap==5.0.2
soupsieve==2.8.3
stevedore==5.6.0
tabulate==0.9.0
toml==0.10.2
tomlkit==0.14.0
tqdm==4.67.1
typing_extensions==4.15.0
tzdata==2025.3
urllib3==1.26.20
virtualenv==20.36.1
wcwidth==0.4.0
websocket-client==1.9.0
wrapt==2.0.1
xdg==6.0.0
xmltodict==1.0.2
yq==3.4.3
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties content
OS_STACK_TEMPLATE=csit-2-instance-type.yaml
OS_CLOUD=vex
OS_STACK_NAME=releng-controller-csit-3node-clustering-tell-all-scandium-91
OS_STACK_TEMPLATE_DIR=openstack-hot
[EnvInject] - Variables injected successfully.
provisioning config files...
copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
[controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins13495671280232699062.sh
---> Create parameters file for OpenStack HOT
OpenStack Heat parameters generated
-----------------------------------
parameters:
vm_0_count: '3'
vm_0_flavor: 'v3-standard-4'
vm_0_image: 'ZZCI - Ubuntu 22.04 - builder - x86_64 - 20260109-084045.554'
vm_1_count: '0'
vm_1_flavor: 'v3-standard-2'
vm_1_image: 'ZZCI - Ubuntu 22.04 - mininet-ovs-217 - x86_64 - 20250917-133034.654'
job_name: '43164-91'
silo: 'releng'
[controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash -l /tmp/jenkins5809529414868705825.sh
---> Create HEAT stack
+ source /home/jenkins/lf-env.sh
+ lf-activate-venv --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq
++ mktemp -d /tmp/venv-XXXX
+ lf_venv=/tmp/venv-366B
+ local venv_file=/tmp/.os_lf_venv
+ local python=python3
+ local options
+ local set_path=true
+ local install_args=
++ getopt -o np:v: -l no-path,system-site-packages,python:,venv-file: -n lf-activate-venv -- --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq
+ options=' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''urllib3~=1.26.15'\'' '\''yq'\'''
+ eval set -- ' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''urllib3~=1.26.15'\'' '\''yq'\'''
++ set -- --python python3 -- 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq
+ true
+ case $1 in
+ python=python3
+ shift 2
+ true
+ case $1 in
+ shift
+ break
+ case $python in
+ local pkg_list=
+ [[ -d /opt/pyenv ]]
+ echo 'Setup pyenv:'
Setup pyenv:
+ export PYENV_ROOT=/opt/pyenv
+ PYENV_ROOT=/opt/pyenv
+ export PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
+ PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
+ pyenv versions
system
3.8.13
3.9.13
3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.python-version)
+ command -v pyenv
++ pyenv init - --no-rehash
+ eval 'PATH="$(bash --norc -ec '\''IFS=:; paths=($PATH);
for i in ${!paths[@]}; do
if [[ ${paths[i]} == "'\'''\''/opt/pyenv/shims'\'''\''" ]]; then unset '\''\'\'''\''paths[i]'\''\'\'''\'';
fi; done;
echo "${paths[*]}"'\'')"
export PATH="/opt/pyenv/shims:${PATH}"
export PYENV_SHELL=bash
source '\''/opt/pyenv/libexec/../completions/pyenv.bash'\''
pyenv() {
local command
command="${1:-}"
if [ "$#" -gt 0 ]; then
shift
fi
case "$command" in
rehash|shell)
eval "$(pyenv "sh-$command" "$@")"
;;
*)
command pyenv "$command" "$@"
;;
esac
}'
+++ bash --norc -ec 'IFS=:; paths=($PATH);
for i in ${!paths[@]}; do
if [[ ${paths[i]} == "/opt/pyenv/shims" ]]; then unset '\''paths[i]'\'';
fi; done;
echo "${paths[*]}"'
++ PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
++ export PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
++ PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
++ export PYENV_SHELL=bash
++ PYENV_SHELL=bash
++ source /opt/pyenv/libexec/../completions/pyenv.bash
+++ complete -F _pyenv pyenv
++ lf-pyver python3
++ local py_version_xy=python3
++ local py_version_xyz=
++ pyenv versions
++ local command
++ command=versions
++ '[' 1 -gt 0 ']'
++ shift
++ case "$command" in
++ command pyenv versions
++ pyenv versions
++ grep -E '^[0-9.]*[0-9]$'
++ sed 's/^[ *]* //'
++ awk '{ print $1 }'
++ [[ ! -s /tmp/.pyenv_versions ]]
+++ grep '^3' /tmp/.pyenv_versions
+++ tail -n 1
+++ sort -V
++ py_version_xyz=3.11.7
++ [[ -z 3.11.7 ]]
++ echo 3.11.7
++ return 0
+ pyenv local 3.11.7
+ local command
+ command=local
+ '[' 2 -gt 0 ']'
+ shift
+ case "$command" in
+ command pyenv local 3.11.7
+ pyenv local 3.11.7
+ for arg in "$@"
+ case $arg in
+ pkg_list+='lftools[openstack] '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='kubernetes '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='niet '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='python-heatclient '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='python-openstackclient '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='python-magnumclient '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='urllib3~=1.26.15 '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='yq '
+ [[ -f /tmp/.os_lf_venv ]]
++ cat /tmp/.os_lf_venv
+ lf_venv=/tmp/venv-DjjA
+ echo 'lf-activate-venv(): INFO: Reuse venv:/tmp/venv-DjjA from' file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-DjjA from file:/tmp/.os_lf_venv
+ echo 'lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)'
lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
+ local 'pip_opts=--upgrade --quiet'
+ pip_opts='--upgrade --quiet --trusted-host pypi.org'
+ pip_opts='--upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org'
+ pip_opts='--upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org'
+ [[ -n '' ]]
+ [[ -n '' ]]
+ echo 'lf-activate-venv(): INFO: Attempting to install with network-safe options...'
lf-activate-venv(): INFO: Attempting to install with network-safe options...
+ /tmp/venv-DjjA/bin/python3 -m pip install --upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org pip 'setuptools<66' virtualenv
+ echo 'lf-activate-venv(): INFO: Base packages installed successfully'
lf-activate-venv(): INFO: Base packages installed successfully
+ [[ -z lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq ]]
+ echo 'lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq '
lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq
+ /tmp/venv-DjjA/bin/python3 -m pip install --upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org --upgrade-strategy eager 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq
+ type python3
+ true
+ echo 'lf-activate-venv(): INFO: Adding /tmp/venv-DjjA/bin to PATH'
lf-activate-venv(): INFO: Adding /tmp/venv-DjjA/bin to PATH
+ PATH=/tmp/venv-DjjA/bin:/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
+ return 0
+ openstack --os-cloud vex limits show --absolute
+--------------------------+---------+
| Name | Value |
+--------------------------+---------+
| maxTotalInstances | -1 |
| maxTotalCores | 450 |
| maxTotalRAMSize | 1000000 |
| maxServerMeta | 128 |
| maxImageMeta | 128 |
| maxPersonality | 5 |
| maxPersonalitySize | 10240 |
| maxTotalKeypairs | 100 |
| maxServerGroups | 10 |
| maxServerGroupMembers | 10 |
| maxTotalFloatingIps | -1 |
| maxSecurityGroups | -1 |
| maxSecurityGroupRules | -1 |
| totalRAMUsed | 303104 |
| totalCoresUsed | 74 |
| totalInstancesUsed | 29 |
| totalFloatingIpsUsed | 0 |
| totalSecurityGroupsUsed | 0 |
| totalServerGroupsUsed | 0 |
| maxTotalVolumes | -1 |
| maxTotalSnapshots | 10 |
| maxTotalVolumeGigabytes | 4096 |
| maxTotalBackups | 10 |
| maxTotalBackupGigabytes | 1000 |
| totalVolumesUsed | 0 |
| totalGigabytesUsed | 0 |
| totalSnapshotsUsed | 0 |
| totalBackupsUsed | 0 |
| totalBackupGigabytesUsed | 0 |
+--------------------------+---------+
+ pushd /opt/ciman/openstack-hot
/opt/ciman/openstack-hot /w/workspace/controller-csit-3node-clustering-tell-all-scandium
+ lftools openstack --os-cloud vex stack create releng-controller-csit-3node-clustering-tell-all-scandium-91 csit-2-instance-type.yaml /w/workspace/controller-csit-3node-clustering-tell-all-scandium/stack-parameters.yaml
Creating stack releng-controller-csit-3node-clustering-tell-all-scandium-91
Waiting to initialize infrastructure...
Waiting to initialize infrastructure...
Stack initialization successful.
------------------------------------
Stack Details
------------------------------------
{'added': None,
'capabilities': [],
'created_at': '2026-01-26T23:05:06Z',
'deleted': None,
'deleted_at': None,
'description': 'No description',
'environment': None,
'environment_files': None,
'files': None,
'files_container': None,
'id': '22ce4738-3bc6-42fc-8a1b-48dfaa6606c4',
'is_rollback_disabled': True,
'links': [{'href': 'https://orchestration.public.mtl1.vexxhost.net/v1/12c36e260d8e4bb2913965203b1b491f/stacks/releng-controller-csit-3node-clustering-tell-all-scandium-91/22ce4738-3bc6-42fc-8a1b-48dfaa6606c4',
'rel': 'self'}],
'location': Munch({'cloud': 'vex', 'region_name': 'ca-ymq-1', 'zone': None, 'project': Munch({'id': '12c36e260d8e4bb2913965203b1b491f', 'name': '61975f2c-7c17-4d69-82fa-c3ae420ad6fd', 'domain_id': None, 'domain_name': 'Default'})}),
'name': 'releng-controller-csit-3node-clustering-tell-all-scandium-91',
'notification_topics': [],
'outputs': [{'description': 'IP addresses of the 2nd vm types',
'output_key': 'vm_1_ips',
'output_value': []},
{'description': 'IP addresses of the 1st vm types',
'output_key': 'vm_0_ips',
'output_value': ['10.30.171.69',
'10.30.170.77',
'10.30.171.81']}],
'owner_id': ****,
'parameters': {'OS::project_id': '12c36e260d8e4bb2913965203b1b491f',
'OS::stack_id': '22ce4738-3bc6-42fc-8a1b-48dfaa6606c4',
'OS::stack_name': 'releng-controller-csit-3node-clustering-tell-all-scandium-91',
'job_name': '43164-91',
'silo': 'releng',
'vm_0_count': '3',
'vm_0_flavor': 'v3-standard-4',
'vm_0_image': 'ZZCI - Ubuntu 22.04 - builder - x86_64 - '
'20260109-084045.554',
'vm_1_count': '0',
'vm_1_flavor': 'v3-standard-2',
'vm_1_image': 'ZZCI - Ubuntu 22.04 - mininet-ovs-217 - x86_64 '
'- 20250917-133034.654'},
'parent_id': None,
'replaced': None,
'status': 'CREATE_COMPLETE',
'status_reason': 'Stack CREATE completed successfully',
'tags': [],
'template': None,
'template_description': 'No description',
'template_url': None,
'timeout_mins': 15,
'unchanged': None,
'updated': None,
'updated_at': None,
'user_project_id': '5d73c43dca324dfc866f0b2b60f73115'}
------------------------------------
+ popd
/w/workspace/controller-csit-3node-clustering-tell-all-scandium
[controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash -l /tmp/jenkins11632208284289645210.sh
---> Copy SSH public keys to CSIT lab
Setup pyenv:
system
3.8.13
3.9.13
3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-DjjA from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
lf-activate-venv(): INFO: Attempting to install with network-safe options...
lf-activate-venv(): INFO: Base packages installed successfully
lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes python-heatclient python-openstackclient urllib3~=1.26.15
lf-activate-venv(): INFO: Adding /tmp/venv-DjjA/bin to PATH
SSH not responding on 10.30.170.77. Retrying in 10 seconds...
SSH not responding on 10.30.171.81. Retrying in 10 seconds...
SSH not responding on 10.30.171.69. Retrying in 10 seconds...
Ping to 10.30.170.77 successful.
Ping to 10.30.171.81 successful.
Ping to 10.30.171.69 successful.
SSH not responding on 10.30.171.81. Retrying in 10 seconds...
SSH not responding on 10.30.171.69. Retrying in 10 seconds...
Warning: Permanently added '10.30.170.77' (ECDSA) to the list of known hosts.
releng-43164-91-0-builder-1
Successfully copied public keys to slave 10.30.170.77
Ping to 10.30.171.81 successful.
Ping to 10.30.171.69 successful.
SSH not responding on 10.30.171.81. Retrying in 10 seconds...
SSH not responding on 10.30.171.69. Retrying in 10 seconds...
Ping to 10.30.171.81 successful.
Ping to 10.30.171.69 successful.
SSH not responding on 10.30.171.81. Retrying in 10 seconds...
SSH not responding on 10.30.171.69. Retrying in 10 seconds...
Ping to 10.30.171.81 successful.
Ping to 10.30.171.69 successful.
Warning: Permanently added '10.30.171.81' (ECDSA) to the list of known hosts.
releng-43164-91-0-builder-2
Successfully copied public keys to slave 10.30.171.81
Warning: Permanently added '10.30.171.69' (ECDSA) to the list of known hosts.
releng-43164-91-0-builder-0
Successfully copied public keys to slave 10.30.171.69
Process 6497 ready.
Process 6498 ready.
Process 6499 ready.
SSH ready on all stack servers.
[controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash -l /tmp/jenkins6284671691485018008.sh
Setup pyenv:
system
3.8.13
3.9.13
3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.python-version)
lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-0LDJ
lf-activate-venv(): INFO: Save venv in file: /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.robot_venv
lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
lf-activate-venv(): INFO: Attempting to install with network-safe options...
lf-activate-venv(): INFO: Base packages installed successfully
lf-activate-venv(): INFO: Installing additional packages: setuptools wheel
lf-activate-venv(): INFO: Adding /tmp/venv-0LDJ/bin to PATH
+ echo 'Installing Python Requirements'
Installing Python Requirements
+ cat
+ python -m pip install -r requirements.txt
Looking in indexes: https://nexus3.opendaylight.org/repository/PyPi/simple
Collecting docker-py (from -r requirements.txt (line 1))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/docker-py/1.10.6/docker_py-1.10.6-py2.py3-none-any.whl (50 kB)
Collecting ipaddr (from -r requirements.txt (line 2))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/ipaddr/2.2.0/ipaddr-2.2.0.tar.gz (26 kB)
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing metadata (pyproject.toml): started
Preparing metadata (pyproject.toml): finished with status 'done'
Collecting netaddr (from -r requirements.txt (line 3))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/netaddr/1.3.0/netaddr-1.3.0-py3-none-any.whl (2.3 MB)
Collecting netifaces (from -r requirements.txt (line 4))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/netifaces/0.11.0/netifaces-0.11.0.tar.gz (30 kB)
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing metadata (pyproject.toml): started
Preparing metadata (pyproject.toml): finished with status 'done'
Collecting pyhocon (from -r requirements.txt (line 5))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyhocon/0.3.61/pyhocon-0.3.61-py3-none-any.whl (25 kB)
Collecting requests (from -r requirements.txt (line 6))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/requests/2.32.5/requests-2.32.5-py3-none-any.whl (64 kB)
Collecting robotframework (from -r requirements.txt (line 7))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework/7.4.1/robotframework-7.4.1-py3-none-any.whl (806 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 806.9/806.9 kB 33.4 MB/s 0:00:00
Collecting robotframework-httplibrary (from -r requirements.txt (line 8))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-httplibrary/0.4.2/robotframework-httplibrary-0.4.2.tar.gz (9.1 kB)
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing metadata (pyproject.toml): started
Preparing metadata (pyproject.toml): finished with status 'done'
Collecting robotframework-requests==0.9.7 (from -r requirements.txt (line 9))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-requests/0.9.7/robotframework_requests-0.9.7-py3-none-any.whl (21 kB)
Collecting robotframework-selenium2library (from -r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-selenium2library/3.0.0/robotframework_selenium2library-3.0.0-py2.py3-none-any.whl (6.2 kB)
Collecting robotframework-sshlibrary==3.8.0 (from -r requirements.txt (line 11))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-sshlibrary/3.8.0/robotframework-sshlibrary-3.8.0.tar.gz (51 kB)
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing metadata (pyproject.toml): started
Preparing metadata (pyproject.toml): finished with status 'done'
Collecting scapy (from -r requirements.txt (line 12))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/scapy/2.7.0/scapy-2.7.0-py3-none-any.whl (2.6 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.6/2.6 MB 47.6 MB/s 0:00:00
Collecting jsonpath-rw (from -r requirements.txt (line 15))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpath-rw/1.4.0/jsonpath-rw-1.4.0.tar.gz (13 kB)
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing metadata (pyproject.toml): started
Preparing metadata (pyproject.toml): finished with status 'done'
Collecting elasticsearch (from -r requirements.txt (line 18))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch/9.2.1/elasticsearch-9.2.1-py3-none-any.whl (963 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 963.6/963.6 kB 46.1 MB/s 0:00:00
Collecting elasticsearch-dsl (from -r requirements.txt (line 19))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch-dsl/8.18.0/elasticsearch_dsl-8.18.0-py3-none-any.whl (10 kB)
Collecting pyangbind (from -r requirements.txt (line 22))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyangbind/0.8.7/pyangbind-0.8.7-py3-none-any.whl (52 kB)
Collecting isodate (from -r requirements.txt (line 25))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/isodate/0.7.2/isodate-0.7.2-py3-none-any.whl (22 kB)
Collecting jmespath (from -r requirements.txt (line 28))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jmespath/1.1.0/jmespath-1.1.0-py3-none-any.whl (20 kB)
Collecting jsonpatch (from -r requirements.txt (line 31))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpatch/1.33/jsonpatch-1.33-py2.py3-none-any.whl (12 kB)
Collecting paramiko>=1.15.3 (from robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/paramiko/4.0.0/paramiko-4.0.0-py3-none-any.whl (223 kB)
Collecting scp>=0.13.0 (from robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/scp/0.15.0/scp-0.15.0-py2.py3-none-any.whl (8.8 kB)
Collecting docker-pycreds>=0.2.1 (from docker-py->-r requirements.txt (line 1))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/docker-pycreds/0.4.0/docker_pycreds-0.4.0-py2.py3-none-any.whl (9.0 kB)
Collecting six>=1.4.0 (from docker-py->-r requirements.txt (line 1))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/six/1.17.0/six-1.17.0-py2.py3-none-any.whl (11 kB)
Collecting websocket-client>=0.32.0 (from docker-py->-r requirements.txt (line 1))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/websocket-client/1.9.0/websocket_client-1.9.0-py3-none-any.whl (82 kB)
Collecting pyparsing<4,>=2 (from pyhocon->-r requirements.txt (line 5))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pyparsing/3.3.2/pyparsing-3.3.2-py3-none-any.whl (122 kB)
Collecting charset_normalizer<4,>=2 (from requests->-r requirements.txt (line 6))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/charset-normalizer/3.4.4/charset_normalizer-3.4.4-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl (151 kB)
Collecting idna<4,>=2.5 (from requests->-r requirements.txt (line 6))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/idna/3.11/idna-3.11-py3-none-any.whl (71 kB)
Collecting urllib3<3,>=1.21.1 (from requests->-r requirements.txt (line 6))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/urllib3/2.6.3/urllib3-2.6.3-py3-none-any.whl (131 kB)
Collecting certifi>=2017.4.17 (from requests->-r requirements.txt (line 6))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/certifi/2026.1.4/certifi-2026.1.4-py3-none-any.whl (152 kB)
Collecting webtest>=2.0 (from robotframework-httplibrary->-r requirements.txt (line 8))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/webtest/3.0.7/webtest-3.0.7-py3-none-any.whl (32 kB)
Collecting jsonpointer (from robotframework-httplibrary->-r requirements.txt (line 8))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpointer/3.0.0/jsonpointer-3.0.0-py2.py3-none-any.whl (7.6 kB)
Collecting robotframework-seleniumlibrary>=3.0.0 (from robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-seleniumlibrary/6.8.0/robotframework_seleniumlibrary-6.8.0-py3-none-any.whl (104 kB)
Collecting ply (from jsonpath-rw->-r requirements.txt (line 15))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/ply/3.11/ply-3.11-py2.py3-none-any.whl (49 kB)
Collecting decorator (from jsonpath-rw->-r requirements.txt (line 15))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/decorator/5.2.1/decorator-5.2.1-py3-none-any.whl (9.2 kB)
Collecting anyio (from elasticsearch->-r requirements.txt (line 18))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/anyio/4.12.1/anyio-4.12.1-py3-none-any.whl (113 kB)
Collecting elastic-transport<10,>=9.2.0 (from elasticsearch->-r requirements.txt (line 18))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elastic-transport/9.2.1/elastic_transport-9.2.1-py3-none-any.whl (65 kB)
Collecting python-dateutil (from elasticsearch->-r requirements.txt (line 18))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/python-dateutil/2.9.0.post0/python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB)
Collecting sniffio (from elasticsearch->-r requirements.txt (line 18))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/sniffio/1.3.1/sniffio-1.3.1-py3-none-any.whl (10 kB)
Collecting typing-extensions (from elasticsearch->-r requirements.txt (line 18))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/typing-extensions/4.15.0/typing_extensions-4.15.0-py3-none-any.whl (44 kB)
Collecting elasticsearch (from -r requirements.txt (line 18))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch/8.19.3/elasticsearch-8.19.3-py3-none-any.whl (952 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 952.8/952.8 kB 32.8 MB/s 0:00:00
INFO: pip is looking at multiple versions of elasticsearch-dsl to determine which version is compatible with other requirements. This could take a while.
Collecting elasticsearch-dsl (from -r requirements.txt (line 19))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch-dsl/8.17.1/elasticsearch_dsl-8.17.1-py3-none-any.whl (158 kB)
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch-dsl/8.17.0/elasticsearch_dsl-8.17.0-py3-none-any.whl (158 kB)
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch-dsl/8.16.0/elasticsearch_dsl-8.16.0-py3-none-any.whl (158 kB)
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch-dsl/8.15.4/elasticsearch_dsl-8.15.4-py3-none-any.whl (104 kB)
Collecting elastic-transport<9,>=8.15.1 (from elasticsearch->-r requirements.txt (line 18))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elastic-transport/8.17.1/elastic_transport-8.17.1-py3-none-any.whl (64 kB)
Collecting pyang (from pyangbind->-r requirements.txt (line 22))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyang/2.7.1/pyang-2.7.1-py2.py3-none-any.whl (598 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 598.5/598.5 kB 12.9 MB/s 0:00:00
Collecting lxml (from pyangbind->-r requirements.txt (line 22))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/lxml/6.0.2/lxml-6.0.2-cp311-cp311-manylinux_2_26_x86_64.manylinux_2_28_x86_64.whl (5.2 MB)
Collecting regex (from pyangbind->-r requirements.txt (line 22))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/regex/2026.1.15/regex-2026.1.15-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl (800 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 800.5/800.5 kB 37.3 MB/s 0:00:00
Collecting enum34 (from pyangbind->-r requirements.txt (line 22))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/enum34/1.1.10/enum34-1.1.10-py3-none-any.whl (11 kB)
Collecting bcrypt>=3.2 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/bcrypt/5.0.0/bcrypt-5.0.0-cp39-abi3-manylinux_2_28_x86_64.whl (278 kB)
Collecting cryptography>=3.3 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/cryptography/46.0.3/cryptography-46.0.3-cp311-abi3-manylinux_2_28_x86_64.whl (4.5 MB)
Collecting invoke>=2.0 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/invoke/2.2.1/invoke-2.2.1-py3-none-any.whl (160 kB)
Collecting pynacl>=1.5 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pynacl/1.6.2/pynacl-1.6.2-cp38-abi3-manylinux_2_26_x86_64.manylinux_2_28_x86_64.whl (1.4 MB)
Collecting cffi>=2.0.0 (from cryptography>=3.3->paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/cffi/2.0.0/cffi-2.0.0-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (215 kB)
Collecting pycparser (from cffi>=2.0.0->cryptography>=3.3->paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pycparser/3.0/pycparser-3.0-py3-none-any.whl (48 kB)
Collecting selenium>=4.3.0 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/selenium/4.40.0/selenium-4.40.0-py3-none-any.whl (9.6 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 9.6/9.6 MB 75.5 MB/s 0:00:00
Collecting robotframework-pythonlibcore>=4.4.1 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-pythonlibcore/4.5.0/robotframework_pythonlibcore-4.5.0-py3-none-any.whl (19 kB)
Collecting click>=8.0 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/click/8.3.1/click-8.3.1-py3-none-any.whl (108 kB)
Collecting trio<1.0,>=0.31.0 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/trio/0.32.0/trio-0.32.0-py3-none-any.whl (512 kB)
Collecting trio-websocket<1.0,>=0.12.2 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/trio-websocket/0.12.2/trio_websocket-0.12.2-py3-none-any.whl (21 kB)
Collecting trio-typing>=0.10.0 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/trio-typing/0.10.0/trio_typing-0.10.0-py3-none-any.whl (42 kB)
Collecting types-certifi>=2021.10.8.3 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/types-certifi/2021.10.8.3/types_certifi-2021.10.8.3-py3-none-any.whl (2.1 kB)
Collecting types-urllib3>=1.26.25.14 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/types-urllib3/1.26.25.14/types_urllib3-1.26.25.14-py3-none-any.whl (15 kB)
Collecting attrs>=23.2.0 (from trio<1.0,>=0.31.0->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/attrs/25.4.0/attrs-25.4.0-py3-none-any.whl (67 kB)
Collecting sortedcontainers (from trio<1.0,>=0.31.0->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/sortedcontainers/2.4.0/sortedcontainers-2.4.0-py2.py3-none-any.whl (29 kB)
Collecting outcome (from trio<1.0,>=0.31.0->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/outcome/1.3.0.post0/outcome-1.3.0.post0-py2.py3-none-any.whl (10 kB)
Collecting wsproto>=0.14 (from trio-websocket<1.0,>=0.12.2->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/wsproto/1.3.2/wsproto-1.3.2-py3-none-any.whl (24 kB)
Collecting pysocks!=1.5.7,<2.0,>=1.5.6 (from urllib3[socks]<3.0,>=2.6.3->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pysocks/1.7.1/PySocks-1.7.1-py3-none-any.whl (16 kB)
Collecting mypy-extensions>=0.4.2 (from trio-typing>=0.10.0->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/mypy-extensions/1.1.0/mypy_extensions-1.1.0-py3-none-any.whl (5.0 kB)
Collecting async-generator (from trio-typing>=0.10.0->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/async-generator/1.10/async_generator-1.10-py3-none-any.whl (18 kB)
Requirement already satisfied: packaging in /tmp/venv-0LDJ/lib/python3.11/site-packages (from trio-typing>=0.10.0->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) (26.0)
Collecting importlib-metadata (from trio-typing>=0.10.0->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/importlib-metadata/8.7.1/importlib_metadata-8.7.1-py3-none-any.whl (27 kB)
Collecting WebOb>=1.2 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/webob/1.8.9/WebOb-1.8.9-py2.py3-none-any.whl (115 kB)
Collecting waitress>=3.0.2 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/waitress/3.0.2/waitress-3.0.2-py3-none-any.whl (56 kB)
Collecting beautifulsoup4 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/beautifulsoup4/4.14.3/beautifulsoup4-4.14.3-py3-none-any.whl (107 kB)
Collecting h11<1,>=0.16.0 (from wsproto>=0.14->trio-websocket<1.0,>=0.12.2->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/h11/0.16.0/h11-0.16.0-py3-none-any.whl (37 kB)
Collecting soupsieve>=1.6.1 (from beautifulsoup4->webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/soupsieve/2.8.3/soupsieve-2.8.3-py3-none-any.whl (37 kB)
Collecting zipp>=3.20 (from importlib-metadata->trio-typing>=0.10.0->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/zipp/3.23.0/zipp-3.23.0-py3-none-any.whl (10 kB)
Building wheels for collected packages: robotframework-sshlibrary, ipaddr, netifaces, robotframework-httplibrary, jsonpath-rw
Building wheel for robotframework-sshlibrary (pyproject.toml): started
Building wheel for robotframework-sshlibrary (pyproject.toml): finished with status 'done'
Created wheel for robotframework-sshlibrary: filename=robotframework_sshlibrary-3.8.0-py3-none-any.whl size=55204 sha256=166db8dc3c6e4a13596d0fe1cc04c3815f89fe3d064b70c99955540dd4bbd4b9
Stored in directory: /home/jenkins/.cache/pip/wheels/f7/c9/b3/a977b7bcc410d45ae27d240df3d00a12585509180e373ecccc
Building wheel for ipaddr (pyproject.toml): started
Building wheel for ipaddr (pyproject.toml): finished with status 'done'
Created wheel for ipaddr: filename=ipaddr-2.2.0-py3-none-any.whl size=18354 sha256=caca8aed68a14f9bb93b0b86dc85023cc404a90a422c54af46c7fd64e6ec5231
Stored in directory: /home/jenkins/.cache/pip/wheels/dc/6c/04/da2d847fa8d45c59af3e1d83e2acc29cb8adcbaf04c0898dbf
Building wheel for netifaces (pyproject.toml): started
Building wheel for netifaces (pyproject.toml): finished with status 'done'
Created wheel for netifaces: filename=netifaces-0.11.0-cp311-cp311-linux_x86_64.whl size=41080 sha256=a78f98fd7fd5c7a41ab699dcce8202f6c947d396a9fabfdec7ee98c6e4bb22a3
Stored in directory: /home/jenkins/.cache/pip/wheels/f8/18/88/e61d54b995bea304bdb1d040a92b72228a1bf72ca2a3eba7c9
Building wheel for robotframework-httplibrary (pyproject.toml): started
Building wheel for robotframework-httplibrary (pyproject.toml): finished with status 'done'
Created wheel for robotframework-httplibrary: filename=robotframework_httplibrary-0.4.2-py3-none-any.whl size=10013 sha256=b80c985d691fbf9d2fe9f5de9173990b2752e9b3d631fab5259bd98b4f9d615f
Stored in directory: /home/jenkins/.cache/pip/wheels/aa/bc/0d/9a20dd51effef392aae2733cb4c7b66c6fa29fca33d88b57ed
Building wheel for jsonpath-rw (pyproject.toml): started
Building wheel for jsonpath-rw (pyproject.toml): finished with status 'done'
Created wheel for jsonpath-rw: filename=jsonpath_rw-1.4.0-py3-none-any.whl size=15175 sha256=d54b9cdc36134885c447e108f9e0a444016d4bb4aadb0109f2245fb61df894b4
Stored in directory: /home/jenkins/.cache/pip/wheels/f1/54/63/9a8da38cefae13755097b36cc852decc25d8ef69c37d58d4eb
Successfully built robotframework-sshlibrary ipaddr netifaces robotframework-httplibrary jsonpath-rw
Installing collected packages: types-urllib3, types-certifi, sortedcontainers, ply, netifaces, ipaddr, enum34, zipp, websocket-client, WebOb, waitress, urllib3, typing-extensions, soupsieve, sniffio, six, scapy, robotframework-pythonlibcore, robotframework, regex, pysocks, pyparsing, pycparser, netaddr, mypy-extensions, lxml, jsonpointer, jmespath, isodate, invoke, idna, h11, decorator, click, charset_normalizer, certifi, bcrypt, attrs, async-generator, wsproto, requests, python-dateutil, pyhocon, pyang, outcome, jsonpath-rw, jsonpatch, importlib-metadata, elastic-transport, docker-pycreds, cffi, beautifulsoup4, webtest, trio, robotframework-requests, pynacl, pyangbind, elasticsearch, docker-py, cryptography, trio-websocket, trio-typing, robotframework-httplibrary, paramiko, elasticsearch-dsl, selenium, scp, robotframework-sshlibrary, robotframework-seleniumlibrary, robotframework-selenium2library
Successfully installed WebOb-1.8.9 async-generator-1.10 attrs-25.4.0 bcrypt-5.0.0 beautifulsoup4-4.14.3 certifi-2026.1.4 cffi-2.0.0 charset_normalizer-3.4.4 click-8.3.1 cryptography-46.0.3 decorator-5.2.1 docker-py-1.10.6 docker-pycreds-0.4.0 elastic-transport-8.17.1 elasticsearch-8.19.3 elasticsearch-dsl-8.15.4 enum34-1.1.10 h11-0.16.0 idna-3.11 importlib-metadata-8.7.1 invoke-2.2.1 ipaddr-2.2.0 isodate-0.7.2 jmespath-1.1.0 jsonpatch-1.33 jsonpath-rw-1.4.0 jsonpointer-3.0.0 lxml-6.0.2 mypy-extensions-1.1.0 netaddr-1.3.0 netifaces-0.11.0 outcome-1.3.0.post0 paramiko-4.0.0 ply-3.11 pyang-2.7.1 pyangbind-0.8.7 pycparser-3.0 pyhocon-0.3.61 pynacl-1.6.2 pyparsing-3.3.2 pysocks-1.7.1 python-dateutil-2.9.0.post0 regex-2026.1.15 requests-2.32.5 robotframework-7.4.1 robotframework-httplibrary-0.4.2 robotframework-pythonlibcore-4.5.0 robotframework-requests-0.9.7 robotframework-selenium2library-3.0.0 robotframework-seleniumlibrary-6.8.0 robotframework-sshlibrary-3.8.0 scapy-2.7.0 scp-0.15.0 selenium-4.40.0 six-1.17.0 sniffio-1.3.1 sortedcontainers-2.4.0 soupsieve-2.8.3 trio-0.32.0 trio-typing-0.10.0 trio-websocket-0.12.2 types-certifi-2021.10.8.3 types-urllib3-1.26.25.14 typing-extensions-4.15.0 urllib3-2.6.3 waitress-3.0.2 websocket-client-1.9.0 webtest-3.0.7 wsproto-1.3.2 zipp-3.23.0
+ pip freeze
async-generator==1.10
attrs==25.4.0
bcrypt==5.0.0
beautifulsoup4==4.14.3
certifi==2026.1.4
cffi==2.0.0
charset-normalizer==3.4.4
click==8.3.1
cryptography==46.0.3
decorator==5.2.1
distlib==0.4.0
docker-py==1.10.6
docker-pycreds==0.4.0
elastic-transport==8.17.1
elasticsearch==8.19.3
elasticsearch-dsl==8.15.4
enum34==1.1.10
filelock==3.20.3
h11==0.16.0
idna==3.11
importlib_metadata==8.7.1
invoke==2.2.1
ipaddr==2.2.0
isodate==0.7.2
jmespath==1.1.0
jsonpatch==1.33
jsonpath-rw==1.4.0
jsonpointer==3.0.0
lxml==6.0.2
mypy_extensions==1.1.0
netaddr==1.3.0
netifaces==0.11.0
outcome==1.3.0.post0
packaging==26.0
paramiko==4.0.0
platformdirs==4.5.1
ply==3.11
pyang==2.7.1
pyangbind==0.8.7
pycparser==3.0
pyhocon==0.3.61
PyNaCl==1.6.2
pyparsing==3.3.2
PySocks==1.7.1
python-dateutil==2.9.0.post0
regex==2026.1.15
requests==2.32.5
robotframework==7.4.1
robotframework-httplibrary==0.4.2
robotframework-pythonlibcore==4.5.0
robotframework-requests==0.9.7
robotframework-selenium2library==3.0.0
robotframework-seleniumlibrary==6.8.0
robotframework-sshlibrary==3.8.0
scapy==2.7.0
scp==0.15.0
selenium==4.40.0
six==1.17.0
sniffio==1.3.1
sortedcontainers==2.4.0
soupsieve==2.8.3
trio==0.32.0
trio-typing==0.10.0
trio-websocket==0.12.2
types-certifi==2021.10.8.3
types-urllib3==1.26.25.14
typing_extensions==4.15.0
urllib3==2.6.3
virtualenv==20.36.1
waitress==3.0.2
WebOb==1.8.9
websocket-client==1.9.0
WebTest==3.0.7
wsproto==1.3.2
zipp==3.23.0
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties file path 'env.properties'
[EnvInject] - Variables injected successfully.
[controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash -l /tmp/jenkins14855272373412376076.sh
Setup pyenv:
system
3.8.13
3.9.13
3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-DjjA from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
lf-activate-venv(): INFO: Attempting to install with network-safe options...
lf-activate-venv(): INFO: Base packages installed successfully
lf-activate-venv(): INFO: Installing additional packages: python-heatclient python-openstackclient yq
lf-activate-venv(): INFO: Adding /tmp/venv-DjjA/bin to PATH
+ ODL_SYSTEM=()
+ TOOLS_SYSTEM=()
+ OPENSTACK_SYSTEM=()
+ OPENSTACK_CONTROLLERS=()
+ mapfile -t ADDR
++ openstack stack show -f json -c outputs releng-controller-csit-3node-clustering-tell-all-scandium-91
++ jq -r '.outputs[] | select(.output_key | match("^vm_[0-9]+_ips$")) | .output_value | .[]'
+ for i in "${ADDR[@]}"
++ ssh 10.30.171.69 hostname -s
Warning: Permanently added '10.30.171.69' (ECDSA) to the list of known hosts.
+ REMHOST=releng-43164-91-0-builder-0
+ case ${REMHOST} in
+ ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}")
+ for i in "${ADDR[@]}"
++ ssh 10.30.170.77 hostname -s
Warning: Permanently added '10.30.170.77' (ECDSA) to the list of known hosts.
+ REMHOST=releng-43164-91-0-builder-1
+ case ${REMHOST} in
+ ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}")
+ for i in "${ADDR[@]}"
++ ssh 10.30.171.81 hostname -s
Warning: Permanently added '10.30.171.81' (ECDSA) to the list of known hosts.
+ REMHOST=releng-43164-91-0-builder-2
+ case ${REMHOST} in
+ ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}")
+ echo NUM_ODL_SYSTEM=3
+ echo NUM_TOOLS_SYSTEM=0
+ '[' '' == yes ']'
+ NUM_OPENSTACK_SYSTEM=0
+ echo NUM_OPENSTACK_SYSTEM=0
+ '[' 0 -eq 2 ']'
+ echo ODL_SYSTEM_IP=10.30.171.69
++ seq 0 2
+ for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 )))
+ echo ODL_SYSTEM_1_IP=10.30.171.69
+ for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 )))
+ echo ODL_SYSTEM_2_IP=10.30.170.77
+ for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 )))
+ echo ODL_SYSTEM_3_IP=10.30.171.81
+ echo TOOLS_SYSTEM_IP=
++ seq 0 -1
+ openstack_index=0
+ NUM_OPENSTACK_CONTROL_NODES=1
+ echo NUM_OPENSTACK_CONTROL_NODES=1
++ seq 0 0
+ for i in $(seq 0 $((NUM_OPENSTACK_CONTROL_NODES - 1)))
+ echo OPENSTACK_CONTROL_NODE_1_IP=
+ NUM_OPENSTACK_COMPUTE_NODES=-1
+ echo NUM_OPENSTACK_COMPUTE_NODES=-1
+ '[' -1 -ge 2 ']'
++ seq 0 -2
+ NUM_OPENSTACK_HAPROXY_NODES=0
+ echo NUM_OPENSTACK_HAPROXY_NODES=0
++ seq 0 -1
+ echo 'Contents of slave_addresses.txt:'
Contents of slave_addresses.txt:
+ cat slave_addresses.txt
NUM_ODL_SYSTEM=3
NUM_TOOLS_SYSTEM=0
NUM_OPENSTACK_SYSTEM=0
ODL_SYSTEM_IP=10.30.171.69
ODL_SYSTEM_1_IP=10.30.171.69
ODL_SYSTEM_2_IP=10.30.170.77
ODL_SYSTEM_3_IP=10.30.171.81
TOOLS_SYSTEM_IP=
NUM_OPENSTACK_CONTROL_NODES=1
OPENSTACK_CONTROL_NODE_1_IP=
NUM_OPENSTACK_COMPUTE_NODES=-1
NUM_OPENSTACK_HAPROXY_NODES=0
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties file path 'slave_addresses.txt'
[EnvInject] - Variables injected successfully.
[controller-csit-3node-clustering-tell-all-scandium] $ /bin/sh /tmp/jenkins5926274035483182275.sh
Preparing for JRE Version 21
Karaf artifact is karaf
Karaf project is integration
Java home is /usr/lib/jvm/java-21-openjdk-amd64
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties file path 'set_variables.env'
[EnvInject] - Variables injected successfully.
[controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins12238424066746664288.sh
2026-01-26 23:07:37 URL:https://raw.githubusercontent.com/opendaylight/integration-distribution/stable/scandium/pom.xml [2619/2619] -> "pom.xml" [1]
Bundle version is 0.21.4-SNAPSHOT
--2026-01-26 23:07:37-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.4-SNAPSHOT/maven-metadata.xml
Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6
Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 1410 (1.4K) [application/xml]
Saving to: ‘maven-metadata.xml’
0K . 100% 71.1M=0s
2026-01-26 23:07:37 (71.1 MB/s) - ‘maven-metadata.xml’ saved [1410/1410]
org.opendaylight.integration
karaf
0.21.4-SNAPSHOT
20260126.212650
540
20260126212650
pom
0.21.4-20260126.212650-540
20260126212650
tar.gz
0.21.4-20260126.212650-540
20260126212650
zip
0.21.4-20260126.212650-540
20260126212650
cyclonedx
xml
0.21.4-20260126.212650-540
20260126212650
cyclonedx
json
0.21.4-20260126.212650-540
20260126212650
Nexus timestamp is 0.21.4-20260126.212650-540
Distribution bundle URL is https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.4-SNAPSHOT/karaf-0.21.4-20260126.212650-540.zip
Distribution bundle is karaf-0.21.4-20260126.212650-540.zip
Distribution bundle version is 0.21.4-SNAPSHOT
Distribution folder is karaf-0.21.4-SNAPSHOT
Nexus prefix is https://nexus.opendaylight.org
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties file path 'detect_variables.env'
[EnvInject] - Variables injected successfully.
[controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash -l /tmp/jenkins14436016451933238230.sh
Setup pyenv:
system
3.8.13
3.9.13
3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-DjjA from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
lf-activate-venv(): INFO: Attempting to install with network-safe options...
lf-activate-venv(): INFO: Base packages installed successfully
lf-activate-venv(): INFO: Installing additional packages: python-heatclient python-openstackclient
lf-activate-venv(): INFO: Adding /tmp/venv-DjjA/bin to PATH
Copying common-functions.sh to /tmp
Copying common-functions.sh to 10.30.171.69:/tmp
Warning: Permanently added '10.30.171.69' (ECDSA) to the list of known hosts.
Copying common-functions.sh to 10.30.170.77:/tmp
Warning: Permanently added '10.30.170.77' (ECDSA) to the list of known hosts.
Copying common-functions.sh to 10.30.171.81:/tmp
Warning: Permanently added '10.30.171.81' (ECDSA) to the list of known hosts.
[controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins12140155664768703823.sh
common-functions.sh is being sourced
common-functions environment:
MAVENCONF: /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
ACTUALFEATURES:
FEATURESCONF: /tmp/karaf-0.21.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
CUSTOMPROP: /tmp/karaf-0.21.4-SNAPSHOT/etc/custom.properties
LOGCONF: /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
MEMCONF: /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv
CONTROLLERMEM: 2048m
AKKACONF: /tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/akka.conf
MODULESCONF: /tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/modules.conf
MODULESHARDSCONF: /tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/module-shards.conf
SUITES:
#################################################
## Configure Cluster and Start ##
#################################################
ACTUALFEATURES: odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app
SPACE_SEPARATED_FEATURES: odl-integration-compatible-with-all odl-jolokia odl-restconf odl-clustering-test-app
Locating script plan to use...
script plan exists!!!
Changing the script plan path...
# Place the scripts in run order:
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/scripts/car_people_shard.sh
Executing /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/scripts/car_people_shard.sh...
Add car-people shards file
Copy shard config to member-1 with IP address 10.30.171.69
Warning: Permanently added '10.30.171.69' (ECDSA) to the list of known hosts.
Copy shard config to member-2 with IP address 10.30.170.77
Warning: Permanently added '10.30.170.77' (ECDSA) to the list of known hosts.
Copy shard config to member-3 with IP address 10.30.171.81
Warning: Permanently added '10.30.171.81' (ECDSA) to the list of known hosts.
Finished running script plans
Configuring member-1 with IP address 10.30.171.69
Warning: Permanently added '10.30.171.69' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.171.69' (ECDSA) to the list of known hosts.
+ source /tmp/common-functions.sh karaf-0.21.4-SNAPSHOT scandium
common-functions.sh is being sourced
++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]]
++ echo 'common-functions.sh is being sourced'
++ BUNDLEFOLDER=karaf-0.21.4-SNAPSHOT
++ DISTROSTREAM=scandium
++ export MAVENCONF=/tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
++ MAVENCONF=/tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
++ export FEATURESCONF=/tmp/karaf-0.21.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
++ FEATURESCONF=/tmp/karaf-0.21.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
++ export CUSTOMPROP=/tmp/karaf-0.21.4-SNAPSHOT/etc/custom.properties
++ CUSTOMPROP=/tmp/karaf-0.21.4-SNAPSHOT/etc/custom.properties
++ export LOGCONF=/tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
++ LOGCONF=/tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
++ export MEMCONF=/tmp/karaf-0.21.4-SNAPSHOT/bin/setenv
++ MEMCONF=/tmp/karaf-0.21.4-SNAPSHOT/bin/setenv
++ export CONTROLLERMEM=
++ CONTROLLERMEM=
++ case "${DISTROSTREAM}" in
++ CLUSTER_SYSTEM=akka
++ export AKKACONF=/tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/akka.conf
++ AKKACONF=/tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/akka.conf
++ export MODULESCONF=/tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/modules.conf
++ MODULESCONF=/tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/modules.conf
++ export MODULESHARDSCONF=/tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/module-shards.conf
++ MODULESHARDSCONF=/tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/module-shards.conf
++ print_common_env
++ cat
common-functions environment:
MAVENCONF: /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
ACTUALFEATURES:
FEATURESCONF: /tmp/karaf-0.21.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
CUSTOMPROP: /tmp/karaf-0.21.4-SNAPSHOT/etc/custom.properties
LOGCONF: /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
MEMCONF: /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv
CONTROLLERMEM:
AKKACONF: /tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/akka.conf
MODULESCONF: /tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/modules.conf
MODULESHARDSCONF: /tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/module-shards.conf
SUITES:
++ SSH='ssh -t -t'
++ extra_services_cntl=' dnsmasq.service httpd.service libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service rabbitmq-server.service '
++ extra_services_cmp=' libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service '
Changing to /tmp
Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.4-SNAPSHOT/karaf-0.21.4-20260126.212650-540.zip
+ echo 'Changing to /tmp'
+ cd /tmp
+ echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.4-SNAPSHOT/karaf-0.21.4-20260126.212650-540.zip'
+ wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.4-SNAPSHOT/karaf-0.21.4-20260126.212650-540.zip
--2026-01-26 23:07:50-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.4-SNAPSHOT/karaf-0.21.4-20260126.212650-540.zip
Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6
Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 239811461 (229M) [application/zip]
Saving to: ‘karaf-0.21.4-20260126.212650-540.zip’
0K ........ ........ ........ ........ ........ ........ 1% 57.5M 4s
3072K ........ ........ ........ ........ ........ ........ 2% 114M 3s
6144K ........ ........ ........ ........ ........ ........ 3% 138M 2s
9216K ........ ........ ........ ........ ........ ........ 5% 103M 2s
12288K ........ ........ ........ ........ ........ ........ 6% 170M 2s
15360K ........ ........ ........ ........ ........ ........ 7% 187M 2s
18432K ........ ........ ........ ........ ........ ........ 9% 220M 2s
21504K ........ ........ ........ ........ ........ ........ 10% 166M 2s
24576K ........ ........ ........ ........ ........ ........ 11% 236M 2s
27648K ........ ........ ........ ........ ........ ........ 13% 208M 1s
30720K ........ ........ ........ ........ ........ ........ 14% 251M 1s
33792K ........ ........ ........ ........ ........ ........ 15% 251M 1s
36864K ........ ........ ........ ........ ........ ........ 17% 287M 1s
39936K ........ ........ ........ ........ ........ ........ 18% 286M 1s
43008K ........ ........ ........ ........ ........ ........ 19% 294M 1s
46080K ........ ........ ........ ........ ........ ........ 20% 293M 1s
49152K ........ ........ ........ ........ ........ ........ 22% 278M 1s
52224K ........ ........ ........ ........ ........ ........ 23% 241M 1s
55296K ........ ........ ........ ........ ........ ........ 24% 252M 1s
58368K ........ ........ ........ ........ ........ ........ 26% 337M 1s
61440K ........ ........ ........ ........ ........ ........ 27% 243M 1s
64512K ........ ........ ........ ........ ........ ........ 28% 336M 1s
67584K ........ ........ ........ ........ ........ ........ 30% 384M 1s
70656K ........ ........ ........ ........ ........ ........ 31% 258M 1s
73728K ........ ........ ........ ........ ........ ........ 32% 264M 1s
76800K ........ ........ ........ ........ ........ ........ 34% 352M 1s
79872K ........ ........ ........ ........ ........ ........ 35% 315M 1s
82944K ........ ........ ........ ........ ........ ........ 36% 243M 1s
86016K ........ ........ ........ ........ ........ ........ 38% 237M 1s
89088K ........ ........ ........ ........ ........ ........ 39% 367M 1s
92160K ........ ........ ........ ........ ........ ........ 40% 507M 1s
95232K ........ ........ ........ ........ ........ ........ 41% 400M 1s
98304K ........ ........ ........ ........ ........ ........ 43% 332M 1s
101376K ........ ........ ........ ........ ........ ........ 44% 417M 1s
104448K ........ ........ ........ ........ ........ ........ 45% 228M 1s
107520K ........ ........ ........ ........ ........ ........ 47% 309M 1s
110592K ........ ........ ........ ........ ........ ........ 48% 371M 1s
113664K ........ ........ ........ ........ ........ ........ 49% 422M 1s
116736K ........ ........ ........ ........ ........ ........ 51% 419M 0s
119808K ........ ........ ........ ........ ........ ........ 52% 199M 0s
122880K ........ ........ ........ ........ ........ ........ 53% 340M 0s
125952K ........ ........ ........ ........ ........ ........ 55% 378M 0s
129024K ........ ........ ........ ........ ........ ........ 56% 372M 0s
132096K ........ ........ ........ ........ ........ ........ 57% 193M 0s
135168K ........ ........ ........ ........ ........ ........ 59% 222M 0s
138240K ........ ........ ........ ........ ........ ........ 60% 283M 0s
141312K ........ ........ ........ ........ ........ ........ 61% 248M 0s
144384K ........ ........ ........ ........ ........ ........ 62% 259M 0s
147456K ........ ........ ........ ........ ........ ........ 64% 235M 0s
150528K ........ ........ ........ ........ ........ ........ 65% 286M 0s
153600K ........ ........ ........ ........ ........ ........ 66% 279M 0s
156672K ........ ........ ........ ........ ........ ........ 68% 280M 0s
159744K ........ ........ ........ ........ ........ ........ 69% 276M 0s
162816K ........ ........ ........ ........ ........ ........ 70% 284M 0s
165888K ........ ........ ........ ........ ........ ........ 72% 274M 0s
168960K ........ ........ ........ ........ ........ ........ 73% 283M 0s
172032K ........ ........ ........ ........ ........ ........ 74% 286M 0s
175104K ........ ........ ........ ........ ........ ........ 76% 277M 0s
178176K ........ ........ ........ ........ ........ ........ 77% 278M 0s
181248K ........ ........ ........ ........ ........ ........ 78% 275M 0s
184320K ........ ........ ........ ........ ........ ........ 80% 280M 0s
187392K ........ ........ ........ ........ ........ ........ 81% 279M 0s
190464K ........ ........ ........ ........ ........ ........ 82% 280M 0s
193536K ........ ........ ........ ........ ........ ........ 83% 275M 0s
196608K ........ ........ ........ ........ ........ ........ 85% 276M 0s
199680K ........ ........ ........ ........ ........ ........ 86% 275M 0s
202752K ........ ........ ........ ........ ........ ........ 87% 290M 0s
205824K ........ ........ ........ ........ ........ ........ 89% 284M 0s
208896K ........ ........ ........ ........ ........ ........ 90% 276M 0s
211968K ........ ........ ........ ........ ........ ........ 91% 278M 0s
215040K ........ ........ ........ ........ ........ ........ 93% 280M 0s
218112K ........ ........ ........ ........ ........ ........ 94% 275M 0s
221184K ........ ........ ........ ........ ........ ........ 95% 256M 0s
224256K ........ ........ ........ ........ ........ ........ 97% 277M 0s
227328K ........ ........ ........ ........ ........ ........ 98% 274M 0s
230400K ........ ........ ........ ........ ........ ........ 99% 273M 0s
233472K ........ ... 100% 259M=0.9s
2026-01-26 23:07:51 (249 MB/s) - ‘karaf-0.21.4-20260126.212650-540.zip’ saved [239811461/239811461]
Extracting the new controller...
+ echo 'Extracting the new controller...'
+ unzip -q karaf-0.21.4-20260126.212650-540.zip
Adding external repositories...
+ echo 'Adding external repositories...'
+ sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
+ cat /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
################################################################################
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
################################################################################
#
# If set to true, the following property will not allow any certificate to be used
# when accessing Maven repositories through SSL
#
#org.ops4j.pax.url.mvn.certificateCheck=
#
# Path to the local Maven settings file.
# The repositories defined in this file will be automatically added to the list
# of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property
# below is not set.
# The following locations are checked for the existence of the settings.xml file
# * 1. looks for the specified url
# * 2. if not found looks for ${user.home}/.m2/settings.xml
# * 3. if not found looks for ${maven.home}/conf/settings.xml
# * 4. if not found looks for ${M2_HOME}/conf/settings.xml
#
#org.ops4j.pax.url.mvn.settings=
#
# Path to the local Maven repository which is used to avoid downloading
# artifacts when they already exist locally.
# The value of this property will be extracted from the settings.xml file
# above, or defaulted to:
# System.getProperty( "user.home" ) + "/.m2/repository"
#
org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository}
#
# Default this to false. It's just weird to use undocumented repos
#
org.ops4j.pax.url.mvn.useFallbackRepositories=false
#
# Uncomment if you don't wanna use the proxy settings
# from the Maven conf/settings.xml file
#
# org.ops4j.pax.url.mvn.proxySupport=false
#
# Comma separated list of repositories scanned when resolving an artifact.
# Those repositories will be checked before iterating through the
# below list of repositories and even before the local repository
# A repository url can be appended with zero or more of the following flags:
# @snapshots : the repository contains snaphots
# @noreleases : the repository does not contain any released artifacts
#
# The following property value will add the system folder as a repo.
#
org.ops4j.pax.url.mvn.defaultRepositories=\
file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\
file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\
file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots
# Use the default local repo (e.g.~/.m2/repository) as a "remote" repo
#org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false
#
# Comma separated list of repositories scanned when resolving an artifact.
# The default list includes the following repositories:
# http://repo1.maven.org/maven2@id=central
# http://repository.springsource.com/maven/bundles/release@id=spring.ebr
# http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external
# http://zodiac.springsource.com/maven/bundles/release@id=gemini
# http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases
# https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases
# https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
# To add repositories to the default ones, prepend '+' to the list of repositories
# to add.
# A repository url can be appended with zero or more of the following flags:
# @snapshots : the repository contains snapshots
# @noreleases : the repository does not contain any released artifacts
# @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended
#
org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.Configuring the startup features...
+ [[ True == \T\r\u\e ]]
+ echo 'Configuring the startup features...'
+ sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.21.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
+ FEATURE_TEST_STRING=features-test
+ FEATURE_TEST_VERSION=0.21.4-SNAPSHOT
+ KARAF_VERSION=karaf4
+ [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]]
+ sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.21.4-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.21.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
+ [[ ! -z '' ]]
+ cat /tmp/karaf-0.21.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
################################################################################
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
################################################################################
#
# Comma separated list of features repositories to register by default
#
featuresRepositories = mvn:org.opendaylight.integration/features-test/0.21.4-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/7f68dd39-34cc-4efc-8cc8-cfcdf355b893.xml
#
# Comma separated list of features to install at startup
#
featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, 21808cfe-e671-4908-a89a-6f0909233b41
#
# Resource repositories (OBR) that the features resolver can use
# to resolve requirements/capabilities
#
# The format of the resourceRepositories is
# resourceRepositories=[xml:url|json:url],...
# for Instance:
#
#resourceRepositories=xml:http://host/path/to/index.xml
# or
#resourceRepositories=json:http://host/path/to/index.json
#
#
# Defines if the boot features are started in asynchronous mode (in a dedicated thread)
#
featuresBootAsynchronous=false
#
# Service requirements enforcement
#
# By default, the feature resolver checks the service requirements/capabilities of
# bundles for new features (xml schema >= 1.3.0) in order to automatically installs
# the required bundles.
# The following flag can have those values:
# - disable: service requirements are completely ignored
# - default: service requirements are ignored for old features
# - enforce: service requirements are always verified
#
#serviceRequirements=default
#
# Store cfg file for config element in feature
#
#configCfgStore=true
#
# Define if the feature service automatically refresh bundles
#
autoRefresh=true
#
# Configuration of features processing mechanism (overrides, blacklisting, modification of features)
# XML file defines instructions related to features processing
# versions.properties may declare properties to resolve placeholders in XML file
# both files are relative to ${karaf.etc}
#
#featureProcessing=org.apache.karaf.features.xml
#featureProcessingVersions=versions.properties
+ configure_karaf_log karaf4 ''
+ local -r karaf_version=karaf4
+ local -r controllerdebugmap=
+ local logapi=log4j
+ grep log4j2 /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
log4j2.rootLogger.level = INFO
#log4j2.rootLogger.type = asyncRoot
#log4j2.rootLogger.includeLocation = false
log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
log4j2.rootLogger.appenderRef.Console.ref = Console
log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
log4j2.logger.spifly.name = org.apache.aries.spifly
log4j2.logger.spifly.level = WARN
log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
log4j2.logger.audit.level = INFO
log4j2.logger.audit.additivity = false
log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
# Console appender not used by default (see log4j2.rootLogger.appenderRefs)
log4j2.appender.console.type = Console
log4j2.appender.console.name = Console
log4j2.appender.console.layout.type = PatternLayout
log4j2.appender.console.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.type = RollingRandomAccessFile
log4j2.appender.rolling.name = RollingFile
log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
#log4j2.appender.rolling.immediateFlush = false
log4j2.appender.rolling.append = true
log4j2.appender.rolling.layout.type = PatternLayout
log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.policies.type = Policies
log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.rolling.policies.size.size = 64MB
log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
log4j2.appender.rolling.strategy.max = 7
log4j2.appender.audit.type = RollingRandomAccessFile
log4j2.appender.audit.name = AuditRollingFile
log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
log4j2.appender.audit.append = true
log4j2.appender.audit.layout.type = PatternLayout
log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
log4j2.appender.audit.policies.type = Policies
log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.audit.policies.size.size = 8MB
log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
log4j2.appender.audit.strategy.max = 7
log4j2.appender.osgi.type = PaxOsgi
log4j2.appender.osgi.name = PaxOsgi
log4j2.appender.osgi.filter = *
#log4j2.logger.aether.name = shaded.org.eclipse.aether
#log4j2.logger.aether.level = TRACE
#log4j2.logger.http-headers.name = shaded.org.apache.http.headers
#log4j2.logger.http-headers.level = DEBUG
#log4j2.logger.maven.name = org.ops4j.pax.url.mvn
#log4j2.logger.maven.level = TRACE
Configuring the karaf log... karaf_version: karaf4, logapi: log4j2
+ logapi=log4j2
+ echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2'
+ '[' log4j2 == log4j2 ']'
+ sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
controllerdebugmap:
cat /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
+ orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver
+ orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver
+ echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN'
+ echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN'
+ unset IFS
+ echo 'controllerdebugmap: '
+ '[' -n '' ']'
+ echo 'cat /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg'
+ cat /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
################################################################################
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
################################################################################
# Common pattern layout for appenders
log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
# Root logger
log4j2.rootLogger.level = INFO
# uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library
#log4j2.rootLogger.type = asyncRoot
#log4j2.rootLogger.includeLocation = false
log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
log4j2.rootLogger.appenderRef.Console.ref = Console
log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
# Filters for logs marked by org.opendaylight.odlparent.Markers
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
# Loggers configuration
# Spifly logger
log4j2.logger.spifly.name = org.apache.aries.spifly
log4j2.logger.spifly.level = WARN
# Security audit logger
log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
log4j2.logger.audit.level = INFO
log4j2.logger.audit.additivity = false
log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
# Appenders configuration
# Console appender not used by default (see log4j2.rootLogger.appenderRefs)
log4j2.appender.console.type = Console
log4j2.appender.console.name = Console
log4j2.appender.console.layout.type = PatternLayout
log4j2.appender.console.layout.pattern = ${log4j2.pattern}
# Rolling file appender
log4j2.appender.rolling.type = RollingRandomAccessFile
log4j2.appender.rolling.name = RollingFile
log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
# uncomment to not force a disk flush
#log4j2.appender.rolling.immediateFlush = false
log4j2.appender.rolling.append = true
log4j2.appender.rolling.layout.type = PatternLayout
log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.policies.type = Policies
log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.rolling.policies.size.size = 1GB
log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
log4j2.appender.rolling.strategy.max = 7
# Audit file appender
log4j2.appender.audit.type = RollingRandomAccessFile
log4j2.appender.audit.name = AuditRollingFile
log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
log4j2.appender.audit.append = true
log4j2.appender.audit.layout.type = PatternLayout
log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
log4j2.appender.audit.policies.type = Policies
log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.audit.policies.size.size = 8MB
log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
log4j2.appender.audit.strategy.max = 7
# OSGi appender
log4j2.appender.osgi.type = PaxOsgi
log4j2.appender.osgi.name = PaxOsgi
log4j2.appender.osgi.filter = *
# help with identification of maven-related problems with pax-url-aether
#log4j2.logger.aether.name = shaded.org.eclipse.aether
#log4j2.logger.aether.level = TRACE
#log4j2.logger.http-headers.name = shaded.org.apache.http.headers
#log4j2.logger.http-headers.level = DEBUG
#log4j2.logger.maven.name = org.ops4j.pax.url.mvn
#log4j2.logger.maven.level = TRACE
log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN
log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN
+ set_java_vars /usr/lib/jvm/java-21-openjdk-amd64 3072m /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv
+ local -r java_home=/usr/lib/jvm/java-21-openjdk-amd64
+ local -r controllermem=3072m
+ local -r memconf=/tmp/karaf-0.21.4-SNAPSHOT/bin/setenv
Configure
java home: /usr/lib/jvm/java-21-openjdk-amd64
max memory: 3072m
memconf: /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv
+ echo Configure
+ echo ' java home: /usr/lib/jvm/java-21-openjdk-amd64'
+ echo ' max memory: 3072m'
+ echo ' memconf: /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv'
+ sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64}%g' /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv
+ sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv
cat /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv
+ echo 'cat /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv'
+ cat /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv
#!/bin/sh
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
#
# handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf
# script: client, instance, shell, start, status, stop, karaf
#
# if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then
# Actions go here...
# fi
#
# general settings which should be applied for all scripts go here; please keep
# in mind that it is possible that scripts might be executed more than once, e.g.
# in example of the start script where the start script is executed first and the
# karaf script afterwards.
#
#
# The following section shows the possible configuration options for the default
# karaf scripts
#
export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64} # Location of Java installation
# export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration
# export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options
# export EXTRA_JAVA_OPTS # Additional JVM options
# export KARAF_HOME # Karaf home folder
# export KARAF_DATA # Karaf data folder
# export KARAF_BASE # Karaf base folder
# export KARAF_ETC # Karaf etc folder
# export KARAF_LOG # Karaf log folder
# export KARAF_SYSTEM_OPTS # First citizen Karaf options
# export KARAF_OPTS # Additional available Karaf options
# export KARAF_DEBUG # Enable debug mode
# export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start
# export KARAF_NOROOT # Prevent execution as root if set to true
Set Java version
+ echo 'Set Java version'
+ sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-21-openjdk-amd64/bin/java 1
sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper
sudo: a password is required
+ sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-21-openjdk-amd64/bin/java
sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper
sudo: a password is required
JDK default version ...
+ echo 'JDK default version ...'
+ java -version
openjdk version "21.0.9" 2025-10-21
OpenJDK Runtime Environment (build 21.0.9+10-Ubuntu-122.04)
OpenJDK 64-Bit Server VM (build 21.0.9+10-Ubuntu-122.04, mixed mode, sharing)
Set JAVA_HOME
+ echo 'Set JAVA_HOME'
+ export JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64
+ JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64
++ readlink -e /usr/lib/jvm/java-21-openjdk-amd64/bin/java
+ JAVA_RESOLVED=/usr/lib/jvm/java-21-openjdk-amd64/bin/java
+ echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java'
Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java
Listing all open ports on controller system...
+ echo 'Listing all open ports on controller system...'
+ netstat -pnatu
/tmp/configuration-script.sh: line 40: netstat: command not found
+ '[' -f /tmp/custom_shard_config.txt ']'
+ echo 'Custom shard config exists!!!'
Custom shard config exists!!!
Copying the shard config...
+ echo 'Copying the shard config...'
+ cp /tmp/custom_shard_config.txt /tmp/karaf-0.21.4-SNAPSHOT/bin/
Configuring cluster
+ echo 'Configuring cluster'
+ /tmp/karaf-0.21.4-SNAPSHOT/bin/configure_cluster.sh 1 10.30.171.69 10.30.170.77 10.30.171.81
################################################
## Configure Cluster ##
################################################
NOTE: Cluster configuration files not found. Copying from
/tmp/karaf-0.21.4-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/10.0.14
Configuring unique name in akka.conf
Configuring hostname in akka.conf
Configuring data and rpc seed nodes in akka.conf
modules = [
{
name = "inventory"
namespace = "urn:opendaylight:inventory"
shard-strategy = "module"
},
{
name = "topology"
namespace = "urn:TBD:params:xml:ns:yang:network-topology"
shard-strategy = "module"
},
{
name = "toaster"
namespace = "http://netconfcentral.org/ns/toaster"
shard-strategy = "module"
},
{
name = "car"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
shard-strategy = "module"
},
{
name = "people"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
shard-strategy = "module"
},
{
name = "car-people"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
shard-strategy = "module"
}
]
Configuring replication type in module-shards.conf
################################################
## NOTE: Manually restart controller to ##
## apply configuration. ##
################################################
Dump akka.conf
+ echo 'Dump akka.conf'
+ cat /tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/akka.conf
odl-cluster-data {
akka {
remote {
artery {
enabled = on
transport = tcp
canonical.hostname = "10.30.171.69"
canonical.port = 2550
}
}
cluster {
# Using artery.
seed-nodes = ["akka://opendaylight-cluster-data@10.30.171.69:2550",
"akka://opendaylight-cluster-data@10.30.170.77:2550",
"akka://opendaylight-cluster-data@10.30.171.81:2550"]
roles = ["member-1"]
# when under load we might trip a false positive on the failure detector
# failure-detector {
# heartbeat-interval = 4 s
# acceptable-heartbeat-pause = 16s
# }
}
persistence {
# By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by
# modifying the following two properties. The directory location specified may be a relative or absolute path.
# The relative path is always relative to KARAF_HOME.
# snapshot-store.local.dir = "target/snapshots"
# Use lz4 compression for LocalSnapshotStore snapshots
snapshot-store.local.use-lz4-compression = false
# Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB
snapshot-store.local.lz4-blocksize = 256KB
}
disable-default-actor-system-quarantined-event-handling = "false"
}
}
Dump modules.conf
+ echo 'Dump modules.conf'
+ cat /tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/modules.conf
modules = [
{
name = "inventory"
namespace = "urn:opendaylight:inventory"
shard-strategy = "module"
},
{
name = "topology"
namespace = "urn:TBD:params:xml:ns:yang:network-topology"
shard-strategy = "module"
},
{
name = "toaster"
namespace = "http://netconfcentral.org/ns/toaster"
shard-strategy = "module"
},
{
name = "car"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
shard-strategy = "module"
},
{
name = "people"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
shard-strategy = "module"
},
{
name = "car-people"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
shard-strategy = "module"
}
]
Dump module-shards.conf
+ echo 'Dump module-shards.conf'
+ cat /tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/module-shards.conf
module-shards = [
{
name = "default"
shards = [
{
name = "default"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "inventory"
shards = [
{
name="inventory"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "topology"
shards = [
{
name="topology"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "toaster"
shards = [
{
name="toaster"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "car"
shards = [
{
name="car"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "people"
shards = [
{
name="people"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "car-people"
shards = [
{
name="car-people"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
}
]
Configuring member-2 with IP address 10.30.170.77
Warning: Permanently added '10.30.170.77' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.170.77' (ECDSA) to the list of known hosts.
+ source /tmp/common-functions.sh karaf-0.21.4-SNAPSHOT scandium
++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]]
common-functions.sh is being sourced
++ echo 'common-functions.sh is being sourced'
++ BUNDLEFOLDER=karaf-0.21.4-SNAPSHOT
++ DISTROSTREAM=scandium
++ export MAVENCONF=/tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
++ MAVENCONF=/tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
++ export FEATURESCONF=/tmp/karaf-0.21.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
++ FEATURESCONF=/tmp/karaf-0.21.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
++ export CUSTOMPROP=/tmp/karaf-0.21.4-SNAPSHOT/etc/custom.properties
++ CUSTOMPROP=/tmp/karaf-0.21.4-SNAPSHOT/etc/custom.properties
++ export LOGCONF=/tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
++ LOGCONF=/tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
++ export MEMCONF=/tmp/karaf-0.21.4-SNAPSHOT/bin/setenv
++ MEMCONF=/tmp/karaf-0.21.4-SNAPSHOT/bin/setenv
++ export CONTROLLERMEM=
++ CONTROLLERMEM=
++ case "${DISTROSTREAM}" in
++ CLUSTER_SYSTEM=akka
++ export AKKACONF=/tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/akka.conf
++ AKKACONF=/tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/akka.conf
++ export MODULESCONF=/tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/modules.conf
++ MODULESCONF=/tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/modules.conf
++ export MODULESHARDSCONF=/tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/module-shards.conf
++ MODULESHARDSCONF=/tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/module-shards.conf
++ print_common_env
++ cat
common-functions environment:
MAVENCONF: /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
ACTUALFEATURES:
FEATURESCONF: /tmp/karaf-0.21.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
CUSTOMPROP: /tmp/karaf-0.21.4-SNAPSHOT/etc/custom.properties
LOGCONF: /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
MEMCONF: /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv
CONTROLLERMEM:
AKKACONF: /tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/akka.conf
MODULESCONF: /tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/modules.conf
MODULESHARDSCONF: /tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/module-shards.conf
SUITES:
++ SSH='ssh -t -t'
++ extra_services_cntl=' dnsmasq.service httpd.service libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service rabbitmq-server.service '
++ extra_services_cmp=' libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service '
Changing to /tmp
+ echo 'Changing to /tmp'
+ cd /tmp
Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.4-SNAPSHOT/karaf-0.21.4-20260126.212650-540.zip
+ echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.4-SNAPSHOT/karaf-0.21.4-20260126.212650-540.zip'
+ wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.4-SNAPSHOT/karaf-0.21.4-20260126.212650-540.zip
--2026-01-26 23:07:54-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.4-SNAPSHOT/karaf-0.21.4-20260126.212650-540.zip
Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6
Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 239811461 (229M) [application/zip]
Saving to: ‘karaf-0.21.4-20260126.212650-540.zip’
0K ........ ........ ........ ........ ........ ........ 1% 95.1M 2s
3072K ........ ........ ........ ........ ........ ........ 2% 163M 2s
6144K ........ ........ ........ ........ ........ ........ 3% 136M 2s
9216K ........ ........ ........ ........ ........ ........ 5% 172M 2s
12288K ........ ........ ........ ........ ........ ........ 6% 178M 2s
15360K ........ ........ ........ ........ ........ ........ 7% 260M 1s
18432K ........ ........ ........ ........ ........ ........ 9% 236M 1s
21504K ........ ........ ........ ........ ........ ........ 10% 240M 1s
24576K ........ ........ ........ ........ ........ ........ 11% 254M 1s
27648K ........ ........ ........ ........ ........ ........ 13% 186M 1s
30720K ........ ........ ........ ........ ........ ........ 14% 203M 1s
33792K ........ ........ ........ ........ ........ ........ 15% 313M 1s
36864K ........ ........ ........ ........ ........ ........ 17% 286M 1s
39936K ........ ........ ........ ........ ........ ........ 18% 306M 1s
43008K ........ ........ ........ ........ ........ ........ 19% 277M 1s
46080K ........ ........ ........ ........ ........ ........ 20% 343M 1s
49152K ........ ........ ........ ........ ........ ........ 22% 340M 1s
52224K ........ ........ ........ ........ ........ ........ 23% 339M 1s
55296K ........ ........ ........ ........ ........ ........ 24% 339M 1s
58368K ........ ........ ........ ........ ........ ........ 26% 336M 1s
61440K ........ ........ ........ ........ ........ ........ 27% 340M 1s
64512K ........ ........ ........ ........ ........ ........ 28% 358M 1s
67584K ........ ........ ........ ........ ........ ........ 30% 340M 1s
70656K ........ ........ ........ ........ ........ ........ 31% 367M 1s
73728K ........ ........ ........ ........ ........ ........ 32% 370M 1s
76800K ........ ........ ........ ........ ........ ........ 34% 378M 1s
79872K ........ ........ ........ ........ ........ ........ 35% 349M 1s
82944K ........ ........ ........ ........ ........ ........ 36% 280M 1s
86016K ........ ........ ........ ........ ........ ........ 38% 212M 1s
89088K ........ ........ ........ ........ ........ ........ 39% 299M 1s
92160K ........ ........ ........ ........ ........ ........ 40% 252M 1s
95232K ........ ........ ........ ........ ........ ........ 41% 294M 1s
98304K ........ ........ ........ ........ ........ ........ 43% 305M 1s
101376K ........ ........ ........ ........ ........ ........ 44% 292M 1s
104448K ........ ........ ........ ........ ........ ........ 45% 314M 0s
107520K ........ ........ ........ ........ ........ ........ 47% 321M 0s
110592K ........ ........ ........ ........ ........ ........ 48% 299M 0s
113664K ........ ........ ........ ........ ........ ........ 49% 306M 0s
116736K ........ ........ ........ ........ ........ ........ 51% 303M 0s
119808K ........ ........ ........ ........ ........ ........ 52% 305M 0s
122880K ........ ........ ........ ........ ........ ........ 53% 299M 0s
125952K ........ ........ ........ ........ ........ ........ 55% 312M 0s
129024K ........ ........ ........ ........ ........ ........ 56% 301M 0s
132096K ........ ........ ........ ........ ........ ........ 57% 305M 0s
135168K ........ ........ ........ ........ ........ ........ 59% 293M 0s
138240K ........ ........ ........ ........ ........ ........ 60% 295M 0s
141312K ........ ........ ........ ........ ........ ........ 61% 301M 0s
144384K ........ ........ ........ ........ ........ ........ 62% 304M 0s
147456K ........ ........ ........ ........ ........ ........ 64% 307M 0s
150528K ........ ........ ........ ........ ........ ........ 65% 293M 0s
153600K ........ ........ ........ ........ ........ ........ 66% 217M 0s
156672K ........ ........ ........ ........ ........ ........ 68% 249M 0s
159744K ........ ........ ........ ........ ........ ........ 69% 299M 0s
162816K ........ ........ ........ ........ ........ ........ 70% 298M 0s
165888K ........ ........ ........ ........ ........ ........ 72% 287M 0s
168960K ........ ........ ........ ........ ........ ........ 73% 303M 0s
172032K ........ ........ ........ ........ ........ ........ 74% 303M 0s
175104K ........ ........ ........ ........ ........ ........ 76% 293M 0s
178176K ........ ........ ........ ........ ........ ........ 77% 302M 0s
181248K ........ ........ ........ ........ ........ ........ 78% 301M 0s
184320K ........ ........ ........ ........ ........ ........ 80% 302M 0s
187392K ........ ........ ........ ........ ........ ........ 81% 305M 0s
190464K ........ ........ ........ ........ ........ ........ 82% 308M 0s
193536K ........ ........ ........ ........ ........ ........ 83% 303M 0s
196608K ........ ........ ........ ........ ........ ........ 85% 306M 0s
199680K ........ ........ ........ ........ ........ ........ 86% 281M 0s
202752K ........ ........ ........ ........ ........ ........ 87% 296M 0s
205824K ........ ........ ........ ........ ........ ........ 89% 298M 0s
208896K ........ ........ ........ ........ ........ ........ 90% 312M 0s
211968K ........ ........ ........ ........ ........ ........ 91% 299M 0s
215040K ........ ........ ........ ........ ........ ........ 93% 285M 0s
218112K ........ ........ ........ ........ ........ ........ 94% 297M 0s
221184K ........ ........ ........ ........ ........ ........ 95% 308M 0s
224256K ........ ........ ........ ........ ........ ........ 97% 302M 0s
227328K ........ ........ ........ ........ ........ ........ 98% 302M 0s
230400K ........ ........ ........ ........ ........ ........ 99% 282M 0s
233472K ........ ... 100% 274M=0.8s
2026-01-26 23:07:54 (274 MB/s) - ‘karaf-0.21.4-20260126.212650-540.zip’ saved [239811461/239811461]
Extracting the new controller...
+ echo 'Extracting the new controller...'
+ unzip -q karaf-0.21.4-20260126.212650-540.zip
Adding external repositories...
+ echo 'Adding external repositories...'
+ sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
+ cat /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
################################################################################
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
################################################################################
#
# If set to true, the following property will not allow any certificate to be used
# when accessing Maven repositories through SSL
#
#org.ops4j.pax.url.mvn.certificateCheck=
#
# Path to the local Maven settings file.
# The repositories defined in this file will be automatically added to the list
# of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property
# below is not set.
# The following locations are checked for the existence of the settings.xml file
# * 1. looks for the specified url
# * 2. if not found looks for ${user.home}/.m2/settings.xml
# * 3. if not found looks for ${maven.home}/conf/settings.xml
# * 4. if not found looks for ${M2_HOME}/conf/settings.xml
#
#org.ops4j.pax.url.mvn.settings=
#
# Path to the local Maven repository which is used to avoid downloading
# artifacts when they already exist locally.
# The value of this property will be extracted from the settings.xml file
# above, or defaulted to:
# System.getProperty( "user.home" ) + "/.m2/repository"
#
org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository}
#
# Default this to false. It's just weird to use undocumented repos
#
org.ops4j.pax.url.mvn.useFallbackRepositories=false
#
# Uncomment if you don't wanna use the proxy settings
# from the Maven conf/settings.xml file
#
# org.ops4j.pax.url.mvn.proxySupport=false
#
# Comma separated list of repositories scanned when resolving an artifact.
# Those repositories will be checked before iterating through the
# below list of repositories and even before the local repository
# A repository url can be appended with zero or more of the following flags:
# @snapshots : the repository contains snaphots
# @noreleases : the repository does not contain any released artifacts
#
# The following property value will add the system folder as a repo.
#
org.ops4j.pax.url.mvn.defaultRepositories=\
file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\
file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\
file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots
# Use the default local repo (e.g.~/.m2/repository) as a "remote" repo
#org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false
#
# Comma separated list of repositories scanned when resolving an artifact.
# The default list includes the following repositories:
# http://repo1.maven.org/maven2@id=central
# http://repository.springsource.com/maven/bundles/release@id=spring.ebr
# http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external
# http://zodiac.springsource.com/maven/bundles/release@id=gemini
# http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases
# https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases
# https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
# To add repositories to the default ones, prepend '+' to the list of repositories
# to add.
# A repository url can be appended with zero or more of the following flags:
# @snapshots : the repository contains snapshots
# @noreleases : the repository does not contain any released artifacts
# @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended
#
org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.Configuring the startup features...
+ [[ True == \T\r\u\e ]]
+ echo 'Configuring the startup features...'
+ sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.21.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
+ FEATURE_TEST_STRING=features-test
+ FEATURE_TEST_VERSION=0.21.4-SNAPSHOT
+ KARAF_VERSION=karaf4
+ [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]]
+ sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.21.4-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.21.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
+ [[ ! -z '' ]]
+ cat /tmp/karaf-0.21.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
################################################################################
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
################################################################################
#
# Comma separated list of features repositories to register by default
#
featuresRepositories = mvn:org.opendaylight.integration/features-test/0.21.4-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/7f68dd39-34cc-4efc-8cc8-cfcdf355b893.xml
#
# Comma separated list of features to install at startup
#
featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, 21808cfe-e671-4908-a89a-6f0909233b41
#
# Resource repositories (OBR) that the features resolver can use
# to resolve requirements/capabilities
#
# The format of the resourceRepositories is
# resourceRepositories=[xml:url|json:url],...
# for Instance:
#
#resourceRepositories=xml:http://host/path/to/index.xml
# or
#resourceRepositories=json:http://host/path/to/index.json
#
#
# Defines if the boot features are started in asynchronous mode (in a dedicated thread)
#
featuresBootAsynchronous=false
#
# Service requirements enforcement
#
# By default, the feature resolver checks the service requirements/capabilities of
# bundles for new features (xml schema >= 1.3.0) in order to automatically installs
# the required bundles.
# The following flag can have those values:
# - disable: service requirements are completely ignored
# - default: service requirements are ignored for old features
# - enforce: service requirements are always verified
#
#serviceRequirements=default
#
# Store cfg file for config element in feature
#
#configCfgStore=true
#
# Define if the feature service automatically refresh bundles
#
autoRefresh=true
#
# Configuration of features processing mechanism (overrides, blacklisting, modification of features)
# XML file defines instructions related to features processing
# versions.properties may declare properties to resolve placeholders in XML file
# both files are relative to ${karaf.etc}
#
#featureProcessing=org.apache.karaf.features.xml
#featureProcessingVersions=versions.properties
+ configure_karaf_log karaf4 ''
+ local -r karaf_version=karaf4
+ local -r controllerdebugmap=
+ local logapi=log4j
+ grep log4j2 /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
log4j2.rootLogger.level = INFO
#log4j2.rootLogger.type = asyncRoot
#log4j2.rootLogger.includeLocation = false
log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
log4j2.rootLogger.appenderRef.Console.ref = Console
log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
log4j2.logger.spifly.name = org.apache.aries.spifly
log4j2.logger.spifly.level = WARN
log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
log4j2.logger.audit.level = INFO
log4j2.logger.audit.additivity = false
log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
# Console appender not used by default (see log4j2.rootLogger.appenderRefs)
log4j2.appender.console.type = Console
log4j2.appender.console.name = Console
log4j2.appender.console.layout.type = PatternLayout
log4j2.appender.console.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.type = RollingRandomAccessFile
log4j2.appender.rolling.name = RollingFile
log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
#log4j2.appender.rolling.immediateFlush = false
log4j2.appender.rolling.append = true
log4j2.appender.rolling.layout.type = PatternLayout
log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.policies.type = Policies
log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.rolling.policies.size.size = 64MB
log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
log4j2.appender.rolling.strategy.max = 7
log4j2.appender.audit.type = RollingRandomAccessFile
log4j2.appender.audit.name = AuditRollingFile
log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
log4j2.appender.audit.append = true
log4j2.appender.audit.layout.type = PatternLayout
log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
log4j2.appender.audit.policies.type = Policies
log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.audit.policies.size.size = 8MB
log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
log4j2.appender.audit.strategy.max = 7
log4j2.appender.osgi.type = PaxOsgi
log4j2.appender.osgi.name = PaxOsgi
log4j2.appender.osgi.filter = *
#log4j2.logger.aether.name = shaded.org.eclipse.aether
#log4j2.logger.aether.level = TRACE
#log4j2.logger.http-headers.name = shaded.org.apache.http.headers
#log4j2.logger.http-headers.level = DEBUG
#log4j2.logger.maven.name = org.ops4j.pax.url.mvn
#log4j2.logger.maven.level = TRACE
+ logapi=log4j2
Configuring the karaf log... karaf_version: karaf4, logapi: log4j2
+ echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2'
+ '[' log4j2 == log4j2 ']'
+ sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
+ orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver
+ orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver
+ echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN'
controllerdebugmap:
+ echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN'
+ unset IFS
+ echo 'controllerdebugmap: '
+ '[' -n '' ']'
cat /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
+ echo 'cat /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg'
+ cat /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
################################################################################
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
################################################################################
# Common pattern layout for appenders
log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
# Root logger
log4j2.rootLogger.level = INFO
# uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library
#log4j2.rootLogger.type = asyncRoot
#log4j2.rootLogger.includeLocation = false
log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
log4j2.rootLogger.appenderRef.Console.ref = Console
log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
# Filters for logs marked by org.opendaylight.odlparent.Markers
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
# Loggers configuration
# Spifly logger
log4j2.logger.spifly.name = org.apache.aries.spifly
log4j2.logger.spifly.level = WARN
# Security audit logger
log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
log4j2.logger.audit.level = INFO
log4j2.logger.audit.additivity = false
log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
# Appenders configuration
# Console appender not used by default (see log4j2.rootLogger.appenderRefs)
log4j2.appender.console.type = Console
log4j2.appender.console.name = Console
log4j2.appender.console.layout.type = PatternLayout
log4j2.appender.console.layout.pattern = ${log4j2.pattern}
# Rolling file appender
log4j2.appender.rolling.type = RollingRandomAccessFile
log4j2.appender.rolling.name = RollingFile
log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
# uncomment to not force a disk flush
#log4j2.appender.rolling.immediateFlush = false
log4j2.appender.rolling.append = true
log4j2.appender.rolling.layout.type = PatternLayout
log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.policies.type = Policies
log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.rolling.policies.size.size = 1GB
log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
log4j2.appender.rolling.strategy.max = 7
# Audit file appender
log4j2.appender.audit.type = RollingRandomAccessFile
log4j2.appender.audit.name = AuditRollingFile
log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
log4j2.appender.audit.append = true
log4j2.appender.audit.layout.type = PatternLayout
log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
log4j2.appender.audit.policies.type = Policies
log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.audit.policies.size.size = 8MB
log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
log4j2.appender.audit.strategy.max = 7
# OSGi appender
log4j2.appender.osgi.type = PaxOsgi
log4j2.appender.osgi.name = PaxOsgi
log4j2.appender.osgi.filter = *
# help with identification of maven-related problems with pax-url-aether
#log4j2.logger.aether.name = shaded.org.eclipse.aether
#log4j2.logger.aether.level = TRACE
#log4j2.logger.http-headers.name = shaded.org.apache.http.headers
#log4j2.logger.http-headers.level = DEBUG
#log4j2.logger.maven.name = org.ops4j.pax.url.mvn
#log4j2.logger.maven.level = TRACE
log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN
log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN
+ set_java_vars /usr/lib/jvm/java-21-openjdk-amd64 3072m /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv
+ local -r java_home=/usr/lib/jvm/java-21-openjdk-amd64
+ local -r controllermem=3072m
+ local -r memconf=/tmp/karaf-0.21.4-SNAPSHOT/bin/setenv
Configure
java home: /usr/lib/jvm/java-21-openjdk-amd64
max memory: 3072m
memconf: /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv
+ echo Configure
+ echo ' java home: /usr/lib/jvm/java-21-openjdk-amd64'
+ echo ' max memory: 3072m'
+ echo ' memconf: /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv'
+ sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64}%g' /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv
+ sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv
cat /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv
+ echo 'cat /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv'
+ cat /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv
#!/bin/sh
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
#
# handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf
# script: client, instance, shell, start, status, stop, karaf
#
# if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then
# Actions go here...
# fi
#
# general settings which should be applied for all scripts go here; please keep
# in mind that it is possible that scripts might be executed more than once, e.g.
# in example of the start script where the start script is executed first and the
# karaf script afterwards.
#
#
# The following section shows the possible configuration options for the default
# karaf scripts
#
export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64} # Location of Java installation
# export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration
# export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options
# export EXTRA_JAVA_OPTS # Additional JVM options
# export KARAF_HOME # Karaf home folder
# export KARAF_DATA # Karaf data folder
# export KARAF_BASE # Karaf base folder
# export KARAF_ETC # Karaf etc folder
# export KARAF_LOG # Karaf log folder
# export KARAF_SYSTEM_OPTS # First citizen Karaf options
# export KARAF_OPTS # Additional available Karaf options
# export KARAF_DEBUG # Enable debug mode
# export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start
# export KARAF_NOROOT # Prevent execution as root if set to true
Set Java version
+ echo 'Set Java version'
+ sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-21-openjdk-amd64/bin/java 1
sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper
sudo: a password is required
+ sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-21-openjdk-amd64/bin/java
sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper
sudo: a password is required
JDK default version ...
+ echo 'JDK default version ...'
+ java -version
openjdk version "21.0.9" 2025-10-21
OpenJDK Runtime Environment (build 21.0.9+10-Ubuntu-122.04)
OpenJDK 64-Bit Server VM (build 21.0.9+10-Ubuntu-122.04, mixed mode, sharing)
Set JAVA_HOME
+ echo 'Set JAVA_HOME'
+ export JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64
+ JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64
++ readlink -e /usr/lib/jvm/java-21-openjdk-amd64/bin/java
Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java
+ JAVA_RESOLVED=/usr/lib/jvm/java-21-openjdk-amd64/bin/java
+ echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java'
Listing all open ports on controller system...
+ echo 'Listing all open ports on controller system...'
+ netstat -pnatu
/tmp/configuration-script.sh: line 40: netstat: command not found
Custom shard config exists!!!
Copying the shard config...
+ '[' -f /tmp/custom_shard_config.txt ']'
+ echo 'Custom shard config exists!!!'
+ echo 'Copying the shard config...'
+ cp /tmp/custom_shard_config.txt /tmp/karaf-0.21.4-SNAPSHOT/bin/
Configuring cluster
+ echo 'Configuring cluster'
+ /tmp/karaf-0.21.4-SNAPSHOT/bin/configure_cluster.sh 2 10.30.171.69 10.30.170.77 10.30.171.81
################################################
## Configure Cluster ##
################################################
NOTE: Cluster configuration files not found. Copying from
/tmp/karaf-0.21.4-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/10.0.14
Configuring unique name in akka.conf
Configuring hostname in akka.conf
Configuring data and rpc seed nodes in akka.conf
modules = [
{
name = "inventory"
namespace = "urn:opendaylight:inventory"
shard-strategy = "module"
},
{
name = "topology"
namespace = "urn:TBD:params:xml:ns:yang:network-topology"
shard-strategy = "module"
},
{
name = "toaster"
namespace = "http://netconfcentral.org/ns/toaster"
shard-strategy = "module"
},
{
name = "car"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
shard-strategy = "module"
},
{
name = "people"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
shard-strategy = "module"
},
{
name = "car-people"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
shard-strategy = "module"
}
]
Configuring replication type in module-shards.conf
################################################
## NOTE: Manually restart controller to ##
## apply configuration. ##
################################################
Dump akka.conf
+ echo 'Dump akka.conf'
+ cat /tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/akka.conf
odl-cluster-data {
akka {
remote {
artery {
enabled = on
transport = tcp
canonical.hostname = "10.30.170.77"
canonical.port = 2550
}
}
cluster {
# Using artery.
seed-nodes = ["akka://opendaylight-cluster-data@10.30.171.69:2550",
"akka://opendaylight-cluster-data@10.30.170.77:2550",
"akka://opendaylight-cluster-data@10.30.171.81:2550"]
roles = ["member-2"]
# when under load we might trip a false positive on the failure detector
# failure-detector {
# heartbeat-interval = 4 s
# acceptable-heartbeat-pause = 16s
# }
}
persistence {
# By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by
# modifying the following two properties. The directory location specified may be a relative or absolute path.
# The relative path is always relative to KARAF_HOME.
# snapshot-store.local.dir = "target/snapshots"
# Use lz4 compression for LocalSnapshotStore snapshots
snapshot-store.local.use-lz4-compression = false
# Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB
snapshot-store.local.lz4-blocksize = 256KB
}
disable-default-actor-system-quarantined-event-handling = "false"
}
}
Dump modules.conf
+ echo 'Dump modules.conf'
+ cat /tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/modules.conf
modules = [
{
name = "inventory"
namespace = "urn:opendaylight:inventory"
shard-strategy = "module"
},
{
name = "topology"
namespace = "urn:TBD:params:xml:ns:yang:network-topology"
shard-strategy = "module"
},
{
name = "toaster"
namespace = "http://netconfcentral.org/ns/toaster"
shard-strategy = "module"
},
{
name = "car"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
shard-strategy = "module"
},
{
name = "people"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
shard-strategy = "module"
},
{
name = "car-people"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
shard-strategy = "module"
}
]
Dump module-shards.conf
+ echo 'Dump module-shards.conf'
+ cat /tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/module-shards.conf
module-shards = [
{
name = "default"
shards = [
{
name = "default"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "inventory"
shards = [
{
name="inventory"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "topology"
shards = [
{
name="topology"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "toaster"
shards = [
{
name="toaster"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "car"
shards = [
{
name="car"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "people"
shards = [
{
name="people"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "car-people"
shards = [
{
name="car-people"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
}
]
Configuring member-3 with IP address 10.30.171.81
Warning: Permanently added '10.30.171.81' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.171.81' (ECDSA) to the list of known hosts.
+ source /tmp/common-functions.sh karaf-0.21.4-SNAPSHOT scandium
++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]]
common-functions.sh is being sourced
++ echo 'common-functions.sh is being sourced'
++ BUNDLEFOLDER=karaf-0.21.4-SNAPSHOT
++ DISTROSTREAM=scandium
++ export MAVENCONF=/tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
++ MAVENCONF=/tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
++ export FEATURESCONF=/tmp/karaf-0.21.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
++ FEATURESCONF=/tmp/karaf-0.21.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
++ export CUSTOMPROP=/tmp/karaf-0.21.4-SNAPSHOT/etc/custom.properties
++ CUSTOMPROP=/tmp/karaf-0.21.4-SNAPSHOT/etc/custom.properties
++ export LOGCONF=/tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
++ LOGCONF=/tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
++ export MEMCONF=/tmp/karaf-0.21.4-SNAPSHOT/bin/setenv
++ MEMCONF=/tmp/karaf-0.21.4-SNAPSHOT/bin/setenv
++ export CONTROLLERMEM=
++ CONTROLLERMEM=
++ case "${DISTROSTREAM}" in
++ CLUSTER_SYSTEM=akka
++ export AKKACONF=/tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/akka.conf
++ AKKACONF=/tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/akka.conf
++ export MODULESCONF=/tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/modules.conf
++ MODULESCONF=/tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/modules.conf
++ export MODULESHARDSCONF=/tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/module-shards.conf
++ MODULESHARDSCONF=/tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/module-shards.conf
++ print_common_env
++ cat
common-functions environment:
MAVENCONF: /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
ACTUALFEATURES:
FEATURESCONF: /tmp/karaf-0.21.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
CUSTOMPROP: /tmp/karaf-0.21.4-SNAPSHOT/etc/custom.properties
LOGCONF: /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
MEMCONF: /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv
CONTROLLERMEM:
AKKACONF: /tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/akka.conf
MODULESCONF: /tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/modules.conf
MODULESHARDSCONF: /tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/module-shards.conf
SUITES:
++ SSH='ssh -t -t'
++ extra_services_cntl=' dnsmasq.service httpd.service libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service rabbitmq-server.service '
++ extra_services_cmp=' libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service '
Changing to /tmp
Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.4-SNAPSHOT/karaf-0.21.4-20260126.212650-540.zip
+ echo 'Changing to /tmp'
+ cd /tmp
+ echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.4-SNAPSHOT/karaf-0.21.4-20260126.212650-540.zip'
+ wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.4-SNAPSHOT/karaf-0.21.4-20260126.212650-540.zip
--2026-01-26 23:07:57-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.4-SNAPSHOT/karaf-0.21.4-20260126.212650-540.zip
Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6
Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 239811461 (229M) [application/zip]
Saving to: ‘karaf-0.21.4-20260126.212650-540.zip’
0K ........ ........ ........ ........ ........ ........ 1% 106M 2s
3072K ........ ........ ........ ........ ........ ........ 2% 190M 2s
6144K ........ ........ ........ ........ ........ ........ 3% 176M 1s
9216K ........ ........ ........ ........ ........ ........ 5% 158M 1s
12288K ........ ........ ........ ........ ........ ........ 6% 143M 1s
15360K ........ ........ ........ ........ ........ ........ 7% 211M 1s
18432K ........ ........ ........ ........ ........ ........ 9% 200M 1s
21504K ........ ........ ........ ........ ........ ........ 10% 236M 1s
24576K ........ ........ ........ ........ ........ ........ 11% 261M 1s
27648K ........ ........ ........ ........ ........ ........ 13% 238M 1s
30720K ........ ........ ........ ........ ........ ........ 14% 282M 1s
33792K ........ ........ ........ ........ ........ ........ 15% 308M 1s
36864K ........ ........ ........ ........ ........ ........ 17% 307M 1s
39936K ........ ........ ........ ........ ........ ........ 18% 257M 1s
43008K ........ ........ ........ ........ ........ ........ 19% 205M 1s
46080K ........ ........ ........ ........ ........ ........ 20% 308M 1s
49152K ........ ........ ........ ........ ........ ........ 22% 301M 1s
52224K ........ ........ ........ ........ ........ ........ 23% 269M 1s
55296K ........ ........ ........ ........ ........ ........ 24% 260M 1s
58368K ........ ........ ........ ........ ........ ........ 26% 307M 1s
61440K ........ ........ ........ ........ ........ ........ 27% 413M 1s
64512K ........ ........ ........ ........ ........ ........ 28% 343M 1s
67584K ........ ........ ........ ........ ........ ........ 30% 325M 1s
70656K ........ ........ ........ ........ ........ ........ 31% 332M 1s
73728K ........ ........ ........ ........ ........ ........ 32% 268M 1s
76800K ........ ........ ........ ........ ........ ........ 34% 347M 1s
79872K ........ ........ ........ ........ ........ ........ 35% 309M 1s
82944K ........ ........ ........ ........ ........ ........ 36% 285M 1s
86016K ........ ........ ........ ........ ........ ........ 38% 290M 1s
89088K ........ ........ ........ ........ ........ ........ 39% 202M 1s
92160K ........ ........ ........ ........ ........ ........ 40% 321M 1s
95232K ........ ........ ........ ........ ........ ........ 41% 402M 1s
98304K ........ ........ ........ ........ ........ ........ 43% 283M 1s
101376K ........ ........ ........ ........ ........ ........ 44% 334M 1s
104448K ........ ........ ........ ........ ........ ........ 45% 348M 0s
107520K ........ ........ ........ ........ ........ ........ 47% 208M 0s
110592K ........ ........ ........ ........ ........ ........ 48% 293M 0s
113664K ........ ........ ........ ........ ........ ........ 49% 363M 0s
116736K ........ ........ ........ ........ ........ ........ 51% 406M 0s
119808K ........ ........ ........ ........ ........ ........ 52% 395M 0s
122880K ........ ........ ........ ........ ........ ........ 53% 273M 0s
125952K ........ ........ ........ ........ ........ ........ 55% 294M 0s
129024K ........ ........ ........ ........ ........ ........ 56% 395M 0s
132096K ........ ........ ........ ........ ........ ........ 57% 287M 0s
135168K ........ ........ ........ ........ ........ ........ 59% 329M 0s
138240K ........ ........ ........ ........ ........ ........ 60% 319M 0s
141312K ........ ........ ........ ........ ........ ........ 61% 268M 0s
144384K ........ ........ ........ ........ ........ ........ 62% 257M 0s
147456K ........ ........ ........ ........ ........ ........ 64% 365M 0s
150528K ........ ........ ........ ........ ........ ........ 65% 333M 0s
153600K ........ ........ ........ ........ ........ ........ 66% 235M 0s
156672K ........ ........ ........ ........ ........ ........ 68% 205M 0s
159744K ........ ........ ........ ........ ........ ........ 69% 303M 0s
162816K ........ ........ ........ ........ ........ ........ 70% 422M 0s
165888K ........ ........ ........ ........ ........ ........ 72% 309M 0s
168960K ........ ........ ........ ........ ........ ........ 73% 350M 0s
172032K ........ ........ ........ ........ ........ ........ 74% 324M 0s
175104K ........ ........ ........ ........ ........ ........ 76% 352M 0s
178176K ........ ........ ........ ........ ........ ........ 77% 321M 0s
181248K ........ ........ ........ ........ ........ ........ 78% 232M 0s
184320K ........ ........ ........ ........ ........ ........ 80% 249M 0s
187392K ........ ........ ........ ........ ........ ........ 81% 370M 0s
190464K ........ ........ ........ ........ ........ ........ 82% 364M 0s
193536K ........ ........ ........ ........ ........ ........ 83% 361M 0s
196608K ........ ........ ........ ........ ........ ........ 85% 351M 0s
199680K ........ ........ ........ ........ ........ ........ 86% 275M 0s
202752K ........ ........ ........ ........ ........ ........ 87% 232M 0s
205824K ........ ........ ........ ........ ........ ........ 89% 331M 0s
208896K ........ ........ ........ ........ ........ ........ 90% 384M 0s
211968K ........ ........ ........ ........ ........ ........ 91% 292M 0s
215040K ........ ........ ........ ........ ........ ........ 93% 347M 0s
218112K ........ ........ ........ ........ ........ ........ 94% 313M 0s
221184K ........ ........ ........ ........ ........ ........ 95% 284M 0s
224256K ........ ........ ........ ........ ........ ........ 97% 263M 0s
227328K ........ ........ ........ ........ ........ ........ 98% 268M 0s
230400K ........ ........ ........ ........ ........ ........ 99% 355M 0s
233472K ........ ... 100% 339M=0.8s
2026-01-26 23:07:58 (277 MB/s) - ‘karaf-0.21.4-20260126.212650-540.zip’ saved [239811461/239811461]
Extracting the new controller...
+ echo 'Extracting the new controller...'
+ unzip -q karaf-0.21.4-20260126.212650-540.zip
Adding external repositories...
+ echo 'Adding external repositories...'
+ sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
+ cat /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
################################################################################
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
################################################################################
#
# If set to true, the following property will not allow any certificate to be used
# when accessing Maven repositories through SSL
#
#org.ops4j.pax.url.mvn.certificateCheck=
#
# Path to the local Maven settings file.
# The repositories defined in this file will be automatically added to the list
# of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property
# below is not set.
# The following locations are checked for the existence of the settings.xml file
# * 1. looks for the specified url
# * 2. if not found looks for ${user.home}/.m2/settings.xml
# * 3. if not found looks for ${maven.home}/conf/settings.xml
# * 4. if not found looks for ${M2_HOME}/conf/settings.xml
#
#org.ops4j.pax.url.mvn.settings=
#
# Path to the local Maven repository which is used to avoid downloading
# artifacts when they already exist locally.
# The value of this property will be extracted from the settings.xml file
# above, or defaulted to:
# System.getProperty( "user.home" ) + "/.m2/repository"
#
org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository}
#
# Default this to false. It's just weird to use undocumented repos
#
org.ops4j.pax.url.mvn.useFallbackRepositories=false
#
# Uncomment if you don't wanna use the proxy settings
# from the Maven conf/settings.xml file
#
# org.ops4j.pax.url.mvn.proxySupport=false
#
# Comma separated list of repositories scanned when resolving an artifact.
# Those repositories will be checked before iterating through the
# below list of repositories and even before the local repository
# A repository url can be appended with zero or more of the following flags:
# @snapshots : the repository contains snaphots
# @noreleases : the repository does not contain any released artifacts
#
# The following property value will add the system folder as a repo.
#
org.ops4j.pax.url.mvn.defaultRepositories=\
file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\
file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\
file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots
# Use the default local repo (e.g.~/.m2/repository) as a "remote" repo
#org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false
#
# Comma separated list of repositories scanned when resolving an artifact.
# The default list includes the following repositories:
# http://repo1.maven.org/maven2@id=central
# http://repository.springsource.com/maven/bundles/release@id=spring.ebr
# http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external
# http://zodiac.springsource.com/maven/bundles/release@id=gemini
# http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases
# https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases
# https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
# To add repositories to the default ones, prepend '+' to the list of repositories
# to add.
# A repository url can be appended with zero or more of the following flags:
# @snapshots : the repository contains snapshots
# @noreleases : the repository does not contain any released artifacts
# @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended
#
org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.+ [[ True == \T\r\u\e ]]
+ echo 'Configuring the startup features...'
Configuring the startup features...
+ sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.21.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
+ FEATURE_TEST_STRING=features-test
+ FEATURE_TEST_VERSION=0.21.4-SNAPSHOT
+ KARAF_VERSION=karaf4
+ [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]]
+ sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.21.4-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.21.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
+ [[ ! -z '' ]]
+ cat /tmp/karaf-0.21.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
################################################################################
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
################################################################################
#
# Comma separated list of features repositories to register by default
#
featuresRepositories = mvn:org.opendaylight.integration/features-test/0.21.4-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/7f68dd39-34cc-4efc-8cc8-cfcdf355b893.xml
#
# Comma separated list of features to install at startup
#
featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, 21808cfe-e671-4908-a89a-6f0909233b41
#
# Resource repositories (OBR) that the features resolver can use
# to resolve requirements/capabilities
#
# The format of the resourceRepositories is
# resourceRepositories=[xml:url|json:url],...
# for Instance:
#
#resourceRepositories=xml:http://host/path/to/index.xml
# or
#resourceRepositories=json:http://host/path/to/index.json
#
#
# Defines if the boot features are started in asynchronous mode (in a dedicated thread)
#
featuresBootAsynchronous=false
#
# Service requirements enforcement
#
# By default, the feature resolver checks the service requirements/capabilities of
# bundles for new features (xml schema >= 1.3.0) in order to automatically installs
# the required bundles.
# The following flag can have those values:
# - disable: service requirements are completely ignored
# - default: service requirements are ignored for old features
# - enforce: service requirements are always verified
#
#serviceRequirements=default
#
# Store cfg file for config element in feature
#
#configCfgStore=true
#
# Define if the feature service automatically refresh bundles
#
autoRefresh=true
#
# Configuration of features processing mechanism (overrides, blacklisting, modification of features)
# XML file defines instructions related to features processing
# versions.properties may declare properties to resolve placeholders in XML file
# both files are relative to ${karaf.etc}
#
#featureProcessing=org.apache.karaf.features.xml
#featureProcessingVersions=versions.properties
+ configure_karaf_log karaf4 ''
+ local -r karaf_version=karaf4
+ local -r controllerdebugmap=
+ local logapi=log4j
+ grep log4j2 /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
log4j2.rootLogger.level = INFO
#log4j2.rootLogger.type = asyncRoot
#log4j2.rootLogger.includeLocation = false
log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
log4j2.rootLogger.appenderRef.Console.ref = Console
log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
log4j2.logger.spifly.name = org.apache.aries.spifly
log4j2.logger.spifly.level = WARN
log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
log4j2.logger.audit.level = INFO
log4j2.logger.audit.additivity = false
log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
# Console appender not used by default (see log4j2.rootLogger.appenderRefs)
log4j2.appender.console.type = Console
log4j2.appender.console.name = Console
log4j2.appender.console.layout.type = PatternLayout
log4j2.appender.console.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.type = RollingRandomAccessFile
log4j2.appender.rolling.name = RollingFile
log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
#log4j2.appender.rolling.immediateFlush = false
log4j2.appender.rolling.append = true
log4j2.appender.rolling.layout.type = PatternLayout
log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.policies.type = Policies
log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.rolling.policies.size.size = 64MB
log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
log4j2.appender.rolling.strategy.max = 7
log4j2.appender.audit.type = RollingRandomAccessFile
log4j2.appender.audit.name = AuditRollingFile
log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
log4j2.appender.audit.append = true
log4j2.appender.audit.layout.type = PatternLayout
log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
log4j2.appender.audit.policies.type = Policies
log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.audit.policies.size.size = 8MB
log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
log4j2.appender.audit.strategy.max = 7
log4j2.appender.osgi.type = PaxOsgi
log4j2.appender.osgi.name = PaxOsgi
log4j2.appender.osgi.filter = *
#log4j2.logger.aether.name = shaded.org.eclipse.aether
#log4j2.logger.aether.level = TRACE
#log4j2.logger.http-headers.name = shaded.org.apache.http.headers
#log4j2.logger.http-headers.level = DEBUG
#log4j2.logger.maven.name = org.ops4j.pax.url.mvn
#log4j2.logger.maven.level = TRACE
Configuring the karaf log... karaf_version: karaf4, logapi: log4j2
+ logapi=log4j2
+ echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2'
+ '[' log4j2 == log4j2 ']'
+ sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
+ orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver
+ orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver
+ echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN'
+ echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN'
controllerdebugmap:
cat /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
+ unset IFS
+ echo 'controllerdebugmap: '
+ '[' -n '' ']'
+ echo 'cat /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg'
+ cat /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
################################################################################
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
################################################################################
# Common pattern layout for appenders
log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
# Root logger
log4j2.rootLogger.level = INFO
# uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library
#log4j2.rootLogger.type = asyncRoot
#log4j2.rootLogger.includeLocation = false
log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
log4j2.rootLogger.appenderRef.Console.ref = Console
log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
# Filters for logs marked by org.opendaylight.odlparent.Markers
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
# Loggers configuration
# Spifly logger
log4j2.logger.spifly.name = org.apache.aries.spifly
log4j2.logger.spifly.level = WARN
# Security audit logger
log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
log4j2.logger.audit.level = INFO
log4j2.logger.audit.additivity = false
log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
# Appenders configuration
# Console appender not used by default (see log4j2.rootLogger.appenderRefs)
log4j2.appender.console.type = Console
log4j2.appender.console.name = Console
log4j2.appender.console.layout.type = PatternLayout
log4j2.appender.console.layout.pattern = ${log4j2.pattern}
# Rolling file appender
log4j2.appender.rolling.type = RollingRandomAccessFile
log4j2.appender.rolling.name = RollingFile
log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
# uncomment to not force a disk flush
#log4j2.appender.rolling.immediateFlush = false
log4j2.appender.rolling.append = true
log4j2.appender.rolling.layout.type = PatternLayout
log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.policies.type = Policies
log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.rolling.policies.size.size = 1GB
log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
log4j2.appender.rolling.strategy.max = 7
# Audit file appender
log4j2.appender.audit.type = RollingRandomAccessFile
log4j2.appender.audit.name = AuditRollingFile
log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
log4j2.appender.audit.append = true
log4j2.appender.audit.layout.type = PatternLayout
log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
log4j2.appender.audit.policies.type = Policies
log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.audit.policies.size.size = 8MB
log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
log4j2.appender.audit.strategy.max = 7
# OSGi appender
log4j2.appender.osgi.type = PaxOsgi
log4j2.appender.osgi.name = PaxOsgi
log4j2.appender.osgi.filter = *
# help with identification of maven-related problems with pax-url-aether
#log4j2.logger.aether.name = shaded.org.eclipse.aether
#log4j2.logger.aether.level = TRACE
#log4j2.logger.http-headers.name = shaded.org.apache.http.headers
#log4j2.logger.http-headers.level = DEBUG
#log4j2.logger.maven.name = org.ops4j.pax.url.mvn
#log4j2.logger.maven.level = TRACE
log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN
log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN
+ set_java_vars /usr/lib/jvm/java-21-openjdk-amd64 3072m /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv
Configure
java home: /usr/lib/jvm/java-21-openjdk-amd64
max memory: 3072m
memconf: /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv
+ local -r java_home=/usr/lib/jvm/java-21-openjdk-amd64
+ local -r controllermem=3072m
+ local -r memconf=/tmp/karaf-0.21.4-SNAPSHOT/bin/setenv
+ echo Configure
+ echo ' java home: /usr/lib/jvm/java-21-openjdk-amd64'
+ echo ' max memory: 3072m'
+ echo ' memconf: /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv'
+ sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64}%g' /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv
+ sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv
cat /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv
+ echo 'cat /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv'
+ cat /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv
#!/bin/sh
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
#
# handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf
# script: client, instance, shell, start, status, stop, karaf
#
# if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then
# Actions go here...
# fi
#
# general settings which should be applied for all scripts go here; please keep
# in mind that it is possible that scripts might be executed more than once, e.g.
# in example of the start script where the start script is executed first and the
# karaf script afterwards.
#
#
# The following section shows the possible configuration options for the default
# karaf scripts
#
export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64} # Location of Java installation
# export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration
# export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options
# export EXTRA_JAVA_OPTS # Additional JVM options
# export KARAF_HOME # Karaf home folder
# export KARAF_DATA # Karaf data folder
# export KARAF_BASE # Karaf base folder
# export KARAF_ETC # Karaf etc folder
# export KARAF_LOG # Karaf log folder
# export KARAF_SYSTEM_OPTS # First citizen Karaf options
# export KARAF_OPTS # Additional available Karaf options
# export KARAF_DEBUG # Enable debug mode
# export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start
# export KARAF_NOROOT # Prevent execution as root if set to true
Set Java version
+ echo 'Set Java version'
+ sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-21-openjdk-amd64/bin/java 1
sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper
sudo: a password is required
+ sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-21-openjdk-amd64/bin/java
sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper
sudo: a password is required
JDK default version ...
+ echo 'JDK default version ...'
+ java -version
openjdk version "21.0.9" 2025-10-21
OpenJDK Runtime Environment (build 21.0.9+10-Ubuntu-122.04)
OpenJDK 64-Bit Server VM (build 21.0.9+10-Ubuntu-122.04, mixed mode, sharing)
Set JAVA_HOME
+ echo 'Set JAVA_HOME'
+ export JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64
+ JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64
++ readlink -e /usr/lib/jvm/java-21-openjdk-amd64/bin/java
Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java
+ JAVA_RESOLVED=/usr/lib/jvm/java-21-openjdk-amd64/bin/java
+ echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java'
Listing all open ports on controller system...
+ echo 'Listing all open ports on controller system...'
+ netstat -pnatu
/tmp/configuration-script.sh: line 40: netstat: command not found
+ '[' -f /tmp/custom_shard_config.txt ']'
+ echo 'Custom shard config exists!!!'
Custom shard config exists!!!
Copying the shard config...
+ echo 'Copying the shard config...'
+ cp /tmp/custom_shard_config.txt /tmp/karaf-0.21.4-SNAPSHOT/bin/
Configuring cluster
+ echo 'Configuring cluster'
+ /tmp/karaf-0.21.4-SNAPSHOT/bin/configure_cluster.sh 3 10.30.171.69 10.30.170.77 10.30.171.81
################################################
## Configure Cluster ##
################################################
NOTE: Cluster configuration files not found. Copying from
/tmp/karaf-0.21.4-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/10.0.14
Configuring unique name in akka.conf
Configuring hostname in akka.conf
Configuring data and rpc seed nodes in akka.conf
modules = [
{
name = "inventory"
namespace = "urn:opendaylight:inventory"
shard-strategy = "module"
},
{
name = "topology"
namespace = "urn:TBD:params:xml:ns:yang:network-topology"
shard-strategy = "module"
},
{
name = "toaster"
namespace = "http://netconfcentral.org/ns/toaster"
shard-strategy = "module"
},
{
name = "car"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
shard-strategy = "module"
},
{
name = "people"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
shard-strategy = "module"
},
{
name = "car-people"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
shard-strategy = "module"
}
]
Configuring replication type in module-shards.conf
################################################
## NOTE: Manually restart controller to ##
## apply configuration. ##
################################################
Dump akka.conf
+ echo 'Dump akka.conf'
+ cat /tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/akka.conf
odl-cluster-data {
akka {
remote {
artery {
enabled = on
transport = tcp
canonical.hostname = "10.30.171.81"
canonical.port = 2550
}
}
cluster {
# Using artery.
seed-nodes = ["akka://opendaylight-cluster-data@10.30.171.69:2550",
"akka://opendaylight-cluster-data@10.30.170.77:2550",
"akka://opendaylight-cluster-data@10.30.171.81:2550"]
roles = ["member-3"]
# when under load we might trip a false positive on the failure detector
# failure-detector {
# heartbeat-interval = 4 s
# acceptable-heartbeat-pause = 16s
# }
}
persistence {
# By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by
# modifying the following two properties. The directory location specified may be a relative or absolute path.
# The relative path is always relative to KARAF_HOME.
# snapshot-store.local.dir = "target/snapshots"
# Use lz4 compression for LocalSnapshotStore snapshots
snapshot-store.local.use-lz4-compression = false
# Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB
snapshot-store.local.lz4-blocksize = 256KB
}
disable-default-actor-system-quarantined-event-handling = "false"
}
}
Dump modules.conf
+ echo 'Dump modules.conf'
+ cat /tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/modules.conf
modules = [
{
name = "inventory"
namespace = "urn:opendaylight:inventory"
shard-strategy = "module"
},
{
name = "topology"
namespace = "urn:TBD:params:xml:ns:yang:network-topology"
shard-strategy = "module"
},
{
name = "toaster"
namespace = "http://netconfcentral.org/ns/toaster"
shard-strategy = "module"
},
{
name = "car"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
shard-strategy = "module"
},
{
name = "people"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
shard-strategy = "module"
},
{
name = "car-people"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
shard-strategy = "module"
}
]
Dump module-shards.conf
+ echo 'Dump module-shards.conf'
+ cat /tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/module-shards.conf
module-shards = [
{
name = "default"
shards = [
{
name = "default"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "inventory"
shards = [
{
name="inventory"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "topology"
shards = [
{
name="topology"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "toaster"
shards = [
{
name="toaster"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "car"
shards = [
{
name="car"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "people"
shards = [
{
name="people"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "car-people"
shards = [
{
name="car-people"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
}
]
Locating config plan to use...
Finished running config plans
Starting member-1 with IP address 10.30.171.69
Warning: Permanently added '10.30.171.69' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.171.69' (ECDSA) to the list of known hosts.
Redirecting karaf console output to karaf_console.log
Starting controller...
start: Redirecting Karaf output to /tmp/karaf-0.21.4-SNAPSHOT/data/log/karaf_console.log
Starting member-2 with IP address 10.30.170.77
Warning: Permanently added '10.30.170.77' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.170.77' (ECDSA) to the list of known hosts.
Redirecting karaf console output to karaf_console.log
Starting controller...
start: Redirecting Karaf output to /tmp/karaf-0.21.4-SNAPSHOT/data/log/karaf_console.log
Starting member-3 with IP address 10.30.171.81
Warning: Permanently added '10.30.171.81' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.171.81' (ECDSA) to the list of known hosts.
Redirecting karaf console output to karaf_console.log
Starting controller...
start: Redirecting Karaf output to /tmp/karaf-0.21.4-SNAPSHOT/data/log/karaf_console.log
[controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins2048181085262546984.sh
common-functions.sh is being sourced
common-functions environment:
MAVENCONF: /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
ACTUALFEATURES:
FEATURESCONF: /tmp/karaf-0.21.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
CUSTOMPROP: /tmp/karaf-0.21.4-SNAPSHOT/etc/custom.properties
LOGCONF: /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
MEMCONF: /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv
CONTROLLERMEM: 2048m
AKKACONF: /tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/akka.conf
MODULESCONF: /tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/modules.conf
MODULESHARDSCONF: /tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/module-shards.conf
SUITES:
+ echo '#################################################'
#################################################
+ echo '## Verify Cluster is UP ##'
## Verify Cluster is UP ##
+ echo '#################################################'
#################################################
+ create_post_startup_script
+ cat
+ copy_and_run_post_startup_script
+ seed_index=1
++ seq 1 3
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_1_IP
+ echo 'Execute the post startup script on controller 10.30.171.69'
Execute the post startup script on controller 10.30.171.69
+ scp /w/workspace/controller-csit-3node-clustering-tell-all-scandium/post-startup-script.sh 10.30.171.69:/tmp/
Warning: Permanently added '10.30.171.69' (ECDSA) to the list of known hosts.
+ ssh 10.30.171.69 'bash /tmp/post-startup-script.sh 1'
Warning: Permanently added '10.30.171.69' (ECDSA) to the list of known hosts.
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
Waiting up to 3 minutes for controller to come up, checking every 5 seconds...
2026-01-26T23:08:45,330 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 282 - org.opendaylight.infrautils.ready-api - 7.1.7 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
Controller is UP
2026-01-26T23:08:45,330 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 282 - org.opendaylight.infrautils.ready-api - 7.1.7 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
Listing all open ports on controller system...
/tmp/post-startup-script.sh: line 51: netstat: command not found
looking for "BindException: Address already in use" in log file
looking for "server is unhealthy" in log file
+ '[' 1 == 0 ']'
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_2_IP
+ echo 'Execute the post startup script on controller 10.30.170.77'
Execute the post startup script on controller 10.30.170.77
+ scp /w/workspace/controller-csit-3node-clustering-tell-all-scandium/post-startup-script.sh 10.30.170.77:/tmp/
Warning: Permanently added '10.30.170.77' (ECDSA) to the list of known hosts.
+ ssh 10.30.170.77 'bash /tmp/post-startup-script.sh 2'
Warning: Permanently added '10.30.170.77' (ECDSA) to the list of known hosts.
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
Waiting up to 3 minutes for controller to come up, checking every 5 seconds...
2026-01-26T23:08:45,641 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 282 - org.opendaylight.infrautils.ready-api - 7.1.7 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
Controller is UP
2026-01-26T23:08:45,641 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 282 - org.opendaylight.infrautils.ready-api - 7.1.7 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
Listing all open ports on controller system...
/tmp/post-startup-script.sh: line 51: netstat: command not found
looking for "BindException: Address already in use" in log file
looking for "server is unhealthy" in log file
+ '[' 2 == 0 ']'
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_3_IP
+ echo 'Execute the post startup script on controller 10.30.171.81'
Execute the post startup script on controller 10.30.171.81
+ scp /w/workspace/controller-csit-3node-clustering-tell-all-scandium/post-startup-script.sh 10.30.171.81:/tmp/
Warning: Permanently added '10.30.171.81' (ECDSA) to the list of known hosts.
+ ssh 10.30.171.81 'bash /tmp/post-startup-script.sh 3'
Warning: Permanently added '10.30.171.81' (ECDSA) to the list of known hosts.
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
Waiting up to 3 minutes for controller to come up, checking every 5 seconds...
2026-01-26T23:08:45,302 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 282 - org.opendaylight.infrautils.ready-api - 7.1.7 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
Controller is UP
2026-01-26T23:08:45,302 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 282 - org.opendaylight.infrautils.ready-api - 7.1.7 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
Listing all open ports on controller system...
/tmp/post-startup-script.sh: line 51: netstat: command not found
looking for "BindException: Address already in use" in log file
looking for "server is unhealthy" in log file
+ '[' 0 == 0 ']'
+ seed_index=1
+ dump_controller_threads
++ seq 1 3
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_1_IP
+ echo 'Let'\''s take the karaf thread dump'
Let's take the karaf thread dump
+ ssh 10.30.171.69 'sudo ps aux'
Warning: Permanently added '10.30.171.69' (ECDSA) to the list of known hosts.
++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-scandium/ps_before.log
++ grep -v grep
++ cut -f2 '-d '
++ tr -s ' '
+ pid=2110
+ echo 'karaf main: org.apache.karaf.main.Main, pid:2110'
karaf main: org.apache.karaf.main.Main, pid:2110
+ ssh 10.30.171.69 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 2110'
Warning: Permanently added '10.30.171.69' (ECDSA) to the list of known hosts.
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_2_IP
+ echo 'Let'\''s take the karaf thread dump'
Let's take the karaf thread dump
+ ssh 10.30.170.77 'sudo ps aux'
Warning: Permanently added '10.30.170.77' (ECDSA) to the list of known hosts.
++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-scandium/ps_before.log
++ grep -v grep
++ tr -s ' '
++ cut -f2 '-d '
+ pid=2095
+ echo 'karaf main: org.apache.karaf.main.Main, pid:2095'
karaf main: org.apache.karaf.main.Main, pid:2095
+ ssh 10.30.170.77 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 2095'
Warning: Permanently added '10.30.170.77' (ECDSA) to the list of known hosts.
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_3_IP
+ echo 'Let'\''s take the karaf thread dump'
Let's take the karaf thread dump
+ ssh 10.30.171.81 'sudo ps aux'
Warning: Permanently added '10.30.171.81' (ECDSA) to the list of known hosts.
++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-scandium/ps_before.log
++ grep -v grep
++ tr -s ' '
++ cut -f2 '-d '
+ pid=2116
+ echo 'karaf main: org.apache.karaf.main.Main, pid:2116'
karaf main: org.apache.karaf.main.Main, pid:2116
+ ssh 10.30.171.81 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 2116'
Warning: Permanently added '10.30.171.81' (ECDSA) to the list of known hosts.
+ '[' 0 -gt 0 ']'
+ echo 'Generating controller variables...'
Generating controller variables...
++ seq 1 3
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_1_IP
+ odl_variables=' -v ODL_SYSTEM_1_IP:10.30.171.69'
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_2_IP
+ odl_variables=' -v ODL_SYSTEM_1_IP:10.30.171.69 -v ODL_SYSTEM_2_IP:10.30.170.77'
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_3_IP
+ odl_variables=' -v ODL_SYSTEM_1_IP:10.30.171.69 -v ODL_SYSTEM_2_IP:10.30.170.77 -v ODL_SYSTEM_3_IP:10.30.171.81'
+ echo 'Generating mininet variables...'
Generating mininet variables...
++ seq 1 0
+ get_test_suites SUITES
+ local __suite_list=SUITES
+ echo 'Locating test plan to use...'
Locating test plan to use...
+ testplan_filepath=/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/testplans/controller-clustering-tell-scandium.txt
+ '[' '!' -f /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/testplans/controller-clustering-tell-scandium.txt ']'
+ testplan_filepath=/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/testplans/controller-clustering-tell.txt
+ '[' disabled '!=' disabled ']'
+ echo 'Changing the testplan path...'
Changing the testplan path...
+ sed s:integration:/w/workspace/controller-csit-3node-clustering-tell-all-scandium: /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/testplans/controller-clustering-tell.txt
+ cat testplan.txt
# Place the suites in run order:
# disabling all "prefix based" suites. This functionality was newly
# introduced with these tests in 2017. The assumption is that
# development stopped in that area, but may continue at a later
# time. Still, the tests are failing and no resources to solve the
# failures at this time. If/When this changes, we can uncomment
# those suites. Note that every suite is commented out with it's
# accompanying "restart_with_tell_based_true" setup suite.
# /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/ddb-sanity-prefix-based.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown_prefbasedshard.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement_prefbasedshard.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/leader_isolation_prefbasedshard.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/client_isolation.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/client_isolation_prefbasedshard.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/listener_stability.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/listener_stability_prefbasedshard.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/master_stability.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot
+ '[' -z '' ']'
++ grep -E -v '(^[[:space:]]*#|^[[:space:]]*$)' testplan.txt
++ tr '\012' ' '
+ suite_list='/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot '
+ eval 'SUITES='\''/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot '\'''
++ SUITES='/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot '
+ echo 'Starting Robot test suites /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot ...'
Starting Robot test suites /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot ...
+ robot -N controller-clustering-tell.txt --removekeywords wuks -e exclude -e skip_if_scandium -v BUNDLEFOLDER:karaf-0.21.4-SNAPSHOT -v BUNDLE_URL:https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.4-SNAPSHOT/karaf-0.21.4-20260126.212650-540.zip -v CONTROLLER:10.30.171.69 -v CONTROLLER1:10.30.170.77 -v CONTROLLER2:10.30.171.81 -v CONTROLLER_USER:jenkins -v JAVA_HOME:/usr/lib/jvm/java-21-openjdk-amd64 -v JDKVERSION:openjdk21 -v JENKINS_WORKSPACE:/w/workspace/controller-csit-3node-clustering-tell-all-scandium -v MININET: -v MININET1: -v MININET2: -v MININET_USER:jenkins -v NEXUSURL_PREFIX:https://nexus.opendaylight.org -v NUM_ODL_SYSTEM:3 -v NUM_TOOLS_SYSTEM:0 -v ODL_STREAM:scandium -v ODL_SYSTEM_IP:10.30.171.69 -v ODL_SYSTEM_1_IP:10.30.171.69 -v ODL_SYSTEM_2_IP:10.30.170.77 -v ODL_SYSTEM_3_IP:10.30.171.81 -v ODL_SYSTEM_USER:jenkins -v TOOLS_SYSTEM_IP: -v TOOLS_SYSTEM_USER:jenkins -v USER_HOME:/home/jenkins -v IS_KARAF_APPL:True -v WORKSPACE:/tmp /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot
==============================================================================
controller-clustering-tell.txt
==============================================================================
controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
==============================================================================
Stop_All_Members :: Stop every odl node. | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync. | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-tell.txt.Ddb-Sanity-Module-Based :: DOMDataBroker tes...
==============================================================================
Get_Shard_Role :: Get shard role. | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_ddb_sanity_module_based_get_shard_role"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_get_shard_role&order=bug_status"
HTTPError: 404 Client Error: Not Found for url: http://10.30.171.69:8181/restconf/operations/cluster-admin:get-shard-role
------------------------------------------------------------------------------
Subscribe_Listener_To_Leader :: Subscribe listener to leader. | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_ddb_sanity_module_based_subscribe_listener_to_leader"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_subscribe_listener_to_leader&order=bug_status"
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Subscribe_Listener_To_Follower :: Subscribe listener to follower. | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_ddb_sanity_module_based_subscribe_listener_to_follower"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_subscribe_listener_to_follower&order=bug_status"
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Make_Leader_Local :: Make the loeader local and verify. | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_ddb_sanity_module_based_make_leader_local"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_make_leader_local&order=bug_status"
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Remove_Leader_Shard_Replica_And_Add_It_Back :: Remove and add shar... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_ddb_sanity_module_based_remove_leader_shard_replica_and_add_it_back"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_remove_leader_shard_replica_and_add_it_back&order=bug_status"
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Remove_Follower_Shard_Replica_And_Add_It_Back :: Remove and add sh... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_ddb_sanity_module_based_remove_follower_shard_replica_and_add_it_back"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_remove_follower_shard_replica_and_add_it_back&order=bug_status"
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Write_Transactions_One_Node_Leader :: Write transactions. | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_one_node_leader"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_one_node_leader&order=bug_status"
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Write_Transactions_One_Node_Follower :: Write transactions. | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_one_node_follower"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_one_node_follower&order=bug_status"
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Write_Transactions_All_Nodes :: Write transactions. | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_all_nodes"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_all_nodes&order=bug_status"
Resolving variable '${response.text}' failed: AttributeError: 'ReadTimeout' object has no attribute 'text'
------------------------------------------------------------------------------
controller-clustering-tell.txt.Ddb-Sanity-Module-Based :: DOMDataB... | FAIL |
9 tests, 0 passed, 9 failed
==============================================================================
controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
==============================================================================
Stop_All_Members :: Stop every odl node. | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync. | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-tell.txt.Clean Leader Shutdown :: DOMDataBroker testi...
==============================================================================
Local_Leader_Shutdown :: Shutdown the leader on the same node as t... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_clean_leader_shutdown_local_leader_shutdown"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_clean_leader_shutdown_local_leader_shutdown&order=bug_status"
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Restart :: Restart odl | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_clean_leader_shutdown_restart"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_clean_leader_shutdown_restart&order=bug_status"
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Remote_Leader_Shutdown :: Shutdown the leader on different node as... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_clean_leader_shutdown_remote_leader_shutdown"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_clean_leader_shutdown_remote_leader_shutdown&order=bug_status"
ConnectionError: HTTPConnectionPool(host='10.30.171.69', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError("HTTPConnection(host='10.30.171.69', port=8181): Failed to establish a new connection: [Errno 111] Connection refused"))
------------------------------------------------------------------------------
controller-clustering-tell.txt.Clean Leader Shutdown :: DOMDataBro... | FAIL |
3 tests, 0 passed, 3 failed
==============================================================================
controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
==============================================================================
Stop_All_Members :: Stop every odl node. | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync. | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-tell.txt.Explicit Leader Movement :: DOMDataBroker te...
==============================================================================
Local_To_Remote_Movement :: Leader moves from local to remote node... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_explicit_leader_movement_local_to_remote_movement"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_local_to_remote_movement&order=bug_status"
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Restart1 :: Restart odl | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_explicit_leader_movement_restart1"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_restart1&order=bug_status"
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Remote_To_Remote_Movement :: Leader moves from one remote to other... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_explicit_leader_movement_remote_to_remote_movement"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_remote_to_remote_movement&order=bug_status"
ConnectionError: HTTPConnectionPool(host='10.30.171.69', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError("HTTPConnection(host='10.30.171.69', port=8181): Failed to establish a new connection: [Errno 111] Connection refused"))
------------------------------------------------------------------------------
Restart2 :: Restart odl | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_explicit_leader_movement_restart2"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_restart2&order=bug_status"
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Remote_To_Local_Movement :: Leader moves from remote to local node... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_explicit_leader_movement_remote_to_local_movement"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_remote_to_local_movement&order=bug_status"
ConnectionError: HTTPConnectionPool(host='10.30.171.69', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError("HTTPConnection(host='10.30.171.69', port=8181): Failed to establish a new connection: [Errno 111] Connection refused"))
------------------------------------------------------------------------------
controller-clustering-tell.txt.Explicit Leader Movement :: DOMData... | FAIL |
5 tests, 0 passed, 5 failed
==============================================================================
controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
==============================================================================
Stop_All_Members :: Stop every odl node. | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync. | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-tell.txt.Leader Isolation :: DOMDataBroker testing: L...
==============================================================================
Healing_Within_Request_Timeout :: The isolated node (leader) is re... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_leader_isolation_healing_within_request_timeout"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_leader_isolation_healing_within_request_timeout&order=bug_status"
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Restart :: Restart odl | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_leader_isolation_restart"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_leader_isolation_restart&order=bug_status"
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Healing_After_Request_Timeout :: The isolated node (leader) is rej... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_leader_isolation_healing_after_request_timeout"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_leader_isolation_healing_after_request_timeout&order=bug_status"
ConnectionError: HTTPConnectionPool(host='10.30.171.69', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError("HTTPConnection(host='10.30.171.69', port=8181): Failed to establish a new connection: [Errno 111] Connection refused"))
------------------------------------------------------------------------------
controller-clustering-tell.txt.Leader Isolation :: DOMDataBroker t... | FAIL |
3 tests, 0 passed, 3 failed
==============================================================================
controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
==============================================================================
Stop_All_Members :: Stop every odl node. | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync. | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-tell.txt.Client Isolation :: DOMDataBroker testing: C...
==============================================================================
Producer_On_Shard_Leader_Node_ChainedTx :: Client isolation with p... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_client_isolation_producer_on_shard_leader_node_chainedtx"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_producer_on_shard_leader_node_chainedtx&order=bug_status"
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=125.0)
Also keyword teardown failed:
Several failures occurred:
1) Variable '${client_node_dst}' not found.
2) Variable '${client_node_dst}' not found.
3) Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 1 minute 10 seconds. The last error was: Several failures occurred:
1) ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=125.0)
2) Resolving variable '${response.text}' failed: AttributeError: 'NoneType' object has no attribute 'text'
3) Resolving variable '${response.status_code}' failed: AttributeError: 'No...
[ Message content over the limit has been removed. ]
...se.text}' failed: AttributeError: 'NoneType' object has no attribute 'text'
66) Evaluating expression "json.loads('''None''')" failed: JSONDecodeError: Expecting value: line 1 column 1 (char 0)
67) ValueError: Argument 'dictionary' got value 'None' (None) that cannot be converted to Mapping.
68) ValueError: Argument 'dictionary' got value 'None' (None) that cannot be converted to Mapping.
69) Unrecognized Raft state: None
70) No leader found.
71) Too many Leaders.
72) IndexError: Given index 0 is out of the range 0--1.
4) KeyError: 'threads'
------------------------------------------------------------------------------
Restart1 :: Restart odl | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_client_isolation_restart1"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_restart1&order=bug_status"
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Producer_On_Shard_Leader_Node_SimpleTx :: Client isolation with pr... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_client_isolation_producer_on_shard_leader_node_simpletx"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_producer_on_shard_leader_node_simpletx&order=bug_status"
ConnectionError: HTTPConnectionPool(host='10.30.171.69', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError("HTTPConnection(host='10.30.171.69', port=8181): Failed to establish a new connection: [Errno 111] Connection refused"))
Also keyword teardown failed:
Several failures occurred:
1) Variable '${client_node_dst}' not found.
2) Variable '${client_node_dst}' not found.
3) Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 1 minute 10 seconds. The last error was: Several failures occurred:
1) ConnectionError: HTTPConnectionPool(host='10.30.171.69', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError("HTTPConnection(host='10.30.171.69', port=8181): Fa...
[ Message content over the limit has been removed. ]
...se.text}' failed: AttributeError: 'NoneType' object has no attribute 'text'
174) Evaluating expression "json.loads('''None''')" failed: JSONDecodeError: Expecting value: line 1 column 1 (char 0)
175) ValueError: Argument 'dictionary' got value 'None' (None) that cannot be converted to Mapping.
176) ValueError: Argument 'dictionary' got value 'None' (None) that cannot be converted to Mapping.
177) Unrecognized Raft state: None
178) No leader found.
179) Too many Leaders.
180) IndexError: Given index 0 is out of the range 0--1.
4) KeyError: 'threads'
------------------------------------------------------------------------------
Restart2 :: Restart odl | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_client_isolation_restart2"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_restart2&order=bug_status"
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Producer_On_Shard_Non_Leader_Node_ChainedTx :: Client isolation wi... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_client_isolation_producer_on_shard_non_leader_node_chainedtx"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_producer_on_shard_non_leader_node_chainedtx&order=bug_status"
ConnectionError: HTTPConnectionPool(host='10.30.171.69', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError("HTTPConnection(host='10.30.171.69', port=8181): Failed to establish a new connection: [Errno 111] Connection refused"))
Also keyword teardown failed:
Several failures occurred:
1) Variable '${client_node_dst}' not found.
2) Variable '${client_node_dst}' not found.
3) Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 1 minute 10 seconds. The last error was: Several failures occurred:
1) ConnectionError: HTTPConnectionPool(host='10.30.171.69', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError("HTTPConnection(host='10.30.171.69', port=8181): Fa...
[ Message content over the limit has been removed. ]
...se.text}' failed: AttributeError: 'NoneType' object has no attribute 'text'
174) Evaluating expression "json.loads('''None''')" failed: JSONDecodeError: Expecting value: line 1 column 1 (char 0)
175) ValueError: Argument 'dictionary' got value 'None' (None) that cannot be converted to Mapping.
176) ValueError: Argument 'dictionary' got value 'None' (None) that cannot be converted to Mapping.
177) Unrecognized Raft state: None
178) No leader found.
179) Too many Leaders.
180) IndexError: Given index 0 is out of the range 0--1.
4) KeyError: 'threads'
------------------------------------------------------------------------------
Restart3 :: Restart odl | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_client_isolation_restart3"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_restart3&order=bug_status"
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Producer_On_Shard_Non_Leader_Node_SimpleTx :: Client isolation wit... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_client_isolation_producer_on_shard_non_leader_node_simpletx"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_producer_on_shard_non_leader_node_simpletx&order=bug_status"
ConnectionError: HTTPConnectionPool(host='10.30.171.69', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError("HTTPConnection(host='10.30.171.69', port=8181): Failed to establish a new connection: [Errno 111] Connection refused"))
Also keyword teardown failed:
Several failures occurred:
1) Variable '${client_node_dst}' not found.
2) Variable '${client_node_dst}' not found.
3) Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 1 minute 10 seconds. The last error was: Several failures occurred:
1) ConnectionError: HTTPConnectionPool(host='10.30.171.69', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError("HTTPConnection(host='10.30.171.69', port=8181): Fa...
[ Message content over the limit has been removed. ]
...se.text}' failed: AttributeError: 'NoneType' object has no attribute 'text'
174) Evaluating expression "json.loads('''None''')" failed: JSONDecodeError: Expecting value: line 1 column 1 (char 0)
175) ValueError: Argument 'dictionary' got value 'None' (None) that cannot be converted to Mapping.
176) ValueError: Argument 'dictionary' got value 'None' (None) that cannot be converted to Mapping.
177) Unrecognized Raft state: None
178) No leader found.
179) Too many Leaders.
180) IndexError: Given index 0 is out of the range 0--1.
4) KeyError: 'threads'
------------------------------------------------------------------------------
controller-clustering-tell.txt.Client Isolation :: DOMDataBroker t... | FAIL |
7 tests, 0 passed, 7 failed
==============================================================================
controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
==============================================================================
Stop_All_Members :: Stop every odl node. | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync. | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-tell.txt.Listener Stability :: DOMDataBroker testing:...
==============================================================================
Move_Leader_From_Listener_Local_To_Remote :: Listener runs on lead... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_listener_stability_move_leader_from_listener_local_to_remote"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_listener_stability_move_leader_from_listener_local_to_remote&order=bug_status"
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Restart_1 :: Restart odl. | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_listener_stability_restart_1"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_listener_stability_restart_1&order=bug_status"
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Move_Leader_From_Listener_Remote_To_Other_Remote :: Listener runs ... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_listener_stability_move_leader_from_listener_remote_to_other_remote"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_listener_stability_move_leader_from_listener_remote_to_other_remote&order=bug_status"
ConnectionError: HTTPConnectionPool(host='10.30.171.69', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError("HTTPConnection(host='10.30.171.69', port=8181): Failed to establish a new connection: [Errno 111] Connection refused"))
------------------------------------------------------------------------------
Restart_2 :: Restart odl. | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_listener_stability_restart_2"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_listener_stability_restart_2&order=bug_status"
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Move_Leader_From_Listener_Remote_To_Local :: Listener runs on foll... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_listener_stability_move_leader_from_listener_remote_to_local"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_listener_stability_move_leader_from_listener_remote_to_local&order=bug_status"
ConnectionError: HTTPConnectionPool(host='10.30.171.69', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError("HTTPConnection(host='10.30.171.69', port=8181): Failed to establish a new connection: [Errno 111] Connection refused"))
------------------------------------------------------------------------------
controller-clustering-tell.txt.Listener Stability :: DOMDataBroker... | FAIL |
5 tests, 0 passed, 5 failed
==============================================================================
controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
==============================================================================
Stop_All_Members :: Stop every odl node. | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync. | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-tell.txt.Master Stability :: Cluster Singleton testin...
==============================================================================
Register_Singleton_Constant_On_Each_Node_And_Verify :: Register a ... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_master_stability_register_singleton_constant_on_each_node_and_verify"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_register_singleton_constant_on_each_node_and_verify&order=bug_status"
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Unregister_Singleton_Constant_On_Non_Master_Node :: Unregister the... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_master_stability_unregister_singleton_constant_on_non_master_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_unregister_singleton_constant_on_non_master_node&order=bug_status"
Variable '@{cs_candidates}' not found. Did you mean:
@{cs_exp_candidates}
------------------------------------------------------------------------------
Monitor_Stability_While_Unregistered :: Verify that the owner rema... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_master_stability_monitor_stability_while_unregistered"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_monitor_stability_while_unregistered&order=bug_status"
Variable '${cs_owner}' not found.
------------------------------------------------------------------------------
Reregister_Singleton_Constant :: Re-register the unregistered cand... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_master_stability_reregister_singleton_constant"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_reregister_singleton_constant&order=bug_status"
Variable '${unregistered_node}' not found.
------------------------------------------------------------------------------
Verify_Stability_After_Reregistration :: Verify that the owner rem... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_master_stability_verify_stability_after_reregistration"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_verify_stability_after_reregistration&order=bug_status"
Variable '${cs_owner}' not found.
------------------------------------------------------------------------------
Unregister_Singleton_Constant_On_Each_Node :: Unregister the appli... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_master_stability_unregister_singleton_constant_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_unregister_singleton_constant_on_each_node&order=bug_status"
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-tell.txt.Master Stability :: Cluster Singlet... | FAIL |
6 tests, 0 passed, 6 failed
==============================================================================
controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
==============================================================================
Stop_All_Members :: Stop every odl node. | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync. | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.77:8181/jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore
------------------------------------------------------------------------------
controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-tell.txt.Partition And Heal :: Cluster Singleton test...
==============================================================================
Register_Singleton_Constant_On_Each_Node :: Register a candidate a... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_partition_and_heal_register_singleton_constant_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_register_singleton_constant_on_each_node&order=bug_status"
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.77:8181/rests/operations/odl-mdsal-lowlevel-control:register-singleton-constant
------------------------------------------------------------------------------
Verify_Singleton_Constant_On_Each_Node :: Store the owner and cand... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_partition_and_heal_verify_singleton_constant_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_verify_singleton_constant_on_each_node&order=bug_status"
Could not parse owner and candidates for device get-singleton-constant-service']
------------------------------------------------------------------------------
Isolate_Owner_Node :: Isolate the cluster node which is the owner.... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_partition_and_heal_isolate_owner_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_isolate_owner_node&order=bug_status"
Variable '${cs_owner}' not found.
------------------------------------------------------------------------------
Monitor_Stability_While_Isolated :: Monitor the stability of the s... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_partition_and_heal_monitor_stability_while_isolated"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_monitor_stability_while_isolated&order=bug_status"
Invalid IF condition: Evaluating expression '"${index}" == "${cs_isolated_index}"' failed: Variable '${cs_isolated_index}' not found.
------------------------------------------------------------------------------
Rejoin_Isolated_node :: Rejoin isolated node. | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_partition_and_heal_rejoin_isolated_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_rejoin_isolated_node&order=bug_status"
Variable '${cs_isolated_index}' not found.
------------------------------------------------------------------------------
Unregister_Singleton_Constant_On_Each_Node :: Unregister the appli... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_partition_and_heal_unregister_singleton_constant_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_unregister_singleton_constant_on_each_node&order=bug_status"
ConnectionError: HTTPConnectionPool(host='10.30.170.77', port=8181): Max retries exceeded with url: /rests/operations/odl-mdsal-lowlevel-control:unregister-singleton-constant (Caused by NewConnectionError("HTTPConnection(host='10.30.170.77', port=8181): Failed to establish a new connection: [Errno 111] Connection refused"))
------------------------------------------------------------------------------
controller-clustering-tell.txt.Partition And Heal :: Cluster Singl... | FAIL |
6 tests, 0 passed, 6 failed
==============================================================================
controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
==============================================================================
Stop_All_Members :: Stop every odl node. | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync. | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-tell.txt.Chasing The Leader :: Cluster Singleton test...
==============================================================================
Register_Candidates :: Register a candidate application on each no... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_chasing_the_leader_register_candidates"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_chasing_the_leader_register_candidates&order=bug_status"
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Do_Nothing :: Do nothing for the time of the test duration, becaus... | PASS |
------------------------------------------------------------------------------
Unregister_Candidates_And_Validate_Criteria :: Unregister the test... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_chasing_the_leader_unregister_candidates_and_validate_criteria"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_chasing_the_leader_unregister_candidates_and_validate_criteria&order=bug_status"
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-tell.txt.Chasing The Leader :: Cluster Singl... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
==============================================================================
Stop_All_Members :: Stop every odl node. | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync. | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-tell.txt.Carpeople Crud :: Suite for performing basic...
==============================================================================
Add_Cars_To_Leader :: Add 30 cars to car Leader by one big PUT. | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
See_Added_Cars_On_Leader :: GET response from Leader should match ... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
See_Added_Cars_On_Followers :: The same check on other members. | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Add_People_To_First_Follower :: Add 30 people to people first Foll... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
See_Added_People_On_Leader :: GET response from Leader should matc... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
See_Added_People_On_Followers :: The same check on other members. | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Buy_Cars_On_Leader :: Buy some cars on car-people Leader, loop of ... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Buy_Cars_On_Followers :: On each Follower buy corresponding ID seg... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
See_Added_CarPeople_On_Leader :: GET car-person mappings from Lead... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
See_Added_CarPeople_On_Followers :: The same check on other members. | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Delete_All_CarPeople_On_Leader :: DELETE car-people container. No ... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Delete_All_People_On_Leader :: DELETE people container. No verific... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Delete_All_Cars_On_Leader :: DELETE cars container. No verificatio... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
controller-clustering-tell.txt.Carpeople Crud :: Suite for perform... | FAIL |
Suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
13 tests, 0 passed, 13 failed
==============================================================================
controller-clustering-tell.txt.Car Failover Crud :: Suite mixing basic oper...
==============================================================================
Add_Original_Cars_On_Old_Leader_And_Verify :: Add initial cars on ... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Stop_Original_Car_Leader :: Stop the car Leader to cause a new lea... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Wait_For_New_Leader :: Wait until new car Leader is elected. | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
See_Original_Cars_On_New_Leader :: GET cars from new Leader, shoul... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
See_Original_Cars_On_New_Followers :: The same check on other exis... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Delete_Original_Cars_On_New_Leader :: Delete cars on the new Leader. | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Add_Leader_Cars_On_New_Leader :: Add cars on the new Leader. | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
See_Leader_Cars_On_New_Leader :: GET cars from new Leader, should ... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
See_Leader_Cars_On_New_Followers :: The same check on other existi... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Delete_Leader_Cars_On_New_First_Follower :: Delete cars in new fir... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Add_Follower_Cars_On_New_First_Follower :: Add cars on the new fir... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
See_Folower_Cars_On_New_Leader :: Get cars from the new Leader, sh... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
See_Follower_Cars_On_New_Followers :: The same check on other exis... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Start_Old_Car_Leader :: Start the stopped member without deleting ... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
See_Folower_Cars_On_Old_Leader :: GET cars from the restarted memb... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Delete_Follower_Cars_On_New_Leader :: Delete cars on the last Leader. | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
controller-clustering-tell.txt.Car Failover Crud :: Suite mixing b... | FAIL |
Suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
16 tests, 0 passed, 16 failed
==============================================================================
controller-clustering-tell.txt.Car Persistence Recovery :: This test restar...
==============================================================================
Add_Cars_On_Leader_And_Verify :: Single big PUT to datastore to ad... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Stop_All_Members :: Stop all controllers. | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Start_All_Members :: Start all controllers (should restore the per... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Memorize_Leader_And_Followers :: Locate current Leader of car Shard. | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
See_Cars_On_Leader :: GET cars from Leader, should match the PUT d... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
See_Cars_On_Followers :: The same check on other members. | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Delete_Cars_On_Leader :: Delete cars on the new Leader. | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
controller-clustering-tell.txt.Car Persistence Recovery :: This te... | FAIL |
Suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
7 tests, 0 passed, 7 failed
==============================================================================
controller-clustering-tell.txt.Buycar Failover :: This test focuses on test...
==============================================================================
Add_Cars_To_Leader_And_Verify :: Add all needed cars to car Leader... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Add_People_To_First_Follower_And_Verify :: Add all needed people t... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Buy_Cars_On_Leader_And_Verify :: Buy some cars on the leader member. | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Buy_Cars_On_Follower_And_Verify :: Buy some cars on the first foll... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Reboot_People_Leader :: Previous people Leader is rebooted. We sho... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Buy_Cars_On_Leader_After_Reboot_And_Verify :: Buy some cars on the... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Buy_Cars_On_Follower_After_Reboot_And_Verify :: Buy some cars on t... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Delete_All_CarPeople :: DELETE car-people container. No verificati... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Delete_All_People :: DELETE people container. No verification beyo... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Delete_All_Cars :: DELETE cars container. No verification beyond h... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
controller-clustering-tell.txt.Buycar Failover :: This test focuse... | FAIL |
Suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
10 tests, 0 passed, 10 failed
==============================================================================
controller-clustering-tell.txt.Entity Isolate :: Suite for performing membe...
==============================================================================
Check All Shards Before Isolate :: Check all shards in controller. | FAIL |
Parent suite setup failed:
Evaluating expression 'json.loads(\'\'\'{\n "error": "javax.management.InstanceNotFoundException : org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "error_type": "javax.management.InstanceNotFoundException",\n "request": {\n "mbean": "org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "type": "read"\n },\n "stacktrace": "javax.management.InstanceNotFoundException: org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1073)\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1343)\\n\\tat java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:921)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:46)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:41)\\n\\tat org.jolokia.backend.executor.AbstractMBeanServerExecutor.call(AbstractMBeanServerExecutor.java:90)\\n\\tat org.jolokia.handler.ReadHandler.getMBeanInfo(ReadHandler.java:233)\\n\\tat org.jolokia.handler.ReadHandler.getAllAttributesNames(ReadHandler.java:245)\\n\\tat org.jolokia.handler.ReadHandler.resolveAttributes(ReadHandler.java:221)\\n\\tat org.jolokia.handler.ReadHandler.f...
[ Message content over the limit has been removed. ]
...lipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\\n\\tat org.eclipse.jetty.server.Server.handle(Server.java:516)\\n\\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)\\n\\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)\\n\\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)\\n\\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\\n\\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\\n\\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\\n\\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)\\n\\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\\n\\tat java.base/java.lang.Thread.run(Thread.java:1583)\\n",\n "status": 404\n}\n\'\'\')' failed: JSONDecodeError: Invalid control character at: line 8 column 190 (char 619)
------------------------------------------------------------------------------
Isolate Entity Leader :: Isolate the entity-ownership Leader to ca... | FAIL |
Parent suite setup failed:
Evaluating expression 'json.loads(\'\'\'{\n "error": "javax.management.InstanceNotFoundException : org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "error_type": "javax.management.InstanceNotFoundException",\n "request": {\n "mbean": "org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "type": "read"\n },\n "stacktrace": "javax.management.InstanceNotFoundException: org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1073)\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1343)\\n\\tat java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:921)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:46)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:41)\\n\\tat org.jolokia.backend.executor.AbstractMBeanServerExecutor.call(AbstractMBeanServerExecutor.java:90)\\n\\tat org.jolokia.handler.ReadHandler.getMBeanInfo(ReadHandler.java:233)\\n\\tat org.jolokia.handler.ReadHandler.getAllAttributesNames(ReadHandler.java:245)\\n\\tat org.jolokia.handler.ReadHandler.resolveAttributes(ReadHandler.java:221)\\n\\tat org.jolokia.handler.ReadHandler.f...
[ Message content over the limit has been removed. ]
...lipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\\n\\tat org.eclipse.jetty.server.Server.handle(Server.java:516)\\n\\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)\\n\\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)\\n\\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)\\n\\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\\n\\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\\n\\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\\n\\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)\\n\\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\\n\\tat java.base/java.lang.Thread.run(Thread.java:1583)\\n",\n "status": 404\n}\n\'\'\')' failed: JSONDecodeError: Invalid control character at: line 8 column 190 (char 619)
------------------------------------------------------------------------------
Check All Shards After Isolate :: Check all shards in controller. | FAIL |
Parent suite setup failed:
Evaluating expression 'json.loads(\'\'\'{\n "error": "javax.management.InstanceNotFoundException : org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "error_type": "javax.management.InstanceNotFoundException",\n "request": {\n "mbean": "org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "type": "read"\n },\n "stacktrace": "javax.management.InstanceNotFoundException: org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1073)\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1343)\\n\\tat java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:921)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:46)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:41)\\n\\tat org.jolokia.backend.executor.AbstractMBeanServerExecutor.call(AbstractMBeanServerExecutor.java:90)\\n\\tat org.jolokia.handler.ReadHandler.getMBeanInfo(ReadHandler.java:233)\\n\\tat org.jolokia.handler.ReadHandler.getAllAttributesNames(ReadHandler.java:245)\\n\\tat org.jolokia.handler.ReadHandler.resolveAttributes(ReadHandler.java:221)\\n\\tat org.jolokia.handler.ReadHandler.f...
[ Message content over the limit has been removed. ]
...lipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\\n\\tat org.eclipse.jetty.server.Server.handle(Server.java:516)\\n\\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)\\n\\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)\\n\\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)\\n\\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\\n\\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\\n\\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\\n\\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)\\n\\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\\n\\tat java.base/java.lang.Thread.run(Thread.java:1583)\\n",\n "status": 404\n}\n\'\'\')' failed: JSONDecodeError: Invalid control character at: line 8 column 190 (char 619)
------------------------------------------------------------------------------
Rejoin Entity Leader :: Rejoin the entity-ownership Leader. | FAIL |
Parent suite setup failed:
Evaluating expression 'json.loads(\'\'\'{\n "error": "javax.management.InstanceNotFoundException : org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "error_type": "javax.management.InstanceNotFoundException",\n "request": {\n "mbean": "org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "type": "read"\n },\n "stacktrace": "javax.management.InstanceNotFoundException: org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1073)\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1343)\\n\\tat java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:921)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:46)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:41)\\n\\tat org.jolokia.backend.executor.AbstractMBeanServerExecutor.call(AbstractMBeanServerExecutor.java:90)\\n\\tat org.jolokia.handler.ReadHandler.getMBeanInfo(ReadHandler.java:233)\\n\\tat org.jolokia.handler.ReadHandler.getAllAttributesNames(ReadHandler.java:245)\\n\\tat org.jolokia.handler.ReadHandler.resolveAttributes(ReadHandler.java:221)\\n\\tat org.jolokia.handler.ReadHandler.f...
[ Message content over the limit has been removed. ]
...lipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\\n\\tat org.eclipse.jetty.server.Server.handle(Server.java:516)\\n\\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)\\n\\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)\\n\\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)\\n\\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\\n\\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\\n\\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\\n\\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)\\n\\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\\n\\tat java.base/java.lang.Thread.run(Thread.java:1583)\\n",\n "status": 404\n}\n\'\'\')' failed: JSONDecodeError: Invalid control character at: line 8 column 190 (char 619)
------------------------------------------------------------------------------
Check All Shards After Rejoin :: Check all shards in controller. | FAIL |
Parent suite setup failed:
Evaluating expression 'json.loads(\'\'\'{\n "error": "javax.management.InstanceNotFoundException : org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "error_type": "javax.management.InstanceNotFoundException",\n "request": {\n "mbean": "org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "type": "read"\n },\n "stacktrace": "javax.management.InstanceNotFoundException: org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1073)\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1343)\\n\\tat java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:921)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:46)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:41)\\n\\tat org.jolokia.backend.executor.AbstractMBeanServerExecutor.call(AbstractMBeanServerExecutor.java:90)\\n\\tat org.jolokia.handler.ReadHandler.getMBeanInfo(ReadHandler.java:233)\\n\\tat org.jolokia.handler.ReadHandler.getAllAttributesNames(ReadHandler.java:245)\\n\\tat org.jolokia.handler.ReadHandler.resolveAttributes(ReadHandler.java:221)\\n\\tat org.jolokia.handler.ReadHandler.f...
[ Message content over the limit has been removed. ]
...lipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\\n\\tat org.eclipse.jetty.server.Server.handle(Server.java:516)\\n\\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)\\n\\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)\\n\\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)\\n\\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\\n\\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\\n\\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\\n\\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)\\n\\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\\n\\tat java.base/java.lang.Thread.run(Thread.java:1583)\\n",\n "status": 404\n}\n\'\'\')' failed: JSONDecodeError: Invalid control character at: line 8 column 190 (char 619)
------------------------------------------------------------------------------
controller-clustering-tell.txt.Entity Isolate :: Suite for perform... | FAIL |
Suite setup failed:
Evaluating expression 'json.loads(\'\'\'{\n "error": "javax.management.InstanceNotFoundException : org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "error_type": "javax.management.InstanceNotFoundException",\n "request": {\n "mbean": "org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "type": "read"\n },\n "stacktrace": "javax.management.InstanceNotFoundException: org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1073)\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1343)\\n\\tat java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:921)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:46)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:41)\\n\\tat org.jolokia.backend.executor.AbstractMBeanServerExecutor.call(AbstractMBeanServerExecutor.java:90)\\n\\tat org.jolokia.handler.ReadHandler.getMBeanInfo(ReadHandler.java:233)\\n\\tat org.jolokia.handler.ReadHandler.getAllAttributesNames(ReadHandler.java:245)\\n\\tat org.jolokia.handler.ReadHandler.resolveAttributes(ReadHandler.java:221)\\n\\tat org.jolokia.handler.ReadHandler.f...
[ Message content over the limit has been removed. ]
...lipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\\n\\tat org.eclipse.jetty.server.Server.handle(Server.java:516)\\n\\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)\\n\\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)\\n\\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)\\n\\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\\n\\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\\n\\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\\n\\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)\\n\\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\\n\\tat java.base/java.lang.Thread.run(Thread.java:1583)\\n",\n "status": 404\n}\n\'\'\')' failed: JSONDecodeError: Invalid control character at: line 8 column 190 (char 619)
5 tests, 0 passed, 5 failed
==============================================================================
controller-clustering-tell.txt.Buycar Failover Isolation :: This test focus...
==============================================================================
Add_Cars_To_Leader_And_Verify :: Add all needed cars to car Leader... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Add_People_To_First_Follower_And_Verify :: Add all needed people t... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Buy_Cars_On_Leader_And_Verify :: Buy some cars on the leader member. | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Buy_Cars_On_Follower_And_Verify :: Buy some cars on the first foll... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Isolate_and_Rejoin_People_Leader :: Previous people Leader is isol... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Buy_Cars_On_Leader_After_Rejoin_And_Verify :: Buy some cars on the... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Buy_Cars_On_Follower_After_Rejoin_And_Verify :: Buy some cars on t... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Delete_All_CarPeople :: DELETE car-people container. No verificati... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Delete_All_People :: DELETE people container. No verification beyo... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Delete_All_Cars :: DELETE cars container. No verification beyond h... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
controller-clustering-tell.txt.Buycar Failover Isolation :: This t... | FAIL |
Suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
10 tests, 0 passed, 10 failed
==============================================================================
controller-clustering-tell.txt.Car Failover Crud Isolation :: Suite mixing ...
==============================================================================
Add_Original_Cars_On_Old_Leader_And_Verify :: Add initial cars on ... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Isolate_Original_Car_Leader :: Isolate the car Leader to cause a n... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Wait_For_New_Leader :: Wait until new car Leader is elected. | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
See_Original_Cars_On_New_Leader :: GET cars from new Leader, shoul... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
See_Original_Cars_On_New_Followers :: The same check on other exis... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Delete_Original_Cars_On_New_Leader :: Delete cars on the new Leader. | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Add_Leader_Cars_On_New_Leader :: Add cars on the new Leader. | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
See_Leader_Cars_On_New_Leader :: GET cars from new Leader, should ... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
See_Leader_Cars_On_New_Followers :: The same check on other existi... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Delete_Leader_Cars_On_New_First_Follower :: Delete cars in new fir... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Add_Follower_Cars_On_New_First_Follower :: Add cars on the new fir... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
See_Folower_Cars_On_New_Leader :: Get cars from the new Leader, sh... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
See_Follower_Cars_On_New_Followers :: The same check on other exis... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Rejoin_Old_Car_Leader :: Rejoin the isolated member without deleti... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
See_Folower_Cars_On_Old_Leader :: GET cars from the restarted memb... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Delete_Follower_Cars_On_New_Leader :: Delete cars on the last Leader. | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
controller-clustering-tell.txt.Car Failover Crud Isolation :: Suit... | FAIL |
Suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
16 tests, 0 passed, 16 failed
==============================================================================
controller-clustering-tell.txt.Car Outage Corners :: Cluster suite for test...
==============================================================================
Stop_Majority_Of_The_Followers :: Stop half plus one car Follower ... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Attempt_To_Add_Cars_To_Leader :: Adding cars should fail, as major... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Start_Tipping_Follower :: Start one Follower member without persis... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Add_Cars_On_Tipping_Follower :: Add cars on the tipping Follower. | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
See_Cars_On_Existing_Members :: On each up member: GET cars, shoul... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Start_Other_Followers :: Start other followers without persisted d... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
See_Cars_On_New_Follower_Leader :: GET cars from a new follower to... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Delete_Cars_On_Leader :: Delete cars on Leader. | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
controller-clustering-tell.txt.Car Outage Corners :: Cluster suite... | FAIL |
Suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.81', port=8181): Read timed out. (read timeout=5.0)
8 tests, 0 passed, 8 failed
==============================================================================
controller-clustering-tell.txt | FAIL |
162 tests, 11 passed, 151 failed
==============================================================================
Output: /w/workspace/controller-csit-3node-clustering-tell-all-scandium/output.xml
Log: /w/workspace/controller-csit-3node-clustering-tell-all-scandium/log.html
Report: /w/workspace/controller-csit-3node-clustering-tell-all-scandium/report.html
+ true
+ echo 'Examining the files in data/log and checking filesize'
Examining the files in data/log and checking filesize
+ ssh 10.30.171.69 'ls -altr /tmp/karaf-0.21.4-SNAPSHOT/data/log/'
Warning: Permanently added '10.30.171.69' (ECDSA) to the list of known hosts.
total 8372
drwxrwxr-x 2 jenkins jenkins 4096 Jan 26 23:08 .
-rw-rw-r-- 1 jenkins jenkins 1720 Jan 26 23:08 karaf_console.log
drwxrwxr-x 9 jenkins jenkins 4096 Jan 27 04:39 ..
-rw-rw-r-- 1 jenkins jenkins 8554570 Jan 27 04:53 karaf.log
+ ssh 10.30.171.69 'du -hs /tmp/karaf-0.21.4-SNAPSHOT/data/log/*'
Warning: Permanently added '10.30.171.69' (ECDSA) to the list of known hosts.
8.2M /tmp/karaf-0.21.4-SNAPSHOT/data/log/karaf.log
4.0K /tmp/karaf-0.21.4-SNAPSHOT/data/log/karaf_console.log
+ ssh 10.30.170.77 'ls -altr /tmp/karaf-0.21.4-SNAPSHOT/data/log/'
Warning: Permanently added '10.30.170.77' (ECDSA) to the list of known hosts.
total 20304
drwxrwxr-x 2 jenkins jenkins 4096 Jan 26 23:08 .
-rw-rw-r-- 1 jenkins jenkins 1720 Jan 26 23:08 karaf_console.log
drwxrwxr-x 9 jenkins jenkins 4096 Jan 27 04:39 ..
-rw-rw-r-- 1 jenkins jenkins 20771079 Jan 27 04:53 karaf.log
+ ssh 10.30.170.77 'du -hs /tmp/karaf-0.21.4-SNAPSHOT/data/log/*'
Warning: Permanently added '10.30.170.77' (ECDSA) to the list of known hosts.
20M /tmp/karaf-0.21.4-SNAPSHOT/data/log/karaf.log
4.0K /tmp/karaf-0.21.4-SNAPSHOT/data/log/karaf_console.log
+ ssh 10.30.171.81 'ls -altr /tmp/karaf-0.21.4-SNAPSHOT/data/log/'
Warning: Permanently added '10.30.171.81' (ECDSA) to the list of known hosts.
total 11964
drwxrwxr-x 2 jenkins jenkins 4096 Jan 26 23:08 .
-rw-rw-r-- 1 jenkins jenkins 143996 Jan 26 23:18 karaf_console.log
drwxrwxr-x 4 jenkins jenkins 4096 Jan 27 04:39 ..
-rw-rw-r-- 1 jenkins jenkins 12088646 Jan 27 04:54 karaf.log
+ ssh 10.30.171.81 'du -hs /tmp/karaf-0.21.4-SNAPSHOT/data/log/*'
Warning: Permanently added '10.30.171.81' (ECDSA) to the list of known hosts.
12M /tmp/karaf-0.21.4-SNAPSHOT/data/log/karaf.log
144K /tmp/karaf-0.21.4-SNAPSHOT/data/log/karaf_console.log
+ set +e
++ seq 1 3
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_1_IP
+ echo 'Let'\''s take the karaf thread dump again'
Let's take the karaf thread dump again
+ ssh 10.30.171.69 'sudo ps aux'
Warning: Permanently added '10.30.171.69' (ECDSA) to the list of known hosts.
++ tr -s ' '
++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-scandium/ps_after.log
++ cut -f2 '-d '
++ grep -v grep
+ pid=29330
+ echo 'karaf main: org.apache.karaf.main.Main, pid:29330'
karaf main: org.apache.karaf.main.Main, pid:29330
+ ssh 10.30.171.69 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 29330'
Warning: Permanently added '10.30.171.69' (ECDSA) to the list of known hosts.
+ echo 'killing karaf process...'
killing karaf process...
+ ssh 10.30.171.69 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh'
Warning: Permanently added '10.30.171.69' (ECDSA) to the list of known hosts.
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_2_IP
+ echo 'Let'\''s take the karaf thread dump again'
Let's take the karaf thread dump again
+ ssh 10.30.170.77 'sudo ps aux'
Warning: Permanently added '10.30.170.77' (ECDSA) to the list of known hosts.
++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-scandium/ps_after.log
++ grep -v grep
++ tr -s ' '
++ cut -f2 '-d '
+ pid=37394
+ echo 'karaf main: org.apache.karaf.main.Main, pid:37394'
karaf main: org.apache.karaf.main.Main, pid:37394
+ ssh 10.30.170.77 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 37394'
Warning: Permanently added '10.30.170.77' (ECDSA) to the list of known hosts.
+ echo 'killing karaf process...'
killing karaf process...
+ ssh 10.30.170.77 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh'
Warning: Permanently added '10.30.170.77' (ECDSA) to the list of known hosts.
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_3_IP
+ echo 'Let'\''s take the karaf thread dump again'
Let's take the karaf thread dump again
+ ssh 10.30.171.81 'sudo ps aux'
Warning: Permanently added '10.30.171.81' (ECDSA) to the list of known hosts.
++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-scandium/ps_after.log
++ grep -v grep
++ tr -s ' '
++ cut -f2 '-d '
+ pid=2116
+ echo 'karaf main: org.apache.karaf.main.Main, pid:2116'
karaf main: org.apache.karaf.main.Main, pid:2116
+ ssh 10.30.171.81 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 2116'
Warning: Permanently added '10.30.171.81' (ECDSA) to the list of known hosts.
+ echo 'killing karaf process...'
killing karaf process...
+ ssh 10.30.171.81 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh'
Warning: Permanently added '10.30.171.81' (ECDSA) to the list of known hosts.
+ sleep 5
++ seq 1 3
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_1_IP
+ echo 'Compressing karaf.log 1'
Compressing karaf.log 1
+ ssh 10.30.171.69 gzip --best /tmp/karaf-0.21.4-SNAPSHOT/data/log/karaf.log
Warning: Permanently added '10.30.171.69' (ECDSA) to the list of known hosts.
+ echo 'Fetching compressed karaf.log 1'
Fetching compressed karaf.log 1
+ scp 10.30.171.69:/tmp/karaf-0.21.4-SNAPSHOT/data/log/karaf.log.gz odl1_karaf.log.gz
Warning: Permanently added '10.30.171.69' (ECDSA) to the list of known hosts.
+ ssh 10.30.171.69 rm -f /tmp/karaf-0.21.4-SNAPSHOT/data/log/karaf.log.gz
Warning: Permanently added '10.30.171.69' (ECDSA) to the list of known hosts.
+ scp 10.30.171.69:/tmp/karaf-0.21.4-SNAPSHOT/data/log/karaf_console.log odl1_karaf_console.log
Warning: Permanently added '10.30.171.69' (ECDSA) to the list of known hosts.
+ ssh 10.30.171.69 rm -f /tmp/karaf-0.21.4-SNAPSHOT/data/log/karaf_console.log
Warning: Permanently added '10.30.171.69' (ECDSA) to the list of known hosts.
+ echo 'Fetch GC logs'
Fetch GC logs
+ mkdir -p gclogs-1
+ scp '10.30.171.69:/tmp/karaf-0.21.4-SNAPSHOT/data/log/*.log' gclogs-1/
Warning: Permanently added '10.30.171.69' (ECDSA) to the list of known hosts.
scp: /tmp/karaf-0.21.4-SNAPSHOT/data/log/*.log: No such file or directory
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_2_IP
+ echo 'Compressing karaf.log 2'
Compressing karaf.log 2
+ ssh 10.30.170.77 gzip --best /tmp/karaf-0.21.4-SNAPSHOT/data/log/karaf.log
Warning: Permanently added '10.30.170.77' (ECDSA) to the list of known hosts.
+ echo 'Fetching compressed karaf.log 2'
Fetching compressed karaf.log 2
+ scp 10.30.170.77:/tmp/karaf-0.21.4-SNAPSHOT/data/log/karaf.log.gz odl2_karaf.log.gz
Warning: Permanently added '10.30.170.77' (ECDSA) to the list of known hosts.
+ ssh 10.30.170.77 rm -f /tmp/karaf-0.21.4-SNAPSHOT/data/log/karaf.log.gz
Warning: Permanently added '10.30.170.77' (ECDSA) to the list of known hosts.
+ scp 10.30.170.77:/tmp/karaf-0.21.4-SNAPSHOT/data/log/karaf_console.log odl2_karaf_console.log
Warning: Permanently added '10.30.170.77' (ECDSA) to the list of known hosts.
+ ssh 10.30.170.77 rm -f /tmp/karaf-0.21.4-SNAPSHOT/data/log/karaf_console.log
Warning: Permanently added '10.30.170.77' (ECDSA) to the list of known hosts.
+ echo 'Fetch GC logs'
Fetch GC logs
+ mkdir -p gclogs-2
+ scp '10.30.170.77:/tmp/karaf-0.21.4-SNAPSHOT/data/log/*.log' gclogs-2/
Warning: Permanently added '10.30.170.77' (ECDSA) to the list of known hosts.
scp: /tmp/karaf-0.21.4-SNAPSHOT/data/log/*.log: No such file or directory
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_3_IP
+ echo 'Compressing karaf.log 3'
Compressing karaf.log 3
+ ssh 10.30.171.81 gzip --best /tmp/karaf-0.21.4-SNAPSHOT/data/log/karaf.log
Warning: Permanently added '10.30.171.81' (ECDSA) to the list of known hosts.
+ echo 'Fetching compressed karaf.log 3'
Fetching compressed karaf.log 3
+ scp 10.30.171.81:/tmp/karaf-0.21.4-SNAPSHOT/data/log/karaf.log.gz odl3_karaf.log.gz
Warning: Permanently added '10.30.171.81' (ECDSA) to the list of known hosts.
+ ssh 10.30.171.81 rm -f /tmp/karaf-0.21.4-SNAPSHOT/data/log/karaf.log.gz
Warning: Permanently added '10.30.171.81' (ECDSA) to the list of known hosts.
+ scp 10.30.171.81:/tmp/karaf-0.21.4-SNAPSHOT/data/log/karaf_console.log odl3_karaf_console.log
Warning: Permanently added '10.30.171.81' (ECDSA) to the list of known hosts.
+ ssh 10.30.171.81 rm -f /tmp/karaf-0.21.4-SNAPSHOT/data/log/karaf_console.log
Warning: Permanently added '10.30.171.81' (ECDSA) to the list of known hosts.
+ echo 'Fetch GC logs'
Fetch GC logs
+ mkdir -p gclogs-3
+ scp '10.30.171.81:/tmp/karaf-0.21.4-SNAPSHOT/data/log/*.log' gclogs-3/
Warning: Permanently added '10.30.171.81' (ECDSA) to the list of known hosts.
scp: /tmp/karaf-0.21.4-SNAPSHOT/data/log/*.log: No such file or directory
+ echo 'Examine copied files'
Examine copied files
+ ls -lt
total 74308
drwxrwxr-x. 2 jenkins jenkins 6 Jan 27 04:54 gclogs-3
-rw-rw-r--. 1 jenkins jenkins 143996 Jan 27 04:54 odl3_karaf_console.log
-rw-rw-r--. 1 jenkins jenkins 437682 Jan 27 04:54 odl3_karaf.log.gz
drwxrwxr-x. 2 jenkins jenkins 6 Jan 27 04:54 gclogs-2
-rw-rw-r--. 1 jenkins jenkins 1720 Jan 27 04:54 odl2_karaf_console.log
-rw-rw-r--. 1 jenkins jenkins 842714 Jan 27 04:54 odl2_karaf.log.gz
drwxrwxr-x. 2 jenkins jenkins 6 Jan 27 04:54 gclogs-1
-rw-rw-r--. 1 jenkins jenkins 1720 Jan 27 04:54 odl1_karaf_console.log
-rw-rw-r--. 1 jenkins jenkins 615181 Jan 27 04:54 odl1_karaf.log.gz
-rw-rw-r--. 1 jenkins jenkins 146051 Jan 27 04:54 karaf_3_2116_threads_after.log
-rw-rw-r--. 1 jenkins jenkins 14076 Jan 27 04:54 ps_after.log
-rw-rw-r--. 1 jenkins jenkins 127561 Jan 27 04:54 karaf_2_37394_threads_after.log
-rw-rw-r--. 1 jenkins jenkins 123481 Jan 27 04:54 karaf_1_29330_threads_after.log
-rw-rw-r--. 1 jenkins jenkins 307547 Jan 27 04:54 report.html
-rw-rw-r--. 1 jenkins jenkins 3947268 Jan 27 04:54 log.html
-rw-rw-r--. 1 jenkins jenkins 68923987 Jan 27 04:54 output.xml
-rw-rw-r--. 1 jenkins jenkins 6069 Jan 26 23:11 testplan.txt
-rw-rw-r--. 1 jenkins jenkins 110517 Jan 26 23:11 karaf_3_2116_threads_before.log
-rw-rw-r--. 1 jenkins jenkins 14124 Jan 26 23:11 ps_before.log
-rw-rw-r--. 1 jenkins jenkins 110628 Jan 26 23:11 karaf_2_2095_threads_before.log
-rw-rw-r--. 1 jenkins jenkins 115981 Jan 26 23:11 karaf_1_2110_threads_before.log
-rw-rw-r--. 1 jenkins jenkins 3106 Jan 26 23:08 post-startup-script.sh
-rw-rw-r--. 1 jenkins jenkins 252 Jan 26 23:07 startup-script.sh
-rw-rw-r--. 1 jenkins jenkins 3469 Jan 26 23:07 configuration-script.sh
-rw-rw-r--. 1 jenkins jenkins 695 Jan 26 23:07 custom_shard_config.txt
-rw-rw-r--. 1 jenkins jenkins 136 Jan 26 23:07 scriptplan.txt
-rw-rw-r--. 1 jenkins jenkins 337 Jan 26 23:07 detect_variables.env
-rw-rw-r--. 1 jenkins jenkins 2619 Jan 26 23:07 pom.xml
-rw-rw-r--. 1 jenkins jenkins 92 Jan 26 23:07 set_variables.env
-rw-rw-r--. 1 jenkins jenkins 310 Jan 26 23:07 slave_addresses.txt
-rw-rw-r--. 1 jenkins jenkins 570 Jan 26 23:06 requirements.txt
-rw-rw-r--. 1 jenkins jenkins 26 Jan 26 23:06 env.properties
-rw-rw-r--. 1 jenkins jenkins 333 Jan 26 23:04 stack-parameters.yaml
drwxrwxr-x. 7 jenkins jenkins 4096 Jan 26 23:03 test
drwxrwxr-x. 2 jenkins jenkins 6 Jan 26 23:03 test@tmp
-rw-rw-r--. 1 jenkins jenkins 1410 Jan 26 21:27 maven-metadata.xml
+ true
[controller-csit-3node-clustering-tell-all-scandium] $ /bin/sh /tmp/jenkins3390125899584722072.sh
Cleaning up Robot installation...
$ ssh-agent -k
unset SSH_AUTH_SOCK;
unset SSH_AGENT_PID;
echo Agent pid 5281 killed;
[ssh-agent] Stopped.
Recording plot data
Robot results publisher started...
INFO: Checking test criticality is deprecated and will be dropped in a future release!
-Parsing output xml:
Done!
-Copying log files to build dir:
Done!
-Assigning results to build:
Done!
-Checking thresholds:
Done!
Done publishing Robot results.
Build step 'Publish Robot Framework test results' changed build result to UNSTABLE
[PostBuildScript] - [INFO] Executing post build scripts.
[controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins13718564048863313045.sh
Archiving csit artifacts
mv: cannot stat '*_1.png': No such file or directory
mv: cannot stat '/tmp/odl1_*': No such file or directory
mv: cannot stat '*_2.png': No such file or directory
mv: cannot stat '/tmp/odl2_*': No such file or directory
mv: cannot stat '*_3.png': No such file or directory
mv: cannot stat '/tmp/odl3_*': No such file or directory
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
100 2536k 0 2536k 0 0 4867k 0 --:--:-- --:--:-- --:--:-- 4858k
100 5584k 0 5584k 0 0 4911k 0 --:--:-- 0:00:01 --:--:-- 4911k
Archive: robot-plugin.zip
inflating: ./archives/robot-plugin/log.html
inflating: ./archives/robot-plugin/output.xml
inflating: ./archives/robot-plugin/report.html
mv: cannot stat '*.log.gz': No such file or directory
mv: cannot stat '*.csv': No such file or directory
mv: cannot stat '*.png': No such file or directory
[PostBuildScript] - [INFO] Executing post build scripts.
[controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins10457371311551646652.sh
[PostBuildScript] - [INFO] Executing post build scripts.
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties content
OS_CLOUD=vex
OS_STACK_NAME=releng-controller-csit-3node-clustering-tell-all-scandium-91
[EnvInject] - Variables injected successfully.
provisioning config files...
copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
[controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins10724069075048923764.sh
---> openstack-stack-delete.sh
Setup pyenv:
system
3.8.13
3.9.13
3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-DjjA from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
lf-activate-venv(): INFO: Attempting to install with network-safe options...
lf-activate-venv(): INFO: Base packages installed successfully
lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes python-heatclient python-openstackclient urllib3~=1.26.15
lf-activate-venv(): INFO: Adding /tmp/venv-DjjA/bin to PATH
INFO: Stack cost retrieval disabled, setting cost to 0
INFO: Deleting stack releng-controller-csit-3node-clustering-tell-all-scandium-91
Successfully deleted stack releng-controller-csit-3node-clustering-tell-all-scandium-91
[PostBuildScript] - [INFO] Executing post build scripts.
[controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins926865871934600106.sh
---> sysstat.sh
[controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins16184384689874981777.sh
---> package-listing.sh
++ facter osfamily
++ tr '[:upper:]' '[:lower:]'
+ OS_FAMILY=redhat
+ workspace=/w/workspace/controller-csit-3node-clustering-tell-all-scandium
+ START_PACKAGES=/tmp/packages_start.txt
+ END_PACKAGES=/tmp/packages_end.txt
+ DIFF_PACKAGES=/tmp/packages_diff.txt
+ PACKAGES=/tmp/packages_start.txt
+ '[' /w/workspace/controller-csit-3node-clustering-tell-all-scandium ']'
+ PACKAGES=/tmp/packages_end.txt
+ case "${OS_FAMILY}" in
+ rpm -qa
+ sort
+ '[' -f /tmp/packages_start.txt ']'
+ '[' -f /tmp/packages_end.txt ']'
+ diff /tmp/packages_start.txt /tmp/packages_end.txt
+ '[' /w/workspace/controller-csit-3node-clustering-tell-all-scandium ']'
+ mkdir -p /w/workspace/controller-csit-3node-clustering-tell-all-scandium/archives/
+ cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/controller-csit-3node-clustering-tell-all-scandium/archives/
[controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins9353485777676888287.sh
---> capture-instance-metadata.sh
Setup pyenv:
system
3.8.13
3.9.13
3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-DjjA from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
lf-activate-venv(): INFO: Attempting to install with network-safe options...
lf-activate-venv(): INFO: Base packages installed successfully
lf-activate-venv(): INFO: Installing additional packages: lftools
lf-activate-venv(): INFO: Adding /tmp/venv-DjjA/bin to PATH
INFO: Running in OpenStack, capturing instance metadata
[controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins10257168993450986480.sh
provisioning config files...
Could not find credentials [logs] for controller-csit-3node-clustering-tell-all-scandium #91
copy managed file [jenkins-log-archives-settings] to file:/w/workspace/controller-csit-3node-clustering-tell-all-scandium@tmp/config15804992741218527174tmp
Regular expression run condition: Expression=[^.*logs-s3.*], Label=[odl-logs-s3-cloudfront-index]
Run condition [Regular expression match] enabling perform for step [Provide Configuration files]
provisioning config files...
copy managed file [jenkins-s3-log-ship] to file:/home/jenkins/.aws/credentials
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties content
SERVER_ID=logs
[EnvInject] - Variables injected successfully.
[controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins502780272047043435.sh
---> create-netrc.sh
WARN: Log server credential not found.
[controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins1447392942285871099.sh
---> python-tools-install.sh
Setup pyenv:
system
3.8.13
3.9.13
3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-DjjA from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
lf-activate-venv(): INFO: Attempting to install with network-safe options...
lf-activate-venv(): INFO: Base packages installed successfully
lf-activate-venv(): INFO: Installing additional packages: lftools
lf-activate-venv(): INFO: Adding /tmp/venv-DjjA/bin to PATH
[controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins11850585320947283193.sh
---> sudo-logs.sh
Archiving 'sudo' log..
[controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins15824281168087933485.sh
---> job-cost.sh
Setup pyenv:
system
3.8.13
3.9.13
3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-DjjA from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
lf-activate-venv(): INFO: Attempting to install with network-safe options...
lf-activate-venv(): INFO: Base packages installed successfully
lf-activate-venv(): INFO: Installing additional packages: zipp==1.1.0 python-openstackclient urllib3~=1.26.15
lf-activate-venv(): INFO: Adding /tmp/venv-DjjA/bin to PATH
DEBUG: total: 0
INFO: Retrieving Stack Cost...
INFO: Retrieving Pricing Info for: v3-standard-2
INFO: Archiving Costs
[controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash -l /tmp/jenkins15777834637720127857.sh
---> logs-deploy.sh
Setup pyenv:
system
3.8.13
3.9.13
3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-DjjA from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
lf-activate-venv(): INFO: Attempting to install with network-safe options...
lf-activate-venv(): INFO: Base packages installed successfully
lf-activate-venv(): INFO: Installing additional packages: lftools urllib3~=1.26.15
lf-activate-venv(): INFO: Adding /tmp/venv-DjjA/bin to PATH
WARNING: Nexus logging server not set
INFO: S3 path logs/releng/vex-yul-odl-jenkins-1/controller-csit-3node-clustering-tell-all-scandium/91/
INFO: archiving logs to S3
---> uname -a:
Linux prd-centos8-robot-2c-8g-4727.novalocal 4.18.0-553.5.1.el8.x86_64 #1 SMP Tue May 21 05:46:01 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
---> lscpu:
Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Byte Order: Little Endian
CPU(s): 2
On-line CPU(s) list: 0,1
Thread(s) per core: 1
Core(s) per socket: 1
Socket(s): 2
NUMA node(s): 1
Vendor ID: AuthenticAMD
CPU family: 23
Model: 49
Model name: AMD EPYC-Rome Processor
Stepping: 0
CPU MHz: 2799.998
BogoMIPS: 5599.99
Virtualization: AMD-V
Hypervisor vendor: KVM
Virtualization type: full
L1d cache: 32K
L1i cache: 32K
L2 cache: 512K
L3 cache: 16384K
NUMA node0 CPU(s): 0,1
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities
---> nproc:
2
---> df -h:
Filesystem Size Used Avail Use% Mounted on
devtmpfs 3.8G 0 3.8G 0% /dev
tmpfs 3.8G 0 3.8G 0% /dev/shm
tmpfs 3.8G 17M 3.8G 1% /run
tmpfs 3.8G 0 3.8G 0% /sys/fs/cgroup
/dev/vda1 40G 8.5G 32G 22% /
tmpfs 770M 0 770M 0% /run/user/1001
---> free -m:
total used free shared buff/cache available
Mem: 7697 642 4709 19 2345 6756
Swap: 1023 0 1023
---> ip addr:
1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
inet 127.0.0.1/8 scope host lo
valid_lft forever preferred_lft forever
inet6 ::1/128 scope host
valid_lft forever preferred_lft forever
2: eth0: mtu 1458 qdisc mq state UP group default qlen 1000
link/ether fa:16:3e:b7:a8:ea brd ff:ff:ff:ff:ff:ff
altname enp0s3
altname ens3
inet 10.30.170.160/23 brd 10.30.171.255 scope global dynamic noprefixroute eth0
valid_lft 65198sec preferred_lft 65198sec
inet6 fe80::f816:3eff:feb7:a8ea/64 scope link
valid_lft forever preferred_lft forever
---> sar -b -r -n DEV:
Linux 4.18.0-553.5.1.el8.x86_64 (prd-centos8-robot-2c-8g-4727.novalocal) 01/27/2026 _x86_64_ (2 CPU)
12:00:01 AM tps rtps wtps bread/s bwrtn/s
12:01:01 AM 0.92 0.00 0.92 0.00 210.93
12:02:01 AM 0.58 0.08 0.50 1.87 29.01
12:03:01 AM 0.17 0.00 0.17 0.00 1.55
12:04:01 AM 0.23 0.00 0.23 0.00 3.47
12:05:01 AM 0.20 0.00 0.20 0.00 4.83
12:06:01 AM 0.32 0.00 0.32 0.00 4.37
12:07:01 AM 0.15 0.00 0.15 0.00 3.35
12:08:01 AM 0.47 0.07 0.40 7.60 10.71
12:09:01 AM 0.35 0.00 0.35 0.00 11.88
12:10:01 AM 0.13 0.00 0.13 0.00 2.53
12:11:01 AM 0.18 0.00 0.18 0.00 4.18
12:12:01 AM 0.17 0.00 0.17 0.00 2.02
12:13:01 AM 0.28 0.00 0.28 0.00 3.77
12:14:01 AM 0.37 0.00 0.37 0.00 5.23
12:15:01 AM 0.13 0.00 0.13 0.00 2.67
12:16:01 AM 0.13 0.00 0.13 0.00 17.48
12:17:01 AM 0.15 0.00 0.15 0.00 8.68
12:18:01 AM 0.17 0.00 0.17 0.00 16.26
12:19:01 AM 0.32 0.00 0.32 0.00 21.35
12:20:01 AM 0.17 0.00 0.17 0.00 8.81
12:21:01 AM 0.27 0.00 0.27 0.00 17.98
12:22:01 AM 0.23 0.00 0.23 0.00 7.23
12:23:01 AM 0.20 0.00 0.20 0.00 3.03
12:24:01 AM 0.25 0.00 0.25 0.00 3.77
12:25:01 AM 0.18 0.00 0.18 0.00 8.43
12:26:01 AM 0.13 0.00 0.13 0.00 13.86
12:27:01 AM 0.15 0.00 0.15 0.00 15.21
12:28:01 AM 0.25 0.00 0.25 0.00 10.76
12:29:01 AM 0.22 0.00 0.22 0.00 18.43
12:30:01 AM 0.28 0.00 0.28 0.00 19.99
12:31:01 AM 0.38 0.00 0.38 0.00 16.95
12:32:01 AM 0.13 0.00 0.13 0.00 17.71
12:33:01 AM 0.27 0.00 0.27 0.00 7.15
12:34:01 AM 0.25 0.00 0.25 0.00 3.35
12:35:01 AM 0.17 0.00 0.17 0.00 4.12
12:36:01 AM 0.10 0.00 0.10 0.00 0.80
12:37:01 AM 0.23 0.00 0.23 0.00 5.08
12:38:01 AM 0.68 0.32 0.37 6.93 5.12
12:39:01 AM 1.08 0.00 1.08 0.00 28.53
12:40:01 AM 0.40 0.00 0.40 0.00 7.91
12:41:01 AM 0.30 0.00 0.30 0.00 4.07
12:42:01 AM 0.20 0.00 0.20 0.00 3.07
12:43:01 AM 0.20 0.00 0.20 0.00 4.60
12:44:01 AM 0.27 0.00 0.27 0.00 20.44
12:45:01 AM 0.18 0.00 0.18 0.00 14.43
12:46:01 AM 0.20 0.00 0.20 0.00 9.42
12:47:01 AM 0.13 0.00 0.13 0.00 16.13
12:48:01 AM 0.23 0.00 0.23 0.00 17.93
12:49:01 AM 0.37 0.00 0.37 0.00 18.03
12:50:01 AM 0.48 0.00 0.48 0.00 10.66
12:51:01 AM 0.18 0.00 0.18 0.00 6.58
12:52:01 AM 0.20 0.00 0.20 0.00 17.48
12:53:01 AM 0.52 0.00 0.52 0.00 17.38
12:54:01 AM 0.62 0.00 0.62 0.00 19.65
12:55:01 AM 0.47 0.00 0.47 0.00 16.34
12:56:01 AM 0.50 0.00 0.50 0.00 16.13
12:57:01 AM 0.60 0.00 0.60 0.00 17.96
12:58:01 AM 0.40 0.00 0.40 0.00 11.71
12:59:01 AM 0.42 0.00 0.42 0.00 16.31
01:00:01 AM 0.15 0.00 0.15 0.00 14.57
01:01:01 AM 0.17 0.00 0.17 0.00 10.03
01:02:01 AM 0.95 0.00 0.95 0.00 29.46
01:03:01 AM 0.35 0.00 0.35 0.00 11.85
01:04:01 AM 0.28 0.00 0.28 0.00 19.05
01:05:01 AM 0.27 0.00 0.27 0.00 27.88
01:06:01 AM 0.40 0.00 0.40 0.00 7.43
01:07:01 AM 0.33 0.00 0.33 0.00 3.72
01:08:01 AM 0.37 0.00 0.37 0.00 6.66
01:09:01 AM 0.45 0.00 0.45 0.00 6.63
01:10:01 AM 0.30 0.00 0.30 0.00 5.56
01:11:01 AM 0.40 0.00 0.40 0.00 5.08
01:12:01 AM 0.45 0.00 0.45 0.00 9.90
01:13:01 AM 0.17 0.00 0.17 0.00 4.37
01:14:01 AM 0.28 0.00 0.28 0.00 6.25
01:15:01 AM 0.13 0.00 0.13 0.00 1.43
01:16:01 AM 0.12 0.00 0.12 0.00 2.92
01:17:01 AM 0.13 0.00 0.13 0.00 10.86
01:18:01 AM 0.23 0.00 0.23 0.00 17.21
01:19:01 AM 0.48 0.00 0.48 0.00 23.41
01:20:01 AM 0.27 0.00 0.27 0.00 14.95
01:21:01 AM 0.57 0.00 0.57 0.00 18.53
01:22:01 AM 0.23 0.00 0.23 0.00 10.51
01:23:01 AM 0.17 0.00 0.17 0.00 12.23
01:24:01 AM 0.28 0.00 0.28 0.00 10.25
01:25:01 AM 0.17 0.00 0.17 0.00 12.13
01:26:01 AM 0.22 0.00 0.22 0.00 17.88
01:27:01 AM 0.17 0.00 0.17 0.00 9.23
01:28:01 AM 0.20 0.00 0.20 0.00 17.20
01:29:01 AM 0.40 0.00 0.40 0.00 18.18
01:30:01 AM 0.20 0.00 0.20 0.00 15.64
01:31:01 AM 0.17 0.00 0.17 0.00 21.76
01:32:01 AM 0.22 0.00 0.22 0.00 6.93
01:33:01 AM 0.27 0.00 0.27 0.00 3.17
01:34:01 AM 0.33 0.00 0.33 0.00 7.37
01:35:01 AM 0.17 0.00 0.17 0.00 1.62
01:36:01 AM 0.12 0.00 0.12 0.00 3.08
01:37:01 AM 0.15 0.00 0.15 0.00 1.58
01:38:01 AM 0.23 0.00 0.23 0.00 3.78
01:39:01 AM 0.45 0.00 0.45 0.00 13.75
01:40:01 AM 0.28 0.00 0.28 0.00 5.48
01:41:01 AM 0.22 0.00 0.22 0.00 2.98
01:42:01 AM 0.27 0.00 0.27 0.00 5.65
01:43:01 AM 0.25 0.00 0.25 0.00 3.62
01:44:01 AM 0.25 0.00 0.25 0.00 6.03
01:45:01 AM 0.12 0.00 0.12 0.00 1.97
01:46:01 AM 0.13 0.00 0.13 0.00 3.72
01:47:01 AM 0.12 0.00 0.12 0.00 0.82
01:48:01 AM 0.28 0.00 0.28 0.00 6.98
01:49:01 AM 0.23 0.00 0.23 0.00 4.18
01:50:01 AM 0.22 0.00 0.22 0.00 2.43
01:51:01 AM 0.25 0.00 0.25 0.00 5.42
01:52:01 AM 0.17 0.00 0.17 0.00 2.40
01:53:01 AM 0.28 0.00 0.28 0.00 6.75
01:54:01 AM 0.23 0.00 0.23 0.00 3.22
01:55:01 AM 0.18 0.00 0.18 0.00 13.50
01:56:01 AM 0.12 0.00 0.12 0.00 8.40
01:57:01 AM 0.52 0.00 0.52 0.00 23.63
01:58:01 AM 0.57 0.00 0.57 0.00 18.71
01:59:01 AM 0.58 0.00 0.58 0.00 20.15
02:00:01 AM 0.18 0.00 0.18 0.00 12.98
02:01:01 AM 0.18 0.00 0.18 0.00 8.97
02:02:01 AM 0.53 0.00 0.53 0.00 14.73
02:03:01 AM 0.37 0.00 0.37 0.00 4.00
02:04:01 AM 0.43 0.00 0.43 0.00 8.80
02:05:01 AM 0.35 0.00 0.35 0.00 3.98
02:06:01 AM 0.40 0.00 0.40 0.00 7.78
02:07:01 AM 0.38 0.00 0.38 0.00 4.05
02:08:01 AM 0.30 0.00 0.30 0.00 4.37
02:09:01 AM 0.30 0.00 0.30 0.00 6.12
02:10:01 AM 0.18 0.00 0.18 0.00 2.48
02:11:01 AM 0.23 0.00 0.23 0.00 5.90
02:12:01 AM 0.27 0.00 0.27 0.00 4.32
02:13:01 AM 0.87 0.00 0.87 0.00 15.66
02:14:01 AM 0.47 0.00 0.47 0.00 7.98
02:15:01 AM 0.32 0.00 0.32 0.00 7.57
02:16:01 AM 0.30 0.00 0.30 0.00 19.33
02:17:01 AM 0.48 0.00 0.48 0.00 16.69
02:18:01 AM 0.53 0.00 0.53 0.00 17.61
02:19:01 AM 0.67 0.00 0.67 0.00 21.08
02:20:01 AM 0.52 0.00 0.52 0.00 17.98
02:21:01 AM 0.63 0.00 0.63 0.00 21.20
02:22:01 AM 0.28 0.00 0.28 0.00 6.70
02:23:01 AM 0.17 0.00 0.17 0.00 1.97
02:24:01 AM 0.32 0.00 0.32 0.00 4.63
02:25:01 AM 0.15 0.00 0.15 0.00 4.28
02:26:01 AM 0.15 0.00 0.15 0.00 1.45
02:27:01 AM 0.12 0.00 0.12 0.00 3.87
02:28:01 AM 0.15 0.00 0.15 0.00 1.95
02:29:01 AM 0.25 0.00 0.25 0.00 6.95
02:30:01 AM 0.22 0.00 0.22 0.00 1.92
02:31:01 AM 0.25 0.00 0.25 0.00 5.97
02:32:01 AM 0.27 0.00 0.27 0.00 3.62
02:33:01 AM 0.17 0.00 0.17 0.00 4.77
02:34:01 AM 0.27 0.00 0.27 0.00 4.10
02:35:01 AM 0.13 0.00 0.13 0.00 4.53
02:36:01 AM 0.13 0.00 0.13 0.00 18.13
02:37:01 AM 0.12 0.00 0.12 0.00 8.40
02:38:01 AM 0.25 0.00 0.25 0.00 18.39
02:39:01 AM 0.28 0.00 0.28 0.00 19.73
02:40:01 AM 0.17 0.00 0.17 0.00 10.80
02:41:01 AM 0.17 0.00 0.17 0.00 18.21
02:42:01 AM 0.25 0.00 0.25 0.00 6.60
02:43:01 AM 0.17 0.00 0.17 0.00 1.93
02:44:01 AM 0.25 0.00 0.25 0.00 4.12
02:45:01 AM 0.28 0.00 0.28 0.00 6.57
02:46:01 AM 0.15 0.00 0.15 0.00 1.50
02:47:01 AM 0.18 0.00 0.18 0.00 5.33
02:48:01 AM 0.13 0.00 0.13 0.00 1.28
02:49:01 AM 0.25 0.00 0.25 0.00 7.32
02:50:01 AM 0.13 0.00 0.13 0.00 1.43
02:51:01 AM 0.15 0.00 0.15 0.00 4.17
02:52:01 AM 0.23 0.00 0.23 0.00 4.28
02:53:01 AM 0.35 0.00 0.35 0.00 7.98
02:54:01 AM 0.23 0.00 0.23 0.00 3.10
02:55:01 AM 0.15 0.00 0.15 0.00 9.48
02:56:01 AM 0.18 0.00 0.18 0.00 16.41
02:57:01 AM 0.13 0.00 0.13 0.00 8.70
02:58:01 AM 0.27 0.00 0.27 0.00 17.03
02:59:01 AM 0.22 0.00 0.22 0.00 17.76
03:00:01 AM 0.13 0.00 0.13 0.00 8.68
03:01:01 AM 0.30 0.00 0.30 0.00 16.86
03:02:01 AM 0.22 0.00 0.22 0.00 26.54
03:03:01 AM 0.27 0.00 0.27 0.00 6.08
03:04:01 AM 0.22 0.00 0.22 0.00 3.22
03:05:01 AM 0.13 0.00 0.13 0.00 3.75
03:06:01 AM 0.23 0.00 0.23 0.00 3.08
03:07:01 AM 0.17 0.00 0.17 0.00 4.02
03:08:01 AM 0.20 0.00 0.20 0.00 2.85
03:09:01 AM 0.20 0.00 0.20 0.00 9.50
03:10:01 AM 0.15 0.00 0.15 0.00 2.70
03:11:01 AM 0.22 0.00 0.22 0.00 4.74
03:12:01 AM 0.18 0.00 0.18 0.00 2.22
03:13:01 AM 0.33 0.00 0.33 0.00 7.08
03:14:01 AM 0.25 0.00 0.25 0.00 18.96
03:15:01 AM 0.13 0.00 0.13 0.00 8.53
03:16:01 AM 0.18 0.00 0.18 0.00 15.78
03:17:01 AM 0.20 0.00 0.20 0.00 18.94
03:18:02 AM 0.35 0.00 0.35 0.00 15.80
03:19:01 AM 0.27 0.00 0.27 0.00 15.15
03:20:01 AM 0.32 0.00 0.32 0.00 6.13
03:21:01 AM 0.25 0.00 0.25 0.00 8.38
03:22:01 AM 0.28 0.00 0.28 0.00 18.58
03:23:01 AM 0.57 0.00 0.57 0.00 19.33
03:24:01 AM 0.72 0.00 0.72 0.00 21.50
03:25:01 AM 0.25 0.00 0.25 0.00 13.08
03:26:01 AM 0.13 0.00 0.13 0.00 15.06
03:27:01 AM 0.13 0.00 0.13 0.00 7.73
03:28:01 AM 0.23 0.00 0.23 0.00 11.75
03:29:01 AM 0.23 0.00 0.23 0.00 12.51
03:30:01 AM 0.32 0.00 0.32 0.00 20.67
03:31:01 AM 0.60 0.00 0.60 0.00 18.94
03:32:01 AM 0.20 0.00 0.20 0.00 13.58
03:33:01 AM 0.30 0.00 0.30 0.00 16.09
03:34:01 AM 0.30 0.00 0.30 0.00 17.48
03:35:01 AM 0.17 0.00 0.17 0.00 13.08
03:36:01 AM 1.10 0.00 1.10 0.00 31.36
03:37:01 AM 0.25 0.00 0.25 0.00 3.52
03:38:01 AM 0.22 0.00 0.22 0.00 4.65
03:39:01 AM 0.35 0.00 0.35 0.00 5.77
03:40:01 AM 0.15 0.00 0.15 0.00 1.87
03:41:01 AM 0.18 0.00 0.18 0.00 4.42
03:42:01 AM 0.13 0.00 0.13 0.00 1.83
03:43:01 AM 0.18 0.00 0.18 0.00 9.05
03:44:01 AM 0.30 0.00 0.30 0.00 8.83
03:45:01 AM 0.15 0.00 0.15 0.00 1.97
03:46:01 AM 0.18 0.00 0.18 0.00 2.30
03:47:01 AM 0.22 0.00 0.22 0.00 5.50
03:48:01 AM 0.20 0.00 0.20 0.00 4.17
03:49:01 AM 0.45 0.00 0.45 0.00 13.73
03:50:01 AM 0.32 0.00 0.32 0.00 4.12
03:51:01 AM 0.37 0.00 0.37 0.00 4.10
03:52:01 AM 0.17 0.00 0.17 0.00 6.78
03:53:01 AM 0.25 0.00 0.25 0.00 11.30
03:54:01 AM 0.68 0.00 0.68 0.00 27.06
03:55:01 AM 0.42 0.00 0.42 0.00 15.73
03:56:01 AM 0.17 0.00 0.17 0.00 10.78
03:57:01 AM 0.15 0.00 0.15 0.00 16.26
03:58:01 AM 0.17 0.00 0.17 0.00 16.55
03:59:01 AM 0.35 0.00 0.35 0.00 24.56
04:00:01 AM 0.45 0.00 0.45 0.00 13.86
04:01:01 AM 0.33 0.00 0.33 0.00 13.33
04:02:01 AM 0.12 0.00 0.12 0.00 7.06
04:03:01 AM 0.25 0.00 0.25 0.00 16.31
04:04:01 AM 0.23 0.00 0.23 0.00 9.77
04:05:01 AM 0.18 0.00 0.18 0.00 15.10
04:06:01 AM 0.15 0.00 0.15 0.00 2.70
04:07:01 AM 0.23 0.00 0.23 0.00 10.01
04:08:01 AM 0.28 0.00 0.28 0.00 6.35
04:09:01 AM 0.23 0.00 0.23 0.00 6.33
04:10:01 AM 0.18 0.00 0.18 0.00 12.18
04:11:01 AM 0.25 0.00 0.25 0.00 8.06
04:12:01 AM 0.15 0.00 0.15 0.00 16.79
04:13:01 AM 0.27 0.00 0.27 0.00 18.88
04:14:01 AM 0.40 0.00 0.40 0.00 16.55
04:15:01 AM 0.15 0.00 0.15 0.00 10.66
04:16:01 AM 0.13 0.00 0.13 0.00 16.83
04:17:01 AM 0.23 0.00 0.23 0.00 28.55
04:18:01 AM 0.42 0.00 0.42 0.00 7.55
04:19:01 AM 0.40 0.00 0.40 0.00 5.58
04:20:01 AM 0.25 0.00 0.25 0.00 4.95
04:21:01 AM 0.28 0.00 0.28 0.00 3.86
04:22:01 AM 0.30 0.00 0.30 0.00 4.32
04:23:01 AM 0.28 0.00 0.28 0.00 6.33
04:24:01 AM 0.22 0.00 0.22 0.00 3.35
04:25:01 AM 0.13 0.00 0.13 0.00 8.67
04:26:01 AM 0.15 0.00 0.15 0.00 6.48
04:27:01 AM 0.23 0.00 0.23 0.00 3.07
04:28:01 AM 0.23 0.00 0.23 0.00 3.05
04:29:02 AM 0.27 0.00 0.27 0.00 6.20
04:30:01 AM 0.14 0.00 0.14 0.00 2.51
04:31:01 AM 0.22 0.00 0.22 0.00 7.31
04:32:01 AM 0.33 0.00 0.33 0.00 5.67
04:33:01 AM 0.38 0.00 0.38 0.00 9.65
04:34:01 AM 0.30 0.00 0.30 0.00 16.76
04:35:01 AM 0.18 0.00 0.18 0.00 17.71
04:36:01 AM 0.13 0.00 0.13 0.00 8.92
04:37:01 AM 0.22 0.00 0.22 0.00 21.33
04:38:01 AM 0.68 0.00 0.68 0.00 20.94
04:39:01 AM 0.33 0.00 0.33 0.00 16.38
04:40:01 AM 0.18 0.00 0.18 0.00 22.53
04:41:01 AM 0.38 0.00 0.38 0.00 4.78
04:42:01 AM 0.33 0.00 0.33 0.00 3.95
04:43:01 AM 0.28 0.00 0.28 0.00 5.62
04:44:01 AM 0.27 0.00 0.27 0.00 3.85
04:45:01 AM 0.27 0.00 0.27 0.00 6.01
04:46:01 AM 0.20 0.00 0.20 0.00 2.43
04:47:01 AM 0.13 0.00 0.13 0.00 6.51
04:48:01 AM 0.17 0.00 0.17 0.00 13.86
04:49:01 AM 0.27 0.00 0.27 0.00 18.53
04:50:01 AM 0.13 0.00 0.13 0.00 12.55
04:51:01 AM 0.22 0.00 0.22 0.00 15.80
04:52:01 AM 0.28 0.00 0.28 0.00 16.28
04:53:01 AM 0.22 0.00 0.22 0.00 14.31
04:54:01 AM 0.33 0.00 0.33 0.00 17.46
04:55:01 AM 10.86 0.28 10.58 33.86 501.72
04:56:01 AM 33.22 0.42 32.81 48.25 4052.77
Average: 0.42 0.00 0.42 0.33 26.19
12:00:01 AM kbmemfree kbavail kbmemused %memused kbbuffers kbcached kbcommit %commit kbactive kbinact kbdirty
12:01:01 AM 4852924 6986984 3029508 38.43 2688 2300304 768952 8.61 270968 2372052 40
12:02:01 AM 4852188 6986896 3030244 38.44 2688 2300952 753476 8.44 271100 2372780 4
12:03:01 AM 4852728 6987436 3029704 38.44 2688 2300952 753476 8.44 271100 2372372 4
12:04:01 AM 4852664 6987380 3029768 38.44 2688 2300960 753476 8.44 271100 2372632 16
12:05:01 AM 4852744 6987536 3029688 38.44 2688 2301036 753476 8.44 271100 2372584 4
12:06:01 AM 4852336 6987128 3030096 38.44 2688 2301036 753476 8.44 271100 2372848 4
12:07:01 AM 4851988 6986848 3030444 38.45 2688 2301104 747636 8.37 271100 2372972 4
12:08:01 AM 4852160 6987372 3030272 38.44 2688 2301456 754328 8.45 271188 2372928 4
12:09:01 AM 4851980 6987376 3030452 38.45 2688 2301640 754328 8.45 271188 2373180 16
12:10:01 AM 4851628 6987136 3030804 38.45 2688 2301752 755812 8.46 271188 2373232 80
12:11:01 AM 4851896 6987392 3030536 38.45 2688 2301756 755812 8.46 271188 2373116 4
12:12:01 AM 4851944 6987440 3030488 38.45 2688 2301756 755812 8.46 271188 2373116 4
12:13:01 AM 4851972 6987488 3030460 38.45 2688 2301776 755812 8.46 271188 2373140 4
12:14:01 AM 4852076 6987600 3030356 38.44 2688 2301784 755812 8.46 271188 2373216 8
12:15:01 AM 4851652 6987392 3030780 38.45 2688 2302008 771220 8.64 271188 2373476 184
12:16:01 AM 4851472 6987592 3030960 38.45 2688 2302388 771220 8.64 271188 2373856 68
12:17:01 AM 4851236 6987732 3031196 38.46 2688 2302764 771220 8.64 271188 2374116 216
12:18:01 AM 4850724 6987600 3031708 38.46 2688 2303144 771220 8.64 271188 2374496 144
12:19:01 AM 4850340 6987596 3032092 38.47 2688 2303524 754988 8.45 271188 2374956 116
12:20:01 AM 4849732 6987372 3032700 38.47 2688 2303900 759580 8.50 271188 2375412 156
12:21:01 AM 4849572 6987592 3032860 38.48 2688 2304280 759580 8.50 271264 2375600 84
12:22:01 AM 4849020 6987104 3033412 38.48 2688 2304360 759580 8.50 271300 2376036 48
12:23:01 AM 4849448 6987556 3032984 38.48 2688 2304368 759580 8.50 271300 2375768 4
12:24:01 AM 4849300 6987508 3033132 38.48 2688 2304468 759580 8.50 271308 2375900 96
12:25:01 AM 4848956 6987392 3033476 38.48 2688 2304696 759580 8.50 271300 2376204 124
12:26:01 AM 4849004 6987808 3033428 38.48 2688 2305072 759580 8.50 271300 2376352 116
12:27:01 AM 4848392 6987588 3034040 38.49 2688 2305452 759580 8.50 271300 2376792 68
12:28:01 AM 4848180 6987744 3034252 38.49 2688 2305828 759580 8.50 271300 2377212 216
12:29:01 AM 4847492 6987432 3034940 38.50 2688 2306204 759580 8.50 271300 2377656 144
12:30:01 AM 4846684 6987008 3035748 38.51 2688 2306580 758468 8.49 271300 2378100 4
12:31:01 AM 4846520 6987224 3035912 38.51 2688 2306960 758468 8.49 271300 2378476 24
12:32:01 AM 4846088 6987356 3036344 38.52 2688 2307524 758468 8.49 271300 2378924 96
12:33:01 AM 4846072 6987344 3036360 38.52 2688 2307528 758468 8.49 271300 2379136 4
12:34:01 AM 4845864 6987212 3036568 38.52 2688 2307604 758468 8.49 271300 2379156 84
12:35:01 AM 4846156 6987504 3036276 38.52 2688 2307604 758468 8.49 271300 2379020 4
12:36:01 AM 4845964 6987316 3036468 38.52 2688 2307608 758468 8.49 271300 2379024 4
12:37:01 AM 4846188 6987612 3036244 38.52 2688 2307680 758468 8.49 271300 2379096 4
12:38:01 AM 4845532 6987152 3036900 38.53 2688 2307876 758468 8.49 271412 2379476 12
12:39:01 AM 4845248 6987056 3037184 38.53 2688 2308064 758468 8.49 271412 2379464 4
12:40:01 AM 4844448 6986364 3037984 38.54 2688 2308172 758468 8.49 271412 2380192 4
12:41:01 AM 4844744 6986668 3037688 38.54 2688 2308180 758468 8.49 271412 2380100 0
12:42:01 AM 4844460 6986432 3037972 38.54 2688 2308228 758468 8.49 271412 2380376 68
12:43:01 AM 4844300 6986468 3038132 38.54 2688 2308432 758468 8.49 271412 2380664 212
12:44:01 AM 4843664 6986212 3038768 38.55 2688 2308812 758468 8.49 271412 2381044 84
12:45:01 AM 4843796 6986720 3038636 38.55 2688 2309188 758468 8.49 271412 2381216 68
12:46:01 AM 4843344 6986644 3039088 38.56 2688 2309564 758468 8.49 271412 2381596 220
12:47:01 AM 4842868 6986548 3039564 38.56 2688 2309944 758468 8.49 271412 2381976 144
12:48:01 AM 4842680 6986736 3039752 38.56 2688 2310320 758468 8.49 271412 2382364 72
12:49:01 AM 4842328 6986736 3040104 38.57 2688 2310664 758468 8.49 271412 2382788 4
12:50:01 AM 4842584 6987132 3039848 38.56 2688 2310804 755360 8.46 271412 2382512 4
12:51:01 AM 4841892 6986700 3040540 38.57 2688 2311072 755360 8.46 271412 2383140 116
12:52:01 AM 4841404 6986592 3041028 38.58 2688 2311452 755360 8.46 271412 2383692 40
12:53:01 AM 4840876 6986440 3041556 38.59 2688 2311828 755360 8.46 271412 2384068 40
12:54:01 AM 4840400 6986340 3042032 38.59 2688 2312204 755360 8.46 271412 2384512 24
12:55:01 AM 4839976 6986300 3042456 38.60 2688 2312584 755360 8.46 271412 2384940 24
12:56:01 AM 4839484 6986184 3042948 38.60 2688 2312960 755360 8.46 271412 2385320 40
12:57:01 AM 4839372 6986388 3043060 38.61 2688 2313268 755360 8.46 271412 2385520 16
12:58:01 AM 4839112 6986368 3043320 38.61 2688 2313508 755360 8.46 271440 2385872 8
12:59:01 AM 4838508 6986112 3043924 38.62 2688 2313860 755360 8.46 271440 2386332 68
01:00:01 AM 4838944 6986924 3043488 38.61 2688 2314236 750592 8.40 271440 2386108 40
01:01:01 AM 4837376 6985720 3045056 38.63 2688 2314600 750592 8.40 271440 2387284 144
01:02:01 AM 4837372 6986104 3045060 38.63 2688 2314980 759104 8.50 281312 2377348 40
01:03:01 AM 4837164 6986268 3045268 38.63 2688 2315360 759104 8.50 281312 2377720 220
01:04:01 AM 4835660 6985140 3046772 38.65 2688 2315736 759104 8.50 281312 2378372 144
01:05:01 AM 4836120 6986228 3046312 38.65 2688 2316364 759104 8.50 281312 2378880 28
01:06:01 AM 4836128 6986312 3046304 38.65 2688 2316432 759104 8.50 281312 2378824 4
01:07:01 AM 4835844 6986032 3046588 38.65 2688 2316436 742876 8.32 281312 2379016 16
01:08:01 AM 4836012 6986280 3046420 38.65 2688 2316516 742876 8.32 281312 2378912 4
01:09:01 AM 4836140 6986408 3046292 38.65 2688 2316516 742876 8.32 281312 2378980 4
01:10:01 AM 4836004 6986348 3046428 38.65 2688 2316592 740728 8.29 281312 2379104 4
01:11:01 AM 4835744 6986088 3046688 38.65 2688 2316592 740728 8.29 281312 2379264 4
01:12:01 AM 4835944 6986464 3046488 38.65 2688 2316768 740728 8.29 281312 2379180 56
01:13:01 AM 4835604 6986180 3046828 38.65 2688 2316824 757748 8.48 281312 2379260 16
01:14:01 AM 4835700 6986336 3046732 38.65 2688 2316884 757748 8.48 281312 2379376 4
01:15:01 AM 4835624 6986264 3046808 38.65 2688 2316888 757748 8.48 281312 2379312 4
01:16:01 AM 4835548 6986252 3046884 38.65 2688 2316952 757748 8.48 281312 2379368 4
01:17:01 AM 4835004 6986136 3047428 38.66 2688 2317388 757748 8.48 281312 2380116 160
01:18:01 AM 4835148 6986668 3047284 38.66 2688 2317776 757748 8.48 281312 2380080 88
01:19:01 AM 4834024 6985940 3048408 38.67 2688 2318172 757748 8.48 281308 2380840 24
01:20:01 AM 4834236 6986532 3048196 38.67 2688 2318552 756664 8.47 281308 2380852 40
01:21:01 AM 4834140 6986820 3048292 38.67 2688 2318936 756664 8.47 281308 2381076 36
01:22:01 AM 4833444 6986512 3048988 38.68 2688 2319320 756664 8.47 281308 2381696 192
01:23:01 AM 4833472 6986692 3048960 38.68 2688 2319464 756664 8.47 281308 2381868 24
01:24:01 AM 4833056 6986528 3049376 38.69 2688 2319716 756664 8.47 281308 2382052 72
01:25:01 AM 4832748 6986584 3049684 38.69 2688 2320088 756664 8.47 281308 2382464 112
01:26:01 AM 4832384 6986608 3050048 38.69 2688 2320476 756664 8.47 281308 2382736 40
01:27:01 AM 4831640 6986260 3050792 38.70 2688 2320872 756664 8.47 281308 2383540 220
01:28:01 AM 4831224 6986224 3051208 38.71 2688 2321252 756664 8.47 281308 2383764 132
01:29:01 AM 4830972 6986344 3051460 38.71 2688 2321624 756664 8.47 281308 2384068 116
01:30:01 AM 4830668 6986428 3051764 38.72 2688 2322004 739760 8.28 281308 2384388 72
01:31:01 AM 4830152 6986576 3052280 38.72 2688 2322664 739760 8.28 281308 2384924 112
01:32:01 AM 4830108 6986532 3052324 38.72 2688 2322664 739760 8.28 281308 2384960 4
01:33:01 AM 4829568 6985996 3052864 38.73 2688 2322668 739760 8.28 281308 2385440 4
01:34:01 AM 4829988 6986500 3052444 38.72 2688 2322752 739760 8.28 281308 2385140 4
01:35:01 AM 4830024 6986536 3052408 38.72 2688 2322752 739760 8.28 281308 2385188 4
01:36:01 AM 4830080 6986660 3052352 38.72 2688 2322820 739760 8.28 281308 2385256 4
01:37:01 AM 4829984 6986572 3052448 38.72 2688 2322824 739760 8.28 281308 2385144 4
01:38:01 AM 4829452 6986216 3052980 38.73 2688 2323000 739760 8.28 281308 2385596 192
01:39:01 AM 4829768 6986588 3052664 38.73 2688 2323056 739760 8.28 281308 2385464 8
01:40:01 AM 4828736 6985620 3053696 38.74 2688 2323120 756768 8.47 281308 2386044 16
01:41:01 AM 4829228 6986112 3053204 38.73 2688 2323120 756768 8.47 281308 2385748 8
01:42:01 AM 4828968 6985924 3053464 38.74 2688 2323192 756768 8.47 281308 2386136 4
01:43:01 AM 4828840 6985800 3053592 38.74 2688 2323196 756768 8.47 281308 2386140 4
01:44:01 AM 4828692 6985736 3053740 38.74 2688 2323280 756768 8.47 281308 2386228 4
01:45:01 AM 4828620 6985664 3053812 38.74 2688 2323280 756768 8.47 281308 2386436 4
01:46:01 AM 4828352 6985476 3054080 38.75 2688 2323360 756768 8.47 281308 2386520 4
01:47:01 AM 4828652 6985776 3053780 38.74 2688 2323360 756768 8.47 281308 2386248 4
01:48:01 AM 4828724 6985932 3053708 38.74 2688 2323444 756768 8.47 281308 2386448 4
01:49:01 AM 4828668 6985880 3053764 38.74 2688 2323448 756768 8.47 281308 2386404 4
01:50:01 AM 4828496 6985784 3053936 38.74 2688 2323524 772680 8.65 281308 2386528 84
01:51:01 AM 4828488 6985784 3053944 38.74 2688 2323528 756184 8.47 281308 2386416 4
01:52:01 AM 4828152 6985536 3054280 38.75 2688 2323616 756184 8.47 281308 2386820 96
01:53:01 AM 4828424 6985808 3054008 38.74 2688 2323616 756184 8.47 281308 2386548 4
01:54:01 AM 4828376 6985832 3054056 38.75 2688 2323688 756184 8.47 281316 2386672 76
01:55:01 AM 4828260 6986020 3054172 38.75 2688 2324000 756184 8.47 281316 2387016 24
01:56:01 AM 4827600 6985740 3054832 38.75 2688 2324372 756184 8.47 281316 2387412 168
01:57:01 AM 4827072 6985584 3055360 38.76 2688 2324752 756184 8.47 281316 2387896 24
01:58:01 AM 4826640 6985532 3055792 38.77 2688 2325132 771848 8.64 281316 2388440 24
01:59:01 AM 4826160 6985436 3056272 38.77 2688 2325516 771848 8.64 281316 2388824 4
02:00:01 AM 4826828 6986488 3055604 38.76 2688 2325900 747384 8.37 281316 2388588 68
02:01:01 AM 4825108 6985064 3057324 38.79 2688 2326188 747384 8.37 281316 2389812 124
02:02:01 AM 4825832 6985900 3056600 38.78 2688 2326300 747384 8.37 281332 2389452 4
02:03:01 AM 4825640 6985708 3056792 38.78 2688 2326300 747384 8.37 281332 2389452 4
02:04:01 AM 4825456 6985620 3056976 38.78 2688 2326396 747384 8.37 281332 2389752 4
02:05:01 AM 4825564 6985732 3056868 38.78 2688 2326400 747384 8.37 281332 2389436 4
02:06:01 AM 4825496 6985756 3056936 38.78 2688 2326492 747384 8.37 281332 2389528 4
02:07:01 AM 4825464 6985724 3056968 38.78 2688 2326492 747384 8.37 281332 2389644 4
02:08:01 AM 4824688 6985044 3057744 38.79 2688 2326588 747384 8.37 281332 2389616 40
02:09:01 AM 4824908 6985264 3057524 38.79 2688 2326588 747384 8.37 281332 2389648 8
02:10:01 AM 4824772 6985220 3057660 38.79 2688 2326680 762240 8.53 281332 2389780 100
02:11:01 AM 4824720 6985176 3057712 38.79 2688 2326684 762240 8.53 281332 2389676 4
02:12:01 AM 4824840 6985296 3057592 38.79 2688 2326684 758144 8.49 281412 2389604 244
02:13:01 AM 4824800 6985352 3057632 38.79 2688 2326780 758144 8.49 281412 2389700 4
02:14:01 AM 4824904 6985460 3057528 38.79 2688 2326784 758144 8.49 281412 2389776 4
02:15:01 AM 4825000 6985788 3057432 38.79 2688 2327016 758144 8.49 281412 2389928 132
02:16:01 AM 4824840 6986024 3057592 38.79 2688 2327420 758144 8.49 281412 2390356 24
02:17:01 AM 4824020 6985588 3058412 38.80 2688 2327804 758144 8.49 281412 2390936 40
02:18:01 AM 4823296 6985244 3059136 38.81 2688 2328184 758144 8.49 281412 2391728 40
02:19:01 AM 4822900 6985236 3059532 38.81 2688 2328568 758144 8.49 281412 2392092 24
02:20:01 AM 4822316 6985036 3060116 38.82 2688 2328948 761940 8.53 281412 2392400 36
02:21:01 AM 4822316 6985456 3060116 38.82 2688 2329356 761940 8.53 281412 2392696 4
02:22:01 AM 4822344 6985600 3060088 38.82 2688 2329472 761940 8.53 281412 2392820 4
02:23:01 AM 4822100 6985356 3060332 38.82 2688 2329472 761940 8.53 281412 2392820 4
02:24:01 AM 4821808 6985152 3060624 38.83 2688 2329564 761940 8.53 281412 2392980 100
02:25:01 AM 4822012 6985360 3060420 38.83 2688 2329568 761940 8.53 281412 2392916 4
02:26:01 AM 4821820 6985260 3060612 38.83 2688 2329660 761940 8.53 281412 2393124 100
02:27:01 AM 4822020 6985460 3060412 38.83 2688 2329660 761940 8.53 281412 2393008 4
02:28:01 AM 4821360 6984896 3061072 38.83 2688 2329756 761940 8.53 281412 2393452 100
02:29:01 AM 4821524 6985060 3060908 38.83 2688 2329756 761940 8.53 281412 2393316 4
02:30:01 AM 4821428 6985056 3061004 38.83 2688 2329848 741760 8.31 281412 2393332 100
02:31:01 AM 4821696 6985328 3060736 38.83 2688 2329852 741760 8.31 281412 2393232 4
02:32:01 AM 4821712 6985344 3060720 38.83 2688 2329852 741760 8.31 281412 2393232 4
02:33:01 AM 4821372 6985100 3061060 38.83 2688 2329948 741760 8.31 281412 2393552 4
02:34:01 AM 4821480 6985208 3060952 38.83 2688 2329948 741760 8.31 281412 2393420 4
02:35:01 AM 4821040 6985020 3061392 38.84 2688 2330200 757136 8.48 281412 2393712 152
02:36:01 AM 4820684 6985044 3061748 38.84 2688 2330588 757136 8.48 281412 2394176 24
02:37:01 AM 4820484 6985232 3061948 38.85 2688 2330968 757136 8.48 281412 2394668 176
02:38:01 AM 4819928 6985048 3062504 38.85 2688 2331348 757136 8.48 281412 2395248 100
02:39:01 AM 4819376 6984884 3063056 38.86 2688 2331732 757136 8.48 281412 2395468 20
02:40:01 AM 4818940 6984832 3063492 38.86 2688 2332116 750484 8.40 281412 2395780 116
02:41:01 AM 4818944 6985244 3063488 38.86 2688 2332516 750484 8.40 281412 2396284 4
02:42:01 AM 4818732 6985140 3063700 38.87 2688 2332624 750484 8.40 281412 2396304 4
02:43:01 AM 4818708 6985116 3063724 38.87 2688 2332624 750484 8.40 281412 2396304 4
02:44:01 AM 4818508 6985016 3063924 38.87 2688 2332724 750484 8.40 281412 2396480 104
02:45:01 AM 4818728 6985236 3063704 38.87 2688 2332724 750484 8.40 281412 2396412 4
02:46:01 AM 4818544 6985144 3063888 38.87 2688 2332816 750484 8.40 281412 2396504 100
02:47:01 AM 4818348 6984952 3064084 38.87 2688 2332820 750484 8.40 281412 2396512 4
02:48:01 AM 4817828 6984524 3064604 38.88 2688 2332912 750484 8.40 281412 2397040 100
02:49:01 AM 4818276 6984972 3064156 38.87 2688 2332912 750484 8.40 281412 2396708 4
02:50:01 AM 4817652 6984444 3064780 38.88 2688 2333008 750484 8.40 281412 2397168 100
02:51:01 AM 4817672 6984468 3064760 38.88 2688 2333008 750484 8.40 281412 2397172 4
02:52:01 AM 4817356 6984244 3065076 38.88 2688 2333100 750484 8.40 281412 2397604 100
02:53:01 AM 4817632 6984524 3064800 38.88 2688 2333104 750484 8.40 281412 2397404 4
02:54:01 AM 4817548 6984440 3064884 38.88 2688 2333104 750484 8.40 281412 2397356 4
02:55:01 AM 4817160 6984300 3065272 38.89 2688 2333352 750484 8.40 281412 2397736 16
02:56:01 AM 4816892 6984468 3065540 38.89 2688 2333796 750484 8.40 281412 2397968 4
02:57:01 AM 4816440 6984408 3065992 38.90 2688 2334180 766140 8.58 281412 2398476 160
02:58:01 AM 4816192 6984536 3066240 38.90 2688 2334564 766140 8.58 281412 2398736 132
02:59:01 AM 4815816 6984540 3066616 38.90 2688 2334944 766140 8.58 281412 2399188 84
03:00:01 AM 4815300 6984392 3067132 38.91 2688 2335312 766932 8.59 281412 2399716 220
03:01:01 AM 4814216 6983692 3068216 38.92 2688 2335696 750972 8.41 281412 2400332 192
03:02:01 AM 4814532 6984616 3067900 38.92 2688 2336296 750972 8.41 281416 2400476 80
03:03:01 AM 4814552 6984636 3067880 38.92 2688 2336296 750972 8.41 281416 2400476 4
03:04:01 AM 4814148 6984240 3068284 38.93 2688 2336304 750972 8.41 281416 2400888 16
03:05:01 AM 4814352 6984516 3068080 38.92 2688 2336376 750972 8.41 281416 2400560 4
03:06:01 AM 4814628 6984792 3067804 38.92 2688 2336376 750972 8.41 281416 2400560 4
03:07:01 AM 4814328 6984560 3068104 38.92 2688 2336448 750972 8.41 281416 2400632 4
03:08:01 AM 4814004 6984240 3068428 38.93 2688 2336452 750972 8.41 281416 2400844 16
03:09:01 AM 4813656 6984064 3068776 38.93 2688 2336624 750972 8.41 281416 2401092 8
03:10:01 AM 4814552 6985016 3067880 38.92 2688 2336680 756904 8.48 281416 2400604 20
03:11:01 AM 4813792 6984332 3068640 38.93 2688 2336752 756904 8.48 281416 2401076 4
03:12:01 AM 4813796 6984336 3068636 38.93 2688 2336752 756904 8.48 281416 2401076 4
03:13:01 AM 4813828 6984588 3068604 38.93 2688 2336980 756904 8.48 281416 2401288 168
03:14:01 AM 4813092 6984216 3069340 38.94 2688 2337344 756904 8.48 281416 2401604 68
03:15:01 AM 4812908 6984392 3069524 38.94 2688 2337696 756904 8.48 281416 2401896 192
03:16:01 AM 4812788 6984644 3069644 38.94 2688 2338068 756904 8.48 281416 2402284 148
03:17:01 AM 4812316 6984544 3070116 38.95 2688 2338448 756904 8.48 281416 2402656 24
03:18:02 AM 4811840 6984448 3070592 38.95 2688 2338828 756904 8.48 281416 2403036 36
03:19:01 AM 4811368 6984360 3071064 38.96 2688 2339200 756904 8.48 281416 2403496 72
03:20:01 AM 4811340 6984380 3071092 38.96 2688 2339248 756176 8.47 281416 2403712 4
03:21:01 AM 4811144 6984464 3071288 38.96 2688 2339528 756176 8.47 281416 2403768 124
03:22:01 AM 4810472 6984168 3071960 38.97 2688 2339912 756176 8.47 281416 2404148 52
03:23:01 AM 4810264 6984348 3072168 38.97 2688 2340292 756176 8.47 281416 2404652 4
03:24:01 AM 4810028 6984500 3072404 38.98 2688 2340680 756176 8.47 281416 2404992 40
03:25:01 AM 4809320 6984164 3073112 38.99 2688 2341060 756176 8.47 281416 2405500 64
03:26:01 AM 4808960 6984184 3073472 38.99 2688 2341440 756176 8.47 281416 2405676 24
03:27:01 AM 4808940 6984540 3073492 38.99 2688 2341808 756176 8.47 281416 2406088 188
03:28:01 AM 4808540 6984384 3073892 39.00 2688 2342052 756176 8.47 281416 2406332 128
03:29:01 AM 4807772 6983908 3074660 39.01 2688 2342348 756176 8.47 281416 2407028 160
03:30:01 AM 4807688 6984208 3074744 39.01 2688 2342732 758936 8.50 281416 2407120 20
03:31:01 AM 4807312 6984216 3075120 39.01 2688 2343116 758936 8.50 281416 2407396 24
03:32:01 AM 4806864 6984136 3075568 39.02 2688 2343484 758936 8.50 281416 2407880 52
03:33:01 AM 4806344 6984000 3076088 39.02 2688 2343864 758936 8.50 281416 2408468 52
03:34:01 AM 4806284 6984320 3076148 39.03 2688 2344248 758936 8.50 281416 2408712 24
03:35:01 AM 4805516 6984224 3076916 39.04 2688 2344912 750264 8.40 281416 2409316 332
03:36:01 AM 4805560 6984364 3076872 39.03 2688 2345008 751000 8.41 282276 2408444 4
03:37:01 AM 4805432 6984236 3077000 39.04 2688 2345008 751000 8.41 282276 2408444 4
03:38:01 AM 4805432 6984320 3077000 39.04 2688 2345092 751000 8.41 282276 2408528 4
03:39:01 AM 4805312 6984204 3077120 39.04 2688 2345096 751000 8.41 282276 2408784 16
03:40:01 AM 4805224 6984196 3077208 39.04 2688 2345176 742080 8.31 282276 2408844 92
03:41:01 AM 4805544 6984516 3076888 39.03 2688 2345176 742080 8.31 282276 2408612 4
03:42:01 AM 4805008 6984124 3077424 39.04 2688 2345320 742080 8.31 282276 2408876 148
03:43:01 AM 4805012 6984208 3077420 39.04 2688 2345400 742080 8.31 282276 2408848 4
03:44:01 AM 4804824 6984172 3077608 39.04 2688 2345552 742080 8.31 282284 2409064 4
03:45:01 AM 4804764 6984116 3077668 39.04 2688 2345556 742080 8.31 282284 2409116 4
03:46:01 AM 4804924 6984324 3077508 39.04 2688 2345604 742080 8.31 282284 2409048 56
03:47:01 AM 4804704 6984200 3077728 39.05 2688 2345700 742080 8.31 282284 2409252 48
03:48:01 AM 4804656 6984220 3077776 39.05 2688 2345768 742080 8.31 282284 2409204 56
03:49:01 AM 4804404 6984144 3078028 39.05 2688 2345960 742080 8.31 282288 2409444 4
03:50:01 AM 4804148 6983904 3078284 39.05 2688 2345960 760860 8.52 282288 2409644 4
03:51:01 AM 4804572 6984372 3077860 39.05 2688 2346004 760860 8.52 282288 2409428 48
03:52:01 AM 4804244 6984228 3078188 39.05 2688 2346196 760860 8.52 282288 2409740 96
03:53:01 AM 4803816 6984208 3078616 39.06 2688 2346596 760860 8.52 282288 2409996 236
03:54:01 AM 4803192 6983948 3079240 39.06 2688 2346960 760860 8.52 282288 2410592 24
03:55:01 AM 4803328 6984460 3079104 39.06 2688 2347344 760860 8.52 282288 2410772 56
03:56:01 AM 4802796 6984312 3079636 39.07 2688 2347728 760860 8.52 282288 2411148 176
03:57:01 AM 4802508 6984404 3079924 39.07 2688 2348108 760860 8.52 282288 2411528 100
03:58:01 AM 4802036 6984320 3080396 39.08 2688 2348492 760860 8.52 282288 2411912 24
03:59:01 AM 4801224 6984104 3081208 39.09 2688 2349080 760860 8.52 282288 2412576 4
04:00:01 AM 4800784 6983952 3081648 39.10 2688 2349368 750276 8.40 282288 2413028 4
04:01:01 AM 4799532 6982992 3082900 39.11 2688 2349660 750276 8.40 282288 2413784 56
04:02:01 AM 4800468 6984204 3081964 39.10 2688 2349944 750276 8.40 282288 2413364 152
04:03:01 AM 4800276 6984300 3082156 39.10 2688 2350232 765652 8.57 282288 2413652 56
04:04:01 AM 4799876 6984188 3082556 39.11 2688 2350520 765652 8.57 282288 2414144 152
04:05:01 AM 4799772 6984368 3082660 39.11 2688 2350792 765652 8.57 282288 2414228 16
04:06:01 AM 4799644 6984420 3082788 39.11 2688 2350972 765652 8.57 282288 2414412 148
04:07:01 AM 4799528 6984396 3082904 39.11 2688 2351064 765652 8.57 282304 2414484 16
04:08:01 AM 4799192 6984132 3083240 39.12 2688 2351136 765652 8.57 282304 2414672 24
04:09:01 AM 4799252 6984312 3083180 39.11 2688 2351256 765652 8.57 282304 2414748 56
04:10:01 AM 4798472 6983804 3083960 39.12 2688 2351528 750308 8.40 282304 2415200 4
04:11:01 AM 4798536 6984176 3083896 39.12 2688 2351844 750308 8.40 282304 2415260 160
04:12:01 AM 4798204 6984228 3084228 39.13 2688 2352228 750308 8.40 282304 2415644 84
04:13:01 AM 4797776 6984192 3084656 39.13 2688 2352612 750308 8.40 282304 2416040 4
04:14:01 AM 4797372 6984168 3085060 39.14 2688 2352992 750308 8.40 282304 2416604 100
04:15:01 AM 4797084 6984268 3085348 39.14 2688 2353388 750308 8.40 282304 2416796 208
04:16:01 AM 4796800 6984368 3085632 39.15 2688 2353772 750308 8.40 282304 2417316 128
04:17:01 AM 4796000 6984252 3086432 39.16 2688 2354456 750308 8.40 282304 2417980 4
04:18:01 AM 4795844 6984188 3086588 39.16 2688 2354540 750308 8.40 282304 2418168 4
04:19:01 AM 4796160 6984508 3086272 39.15 2688 2354544 750308 8.40 282304 2418036 4
04:20:01 AM 4796352 6984780 3086080 39.15 2688 2354624 765900 8.58 282304 2417700 4
04:21:01 AM 4795968 6984408 3086464 39.16 2688 2354636 765900 8.58 282304 2418060 4
04:22:01 AM 4795416 6983932 3087016 39.16 2688 2354712 765900 8.58 282304 2418488 88
04:23:01 AM 4795860 6984376 3086572 39.16 2688 2354712 765900 8.58 282304 2418148 4
04:24:01 AM 4795628 6984280 3086804 39.16 2688 2354852 747228 8.37 282304 2418352 144
04:25:01 AM 4795164 6983904 3087268 39.17 2688 2354932 747228 8.37 282304 2418708 8
04:26:01 AM 4795172 6984060 3087260 39.17 2688 2355080 747228 8.37 282308 2418648 8
04:27:01 AM 4795368 6984260 3087064 39.16 2688 2355084 747228 8.37 282308 2418528 4
04:28:01 AM 4795188 6984136 3087244 39.17 2688 2355140 747228 8.37 282308 2418584 64
04:29:02 AM 4794784 6983740 3087648 39.17 2688 2355148 747228 8.37 282308 2419020 4
04:30:01 AM 4794948 6984068 3087484 39.17 2688 2355328 750292 8.40 282312 2419004 140
04:31:01 AM 4794888 6984024 3087544 39.17 2688 2355328 750292 8.40 282312 2418908 4
04:32:01 AM 4794864 6984004 3087568 39.17 2688 2355332 750292 8.40 282312 2418912 4
04:33:01 AM 4794408 6983780 3088024 39.18 2688 2355564 769112 8.61 282312 2419504 104
04:34:01 AM 4794176 6983944 3088256 39.18 2688 2355968 769112 8.61 282312 2419620 148
04:35:01 AM 4794136 6984304 3088296 39.18 2688 2356368 769112 8.61 282312 2419832 84
04:36:01 AM 4793668 6984216 3088764 39.19 2688 2356748 769112 8.61 282312 2420336 236
04:37:01 AM 4793408 6984336 3089024 39.19 2688 2357128 769112 8.61 282312 2420600 24
04:38:01 AM 4792676 6983992 3089756 39.20 2688 2357516 769112 8.61 282312 2421320 24
04:39:01 AM 4792336 6984032 3090096 39.20 2688 2357896 769112 8.61 282312 2421660 40
04:40:01 AM 4790804 6983104 3091628 39.22 2688 2358488 769112 8.61 282312 2422668 4
04:41:01 AM 4791896 6984200 3090536 39.21 2688 2358492 745636 8.35 282312 2422060 4
04:42:01 AM 4791436 6983748 3090996 39.21 2688 2358500 745636 8.35 282312 2422336 4
04:43:01 AM 4791808 6984196 3090624 39.21 2688 2358576 745636 8.35 282312 2422144 4
04:44:01 AM 4791764 6984152 3090668 39.21 2688 2358576 745636 8.35 282312 2422212 4
04:45:01 AM 4791848 6984316 3090584 39.21 2688 2358656 745636 8.35 282312 2422224 4
04:46:01 AM 4791880 6984352 3090552 39.21 2688 2358660 745636 8.35 282312 2422228 4
04:47:01 AM 4790920 6983560 3091512 39.22 2688 2358828 745636 8.35 282312 2422804 16
04:48:01 AM 4788204 6981240 3094228 39.25 2688 2359224 765400 8.57 282316 2425604 52
04:49:01 AM 4787408 6980836 3095024 39.26 2688 2359616 781876 8.75 282316 2426260 16
04:50:01 AM 4786248 6980056 3096184 39.28 2688 2359996 816472 9.14 282316 2426904 48
04:51:01 AM 4783540 6977740 3098892 39.31 2688 2360388 835764 9.36 282316 2429440 16
04:52:01 AM 4782404 6976988 3100028 39.33 2688 2360756 869068 9.73 282316 2430356 4
04:53:01 AM 4779788 6974752 3102644 39.36 2688 2361136 891972 9.99 282316 2432784 16
04:54:01 AM 4778904 6974272 3103528 39.37 2688 2361532 924820 10.36 282316 2433328 4
04:55:01 AM 4738572 6869736 3143860 39.88 2688 2303340 790224 8.85 384292 2398072 129252
04:56:01 AM 4857868 6952760 3024564 38.37 2688 2267692 724692 8.11 550640 2116896 25328
Average: 4820835 6984730 3061597 38.84 2688 2330164 757015 8.48 280798 2394825 576
12:00:01 AM IFACE rxpck/s txpck/s rxkB/s txkB/s rxcmp/s txcmp/s rxmcst/s %ifutil
12:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:01:01 AM eth0 11.03 9.08 2.67 1.80 0.00 0.00 0.00 0.00
12:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:02:01 AM eth0 13.82 11.86 3.65 2.38 0.00 0.00 0.00 0.00
12:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:03:01 AM eth0 0.23 0.00 0.02 0.00 0.00 0.00 0.00 0.00
12:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:04:01 AM eth0 1.00 0.50 0.41 0.27 0.00 0.00 0.00 0.00
12:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:05:01 AM eth0 0.60 0.37 0.13 0.05 0.00 0.00 0.00 0.00
12:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:06:01 AM eth0 1.83 0.23 0.42 0.20 0.00 0.00 0.00 0.00
12:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:07:01 AM eth0 0.90 0.52 0.42 0.30 0.00 0.00 0.00 0.00
12:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:08:01 AM eth0 0.45 0.00 0.03 0.00 0.00 0.00 0.00 0.00
12:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:09:01 AM eth0 10.20 9.83 1.90 1.15 0.00 0.00 0.00 0.00
12:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:10:01 AM eth0 5.16 4.97 0.77 0.43 0.00 0.00 0.00 0.00
12:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:11:01 AM eth0 0.28 0.02 0.02 0.00 0.00 0.00 0.00 0.00
12:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:12:01 AM eth0 0.98 0.10 0.09 0.00 0.00 0.00 0.00 0.00
12:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:13:01 AM eth0 0.40 0.13 0.03 0.01 0.00 0.00 0.00 0.00
12:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:14:01 AM eth0 0.77 0.18 0.19 0.07 0.00 0.00 0.00 0.00
12:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:15:01 AM eth0 9.17 8.37 1.80 1.14 0.00 0.00 0.00 0.00
12:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:16:01 AM eth0 11.20 9.13 2.73 1.80 0.00 0.00 0.00 0.00
12:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:17:01 AM eth0 10.88 9.08 2.72 1.79 0.00 0.00 0.00 0.00
12:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:18:01 AM eth0 11.13 9.08 2.72 1.79 0.00 0.00 0.00 0.00
12:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:19:01 AM eth0 11.01 9.28 2.76 1.86 0.00 0.00 0.00 0.00
12:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:20:01 AM eth0 12.96 9.25 2.95 1.82 0.00 0.00 0.00 0.00
12:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:21:01 AM eth0 14.31 8.70 2.90 1.72 0.00 0.00 0.00 0.00
12:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:22:01 AM eth0 5.62 1.28 1.46 0.91 0.00 0.00 0.00 0.00
12:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:23:01 AM eth0 0.38 0.03 0.03 0.00 0.00 0.00 0.00 0.00
12:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:24:01 AM eth0 2.28 1.48 0.55 0.33 0.00 0.00 0.00 0.00
12:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:25:01 AM eth0 4.30 3.47 1.11 0.85 0.00 0.00 0.00 0.00
12:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:26:01 AM eth0 12.33 9.03 2.86 1.79 0.00 0.00 0.00 0.00
12:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:27:01 AM eth0 11.43 9.08 2.71 1.79 0.00 0.00 0.00 0.00
12:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:28:01 AM eth0 11.78 9.08 2.73 1.79 0.00 0.00 0.00 0.00
12:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:29:01 AM eth0 11.86 9.10 2.80 1.85 0.00 0.00 0.00 0.00
12:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:30:01 AM eth0 11.03 9.23 2.73 1.82 0.00 0.00 0.00 0.00
12:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:31:01 AM eth0 11.03 9.20 2.72 1.80 0.00 0.00 0.00 0.00
12:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:32:01 AM eth0 13.70 11.28 3.38 2.09 0.00 0.00 0.00 0.00
12:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:33:01 AM eth0 1.12 0.18 0.35 0.19 0.00 0.00 0.00 0.00
12:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:34:01 AM eth0 0.88 0.60 0.48 0.30 0.00 0.00 0.00 0.00
12:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:35:01 AM eth0 0.28 0.12 0.02 0.01 0.00 0.00 0.00 0.00
12:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:36:01 AM eth0 0.80 0.00 0.11 0.00 0.00 0.00 0.00 0.00
12:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:37:01 AM eth0 1.92 0.35 0.24 0.05 0.00 0.00 0.00 0.00
12:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:38:01 AM eth0 1.42 0.48 0.82 0.57 0.00 0.00 0.00 0.00
12:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:39:01 AM eth0 10.58 9.73 1.94 1.14 0.00 0.00 0.00 0.00
12:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:40:01 AM eth0 12.10 5.65 2.02 0.84 0.00 0.00 0.00 0.00
12:41:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:41:01 AM eth0 1.30 0.35 0.55 0.38 0.00 0.00 0.00 0.00
12:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:42:01 AM eth0 7.12 4.45 2.05 1.21 0.00 0.00 0.00 0.00
12:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:43:01 AM eth0 6.75 5.17 1.65 1.13 0.00 0.00 0.00 0.00
12:44:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:44:01 AM eth0 17.34 9.55 3.93 2.12 0.00 0.00 0.00 0.00
12:45:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:45:01 AM eth0 11.91 9.20 2.80 1.80 0.00 0.00 0.00 0.00
12:46:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:46:01 AM eth0 11.40 9.08 2.69 1.79 0.00 0.00 0.00 0.00
12:47:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:47:01 AM eth0 11.51 9.21 2.78 1.80 0.00 0.00 0.00 0.00
12:48:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:48:01 AM eth0 11.96 9.20 2.76 1.80 0.00 0.00 0.00 0.00
12:49:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:49:01 AM eth0 11.16 8.35 2.65 1.68 0.00 0.00 0.00 0.00
12:50:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:50:01 AM eth0 2.08 0.68 0.21 0.11 0.00 0.00 0.00 0.00
12:51:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:51:01 AM eth0 8.67 6.24 1.79 1.22 0.00 0.00 0.00 0.00
12:52:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:52:01 AM eth0 11.28 9.08 2.64 1.79 0.00 0.00 0.00 0.00
12:53:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:53:01 AM eth0 10.85 9.01 2.66 1.79 0.00 0.00 0.00 0.00
12:54:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:54:01 AM eth0 11.40 9.28 2.85 1.86 0.00 0.00 0.00 0.00
12:55:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:55:01 AM eth0 10.93 9.10 2.72 1.79 0.00 0.00 0.00 0.00
12:56:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:56:01 AM eth0 11.13 9.03 2.71 1.79 0.00 0.00 0.00 0.00
12:57:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:57:01 AM eth0 9.77 6.07 2.06 1.18 0.00 0.00 0.00 0.00
12:58:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:58:01 AM eth0 4.57 2.42 1.01 0.67 0.00 0.00 0.00 0.00
12:59:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:59:01 AM eth0 10.96 8.93 2.96 1.99 0.00 0.00 0.00 0.00
01:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:00:01 AM eth0 16.95 9.04 3.45 1.79 0.00 0.00 0.00 0.00
01:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:01:01 AM eth0 11.25 9.04 2.70 1.78 0.00 0.00 0.00 0.00
01:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:02:01 AM eth0 11.46 9.24 2.70 1.82 0.00 0.00 0.00 0.00
01:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:03:01 AM eth0 11.25 9.00 2.72 1.79 0.00 0.00 0.00 0.00
01:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:04:01 AM eth0 14.78 9.60 53.62 2.07 0.00 0.00 0.00 0.00
01:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:05:01 AM eth0 18.00 14.60 4.66 2.94 0.00 0.00 0.00 0.00
01:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:06:01 AM eth0 0.65 0.38 0.09 0.05 0.00 0.00 0.00 0.00
01:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:07:01 AM eth0 1.33 0.15 0.42 0.19 0.00 0.00 0.00 0.00
01:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:08:01 AM eth0 0.88 0.35 0.10 0.05 0.00 0.00 0.00 0.00
01:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:09:01 AM eth0 0.57 0.13 0.16 0.07 0.00 0.00 0.00 0.00
01:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:10:01 AM eth0 0.77 0.33 0.09 0.04 0.00 0.00 0.00 0.00
01:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:11:01 AM eth0 0.82 0.22 0.31 0.19 0.00 0.00 0.00 0.00
01:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:12:01 AM eth0 10.11 9.36 1.77 1.05 0.00 0.00 0.00 0.00
01:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:13:01 AM eth0 5.03 4.72 0.69 0.36 0.00 0.00 0.00 0.00
01:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:14:01 AM eth0 1.02 0.72 0.27 0.16 0.00 0.00 0.00 0.00
01:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:15:01 AM eth0 0.35 0.12 0.02 0.01 0.00 0.00 0.00 0.00
01:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:16:01 AM eth0 4.60 3.83 0.62 0.31 0.00 0.00 0.00 0.00
01:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:17:01 AM eth0 12.70 10.66 3.37 2.26 0.00 0.00 0.00 0.00
01:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:18:01 AM eth0 11.73 9.32 2.90 1.81 0.00 0.00 0.00 0.00
01:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:19:01 AM eth0 11.60 9.48 3.20 2.06 0.00 0.00 0.00 0.00
01:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:20:01 AM eth0 11.66 9.30 3.08 1.99 0.00 0.00 0.00 0.00
01:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:21:01 AM eth0 10.88 9.00 2.73 1.81 0.00 0.00 0.00 0.00
01:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:22:01 AM eth0 11.43 9.28 3.11 2.05 0.00 0.00 0.00 0.00
01:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:23:01 AM eth0 3.67 2.53 1.21 0.85 0.00 0.00 0.00 0.00
01:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:24:01 AM eth0 2.82 2.45 0.66 0.52 0.00 0.00 0.00 0.00
01:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:25:01 AM eth0 11.03 9.53 2.81 1.83 0.00 0.00 0.00 0.00
01:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:26:01 AM eth0 10.68 8.98 2.74 1.79 0.00 0.00 0.00 0.00
01:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:27:01 AM eth0 11.95 9.10 3.15 1.97 0.00 0.00 0.00 0.00
01:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:28:01 AM eth0 11.45 9.28 3.11 2.05 0.00 0.00 0.00 0.00
01:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:29:01 AM eth0 11.08 9.17 2.89 1.86 0.00 0.00 0.00 0.00
01:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:30:01 AM eth0 10.90 8.96 2.79 1.79 0.00 0.00 0.00 0.00
01:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:31:01 AM eth0 15.81 13.26 4.02 2.48 0.00 0.00 0.00 0.00
01:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:32:01 AM eth0 1.07 0.03 0.12 0.00 0.00 0.00 0.00 0.00
01:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:33:01 AM eth0 1.17 0.45 0.56 0.39 0.00 0.00 0.00 0.00
01:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:34:01 AM eth0 0.72 0.52 0.21 0.11 0.00 0.00 0.00 0.00
01:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:35:01 AM eth0 0.20 0.00 0.02 0.00 0.00 0.00 0.00 0.00
01:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:36:01 AM eth0 0.50 0.33 0.08 0.04 0.00 0.00 0.00 0.00
01:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:37:01 AM eth0 0.88 0.00 0.10 0.00 0.00 0.00 0.00 0.00
01:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:38:01 AM eth0 11.15 10.03 2.55 1.64 0.00 0.00 0.00 0.00
01:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:39:01 AM eth0 5.40 5.32 0.89 0.50 0.00 0.00 0.00 0.00
01:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:40:01 AM eth0 2.38 0.58 0.57 0.23 0.00 0.00 0.00 0.00
01:41:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:41:01 AM eth0 1.07 0.33 0.30 0.20 0.00 0.00 0.00 0.00
01:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:42:01 AM eth0 0.60 0.25 0.09 0.03 0.00 0.00 0.00 0.00
01:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:43:01 AM eth0 0.20 0.03 0.02 0.00 0.00 0.00 0.00 0.00
01:44:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:44:01 AM eth0 7.37 0.35 0.98 0.09 0.00 0.00 0.00 0.00
01:45:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:45:01 AM eth0 1.73 0.60 0.90 0.64 0.00 0.00 0.00 0.00
01:46:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:46:01 AM eth0 1.95 0.43 0.50 0.22 0.00 0.00 0.00 0.00
01:47:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:47:01 AM eth0 3.88 0.00 0.49 0.00 0.00 0.00 0.00 0.00
01:48:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:48:01 AM eth0 3.63 0.37 0.48 0.04 0.00 0.00 0.00 0.00
01:49:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:49:01 AM eth0 1.00 0.10 0.19 0.06 0.00 0.00 0.00 0.00
01:50:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:50:01 AM eth0 0.70 0.25 0.10 0.03 0.00 0.00 0.00 0.00
01:51:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:51:01 AM eth0 1.02 0.00 0.07 0.00 0.00 0.00 0.00 0.00
01:52:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:52:01 AM eth0 2.32 0.50 0.48 0.23 0.00 0.00 0.00 0.00
01:53:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:53:01 AM eth0 0.70 0.00 0.06 0.00 0.00 0.00 0.00 0.00
01:54:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:54:01 AM eth0 5.63 3.65 0.79 0.34 0.00 0.00 0.00 0.00
01:55:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:55:01 AM eth0 10.61 7.55 2.24 1.45 0.00 0.00 0.00 0.00
01:56:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:56:01 AM eth0 11.25 9.00 2.82 1.79 0.00 0.00 0.00 0.00
01:57:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:57:01 AM eth0 13.26 8.85 3.01 1.73 0.00 0.00 0.00 0.00
01:58:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:58:01 AM eth0 13.23 9.65 3.57 2.25 0.00 0.00 0.00 0.00
01:59:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:59:01 AM eth0 11.65 9.47 3.17 2.05 0.00 0.00 0.00 0.00
02:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:00:01 AM eth0 16.57 9.16 3.50 1.82 0.00 0.00 0.00 0.00
02:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:01:01 AM eth0 7.48 5.64 1.71 1.11 0.00 0.00 0.00 0.00
02:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:02:01 AM eth0 1.43 0.52 0.12 0.08 0.00 0.00 0.00 0.00
02:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:03:01 AM eth0 0.70 0.00 0.07 0.00 0.00 0.00 0.00 0.00
02:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:04:01 AM eth0 1.78 0.75 0.71 0.47 0.00 0.00 0.00 0.00
02:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:05:01 AM eth0 0.30 0.00 0.02 0.00 0.00 0.00 0.00 0.00
02:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:06:01 AM eth0 0.75 0.22 0.04 0.02 0.00 0.00 0.00 0.00
02:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:07:01 AM eth0 0.75 0.00 0.06 0.00 0.00 0.00 0.00 0.00
02:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:08:01 AM eth0 2.23 0.18 13.30 0.02 0.00 0.00 0.00 0.00
02:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:09:01 AM eth0 1.19 0.85 0.20 6.47 0.00 0.00 0.00 0.00
02:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:10:01 AM eth0 0.50 0.10 0.03 0.01 0.00 0.00 0.00 0.00
02:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:11:01 AM eth0 0.33 0.08 0.02 0.00 0.00 0.00 0.00 0.00
02:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:12:01 AM eth0 0.43 0.00 0.02 0.00 0.00 0.00 0.00 0.00
02:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:13:01 AM eth0 0.43 0.17 0.03 0.01 0.00 0.00 0.00 0.00
02:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:14:01 AM eth0 1.15 0.72 0.20 6.28 0.00 0.00 0.00 0.00
02:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:15:01 AM eth0 4.67 3.92 1.06 0.77 0.00 0.00 0.00 0.00
02:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:16:01 AM eth0 11.26 9.00 2.81 1.79 0.00 0.00 0.00 0.00
02:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:17:01 AM eth0 11.01 8.91 2.77 1.78 0.00 0.00 0.00 0.00
02:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:18:01 AM eth0 13.18 10.68 3.49 14.45 0.00 0.00 0.00 0.00
02:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:19:01 AM eth0 11.48 9.50 3.23 2.12 0.00 0.00 0.00 0.00
02:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:20:01 AM eth0 16.08 8.95 11.73 1.78 0.00 0.00 0.00 0.00
02:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:21:01 AM eth0 10.41 8.68 2.58 1.69 0.00 0.00 0.00 0.00
02:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:22:01 AM eth0 0.82 0.55 0.08 0.08 0.00 0.00 0.00 0.00
02:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:23:01 AM eth0 0.23 0.05 0.02 0.00 0.00 0.00 0.00 0.00
02:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:24:01 AM eth0 0.68 0.32 0.18 0.08 0.00 0.00 0.00 0.00
02:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:25:01 AM eth0 0.20 0.00 0.02 0.00 0.00 0.00 0.00 0.00
02:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:26:01 AM eth0 0.38 0.18 0.02 0.02 0.00 0.00 0.00 0.00
02:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:27:01 AM eth0 0.53 0.00 0.06 0.00 0.00 0.00 0.00 0.00
02:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:28:01 AM eth0 0.93 0.60 0.38 0.29 0.00 0.00 0.00 0.00
02:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:29:01 AM eth0 0.37 0.12 0.15 0.06 0.00 0.00 0.00 0.00
02:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:30:01 AM eth0 0.25 0.10 0.02 0.01 0.00 0.00 0.00 0.00
02:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:31:01 AM eth0 0.30 0.15 0.02 0.01 0.00 0.00 0.00 0.00
02:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:32:01 AM eth0 1.13 0.05 0.16 0.00 0.00 0.00 0.00 0.00
02:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:33:01 AM eth0 1.35 0.55 0.58 0.40 0.00 0.00 0.00 0.00
02:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:34:01 AM eth0 0.42 0.18 0.15 0.07 0.00 0.00 0.00 0.00
02:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:35:01 AM eth0 4.83 4.20 1.13 0.81 0.00 0.00 0.00 0.00
02:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:36:01 AM eth0 10.71 8.95 2.71 1.76 0.00 0.00 0.00 0.00
02:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:37:01 AM eth0 11.03 8.92 2.73 1.78 0.00 0.00 0.00 0.00
02:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:38:01 AM eth0 11.26 9.45 3.07 2.08 0.00 0.00 0.00 0.00
02:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:39:01 AM eth0 10.96 9.17 2.86 1.86 0.00 0.00 0.00 0.00
02:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:40:01 AM eth0 11.10 9.06 2.78 1.81 0.00 0.00 0.00 0.00
02:41:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:41:01 AM eth0 9.88 8.00 2.46 1.56 0.00 0.00 0.00 0.00
02:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:42:01 AM eth0 0.62 0.47 0.07 0.08 0.00 0.00 0.00 0.00
02:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:43:01 AM eth0 0.22 0.00 0.02 0.00 0.00 0.00 0.00 0.00
02:44:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:44:01 AM eth0 0.63 0.38 0.16 0.09 0.00 0.00 0.00 0.00
02:45:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:45:01 AM eth0 0.13 0.00 0.01 0.00 0.00 0.00 0.00 0.00
02:46:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:46:01 AM eth0 0.33 0.18 0.02 0.02 0.00 0.00 0.00 0.00
02:47:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:47:01 AM eth0 1.22 0.00 0.18 0.00 0.00 0.00 0.00 0.00
02:48:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:48:01 AM eth0 1.00 0.68 0.53 0.41 0.00 0.00 0.00 0.00
02:49:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:49:01 AM eth0 0.40 0.20 0.15 0.07 0.00 0.00 0.00 0.00
02:50:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:50:01 AM eth0 0.30 0.18 0.02 0.02 0.00 0.00 0.00 0.00
02:51:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:51:01 AM eth0 1.83 0.00 0.23 0.00 0.00 0.00 0.00 0.00
02:52:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:52:01 AM eth0 0.58 0.38 0.27 0.21 0.00 0.00 0.00 0.00
02:53:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:53:01 AM eth0 0.33 0.12 0.02 0.00 0.00 0.00 0.00 0.00
02:54:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:54:01 AM eth0 6.40 0.18 0.84 0.07 0.00 0.00 0.00 0.00
02:55:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:55:01 AM eth0 3.63 2.55 1.11 0.88 0.00 0.00 0.00 0.00
02:56:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:56:01 AM eth0 12.20 10.26 3.04 2.02 0.00 0.00 0.00 0.00
02:57:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:57:01 AM eth0 17.44 8.91 3.56 1.78 0.00 0.00 0.00 0.00
02:58:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:58:01 AM eth0 12.86 9.03 2.92 1.79 0.00 0.00 0.00 0.00
02:59:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:59:01 AM eth0 11.78 9.10 2.90 1.85 0.00 0.00 0.00 0.00
03:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:00:01 AM eth0 10.68 8.86 2.66 1.73 0.00 0.00 0.00 0.00
03:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:01:01 AM eth0 11.66 9.10 2.81 1.79 0.00 0.00 0.00 0.00
03:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:02:01 AM eth0 15.79 12.08 3.68 2.27 0.00 0.00 0.00 0.00
03:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:03:01 AM eth0 2.22 0.00 0.20 0.00 0.00 0.00 0.00 0.00
03:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:04:01 AM eth0 2.47 0.33 0.48 0.26 0.00 0.00 0.00 0.00
03:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:05:01 AM eth0 1.87 0.38 0.15 0.05 0.00 0.00 0.00 0.00
03:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:06:01 AM eth0 0.42 0.05 0.03 0.00 0.00 0.00 0.00 0.00
03:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:07:01 AM eth0 0.92 0.37 0.10 0.05 0.00 0.00 0.00 0.00
03:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:08:01 AM eth0 3.65 0.23 0.58 0.20 0.00 0.00 0.00 0.00
03:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:09:01 AM eth0 12.08 9.97 2.77 1.69 0.00 0.00 0.00 0.00
03:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:10:01 AM eth0 6.72 5.39 1.16 0.63 0.00 0.00 0.00 0.00
03:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:11:01 AM eth0 4.81 0.27 0.69 0.03 0.00 0.00 0.00 0.00
03:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:12:01 AM eth0 1.73 0.10 0.14 0.00 0.00 0.00 0.00 0.00
03:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:13:01 AM eth0 8.26 6.96 1.65 0.99 0.00 0.00 0.00 0.00
03:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:14:01 AM eth0 11.20 9.15 2.83 1.85 0.00 0.00 0.00 0.00
03:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:15:01 AM eth0 10.15 8.30 2.46 1.61 0.00 0.00 0.00 0.00
03:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:16:01 AM eth0 10.73 8.68 2.64 1.72 0.00 0.00 0.00 0.00
03:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:17:01 AM eth0 11.20 8.96 2.74 1.79 0.00 0.00 0.00 0.00
03:18:02 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:18:02 AM eth0 11.15 8.85 2.75 1.78 0.00 0.00 0.00 0.00
03:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:19:01 AM eth0 11.39 8.73 2.83 1.77 0.00 0.00 0.00 0.00
03:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:20:01 AM eth0 0.77 0.52 0.08 0.08 0.00 0.00 0.00 0.00
03:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:21:01 AM eth0 5.71 4.83 1.32 0.93 0.00 0.00 0.00 0.00
03:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:22:01 AM eth0 10.70 9.00 2.72 1.79 0.00 0.00 0.00 0.00
03:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:23:01 AM eth0 10.88 9.08 2.71 1.77 0.00 0.00 0.00 0.00
03:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:24:01 AM eth0 11.05 9.20 2.87 1.86 0.00 0.00 0.00 0.00
03:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:25:01 AM eth0 12.30 9.55 3.16 2.00 0.00 0.00 0.00 0.00
03:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:26:01 AM eth0 10.75 9.08 2.72 1.79 0.00 0.00 0.00 0.00
03:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:27:01 AM eth0 9.21 7.46 2.24 1.46 0.00 0.00 0.00 0.00
03:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:28:01 AM eth0 2.98 2.22 0.57 0.42 0.00 0.00 0.00 0.00
03:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:29:01 AM eth0 8.92 7.25 2.45 1.62 0.00 0.00 0.00 0.00
03:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:30:01 AM eth0 11.46 9.13 2.85 1.80 0.00 0.00 0.00 0.00
03:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:31:01 AM eth0 11.06 9.10 2.74 1.79 0.00 0.00 0.00 0.00
03:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:32:01 AM eth0 11.06 9.20 2.72 1.79 0.00 0.00 0.00 0.00
03:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:33:01 AM eth0 11.38 9.26 3.07 2.05 0.00 0.00 0.00 0.00
03:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:34:01 AM eth0 10.61 9.07 2.80 1.81 0.00 0.00 0.00 0.00
03:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:35:01 AM eth0 18.08 15.43 4.62 2.93 0.00 0.00 0.00 0.00
03:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:36:01 AM eth0 1.27 1.17 0.16 0.12 0.00 0.00 0.00 0.00
03:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:37:01 AM eth0 0.33 0.00 0.02 0.00 0.00 0.00 0.00 0.00
03:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:38:01 AM eth0 0.58 0.37 0.12 0.05 0.00 0.00 0.00 0.00
03:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:39:01 AM eth0 1.28 0.27 0.46 0.26 0.00 0.00 0.00 0.00
03:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:40:01 AM eth0 0.53 0.42 0.08 0.05 0.00 0.00 0.00 0.00
03:41:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:41:01 AM eth0 0.30 0.05 0.02 0.00 0.00 0.00 0.00 0.00
03:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:42:01 AM eth0 4.07 3.40 0.93 0.70 0.00 0.00 0.00 0.00
03:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:43:01 AM eth0 11.48 11.31 1.63 0.80 0.00 0.00 0.00 0.00
03:44:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:44:01 AM eth0 0.90 0.70 0.22 0.17 0.00 0.00 0.00 0.00
03:45:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:45:01 AM eth0 0.38 0.10 0.02 0.00 0.00 0.00 0.00 0.00
03:46:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:46:01 AM eth0 5.03 4.90 0.71 0.34 0.00 0.00 0.00 0.00
03:47:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:47:01 AM eth0 9.20 9.07 1.34 0.72 0.00 0.00 0.00 0.00
03:48:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:48:01 AM eth0 4.60 4.52 0.68 0.35 0.00 0.00 0.00 0.00
03:49:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:49:01 AM eth0 6.10 5.60 0.96 0.55 0.00 0.00 0.00 0.00
03:50:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:50:01 AM eth0 0.45 0.22 0.27 0.20 0.00 0.00 0.00 0.00
03:51:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:51:01 AM eth0 0.68 0.40 0.10 0.10 0.00 0.00 0.00 0.00
03:52:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:52:01 AM eth0 10.96 10.55 2.01 1.21 0.00 0.00 0.00 0.00
03:53:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:53:01 AM eth0 11.35 9.47 2.87 1.87 0.00 0.00 0.00 0.00
03:54:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:54:01 AM eth0 10.75 8.95 2.82 1.83 0.00 0.00 0.00 0.00
03:55:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:55:01 AM eth0 10.53 8.81 2.71 1.74 0.00 0.00 0.00 0.00
03:56:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:56:01 AM eth0 11.01 9.10 2.82 1.79 0.00 0.00 0.00 0.00
03:57:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:57:01 AM eth0 11.18 9.16 2.83 1.80 0.00 0.00 0.00 0.00
03:58:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:58:01 AM eth0 11.05 9.07 2.79 1.79 0.00 0.00 0.00 0.00
03:59:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:59:01 AM eth0 13.63 11.56 3.58 2.25 0.00 0.00 0.00 0.00
04:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:00:01 AM eth0 0.62 0.80 0.25 0.14 0.00 0.00 0.00 0.00
04:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:01:01 AM eth0 0.73 0.85 0.25 0.15 0.00 0.00 0.00 0.00
04:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:02:01 AM eth0 0.58 0.80 0.25 0.14 0.00 0.00 0.00 0.00
04:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:03:01 AM eth0 0.68 0.80 0.25 0.14 0.00 0.00 0.00 0.00
04:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:04:01 AM eth0 1.22 1.27 0.65 0.41 0.00 0.00 0.00 0.00
04:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:05:01 AM eth0 9.98 9.60 1.91 1.11 0.00 0.00 0.00 0.00
04:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:06:01 AM eth0 9.40 9.42 1.40 0.74 0.00 0.00 0.00 0.00
04:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:07:01 AM eth0 2.88 2.57 0.41 0.23 0.00 0.00 0.00 0.00
04:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:08:01 AM eth0 2.98 2.85 0.43 0.28 0.00 0.00 0.00 0.00
04:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:09:01 AM eth0 5.72 5.02 0.90 0.47 0.00 0.00 0.00 0.00
04:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:10:01 AM eth0 6.12 5.87 1.26 0.88 0.00 0.00 0.00 0.00
04:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:11:01 AM eth0 8.63 7.56 2.16 1.47 0.00 0.00 0.00 0.00
04:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:12:01 AM eth0 10.70 9.10 2.76 1.81 0.00 0.00 0.00 0.00
04:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:13:01 AM eth0 11.08 9.12 2.85 1.80 0.00 0.00 0.00 0.00
04:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:14:01 AM eth0 11.31 9.35 2.94 1.87 0.00 0.00 0.00 0.00
04:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:15:01 AM eth0 11.01 9.08 2.76 1.79 0.00 0.00 0.00 0.00
04:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:16:01 AM eth0 11.23 9.13 3.03 1.98 0.00 0.00 0.00 0.00
04:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:17:01 AM eth0 18.56 15.71 4.77 3.00 0.00 0.00 0.00 0.00
04:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:18:01 AM eth0 0.68 0.55 0.34 0.25 0.00 0.00 0.00 0.00
04:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:19:01 AM eth0 0.37 0.17 0.15 0.07 0.00 0.00 0.00 0.00
04:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:20:01 AM eth0 0.57 0.33 0.11 0.04 0.00 0.00 0.00 0.00
04:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:21:01 AM eth0 1.60 0.00 0.19 0.00 0.00 0.00 0.00 0.00
04:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:22:01 AM eth0 0.77 0.60 0.33 0.24 0.00 0.00 0.00 0.00
04:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:23:01 AM eth0 0.28 0.03 0.02 0.00 0.00 0.00 0.00 0.00
04:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:24:01 AM eth0 9.23 3.53 1.63 0.72 0.00 0.00 0.00 0.00
04:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:25:01 AM eth0 13.03 11.00 2.44 1.32 0.00 0.00 0.00 0.00
04:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:26:01 AM eth0 1.48 0.58 0.21 0.09 0.00 0.00 0.00 0.00
04:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:27:01 AM eth0 8.50 0.10 1.06 0.00 0.00 0.00 0.00 0.00
04:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:28:01 AM eth0 5.95 3.60 0.67 0.25 0.00 0.00 0.00 0.00
04:29:02 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:29:02 AM eth0 1.82 0.58 0.50 0.32 0.00 0.00 0.00 0.00
04:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:30:01 AM eth0 5.49 5.13 0.77 0.41 0.00 0.00 0.00 0.00
04:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:31:01 AM eth0 0.98 0.07 0.06 0.00 0.00 0.00 0.00 0.00
04:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:32:01 AM eth0 0.67 0.05 0.05 0.00 0.00 0.00 0.00 0.00
04:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:33:01 AM eth0 14.58 11.36 2.53 1.52 0.00 0.00 0.00 0.00
04:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:34:01 AM eth0 14.16 9.83 3.21 2.00 0.00 0.00 0.00 0.00
04:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:35:01 AM eth0 11.08 9.07 2.78 1.79 0.00 0.00 0.00 0.00
04:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:36:01 AM eth0 10.58 9.00 2.71 1.79 0.00 0.00 0.00 0.00
04:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:37:01 AM eth0 12.70 9.00 2.96 1.79 0.00 0.00 0.00 0.00
04:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:38:01 AM eth0 13.23 9.33 3.32 2.05 0.00 0.00 0.00 0.00
04:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:39:01 AM eth0 11.43 9.13 3.15 2.03 0.00 0.00 0.00 0.00
04:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:40:01 AM eth0 19.39 12.23 4.57 2.46 0.00 0.00 0.00 0.00
04:41:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:41:01 AM eth0 1.30 0.03 0.11 0.00 0.00 0.00 0.00 0.00
04:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:42:01 AM eth0 0.93 0.22 0.29 0.19 0.00 0.00 0.00 0.00
04:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:43:01 AM eth0 0.72 0.30 0.09 0.04 0.00 0.00 0.00 0.00
04:44:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:44:01 AM eth0 0.78 0.12 0.17 0.07 0.00 0.00 0.00 0.00
04:45:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:45:01 AM eth0 0.63 0.32 0.09 0.04 0.00 0.00 0.00 0.00
04:46:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:46:01 AM eth0 0.32 0.00 0.02 0.00 0.00 0.00 0.00 0.00
04:47:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:47:01 AM eth0 10.95 9.80 2.07 1.26 0.00 0.00 0.00 0.00
04:48:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:48:01 AM eth0 10.46 9.85 3.09 1.19 0.00 0.00 0.00 0.00
04:49:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:49:01 AM eth0 11.15 10.11 3.24 1.24 0.00 0.00 0.00 0.00
04:50:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:50:01 AM eth0 8.86 8.71 2.82 0.96 0.00 0.00 0.00 0.00
04:51:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:51:01 AM eth0 9.33 8.93 2.96 1.05 0.00 0.00 0.00 0.00
04:52:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:52:01 AM eth0 9.97 9.65 2.63 1.52 0.00 0.00 0.00 0.00
04:53:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:53:01 AM eth0 9.45 9.16 2.92 1.02 0.00 0.00 0.00 0.00
04:54:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:54:01 AM eth0 11.10 10.16 3.32 1.33 0.00 0.00 0.00 0.00
04:55:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:55:01 AM eth0 137.18 91.25 218.02 320.06 0.00 0.00 0.00 0.00
04:56:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:56:01 AM eth0 17.14 15.88 14.85 8.12 0.00 0.00 0.00 0.00
Average: lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
Average: eth0 6.92 5.20 2.53 2.11 0.00 0.00 0.00 0.00
---> sar -P ALL:
Linux 4.18.0-553.5.1.el8.x86_64 (prd-centos8-robot-2c-8g-4727.novalocal) 01/27/2026 _x86_64_ (2 CPU)
12:00:01 AM CPU %user %nice %system %iowait %steal %idle
12:01:01 AM all 4.45 0.03 0.46 0.02 0.05 94.99
12:01:01 AM 0 4.08 0.02 0.37 0.02 0.05 95.47
12:01:01 AM 1 4.81 0.05 0.55 0.02 0.05 94.52
12:02:01 AM all 4.64 0.00 0.30 0.00 0.05 95.01
12:02:01 AM 0 4.28 0.00 0.32 0.00 0.07 95.33
12:02:01 AM 1 5.01 0.00 0.28 0.00 0.03 94.68
12:03:01 AM all 0.35 0.00 0.07 0.00 0.03 99.55
12:03:01 AM 0 0.17 0.00 0.08 0.00 0.03 99.72
12:03:01 AM 1 0.53 0.00 0.05 0.00 0.03 99.38
12:04:01 AM all 0.34 0.00 0.07 0.00 0.04 99.55
12:04:01 AM 0 0.12 0.00 0.07 0.00 0.05 99.77
12:04:01 AM 1 0.57 0.00 0.07 0.00 0.03 99.33
12:05:01 AM all 0.47 0.00 0.08 0.00 0.03 99.42
12:05:01 AM 0 0.58 0.00 0.07 0.00 0.03 99.32
12:05:01 AM 1 0.35 0.00 0.10 0.00 0.03 99.52
12:06:01 AM all 0.34 0.00 0.06 0.00 0.03 99.57
12:06:01 AM 0 0.62 0.00 0.07 0.00 0.05 99.26
12:06:01 AM 1 0.07 0.00 0.05 0.00 0.02 99.87
12:07:01 AM all 0.39 0.00 0.08 0.00 0.03 99.49
12:07:01 AM 0 0.47 0.00 0.07 0.00 0.03 99.43
12:07:01 AM 1 0.32 0.00 0.10 0.00 0.03 99.55
12:08:01 AM all 0.29 0.00 0.12 0.01 0.04 99.54
12:08:01 AM 0 0.13 0.00 0.12 0.00 0.05 99.70
12:08:01 AM 1 0.45 0.00 0.12 0.02 0.03 99.38
12:09:01 AM all 5.08 0.00 1.02 0.00 0.05 93.85
12:09:01 AM 0 9.69 0.00 1.97 0.00 0.05 88.29
12:09:01 AM 1 0.72 0.00 0.12 0.00 0.05 99.12
12:10:01 AM all 6.49 0.00 3.35 0.00 0.06 90.10
12:10:01 AM 0 12.81 0.00 6.85 0.00 0.07 80.26
12:10:01 AM 1 0.65 0.00 0.12 0.00 0.05 99.18
12:11:01 AM all 0.34 0.00 0.08 0.00 0.04 99.53
12:11:01 AM 0 0.08 0.00 0.07 0.00 0.03 99.82
12:11:01 AM 1 0.60 0.00 0.10 0.00 0.05 99.25
12:11:01 AM CPU %user %nice %system %iowait %steal %idle
12:12:01 AM all 0.37 0.00 0.08 0.00 0.03 99.52
12:12:01 AM 0 0.15 0.00 0.08 0.00 0.03 99.73
12:12:01 AM 1 0.58 0.00 0.07 0.00 0.03 99.32
12:13:01 AM all 0.42 0.00 0.10 0.00 0.07 99.41
12:13:01 AM 0 0.50 0.00 0.10 0.00 0.07 99.33
12:13:01 AM 1 0.33 0.00 0.10 0.00 0.07 99.50
12:14:01 AM all 0.53 0.00 0.10 0.00 0.07 99.31
12:14:01 AM 0 0.68 0.00 0.07 0.00 0.05 99.20
12:14:01 AM 1 0.37 0.00 0.13 0.00 0.08 99.42
12:15:01 AM all 6.50 0.00 1.47 0.00 0.07 91.96
12:15:01 AM 0 1.45 0.00 0.17 0.00 0.07 98.31
12:15:01 AM 1 11.87 0.00 2.86 0.00 0.07 85.20
12:16:01 AM all 4.42 0.00 0.18 0.00 0.06 95.34
12:16:01 AM 0 3.64 0.00 0.17 0.00 0.05 96.14
12:16:01 AM 1 5.20 0.00 0.20 0.00 0.07 94.54
12:17:01 AM all 4.46 0.00 0.20 0.00 0.07 95.27
12:17:01 AM 0 4.55 0.00 0.17 0.00 0.07 95.22
12:17:01 AM 1 4.38 0.00 0.23 0.00 0.07 95.32
12:18:01 AM all 4.40 0.00 0.18 0.00 0.06 95.35
12:18:01 AM 0 5.99 0.00 0.23 0.00 0.07 93.71
12:18:01 AM 1 2.81 0.00 0.13 0.00 0.05 97.00
12:19:01 AM all 4.41 0.00 0.21 0.00 0.07 95.31
12:19:01 AM 0 4.63 0.00 0.20 0.00 0.07 95.10
12:19:01 AM 1 4.19 0.00 0.22 0.00 0.07 95.52
12:20:01 AM all 4.49 0.00 0.18 0.00 0.05 95.28
12:20:01 AM 0 5.52 0.00 0.18 0.00 0.05 94.25
12:20:01 AM 1 3.46 0.00 0.18 0.00 0.05 96.30
12:21:01 AM all 4.71 0.00 0.26 0.00 0.05 94.98
12:21:01 AM 0 2.91 0.00 0.23 0.00 0.05 96.80
12:21:01 AM 1 6.51 0.00 0.29 0.00 0.05 93.15
12:22:01 AM all 6.49 0.00 1.52 0.00 0.07 91.92
12:22:01 AM 0 0.68 0.00 0.13 0.00 0.05 99.13
12:22:01 AM 1 12.78 0.00 3.03 0.00 0.09 84.10
12:22:01 AM CPU %user %nice %system %iowait %steal %idle
12:23:01 AM all 0.43 0.00 0.11 0.00 0.04 99.42
12:23:01 AM 0 0.64 0.00 0.12 0.00 0.05 99.20
12:23:01 AM 1 0.22 0.00 0.10 0.00 0.03 99.65
12:24:01 AM all 1.16 0.00 0.12 0.00 0.04 98.68
12:24:01 AM 0 1.54 0.00 0.13 0.00 0.03 98.30
12:24:01 AM 1 0.79 0.00 0.10 0.00 0.05 99.06
12:25:01 AM all 6.76 0.00 2.57 0.00 0.06 90.61
12:25:01 AM 0 1.15 0.00 0.13 0.00 0.05 98.66
12:25:01 AM 1 12.81 0.00 5.19 0.00 0.07 81.93
12:26:01 AM all 4.46 0.00 0.34 0.00 0.06 95.14
12:26:01 AM 0 5.47 0.00 0.37 0.00 0.05 94.11
12:26:01 AM 1 3.44 0.00 0.32 0.00 0.07 96.17
12:27:01 AM all 4.39 0.00 0.32 0.00 0.05 95.24
12:27:01 AM 0 2.34 0.00 0.18 0.00 0.05 97.42
12:27:01 AM 1 6.44 0.00 0.45 0.00 0.05 93.06
12:28:01 AM all 4.50 0.00 0.32 0.00 0.07 95.11
12:28:01 AM 0 6.31 0.00 0.40 0.00 0.07 93.23
12:28:01 AM 1 2.71 0.00 0.23 0.00 0.07 96.99
12:29:01 AM all 4.49 0.00 0.32 0.00 0.06 95.13
12:29:01 AM 0 4.33 0.00 0.33 0.00 0.07 95.27
12:29:01 AM 1 4.65 0.00 0.30 0.00 0.05 95.00
12:30:01 AM all 4.51 0.00 0.33 0.00 0.08 95.08
12:30:01 AM 0 4.58 0.00 0.32 0.00 0.08 95.02
12:30:01 AM 1 4.44 0.00 0.35 0.00 0.07 95.14
12:31:01 AM all 4.51 0.00 0.32 0.01 0.07 95.09
12:31:01 AM 0 2.86 0.00 0.23 0.02 0.05 96.84
12:31:01 AM 1 6.17 0.00 0.40 0.00 0.08 93.35
12:32:01 AM all 4.52 0.00 0.27 0.00 0.04 95.17
12:32:01 AM 0 4.55 0.00 0.27 0.00 0.05 95.13
12:32:01 AM 1 4.49 0.00 0.27 0.00 0.03 95.20
12:33:01 AM all 0.29 0.00 0.07 0.00 0.04 99.60
12:33:01 AM 0 0.55 0.00 0.08 0.00 0.05 99.31
12:33:01 AM 1 0.03 0.00 0.05 0.00 0.03 99.88
12:33:01 AM CPU %user %nice %system %iowait %steal %idle
12:34:01 AM all 0.55 0.00 0.09 0.00 0.02 99.34
12:34:01 AM 0 0.95 0.00 0.08 0.00 0.02 98.95
12:34:01 AM 1 0.15 0.00 0.10 0.00 0.02 99.73
12:35:01 AM all 0.34 0.00 0.08 0.00 0.05 99.53
12:35:01 AM 0 0.58 0.00 0.05 0.00 0.03 99.33
12:35:01 AM 1 0.10 0.00 0.10 0.00 0.07 99.73
12:36:01 AM all 0.32 0.00 0.08 0.00 0.03 99.57
12:36:01 AM 0 0.20 0.00 0.08 0.00 0.03 99.68
12:36:01 AM 1 0.43 0.00 0.07 0.00 0.03 99.47
12:37:01 AM all 0.54 0.00 0.09 0.00 0.03 99.34
12:37:01 AM 0 0.43 0.00 0.10 0.00 0.03 99.43
12:37:01 AM 1 0.65 0.00 0.08 0.00 0.02 99.25
12:38:01 AM all 0.27 0.00 0.13 0.02 0.02 99.57
12:38:01 AM 0 0.38 0.00 0.17 0.00 0.02 99.43
12:38:01 AM 1 0.15 0.00 0.10 0.03 0.02 99.70
12:39:01 AM all 5.96 0.00 1.83 0.00 0.06 92.16
12:39:01 AM 0 1.09 0.00 0.18 0.00 0.03 98.70
12:39:01 AM 1 11.10 0.00 3.56 0.00 0.09 85.25
12:40:01 AM all 6.75 0.00 3.05 0.00 0.07 90.13
12:40:01 AM 0 9.71 0.00 4.00 0.00 0.09 86.21
12:40:01 AM 1 3.89 0.00 2.13 0.00 0.05 93.92
12:41:01 AM all 0.45 0.00 0.11 0.00 0.03 99.42
12:41:01 AM 0 0.23 0.00 0.13 0.00 0.03 99.60
12:41:01 AM 1 0.67 0.00 0.08 0.00 0.02 99.23
12:42:01 AM all 0.58 0.00 0.12 0.00 0.03 99.27
12:42:01 AM 0 0.35 0.00 0.15 0.00 0.03 99.47
12:42:01 AM 1 0.82 0.00 0.08 0.00 0.02 99.08
12:43:01 AM all 7.01 0.00 1.88 0.00 0.05 91.06
12:43:01 AM 0 0.77 0.00 0.22 0.00 0.03 98.98
12:43:01 AM 1 13.61 0.00 3.65 0.00 0.07 82.66
12:44:01 AM all 4.69 0.00 0.22 0.00 0.05 95.04
12:44:01 AM 0 2.69 0.00 0.17 0.00 0.03 97.11
12:44:01 AM 1 6.69 0.00 0.27 0.00 0.07 92.97
12:44:01 AM CPU %user %nice %system %iowait %steal %idle
12:45:01 AM all 4.70 0.00 0.21 0.00 0.05 95.04
12:45:01 AM 0 4.33 0.00 0.22 0.00 0.05 95.40
12:45:01 AM 1 5.07 0.00 0.20 0.00 0.05 94.68
12:46:01 AM all 4.73 0.00 0.22 0.00 0.06 95.00
12:46:01 AM 0 5.84 0.00 0.22 0.00 0.07 93.87
12:46:01 AM 1 3.61 0.00 0.22 0.00 0.05 96.12
12:47:01 AM all 4.52 0.00 0.18 0.00 0.04 95.26
12:47:01 AM 0 5.29 0.00 0.20 0.00 0.03 94.48
12:47:01 AM 1 3.75 0.00 0.17 0.00 0.05 96.04
12:48:01 AM all 4.69 0.00 0.24 0.00 0.06 95.01
12:48:01 AM 0 2.12 0.00 0.22 0.00 0.07 97.59
12:48:01 AM 1 7.26 0.00 0.27 0.00 0.05 92.42
12:49:01 AM all 5.22 0.00 0.29 0.00 0.05 94.45
12:49:01 AM 0 2.49 0.00 0.22 0.00 0.03 97.26
12:49:01 AM 1 7.97 0.00 0.36 0.00 0.07 91.60
12:50:01 AM all 7.12 0.00 1.78 0.00 0.08 91.03
12:50:01 AM 0 0.67 0.00 0.17 0.00 0.05 99.11
12:50:01 AM 1 14.20 0.00 3.54 0.00 0.11 82.15
12:51:01 AM all 6.74 0.00 1.62 0.01 0.07 91.55
12:51:01 AM 0 1.77 0.00 0.22 0.02 0.05 97.95
12:51:01 AM 1 11.96 0.00 3.10 0.00 0.09 84.85
12:52:01 AM all 4.55 0.00 0.21 0.00 0.05 95.19
12:52:01 AM 0 6.64 0.00 0.23 0.00 0.07 93.05
12:52:01 AM 1 2.46 0.00 0.18 0.00 0.03 97.32
12:53:01 AM all 4.62 0.00 0.18 0.00 0.06 95.14
12:53:01 AM 0 5.44 0.00 0.20 0.00 0.07 94.29
12:53:01 AM 1 3.81 0.00 0.15 0.00 0.05 95.99
12:54:01 AM all 4.63 0.00 0.21 0.00 0.04 95.11
12:54:01 AM 0 3.38 0.00 0.18 0.00 0.03 96.40
12:54:01 AM 1 5.89 0.00 0.23 0.00 0.05 93.83
12:55:01 AM all 4.58 0.00 0.19 0.00 0.07 95.16
12:55:01 AM 0 4.85 0.00 0.20 0.00 0.07 94.88
12:55:01 AM 1 4.31 0.00 0.18 0.00 0.07 95.44
12:55:01 AM CPU %user %nice %system %iowait %steal %idle
12:56:01 AM all 4.53 0.00 0.18 0.00 0.05 95.23
12:56:01 AM 0 3.13 0.00 0.13 0.00 0.05 96.69
12:56:01 AM 1 5.94 0.00 0.23 0.00 0.05 93.78
12:57:01 AM all 5.60 0.00 0.64 0.00 0.06 93.70
12:57:01 AM 0 3.06 0.00 0.18 0.00 0.05 96.70
12:57:01 AM 1 8.22 0.00 1.10 0.00 0.07 90.61
12:58:01 AM all 6.91 0.00 2.03 0.00 0.07 90.99
12:58:01 AM 0 3.76 0.00 0.27 0.00 0.05 95.91
12:58:01 AM 1 10.21 0.00 3.86 0.00 0.09 85.84
12:59:01 AM all 5.76 0.00 1.74 0.00 0.05 92.45
12:59:01 AM 0 6.04 0.00 0.44 0.00 0.05 93.47
12:59:01 AM 1 5.49 0.00 3.02 0.00 0.05 91.43
01:00:01 AM all 4.54 0.00 0.36 0.00 0.03 95.06
01:00:01 AM 0 3.98 0.00 0.37 0.00 0.03 95.62
01:00:01 AM 1 5.10 0.00 0.35 0.00 0.03 94.51
01:01:01 AM all 4.47 0.00 0.36 0.00 0.06 95.11
01:01:01 AM 0 3.07 0.00 0.32 0.00 0.05 96.56
01:01:01 AM 1 5.88 0.00 0.39 0.00 0.07 93.66
01:02:01 AM all 4.56 0.17 0.38 0.01 0.04 94.85
01:02:01 AM 0 3.38 0.00 0.30 0.00 0.03 96.29
01:02:01 AM 1 5.73 0.33 0.45 0.02 0.05 93.41
01:03:01 AM all 4.52 0.00 0.31 0.00 0.06 95.12
01:03:01 AM 0 3.71 0.00 0.27 0.00 0.05 95.97
01:03:01 AM 1 5.32 0.00 0.35 0.00 0.07 94.26
01:04:01 AM all 4.57 0.00 0.35 0.00 0.05 95.03
01:04:01 AM 0 3.61 0.00 0.25 0.00 0.05 96.08
01:04:01 AM 1 5.53 0.00 0.45 0.00 0.05 93.97
01:05:01 AM all 5.93 0.00 0.36 0.00 0.04 93.67
01:05:01 AM 0 5.11 0.00 0.34 0.00 0.05 94.50
01:05:01 AM 1 6.74 0.00 0.38 0.00 0.03 92.84
01:06:01 AM all 0.56 0.00 0.08 0.00 0.03 99.33
01:06:01 AM 0 0.45 0.00 0.08 0.00 0.03 99.43
01:06:01 AM 1 0.67 0.00 0.07 0.00 0.03 99.23
01:06:01 AM CPU %user %nice %system %iowait %steal %idle
01:07:01 AM all 0.34 0.00 0.08 0.00 0.03 99.54
01:07:01 AM 0 0.12 0.00 0.08 0.00 0.03 99.77
01:07:01 AM 1 0.57 0.00 0.08 0.00 0.03 99.32
01:08:01 AM all 0.51 0.00 0.08 0.00 0.03 99.37
01:08:01 AM 0 0.43 0.00 0.10 0.00 0.03 99.43
01:08:01 AM 1 0.58 0.00 0.07 0.00 0.03 99.32
01:09:01 AM all 0.34 0.00 0.07 0.00 0.03 99.56
01:09:01 AM 0 0.12 0.00 0.08 0.00 0.03 99.77
01:09:01 AM 1 0.57 0.00 0.05 0.00 0.03 99.35
01:10:01 AM all 0.51 0.00 0.08 0.00 0.03 99.38
01:10:01 AM 0 0.57 0.00 0.08 0.00 0.03 99.32
01:10:01 AM 1 0.45 0.00 0.08 0.00 0.02 99.45
01:11:01 AM all 0.35 0.00 0.07 0.00 0.03 99.55
01:11:01 AM 0 0.62 0.00 0.07 0.00 0.05 99.26
01:11:01 AM 1 0.08 0.00 0.07 0.00 0.02 99.83
01:12:01 AM all 3.37 0.00 0.21 0.00 0.04 96.37
01:12:01 AM 0 5.22 0.00 0.27 0.00 0.03 94.47
01:12:01 AM 1 1.57 0.00 0.15 0.00 0.05 98.23
01:13:01 AM all 6.67 0.00 3.37 0.00 0.06 89.90
01:13:01 AM 0 7.63 0.00 4.86 0.00 0.07 87.44
01:13:01 AM 1 5.73 0.00 1.92 0.00 0.05 92.30
01:14:01 AM all 2.06 0.00 1.04 0.00 0.04 96.86
01:14:01 AM 0 0.65 0.00 0.07 0.00 0.05 99.23
01:14:01 AM 1 3.49 0.00 2.02 0.00 0.03 94.46
01:15:01 AM all 0.41 0.00 0.08 0.00 0.03 99.49
01:15:01 AM 0 0.58 0.00 0.05 0.00 0.02 99.35
01:15:01 AM 1 0.23 0.00 0.10 0.00 0.03 99.63
01:16:01 AM all 4.66 0.00 1.51 0.00 0.05 93.78
01:16:01 AM 0 0.55 0.00 0.13 0.00 0.03 99.28
01:16:01 AM 1 9.01 0.00 2.96 0.00 0.07 87.95
01:17:01 AM all 5.26 0.00 0.24 0.00 0.06 94.44
01:17:01 AM 0 3.55 0.00 0.20 0.00 0.05 96.20
01:17:01 AM 1 6.97 0.00 0.28 0.00 0.07 92.68
01:17:01 AM CPU %user %nice %system %iowait %steal %idle
01:18:01 AM all 4.56 0.00 0.20 0.00 0.06 95.18
01:18:01 AM 0 2.93 0.00 0.20 0.00 0.05 96.82
01:18:01 AM 1 6.19 0.00 0.20 0.00 0.07 93.54
01:19:01 AM all 4.67 0.00 0.20 0.00 0.07 95.07
01:19:01 AM 0 2.96 0.00 0.20 0.00 0.07 96.77
01:19:01 AM 1 6.37 0.00 0.20 0.00 0.07 93.36
01:20:01 AM all 4.49 0.00 0.18 0.00 0.05 95.29
01:20:01 AM 0 3.26 0.00 0.17 0.00 0.07 96.50
01:20:01 AM 1 5.72 0.00 0.18 0.00 0.03 94.07
01:21:01 AM all 4.48 0.00 0.19 0.00 0.04 95.29
01:21:01 AM 0 3.80 0.00 0.22 0.00 0.03 95.95
01:21:01 AM 1 5.16 0.00 0.17 0.00 0.05 94.62
01:22:01 AM all 4.59 0.00 0.21 0.00 0.06 95.14
01:22:01 AM 0 5.77 0.00 0.22 0.00 0.07 93.94
01:22:01 AM 1 3.41 0.00 0.20 0.00 0.05 96.34
01:23:01 AM all 6.73 0.00 1.43 0.00 0.06 91.78
01:23:01 AM 0 1.72 0.00 0.15 0.00 0.03 98.10
01:23:01 AM 1 12.13 0.00 2.81 0.00 0.09 84.97
01:24:01 AM all 6.71 0.00 2.68 0.00 0.06 90.54
01:24:01 AM 0 2.83 0.00 0.25 0.00 0.05 96.86
01:24:01 AM 1 10.79 0.00 5.24 0.00 0.07 83.90
01:25:01 AM all 5.63 0.00 0.39 0.00 0.05 93.93
01:25:01 AM 0 5.14 0.00 0.37 0.00 0.05 94.45
01:25:01 AM 1 6.13 0.00 0.41 0.00 0.05 93.41
01:26:01 AM all 4.56 0.00 0.35 0.00 0.05 95.04
01:26:01 AM 0 3.19 0.00 0.28 0.00 0.05 96.47
01:26:01 AM 1 5.92 0.00 0.42 0.00 0.05 93.61
01:27:01 AM all 4.56 0.00 0.34 0.00 0.07 95.03
01:27:01 AM 0 1.62 0.00 0.18 0.00 0.05 98.14
01:27:01 AM 1 7.50 0.00 0.50 0.00 0.08 91.91
01:28:01 AM all 4.54 0.00 0.33 0.00 0.04 95.08
01:28:01 AM 0 1.62 0.00 0.22 0.00 0.03 98.13
01:28:01 AM 1 7.46 0.00 0.45 0.00 0.05 92.04
01:28:01 AM CPU %user %nice %system %iowait %steal %idle
01:29:01 AM all 4.59 0.00 0.31 0.01 0.07 95.03
01:29:01 AM 0 2.22 0.00 0.18 0.00 0.07 97.53
01:29:01 AM 1 6.96 0.00 0.43 0.02 0.07 92.53
01:30:01 AM all 4.51 0.00 0.33 0.00 0.05 95.12
01:30:01 AM 0 5.71 0.00 0.32 0.00 0.05 93.92
01:30:01 AM 1 3.31 0.00 0.33 0.00 0.05 96.31
01:31:01 AM all 5.47 0.00 0.32 0.00 0.06 94.16
01:31:01 AM 0 3.73 0.00 0.28 0.00 0.07 95.92
01:31:01 AM 1 7.20 0.00 0.35 0.00 0.05 92.40
01:32:01 AM all 0.36 0.00 0.07 0.00 0.03 99.54
01:32:01 AM 0 0.13 0.00 0.07 0.00 0.03 99.77
01:32:01 AM 1 0.58 0.00 0.07 0.00 0.03 99.32
01:33:01 AM all 0.38 0.00 0.07 0.00 0.03 99.52
01:33:01 AM 0 0.18 0.00 0.08 0.00 0.03 99.70
01:33:01 AM 1 0.58 0.00 0.05 0.00 0.03 99.33
01:34:01 AM all 0.39 0.00 0.08 0.00 0.03 99.49
01:34:01 AM 0 0.40 0.00 0.08 0.00 0.03 99.48
01:34:01 AM 1 0.38 0.00 0.08 0.00 0.03 99.50
01:35:01 AM all 0.19 0.00 0.07 0.00 0.02 99.72
01:35:01 AM 0 0.10 0.00 0.03 0.00 0.02 99.85
01:35:01 AM 1 0.28 0.00 0.10 0.00 0.02 99.60
01:36:01 AM all 0.57 0.00 0.08 0.00 0.03 99.32
01:36:01 AM 0 0.30 0.00 0.07 0.00 0.03 99.60
01:36:01 AM 1 0.83 0.00 0.08 0.00 0.03 99.05
01:37:01 AM all 0.37 0.00 0.08 0.00 0.03 99.52
01:37:01 AM 0 0.12 0.00 0.10 0.00 0.03 99.75
01:37:01 AM 1 0.62 0.00 0.07 0.00 0.03 99.28
01:38:01 AM all 4.54 0.00 0.34 0.01 0.04 95.07
01:38:01 AM 0 4.28 0.00 0.31 0.02 0.03 95.36
01:38:01 AM 1 4.81 0.00 0.37 0.00 0.05 94.77
01:39:01 AM all 7.16 0.00 4.46 0.00 0.08 88.30
01:39:01 AM 0 0.70 0.00 0.15 0.00 0.03 99.12
01:39:01 AM 1 14.20 0.00 9.14 0.00 0.13 76.53
01:39:01 AM CPU %user %nice %system %iowait %steal %idle
01:40:01 AM all 1.31 0.00 0.16 0.00 0.03 98.50
01:40:01 AM 0 0.65 0.00 0.12 0.00 0.02 99.21
01:40:01 AM 1 1.97 0.00 0.20 0.00 0.03 97.79
01:41:01 AM all 0.44 0.00 0.10 0.00 0.03 99.42
01:41:01 AM 0 0.55 0.00 0.03 0.00 0.02 99.40
01:41:01 AM 1 0.33 0.00 0.17 0.00 0.05 99.45
01:42:01 AM all 0.56 0.00 0.11 0.00 0.03 99.31
01:42:01 AM 0 0.62 0.00 0.08 0.00 0.03 99.27
01:42:01 AM 1 0.50 0.00 0.13 0.00 0.02 99.35
01:43:01 AM all 0.42 0.00 0.09 0.00 0.04 99.45
01:43:01 AM 0 0.63 0.00 0.07 0.00 0.03 99.27
01:43:01 AM 1 0.20 0.00 0.12 0.00 0.05 99.63
01:44:01 AM all 0.63 0.00 0.11 0.00 0.03 99.23
01:44:01 AM 0 1.00 0.00 0.08 0.00 0.03 98.88
01:44:01 AM 1 0.27 0.00 0.13 0.00 0.02 99.58
01:45:01 AM all 0.41 0.00 0.12 0.00 0.03 99.45
01:45:01 AM 0 0.58 0.00 0.12 0.00 0.02 99.28
01:45:01 AM 1 0.23 0.00 0.12 0.00 0.03 99.62
01:46:01 AM all 0.45 0.00 0.10 0.00 0.02 99.43
01:46:01 AM 0 0.38 0.00 0.10 0.00 0.02 99.50
01:46:01 AM 1 0.52 0.00 0.10 0.00 0.02 99.36
01:47:01 AM all 0.39 0.00 0.11 0.00 0.03 99.47
01:47:01 AM 0 0.67 0.00 0.13 0.00 0.02 99.18
01:47:01 AM 1 0.12 0.00 0.08 0.00 0.03 99.77
01:48:01 AM all 0.58 0.00 0.11 0.00 0.03 99.28
01:48:01 AM 0 0.55 0.00 0.12 0.00 0.03 99.30
01:48:01 AM 1 0.62 0.00 0.10 0.00 0.02 99.27
01:49:01 AM all 0.33 0.00 0.10 0.00 0.02 99.56
01:49:01 AM 0 0.22 0.00 0.12 0.00 0.03 99.63
01:49:01 AM 1 0.43 0.00 0.08 0.00 0.00 99.48
01:50:01 AM all 0.57 0.00 0.08 0.00 0.03 99.32
01:50:01 AM 0 0.23 0.00 0.08 0.00 0.02 99.67
01:50:01 AM 1 0.90 0.00 0.08 0.00 0.03 98.98
01:50:01 AM CPU %user %nice %system %iowait %steal %idle
01:51:01 AM all 0.43 0.00 0.10 0.00 0.03 99.45
01:51:01 AM 0 0.15 0.00 0.10 0.00 0.03 99.72
01:51:01 AM 1 0.70 0.00 0.10 0.00 0.02 99.18
01:52:01 AM all 0.50 0.00 0.14 0.00 0.02 99.34
01:52:01 AM 0 0.55 0.00 0.12 0.00 0.02 99.31
01:52:01 AM 1 0.45 0.00 0.17 0.00 0.02 99.37
01:53:01 AM all 0.43 0.00 0.09 0.00 0.03 99.45
01:53:01 AM 0 0.60 0.00 0.05 0.00 0.02 99.33
01:53:01 AM 1 0.27 0.00 0.13 0.00 0.03 99.57
01:54:01 AM all 2.36 0.00 0.22 0.00 0.04 97.38
01:54:01 AM 0 4.47 0.00 0.29 0.00 0.05 95.19
01:54:01 AM 1 0.30 0.00 0.15 0.00 0.03 99.52
01:55:01 AM all 6.57 0.00 1.69 0.00 0.06 91.68
01:55:01 AM 0 9.91 0.00 3.21 0.00 0.07 86.81
01:55:01 AM 1 3.34 0.00 0.23 0.00 0.05 96.37
01:56:01 AM all 4.84 0.00 0.21 0.00 0.04 94.91
01:56:01 AM 0 4.44 0.00 0.20 0.00 0.05 95.31
01:56:01 AM 1 5.25 0.00 0.22 0.00 0.03 94.50
01:57:01 AM all 4.85 0.00 0.19 0.00 0.05 94.91
01:57:01 AM 0 2.53 0.00 0.18 0.00 0.05 97.24
01:57:01 AM 1 7.18 0.00 0.20 0.00 0.05 92.57
01:58:01 AM all 4.83 0.00 0.23 0.00 0.03 94.91
01:58:01 AM 0 3.58 0.00 0.18 0.00 0.03 96.20
01:58:01 AM 1 6.08 0.00 0.27 0.00 0.03 93.62
01:59:01 AM all 4.88 0.00 0.22 0.00 0.07 94.83
01:59:01 AM 0 3.68 0.00 0.20 0.00 0.07 96.05
01:59:01 AM 1 6.09 0.00 0.23 0.00 0.07 93.61
02:00:01 AM all 5.06 0.00 0.21 0.00 0.04 94.68
02:00:01 AM 0 6.14 0.00 0.24 0.00 0.05 93.57
02:00:01 AM 1 3.98 0.00 0.18 0.00 0.03 95.80
02:01:01 AM all 6.21 0.00 0.36 0.00 0.07 93.36
02:01:01 AM 0 7.47 0.00 0.41 0.00 0.07 92.06
02:01:01 AM 1 4.96 0.00 0.32 0.00 0.07 94.66
02:01:01 AM CPU %user %nice %system %iowait %steal %idle
02:02:01 AM all 4.56 0.00 1.66 0.00 0.06 93.72
02:02:01 AM 0 8.69 0.00 3.28 0.00 0.09 87.95
02:02:01 AM 1 0.65 0.00 0.13 0.00 0.03 99.18
02:03:01 AM all 0.29 0.00 0.07 0.00 0.02 99.62
02:03:01 AM 0 0.12 0.00 0.07 0.00 0.02 99.80
02:03:01 AM 1 0.47 0.00 0.07 0.00 0.02 99.45
02:04:01 AM all 0.43 0.00 0.10 0.00 0.02 99.45
02:04:01 AM 0 0.53 0.00 0.12 0.00 0.03 99.31
02:04:01 AM 1 0.33 0.00 0.08 0.00 0.00 99.58
02:05:01 AM all 0.38 0.00 0.08 0.00 0.03 99.52
02:05:01 AM 0 0.58 0.00 0.08 0.00 0.03 99.30
02:05:01 AM 1 0.17 0.00 0.07 0.00 0.03 99.73
02:06:01 AM all 0.46 0.00 0.11 0.00 0.02 99.41
02:06:01 AM 0 0.32 0.00 0.10 0.00 0.02 99.56
02:06:01 AM 1 0.60 0.00 0.12 0.00 0.02 99.27
02:07:01 AM all 0.35 0.00 0.08 0.00 0.03 99.55
02:07:01 AM 0 0.59 0.00 0.08 0.00 0.03 99.30
02:07:01 AM 1 0.12 0.00 0.07 0.00 0.02 99.80
02:08:01 AM all 0.53 0.00 0.10 0.00 0.03 99.34
02:08:01 AM 0 0.65 0.00 0.10 0.00 0.03 99.21
02:08:01 AM 1 0.42 0.00 0.10 0.00 0.02 99.47
02:09:01 AM all 0.23 0.00 0.10 0.00 0.02 99.65
02:09:01 AM 0 0.36 0.00 0.14 0.00 0.02 99.49
02:09:01 AM 1 0.10 0.00 0.07 0.00 0.02 99.81
02:10:01 AM all 0.27 0.00 0.11 0.00 0.03 99.59
02:10:01 AM 0 0.15 0.00 0.10 0.00 0.05 99.70
02:10:01 AM 1 0.38 0.00 0.12 0.00 0.02 99.48
02:11:01 AM all 0.14 0.00 0.09 0.01 0.02 99.74
02:11:01 AM 0 0.18 0.00 0.12 0.02 0.03 99.65
02:11:01 AM 1 0.10 0.00 0.07 0.00 0.00 99.83
02:12:01 AM all 0.11 0.18 0.14 0.00 0.04 99.52
02:12:01 AM 0 0.12 0.18 0.17 0.00 0.05 99.48
02:12:01 AM 1 0.10 0.18 0.12 0.00 0.03 99.57
02:12:01 AM CPU %user %nice %system %iowait %steal %idle
02:13:01 AM all 0.26 0.00 0.09 0.00 0.03 99.62
02:13:01 AM 0 0.15 0.00 0.10 0.00 0.03 99.72
02:13:01 AM 1 0.37 0.00 0.08 0.00 0.02 99.53
02:14:01 AM all 0.13 0.00 0.07 0.00 0.02 99.79
02:14:01 AM 0 0.13 0.00 0.07 0.00 0.02 99.78
02:14:01 AM 1 0.12 0.00 0.07 0.00 0.02 99.80
02:15:01 AM all 6.24 0.00 1.50 0.00 0.07 92.19
02:15:01 AM 0 10.58 0.00 2.96 0.00 0.09 86.37
02:15:01 AM 1 2.17 0.00 0.13 0.00 0.05 97.64
02:16:01 AM all 4.41 0.00 0.23 0.00 0.04 95.32
02:16:01 AM 0 5.21 0.00 0.25 0.00 0.05 94.49
02:16:01 AM 1 3.61 0.00 0.20 0.00 0.03 96.16
02:17:01 AM all 4.45 0.00 0.18 0.00 0.04 95.33
02:17:01 AM 0 3.73 0.00 0.17 0.00 0.03 96.07
02:17:01 AM 1 5.17 0.00 0.20 0.00 0.05 94.58
02:18:01 AM all 4.60 0.00 0.20 0.00 0.07 95.13
02:18:01 AM 0 3.30 0.00 0.20 0.00 0.07 96.44
02:18:01 AM 1 5.90 0.00 0.20 0.00 0.07 93.83
02:19:01 AM all 4.60 0.00 0.19 0.00 0.05 95.16
02:19:01 AM 0 4.00 0.00 0.17 0.00 0.05 95.78
02:19:01 AM 1 5.20 0.00 0.22 0.00 0.05 94.54
02:20:01 AM all 4.55 0.00 0.21 0.00 0.05 95.19
02:20:01 AM 0 4.54 0.00 0.20 0.00 0.05 95.20
02:20:01 AM 1 4.56 0.00 0.22 0.00 0.05 95.17
02:21:01 AM all 4.92 0.00 0.24 0.00 0.05 94.78
02:21:01 AM 0 2.20 0.00 0.20 0.00 0.05 97.55
02:21:01 AM 1 7.67 0.00 0.29 0.00 0.05 91.99
02:22:01 AM all 4.26 0.00 1.55 0.00 0.05 94.14
02:22:01 AM 0 2.84 0.00 0.29 0.00 0.05 96.82
02:22:01 AM 1 5.70 0.00 2.83 0.00 0.05 91.41
02:23:01 AM all 0.28 0.00 0.07 0.03 0.02 99.61
02:23:01 AM 0 0.12 0.00 0.07 0.00 0.02 99.80
02:23:01 AM 1 0.45 0.00 0.07 0.05 0.02 99.42
02:23:01 AM CPU %user %nice %system %iowait %steal %idle
02:24:01 AM all 0.47 0.00 0.08 0.00 0.04 99.41
02:24:01 AM 0 0.37 0.00 0.10 0.00 0.03 99.50
02:24:01 AM 1 0.57 0.00 0.07 0.00 0.05 99.32
02:25:01 AM all 0.37 0.00 0.07 0.00 0.03 99.54
02:25:01 AM 0 0.15 0.00 0.10 0.00 0.03 99.72
02:25:01 AM 1 0.58 0.00 0.03 0.00 0.02 99.37
02:26:01 AM all 0.38 0.00 0.09 0.00 0.03 99.50
02:26:01 AM 0 0.15 0.00 0.08 0.00 0.03 99.73
02:26:01 AM 1 0.62 0.00 0.10 0.00 0.02 99.26
02:27:01 AM all 0.37 0.00 0.06 0.00 0.03 99.55
02:27:01 AM 0 0.22 0.00 0.07 0.00 0.03 99.68
02:27:01 AM 1 0.52 0.00 0.05 0.00 0.02 99.42
02:28:01 AM all 0.58 0.00 0.09 0.00 0.03 99.29
02:28:01 AM 0 0.58 0.00 0.08 0.00 0.03 99.30
02:28:01 AM 1 0.58 0.00 0.10 0.00 0.03 99.28
02:29:01 AM all 0.33 0.00 0.07 0.00 0.03 99.58
02:29:01 AM 0 0.48 0.00 0.05 0.00 0.02 99.45
02:29:01 AM 1 0.17 0.00 0.08 0.00 0.03 99.72
02:30:01 AM all 0.54 0.00 0.09 0.00 0.02 99.35
02:30:01 AM 0 0.85 0.00 0.08 0.00 0.02 99.05
02:30:01 AM 1 0.23 0.00 0.10 0.00 0.02 99.65
02:31:01 AM all 0.37 0.00 0.08 0.00 0.03 99.53
02:31:01 AM 0 0.38 0.00 0.07 0.00 0.02 99.53
02:31:01 AM 1 0.35 0.00 0.08 0.00 0.03 99.53
02:32:01 AM all 0.34 0.00 0.09 0.00 0.03 99.54
02:32:01 AM 0 0.20 0.00 0.12 0.00 0.03 99.65
02:32:01 AM 1 0.48 0.00 0.07 0.00 0.02 99.43
02:33:01 AM all 0.54 0.00 0.10 0.00 0.03 99.33
02:33:01 AM 0 0.65 0.00 0.08 0.00 0.03 99.23
02:33:01 AM 1 0.43 0.00 0.12 0.00 0.02 99.43
02:34:01 AM all 0.34 0.00 0.08 0.00 0.02 99.57
02:34:01 AM 0 0.52 0.00 0.07 0.00 0.02 99.40
02:34:01 AM 1 0.17 0.00 0.08 0.00 0.02 99.73
02:34:01 AM CPU %user %nice %system %iowait %steal %idle
02:35:01 AM all 6.56 0.00 1.67 0.00 0.07 91.70
02:35:01 AM 0 1.27 0.00 0.12 0.00 0.03 98.58
02:35:01 AM 1 12.18 0.00 3.32 0.00 0.11 84.40
02:36:01 AM all 4.61 0.00 0.19 0.00 0.05 95.15
02:36:01 AM 0 3.90 0.00 0.20 0.00 0.05 95.85
02:36:01 AM 1 5.32 0.00 0.18 0.00 0.05 94.45
02:37:01 AM all 4.64 0.00 0.19 0.00 0.03 95.14
02:37:01 AM 0 2.28 0.00 0.17 0.00 0.03 97.52
02:37:01 AM 1 6.99 0.00 0.22 0.00 0.03 92.76
02:38:01 AM all 4.72 0.00 0.22 0.00 0.04 95.02
02:38:01 AM 0 1.66 0.00 0.18 0.00 0.03 98.13
02:38:01 AM 1 7.78 0.00 0.25 0.00 0.05 91.92
02:39:01 AM all 4.75 0.00 0.18 0.00 0.05 95.02
02:39:01 AM 0 1.82 0.00 0.15 0.00 0.05 97.98
02:39:01 AM 1 7.68 0.00 0.22 0.00 0.05 92.05
02:40:01 AM all 4.89 0.00 0.23 0.01 0.04 94.82
02:40:01 AM 0 6.51 0.00 0.23 0.00 0.03 93.22
02:40:01 AM 1 3.27 0.00 0.23 0.02 0.05 96.42
02:41:01 AM all 5.26 0.00 0.27 0.00 0.07 94.40
02:41:01 AM 0 4.13 0.00 0.22 0.00 0.07 95.58
02:41:01 AM 1 6.41 0.00 0.32 0.00 0.07 93.20
02:42:01 AM all 4.01 0.00 1.55 0.00 0.05 94.38
02:42:01 AM 0 0.45 0.00 0.13 0.00 0.03 99.38
02:42:01 AM 1 7.73 0.00 3.04 0.00 0.07 89.16
02:43:01 AM all 0.36 0.00 0.08 0.00 0.03 99.53
02:43:01 AM 0 0.55 0.00 0.07 0.00 0.03 99.35
02:43:01 AM 1 0.17 0.00 0.10 0.00 0.02 99.72
02:44:01 AM all 0.48 0.00 0.08 0.00 0.03 99.41
02:44:01 AM 0 0.38 0.00 0.10 0.00 0.03 99.48
02:44:01 AM 1 0.58 0.00 0.07 0.00 0.02 99.33
02:45:01 AM all 0.38 0.00 0.07 0.00 0.03 99.53
02:45:01 AM 0 0.17 0.00 0.05 0.00 0.02 99.77
02:45:01 AM 1 0.58 0.00 0.08 0.00 0.03 99.30
02:45:01 AM CPU %user %nice %system %iowait %steal %idle
02:46:01 AM all 0.32 0.00 0.08 0.00 0.03 99.57
02:46:01 AM 0 0.33 0.00 0.08 0.00 0.02 99.57
02:46:01 AM 1 0.30 0.00 0.08 0.00 0.03 99.58
02:47:01 AM all 0.36 0.00 0.07 0.00 0.03 99.54
02:47:01 AM 0 0.12 0.00 0.07 0.00 0.03 99.78
02:47:01 AM 1 0.60 0.00 0.07 0.00 0.03 99.30
02:48:01 AM all 0.48 0.00 0.10 0.00 0.03 99.39
02:48:01 AM 0 0.40 0.00 0.12 0.00 0.03 99.45
02:48:01 AM 1 0.57 0.00 0.08 0.00 0.02 99.33
02:49:01 AM all 0.35 0.00 0.08 0.00 0.03 99.53
02:49:01 AM 0 0.15 0.00 0.08 0.00 0.03 99.73
02:49:01 AM 1 0.55 0.00 0.08 0.00 0.03 99.33
02:50:01 AM all 0.50 0.00 0.10 0.00 0.03 99.37
02:50:01 AM 0 0.38 0.00 0.13 0.00 0.03 99.45
02:50:01 AM 1 0.62 0.00 0.07 0.00 0.02 99.30
02:51:01 AM all 0.37 0.00 0.08 0.00 0.03 99.52
02:51:01 AM 0 0.63 0.00 0.08 0.00 0.05 99.23
02:51:01 AM 1 0.10 0.00 0.07 0.00 0.02 99.82
02:52:01 AM all 0.63 0.00 0.09 0.00 0.03 99.25
02:52:01 AM 0 0.65 0.00 0.03 0.00 0.02 99.30
02:52:01 AM 1 0.62 0.00 0.15 0.00 0.03 99.20
02:53:01 AM all 0.25 0.00 0.07 0.01 0.03 99.64
02:53:01 AM 0 0.38 0.00 0.07 0.02 0.03 99.50
02:53:01 AM 1 0.12 0.00 0.07 0.00 0.03 99.78
02:54:01 AM all 0.28 0.00 0.10 0.00 0.05 99.57
02:54:01 AM 0 0.47 0.00 0.13 0.00 0.05 99.35
02:54:01 AM 1 0.10 0.00 0.07 0.00 0.05 99.78
02:55:01 AM all 7.31 0.00 2.82 0.00 0.08 89.79
02:55:01 AM 0 13.91 0.00 5.71 0.00 0.13 80.26
02:55:01 AM 1 1.20 0.00 0.15 0.00 0.03 98.61
02:56:01 AM all 5.44 0.00 0.42 0.00 0.05 94.09
02:56:01 AM 0 6.33 0.00 0.49 0.00 0.05 93.13
02:56:01 AM 1 4.55 0.00 0.35 0.00 0.05 95.05
02:56:01 AM CPU %user %nice %system %iowait %steal %idle
02:57:01 AM all 4.89 0.00 0.34 0.00 0.03 94.73
02:57:01 AM 0 3.12 0.00 0.25 0.00 0.03 96.60
02:57:01 AM 1 6.66 0.00 0.44 0.00 0.03 92.87
02:58:01 AM all 4.82 0.00 0.43 0.00 0.05 94.70
02:58:01 AM 0 5.46 0.00 0.49 0.00 0.05 94.00
02:58:01 AM 1 4.18 0.00 0.37 0.00 0.05 95.40
02:59:01 AM all 4.76 0.00 0.37 0.00 0.07 94.80
02:59:01 AM 0 5.70 0.00 0.44 0.00 0.07 93.80
02:59:01 AM 1 3.83 0.00 0.30 0.00 0.07 95.80
03:00:01 AM all 4.90 0.00 0.39 0.00 0.08 94.63
03:00:01 AM 0 4.02 0.00 0.35 0.00 0.08 95.55
03:00:01 AM 1 5.79 0.00 0.42 0.00 0.08 93.71
03:01:01 AM all 4.83 0.00 0.41 0.00 0.05 94.71
03:01:01 AM 0 5.41 0.00 0.40 0.00 0.05 94.14
03:01:01 AM 1 4.25 0.00 0.42 0.00 0.05 95.28
03:02:01 AM all 5.23 0.00 0.33 0.00 0.04 94.41
03:02:01 AM 0 4.37 0.00 0.27 0.00 0.05 95.31
03:02:01 AM 1 6.08 0.00 0.38 0.00 0.03 93.50
03:03:01 AM all 0.35 0.00 0.09 0.00 0.02 99.54
03:03:01 AM 0 0.20 0.00 0.13 0.00 0.02 99.65
03:03:01 AM 1 0.50 0.00 0.05 0.00 0.02 99.43
03:04:01 AM all 0.40 0.00 0.09 0.00 0.03 99.48
03:04:01 AM 0 0.54 0.00 0.08 0.00 0.03 99.35
03:04:01 AM 1 0.27 0.00 0.10 0.00 0.02 99.62
03:05:01 AM all 0.60 0.00 0.07 0.00 0.03 99.31
03:05:01 AM 0 0.67 0.00 0.07 0.00 0.03 99.23
03:05:01 AM 1 0.53 0.00 0.07 0.00 0.02 99.38
03:06:01 AM all 0.36 0.00 0.08 0.00 0.03 99.54
03:06:01 AM 0 0.62 0.00 0.10 0.00 0.03 99.25
03:06:01 AM 1 0.10 0.00 0.05 0.00 0.02 99.83
03:07:01 AM all 0.52 0.00 0.10 0.00 0.02 99.36
03:07:01 AM 0 0.52 0.00 0.05 0.00 0.02 99.41
03:07:01 AM 1 0.52 0.00 0.15 0.00 0.02 99.32
03:07:01 AM CPU %user %nice %system %iowait %steal %idle
03:08:01 AM all 0.39 0.00 0.08 0.00 0.03 99.51
03:08:01 AM 0 0.58 0.00 0.05 0.00 0.02 99.35
03:08:01 AM 1 0.20 0.00 0.10 0.00 0.03 99.67
03:09:01 AM all 5.49 0.00 0.42 0.00 0.05 94.04
03:09:01 AM 0 8.12 0.00 0.61 0.00 0.07 91.19
03:09:01 AM 1 2.98 0.00 0.23 0.00 0.03 96.76
03:10:01 AM all 7.17 0.00 4.65 0.00 0.07 88.11
03:10:01 AM 0 5.15 0.00 5.29 0.00 0.05 89.51
03:10:01 AM 1 9.25 0.00 3.99 0.00 0.09 86.67
03:11:01 AM all 0.57 0.00 0.11 0.00 0.03 99.29
03:11:01 AM 0 0.70 0.00 0.12 0.00 0.05 99.13
03:11:01 AM 1 0.43 0.00 0.10 0.00 0.02 99.45
03:12:01 AM all 0.38 0.00 0.09 0.00 0.03 99.50
03:12:01 AM 0 0.62 0.00 0.08 0.00 0.02 99.28
03:12:01 AM 1 0.15 0.00 0.10 0.00 0.03 99.72
03:13:01 AM all 6.78 0.00 1.68 0.00 0.07 91.47
03:13:01 AM 0 2.19 0.00 0.22 0.00 0.03 97.55
03:13:01 AM 1 11.64 0.00 3.23 0.00 0.11 85.03
03:14:01 AM all 4.59 0.00 0.18 0.00 0.04 95.18
03:14:01 AM 0 3.21 0.00 0.17 0.00 0.03 96.59
03:14:01 AM 1 5.97 0.00 0.20 0.00 0.05 93.78
03:15:01 AM all 4.24 0.00 0.21 0.00 0.04 95.51
03:15:01 AM 0 2.07 0.00 0.17 0.00 0.05 97.71
03:15:01 AM 1 6.41 0.00 0.25 0.00 0.03 93.31
03:16:01 AM all 4.72 0.00 0.20 0.00 0.08 95.01
03:16:01 AM 0 3.60 0.00 0.20 0.00 0.07 96.14
03:16:01 AM 1 5.83 0.00 0.20 0.00 0.08 93.88
03:17:01 AM all 5.15 0.00 0.21 0.00 0.08 94.56
03:17:01 AM 0 5.18 0.00 0.25 0.00 0.10 94.47
03:17:01 AM 1 5.12 0.00 0.17 0.00 0.07 94.65
03:18:02 AM all 4.74 0.00 0.24 0.00 0.03 94.99
03:18:02 AM 0 2.28 0.00 0.23 0.00 0.03 97.46
03:18:02 AM 1 7.19 0.00 0.25 0.00 0.03 92.52
03:18:02 AM CPU %user %nice %system %iowait %steal %idle
03:19:01 AM all 4.44 0.00 0.21 0.00 0.05 95.29
03:19:01 AM 0 3.29 0.00 0.22 0.00 0.05 96.44
03:19:01 AM 1 5.60 0.00 0.20 0.00 0.05 94.14
03:20:01 AM all 7.09 0.00 1.76 0.00 0.08 91.07
03:20:01 AM 0 0.44 0.00 0.13 0.00 0.03 99.40
03:20:01 AM 1 14.36 0.00 3.53 0.00 0.13 81.98
03:21:01 AM all 7.00 0.00 1.89 0.00 0.07 91.03
03:21:01 AM 0 0.80 0.00 0.22 0.00 0.03 98.95
03:21:01 AM 1 13.58 0.00 3.67 0.00 0.11 82.65
03:22:01 AM all 4.64 0.00 0.19 0.00 0.05 95.11
03:22:01 AM 0 2.74 0.00 0.17 0.00 0.05 97.04
03:22:01 AM 1 6.55 0.00 0.22 0.00 0.05 93.19
03:23:01 AM all 4.64 0.00 0.18 0.00 0.06 95.13
03:23:01 AM 0 2.93 0.00 0.17 0.00 0.07 96.84
03:23:01 AM 1 6.35 0.00 0.18 0.00 0.05 93.41
03:24:01 AM all 4.67 0.00 0.19 0.00 0.04 95.09
03:24:01 AM 0 1.10 0.00 0.17 0.00 0.05 98.68
03:24:01 AM 1 8.25 0.00 0.22 0.00 0.03 91.50
03:25:01 AM all 4.64 0.00 0.20 0.00 0.04 95.12
03:25:01 AM 0 3.61 0.00 0.22 0.00 0.03 96.13
03:25:01 AM 1 5.67 0.00 0.18 0.00 0.05 94.10
03:26:01 AM all 4.71 0.00 0.22 0.00 0.07 95.01
03:26:01 AM 0 2.12 0.00 0.20 0.00 0.07 97.61
03:26:01 AM 1 7.29 0.00 0.23 0.00 0.07 92.41
03:27:01 AM all 5.45 0.00 0.24 0.00 0.05 94.26
03:27:01 AM 0 1.27 0.00 0.12 0.00 0.03 98.58
03:27:01 AM 1 9.73 0.00 0.36 0.00 0.07 89.84
03:28:01 AM all 7.09 0.00 1.63 0.00 0.06 91.22
03:28:01 AM 0 0.75 0.00 0.20 0.00 0.03 99.01
03:28:01 AM 1 13.96 0.00 3.19 0.00 0.09 82.76
03:29:01 AM all 6.06 0.00 2.61 0.00 0.07 91.26
03:29:01 AM 0 2.21 0.00 0.25 0.00 0.07 97.47
03:29:01 AM 1 10.06 0.00 5.05 0.00 0.07 84.83
03:29:01 AM CPU %user %nice %system %iowait %steal %idle
03:30:01 AM all 5.07 0.00 0.38 0.01 0.08 94.46
03:30:01 AM 0 4.37 0.00 0.33 0.02 0.08 95.20
03:30:01 AM 1 5.77 0.00 0.42 0.00 0.08 93.73
03:31:01 AM all 4.99 0.00 0.40 0.00 0.07 94.54
03:31:01 AM 0 4.32 0.00 0.35 0.00 0.07 95.26
03:31:01 AM 1 5.67 0.00 0.45 0.00 0.07 93.82
03:32:01 AM all 4.71 0.00 0.35 0.00 0.05 94.89
03:32:01 AM 0 2.27 0.00 0.23 0.00 0.05 97.44
03:32:01 AM 1 7.14 0.00 0.47 0.00 0.05 92.34
03:33:01 AM all 4.60 0.00 0.37 0.01 0.05 94.98
03:33:01 AM 0 3.53 0.00 0.32 0.00 0.05 96.10
03:33:01 AM 1 5.67 0.00 0.42 0.02 0.05 93.85
03:34:01 AM all 4.96 0.00 0.34 0.00 0.05 94.65
03:34:01 AM 0 3.43 0.00 0.23 0.00 0.03 96.30
03:34:01 AM 1 6.49 0.00 0.45 0.00 0.07 92.99
03:35:01 AM all 6.62 0.00 0.37 0.00 0.06 92.95
03:35:01 AM 0 7.48 0.00 0.42 0.00 0.07 92.03
03:35:01 AM 1 5.75 0.00 0.32 0.00 0.05 93.88
03:36:01 AM all 0.60 0.18 0.17 0.01 0.03 99.02
03:36:01 AM 0 0.72 0.00 0.13 0.02 0.02 99.12
03:36:01 AM 1 0.48 0.35 0.20 0.00 0.03 98.93
03:37:01 AM all 0.38 0.00 0.06 0.00 0.03 99.52
03:37:01 AM 0 0.48 0.00 0.02 0.00 0.02 99.48
03:37:01 AM 1 0.28 0.00 0.10 0.00 0.05 99.57
03:38:01 AM all 0.63 0.00 0.10 0.00 0.03 99.25
03:38:01 AM 0 0.95 0.00 0.08 0.00 0.02 98.95
03:38:01 AM 1 0.30 0.00 0.12 0.00 0.03 99.55
03:39:01 AM all 0.35 0.00 0.08 0.00 0.03 99.53
03:39:01 AM 0 0.50 0.00 0.07 0.00 0.03 99.40
03:39:01 AM 1 0.20 0.00 0.10 0.00 0.03 99.67
03:40:01 AM all 0.63 0.00 0.10 0.00 0.03 99.25
03:40:01 AM 0 0.65 0.00 0.12 0.00 0.02 99.21
03:40:01 AM 1 0.60 0.00 0.08 0.00 0.03 99.28
03:40:01 AM CPU %user %nice %system %iowait %steal %idle
03:41:01 AM all 0.36 0.00 0.08 0.00 0.03 99.53
03:41:01 AM 0 0.64 0.00 0.10 0.00 0.05 99.21
03:41:01 AM 1 0.08 0.00 0.05 0.00 0.02 99.85
03:42:01 AM all 2.80 0.00 0.16 0.00 0.03 97.02
03:42:01 AM 0 3.31 0.00 0.19 0.00 0.03 96.47
03:42:01 AM 1 2.29 0.00 0.13 0.00 0.02 97.56
03:43:01 AM all 8.10 0.00 3.76 0.00 0.11 88.04
03:43:01 AM 0 16.11 0.00 7.64 0.00 0.15 76.10
03:43:01 AM 1 0.83 0.00 0.23 0.00 0.07 98.86
03:44:01 AM all 3.99 0.00 1.82 0.00 0.05 94.14
03:44:01 AM 0 7.45 0.00 3.49 0.00 0.05 89.00
03:44:01 AM 1 0.64 0.00 0.20 0.00 0.05 99.11
03:45:01 AM all 0.45 0.00 0.10 0.00 0.03 99.42
03:45:01 AM 0 0.20 0.00 0.10 0.00 0.03 99.67
03:45:01 AM 1 0.70 0.00 0.10 0.00 0.03 99.17
03:46:01 AM all 3.36 0.00 1.20 0.00 0.03 95.41
03:46:01 AM 0 6.36 0.00 2.36 0.00 0.05 91.23
03:46:01 AM 1 0.48 0.00 0.10 0.00 0.02 99.40
03:47:01 AM all 6.83 0.00 1.86 0.00 0.07 91.24
03:47:01 AM 0 3.23 0.00 0.71 0.00 0.07 95.98
03:47:01 AM 1 10.63 0.00 3.08 0.00 0.07 86.22
03:48:01 AM all 7.28 0.00 3.02 0.00 0.08 89.62
03:48:01 AM 0 7.39 0.00 2.54 0.00 0.09 89.99
03:48:01 AM 1 7.17 0.00 3.51 0.00 0.07 89.26
03:49:01 AM all 8.15 0.00 2.52 0.00 0.10 89.24
03:49:01 AM 0 16.25 0.00 5.05 0.00 0.14 78.55
03:49:01 AM 1 0.68 0.00 0.18 0.00 0.05 99.08
03:50:01 AM all 0.46 0.00 0.12 0.00 0.03 99.40
03:50:01 AM 0 0.17 0.00 0.12 0.00 0.02 99.70
03:50:01 AM 1 0.75 0.00 0.12 0.00 0.03 99.10
03:51:01 AM all 0.61 0.00 0.13 0.00 0.03 99.24
03:51:01 AM 0 1.04 0.00 0.17 0.00 0.03 98.76
03:51:01 AM 1 0.18 0.00 0.08 0.00 0.02 99.72
03:51:01 AM CPU %user %nice %system %iowait %steal %idle
03:52:01 AM all 8.97 0.00 2.95 0.00 0.11 87.98
03:52:01 AM 0 17.57 0.00 6.00 0.00 0.18 76.25
03:52:01 AM 1 1.08 0.00 0.15 0.00 0.05 98.71
03:53:01 AM all 5.33 0.00 0.36 0.01 0.05 94.26
03:53:01 AM 0 3.77 0.00 0.32 0.00 0.05 95.86
03:53:01 AM 1 6.88 0.00 0.40 0.02 0.05 92.65
03:54:01 AM all 5.27 0.00 0.36 0.00 0.06 94.31
03:54:01 AM 0 5.44 0.00 0.33 0.00 0.07 94.16
03:54:01 AM 1 5.10 0.00 0.38 0.00 0.05 94.47
03:55:01 AM all 5.11 0.00 0.38 0.00 0.05 94.46
03:55:01 AM 0 5.44 0.00 0.44 0.00 0.05 94.07
03:55:01 AM 1 4.78 0.00 0.32 0.00 0.05 94.85
03:56:01 AM all 5.18 0.00 0.37 0.00 0.08 94.37
03:56:01 AM 0 5.47 0.00 0.38 0.00 0.08 94.06
03:56:01 AM 1 4.90 0.00 0.35 0.00 0.07 94.68
03:57:01 AM all 4.47 0.00 0.33 0.00 0.06 95.13
03:57:01 AM 0 3.29 0.00 0.32 0.00 0.07 96.32
03:57:01 AM 1 5.65 0.00 0.35 0.00 0.05 93.94
03:58:01 AM all 4.40 0.00 0.33 0.00 0.07 95.21
03:58:01 AM 0 2.81 0.00 0.22 0.00 0.05 96.92
03:58:01 AM 1 5.98 0.00 0.43 0.00 0.08 93.50
03:59:01 AM all 4.91 0.00 0.32 0.00 0.05 94.72
03:59:01 AM 0 2.66 0.00 0.30 0.00 0.07 96.97
03:59:01 AM 1 7.15 0.00 0.33 0.00 0.03 92.48
04:00:01 AM all 1.24 0.00 0.20 0.00 0.04 98.52
04:00:01 AM 0 0.49 0.00 0.22 0.00 0.03 99.26
04:00:01 AM 1 1.99 0.00 0.18 0.00 0.05 97.78
04:01:01 AM all 1.36 0.00 0.18 0.00 0.04 98.42
04:01:01 AM 0 0.80 0.00 0.15 0.00 0.03 99.01
04:01:01 AM 1 1.92 0.00 0.20 0.00 0.05 97.83
04:02:01 AM all 1.30 0.00 0.18 0.00 0.03 98.50
04:02:01 AM 0 1.24 0.00 0.13 0.00 0.02 98.61
04:02:01 AM 1 1.37 0.00 0.22 0.00 0.03 98.38
04:02:01 AM CPU %user %nice %system %iowait %steal %idle
04:03:01 AM all 1.21 0.00 0.15 0.00 0.04 98.60
04:03:01 AM 0 1.37 0.00 0.20 0.00 0.07 98.36
04:03:01 AM 1 1.05 0.00 0.10 0.00 0.02 98.83
04:04:01 AM all 1.25 0.00 0.18 0.00 0.04 98.53
04:04:01 AM 0 1.76 0.00 0.22 0.00 0.05 97.98
04:04:01 AM 1 0.73 0.00 0.15 0.00 0.03 99.08
04:05:01 AM all 6.58 0.00 3.47 0.00 0.09 89.86
04:05:01 AM 0 1.86 0.00 0.23 0.00 0.07 97.84
04:05:01 AM 1 11.58 0.00 6.91 0.00 0.11 81.41
04:06:01 AM all 8.78 0.00 2.13 0.00 0.09 89.00
04:06:01 AM 0 14.06 0.00 4.00 0.00 0.11 81.83
04:06:01 AM 1 3.77 0.00 0.34 0.00 0.07 95.82
04:07:01 AM all 8.67 0.00 2.08 0.00 0.10 89.16
04:07:01 AM 0 17.45 0.00 4.18 0.00 0.15 78.22
04:07:01 AM 1 0.70 0.00 0.17 0.00 0.05 99.08
04:08:01 AM all 7.31 0.00 3.54 0.00 0.08 89.07
04:08:01 AM 0 14.51 0.00 7.21 0.00 0.11 78.17
04:08:01 AM 1 0.73 0.00 0.18 0.00 0.05 99.03
04:09:01 AM all 6.77 0.00 1.55 0.00 0.07 91.61
04:09:01 AM 0 13.51 0.00 3.13 0.00 0.07 83.28
04:09:01 AM 1 0.63 0.00 0.12 0.00 0.07 99.18
04:10:01 AM all 7.05 0.00 2.11 0.00 0.06 90.77
04:10:01 AM 0 12.69 0.00 4.21 0.00 0.07 83.03
04:10:01 AM 1 1.82 0.00 0.17 0.00 0.05 97.96
04:11:01 AM all 5.65 0.00 2.53 0.00 0.06 91.76
04:11:01 AM 0 8.43 0.00 4.88 0.00 0.07 86.61
04:11:01 AM 1 2.97 0.00 0.25 0.00 0.05 96.73
04:12:01 AM all 4.53 0.00 0.33 0.00 0.05 95.09
04:12:01 AM 0 4.13 0.00 0.33 0.00 0.03 95.50
04:12:01 AM 1 4.93 0.00 0.33 0.00 0.07 94.67
04:13:01 AM all 4.42 0.00 0.30 0.00 0.07 95.21
04:13:01 AM 0 1.99 0.00 0.18 0.00 0.07 97.76
04:13:01 AM 1 6.86 0.00 0.42 0.00 0.07 92.66
04:13:01 AM CPU %user %nice %system %iowait %steal %idle
04:14:01 AM all 4.44 0.00 0.32 0.01 0.05 95.19
04:14:01 AM 0 4.23 0.00 0.33 0.02 0.05 95.37
04:14:01 AM 1 4.64 0.00 0.30 0.00 0.05 95.01
04:15:01 AM all 4.48 0.00 0.33 0.00 0.06 95.14
04:15:01 AM 0 2.64 0.00 0.20 0.00 0.05 97.11
04:15:01 AM 1 6.32 0.00 0.45 0.00 0.07 93.17
04:16:01 AM all 4.36 0.00 0.31 0.00 0.06 95.28
04:16:01 AM 0 3.21 0.00 0.28 0.00 0.07 96.44
04:16:01 AM 1 5.50 0.00 0.33 0.00 0.05 94.12
04:17:01 AM all 6.58 0.00 0.38 0.00 0.08 92.97
04:17:01 AM 0 3.83 0.00 0.27 0.00 0.07 95.84
04:17:01 AM 1 9.33 0.00 0.48 0.00 0.08 90.11
04:18:01 AM all 0.51 0.00 0.08 0.00 0.04 99.37
04:18:01 AM 0 0.60 0.00 0.05 0.00 0.05 99.30
04:18:01 AM 1 0.42 0.00 0.10 0.00 0.03 99.45
04:19:01 AM all 0.34 0.00 0.06 0.00 0.03 99.57
04:19:01 AM 0 0.63 0.00 0.08 0.00 0.05 99.23
04:19:01 AM 1 0.05 0.00 0.03 0.00 0.02 99.90
04:20:01 AM all 0.53 0.00 0.08 0.00 0.04 99.36
04:20:01 AM 0 0.67 0.00 0.08 0.00 0.05 99.20
04:20:01 AM 1 0.38 0.00 0.07 0.00 0.03 99.52
04:21:01 AM all 0.40 0.00 0.07 0.00 0.03 99.51
04:21:01 AM 0 0.62 0.00 0.07 0.00 0.03 99.28
04:21:01 AM 1 0.18 0.00 0.07 0.00 0.02 99.73
04:22:01 AM all 0.58 0.00 0.09 0.00 0.03 99.30
04:22:01 AM 0 0.78 0.00 0.07 0.00 0.02 99.13
04:22:01 AM 1 0.38 0.00 0.12 0.00 0.03 99.47
04:23:01 AM all 0.22 0.00 0.07 0.00 0.04 99.67
04:23:01 AM 0 0.13 0.00 0.08 0.00 0.03 99.75
04:23:01 AM 1 0.30 0.00 0.05 0.00 0.05 99.60
04:24:01 AM all 1.90 0.00 0.12 0.00 0.03 97.95
04:24:01 AM 0 0.33 0.00 0.10 0.00 0.05 99.52
04:24:01 AM 1 3.48 0.00 0.13 0.00 0.02 96.36
04:24:01 AM CPU %user %nice %system %iowait %steal %idle
04:25:01 AM all 6.61 0.00 3.46 0.00 0.07 89.86
04:25:01 AM 0 0.72 0.00 0.17 0.00 0.05 99.06
04:25:01 AM 1 13.05 0.00 7.06 0.00 0.09 79.79
04:26:01 AM all 3.46 0.00 1.76 0.00 0.05 94.73
04:26:01 AM 0 0.63 0.00 0.13 0.00 0.07 99.17
04:26:01 AM 1 6.39 0.00 3.44 0.00 0.03 90.14
04:27:01 AM all 0.35 0.00 0.08 0.00 0.05 99.52
04:27:01 AM 0 0.62 0.00 0.07 0.00 0.05 99.27
04:27:01 AM 1 0.08 0.00 0.08 0.00 0.05 99.78
04:28:01 AM all 3.10 0.00 0.87 0.00 0.05 95.98
04:28:01 AM 0 0.63 0.00 0.08 0.00 0.05 99.23
04:28:01 AM 1 5.66 0.00 1.69 0.00 0.05 92.60
04:29:02 AM all 1.83 0.00 0.56 0.00 0.06 97.55
04:29:02 AM 0 0.50 0.00 0.17 0.00 0.08 99.25
04:29:02 AM 1 3.18 0.00 0.95 0.00 0.03 95.83
04:30:01 AM all 4.94 0.00 1.89 0.00 0.07 93.09
04:30:01 AM 0 9.50 0.00 3.76 0.00 0.07 86.67
04:30:01 AM 1 0.64 0.00 0.14 0.00 0.07 99.15
04:31:01 AM all 0.34 0.00 0.07 0.01 0.06 99.52
04:31:01 AM 0 0.08 0.00 0.07 0.02 0.05 99.78
04:31:01 AM 1 0.60 0.00 0.07 0.00 0.07 99.27
04:32:01 AM all 0.33 0.00 0.08 0.00 0.03 99.55
04:32:01 AM 0 0.13 0.00 0.08 0.00 0.03 99.75
04:32:01 AM 1 0.53 0.00 0.08 0.00 0.03 99.35
04:33:01 AM all 7.06 0.00 2.51 0.00 0.07 90.37
04:33:01 AM 0 13.92 0.00 5.01 0.00 0.05 81.01
04:33:01 AM 1 0.70 0.00 0.18 0.00 0.08 99.03
04:34:01 AM all 4.70 0.00 0.35 0.00 0.08 94.88
04:34:01 AM 0 3.96 0.00 0.32 0.00 0.08 95.63
04:34:01 AM 1 5.43 0.00 0.38 0.00 0.07 94.12
04:35:01 AM all 4.22 0.00 0.32 0.00 0.06 95.41
04:35:01 AM 0 6.70 0.00 0.42 0.00 0.07 92.81
04:35:01 AM 1 1.74 0.00 0.22 0.00 0.05 97.99
04:35:01 AM CPU %user %nice %system %iowait %steal %idle
04:36:01 AM all 4.42 0.00 0.31 0.00 0.08 95.19
04:36:01 AM 0 2.14 0.00 0.18 0.00 0.07 97.61
04:36:01 AM 1 6.70 0.00 0.43 0.00 0.10 92.77
04:37:01 AM all 4.39 0.00 0.28 0.00 0.08 95.25
04:37:01 AM 0 5.67 0.00 0.33 0.00 0.08 93.91
04:37:01 AM 1 3.11 0.00 0.23 0.00 0.07 96.59
04:38:01 AM all 4.40 0.00 0.33 0.01 0.07 95.19
04:38:01 AM 0 6.61 0.00 0.43 0.00 0.08 92.88
04:38:01 AM 1 2.21 0.00 0.23 0.02 0.05 97.49
04:39:01 AM all 4.55 0.00 0.33 0.00 0.08 95.04
04:39:01 AM 0 3.58 0.00 0.28 0.00 0.07 96.07
04:39:01 AM 1 5.51 0.00 0.38 0.00 0.08 94.02
04:40:01 AM all 4.95 0.00 0.27 0.00 0.06 94.73
04:40:01 AM 0 7.04 0.00 0.32 0.00 0.07 92.57
04:40:01 AM 1 2.86 0.00 0.22 0.00 0.05 96.88
04:41:01 AM all 0.33 0.00 0.07 0.00 0.04 99.57
04:41:01 AM 0 0.58 0.00 0.07 0.00 0.05 99.30
04:41:01 AM 1 0.07 0.00 0.07 0.00 0.03 99.83
04:42:01 AM all 0.26 0.00 0.08 0.00 0.05 99.62
04:42:01 AM 0 0.25 0.00 0.07 0.00 0.05 99.63
04:42:01 AM 1 0.27 0.00 0.08 0.00 0.05 99.60
04:43:01 AM all 0.29 0.00 0.08 0.00 0.04 99.58
04:43:01 AM 0 0.25 0.00 0.12 0.00 0.07 99.56
04:43:01 AM 1 0.33 0.00 0.05 0.00 0.02 99.60
04:44:01 AM all 0.33 0.00 0.05 0.00 0.04 99.58
04:44:01 AM 0 0.57 0.00 0.03 0.00 0.05 99.35
04:44:01 AM 1 0.08 0.00 0.07 0.00 0.03 99.82
04:45:01 AM all 0.48 0.00 0.08 0.00 0.05 99.39
04:45:01 AM 0 0.82 0.00 0.07 0.00 0.03 99.08
04:45:01 AM 1 0.15 0.00 0.08 0.00 0.07 99.70
04:46:01 AM all 0.33 0.00 0.05 0.00 0.04 99.58
04:46:01 AM 0 0.55 0.00 0.03 0.00 0.03 99.38
04:46:01 AM 1 0.10 0.00 0.07 0.00 0.05 99.78
04:46:01 AM CPU %user %nice %system %iowait %steal %idle
04:47:01 AM all 4.54 0.00 3.26 0.00 0.06 92.15
04:47:01 AM 0 8.73 0.00 6.52 0.00 0.05 84.69
04:47:01 AM 1 0.52 0.00 0.13 0.00 0.07 99.28
04:48:01 AM all 6.51 0.00 3.37 0.00 0.06 90.05
04:48:01 AM 0 5.01 0.00 0.53 0.00 0.05 94.40
04:48:01 AM 1 8.05 0.00 6.28 0.00 0.07 85.61
04:49:01 AM all 6.62 0.00 3.70 0.00 0.07 89.61
04:49:01 AM 0 5.46 0.00 0.76 0.00 0.07 93.72
04:49:01 AM 1 7.79 0.00 6.69 0.00 0.07 85.45
04:50:01 AM all 6.06 0.00 2.91 0.00 0.06 90.97
04:50:01 AM 0 3.96 0.00 4.87 0.00 0.07 91.10
04:50:01 AM 1 8.11 0.00 0.99 0.00 0.05 90.84
04:51:01 AM all 6.31 0.00 3.13 0.00 0.05 90.51
04:51:01 AM 0 7.84 0.00 0.68 0.00 0.05 91.42
04:51:01 AM 1 4.79 0.00 5.56 0.00 0.05 89.60
04:52:01 AM all 7.01 0.00 3.15 0.00 0.07 89.77
04:52:01 AM 0 11.05 0.00 6.02 0.00 0.05 82.87
04:52:01 AM 1 3.22 0.00 0.46 0.00 0.08 96.23
04:53:01 AM all 6.51 0.00 3.26 0.00 0.06 90.17
04:53:01 AM 0 9.85 0.00 6.25 0.00 0.05 83.85
04:53:01 AM 1 3.36 0.00 0.44 0.00 0.07 96.13
04:54:01 AM all 6.19 0.00 3.02 0.00 0.06 90.73
04:54:01 AM 0 2.53 0.00 0.57 0.00 0.07 96.83
04:54:01 AM 1 10.14 0.00 5.66 0.00 0.05 84.14
04:55:01 AM all 25.32 0.00 2.43 0.10 0.08 72.08
04:55:01 AM 0 10.83 0.00 1.96 0.05 0.08 87.08
04:55:01 AM 1 39.87 0.00 2.90 0.15 0.07 57.01
04:56:01 AM all 31.84 0.00 4.53 0.27 0.08 63.29
04:56:01 AM 0 23.25 0.00 4.13 0.35 0.08 72.19
04:56:01 AM 1 40.45 0.00 4.92 0.18 0.07 54.38
Average: all 3.42 0.00 0.62 0.00 0.05 95.91
Average: 0 3.02 0.00 0.59 0.00 0.05 96.35
Average: 1 3.82 0.00 0.65 0.00 0.05 95.48