Started by upstream project "integration-distribution-mri-test-scandium" build number 90
originally caused by:
Started by timer
Running as SYSTEM
[EnvInject] - Loading node environment variables.
Building remotely on prd-centos8-robot-2c-8g-1820 (centos8-robot-2c-8g) in workspace /w/workspace/controller-csit-3node-clustering-tell-all-scandium
[ssh-agent] Looking for ssh-agent implementation...
[ssh-agent] Exec ssh-agent (binary ssh-agent on a remote machine)
$ ssh-agent
SSH_AUTH_SOCK=/tmp/ssh-vw2oPCjNFuUz/agent.5287
SSH_AGENT_PID=5289
[ssh-agent] Started.
Running ssh-add (command line suppressed)
Identity added: /w/workspace/controller-csit-3node-clustering-tell-all-scandium@tmp/private_key_13360898965512635481.key (/w/workspace/controller-csit-3node-clustering-tell-all-scandium@tmp/private_key_13360898965512635481.key)
[ssh-agent] Using credentials jenkins (Release Engineering Jenkins Key)
The recommended git tool is: NONE
using credential opendaylight-jenkins-ssh
Wiping out workspace first.
Cloning the remote Git repository
Cloning repository git://devvexx.opendaylight.org/mirror/integration/test
> git init /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test # timeout=10
Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test
> git --version # timeout=10
> git --version # 'git version 2.43.0'
using GIT_SSH to set credentials Release Engineering Jenkins Key
[INFO] Currently running in a labeled security context
[INFO] Currently SELinux is 'enforcing' on the host
> /usr/bin/chcon --type=ssh_home_t /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test@tmp/jenkins-gitclient-ssh16790515017503562699.key
Verifying host key using known hosts file
You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification.
> git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10
Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test
using GIT_SSH to set credentials Release Engineering Jenkins Key
[INFO] Currently running in a labeled security context
[INFO] Currently SELinux is 'enforcing' on the host
> /usr/bin/chcon --type=ssh_home_t /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test@tmp/jenkins-gitclient-ssh2559818445911437624.key
Verifying host key using known hosts file
You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification.
> git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test master # timeout=10
> git rev-parse FETCH_HEAD^{commit} # timeout=10
Checking out Revision cc140aba40d20c279ad305eb08204917e9a97348 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f cc140aba40d20c279ad305eb08204917e9a97348 # timeout=10
Commit message: "Add bgpcep variables for vanadium"
> git rev-parse FETCH_HEAD^{commit} # timeout=10
> git rev-list --no-walk 2791c5dea1951b0af9405c9ac43be0884a2c5414 # timeout=10
No emails were triggered.
provisioning config files...
copy managed file [npmrc] to file:/home/jenkins/.npmrc
copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf
copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
[controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins6971950675534789420.sh
---> python-tools-install.sh
Setup pyenv:
system
* 3.8.13 (set by /opt/pyenv/version)
* 3.9.13 (set by /opt/pyenv/version)
* 3.10.13 (set by /opt/pyenv/version)
* 3.11.7 (set by /opt/pyenv/version)
lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-U8VX
lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
lf-activate-venv(): INFO: Attempting to install with network-safe options...
lf-activate-venv(): INFO: Base packages installed successfully
lf-activate-venv(): INFO: Installing additional packages: lftools
lf-activate-venv(): INFO: Adding /tmp/venv-U8VX/bin to PATH
Generating Requirements File
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
httplib2 0.30.2 requires pyparsing<4,>=3.0.4, but you have pyparsing 2.4.7 which is incompatible.
Python 3.11.7
pip 25.3 from /tmp/venv-U8VX/lib/python3.11/site-packages/pip (python 3.11)
appdirs==1.4.4
argcomplete==3.6.3
aspy.yaml==1.3.0
attrs==25.4.0
autopage==0.5.2
beautifulsoup4==4.14.3
boto3==1.42.30
botocore==1.42.30
bs4==0.0.2
certifi==2026.1.4
cffi==2.0.0
cfgv==3.5.0
chardet==5.2.0
charset-normalizer==3.4.4
click==8.3.1
cliff==4.13.1
cmd2==3.1.0
cryptography==3.3.2
debtcollector==3.0.0
decorator==5.2.1
defusedxml==0.7.1
Deprecated==1.3.1
distlib==0.4.0
dnspython==2.8.0
docker==7.1.0
dogpile.cache==1.5.0
durationpy==0.10
email-validator==2.3.0
filelock==3.20.3
future==1.0.0
gitdb==4.0.12
GitPython==3.1.46
httplib2==0.30.2
identify==2.6.16
idna==3.11
importlib-resources==1.5.0
iso8601==2.1.0
Jinja2==3.1.6
jmespath==1.0.1
jsonpatch==1.33
jsonpointer==3.0.0
jsonschema==4.26.0
jsonschema-specifications==2025.9.1
keystoneauth1==5.12.0
kubernetes==35.0.0
lftools==0.37.21
lxml==6.0.2
markdown-it-py==4.0.0
MarkupSafe==3.0.3
mdurl==0.1.2
msgpack==1.1.2
multi_key_dict==2.0.3
munch==4.0.0
netaddr==1.3.0
niet==1.4.2
nodeenv==1.10.0
oauth2client==4.1.3
oauthlib==3.3.1
openstacksdk==4.8.0
os-service-types==1.8.2
osc-lib==4.3.0
oslo.config==10.2.0
oslo.context==6.2.0
oslo.i18n==6.7.1
oslo.log==8.0.0
oslo.serialization==5.9.0
oslo.utils==9.2.0
packaging==25.0
pbr==7.0.3
platformdirs==4.5.1
prettytable==3.17.0
psutil==7.2.1
pyasn1==0.6.2
pyasn1_modules==0.4.2
pycparser==2.23
pygerrit2==2.0.15
PyGithub==2.8.1
Pygments==2.19.2
PyJWT==2.10.1
PyNaCl==1.6.2
pyparsing==2.4.7
pyperclip==1.11.0
pyrsistent==0.20.0
python-cinderclient==9.8.0
python-dateutil==2.9.0.post0
python-heatclient==4.3.0
python-jenkins==1.8.3
python-keystoneclient==5.7.0
python-magnumclient==4.9.0
python-openstackclient==8.3.0
python-swiftclient==4.9.0
PyYAML==6.0.3
referencing==0.37.0
requests==2.32.5
requests-oauthlib==2.0.0
requestsexceptions==1.4.0
rfc3986==2.0.0
rich==14.2.0
rich-argparse==1.7.2
rpds-py==0.30.0
rsa==4.9.1
ruamel.yaml==0.19.1
ruamel.yaml.clib==0.2.15
s3transfer==0.16.0
simplejson==3.20.2
six==1.17.0
smmap==5.0.2
soupsieve==2.8.2
stevedore==5.6.0
tabulate==0.9.0
toml==0.10.2
tomlkit==0.14.0
tqdm==4.67.1
typing_extensions==4.15.0
tzdata==2025.3
urllib3==1.26.20
virtualenv==20.36.1
wcwidth==0.2.14
websocket-client==1.9.0
wrapt==2.0.1
xdg==6.0.0
xmltodict==1.0.2
yq==3.4.3
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties content
OS_STACK_TEMPLATE=csit-2-instance-type.yaml
OS_CLOUD=vex
OS_STACK_NAME=releng-controller-csit-3node-clustering-tell-all-scandium-90
OS_STACK_TEMPLATE_DIR=openstack-hot
[EnvInject] - Variables injected successfully.
provisioning config files...
copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
[controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins15337006505111078361.sh
---> Create parameters file for OpenStack HOT
OpenStack Heat parameters generated
-----------------------------------
parameters:
vm_0_count: '3'
vm_0_flavor: 'v3-standard-4'
vm_0_image: 'ZZCI - Ubuntu 22.04 - builder - x86_64 - 20260109-084045.554'
vm_1_count: '0'
vm_1_flavor: 'v3-standard-2'
vm_1_image: 'ZZCI - Ubuntu 22.04 - mininet-ovs-217 - x86_64 - 20250917-133034.654'
job_name: '43164-90'
silo: 'releng'
[controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash -l /tmp/jenkins1203765931679795964.sh
---> Create HEAT stack
+ source /home/jenkins/lf-env.sh
+ lf-activate-venv --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq
++ mktemp -d /tmp/venv-XXXX
+ lf_venv=/tmp/venv-Stbr
+ local venv_file=/tmp/.os_lf_venv
+ local python=python3
+ local options
+ local set_path=true
+ local install_args=
++ getopt -o np:v: -l no-path,system-site-packages,python:,venv-file: -n lf-activate-venv -- --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq
+ options=' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''urllib3~=1.26.15'\'' '\''yq'\'''
+ eval set -- ' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''urllib3~=1.26.15'\'' '\''yq'\'''
++ set -- --python python3 -- 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq
+ true
+ case $1 in
+ python=python3
+ shift 2
+ true
+ case $1 in
+ shift
+ break
+ case $python in
+ local pkg_list=
+ [[ -d /opt/pyenv ]]
+ echo 'Setup pyenv:'
Setup pyenv:
+ export PYENV_ROOT=/opt/pyenv
+ PYENV_ROOT=/opt/pyenv
+ export PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
+ PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
+ pyenv versions
system
3.8.13
3.9.13
3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.python-version)
+ command -v pyenv
++ pyenv init - --no-rehash
+ eval 'PATH="$(bash --norc -ec '\''IFS=:; paths=($PATH);
for i in ${!paths[@]}; do
if [[ ${paths[i]} == "'\'''\''/opt/pyenv/shims'\'''\''" ]]; then unset '\''\'\'''\''paths[i]'\''\'\'''\'';
fi; done;
echo "${paths[*]}"'\'')"
export PATH="/opt/pyenv/shims:${PATH}"
export PYENV_SHELL=bash
source '\''/opt/pyenv/libexec/../completions/pyenv.bash'\''
pyenv() {
local command
command="${1:-}"
if [ "$#" -gt 0 ]; then
shift
fi
case "$command" in
rehash|shell)
eval "$(pyenv "sh-$command" "$@")"
;;
*)
command pyenv "$command" "$@"
;;
esac
}'
+++ bash --norc -ec 'IFS=:; paths=($PATH);
for i in ${!paths[@]}; do
if [[ ${paths[i]} == "/opt/pyenv/shims" ]]; then unset '\''paths[i]'\'';
fi; done;
echo "${paths[*]}"'
++ PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
++ export PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
++ PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
++ export PYENV_SHELL=bash
++ PYENV_SHELL=bash
++ source /opt/pyenv/libexec/../completions/pyenv.bash
+++ complete -F _pyenv pyenv
++ lf-pyver python3
++ local py_version_xy=python3
++ local py_version_xyz=
++ awk '{ print $1 }'
++ pyenv versions
++ local command
++ command=versions
++ '[' 1 -gt 0 ']'
++ shift
++ case "$command" in
++ command pyenv versions
++ pyenv versions
++ sed 's/^[ *]* //'
++ grep -E '^[0-9.]*[0-9]$'
++ [[ ! -s /tmp/.pyenv_versions ]]
+++ grep '^3' /tmp/.pyenv_versions
+++ tail -n 1
+++ sort -V
++ py_version_xyz=3.11.7
++ [[ -z 3.11.7 ]]
++ echo 3.11.7
++ return 0
+ pyenv local 3.11.7
+ local command
+ command=local
+ '[' 2 -gt 0 ']'
+ shift
+ case "$command" in
+ command pyenv local 3.11.7
+ pyenv local 3.11.7
+ for arg in "$@"
+ case $arg in
+ pkg_list+='lftools[openstack] '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='kubernetes '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='niet '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='python-heatclient '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='python-openstackclient '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='python-magnumclient '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='urllib3~=1.26.15 '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='yq '
+ [[ -f /tmp/.os_lf_venv ]]
++ cat /tmp/.os_lf_venv
+ lf_venv=/tmp/venv-U8VX
+ echo 'lf-activate-venv(): INFO: Reuse venv:/tmp/venv-U8VX from' file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-U8VX from file:/tmp/.os_lf_venv
+ echo 'lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)'
lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
+ local 'pip_opts=--upgrade --quiet'
+ pip_opts='--upgrade --quiet --trusted-host pypi.org'
+ pip_opts='--upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org'
+ pip_opts='--upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org'
+ [[ -n '' ]]
+ [[ -n '' ]]
+ echo 'lf-activate-venv(): INFO: Attempting to install with network-safe options...'
lf-activate-venv(): INFO: Attempting to install with network-safe options...
+ /tmp/venv-U8VX/bin/python3 -m pip install --upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org pip 'setuptools<66' virtualenv
+ echo 'lf-activate-venv(): INFO: Base packages installed successfully'
lf-activate-venv(): INFO: Base packages installed successfully
+ [[ -z lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq ]]
+ echo 'lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq '
lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq
+ /tmp/venv-U8VX/bin/python3 -m pip install --upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org --upgrade-strategy eager 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq
+ type python3
+ true
+ echo 'lf-activate-venv(): INFO: Adding /tmp/venv-U8VX/bin to PATH'
lf-activate-venv(): INFO: Adding /tmp/venv-U8VX/bin to PATH
+ PATH=/tmp/venv-U8VX/bin:/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
+ return 0
+ openstack --os-cloud vex limits show --absolute
+--------------------------+---------+
| Name | Value |
+--------------------------+---------+
| maxTotalInstances | -1 |
| maxTotalCores | 450 |
| maxTotalRAMSize | 1000000 |
| maxServerMeta | 128 |
| maxImageMeta | 128 |
| maxPersonality | 5 |
| maxPersonalitySize | 10240 |
| maxTotalKeypairs | 100 |
| maxServerGroups | 10 |
| maxServerGroupMembers | 10 |
| maxTotalFloatingIps | -1 |
| maxSecurityGroups | -1 |
| maxSecurityGroupRules | -1 |
| totalRAMUsed | 581632 |
| totalCoresUsed | 142 |
| totalInstancesUsed | 44 |
| totalFloatingIpsUsed | 0 |
| totalSecurityGroupsUsed | 0 |
| totalServerGroupsUsed | 0 |
| maxTotalVolumes | -1 |
| maxTotalSnapshots | 10 |
| maxTotalVolumeGigabytes | 4096 |
| maxTotalBackups | 10 |
| maxTotalBackupGigabytes | 1000 |
| totalVolumesUsed | 0 |
| totalGigabytesUsed | 0 |
| totalSnapshotsUsed | 0 |
| totalBackupsUsed | 0 |
| totalBackupGigabytesUsed | 0 |
+--------------------------+---------+
+ pushd /opt/ciman/openstack-hot
/opt/ciman/openstack-hot /w/workspace/controller-csit-3node-clustering-tell-all-scandium
+ lftools openstack --os-cloud vex stack create releng-controller-csit-3node-clustering-tell-all-scandium-90 csit-2-instance-type.yaml /w/workspace/controller-csit-3node-clustering-tell-all-scandium/stack-parameters.yaml
Creating stack releng-controller-csit-3node-clustering-tell-all-scandium-90
Waiting to initialize infrastructure...
Stack initialization successful.
------------------------------------
Stack Details
------------------------------------
{'added': None,
'capabilities': [],
'created_at': '2026-01-18T23:49:14Z',
'deleted': None,
'deleted_at': None,
'description': 'No description',
'environment': None,
'environment_files': None,
'files': None,
'files_container': None,
'id': '16946c14-1370-486c-94f3-5e7fd2a62587',
'is_rollback_disabled': True,
'links': [{'href': 'https://orchestration.public.mtl1.vexxhost.net/v1/12c36e260d8e4bb2913965203b1b491f/stacks/releng-controller-csit-3node-clustering-tell-all-scandium-90/16946c14-1370-486c-94f3-5e7fd2a62587',
'rel': 'self'}],
'location': Munch({'cloud': 'vex', 'region_name': 'ca-ymq-1', 'zone': None, 'project': Munch({'id': '12c36e260d8e4bb2913965203b1b491f', 'name': '61975f2c-7c17-4d69-82fa-c3ae420ad6fd', 'domain_id': None, 'domain_name': 'Default'})}),
'name': 'releng-controller-csit-3node-clustering-tell-all-scandium-90',
'notification_topics': [],
'outputs': [{'description': 'IP addresses of the 1st vm types',
'output_key': 'vm_0_ips',
'output_value': ['10.30.170.68',
'10.30.170.136',
'10.30.171.135']},
{'description': 'IP addresses of the 2nd vm types',
'output_key': 'vm_1_ips',
'output_value': []}],
'owner_id': ****,
'parameters': {'OS::project_id': '12c36e260d8e4bb2913965203b1b491f',
'OS::stack_id': '16946c14-1370-486c-94f3-5e7fd2a62587',
'OS::stack_name': 'releng-controller-csit-3node-clustering-tell-all-scandium-90',
'job_name': '43164-90',
'silo': 'releng',
'vm_0_count': '3',
'vm_0_flavor': 'v3-standard-4',
'vm_0_image': 'ZZCI - Ubuntu 22.04 - builder - x86_64 - '
'20260109-084045.554',
'vm_1_count': '0',
'vm_1_flavor': 'v3-standard-2',
'vm_1_image': 'ZZCI - Ubuntu 22.04 - mininet-ovs-217 - x86_64 '
'- 20250917-133034.654'},
'parent_id': None,
'replaced': None,
'status': 'CREATE_COMPLETE',
'status_reason': 'Stack CREATE completed successfully',
'tags': [],
'template': None,
'template_description': 'No description',
'template_url': None,
'timeout_mins': 15,
'unchanged': None,
'updated': None,
'updated_at': None,
'user_project_id': 'c286d0fe600f49c892833900bd6cc734'}
------------------------------------
+ popd
/w/workspace/controller-csit-3node-clustering-tell-all-scandium
[controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash -l /tmp/jenkins9437528446282591044.sh
---> Copy SSH public keys to CSIT lab
Setup pyenv:
system
3.8.13
3.9.13
3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-U8VX from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
lf-activate-venv(): INFO: Attempting to install with network-safe options...
lf-activate-venv(): INFO: Base packages installed successfully
lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes python-heatclient python-openstackclient urllib3~=1.26.15
lf-activate-venv(): INFO: Adding /tmp/venv-U8VX/bin to PATH
SSH not responding on 10.30.170.68. Retrying in 10 seconds...
SSH not responding on 10.30.170.136. Retrying in 10 seconds...
SSH not responding on 10.30.171.135. Retrying in 10 seconds...
Ping to 10.30.170.68 successful.
Ping to 10.30.170.136 successful.
Ping to 10.30.171.135 successful.
SSH not responding on 10.30.170.136. Retrying in 10 seconds...
SSH not responding on 10.30.171.135. Retrying in 10 seconds...
Warning: Permanently added '10.30.170.68' (ECDSA) to the list of known hosts.
releng-43164-90-0-builder-0
Successfully copied public keys to slave 10.30.170.68
Process 6500 ready.
Ping to 10.30.170.136 successful.
Ping to 10.30.171.135 successful.
Warning: Permanently added '10.30.170.136' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.171.135' (ECDSA) to the list of known hosts.
releng-43164-90-0-builder-1
Successfully copied public keys to slave 10.30.170.136
Process 6501 ready.
releng-43164-90-0-builder-2
Successfully copied public keys to slave 10.30.171.135
Process 6502 ready.
SSH ready on all stack servers.
[controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash -l /tmp/jenkins4075395761378398653.sh
Setup pyenv:
system
3.8.13
3.9.13
3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.python-version)
lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-9KRt
lf-activate-venv(): INFO: Save venv in file: /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.robot_venv
lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
lf-activate-venv(): INFO: Attempting to install with network-safe options...
lf-activate-venv(): INFO: Base packages installed successfully
lf-activate-venv(): INFO: Installing additional packages: setuptools wheel
lf-activate-venv(): INFO: Adding /tmp/venv-9KRt/bin to PATH
+ echo 'Installing Python Requirements'
Installing Python Requirements
+ cat
+ python -m pip install -r requirements.txt
Looking in indexes: https://nexus3.opendaylight.org/repository/PyPi/simple
Collecting docker-py (from -r requirements.txt (line 1))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/docker-py/1.10.6/docker_py-1.10.6-py2.py3-none-any.whl (50 kB)
Collecting ipaddr (from -r requirements.txt (line 2))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/ipaddr/2.2.0/ipaddr-2.2.0.tar.gz (26 kB)
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing metadata (pyproject.toml): started
Preparing metadata (pyproject.toml): finished with status 'done'
Collecting netaddr (from -r requirements.txt (line 3))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/netaddr/1.3.0/netaddr-1.3.0-py3-none-any.whl (2.3 MB)
Collecting netifaces (from -r requirements.txt (line 4))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/netifaces/0.11.0/netifaces-0.11.0.tar.gz (30 kB)
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing metadata (pyproject.toml): started
Preparing metadata (pyproject.toml): finished with status 'done'
Collecting pyhocon (from -r requirements.txt (line 5))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyhocon/0.3.61/pyhocon-0.3.61-py3-none-any.whl (25 kB)
Collecting requests (from -r requirements.txt (line 6))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/requests/2.32.5/requests-2.32.5-py3-none-any.whl (64 kB)
Collecting robotframework (from -r requirements.txt (line 7))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework/7.4.1/robotframework-7.4.1-py3-none-any.whl (806 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 806.9/806.9 kB 34.4 MB/s 0:00:00
Collecting robotframework-httplibrary (from -r requirements.txt (line 8))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-httplibrary/0.4.2/robotframework-httplibrary-0.4.2.tar.gz (9.1 kB)
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing metadata (pyproject.toml): started
Preparing metadata (pyproject.toml): finished with status 'done'
Collecting robotframework-requests==0.9.7 (from -r requirements.txt (line 9))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-requests/0.9.7/robotframework_requests-0.9.7-py3-none-any.whl (21 kB)
Collecting robotframework-selenium2library (from -r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-selenium2library/3.0.0/robotframework_selenium2library-3.0.0-py2.py3-none-any.whl (6.2 kB)
Collecting robotframework-sshlibrary==3.8.0 (from -r requirements.txt (line 11))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-sshlibrary/3.8.0/robotframework-sshlibrary-3.8.0.tar.gz (51 kB)
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing metadata (pyproject.toml): started
Preparing metadata (pyproject.toml): finished with status 'done'
Collecting scapy (from -r requirements.txt (line 12))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/scapy/2.7.0/scapy-2.7.0-py3-none-any.whl (2.6 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.6/2.6 MB 34.7 MB/s 0:00:00
Collecting jsonpath-rw (from -r requirements.txt (line 15))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpath-rw/1.4.0/jsonpath-rw-1.4.0.tar.gz (13 kB)
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing metadata (pyproject.toml): started
Preparing metadata (pyproject.toml): finished with status 'done'
Collecting elasticsearch (from -r requirements.txt (line 18))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch/9.2.1/elasticsearch-9.2.1-py3-none-any.whl (963 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 963.6/963.6 kB 30.2 MB/s 0:00:00
Collecting elasticsearch-dsl (from -r requirements.txt (line 19))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch-dsl/8.18.0/elasticsearch_dsl-8.18.0-py3-none-any.whl (10 kB)
Collecting pyangbind (from -r requirements.txt (line 22))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyangbind/0.8.7/pyangbind-0.8.7-py3-none-any.whl (52 kB)
Collecting isodate (from -r requirements.txt (line 25))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/isodate/0.7.2/isodate-0.7.2-py3-none-any.whl (22 kB)
Collecting jmespath (from -r requirements.txt (line 28))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jmespath/1.0.1/jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting jsonpatch (from -r requirements.txt (line 31))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpatch/1.33/jsonpatch-1.33-py2.py3-none-any.whl (12 kB)
Collecting paramiko>=1.15.3 (from robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/paramiko/4.0.0/paramiko-4.0.0-py3-none-any.whl (223 kB)
Collecting scp>=0.13.0 (from robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/scp/0.15.0/scp-0.15.0-py2.py3-none-any.whl (8.8 kB)
Collecting docker-pycreds>=0.2.1 (from docker-py->-r requirements.txt (line 1))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/docker-pycreds/0.4.0/docker_pycreds-0.4.0-py2.py3-none-any.whl (9.0 kB)
Collecting six>=1.4.0 (from docker-py->-r requirements.txt (line 1))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/six/1.17.0/six-1.17.0-py2.py3-none-any.whl (11 kB)
Collecting websocket-client>=0.32.0 (from docker-py->-r requirements.txt (line 1))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/websocket-client/1.9.0/websocket_client-1.9.0-py3-none-any.whl (82 kB)
Collecting pyparsing<4,>=2 (from pyhocon->-r requirements.txt (line 5))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pyparsing/3.3.1/pyparsing-3.3.1-py3-none-any.whl (121 kB)
Collecting charset_normalizer<4,>=2 (from requests->-r requirements.txt (line 6))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/charset-normalizer/3.4.4/charset_normalizer-3.4.4-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl (151 kB)
Collecting idna<4,>=2.5 (from requests->-r requirements.txt (line 6))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/idna/3.11/idna-3.11-py3-none-any.whl (71 kB)
Collecting urllib3<3,>=1.21.1 (from requests->-r requirements.txt (line 6))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/urllib3/2.6.3/urllib3-2.6.3-py3-none-any.whl (131 kB)
Collecting certifi>=2017.4.17 (from requests->-r requirements.txt (line 6))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/certifi/2026.1.4/certifi-2026.1.4-py3-none-any.whl (152 kB)
Collecting webtest>=2.0 (from robotframework-httplibrary->-r requirements.txt (line 8))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/webtest/3.0.7/webtest-3.0.7-py3-none-any.whl (32 kB)
Collecting jsonpointer (from robotframework-httplibrary->-r requirements.txt (line 8))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpointer/3.0.0/jsonpointer-3.0.0-py2.py3-none-any.whl (7.6 kB)
Collecting robotframework-seleniumlibrary>=3.0.0 (from robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-seleniumlibrary/6.8.0/robotframework_seleniumlibrary-6.8.0-py3-none-any.whl (104 kB)
Collecting ply (from jsonpath-rw->-r requirements.txt (line 15))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/ply/3.11/ply-3.11-py2.py3-none-any.whl (49 kB)
Collecting decorator (from jsonpath-rw->-r requirements.txt (line 15))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/decorator/5.2.1/decorator-5.2.1-py3-none-any.whl (9.2 kB)
Collecting anyio (from elasticsearch->-r requirements.txt (line 18))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/anyio/4.12.1/anyio-4.12.1-py3-none-any.whl (113 kB)
Collecting elastic-transport<10,>=9.2.0 (from elasticsearch->-r requirements.txt (line 18))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elastic-transport/9.2.1/elastic_transport-9.2.1-py3-none-any.whl (65 kB)
Collecting python-dateutil (from elasticsearch->-r requirements.txt (line 18))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/python-dateutil/2.9.0.post0/python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB)
Collecting sniffio (from elasticsearch->-r requirements.txt (line 18))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/sniffio/1.3.1/sniffio-1.3.1-py3-none-any.whl (10 kB)
Collecting typing-extensions (from elasticsearch->-r requirements.txt (line 18))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/typing-extensions/4.15.0/typing_extensions-4.15.0-py3-none-any.whl (44 kB)
Collecting elasticsearch (from -r requirements.txt (line 18))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch/8.19.3/elasticsearch-8.19.3-py3-none-any.whl (952 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 952.8/952.8 kB 42.3 MB/s 0:00:00
INFO: pip is looking at multiple versions of elasticsearch-dsl to determine which version is compatible with other requirements. This could take a while.
Collecting elasticsearch-dsl (from -r requirements.txt (line 19))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch-dsl/8.17.1/elasticsearch_dsl-8.17.1-py3-none-any.whl (158 kB)
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch-dsl/8.17.0/elasticsearch_dsl-8.17.0-py3-none-any.whl (158 kB)
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch-dsl/8.16.0/elasticsearch_dsl-8.16.0-py3-none-any.whl (158 kB)
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch-dsl/8.15.4/elasticsearch_dsl-8.15.4-py3-none-any.whl (104 kB)
Collecting elastic-transport<9,>=8.15.1 (from elasticsearch->-r requirements.txt (line 18))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elastic-transport/8.17.1/elastic_transport-8.17.1-py3-none-any.whl (64 kB)
Collecting pyang (from pyangbind->-r requirements.txt (line 22))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyang/2.7.1/pyang-2.7.1-py2.py3-none-any.whl (598 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 598.5/598.5 kB 31.3 MB/s 0:00:00
Collecting lxml (from pyangbind->-r requirements.txt (line 22))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/lxml/6.0.2/lxml-6.0.2-cp311-cp311-manylinux_2_26_x86_64.manylinux_2_28_x86_64.whl (5.2 MB)
Collecting regex (from pyangbind->-r requirements.txt (line 22))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/regex/2026.1.15/regex-2026.1.15-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl (800 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 800.5/800.5 kB 19.5 MB/s 0:00:00
Collecting enum34 (from pyangbind->-r requirements.txt (line 22))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/enum34/1.1.10/enum34-1.1.10-py3-none-any.whl (11 kB)
Collecting bcrypt>=3.2 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/bcrypt/5.0.0/bcrypt-5.0.0-cp39-abi3-manylinux_2_28_x86_64.whl (278 kB)
Collecting cryptography>=3.3 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/cryptography/46.0.3/cryptography-46.0.3-cp311-abi3-manylinux_2_28_x86_64.whl (4.5 MB)
Collecting invoke>=2.0 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/invoke/2.2.1/invoke-2.2.1-py3-none-any.whl (160 kB)
Collecting pynacl>=1.5 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pynacl/1.6.2/pynacl-1.6.2-cp38-abi3-manylinux_2_26_x86_64.manylinux_2_28_x86_64.whl (1.4 MB)
Collecting cffi>=2.0.0 (from cryptography>=3.3->paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/cffi/2.0.0/cffi-2.0.0-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (215 kB)
Collecting pycparser (from cffi>=2.0.0->cryptography>=3.3->paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pycparser/2.23/pycparser-2.23-py3-none-any.whl (118 kB)
Collecting selenium>=4.3.0 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/selenium/4.40.0/selenium-4.40.0-py3-none-any.whl (9.6 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 9.6/9.6 MB 55.6 MB/s 0:00:00
Collecting robotframework-pythonlibcore>=4.4.1 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-pythonlibcore/4.5.0/robotframework_pythonlibcore-4.5.0-py3-none-any.whl (19 kB)
Collecting click>=8.0 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/click/8.3.1/click-8.3.1-py3-none-any.whl (108 kB)
Collecting trio<1.0,>=0.31.0 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/trio/0.32.0/trio-0.32.0-py3-none-any.whl (512 kB)
Collecting trio-websocket<1.0,>=0.12.2 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/trio-websocket/0.12.2/trio_websocket-0.12.2-py3-none-any.whl (21 kB)
Collecting trio-typing>=0.10.0 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/trio-typing/0.10.0/trio_typing-0.10.0-py3-none-any.whl (42 kB)
Collecting types-certifi>=2021.10.8.3 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/types-certifi/2021.10.8.3/types_certifi-2021.10.8.3-py3-none-any.whl (2.1 kB)
Collecting types-urllib3>=1.26.25.14 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/types-urllib3/1.26.25.14/types_urllib3-1.26.25.14-py3-none-any.whl (15 kB)
Collecting attrs>=23.2.0 (from trio<1.0,>=0.31.0->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/attrs/25.4.0/attrs-25.4.0-py3-none-any.whl (67 kB)
Collecting sortedcontainers (from trio<1.0,>=0.31.0->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/sortedcontainers/2.4.0/sortedcontainers-2.4.0-py2.py3-none-any.whl (29 kB)
Collecting outcome (from trio<1.0,>=0.31.0->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/outcome/1.3.0.post0/outcome-1.3.0.post0-py2.py3-none-any.whl (10 kB)
Collecting wsproto>=0.14 (from trio-websocket<1.0,>=0.12.2->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/wsproto/1.3.2/wsproto-1.3.2-py3-none-any.whl (24 kB)
Collecting pysocks!=1.5.7,<2.0,>=1.5.6 (from urllib3[socks]<3.0,>=2.6.3->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pysocks/1.7.1/PySocks-1.7.1-py3-none-any.whl (16 kB)
Collecting mypy-extensions>=0.4.2 (from trio-typing>=0.10.0->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/mypy-extensions/1.1.0/mypy_extensions-1.1.0-py3-none-any.whl (5.0 kB)
Collecting async-generator (from trio-typing>=0.10.0->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/async-generator/1.10/async_generator-1.10-py3-none-any.whl (18 kB)
Collecting packaging (from trio-typing>=0.10.0->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/packaging/25.0/packaging-25.0-py3-none-any.whl (66 kB)
Collecting importlib-metadata (from trio-typing>=0.10.0->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/importlib-metadata/8.7.1/importlib_metadata-8.7.1-py3-none-any.whl (27 kB)
Collecting WebOb>=1.2 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/webob/1.8.9/WebOb-1.8.9-py2.py3-none-any.whl (115 kB)
Collecting waitress>=3.0.2 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/waitress/3.0.2/waitress-3.0.2-py3-none-any.whl (56 kB)
Collecting beautifulsoup4 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/beautifulsoup4/4.14.3/beautifulsoup4-4.14.3-py3-none-any.whl (107 kB)
Collecting h11<1,>=0.16.0 (from wsproto>=0.14->trio-websocket<1.0,>=0.12.2->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/h11/0.16.0/h11-0.16.0-py3-none-any.whl (37 kB)
Collecting soupsieve>=1.6.1 (from beautifulsoup4->webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/soupsieve/2.8.2/soupsieve-2.8.2-py3-none-any.whl (37 kB)
Collecting zipp>=3.20 (from importlib-metadata->trio-typing>=0.10.0->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/zipp/3.23.0/zipp-3.23.0-py3-none-any.whl (10 kB)
Building wheels for collected packages: robotframework-sshlibrary, ipaddr, netifaces, robotframework-httplibrary, jsonpath-rw
Building wheel for robotframework-sshlibrary (pyproject.toml): started
Building wheel for robotframework-sshlibrary (pyproject.toml): finished with status 'done'
Created wheel for robotframework-sshlibrary: filename=robotframework_sshlibrary-3.8.0-py3-none-any.whl size=55205 sha256=4e920ebbbb40833331c0552350a472dc6b40082f6c64b7a5eb1c9428eca634ec
Stored in directory: /home/jenkins/.cache/pip/wheels/f7/c9/b3/a977b7bcc410d45ae27d240df3d00a12585509180e373ecccc
Building wheel for ipaddr (pyproject.toml): started
Building wheel for ipaddr (pyproject.toml): finished with status 'done'
Created wheel for ipaddr: filename=ipaddr-2.2.0-py3-none-any.whl size=18353 sha256=d58fdab605621e2dbf8887673eac95a54f6817cb54ffaa2134b81600f74c4f5b
Stored in directory: /home/jenkins/.cache/pip/wheels/dc/6c/04/da2d847fa8d45c59af3e1d83e2acc29cb8adcbaf04c0898dbf
Building wheel for netifaces (pyproject.toml): started
Building wheel for netifaces (pyproject.toml): finished with status 'done'
Created wheel for netifaces: filename=netifaces-0.11.0-cp311-cp311-linux_x86_64.whl size=41070 sha256=88ba77f54cfd19e0f404a2197c94cbe53cac193321d9567661b8fc7e02026a56
Stored in directory: /home/jenkins/.cache/pip/wheels/f8/18/88/e61d54b995bea304bdb1d040a92b72228a1bf72ca2a3eba7c9
Building wheel for robotframework-httplibrary (pyproject.toml): started
Building wheel for robotframework-httplibrary (pyproject.toml): finished with status 'done'
Created wheel for robotframework-httplibrary: filename=robotframework_httplibrary-0.4.2-py3-none-any.whl size=10014 sha256=8e80c939fb505121e08b0557293421bc1c95cdff7277539d660b903c6e480779
Stored in directory: /home/jenkins/.cache/pip/wheels/aa/bc/0d/9a20dd51effef392aae2733cb4c7b66c6fa29fca33d88b57ed
Building wheel for jsonpath-rw (pyproject.toml): started
Building wheel for jsonpath-rw (pyproject.toml): finished with status 'done'
Created wheel for jsonpath-rw: filename=jsonpath_rw-1.4.0-py3-none-any.whl size=15176 sha256=8e7d8f21bfb7547d2bab063f1a744cdf838f3dcb94666cedd65d0cc748b20c17
Stored in directory: /home/jenkins/.cache/pip/wheels/f1/54/63/9a8da38cefae13755097b36cc852decc25d8ef69c37d58d4eb
Successfully built robotframework-sshlibrary ipaddr netifaces robotframework-httplibrary jsonpath-rw
Installing collected packages: types-urllib3, types-certifi, sortedcontainers, ply, netifaces, ipaddr, enum34, zipp, websocket-client, WebOb, waitress, urllib3, typing-extensions, soupsieve, sniffio, six, scapy, robotframework-pythonlibcore, robotframework, regex, pysocks, pyparsing, pycparser, packaging, netaddr, mypy-extensions, lxml, jsonpointer, jmespath, isodate, invoke, idna, h11, decorator, click, charset_normalizer, certifi, bcrypt, attrs, async-generator, wsproto, requests, python-dateutil, pyhocon, pyang, outcome, jsonpath-rw, jsonpatch, importlib-metadata, elastic-transport, docker-pycreds, cffi, beautifulsoup4, webtest, trio, robotframework-requests, pynacl, pyangbind, elasticsearch, docker-py, cryptography, trio-websocket, trio-typing, robotframework-httplibrary, paramiko, elasticsearch-dsl, selenium, scp, robotframework-sshlibrary, robotframework-seleniumlibrary, robotframework-selenium2library
Successfully installed WebOb-1.8.9 async-generator-1.10 attrs-25.4.0 bcrypt-5.0.0 beautifulsoup4-4.14.3 certifi-2026.1.4 cffi-2.0.0 charset_normalizer-3.4.4 click-8.3.1 cryptography-46.0.3 decorator-5.2.1 docker-py-1.10.6 docker-pycreds-0.4.0 elastic-transport-8.17.1 elasticsearch-8.19.3 elasticsearch-dsl-8.15.4 enum34-1.1.10 h11-0.16.0 idna-3.11 importlib-metadata-8.7.1 invoke-2.2.1 ipaddr-2.2.0 isodate-0.7.2 jmespath-1.0.1 jsonpatch-1.33 jsonpath-rw-1.4.0 jsonpointer-3.0.0 lxml-6.0.2 mypy-extensions-1.1.0 netaddr-1.3.0 netifaces-0.11.0 outcome-1.3.0.post0 packaging-25.0 paramiko-4.0.0 ply-3.11 pyang-2.7.1 pyangbind-0.8.7 pycparser-2.23 pyhocon-0.3.61 pynacl-1.6.2 pyparsing-3.3.1 pysocks-1.7.1 python-dateutil-2.9.0.post0 regex-2026.1.15 requests-2.32.5 robotframework-7.4.1 robotframework-httplibrary-0.4.2 robotframework-pythonlibcore-4.5.0 robotframework-requests-0.9.7 robotframework-selenium2library-3.0.0 robotframework-seleniumlibrary-6.8.0 robotframework-sshlibrary-3.8.0 scapy-2.7.0 scp-0.15.0 selenium-4.40.0 six-1.17.0 sniffio-1.3.1 sortedcontainers-2.4.0 soupsieve-2.8.2 trio-0.32.0 trio-typing-0.10.0 trio-websocket-0.12.2 types-certifi-2021.10.8.3 types-urllib3-1.26.25.14 typing-extensions-4.15.0 urllib3-2.6.3 waitress-3.0.2 websocket-client-1.9.0 webtest-3.0.7 wsproto-1.3.2 zipp-3.23.0
+ pip freeze
async-generator==1.10
attrs==25.4.0
bcrypt==5.0.0
beautifulsoup4==4.14.3
certifi==2026.1.4
cffi==2.0.0
charset-normalizer==3.4.4
click==8.3.1
cryptography==46.0.3
decorator==5.2.1
distlib==0.4.0
docker-py==1.10.6
docker-pycreds==0.4.0
elastic-transport==8.17.1
elasticsearch==8.19.3
elasticsearch-dsl==8.15.4
enum34==1.1.10
filelock==3.20.3
h11==0.16.0
idna==3.11
importlib_metadata==8.7.1
invoke==2.2.1
ipaddr==2.2.0
isodate==0.7.2
jmespath==1.0.1
jsonpatch==1.33
jsonpath-rw==1.4.0
jsonpointer==3.0.0
lxml==6.0.2
mypy_extensions==1.1.0
netaddr==1.3.0
netifaces==0.11.0
outcome==1.3.0.post0
packaging==25.0
paramiko==4.0.0
platformdirs==4.5.1
ply==3.11
pyang==2.7.1
pyangbind==0.8.7
pycparser==2.23
pyhocon==0.3.61
PyNaCl==1.6.2
pyparsing==3.3.1
PySocks==1.7.1
python-dateutil==2.9.0.post0
regex==2026.1.15
requests==2.32.5
robotframework==7.4.1
robotframework-httplibrary==0.4.2
robotframework-pythonlibcore==4.5.0
robotframework-requests==0.9.7
robotframework-selenium2library==3.0.0
robotframework-seleniumlibrary==6.8.0
robotframework-sshlibrary==3.8.0
scapy==2.7.0
scp==0.15.0
selenium==4.40.0
six==1.17.0
sniffio==1.3.1
sortedcontainers==2.4.0
soupsieve==2.8.2
trio==0.32.0
trio-typing==0.10.0
trio-websocket==0.12.2
types-certifi==2021.10.8.3
types-urllib3==1.26.25.14
typing_extensions==4.15.0
urllib3==2.6.3
virtualenv==20.36.1
waitress==3.0.2
WebOb==1.8.9
websocket-client==1.9.0
WebTest==3.0.7
wsproto==1.3.2
zipp==3.23.0
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties file path 'env.properties'
[EnvInject] - Variables injected successfully.
[controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash -l /tmp/jenkins15300995802277829457.sh
Setup pyenv:
system
3.8.13
3.9.13
3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-U8VX from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
lf-activate-venv(): INFO: Attempting to install with network-safe options...
lf-activate-venv(): INFO: Base packages installed successfully
lf-activate-venv(): INFO: Installing additional packages: python-heatclient python-openstackclient yq
lf-activate-venv(): INFO: Adding /tmp/venv-U8VX/bin to PATH
+ ODL_SYSTEM=()
+ TOOLS_SYSTEM=()
+ OPENSTACK_SYSTEM=()
+ OPENSTACK_CONTROLLERS=()
+ mapfile -t ADDR
++ openstack stack show -f json -c outputs releng-controller-csit-3node-clustering-tell-all-scandium-90
++ jq -r '.outputs[] | select(.output_key | match("^vm_[0-9]+_ips$")) | .output_value | .[]'
+ for i in "${ADDR[@]}"
++ ssh 10.30.170.68 hostname -s
Warning: Permanently added '10.30.170.68' (ECDSA) to the list of known hosts.
+ REMHOST=releng-43164-90-0-builder-0
+ case ${REMHOST} in
+ ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}")
+ for i in "${ADDR[@]}"
++ ssh 10.30.170.136 hostname -s
Warning: Permanently added '10.30.170.136' (ECDSA) to the list of known hosts.
+ REMHOST=releng-43164-90-0-builder-1
+ case ${REMHOST} in
+ ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}")
+ for i in "${ADDR[@]}"
++ ssh 10.30.171.135 hostname -s
Warning: Permanently added '10.30.171.135' (ECDSA) to the list of known hosts.
+ REMHOST=releng-43164-90-0-builder-2
+ case ${REMHOST} in
+ ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}")
+ echo NUM_ODL_SYSTEM=3
+ echo NUM_TOOLS_SYSTEM=0
+ '[' '' == yes ']'
+ NUM_OPENSTACK_SYSTEM=0
+ echo NUM_OPENSTACK_SYSTEM=0
+ '[' 0 -eq 2 ']'
+ echo ODL_SYSTEM_IP=10.30.170.68
++ seq 0 2
+ for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 )))
+ echo ODL_SYSTEM_1_IP=10.30.170.68
+ for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 )))
+ echo ODL_SYSTEM_2_IP=10.30.170.136
+ for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 )))
+ echo ODL_SYSTEM_3_IP=10.30.171.135
+ echo TOOLS_SYSTEM_IP=
++ seq 0 -1
+ openstack_index=0
+ NUM_OPENSTACK_CONTROL_NODES=1
+ echo NUM_OPENSTACK_CONTROL_NODES=1
++ seq 0 0
+ for i in $(seq 0 $((NUM_OPENSTACK_CONTROL_NODES - 1)))
+ echo OPENSTACK_CONTROL_NODE_1_IP=
+ NUM_OPENSTACK_COMPUTE_NODES=-1
+ echo NUM_OPENSTACK_COMPUTE_NODES=-1
+ '[' -1 -ge 2 ']'
++ seq 0 -2
+ NUM_OPENSTACK_HAPROXY_NODES=0
+ echo NUM_OPENSTACK_HAPROXY_NODES=0
++ seq 0 -1
+ echo 'Contents of slave_addresses.txt:'
Contents of slave_addresses.txt:
+ cat slave_addresses.txt
NUM_ODL_SYSTEM=3
NUM_TOOLS_SYSTEM=0
NUM_OPENSTACK_SYSTEM=0
ODL_SYSTEM_IP=10.30.170.68
ODL_SYSTEM_1_IP=10.30.170.68
ODL_SYSTEM_2_IP=10.30.170.136
ODL_SYSTEM_3_IP=10.30.171.135
TOOLS_SYSTEM_IP=
NUM_OPENSTACK_CONTROL_NODES=1
OPENSTACK_CONTROL_NODE_1_IP=
NUM_OPENSTACK_COMPUTE_NODES=-1
NUM_OPENSTACK_HAPROXY_NODES=0
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties file path 'slave_addresses.txt'
[EnvInject] - Variables injected successfully.
[controller-csit-3node-clustering-tell-all-scandium] $ /bin/sh /tmp/jenkins14354424831413351691.sh
Preparing for JRE Version 21
Karaf artifact is karaf
Karaf project is integration
Java home is /usr/lib/jvm/java-21-openjdk-amd64
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties file path 'set_variables.env'
[EnvInject] - Variables injected successfully.
[controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins10168166356892593021.sh
2026-01-18 23:51:06 URL:https://raw.githubusercontent.com/opendaylight/integration-distribution/stable/scandium/pom.xml [2619/2619] -> "pom.xml" [1]
Bundle version is 0.21.4-SNAPSHOT
--2026-01-18 23:51:06-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.4-SNAPSHOT/maven-metadata.xml
Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6
Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 1410 (1.4K) [application/xml]
Saving to: ‘maven-metadata.xml’
0K . 100% 59.3M=0s
2026-01-18 23:51:06 (59.3 MB/s) - ‘maven-metadata.xml’ saved [1410/1410]
org.opendaylight.integration
karaf
0.21.4-SNAPSHOT
20260118.212536
493
20260118212536
pom
0.21.4-20260118.212536-493
20260118212536
tar.gz
0.21.4-20260118.212536-493
20260118212536
zip
0.21.4-20260118.212536-493
20260118212536
cyclonedx
xml
0.21.4-20260118.212536-493
20260118212536
cyclonedx
json
0.21.4-20260118.212536-493
20260118212536
Nexus timestamp is 0.21.4-20260118.212536-493
Distribution bundle URL is https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.4-SNAPSHOT/karaf-0.21.4-20260118.212536-493.zip
Distribution bundle is karaf-0.21.4-20260118.212536-493.zip
Distribution bundle version is 0.21.4-SNAPSHOT
Distribution folder is karaf-0.21.4-SNAPSHOT
Nexus prefix is https://nexus.opendaylight.org
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties file path 'detect_variables.env'
[EnvInject] - Variables injected successfully.
[controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash -l /tmp/jenkins12740237466752465697.sh
Setup pyenv:
system
3.8.13
3.9.13
3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-U8VX from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
lf-activate-venv(): INFO: Attempting to install with network-safe options...
lf-activate-venv(): INFO: Base packages installed successfully
lf-activate-venv(): INFO: Installing additional packages: python-heatclient python-openstackclient
lf-activate-venv(): INFO: Adding /tmp/venv-U8VX/bin to PATH
Copying common-functions.sh to /tmp
Copying common-functions.sh to 10.30.170.68:/tmp
Warning: Permanently added '10.30.170.68' (ECDSA) to the list of known hosts.
Copying common-functions.sh to 10.30.170.136:/tmp
Warning: Permanently added '10.30.170.136' (ECDSA) to the list of known hosts.
Copying common-functions.sh to 10.30.171.135:/tmp
Warning: Permanently added '10.30.171.135' (ECDSA) to the list of known hosts.
[controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins10474470292863427367.sh
common-functions.sh is being sourced
common-functions environment:
MAVENCONF: /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
ACTUALFEATURES:
FEATURESCONF: /tmp/karaf-0.21.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
CUSTOMPROP: /tmp/karaf-0.21.4-SNAPSHOT/etc/custom.properties
LOGCONF: /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
MEMCONF: /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv
CONTROLLERMEM: 2048m
AKKACONF: /tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/akka.conf
MODULESCONF: /tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/modules.conf
MODULESHARDSCONF: /tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/module-shards.conf
SUITES:
#################################################
## Configure Cluster and Start ##
#################################################
ACTUALFEATURES: odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app
SPACE_SEPARATED_FEATURES: odl-integration-compatible-with-all odl-jolokia odl-restconf odl-clustering-test-app
Locating script plan to use...
script plan exists!!!
Changing the script plan path...
# Place the scripts in run order:
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/scripts/car_people_shard.sh
Executing /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/scripts/car_people_shard.sh...
Add car-people shards file
Copy shard config to member-1 with IP address 10.30.170.68
Warning: Permanently added '10.30.170.68' (ECDSA) to the list of known hosts.
Copy shard config to member-2 with IP address 10.30.170.136
Warning: Permanently added '10.30.170.136' (ECDSA) to the list of known hosts.
Copy shard config to member-3 with IP address 10.30.171.135
Warning: Permanently added '10.30.171.135' (ECDSA) to the list of known hosts.
Finished running script plans
Configuring member-1 with IP address 10.30.170.68
Warning: Permanently added '10.30.170.68' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.170.68' (ECDSA) to the list of known hosts.
+ source /tmp/common-functions.sh karaf-0.21.4-SNAPSHOT scandium
common-functions.sh is being sourced
++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]]
++ echo 'common-functions.sh is being sourced'
++ BUNDLEFOLDER=karaf-0.21.4-SNAPSHOT
++ DISTROSTREAM=scandium
++ export MAVENCONF=/tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
++ MAVENCONF=/tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
++ export FEATURESCONF=/tmp/karaf-0.21.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
++ FEATURESCONF=/tmp/karaf-0.21.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
++ export CUSTOMPROP=/tmp/karaf-0.21.4-SNAPSHOT/etc/custom.properties
++ CUSTOMPROP=/tmp/karaf-0.21.4-SNAPSHOT/etc/custom.properties
++ export LOGCONF=/tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
++ LOGCONF=/tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
++ export MEMCONF=/tmp/karaf-0.21.4-SNAPSHOT/bin/setenv
++ MEMCONF=/tmp/karaf-0.21.4-SNAPSHOT/bin/setenv
++ export CONTROLLERMEM=
++ CONTROLLERMEM=
++ case "${DISTROSTREAM}" in
++ CLUSTER_SYSTEM=akka
++ export AKKACONF=/tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/akka.conf
++ AKKACONF=/tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/akka.conf
++ export MODULESCONF=/tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/modules.conf
++ MODULESCONF=/tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/modules.conf
++ export MODULESHARDSCONF=/tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/module-shards.conf
++ MODULESHARDSCONF=/tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/module-shards.conf
++ print_common_env
++ cat
common-functions environment:
MAVENCONF: /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
ACTUALFEATURES:
FEATURESCONF: /tmp/karaf-0.21.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
CUSTOMPROP: /tmp/karaf-0.21.4-SNAPSHOT/etc/custom.properties
LOGCONF: /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
MEMCONF: /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv
CONTROLLERMEM:
AKKACONF: /tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/akka.conf
MODULESCONF: /tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/modules.conf
MODULESHARDSCONF: /tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/module-shards.conf
SUITES:
++ SSH='ssh -t -t'
++ extra_services_cntl=' dnsmasq.service httpd.service libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service rabbitmq-server.service '
++ extra_services_cmp=' libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service '
Changing to /tmp
Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.4-SNAPSHOT/karaf-0.21.4-20260118.212536-493.zip
+ echo 'Changing to /tmp'
+ cd /tmp
+ echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.4-SNAPSHOT/karaf-0.21.4-20260118.212536-493.zip'
+ wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.4-SNAPSHOT/karaf-0.21.4-20260118.212536-493.zip
--2026-01-18 23:51:20-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.4-SNAPSHOT/karaf-0.21.4-20260118.212536-493.zip
Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6
Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 239812769 (229M) [application/zip]
Saving to: ‘karaf-0.21.4-20260118.212536-493.zip’
0K ........ ........ ........ ........ ........ ........ 1% 80.4M 3s
3072K ........ ........ ........ ........ ........ ........ 2% 138M 2s
6144K ........ ........ ........ ........ ........ ........ 3% 165M 2s
9216K ........ ........ ........ ........ ........ ........ 5% 152M 2s
12288K ........ ........ ........ ........ ........ ........ 6% 155M 2s
15360K ........ ........ ........ ........ ........ ........ 7% 187M 2s
18432K ........ ........ ........ ........ ........ ........ 9% 158M 1s
21504K ........ ........ ........ ........ ........ ........ 10% 116M 2s
24576K ........ ........ ........ ........ ........ ........ 11% 123M 2s
27648K ........ ........ ........ ........ ........ ........ 13% 248M 1s
30720K ........ ........ ........ ........ ........ ........ 14% 235M 1s
33792K ........ ........ ........ ........ ........ ........ 15% 283M 1s
36864K ........ ........ ........ ........ ........ ........ 17% 312M 1s
39936K ........ ........ ........ ........ ........ ........ 18% 322M 1s
43008K ........ ........ ........ ........ ........ ........ 19% 310M 1s
46080K ........ ........ ........ ........ ........ ........ 20% 291M 1s
49152K ........ ........ ........ ........ ........ ........ 22% 324M 1s
52224K ........ ........ ........ ........ ........ ........ 23% 314M 1s
55296K ........ ........ ........ ........ ........ ........ 24% 379M 1s
58368K ........ ........ ........ ........ ........ ........ 26% 316M 1s
61440K ........ ........ ........ ........ ........ ........ 27% 198M 1s
64512K ........ ........ ........ ........ ........ ........ 28% 243M 1s
67584K ........ ........ ........ ........ ........ ........ 30% 366M 1s
70656K ........ ........ ........ ........ ........ ........ 31% 348M 1s
73728K ........ ........ ........ ........ ........ ........ 32% 345M 1s
76800K ........ ........ ........ ........ ........ ........ 34% 357M 1s
79872K ........ ........ ........ ........ ........ ........ 35% 362M 1s
82944K ........ ........ ........ ........ ........ ........ 36% 210M 1s
86016K ........ ........ ........ ........ ........ ........ 38% 296M 1s
89088K ........ ........ ........ ........ ........ ........ 39% 370M 1s
92160K ........ ........ ........ ........ ........ ........ 40% 357M 1s
95232K ........ ........ ........ ........ ........ ........ 41% 312M 1s
98304K ........ ........ ........ ........ ........ ........ 43% 346M 1s
101376K ........ ........ ........ ........ ........ ........ 44% 362M 1s
104448K ........ ........ ........ ........ ........ ........ 45% 345M 1s
107520K ........ ........ ........ ........ ........ ........ 47% 303M 1s
110592K ........ ........ ........ ........ ........ ........ 48% 296M 1s
113664K ........ ........ ........ ........ ........ ........ 49% 272M 0s
116736K ........ ........ ........ ........ ........ ........ 51% 184M 0s
119808K ........ ........ ........ ........ ........ ........ 52% 297M 0s
122880K ........ ........ ........ ........ ........ ........ 53% 266M 0s
125952K ........ ........ ........ ........ ........ ........ 55% 362M 0s
129024K ........ ........ ........ ........ ........ ........ 56% 354M 0s
132096K ........ ........ ........ ........ ........ ........ 57% 186M 0s
135168K ........ ........ ........ ........ ........ ........ 59% 297M 0s
138240K ........ ........ ........ ........ ........ ........ 60% 282M 0s
141312K ........ ........ ........ ........ ........ ........ 61% 290M 0s
144384K ........ ........ ........ ........ ........ ........ 62% 364M 0s
147456K ........ ........ ........ ........ ........ ........ 64% 372M 0s
150528K ........ ........ ........ ........ ........ ........ 65% 361M 0s
153600K ........ ........ ........ ........ ........ ........ 66% 288M 0s
156672K ........ ........ ........ ........ ........ ........ 68% 345M 0s
159744K ........ ........ ........ ........ ........ ........ 69% 350M 0s
162816K ........ ........ ........ ........ ........ ........ 70% 299M 0s
165888K ........ ........ ........ ........ ........ ........ 72% 328M 0s
168960K ........ ........ ........ ........ ........ ........ 73% 372M 0s
172032K ........ ........ ........ ........ ........ ........ 74% 340M 0s
175104K ........ ........ ........ ........ ........ ........ 76% 175M 0s
178176K ........ ........ ........ ........ ........ ........ 77% 297M 0s
181248K ........ ........ ........ ........ ........ ........ 78% 225M 0s
184320K ........ ........ ........ ........ ........ ........ 80% 197M 0s
187392K ........ ........ ........ ........ ........ ........ 81% 323M 0s
190464K ........ ........ ........ ........ ........ ........ 82% 356M 0s
193536K ........ ........ ........ ........ ........ ........ 83% 355M 0s
196608K ........ ........ ........ ........ ........ ........ 85% 255M 0s
199680K ........ ........ ........ ........ ........ ........ 86% 289M 0s
202752K ........ ........ ........ ........ ........ ........ 87% 356M 0s
205824K ........ ........ ........ ........ ........ ........ 89% 367M 0s
208896K ........ ........ ........ ........ ........ ........ 90% 356M 0s
211968K ........ ........ ........ ........ ........ ........ 91% 251M 0s
215040K ........ ........ ........ ........ ........ ........ 93% 192M 0s
218112K ........ ........ ........ ........ ........ ........ 94% 308M 0s
221184K ........ ........ ........ ........ ........ ........ 95% 358M 0s
224256K ........ ........ ........ ........ ........ ........ 97% 356M 0s
227328K ........ ........ ........ ........ ........ ........ 98% 360M 0s
230400K ........ ........ ........ ........ ........ ........ 99% 334M 0s
233472K ........ ... 100% 98.7M=0.9s
2026-01-18 23:51:21 (258 MB/s) - ‘karaf-0.21.4-20260118.212536-493.zip’ saved [239812769/239812769]
Extracting the new controller...
+ echo 'Extracting the new controller...'
+ unzip -q karaf-0.21.4-20260118.212536-493.zip
Adding external repositories...
+ echo 'Adding external repositories...'
+ sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
+ cat /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
################################################################################
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
################################################################################
#
# If set to true, the following property will not allow any certificate to be used
# when accessing Maven repositories through SSL
#
#org.ops4j.pax.url.mvn.certificateCheck=
#
# Path to the local Maven settings file.
# The repositories defined in this file will be automatically added to the list
# of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property
# below is not set.
# The following locations are checked for the existence of the settings.xml file
# * 1. looks for the specified url
# * 2. if not found looks for ${user.home}/.m2/settings.xml
# * 3. if not found looks for ${maven.home}/conf/settings.xml
# * 4. if not found looks for ${M2_HOME}/conf/settings.xml
#
#org.ops4j.pax.url.mvn.settings=
#
# Path to the local Maven repository which is used to avoid downloading
# artifacts when they already exist locally.
# The value of this property will be extracted from the settings.xml file
# above, or defaulted to:
# System.getProperty( "user.home" ) + "/.m2/repository"
#
org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository}
#
# Default this to false. It's just weird to use undocumented repos
#
org.ops4j.pax.url.mvn.useFallbackRepositories=false
#
# Uncomment if you don't wanna use the proxy settings
# from the Maven conf/settings.xml file
#
# org.ops4j.pax.url.mvn.proxySupport=false
#
# Comma separated list of repositories scanned when resolving an artifact.
# Those repositories will be checked before iterating through the
# below list of repositories and even before the local repository
# A repository url can be appended with zero or more of the following flags:
# @snapshots : the repository contains snaphots
# @noreleases : the repository does not contain any released artifacts
#
# The following property value will add the system folder as a repo.
#
org.ops4j.pax.url.mvn.defaultRepositories=\
file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\
file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\
file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots
# Use the default local repo (e.g.~/.m2/repository) as a "remote" repo
#org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false
#
# Comma separated list of repositories scanned when resolving an artifact.
# The default list includes the following repositories:
# http://repo1.maven.org/maven2@id=central
# http://repository.springsource.com/maven/bundles/release@id=spring.ebr
# http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external
# http://zodiac.springsource.com/maven/bundles/release@id=gemini
# http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases
# https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases
# https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
# To add repositories to the default ones, prepend '+' to the list of repositories
# to add.
# A repository url can be appended with zero or more of the following flags:
# @snapshots : the repository contains snapshots
# @noreleases : the repository does not contain any released artifacts
# @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended
#
org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.Configuring the startup features...
+ [[ True == \T\r\u\e ]]
+ echo 'Configuring the startup features...'
+ sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.21.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
+ FEATURE_TEST_STRING=features-test
+ FEATURE_TEST_VERSION=0.21.4-SNAPSHOT
+ KARAF_VERSION=karaf4
+ [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]]
+ sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.21.4-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.21.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
+ [[ ! -z '' ]]
+ cat /tmp/karaf-0.21.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
################################################################################
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
################################################################################
#
# Comma separated list of features repositories to register by default
#
featuresRepositories = mvn:org.opendaylight.integration/features-test/0.21.4-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/621a16f5-c371-43a1-9b25-87a911f24926.xml
#
# Comma separated list of features to install at startup
#
featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, 1029ce08-34fd-4a36-9164-491d0aaf782d
#
# Resource repositories (OBR) that the features resolver can use
# to resolve requirements/capabilities
#
# The format of the resourceRepositories is
# resourceRepositories=[xml:url|json:url],...
# for Instance:
#
#resourceRepositories=xml:http://host/path/to/index.xml
# or
#resourceRepositories=json:http://host/path/to/index.json
#
#
# Defines if the boot features are started in asynchronous mode (in a dedicated thread)
#
featuresBootAsynchronous=false
#
# Service requirements enforcement
#
# By default, the feature resolver checks the service requirements/capabilities of
# bundles for new features (xml schema >= 1.3.0) in order to automatically installs
# the required bundles.
# The following flag can have those values:
# - disable: service requirements are completely ignored
# - default: service requirements are ignored for old features
# - enforce: service requirements are always verified
#
#serviceRequirements=default
#
# Store cfg file for config element in feature
#
#configCfgStore=true
#
# Define if the feature service automatically refresh bundles
#
autoRefresh=true
#
# Configuration of features processing mechanism (overrides, blacklisting, modification of features)
# XML file defines instructions related to features processing
# versions.properties may declare properties to resolve placeholders in XML file
# both files are relative to ${karaf.etc}
#
#featureProcessing=org.apache.karaf.features.xml
#featureProcessingVersions=versions.properties
+ configure_karaf_log karaf4 ''
+ local -r karaf_version=karaf4
+ local -r controllerdebugmap=
+ local logapi=log4j
+ grep log4j2 /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
log4j2.rootLogger.level = INFO
#log4j2.rootLogger.type = asyncRoot
#log4j2.rootLogger.includeLocation = false
log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
log4j2.rootLogger.appenderRef.Console.ref = Console
log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
log4j2.logger.spifly.name = org.apache.aries.spifly
log4j2.logger.spifly.level = WARN
log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
log4j2.logger.audit.level = INFO
log4j2.logger.audit.additivity = false
log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
# Console appender not used by default (see log4j2.rootLogger.appenderRefs)
log4j2.appender.console.type = Console
log4j2.appender.console.name = Console
log4j2.appender.console.layout.type = PatternLayout
log4j2.appender.console.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.type = RollingRandomAccessFile
log4j2.appender.rolling.name = RollingFile
log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
#log4j2.appender.rolling.immediateFlush = false
log4j2.appender.rolling.append = true
log4j2.appender.rolling.layout.type = PatternLayout
log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.policies.type = Policies
log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.rolling.policies.size.size = 64MB
log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
log4j2.appender.rolling.strategy.max = 7
log4j2.appender.audit.type = RollingRandomAccessFile
log4j2.appender.audit.name = AuditRollingFile
log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
log4j2.appender.audit.append = true
log4j2.appender.audit.layout.type = PatternLayout
log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
log4j2.appender.audit.policies.type = Policies
log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.audit.policies.size.size = 8MB
log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
log4j2.appender.audit.strategy.max = 7
log4j2.appender.osgi.type = PaxOsgi
log4j2.appender.osgi.name = PaxOsgi
log4j2.appender.osgi.filter = *
#log4j2.logger.aether.name = shaded.org.eclipse.aether
#log4j2.logger.aether.level = TRACE
#log4j2.logger.http-headers.name = shaded.org.apache.http.headers
#log4j2.logger.http-headers.level = DEBUG
#log4j2.logger.maven.name = org.ops4j.pax.url.mvn
#log4j2.logger.maven.level = TRACE
+ logapi=log4j2
Configuring the karaf log... karaf_version: karaf4, logapi: log4j2
+ echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2'
+ '[' log4j2 == log4j2 ']'
+ sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
controllerdebugmap:
cat /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
################################################################################
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
################################################################################
# Common pattern layout for appenders
log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
# Root logger
log4j2.rootLogger.level = INFO
# uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library
#log4j2.rootLogger.type = asyncRoot
#log4j2.rootLogger.includeLocation = false
log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
log4j2.rootLogger.appenderRef.Console.ref = Console
log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
# Filters for logs marked by org.opendaylight.odlparent.Markers
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
# Loggers configuration
# Spifly logger
log4j2.logger.spifly.name = org.apache.aries.spifly
log4j2.logger.spifly.level = WARN
# Security audit logger
log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
log4j2.logger.audit.level = INFO
log4j2.logger.audit.additivity = false
log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
# Appenders configuration
# Console appender not used by default (see log4j2.rootLogger.appenderRefs)
log4j2.appender.console.type = Console
log4j2.appender.console.name = Console
log4j2.appender.console.layout.type = PatternLayout
log4j2.appender.console.layout.pattern = ${log4j2.pattern}
# Rolling file appender
log4j2.appender.rolling.type = RollingRandomAccessFile
log4j2.appender.rolling.name = RollingFile
log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
# uncomment to not force a disk flush
#log4j2.appender.rolling.immediateFlush = false
log4j2.appender.rolling.append = true
log4j2.appender.rolling.layout.type = PatternLayout
log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.policies.type = Policies
log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.rolling.policies.size.size = 1GB
log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
log4j2.appender.rolling.strategy.max = 7
# Audit file appender
log4j2.appender.audit.type = RollingRandomAccessFile
log4j2.appender.audit.name = AuditRollingFile
log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
log4j2.appender.audit.append = true
log4j2.appender.audit.layout.type = PatternLayout
log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
log4j2.appender.audit.policies.type = Policies
log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.audit.policies.size.size = 8MB
log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
log4j2.appender.audit.strategy.max = 7
# OSGi appender
log4j2.appender.osgi.type = PaxOsgi
log4j2.appender.osgi.name = PaxOsgi
log4j2.appender.osgi.filter = *
# help with identification of maven-related problems with pax-url-aether
#log4j2.logger.aether.name = shaded.org.eclipse.aether
#log4j2.logger.aether.level = TRACE
#log4j2.logger.http-headers.name = shaded.org.apache.http.headers
#log4j2.logger.http-headers.level = DEBUG
#log4j2.logger.maven.name = org.ops4j.pax.url.mvn
#log4j2.logger.maven.level = TRACE
log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN
log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN
Configure
java home: /usr/lib/jvm/java-21-openjdk-amd64
max memory: 3072m
memconf: /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv
+ orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver
+ orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver
+ echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN'
+ echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN'
+ unset IFS
+ echo 'controllerdebugmap: '
+ '[' -n '' ']'
+ echo 'cat /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg'
+ cat /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
+ set_java_vars /usr/lib/jvm/java-21-openjdk-amd64 3072m /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv
+ local -r java_home=/usr/lib/jvm/java-21-openjdk-amd64
+ local -r controllermem=3072m
+ local -r memconf=/tmp/karaf-0.21.4-SNAPSHOT/bin/setenv
+ echo Configure
+ echo ' java home: /usr/lib/jvm/java-21-openjdk-amd64'
+ echo ' max memory: 3072m'
+ echo ' memconf: /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv'
+ sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64}%g' /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv
+ sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv
cat /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv
+ echo 'cat /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv'
+ cat /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv
#!/bin/sh
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
#
# handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf
# script: client, instance, shell, start, status, stop, karaf
#
# if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then
# Actions go here...
# fi
#
# general settings which should be applied for all scripts go here; please keep
# in mind that it is possible that scripts might be executed more than once, e.g.
# in example of the start script where the start script is executed first and the
# karaf script afterwards.
#
#
# The following section shows the possible configuration options for the default
# karaf scripts
#
export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64} # Location of Java installation
# export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration
# export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options
# export EXTRA_JAVA_OPTS # Additional JVM options
# export KARAF_HOME # Karaf home folder
# export KARAF_DATA # Karaf data folder
# export KARAF_BASE # Karaf base folder
# export KARAF_ETC # Karaf etc folder
# export KARAF_LOG # Karaf log folder
# export KARAF_SYSTEM_OPTS # First citizen Karaf options
# export KARAF_OPTS # Additional available Karaf options
# export KARAF_DEBUG # Enable debug mode
# export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start
# export KARAF_NOROOT # Prevent execution as root if set to true
Set Java version
+ echo 'Set Java version'
+ sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-21-openjdk-amd64/bin/java 1
sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper
sudo: a password is required
+ sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-21-openjdk-amd64/bin/java
sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper
sudo: a password is required
JDK default version ...
+ echo 'JDK default version ...'
+ java -version
openjdk version "21.0.9" 2025-10-21
OpenJDK Runtime Environment (build 21.0.9+10-Ubuntu-122.04)
OpenJDK 64-Bit Server VM (build 21.0.9+10-Ubuntu-122.04, mixed mode, sharing)
Set JAVA_HOME
+ echo 'Set JAVA_HOME'
+ export JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64
+ JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64
++ readlink -e /usr/lib/jvm/java-21-openjdk-amd64/bin/java
+ JAVA_RESOLVED=/usr/lib/jvm/java-21-openjdk-amd64/bin/java
Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java
Listing all open ports on controller system...
+ echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java'
+ echo 'Listing all open ports on controller system...'
+ netstat -pnatu
/tmp/configuration-script.sh: line 40: netstat: command not found
Custom shard config exists!!!
+ '[' -f /tmp/custom_shard_config.txt ']'
+ echo 'Custom shard config exists!!!'
Copying the shard config...
+ echo 'Copying the shard config...'
+ cp /tmp/custom_shard_config.txt /tmp/karaf-0.21.4-SNAPSHOT/bin/
Configuring cluster
+ echo 'Configuring cluster'
+ /tmp/karaf-0.21.4-SNAPSHOT/bin/configure_cluster.sh 1 10.30.170.68 10.30.170.136 10.30.171.135
################################################
## Configure Cluster ##
################################################
NOTE: Cluster configuration files not found. Copying from
/tmp/karaf-0.21.4-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/10.0.14
Configuring unique name in akka.conf
Configuring hostname in akka.conf
Configuring data and rpc seed nodes in akka.conf
modules = [
{
name = "inventory"
namespace = "urn:opendaylight:inventory"
shard-strategy = "module"
},
{
name = "topology"
namespace = "urn:TBD:params:xml:ns:yang:network-topology"
shard-strategy = "module"
},
{
name = "toaster"
namespace = "http://netconfcentral.org/ns/toaster"
shard-strategy = "module"
},
{
name = "car"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
shard-strategy = "module"
},
{
name = "people"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
shard-strategy = "module"
},
{
name = "car-people"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
shard-strategy = "module"
}
]
Configuring replication type in module-shards.conf
################################################
## NOTE: Manually restart controller to ##
## apply configuration. ##
################################################
Dump akka.conf
+ echo 'Dump akka.conf'
+ cat /tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/akka.conf
odl-cluster-data {
akka {
remote {
artery {
enabled = on
transport = tcp
canonical.hostname = "10.30.170.68"
canonical.port = 2550
}
}
cluster {
# Using artery.
seed-nodes = ["akka://opendaylight-cluster-data@10.30.170.68:2550",
"akka://opendaylight-cluster-data@10.30.170.136:2550",
"akka://opendaylight-cluster-data@10.30.171.135:2550"]
roles = ["member-1"]
# when under load we might trip a false positive on the failure detector
# failure-detector {
# heartbeat-interval = 4 s
# acceptable-heartbeat-pause = 16s
# }
}
persistence {
# By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by
# modifying the following two properties. The directory location specified may be a relative or absolute path.
# The relative path is always relative to KARAF_HOME.
# snapshot-store.local.dir = "target/snapshots"
# Use lz4 compression for LocalSnapshotStore snapshots
snapshot-store.local.use-lz4-compression = false
# Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB
snapshot-store.local.lz4-blocksize = 256KB
}
disable-default-actor-system-quarantined-event-handling = "false"
}
}
Dump modules.conf
+ echo 'Dump modules.conf'
+ cat /tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/modules.conf
modules = [
{
name = "inventory"
namespace = "urn:opendaylight:inventory"
shard-strategy = "module"
},
{
name = "topology"
namespace = "urn:TBD:params:xml:ns:yang:network-topology"
shard-strategy = "module"
},
{
name = "toaster"
namespace = "http://netconfcentral.org/ns/toaster"
shard-strategy = "module"
},
{
name = "car"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
shard-strategy = "module"
},
{
name = "people"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
shard-strategy = "module"
},
{
name = "car-people"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
shard-strategy = "module"
}
]
Dump module-shards.conf
+ echo 'Dump module-shards.conf'
+ cat /tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/module-shards.conf
module-shards = [
{
name = "default"
shards = [
{
name = "default"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "inventory"
shards = [
{
name="inventory"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "topology"
shards = [
{
name="topology"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "toaster"
shards = [
{
name="toaster"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "car"
shards = [
{
name="car"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "people"
shards = [
{
name="people"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "car-people"
shards = [
{
name="car-people"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
}
]
Configuring member-2 with IP address 10.30.170.136
Warning: Permanently added '10.30.170.136' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.170.136' (ECDSA) to the list of known hosts.
+ source /tmp/common-functions.sh karaf-0.21.4-SNAPSHOT scandium
++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]]
common-functions.sh is being sourced
++ echo 'common-functions.sh is being sourced'
++ BUNDLEFOLDER=karaf-0.21.4-SNAPSHOT
++ DISTROSTREAM=scandium
++ export MAVENCONF=/tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
++ MAVENCONF=/tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
++ export FEATURESCONF=/tmp/karaf-0.21.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
++ FEATURESCONF=/tmp/karaf-0.21.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
++ export CUSTOMPROP=/tmp/karaf-0.21.4-SNAPSHOT/etc/custom.properties
++ CUSTOMPROP=/tmp/karaf-0.21.4-SNAPSHOT/etc/custom.properties
++ export LOGCONF=/tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
++ LOGCONF=/tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
++ export MEMCONF=/tmp/karaf-0.21.4-SNAPSHOT/bin/setenv
++ MEMCONF=/tmp/karaf-0.21.4-SNAPSHOT/bin/setenv
++ export CONTROLLERMEM=
++ CONTROLLERMEM=
++ case "${DISTROSTREAM}" in
++ CLUSTER_SYSTEM=akka
++ export AKKACONF=/tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/akka.conf
++ AKKACONF=/tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/akka.conf
++ export MODULESCONF=/tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/modules.conf
++ MODULESCONF=/tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/modules.conf
++ export MODULESHARDSCONF=/tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/module-shards.conf
++ MODULESHARDSCONF=/tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/module-shards.conf
++ print_common_env
++ cat
common-functions environment:
MAVENCONF: /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
ACTUALFEATURES:
FEATURESCONF: /tmp/karaf-0.21.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
CUSTOMPROP: /tmp/karaf-0.21.4-SNAPSHOT/etc/custom.properties
LOGCONF: /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
MEMCONF: /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv
CONTROLLERMEM:
AKKACONF: /tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/akka.conf
MODULESCONF: /tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/modules.conf
MODULESHARDSCONF: /tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/module-shards.conf
SUITES:
++ SSH='ssh -t -t'
++ extra_services_cntl=' dnsmasq.service httpd.service libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service rabbitmq-server.service '
++ extra_services_cmp=' libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service '
Changing to /tmp
Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.4-SNAPSHOT/karaf-0.21.4-20260118.212536-493.zip
+ echo 'Changing to /tmp'
+ cd /tmp
+ echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.4-SNAPSHOT/karaf-0.21.4-20260118.212536-493.zip'
+ wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.4-SNAPSHOT/karaf-0.21.4-20260118.212536-493.zip
--2026-01-18 23:51:23-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.4-SNAPSHOT/karaf-0.21.4-20260118.212536-493.zip
Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6
Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 239812769 (229M) [application/zip]
Saving to: ‘karaf-0.21.4-20260118.212536-493.zip’
0K ........ ........ ........ ........ ........ ........ 1% 84.8M 3s
3072K ........ ........ ........ ........ ........ ........ 2% 151M 2s
6144K ........ ........ ........ ........ ........ ........ 3% 163M 2s
9216K ........ ........ ........ ........ ........ ........ 5% 169M 2s
12288K ........ ........ ........ ........ ........ ........ 6% 218M 1s
15360K ........ ........ ........ ........ ........ ........ 7% 253M 1s
18432K ........ ........ ........ ........ ........ ........ 9% 250M 1s
21504K ........ ........ ........ ........ ........ ........ 10% 276M 1s
24576K ........ ........ ........ ........ ........ ........ 11% 305M 1s
27648K ........ ........ ........ ........ ........ ........ 13% 281M 1s
30720K ........ ........ ........ ........ ........ ........ 14% 253M 1s
33792K ........ ........ ........ ........ ........ ........ 15% 247M 1s
36864K ........ ........ ........ ........ ........ ........ 17% 237M 1s
39936K ........ ........ ........ ........ ........ ........ 18% 234M 1s
43008K ........ ........ ........ ........ ........ ........ 19% 238M 1s
46080K ........ ........ ........ ........ ........ ........ 20% 216M 1s
49152K ........ ........ ........ ........ ........ ........ 22% 226M 1s
52224K ........ ........ ........ ........ ........ ........ 23% 229M 1s
55296K ........ ........ ........ ........ ........ ........ 24% 229M 1s
58368K ........ ........ ........ ........ ........ ........ 26% 229M 1s
61440K ........ ........ ........ ........ ........ ........ 27% 222M 1s
64512K ........ ........ ........ ........ ........ ........ 28% 229M 1s
67584K ........ ........ ........ ........ ........ ........ 30% 230M 1s
70656K ........ ........ ........ ........ ........ ........ 31% 237M 1s
73728K ........ ........ ........ ........ ........ ........ 32% 231M 1s
76800K ........ ........ ........ ........ ........ ........ 34% 220M 1s
79872K ........ ........ ........ ........ ........ ........ 35% 239M 1s
82944K ........ ........ ........ ........ ........ ........ 36% 230M 1s
86016K ........ ........ ........ ........ ........ ........ 38% 227M 1s
89088K ........ ........ ........ ........ ........ ........ 39% 223M 1s
92160K ........ ........ ........ ........ ........ ........ 40% 226M 1s
95232K ........ ........ ........ ........ ........ ........ 41% 227M 1s
98304K ........ ........ ........ ........ ........ ........ 43% 226M 1s
101376K ........ ........ ........ ........ ........ ........ 44% 226M 1s
104448K ........ ........ ........ ........ ........ ........ 45% 230M 1s
107520K ........ ........ ........ ........ ........ ........ 47% 240M 1s
110592K ........ ........ ........ ........ ........ ........ 48% 234M 1s
113664K ........ ........ ........ ........ ........ ........ 49% 235M 1s
116736K ........ ........ ........ ........ ........ ........ 51% 228M 1s
119808K ........ ........ ........ ........ ........ ........ 52% 232M 0s
122880K ........ ........ ........ ........ ........ ........ 53% 233M 0s
125952K ........ ........ ........ ........ ........ ........ 55% 236M 0s
129024K ........ ........ ........ ........ ........ ........ 56% 237M 0s
132096K ........ ........ ........ ........ ........ ........ 57% 229M 0s
135168K ........ ........ ........ ........ ........ ........ 59% 237M 0s
138240K ........ ........ ........ ........ ........ ........ 60% 233M 0s
141312K ........ ........ ........ ........ ........ ........ 61% 233M 0s
144384K ........ ........ ........ ........ ........ ........ 62% 229M 0s
147456K ........ ........ ........ ........ ........ ........ 64% 231M 0s
150528K ........ ........ ........ ........ ........ ........ 65% 240M 0s
153600K ........ ........ ........ ........ ........ ........ 66% 254M 0s
156672K ........ ........ ........ ........ ........ ........ 68% 231M 0s
159744K ........ ........ ........ ........ ........ ........ 69% 245M 0s
162816K ........ ........ ........ ........ ........ ........ 70% 237M 0s
165888K ........ ........ ........ ........ ........ ........ 72% 276M 0s
168960K ........ ........ ........ ........ ........ ........ 73% 315M 0s
172032K ........ ........ ........ ........ ........ ........ 74% 263M 0s
175104K ........ ........ ........ ........ ........ ........ 76% 254M 0s
178176K ........ ........ ........ ........ ........ ........ 77% 238M 0s
181248K ........ ........ ........ ........ ........ ........ 78% 225M 0s
184320K ........ ........ ........ ........ ........ ........ 80% 233M 0s
187392K ........ ........ ........ ........ ........ ........ 81% 229M 0s
190464K ........ ........ ........ ........ ........ ........ 82% 229M 0s
193536K ........ ........ ........ ........ ........ ........ 83% 301M 0s
196608K ........ ........ ........ ........ ........ ........ 85% 237M 0s
199680K ........ ........ ........ ........ ........ ........ 86% 238M 0s
202752K ........ ........ ........ ........ ........ ........ 87% 236M 0s
205824K ........ ........ ........ ........ ........ ........ 89% 222M 0s
208896K ........ ........ ........ ........ ........ ........ 90% 233M 0s
211968K ........ ........ ........ ........ ........ ........ 91% 232M 0s
215040K ........ ........ ........ ........ ........ ........ 93% 224M 0s
218112K ........ ........ ........ ........ ........ ........ 94% 233M 0s
221184K ........ ........ ........ ........ ........ ........ 95% 242M 0s
224256K ........ ........ ........ ........ ........ ........ 97% 232M 0s
227328K ........ ........ ........ ........ ........ ........ 98% 236M 0s
230400K ........ ........ ........ ........ ........ ........ 99% 213M 0s
233472K ........ ... 100% 239M=1.0s
2026-01-18 23:51:25 (227 MB/s) - ‘karaf-0.21.4-20260118.212536-493.zip’ saved [239812769/239812769]
Extracting the new controller...
+ echo 'Extracting the new controller...'
+ unzip -q karaf-0.21.4-20260118.212536-493.zip
Adding external repositories...
+ echo 'Adding external repositories...'
+ sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
+ cat /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
################################################################################
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
################################################################################
#
# If set to true, the following property will not allow any certificate to be used
# when accessing Maven repositories through SSL
#
#org.ops4j.pax.url.mvn.certificateCheck=
#
# Path to the local Maven settings file.
# The repositories defined in this file will be automatically added to the list
# of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property
# below is not set.
# The following locations are checked for the existence of the settings.xml file
# * 1. looks for the specified url
# * 2. if not found looks for ${user.home}/.m2/settings.xml
# * 3. if not found looks for ${maven.home}/conf/settings.xml
# * 4. if not found looks for ${M2_HOME}/conf/settings.xml
#
#org.ops4j.pax.url.mvn.settings=
#
# Path to the local Maven repository which is used to avoid downloading
# artifacts when they already exist locally.
# The value of this property will be extracted from the settings.xml file
# above, or defaulted to:
# System.getProperty( "user.home" ) + "/.m2/repository"
#
org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository}
#
# Default this to false. It's just weird to use undocumented repos
#
org.ops4j.pax.url.mvn.useFallbackRepositories=false
#
# Uncomment if you don't wanna use the proxy settings
# from the Maven conf/settings.xml file
#
# org.ops4j.pax.url.mvn.proxySupport=false
#
# Comma separated list of repositories scanned when resolving an artifact.
# Those repositories will be checked before iterating through the
# below list of repositories and even before the local repository
# A repository url can be appended with zero or more of the following flags:
# @snapshots : the repository contains snaphots
# @noreleases : the repository does not contain any released artifacts
#
# The following property value will add the system folder as a repo.
#
org.ops4j.pax.url.mvn.defaultRepositories=\
file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\
file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\
file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots
# Use the default local repo (e.g.~/.m2/repository) as a "remote" repo
#org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false
#
# Comma separated list of repositories scanned when resolving an artifact.
# The default list includes the following repositories:
# http://repo1.maven.org/maven2@id=central
# http://repository.springsource.com/maven/bundles/release@id=spring.ebr
# http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external
# http://zodiac.springsource.com/maven/bundles/release@id=gemini
# http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases
# https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases
# https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
# To add repositories to the default ones, prepend '+' to the list of repositories
# to add.
# A repository url can be appended with zero or more of the following flags:
# @snapshots : the repository contains snapshots
# @noreleases : the repository does not contain any released artifacts
# @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended
#
org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.Configuring the startup features...
+ [[ True == \T\r\u\e ]]
+ echo 'Configuring the startup features...'
+ sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.21.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
+ FEATURE_TEST_STRING=features-test
+ FEATURE_TEST_VERSION=0.21.4-SNAPSHOT
+ KARAF_VERSION=karaf4
+ [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]]
+ sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.21.4-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.21.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
+ [[ ! -z '' ]]
+ cat /tmp/karaf-0.21.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
################################################################################
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
################################################################################
#
# Comma separated list of features repositories to register by default
#
featuresRepositories = mvn:org.opendaylight.integration/features-test/0.21.4-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/621a16f5-c371-43a1-9b25-87a911f24926.xml
#
# Comma separated list of features to install at startup
#
featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, 1029ce08-34fd-4a36-9164-491d0aaf782d
#
# Resource repositories (OBR) that the features resolver can use
# to resolve requirements/capabilities
#
# The format of the resourceRepositories is
# resourceRepositories=[xml:url|json:url],...
# for Instance:
#
#resourceRepositories=xml:http://host/path/to/index.xml
# or
#resourceRepositories=json:http://host/path/to/index.json
#
#
# Defines if the boot features are started in asynchronous mode (in a dedicated thread)
#
featuresBootAsynchronous=false
#
# Service requirements enforcement
#
# By default, the feature resolver checks the service requirements/capabilities of
# bundles for new features (xml schema >= 1.3.0) in order to automatically installs
# the required bundles.
# The following flag can have those values:
# - disable: service requirements are completely ignored
# - default: service requirements are ignored for old features
# - enforce: service requirements are always verified
#
#serviceRequirements=default
#
# Store cfg file for config element in feature
#
#configCfgStore=true
#
# Define if the feature service automatically refresh bundles
#
autoRefresh=true
#
# Configuration of features processing mechanism (overrides, blacklisting, modification of features)
# XML file defines instructions related to features processing
# versions.properties may declare properties to resolve placeholders in XML file
# both files are relative to ${karaf.etc}
#
#featureProcessing=org.apache.karaf.features.xml
#featureProcessingVersions=versions.properties
+ configure_karaf_log karaf4 ''
+ local -r karaf_version=karaf4
+ local -r controllerdebugmap=
+ local logapi=log4j
+ grep log4j2 /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
log4j2.rootLogger.level = INFO
#log4j2.rootLogger.type = asyncRoot
#log4j2.rootLogger.includeLocation = false
log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
log4j2.rootLogger.appenderRef.Console.ref = Console
log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
log4j2.logger.spifly.name = org.apache.aries.spifly
log4j2.logger.spifly.level = WARN
log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
log4j2.logger.audit.level = INFO
log4j2.logger.audit.additivity = false
log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
# Console appender not used by default (see log4j2.rootLogger.appenderRefs)
log4j2.appender.console.type = Console
log4j2.appender.console.name = Console
log4j2.appender.console.layout.type = PatternLayout
log4j2.appender.console.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.type = RollingRandomAccessFile
log4j2.appender.rolling.name = RollingFile
log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
#log4j2.appender.rolling.immediateFlush = false
log4j2.appender.rolling.append = true
log4j2.appender.rolling.layout.type = PatternLayout
log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.policies.type = Policies
log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.rolling.policies.size.size = 64MB
log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
log4j2.appender.rolling.strategy.max = 7
log4j2.appender.audit.type = RollingRandomAccessFile
log4j2.appender.audit.name = AuditRollingFile
log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
log4j2.appender.audit.append = true
log4j2.appender.audit.layout.type = PatternLayout
log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
log4j2.appender.audit.policies.type = Policies
log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.audit.policies.size.size = 8MB
log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
log4j2.appender.audit.strategy.max = 7
log4j2.appender.osgi.type = PaxOsgi
log4j2.appender.osgi.name = PaxOsgi
log4j2.appender.osgi.filter = *
#log4j2.logger.aether.name = shaded.org.eclipse.aether
#log4j2.logger.aether.level = TRACE
#log4j2.logger.http-headers.name = shaded.org.apache.http.headers
#log4j2.logger.http-headers.level = DEBUG
#log4j2.logger.maven.name = org.ops4j.pax.url.mvn
#log4j2.logger.maven.level = TRACE
Configuring the karaf log... karaf_version: karaf4, logapi: log4j2
+ logapi=log4j2
+ echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2'
+ '[' log4j2 == log4j2 ']'
+ sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
+ orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver
+ orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver
+ echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN'
+ echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN'
+ unset IFS
controllerdebugmap:
cat /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
+ echo 'controllerdebugmap: '
+ '[' -n '' ']'
+ echo 'cat /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg'
+ cat /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
################################################################################
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
################################################################################
# Common pattern layout for appenders
log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
# Root logger
log4j2.rootLogger.level = INFO
# uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library
#log4j2.rootLogger.type = asyncRoot
#log4j2.rootLogger.includeLocation = false
log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
log4j2.rootLogger.appenderRef.Console.ref = Console
log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
# Filters for logs marked by org.opendaylight.odlparent.Markers
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
# Loggers configuration
# Spifly logger
log4j2.logger.spifly.name = org.apache.aries.spifly
log4j2.logger.spifly.level = WARN
# Security audit logger
log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
log4j2.logger.audit.level = INFO
log4j2.logger.audit.additivity = false
log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
# Appenders configuration
# Console appender not used by default (see log4j2.rootLogger.appenderRefs)
log4j2.appender.console.type = Console
log4j2.appender.console.name = Console
log4j2.appender.console.layout.type = PatternLayout
log4j2.appender.console.layout.pattern = ${log4j2.pattern}
# Rolling file appender
log4j2.appender.rolling.type = RollingRandomAccessFile
log4j2.appender.rolling.name = RollingFile
log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
# uncomment to not force a disk flush
#log4j2.appender.rolling.immediateFlush = false
log4j2.appender.rolling.append = true
log4j2.appender.rolling.layout.type = PatternLayout
log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.policies.type = Policies
log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.rolling.policies.size.size = 1GB
log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
log4j2.appender.rolling.strategy.max = 7
# Audit file appender
log4j2.appender.audit.type = RollingRandomAccessFile
log4j2.appender.audit.name = AuditRollingFile
log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
log4j2.appender.audit.append = true
log4j2.appender.audit.layout.type = PatternLayout
log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
log4j2.appender.audit.policies.type = Policies
log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.audit.policies.size.size = 8MB
log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
log4j2.appender.audit.strategy.max = 7
# OSGi appender
log4j2.appender.osgi.type = PaxOsgi
log4j2.appender.osgi.name = PaxOsgi
log4j2.appender.osgi.filter = *
# help with identification of maven-related problems with pax-url-aether
#log4j2.logger.aether.name = shaded.org.eclipse.aether
#log4j2.logger.aether.level = TRACE
#log4j2.logger.http-headers.name = shaded.org.apache.http.headers
#log4j2.logger.http-headers.level = DEBUG
#log4j2.logger.maven.name = org.ops4j.pax.url.mvn
#log4j2.logger.maven.level = TRACE
log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN
log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN
+ set_java_vars /usr/lib/jvm/java-21-openjdk-amd64 3072m /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv
+ local -r java_home=/usr/lib/jvm/java-21-openjdk-amd64
+ local -r controllermem=3072m
+ local -r memconf=/tmp/karaf-0.21.4-SNAPSHOT/bin/setenv
Configure
java home: /usr/lib/jvm/java-21-openjdk-amd64
max memory: 3072m
memconf: /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv
+ echo Configure
+ echo ' java home: /usr/lib/jvm/java-21-openjdk-amd64'
+ echo ' max memory: 3072m'
+ echo ' memconf: /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv'
+ sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64}%g' /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv
+ sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv
cat /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv
+ echo 'cat /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv'
+ cat /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv
#!/bin/sh
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
#
# handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf
# script: client, instance, shell, start, status, stop, karaf
#
# if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then
# Actions go here...
# fi
#
# general settings which should be applied for all scripts go here; please keep
# in mind that it is possible that scripts might be executed more than once, e.g.
# in example of the start script where the start script is executed first and the
# karaf script afterwards.
#
#
# The following section shows the possible configuration options for the default
# karaf scripts
#
export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64} # Location of Java installation
# export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration
# export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options
# export EXTRA_JAVA_OPTS # Additional JVM options
# export KARAF_HOME # Karaf home folder
# export KARAF_DATA # Karaf data folder
# export KARAF_BASE # Karaf base folder
# export KARAF_ETC # Karaf etc folder
# export KARAF_LOG # Karaf log folder
# export KARAF_SYSTEM_OPTS # First citizen Karaf options
# export KARAF_OPTS # Additional available Karaf options
# export KARAF_DEBUG # Enable debug mode
# export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start
# export KARAF_NOROOT # Prevent execution as root if set to true
Set Java version
+ echo 'Set Java version'
+ sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-21-openjdk-amd64/bin/java 1
sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper
sudo: a password is required
+ sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-21-openjdk-amd64/bin/java
JDK default version ...
sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper
sudo: a password is required
+ echo 'JDK default version ...'
+ java -version
openjdk version "21.0.9" 2025-10-21
OpenJDK Runtime Environment (build 21.0.9+10-Ubuntu-122.04)
OpenJDK 64-Bit Server VM (build 21.0.9+10-Ubuntu-122.04, mixed mode, sharing)
Set JAVA_HOME
+ echo 'Set JAVA_HOME'
+ export JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64
+ JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64
++ readlink -e /usr/lib/jvm/java-21-openjdk-amd64/bin/java
Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java
Listing all open ports on controller system...
+ JAVA_RESOLVED=/usr/lib/jvm/java-21-openjdk-amd64/bin/java
+ echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java'
+ echo 'Listing all open ports on controller system...'
+ netstat -pnatu
/tmp/configuration-script.sh: line 40: netstat: command not found
Custom shard config exists!!!
Copying the shard config...
+ '[' -f /tmp/custom_shard_config.txt ']'
+ echo 'Custom shard config exists!!!'
+ echo 'Copying the shard config...'
+ cp /tmp/custom_shard_config.txt /tmp/karaf-0.21.4-SNAPSHOT/bin/
Configuring cluster
+ echo 'Configuring cluster'
+ /tmp/karaf-0.21.4-SNAPSHOT/bin/configure_cluster.sh 2 10.30.170.68 10.30.170.136 10.30.171.135
################################################
## Configure Cluster ##
################################################
NOTE: Cluster configuration files not found. Copying from
/tmp/karaf-0.21.4-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/10.0.14
Configuring unique name in akka.conf
Configuring hostname in akka.conf
Configuring data and rpc seed nodes in akka.conf
modules = [
{
name = "inventory"
namespace = "urn:opendaylight:inventory"
shard-strategy = "module"
},
{
name = "topology"
namespace = "urn:TBD:params:xml:ns:yang:network-topology"
shard-strategy = "module"
},
{
name = "toaster"
namespace = "http://netconfcentral.org/ns/toaster"
shard-strategy = "module"
},
{
name = "car"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
shard-strategy = "module"
},
{
name = "people"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
shard-strategy = "module"
},
{
name = "car-people"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
shard-strategy = "module"
}
]
Configuring replication type in module-shards.conf
################################################
## NOTE: Manually restart controller to ##
## apply configuration. ##
################################################
Dump akka.conf
+ echo 'Dump akka.conf'
+ cat /tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/akka.conf
odl-cluster-data {
akka {
remote {
artery {
enabled = on
transport = tcp
canonical.hostname = "10.30.170.136"
canonical.port = 2550
}
}
cluster {
# Using artery.
seed-nodes = ["akka://opendaylight-cluster-data@10.30.170.68:2550",
"akka://opendaylight-cluster-data@10.30.170.136:2550",
"akka://opendaylight-cluster-data@10.30.171.135:2550"]
roles = ["member-2"]
# when under load we might trip a false positive on the failure detector
# failure-detector {
# heartbeat-interval = 4 s
# acceptable-heartbeat-pause = 16s
# }
}
persistence {
# By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by
# modifying the following two properties. The directory location specified may be a relative or absolute path.
# The relative path is always relative to KARAF_HOME.
# snapshot-store.local.dir = "target/snapshots"
# Use lz4 compression for LocalSnapshotStore snapshots
snapshot-store.local.use-lz4-compression = false
# Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB
snapshot-store.local.lz4-blocksize = 256KB
}
disable-default-actor-system-quarantined-event-handling = "false"
}
}
Dump modules.conf
+ echo 'Dump modules.conf'
+ cat /tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/modules.conf
modules = [
{
name = "inventory"
namespace = "urn:opendaylight:inventory"
shard-strategy = "module"
},
{
name = "topology"
namespace = "urn:TBD:params:xml:ns:yang:network-topology"
shard-strategy = "module"
},
{
name = "toaster"
namespace = "http://netconfcentral.org/ns/toaster"
shard-strategy = "module"
},
{
name = "car"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
shard-strategy = "module"
},
{
name = "people"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
shard-strategy = "module"
},
{
name = "car-people"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
shard-strategy = "module"
}
]
Dump module-shards.conf
+ echo 'Dump module-shards.conf'
+ cat /tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/module-shards.conf
module-shards = [
{
name = "default"
shards = [
{
name = "default"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "inventory"
shards = [
{
name="inventory"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "topology"
shards = [
{
name="topology"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "toaster"
shards = [
{
name="toaster"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "car"
shards = [
{
name="car"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "people"
shards = [
{
name="people"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "car-people"
shards = [
{
name="car-people"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
}
]
Configuring member-3 with IP address 10.30.171.135
Warning: Permanently added '10.30.171.135' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.171.135' (ECDSA) to the list of known hosts.
+ source /tmp/common-functions.sh karaf-0.21.4-SNAPSHOT scandium
common-functions.sh is being sourced
++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]]
++ echo 'common-functions.sh is being sourced'
++ BUNDLEFOLDER=karaf-0.21.4-SNAPSHOT
++ DISTROSTREAM=scandium
++ export MAVENCONF=/tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
++ MAVENCONF=/tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
++ export FEATURESCONF=/tmp/karaf-0.21.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
++ FEATURESCONF=/tmp/karaf-0.21.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
++ export CUSTOMPROP=/tmp/karaf-0.21.4-SNAPSHOT/etc/custom.properties
++ CUSTOMPROP=/tmp/karaf-0.21.4-SNAPSHOT/etc/custom.properties
++ export LOGCONF=/tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
++ LOGCONF=/tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
++ export MEMCONF=/tmp/karaf-0.21.4-SNAPSHOT/bin/setenv
++ MEMCONF=/tmp/karaf-0.21.4-SNAPSHOT/bin/setenv
++ export CONTROLLERMEM=
++ CONTROLLERMEM=
++ case "${DISTROSTREAM}" in
++ CLUSTER_SYSTEM=akka
++ export AKKACONF=/tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/akka.conf
++ AKKACONF=/tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/akka.conf
++ export MODULESCONF=/tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/modules.conf
++ MODULESCONF=/tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/modules.conf
++ export MODULESHARDSCONF=/tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/module-shards.conf
++ MODULESHARDSCONF=/tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/module-shards.conf
++ print_common_env
++ cat
common-functions environment:
MAVENCONF: /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
ACTUALFEATURES:
FEATURESCONF: /tmp/karaf-0.21.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
CUSTOMPROP: /tmp/karaf-0.21.4-SNAPSHOT/etc/custom.properties
LOGCONF: /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
MEMCONF: /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv
CONTROLLERMEM:
AKKACONF: /tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/akka.conf
MODULESCONF: /tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/modules.conf
MODULESHARDSCONF: /tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/module-shards.conf
SUITES:
++ SSH='ssh -t -t'
++ extra_services_cntl=' dnsmasq.service httpd.service libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service rabbitmq-server.service '
++ extra_services_cmp=' libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service '
Changing to /tmp
+ echo 'Changing to /tmp'
+ cd /tmp
Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.4-SNAPSHOT/karaf-0.21.4-20260118.212536-493.zip
+ echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.4-SNAPSHOT/karaf-0.21.4-20260118.212536-493.zip'
+ wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.4-SNAPSHOT/karaf-0.21.4-20260118.212536-493.zip
--2026-01-18 23:51:27-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.4-SNAPSHOT/karaf-0.21.4-20260118.212536-493.zip
Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6
Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 239812769 (229M) [application/zip]
Saving to: ‘karaf-0.21.4-20260118.212536-493.zip’
0K ........ ........ ........ ........ ........ ........ 1% 69.2M 3s
3072K ........ ........ ........ ........ ........ ........ 2% 113M 3s
6144K ........ ........ ........ ........ ........ ........ 3% 182M 2s
9216K ........ ........ ........ ........ ........ ........ 5% 164M 2s
12288K ........ ........ ........ ........ ........ ........ 6% 173M 2s
15360K ........ ........ ........ ........ ........ ........ 7% 248M 2s
18432K ........ ........ ........ ........ ........ ........ 9% 294M 1s
21504K ........ ........ ........ ........ ........ ........ 10% 298M 1s
24576K ........ ........ ........ ........ ........ ........ 11% 299M 1s
27648K ........ ........ ........ ........ ........ ........ 13% 170M 1s
30720K ........ ........ ........ ........ ........ ........ 14% 245M 1s
33792K ........ ........ ........ ........ ........ ........ 15% 366M 1s
36864K ........ ........ ........ ........ ........ ........ 17% 326M 1s
39936K ........ ........ ........ ........ ........ ........ 18% 299M 1s
43008K ........ ........ ........ ........ ........ ........ 19% 353M 1s
46080K ........ ........ ........ ........ ........ ........ 20% 345M 1s
49152K ........ ........ ........ ........ ........ ........ 22% 319M 1s
52224K ........ ........ ........ ........ ........ ........ 23% 229M 1s
55296K ........ ........ ........ ........ ........ ........ 24% 281M 1s
58368K ........ ........ ........ ........ ........ ........ 26% 289M 1s
61440K ........ ........ ........ ........ ........ ........ 27% 251M 1s
64512K ........ ........ ........ ........ ........ ........ 28% 253M 1s
67584K ........ ........ ........ ........ ........ ........ 30% 300M 1s
70656K ........ ........ ........ ........ ........ ........ 31% 361M 1s
73728K ........ ........ ........ ........ ........ ........ 32% 367M 1s
76800K ........ ........ ........ ........ ........ ........ 34% 380M 1s
79872K ........ ........ ........ ........ ........ ........ 35% 350M 1s
82944K ........ ........ ........ ........ ........ ........ 36% 398M 1s
86016K ........ ........ ........ ........ ........ ........ 38% 370M 1s
89088K ........ ........ ........ ........ ........ ........ 39% 345M 1s
92160K ........ ........ ........ ........ ........ ........ 40% 335M 1s
95232K ........ ........ ........ ........ ........ ........ 41% 376M 1s
98304K ........ ........ ........ ........ ........ ........ 43% 346M 1s
101376K ........ ........ ........ ........ ........ ........ 44% 251M 1s
104448K ........ ........ ........ ........ ........ ........ 45% 265M 0s
107520K ........ ........ ........ ........ ........ ........ 47% 240M 0s
110592K ........ ........ ........ ........ ........ ........ 48% 246M 0s
113664K ........ ........ ........ ........ ........ ........ 49% 268M 0s
116736K ........ ........ ........ ........ ........ ........ 51% 289M 0s
119808K ........ ........ ........ ........ ........ ........ 52% 251M 0s
122880K ........ ........ ........ ........ ........ ........ 53% 254M 0s
125952K ........ ........ ........ ........ ........ ........ 55% 240M 0s
129024K ........ ........ ........ ........ ........ ........ 56% 273M 0s
132096K ........ ........ ........ ........ ........ ........ 57% 374M 0s
135168K ........ ........ ........ ........ ........ ........ 59% 371M 0s
138240K ........ ........ ........ ........ ........ ........ 60% 382M 0s
141312K ........ ........ ........ ........ ........ ........ 61% 294M 0s
144384K ........ ........ ........ ........ ........ ........ 62% 274M 0s
147456K ........ ........ ........ ........ ........ ........ 64% 257M 0s
150528K ........ ........ ........ ........ ........ ........ 65% 274M 0s
153600K ........ ........ ........ ........ ........ ........ 66% 359M 0s
156672K ........ ........ ........ ........ ........ ........ 68% 370M 0s
159744K ........ ........ ........ ........ ........ ........ 69% 382M 0s
162816K ........ ........ ........ ........ ........ ........ 70% 364M 0s
165888K ........ ........ ........ ........ ........ ........ 72% 404M 0s
168960K ........ ........ ........ ........ ........ ........ 73% 354M 0s
172032K ........ ........ ........ ........ ........ ........ 74% 394M 0s
175104K ........ ........ ........ ........ ........ ........ 76% 377M 0s
178176K ........ ........ ........ ........ ........ ........ 77% 348M 0s
181248K ........ ........ ........ ........ ........ ........ 78% 380M 0s
184320K ........ ........ ........ ........ ........ ........ 80% 361M 0s
187392K ........ ........ ........ ........ ........ ........ 81% 353M 0s
190464K ........ ........ ........ ........ ........ ........ 82% 161M 0s
193536K ........ ........ ........ ........ ........ ........ 83% 282M 0s
196608K ........ ........ ........ ........ ........ ........ 85% 368M 0s
199680K ........ ........ ........ ........ ........ ........ 86% 353M 0s
202752K ........ ........ ........ ........ ........ ........ 87% 363M 0s
205824K ........ ........ ........ ........ ........ ........ 89% 356M 0s
208896K ........ ........ ........ ........ ........ ........ 90% 354M 0s
211968K ........ ........ ........ ........ ........ ........ 91% 362M 0s
215040K ........ ........ ........ ........ ........ ........ 93% 364M 0s
218112K ........ ........ ........ ........ ........ ........ 94% 336M 0s
221184K ........ ........ ........ ........ ........ ........ 95% 396M 0s
224256K ........ ........ ........ ........ ........ ........ 97% 349M 0s
227328K ........ ........ ........ ........ ........ ........ 98% 367M 0s
230400K ........ ........ ........ ........ ........ ........ 99% 353M 0s
233472K ........ ... 100% 398M=0.8s
2026-01-18 23:51:28 (282 MB/s) - ‘karaf-0.21.4-20260118.212536-493.zip’ saved [239812769/239812769]
Extracting the new controller...
+ echo 'Extracting the new controller...'
+ unzip -q karaf-0.21.4-20260118.212536-493.zip
Adding external repositories...
+ echo 'Adding external repositories...'
+ sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
+ cat /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
################################################################################
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
################################################################################
#
# If set to true, the following property will not allow any certificate to be used
# when accessing Maven repositories through SSL
#
#org.ops4j.pax.url.mvn.certificateCheck=
#
# Path to the local Maven settings file.
# The repositories defined in this file will be automatically added to the list
# of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property
# below is not set.
# The following locations are checked for the existence of the settings.xml file
# * 1. looks for the specified url
# * 2. if not found looks for ${user.home}/.m2/settings.xml
# * 3. if not found looks for ${maven.home}/conf/settings.xml
# * 4. if not found looks for ${M2_HOME}/conf/settings.xml
#
#org.ops4j.pax.url.mvn.settings=
#
# Path to the local Maven repository which is used to avoid downloading
# artifacts when they already exist locally.
# The value of this property will be extracted from the settings.xml file
# above, or defaulted to:
# System.getProperty( "user.home" ) + "/.m2/repository"
#
org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository}
#
# Default this to false. It's just weird to use undocumented repos
#
org.ops4j.pax.url.mvn.useFallbackRepositories=false
#
# Uncomment if you don't wanna use the proxy settings
# from the Maven conf/settings.xml file
#
# org.ops4j.pax.url.mvn.proxySupport=false
#
# Comma separated list of repositories scanned when resolving an artifact.
# Those repositories will be checked before iterating through the
# below list of repositories and even before the local repository
# A repository url can be appended with zero or more of the following flags:
# @snapshots : the repository contains snaphots
# @noreleases : the repository does not contain any released artifacts
#
# The following property value will add the system folder as a repo.
#
org.ops4j.pax.url.mvn.defaultRepositories=\
file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\
file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\
file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots
# Use the default local repo (e.g.~/.m2/repository) as a "remote" repo
#org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false
#
# Comma separated list of repositories scanned when resolving an artifact.
# The default list includes the following repositories:
# http://repo1.maven.org/maven2@id=central
# http://repository.springsource.com/maven/bundles/release@id=spring.ebr
# http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external
# http://zodiac.springsource.com/maven/bundles/release@id=gemini
# http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases
# https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases
# https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
# To add repositories to the default ones, prepend '+' to the list of repositories
# to add.
# A repository url can be appended with zero or more of the following flags:
# @snapshots : the repository contains snapshots
# @noreleases : the repository does not contain any released artifacts
# @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended
#
org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.Configuring the startup features...
+ [[ True == \T\r\u\e ]]
+ echo 'Configuring the startup features...'
+ sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.21.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
+ FEATURE_TEST_STRING=features-test
+ FEATURE_TEST_VERSION=0.21.4-SNAPSHOT
+ KARAF_VERSION=karaf4
+ [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]]
+ sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.21.4-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.21.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
+ [[ ! -z '' ]]
+ cat /tmp/karaf-0.21.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
################################################################################
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
################################################################################
#
# Comma separated list of features repositories to register by default
#
featuresRepositories = mvn:org.opendaylight.integration/features-test/0.21.4-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/621a16f5-c371-43a1-9b25-87a911f24926.xml
#
# Comma separated list of features to install at startup
#
featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, 1029ce08-34fd-4a36-9164-491d0aaf782d
#
# Resource repositories (OBR) that the features resolver can use
# to resolve requirements/capabilities
#
# The format of the resourceRepositories is
# resourceRepositories=[xml:url|json:url],...
# for Instance:
#
#resourceRepositories=xml:http://host/path/to/index.xml
# or
#resourceRepositories=json:http://host/path/to/index.json
#
#
# Defines if the boot features are started in asynchronous mode (in a dedicated thread)
#
featuresBootAsynchronous=false
#
# Service requirements enforcement
#
# By default, the feature resolver checks the service requirements/capabilities of
# bundles for new features (xml schema >= 1.3.0) in order to automatically installs
# the required bundles.
# The following flag can have those values:
# - disable: service requirements are completely ignored
# - default: service requirements are ignored for old features
# - enforce: service requirements are always verified
#
#serviceRequirements=default
#
# Store cfg file for config element in feature
#
#configCfgStore=true
#
# Define if the feature service automatically refresh bundles
#
autoRefresh=true
#
# Configuration of features processing mechanism (overrides, blacklisting, modification of features)
# XML file defines instructions related to features processing
# versions.properties may declare properties to resolve placeholders in XML file
# both files are relative to ${karaf.etc}
#
#featureProcessing=org.apache.karaf.features.xml
#featureProcessingVersions=versions.properties
+ configure_karaf_log karaf4 ''
+ local -r karaf_version=karaf4
+ local -r controllerdebugmap=
+ local logapi=log4j
+ grep log4j2 /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
log4j2.rootLogger.level = INFO
#log4j2.rootLogger.type = asyncRoot
#log4j2.rootLogger.includeLocation = false
log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
log4j2.rootLogger.appenderRef.Console.ref = Console
log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
log4j2.logger.spifly.name = org.apache.aries.spifly
log4j2.logger.spifly.level = WARN
log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
log4j2.logger.audit.level = INFO
log4j2.logger.audit.additivity = false
log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
# Console appender not used by default (see log4j2.rootLogger.appenderRefs)
log4j2.appender.console.type = Console
log4j2.appender.console.name = Console
log4j2.appender.console.layout.type = PatternLayout
log4j2.appender.console.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.type = RollingRandomAccessFile
log4j2.appender.rolling.name = RollingFile
log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
#log4j2.appender.rolling.immediateFlush = false
log4j2.appender.rolling.append = true
log4j2.appender.rolling.layout.type = PatternLayout
log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.policies.type = Policies
log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.rolling.policies.size.size = 64MB
log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
log4j2.appender.rolling.strategy.max = 7
log4j2.appender.audit.type = RollingRandomAccessFile
log4j2.appender.audit.name = AuditRollingFile
log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
log4j2.appender.audit.append = true
log4j2.appender.audit.layout.type = PatternLayout
log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
log4j2.appender.audit.policies.type = Policies
log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.audit.policies.size.size = 8MB
log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
log4j2.appender.audit.strategy.max = 7
log4j2.appender.osgi.type = PaxOsgi
log4j2.appender.osgi.name = PaxOsgi
log4j2.appender.osgi.filter = *
#log4j2.logger.aether.name = shaded.org.eclipse.aether
#log4j2.logger.aether.level = TRACE
#log4j2.logger.http-headers.name = shaded.org.apache.http.headers
#log4j2.logger.http-headers.level = DEBUG
#log4j2.logger.maven.name = org.ops4j.pax.url.mvn
#log4j2.logger.maven.level = TRACE
Configuring the karaf log... karaf_version: karaf4, logapi: log4j2
+ logapi=log4j2
+ echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2'
+ '[' log4j2 == log4j2 ']'
+ sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
controllerdebugmap:
cat /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
+ orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver
+ orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver
+ echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN'
+ echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN'
+ unset IFS
+ echo 'controllerdebugmap: '
+ '[' -n '' ']'
+ echo 'cat /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg'
+ cat /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
################################################################################
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
################################################################################
# Common pattern layout for appenders
log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
# Root logger
log4j2.rootLogger.level = INFO
# uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library
#log4j2.rootLogger.type = asyncRoot
#log4j2.rootLogger.includeLocation = false
log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
log4j2.rootLogger.appenderRef.Console.ref = Console
log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
# Filters for logs marked by org.opendaylight.odlparent.Markers
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
# Loggers configuration
# Spifly logger
log4j2.logger.spifly.name = org.apache.aries.spifly
log4j2.logger.spifly.level = WARN
# Security audit logger
log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
log4j2.logger.audit.level = INFO
log4j2.logger.audit.additivity = false
log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
# Appenders configuration
# Console appender not used by default (see log4j2.rootLogger.appenderRefs)
log4j2.appender.console.type = Console
log4j2.appender.console.name = Console
log4j2.appender.console.layout.type = PatternLayout
log4j2.appender.console.layout.pattern = ${log4j2.pattern}
# Rolling file appender
log4j2.appender.rolling.type = RollingRandomAccessFile
log4j2.appender.rolling.name = RollingFile
log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
# uncomment to not force a disk flush
#log4j2.appender.rolling.immediateFlush = false
log4j2.appender.rolling.append = true
log4j2.appender.rolling.layout.type = PatternLayout
log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.policies.type = Policies
log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.rolling.policies.size.size = 1GB
log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
log4j2.appender.rolling.strategy.max = 7
# Audit file appender
log4j2.appender.audit.type = RollingRandomAccessFile
log4j2.appender.audit.name = AuditRollingFile
log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
log4j2.appender.audit.append = true
log4j2.appender.audit.layout.type = PatternLayout
log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
log4j2.appender.audit.policies.type = Policies
log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.audit.policies.size.size = 8MB
log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
log4j2.appender.audit.strategy.max = 7
# OSGi appender
log4j2.appender.osgi.type = PaxOsgi
log4j2.appender.osgi.name = PaxOsgi
log4j2.appender.osgi.filter = *
# help with identification of maven-related problems with pax-url-aether
#log4j2.logger.aether.name = shaded.org.eclipse.aether
#log4j2.logger.aether.level = TRACE
#log4j2.logger.http-headers.name = shaded.org.apache.http.headers
#log4j2.logger.http-headers.level = DEBUG
#log4j2.logger.maven.name = org.ops4j.pax.url.mvn
#log4j2.logger.maven.level = TRACE
log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN
log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN
+ set_java_vars /usr/lib/jvm/java-21-openjdk-amd64 3072m /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv
+ local -r java_home=/usr/lib/jvm/java-21-openjdk-amd64
+ local -r controllermem=3072m
Configure
+ local -r memconf=/tmp/karaf-0.21.4-SNAPSHOT/bin/setenv
+ echo Configure
java home: /usr/lib/jvm/java-21-openjdk-amd64
max memory: 3072m
memconf: /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv
+ echo ' java home: /usr/lib/jvm/java-21-openjdk-amd64'
+ echo ' max memory: 3072m'
+ echo ' memconf: /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv'
+ sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64}%g' /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv
+ sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv
cat /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv
+ echo 'cat /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv'
+ cat /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv
#!/bin/sh
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
#
# handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf
# script: client, instance, shell, start, status, stop, karaf
#
# if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then
# Actions go here...
# fi
#
# general settings which should be applied for all scripts go here; please keep
# in mind that it is possible that scripts might be executed more than once, e.g.
# in example of the start script where the start script is executed first and the
# karaf script afterwards.
#
#
# The following section shows the possible configuration options for the default
# karaf scripts
#
export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64} # Location of Java installation
# export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration
# export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options
# export EXTRA_JAVA_OPTS # Additional JVM options
# export KARAF_HOME # Karaf home folder
# export KARAF_DATA # Karaf data folder
# export KARAF_BASE # Karaf base folder
# export KARAF_ETC # Karaf etc folder
# export KARAF_LOG # Karaf log folder
# export KARAF_SYSTEM_OPTS # First citizen Karaf options
# export KARAF_OPTS # Additional available Karaf options
# export KARAF_DEBUG # Enable debug mode
# export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start
# export KARAF_NOROOT # Prevent execution as root if set to true
Set Java version
+ echo 'Set Java version'
+ sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-21-openjdk-amd64/bin/java 1
sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper
sudo: a password is required
+ sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-21-openjdk-amd64/bin/java
sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper
sudo: a password is required
JDK default version ...
+ echo 'JDK default version ...'
+ java -version
openjdk version "21.0.9" 2025-10-21
OpenJDK Runtime Environment (build 21.0.9+10-Ubuntu-122.04)
OpenJDK 64-Bit Server VM (build 21.0.9+10-Ubuntu-122.04, mixed mode, sharing)
Set JAVA_HOME
+ echo 'Set JAVA_HOME'
+ export JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64
+ JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64
++ readlink -e /usr/lib/jvm/java-21-openjdk-amd64/bin/java
Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java
Listing all open ports on controller system...
+ JAVA_RESOLVED=/usr/lib/jvm/java-21-openjdk-amd64/bin/java
+ echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java'
+ echo 'Listing all open ports on controller system...'
+ netstat -pnatu
/tmp/configuration-script.sh: line 40: netstat: command not found
Custom shard config exists!!!
Copying the shard config...
+ '[' -f /tmp/custom_shard_config.txt ']'
+ echo 'Custom shard config exists!!!'
+ echo 'Copying the shard config...'
+ cp /tmp/custom_shard_config.txt /tmp/karaf-0.21.4-SNAPSHOT/bin/
Configuring cluster
+ echo 'Configuring cluster'
+ /tmp/karaf-0.21.4-SNAPSHOT/bin/configure_cluster.sh 3 10.30.170.68 10.30.170.136 10.30.171.135
################################################
## Configure Cluster ##
################################################
NOTE: Cluster configuration files not found. Copying from
/tmp/karaf-0.21.4-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/10.0.14
Configuring unique name in akka.conf
Configuring hostname in akka.conf
Configuring data and rpc seed nodes in akka.conf
modules = [
{
name = "inventory"
namespace = "urn:opendaylight:inventory"
shard-strategy = "module"
},
{
name = "topology"
namespace = "urn:TBD:params:xml:ns:yang:network-topology"
shard-strategy = "module"
},
{
name = "toaster"
namespace = "http://netconfcentral.org/ns/toaster"
shard-strategy = "module"
},
{
name = "car"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
shard-strategy = "module"
},
{
name = "people"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
shard-strategy = "module"
},
{
name = "car-people"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
shard-strategy = "module"
}
]
Configuring replication type in module-shards.conf
################################################
## NOTE: Manually restart controller to ##
## apply configuration. ##
################################################
Dump akka.conf
+ echo 'Dump akka.conf'
+ cat /tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/akka.conf
odl-cluster-data {
akka {
remote {
artery {
enabled = on
transport = tcp
canonical.hostname = "10.30.171.135"
canonical.port = 2550
}
}
cluster {
# Using artery.
seed-nodes = ["akka://opendaylight-cluster-data@10.30.170.68:2550",
"akka://opendaylight-cluster-data@10.30.170.136:2550",
"akka://opendaylight-cluster-data@10.30.171.135:2550"]
roles = ["member-3"]
# when under load we might trip a false positive on the failure detector
# failure-detector {
# heartbeat-interval = 4 s
# acceptable-heartbeat-pause = 16s
# }
}
persistence {
# By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by
# modifying the following two properties. The directory location specified may be a relative or absolute path.
# The relative path is always relative to KARAF_HOME.
# snapshot-store.local.dir = "target/snapshots"
# Use lz4 compression for LocalSnapshotStore snapshots
snapshot-store.local.use-lz4-compression = false
# Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB
snapshot-store.local.lz4-blocksize = 256KB
}
disable-default-actor-system-quarantined-event-handling = "false"
}
}
Dump modules.conf
+ echo 'Dump modules.conf'
+ cat /tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/modules.conf
modules = [
{
name = "inventory"
namespace = "urn:opendaylight:inventory"
shard-strategy = "module"
},
{
name = "topology"
namespace = "urn:TBD:params:xml:ns:yang:network-topology"
shard-strategy = "module"
},
{
name = "toaster"
namespace = "http://netconfcentral.org/ns/toaster"
shard-strategy = "module"
},
{
name = "car"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
shard-strategy = "module"
},
{
name = "people"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
shard-strategy = "module"
},
{
name = "car-people"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
shard-strategy = "module"
}
]
+ echo 'Dump module-shards.conf'
Dump module-shards.conf
+ cat /tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/module-shards.conf
module-shards = [
{
name = "default"
shards = [
{
name = "default"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "inventory"
shards = [
{
name="inventory"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "topology"
shards = [
{
name="topology"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "toaster"
shards = [
{
name="toaster"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "car"
shards = [
{
name="car"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "people"
shards = [
{
name="people"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "car-people"
shards = [
{
name="car-people"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
}
]
Locating config plan to use...
Finished running config plans
Starting member-1 with IP address 10.30.170.68
Warning: Permanently added '10.30.170.68' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.170.68' (ECDSA) to the list of known hosts.
Redirecting karaf console output to karaf_console.log
Starting controller...
start: Redirecting Karaf output to /tmp/karaf-0.21.4-SNAPSHOT/data/log/karaf_console.log
Starting member-2 with IP address 10.30.170.136
Warning: Permanently added '10.30.170.136' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.170.136' (ECDSA) to the list of known hosts.
Redirecting karaf console output to karaf_console.log
Starting controller...
start: Redirecting Karaf output to /tmp/karaf-0.21.4-SNAPSHOT/data/log/karaf_console.log
Starting member-3 with IP address 10.30.171.135
Warning: Permanently added '10.30.171.135' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.171.135' (ECDSA) to the list of known hosts.
Redirecting karaf console output to karaf_console.log
Starting controller...
start: Redirecting Karaf output to /tmp/karaf-0.21.4-SNAPSHOT/data/log/karaf_console.log
[controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins10271203075876018360.sh
common-functions.sh is being sourced
common-functions environment:
MAVENCONF: /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
ACTUALFEATURES:
FEATURESCONF: /tmp/karaf-0.21.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
CUSTOMPROP: /tmp/karaf-0.21.4-SNAPSHOT/etc/custom.properties
LOGCONF: /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
MEMCONF: /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv
CONTROLLERMEM: 2048m
AKKACONF: /tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/akka.conf
MODULESCONF: /tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/modules.conf
MODULESHARDSCONF: /tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/module-shards.conf
SUITES:
+ echo '#################################################'
#################################################
+ echo '## Verify Cluster is UP ##'
## Verify Cluster is UP ##
+ echo '#################################################'
#################################################
+ create_post_startup_script
+ cat
+ copy_and_run_post_startup_script
+ seed_index=1
++ seq 1 3
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_1_IP
+ echo 'Execute the post startup script on controller 10.30.170.68'
Execute the post startup script on controller 10.30.170.68
+ scp /w/workspace/controller-csit-3node-clustering-tell-all-scandium/post-startup-script.sh 10.30.170.68:/tmp/
Warning: Permanently added '10.30.170.68' (ECDSA) to the list of known hosts.
+ ssh 10.30.170.68 'bash /tmp/post-startup-script.sh 1'
Warning: Permanently added '10.30.170.68' (ECDSA) to the list of known hosts.
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
Waiting up to 3 minutes for controller to come up, checking every 5 seconds...
2026-01-18T23:52:13,151 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 282 - org.opendaylight.infrautils.ready-api - 7.1.7 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
Controller is UP
2026-01-18T23:52:13,151 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 282 - org.opendaylight.infrautils.ready-api - 7.1.7 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
Listing all open ports on controller system...
/tmp/post-startup-script.sh: line 51: netstat: command not found
looking for "BindException: Address already in use" in log file
looking for "server is unhealthy" in log file
+ '[' 1 == 0 ']'
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_2_IP
+ echo 'Execute the post startup script on controller 10.30.170.136'
Execute the post startup script on controller 10.30.170.136
+ scp /w/workspace/controller-csit-3node-clustering-tell-all-scandium/post-startup-script.sh 10.30.170.136:/tmp/
Warning: Permanently added '10.30.170.136' (ECDSA) to the list of known hosts.
+ ssh 10.30.170.136 'bash /tmp/post-startup-script.sh 2'
Warning: Permanently added '10.30.170.136' (ECDSA) to the list of known hosts.
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
Waiting up to 3 minutes for controller to come up, checking every 5 seconds...
2026-01-18T23:52:13,317 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 282 - org.opendaylight.infrautils.ready-api - 7.1.7 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
Controller is UP
2026-01-18T23:52:13,317 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 282 - org.opendaylight.infrautils.ready-api - 7.1.7 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
Listing all open ports on controller system...
/tmp/post-startup-script.sh: line 51: netstat: command not found
looking for "BindException: Address already in use" in log file
looking for "server is unhealthy" in log file
+ '[' 2 == 0 ']'
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_3_IP
+ echo 'Execute the post startup script on controller 10.30.171.135'
Execute the post startup script on controller 10.30.171.135
+ scp /w/workspace/controller-csit-3node-clustering-tell-all-scandium/post-startup-script.sh 10.30.171.135:/tmp/
Warning: Permanently added '10.30.171.135' (ECDSA) to the list of known hosts.
+ ssh 10.30.171.135 'bash /tmp/post-startup-script.sh 3'
Warning: Permanently added '10.30.171.135' (ECDSA) to the list of known hosts.
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
Waiting up to 3 minutes for controller to come up, checking every 5 seconds...
2026-01-18T23:52:13,564 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 282 - org.opendaylight.infrautils.ready-api - 7.1.7 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
Controller is UP
2026-01-18T23:52:13,564 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 282 - org.opendaylight.infrautils.ready-api - 7.1.7 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
Listing all open ports on controller system...
/tmp/post-startup-script.sh: line 51: netstat: command not found
looking for "BindException: Address already in use" in log file
looking for "server is unhealthy" in log file
+ '[' 0 == 0 ']'
+ seed_index=1
+ dump_controller_threads
++ seq 1 3
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_1_IP
+ echo 'Let'\''s take the karaf thread dump'
Let's take the karaf thread dump
+ ssh 10.30.170.68 'sudo ps aux'
Warning: Permanently added '10.30.170.68' (ECDSA) to the list of known hosts.
++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-scandium/ps_before.log
++ grep -v grep
++ cut -f2 '-d '
++ tr -s ' '
+ pid=2088
+ echo 'karaf main: org.apache.karaf.main.Main, pid:2088'
karaf main: org.apache.karaf.main.Main, pid:2088
+ ssh 10.30.170.68 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 2088'
Warning: Permanently added '10.30.170.68' (ECDSA) to the list of known hosts.
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_2_IP
+ echo 'Let'\''s take the karaf thread dump'
Let's take the karaf thread dump
+ ssh 10.30.170.136 'sudo ps aux'
Warning: Permanently added '10.30.170.136' (ECDSA) to the list of known hosts.
++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-scandium/ps_before.log
++ grep -v grep
++ tr -s ' '
++ cut -f2 '-d '
+ pid=2094
+ echo 'karaf main: org.apache.karaf.main.Main, pid:2094'
karaf main: org.apache.karaf.main.Main, pid:2094
+ ssh 10.30.170.136 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 2094'
Warning: Permanently added '10.30.170.136' (ECDSA) to the list of known hosts.
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_3_IP
+ echo 'Let'\''s take the karaf thread dump'
Let's take the karaf thread dump
+ ssh 10.30.171.135 'sudo ps aux'
Warning: Permanently added '10.30.171.135' (ECDSA) to the list of known hosts.
++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-scandium/ps_before.log
++ grep -v grep
++ tr -s ' '
++ cut -f2 '-d '
+ pid=2097
+ echo 'karaf main: org.apache.karaf.main.Main, pid:2097'
karaf main: org.apache.karaf.main.Main, pid:2097
+ ssh 10.30.171.135 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 2097'
Warning: Permanently added '10.30.171.135' (ECDSA) to the list of known hosts.
+ '[' 0 -gt 0 ']'
+ echo 'Generating controller variables...'
Generating controller variables...
++ seq 1 3
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_1_IP
+ odl_variables=' -v ODL_SYSTEM_1_IP:10.30.170.68'
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_2_IP
+ odl_variables=' -v ODL_SYSTEM_1_IP:10.30.170.68 -v ODL_SYSTEM_2_IP:10.30.170.136'
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_3_IP
+ odl_variables=' -v ODL_SYSTEM_1_IP:10.30.170.68 -v ODL_SYSTEM_2_IP:10.30.170.136 -v ODL_SYSTEM_3_IP:10.30.171.135'
+ echo 'Generating mininet variables...'
Generating mininet variables...
++ seq 1 0
+ get_test_suites SUITES
+ local __suite_list=SUITES
+ echo 'Locating test plan to use...'
Locating test plan to use...
+ testplan_filepath=/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/testplans/controller-clustering-tell-scandium.txt
+ '[' '!' -f /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/testplans/controller-clustering-tell-scandium.txt ']'
+ testplan_filepath=/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/testplans/controller-clustering-tell.txt
+ '[' disabled '!=' disabled ']'
+ echo 'Changing the testplan path...'
Changing the testplan path...
+ sed s:integration:/w/workspace/controller-csit-3node-clustering-tell-all-scandium: /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/testplans/controller-clustering-tell.txt
+ cat testplan.txt
# Place the suites in run order:
# disabling all "prefix based" suites. This functionality was newly
# introduced with these tests in 2017. The assumption is that
# development stopped in that area, but may continue at a later
# time. Still, the tests are failing and no resources to solve the
# failures at this time. If/When this changes, we can uncomment
# those suites. Note that every suite is commented out with it's
# accompanying "restart_with_tell_based_true" setup suite.
# /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/ddb-sanity-prefix-based.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown_prefbasedshard.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement_prefbasedshard.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/leader_isolation_prefbasedshard.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/client_isolation.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/client_isolation_prefbasedshard.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/listener_stability.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/listener_stability_prefbasedshard.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/master_stability.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot
/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot
+ '[' -z '' ']'
++ grep -E -v '(^[[:space:]]*#|^[[:space:]]*$)' testplan.txt
++ tr '\012' ' '
+ suite_list='/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot '
+ eval 'SUITES='\''/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot '\'''
++ SUITES='/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot '
+ echo 'Starting Robot test suites /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot ...'
Starting Robot test suites /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot ...
+ robot -N controller-clustering-tell.txt --removekeywords wuks -e exclude -e skip_if_scandium -v BUNDLEFOLDER:karaf-0.21.4-SNAPSHOT -v BUNDLE_URL:https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.4-SNAPSHOT/karaf-0.21.4-20260118.212536-493.zip -v CONTROLLER:10.30.170.68 -v CONTROLLER1:10.30.170.136 -v CONTROLLER2:10.30.171.135 -v CONTROLLER_USER:jenkins -v JAVA_HOME:/usr/lib/jvm/java-21-openjdk-amd64 -v JDKVERSION:openjdk21 -v JENKINS_WORKSPACE:/w/workspace/controller-csit-3node-clustering-tell-all-scandium -v MININET: -v MININET1: -v MININET2: -v MININET_USER:jenkins -v NEXUSURL_PREFIX:https://nexus.opendaylight.org -v NUM_ODL_SYSTEM:3 -v NUM_TOOLS_SYSTEM:0 -v ODL_STREAM:scandium -v ODL_SYSTEM_IP:10.30.170.68 -v ODL_SYSTEM_1_IP:10.30.170.68 -v ODL_SYSTEM_2_IP:10.30.170.136 -v ODL_SYSTEM_3_IP:10.30.171.135 -v ODL_SYSTEM_USER:jenkins -v TOOLS_SYSTEM_IP: -v TOOLS_SYSTEM_USER:jenkins -v USER_HOME:/home/jenkins -v IS_KARAF_APPL:True -v WORKSPACE:/tmp /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot
==============================================================================
controller-clustering-tell.txt
==============================================================================
controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
==============================================================================
Stop_All_Members :: Stop every odl node. | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync. | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-tell.txt.Ddb-Sanity-Module-Based :: DOMDataBroker tes...
==============================================================================
Get_Shard_Role :: Get shard role. | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_ddb_sanity_module_based_get_shard_role"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_get_shard_role&order=bug_status"
HTTPError: 404 Client Error: Not Found for url: http://10.30.170.68:8181/restconf/operations/cluster-admin:get-shard-role
------------------------------------------------------------------------------
Subscribe_Listener_To_Leader :: Subscribe listener to leader. | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_ddb_sanity_module_based_subscribe_listener_to_leader"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_subscribe_listener_to_leader&order=bug_status"
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Subscribe_Listener_To_Follower :: Subscribe listener to follower. | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_ddb_sanity_module_based_subscribe_listener_to_follower"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_subscribe_listener_to_follower&order=bug_status"
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Make_Leader_Local :: Make the loeader local and verify. | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_ddb_sanity_module_based_make_leader_local"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_make_leader_local&order=bug_status"
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Remove_Leader_Shard_Replica_And_Add_It_Back :: Remove and add shar... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_ddb_sanity_module_based_remove_leader_shard_replica_and_add_it_back"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_remove_leader_shard_replica_and_add_it_back&order=bug_status"
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Remove_Follower_Shard_Replica_And_Add_It_Back :: Remove and add sh... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_ddb_sanity_module_based_remove_follower_shard_replica_and_add_it_back"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_remove_follower_shard_replica_and_add_it_back&order=bug_status"
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Write_Transactions_One_Node_Leader :: Write transactions. | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_one_node_leader"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_one_node_leader&order=bug_status"
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Write_Transactions_One_Node_Follower :: Write transactions. | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_one_node_follower"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_one_node_follower&order=bug_status"
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Write_Transactions_All_Nodes :: Write transactions. | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_all_nodes"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_all_nodes&order=bug_status"
Resolving variable '${response.text}' failed: AttributeError: 'ReadTimeout' object has no attribute 'text'
------------------------------------------------------------------------------
controller-clustering-tell.txt.Ddb-Sanity-Module-Based :: DOMDataB... | FAIL |
9 tests, 0 passed, 9 failed
==============================================================================
controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
==============================================================================
Stop_All_Members :: Stop every odl node. | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync. | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-tell.txt.Clean Leader Shutdown :: DOMDataBroker testi...
==============================================================================
Local_Leader_Shutdown :: Shutdown the leader on the same node as t... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_clean_leader_shutdown_local_leader_shutdown"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_clean_leader_shutdown_local_leader_shutdown&order=bug_status"
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Restart :: Restart odl | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_clean_leader_shutdown_restart"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_clean_leader_shutdown_restart&order=bug_status"
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Remote_Leader_Shutdown :: Shutdown the leader on different node as... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_clean_leader_shutdown_remote_leader_shutdown"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_clean_leader_shutdown_remote_leader_shutdown&order=bug_status"
ConnectionError: HTTPConnectionPool(host='10.30.170.68', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError("HTTPConnection(host='10.30.170.68', port=8181): Failed to establish a new connection: [Errno 111] Connection refused"))
------------------------------------------------------------------------------
controller-clustering-tell.txt.Clean Leader Shutdown :: DOMDataBro... | FAIL |
3 tests, 0 passed, 3 failed
==============================================================================
controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
==============================================================================
Stop_All_Members :: Stop every odl node. | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync. | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-tell.txt.Explicit Leader Movement :: DOMDataBroker te...
==============================================================================
Local_To_Remote_Movement :: Leader moves from local to remote node... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_explicit_leader_movement_local_to_remote_movement"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_local_to_remote_movement&order=bug_status"
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Restart1 :: Restart odl | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_explicit_leader_movement_restart1"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_restart1&order=bug_status"
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Remote_To_Remote_Movement :: Leader moves from one remote to other... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_explicit_leader_movement_remote_to_remote_movement"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_remote_to_remote_movement&order=bug_status"
ConnectionError: HTTPConnectionPool(host='10.30.170.68', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError("HTTPConnection(host='10.30.170.68', port=8181): Failed to establish a new connection: [Errno 111] Connection refused"))
------------------------------------------------------------------------------
Restart2 :: Restart odl | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_explicit_leader_movement_restart2"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_restart2&order=bug_status"
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Remote_To_Local_Movement :: Leader moves from remote to local node... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_explicit_leader_movement_remote_to_local_movement"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_remote_to_local_movement&order=bug_status"
ConnectionError: HTTPConnectionPool(host='10.30.170.68', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError("HTTPConnection(host='10.30.170.68', port=8181): Failed to establish a new connection: [Errno 111] Connection refused"))
------------------------------------------------------------------------------
controller-clustering-tell.txt.Explicit Leader Movement :: DOMData... | FAIL |
5 tests, 0 passed, 5 failed
==============================================================================
controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
==============================================================================
Stop_All_Members :: Stop every odl node. | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync. | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-tell.txt.Leader Isolation :: DOMDataBroker testing: L...
==============================================================================
Healing_Within_Request_Timeout :: The isolated node (leader) is re... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_leader_isolation_healing_within_request_timeout"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_leader_isolation_healing_within_request_timeout&order=bug_status"
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Restart :: Restart odl | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_leader_isolation_restart"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_leader_isolation_restart&order=bug_status"
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Healing_After_Request_Timeout :: The isolated node (leader) is rej... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_leader_isolation_healing_after_request_timeout"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_leader_isolation_healing_after_request_timeout&order=bug_status"
ConnectionError: HTTPConnectionPool(host='10.30.170.68', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError("HTTPConnection(host='10.30.170.68', port=8181): Failed to establish a new connection: [Errno 111] Connection refused"))
------------------------------------------------------------------------------
controller-clustering-tell.txt.Leader Isolation :: DOMDataBroker t... | FAIL |
3 tests, 0 passed, 3 failed
==============================================================================
controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
==============================================================================
Stop_All_Members :: Stop every odl node. | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync. | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-tell.txt.Client Isolation :: DOMDataBroker testing: C...
==============================================================================
Producer_On_Shard_Leader_Node_ChainedTx :: Client isolation with p... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_client_isolation_producer_on_shard_leader_node_chainedtx"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_producer_on_shard_leader_node_chainedtx&order=bug_status"
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=125.0)
Also keyword teardown failed:
Several failures occurred:
1) Variable '${client_node_dst}' not found.
2) Variable '${client_node_dst}' not found.
3) Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 1 minute 10 seconds. The last error was: Several failures occurred:
1) ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=125.0)
2) Resolving variable '${response.text}' failed: AttributeError: 'NoneType' object has no attribute 'text'
3) Resolving variable '${response.status_code}' failed: AttributeError: 'No...
[ Message content over the limit has been removed. ]
...se.text}' failed: AttributeError: 'NoneType' object has no attribute 'text'
66) Evaluating expression "json.loads('''None''')" failed: JSONDecodeError: Expecting value: line 1 column 1 (char 0)
67) ValueError: Argument 'dictionary' got value 'None' (None) that cannot be converted to Mapping.
68) ValueError: Argument 'dictionary' got value 'None' (None) that cannot be converted to Mapping.
69) Unrecognized Raft state: None
70) No leader found.
71) Too many Leaders.
72) IndexError: Given index 0 is out of the range 0--1.
4) KeyError: 'threads'
------------------------------------------------------------------------------
Restart1 :: Restart odl | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_client_isolation_restart1"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_restart1&order=bug_status"
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Producer_On_Shard_Leader_Node_SimpleTx :: Client isolation with pr... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_client_isolation_producer_on_shard_leader_node_simpletx"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_producer_on_shard_leader_node_simpletx&order=bug_status"
ConnectionError: HTTPConnectionPool(host='10.30.170.68', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError("HTTPConnection(host='10.30.170.68', port=8181): Failed to establish a new connection: [Errno 111] Connection refused"))
Also keyword teardown failed:
Several failures occurred:
1) Variable '${client_node_dst}' not found.
2) Variable '${client_node_dst}' not found.
3) Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 1 minute 10 seconds. The last error was: Several failures occurred:
1) ConnectionError: HTTPConnectionPool(host='10.30.170.68', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError("HTTPConnection(host='10.30.170.68', port=8181): Fa...
[ Message content over the limit has been removed. ]
...se.text}' failed: AttributeError: 'NoneType' object has no attribute 'text'
174) Evaluating expression "json.loads('''None''')" failed: JSONDecodeError: Expecting value: line 1 column 1 (char 0)
175) ValueError: Argument 'dictionary' got value 'None' (None) that cannot be converted to Mapping.
176) ValueError: Argument 'dictionary' got value 'None' (None) that cannot be converted to Mapping.
177) Unrecognized Raft state: None
178) No leader found.
179) Too many Leaders.
180) IndexError: Given index 0 is out of the range 0--1.
4) KeyError: 'threads'
------------------------------------------------------------------------------
Restart2 :: Restart odl | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_client_isolation_restart2"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_restart2&order=bug_status"
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Producer_On_Shard_Non_Leader_Node_ChainedTx :: Client isolation wi... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_client_isolation_producer_on_shard_non_leader_node_chainedtx"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_producer_on_shard_non_leader_node_chainedtx&order=bug_status"
ConnectionError: HTTPConnectionPool(host='10.30.170.68', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError("HTTPConnection(host='10.30.170.68', port=8181): Failed to establish a new connection: [Errno 111] Connection refused"))
Also keyword teardown failed:
Several failures occurred:
1) Variable '${client_node_dst}' not found.
2) Variable '${client_node_dst}' not found.
3) Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 1 minute 10 seconds. The last error was: Several failures occurred:
1) ConnectionError: HTTPConnectionPool(host='10.30.170.68', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError("HTTPConnection(host='10.30.170.68', port=8181): Fa...
[ Message content over the limit has been removed. ]
...se.text}' failed: AttributeError: 'NoneType' object has no attribute 'text'
174) Evaluating expression "json.loads('''None''')" failed: JSONDecodeError: Expecting value: line 1 column 1 (char 0)
175) ValueError: Argument 'dictionary' got value 'None' (None) that cannot be converted to Mapping.
176) ValueError: Argument 'dictionary' got value 'None' (None) that cannot be converted to Mapping.
177) Unrecognized Raft state: None
178) No leader found.
179) Too many Leaders.
180) IndexError: Given index 0 is out of the range 0--1.
4) KeyError: 'threads'
------------------------------------------------------------------------------
Restart3 :: Restart odl | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_client_isolation_restart3"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_restart3&order=bug_status"
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Producer_On_Shard_Non_Leader_Node_SimpleTx :: Client isolation wit... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_client_isolation_producer_on_shard_non_leader_node_simpletx"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_producer_on_shard_non_leader_node_simpletx&order=bug_status"
ConnectionError: HTTPConnectionPool(host='10.30.170.68', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError("HTTPConnection(host='10.30.170.68', port=8181): Failed to establish a new connection: [Errno 111] Connection refused"))
Also keyword teardown failed:
Several failures occurred:
1) Variable '${client_node_dst}' not found.
2) Variable '${client_node_dst}' not found.
3) Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 1 minute 10 seconds. The last error was: Several failures occurred:
1) ConnectionError: HTTPConnectionPool(host='10.30.170.68', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError("HTTPConnection(host='10.30.170.68', port=8181): Fa...
[ Message content over the limit has been removed. ]
...se.text}' failed: AttributeError: 'NoneType' object has no attribute 'text'
174) Evaluating expression "json.loads('''None''')" failed: JSONDecodeError: Expecting value: line 1 column 1 (char 0)
175) ValueError: Argument 'dictionary' got value 'None' (None) that cannot be converted to Mapping.
176) ValueError: Argument 'dictionary' got value 'None' (None) that cannot be converted to Mapping.
177) Unrecognized Raft state: None
178) No leader found.
179) Too many Leaders.
180) IndexError: Given index 0 is out of the range 0--1.
4) KeyError: 'threads'
------------------------------------------------------------------------------
controller-clustering-tell.txt.Client Isolation :: DOMDataBroker t... | FAIL |
7 tests, 0 passed, 7 failed
==============================================================================
controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
==============================================================================
Stop_All_Members :: Stop every odl node. | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync. | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-tell.txt.Listener Stability :: DOMDataBroker testing:...
==============================================================================
Move_Leader_From_Listener_Local_To_Remote :: Listener runs on lead... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_listener_stability_move_leader_from_listener_local_to_remote"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_listener_stability_move_leader_from_listener_local_to_remote&order=bug_status"
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Restart_1 :: Restart odl. | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_listener_stability_restart_1"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_listener_stability_restart_1&order=bug_status"
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Move_Leader_From_Listener_Remote_To_Other_Remote :: Listener runs ... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_listener_stability_move_leader_from_listener_remote_to_other_remote"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_listener_stability_move_leader_from_listener_remote_to_other_remote&order=bug_status"
ConnectionError: HTTPConnectionPool(host='10.30.170.68', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError("HTTPConnection(host='10.30.170.68', port=8181): Failed to establish a new connection: [Errno 111] Connection refused"))
------------------------------------------------------------------------------
Restart_2 :: Restart odl. | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_listener_stability_restart_2"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_listener_stability_restart_2&order=bug_status"
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Move_Leader_From_Listener_Remote_To_Local :: Listener runs on foll... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_listener_stability_move_leader_from_listener_remote_to_local"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_listener_stability_move_leader_from_listener_remote_to_local&order=bug_status"
ConnectionError: HTTPConnectionPool(host='10.30.170.68', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError("HTTPConnection(host='10.30.170.68', port=8181): Failed to establish a new connection: [Errno 111] Connection refused"))
------------------------------------------------------------------------------
controller-clustering-tell.txt.Listener Stability :: DOMDataBroker... | FAIL |
5 tests, 0 passed, 5 failed
==============================================================================
controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
==============================================================================
Stop_All_Members :: Stop every odl node. | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync. | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-tell.txt.Master Stability :: Cluster Singleton testin...
==============================================================================
Register_Singleton_Constant_On_Each_Node_And_Verify :: Register a ... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_master_stability_register_singleton_constant_on_each_node_and_verify"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_register_singleton_constant_on_each_node_and_verify&order=bug_status"
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Unregister_Singleton_Constant_On_Non_Master_Node :: Unregister the... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_master_stability_unregister_singleton_constant_on_non_master_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_unregister_singleton_constant_on_non_master_node&order=bug_status"
Variable '@{cs_candidates}' not found. Did you mean:
@{cs_exp_candidates}
------------------------------------------------------------------------------
Monitor_Stability_While_Unregistered :: Verify that the owner rema... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_master_stability_monitor_stability_while_unregistered"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_monitor_stability_while_unregistered&order=bug_status"
Variable '${cs_owner}' not found.
------------------------------------------------------------------------------
Reregister_Singleton_Constant :: Re-register the unregistered cand... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_master_stability_reregister_singleton_constant"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_reregister_singleton_constant&order=bug_status"
Variable '${unregistered_node}' not found.
------------------------------------------------------------------------------
Verify_Stability_After_Reregistration :: Verify that the owner rem... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_master_stability_verify_stability_after_reregistration"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_verify_stability_after_reregistration&order=bug_status"
Variable '${cs_owner}' not found.
------------------------------------------------------------------------------
Unregister_Singleton_Constant_On_Each_Node :: Unregister the appli... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_master_stability_unregister_singleton_constant_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_unregister_singleton_constant_on_each_node&order=bug_status"
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-tell.txt.Master Stability :: Cluster Singlet... | FAIL |
6 tests, 0 passed, 6 failed
==============================================================================
controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
==============================================================================
Stop_All_Members :: Stop every odl node. | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync. | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.136:8181/jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore
------------------------------------------------------------------------------
controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-tell.txt.Partition And Heal :: Cluster Singleton test...
==============================================================================
Register_Singleton_Constant_On_Each_Node :: Register a candidate a... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_partition_and_heal_register_singleton_constant_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_register_singleton_constant_on_each_node&order=bug_status"
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.136:8181/rests/operations/odl-mdsal-lowlevel-control:register-singleton-constant
------------------------------------------------------------------------------
Verify_Singleton_Constant_On_Each_Node :: Store the owner and cand... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_partition_and_heal_verify_singleton_constant_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_verify_singleton_constant_on_each_node&order=bug_status"
Could not parse owner and candidates for device get-singleton-constant-service']
------------------------------------------------------------------------------
Isolate_Owner_Node :: Isolate the cluster node which is the owner.... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_partition_and_heal_isolate_owner_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_isolate_owner_node&order=bug_status"
Variable '${cs_owner}' not found.
------------------------------------------------------------------------------
Monitor_Stability_While_Isolated :: Monitor the stability of the s... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_partition_and_heal_monitor_stability_while_isolated"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_monitor_stability_while_isolated&order=bug_status"
Invalid IF condition: Evaluating expression '"${index}" == "${cs_isolated_index}"' failed: Variable '${cs_isolated_index}' not found.
------------------------------------------------------------------------------
Rejoin_Isolated_node :: Rejoin isolated node. | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_partition_and_heal_rejoin_isolated_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_rejoin_isolated_node&order=bug_status"
Variable '${cs_isolated_index}' not found.
------------------------------------------------------------------------------
Unregister_Singleton_Constant_On_Each_Node :: Unregister the appli... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_partition_and_heal_unregister_singleton_constant_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_unregister_singleton_constant_on_each_node&order=bug_status"
ConnectionError: HTTPConnectionPool(host='10.30.170.136', port=8181): Max retries exceeded with url: /rests/operations/odl-mdsal-lowlevel-control:unregister-singleton-constant (Caused by NewConnectionError("HTTPConnection(host='10.30.170.136', port=8181): Failed to establish a new connection: [Errno 111] Connection refused"))
------------------------------------------------------------------------------
controller-clustering-tell.txt.Partition And Heal :: Cluster Singl... | FAIL |
6 tests, 0 passed, 6 failed
==============================================================================
controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
==============================================================================
Stop_All_Members :: Stop every odl node. | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync. | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-tell.txt.Chasing The Leader :: Cluster Singleton test...
==============================================================================
Register_Candidates :: Register a candidate application on each no... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_chasing_the_leader_register_candidates"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_chasing_the_leader_register_candidates&order=bug_status"
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Do_Nothing :: Do nothing for the time of the test duration, becaus... | PASS |
------------------------------------------------------------------------------
Unregister_Candidates_And_Validate_Criteria :: Unregister the test... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_chasing_the_leader_unregister_candidates_and_validate_criteria"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_chasing_the_leader_unregister_candidates_and_validate_criteria&order=bug_status"
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-tell.txt.Chasing The Leader :: Cluster Singl... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
==============================================================================
Stop_All_Members :: Stop every odl node. | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync. | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-tell.txt.Carpeople Crud :: Suite for performing basic...
==============================================================================
Add_Cars_To_Leader :: Add 30 cars to car Leader by one big PUT. | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
See_Added_Cars_On_Leader :: GET response from Leader should match ... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
See_Added_Cars_On_Followers :: The same check on other members. | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Add_People_To_First_Follower :: Add 30 people to people first Foll... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
See_Added_People_On_Leader :: GET response from Leader should matc... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
See_Added_People_On_Followers :: The same check on other members. | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Buy_Cars_On_Leader :: Buy some cars on car-people Leader, loop of ... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Buy_Cars_On_Followers :: On each Follower buy corresponding ID seg... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
See_Added_CarPeople_On_Leader :: GET car-person mappings from Lead... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
See_Added_CarPeople_On_Followers :: The same check on other members. | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Delete_All_CarPeople_On_Leader :: DELETE car-people container. No ... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Delete_All_People_On_Leader :: DELETE people container. No verific... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Delete_All_Cars_On_Leader :: DELETE cars container. No verificatio... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
controller-clustering-tell.txt.Carpeople Crud :: Suite for perform... | FAIL |
Suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
13 tests, 0 passed, 13 failed
==============================================================================
controller-clustering-tell.txt.Car Failover Crud :: Suite mixing basic oper...
==============================================================================
Add_Original_Cars_On_Old_Leader_And_Verify :: Add initial cars on ... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Stop_Original_Car_Leader :: Stop the car Leader to cause a new lea... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Wait_For_New_Leader :: Wait until new car Leader is elected. | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
See_Original_Cars_On_New_Leader :: GET cars from new Leader, shoul... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
See_Original_Cars_On_New_Followers :: The same check on other exis... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Delete_Original_Cars_On_New_Leader :: Delete cars on the new Leader. | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Add_Leader_Cars_On_New_Leader :: Add cars on the new Leader. | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
See_Leader_Cars_On_New_Leader :: GET cars from new Leader, should ... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
See_Leader_Cars_On_New_Followers :: The same check on other existi... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Delete_Leader_Cars_On_New_First_Follower :: Delete cars in new fir... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Add_Follower_Cars_On_New_First_Follower :: Add cars on the new fir... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
See_Folower_Cars_On_New_Leader :: Get cars from the new Leader, sh... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
See_Follower_Cars_On_New_Followers :: The same check on other exis... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Start_Old_Car_Leader :: Start the stopped member without deleting ... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
See_Folower_Cars_On_Old_Leader :: GET cars from the restarted memb... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Delete_Follower_Cars_On_New_Leader :: Delete cars on the last Leader. | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
controller-clustering-tell.txt.Car Failover Crud :: Suite mixing b... | FAIL |
Suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
16 tests, 0 passed, 16 failed
==============================================================================
controller-clustering-tell.txt.Car Persistence Recovery :: This test restar...
==============================================================================
Add_Cars_On_Leader_And_Verify :: Single big PUT to datastore to ad... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Stop_All_Members :: Stop all controllers. | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Start_All_Members :: Start all controllers (should restore the per... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Memorize_Leader_And_Followers :: Locate current Leader of car Shard. | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
See_Cars_On_Leader :: GET cars from Leader, should match the PUT d... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
See_Cars_On_Followers :: The same check on other members. | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Delete_Cars_On_Leader :: Delete cars on the new Leader. | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
controller-clustering-tell.txt.Car Persistence Recovery :: This te... | FAIL |
Suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
7 tests, 0 passed, 7 failed
==============================================================================
controller-clustering-tell.txt.Buycar Failover :: This test focuses on test...
==============================================================================
Add_Cars_To_Leader_And_Verify :: Add all needed cars to car Leader... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Add_People_To_First_Follower_And_Verify :: Add all needed people t... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Buy_Cars_On_Leader_And_Verify :: Buy some cars on the leader member. | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Buy_Cars_On_Follower_And_Verify :: Buy some cars on the first foll... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Reboot_People_Leader :: Previous people Leader is rebooted. We sho... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Buy_Cars_On_Leader_After_Reboot_And_Verify :: Buy some cars on the... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Buy_Cars_On_Follower_After_Reboot_And_Verify :: Buy some cars on t... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Delete_All_CarPeople :: DELETE car-people container. No verificati... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Delete_All_People :: DELETE people container. No verification beyo... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Delete_All_Cars :: DELETE cars container. No verification beyond h... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
controller-clustering-tell.txt.Buycar Failover :: This test focuse... | FAIL |
Suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
10 tests, 0 passed, 10 failed
==============================================================================
controller-clustering-tell.txt.Entity Isolate :: Suite for performing membe...
==============================================================================
Check All Shards Before Isolate :: Check all shards in controller. | FAIL |
Parent suite setup failed:
Evaluating expression 'json.loads(\'\'\'{\n "error": "javax.management.InstanceNotFoundException : org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "error_type": "javax.management.InstanceNotFoundException",\n "request": {\n "mbean": "org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "type": "read"\n },\n "stacktrace": "javax.management.InstanceNotFoundException: org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1073)\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1343)\\n\\tat java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:921)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:46)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:41)\\n\\tat org.jolokia.backend.executor.AbstractMBeanServerExecutor.call(AbstractMBeanServerExecutor.java:90)\\n\\tat org.jolokia.handler.ReadHandler.getMBeanInfo(ReadHandler.java:233)\\n\\tat org.jolokia.handler.ReadHandler.getAllAttributesNames(ReadHandler.java:245)\\n\\tat org.jolokia.handler.ReadHandler.resolveAttributes(ReadHandler.java:221)\\n\\tat org.jolokia.handler.ReadHandler.f...
[ Message content over the limit has been removed. ]
...lipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\\n\\tat org.eclipse.jetty.server.Server.handle(Server.java:516)\\n\\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)\\n\\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)\\n\\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)\\n\\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\\n\\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\\n\\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\\n\\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)\\n\\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\\n\\tat java.base/java.lang.Thread.run(Thread.java:1583)\\n",\n "status": 404\n}\n\'\'\')' failed: JSONDecodeError: Invalid control character at: line 8 column 190 (char 619)
------------------------------------------------------------------------------
Isolate Entity Leader :: Isolate the entity-ownership Leader to ca... | FAIL |
Parent suite setup failed:
Evaluating expression 'json.loads(\'\'\'{\n "error": "javax.management.InstanceNotFoundException : org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "error_type": "javax.management.InstanceNotFoundException",\n "request": {\n "mbean": "org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "type": "read"\n },\n "stacktrace": "javax.management.InstanceNotFoundException: org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1073)\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1343)\\n\\tat java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:921)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:46)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:41)\\n\\tat org.jolokia.backend.executor.AbstractMBeanServerExecutor.call(AbstractMBeanServerExecutor.java:90)\\n\\tat org.jolokia.handler.ReadHandler.getMBeanInfo(ReadHandler.java:233)\\n\\tat org.jolokia.handler.ReadHandler.getAllAttributesNames(ReadHandler.java:245)\\n\\tat org.jolokia.handler.ReadHandler.resolveAttributes(ReadHandler.java:221)\\n\\tat org.jolokia.handler.ReadHandler.f...
[ Message content over the limit has been removed. ]
...lipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\\n\\tat org.eclipse.jetty.server.Server.handle(Server.java:516)\\n\\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)\\n\\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)\\n\\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)\\n\\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\\n\\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\\n\\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\\n\\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)\\n\\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\\n\\tat java.base/java.lang.Thread.run(Thread.java:1583)\\n",\n "status": 404\n}\n\'\'\')' failed: JSONDecodeError: Invalid control character at: line 8 column 190 (char 619)
------------------------------------------------------------------------------
Check All Shards After Isolate :: Check all shards in controller. | FAIL |
Parent suite setup failed:
Evaluating expression 'json.loads(\'\'\'{\n "error": "javax.management.InstanceNotFoundException : org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "error_type": "javax.management.InstanceNotFoundException",\n "request": {\n "mbean": "org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "type": "read"\n },\n "stacktrace": "javax.management.InstanceNotFoundException: org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1073)\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1343)\\n\\tat java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:921)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:46)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:41)\\n\\tat org.jolokia.backend.executor.AbstractMBeanServerExecutor.call(AbstractMBeanServerExecutor.java:90)\\n\\tat org.jolokia.handler.ReadHandler.getMBeanInfo(ReadHandler.java:233)\\n\\tat org.jolokia.handler.ReadHandler.getAllAttributesNames(ReadHandler.java:245)\\n\\tat org.jolokia.handler.ReadHandler.resolveAttributes(ReadHandler.java:221)\\n\\tat org.jolokia.handler.ReadHandler.f...
[ Message content over the limit has been removed. ]
...lipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\\n\\tat org.eclipse.jetty.server.Server.handle(Server.java:516)\\n\\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)\\n\\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)\\n\\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)\\n\\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\\n\\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\\n\\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\\n\\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)\\n\\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\\n\\tat java.base/java.lang.Thread.run(Thread.java:1583)\\n",\n "status": 404\n}\n\'\'\')' failed: JSONDecodeError: Invalid control character at: line 8 column 190 (char 619)
------------------------------------------------------------------------------
Rejoin Entity Leader :: Rejoin the entity-ownership Leader. | FAIL |
Parent suite setup failed:
Evaluating expression 'json.loads(\'\'\'{\n "error": "javax.management.InstanceNotFoundException : org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "error_type": "javax.management.InstanceNotFoundException",\n "request": {\n "mbean": "org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "type": "read"\n },\n "stacktrace": "javax.management.InstanceNotFoundException: org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1073)\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1343)\\n\\tat java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:921)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:46)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:41)\\n\\tat org.jolokia.backend.executor.AbstractMBeanServerExecutor.call(AbstractMBeanServerExecutor.java:90)\\n\\tat org.jolokia.handler.ReadHandler.getMBeanInfo(ReadHandler.java:233)\\n\\tat org.jolokia.handler.ReadHandler.getAllAttributesNames(ReadHandler.java:245)\\n\\tat org.jolokia.handler.ReadHandler.resolveAttributes(ReadHandler.java:221)\\n\\tat org.jolokia.handler.ReadHandler.f...
[ Message content over the limit has been removed. ]
...lipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\\n\\tat org.eclipse.jetty.server.Server.handle(Server.java:516)\\n\\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)\\n\\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)\\n\\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)\\n\\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\\n\\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\\n\\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\\n\\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)\\n\\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\\n\\tat java.base/java.lang.Thread.run(Thread.java:1583)\\n",\n "status": 404\n}\n\'\'\')' failed: JSONDecodeError: Invalid control character at: line 8 column 190 (char 619)
------------------------------------------------------------------------------
Check All Shards After Rejoin :: Check all shards in controller. | FAIL |
Parent suite setup failed:
Evaluating expression 'json.loads(\'\'\'{\n "error": "javax.management.InstanceNotFoundException : org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "error_type": "javax.management.InstanceNotFoundException",\n "request": {\n "mbean": "org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "type": "read"\n },\n "stacktrace": "javax.management.InstanceNotFoundException: org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1073)\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1343)\\n\\tat java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:921)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:46)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:41)\\n\\tat org.jolokia.backend.executor.AbstractMBeanServerExecutor.call(AbstractMBeanServerExecutor.java:90)\\n\\tat org.jolokia.handler.ReadHandler.getMBeanInfo(ReadHandler.java:233)\\n\\tat org.jolokia.handler.ReadHandler.getAllAttributesNames(ReadHandler.java:245)\\n\\tat org.jolokia.handler.ReadHandler.resolveAttributes(ReadHandler.java:221)\\n\\tat org.jolokia.handler.ReadHandler.f...
[ Message content over the limit has been removed. ]
...lipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\\n\\tat org.eclipse.jetty.server.Server.handle(Server.java:516)\\n\\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)\\n\\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)\\n\\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)\\n\\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\\n\\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\\n\\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\\n\\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)\\n\\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\\n\\tat java.base/java.lang.Thread.run(Thread.java:1583)\\n",\n "status": 404\n}\n\'\'\')' failed: JSONDecodeError: Invalid control character at: line 8 column 190 (char 619)
------------------------------------------------------------------------------
controller-clustering-tell.txt.Entity Isolate :: Suite for perform... | FAIL |
Suite setup failed:
Evaluating expression 'json.loads(\'\'\'{\n "error": "javax.management.InstanceNotFoundException : org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "error_type": "javax.management.InstanceNotFoundException",\n "request": {\n "mbean": "org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "type": "read"\n },\n "stacktrace": "javax.management.InstanceNotFoundException: org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1073)\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1343)\\n\\tat java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:921)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:46)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:41)\\n\\tat org.jolokia.backend.executor.AbstractMBeanServerExecutor.call(AbstractMBeanServerExecutor.java:90)\\n\\tat org.jolokia.handler.ReadHandler.getMBeanInfo(ReadHandler.java:233)\\n\\tat org.jolokia.handler.ReadHandler.getAllAttributesNames(ReadHandler.java:245)\\n\\tat org.jolokia.handler.ReadHandler.resolveAttributes(ReadHandler.java:221)\\n\\tat org.jolokia.handler.ReadHandler.f...
[ Message content over the limit has been removed. ]
...lipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\\n\\tat org.eclipse.jetty.server.Server.handle(Server.java:516)\\n\\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)\\n\\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)\\n\\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)\\n\\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\\n\\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\\n\\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\\n\\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)\\n\\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\\n\\tat java.base/java.lang.Thread.run(Thread.java:1583)\\n",\n "status": 404\n}\n\'\'\')' failed: JSONDecodeError: Invalid control character at: line 8 column 190 (char 619)
5 tests, 0 passed, 5 failed
==============================================================================
controller-clustering-tell.txt.Buycar Failover Isolation :: This test focus...
==============================================================================
Add_Cars_To_Leader_And_Verify :: Add all needed cars to car Leader... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Add_People_To_First_Follower_And_Verify :: Add all needed people t... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Buy_Cars_On_Leader_And_Verify :: Buy some cars on the leader member. | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Buy_Cars_On_Follower_And_Verify :: Buy some cars on the first foll... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Isolate_and_Rejoin_People_Leader :: Previous people Leader is isol... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Buy_Cars_On_Leader_After_Rejoin_And_Verify :: Buy some cars on the... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Buy_Cars_On_Follower_After_Rejoin_And_Verify :: Buy some cars on t... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Delete_All_CarPeople :: DELETE car-people container. No verificati... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Delete_All_People :: DELETE people container. No verification beyo... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Delete_All_Cars :: DELETE cars container. No verification beyond h... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
controller-clustering-tell.txt.Buycar Failover Isolation :: This t... | FAIL |
Suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
10 tests, 0 passed, 10 failed
==============================================================================
controller-clustering-tell.txt.Car Failover Crud Isolation :: Suite mixing ...
==============================================================================
Add_Original_Cars_On_Old_Leader_And_Verify :: Add initial cars on ... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Isolate_Original_Car_Leader :: Isolate the car Leader to cause a n... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Wait_For_New_Leader :: Wait until new car Leader is elected. | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
See_Original_Cars_On_New_Leader :: GET cars from new Leader, shoul... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
See_Original_Cars_On_New_Followers :: The same check on other exis... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Delete_Original_Cars_On_New_Leader :: Delete cars on the new Leader. | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Add_Leader_Cars_On_New_Leader :: Add cars on the new Leader. | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
See_Leader_Cars_On_New_Leader :: GET cars from new Leader, should ... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
See_Leader_Cars_On_New_Followers :: The same check on other existi... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Delete_Leader_Cars_On_New_First_Follower :: Delete cars in new fir... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Add_Follower_Cars_On_New_First_Follower :: Add cars on the new fir... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
See_Folower_Cars_On_New_Leader :: Get cars from the new Leader, sh... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
See_Follower_Cars_On_New_Followers :: The same check on other exis... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Rejoin_Old_Car_Leader :: Rejoin the isolated member without deleti... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
See_Folower_Cars_On_Old_Leader :: GET cars from the restarted memb... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Delete_Follower_Cars_On_New_Leader :: Delete cars on the last Leader. | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
controller-clustering-tell.txt.Car Failover Crud Isolation :: Suit... | FAIL |
Suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
16 tests, 0 passed, 16 failed
==============================================================================
controller-clustering-tell.txt.Car Outage Corners :: Cluster suite for test...
==============================================================================
Stop_Majority_Of_The_Followers :: Stop half plus one car Follower ... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Attempt_To_Add_Cars_To_Leader :: Adding cars should fail, as major... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Start_Tipping_Follower :: Start one Follower member without persis... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Add_Cars_On_Tipping_Follower :: Add cars on the tipping Follower. | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
See_Cars_On_Existing_Members :: On each up member: GET cars, shoul... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Start_Other_Followers :: Start other followers without persisted d... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
See_Cars_On_New_Follower_Leader :: GET cars from a new follower to... | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
Delete_Cars_On_Leader :: Delete cars on Leader. | FAIL |
Parent suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
------------------------------------------------------------------------------
controller-clustering-tell.txt.Car Outage Corners :: Cluster suite... | FAIL |
Suite setup failed:
ReadTimeout: HTTPConnectionPool(host='10.30.171.135', port=8181): Read timed out. (read timeout=5.0)
8 tests, 0 passed, 8 failed
==============================================================================
controller-clustering-tell.txt | FAIL |
162 tests, 11 passed, 151 failed
==============================================================================
Output: /w/workspace/controller-csit-3node-clustering-tell-all-scandium/output.xml
Log: /w/workspace/controller-csit-3node-clustering-tell-all-scandium/log.html
Report: /w/workspace/controller-csit-3node-clustering-tell-all-scandium/report.html
+ true
+ echo 'Examining the files in data/log and checking filesize'
Examining the files in data/log and checking filesize
+ ssh 10.30.170.68 'ls -altr /tmp/karaf-0.21.4-SNAPSHOT/data/log/'
Warning: Permanently added '10.30.170.68' (ECDSA) to the list of known hosts.
total 14244
drwxrwxr-x 2 jenkins jenkins 4096 Jan 18 23:51 .
-rw-rw-r-- 1 jenkins jenkins 1720 Jan 18 23:51 karaf_console.log
drwxrwxr-x 9 jenkins jenkins 4096 Jan 19 05:23 ..
-rw-rw-r-- 1 jenkins jenkins 14566861 Jan 19 05:37 karaf.log
+ ssh 10.30.170.68 'du -hs /tmp/karaf-0.21.4-SNAPSHOT/data/log/*'
Warning: Permanently added '10.30.170.68' (ECDSA) to the list of known hosts.
14M /tmp/karaf-0.21.4-SNAPSHOT/data/log/karaf.log
4.0K /tmp/karaf-0.21.4-SNAPSHOT/data/log/karaf_console.log
+ ssh 10.30.170.136 'ls -altr /tmp/karaf-0.21.4-SNAPSHOT/data/log/'
Warning: Permanently added '10.30.170.136' (ECDSA) to the list of known hosts.
total 16280
drwxrwxr-x 2 jenkins jenkins 4096 Jan 18 23:51 .
-rw-rw-r-- 1 jenkins jenkins 1720 Jan 18 23:51 karaf_console.log
drwxrwxr-x 9 jenkins jenkins 4096 Jan 19 05:23 ..
-rw-rw-r-- 1 jenkins jenkins 16652124 Jan 19 05:37 karaf.log
+ ssh 10.30.170.136 'du -hs /tmp/karaf-0.21.4-SNAPSHOT/data/log/*'
Warning: Permanently added '10.30.170.136' (ECDSA) to the list of known hosts.
16M /tmp/karaf-0.21.4-SNAPSHOT/data/log/karaf.log
4.0K /tmp/karaf-0.21.4-SNAPSHOT/data/log/karaf_console.log
+ ssh 10.30.171.135 'ls -altr /tmp/karaf-0.21.4-SNAPSHOT/data/log/'
Warning: Permanently added '10.30.171.135' (ECDSA) to the list of known hosts.
total 11540
drwxrwxr-x 2 jenkins jenkins 4096 Jan 18 23:51 .
-rw-rw-r-- 1 jenkins jenkins 147569 Jan 19 00:01 karaf_console.log
drwxrwxr-x 5 jenkins jenkins 4096 Jan 19 05:23 ..
-rw-rw-r-- 1 jenkins jenkins 11649935 Jan 19 05:37 karaf.log
+ ssh 10.30.171.135 'du -hs /tmp/karaf-0.21.4-SNAPSHOT/data/log/*'
Warning: Permanently added '10.30.171.135' (ECDSA) to the list of known hosts.
12M /tmp/karaf-0.21.4-SNAPSHOT/data/log/karaf.log
148K /tmp/karaf-0.21.4-SNAPSHOT/data/log/karaf_console.log
+ set +e
++ seq 1 3
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_1_IP
+ echo 'Let'\''s take the karaf thread dump again'
Let's take the karaf thread dump again
+ ssh 10.30.170.68 'sudo ps aux'
Warning: Permanently added '10.30.170.68' (ECDSA) to the list of known hosts.
++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-scandium/ps_after.log
++ grep -v grep
++ cut -f2 '-d '
++ tr -s ' '
+ pid=29425
+ echo 'karaf main: org.apache.karaf.main.Main, pid:29425'
karaf main: org.apache.karaf.main.Main, pid:29425
+ ssh 10.30.170.68 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 29425'
Warning: Permanently added '10.30.170.68' (ECDSA) to the list of known hosts.
+ echo 'killing karaf process...'
killing karaf process...
+ ssh 10.30.170.68 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh'
Warning: Permanently added '10.30.170.68' (ECDSA) to the list of known hosts.
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_2_IP
+ echo 'Let'\''s take the karaf thread dump again'
Let's take the karaf thread dump again
+ ssh 10.30.170.136 'sudo ps aux'
Warning: Permanently added '10.30.170.136' (ECDSA) to the list of known hosts.
++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-scandium/ps_after.log
++ grep -v grep
++ tr -s ' '
++ cut -f2 '-d '
+ pid=37992
+ echo 'karaf main: org.apache.karaf.main.Main, pid:37992'
karaf main: org.apache.karaf.main.Main, pid:37992
+ ssh 10.30.170.136 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 37992'
Warning: Permanently added '10.30.170.136' (ECDSA) to the list of known hosts.
+ echo 'killing karaf process...'
killing karaf process...
+ ssh 10.30.170.136 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh'
Warning: Permanently added '10.30.170.136' (ECDSA) to the list of known hosts.
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_3_IP
+ echo 'Let'\''s take the karaf thread dump again'
Let's take the karaf thread dump again
+ ssh 10.30.171.135 'sudo ps aux'
Warning: Permanently added '10.30.171.135' (ECDSA) to the list of known hosts.
++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-scandium/ps_after.log
++ grep -v grep
++ cut -f2 '-d '
++ tr -s ' '
+ pid=2097
+ echo 'karaf main: org.apache.karaf.main.Main, pid:2097'
karaf main: org.apache.karaf.main.Main, pid:2097
+ ssh 10.30.171.135 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 2097'
Warning: Permanently added '10.30.171.135' (ECDSA) to the list of known hosts.
+ echo 'killing karaf process...'
killing karaf process...
+ ssh 10.30.171.135 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh'
Warning: Permanently added '10.30.171.135' (ECDSA) to the list of known hosts.
+ sleep 5
++ seq 1 3
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_1_IP
+ echo 'Compressing karaf.log 1'
Compressing karaf.log 1
+ ssh 10.30.170.68 gzip --best /tmp/karaf-0.21.4-SNAPSHOT/data/log/karaf.log
Warning: Permanently added '10.30.170.68' (ECDSA) to the list of known hosts.
+ echo 'Fetching compressed karaf.log 1'
Fetching compressed karaf.log 1
+ scp 10.30.170.68:/tmp/karaf-0.21.4-SNAPSHOT/data/log/karaf.log.gz odl1_karaf.log.gz
Warning: Permanently added '10.30.170.68' (ECDSA) to the list of known hosts.
+ ssh 10.30.170.68 rm -f /tmp/karaf-0.21.4-SNAPSHOT/data/log/karaf.log.gz
Warning: Permanently added '10.30.170.68' (ECDSA) to the list of known hosts.
+ scp 10.30.170.68:/tmp/karaf-0.21.4-SNAPSHOT/data/log/karaf_console.log odl1_karaf_console.log
Warning: Permanently added '10.30.170.68' (ECDSA) to the list of known hosts.
+ ssh 10.30.170.68 rm -f /tmp/karaf-0.21.4-SNAPSHOT/data/log/karaf_console.log
Warning: Permanently added '10.30.170.68' (ECDSA) to the list of known hosts.
+ echo 'Fetch GC logs'
Fetch GC logs
+ mkdir -p gclogs-1
+ scp '10.30.170.68:/tmp/karaf-0.21.4-SNAPSHOT/data/log/*.log' gclogs-1/
Warning: Permanently added '10.30.170.68' (ECDSA) to the list of known hosts.
scp: /tmp/karaf-0.21.4-SNAPSHOT/data/log/*.log: No such file or directory
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_2_IP
+ echo 'Compressing karaf.log 2'
Compressing karaf.log 2
+ ssh 10.30.170.136 gzip --best /tmp/karaf-0.21.4-SNAPSHOT/data/log/karaf.log
Warning: Permanently added '10.30.170.136' (ECDSA) to the list of known hosts.
+ echo 'Fetching compressed karaf.log 2'
Fetching compressed karaf.log 2
+ scp 10.30.170.136:/tmp/karaf-0.21.4-SNAPSHOT/data/log/karaf.log.gz odl2_karaf.log.gz
Warning: Permanently added '10.30.170.136' (ECDSA) to the list of known hosts.
+ ssh 10.30.170.136 rm -f /tmp/karaf-0.21.4-SNAPSHOT/data/log/karaf.log.gz
Warning: Permanently added '10.30.170.136' (ECDSA) to the list of known hosts.
+ scp 10.30.170.136:/tmp/karaf-0.21.4-SNAPSHOT/data/log/karaf_console.log odl2_karaf_console.log
Warning: Permanently added '10.30.170.136' (ECDSA) to the list of known hosts.
+ ssh 10.30.170.136 rm -f /tmp/karaf-0.21.4-SNAPSHOT/data/log/karaf_console.log
Warning: Permanently added '10.30.170.136' (ECDSA) to the list of known hosts.
+ echo 'Fetch GC logs'
Fetch GC logs
+ mkdir -p gclogs-2
+ scp '10.30.170.136:/tmp/karaf-0.21.4-SNAPSHOT/data/log/*.log' gclogs-2/
Warning: Permanently added '10.30.170.136' (ECDSA) to the list of known hosts.
scp: /tmp/karaf-0.21.4-SNAPSHOT/data/log/*.log: No such file or directory
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_3_IP
+ echo 'Compressing karaf.log 3'
Compressing karaf.log 3
+ ssh 10.30.171.135 gzip --best /tmp/karaf-0.21.4-SNAPSHOT/data/log/karaf.log
Warning: Permanently added '10.30.171.135' (ECDSA) to the list of known hosts.
+ echo 'Fetching compressed karaf.log 3'
Fetching compressed karaf.log 3
+ scp 10.30.171.135:/tmp/karaf-0.21.4-SNAPSHOT/data/log/karaf.log.gz odl3_karaf.log.gz
Warning: Permanently added '10.30.171.135' (ECDSA) to the list of known hosts.
+ ssh 10.30.171.135 rm -f /tmp/karaf-0.21.4-SNAPSHOT/data/log/karaf.log.gz
Warning: Permanently added '10.30.171.135' (ECDSA) to the list of known hosts.
+ scp 10.30.171.135:/tmp/karaf-0.21.4-SNAPSHOT/data/log/karaf_console.log odl3_karaf_console.log
Warning: Permanently added '10.30.171.135' (ECDSA) to the list of known hosts.
+ ssh 10.30.171.135 rm -f /tmp/karaf-0.21.4-SNAPSHOT/data/log/karaf_console.log
Warning: Permanently added '10.30.171.135' (ECDSA) to the list of known hosts.
+ echo 'Fetch GC logs'
Fetch GC logs
+ mkdir -p gclogs-3
+ scp '10.30.171.135:/tmp/karaf-0.21.4-SNAPSHOT/data/log/*.log' gclogs-3/
Warning: Permanently added '10.30.171.135' (ECDSA) to the list of known hosts.
scp: /tmp/karaf-0.21.4-SNAPSHOT/data/log/*.log: No such file or directory
+ echo 'Examine copied files'
Examine copied files
+ ls -lt
total 74624
drwxrwxr-x. 2 jenkins jenkins 6 Jan 19 05:38 gclogs-3
-rw-rw-r--. 1 jenkins jenkins 147569 Jan 19 05:38 odl3_karaf_console.log
-rw-rw-r--. 1 jenkins jenkins 400730 Jan 19 05:38 odl3_karaf.log.gz
drwxrwxr-x. 2 jenkins jenkins 6 Jan 19 05:38 gclogs-2
-rw-rw-r--. 1 jenkins jenkins 1720 Jan 19 05:38 odl2_karaf_console.log
-rw-rw-r--. 1 jenkins jenkins 666915 Jan 19 05:38 odl2_karaf.log.gz
drwxrwxr-x. 2 jenkins jenkins 6 Jan 19 05:38 gclogs-1
-rw-rw-r--. 1 jenkins jenkins 1720 Jan 19 05:38 odl1_karaf_console.log
-rw-rw-r--. 1 jenkins jenkins 854235 Jan 19 05:38 odl1_karaf.log.gz
-rw-rw-r--. 1 jenkins jenkins 147246 Jan 19 05:38 karaf_3_2097_threads_after.log
-rw-rw-r--. 1 jenkins jenkins 13546 Jan 19 05:38 ps_after.log
-rw-rw-r--. 1 jenkins jenkins 128845 Jan 19 05:38 karaf_2_37992_threads_after.log
-rw-rw-r--. 1 jenkins jenkins 127545 Jan 19 05:38 karaf_1_29425_threads_after.log
-rw-rw-r--. 1 jenkins jenkins 307570 Jan 19 05:38 report.html
-rw-rw-r--. 1 jenkins jenkins 3936783 Jan 19 05:38 log.html
-rw-rw-r--. 1 jenkins jenkins 69226921 Jan 19 05:37 output.xml
-rw-rw-r--. 1 jenkins jenkins 6069 Jan 18 23:54 testplan.txt
-rw-rw-r--. 1 jenkins jenkins 111444 Jan 18 23:54 karaf_3_2097_threads_before.log
-rw-rw-r--. 1 jenkins jenkins 13798 Jan 18 23:54 ps_before.log
-rw-rw-r--. 1 jenkins jenkins 109930 Jan 18 23:54 karaf_2_2094_threads_before.log
-rw-rw-r--. 1 jenkins jenkins 113545 Jan 18 23:54 karaf_1_2088_threads_before.log
-rw-rw-r--. 1 jenkins jenkins 3106 Jan 18 23:51 post-startup-script.sh
-rw-rw-r--. 1 jenkins jenkins 252 Jan 18 23:51 startup-script.sh
-rw-rw-r--. 1 jenkins jenkins 3471 Jan 18 23:51 configuration-script.sh
-rw-rw-r--. 1 jenkins jenkins 695 Jan 18 23:51 custom_shard_config.txt
-rw-rw-r--. 1 jenkins jenkins 136 Jan 18 23:51 scriptplan.txt
-rw-rw-r--. 1 jenkins jenkins 337 Jan 18 23:51 detect_variables.env
-rw-rw-r--. 1 jenkins jenkins 2619 Jan 18 23:51 pom.xml
-rw-rw-r--. 1 jenkins jenkins 92 Jan 18 23:51 set_variables.env
-rw-rw-r--. 1 jenkins jenkins 312 Jan 18 23:51 slave_addresses.txt
-rw-rw-r--. 1 jenkins jenkins 570 Jan 18 23:50 requirements.txt
-rw-rw-r--. 1 jenkins jenkins 26 Jan 18 23:50 env.properties
-rw-rw-r--. 1 jenkins jenkins 333 Jan 18 23:48 stack-parameters.yaml
drwxrwxr-x. 7 jenkins jenkins 4096 Jan 18 23:47 test
drwxrwxr-x. 2 jenkins jenkins 6 Jan 18 23:47 test@tmp
-rw-rw-r--. 1 jenkins jenkins 1410 Jan 18 21:25 maven-metadata.xml
+ true
[controller-csit-3node-clustering-tell-all-scandium] $ /bin/sh /tmp/jenkins15367863756501283929.sh
Cleaning up Robot installation...
$ ssh-agent -k
unset SSH_AUTH_SOCK;
unset SSH_AGENT_PID;
echo Agent pid 5289 killed;
[ssh-agent] Stopped.
Recording plot data
Robot results publisher started...
INFO: Checking test criticality is deprecated and will be dropped in a future release!
-Parsing output xml:
Done!
-Copying log files to build dir:
Done!
-Assigning results to build:
Done!
-Checking thresholds:
Done!
Done publishing Robot results.
Build step 'Publish Robot Framework test results' changed build result to UNSTABLE
[PostBuildScript] - [INFO] Executing post build scripts.
[controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins17762098425567380291.sh
Archiving csit artifacts
mv: cannot stat '*_1.png': No such file or directory
mv: cannot stat '/tmp/odl1_*': No such file or directory
mv: cannot stat '*_2.png': No such file or directory
mv: cannot stat '/tmp/odl2_*': No such file or directory
mv: cannot stat '*_3.png': No such file or directory
mv: cannot stat '/tmp/odl3_*': No such file or directory
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
100 104k 0 104k 0 0 2122k 0 --:--:-- --:--:-- --:--:-- 2080k
100 5160k 0 5160k 0 0 4914k 0 --:--:-- 0:00:01 --:--:-- 4909k
100 5596k 0 5596k 0 0 5051k 0 --:--:-- 0:00:01 --:--:-- 5046k
Archive: robot-plugin.zip
inflating: ./archives/robot-plugin/log.html
inflating: ./archives/robot-plugin/output.xml
inflating: ./archives/robot-plugin/report.html
mv: cannot stat '*.log.gz': No such file or directory
mv: cannot stat '*.csv': No such file or directory
mv: cannot stat '*.png': No such file or directory
[PostBuildScript] - [INFO] Executing post build scripts.
[controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins7077840780867416666.sh
[PostBuildScript] - [INFO] Executing post build scripts.
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties content
OS_CLOUD=vex
OS_STACK_NAME=releng-controller-csit-3node-clustering-tell-all-scandium-90
[EnvInject] - Variables injected successfully.
provisioning config files...
copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
[controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins14271614508640384501.sh
---> openstack-stack-delete.sh
Setup pyenv:
system
3.8.13
3.9.13
3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-U8VX from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
lf-activate-venv(): INFO: Attempting to install with network-safe options...
lf-activate-venv(): INFO: Base packages installed successfully
lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes python-heatclient python-openstackclient urllib3~=1.26.15
lf-activate-venv(): INFO: Adding /tmp/venv-U8VX/bin to PATH
INFO: Stack cost retrieval disabled, setting cost to 0
INFO: Deleting stack releng-controller-csit-3node-clustering-tell-all-scandium-90
Successfully deleted stack releng-controller-csit-3node-clustering-tell-all-scandium-90
[PostBuildScript] - [INFO] Executing post build scripts.
[controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins15053196674804391944.sh
---> sysstat.sh
[controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins4502138277311013277.sh
---> package-listing.sh
++ facter osfamily
++ tr '[:upper:]' '[:lower:]'
+ OS_FAMILY=redhat
+ workspace=/w/workspace/controller-csit-3node-clustering-tell-all-scandium
+ START_PACKAGES=/tmp/packages_start.txt
+ END_PACKAGES=/tmp/packages_end.txt
+ DIFF_PACKAGES=/tmp/packages_diff.txt
+ PACKAGES=/tmp/packages_start.txt
+ '[' /w/workspace/controller-csit-3node-clustering-tell-all-scandium ']'
+ PACKAGES=/tmp/packages_end.txt
+ case "${OS_FAMILY}" in
+ rpm -qa
+ sort
+ '[' -f /tmp/packages_start.txt ']'
+ '[' -f /tmp/packages_end.txt ']'
+ diff /tmp/packages_start.txt /tmp/packages_end.txt
+ '[' /w/workspace/controller-csit-3node-clustering-tell-all-scandium ']'
+ mkdir -p /w/workspace/controller-csit-3node-clustering-tell-all-scandium/archives/
+ cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/controller-csit-3node-clustering-tell-all-scandium/archives/
[controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins2002789664544831117.sh
---> capture-instance-metadata.sh
Setup pyenv:
system
3.8.13
3.9.13
3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-U8VX from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
lf-activate-venv(): INFO: Attempting to install with network-safe options...
lf-activate-venv(): INFO: Base packages installed successfully
lf-activate-venv(): INFO: Installing additional packages: lftools
lf-activate-venv(): INFO: Adding /tmp/venv-U8VX/bin to PATH
INFO: Running in OpenStack, capturing instance metadata
[controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins13575634339066748617.sh
provisioning config files...
Could not find credentials [logs] for controller-csit-3node-clustering-tell-all-scandium #90
copy managed file [jenkins-log-archives-settings] to file:/w/workspace/controller-csit-3node-clustering-tell-all-scandium@tmp/config14921708705435702714tmp
Regular expression run condition: Expression=[^.*logs-s3.*], Label=[odl-logs-s3-cloudfront-index]
Run condition [Regular expression match] enabling perform for step [Provide Configuration files]
provisioning config files...
copy managed file [jenkins-s3-log-ship] to file:/home/jenkins/.aws/credentials
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties content
SERVER_ID=logs
[EnvInject] - Variables injected successfully.
[controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins10908683133934733301.sh
---> create-netrc.sh
WARN: Log server credential not found.
[controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins10891973885142175330.sh
---> python-tools-install.sh
Setup pyenv:
system
3.8.13
3.9.13
3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-U8VX from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
lf-activate-venv(): INFO: Attempting to install with network-safe options...
lf-activate-venv(): INFO: Base packages installed successfully
lf-activate-venv(): INFO: Installing additional packages: lftools
lf-activate-venv(): INFO: Adding /tmp/venv-U8VX/bin to PATH
[controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins17137444293829715904.sh
---> sudo-logs.sh
Archiving 'sudo' log..
[controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins15735195006724506857.sh
---> job-cost.sh
Setup pyenv:
system
3.8.13
3.9.13
3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-U8VX from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
lf-activate-venv(): INFO: Attempting to install with network-safe options...
lf-activate-venv(): INFO: Base packages installed successfully
lf-activate-venv(): INFO: Installing additional packages: zipp==1.1.0 python-openstackclient urllib3~=1.26.15
lf-activate-venv(): INFO: Adding /tmp/venv-U8VX/bin to PATH
DEBUG: total: 0
INFO: Retrieving Stack Cost...
INFO: Retrieving Pricing Info for: v3-standard-2
INFO: Archiving Costs
[controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash -l /tmp/jenkins5687982721536687505.sh
---> logs-deploy.sh
Setup pyenv:
system
3.8.13
3.9.13
3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-U8VX from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
lf-activate-venv(): INFO: Attempting to install with network-safe options...
lf-activate-venv(): INFO: Base packages installed successfully
lf-activate-venv(): INFO: Installing additional packages: lftools urllib3~=1.26.15
lf-activate-venv(): INFO: Adding /tmp/venv-U8VX/bin to PATH
WARNING: Nexus logging server not set
INFO: S3 path logs/releng/vex-yul-odl-jenkins-1/controller-csit-3node-clustering-tell-all-scandium/90/
INFO: archiving logs to S3
---> uname -a:
Linux prd-centos8-robot-2c-8g-1820.novalocal 4.18.0-553.5.1.el8.x86_64 #1 SMP Tue May 21 05:46:01 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
---> lscpu:
Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Byte Order: Little Endian
CPU(s): 2
On-line CPU(s) list: 0,1
Thread(s) per core: 1
Core(s) per socket: 1
Socket(s): 2
NUMA node(s): 1
Vendor ID: AuthenticAMD
CPU family: 23
Model: 49
Model name: AMD EPYC-Rome Processor
Stepping: 0
CPU MHz: 2799.998
BogoMIPS: 5599.99
Virtualization: AMD-V
Hypervisor vendor: KVM
Virtualization type: full
L1d cache: 32K
L1i cache: 32K
L2 cache: 512K
L3 cache: 16384K
NUMA node0 CPU(s): 0,1
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities
---> nproc:
2
---> df -h:
Filesystem Size Used Avail Use% Mounted on
devtmpfs 3.8G 0 3.8G 0% /dev
tmpfs 3.8G 0 3.8G 0% /dev/shm
tmpfs 3.8G 25M 3.8G 1% /run
tmpfs 3.8G 0 3.8G 0% /sys/fs/cgroup
/dev/vda1 40G 8.5G 32G 22% /
tmpfs 770M 0 770M 0% /run/user/1001
---> free -m:
total used free shared buff/cache available
Mem: 7697 656 4681 27 2360 6734
Swap: 1023 0 1023
---> ip addr:
1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
inet 127.0.0.1/8 scope host lo
valid_lft forever preferred_lft forever
inet6 ::1/128 scope host
valid_lft forever preferred_lft forever
2: eth0: mtu 1458 qdisc mq state UP group default qlen 1000
link/ether fa:16:3e:9e:e8:60 brd ff:ff:ff:ff:ff:ff
altname enp0s3
altname ens3
inet 10.30.171.131/23 brd 10.30.171.255 scope global dynamic noprefixroute eth0
valid_lft 65233sec preferred_lft 65233sec
inet6 fe80::f816:3eff:fe9e:e860/64 scope link
valid_lft forever preferred_lft forever
---> sar -b -r -n DEV:
Linux 4.18.0-553.5.1.el8.x86_64 (prd-centos8-robot-2c-8g-1820.novalocal) 01/19/2026 _x86_64_ (2 CPU)
12:00:01 AM tps rtps wtps bread/s bwrtn/s
12:01:01 AM 0.98 0.02 0.97 0.13 203.55
12:02:01 AM 0.52 0.13 0.38 3.86 32.25
12:03:01 AM 1.40 0.02 1.38 0.13 35.10
12:04:01 AM 8.66 5.73 2.93 555.41 70.18
12:05:01 AM 0.28 0.03 0.25 1.33 6.57
12:06:01 AM 0.15 0.00 0.15 0.00 1.90
12:07:01 AM 0.22 0.00 0.22 0.00 4.67
12:08:01 AM 0.67 0.07 0.60 7.60 12.60
12:09:01 AM 0.28 0.00 0.28 0.00 3.90
12:10:01 AM 0.13 0.00 0.13 0.00 8.40
12:11:01 AM 0.20 0.00 0.20 0.00 7.53
12:12:01 AM 0.15 0.00 0.15 0.00 1.90
12:13:01 AM 0.35 0.00 0.35 0.00 6.53
12:14:01 AM 0.15 0.00 0.15 0.00 3.63
12:15:01 AM 0.23 0.00 0.23 0.00 4.38
12:16:01 AM 0.15 0.00 0.15 0.00 1.62
12:17:01 AM 0.18 0.00 0.18 0.00 5.11
12:18:01 AM 0.33 0.00 0.33 0.00 5.00
12:19:01 AM 0.13 0.00 0.13 0.00 1.27
12:20:01 AM 0.25 0.03 0.22 1.34 5.68
12:21:01 AM 1.31 0.28 1.03 5.57 21.96
12:22:01 AM 0.48 0.00 0.48 0.00 9.67
12:23:01 AM 0.32 0.00 0.32 0.00 5.66
12:24:01 AM 0.12 0.00 0.12 0.00 0.97
12:25:01 AM 0.18 0.00 0.18 0.00 4.32
12:26:01 AM 0.17 0.00 0.17 0.00 3.47
12:27:01 AM 0.12 0.00 0.12 0.00 1.07
12:28:01 AM 0.48 0.00 0.48 0.00 11.18
12:29:01 AM 0.20 0.00 0.20 0.00 2.27
12:30:01 AM 0.15 0.00 0.15 0.00 1.10
12:31:01 AM 0.22 0.00 0.22 0.00 4.29
12:32:01 AM 0.18 0.00 0.18 0.00 2.52
12:33:01 AM 0.27 0.00 0.27 0.00 4.48
12:34:01 AM 0.13 0.00 0.13 0.00 1.32
12:35:01 AM 0.22 0.00 0.22 0.00 2.37
12:36:01 AM 0.17 0.00 0.17 0.00 3.00
12:37:01 AM 0.17 0.00 0.17 0.00 1.32
12:38:01 AM 0.33 0.02 0.32 0.13 5.01
12:39:01 AM 0.35 0.00 0.35 0.00 18.20
12:40:01 AM 0.12 0.00 0.12 0.00 8.30
12:41:01 AM 0.42 0.00 0.42 0.00 21.25
12:42:01 AM 0.27 0.00 0.27 0.00 12.73
12:43:01 AM 0.43 0.00 0.43 0.00 21.99
12:44:01 AM 0.15 0.00 0.15 0.00 8.98
12:45:01 AM 0.20 0.00 0.20 0.00 17.23
12:46:01 AM 0.15 0.00 0.15 0.00 19.86
12:47:01 AM 0.17 0.00 0.17 0.00 2.40
12:48:01 AM 0.33 0.00 0.33 0.00 7.91
12:49:01 AM 0.38 0.00 0.38 0.00 5.30
12:50:01 AM 0.20 0.00 0.20 0.00 2.52
12:51:01 AM 0.22 0.00 0.22 0.00 4.72
12:52:01 AM 0.13 0.00 0.13 0.00 1.98
12:53:01 AM 0.28 0.00 0.28 0.00 10.90
12:54:01 AM 0.15 0.00 0.15 0.00 5.07
12:55:01 AM 0.12 0.00 0.12 0.00 1.30
12:56:01 AM 0.13 0.00 0.13 0.00 0.97
12:57:01 AM 0.25 0.00 0.25 0.00 3.75
12:58:01 AM 0.35 0.00 0.35 0.00 5.98
12:59:01 AM 0.12 0.00 0.12 0.00 12.46
01:00:01 AM 0.15 0.00 0.15 0.00 8.92
01:01:01 AM 0.48 0.00 0.48 0.00 23.03
01:02:01 AM 0.23 0.00 0.23 0.00 18.76
01:03:01 AM 0.23 0.00 0.23 0.00 10.18
01:04:01 AM 0.27 0.00 0.27 0.00 19.88
01:05:01 AM 0.18 0.00 0.18 0.00 13.88
01:06:01 AM 0.40 0.00 0.40 0.00 6.11
01:07:01 AM 0.33 0.00 0.33 0.00 3.63
01:08:01 AM 0.58 0.00 0.58 0.00 10.88
01:09:01 AM 0.18 0.00 0.18 0.00 11.48
01:10:01 AM 0.18 0.00 0.18 0.00 17.46
01:11:01 AM 0.18 0.00 0.18 0.00 8.10
01:12:01 AM 0.22 0.00 0.22 0.00 17.95
01:13:01 AM 0.37 0.00 0.37 0.00 20.58
01:14:01 AM 0.18 0.00 0.18 0.00 9.35
01:15:01 AM 0.25 0.00 0.25 0.00 24.78
01:16:01 AM 0.18 0.00 0.18 0.00 12.41
01:17:01 AM 0.15 0.00 0.15 0.00 1.88
01:18:01 AM 0.35 0.00 0.35 0.00 7.95
01:19:01 AM 0.13 0.00 0.13 0.00 1.85
01:20:01 AM 0.12 0.00 0.12 0.00 0.78
01:21:01 AM 0.17 0.00 0.17 0.00 4.32
01:22:01 AM 0.27 0.00 0.27 0.00 3.98
01:23:01 AM 0.42 0.00 0.42 0.00 12.56
01:24:01 AM 0.23 0.00 0.23 0.00 5.65
01:25:01 AM 0.15 0.00 0.15 0.00 1.62
01:26:01 AM 0.10 0.00 0.10 0.00 0.82
01:27:01 AM 0.18 0.00 0.18 0.00 13.08
01:28:01 AM 0.37 0.00 0.37 0.00 19.31
01:29:01 AM 0.15 0.00 0.15 0.00 15.33
01:30:01 AM 0.12 0.00 0.12 0.00 7.20
01:31:01 AM 0.32 0.00 0.32 0.00 21.49
01:32:01 AM 0.60 0.00 0.60 0.00 19.65
01:33:01 AM 0.30 0.00 0.30 0.00 11.70
01:34:01 AM 0.13 0.00 0.13 0.00 5.78
01:35:01 AM 0.18 0.00 0.18 0.00 14.85
01:36:01 AM 0.17 0.00 0.17 0.00 7.88
01:37:01 AM 0.20 0.00 0.20 0.00 18.66
01:38:01 AM 0.40 0.00 0.40 0.00 18.64
01:39:01 AM 0.28 0.00 0.28 0.00 14.93
01:40:01 AM 0.18 0.00 0.18 0.00 15.34
01:41:01 AM 0.33 0.00 0.33 0.00 14.31
01:42:01 AM 0.15 0.00 0.15 0.00 5.20
01:43:01 AM 0.37 0.00 0.37 0.00 23.03
01:44:01 AM 0.48 0.00 0.48 0.00 16.51
01:45:01 AM 0.53 0.00 0.53 0.00 18.30
01:46:01 AM 0.67 0.00 0.67 0.00 19.60
01:47:01 AM 0.27 0.00 0.27 0.00 14.78
01:48:01 AM 0.33 0.00 0.33 0.00 12.63
01:49:01 AM 0.33 0.00 0.33 0.00 27.23
01:50:01 AM 0.37 0.00 0.37 0.00 4.37
01:51:01 AM 0.90 0.00 0.90 0.00 13.86
01:52:01 AM 0.23 0.00 0.23 0.00 5.90
01:53:01 AM 0.28 0.00 0.28 0.00 4.58
01:54:01 AM 0.13 0.00 0.13 0.00 3.62
01:55:01 AM 0.17 0.00 0.17 0.00 1.98
01:56:01 AM 0.13 0.00 0.13 0.00 6.80
01:57:01 AM 0.12 0.00 0.12 0.00 2.53
01:58:01 AM 0.33 0.00 0.33 0.00 7.27
01:59:01 AM 0.23 0.00 0.23 0.00 2.63
02:00:01 AM 0.17 0.00 0.17 0.00 3.88
02:01:01 AM 0.17 0.00 0.17 0.00 16.96
02:02:01 AM 0.27 0.00 0.27 0.00 20.27
02:03:01 AM 0.57 0.00 0.57 0.00 21.33
02:04:01 AM 0.30 0.00 0.30 0.00 15.23
02:05:01 AM 0.18 0.00 0.18 0.00 14.70
02:06:01 AM 0.23 0.00 0.23 0.00 14.80
02:07:01 AM 0.12 0.00 0.12 0.00 2.42
02:08:01 AM 0.50 0.00 0.50 0.00 16.41
02:09:01 AM 0.15 0.00 0.15 0.00 15.19
02:10:01 AM 0.30 0.00 0.30 0.00 16.53
02:11:01 AM 0.27 0.00 0.27 0.00 10.20
02:12:01 AM 0.18 0.00 0.18 0.00 16.61
02:13:01 AM 0.42 0.00 0.42 0.00 19.83
02:14:01 AM 0.57 0.00 0.57 0.00 24.56
02:15:01 AM 0.15 0.00 0.15 0.00 12.95
02:16:01 AM 0.17 0.00 0.17 0.00 2.18
02:17:01 AM 0.13 0.00 0.13 0.00 0.92
02:18:01 AM 0.35 0.00 0.35 0.00 8.60
02:19:01 AM 0.20 0.00 0.20 0.00 3.20
02:20:01 AM 0.25 0.00 0.25 0.00 5.05
02:21:01 AM 0.18 0.00 0.18 0.00 1.92
02:22:01 AM 0.18 0.00 0.18 0.00 8.13
02:23:01 AM 0.33 0.00 0.33 0.00 7.40
02:24:01 AM 0.15 0.00 0.15 0.00 3.72
02:25:01 AM 0.10 0.00 0.10 0.00 0.80
02:26:01 AM 0.15 0.00 0.15 0.00 3.55
02:27:01 AM 0.32 0.00 0.32 0.00 4.57
02:28:01 AM 0.38 0.00 0.38 0.00 9.18
02:29:01 AM 0.17 0.00 0.17 0.00 1.58
02:30:01 AM 0.10 0.00 0.10 0.00 3.20
02:31:01 AM 0.15 0.00 0.15 0.00 1.63
02:32:01 AM 0.20 0.00 0.20 0.00 5.47
02:33:01 AM 0.32 0.00 0.32 0.00 5.71
02:34:01 AM 0.23 0.00 0.23 0.00 5.18
02:35:01 AM 0.18 0.00 0.18 0.00 2.13
02:36:01 AM 0.12 0.00 0.12 0.00 3.85
02:37:01 AM 0.10 0.00 0.10 0.00 0.68
02:38:01 AM 0.42 0.00 0.42 0.00 9.16
02:39:01 AM 0.15 0.00 0.15 0.00 11.01
02:40:02 AM 0.18 0.00 0.18 0.00 15.08
02:41:01 AM 0.27 0.00 0.27 0.00 17.52
02:42:01 AM 0.20 0.00 0.20 0.00 10.28
02:43:01 AM 0.33 0.00 0.33 0.00 20.89
02:44:01 AM 0.15 0.00 0.15 0.00 16.39
02:45:01 AM 0.12 0.00 0.12 0.00 7.47
02:46:01 AM 0.13 0.00 0.13 0.00 5.86
02:47:01 AM 0.12 0.00 0.12 0.00 1.32
02:48:01 AM 0.35 0.00 0.35 0.00 8.75
02:49:01 AM 0.32 0.00 0.32 0.00 3.20
02:50:00 AM 0.40 0.00 0.40 0.00 7.47
02:50:01 AM 0.00 0.00 0.00 0.00 0.00
02:51:01 AM 0.48 0.00 0.48 0.00 6.21
02:52:01 AM 0.30 0.00 0.30 0.00 6.23
02:53:01 AM 0.48 0.00 0.48 0.00 6.61
02:54:01 AM 0.30 0.00 0.30 0.00 6.10
02:55:01 AM 0.33 0.00 0.33 0.00 3.87
02:56:01 AM 0.30 0.00 0.30 0.00 6.15
02:57:01 AM 0.35 0.00 0.35 0.00 3.83
02:58:01 AM 0.80 0.00 0.80 0.00 13.91
02:59:01 AM 0.40 0.00 0.40 0.00 9.93
03:00:01 AM 0.17 0.00 0.17 0.00 13.31
03:01:01 AM 0.22 0.00 0.22 0.00 18.96
03:02:01 AM 0.23 0.00 0.23 0.00 10.92
03:03:01 AM 0.37 0.00 0.37 0.00 20.78
03:04:01 AM 0.15 0.00 0.15 0.00 15.46
03:05:01 AM 0.13 0.00 0.13 0.00 8.66
03:06:01 AM 0.13 0.00 0.13 0.00 8.00
03:07:01 AM 0.15 0.00 0.15 0.00 1.62
03:08:01 AM 0.33 0.00 0.33 0.00 8.60
03:09:01 AM 0.18 0.00 0.18 0.00 1.88
03:10:01 AM 0.13 0.00 0.13 0.00 4.12
03:11:01 AM 0.23 0.00 0.23 0.00 2.55
03:12:01 AM 0.18 0.00 0.18 0.00 3.07
03:13:01 AM 0.45 0.00 0.45 0.00 9.46
03:14:01 AM 0.33 0.00 0.33 0.00 7.33
03:15:01 AM 0.43 0.00 0.43 0.00 4.55
03:16:01 AM 1.17 0.00 1.17 0.00 19.36
03:17:01 AM 0.13 0.00 0.13 0.00 4.38
03:18:01 AM 0.30 0.00 0.30 0.00 4.47
03:19:01 AM 0.17 0.00 0.17 0.00 13.66
03:20:01 AM 0.22 0.00 0.22 0.00 11.78
03:21:01 AM 0.27 0.00 0.27 0.00 17.18
03:22:01 AM 0.27 0.00 0.27 0.00 13.60
03:23:01 AM 0.35 0.00 0.35 0.00 22.63
03:24:01 AM 0.48 0.00 0.48 0.00 16.65
03:25:01 AM 0.38 0.00 0.38 0.00 13.13
03:26:01 AM 0.30 0.00 0.30 0.00 6.30
03:27:01 AM 0.30 0.00 0.30 0.00 2.65
03:28:01 AM 0.35 0.00 0.35 0.00 7.76
03:29:01 AM 0.30 0.00 0.30 0.00 4.80
03:30:01 AM 0.17 0.00 0.17 0.00 5.03
03:31:01 AM 0.17 0.00 0.17 0.00 2.13
03:32:01 AM 0.13 0.00 0.13 0.00 1.73
03:33:01 AM 0.33 0.00 0.33 0.00 9.13
03:34:01 AM 0.13 0.00 0.13 0.00 1.70
03:35:01 AM 0.25 0.00 0.25 0.00 6.25
03:36:01 AM 0.15 0.00 0.15 0.00 1.48
03:37:01 AM 0.18 0.00 0.18 0.00 4.60
03:38:01 AM 0.37 0.00 0.37 0.00 5.82
03:39:01 AM 0.20 0.00 0.20 0.00 15.36
03:40:01 AM 0.17 0.00 0.17 0.00 8.82
03:41:01 AM 0.17 0.00 0.17 0.00 16.86
03:42:01 AM 0.30 0.00 0.30 0.00 17.61
03:43:01 AM 0.47 0.00 0.47 0.00 18.18
03:44:02 AM 0.20 0.00 0.20 0.00 11.48
03:45:01 AM 0.12 0.00 0.12 0.00 16.27
03:46:01 AM 0.18 0.00 0.18 0.00 22.33
03:47:01 AM 0.13 0.00 0.13 0.00 0.97
03:48:01 AM 0.35 0.00 0.35 0.00 5.15
03:49:01 AM 0.13 0.00 0.13 0.00 3.88
03:50:01 AM 0.17 0.00 0.17 0.00 1.58
03:51:01 AM 0.25 0.00 0.25 0.00 5.10
03:52:01 AM 0.18 0.00 0.18 0.00 2.52
03:53:01 AM 0.38 0.00 0.38 0.00 12.38
03:54:01 AM 0.38 0.00 0.38 0.00 7.18
03:55:01 AM 0.30 0.00 0.30 0.00 3.43
03:56:01 AM 0.30 0.00 0.30 0.00 4.62
03:57:01 AM 0.12 0.00 0.12 0.00 3.90
03:58:01 AM 0.40 0.00 0.40 0.00 20.40
03:59:01 AM 0.25 0.00 0.25 0.00 17.99
04:00:01 AM 0.32 0.00 0.32 0.00 16.93
04:01:01 AM 0.15 0.00 0.15 0.00 8.70
04:02:01 AM 0.18 0.00 0.18 0.00 19.59
04:03:01 AM 0.47 0.00 0.47 0.00 18.89
04:04:01 AM 0.17 0.00 0.17 0.00 4.03
04:05:01 AM 0.20 0.00 0.20 0.00 14.46
04:06:01 AM 0.12 0.00 0.12 0.00 8.13
04:07:01 AM 0.25 0.00 0.25 0.00 15.66
04:08:01 AM 0.45 0.00 0.45 0.00 21.41
04:09:01 AM 0.18 0.00 0.18 0.00 16.81
04:10:01 AM 0.20 0.00 0.20 0.00 9.98
04:11:01 AM 0.27 0.00 0.27 0.00 16.96
04:12:01 AM 0.22 0.00 0.22 0.00 11.61
04:13:01 AM 0.28 0.00 0.28 0.00 13.83
04:14:01 AM 0.25 0.00 0.25 0.00 17.73
04:15:01 AM 0.20 0.00 0.20 0.00 11.98
04:16:01 AM 0.18 0.00 0.18 0.00 16.43
04:17:01 AM 0.13 0.00 0.13 0.00 15.33
04:18:01 AM 0.33 0.00 0.33 0.00 14.25
04:19:01 AM 0.20 0.00 0.20 0.00 25.26
04:20:01 AM 0.23 0.00 0.23 0.00 5.08
04:21:01 AM 0.23 0.00 0.23 0.00 2.62
04:22:01 AM 0.15 0.00 0.15 0.00 4.68
04:23:01 AM 0.32 0.00 0.32 0.00 5.53
04:24:01 AM 0.13 0.00 0.13 0.00 3.33
04:25:01 AM 0.12 0.00 0.12 0.00 1.30
04:26:01 AM 0.10 0.00 0.10 0.00 0.65
04:27:01 AM 0.35 0.00 0.35 0.00 12.36
04:28:01 AM 0.37 0.00 0.37 0.00 10.75
04:29:01 AM 0.12 0.00 0.12 0.00 0.77
04:30:01 AM 0.12 0.00 0.12 0.00 2.68
04:31:01 AM 0.88 0.00 0.88 0.00 14.86
04:32:01 AM 0.27 0.00 0.27 0.00 7.10
04:33:01 AM 0.30 0.00 0.30 0.00 6.90
04:34:01 AM 0.18 0.00 0.18 0.00 6.38
04:35:01 AM 0.08 0.00 0.08 0.00 0.52
04:36:01 AM 0.13 0.00 0.13 0.00 9.87
04:37:01 AM 0.13 0.00 0.13 0.00 14.13
04:38:01 AM 0.20 0.00 0.20 0.00 17.46
04:39:01 AM 0.27 0.00 0.27 0.00 11.35
04:40:01 AM 0.32 0.00 0.32 0.00 19.06
04:41:01 AM 0.42 0.00 0.42 0.00 19.98
04:42:01 AM 0.50 0.00 0.50 0.00 29.51
04:43:01 AM 0.37 0.00 0.37 0.00 11.95
04:44:01 AM 0.27 0.00 0.27 0.00 11.75
04:45:01 AM 0.27 0.00 0.27 0.00 8.28
04:46:01 AM 0.28 0.00 0.28 0.00 15.36
04:47:01 AM 0.58 0.00 0.58 0.00 16.24
04:48:01 AM 0.52 0.00 0.52 0.00 16.10
04:49:01 AM 0.37 0.00 0.37 0.00 11.81
04:50:01 AM 0.38 0.00 0.38 0.00 8.80
04:51:01 AM 0.30 0.00 0.30 0.00 7.15
04:52:02 AM 0.15 0.00 0.15 0.00 3.20
04:53:01 AM 0.34 0.00 0.34 0.00 10.39
04:54:01 AM 0.23 0.00 0.23 0.00 11.48
04:55:01 AM 0.20 0.00 0.20 0.00 16.28
04:56:01 AM 0.13 0.00 0.13 0.00 8.68
04:57:01 AM 0.17 0.00 0.17 0.00 16.41
04:58:01 AM 0.35 0.00 0.35 0.00 20.38
04:59:01 AM 0.15 0.00 0.15 0.00 10.41
05:00:01 AM 0.18 0.00 0.18 0.00 16.14
05:01:01 AM 0.28 0.00 0.28 0.00 24.56
05:02:01 AM 0.22 0.00 0.22 0.00 7.90
05:03:01 AM 0.30 0.00 0.30 0.00 5.01
05:04:01 AM 0.13 0.00 0.13 0.00 4.27
05:05:01 AM 0.13 0.00 0.13 0.00 1.33
05:06:01 AM 0.17 0.00 0.17 0.00 3.87
05:07:01 AM 0.15 0.00 0.15 0.00 1.62
05:08:01 AM 0.42 0.00 0.42 0.00 6.20
05:09:01 AM 0.20 0.00 0.20 0.00 9.50
05:10:01 AM 0.18 0.00 0.18 0.00 6.58
05:11:01 AM 0.18 0.00 0.18 0.00 1.75
05:12:01 AM 0.18 0.00 0.18 0.00 4.17
05:13:01 AM 0.33 0.00 0.33 0.00 5.58
05:14:01 AM 0.15 0.00 0.15 0.00 3.10
05:15:01 AM 0.25 0.00 0.25 0.00 7.71
05:16:01 AM 0.25 0.00 0.25 0.00 3.12
05:17:01 AM 0.23 0.00 0.23 0.00 7.75
05:18:01 AM 0.35 0.00 0.35 0.00 20.79
05:19:01 AM 0.17 0.00 0.17 0.00 16.70
05:20:01 AM 0.13 0.00 0.13 0.00 8.66
05:21:01 AM 0.18 0.00 0.18 0.00 16.56
05:22:01 AM 0.27 0.00 0.27 0.00 17.60
05:23:01 AM 0.35 0.00 0.35 0.00 33.17
05:24:01 AM 0.13 0.00 0.13 0.00 4.80
05:25:01 AM 0.15 0.00 0.15 0.00 1.57
05:26:01 AM 0.13 0.00 0.13 0.00 0.92
05:27:01 AM 0.13 0.00 0.13 0.00 4.12
05:28:01 AM 0.35 0.00 0.35 0.00 4.92
05:29:01 AM 0.22 0.00 0.22 0.00 4.73
05:30:01 AM 0.10 0.00 0.10 0.00 0.77
05:31:01 AM 0.33 0.00 0.33 0.00 10.56
05:32:01 AM 0.85 0.00 0.85 0.00 26.32
05:33:01 AM 0.37 0.00 0.37 0.00 18.78
05:34:01 AM 0.17 0.00 0.17 0.00 14.43
05:35:01 AM 0.20 0.00 0.20 0.00 14.80
05:36:01 AM 0.18 0.00 0.18 0.00 14.15
05:37:01 AM 0.17 0.00 0.17 0.00 25.50
05:38:01 AM 0.33 0.00 0.33 0.00 6.15
05:39:01 AM 20.64 0.32 20.33 39.05 3576.64
Average: 0.35 0.02 0.33 1.81 21.07
12:00:01 AM kbmemfree kbavail kbmemused %memused kbbuffers kbcached kbcommit %commit kbactive kbinact kbdirty
12:01:01 AM 4845928 6966876 3036504 38.52 2688 2295236 775044 8.68 267816 2382564 216
12:02:01 AM 4840136 6961876 3042296 38.60 2688 2296024 792048 8.87 268268 2387660 96
12:03:01 AM 4841704 6963428 3040728 38.58 2688 2296020 767900 8.60 268404 2386272 8
12:04:01 AM 4826084 6964492 3056348 38.77 2688 2312676 767856 8.60 270580 2399760 4
12:05:01 AM 4825852 6964380 3056580 38.78 2688 2312796 767856 8.60 270584 2400132 4
12:06:01 AM 4825544 6964072 3056888 38.78 2688 2312796 767856 8.60 270584 2400452 4
12:07:01 AM 4824776 6963376 3057656 38.79 2688 2312868 780144 8.74 270584 2400844 4
12:08:01 AM 4825028 6963892 3057404 38.79 2688 2313132 779240 8.73 270616 2400948 4
12:09:01 AM 4825832 6964868 3056600 38.78 2688 2313304 779240 8.73 270764 2399856 180
12:10:01 AM 4823272 6962364 3059160 38.81 2688 2313360 795180 8.90 270764 2402344 16
12:11:01 AM 4823324 6962580 3059108 38.81 2688 2313524 795180 8.90 270764 2402400 80
12:12:01 AM 4823200 6962456 3059232 38.81 2688 2313524 795180 8.90 270764 2402400 4
12:13:01 AM 4823152 6962436 3059280 38.81 2688 2313576 795180 8.90 270764 2402508 68
12:14:01 AM 4823252 6962632 3059180 38.81 2688 2313648 795180 8.90 270764 2402536 68
12:15:01 AM 4823308 6962688 3059124 38.81 2688 2313648 778844 8.72 270764 2402536 4
12:16:01 AM 4823220 6962652 3059212 38.81 2688 2313700 778844 8.72 270764 2402704 56
12:17:01 AM 4823096 6962596 3059336 38.81 2688 2313768 778844 8.72 270764 2402772 8
12:18:01 AM 4823144 6962644 3059288 38.81 2688 2313768 778844 8.72 270764 2402732 12
12:19:01 AM 4823044 6962616 3059388 38.81 2688 2313840 778844 8.72 270764 2402852 76
12:20:01 AM 4823068 6962696 3059364 38.81 2688 2313896 781196 8.75 270764 2402560 8
12:21:01 AM 4822628 6962460 3059804 38.82 2688 2314096 781196 8.75 270896 2402884 4
12:22:01 AM 4822792 6962740 3059640 38.82 2688 2314216 781196 8.75 270896 2403004 4
12:23:01 AM 4822492 6962440 3059940 38.82 2688 2314216 781196 8.75 270896 2403188 4
12:24:01 AM 4822244 6962244 3060188 38.82 2688 2314268 781196 8.75 270896 2403172 56
12:25:01 AM 4821912 6961980 3060520 38.83 2688 2314336 781196 8.75 270896 2403464 60
12:26:01 AM 4821980 6962048 3060452 38.83 2688 2314336 781196 8.75 270896 2403472 8
12:27:01 AM 4822200 6962320 3060232 38.82 2688 2314388 781196 8.75 270896 2403324 56
12:28:01 AM 4821920 6962112 3060512 38.83 2688 2314460 781196 8.75 270896 2403604 8
12:29:01 AM 4822180 6962372 3060252 38.82 2688 2314460 781196 8.75 270896 2403400 8
12:30:01 AM 4821948 6962204 3060484 38.83 2688 2314524 773096 8.66 270896 2403588 72
12:31:01 AM 4821808 6962080 3060624 38.83 2688 2314536 790908 8.86 270896 2403544 4
12:32:01 AM 4821972 6962244 3060460 38.83 2688 2314536 790908 8.86 270896 2403532 4
12:33:01 AM 4821632 6961908 3060800 38.83 2688 2314540 790908 8.86 270896 2403808 16
12:34:01 AM 4821672 6961948 3060760 38.83 2688 2314540 790908 8.86 270896 2403816 4
12:35:01 AM 4821956 6962232 3060476 38.83 2688 2314540 790908 8.86 270896 2403552 4
12:36:01 AM 4821436 6961716 3060996 38.83 2688 2314544 790908 8.86 270896 2403876 8
12:37:01 AM 4821876 6962156 3060556 38.83 2688 2314544 790908 8.86 270896 2403648 8
12:38:01 AM 4821500 6961928 3060932 38.83 2688 2314692 771120 8.63 270896 2404072 152
12:39:01 AM 4821560 6962264 3060872 38.83 2688 2314976 789404 8.84 270896 2404176 12
12:40:01 AM 4820928 6962016 3061504 38.84 2688 2315352 781584 8.75 270896 2404676 156
12:41:01 AM 4819360 6960824 3063072 38.86 2688 2315732 781584 8.75 270932 2406504 84
12:42:01 AM 4818436 6960276 3063996 38.87 2688 2316108 781584 8.75 270932 2407124 184
12:43:01 AM 4818320 6960536 3064112 38.87 2688 2316484 781584 8.75 270932 2407416 76
12:44:01 AM 4817804 6960396 3064628 38.88 2688 2316864 781584 8.75 270932 2408008 216
12:45:01 AM 4816564 6959864 3065868 38.89 2688 2317564 781584 8.75 270932 2409016 468
12:46:01 AM 4816872 6960276 3065560 38.89 2688 2317668 781584 8.75 270932 2408736 4
12:47:01 AM 4816836 6960244 3065596 38.89 2688 2317672 781584 8.75 270932 2408740 4
12:48:01 AM 4816620 6960108 3065812 38.89 2688 2317752 781584 8.75 270932 2409032 8
12:49:01 AM 4816728 6960216 3065704 38.89 2688 2317752 781584 8.75 270932 2408944 4
12:50:01 AM 4816316 6959876 3066116 38.90 2688 2317824 782996 8.77 270932 2409136 76
12:51:01 AM 4816768 6960324 3065664 38.89 2688 2317824 782996 8.77 270932 2408904 4
12:52:01 AM 4816612 6960300 3065820 38.89 2688 2317956 782996 8.77 270932 2409048 136
12:53:01 AM 4816376 6960160 3066056 38.90 2688 2318052 782996 8.77 270932 2409248 56
12:54:01 AM 4816216 6960072 3066216 38.90 2688 2318124 782996 8.77 270932 2409256 4
12:55:01 AM 4816344 6960204 3066088 38.90 2688 2318128 782996 8.77 270932 2409228 4
12:56:01 AM 4816296 6960172 3066136 38.90 2688 2318144 782996 8.77 270940 2409364 24
12:57:01 AM 4816296 6960184 3066136 38.90 2688 2318156 782996 8.77 270932 2409288 16
12:58:01 AM 4816012 6959952 3066420 38.90 2688 2318208 782996 8.77 270932 2409560 68
12:59:01 AM 4815952 6960212 3066480 38.90 2688 2318536 782996 8.77 270932 2409684 56
01:00:01 AM 4815484 6960120 3066948 38.91 2688 2318912 798824 8.94 270932 2410176 204
01:01:01 AM 4814908 6959932 3067524 38.92 2688 2319292 798824 8.94 270936 2410640 128
01:02:01 AM 4815080 6960480 3067352 38.91 2688 2319668 798824 8.94 270952 2410640 52
01:03:01 AM 4814756 6960544 3067676 38.92 2688 2320064 798824 8.94 270952 2410984 228
01:04:01 AM 4814164 6960328 3068268 38.93 2688 2320440 798824 8.94 270952 2411424 144
01:05:01 AM 4813932 6960356 3068500 38.93 2688 2320692 798824 8.94 271064 2411640 36
01:06:01 AM 4814156 6960624 3068276 38.93 2688 2320736 798824 8.94 271064 2411596 4
01:07:01 AM 4814252 6960732 3068180 38.92 2688 2320748 798824 8.94 271064 2411492 4
01:08:01 AM 4813612 6960292 3068820 38.93 2688 2320948 782288 8.76 271064 2411976 140
01:09:01 AM 4813132 6960080 3069300 38.94 2688 2321216 782288 8.76 271064 2412436 128
01:10:01 AM 4812972 6960292 3069460 38.94 2688 2321596 773224 8.66 271064 2412652 24
01:11:01 AM 4812856 6960564 3069576 38.94 2688 2321976 773224 8.66 271064 2412928 204
01:12:01 AM 4812420 6960500 3070012 38.95 2688 2322356 773224 8.66 271064 2413316 128
01:13:01 AM 4811932 6960388 3070500 38.95 2688 2322732 773224 8.66 271064 2413808 60
01:14:01 AM 4811520 6960352 3070912 38.96 2688 2323108 773224 8.66 271064 2414160 208
01:15:01 AM 4810788 6960320 3071644 38.97 2688 2323800 773224 8.66 271064 2414860 232
01:16:01 AM 4810376 6959992 3072056 38.97 2688 2323884 773224 8.66 271064 2415284 8
01:17:01 AM 4810304 6959920 3072128 38.97 2688 2323884 773224 8.66 271064 2415012 8
01:18:01 AM 4810076 6959776 3072356 38.98 2688 2323968 773224 8.66 271064 2415280 12
01:19:01 AM 4810060 6959760 3072372 38.98 2688 2323968 773224 8.66 271064 2415364 4
01:20:01 AM 4810092 6959864 3072340 38.98 2688 2324040 773224 8.66 271064 2415300 80
01:21:01 AM 4810200 6959984 3072232 38.98 2688 2324048 773224 8.66 271064 2415308 4
01:22:01 AM 4810092 6960016 3072340 38.98 2688 2324188 773224 8.66 271064 2415544 148
01:23:01 AM 4807728 6957736 3074704 39.01 2688 2324272 791996 8.87 271064 2417584 56
01:24:01 AM 4807884 6957964 3074548 39.01 2688 2324344 791996 8.87 271064 2417592 4
01:25:01 AM 4807996 6958076 3074436 39.00 2688 2324344 791996 8.87 271064 2417552 4
01:26:01 AM 4807912 6958052 3074520 39.00 2688 2324404 791996 8.87 271064 2417608 64
01:27:01 AM 4807552 6958044 3074880 39.01 2688 2324764 791996 8.87 271064 2418068 84
01:28:01 AM 4807040 6957908 3075392 39.02 2688 2325140 791996 8.87 271064 2418532 56
01:29:01 AM 4806744 6958000 3075688 39.02 2688 2325520 776408 8.69 271064 2418832 4
01:30:01 AM 4806204 6957840 3076228 39.03 2688 2325908 774708 8.67 271064 2419328 204
01:31:01 AM 4805948 6957952 3076484 39.03 2688 2326276 774708 8.67 271064 2419580 24
01:32:01 AM 4805816 6958208 3076616 39.03 2688 2326664 774708 8.67 271064 2419892 20
01:33:01 AM 4805272 6957896 3077160 39.04 2688 2326888 774708 8.67 271064 2420356 44
01:34:01 AM 4805584 6958316 3076848 39.03 2688 2327004 774708 8.67 271064 2420260 20
01:35:01 AM 4804708 6957840 3077724 39.05 2688 2327404 774708 8.67 271064 2420980 24
01:36:01 AM 4804500 6958008 3077932 39.05 2688 2327780 774708 8.67 271064 2421324 204
01:37:01 AM 4804176 6958068 3078256 39.05 2688 2328160 774708 8.67 271064 2421588 68
01:38:01 AM 4803496 6957764 3078936 39.06 2688 2328536 774708 8.67 271064 2422148 52
01:39:01 AM 4803420 6958064 3079012 39.06 2688 2328912 774708 8.67 271064 2422340 68
01:40:01 AM 4802496 6957520 3079936 39.07 2688 2329292 795084 8.90 271064 2422836 40
01:41:01 AM 4804320 6959620 3078112 39.05 2688 2329604 772788 8.65 271064 2421216 48
01:42:01 AM 4804504 6960052 3077928 39.05 2688 2329804 772788 8.65 271064 2421200 136
01:43:01 AM 4803860 6959784 3078572 39.06 2688 2330188 772788 8.65 271064 2421800 40
01:44:01 AM 4803432 6959748 3079000 39.06 2688 2330572 772788 8.65 271064 2422128 32
01:45:01 AM 4802784 6959468 3079648 39.07 2688 2330940 772788 8.65 271064 2422824 4
01:46:01 AM 4802828 6959884 3079604 39.07 2688 2331320 772788 8.65 271064 2422832 4
01:47:01 AM 4802140 6959572 3080292 39.08 2688 2331696 772788 8.65 271064 2423368 24
01:48:01 AM 4801468 6959396 3080964 39.09 2688 2332184 772788 8.65 271064 2424180 284
01:49:01 AM 4801472 6959844 3080960 39.09 2688 2332624 772788 8.65 271064 2424196 4
01:50:01 AM 4801180 6959552 3081252 39.09 2688 2332624 774252 8.67 271064 2424312 4
01:51:01 AM 4801336 6959788 3081096 39.09 2688 2332708 772712 8.65 280392 2414964 84
01:52:01 AM 4801036 6959488 3081396 39.09 2688 2332708 772712 8.65 280392 2415252 4
01:53:01 AM 4801152 6959604 3081280 39.09 2688 2332708 772712 8.65 280392 2415048 12
01:54:01 AM 4801092 6959620 3081340 39.09 2688 2332784 772712 8.65 280392 2415172 8
01:55:01 AM 4801052 6959580 3081380 39.09 2688 2332784 772712 8.65 280392 2415308 4
01:56:01 AM 4800924 6959636 3081508 39.09 2688 2332968 772712 8.65 280392 2415260 16
01:57:01 AM 4798828 6957652 3083604 39.12 2688 2333080 772712 8.65 280392 2417408 76
01:58:01 AM 4798596 6957420 3083836 39.12 2688 2333080 772712 8.65 280392 2417592 12
01:59:01 AM 4798688 6957568 3083744 39.12 2688 2333136 772712 8.65 280392 2417464 64
02:00:01 AM 4798324 6957432 3084108 39.13 2688 2333372 771332 8.64 280392 2417808 232
02:01:01 AM 4796956 6956452 3085476 39.14 2688 2333752 771332 8.64 280392 2418696 144
02:02:01 AM 4797700 6957580 3084732 39.13 2688 2334140 786740 8.81 280392 2418556 40
02:03:01 AM 4797196 6957456 3085236 39.14 2688 2334520 786740 8.81 280392 2419044 24
02:04:01 AM 4796604 6957244 3085828 39.15 2688 2334900 786740 8.81 280392 2419444 52
02:05:01 AM 4796464 6957492 3085968 39.15 2688 2335288 786740 8.81 280392 2419628 40
02:06:01 AM 4796308 6957696 3086124 39.15 2688 2335640 786740 8.81 280392 2419988 24
02:07:01 AM 4796268 6957860 3086164 39.15 2688 2335860 786740 8.81 280392 2420180 196
02:08:01 AM 4795652 6957464 3086780 39.16 2688 2336072 786740 8.81 280392 2420672 112
02:09:01 AM 4795620 6957812 3086812 39.16 2688 2336452 786740 8.81 280392 2420780 68
02:10:01 AM 4794296 6956880 3088136 39.18 2688 2336836 803804 9.00 280392 2421636 24
02:11:01 AM 4794636 6957608 3087796 39.17 2688 2337220 784340 8.78 280392 2421552 184
02:12:01 AM 4793992 6957340 3088440 39.18 2688 2337588 784340 8.78 280392 2422064 136
02:13:01 AM 4793500 6957236 3088932 39.19 2688 2337972 784340 8.78 280392 2422412 24
02:14:01 AM 4793108 6957496 3089324 39.19 2688 2338624 784340 8.78 280392 2423000 116
02:15:01 AM 4792968 6957608 3089464 39.19 2688 2338876 784340 8.78 280392 2423252 4
02:16:01 AM 4793048 6957692 3089384 39.19 2688 2338880 784340 8.78 280392 2423256 4
02:17:01 AM 4792984 6957708 3089448 39.19 2688 2338960 784340 8.78 280392 2423336 88
02:18:01 AM 4792368 6957092 3090064 39.20 2688 2338960 784340 8.78 280392 2423600 16
02:19:01 AM 4792064 6956800 3090368 39.21 2688 2338972 784340 8.78 280392 2423544 16
02:20:01 AM 4791712 6956508 3090720 39.21 2688 2339032 784340 8.78 280392 2423704 4
02:21:01 AM 4791968 6956764 3090464 39.21 2688 2339036 784340 8.78 280392 2423476 4
02:22:01 AM 4792568 6957560 3089864 39.20 2688 2339232 784340 8.78 280392 2423684 24
02:23:01 AM 4792384 6957476 3090048 39.20 2688 2339332 784340 8.78 280392 2423852 76
02:24:01 AM 4792140 6957232 3090292 39.20 2688 2339332 784340 8.78 280392 2423784 4
02:25:01 AM 4792244 6957412 3090188 39.20 2688 2339408 784340 8.78 280392 2423868 80
02:26:01 AM 4792296 6957464 3090136 39.20 2688 2339408 784340 8.78 280392 2423868 4
02:27:01 AM 4791616 6956868 3090816 39.21 2688 2339492 784340 8.78 280392 2424508 92
02:28:01 AM 4791748 6957004 3090684 39.21 2688 2339496 784340 8.78 280392 2424380 4
02:29:01 AM 4792000 6957256 3090432 39.21 2688 2339496 784340 8.78 280392 2424312 4
02:30:01 AM 4791520 6956852 3090912 39.21 2688 2339572 774908 8.68 280392 2424620 4
02:31:01 AM 4791668 6957004 3090764 39.21 2688 2339576 774908 8.68 280392 2424392 4
02:32:01 AM 4791008 6956428 3091424 39.22 2688 2339660 774908 8.68 280392 2424952 16
02:33:01 AM 4790988 6956412 3091444 39.22 2688 2339664 774908 8.68 280392 2424824 12
02:34:01 AM 4791276 6956776 3091156 39.22 2688 2339740 774908 8.68 280392 2424628 8
02:35:01 AM 4791396 6956896 3091036 39.21 2688 2339740 774908 8.68 280392 2424628 4
02:36:01 AM 4791352 6956944 3091080 39.21 2688 2339832 774908 8.68 280392 2424720 4
02:37:01 AM 4791384 6956976 3091048 39.21 2688 2339832 774908 8.68 280392 2424720 4
02:38:01 AM 4791408 6957084 3091024 39.21 2688 2339916 774908 8.68 280400 2424860 16
02:39:01 AM 4790960 6957052 3091472 39.22 2688 2340340 774908 8.68 280400 2425204 152
02:40:02 AM 4790384 6956856 3092048 39.23 2688 2340720 796976 8.92 280400 2425584 116
02:41:01 AM 4790236 6957092 3092196 39.23 2688 2341104 796976 8.92 280400 2425968 68
02:42:01 AM 4789664 6956904 3092768 39.24 2688 2341488 796976 8.92 280400 2426356 228
02:43:01 AM 4789488 6957108 3092944 39.24 2688 2341868 796976 8.92 280400 2426804 144
02:44:01 AM 4789176 6957180 3093256 39.24 2688 2342252 796976 8.92 280400 2427116 68
02:45:01 AM 4789008 6957208 3093424 39.24 2688 2342440 796976 8.92 280400 2427328 56
02:46:01 AM 4788688 6956988 3093744 39.25 2688 2342540 796976 8.92 280400 2427424 4
02:47:01 AM 4788716 6957020 3093716 39.25 2688 2342544 796976 8.92 280400 2427428 4
02:48:01 AM 4788284 6956684 3094148 39.25 2688 2342640 796976 8.92 280400 2427932 4
02:49:01 AM 4788728 6957128 3093704 39.25 2688 2342640 796976 8.92 280400 2427524 4
02:50:00 AM 4789088 6957584 3093344 39.24 2688 2342736 791596 8.86 280400 2427272 4
02:50:01 AM 4788492 6956988 3093940 39.25 2688 2342736 791596 8.86 280404 2427676 12
02:51:01 AM 4788576 6957072 3093856 39.25 2688 2342736 791596 8.86 280400 2427620 4
02:52:01 AM 4788552 6957144 3093880 39.25 2688 2342832 791596 8.86 280400 2427716 4
02:53:01 AM 4788440 6957032 3093992 39.25 2688 2342832 791596 8.86 280400 2427792 4
02:54:01 AM 4788476 6957160 3093956 39.25 2688 2342924 791596 8.86 280400 2427816 8
02:55:01 AM 4788456 6957144 3093976 39.25 2688 2342928 791596 8.86 280400 2427820 4
02:56:01 AM 4788404 6957184 3094028 39.25 2688 2343020 791596 8.86 280400 2427912 4
02:57:01 AM 4788524 6957304 3093908 39.25 2688 2343020 791596 8.86 280400 2427912 4
02:58:01 AM 4787920 6956792 3094512 39.26 2688 2343112 791596 8.86 280400 2428068 4
02:59:01 AM 4787952 6957096 3094480 39.26 2688 2343388 791596 8.86 280400 2428268 104
03:00:01 AM 4787536 6957060 3094896 39.26 2688 2343768 774456 8.67 280400 2428564 144
03:01:01 AM 4786676 6956584 3095756 39.27 2688 2344152 774456 8.67 280400 2429184 4
03:02:01 AM 4786976 6957268 3095456 39.27 2688 2344536 774456 8.67 280400 2429140 164
03:03:01 AM 4786356 6957012 3096076 39.28 2688 2344900 774456 8.67 280400 2429716 92
03:04:01 AM 4785744 6956784 3096688 39.29 2688 2345284 774456 8.67 280400 2430376 52
03:05:01 AM 4785972 6957316 3096460 39.28 2688 2345580 774456 8.67 280400 2430360 120
03:06:01 AM 4785616 6957060 3096816 39.29 2688 2345680 789836 8.84 280400 2430568 4
03:07:01 AM 4785720 6957168 3096712 39.29 2688 2345684 789836 8.84 280400 2430456 4
03:08:01 AM 4785280 6956824 3097152 39.29 2688 2345780 789836 8.84 280400 2430964 12
03:09:01 AM 4785396 6956940 3097036 39.29 2688 2345780 789836 8.84 280400 2430672 8
03:10:01 AM 4785080 6956720 3097352 39.29 2688 2345876 786308 8.80 280400 2430884 4
03:11:01 AM 4785376 6957016 3097056 39.29 2688 2345876 786308 8.80 280400 2430740 4
03:12:01 AM 4784976 6956712 3097456 39.30 2688 2345972 786308 8.80 280400 2431164 104
03:13:01 AM 4785192 6956928 3097240 39.29 2688 2345972 786308 8.80 280400 2431076 4
03:14:01 AM 4784800 6956628 3097632 39.30 2688 2346064 786308 8.80 280400 2431132 4
03:15:01 AM 4784532 6956364 3097900 39.30 2688 2346068 789576 8.84 280400 2431444 4
03:16:01 AM 4785064 6957008 3097368 39.29 2688 2346176 789532 8.84 281692 2429684 100
03:17:01 AM 4785180 6957124 3097252 39.29 2688 2346176 789532 8.84 281692 2429688 4
03:18:01 AM 4785196 6957232 3097236 39.29 2688 2346268 789532 8.84 281692 2429848 104
03:19:01 AM 4784492 6956804 3097940 39.30 2688 2346552 789532 8.84 281692 2430220 8
03:20:01 AM 4784496 6957192 3097936 39.30 2688 2346936 789532 8.84 281692 2430456 100
03:21:01 AM 4783608 6956692 3098824 39.31 2688 2347320 789532 8.84 281692 2431264 52
03:22:01 AM 4783268 6956732 3099164 39.32 2688 2347700 789532 8.84 281692 2431644 144
03:23:01 AM 4782588 6956440 3099844 39.33 2688 2348088 789532 8.84 281692 2432224 80
03:24:01 AM 4782412 6956652 3100020 39.33 2688 2348468 789532 8.84 281692 2432428 24
03:25:01 AM 4781932 6956448 3100500 39.33 2688 2348744 789532 8.84 281692 2433008 4
03:26:01 AM 4781916 6956540 3100516 39.33 2688 2348852 789532 8.84 281692 2432852 4
03:27:01 AM 4781936 6956560 3100496 39.33 2688 2348852 772908 8.65 281692 2432856 4
03:28:01 AM 4781692 6956408 3100740 39.34 2688 2348944 772908 8.65 281692 2433188 4
03:29:01 AM 4781552 6956272 3100880 39.34 2688 2348948 772908 8.65 281692 2433192 4
03:30:01 AM 4781532 6956344 3100900 39.34 2688 2349040 783388 8.77 281692 2433312 4
03:31:01 AM 4781624 6956444 3100808 39.34 2688 2349044 783388 8.77 281692 2433084 4
03:32:01 AM 4781708 6956620 3100724 39.34 2688 2349136 783388 8.77 281692 2433176 100
03:33:01 AM 4781212 6956124 3101220 39.34 2688 2349136 783388 8.77 281692 2433456 4
03:34:01 AM 4781592 6956596 3100840 39.34 2688 2349228 783388 8.77 281692 2433392 104
03:35:01 AM 4781624 6956632 3100808 39.34 2688 2349232 783388 8.77 281692 2433280 4
03:36:01 AM 4781632 6956736 3100800 39.34 2688 2349328 783388 8.77 281692 2433376 104
03:37:01 AM 4781344 6956448 3101088 39.34 2688 2349328 783388 8.77 281692 2433376 4
03:38:01 AM 4781396 6956696 3101036 39.34 2688 2349524 783388 8.77 281692 2433616 208
03:39:01 AM 4781104 6956636 3101328 39.34 2688 2349764 783388 8.77 281692 2433780 28
03:40:01 AM 4780608 6956520 3101824 39.35 2688 2350144 766992 8.59 281692 2434276 176
03:41:01 AM 4780220 6956524 3102212 39.36 2688 2350536 766992 8.59 281692 2434668 100
03:42:01 AM 4779888 6956572 3102544 39.36 2688 2350916 766992 8.59 281692 2435048 68
03:43:01 AM 4779220 6956288 3103212 39.37 2688 2351300 766992 8.59 281692 2435500 124
03:44:02 AM 4779024 6956484 3103408 39.37 2688 2351684 766992 8.59 281692 2435824 208
03:45:01 AM 4778120 6956304 3104312 39.38 2688 2352408 766992 8.59 281692 2436556 476
03:46:01 AM 4778208 6956540 3104224 39.38 2688 2352556 766992 8.59 281692 2436584 4
03:47:01 AM 4778152 6956484 3104280 39.38 2688 2352556 766992 8.59 281692 2436584 4
03:48:01 AM 4778112 6956524 3104320 39.38 2688 2352636 766992 8.59 281692 2436732 96
03:49:01 AM 4778200 6956616 3104232 39.38 2688 2352640 766992 8.59 281692 2436668 8
03:50:01 AM 4777972 6956396 3104460 39.38 2688 2352648 766992 8.59 281692 2436788 16
03:51:01 AM 4778228 6956716 3104204 39.38 2688 2352712 766992 8.59 281692 2436740 4
03:52:01 AM 4778128 6956616 3104304 39.38 2688 2352712 766992 8.59 281692 2436744 4
03:53:01 AM 4777632 6956312 3104800 39.39 2688 2352904 787120 8.81 281692 2437132 4
03:54:01 AM 4777624 6956408 3104808 39.39 2688 2353008 787120 8.81 281692 2437056 4
03:55:01 AM 4777668 6956452 3104764 39.39 2688 2353008 787120 8.81 281692 2437056 4
03:56:01 AM 4777712 6956552 3104720 39.39 2688 2353064 787120 8.81 281692 2437224 16
03:57:01 AM 4777460 6956572 3104972 39.39 2688 2353344 787120 8.81 281692 2437368 204
03:58:01 AM 4777160 6956660 3105272 39.39 2688 2353728 787120 8.81 281692 2437816 148
03:59:01 AM 4776880 6956768 3105552 39.40 2688 2354108 787120 8.81 281692 2438136 68
04:00:01 AM 4776012 6956276 3106420 39.41 2688 2354492 783376 8.77 281692 2438628 52
04:01:01 AM 4775024 6955672 3107408 39.42 2688 2354876 783376 8.77 281692 2439596 208
04:02:01 AM 4775428 6956460 3107004 39.42 2688 2355260 783376 8.77 281692 2439400 68
04:03:01 AM 4775044 6956388 3107388 39.42 2688 2355564 783376 8.77 281692 2439664 36
04:04:01 AM 4775040 6956512 3107392 39.42 2688 2355692 783376 8.77 281692 2439928 104
04:05:01 AM 4775004 6956796 3107428 39.42 2688 2356020 783376 8.77 281692 2440056 40
04:06:01 AM 4774504 6956684 3107928 39.43 2688 2356400 783376 8.77 281692 2440620 204
04:07:01 AM 4773920 6956472 3108512 39.44 2688 2356780 783376 8.77 281692 2440904 188
04:08:01 AM 4773400 6956352 3109032 39.44 2688 2357168 783376 8.77 281696 2441500 120
04:09:01 AM 4773284 6956608 3109148 39.44 2688 2357548 783376 8.77 281692 2441716 40
04:10:01 AM 4772564 6956284 3109868 39.45 2688 2357944 775588 8.68 281692 2442232 204
04:11:01 AM 4772440 6956404 3109992 39.45 2688 2358180 775588 8.68 281692 2442472 16
04:12:01 AM 4772332 6956552 3110100 39.46 2688 2358436 775588 8.68 281692 2442584 4
04:13:01 AM 4771700 6956328 3110732 39.46 2688 2358852 775588 8.68 281692 2443192 156
04:14:01 AM 4771332 6956356 3111100 39.47 2688 2359236 775588 8.68 281692 2443400 68
04:15:01 AM 4770948 6956348 3111484 39.47 2688 2359620 775588 8.68 281692 2443892 160
04:16:01 AM 4770668 6956448 3111764 39.48 2688 2360000 775588 8.68 281692 2444248 84
04:17:01 AM 4770344 6956508 3112088 39.48 2688 2360384 775588 8.68 281692 2444552 36
04:18:01 AM 4769888 6956436 3112544 39.49 2688 2360768 775588 8.68 281692 2445008 140
04:19:01 AM 4769244 6956460 3113188 39.50 2688 2361428 775588 8.68 281692 2445612 84
04:20:01 AM 4769100 6956320 3113332 39.50 2688 2361432 775264 8.68 281692 2445732 4
04:21:01 AM 4769292 6956520 3113140 39.49 2688 2361440 775264 8.68 281692 2445620 16
04:22:01 AM 4769072 6956376 3113360 39.50 2688 2361516 775264 8.68 281692 2445700 4
04:23:01 AM 4769008 6956312 3113424 39.50 2688 2361516 775264 8.68 281692 2445768 4
04:24:01 AM 4769096 6956472 3113336 39.50 2688 2361588 775264 8.68 281692 2445772 4
04:25:01 AM 4769048 6956428 3113384 39.50 2688 2361592 775264 8.68 281692 2445776 4
04:26:01 AM 4768720 6956272 3113712 39.50 2688 2361764 775264 8.68 281692 2445952 180
04:27:01 AM 4768876 6956492 3113556 39.50 2688 2361828 775264 8.68 281692 2446024 16
04:28:01 AM 4768380 6956136 3114052 39.51 2688 2361968 775264 8.68 281700 2446232 4
04:29:01 AM 4768528 6956284 3113904 39.50 2688 2361968 775264 8.68 281700 2446164 4
04:30:01 AM 4767332 6955184 3115100 39.52 2688 2362064 818008 9.16 281700 2446840 48
04:31:01 AM 4768328 6956268 3114104 39.51 2688 2362132 785412 8.79 282292 2445740 56
04:32:01 AM 4768212 6956244 3114220 39.51 2688 2362224 785412 8.79 282292 2445832 44
04:33:01 AM 4767752 6955936 3114680 39.51 2688 2362376 785412 8.79 282296 2446192 136
04:34:01 AM 4767888 6956072 3114544 39.51 2688 2362376 785412 8.79 282296 2445988 4
04:35:01 AM 4767612 6955932 3114820 39.52 2688 2362512 785412 8.79 282296 2446116 144
04:36:01 AM 4767764 6956328 3114668 39.51 2688 2362764 785412 8.79 282296 2446376 128
04:37:01 AM 4767264 6956204 3115168 39.52 2688 2363140 785412 8.79 282296 2446756 112
04:38:01 AM 4766920 6956236 3115512 39.52 2688 2363516 785412 8.79 282296 2447200 44
04:39:01 AM 4766636 6956332 3115796 39.53 2688 2363896 785412 8.79 282296 2447512 192
04:40:01 AM 4765744 6955816 3116688 39.54 2688 2364272 789468 8.84 282296 2448004 112
04:41:01 AM 4765620 6956076 3116812 39.54 2688 2364656 789468 8.84 282296 2448292 4
04:42:01 AM 4764532 6955720 3117900 39.56 2688 2365388 789468 8.84 282296 2449556 4
04:43:01 AM 4764716 6956120 3117716 39.55 2688 2365612 789468 8.84 282296 2449316 56
04:44:01 AM 4764504 6956196 3117928 39.56 2688 2365900 789468 8.84 282296 2449536 52
04:45:01 AM 4764236 6956216 3118196 39.56 2688 2366188 789468 8.84 282296 2449824 152
04:46:01 AM 4763744 6956012 3118688 39.57 2688 2366476 789468 8.84 282296 2450384 56
04:47:01 AM 4763588 6956144 3118844 39.57 2688 2366764 789468 8.84 282296 2450400 56
04:48:01 AM 4763204 6956072 3119228 39.57 2688 2367076 789468 8.84 282296 2450904 80
04:49:01 AM 4763060 6956124 3119372 39.57 2688 2367264 789468 8.84 282296 2450900 4
04:50:01 AM 4762712 6955928 3119720 39.58 2688 2367416 785540 8.80 282296 2451164 4
04:51:01 AM 4762456 6955776 3119976 39.58 2688 2367512 785540 8.80 282312 2451520 16
04:52:02 AM 4762736 6956172 3119696 39.58 2688 2367628 785540 8.80 282312 2451248 68
04:53:01 AM 4762664 6956176 3119768 39.58 2688 2367712 785540 8.80 282312 2451392 24
04:54:01 AM 4762308 6956100 3120124 39.58 2688 2367984 785540 8.80 282312 2451596 28
04:55:01 AM 4761588 6955788 3120844 39.59 2688 2368400 785540 8.80 282312 2452292 36
04:56:01 AM 4761796 6956396 3120636 39.59 2688 2368788 785540 8.80 282312 2452532 192
04:57:01 AM 4761292 6956260 3121140 39.60 2688 2369168 785540 8.80 282312 2452792 116
04:58:01 AM 4760744 6956092 3121688 39.60 2688 2369548 785540 8.80 282312 2453240 52
04:59:01 AM 4760156 6955892 3122276 39.61 2688 2369936 785540 8.80 282312 2453892 164
05:00:01 AM 4759816 6955932 3122616 39.61 2688 2370316 783440 8.77 282312 2454068 100
05:01:01 AM 4758444 6955260 3123988 39.63 2688 2371008 783440 8.77 282312 2455364 144
05:02:01 AM 4759360 6956180 3123072 39.62 2688 2371012 783440 8.77 282312 2454672 4
05:03:01 AM 4759248 6956068 3123184 39.62 2688 2371012 783440 8.77 282312 2454744 12
05:04:01 AM 4758712 6955616 3123720 39.63 2688 2371096 783440 8.77 282312 2455036 4
05:05:01 AM 4758988 6955892 3123444 39.63 2688 2371096 783440 8.77 282312 2454764 4
05:06:01 AM 4759128 6956100 3123304 39.62 2688 2371164 783440 8.77 282312 2454836 4
05:07:01 AM 4759136 6956112 3123296 39.62 2688 2371168 783440 8.77 282312 2454840 4
05:08:01 AM 4758580 6955732 3123852 39.63 2688 2371344 783440 8.77 282312 2455404 192
05:09:01 AM 4758368 6955584 3124064 39.63 2688 2371408 783440 8.77 282312 2455696 28
05:10:01 AM 4757572 6954920 3124860 39.64 2688 2371540 777328 8.70 282316 2456448 4
05:11:01 AM 4757776 6955132 3124656 39.64 2688 2371540 777328 8.70 282316 2456216 4
05:12:01 AM 4757708 6955124 3124724 39.64 2688 2371608 777328 8.70 282316 2456280 16
05:13:01 AM 4757472 6954928 3124960 39.64 2688 2371640 777328 8.70 282316 2456388 48
05:14:01 AM 4757288 6954892 3125144 39.65 2688 2371788 777328 8.70 282320 2456464 148
05:15:01 AM 4757316 6954924 3125116 39.65 2688 2371792 777328 8.70 282320 2456468 8
05:16:01 AM 4757432 6955176 3125000 39.65 2688 2371928 777328 8.70 282320 2456596 144
05:17:01 AM 4756848 6954828 3125584 39.65 2688 2372164 792820 8.88 282320 2456948 212
05:18:01 AM 4756584 6954940 3125848 39.66 2688 2372548 792820 8.88 282320 2457288 120
05:19:01 AM 4755968 6954716 3126464 39.66 2688 2372932 792820 8.88 282320 2457896 40
05:20:01 AM 4755268 6954408 3127164 39.67 2688 2373328 785620 8.80 282320 2458428 208
05:21:01 AM 4755652 6955168 3126780 39.67 2688 2373696 785620 8.80 282320 2458424 120
05:22:01 AM 4755112 6955012 3127320 39.67 2688 2374080 785620 8.80 282320 2458916 84
05:23:01 AM 4754380 6955036 3128052 39.68 2688 2374836 785620 8.80 282320 2459676 16
05:24:01 AM 4754016 6954772 3128416 39.69 2688 2374936 785620 8.80 282320 2459916 4
05:25:01 AM 4753920 6954676 3128512 39.69 2688 2374936 785620 8.80 282320 2459992 4
05:26:01 AM 4754344 6955180 3128088 39.68 2688 2375016 785620 8.80 282320 2459800 88
05:27:01 AM 4754256 6955096 3128176 39.69 2688 2375020 785620 8.80 282320 2459804 4
05:28:01 AM 4754076 6954988 3128356 39.69 2688 2375092 785620 8.80 282320 2460056 80
05:29:01 AM 4754136 6955048 3128296 39.69 2688 2375092 785620 8.80 282320 2459876 4
05:30:01 AM 4753940 6954856 3128492 39.69 2688 2375096 777380 8.70 282320 2459996 4
05:31:01 AM 4752052 6953180 3130380 39.71 2688 2375308 796032 8.91 282320 2461496 48
05:32:01 AM 4753076 6954808 3129356 39.70 2688 2375912 802824 8.99 282532 2460600 236
05:33:01 AM 4749848 6951968 3132584 39.74 2688 2376300 820344 9.19 282532 2463432 252
05:34:01 AM 4749240 6951744 3133192 39.75 2688 2376684 858816 9.62 282532 2463832 240
05:35:01 AM 4745988 6948972 3136444 39.79 2688 2377152 893080 10.00 282532 2466700 332
05:36:01 AM 4745468 6948852 3136964 39.80 2688 2377544 925960 10.37 282532 2467276 352
05:37:01 AM 4742440 6946208 3139992 39.84 2688 2377928 942584 10.55 282532 2469936 8
05:38:01 AM 4537948 6742508 3344484 42.43 2688 2378764 1165420 13.05 282532 2673936 808
05:39:01 AM 4859028 6955104 3023404 38.36 2688 2276332 727512 8.15 548456 2113472 23468
Average: 4789160 6957162 3093272 39.24 2688 2342256 785148 8.79 278776 2428606 135
12:00:01 AM IFACE rxpck/s txpck/s rxkB/s txkB/s rxcmp/s txcmp/s rxmcst/s %ifutil
12:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:01:01 AM eth0 12.00 9.26 2.84 1.81 0.00 0.00 0.00 0.00
12:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:02:01 AM eth0 16.66 13.74 4.29 2.75 0.00 0.00 0.00 0.00
12:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:03:01 AM eth0 0.85 0.32 0.22 0.08 0.00 0.00 0.00 0.00
12:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:04:01 AM eth0 1.87 1.12 0.37 0.27 0.00 0.00 0.00 0.00
12:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:05:01 AM eth0 0.73 0.43 0.09 0.05 0.00 0.00 0.00 0.00
12:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:06:01 AM eth0 1.63 0.27 0.35 0.20 0.00 0.00 0.00 0.00
12:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:07:01 AM eth0 3.52 0.42 0.36 0.05 0.00 0.00 0.00 0.00
12:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:08:01 AM eth0 2.45 0.57 0.90 0.52 0.00 0.00 0.00 0.00
12:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:09:01 AM eth0 10.48 9.80 1.80 1.09 0.00 0.00 0.00 0.00
12:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:10:01 AM eth0 10.25 4.57 1.43 0.39 0.00 0.00 0.00 0.00
12:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:11:01 AM eth0 5.56 5.05 0.80 0.42 0.00 0.00 0.00 0.00
12:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:12:01 AM eth0 1.00 0.08 0.06 0.01 0.00 0.00 0.00 0.00
12:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:13:01 AM eth0 4.88 4.48 0.79 0.37 0.00 0.00 0.00 0.00
12:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:14:01 AM eth0 1.38 0.65 0.19 0.10 0.00 0.00 0.00 0.00
12:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:15:01 AM eth0 0.42 0.07 0.03 0.00 0.00 0.00 0.00 0.00
12:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:16:01 AM eth0 6.02 3.93 0.71 0.28 0.00 0.00 0.00 0.00
12:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:17:01 AM eth0 3.38 0.58 0.25 0.09 0.00 0.00 0.00 0.00
12:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:18:01 AM eth0 0.92 0.15 0.17 0.07 0.00 0.00 0.00 0.00
12:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:19:01 AM eth0 4.73 4.55 0.72 0.36 0.00 0.00 0.00 0.00
12:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:20:01 AM eth0 0.75 0.30 0.10 0.03 0.00 0.00 0.00 0.00
12:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:21:01 AM eth0 0.23 0.05 0.02 0.00 0.00 0.00 0.00 0.00
12:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:22:01 AM eth0 5.83 5.50 0.85 0.44 0.00 0.00 0.00 0.00
12:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:23:01 AM eth0 0.45 0.13 0.15 0.07 0.00 0.00 0.00 0.00
12:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:24:01 AM eth0 5.47 4.25 0.86 0.30 0.00 0.00 0.00 0.00
12:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:25:01 AM eth0 1.67 0.87 0.55 0.35 0.00 0.00 0.00 0.00
12:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:26:01 AM eth0 0.70 0.20 0.28 0.20 0.00 0.00 0.00 0.00
12:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:27:01 AM eth0 5.06 4.38 0.74 0.31 0.00 0.00 0.00 0.00
12:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:28:01 AM eth0 1.52 0.83 0.62 0.41 0.00 0.00 0.00 0.00
12:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:29:01 AM eth0 0.17 0.05 0.02 0.00 0.00 0.00 0.00 0.00
12:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:30:01 AM eth0 4.30 3.70 0.71 0.30 0.00 0.00 0.00 0.00
12:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:31:01 AM eth0 0.73 0.32 0.11 0.05 0.00 0.00 0.00 0.00
12:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:32:01 AM eth0 0.78 0.17 0.06 0.01 0.00 0.00 0.00 0.00
12:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:33:01 AM eth0 2.05 0.42 0.55 0.26 0.00 0.00 0.00 0.00
12:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:34:01 AM eth0 0.62 0.15 0.27 0.19 0.00 0.00 0.00 0.00
12:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:35:01 AM eth0 2.43 0.05 0.27 0.00 0.00 0.00 0.00 0.00
12:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:36:01 AM eth0 3.68 0.83 1.50 0.96 0.00 0.00 0.00 0.00
12:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:37:01 AM eth0 2.07 0.15 0.26 0.01 0.00 0.00 0.00 0.00
12:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:38:01 AM eth0 14.08 9.40 2.74 1.41 0.00 0.00 0.00 0.00
12:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:39:01 AM eth0 8.95 6.88 2.02 1.31 0.00 0.00 0.00 0.00
12:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:40:01 AM eth0 11.65 9.11 2.74 1.79 0.00 0.00 0.00 0.00
12:41:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:41:01 AM eth0 11.35 9.20 2.71 1.80 0.00 0.00 0.00 0.00
12:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:42:01 AM eth0 12.18 9.35 3.02 1.99 0.00 0.00 0.00 0.00
12:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:43:01 AM eth0 11.30 9.25 2.84 1.86 0.00 0.00 0.00 0.00
12:44:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:44:01 AM eth0 12.43 9.03 2.80 1.79 0.00 0.00 0.00 0.00
12:45:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:45:01 AM eth0 22.61 17.33 5.97 3.68 0.00 0.00 0.00 0.00
12:46:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:46:01 AM eth0 1.12 0.38 0.12 0.05 0.00 0.00 0.00 0.00
12:47:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:47:01 AM eth0 1.33 0.05 0.14 0.00 0.00 0.00 0.00 0.00
12:48:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:48:01 AM eth0 1.90 0.90 0.83 0.56 0.00 0.00 0.00 0.00
12:49:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:49:01 AM eth0 0.52 0.07 0.07 0.00 0.00 0.00 0.00 0.00
12:50:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:50:01 AM eth0 2.27 0.42 0.28 0.05 0.00 0.00 0.00 0.00
12:51:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:51:01 AM eth0 0.62 0.05 0.08 0.00 0.00 0.00 0.00 0.00
12:52:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:52:01 AM eth0 3.83 2.65 0.81 0.52 0.00 0.00 0.00 0.00
12:53:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:53:01 AM eth0 11.91 11.55 1.82 0.95 0.00 0.00 0.00 0.00
12:54:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:54:01 AM eth0 1.20 0.55 0.18 0.09 0.00 0.00 0.00 0.00
12:55:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:55:01 AM eth0 0.45 0.15 0.03 0.01 0.00 0.00 0.00 0.00
12:56:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:56:01 AM eth0 0.52 0.10 0.03 0.01 0.00 0.00 0.00 0.00
12:57:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:57:01 AM eth0 2.68 0.05 0.30 0.00 0.00 0.00 0.00 0.00
12:58:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:58:01 AM eth0 5.40 4.05 1.29 0.77 0.00 0.00 0.00 0.00
12:59:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:59:01 AM eth0 10.71 8.43 2.62 1.60 0.00 0.00 0.00 0.00
01:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:00:01 AM eth0 15.60 9.05 3.28 1.79 0.00 0.00 0.00 0.00
01:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:01:01 AM eth0 11.51 9.18 2.76 1.82 0.00 0.00 0.00 0.00
01:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:02:01 AM eth0 11.70 9.21 2.77 1.80 0.00 0.00 0.00 0.00
01:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:03:01 AM eth0 11.93 9.45 2.98 1.90 0.00 0.00 0.00 0.00
01:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:04:01 AM eth0 12.16 9.30 2.99 1.99 0.00 0.00 0.00 0.00
01:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:05:01 AM eth0 6.90 5.13 3.96 1.15 0.00 0.00 0.00 0.00
01:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:06:01 AM eth0 2.08 0.38 0.13 0.07 0.00 0.00 0.00 0.00
01:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:07:01 AM eth0 4.98 0.02 0.43 0.00 0.00 0.00 0.00 0.00
01:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:08:01 AM eth0 4.78 2.47 1.54 1.04 0.00 0.00 0.00 0.00
01:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:09:01 AM eth0 8.37 6.68 2.36 1.61 0.00 0.00 0.00 0.00
01:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:10:01 AM eth0 16.08 9.23 3.37 1.80 0.00 0.00 0.00 0.00
01:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:11:01 AM eth0 11.56 9.03 2.78 1.79 0.00 0.00 0.00 0.00
01:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:12:01 AM eth0 11.36 9.13 2.69 1.80 0.00 0.00 0.00 0.00
01:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:13:01 AM eth0 11.53 9.12 2.88 1.85 0.00 0.00 0.00 0.00
01:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:14:01 AM eth0 11.81 9.16 2.81 1.80 0.00 0.00 0.00 0.00
01:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:15:01 AM eth0 20.01 16.13 4.93 3.07 0.00 0.00 0.00 0.00
01:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:16:01 AM eth0 1.72 0.65 0.65 0.43 0.00 0.00 0.00 0.00
01:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:17:01 AM eth0 2.90 0.02 7.82 0.00 0.00 0.00 0.00 0.00
01:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:18:01 AM eth0 1.52 0.48 0.22 0.11 0.00 0.00 0.00 0.00
01:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:19:01 AM eth0 0.77 0.28 0.42 0.26 0.00 0.00 0.00 0.00
01:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:20:01 AM eth0 0.95 0.32 0.14 0.04 0.00 0.00 0.00 0.00
01:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:21:01 AM eth0 0.55 0.00 0.06 0.00 0.00 0.00 0.00 0.00
01:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:22:01 AM eth0 4.67 3.75 1.22 0.87 0.00 0.00 0.00 0.00
01:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:23:01 AM eth0 11.40 11.18 1.71 0.85 0.00 0.00 0.00 0.00
01:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:24:01 AM eth0 0.98 0.67 0.17 0.10 0.00 0.00 0.00 0.00
01:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:25:01 AM eth0 0.68 0.10 0.07 0.00 0.00 0.00 0.00 0.00
01:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:26:01 AM eth0 3.85 3.53 0.54 0.25 0.00 0.00 0.00 0.00
01:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:27:01 AM eth0 11.31 9.13 2.71 1.76 0.00 0.00 0.00 0.00
01:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:28:01 AM eth0 12.10 9.72 3.27 2.15 0.00 0.00 0.00 0.00
01:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:29:01 AM eth0 10.83 9.26 2.71 1.81 0.00 0.00 0.00 0.00
01:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:30:01 AM eth0 11.05 9.10 2.68 1.80 0.00 0.00 0.00 0.00
01:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:31:01 AM eth0 11.31 9.05 2.74 1.79 0.00 0.00 0.00 0.00
01:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:32:01 AM eth0 10.90 9.05 2.65 1.79 0.00 0.00 0.00 0.00
01:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:33:01 AM eth0 6.48 4.55 1.69 1.09 0.00 0.00 0.00 0.00
01:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:34:01 AM eth0 1.43 0.75 0.18 0.15 0.00 0.00 0.00 0.00
01:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:35:01 AM eth0 11.81 10.03 3.20 2.17 0.00 0.00 0.00 0.00
01:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:36:01 AM eth0 11.11 9.12 2.72 1.79 0.00 0.00 0.00 0.00
01:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:37:01 AM eth0 10.93 8.98 2.67 1.79 0.00 0.00 0.00 0.00
01:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:38:01 AM eth0 11.70 9.48 2.93 1.88 0.00 0.00 0.00 0.00
01:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:39:01 AM eth0 11.65 9.17 2.81 1.80 0.00 0.00 0.00 0.00
01:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:40:01 AM eth0 11.08 9.10 2.70 1.79 0.00 0.00 0.00 0.00
01:41:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:41:01 AM eth0 5.57 4.37 1.40 0.99 0.00 0.00 0.00 0.00
01:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:42:01 AM eth0 3.75 3.42 0.84 0.65 0.00 0.00 0.00 0.00
01:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:43:01 AM eth0 11.51 9.25 2.89 1.90 0.00 0.00 0.00 0.00
01:44:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:44:01 AM eth0 11.43 9.15 2.75 1.80 0.00 0.00 0.00 0.00
01:45:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:45:01 AM eth0 11.56 9.27 3.01 1.99 0.00 0.00 0.00 0.00
01:46:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:46:01 AM eth0 10.90 9.02 2.65 1.79 0.00 0.00 0.00 0.00
01:47:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:47:01 AM eth0 11.63 8.96 2.79 1.79 0.00 0.00 0.00 0.00
01:48:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:48:01 AM eth0 13.48 11.36 3.63 2.46 0.00 0.00 0.00 0.00
01:49:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:49:01 AM eth0 10.33 8.73 2.61 1.57 0.00 0.00 0.00 0.00
01:50:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:50:01 AM eth0 0.18 0.00 0.01 0.00 0.00 0.00 0.00 0.00
01:51:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:51:01 AM eth0 2.17 0.42 0.30 0.05 0.00 0.00 0.00 0.00
01:52:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:52:01 AM eth0 0.83 0.22 0.33 0.20 0.00 0.00 0.00 0.00
01:53:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:53:01 AM eth0 0.73 0.15 0.19 0.07 0.00 0.00 0.00 0.00
01:54:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:54:01 AM eth0 5.52 0.32 0.66 0.04 0.00 0.00 0.00 0.00
01:55:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:55:01 AM eth0 1.20 0.27 0.39 0.26 0.00 0.00 0.00 0.00
01:56:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:56:01 AM eth0 10.96 9.37 1.93 1.05 0.00 0.00 0.00 0.00
01:57:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:57:01 AM eth0 10.83 5.03 1.49 0.43 0.00 0.00 0.00 0.00
01:58:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:58:01 AM eth0 1.95 0.22 0.22 0.07 0.00 0.00 0.00 0.00
01:59:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:59:01 AM eth0 4.22 3.15 0.58 0.22 0.00 0.00 0.00 0.00
02:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:00:01 AM eth0 6.75 5.68 1.55 1.08 0.00 0.00 0.00 0.00
02:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:01:01 AM eth0 11.56 8.98 2.79 1.79 0.00 0.00 0.00 0.00
02:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:02:01 AM eth0 11.71 9.11 2.84 1.79 0.00 0.00 0.00 0.00
02:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:03:01 AM eth0 13.30 9.35 2.99 1.87 0.00 0.00 0.00 0.00
02:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:04:01 AM eth0 13.73 9.25 3.08 1.99 0.00 0.00 0.00 0.00
02:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:05:01 AM eth0 11.21 9.07 2.84 1.79 0.00 0.00 0.00 0.00
02:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:06:01 AM eth0 9.58 7.66 2.37 1.52 0.00 0.00 0.00 0.00
02:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:07:01 AM eth0 4.78 2.12 0.74 0.40 0.00 0.00 0.00 0.00
02:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:08:01 AM eth0 5.87 4.42 1.82 1.26 0.00 0.00 0.00 0.00
02:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:09:01 AM eth0 11.23 9.01 2.78 1.79 0.00 0.00 0.00 0.00
02:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:10:01 AM eth0 15.73 9.00 3.38 1.79 0.00 0.00 0.00 0.00
02:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:11:01 AM eth0 11.28 9.16 2.78 1.80 0.00 0.00 0.00 0.00
02:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:12:01 AM eth0 10.90 8.80 2.66 1.75 0.00 0.00 0.00 0.00
02:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:13:01 AM eth0 11.35 9.13 2.89 1.85 0.00 0.00 0.00 0.00
02:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:14:01 AM eth0 17.60 14.43 4.61 2.84 0.00 0.00 0.00 0.00
02:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:15:01 AM eth0 5.81 4.80 1.19 0.84 0.00 0.00 0.00 0.00
02:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:16:01 AM eth0 0.40 0.00 0.03 0.00 0.00 0.00 0.00 0.00
02:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:17:01 AM eth0 1.63 0.37 0.22 0.05 0.00 0.00 0.00 0.00
02:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:18:01 AM eth0 2.10 0.33 0.60 0.32 0.00 0.00 0.00 0.00
02:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:19:01 AM eth0 6.18 0.18 128.76 0.19 0.00 0.00 0.00 0.00
02:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:20:01 AM eth0 3.12 0.27 0.48 0.04 0.00 0.00 0.00 0.00
02:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:21:01 AM eth0 0.40 0.00 0.03 0.00 0.00 0.00 0.00 0.00
02:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:22:01 AM eth0 10.45 9.67 1.81 1.11 0.00 0.00 0.00 0.00
02:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:23:01 AM eth0 5.70 5.40 0.93 0.48 0.00 0.00 0.00 0.00
02:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:24:01 AM eth0 0.63 0.00 0.04 0.00 0.00 0.00 0.00 0.00
02:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:25:01 AM eth0 0.73 0.42 0.10 0.04 0.00 0.00 0.00 0.00
02:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:26:01 AM eth0 0.78 0.00 0.07 0.00 0.00 0.00 0.00 0.00
02:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:27:01 AM eth0 1.70 1.02 0.48 6.52 0.00 0.00 0.00 0.00
02:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:28:01 AM eth0 1.05 0.70 0.19 6.33 0.00 0.00 0.00 0.00
02:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:29:01 AM eth0 0.43 0.00 0.03 0.00 0.00 0.00 0.00 0.00
02:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:30:01 AM eth0 1.30 0.25 0.23 0.03 0.00 0.00 0.00 0.00
02:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:31:01 AM eth0 1.68 0.00 5.47 0.00 0.00 0.00 0.00 0.00
02:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:32:01 AM eth0 2.38 2.08 0.46 6.54 0.00 0.00 0.00 0.00
02:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:33:01 AM eth0 1.12 0.30 0.46 0.26 0.00 0.00 0.00 0.00
02:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:34:01 AM eth0 0.52 0.23 0.09 0.03 0.00 0.00 0.00 0.00
02:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:35:01 AM eth0 0.25 0.00 0.02 0.00 0.00 0.00 0.00 0.00
02:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:36:01 AM eth0 0.50 0.27 0.09 0.03 0.00 0.00 0.00 0.00
02:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:37:01 AM eth0 0.37 0.00 0.02 0.00 0.00 0.00 0.00 0.00
02:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:38:01 AM eth0 4.35 4.08 0.71 0.40 0.00 0.00 0.00 0.00
02:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:39:01 AM eth0 11.51 9.93 2.90 1.94 0.00 0.00 0.00 0.00
02:40:02 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:40:02 AM eth0 11.56 9.28 2.87 1.81 0.00 0.00 0.00 0.00
02:41:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:41:01 AM eth0 11.25 9.27 2.82 1.83 0.00 0.00 0.00 0.00
02:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:42:01 AM eth0 11.50 9.37 2.90 1.81 0.00 0.00 0.00 0.00
02:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:43:01 AM eth0 11.40 9.18 2.96 1.86 0.00 0.00 0.00 0.00
02:44:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:44:01 AM eth0 11.71 9.20 2.91 1.80 0.00 0.00 0.00 0.00
02:45:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:45:01 AM eth0 3.90 3.15 0.95 0.61 0.00 0.00 0.00 0.00
02:46:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:46:01 AM eth0 0.67 0.45 0.07 0.07 0.00 0.00 0.00 0.00
02:47:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:47:01 AM eth0 0.52 0.00 0.06 0.00 0.00 0.00 0.00 0.00
02:48:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:48:01 AM eth0 0.92 0.53 0.36 0.28 0.00 0.00 0.00 0.00
02:49:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:49:01 AM eth0 0.30 0.02 0.08 0.00 0.00 0.00 0.00 0.00
02:50:00 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:50:00 AM eth0 0.46 0.24 0.03 0.02 0.00 0.00 0.00 0.00
02:50:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:50:01 AM eth0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:51:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:51:01 AM eth0 0.13 0.00 0.01 0.00 0.00 0.00 0.00 0.00
02:52:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:52:01 AM eth0 0.42 0.18 0.03 0.02 0.00 0.00 0.00 0.00
02:53:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:53:01 AM eth0 0.37 0.12 0.15 0.06 0.00 0.00 0.00 0.00
02:54:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:54:01 AM eth0 0.50 0.18 0.03 0.02 0.00 0.00 0.00 0.00
02:55:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:55:01 AM eth0 0.30 0.00 0.02 0.00 0.00 0.00 0.00 0.00
02:56:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:56:01 AM eth0 0.43 0.18 0.03 0.02 0.00 0.00 0.00 0.00
02:57:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:57:01 AM eth0 0.17 0.00 0.02 0.00 0.00 0.00 0.00 0.00
02:58:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:58:01 AM eth0 0.73 0.37 0.18 0.13 0.00 0.00 0.00 0.00
02:59:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:59:01 AM eth0 7.28 6.25 1.79 1.22 0.00 0.00 0.00 0.00
03:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:00:01 AM eth0 11.05 9.21 2.74 1.80 0.00 0.00 0.00 0.00
03:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:01:01 AM eth0 10.71 9.07 2.73 1.79 0.00 0.00 0.00 0.00
03:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:02:01 AM eth0 11.02 9.18 2.79 1.80 0.00 0.00 0.00 0.00
03:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:03:01 AM eth0 10.56 9.05 2.77 1.80 0.00 0.00 0.00 0.00
03:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:04:01 AM eth0 11.45 9.30 3.05 1.98 0.00 0.00 0.00 0.00
03:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:05:01 AM eth0 6.71 5.71 1.66 1.11 0.00 0.00 0.00 0.00
03:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:06:01 AM eth0 0.93 0.43 0.15 0.07 0.00 0.00 0.00 0.00
03:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:07:01 AM eth0 0.48 0.05 0.05 0.00 0.00 0.00 0.00 0.00
03:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:08:01 AM eth0 0.77 0.38 0.35 0.26 0.00 0.00 0.00 0.00
03:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:09:01 AM eth0 0.18 0.03 0.07 0.00 0.00 0.00 0.00 0.00
03:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:10:01 AM eth0 0.37 0.18 0.02 0.02 0.00 0.00 0.00 0.00
03:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:11:01 AM eth0 1.08 0.00 0.14 0.00 0.00 0.00 0.00 0.00
03:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:12:01 AM eth0 0.73 0.32 0.28 0.20 0.00 0.00 0.00 0.00
03:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:13:01 AM eth0 6.73 0.30 1.10 0.26 0.00 0.00 0.00 0.00
03:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:14:01 AM eth0 1.17 0.52 0.54 0.40 0.00 0.00 0.00 0.00
03:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:15:01 AM eth0 2.53 0.05 0.36 0.00 0.00 0.00 0.00 0.00
03:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:16:01 AM eth0 6.62 1.02 0.75 0.08 0.00 0.00 0.00 0.00
03:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:17:01 AM eth0 0.63 0.07 0.05 0.00 0.00 0.00 0.00 0.00
03:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:18:01 AM eth0 1.37 0.33 0.21 0.12 0.00 0.00 0.00 0.00
03:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:19:01 AM eth0 8.00 6.65 1.97 1.29 0.00 0.00 0.00 0.00
03:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:20:01 AM eth0 11.56 9.07 2.81 1.80 0.00 0.00 0.00 0.00
03:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:21:01 AM eth0 11.66 8.89 2.78 1.78 0.00 0.00 0.00 0.00
03:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:22:01 AM eth0 12.93 9.10 2.93 1.79 0.00 0.00 0.00 0.00
03:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:23:01 AM eth0 12.58 9.15 3.00 1.85 0.00 0.00 0.00 0.00
03:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:24:01 AM eth0 11.05 9.12 2.75 1.79 0.00 0.00 0.00 0.00
03:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:25:01 AM eth0 7.25 5.53 1.90 1.24 0.00 0.00 0.00 0.00
03:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:26:01 AM eth0 0.77 0.43 0.08 0.07 0.00 0.00 0.00 0.00
03:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:27:01 AM eth0 2.82 0.00 0.32 0.00 0.00 0.00 0.00 0.00
03:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:28:01 AM eth0 2.57 0.68 0.87 0.53 0.00 0.00 0.00 0.00
03:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:29:01 AM eth0 0.45 0.10 0.27 0.18 0.00 0.00 0.00 0.00
03:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:30:01 AM eth0 7.41 0.18 0.93 0.02 0.00 0.00 0.00 0.00
03:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:31:01 AM eth0 0.57 0.00 0.04 0.00 0.00 0.00 0.00 0.00
03:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:32:01 AM eth0 1.75 0.23 0.13 0.02 0.00 0.00 0.00 0.00
03:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:33:01 AM eth0 0.75 0.27 0.40 0.25 0.00 0.00 0.00 0.00
03:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:34:01 AM eth0 1.22 0.23 0.07 0.02 0.00 0.00 0.00 0.00
03:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:35:01 AM eth0 0.30 0.00 0.02 0.00 0.00 0.00 0.00 0.00
03:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:36:01 AM eth0 0.63 0.18 0.04 0.02 0.00 0.00 0.00 0.00
03:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:37:01 AM eth0 1.05 0.00 0.14 0.00 0.00 0.00 0.00 0.00
03:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:38:01 AM eth0 2.47 1.78 0.51 0.41 0.00 0.00 0.00 0.00
03:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:39:01 AM eth0 5.68 4.72 1.38 0.88 0.00 0.00 0.00 0.00
03:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:40:01 AM eth0 11.18 9.05 2.77 1.79 0.00 0.00 0.00 0.00
03:41:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:41:01 AM eth0 10.63 9.00 2.70 1.79 0.00 0.00 0.00 0.00
03:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:42:01 AM eth0 10.88 8.93 2.70 1.78 0.00 0.00 0.00 0.00
03:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:43:01 AM eth0 11.16 9.27 2.93 1.86 0.00 0.00 0.00 0.00
03:44:02 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:44:02 AM eth0 11.23 9.13 2.81 1.80 0.00 0.00 0.00 0.00
03:45:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:45:01 AM eth0 21.52 17.98 5.52 3.46 0.00 0.00 0.00 0.00
03:46:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:46:01 AM eth0 1.43 0.92 0.24 0.15 0.00 0.00 0.00 0.00
03:47:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:47:01 AM eth0 0.18 0.00 0.02 0.00 0.00 0.00 0.00 0.00
03:48:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:48:01 AM eth0 1.03 0.45 0.24 0.11 0.00 0.00 0.00 0.00
03:49:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:49:01 AM eth0 0.75 0.05 0.13 0.00 0.00 0.00 0.00 0.00
03:50:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:50:01 AM eth0 0.50 0.05 0.03 0.00 0.00 0.00 0.00 0.00
03:51:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:51:01 AM eth0 0.42 0.28 0.08 0.04 0.00 0.00 0.00 0.00
03:52:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:52:01 AM eth0 0.57 0.00 0.07 0.00 0.00 0.00 0.00 0.00
03:53:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:53:01 AM eth0 10.73 9.91 2.00 1.19 0.00 0.00 0.00 0.00
03:54:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:54:01 AM eth0 5.51 5.21 0.80 0.41 0.00 0.00 0.00 0.00
03:55:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:55:01 AM eth0 0.15 0.00 0.01 0.00 0.00 0.00 0.00 0.00
03:56:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:56:01 AM eth0 3.90 3.60 0.54 0.26 0.00 0.00 0.00 0.00
03:57:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:57:01 AM eth0 8.07 6.77 1.96 1.30 0.00 0.00 0.00 0.00
03:58:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:58:01 AM eth0 11.33 9.13 2.91 1.86 0.00 0.00 0.00 0.00
03:59:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:59:01 AM eth0 10.98 9.03 2.79 1.79 0.00 0.00 0.00 0.00
04:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:00:01 AM eth0 10.96 9.02 2.78 1.79 0.00 0.00 0.00 0.00
04:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:01:01 AM eth0 11.41 9.15 2.83 1.80 0.00 0.00 0.00 0.00
04:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:02:01 AM eth0 10.85 9.13 2.78 1.80 0.00 0.00 0.00 0.00
04:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:03:01 AM eth0 8.46 6.73 2.18 1.38 0.00 0.00 0.00 0.00
04:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:04:01 AM eth0 1.32 0.90 0.35 0.30 0.00 0.00 0.00 0.00
04:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:05:01 AM eth0 8.86 7.63 2.24 1.50 0.00 0.00 0.00 0.00
04:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:06:01 AM eth0 10.93 9.06 2.75 1.79 0.00 0.00 0.00 0.00
04:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:07:01 AM eth0 11.15 9.23 2.82 1.80 0.00 0.00 0.00 0.00
04:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:08:01 AM eth0 11.46 9.30 2.93 1.86 0.00 0.00 0.00 0.00
04:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:09:01 AM eth0 10.70 8.98 2.75 1.79 0.00 0.00 0.00 0.00
04:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:10:01 AM eth0 11.13 9.31 2.84 1.85 0.00 0.00 0.00 0.00
04:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:11:01 AM eth0 5.38 4.63 1.30 0.89 0.00 0.00 0.00 0.00
04:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:12:01 AM eth0 2.57 2.22 0.48 0.41 0.00 0.00 0.00 0.00
04:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:13:01 AM eth0 12.48 10.33 3.19 2.03 0.00 0.00 0.00 0.00
04:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:14:01 AM eth0 10.76 8.98 2.75 1.79 0.00 0.00 0.00 0.00
04:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:15:01 AM eth0 10.50 8.96 2.68 1.79 0.00 0.00 0.00 0.00
04:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:16:01 AM eth0 11.13 9.03 2.83 1.79 0.00 0.00 0.00 0.00
04:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:17:01 AM eth0 10.80 8.93 2.77 1.78 0.00 0.00 0.00 0.00
04:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:18:01 AM eth0 10.91 9.07 2.84 1.85 0.00 0.00 0.00 0.00
04:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:19:01 AM eth0 15.10 13.08 3.88 2.44 0.00 0.00 0.00 0.00
04:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:20:01 AM eth0 0.25 0.00 0.02 0.00 0.00 0.00 0.00 0.00
04:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:21:01 AM eth0 0.08 0.02 0.01 0.00 0.00 0.00 0.00 0.00
04:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:22:01 AM eth0 0.45 0.30 0.08 0.04 0.00 0.00 0.00 0.00
04:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:23:01 AM eth0 0.37 0.18 0.15 0.07 0.00 0.00 0.00 0.00
04:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:24:01 AM eth0 0.68 0.35 0.13 0.05 0.00 0.00 0.00 0.00
04:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:25:01 AM eth0 0.08 0.03 0.01 0.00 0.00 0.00 0.00 0.00
04:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:26:01 AM eth0 9.93 9.45 1.78 1.06 0.00 0.00 0.00 0.00
04:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:27:01 AM eth0 5.55 5.60 0.81 0.46 0.00 0.00 0.00 0.00
04:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:28:01 AM eth0 0.70 0.38 0.17 0.10 0.00 0.00 0.00 0.00
04:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:29:01 AM eth0 0.17 0.10 0.01 0.00 0.00 0.00 0.00 0.00
04:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:30:01 AM eth0 9.33 9.18 1.36 0.68 0.00 0.00 0.00 0.00
04:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:31:01 AM eth0 4.12 4.12 0.63 0.33 0.00 0.00 0.00 0.00
04:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:32:01 AM eth0 9.85 9.33 1.44 0.73 0.00 0.00 0.00 0.00
04:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:33:01 AM eth0 1.27 0.97 0.47 0.36 0.00 0.00 0.00 0.00
04:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:34:01 AM eth0 0.22 0.00 0.02 0.00 0.00 0.00 0.00 0.00
04:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:35:01 AM eth0 8.68 8.71 1.47 0.88 0.00 0.00 0.00 0.00
04:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:36:01 AM eth0 7.17 6.10 1.74 1.16 0.00 0.00 0.00 0.00
04:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:37:01 AM eth0 11.00 9.18 2.71 1.80 0.00 0.00 0.00 0.00
04:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:38:01 AM eth0 11.80 9.62 2.99 1.89 0.00 0.00 0.00 0.00
04:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:39:01 AM eth0 10.66 8.96 2.67 1.79 0.00 0.00 0.00 0.00
04:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:40:01 AM eth0 10.81 9.05 2.65 1.79 0.00 0.00 0.00 0.00
04:41:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:41:01 AM eth0 11.61 9.23 2.80 1.80 0.00 0.00 0.00 0.00
04:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:42:01 AM eth0 21.24 17.79 5.49 3.55 0.00 0.00 0.00 0.00
04:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:43:01 AM eth0 0.88 0.88 0.34 0.19 0.00 0.00 0.00 0.00
04:44:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:44:01 AM eth0 0.78 0.60 0.30 0.13 0.00 0.00 0.00 0.00
04:45:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:45:01 AM eth0 0.98 0.60 0.30 0.13 0.00 0.00 0.00 0.00
04:46:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:46:01 AM eth0 1.00 0.88 0.50 0.33 0.00 0.00 0.00 0.00
04:47:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:47:01 AM eth0 0.60 0.60 0.25 0.13 0.00 0.00 0.00 0.00
04:48:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:48:01 AM eth0 1.42 1.22 0.52 0.30 0.00 0.00 0.00 0.00
04:49:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:49:01 AM eth0 12.93 12.63 2.25 1.26 0.00 0.00 0.00 0.00
04:50:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:50:01 AM eth0 5.91 5.16 0.83 0.42 0.00 0.00 0.00 0.00
04:51:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:51:01 AM eth0 3.32 2.97 0.98 0.72 0.00 0.00 0.00 0.00
04:52:02 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:52:02 AM eth0 4.73 4.65 0.68 0.39 0.00 0.00 0.00 0.00
04:53:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:53:01 AM eth0 3.20 3.00 0.59 0.36 0.00 0.00 0.00 0.00
04:54:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:54:01 AM eth0 6.67 5.75 1.11 0.69 0.00 0.00 0.00 0.00
04:55:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:55:01 AM eth0 12.46 10.30 3.49 2.33 0.00 0.00 0.00 0.00
04:56:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:56:01 AM eth0 10.63 8.96 2.72 1.79 0.00 0.00 0.00 0.00
04:57:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:57:01 AM eth0 10.81 9.10 2.79 1.79 0.00 0.00 0.00 0.00
04:58:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:58:01 AM eth0 11.45 9.18 2.93 1.86 0.00 0.00 0.00 0.00
04:59:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
04:59:01 AM eth0 11.21 9.13 3.04 1.98 0.00 0.00 0.00 0.00
05:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
05:00:01 AM eth0 10.76 9.01 2.72 1.79 0.00 0.00 0.00 0.00
05:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
05:01:01 AM eth0 15.88 13.61 4.10 2.57 0.00 0.00 0.00 0.00
05:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
05:02:01 AM eth0 0.13 0.00 0.01 0.00 0.00 0.00 0.00 0.00
05:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
05:03:01 AM eth0 0.33 0.10 0.15 0.06 0.00 0.00 0.00 0.00
05:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
05:04:01 AM eth0 0.88 0.50 0.34 0.24 0.00 0.00 0.00 0.00
05:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
05:05:01 AM eth0 0.08 0.00 0.01 0.00 0.00 0.00 0.00 0.00
05:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
05:06:01 AM eth0 0.43 0.28 0.08 0.04 0.00 0.00 0.00 0.00
05:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
05:07:01 AM eth0 0.13 0.00 0.01 0.00 0.00 0.00 0.00 0.00
05:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
05:08:01 AM eth0 10.18 9.50 1.91 1.11 0.00 0.00 0.00 0.00
05:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
05:09:01 AM eth0 4.63 4.63 0.68 0.39 0.00 0.00 0.00 0.00
05:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
05:10:01 AM eth0 0.35 0.22 0.03 0.03 0.00 0.00 0.00 0.00
05:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
05:11:01 AM eth0 0.15 0.10 0.01 0.00 0.00 0.00 0.00 0.00
05:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
05:12:01 AM eth0 4.23 4.17 0.59 0.33 0.00 0.00 0.00 0.00
05:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
05:13:01 AM eth0 4.93 4.82 0.76 0.38 0.00 0.00 0.00 0.00
05:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
05:14:01 AM eth0 0.72 0.57 0.14 0.09 0.00 0.00 0.00 0.00
05:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
05:15:01 AM eth0 0.12 0.05 0.01 0.00 0.00 0.00 0.00 0.00
05:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
05:16:01 AM eth0 8.90 8.68 1.50 0.88 0.00 0.00 0.00 0.00
05:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
05:17:01 AM eth0 6.77 5.83 1.67 1.12 0.00 0.00 0.00 0.00
05:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
05:18:01 AM eth0 11.71 9.18 2.97 1.87 0.00 0.00 0.00 0.00
05:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
05:19:01 AM eth0 11.63 9.47 3.33 2.18 0.00 0.00 0.00 0.00
05:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
05:20:01 AM eth0 11.70 9.71 3.24 2.09 0.00 0.00 0.00 0.00
05:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
05:21:01 AM eth0 10.41 8.87 2.70 1.77 0.00 0.00 0.00 0.00
05:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
05:22:01 AM eth0 10.55 8.80 2.69 1.75 0.00 0.00 0.00 0.00
05:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
05:23:01 AM eth0 21.19 17.69 5.44 3.45 0.00 0.00 0.00 0.00
05:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
05:24:01 AM eth0 1.72 0.72 0.59 0.32 0.00 0.00 0.00 0.00
05:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
05:25:01 AM eth0 0.85 0.45 0.61 0.45 0.00 0.00 0.00 0.00
05:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
05:26:01 AM eth0 0.50 0.35 0.09 0.05 0.00 0.00 0.00 0.00
05:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
05:27:01 AM eth0 0.10 0.00 0.01 0.00 0.00 0.00 0.00 0.00
05:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
05:28:01 AM eth0 0.68 0.43 0.21 0.11 0.00 0.00 0.00 0.00
05:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
05:29:01 AM eth0 0.17 0.07 0.01 0.00 0.00 0.00 0.00 0.00
05:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
05:30:01 AM eth0 0.15 0.00 0.01 0.00 0.00 0.00 0.00 0.00
05:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
05:31:01 AM eth0 9.97 9.75 1.78 1.12 0.00 0.00 0.00 0.00
05:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
05:32:01 AM eth0 10.13 9.73 4.30 1.09 0.00 0.00 0.00 0.00
05:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
05:33:01 AM eth0 10.05 9.83 3.34 1.37 0.00 0.00 0.00 0.00
05:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
05:34:01 AM eth0 7.35 7.16 2.77 0.88 0.00 0.00 0.00 0.00
05:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
05:35:01 AM eth0 12.80 12.26 3.23 2.02 0.00 0.00 0.00 0.00
05:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
05:36:01 AM eth0 8.88 8.93 2.85 0.99 0.00 0.00 0.00 0.00
05:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
05:37:01 AM eth0 8.92 8.87 2.95 1.08 0.00 0.00 0.00 0.00
05:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
05:38:01 AM eth0 6.21 5.98 2.44 0.61 0.00 0.00 0.00 0.00
05:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
05:39:01 AM eth0 137.99 91.70 218.24 319.98 0.00 0.00 0.00 0.00
Average: lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
Average: eth0 6.41 4.89 2.47 1.85 0.00 0.00 0.00 0.00
---> sar -P ALL:
Linux 4.18.0-553.5.1.el8.x86_64 (prd-centos8-robot-2c-8g-1820.novalocal) 01/19/2026 _x86_64_ (2 CPU)
12:00:01 AM CPU %user %nice %system %iowait %steal %idle
12:01:01 AM all 4.49 0.02 0.50 0.01 0.09 94.89
12:01:01 AM 0 6.21 0.00 0.52 0.00 0.08 93.18
12:01:01 AM 1 2.77 0.03 0.48 0.02 0.10 96.59
12:02:01 AM all 5.66 0.00 0.40 0.00 0.09 93.84
12:02:01 AM 0 5.89 0.00 0.52 0.00 0.10 93.49
12:02:01 AM 1 5.43 0.00 0.28 0.00 0.08 94.20
12:03:01 AM all 0.15 0.00 0.14 0.01 0.05 99.65
12:03:01 AM 0 0.20 0.00 0.12 0.00 0.05 99.63
12:03:01 AM 1 0.10 0.00 0.17 0.02 0.05 99.67
12:04:01 AM all 0.32 0.23 0.17 0.13 0.06 99.10
12:04:01 AM 0 0.27 0.00 0.13 0.02 0.08 99.50
12:04:01 AM 1 0.37 0.47 0.20 0.23 0.03 98.70
12:05:01 AM all 0.48 0.00 0.08 0.00 0.06 99.38
12:05:01 AM 0 0.43 0.00 0.12 0.00 0.05 99.40
12:05:01 AM 1 0.52 0.00 0.05 0.00 0.07 99.37
12:06:01 AM all 0.33 0.00 0.08 0.00 0.05 99.55
12:06:01 AM 0 0.13 0.00 0.10 0.00 0.07 99.70
12:06:01 AM 1 0.52 0.00 0.05 0.00 0.03 99.40
12:07:01 AM all 0.43 0.00 0.09 0.00 0.06 99.42
12:07:01 AM 0 0.40 0.00 0.10 0.00 0.05 99.45
12:07:01 AM 1 0.47 0.00 0.08 0.00 0.07 99.38
12:08:01 AM all 0.36 0.00 0.09 0.01 0.05 99.49
12:08:01 AM 0 0.15 0.00 0.12 0.00 0.05 99.68
12:08:01 AM 1 0.57 0.00 0.07 0.02 0.05 99.30
12:09:01 AM all 4.38 0.00 0.36 0.00 0.06 95.20
12:09:01 AM 0 0.87 0.00 0.13 0.00 0.07 98.93
12:09:01 AM 1 8.00 0.00 0.59 0.00 0.05 91.36
12:10:01 AM all 7.73 0.00 4.30 0.00 0.10 87.87
12:10:01 AM 0 0.64 0.00 0.22 0.00 0.12 99.03
12:10:01 AM 1 15.36 0.00 8.70 0.00 0.07 75.87
12:11:01 AM all 6.70 0.00 2.12 0.00 0.08 91.10
12:11:01 AM 0 13.43 0.00 4.21 0.00 0.07 82.29
12:11:01 AM 1 0.30 0.00 0.13 0.00 0.08 99.48
12:11:01 AM CPU %user %nice %system %iowait %steal %idle
12:12:01 AM all 0.36 0.00 0.07 0.00 0.06 99.52
12:12:01 AM 0 0.32 0.00 0.05 0.00 0.03 99.60
12:12:01 AM 1 0.40 0.00 0.08 0.00 0.08 99.43
12:13:01 AM all 1.01 0.00 0.16 0.01 0.06 98.76
12:13:01 AM 0 1.58 0.00 0.18 0.02 0.05 98.17
12:13:01 AM 1 0.45 0.00 0.13 0.00 0.07 99.35
12:14:01 AM all 5.14 0.00 2.93 0.00 0.07 91.86
12:14:01 AM 0 7.48 0.00 5.54 0.00 0.07 86.91
12:14:01 AM 1 2.75 0.00 0.25 0.00 0.07 96.93
12:15:01 AM all 0.34 0.00 0.08 0.00 0.06 99.52
12:15:01 AM 0 0.58 0.00 0.07 0.00 0.05 99.30
12:15:01 AM 1 0.10 0.00 0.08 0.00 0.07 99.75
12:16:01 AM all 2.70 0.00 0.27 0.00 0.07 96.96
12:16:01 AM 0 5.26 0.00 0.43 0.00 0.03 94.28
12:16:01 AM 1 0.22 0.00 0.12 0.00 0.10 99.57
12:17:01 AM all 2.80 0.00 1.98 0.00 0.07 95.16
12:17:01 AM 0 2.93 0.00 3.67 0.00 0.08 93.32
12:17:01 AM 1 2.66 0.00 0.27 0.00 0.05 97.02
12:18:01 AM all 0.19 0.00 0.09 0.00 0.07 99.65
12:18:01 AM 0 0.30 0.00 0.12 0.00 0.08 99.50
12:18:01 AM 1 0.08 0.00 0.07 0.00 0.05 99.80
12:19:01 AM all 4.20 0.00 1.70 0.00 0.09 94.02
12:19:01 AM 0 8.36 0.00 3.39 0.00 0.09 88.17
12:19:01 AM 1 0.22 0.00 0.08 0.00 0.08 99.62
12:20:01 AM all 1.29 0.00 0.15 0.00 0.06 98.50
12:20:01 AM 0 2.43 0.00 0.19 0.00 0.02 97.37
12:20:01 AM 1 0.15 0.00 0.12 0.00 0.10 99.63
12:21:01 AM all 0.37 0.01 0.11 0.01 0.07 99.44
12:21:01 AM 0 0.61 0.02 0.10 0.00 0.05 99.22
12:21:01 AM 1 0.12 0.00 0.12 0.02 0.08 99.67
12:22:01 AM all 5.21 0.00 1.79 0.00 0.08 92.92
12:22:01 AM 0 0.27 0.00 0.15 0.00 0.08 99.50
12:22:01 AM 1 10.43 0.00 3.53 0.00 0.07 85.98
12:22:01 AM CPU %user %nice %system %iowait %steal %idle
12:23:01 AM all 0.40 0.00 0.08 0.01 0.07 99.45
12:23:01 AM 0 0.20 0.00 0.08 0.02 0.07 99.63
12:23:01 AM 1 0.60 0.00 0.07 0.00 0.07 99.27
12:24:01 AM all 0.77 0.00 0.10 0.00 0.06 99.07
12:24:01 AM 0 0.97 0.00 0.12 0.00 0.07 98.84
12:24:01 AM 1 0.57 0.00 0.08 0.00 0.05 99.30
12:25:01 AM all 5.41 0.00 2.98 0.00 0.08 91.54
12:25:01 AM 0 7.88 0.00 5.59 0.00 0.07 86.46
12:25:01 AM 1 2.91 0.00 0.32 0.00 0.08 96.69
12:26:01 AM all 0.35 0.00 0.08 0.00 0.06 99.52
12:26:01 AM 0 0.55 0.00 0.05 0.00 0.03 99.37
12:26:01 AM 1 0.15 0.00 0.10 0.00 0.08 99.67
12:27:01 AM all 2.23 0.00 0.21 0.00 0.08 97.49
12:27:01 AM 0 0.55 0.00 0.12 0.00 0.08 99.25
12:27:01 AM 1 3.95 0.00 0.31 0.00 0.07 95.68
12:28:01 AM all 3.07 0.00 1.64 0.00 0.06 95.23
12:28:01 AM 0 0.65 0.00 0.12 0.00 0.07 99.17
12:28:01 AM 1 5.55 0.00 3.21 0.00 0.05 91.19
12:29:01 AM all 0.35 0.00 0.07 0.00 0.07 99.52
12:29:01 AM 0 0.60 0.00 0.07 0.00 0.07 99.27
12:29:01 AM 1 0.10 0.00 0.07 0.00 0.07 99.77
12:30:01 AM all 4.11 0.00 1.80 0.00 0.08 94.02
12:30:01 AM 0 0.67 0.00 0.08 0.00 0.07 99.18
12:30:01 AM 1 7.70 0.00 3.60 0.00 0.09 88.61
12:31:01 AM all 1.57 0.00 0.16 0.00 0.07 98.20
12:31:01 AM 0 0.63 0.00 0.10 0.00 0.08 99.19
12:31:01 AM 1 2.52 0.00 0.22 0.00 0.05 97.21
12:32:01 AM all 0.26 0.00 0.08 0.00 0.08 99.59
12:32:01 AM 0 0.42 0.00 0.05 0.00 0.07 99.47
12:32:01 AM 1 0.10 0.00 0.10 0.00 0.08 99.72
12:33:01 AM all 0.32 0.00 0.07 0.00 0.07 99.55
12:33:01 AM 0 0.20 0.00 0.07 0.00 0.07 99.67
12:33:01 AM 1 0.43 0.00 0.07 0.00 0.07 99.43
12:33:01 AM CPU %user %nice %system %iowait %steal %idle
12:34:01 AM all 0.33 0.00 0.08 0.00 0.07 99.52
12:34:01 AM 0 0.43 0.00 0.07 0.00 0.07 99.43
12:34:01 AM 1 0.23 0.00 0.08 0.00 0.07 99.62
12:35:01 AM all 0.20 0.00 0.07 0.00 0.06 99.67
12:35:01 AM 0 0.28 0.00 0.05 0.00 0.05 99.62
12:35:01 AM 1 0.12 0.00 0.08 0.00 0.07 99.73
12:36:01 AM all 0.39 0.00 0.08 0.00 0.07 99.46
12:36:01 AM 0 0.40 0.00 0.07 0.00 0.05 99.48
12:36:01 AM 1 0.38 0.00 0.10 0.00 0.08 99.43
12:37:01 AM all 0.23 0.00 0.07 0.00 0.08 99.63
12:37:01 AM 0 0.18 0.00 0.10 0.00 0.08 99.63
12:37:01 AM 1 0.27 0.00 0.03 0.00 0.07 99.63
12:38:01 AM all 3.83 0.00 0.33 0.00 0.08 95.75
12:38:01 AM 0 0.45 0.00 0.15 0.00 0.08 99.32
12:38:01 AM 1 7.33 0.00 0.52 0.00 0.09 92.06
12:39:01 AM all 6.35 0.00 2.56 0.00 0.09 91.01
12:39:01 AM 0 2.39 0.00 0.22 0.00 0.07 97.33
12:39:01 AM 1 10.48 0.00 5.01 0.00 0.10 84.41
12:40:01 AM all 4.46 0.00 0.35 0.00 0.12 95.07
12:40:01 AM 0 5.62 0.00 0.40 0.00 0.12 93.86
12:40:01 AM 1 3.29 0.00 0.30 0.00 0.12 96.29
12:41:01 AM all 4.38 0.00 0.34 0.00 0.10 95.18
12:41:01 AM 0 3.68 0.00 0.28 0.00 0.10 95.93
12:41:01 AM 1 5.07 0.00 0.40 0.00 0.10 94.43
12:42:01 AM all 4.43 0.00 0.33 0.00 0.10 95.14
12:42:01 AM 0 3.51 0.00 0.30 0.00 0.10 96.09
12:42:01 AM 1 5.35 0.00 0.35 0.00 0.10 94.20
12:43:01 AM all 4.31 0.00 0.33 0.00 0.09 95.27
12:43:01 AM 0 3.70 0.00 0.30 0.00 0.08 95.92
12:43:01 AM 1 4.91 0.00 0.37 0.00 0.10 94.62
12:44:01 AM all 4.41 0.00 0.35 0.00 0.11 95.13
12:44:01 AM 0 4.20 0.00 0.35 0.00 0.10 95.35
12:44:01 AM 1 4.61 0.00 0.35 0.00 0.12 94.92
12:44:01 AM CPU %user %nice %system %iowait %steal %idle
12:45:01 AM all 6.93 0.00 0.45 0.00 0.10 92.52
12:45:01 AM 0 4.10 0.00 0.39 0.00 0.10 95.41
12:45:01 AM 1 9.76 0.00 0.52 0.00 0.10 89.62
12:46:01 AM all 0.49 0.00 0.08 0.00 0.08 99.34
12:46:01 AM 0 0.52 0.00 0.07 0.00 0.07 99.35
12:46:01 AM 1 0.47 0.00 0.10 0.00 0.10 99.33
12:47:01 AM all 0.30 0.00 0.06 0.00 0.06 99.58
12:47:01 AM 0 0.55 0.00 0.07 0.00 0.07 99.32
12:47:01 AM 1 0.05 0.00 0.05 0.00 0.05 99.85
12:48:01 AM all 0.49 0.00 0.11 0.00 0.06 99.34
12:48:01 AM 0 0.58 0.00 0.12 0.00 0.05 99.25
12:48:01 AM 1 0.40 0.00 0.10 0.00 0.07 99.43
12:49:01 AM all 0.20 0.00 0.06 0.00 0.05 99.69
12:49:01 AM 0 0.07 0.00 0.05 0.00 0.03 99.85
12:49:01 AM 1 0.33 0.00 0.07 0.00 0.07 99.53
12:50:01 AM all 0.43 0.00 0.09 0.00 0.07 99.42
12:50:01 AM 0 0.45 0.00 0.13 0.00 0.08 99.33
12:50:01 AM 1 0.40 0.00 0.05 0.00 0.05 99.50
12:51:01 AM all 0.33 0.00 0.06 0.00 0.05 99.56
12:51:01 AM 0 0.08 0.00 0.05 0.00 0.03 99.83
12:51:01 AM 1 0.58 0.00 0.07 0.00 0.07 99.28
12:52:01 AM all 1.35 0.00 0.10 0.00 0.06 98.49
12:52:01 AM 0 0.30 0.00 0.12 0.00 0.07 99.52
12:52:01 AM 1 2.40 0.00 0.08 0.00 0.05 97.46
12:53:01 AM all 8.37 0.00 2.94 0.00 0.09 88.61
12:53:01 AM 0 9.31 0.00 5.18 0.00 0.09 85.42
12:53:01 AM 1 7.42 0.00 0.69 0.00 0.09 91.81
12:54:01 AM all 5.10 0.00 3.66 0.00 0.06 91.18
12:54:01 AM 0 9.95 0.00 7.14 0.00 0.03 82.88
12:54:01 AM 1 0.15 0.00 0.10 0.00 0.08 99.67
12:55:01 AM all 0.30 0.00 0.07 0.00 0.07 99.57
12:55:01 AM 0 0.47 0.00 0.03 0.00 0.05 99.45
12:55:01 AM 1 0.13 0.00 0.10 0.00 0.08 99.68
12:55:01 AM CPU %user %nice %system %iowait %steal %idle
12:56:01 AM all 0.42 0.00 0.09 0.00 0.07 99.42
12:56:01 AM 0 0.58 0.00 0.05 0.00 0.05 99.32
12:56:01 AM 1 0.25 0.00 0.13 0.00 0.08 99.53
12:57:01 AM all 0.52 0.00 0.10 0.00 0.09 99.29
12:57:01 AM 0 0.62 0.00 0.05 0.00 0.07 99.27
12:57:01 AM 1 0.42 0.00 0.15 0.00 0.12 99.31
12:58:01 AM all 3.29 0.00 0.55 0.00 0.10 96.06
12:58:01 AM 0 0.72 0.00 0.13 0.00 0.10 99.05
12:58:01 AM 1 5.93 0.00 0.98 0.00 0.10 92.98
12:59:01 AM all 5.60 0.00 1.51 0.00 0.12 92.77
12:59:01 AM 0 3.03 0.00 0.20 0.00 0.12 96.65
12:59:01 AM 1 8.23 0.00 2.84 0.00 0.12 88.81
01:00:01 AM all 4.38 0.00 0.19 0.00 0.12 95.31
01:00:01 AM 0 2.91 0.00 0.18 0.00 0.10 96.80
01:00:01 AM 1 5.85 0.00 0.20 0.00 0.13 93.81
01:01:01 AM all 4.46 0.00 0.19 0.02 0.12 95.21
01:01:01 AM 0 6.70 0.00 0.23 0.02 0.13 92.91
01:01:01 AM 1 2.22 0.00 0.15 0.02 0.10 97.51
01:02:01 AM all 4.50 0.00 0.19 0.00 0.10 95.21
01:02:01 AM 0 5.08 0.00 0.23 0.00 0.12 94.57
01:02:01 AM 1 3.91 0.00 0.15 0.00 0.08 95.86
01:03:01 AM all 4.51 0.00 0.18 0.00 0.10 95.22
01:03:01 AM 0 2.89 0.00 0.17 0.00 0.08 96.86
01:03:01 AM 1 6.12 0.00 0.18 0.00 0.12 93.57
01:04:01 AM all 4.42 0.00 0.22 0.00 0.12 95.25
01:04:01 AM 0 2.83 0.00 0.18 0.00 0.10 96.89
01:04:01 AM 1 6.00 0.00 0.25 0.00 0.13 93.61
01:05:01 AM all 6.38 0.00 0.43 0.00 0.09 93.09
01:05:01 AM 0 5.19 0.00 0.30 0.00 0.10 94.40
01:05:01 AM 1 7.59 0.00 0.56 0.00 0.09 91.76
01:06:01 AM all 4.75 0.00 1.91 0.00 0.07 93.27
01:06:01 AM 0 9.27 0.00 3.73 0.00 0.05 86.95
01:06:01 AM 1 0.30 0.00 0.12 0.00 0.08 99.50
01:06:01 AM CPU %user %nice %system %iowait %steal %idle
01:07:01 AM all 0.48 0.00 0.09 0.00 0.12 99.31
01:07:01 AM 0 0.27 0.00 0.10 0.00 0.12 99.52
01:07:01 AM 1 0.70 0.00 0.08 0.00 0.12 99.10
01:08:01 AM all 3.98 0.00 0.35 0.00 0.08 95.59
01:08:01 AM 0 1.69 0.00 0.18 0.00 0.10 98.03
01:08:01 AM 1 6.32 0.00 0.51 0.00 0.07 93.10
01:09:01 AM all 6.47 0.00 2.81 0.00 0.09 90.63
01:09:01 AM 0 2.14 0.00 0.18 0.00 0.08 97.60
01:09:01 AM 1 10.97 0.00 5.53 0.00 0.10 83.39
01:10:01 AM all 4.49 0.00 0.35 0.00 0.10 95.06
01:10:01 AM 0 4.55 0.00 0.33 0.00 0.10 95.02
01:10:01 AM 1 4.43 0.00 0.37 0.00 0.10 95.10
01:11:01 AM all 4.50 0.00 0.36 0.00 0.11 95.03
01:11:01 AM 0 3.56 0.00 0.28 0.00 0.10 96.05
01:11:01 AM 1 5.43 0.00 0.43 0.00 0.12 94.02
01:12:01 AM all 4.34 0.00 0.36 0.00 0.09 95.21
01:12:01 AM 0 2.86 0.00 0.28 0.00 0.08 96.77
01:12:01 AM 1 5.82 0.00 0.43 0.00 0.10 93.65
01:13:01 AM all 4.43 0.00 0.33 0.00 0.10 95.14
01:13:01 AM 0 3.29 0.00 0.23 0.00 0.10 96.37
01:13:01 AM 1 5.57 0.00 0.42 0.00 0.10 93.92
01:14:01 AM all 4.41 0.00 0.35 0.00 0.08 95.16
01:14:01 AM 0 4.40 0.00 0.35 0.00 0.08 95.17
01:14:01 AM 1 4.41 0.00 0.35 0.00 0.08 95.15
01:15:01 AM all 6.76 0.00 0.41 0.00 0.08 92.76
01:15:01 AM 0 3.03 0.00 0.28 0.00 0.07 96.62
01:15:01 AM 1 10.49 0.00 0.54 0.00 0.08 88.89
01:16:01 AM all 0.59 0.00 0.11 0.00 0.03 99.27
01:16:01 AM 0 0.70 0.00 0.10 0.00 0.03 99.17
01:16:01 AM 1 0.48 0.00 0.12 0.00 0.03 99.37
01:17:01 AM all 0.37 0.00 0.06 0.00 0.04 99.53
01:17:01 AM 0 0.57 0.00 0.02 0.00 0.03 99.38
01:17:01 AM 1 0.17 0.00 0.10 0.00 0.05 99.68
01:17:01 AM CPU %user %nice %system %iowait %steal %idle
01:18:01 AM all 0.52 0.00 0.08 0.00 0.07 99.34
01:18:01 AM 0 0.58 0.00 0.05 0.00 0.07 99.30
01:18:01 AM 1 0.45 0.00 0.10 0.00 0.07 99.38
01:19:01 AM all 0.23 0.00 0.08 0.00 0.06 99.63
01:19:01 AM 0 0.35 0.00 0.05 0.00 0.05 99.55
01:19:01 AM 1 0.12 0.00 0.10 0.00 0.07 99.72
01:20:01 AM all 0.49 0.00 0.08 0.00 0.07 99.37
01:20:01 AM 0 0.55 0.00 0.05 0.00 0.05 99.35
01:20:01 AM 1 0.43 0.00 0.10 0.00 0.08 99.38
01:21:01 AM all 0.33 0.00 0.05 0.00 0.06 99.57
01:21:01 AM 0 0.53 0.00 0.03 0.00 0.03 99.40
01:21:01 AM 1 0.12 0.00 0.07 0.00 0.08 99.73
01:22:01 AM all 1.98 0.00 0.12 0.00 0.07 97.84
01:22:01 AM 0 2.64 0.00 0.10 0.00 0.03 97.23
01:22:01 AM 1 1.32 0.00 0.13 0.00 0.10 98.45
01:23:01 AM all 8.50 0.00 2.88 0.00 0.08 88.54
01:23:01 AM 0 13.49 0.00 5.46 0.00 0.07 80.98
01:23:01 AM 1 3.63 0.00 0.36 0.00 0.08 95.92
01:24:01 AM all 3.49 0.00 1.63 0.00 0.07 94.81
01:24:01 AM 0 0.30 0.00 0.13 0.00 0.08 99.48
01:24:01 AM 1 6.80 0.00 3.18 0.00 0.05 89.97
01:25:01 AM all 0.36 0.00 0.07 0.00 0.08 99.50
01:25:01 AM 0 0.62 0.00 0.08 0.00 0.07 99.23
01:25:01 AM 1 0.10 0.00 0.05 0.00 0.08 99.77
01:26:01 AM all 3.44 0.00 1.22 0.00 0.07 95.28
01:26:01 AM 0 0.52 0.00 0.12 0.00 0.07 99.30
01:26:01 AM 1 6.48 0.00 2.37 0.00 0.07 91.09
01:27:01 AM all 5.50 0.00 0.73 0.00 0.09 93.68
01:27:01 AM 0 2.02 0.00 0.15 0.00 0.10 97.72
01:27:01 AM 1 9.04 0.00 1.31 0.00 0.09 89.56
01:28:01 AM all 4.46 0.00 0.21 0.00 0.11 95.23
01:28:01 AM 0 3.09 0.00 0.20 0.00 0.10 96.60
01:28:01 AM 1 5.82 0.00 0.22 0.00 0.12 93.85
01:28:01 AM CPU %user %nice %system %iowait %steal %idle
01:29:01 AM all 4.44 0.00 0.18 0.00 0.11 95.28
01:29:01 AM 0 3.93 0.00 0.17 0.00 0.10 95.80
01:29:01 AM 1 4.95 0.00 0.18 0.00 0.12 94.75
01:30:01 AM all 4.39 0.00 0.18 0.00 0.11 95.32
01:30:01 AM 0 6.16 0.00 0.20 0.00 0.12 93.52
01:30:01 AM 1 2.62 0.00 0.17 0.00 0.10 97.11
01:31:01 AM all 4.37 0.00 0.23 0.00 0.11 95.29
01:31:01 AM 0 4.57 0.00 0.20 0.00 0.12 95.12
01:31:01 AM 1 4.18 0.00 0.25 0.00 0.10 95.47
01:32:01 AM all 4.46 0.00 0.16 0.00 0.11 95.27
01:32:01 AM 0 3.79 0.00 0.17 0.00 0.10 95.94
01:32:01 AM 1 5.13 0.00 0.15 0.00 0.12 94.60
01:33:01 AM all 6.76 0.00 0.44 0.01 0.09 92.70
01:33:01 AM 0 1.67 0.00 0.17 0.00 0.10 98.06
01:33:01 AM 1 12.07 0.00 0.72 0.02 0.09 87.11
01:34:01 AM all 7.67 0.00 3.17 0.00 0.07 89.08
01:34:01 AM 0 0.42 0.00 0.15 0.00 0.07 99.36
01:34:01 AM 1 15.49 0.00 6.43 0.00 0.07 78.01
01:35:01 AM all 5.34 0.00 0.23 0.00 0.11 94.33
01:35:01 AM 0 2.94 0.00 0.18 0.00 0.10 96.78
01:35:01 AM 1 7.76 0.00 0.27 0.00 0.12 91.85
01:36:01 AM all 4.42 0.00 0.20 0.00 0.10 95.27
01:36:01 AM 0 3.74 0.00 0.20 0.00 0.10 95.95
01:36:01 AM 1 5.10 0.00 0.20 0.00 0.10 94.59
01:37:01 AM all 4.46 0.00 0.20 0.00 0.12 95.23
01:37:01 AM 0 3.03 0.00 0.20 0.00 0.12 96.66
01:37:01 AM 1 5.89 0.00 0.20 0.00 0.12 93.79
01:38:01 AM all 4.45 0.00 0.18 0.00 0.12 95.25
01:38:01 AM 0 2.21 0.00 0.17 0.00 0.10 97.53
01:38:01 AM 1 6.69 0.00 0.20 0.00 0.13 92.98
01:39:01 AM all 4.35 0.00 0.22 0.00 0.12 95.31
01:39:01 AM 0 6.89 0.00 0.25 0.00 0.13 92.72
01:39:01 AM 1 1.82 0.00 0.18 0.00 0.10 97.90
01:39:01 AM CPU %user %nice %system %iowait %steal %idle
01:40:01 AM all 4.36 0.00 0.18 0.00 0.11 95.35
01:40:01 AM 0 1.54 0.00 0.17 0.00 0.10 98.20
01:40:01 AM 1 7.18 0.00 0.20 0.00 0.12 92.51
01:41:01 AM all 7.54 0.00 2.09 0.00 0.09 90.27
01:41:01 AM 0 13.16 0.00 4.07 0.00 0.09 82.68
01:41:01 AM 1 2.09 0.00 0.17 0.00 0.10 97.65
01:42:01 AM all 7.46 0.00 2.72 0.00 0.09 89.73
01:42:01 AM 0 1.27 0.00 0.13 0.00 0.08 98.51
01:42:01 AM 1 14.16 0.00 5.53 0.00 0.09 80.22
01:43:01 AM all 4.50 0.00 0.37 0.00 0.11 95.03
01:43:01 AM 0 2.87 0.00 0.25 0.00 0.10 96.78
01:43:01 AM 1 6.12 0.00 0.49 0.00 0.12 93.27
01:44:01 AM all 4.36 0.00 0.31 0.00 0.10 95.23
01:44:01 AM 0 5.12 0.00 0.38 0.00 0.12 94.38
01:44:01 AM 1 3.59 0.00 0.23 0.00 0.08 96.09
01:45:01 AM all 4.43 0.00 0.34 0.00 0.12 95.11
01:45:01 AM 0 3.90 0.00 0.35 0.00 0.12 95.63
01:45:01 AM 1 4.96 0.00 0.33 0.00 0.12 94.58
01:46:01 AM all 4.41 0.00 0.38 0.00 0.11 95.10
01:46:01 AM 0 6.40 0.00 0.50 0.00 0.12 92.98
01:46:01 AM 1 2.42 0.00 0.25 0.00 0.10 97.23
01:47:01 AM all 4.40 0.00 0.33 0.00 0.10 95.17
01:47:01 AM 0 2.88 0.00 0.20 0.00 0.08 96.84
01:47:01 AM 1 5.92 0.00 0.47 0.00 0.12 93.49
01:48:01 AM all 5.02 0.00 0.34 0.00 0.10 94.53
01:48:01 AM 0 6.03 0.00 0.42 0.00 0.12 93.44
01:48:01 AM 1 4.02 0.00 0.27 0.00 0.08 95.63
01:49:01 AM all 3.41 0.00 0.23 0.00 0.08 96.28
01:49:01 AM 0 4.66 0.00 0.22 0.00 0.07 95.06
01:49:01 AM 1 2.15 0.00 0.25 0.00 0.10 97.49
01:50:01 AM all 0.33 0.00 0.05 0.00 0.06 99.57
01:50:01 AM 0 0.53 0.00 0.03 0.00 0.05 99.38
01:50:01 AM 1 0.12 0.00 0.07 0.00 0.07 99.75
01:50:01 AM CPU %user %nice %system %iowait %steal %idle
01:51:01 AM all 0.52 0.15 0.13 0.01 0.07 99.13
01:51:01 AM 0 0.62 0.00 0.07 0.00 0.07 99.25
01:51:01 AM 1 0.42 0.30 0.18 0.02 0.07 99.02
01:52:01 AM all 0.31 0.00 0.08 0.00 0.05 99.57
01:52:01 AM 0 0.13 0.00 0.10 0.00 0.05 99.72
01:52:01 AM 1 0.48 0.00 0.05 0.00 0.05 99.42
01:53:01 AM all 0.35 0.00 0.05 0.00 0.07 99.53
01:53:01 AM 0 0.15 0.00 0.08 0.00 0.07 99.70
01:53:01 AM 1 0.55 0.00 0.02 0.00 0.07 99.37
01:54:01 AM all 0.45 0.00 0.08 0.00 0.06 99.41
01:54:01 AM 0 0.57 0.00 0.10 0.00 0.08 99.25
01:54:01 AM 1 0.33 0.00 0.07 0.00 0.03 99.57
01:55:01 AM all 0.18 0.00 0.07 0.00 0.06 99.70
01:55:01 AM 0 0.30 0.00 0.12 0.00 0.07 99.51
01:55:01 AM 1 0.05 0.00 0.02 0.00 0.05 99.88
01:56:01 AM all 6.93 0.00 2.78 0.00 0.08 90.20
01:56:01 AM 0 11.53 0.00 5.50 0.00 0.09 82.88
01:56:01 AM 1 2.47 0.00 0.13 0.00 0.08 97.31
01:57:01 AM all 6.74 0.00 2.18 0.00 0.08 91.01
01:57:01 AM 0 0.33 0.00 0.43 0.00 0.08 99.15
01:57:01 AM 1 13.59 0.00 4.04 0.00 0.07 82.30
01:58:01 AM all 0.37 0.00 0.06 0.01 0.06 99.51
01:58:01 AM 0 0.18 0.00 0.08 0.02 0.08 99.63
01:58:01 AM 1 0.55 0.00 0.03 0.00 0.03 99.38
01:59:01 AM all 0.88 0.00 0.13 0.00 0.06 98.93
01:59:01 AM 0 0.18 0.00 0.13 0.00 0.08 99.60
01:59:01 AM 1 1.58 0.00 0.13 0.00 0.03 98.26
02:00:01 AM all 6.93 0.00 1.78 0.00 0.09 91.19
02:00:01 AM 0 0.79 0.00 0.20 0.00 0.10 98.91
02:00:01 AM 1 13.39 0.00 3.44 0.00 0.09 83.08
02:01:01 AM all 4.34 0.00 0.23 0.00 0.10 95.33
02:01:01 AM 0 4.08 0.00 0.22 0.00 0.10 95.60
02:01:01 AM 1 4.60 0.00 0.23 0.00 0.10 95.07
02:01:01 AM CPU %user %nice %system %iowait %steal %idle
02:02:01 AM all 4.49 0.00 0.18 0.00 0.10 95.23
02:02:01 AM 0 2.16 0.00 0.15 0.00 0.08 97.61
02:02:01 AM 1 6.83 0.00 0.22 0.00 0.12 92.84
02:03:01 AM all 4.41 0.00 0.19 0.00 0.09 95.31
02:03:01 AM 0 4.65 0.00 0.17 0.00 0.08 95.10
02:03:01 AM 1 4.16 0.00 0.22 0.00 0.10 95.52
02:04:01 AM all 4.48 0.00 0.22 0.00 0.12 95.18
02:04:01 AM 0 2.98 0.00 0.22 0.00 0.12 96.69
02:04:01 AM 1 5.99 0.00 0.22 0.00 0.12 93.68
02:05:01 AM all 4.40 0.00 0.19 0.00 0.11 95.30
02:05:01 AM 0 4.58 0.00 0.20 0.00 0.10 95.12
02:05:01 AM 1 4.21 0.00 0.18 0.00 0.12 95.48
02:06:01 AM all 5.37 0.00 0.29 0.00 0.10 94.24
02:06:01 AM 0 5.77 0.00 0.20 0.00 0.13 93.90
02:06:01 AM 1 4.96 0.00 0.39 0.00 0.07 94.58
02:07:01 AM all 7.41 0.00 1.89 0.00 0.09 90.61
02:07:01 AM 0 2.41 0.00 0.18 0.00 0.08 97.32
02:07:01 AM 1 12.74 0.00 3.71 0.00 0.09 83.46
02:08:01 AM all 7.52 0.00 2.78 0.00 0.09 89.61
02:08:01 AM 0 1.87 0.00 0.22 0.00 0.08 97.83
02:08:01 AM 1 13.59 0.00 5.52 0.00 0.09 80.80
02:09:01 AM all 4.37 0.00 0.38 0.00 0.11 95.15
02:09:01 AM 0 1.19 0.00 0.22 0.00 0.07 98.53
02:09:01 AM 1 7.54 0.00 0.53 0.00 0.15 91.78
02:10:01 AM all 4.56 0.00 0.34 0.00 0.11 94.99
02:10:01 AM 0 3.46 0.00 0.27 0.00 0.10 96.17
02:10:01 AM 1 5.65 0.00 0.42 0.00 0.12 93.81
02:11:01 AM all 4.56 0.00 0.35 0.00 0.10 94.99
02:11:01 AM 0 1.57 0.00 0.18 0.00 0.08 98.16
02:11:01 AM 1 7.55 0.00 0.52 0.00 0.12 91.82
02:12:01 AM all 4.44 0.00 0.33 0.00 0.10 95.13
02:12:01 AM 0 3.49 0.00 0.28 0.00 0.10 96.12
02:12:01 AM 1 5.39 0.00 0.37 0.00 0.10 94.15
02:12:01 AM CPU %user %nice %system %iowait %steal %idle
02:13:01 AM all 4.65 0.00 0.36 0.00 0.10 94.89
02:13:01 AM 0 2.85 0.00 0.27 0.00 0.08 96.80
02:13:01 AM 1 6.46 0.00 0.45 0.00 0.12 92.97
02:14:01 AM all 6.71 0.00 0.44 0.00 0.09 92.76
02:14:01 AM 0 2.74 0.00 0.22 0.00 0.07 96.97
02:14:01 AM 1 10.68 0.00 0.65 0.00 0.12 88.55
02:15:01 AM all 1.79 0.00 0.18 0.01 0.07 97.96
02:15:01 AM 0 1.09 0.00 0.15 0.02 0.07 98.68
02:15:01 AM 1 2.49 0.00 0.20 0.00 0.07 97.24
02:16:01 AM all 0.33 0.00 0.08 0.00 0.05 99.55
02:16:01 AM 0 0.58 0.00 0.08 0.00 0.05 99.28
02:16:01 AM 1 0.07 0.00 0.07 0.00 0.05 99.82
02:17:01 AM all 0.52 0.00 0.08 0.00 0.07 99.33
02:17:01 AM 0 0.55 0.00 0.05 0.00 0.05 99.35
02:17:01 AM 1 0.48 0.00 0.12 0.00 0.08 99.32
02:18:01 AM all 0.35 0.00 0.06 0.00 0.04 99.55
02:18:01 AM 0 0.57 0.00 0.05 0.00 0.03 99.35
02:18:01 AM 1 0.13 0.00 0.07 0.00 0.05 99.75
02:19:01 AM all 0.35 0.00 0.07 0.00 0.05 99.53
02:19:01 AM 0 0.22 0.00 0.08 0.00 0.05 99.65
02:19:01 AM 1 0.48 0.00 0.05 0.00 0.05 99.42
02:20:01 AM all 0.49 0.00 0.08 0.00 0.05 99.38
02:20:01 AM 0 0.37 0.00 0.07 0.00 0.05 99.52
02:20:01 AM 1 0.62 0.00 0.08 0.00 0.05 99.25
02:21:01 AM all 0.33 0.00 0.08 0.00 0.05 99.54
02:21:01 AM 0 0.07 0.00 0.07 0.00 0.03 99.83
02:21:01 AM 1 0.60 0.00 0.08 0.00 0.07 99.25
02:22:01 AM all 7.84 0.00 2.57 0.00 0.08 89.51
02:22:01 AM 0 11.16 0.00 4.85 0.00 0.07 83.92
02:22:01 AM 1 4.57 0.00 0.32 0.00 0.08 95.02
02:23:01 AM all 6.92 0.00 2.87 0.00 0.08 90.13
02:23:01 AM 0 12.87 0.00 5.61 0.00 0.09 81.43
02:23:01 AM 1 1.05 0.00 0.17 0.00 0.08 98.69
02:23:01 AM CPU %user %nice %system %iowait %steal %idle
02:24:01 AM all 0.34 0.00 0.08 0.00 0.05 99.52
02:24:01 AM 0 0.12 0.00 0.10 0.00 0.07 99.72
02:24:01 AM 1 0.57 0.00 0.07 0.00 0.03 99.33
02:25:01 AM all 0.44 0.00 0.07 0.00 0.05 99.44
02:25:01 AM 0 0.59 0.00 0.10 0.00 0.07 99.25
02:25:01 AM 1 0.30 0.00 0.03 0.00 0.03 99.63
02:26:01 AM all 0.30 0.00 0.08 0.00 0.03 99.58
02:26:01 AM 0 0.42 0.00 0.07 0.00 0.02 99.50
02:26:01 AM 1 0.18 0.00 0.10 0.00 0.05 99.67
02:27:01 AM all 0.39 0.00 0.10 0.00 0.05 99.46
02:27:01 AM 0 0.58 0.00 0.07 0.00 0.03 99.32
02:27:01 AM 1 0.20 0.00 0.13 0.00 0.07 99.60
02:28:01 AM all 0.14 0.00 0.08 0.03 0.03 99.72
02:28:01 AM 0 0.12 0.00 0.07 0.07 0.02 99.73
02:28:01 AM 1 0.17 0.00 0.08 0.00 0.05 99.70
02:29:01 AM all 0.13 0.00 0.08 0.00 0.05 99.74
02:29:01 AM 0 0.15 0.00 0.08 0.00 0.05 99.72
02:29:01 AM 1 0.12 0.00 0.07 0.00 0.05 99.77
02:30:01 AM all 0.25 0.00 0.10 0.00 0.06 99.59
02:30:01 AM 0 0.33 0.00 0.08 0.00 0.03 99.55
02:30:01 AM 1 0.17 0.00 0.12 0.00 0.08 99.63
02:31:01 AM all 0.13 0.00 0.08 0.00 0.03 99.77
02:31:01 AM 0 0.10 0.00 0.07 0.00 0.02 99.82
02:31:01 AM 1 0.15 0.00 0.08 0.00 0.05 99.72
02:32:01 AM all 0.38 0.00 0.10 0.00 0.05 99.47
02:32:01 AM 0 0.52 0.00 0.10 0.00 0.03 99.35
02:32:01 AM 1 0.25 0.00 0.10 0.00 0.07 99.58
02:33:01 AM all 0.38 0.00 0.08 0.00 0.06 99.49
02:33:01 AM 0 0.10 0.00 0.08 0.00 0.07 99.75
02:33:01 AM 1 0.65 0.00 0.07 0.00 0.05 99.23
02:34:01 AM all 0.32 0.00 0.10 0.00 0.04 99.54
02:34:01 AM 0 0.35 0.00 0.08 0.00 0.03 99.53
02:34:01 AM 1 0.28 0.00 0.12 0.00 0.05 99.55
02:34:01 AM CPU %user %nice %system %iowait %steal %idle
02:35:01 AM all 0.37 0.00 0.08 0.00 0.04 99.52
02:35:01 AM 0 0.15 0.00 0.10 0.00 0.05 99.70
02:35:01 AM 1 0.58 0.00 0.05 0.00 0.03 99.33
02:36:01 AM all 0.37 0.00 0.10 0.00 0.04 99.49
02:36:01 AM 0 0.33 0.00 0.10 0.00 0.03 99.53
02:36:01 AM 1 0.40 0.00 0.10 0.00 0.05 99.45
02:37:01 AM all 0.39 0.00 0.08 0.00 0.05 99.48
02:37:01 AM 0 0.22 0.00 0.10 0.00 0.07 99.62
02:37:01 AM 1 0.57 0.00 0.05 0.00 0.03 99.35
02:38:01 AM all 5.06 0.00 1.88 0.00 0.08 92.98
02:38:01 AM 0 9.57 0.00 3.70 0.00 0.07 86.67
02:38:01 AM 1 0.70 0.00 0.13 0.00 0.08 99.08
02:39:01 AM all 5.39 0.00 0.27 0.00 0.10 94.25
02:39:01 AM 0 3.67 0.00 0.30 0.00 0.10 95.92
02:39:01 AM 1 7.09 0.00 0.23 0.00 0.10 92.57
02:40:02 AM all 4.59 0.00 0.20 0.00 0.09 95.11
02:40:02 AM 0 5.75 0.00 0.22 0.00 0.10 93.93
02:40:02 AM 1 3.44 0.00 0.18 0.00 0.08 96.29
02:41:01 AM all 4.55 0.00 0.20 0.00 0.10 95.15
02:41:01 AM 0 4.02 0.00 0.20 0.00 0.10 95.68
02:41:01 AM 1 5.08 0.00 0.19 0.00 0.10 94.63
02:42:01 AM all 4.49 0.00 0.18 0.00 0.10 95.23
02:42:01 AM 0 3.80 0.00 0.17 0.00 0.10 95.94
02:42:01 AM 1 5.18 0.00 0.18 0.00 0.10 94.53
02:43:01 AM all 4.48 0.00 0.18 0.00 0.09 95.24
02:43:01 AM 0 4.62 0.00 0.20 0.00 0.10 95.08
02:43:01 AM 1 4.35 0.00 0.17 0.00 0.08 95.40
02:44:01 AM all 4.37 0.00 0.26 0.00 0.08 95.28
02:44:01 AM 0 4.28 0.00 0.28 0.00 0.08 95.35
02:44:01 AM 1 4.47 0.00 0.23 0.00 0.08 95.22
02:45:01 AM all 6.84 0.00 0.65 0.00 0.09 92.41
02:45:01 AM 0 1.52 0.00 0.15 0.00 0.08 98.25
02:45:01 AM 1 12.50 0.00 1.19 0.00 0.11 86.20
02:45:01 AM CPU %user %nice %system %iowait %steal %idle
02:46:01 AM all 2.58 0.00 1.45 0.00 0.06 95.92
02:46:01 AM 0 0.62 0.00 0.10 0.00 0.07 99.22
02:46:01 AM 1 4.59 0.00 2.83 0.00 0.05 92.53
02:47:01 AM all 0.33 0.00 0.06 0.00 0.06 99.55
02:47:01 AM 0 0.55 0.00 0.05 0.00 0.07 99.33
02:47:01 AM 1 0.12 0.00 0.07 0.00 0.05 99.77
02:48:01 AM all 0.55 0.00 0.08 0.00 0.05 99.32
02:48:01 AM 0 0.67 0.00 0.10 0.00 0.07 99.17
02:48:01 AM 1 0.43 0.00 0.05 0.00 0.03 99.48
02:49:01 AM all 0.29 0.00 0.07 0.00 0.04 99.60
02:49:01 AM 0 0.50 0.00 0.07 0.00 0.03 99.40
02:49:01 AM 1 0.08 0.00 0.07 0.00 0.05 99.80
02:50:00 AM all 0.36 0.00 0.08 0.00 0.06 99.50
02:50:00 AM 0 0.39 0.00 0.07 0.00 0.05 99.49
02:50:00 AM 1 0.34 0.00 0.08 0.00 0.07 99.51
02:50:01 AM all 0.73 0.00 1.46 0.00 0.00 97.81
02:50:01 AM 0 1.47 0.00 1.47 0.00 0.00 97.06
02:50:01 AM 1 0.00 0.00 1.45 0.00 0.00 98.55
02:51:01 AM all 0.35 0.00 0.05 0.00 0.04 99.56
02:51:01 AM 0 0.58 0.00 0.05 0.00 0.03 99.33
02:51:01 AM 1 0.12 0.00 0.05 0.00 0.05 99.78
02:52:01 AM all 0.53 0.00 0.08 0.00 0.05 99.34
02:52:01 AM 0 0.57 0.00 0.07 0.00 0.05 99.32
02:52:01 AM 1 0.48 0.00 0.10 0.00 0.05 99.37
02:53:01 AM all 0.23 0.00 0.08 0.00 0.04 99.64
02:53:01 AM 0 0.37 0.00 0.07 0.00 0.02 99.55
02:53:01 AM 1 0.10 0.00 0.10 0.00 0.07 99.73
02:54:01 AM all 0.48 0.00 0.07 0.00 0.05 99.40
02:54:01 AM 0 0.82 0.00 0.05 0.00 0.03 99.10
02:54:01 AM 1 0.15 0.00 0.08 0.00 0.07 99.70
02:55:01 AM all 0.37 0.00 0.07 0.00 0.05 99.52
02:55:01 AM 0 0.52 0.00 0.03 0.00 0.03 99.42
02:55:01 AM 1 0.22 0.00 0.10 0.00 0.07 99.62
02:55:01 AM CPU %user %nice %system %iowait %steal %idle
02:56:01 AM all 0.53 0.00 0.08 0.00 0.05 99.34
02:56:01 AM 0 0.73 0.00 0.07 0.00 0.03 99.17
02:56:01 AM 1 0.32 0.00 0.10 0.00 0.07 99.52
02:57:01 AM all 0.37 0.00 0.08 0.00 0.03 99.52
02:57:01 AM 0 0.15 0.00 0.12 0.00 0.03 99.70
02:57:01 AM 1 0.58 0.00 0.05 0.00 0.03 99.33
02:58:01 AM all 1.36 0.00 0.16 0.01 0.06 98.42
02:58:01 AM 0 2.13 0.00 0.24 0.00 0.05 97.58
02:58:01 AM 1 0.60 0.00 0.08 0.02 0.07 99.23
02:59:01 AM all 6.83 0.00 1.95 0.00 0.09 91.13
02:59:01 AM 0 12.81 0.00 3.75 0.00 0.10 83.34
02:59:01 AM 1 1.02 0.00 0.20 0.00 0.08 98.70
03:00:01 AM all 4.55 0.00 0.18 0.00 0.11 95.17
03:00:01 AM 0 3.16 0.00 0.18 0.00 0.10 96.56
03:00:01 AM 1 5.94 0.00 0.17 0.00 0.12 93.78
03:01:01 AM all 4.61 0.00 0.23 0.00 0.11 95.05
03:01:01 AM 0 3.63 0.00 0.22 0.00 0.10 96.05
03:01:01 AM 1 5.58 0.00 0.25 0.00 0.12 94.05
03:02:01 AM all 4.66 0.00 0.23 0.00 0.11 95.00
03:02:01 AM 0 6.60 0.00 0.27 0.00 0.12 93.01
03:02:01 AM 1 2.72 0.00 0.20 0.00 0.10 96.98
03:03:01 AM all 4.52 0.00 0.22 0.00 0.09 95.17
03:03:01 AM 0 2.49 0.00 0.18 0.00 0.08 97.24
03:03:01 AM 1 6.56 0.00 0.25 0.00 0.10 93.09
03:04:01 AM all 4.79 0.00 0.23 0.00 0.10 94.88
03:04:01 AM 0 5.15 0.00 0.25 0.00 0.10 94.50
03:04:01 AM 1 4.43 0.00 0.20 0.00 0.10 95.27
03:05:01 AM all 5.83 0.00 1.01 0.00 0.09 93.07
03:05:01 AM 0 3.30 0.00 0.23 0.00 0.08 96.39
03:05:01 AM 1 8.46 0.00 1.82 0.00 0.09 89.63
03:06:01 AM all 2.40 0.00 1.10 0.00 0.06 96.44
03:06:01 AM 0 3.10 0.00 2.02 0.00 0.05 94.84
03:06:01 AM 1 1.70 0.00 0.19 0.00 0.07 98.05
03:06:01 AM CPU %user %nice %system %iowait %steal %idle
03:07:01 AM all 0.35 0.00 0.06 0.00 0.04 99.55
03:07:01 AM 0 0.13 0.00 0.07 0.00 0.05 99.75
03:07:01 AM 1 0.57 0.00 0.05 0.00 0.03 99.35
03:08:01 AM all 0.50 0.00 0.09 0.01 0.06 99.34
03:08:01 AM 0 0.40 0.00 0.13 0.02 0.07 99.38
03:08:01 AM 1 0.60 0.00 0.05 0.00 0.05 99.30
03:09:01 AM all 0.28 0.00 0.08 0.00 0.04 99.61
03:09:01 AM 0 0.13 0.00 0.07 0.00 0.03 99.77
03:09:01 AM 1 0.42 0.00 0.08 0.00 0.05 99.45
03:10:01 AM all 0.51 0.00 0.08 0.00 0.05 99.37
03:10:01 AM 0 0.45 0.00 0.10 0.00 0.05 99.40
03:10:01 AM 1 0.57 0.00 0.05 0.00 0.05 99.33
03:11:01 AM all 0.30 0.00 0.08 0.00 0.06 99.56
03:11:01 AM 0 0.17 0.00 0.12 0.00 0.08 99.63
03:11:01 AM 1 0.43 0.00 0.05 0.00 0.03 99.48
03:12:01 AM all 0.42 0.00 0.08 0.00 0.06 99.44
03:12:01 AM 0 0.20 0.00 0.10 0.00 0.08 99.62
03:12:01 AM 1 0.63 0.00 0.07 0.00 0.03 99.27
03:13:01 AM all 0.35 0.00 0.07 0.00 0.08 99.51
03:13:01 AM 0 0.12 0.00 0.07 0.00 0.07 99.75
03:13:01 AM 1 0.58 0.00 0.07 0.00 0.08 99.27
03:14:01 AM all 0.45 0.00 0.10 0.00 0.03 99.42
03:14:01 AM 0 0.30 0.00 0.10 0.00 0.03 99.57
03:14:01 AM 1 0.60 0.00 0.10 0.00 0.03 99.27
03:15:01 AM all 0.33 0.00 0.08 0.00 0.05 99.54
03:15:01 AM 0 0.53 0.00 0.05 0.00 0.05 99.37
03:15:01 AM 1 0.13 0.00 0.10 0.00 0.05 99.72
03:16:01 AM all 0.48 0.20 0.16 0.01 0.05 99.11
03:16:01 AM 0 0.63 0.00 0.15 0.02 0.05 99.15
03:16:01 AM 1 0.32 0.40 0.17 0.00 0.05 99.07
03:17:01 AM all 0.33 0.00 0.08 0.00 0.04 99.55
03:17:01 AM 0 0.57 0.00 0.08 0.00 0.05 99.30
03:17:01 AM 1 0.10 0.00 0.07 0.00 0.03 99.80
03:17:01 AM CPU %user %nice %system %iowait %steal %idle
03:18:01 AM all 1.87 0.00 0.24 0.00 0.06 97.82
03:18:01 AM 0 0.58 0.00 0.07 0.00 0.03 99.32
03:18:01 AM 1 3.19 0.00 0.43 0.00 0.09 96.30
03:19:01 AM all 6.30 0.00 1.69 0.00 0.09 91.93
03:19:01 AM 0 2.25 0.00 0.17 0.00 0.08 97.49
03:19:01 AM 1 10.53 0.00 3.29 0.00 0.09 86.09
03:20:01 AM all 4.52 0.00 0.20 0.00 0.08 95.19
03:20:01 AM 0 1.66 0.00 0.15 0.00 0.07 98.12
03:20:01 AM 1 7.39 0.00 0.25 0.00 0.10 92.26
03:21:01 AM all 4.56 0.00 0.22 0.00 0.09 95.13
03:21:01 AM 0 2.25 0.00 0.15 0.00 0.08 97.52
03:21:01 AM 1 6.88 0.00 0.28 0.00 0.10 92.74
03:22:01 AM all 4.53 0.00 0.19 0.00 0.10 95.17
03:22:01 AM 0 2.64 0.00 0.15 0.00 0.08 97.12
03:22:01 AM 1 6.43 0.00 0.23 0.00 0.12 93.22
03:23:01 AM all 4.62 0.00 0.19 0.00 0.10 95.09
03:23:01 AM 0 2.54 0.00 0.18 0.00 0.10 97.17
03:23:01 AM 1 6.69 0.00 0.20 0.00 0.10 93.01
03:24:01 AM all 4.45 0.00 0.20 0.00 0.09 95.26
03:24:01 AM 0 2.53 0.00 0.20 0.00 0.08 97.18
03:24:01 AM 1 6.36 0.00 0.20 0.00 0.10 93.34
03:25:01 AM all 5.66 0.00 1.47 0.00 0.09 92.78
03:25:01 AM 0 0.69 0.00 0.13 0.00 0.07 99.11
03:25:01 AM 1 10.84 0.00 2.86 0.00 0.10 86.19
03:26:01 AM all 2.02 0.00 0.48 0.00 0.06 97.44
03:26:01 AM 0 0.15 0.00 0.15 0.00 0.07 99.63
03:26:01 AM 1 3.91 0.00 0.81 0.00 0.05 95.22
03:27:01 AM all 0.30 0.00 0.06 0.00 0.05 99.59
03:27:01 AM 0 0.15 0.00 0.08 0.00 0.07 99.70
03:27:01 AM 1 0.45 0.00 0.03 0.00 0.03 99.48
03:28:01 AM all 0.43 0.00 0.08 0.00 0.05 99.43
03:28:01 AM 0 0.47 0.00 0.07 0.00 0.05 99.42
03:28:01 AM 1 0.40 0.00 0.10 0.00 0.05 99.45
03:28:01 AM CPU %user %nice %system %iowait %steal %idle
03:29:01 AM all 0.33 0.00 0.08 0.00 0.06 99.53
03:29:01 AM 0 0.55 0.00 0.05 0.00 0.03 99.37
03:29:01 AM 1 0.12 0.00 0.10 0.00 0.08 99.70
03:30:01 AM all 0.48 0.00 0.09 0.00 0.06 99.37
03:30:01 AM 0 0.58 0.00 0.07 0.00 0.05 99.30
03:30:01 AM 1 0.38 0.00 0.12 0.00 0.07 99.43
03:31:01 AM all 0.29 0.00 0.08 0.00 0.05 99.57
03:31:01 AM 0 0.38 0.00 0.03 0.00 0.02 99.57
03:31:01 AM 1 0.20 0.00 0.13 0.00 0.08 99.58
03:32:01 AM all 0.52 0.00 0.08 0.00 0.05 99.35
03:32:01 AM 0 0.50 0.00 0.07 0.00 0.03 99.40
03:32:01 AM 1 0.53 0.00 0.10 0.00 0.07 99.30
03:33:01 AM all 0.33 0.00 0.08 0.00 0.05 99.54
03:33:01 AM 0 0.55 0.00 0.12 0.00 0.05 99.28
03:33:01 AM 1 0.10 0.00 0.05 0.00 0.05 99.80
03:34:01 AM all 0.38 0.00 0.08 0.00 0.03 99.50
03:34:01 AM 0 0.45 0.00 0.10 0.00 0.05 99.40
03:34:01 AM 1 0.32 0.00 0.07 0.00 0.02 99.60
03:35:01 AM all 0.33 0.00 0.06 0.00 0.04 99.57
03:35:01 AM 0 0.25 0.00 0.08 0.00 0.05 99.62
03:35:01 AM 1 0.40 0.00 0.03 0.00 0.03 99.53
03:36:01 AM all 0.43 0.00 0.08 0.00 0.04 99.44
03:36:01 AM 0 0.23 0.00 0.10 0.00 0.07 99.60
03:36:01 AM 1 0.63 0.00 0.07 0.00 0.02 99.28
03:37:01 AM all 0.23 0.00 0.05 0.00 0.03 99.69
03:37:01 AM 0 0.40 0.00 0.07 0.00 0.03 99.50
03:37:01 AM 1 0.05 0.00 0.03 0.00 0.03 99.88
03:38:01 AM all 2.08 0.00 0.17 0.00 0.06 97.70
03:38:01 AM 0 0.65 0.00 0.08 0.00 0.03 99.23
03:38:01 AM 1 3.53 0.00 0.25 0.00 0.08 96.13
03:39:01 AM all 7.35 0.00 2.94 0.00 0.09 89.62
03:39:01 AM 0 1.35 0.00 0.17 0.00 0.07 98.41
03:39:01 AM 1 13.78 0.00 5.90 0.00 0.11 80.22
03:39:01 AM CPU %user %nice %system %iowait %steal %idle
03:40:01 AM all 4.38 0.00 0.33 0.00 0.08 95.21
03:40:01 AM 0 3.58 0.00 0.30 0.00 0.08 96.04
03:40:01 AM 1 5.17 0.00 0.35 0.00 0.08 94.39
03:41:01 AM all 4.52 0.00 0.36 0.00 0.10 95.02
03:41:01 AM 0 1.80 0.00 0.18 0.00 0.10 97.91
03:41:01 AM 1 7.24 0.00 0.54 0.00 0.10 92.12
03:42:01 AM all 4.47 0.00 0.36 0.00 0.09 95.08
03:42:01 AM 0 3.98 0.00 0.37 0.00 0.08 95.57
03:42:01 AM 1 4.95 0.00 0.35 0.00 0.10 94.59
03:43:01 AM all 4.48 0.00 0.35 0.00 0.08 95.08
03:43:01 AM 0 2.96 0.00 0.28 0.00 0.08 96.67
03:43:01 AM 1 6.00 0.00 0.42 0.00 0.08 93.49
03:44:02 AM all 4.48 0.00 0.35 0.00 0.10 95.07
03:44:02 AM 0 5.43 0.00 0.37 0.00 0.10 94.11
03:44:02 AM 1 3.53 0.00 0.33 0.00 0.10 96.04
03:45:01 AM all 7.55 0.00 0.46 0.00 0.10 91.89
03:45:01 AM 0 6.09 0.00 0.39 0.00 0.09 93.43
03:45:01 AM 1 9.00 0.00 0.53 0.00 0.12 90.35
03:46:01 AM all 0.77 0.00 0.11 0.00 0.06 99.06
03:46:01 AM 0 0.57 0.00 0.10 0.00 0.07 99.27
03:46:01 AM 1 0.97 0.00 0.12 0.00 0.05 98.86
03:47:01 AM all 0.18 0.00 0.08 0.00 0.07 99.67
03:47:01 AM 0 0.05 0.00 0.07 0.00 0.05 99.83
03:47:01 AM 1 0.32 0.00 0.08 0.00 0.08 99.51
03:48:01 AM all 0.47 0.00 0.08 0.00 0.06 99.39
03:48:01 AM 0 0.33 0.00 0.08 0.00 0.05 99.53
03:48:01 AM 1 0.60 0.00 0.08 0.00 0.07 99.25
03:49:01 AM all 0.15 0.00 0.07 0.00 0.05 99.73
03:49:01 AM 0 0.02 0.00 0.02 0.00 0.00 99.97
03:49:01 AM 1 0.28 0.00 0.12 0.00 0.10 99.50
03:50:01 AM all 0.31 0.00 0.06 0.00 0.06 99.57
03:50:01 AM 0 0.10 0.00 0.03 0.00 0.07 99.80
03:50:01 AM 1 0.52 0.00 0.08 0.00 0.05 99.35
03:50:01 AM CPU %user %nice %system %iowait %steal %idle
03:51:01 AM all 0.49 0.00 0.07 0.01 0.06 99.37
03:51:01 AM 0 0.37 0.00 0.08 0.00 0.05 99.50
03:51:01 AM 1 0.62 0.00 0.05 0.02 0.07 99.25
03:52:01 AM all 0.38 0.00 0.09 0.00 0.05 99.48
03:52:01 AM 0 0.12 0.00 0.10 0.00 0.05 99.73
03:52:01 AM 1 0.63 0.00 0.08 0.00 0.05 99.23
03:53:01 AM all 7.51 0.00 2.73 0.01 0.08 89.67
03:53:01 AM 0 2.30 0.00 0.23 0.02 0.08 97.36
03:53:01 AM 1 13.14 0.00 5.43 0.00 0.07 81.35
03:54:01 AM all 5.42 0.00 1.97 0.00 0.07 92.55
03:54:01 AM 0 0.63 0.00 0.13 0.00 0.07 99.17
03:54:01 AM 1 10.53 0.00 3.93 0.00 0.07 85.48
03:55:01 AM all 0.33 0.00 0.06 0.00 0.06 99.55
03:55:01 AM 0 0.57 0.00 0.07 0.00 0.05 99.32
03:55:01 AM 1 0.10 0.00 0.05 0.00 0.07 99.78
03:56:01 AM all 1.82 0.00 0.21 0.00 0.08 97.90
03:56:01 AM 0 0.57 0.00 0.12 0.00 0.07 99.25
03:56:01 AM 1 3.08 0.00 0.31 0.00 0.08 96.53
03:57:01 AM all 6.51 0.00 1.81 0.00 0.10 91.57
03:57:01 AM 0 1.10 0.00 0.20 0.00 0.08 98.61
03:57:01 AM 1 12.12 0.00 3.49 0.00 0.12 84.27
03:58:01 AM all 4.37 0.00 0.19 0.00 0.08 95.35
03:58:01 AM 0 2.61 0.00 0.20 0.00 0.08 97.11
03:58:01 AM 1 6.14 0.00 0.18 0.00 0.08 93.60
03:59:01 AM all 4.39 0.00 0.18 0.00 0.08 95.35
03:59:01 AM 0 3.61 0.00 0.17 0.00 0.07 96.15
03:59:01 AM 1 5.16 0.00 0.18 0.00 0.10 94.55
04:00:01 AM all 4.34 0.00 0.19 0.00 0.09 95.38
04:00:01 AM 0 2.54 0.00 0.18 0.00 0.08 97.19
04:00:01 AM 1 6.14 0.00 0.20 0.00 0.10 93.56
04:01:01 AM all 4.42 0.00 0.23 0.00 0.09 95.26
04:01:01 AM 0 1.57 0.00 0.18 0.00 0.08 98.16
04:01:01 AM 1 7.26 0.00 0.28 0.00 0.10 92.35
04:01:01 AM CPU %user %nice %system %iowait %steal %idle
04:02:01 AM all 4.41 0.00 0.18 0.00 0.10 95.31
04:02:01 AM 0 2.06 0.00 0.18 0.00 0.08 97.68
04:02:01 AM 1 6.76 0.00 0.18 0.00 0.12 92.94
04:03:01 AM all 5.67 0.00 0.33 0.00 0.09 93.91
04:03:01 AM 0 1.44 0.00 0.17 0.00 0.08 98.31
04:03:01 AM 1 10.02 0.00 0.50 0.00 0.10 89.38
04:04:01 AM all 7.28 0.00 2.25 0.00 0.08 90.40
04:04:01 AM 0 2.40 0.00 3.34 0.00 0.08 94.17
04:04:01 AM 1 12.54 0.00 1.07 0.00 0.07 86.32
04:05:01 AM all 6.03 0.00 1.82 0.00 0.09 92.06
04:05:01 AM 0 2.66 0.00 0.15 0.00 0.08 97.11
04:05:01 AM 1 9.48 0.00 3.53 0.00 0.10 86.89
04:06:01 AM all 4.37 0.00 0.19 0.00 0.09 95.35
04:06:01 AM 0 1.55 0.00 0.15 0.00 0.07 98.23
04:06:01 AM 1 7.18 0.00 0.23 0.00 0.12 92.47
04:07:01 AM all 4.47 0.00 0.19 0.00 0.09 95.24
04:07:01 AM 0 3.93 0.00 0.17 0.00 0.08 95.82
04:07:01 AM 1 5.01 0.00 0.22 0.00 0.10 94.67
04:08:01 AM all 4.44 0.00 0.18 0.00 0.11 95.27
04:08:01 AM 0 4.48 0.00 0.22 0.00 0.10 95.20
04:08:01 AM 1 4.40 0.00 0.15 0.00 0.12 95.33
04:09:01 AM all 4.36 0.00 0.18 0.00 0.10 95.35
04:09:01 AM 0 2.77 0.00 0.17 0.00 0.08 96.98
04:09:01 AM 1 5.95 0.00 0.20 0.00 0.12 93.73
04:10:01 AM all 4.60 0.00 0.19 0.00 0.12 95.10
04:10:01 AM 0 4.59 0.00 0.22 0.00 0.12 95.07
04:10:01 AM 1 4.60 0.00 0.17 0.00 0.12 95.12
04:11:01 AM all 6.11 0.00 2.20 0.00 0.09 91.60
04:11:01 AM 0 8.90 0.00 4.28 0.00 0.07 86.75
04:11:01 AM 1 3.42 0.00 0.20 0.00 0.10 96.27
04:12:01 AM all 8.38 0.00 2.78 0.00 0.09 88.75
04:12:01 AM 0 15.50 0.00 5.54 0.00 0.09 78.88
04:12:01 AM 1 1.57 0.00 0.13 0.00 0.10 98.20
04:12:01 AM CPU %user %nice %system %iowait %steal %idle
04:13:01 AM all 5.37 0.00 0.40 0.00 0.11 94.11
04:13:01 AM 0 5.52 0.00 0.40 0.00 0.12 93.97
04:13:01 AM 1 5.23 0.00 0.40 0.00 0.10 94.26
04:14:01 AM all 4.48 0.00 0.32 0.00 0.12 95.09
04:14:01 AM 0 4.60 0.00 0.33 0.00 0.12 94.95
04:14:01 AM 1 4.36 0.00 0.30 0.00 0.12 95.22
04:15:01 AM all 4.35 0.00 0.33 0.00 0.12 95.20
04:15:01 AM 0 2.84 0.00 0.25 0.00 0.10 96.81
04:15:01 AM 1 5.87 0.00 0.40 0.00 0.13 93.60
04:16:01 AM all 4.46 0.00 0.33 0.00 0.11 95.09
04:16:01 AM 0 2.92 0.00 0.28 0.00 0.10 96.69
04:16:01 AM 1 6.00 0.00 0.38 0.00 0.12 93.49
04:17:01 AM all 4.39 0.00 0.34 0.00 0.12 95.15
04:17:01 AM 0 2.92 0.00 0.23 0.00 0.10 96.74
04:17:01 AM 1 5.86 0.00 0.45 0.00 0.13 93.55
04:18:01 AM all 4.39 0.00 0.31 0.00 0.10 95.20
04:18:01 AM 0 3.44 0.00 0.28 0.00 0.10 96.17
04:18:01 AM 1 5.33 0.00 0.33 0.00 0.10 94.23
04:19:01 AM all 5.22 0.00 0.33 0.00 0.09 94.36
04:19:01 AM 0 3.48 0.00 0.32 0.00 0.07 96.14
04:19:01 AM 1 6.97 0.00 0.33 0.00 0.12 92.57
04:20:01 AM all 0.28 0.00 0.06 0.00 0.07 99.60
04:20:01 AM 0 0.50 0.00 0.08 0.00 0.08 99.33
04:20:01 AM 1 0.05 0.00 0.03 0.00 0.05 99.87
04:21:01 AM all 0.33 0.00 0.07 0.00 0.07 99.53
04:21:01 AM 0 0.55 0.00 0.07 0.00 0.05 99.33
04:21:01 AM 1 0.12 0.00 0.07 0.00 0.08 99.73
04:22:01 AM all 0.44 0.00 0.07 0.00 0.07 99.42
04:22:01 AM 0 0.08 0.00 0.05 0.00 0.08 99.78
04:22:01 AM 1 0.80 0.00 0.08 0.00 0.05 99.07
04:23:01 AM all 0.33 0.00 0.06 0.01 0.08 99.53
04:23:01 AM 0 0.08 0.00 0.07 0.02 0.07 99.77
04:23:01 AM 1 0.57 0.00 0.05 0.00 0.08 99.30
04:23:01 AM CPU %user %nice %system %iowait %steal %idle
04:24:01 AM all 0.48 0.00 0.07 0.00 0.07 99.39
04:24:01 AM 0 0.32 0.00 0.08 0.00 0.08 99.52
04:24:01 AM 1 0.63 0.00 0.05 0.00 0.05 99.27
04:25:01 AM all 0.32 0.00 0.05 0.00 0.07 99.57
04:25:01 AM 0 0.12 0.00 0.08 0.00 0.10 99.70
04:25:01 AM 1 0.52 0.00 0.02 0.00 0.03 99.43
04:26:01 AM all 4.32 0.00 2.95 0.00 0.08 92.65
04:26:01 AM 0 6.62 0.00 5.80 0.00 0.07 87.51
04:26:01 AM 1 2.09 0.00 0.18 0.00 0.08 97.65
04:27:01 AM all 7.76 0.00 3.25 0.00 0.09 88.91
04:27:01 AM 0 6.88 0.00 2.29 0.00 0.09 90.74
04:27:01 AM 1 8.66 0.00 4.22 0.00 0.09 87.03
04:28:01 AM all 1.11 0.00 0.13 0.00 0.06 98.71
04:28:01 AM 0 0.18 0.00 0.12 0.00 0.10 99.60
04:28:01 AM 1 2.03 0.00 0.13 0.00 0.02 97.82
04:29:01 AM all 0.28 0.00 0.07 0.00 0.07 99.59
04:29:01 AM 0 0.52 0.00 0.10 0.00 0.10 99.28
04:29:01 AM 1 0.03 0.00 0.03 0.00 0.03 99.90
04:30:01 AM all 6.28 0.00 1.73 0.00 0.09 91.91
04:30:01 AM 0 12.48 0.00 3.42 0.00 0.07 84.03
04:30:01 AM 1 0.45 0.00 0.13 0.00 0.10 99.32
04:31:01 AM all 7.60 0.15 3.79 0.00 0.07 88.39
04:31:01 AM 0 7.95 0.00 4.86 0.00 0.07 87.12
04:31:01 AM 1 7.24 0.31 2.72 0.00 0.07 89.66
04:32:01 AM all 7.67 0.00 2.73 0.00 0.10 89.49
04:32:01 AM 0 0.18 0.00 0.15 0.00 0.12 99.55
04:32:01 AM 1 15.75 0.00 5.51 0.00 0.09 78.65
04:33:01 AM all 4.67 0.00 1.72 0.00 0.07 93.55
04:33:01 AM 0 0.63 0.00 0.10 0.00 0.08 99.18
04:33:01 AM 1 8.87 0.00 3.41 0.00 0.05 87.67
04:34:01 AM all 0.34 0.00 0.07 0.00 0.08 99.52
04:34:01 AM 0 0.58 0.00 0.08 0.00 0.10 99.23
04:34:01 AM 1 0.10 0.00 0.05 0.00 0.05 99.80
04:34:01 AM CPU %user %nice %system %iowait %steal %idle
04:35:01 AM all 3.55 0.00 0.31 0.00 0.08 96.06
04:35:01 AM 0 2.99 0.00 0.27 0.00 0.08 96.66
04:35:01 AM 1 4.12 0.00 0.35 0.00 0.07 95.46
04:36:01 AM all 7.01 0.00 2.67 0.00 0.08 90.25
04:36:01 AM 0 12.19 0.00 5.22 0.00 0.09 82.50
04:36:01 AM 1 1.98 0.00 0.20 0.00 0.07 97.75
04:37:01 AM all 4.32 0.00 0.33 0.00 0.11 95.24
04:37:01 AM 0 1.25 0.00 0.15 0.00 0.10 98.50
04:37:01 AM 1 7.39 0.00 0.50 0.00 0.12 91.99
04:38:01 AM all 4.36 0.00 0.36 0.00 0.11 95.17
04:38:01 AM 0 2.44 0.00 0.30 0.00 0.10 97.16
04:38:01 AM 1 6.29 0.00 0.42 0.00 0.12 93.18
04:39:01 AM all 4.36 0.00 0.33 0.00 0.11 95.19
04:39:01 AM 0 1.85 0.00 0.17 0.00 0.08 97.90
04:39:01 AM 1 6.87 0.00 0.50 0.00 0.13 92.49
04:40:01 AM all 4.36 0.00 0.33 0.00 0.11 95.19
04:40:01 AM 0 3.06 0.00 0.28 0.00 0.10 96.56
04:40:01 AM 1 5.67 0.00 0.38 0.00 0.12 93.83
04:41:01 AM all 4.19 0.00 0.34 0.01 0.11 95.35
04:41:01 AM 0 2.70 0.00 0.30 0.02 0.10 96.88
04:41:01 AM 1 5.69 0.00 0.38 0.00 0.12 93.81
04:42:01 AM all 7.14 0.00 0.42 0.00 0.10 92.34
04:42:01 AM 0 4.84 0.00 0.33 0.00 0.10 94.73
04:42:01 AM 1 9.45 0.00 0.50 0.00 0.10 89.95
04:43:01 AM all 0.84 0.00 0.13 0.00 0.10 98.94
04:43:01 AM 0 1.02 0.00 0.15 0.00 0.12 98.71
04:43:01 AM 1 0.65 0.00 0.10 0.00 0.08 99.17
04:44:01 AM all 0.90 0.00 0.14 0.00 0.11 98.85
04:44:01 AM 0 0.50 0.00 0.10 0.00 0.10 99.30
04:44:01 AM 1 1.30 0.00 0.18 0.00 0.12 98.39
04:45:01 AM all 0.79 0.00 0.14 0.00 0.12 98.95
04:45:01 AM 0 0.25 0.00 0.12 0.00 0.08 99.55
04:45:01 AM 1 1.32 0.00 0.17 0.00 0.15 98.36
04:45:01 AM CPU %user %nice %system %iowait %steal %idle
04:46:01 AM all 0.97 0.00 0.13 0.00 0.11 98.79
04:46:01 AM 0 0.80 0.00 0.10 0.00 0.08 99.02
04:46:01 AM 1 1.14 0.00 0.17 0.00 0.13 98.56
04:47:01 AM all 0.90 0.00 0.12 0.00 0.11 98.87
04:47:01 AM 0 0.75 0.00 0.10 0.00 0.10 99.05
04:47:01 AM 1 1.05 0.00 0.13 0.00 0.12 98.70
04:48:01 AM all 1.14 0.00 0.13 0.00 0.10 98.63
04:48:01 AM 0 0.64 0.00 0.12 0.00 0.08 99.16
04:48:01 AM 1 1.65 0.00 0.13 0.00 0.12 98.10
04:49:01 AM all 8.08 0.00 3.84 0.00 0.08 87.99
04:49:01 AM 0 4.06 0.00 0.49 0.00 0.08 95.36
04:49:01 AM 1 12.32 0.00 7.38 0.00 0.07 80.22
04:50:01 AM all 8.79 0.00 4.04 0.00 0.08 87.10
04:50:01 AM 0 17.37 0.00 8.00 0.00 0.05 74.58
04:50:01 AM 1 0.33 0.00 0.13 0.00 0.10 99.43
04:51:01 AM all 8.88 0.00 3.57 0.00 0.08 87.47
04:51:01 AM 0 17.33 0.00 7.11 0.00 0.07 75.49
04:51:01 AM 1 0.65 0.00 0.13 0.00 0.08 99.13
04:52:02 AM all 8.07 0.00 3.63 0.00 0.09 88.21
04:52:02 AM 0 15.80 0.00 7.25 0.00 0.07 76.89
04:52:02 AM 1 0.62 0.00 0.13 0.00 0.12 99.13
04:53:01 AM all 7.11 0.00 2.95 0.01 0.08 89.85
04:53:01 AM 0 3.74 0.00 2.59 0.00 0.09 93.59
04:53:01 AM 1 10.64 0.00 3.32 0.02 0.07 85.95
04:54:01 AM all 7.59 0.00 2.78 0.00 0.10 89.53
04:54:01 AM 0 0.84 0.00 0.15 0.00 0.10 98.91
04:54:01 AM 1 14.87 0.00 5.61 0.00 0.11 79.41
04:55:01 AM all 5.27 0.00 0.39 0.00 0.12 94.22
04:55:01 AM 0 2.59 0.00 0.22 0.00 0.10 97.09
04:55:01 AM 1 7.96 0.00 0.57 0.00 0.13 91.33
04:56:01 AM all 4.41 0.00 0.33 0.00 0.11 95.16
04:56:01 AM 0 3.65 0.00 0.27 0.00 0.10 95.98
04:56:01 AM 1 5.17 0.00 0.38 0.00 0.12 94.33
04:56:01 AM CPU %user %nice %system %iowait %steal %idle
04:57:01 AM all 4.51 0.00 0.36 0.00 0.10 95.03
04:57:01 AM 0 4.06 0.00 0.35 0.00 0.10 95.49
04:57:01 AM 1 4.95 0.00 0.37 0.00 0.10 94.58
04:58:01 AM all 4.52 0.00 0.34 0.00 0.11 95.03
04:58:01 AM 0 5.86 0.00 0.45 0.00 0.12 93.57
04:58:01 AM 1 3.17 0.00 0.23 0.00 0.10 96.49
04:59:01 AM all 4.36 0.00 0.33 0.00 0.11 95.20
04:59:01 AM 0 4.80 0.00 0.30 0.00 0.10 94.80
04:59:01 AM 1 3.93 0.00 0.35 0.00 0.12 95.61
05:00:01 AM all 4.33 0.00 0.37 0.00 0.10 95.21
05:00:01 AM 0 3.87 0.00 0.35 0.00 0.10 95.68
05:00:01 AM 1 4.78 0.00 0.38 0.00 0.10 94.73
05:01:01 AM all 5.62 0.00 0.31 0.00 0.09 93.98
05:01:01 AM 0 6.10 0.00 0.27 0.00 0.07 93.57
05:01:01 AM 1 5.15 0.00 0.35 0.00 0.12 94.38
05:02:01 AM all 0.33 0.00 0.07 0.00 0.06 99.55
05:02:01 AM 0 0.55 0.00 0.05 0.00 0.07 99.33
05:02:01 AM 1 0.10 0.00 0.08 0.00 0.05 99.77
05:03:01 AM all 0.33 0.00 0.05 0.00 0.06 99.56
05:03:01 AM 0 0.53 0.00 0.03 0.00 0.03 99.40
05:03:01 AM 1 0.13 0.00 0.07 0.00 0.08 99.72
05:04:01 AM all 0.50 0.00 0.08 0.00 0.08 99.34
05:04:01 AM 0 0.58 0.00 0.07 0.00 0.07 99.28
05:04:01 AM 1 0.42 0.00 0.10 0.00 0.08 99.40
05:05:01 AM all 0.28 0.00 0.06 0.00 0.06 99.60
05:05:01 AM 0 0.48 0.00 0.07 0.00 0.05 99.40
05:05:01 AM 1 0.08 0.00 0.05 0.00 0.07 99.80
05:06:01 AM all 0.33 0.00 0.08 0.00 0.05 99.53
05:06:01 AM 0 0.30 0.00 0.12 0.00 0.07 99.51
05:06:01 AM 1 0.37 0.00 0.05 0.00 0.03 99.55
05:07:01 AM all 0.28 0.00 0.07 0.00 0.06 99.59
05:07:01 AM 0 0.50 0.00 0.05 0.00 0.07 99.38
05:07:01 AM 1 0.07 0.00 0.08 0.00 0.05 99.80
05:07:01 AM CPU %user %nice %system %iowait %steal %idle
05:08:01 AM all 4.04 0.00 1.87 0.00 0.07 94.02
05:08:01 AM 0 1.20 0.00 0.18 0.00 0.07 98.55
05:08:01 AM 1 6.96 0.00 3.61 0.00 0.07 89.36
05:09:01 AM all 7.09 0.00 3.95 0.00 0.08 88.89
05:09:01 AM 0 7.55 0.00 5.12 0.00 0.07 87.26
05:09:01 AM 1 6.61 0.00 2.74 0.00 0.09 90.56
05:10:01 AM all 1.94 0.00 0.18 0.00 0.07 97.82
05:10:01 AM 0 3.49 0.00 0.23 0.00 0.03 96.24
05:10:01 AM 1 0.39 0.00 0.12 0.00 0.10 99.40
05:11:01 AM all 0.34 0.00 0.06 0.00 0.07 99.53
05:11:01 AM 0 0.08 0.00 0.07 0.00 0.05 99.80
05:11:01 AM 1 0.60 0.00 0.05 0.00 0.08 99.27
05:12:01 AM all 5.15 0.00 1.62 0.00 0.08 93.15
05:12:01 AM 0 0.40 0.00 0.15 0.00 0.08 99.37
05:12:01 AM 1 10.20 0.00 3.17 0.00 0.07 86.56
05:13:01 AM all 0.93 0.00 0.15 0.00 0.11 98.81
05:13:01 AM 0 1.53 0.00 0.18 0.00 0.08 98.20
05:13:01 AM 1 0.33 0.00 0.12 0.00 0.13 99.41
05:14:01 AM all 5.07 0.00 2.29 0.00 0.08 92.56
05:14:01 AM 0 0.37 0.00 0.12 0.00 0.08 99.43
05:14:01 AM 1 9.96 0.00 4.54 0.00 0.07 85.43
05:15:01 AM all 0.27 0.00 0.08 0.00 0.06 99.60
05:15:01 AM 0 0.45 0.00 0.07 0.00 0.07 99.42
05:15:01 AM 1 0.08 0.00 0.08 0.00 0.05 99.78
05:16:01 AM all 2.98 0.00 0.22 0.00 0.08 96.72
05:16:01 AM 0 5.29 0.00 0.36 0.00 0.09 94.27
05:16:01 AM 1 0.72 0.00 0.08 0.00 0.07 99.13
05:17:01 AM all 7.17 0.00 2.90 0.00 0.09 89.84
05:17:01 AM 0 12.78 0.00 5.70 0.00 0.09 81.43
05:17:01 AM 1 1.72 0.00 0.17 0.00 0.10 98.01
05:18:01 AM all 4.43 0.00 0.30 0.00 0.11 95.16
05:18:01 AM 0 3.23 0.00 0.20 0.00 0.10 96.47
05:18:01 AM 1 5.63 0.00 0.40 0.00 0.12 93.85
05:18:01 AM CPU %user %nice %system %iowait %steal %idle
05:19:01 AM all 4.39 0.00 0.34 0.00 0.10 95.17
05:19:01 AM 0 4.78 0.00 0.35 0.00 0.10 94.76
05:19:01 AM 1 3.99 0.00 0.33 0.00 0.10 95.57
05:20:01 AM all 4.40 0.00 0.33 0.00 0.11 95.16
05:20:01 AM 0 4.98 0.00 0.37 0.00 0.10 94.55
05:20:01 AM 1 3.83 0.00 0.28 0.00 0.12 95.77
05:21:01 AM all 4.37 0.00 0.33 0.00 0.11 95.19
05:21:01 AM 0 2.81 0.00 0.27 0.00 0.10 96.82
05:21:01 AM 1 5.94 0.00 0.38 0.00 0.12 93.56
05:22:01 AM all 4.43 0.00 0.33 0.00 0.12 95.13
05:22:01 AM 0 3.11 0.00 0.23 0.00 0.10 96.56
05:22:01 AM 1 5.75 0.00 0.42 0.00 0.13 93.70
05:23:01 AM all 7.36 0.00 0.43 0.01 0.12 92.08
05:23:01 AM 0 8.92 0.00 0.47 0.02 0.12 90.47
05:23:01 AM 1 5.80 0.00 0.40 0.00 0.12 93.68
05:24:01 AM all 0.59 0.00 0.10 0.00 0.08 99.22
05:24:01 AM 0 0.33 0.00 0.12 0.00 0.10 99.45
05:24:01 AM 1 0.85 0.00 0.08 0.00 0.07 99.00
05:25:01 AM all 0.32 0.00 0.05 0.00 0.07 99.57
05:25:01 AM 0 0.10 0.00 0.05 0.00 0.08 99.77
05:25:01 AM 1 0.53 0.00 0.05 0.00 0.05 99.37
05:26:01 AM all 0.48 0.00 0.09 0.00 0.07 99.37
05:26:01 AM 0 0.48 0.00 0.08 0.00 0.07 99.37
05:26:01 AM 1 0.47 0.00 0.10 0.00 0.07 99.37
05:27:01 AM all 0.29 0.00 0.06 0.00 0.06 99.59
05:27:01 AM 0 0.05 0.00 0.05 0.00 0.05 99.85
05:27:01 AM 1 0.53 0.00 0.07 0.00 0.07 99.33
05:28:01 AM all 0.47 0.00 0.07 0.00 0.07 99.40
05:28:01 AM 0 0.40 0.00 0.10 0.00 0.07 99.43
05:28:01 AM 1 0.53 0.00 0.03 0.00 0.07 99.37
05:29:01 AM all 0.26 0.00 0.08 0.00 0.06 99.60
05:29:01 AM 0 0.05 0.00 0.05 0.00 0.05 99.85
05:29:01 AM 1 0.47 0.00 0.12 0.00 0.07 99.35
05:29:01 AM CPU %user %nice %system %iowait %steal %idle
05:30:01 AM all 0.13 0.00 0.09 0.00 0.05 99.72
05:30:01 AM 0 0.00 0.00 0.03 0.00 0.00 99.97
05:30:01 AM 1 0.27 0.00 0.15 0.00 0.10 99.48
05:31:01 AM all 7.85 0.00 4.15 0.00 0.09 87.91
05:31:01 AM 0 15.27 0.00 8.28 0.00 0.09 76.36
05:31:01 AM 1 0.77 0.00 0.20 0.00 0.08 98.95
05:32:01 AM all 7.68 0.16 4.97 0.01 0.09 87.09
05:32:01 AM 0 14.55 0.03 9.68 0.00 0.05 75.69
05:32:01 AM 1 1.07 0.28 0.45 0.02 0.12 98.06
05:33:01 AM all 7.00 0.00 3.25 0.00 0.09 89.66
05:33:01 AM 0 0.80 0.00 0.20 0.00 0.10 98.90
05:33:01 AM 1 13.76 0.00 6.57 0.00 0.07 79.60
05:34:01 AM all 7.26 0.00 3.73 0.00 0.11 88.90
05:34:01 AM 0 0.94 0.00 0.28 0.00 0.12 98.66
05:34:01 AM 1 14.09 0.00 7.44 0.00 0.11 78.36
05:35:01 AM all 8.63 0.00 4.30 0.00 0.10 86.97
05:35:01 AM 0 13.48 0.00 7.12 0.00 0.09 79.31
05:35:01 AM 1 3.95 0.00 1.57 0.00 0.12 94.37
05:36:01 AM all 7.24 0.00 3.62 0.00 0.09 89.05
05:36:01 AM 0 0.99 0.00 0.23 0.00 0.10 98.68
05:36:01 AM 1 14.03 0.00 7.30 0.00 0.07 78.60
05:37:01 AM all 7.46 0.00 4.43 0.00 0.09 88.02
05:37:01 AM 0 7.46 0.00 7.91 0.00 0.09 84.54
05:37:01 AM 1 7.45 0.00 0.94 0.00 0.09 91.52
05:38:01 AM all 14.36 0.00 4.38 0.00 0.10 81.16
05:38:01 AM 0 27.65 0.00 8.39 0.00 0.09 63.88
05:38:01 AM 1 1.46 0.00 0.49 0.00 0.12 97.93
05:39:01 AM all 22.52 0.00 3.40 0.52 0.09 73.46
05:39:01 AM 0 18.33 0.00 2.97 0.72 0.08 77.89
05:39:01 AM 1 26.72 0.00 3.83 0.32 0.10 69.04
Average: all 3.24 0.00 0.68 0.00 0.08 96.00
Average: 0 2.77 0.00 0.69 0.00 0.08 96.46
Average: 1 3.70 0.01 0.67 0.00 0.08 95.54