Started by upstream project "integration-distribution-mri-test-vanadium" build number 25
originally caused by:
Started by timer
Running as SYSTEM
[EnvInject] - Loading node environment variables.
Building remotely on prd-centos8-robot-2c-8g-1589 (centos8-robot-2c-8g) in workspace /w/workspace/controller-csit-3node-clustering-tell-all-vanadium
[ssh-agent] Looking for ssh-agent implementation...
[ssh-agent] Exec ssh-agent (binary ssh-agent on a remote machine)
$ ssh-agent
SSH_AUTH_SOCK=/tmp/ssh-EZZ9eH2tbIsi/agent.5285
SSH_AGENT_PID=5286
[ssh-agent] Started.
Running ssh-add (command line suppressed)
Identity added: /w/workspace/controller-csit-3node-clustering-tell-all-vanadium@tmp/private_key_4641128134241674788.key (/w/workspace/controller-csit-3node-clustering-tell-all-vanadium@tmp/private_key_4641128134241674788.key)
[ssh-agent] Using credentials jenkins (Release Engineering Jenkins Key)
The recommended git tool is: NONE
using credential opendaylight-jenkins-ssh
Wiping out workspace first.
Cloning the remote Git repository
Cloning repository git://devvexx.opendaylight.org/mirror/integration/test
> git init /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test # timeout=10
Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test
> git --version # timeout=10
> git --version # 'git version 2.43.0'
using GIT_SSH to set credentials Release Engineering Jenkins Key
[INFO] Currently running in a labeled security context
[INFO] Currently SELinux is 'enforcing' on the host
> /usr/bin/chcon --type=ssh_home_t /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test@tmp/jenkins-gitclient-ssh14247739973291121082.key
Verifying host key using known hosts file
You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification.
> git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10
Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test
using GIT_SSH to set credentials Release Engineering Jenkins Key
[INFO] Currently running in a labeled security context
[INFO] Currently SELinux is 'enforcing' on the host
> /usr/bin/chcon --type=ssh_home_t /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test@tmp/jenkins-gitclient-ssh5493468530082582239.key
Verifying host key using known hosts file
You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification.
> git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test master # timeout=10
> git rev-parse FETCH_HEAD^{commit} # timeout=10
Checking out Revision cc140aba40d20c279ad305eb08204917e9a97348 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f cc140aba40d20c279ad305eb08204917e9a97348 # timeout=10
Commit message: "Add bgpcep variables for vanadium"
> git rev-parse FETCH_HEAD^{commit} # timeout=10
> git rev-list --no-walk 2791c5dea1951b0af9405c9ac43be0884a2c5414 # timeout=10
No emails were triggered.
provisioning config files...
copy managed file [npmrc] to file:/home/jenkins/.npmrc
copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf
copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
[controller-csit-3node-clustering-tell-all-vanadium] $ /bin/bash /tmp/jenkins3928581090759932005.sh
---> python-tools-install.sh
Setup pyenv:
system
* 3.8.13 (set by /opt/pyenv/version)
* 3.9.13 (set by /opt/pyenv/version)
* 3.10.13 (set by /opt/pyenv/version)
* 3.11.7 (set by /opt/pyenv/version)
lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-jWgQ
lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
lf-activate-venv(): INFO: Attempting to install with network-safe options...
lf-activate-venv(): INFO: Base packages installed successfully
lf-activate-venv(): INFO: Installing additional packages: lftools
lf-activate-venv(): INFO: Adding /tmp/venv-jWgQ/bin to PATH
Generating Requirements File
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
httplib2 0.30.2 requires pyparsing<4,>=3.0.4, but you have pyparsing 2.4.7 which is incompatible.
Python 3.11.7
pip 25.3 from /tmp/venv-jWgQ/lib/python3.11/site-packages/pip (python 3.11)
appdirs==1.4.4
argcomplete==3.6.3
aspy.yaml==1.3.0
attrs==25.4.0
autopage==0.5.2
beautifulsoup4==4.14.3
boto3==1.42.30
botocore==1.42.30
bs4==0.0.2
certifi==2026.1.4
cffi==2.0.0
cfgv==3.5.0
chardet==5.2.0
charset-normalizer==3.4.4
click==8.3.1
cliff==4.13.1
cmd2==3.1.0
cryptography==3.3.2
debtcollector==3.0.0
decorator==5.2.1
defusedxml==0.7.1
Deprecated==1.3.1
distlib==0.4.0
dnspython==2.8.0
docker==7.1.0
dogpile.cache==1.5.0
durationpy==0.10
email-validator==2.3.0
filelock==3.20.3
future==1.0.0
gitdb==4.0.12
GitPython==3.1.46
httplib2==0.30.2
identify==2.6.16
idna==3.11
importlib-resources==1.5.0
iso8601==2.1.0
Jinja2==3.1.6
jmespath==1.0.1
jsonpatch==1.33
jsonpointer==3.0.0
jsonschema==4.26.0
jsonschema-specifications==2025.9.1
keystoneauth1==5.12.0
kubernetes==35.0.0
lftools==0.37.21
lxml==6.0.2
markdown-it-py==4.0.0
MarkupSafe==3.0.3
mdurl==0.1.2
msgpack==1.1.2
multi_key_dict==2.0.3
munch==4.0.0
netaddr==1.3.0
niet==1.4.2
nodeenv==1.10.0
oauth2client==4.1.3
oauthlib==3.3.1
openstacksdk==4.8.0
os-service-types==1.8.2
osc-lib==4.3.0
oslo.config==10.2.0
oslo.context==6.2.0
oslo.i18n==6.7.1
oslo.log==8.0.0
oslo.serialization==5.9.0
oslo.utils==9.2.0
packaging==25.0
pbr==7.0.3
platformdirs==4.5.1
prettytable==3.17.0
psutil==7.2.1
pyasn1==0.6.2
pyasn1_modules==0.4.2
pycparser==2.23
pygerrit2==2.0.15
PyGithub==2.8.1
Pygments==2.19.2
PyJWT==2.10.1
PyNaCl==1.6.2
pyparsing==2.4.7
pyperclip==1.11.0
pyrsistent==0.20.0
python-cinderclient==9.8.0
python-dateutil==2.9.0.post0
python-heatclient==4.3.0
python-jenkins==1.8.3
python-keystoneclient==5.7.0
python-magnumclient==4.9.0
python-openstackclient==8.3.0
python-swiftclient==4.9.0
PyYAML==6.0.3
referencing==0.37.0
requests==2.32.5
requests-oauthlib==2.0.0
requestsexceptions==1.4.0
rfc3986==2.0.0
rich==14.2.0
rich-argparse==1.7.2
rpds-py==0.30.0
rsa==4.9.1
ruamel.yaml==0.19.1
ruamel.yaml.clib==0.2.15
s3transfer==0.16.0
simplejson==3.20.2
six==1.17.0
smmap==5.0.2
soupsieve==2.8.1
stevedore==5.6.0
tabulate==0.9.0
toml==0.10.2
tomlkit==0.14.0
tqdm==4.67.1
typing_extensions==4.15.0
tzdata==2025.3
urllib3==1.26.20
virtualenv==20.36.1
wcwidth==0.2.14
websocket-client==1.9.0
wrapt==2.0.1
xdg==6.0.0
xmltodict==1.0.2
yq==3.4.3
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties content
OS_STACK_TEMPLATE=csit-2-instance-type.yaml
OS_CLOUD=vex
OS_STACK_NAME=releng-controller-csit-3node-clustering-tell-all-vanadium-25
OS_STACK_TEMPLATE_DIR=openstack-hot
[EnvInject] - Variables injected successfully.
provisioning config files...
copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
[controller-csit-3node-clustering-tell-all-vanadium] $ /bin/bash /tmp/jenkins15954025455237260454.sh
---> Create parameters file for OpenStack HOT
OpenStack Heat parameters generated
-----------------------------------
parameters:
vm_0_count: '3'
vm_0_flavor: 'v3-standard-4'
vm_0_image: 'ZZCI - Ubuntu 22.04 - builder - x86_64 - 20260109-084045.554'
vm_1_count: '0'
vm_1_flavor: 'v3-standard-2'
vm_1_image: 'ZZCI - Ubuntu 22.04 - mininet-ovs-217 - x86_64 - 20250917-133034.654'
job_name: '29596-25'
silo: 'releng'
[controller-csit-3node-clustering-tell-all-vanadium] $ /bin/bash -l /tmp/jenkins16201303555846337214.sh
---> Create HEAT stack
+ source /home/jenkins/lf-env.sh
+ lf-activate-venv --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq
++ mktemp -d /tmp/venv-XXXX
+ lf_venv=/tmp/venv-T0on
+ local venv_file=/tmp/.os_lf_venv
+ local python=python3
+ local options
+ local set_path=true
+ local install_args=
++ getopt -o np:v: -l no-path,system-site-packages,python:,venv-file: -n lf-activate-venv -- --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq
+ options=' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''urllib3~=1.26.15'\'' '\''yq'\'''
+ eval set -- ' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''urllib3~=1.26.15'\'' '\''yq'\'''
++ set -- --python python3 -- 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq
+ true
+ case $1 in
+ python=python3
+ shift 2
+ true
+ case $1 in
+ shift
+ break
+ case $python in
+ local pkg_list=
+ [[ -d /opt/pyenv ]]
+ echo 'Setup pyenv:'
Setup pyenv:
+ export PYENV_ROOT=/opt/pyenv
+ PYENV_ROOT=/opt/pyenv
+ export PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
+ PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
+ pyenv versions
system
3.8.13
3.9.13
3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/.python-version)
+ command -v pyenv
++ pyenv init - --no-rehash
+ eval 'PATH="$(bash --norc -ec '\''IFS=:; paths=($PATH);
for i in ${!paths[@]}; do
if [[ ${paths[i]} == "'\'''\''/opt/pyenv/shims'\'''\''" ]]; then unset '\''\'\'''\''paths[i]'\''\'\'''\'';
fi; done;
echo "${paths[*]}"'\'')"
export PATH="/opt/pyenv/shims:${PATH}"
export PYENV_SHELL=bash
source '\''/opt/pyenv/libexec/../completions/pyenv.bash'\''
pyenv() {
local command
command="${1:-}"
if [ "$#" -gt 0 ]; then
shift
fi
case "$command" in
rehash|shell)
eval "$(pyenv "sh-$command" "$@")"
;;
*)
command pyenv "$command" "$@"
;;
esac
}'
+++ bash --norc -ec 'IFS=:; paths=($PATH);
for i in ${!paths[@]}; do
if [[ ${paths[i]} == "/opt/pyenv/shims" ]]; then unset '\''paths[i]'\'';
fi; done;
echo "${paths[*]}"'
++ PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
++ export PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
++ PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
++ export PYENV_SHELL=bash
++ PYENV_SHELL=bash
++ source /opt/pyenv/libexec/../completions/pyenv.bash
+++ complete -F _pyenv pyenv
++ lf-pyver python3
++ local py_version_xy=python3
++ local py_version_xyz=
++ awk '{ print $1 }'
++ pyenv versions
++ local command
++ command=versions
++ '[' 1 -gt 0 ']'
++ shift
++ case "$command" in
++ command pyenv versions
++ pyenv versions
++ sed 's/^[ *]* //'
++ grep -E '^[0-9.]*[0-9]$'
++ [[ ! -s /tmp/.pyenv_versions ]]
+++ tail -n 1
+++ grep '^3' /tmp/.pyenv_versions
+++ sort -V
++ py_version_xyz=3.11.7
++ [[ -z 3.11.7 ]]
++ echo 3.11.7
++ return 0
+ pyenv local 3.11.7
+ local command
+ command=local
+ '[' 2 -gt 0 ']'
+ shift
+ case "$command" in
+ command pyenv local 3.11.7
+ pyenv local 3.11.7
+ for arg in "$@"
+ case $arg in
+ pkg_list+='lftools[openstack] '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='kubernetes '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='niet '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='python-heatclient '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='python-openstackclient '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='python-magnumclient '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='urllib3~=1.26.15 '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='yq '
+ [[ -f /tmp/.os_lf_venv ]]
++ cat /tmp/.os_lf_venv
+ lf_venv=/tmp/venv-jWgQ
+ echo 'lf-activate-venv(): INFO: Reuse venv:/tmp/venv-jWgQ from' file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-jWgQ from file:/tmp/.os_lf_venv
+ echo 'lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)'
lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
+ local 'pip_opts=--upgrade --quiet'
+ pip_opts='--upgrade --quiet --trusted-host pypi.org'
+ pip_opts='--upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org'
+ pip_opts='--upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org'
+ [[ -n '' ]]
+ [[ -n '' ]]
+ echo 'lf-activate-venv(): INFO: Attempting to install with network-safe options...'
lf-activate-venv(): INFO: Attempting to install with network-safe options...
+ /tmp/venv-jWgQ/bin/python3 -m pip install --upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org pip 'setuptools<66' virtualenv
+ echo 'lf-activate-venv(): INFO: Base packages installed successfully'
lf-activate-venv(): INFO: Base packages installed successfully
+ [[ -z lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq ]]
+ echo 'lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq '
lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq
+ /tmp/venv-jWgQ/bin/python3 -m pip install --upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org --upgrade-strategy eager 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq
+ type python3
+ true
+ echo 'lf-activate-venv(): INFO: Adding /tmp/venv-jWgQ/bin to PATH'
lf-activate-venv(): INFO: Adding /tmp/venv-jWgQ/bin to PATH
+ PATH=/tmp/venv-jWgQ/bin:/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
+ return 0
+ openstack --os-cloud vex limits show --absolute
+--------------------------+---------+
| Name | Value |
+--------------------------+---------+
| maxTotalInstances | -1 |
| maxTotalCores | 450 |
| maxTotalRAMSize | 1000000 |
| maxServerMeta | 128 |
| maxImageMeta | 128 |
| maxPersonality | 5 |
| maxPersonalitySize | 10240 |
| maxTotalKeypairs | 100 |
| maxServerGroups | 10 |
| maxServerGroupMembers | 10 |
| maxTotalFloatingIps | -1 |
| maxSecurityGroups | -1 |
| maxSecurityGroupRules | -1 |
| totalRAMUsed | 647168 |
| totalCoresUsed | 158 |
| totalInstancesUsed | 52 |
| totalFloatingIpsUsed | 0 |
| totalSecurityGroupsUsed | 0 |
| totalServerGroupsUsed | 0 |
| maxTotalVolumes | -1 |
| maxTotalSnapshots | 10 |
| maxTotalVolumeGigabytes | 4096 |
| maxTotalBackups | 10 |
| maxTotalBackupGigabytes | 1000 |
| totalVolumesUsed | 0 |
| totalGigabytesUsed | 0 |
| totalSnapshotsUsed | 0 |
| totalBackupsUsed | 0 |
| totalBackupGigabytesUsed | 0 |
+--------------------------+---------+
+ pushd /opt/ciman/openstack-hot
/opt/ciman/openstack-hot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium
+ lftools openstack --os-cloud vex stack create releng-controller-csit-3node-clustering-tell-all-vanadium-25 csit-2-instance-type.yaml /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/stack-parameters.yaml
Creating stack releng-controller-csit-3node-clustering-tell-all-vanadium-25
Waiting to initialize infrastructure...
Stack initialization successful.
------------------------------------
Stack Details
------------------------------------
{'added': None,
'capabilities': [],
'created_at': '2026-01-17T23:41:40Z',
'deleted': None,
'deleted_at': None,
'description': 'No description',
'environment': None,
'environment_files': None,
'files': None,
'files_container': None,
'id': 'f9f3909b-472f-4248-8609-7972a3a191ca',
'is_rollback_disabled': True,
'links': [{'href': 'https://orchestration.public.mtl1.vexxhost.net/v1/12c36e260d8e4bb2913965203b1b491f/stacks/releng-controller-csit-3node-clustering-tell-all-vanadium-25/f9f3909b-472f-4248-8609-7972a3a191ca',
'rel': 'self'}],
'location': Munch({'cloud': 'vex', 'region_name': 'ca-ymq-1', 'zone': None, 'project': Munch({'id': '12c36e260d8e4bb2913965203b1b491f', 'name': '61975f2c-7c17-4d69-82fa-c3ae420ad6fd', 'domain_id': None, 'domain_name': 'Default'})}),
'name': 'releng-controller-csit-3node-clustering-tell-all-vanadium-25',
'notification_topics': [],
'outputs': [{'description': 'IP addresses of the 1st vm types',
'output_key': 'vm_0_ips',
'output_value': ['10.30.170.178',
'10.30.170.99',
'10.30.171.201']},
{'description': 'IP addresses of the 2nd vm types',
'output_key': 'vm_1_ips',
'output_value': []}],
'owner_id': ****,
'parameters': {'OS::project_id': '12c36e260d8e4bb2913965203b1b491f',
'OS::stack_id': 'f9f3909b-472f-4248-8609-7972a3a191ca',
'OS::stack_name': 'releng-controller-csit-3node-clustering-tell-all-vanadium-25',
'job_name': '29596-25',
'silo': 'releng',
'vm_0_count': '3',
'vm_0_flavor': 'v3-standard-4',
'vm_0_image': 'ZZCI - Ubuntu 22.04 - builder - x86_64 - '
'20260109-084045.554',
'vm_1_count': '0',
'vm_1_flavor': 'v3-standard-2',
'vm_1_image': 'ZZCI - Ubuntu 22.04 - mininet-ovs-217 - x86_64 '
'- 20250917-133034.654'},
'parent_id': None,
'replaced': None,
'status': 'CREATE_COMPLETE',
'status_reason': 'Stack CREATE completed successfully',
'tags': [],
'template': None,
'template_description': 'No description',
'template_url': None,
'timeout_mins': 15,
'unchanged': None,
'updated': None,
'updated_at': None,
'user_project_id': 'c3315192e28b435c8e4719d3c6fd5dd0'}
------------------------------------
+ popd
/w/workspace/controller-csit-3node-clustering-tell-all-vanadium
[controller-csit-3node-clustering-tell-all-vanadium] $ /bin/bash -l /tmp/jenkins3849338197393675099.sh
---> Copy SSH public keys to CSIT lab
Setup pyenv:
system
3.8.13
3.9.13
3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-jWgQ from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
lf-activate-venv(): INFO: Attempting to install with network-safe options...
lf-activate-venv(): INFO: Base packages installed successfully
lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes python-heatclient python-openstackclient urllib3~=1.26.15
lf-activate-venv(): INFO: Adding /tmp/venv-jWgQ/bin to PATH
SSH not responding on 10.30.170.178. Retrying in 10 seconds...
SSH not responding on 10.30.170.99. Retrying in 10 seconds...
SSH not responding on 10.30.171.201. Retrying in 10 seconds...
Ping to 10.30.170.178 successful.
Ping to 10.30.170.99 successful.
Ping to 10.30.171.201 successful.
SSH not responding on 10.30.171.201. Retrying in 10 seconds...
Warning: Permanently added '10.30.170.178' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.170.99' (ECDSA) to the list of known hosts.
releng-29596-25-0-builder-0
Successfully copied public keys to slave 10.30.170.178
Process 6505 ready.
releng-29596-25-0-builder-1
Successfully copied public keys to slave 10.30.170.99
Process 6506 ready.
Ping to 10.30.171.201 successful.
Warning: Permanently added '10.30.171.201' (ECDSA) to the list of known hosts.
releng-29596-25-0-builder-2
Successfully copied public keys to slave 10.30.171.201
Process 6507 ready.
SSH ready on all stack servers.
[controller-csit-3node-clustering-tell-all-vanadium] $ /bin/bash -l /tmp/jenkins6871960939430691864.sh
Setup pyenv:
system
3.8.13
3.9.13
3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/.python-version)
lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-kkUh
lf-activate-venv(): INFO: Save venv in file: /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/.robot_venv
lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
lf-activate-venv(): INFO: Attempting to install with network-safe options...
lf-activate-venv(): INFO: Base packages installed successfully
lf-activate-venv(): INFO: Installing additional packages: setuptools wheel
lf-activate-venv(): INFO: Adding /tmp/venv-kkUh/bin to PATH
+ echo 'Installing Python Requirements'
Installing Python Requirements
+ cat
+ python -m pip install -r requirements.txt
Looking in indexes: https://nexus3.opendaylight.org/repository/PyPi/simple
Collecting docker-py (from -r requirements.txt (line 1))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/docker-py/1.10.6/docker_py-1.10.6-py2.py3-none-any.whl (50 kB)
Collecting ipaddr (from -r requirements.txt (line 2))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/ipaddr/2.2.0/ipaddr-2.2.0.tar.gz (26 kB)
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing metadata (pyproject.toml): started
Preparing metadata (pyproject.toml): finished with status 'done'
Collecting netaddr (from -r requirements.txt (line 3))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/netaddr/1.3.0/netaddr-1.3.0-py3-none-any.whl (2.3 MB)
Collecting netifaces (from -r requirements.txt (line 4))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/netifaces/0.11.0/netifaces-0.11.0.tar.gz (30 kB)
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing metadata (pyproject.toml): started
Preparing metadata (pyproject.toml): finished with status 'done'
Collecting pyhocon (from -r requirements.txt (line 5))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyhocon/0.3.61/pyhocon-0.3.61-py3-none-any.whl (25 kB)
Collecting requests (from -r requirements.txt (line 6))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/requests/2.32.5/requests-2.32.5-py3-none-any.whl (64 kB)
Collecting robotframework (from -r requirements.txt (line 7))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework/7.4.1/robotframework-7.4.1-py3-none-any.whl (806 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 806.9/806.9 kB 33.8 MB/s 0:00:00
Collecting robotframework-httplibrary (from -r requirements.txt (line 8))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-httplibrary/0.4.2/robotframework-httplibrary-0.4.2.tar.gz (9.1 kB)
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing metadata (pyproject.toml): started
Preparing metadata (pyproject.toml): finished with status 'done'
Collecting robotframework-requests==0.9.7 (from -r requirements.txt (line 9))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-requests/0.9.7/robotframework_requests-0.9.7-py3-none-any.whl (21 kB)
Collecting robotframework-selenium2library (from -r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-selenium2library/3.0.0/robotframework_selenium2library-3.0.0-py2.py3-none-any.whl (6.2 kB)
Collecting robotframework-sshlibrary==3.8.0 (from -r requirements.txt (line 11))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-sshlibrary/3.8.0/robotframework-sshlibrary-3.8.0.tar.gz (51 kB)
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing metadata (pyproject.toml): started
Preparing metadata (pyproject.toml): finished with status 'done'
Collecting scapy (from -r requirements.txt (line 12))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/scapy/2.7.0/scapy-2.7.0-py3-none-any.whl (2.6 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.6/2.6 MB 54.6 MB/s 0:00:00
Collecting jsonpath-rw (from -r requirements.txt (line 15))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpath-rw/1.4.0/jsonpath-rw-1.4.0.tar.gz (13 kB)
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing metadata (pyproject.toml): started
Preparing metadata (pyproject.toml): finished with status 'done'
Collecting elasticsearch (from -r requirements.txt (line 18))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch/9.2.1/elasticsearch-9.2.1-py3-none-any.whl (963 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 963.6/963.6 kB 33.6 MB/s 0:00:00
Collecting elasticsearch-dsl (from -r requirements.txt (line 19))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch-dsl/8.18.0/elasticsearch_dsl-8.18.0-py3-none-any.whl (10 kB)
Collecting pyangbind (from -r requirements.txt (line 22))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyangbind/0.8.7/pyangbind-0.8.7-py3-none-any.whl (52 kB)
Collecting isodate (from -r requirements.txt (line 25))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/isodate/0.7.2/isodate-0.7.2-py3-none-any.whl (22 kB)
Collecting jmespath (from -r requirements.txt (line 28))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jmespath/1.0.1/jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting jsonpatch (from -r requirements.txt (line 31))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpatch/1.33/jsonpatch-1.33-py2.py3-none-any.whl (12 kB)
Collecting paramiko>=1.15.3 (from robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/paramiko/4.0.0/paramiko-4.0.0-py3-none-any.whl (223 kB)
Collecting scp>=0.13.0 (from robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/scp/0.15.0/scp-0.15.0-py2.py3-none-any.whl (8.8 kB)
Collecting docker-pycreds>=0.2.1 (from docker-py->-r requirements.txt (line 1))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/docker-pycreds/0.4.0/docker_pycreds-0.4.0-py2.py3-none-any.whl (9.0 kB)
Collecting six>=1.4.0 (from docker-py->-r requirements.txt (line 1))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/six/1.17.0/six-1.17.0-py2.py3-none-any.whl (11 kB)
Collecting websocket-client>=0.32.0 (from docker-py->-r requirements.txt (line 1))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/websocket-client/1.9.0/websocket_client-1.9.0-py3-none-any.whl (82 kB)
Collecting pyparsing<4,>=2 (from pyhocon->-r requirements.txt (line 5))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pyparsing/3.3.1/pyparsing-3.3.1-py3-none-any.whl (121 kB)
Collecting charset_normalizer<4,>=2 (from requests->-r requirements.txt (line 6))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/charset-normalizer/3.4.4/charset_normalizer-3.4.4-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl (151 kB)
Collecting idna<4,>=2.5 (from requests->-r requirements.txt (line 6))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/idna/3.11/idna-3.11-py3-none-any.whl (71 kB)
Collecting urllib3<3,>=1.21.1 (from requests->-r requirements.txt (line 6))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/urllib3/2.6.3/urllib3-2.6.3-py3-none-any.whl (131 kB)
Collecting certifi>=2017.4.17 (from requests->-r requirements.txt (line 6))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/certifi/2026.1.4/certifi-2026.1.4-py3-none-any.whl (152 kB)
Collecting webtest>=2.0 (from robotframework-httplibrary->-r requirements.txt (line 8))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/webtest/3.0.7/webtest-3.0.7-py3-none-any.whl (32 kB)
Collecting jsonpointer (from robotframework-httplibrary->-r requirements.txt (line 8))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpointer/3.0.0/jsonpointer-3.0.0-py2.py3-none-any.whl (7.6 kB)
Collecting robotframework-seleniumlibrary>=3.0.0 (from robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-seleniumlibrary/6.8.0/robotframework_seleniumlibrary-6.8.0-py3-none-any.whl (104 kB)
Collecting ply (from jsonpath-rw->-r requirements.txt (line 15))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/ply/3.11/ply-3.11-py2.py3-none-any.whl (49 kB)
Collecting decorator (from jsonpath-rw->-r requirements.txt (line 15))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/decorator/5.2.1/decorator-5.2.1-py3-none-any.whl (9.2 kB)
Collecting anyio (from elasticsearch->-r requirements.txt (line 18))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/anyio/4.12.1/anyio-4.12.1-py3-none-any.whl (113 kB)
Collecting elastic-transport<10,>=9.2.0 (from elasticsearch->-r requirements.txt (line 18))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elastic-transport/9.2.1/elastic_transport-9.2.1-py3-none-any.whl (65 kB)
Collecting python-dateutil (from elasticsearch->-r requirements.txt (line 18))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/python-dateutil/2.9.0.post0/python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB)
Collecting sniffio (from elasticsearch->-r requirements.txt (line 18))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/sniffio/1.3.1/sniffio-1.3.1-py3-none-any.whl (10 kB)
Collecting typing-extensions (from elasticsearch->-r requirements.txt (line 18))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/typing-extensions/4.15.0/typing_extensions-4.15.0-py3-none-any.whl (44 kB)
Collecting elasticsearch (from -r requirements.txt (line 18))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch/8.19.3/elasticsearch-8.19.3-py3-none-any.whl (952 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 952.8/952.8 kB 48.2 MB/s 0:00:00
INFO: pip is looking at multiple versions of elasticsearch-dsl to determine which version is compatible with other requirements. This could take a while.
Collecting elasticsearch-dsl (from -r requirements.txt (line 19))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch-dsl/8.17.1/elasticsearch_dsl-8.17.1-py3-none-any.whl (158 kB)
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch-dsl/8.17.0/elasticsearch_dsl-8.17.0-py3-none-any.whl (158 kB)
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch-dsl/8.16.0/elasticsearch_dsl-8.16.0-py3-none-any.whl (158 kB)
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch-dsl/8.15.4/elasticsearch_dsl-8.15.4-py3-none-any.whl (104 kB)
Collecting elastic-transport<9,>=8.15.1 (from elasticsearch->-r requirements.txt (line 18))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elastic-transport/8.17.1/elastic_transport-8.17.1-py3-none-any.whl (64 kB)
Collecting pyang (from pyangbind->-r requirements.txt (line 22))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyang/2.7.1/pyang-2.7.1-py2.py3-none-any.whl (598 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 598.5/598.5 kB 3.2 MB/s 0:00:00
Collecting lxml (from pyangbind->-r requirements.txt (line 22))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/lxml/6.0.2/lxml-6.0.2-cp311-cp311-manylinux_2_26_x86_64.manylinux_2_28_x86_64.whl (5.2 MB)
Collecting regex (from pyangbind->-r requirements.txt (line 22))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/regex/2026.1.15/regex-2026.1.15-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl (800 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 800.5/800.5 kB 18.6 MB/s 0:00:00
Collecting enum34 (from pyangbind->-r requirements.txt (line 22))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/enum34/1.1.10/enum34-1.1.10-py3-none-any.whl (11 kB)
Collecting bcrypt>=3.2 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/bcrypt/5.0.0/bcrypt-5.0.0-cp39-abi3-manylinux_2_28_x86_64.whl (278 kB)
Collecting cryptography>=3.3 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/cryptography/46.0.3/cryptography-46.0.3-cp311-abi3-manylinux_2_28_x86_64.whl (4.5 MB)
Collecting invoke>=2.0 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/invoke/2.2.1/invoke-2.2.1-py3-none-any.whl (160 kB)
Collecting pynacl>=1.5 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pynacl/1.6.2/pynacl-1.6.2-cp38-abi3-manylinux_2_26_x86_64.manylinux_2_28_x86_64.whl (1.4 MB)
Collecting cffi>=2.0.0 (from cryptography>=3.3->paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/cffi/2.0.0/cffi-2.0.0-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (215 kB)
Collecting pycparser (from cffi>=2.0.0->cryptography>=3.3->paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pycparser/2.23/pycparser-2.23-py3-none-any.whl (118 kB)
Collecting selenium>=4.3.0 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/selenium/4.39.0/selenium-4.39.0-py3-none-any.whl (9.7 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 9.7/9.7 MB 35.3 MB/s 0:00:00
Collecting robotframework-pythonlibcore>=4.4.1 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-pythonlibcore/4.5.0/robotframework_pythonlibcore-4.5.0-py3-none-any.whl (19 kB)
Collecting click>=8.0 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/click/8.3.1/click-8.3.1-py3-none-any.whl (108 kB)
Collecting trio<1.0,>=0.31.0 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/trio/0.32.0/trio-0.32.0-py3-none-any.whl (512 kB)
Collecting trio-websocket<1.0,>=0.12.2 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/trio-websocket/0.12.2/trio_websocket-0.12.2-py3-none-any.whl (21 kB)
Collecting attrs>=23.2.0 (from trio<1.0,>=0.31.0->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/attrs/25.4.0/attrs-25.4.0-py3-none-any.whl (67 kB)
Collecting sortedcontainers (from trio<1.0,>=0.31.0->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/sortedcontainers/2.4.0/sortedcontainers-2.4.0-py2.py3-none-any.whl (29 kB)
Collecting outcome (from trio<1.0,>=0.31.0->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/outcome/1.3.0.post0/outcome-1.3.0.post0-py2.py3-none-any.whl (10 kB)
Collecting wsproto>=0.14 (from trio-websocket<1.0,>=0.12.2->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/wsproto/1.3.2/wsproto-1.3.2-py3-none-any.whl (24 kB)
Collecting pysocks!=1.5.7,<2.0,>=1.5.6 (from urllib3[socks]<3.0,>=2.5.0->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pysocks/1.7.1/PySocks-1.7.1-py3-none-any.whl (16 kB)
Collecting WebOb>=1.2 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/webob/1.8.9/WebOb-1.8.9-py2.py3-none-any.whl (115 kB)
Collecting waitress>=3.0.2 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/waitress/3.0.2/waitress-3.0.2-py3-none-any.whl (56 kB)
Collecting beautifulsoup4 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/beautifulsoup4/4.14.3/beautifulsoup4-4.14.3-py3-none-any.whl (107 kB)
Collecting h11<1,>=0.16.0 (from wsproto>=0.14->trio-websocket<1.0,>=0.12.2->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/h11/0.16.0/h11-0.16.0-py3-none-any.whl (37 kB)
Collecting soupsieve>=1.6.1 (from beautifulsoup4->webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/soupsieve/2.8.1/soupsieve-2.8.1-py3-none-any.whl (36 kB)
Building wheels for collected packages: robotframework-sshlibrary, ipaddr, netifaces, robotframework-httplibrary, jsonpath-rw
Building wheel for robotframework-sshlibrary (pyproject.toml): started
Building wheel for robotframework-sshlibrary (pyproject.toml): finished with status 'done'
Created wheel for robotframework-sshlibrary: filename=robotframework_sshlibrary-3.8.0-py3-none-any.whl size=55205 sha256=cb189d024290c18d21e76f4c991f8c3ed8587d90df13697fad294dacacae525a
Stored in directory: /home/jenkins/.cache/pip/wheels/f7/c9/b3/a977b7bcc410d45ae27d240df3d00a12585509180e373ecccc
Building wheel for ipaddr (pyproject.toml): started
Building wheel for ipaddr (pyproject.toml): finished with status 'done'
Created wheel for ipaddr: filename=ipaddr-2.2.0-py3-none-any.whl size=18353 sha256=8b199dca7c4e121262d4fb8c0e5b5e9150ea0ea1a8ce784a31a9fb7653dfe5da
Stored in directory: /home/jenkins/.cache/pip/wheels/dc/6c/04/da2d847fa8d45c59af3e1d83e2acc29cb8adcbaf04c0898dbf
Building wheel for netifaces (pyproject.toml): started
Building wheel for netifaces (pyproject.toml): finished with status 'done'
Created wheel for netifaces: filename=netifaces-0.11.0-cp311-cp311-linux_x86_64.whl size=41091 sha256=bb8f8c91a8d498b34b71f8d5b30431d3d6bf931e5ee15dfa196f7a41b04236e7
Stored in directory: /home/jenkins/.cache/pip/wheels/f8/18/88/e61d54b995bea304bdb1d040a92b72228a1bf72ca2a3eba7c9
Building wheel for robotframework-httplibrary (pyproject.toml): started
Building wheel for robotframework-httplibrary (pyproject.toml): finished with status 'done'
Created wheel for robotframework-httplibrary: filename=robotframework_httplibrary-0.4.2-py3-none-any.whl size=10014 sha256=4caba964c90ed1dad22026645bf7c86878bfe34b6fa3c3b19a88249a9b0a591c
Stored in directory: /home/jenkins/.cache/pip/wheels/aa/bc/0d/9a20dd51effef392aae2733cb4c7b66c6fa29fca33d88b57ed
Building wheel for jsonpath-rw (pyproject.toml): started
Building wheel for jsonpath-rw (pyproject.toml): finished with status 'done'
Created wheel for jsonpath-rw: filename=jsonpath_rw-1.4.0-py3-none-any.whl size=15176 sha256=2f214692ec05b049013dc2aa800a4e7ca225900bac810fe1d741c8fc31a23864
Stored in directory: /home/jenkins/.cache/pip/wheels/f1/54/63/9a8da38cefae13755097b36cc852decc25d8ef69c37d58d4eb
Successfully built robotframework-sshlibrary ipaddr netifaces robotframework-httplibrary jsonpath-rw
Installing collected packages: sortedcontainers, ply, netifaces, ipaddr, enum34, websocket-client, WebOb, waitress, urllib3, typing-extensions, soupsieve, sniffio, six, scapy, robotframework-pythonlibcore, robotframework, regex, pysocks, pyparsing, pycparser, netaddr, lxml, jsonpointer, jmespath, isodate, invoke, idna, h11, decorator, click, charset_normalizer, certifi, bcrypt, attrs, wsproto, requests, python-dateutil, pyhocon, pyang, outcome, jsonpath-rw, jsonpatch, elastic-transport, docker-pycreds, cffi, beautifulsoup4, webtest, trio, robotframework-requests, pynacl, pyangbind, elasticsearch, docker-py, cryptography, trio-websocket, robotframework-httplibrary, paramiko, elasticsearch-dsl, selenium, scp, robotframework-sshlibrary, robotframework-seleniumlibrary, robotframework-selenium2library
Successfully installed WebOb-1.8.9 attrs-25.4.0 bcrypt-5.0.0 beautifulsoup4-4.14.3 certifi-2026.1.4 cffi-2.0.0 charset_normalizer-3.4.4 click-8.3.1 cryptography-46.0.3 decorator-5.2.1 docker-py-1.10.6 docker-pycreds-0.4.0 elastic-transport-8.17.1 elasticsearch-8.19.3 elasticsearch-dsl-8.15.4 enum34-1.1.10 h11-0.16.0 idna-3.11 invoke-2.2.1 ipaddr-2.2.0 isodate-0.7.2 jmespath-1.0.1 jsonpatch-1.33 jsonpath-rw-1.4.0 jsonpointer-3.0.0 lxml-6.0.2 netaddr-1.3.0 netifaces-0.11.0 outcome-1.3.0.post0 paramiko-4.0.0 ply-3.11 pyang-2.7.1 pyangbind-0.8.7 pycparser-2.23 pyhocon-0.3.61 pynacl-1.6.2 pyparsing-3.3.1 pysocks-1.7.1 python-dateutil-2.9.0.post0 regex-2026.1.15 requests-2.32.5 robotframework-7.4.1 robotframework-httplibrary-0.4.2 robotframework-pythonlibcore-4.5.0 robotframework-requests-0.9.7 robotframework-selenium2library-3.0.0 robotframework-seleniumlibrary-6.8.0 robotframework-sshlibrary-3.8.0 scapy-2.7.0 scp-0.15.0 selenium-4.39.0 six-1.17.0 sniffio-1.3.1 sortedcontainers-2.4.0 soupsieve-2.8.1 trio-0.32.0 trio-websocket-0.12.2 typing-extensions-4.15.0 urllib3-2.6.3 waitress-3.0.2 websocket-client-1.9.0 webtest-3.0.7 wsproto-1.3.2
+ pip freeze
attrs==25.4.0
bcrypt==5.0.0
beautifulsoup4==4.14.3
certifi==2026.1.4
cffi==2.0.0
charset-normalizer==3.4.4
click==8.3.1
cryptography==46.0.3
decorator==5.2.1
distlib==0.4.0
docker-py==1.10.6
docker-pycreds==0.4.0
elastic-transport==8.17.1
elasticsearch==8.19.3
elasticsearch-dsl==8.15.4
enum34==1.1.10
filelock==3.20.3
h11==0.16.0
idna==3.11
invoke==2.2.1
ipaddr==2.2.0
isodate==0.7.2
jmespath==1.0.1
jsonpatch==1.33
jsonpath-rw==1.4.0
jsonpointer==3.0.0
lxml==6.0.2
netaddr==1.3.0
netifaces==0.11.0
outcome==1.3.0.post0
paramiko==4.0.0
platformdirs==4.5.1
ply==3.11
pyang==2.7.1
pyangbind==0.8.7
pycparser==2.23
pyhocon==0.3.61
PyNaCl==1.6.2
pyparsing==3.3.1
PySocks==1.7.1
python-dateutil==2.9.0.post0
regex==2026.1.15
requests==2.32.5
robotframework==7.4.1
robotframework-httplibrary==0.4.2
robotframework-pythonlibcore==4.5.0
robotframework-requests==0.9.7
robotframework-selenium2library==3.0.0
robotframework-seleniumlibrary==6.8.0
robotframework-sshlibrary==3.8.0
scapy==2.7.0
scp==0.15.0
selenium==4.39.0
six==1.17.0
sniffio==1.3.1
sortedcontainers==2.4.0
soupsieve==2.8.1
trio==0.32.0
trio-websocket==0.12.2
typing_extensions==4.15.0
urllib3==2.6.3
virtualenv==20.36.1
waitress==3.0.2
WebOb==1.8.9
websocket-client==1.9.0
WebTest==3.0.7
wsproto==1.3.2
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties file path 'env.properties'
[EnvInject] - Variables injected successfully.
[controller-csit-3node-clustering-tell-all-vanadium] $ /bin/bash -l /tmp/jenkins716251573665428843.sh
Setup pyenv:
system
3.8.13
3.9.13
3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-jWgQ from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
lf-activate-venv(): INFO: Attempting to install with network-safe options...
lf-activate-venv(): INFO: Base packages installed successfully
lf-activate-venv(): INFO: Installing additional packages: python-heatclient python-openstackclient yq
lf-activate-venv(): INFO: Adding /tmp/venv-jWgQ/bin to PATH
+ ODL_SYSTEM=()
+ TOOLS_SYSTEM=()
+ OPENSTACK_SYSTEM=()
+ OPENSTACK_CONTROLLERS=()
+ mapfile -t ADDR
++ openstack stack show -f json -c outputs releng-controller-csit-3node-clustering-tell-all-vanadium-25
++ jq -r '.outputs[] | select(.output_key | match("^vm_[0-9]+_ips$")) | .output_value | .[]'
+ for i in "${ADDR[@]}"
++ ssh 10.30.170.178 hostname -s
Warning: Permanently added '10.30.170.178' (ECDSA) to the list of known hosts.
+ REMHOST=releng-29596-25-0-builder-0
+ case ${REMHOST} in
+ ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}")
+ for i in "${ADDR[@]}"
++ ssh 10.30.170.99 hostname -s
Warning: Permanently added '10.30.170.99' (ECDSA) to the list of known hosts.
+ REMHOST=releng-29596-25-0-builder-1
+ case ${REMHOST} in
+ ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}")
+ for i in "${ADDR[@]}"
++ ssh 10.30.171.201 hostname -s
Warning: Permanently added '10.30.171.201' (ECDSA) to the list of known hosts.
+ REMHOST=releng-29596-25-0-builder-2
+ case ${REMHOST} in
+ ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}")
+ echo NUM_ODL_SYSTEM=3
+ echo NUM_TOOLS_SYSTEM=0
+ '[' '' == yes ']'
+ NUM_OPENSTACK_SYSTEM=0
+ echo NUM_OPENSTACK_SYSTEM=0
+ '[' 0 -eq 2 ']'
+ echo ODL_SYSTEM_IP=10.30.170.178
++ seq 0 2
+ for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 )))
+ echo ODL_SYSTEM_1_IP=10.30.170.178
+ for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 )))
+ echo ODL_SYSTEM_2_IP=10.30.170.99
+ for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 )))
+ echo ODL_SYSTEM_3_IP=10.30.171.201
+ echo TOOLS_SYSTEM_IP=
++ seq 0 -1
+ openstack_index=0
+ NUM_OPENSTACK_CONTROL_NODES=1
+ echo NUM_OPENSTACK_CONTROL_NODES=1
++ seq 0 0
+ for i in $(seq 0 $((NUM_OPENSTACK_CONTROL_NODES - 1)))
+ echo OPENSTACK_CONTROL_NODE_1_IP=
+ NUM_OPENSTACK_COMPUTE_NODES=-1
+ echo NUM_OPENSTACK_COMPUTE_NODES=-1
+ '[' -1 -ge 2 ']'
++ seq 0 -2
+ NUM_OPENSTACK_HAPROXY_NODES=0
+ echo NUM_OPENSTACK_HAPROXY_NODES=0
++ seq 0 -1
+ echo 'Contents of slave_addresses.txt:'
Contents of slave_addresses.txt:
+ cat slave_addresses.txt
NUM_ODL_SYSTEM=3
NUM_TOOLS_SYSTEM=0
NUM_OPENSTACK_SYSTEM=0
ODL_SYSTEM_IP=10.30.170.178
ODL_SYSTEM_1_IP=10.30.170.178
ODL_SYSTEM_2_IP=10.30.170.99
ODL_SYSTEM_3_IP=10.30.171.201
TOOLS_SYSTEM_IP=
NUM_OPENSTACK_CONTROL_NODES=1
OPENSTACK_CONTROL_NODE_1_IP=
NUM_OPENSTACK_COMPUTE_NODES=-1
NUM_OPENSTACK_HAPROXY_NODES=0
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties file path 'slave_addresses.txt'
[EnvInject] - Variables injected successfully.
[controller-csit-3node-clustering-tell-all-vanadium] $ /bin/sh /tmp/jenkins16996956180955108241.sh
Preparing for JRE Version 21
Karaf artifact is karaf
Karaf project is integration
Java home is /usr/lib/jvm/java-21-openjdk-amd64
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties file path 'set_variables.env'
[EnvInject] - Variables injected successfully.
[controller-csit-3node-clustering-tell-all-vanadium] $ /bin/bash /tmp/jenkins12369464651462042252.sh
2026-01-17 23:43:35 URL:https://raw.githubusercontent.com/opendaylight/integration-distribution/master/pom.xml [2619/2619] -> "pom.xml" [1]
Bundle version is 0.24.0-SNAPSHOT
--2026-01-17 23:43:35-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.24.0-SNAPSHOT/maven-metadata.xml
Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6
Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 1404 (1.4K) [application/xml]
Saving to: ‘maven-metadata.xml’
0K . 100% 39.2M=0s
2026-01-17 23:43:35 (39.2 MB/s) - ‘maven-metadata.xml’ saved [1404/1404]
org.opendaylight.integration
karaf
0.24.0-SNAPSHOT
20260117.223656
12
20260117223656
pom
0.24.0-20260117.223656-12
20260117223656
tar.gz
0.24.0-20260117.223656-12
20260117223656
zip
0.24.0-20260117.223656-12
20260117223656
cyclonedx
xml
0.24.0-20260117.223656-12
20260117223656
cyclonedx
json
0.24.0-20260117.223656-12
20260117223656
Nexus timestamp is 0.24.0-20260117.223656-12
Distribution bundle URL is https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.24.0-SNAPSHOT/karaf-0.24.0-20260117.223656-12.zip
Distribution bundle is karaf-0.24.0-20260117.223656-12.zip
Distribution bundle version is 0.24.0-SNAPSHOT
Distribution folder is karaf-0.24.0-SNAPSHOT
Nexus prefix is https://nexus.opendaylight.org
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties file path 'detect_variables.env'
[EnvInject] - Variables injected successfully.
[controller-csit-3node-clustering-tell-all-vanadium] $ /bin/bash -l /tmp/jenkins12222747658597747598.sh
Setup pyenv:
system
3.8.13
3.9.13
3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-jWgQ from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
lf-activate-venv(): INFO: Attempting to install with network-safe options...
lf-activate-venv(): INFO: Base packages installed successfully
lf-activate-venv(): INFO: Installing additional packages: python-heatclient python-openstackclient
lf-activate-venv(): INFO: Adding /tmp/venv-jWgQ/bin to PATH
Copying common-functions.sh to /tmp
Copying common-functions.sh to 10.30.170.178:/tmp
Warning: Permanently added '10.30.170.178' (ECDSA) to the list of known hosts.
Copying common-functions.sh to 10.30.170.99:/tmp
Warning: Permanently added '10.30.170.99' (ECDSA) to the list of known hosts.
Copying common-functions.sh to 10.30.171.201:/tmp
Warning: Permanently added '10.30.171.201' (ECDSA) to the list of known hosts.
[controller-csit-3node-clustering-tell-all-vanadium] $ /bin/bash /tmp/jenkins10935652462331726728.sh
common-functions.sh is being sourced
common-functions environment:
MAVENCONF: /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
ACTUALFEATURES:
FEATURESCONF: /tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
CUSTOMPROP: /tmp/karaf-0.24.0-SNAPSHOT/etc/custom.properties
LOGCONF: /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
MEMCONF: /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
CONTROLLERMEM: 2048m
AKKACONF: /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/pekko.conf
MODULESCONF: /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/modules.conf
MODULESHARDSCONF: /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/module-shards.conf
SUITES:
#################################################
## Configure Cluster and Start ##
#################################################
ACTUALFEATURES: odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app
SPACE_SEPARATED_FEATURES: odl-integration-compatible-with-all odl-jolokia odl-restconf odl-clustering-test-app
Locating script plan to use...
script plan exists!!!
Changing the script plan path...
# Place the scripts in run order:
/w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/scripts/car_people_shard.sh
Executing /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/scripts/car_people_shard.sh...
Add car-people shards file
Copy shard config to member-1 with IP address 10.30.170.178
Warning: Permanently added '10.30.170.178' (ECDSA) to the list of known hosts.
Copy shard config to member-2 with IP address 10.30.170.99
Warning: Permanently added '10.30.170.99' (ECDSA) to the list of known hosts.
Copy shard config to member-3 with IP address 10.30.171.201
Warning: Permanently added '10.30.171.201' (ECDSA) to the list of known hosts.
Finished running script plans
Configuring member-1 with IP address 10.30.170.178
Warning: Permanently added '10.30.170.178' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.170.178' (ECDSA) to the list of known hosts.
+ source /tmp/common-functions.sh karaf-0.24.0-SNAPSHOT vanadium
++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]]
++ echo 'common-functions.sh is being sourced'
common-functions.sh is being sourced
++ BUNDLEFOLDER=karaf-0.24.0-SNAPSHOT
++ DISTROSTREAM=vanadium
++ export MAVENCONF=/tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
++ MAVENCONF=/tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
++ export FEATURESCONF=/tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
++ FEATURESCONF=/tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
++ export CUSTOMPROP=/tmp/karaf-0.24.0-SNAPSHOT/etc/custom.properties
++ CUSTOMPROP=/tmp/karaf-0.24.0-SNAPSHOT/etc/custom.properties
++ export LOGCONF=/tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
++ LOGCONF=/tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
++ export MEMCONF=/tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
++ MEMCONF=/tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
++ export CONTROLLERMEM=
++ CONTROLLERMEM=
++ case "${DISTROSTREAM}" in
++ CLUSTER_SYSTEM=pekko
++ export AKKACONF=/tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/pekko.conf
++ AKKACONF=/tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/pekko.conf
++ export MODULESCONF=/tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/modules.conf
++ MODULESCONF=/tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/modules.conf
++ export MODULESHARDSCONF=/tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/module-shards.conf
++ MODULESHARDSCONF=/tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/module-shards.conf
++ print_common_env
++ cat
common-functions environment:
MAVENCONF: /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
ACTUALFEATURES:
FEATURESCONF: /tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
CUSTOMPROP: /tmp/karaf-0.24.0-SNAPSHOT/etc/custom.properties
LOGCONF: /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
MEMCONF: /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
CONTROLLERMEM:
AKKACONF: /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/pekko.conf
MODULESCONF: /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/modules.conf
MODULESHARDSCONF: /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/module-shards.conf
SUITES:
++ SSH='ssh -t -t'
++ extra_services_cntl=' dnsmasq.service httpd.service libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service rabbitmq-server.service '
++ extra_services_cmp=' libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service '
Changing to /tmp
+ echo 'Changing to /tmp'
+ cd /tmp
Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.24.0-SNAPSHOT/karaf-0.24.0-20260117.223656-12.zip
+ echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.24.0-SNAPSHOT/karaf-0.24.0-20260117.223656-12.zip'
+ wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.24.0-SNAPSHOT/karaf-0.24.0-20260117.223656-12.zip
--2026-01-17 23:43:47-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.24.0-SNAPSHOT/karaf-0.24.0-20260117.223656-12.zip
Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6
Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 240365717 (229M) [application/zip]
Saving to: ‘karaf-0.24.0-20260117.223656-12.zip’
0K ........ ........ ........ ........ ........ ........ 1% 83.9M 3s
3072K ........ ........ ........ ........ ........ ........ 2% 145M 2s
6144K ........ ........ ........ ........ ........ ........ 3% 179M 2s
9216K ........ ........ ........ ........ ........ ........ 5% 165M 2s
12288K ........ ........ ........ ........ ........ ........ 6% 219M 2s
15360K ........ ........ ........ ........ ........ ........ 7% 191M 1s
18432K ........ ........ ........ ........ ........ ........ 9% 211M 1s
21504K ........ ........ ........ ........ ........ ........ 10% 245M 1s
24576K ........ ........ ........ ........ ........ ........ 11% 264M 1s
27648K ........ ........ ........ ........ ........ ........ 13% 238M 1s
30720K ........ ........ ........ ........ ........ ........ 14% 293M 1s
33792K ........ ........ ........ ........ ........ ........ 15% 317M 1s
36864K ........ ........ ........ ........ ........ ........ 17% 302M 1s
39936K ........ ........ ........ ........ ........ ........ 18% 293M 1s
43008K ........ ........ ........ ........ ........ ........ 19% 328M 1s
46080K ........ ........ ........ ........ ........ ........ 20% 350M 1s
49152K ........ ........ ........ ........ ........ ........ 22% 329M 1s
52224K ........ ........ ........ ........ ........ ........ 23% 348M 1s
55296K ........ ........ ........ ........ ........ ........ 24% 317M 1s
58368K ........ ........ ........ ........ ........ ........ 26% 270M 1s
61440K ........ ........ ........ ........ ........ ........ 27% 337M 1s
64512K ........ ........ ........ ........ ........ ........ 28% 321M 1s
67584K ........ ........ ........ ........ ........ ........ 30% 326M 1s
70656K ........ ........ ........ ........ ........ ........ 31% 289M 1s
73728K ........ ........ ........ ........ ........ ........ 32% 297M 1s
76800K ........ ........ ........ ........ ........ ........ 34% 290M 1s
79872K ........ ........ ........ ........ ........ ........ 35% 316M 1s
82944K ........ ........ ........ ........ ........ ........ 36% 365M 1s
86016K ........ ........ ........ ........ ........ ........ 37% 357M 1s
89088K ........ ........ ........ ........ ........ ........ 39% 355M 1s
92160K ........ ........ ........ ........ ........ ........ 40% 354M 1s
95232K ........ ........ ........ ........ ........ ........ 41% 359M 1s
98304K ........ ........ ........ ........ ........ ........ 43% 311M 1s
101376K ........ ........ ........ ........ ........ ........ 44% 296M 0s
104448K ........ ........ ........ ........ ........ ........ 45% 344M 0s
107520K ........ ........ ........ ........ ........ ........ 47% 367M 0s
110592K ........ ........ ........ ........ ........ ........ 48% 335M 0s
113664K ........ ........ ........ ........ ........ ........ 49% 296M 0s
116736K ........ ........ ........ ........ ........ ........ 51% 290M 0s
119808K ........ ........ ........ ........ ........ ........ 52% 313M 0s
122880K ........ ........ ........ ........ ........ ........ 53% 435M 0s
125952K ........ ........ ........ ........ ........ ........ 54% 348M 0s
129024K ........ ........ ........ ........ ........ ........ 56% 363M 0s
132096K ........ ........ ........ ........ ........ ........ 57% 271M 0s
135168K ........ ........ ........ ........ ........ ........ 58% 249M 0s
138240K ........ ........ ........ ........ ........ ........ 60% 328M 0s
141312K ........ ........ ........ ........ ........ ........ 61% 359M 0s
144384K ........ ........ ........ ........ ........ ........ 62% 338M 0s
147456K ........ ........ ........ ........ ........ ........ 64% 352M 0s
150528K ........ ........ ........ ........ ........ ........ 65% 344M 0s
153600K ........ ........ ........ ........ ........ ........ 66% 324M 0s
156672K ........ ........ ........ ........ ........ ........ 68% 380M 0s
159744K ........ ........ ........ ........ ........ ........ 69% 352M 0s
162816K ........ ........ ........ ........ ........ ........ 70% 350M 0s
165888K ........ ........ ........ ........ ........ ........ 71% 344M 0s
168960K ........ ........ ........ ........ ........ ........ 73% 330M 0s
172032K ........ ........ ........ ........ ........ ........ 74% 258M 0s
175104K ........ ........ ........ ........ ........ ........ 75% 229M 0s
178176K ........ ........ ........ ........ ........ ........ 77% 217M 0s
181248K ........ ........ ........ ........ ........ ........ 78% 238M 0s
184320K ........ ........ ........ ........ ........ ........ 79% 225M 0s
187392K ........ ........ ........ ........ ........ ........ 81% 298M 0s
190464K ........ ........ ........ ........ ........ ........ 82% 362M 0s
193536K ........ ........ ........ ........ ........ ........ 83% 383M 0s
196608K ........ ........ ........ ........ ........ ........ 85% 357M 0s
199680K ........ ........ ........ ........ ........ ........ 86% 382M 0s
202752K ........ ........ ........ ........ ........ ........ 87% 367M 0s
205824K ........ ........ ........ ........ ........ ........ 88% 379M 0s
208896K ........ ........ ........ ........ ........ ........ 90% 199M 0s
211968K ........ ........ ........ ........ ........ ........ 91% 308M 0s
215040K ........ ........ ........ ........ ........ ........ 92% 345M 0s
218112K ........ ........ ........ ........ ........ ........ 94% 371M 0s
221184K ........ ........ ........ ........ ........ ........ 95% 373M 0s
224256K ........ ........ ........ ........ ........ ........ 96% 359M 0s
227328K ........ ........ ........ ........ ........ ........ 98% 383M 0s
230400K ........ ........ ........ ........ ........ ........ 99% 348M 0s
233472K ........ ........ ... 100% 309M=0.8s
2026-01-17 23:43:48 (288 MB/s) - ‘karaf-0.24.0-20260117.223656-12.zip’ saved [240365717/240365717]
Extracting the new controller...
+ echo 'Extracting the new controller...'
+ unzip -q karaf-0.24.0-20260117.223656-12.zip
Adding external repositories...
+ echo 'Adding external repositories...'
+ sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
+ cat /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
################################################################################
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
################################################################################
#
# If set to true, the following property will not allow any certificate to be used
# when accessing Maven repositories through SSL
#
#org.ops4j.pax.url.mvn.certificateCheck=
#
# Path to the local Maven settings file.
# The repositories defined in this file will be automatically added to the list
# of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property
# below is not set.
# The following locations are checked for the existence of the settings.xml file
# * 1. looks for the specified url
# * 2. if not found looks for ${user.home}/.m2/settings.xml
# * 3. if not found looks for ${maven.home}/conf/settings.xml
# * 4. if not found looks for ${M2_HOME}/conf/settings.xml
#
#org.ops4j.pax.url.mvn.settings=
#
# Path to the local Maven repository which is used to avoid downloading
# artifacts when they already exist locally.
# The value of this property will be extracted from the settings.xml file
# above, or defaulted to:
# System.getProperty( "user.home" ) + "/.m2/repository"
#
org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository}
#
# Default this to false. It's just weird to use undocumented repos
#
org.ops4j.pax.url.mvn.useFallbackRepositories=false
#
# Uncomment if you don't wanna use the proxy settings
# from the Maven conf/settings.xml file
#
# org.ops4j.pax.url.mvn.proxySupport=false
#
# Comma separated list of repositories scanned when resolving an artifact.
# Those repositories will be checked before iterating through the
# below list of repositories and even before the local repository
# A repository url can be appended with zero or more of the following flags:
# @snapshots : the repository contains snaphots
# @noreleases : the repository does not contain any released artifacts
#
# The following property value will add the system folder as a repo.
#
org.ops4j.pax.url.mvn.defaultRepositories=\
file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\
file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\
file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots
# Use the default local repo (e.g.~/.m2/repository) as a "remote" repo
#org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false
#
# Comma separated list of repositories scanned when resolving an artifact.
# The default list includes the following repositories:
# http://repo1.maven.org/maven2@id=central
# http://repository.springsource.com/maven/bundles/release@id=spring.ebr
# http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external
# http://zodiac.springsource.com/maven/bundles/release@id=gemini
# http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases
# https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases
# https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
# To add repositories to the default ones, prepend '+' to the list of repositories
# to add.
# A repository url can be appended with zero or more of the following flags:
# @snapshots : the repository contains snapshots
# @noreleases : the repository does not contain any released artifacts
# @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended
#
org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.+ [[ True == \T\r\u\e ]]
+ echo 'Configuring the startup features...'
Configuring the startup features...
+ sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
+ FEATURE_TEST_STRING=features-test
+ FEATURE_TEST_VERSION=0.24.0-SNAPSHOT
+ KARAF_VERSION=karaf4
+ [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]]
+ sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.24.0-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
+ [[ ! -z '' ]]
+ cat /tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
################################################################################
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
################################################################################
#
# Comma separated list of features repositories to register by default
#
featuresRepositories = mvn:org.opendaylight.integration/features-test/0.24.0-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/eef4f053-53e3-43e4-9c13-1e5bf5e49fc9.xml
#
# Comma separated list of features to install at startup
#
featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, e0ed419d-f0e5-4080-bffe-2232822c3309
#
# Resource repositories (OBR) that the features resolver can use
# to resolve requirements/capabilities
#
# The format of the resourceRepositories is
# resourceRepositories=[xml:url|json:url],...
# for Instance:
#
#resourceRepositories=xml:http://host/path/to/index.xml
# or
#resourceRepositories=json:http://host/path/to/index.json
#
#
# Defines if the boot features are started in asynchronous mode (in a dedicated thread)
#
featuresBootAsynchronous=false
#
# Service requirements enforcement
#
# By default, the feature resolver checks the service requirements/capabilities of
# bundles for new features (xml schema >= 1.3.0) in order to automatically installs
# the required bundles.
# The following flag can have those values:
# - disable: service requirements are completely ignored
# - default: service requirements are ignored for old features
# - enforce: service requirements are always verified
#
#serviceRequirements=default
#
# Store cfg file for config element in feature
#
#configCfgStore=true
#
# Define if the feature service automatically refresh bundles
#
autoRefresh=true
#
# Configuration of features processing mechanism (overrides, blacklisting, modification of features)
# XML file defines instructions related to features processing
# versions.properties may declare properties to resolve placeholders in XML file
# both files are relative to ${karaf.etc}
#
#featureProcessing=org.apache.karaf.features.xml
#featureProcessingVersions=versions.properties
+ configure_karaf_log karaf4 ''
+ local -r karaf_version=karaf4
+ local -r controllerdebugmap=
+ local logapi=log4j
+ grep log4j2 /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
log4j2.rootLogger.level = INFO
#log4j2.rootLogger.type = asyncRoot
#log4j2.rootLogger.includeLocation = false
log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
log4j2.rootLogger.appenderRef.Console.ref = Console
log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
log4j2.logger.spifly.name = org.apache.aries.spifly
log4j2.logger.spifly.level = WARN
log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
log4j2.logger.audit.level = INFO
log4j2.logger.audit.additivity = false
log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
# Console appender not used by default (see log4j2.rootLogger.appenderRefs)
log4j2.appender.console.type = Console
log4j2.appender.console.name = Console
log4j2.appender.console.layout.type = PatternLayout
log4j2.appender.console.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.type = RollingRandomAccessFile
log4j2.appender.rolling.name = RollingFile
log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
#log4j2.appender.rolling.immediateFlush = false
log4j2.appender.rolling.append = true
log4j2.appender.rolling.layout.type = PatternLayout
log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.policies.type = Policies
log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.rolling.policies.size.size = 64MB
log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
log4j2.appender.rolling.strategy.max = 7
log4j2.appender.audit.type = RollingRandomAccessFile
log4j2.appender.audit.name = AuditRollingFile
log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
log4j2.appender.audit.append = true
log4j2.appender.audit.layout.type = PatternLayout
log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
log4j2.appender.audit.policies.type = Policies
log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.audit.policies.size.size = 8MB
log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
log4j2.appender.audit.strategy.max = 7
log4j2.appender.osgi.type = PaxOsgi
log4j2.appender.osgi.name = PaxOsgi
log4j2.appender.osgi.filter = *
#log4j2.logger.aether.name = shaded.org.eclipse.aether
#log4j2.logger.aether.level = TRACE
#log4j2.logger.http-headers.name = shaded.org.apache.http.headers
#log4j2.logger.http-headers.level = DEBUG
#log4j2.logger.maven.name = org.ops4j.pax.url.mvn
#log4j2.logger.maven.level = TRACE
+ logapi=log4j2
+ echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2'
Configuring the karaf log... karaf_version: karaf4, logapi: log4j2
+ '[' log4j2 == log4j2 ']'
+ sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
+ orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver
+ orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver
+ echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN'
+ echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN'
controllerdebugmap:
+ unset IFS
+ echo 'controllerdebugmap: '
cat /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
+ '[' -n '' ']'
+ echo 'cat /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg'
+ cat /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
################################################################################
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
################################################################################
# Common pattern layout for appenders
log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
# Root logger
log4j2.rootLogger.level = INFO
# uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library
#log4j2.rootLogger.type = asyncRoot
#log4j2.rootLogger.includeLocation = false
log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
log4j2.rootLogger.appenderRef.Console.ref = Console
log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
# Filters for logs marked by org.opendaylight.odlparent.Markers
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
# Loggers configuration
# Spifly logger
log4j2.logger.spifly.name = org.apache.aries.spifly
log4j2.logger.spifly.level = WARN
# Security audit logger
log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
log4j2.logger.audit.level = INFO
log4j2.logger.audit.additivity = false
log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
# Appenders configuration
# Console appender not used by default (see log4j2.rootLogger.appenderRefs)
log4j2.appender.console.type = Console
log4j2.appender.console.name = Console
log4j2.appender.console.layout.type = PatternLayout
log4j2.appender.console.layout.pattern = ${log4j2.pattern}
# Rolling file appender
log4j2.appender.rolling.type = RollingRandomAccessFile
log4j2.appender.rolling.name = RollingFile
log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
# uncomment to not force a disk flush
#log4j2.appender.rolling.immediateFlush = false
log4j2.appender.rolling.append = true
log4j2.appender.rolling.layout.type = PatternLayout
log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.policies.type = Policies
log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.rolling.policies.size.size = 1GB
log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
log4j2.appender.rolling.strategy.max = 7
# Audit file appender
log4j2.appender.audit.type = RollingRandomAccessFile
log4j2.appender.audit.name = AuditRollingFile
log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
log4j2.appender.audit.append = true
log4j2.appender.audit.layout.type = PatternLayout
log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
log4j2.appender.audit.policies.type = Policies
log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.audit.policies.size.size = 8MB
log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
log4j2.appender.audit.strategy.max = 7
# OSGi appender
log4j2.appender.osgi.type = PaxOsgi
log4j2.appender.osgi.name = PaxOsgi
log4j2.appender.osgi.filter = *
# help with identification of maven-related problems with pax-url-aether
#log4j2.logger.aether.name = shaded.org.eclipse.aether
#log4j2.logger.aether.level = TRACE
#log4j2.logger.http-headers.name = shaded.org.apache.http.headers
#log4j2.logger.http-headers.level = DEBUG
#log4j2.logger.maven.name = org.ops4j.pax.url.mvn
#log4j2.logger.maven.level = TRACE
log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN
log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN
+ set_java_vars /usr/lib/jvm/java-21-openjdk-amd64 3072m /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
+ local -r java_home=/usr/lib/jvm/java-21-openjdk-amd64
+ local -r controllermem=3072m
+ local -r memconf=/tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
+ echo Configure
Configure
java home: /usr/lib/jvm/java-21-openjdk-amd64
max memory: 3072m
memconf: /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
+ echo ' java home: /usr/lib/jvm/java-21-openjdk-amd64'
+ echo ' max memory: 3072m'
+ echo ' memconf: /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv'
+ sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64}%g' /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
+ sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
cat /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
+ echo 'cat /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv'
+ cat /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
#!/bin/sh
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
#
# handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf
# script: client, instance, shell, start, status, stop, karaf
#
# if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then
# Actions go here...
# fi
#
# general settings which should be applied for all scripts go here; please keep
# in mind that it is possible that scripts might be executed more than once, e.g.
# in example of the start script where the start script is executed first and the
# karaf script afterwards.
#
#
# The following section shows the possible configuration options for the default
# karaf scripts
#
export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64} # Location of Java installation
# export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration
# export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options
# export EXTRA_JAVA_OPTS # Additional JVM options
# export KARAF_HOME # Karaf home folder
# export KARAF_DATA # Karaf data folder
# export KARAF_BASE # Karaf base folder
# export KARAF_ETC # Karaf etc folder
# export KARAF_LOG # Karaf log folder
# export KARAF_SYSTEM_OPTS # First citizen Karaf options
# export KARAF_OPTS # Additional available Karaf options
# export KARAF_DEBUG # Enable debug mode
# export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start
# export KARAF_NOROOT # Prevent execution as root if set to true
Set Java version
+ echo 'Set Java version'
+ sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-21-openjdk-amd64/bin/java 1
sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper
sudo: a password is required
+ sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-21-openjdk-amd64/bin/java
sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper
sudo: a password is required
JDK default version ...
+ echo 'JDK default version ...'
+ java -version
openjdk version "21.0.9" 2025-10-21
OpenJDK Runtime Environment (build 21.0.9+10-Ubuntu-122.04)
OpenJDK 64-Bit Server VM (build 21.0.9+10-Ubuntu-122.04, mixed mode, sharing)
Set JAVA_HOME
+ echo 'Set JAVA_HOME'
+ export JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64
+ JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64
++ readlink -e /usr/lib/jvm/java-21-openjdk-amd64/bin/java
+ JAVA_RESOLVED=/usr/lib/jvm/java-21-openjdk-amd64/bin/java
Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java
Listing all open ports on controller system...
+ echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java'
+ echo 'Listing all open ports on controller system...'
+ netstat -pnatu
/tmp/configuration-script.sh: line 40: netstat: command not found
Custom shard config exists!!!
+ '[' -f /tmp/custom_shard_config.txt ']'
+ echo 'Custom shard config exists!!!'
+ echo 'Copying the shard config...'
Copying the shard config...
+ cp /tmp/custom_shard_config.txt /tmp/karaf-0.24.0-SNAPSHOT/bin/
Configuring cluster
+ echo 'Configuring cluster'
+ /tmp/karaf-0.24.0-SNAPSHOT/bin/configure_cluster.sh 1 10.30.170.178 10.30.170.99 10.30.171.201
################################################
## Configure Cluster ##
################################################
NOTE: Cluster configuration files not found. Copying from
/tmp/karaf-0.24.0-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/12.0.3
Configuring unique name in pekko.conf
Configuring hostname in pekko.conf
Configuring data and rpc seed nodes in pekko.conf
modules = [
{
name = "inventory"
namespace = "urn:opendaylight:inventory"
shard-strategy = "module"
},
{
name = "topology"
namespace = "urn:TBD:params:xml:ns:yang:network-topology"
shard-strategy = "module"
},
{
name = "toaster"
namespace = "http://netconfcentral.org/ns/toaster"
shard-strategy = "module"
},
{
name = "car"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
shard-strategy = "module"
},
{
name = "people"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
shard-strategy = "module"
},
{
name = "car-people"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
shard-strategy = "module"
}
]
Configuring replication type in module-shards.conf
################################################
## NOTE: Manually restart controller to ##
## apply configuration. ##
################################################
Dump pekko.conf
+ echo 'Dump pekko.conf'
+ cat /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/pekko.conf
odl-cluster-data {
pekko {
remote {
artery {
enabled = on
transport = tcp
canonical.hostname = "10.30.170.178"
canonical.port = 2550
}
}
cluster {
# Using artery.
seed-nodes = ["pekko://opendaylight-cluster-data@10.30.170.178:2550",
"pekko://opendaylight-cluster-data@10.30.170.99:2550",
"pekko://opendaylight-cluster-data@10.30.171.201:2550"]
roles = ["member-1"]
# when under load we might trip a false positive on the failure detector
# failure-detector {
# heartbeat-interval = 4 s
# acceptable-heartbeat-pause = 16s
# }
}
persistence {
# By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by
# modifying the following two properties. The directory location specified may be a relative or absolute path.
# The relative path is always relative to KARAF_HOME.
# snapshot-store.local.dir = "target/snapshots"
}
disable-default-actor-system-quarantined-event-handling = "false"
}
}
Dump modules.conf
+ echo 'Dump modules.conf'
+ cat /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/modules.conf
modules = [
{
name = "inventory"
namespace = "urn:opendaylight:inventory"
shard-strategy = "module"
},
{
name = "topology"
namespace = "urn:TBD:params:xml:ns:yang:network-topology"
shard-strategy = "module"
},
{
name = "toaster"
namespace = "http://netconfcentral.org/ns/toaster"
shard-strategy = "module"
},
{
name = "car"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
shard-strategy = "module"
},
{
name = "people"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
shard-strategy = "module"
},
{
name = "car-people"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
shard-strategy = "module"
}
]
Dump module-shards.conf
+ echo 'Dump module-shards.conf'
+ cat /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/module-shards.conf
module-shards = [
{
name = "default"
shards = [
{
name = "default"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "inventory"
shards = [
{
name="inventory"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "topology"
shards = [
{
name="topology"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "toaster"
shards = [
{
name="toaster"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "car"
shards = [
{
name="car"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "people"
shards = [
{
name="people"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "car-people"
shards = [
{
name="car-people"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
}
]
Configuring member-2 with IP address 10.30.170.99
Warning: Permanently added '10.30.170.99' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.170.99' (ECDSA) to the list of known hosts.
+ source /tmp/common-functions.sh karaf-0.24.0-SNAPSHOT vanadium
common-functions.sh is being sourced
++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]]
++ echo 'common-functions.sh is being sourced'
++ BUNDLEFOLDER=karaf-0.24.0-SNAPSHOT
++ DISTROSTREAM=vanadium
++ export MAVENCONF=/tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
++ MAVENCONF=/tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
++ export FEATURESCONF=/tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
++ FEATURESCONF=/tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
++ export CUSTOMPROP=/tmp/karaf-0.24.0-SNAPSHOT/etc/custom.properties
++ CUSTOMPROP=/tmp/karaf-0.24.0-SNAPSHOT/etc/custom.properties
++ export LOGCONF=/tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
++ LOGCONF=/tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
++ export MEMCONF=/tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
++ MEMCONF=/tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
++ export CONTROLLERMEM=
++ CONTROLLERMEM=
++ case "${DISTROSTREAM}" in
++ CLUSTER_SYSTEM=pekko
++ export AKKACONF=/tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/pekko.conf
++ AKKACONF=/tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/pekko.conf
++ export MODULESCONF=/tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/modules.conf
++ MODULESCONF=/tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/modules.conf
++ export MODULESHARDSCONF=/tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/module-shards.conf
++ MODULESHARDSCONF=/tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/module-shards.conf
++ print_common_env
++ cat
common-functions environment:
MAVENCONF: /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
ACTUALFEATURES:
FEATURESCONF: /tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
CUSTOMPROP: /tmp/karaf-0.24.0-SNAPSHOT/etc/custom.properties
LOGCONF: /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
MEMCONF: /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
CONTROLLERMEM:
AKKACONF: /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/pekko.conf
MODULESCONF: /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/modules.conf
MODULESHARDSCONF: /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/module-shards.conf
SUITES:
++ SSH='ssh -t -t'
++ extra_services_cntl=' dnsmasq.service httpd.service libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service rabbitmq-server.service '
++ extra_services_cmp=' libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service '
Changing to /tmp
Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.24.0-SNAPSHOT/karaf-0.24.0-20260117.223656-12.zip
+ echo 'Changing to /tmp'
+ cd /tmp
+ echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.24.0-SNAPSHOT/karaf-0.24.0-20260117.223656-12.zip'
+ wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.24.0-SNAPSHOT/karaf-0.24.0-20260117.223656-12.zip
--2026-01-17 23:43:51-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.24.0-SNAPSHOT/karaf-0.24.0-20260117.223656-12.zip
Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6
Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 240365717 (229M) [application/zip]
Saving to: ‘karaf-0.24.0-20260117.223656-12.zip’
0K ........ ........ ........ ........ ........ ........ 1% 69.7M 3s
3072K ........ ........ ........ ........ ........ ........ 2% 127M 2s
6144K ........ ........ ........ ........ ........ ........ 3% 140M 2s
9216K ........ ........ ........ ........ ........ ........ 5% 143M 2s
12288K ........ ........ ........ ........ ........ ........ 6% 190M 2s
15360K ........ ........ ........ ........ ........ ........ 7% 207M 2s
18432K ........ ........ ........ ........ ........ ........ 9% 176M 2s
21504K ........ ........ ........ ........ ........ ........ 10% 236M 1s
24576K ........ ........ ........ ........ ........ ........ 11% 223M 1s
27648K ........ ........ ........ ........ ........ ........ 13% 261M 1s
30720K ........ ........ ........ ........ ........ ........ 14% 248M 1s
33792K ........ ........ ........ ........ ........ ........ 15% 226M 1s
36864K ........ ........ ........ ........ ........ ........ 17% 142M 1s
39936K ........ ........ ........ ........ ........ ........ 18% 337M 1s
43008K ........ ........ ........ ........ ........ ........ 19% 469M 1s
46080K ........ ........ ........ ........ ........ ........ 20% 244M 1s
49152K ........ ........ ........ ........ ........ ........ 22% 221M 1s
52224K ........ ........ ........ ........ ........ ........ 23% 241M 1s
55296K ........ ........ ........ ........ ........ ........ 24% 222M 1s
58368K ........ ........ ........ ........ ........ ........ 26% 293M 1s
61440K ........ ........ ........ ........ ........ ........ 27% 277M 1s
64512K ........ ........ ........ ........ ........ ........ 28% 249M 1s
67584K ........ ........ ........ ........ ........ ........ 30% 248M 1s
70656K ........ ........ ........ ........ ........ ........ 31% 270M 1s
73728K ........ ........ ........ ........ ........ ........ 32% 250M 1s
76800K ........ ........ ........ ........ ........ ........ 34% 250M 1s
79872K ........ ........ ........ ........ ........ ........ 35% 251M 1s
82944K ........ ........ ........ ........ ........ ........ 36% 246M 1s
86016K ........ ........ ........ ........ ........ ........ 37% 237M 1s
89088K ........ ........ ........ ........ ........ ........ 39% 272M 1s
92160K ........ ........ ........ ........ ........ ........ 40% 267M 1s
95232K ........ ........ ........ ........ ........ ........ 41% 274M 1s
98304K ........ ........ ........ ........ ........ ........ 43% 214M 1s
101376K ........ ........ ........ ........ ........ ........ 44% 284M 1s
104448K ........ ........ ........ ........ ........ ........ 45% 279M 1s
107520K ........ ........ ........ ........ ........ ........ 47% 263M 1s
110592K ........ ........ ........ ........ ........ ........ 48% 151M 1s
113664K ........ ........ ........ ........ ........ ........ 49% 292M 1s
116736K ........ ........ ........ ........ ........ ........ 51% 285M 1s
119808K ........ ........ ........ ........ ........ ........ 52% 234M 1s
122880K ........ ........ ........ ........ ........ ........ 53% 249M 0s
125952K ........ ........ ........ ........ ........ ........ 54% 209M 0s
129024K ........ ........ ........ ........ ........ ........ 56% 353M 0s
132096K ........ ........ ........ ........ ........ ........ 57% 260M 0s
135168K ........ ........ ........ ........ ........ ........ 58% 278M 0s
138240K ........ ........ ........ ........ ........ ........ 60% 261M 0s
141312K ........ ........ ........ ........ ........ ........ 61% 249M 0s
144384K ........ ........ ........ ........ ........ ........ 62% 304M 0s
147456K ........ ........ ........ ........ ........ ........ 64% 295M 0s
150528K ........ ........ ........ ........ ........ ........ 65% 259M 0s
153600K ........ ........ ........ ........ ........ ........ 66% 285M 0s
156672K ........ ........ ........ ........ ........ ........ 68% 259M 0s
159744K ........ ........ ........ ........ ........ ........ 69% 276M 0s
162816K ........ ........ ........ ........ ........ ........ 70% 228M 0s
165888K ........ ........ ........ ........ ........ ........ 71% 332M 0s
168960K ........ ........ ........ ........ ........ ........ 73% 265M 0s
172032K ........ ........ ........ ........ ........ ........ 74% 268M 0s
175104K ........ ........ ........ ........ ........ ........ 75% 259M 0s
178176K ........ ........ ........ ........ ........ ........ 77% 259M 0s
181248K ........ ........ ........ ........ ........ ........ 78% 265M 0s
184320K ........ ........ ........ ........ ........ ........ 79% 256M 0s
187392K ........ ........ ........ ........ ........ ........ 81% 263M 0s
190464K ........ ........ ........ ........ ........ ........ 82% 270M 0s
193536K ........ ........ ........ ........ ........ ........ 83% 254M 0s
196608K ........ ........ ........ ........ ........ ........ 85% 278M 0s
199680K ........ ........ ........ ........ ........ ........ 86% 252M 0s
202752K ........ ........ ........ ........ ........ ........ 87% 278M 0s
205824K ........ ........ ........ ........ ........ ........ 88% 262M 0s
208896K ........ ........ ........ ........ ........ ........ 90% 236M 0s
211968K ........ ........ ........ ........ ........ ........ 91% 277M 0s
215040K ........ ........ ........ ........ ........ ........ 92% 255M 0s
218112K ........ ........ ........ ........ ........ ........ 94% 257M 0s
221184K ........ ........ ........ ........ ........ ........ 95% 306M 0s
224256K ........ ........ ........ ........ ........ ........ 96% 228M 0s
227328K ........ ........ ........ ........ ........ ........ 98% 239M 0s
230400K ........ ........ ........ ........ ........ ........ 99% 247M 0s
233472K ........ ........ ... 100% 213M=1.0s
2026-01-17 23:43:52 (235 MB/s) - ‘karaf-0.24.0-20260117.223656-12.zip’ saved [240365717/240365717]
Extracting the new controller...
+ echo 'Extracting the new controller...'
+ unzip -q karaf-0.24.0-20260117.223656-12.zip
Adding external repositories...
+ echo 'Adding external repositories...'
+ sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
+ cat /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
################################################################################
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
################################################################################
#
# If set to true, the following property will not allow any certificate to be used
# when accessing Maven repositories through SSL
#
#org.ops4j.pax.url.mvn.certificateCheck=
#
# Path to the local Maven settings file.
# The repositories defined in this file will be automatically added to the list
# of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property
# below is not set.
# The following locations are checked for the existence of the settings.xml file
# * 1. looks for the specified url
# * 2. if not found looks for ${user.home}/.m2/settings.xml
# * 3. if not found looks for ${maven.home}/conf/settings.xml
# * 4. if not found looks for ${M2_HOME}/conf/settings.xml
#
#org.ops4j.pax.url.mvn.settings=
#
# Path to the local Maven repository which is used to avoid downloading
# artifacts when they already exist locally.
# The value of this property will be extracted from the settings.xml file
# above, or defaulted to:
# System.getProperty( "user.home" ) + "/.m2/repository"
#
org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository}
#
# Default this to false. It's just weird to use undocumented repos
#
org.ops4j.pax.url.mvn.useFallbackRepositories=false
#
# Uncomment if you don't wanna use the proxy settings
# from the Maven conf/settings.xml file
#
# org.ops4j.pax.url.mvn.proxySupport=false
#
# Comma separated list of repositories scanned when resolving an artifact.
# Those repositories will be checked before iterating through the
# below list of repositories and even before the local repository
# A repository url can be appended with zero or more of the following flags:
# @snapshots : the repository contains snaphots
# @noreleases : the repository does not contain any released artifacts
#
# The following property value will add the system folder as a repo.
#
org.ops4j.pax.url.mvn.defaultRepositories=\
file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\
file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\
file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots
# Use the default local repo (e.g.~/.m2/repository) as a "remote" repo
#org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false
#
# Comma separated list of repositories scanned when resolving an artifact.
# The default list includes the following repositories:
# http://repo1.maven.org/maven2@id=central
# http://repository.springsource.com/maven/bundles/release@id=spring.ebr
# http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external
# http://zodiac.springsource.com/maven/bundles/release@id=gemini
# http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases
# https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases
# https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
# To add repositories to the default ones, prepend '+' to the list of repositories
# to add.
# A repository url can be appended with zero or more of the following flags:
# @snapshots : the repository contains snapshots
# @noreleases : the repository does not contain any released artifacts
# @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended
#
org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.Configuring the startup features...
+ [[ True == \T\r\u\e ]]
+ echo 'Configuring the startup features...'
+ sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
+ FEATURE_TEST_STRING=features-test
+ FEATURE_TEST_VERSION=0.24.0-SNAPSHOT
+ KARAF_VERSION=karaf4
+ [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]]
+ sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.24.0-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
+ [[ ! -z '' ]]
+ cat /tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
################################################################################
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
################################################################################
#
# Comma separated list of features repositories to register by default
#
featuresRepositories = mvn:org.opendaylight.integration/features-test/0.24.0-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/eef4f053-53e3-43e4-9c13-1e5bf5e49fc9.xml
#
# Comma separated list of features to install at startup
#
featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, e0ed419d-f0e5-4080-bffe-2232822c3309
#
# Resource repositories (OBR) that the features resolver can use
# to resolve requirements/capabilities
#
# The format of the resourceRepositories is
# resourceRepositories=[xml:url|json:url],...
# for Instance:
#
#resourceRepositories=xml:http://host/path/to/index.xml
# or
#resourceRepositories=json:http://host/path/to/index.json
#
#
# Defines if the boot features are started in asynchronous mode (in a dedicated thread)
#
featuresBootAsynchronous=false
#
# Service requirements enforcement
#
# By default, the feature resolver checks the service requirements/capabilities of
# bundles for new features (xml schema >= 1.3.0) in order to automatically installs
# the required bundles.
# The following flag can have those values:
# - disable: service requirements are completely ignored
# - default: service requirements are ignored for old features
# - enforce: service requirements are always verified
#
#serviceRequirements=default
#
# Store cfg file for config element in feature
#
#configCfgStore=true
#
# Define if the feature service automatically refresh bundles
#
autoRefresh=true
#
# Configuration of features processing mechanism (overrides, blacklisting, modification of features)
# XML file defines instructions related to features processing
# versions.properties may declare properties to resolve placeholders in XML file
# both files are relative to ${karaf.etc}
#
#featureProcessing=org.apache.karaf.features.xml
#featureProcessingVersions=versions.properties
+ configure_karaf_log karaf4 ''
+ local -r karaf_version=karaf4
+ local -r controllerdebugmap=
+ local logapi=log4j
+ grep log4j2 /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
log4j2.rootLogger.level = INFO
#log4j2.rootLogger.type = asyncRoot
#log4j2.rootLogger.includeLocation = false
log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
log4j2.rootLogger.appenderRef.Console.ref = Console
log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
log4j2.logger.spifly.name = org.apache.aries.spifly
log4j2.logger.spifly.level = WARN
log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
log4j2.logger.audit.level = INFO
log4j2.logger.audit.additivity = false
log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
# Console appender not used by default (see log4j2.rootLogger.appenderRefs)
log4j2.appender.console.type = Console
log4j2.appender.console.name = Console
log4j2.appender.console.layout.type = PatternLayout
log4j2.appender.console.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.type = RollingRandomAccessFile
log4j2.appender.rolling.name = RollingFile
log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
#log4j2.appender.rolling.immediateFlush = false
log4j2.appender.rolling.append = true
log4j2.appender.rolling.layout.type = PatternLayout
log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.policies.type = Policies
log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.rolling.policies.size.size = 64MB
log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
log4j2.appender.rolling.strategy.max = 7
log4j2.appender.audit.type = RollingRandomAccessFile
log4j2.appender.audit.name = AuditRollingFile
log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
log4j2.appender.audit.append = true
log4j2.appender.audit.layout.type = PatternLayout
log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
log4j2.appender.audit.policies.type = Policies
log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.audit.policies.size.size = 8MB
log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
log4j2.appender.audit.strategy.max = 7
log4j2.appender.osgi.type = PaxOsgi
log4j2.appender.osgi.name = PaxOsgi
log4j2.appender.osgi.filter = *
#log4j2.logger.aether.name = shaded.org.eclipse.aether
#log4j2.logger.aether.level = TRACE
#log4j2.logger.http-headers.name = shaded.org.apache.http.headers
#log4j2.logger.http-headers.level = DEBUG
#log4j2.logger.maven.name = org.ops4j.pax.url.mvn
#log4j2.logger.maven.level = TRACE
+ logapi=log4j2
+ echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2'
Configuring the karaf log... karaf_version: karaf4, logapi: log4j2
+ '[' log4j2 == log4j2 ']'
+ sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
+ orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver
+ orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver
+ echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN'
controllerdebugmap:
cat /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
+ echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN'
+ unset IFS
+ echo 'controllerdebugmap: '
+ '[' -n '' ']'
+ echo 'cat /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg'
+ cat /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
################################################################################
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
################################################################################
# Common pattern layout for appenders
log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
# Root logger
log4j2.rootLogger.level = INFO
# uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library
#log4j2.rootLogger.type = asyncRoot
#log4j2.rootLogger.includeLocation = false
log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
log4j2.rootLogger.appenderRef.Console.ref = Console
log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
# Filters for logs marked by org.opendaylight.odlparent.Markers
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
# Loggers configuration
# Spifly logger
log4j2.logger.spifly.name = org.apache.aries.spifly
log4j2.logger.spifly.level = WARN
# Security audit logger
log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
log4j2.logger.audit.level = INFO
log4j2.logger.audit.additivity = false
log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
# Appenders configuration
# Console appender not used by default (see log4j2.rootLogger.appenderRefs)
log4j2.appender.console.type = Console
log4j2.appender.console.name = Console
log4j2.appender.console.layout.type = PatternLayout
log4j2.appender.console.layout.pattern = ${log4j2.pattern}
# Rolling file appender
log4j2.appender.rolling.type = RollingRandomAccessFile
log4j2.appender.rolling.name = RollingFile
log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
# uncomment to not force a disk flush
#log4j2.appender.rolling.immediateFlush = false
log4j2.appender.rolling.append = true
log4j2.appender.rolling.layout.type = PatternLayout
log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.policies.type = Policies
log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.rolling.policies.size.size = 1GB
log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
log4j2.appender.rolling.strategy.max = 7
# Audit file appender
log4j2.appender.audit.type = RollingRandomAccessFile
log4j2.appender.audit.name = AuditRollingFile
log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
log4j2.appender.audit.append = true
log4j2.appender.audit.layout.type = PatternLayout
log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
log4j2.appender.audit.policies.type = Policies
log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.audit.policies.size.size = 8MB
log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
log4j2.appender.audit.strategy.max = 7
# OSGi appender
log4j2.appender.osgi.type = PaxOsgi
log4j2.appender.osgi.name = PaxOsgi
log4j2.appender.osgi.filter = *
# help with identification of maven-related problems with pax-url-aether
#log4j2.logger.aether.name = shaded.org.eclipse.aether
#log4j2.logger.aether.level = TRACE
#log4j2.logger.http-headers.name = shaded.org.apache.http.headers
#log4j2.logger.http-headers.level = DEBUG
#log4j2.logger.maven.name = org.ops4j.pax.url.mvn
#log4j2.logger.maven.level = TRACE
log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN
log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN
Configure
+ set_java_vars /usr/lib/jvm/java-21-openjdk-amd64 3072m /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
+ local -r java_home=/usr/lib/jvm/java-21-openjdk-amd64
+ local -r controllermem=3072m
+ local -r memconf=/tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
+ echo Configure
java home: /usr/lib/jvm/java-21-openjdk-amd64
max memory: 3072m
memconf: /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
+ echo ' java home: /usr/lib/jvm/java-21-openjdk-amd64'
+ echo ' max memory: 3072m'
+ echo ' memconf: /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv'
+ sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64}%g' /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
+ sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
cat /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
+ echo 'cat /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv'
+ cat /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
#!/bin/sh
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
#
# handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf
# script: client, instance, shell, start, status, stop, karaf
#
# if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then
# Actions go here...
# fi
#
# general settings which should be applied for all scripts go here; please keep
# in mind that it is possible that scripts might be executed more than once, e.g.
# in example of the start script where the start script is executed first and the
# karaf script afterwards.
#
#
# The following section shows the possible configuration options for the default
# karaf scripts
#
export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64} # Location of Java installation
# export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration
# export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options
# export EXTRA_JAVA_OPTS # Additional JVM options
# export KARAF_HOME # Karaf home folder
# export KARAF_DATA # Karaf data folder
# export KARAF_BASE # Karaf base folder
# export KARAF_ETC # Karaf etc folder
# export KARAF_LOG # Karaf log folder
# export KARAF_SYSTEM_OPTS # First citizen Karaf options
# export KARAF_OPTS # Additional available Karaf options
# export KARAF_DEBUG # Enable debug mode
# export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start
# export KARAF_NOROOT # Prevent execution as root if set to true
Set Java version
+ echo 'Set Java version'
+ sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-21-openjdk-amd64/bin/java 1
sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper
sudo: a password is required
+ sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-21-openjdk-amd64/bin/java
sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper
sudo: a password is required
+ echo 'JDK default version ...'
JDK default version ...
+ java -version
openjdk version "21.0.9" 2025-10-21
OpenJDK Runtime Environment (build 21.0.9+10-Ubuntu-122.04)
OpenJDK 64-Bit Server VM (build 21.0.9+10-Ubuntu-122.04, mixed mode, sharing)
Set JAVA_HOME
+ echo 'Set JAVA_HOME'
+ export JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64
+ JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64
++ readlink -e /usr/lib/jvm/java-21-openjdk-amd64/bin/java
Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java
Listing all open ports on controller system...
+ JAVA_RESOLVED=/usr/lib/jvm/java-21-openjdk-amd64/bin/java
+ echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java'
+ echo 'Listing all open ports on controller system...'
+ netstat -pnatu
/tmp/configuration-script.sh: line 40: netstat: command not found
Custom shard config exists!!!
Copying the shard config...
+ '[' -f /tmp/custom_shard_config.txt ']'
+ echo 'Custom shard config exists!!!'
+ echo 'Copying the shard config...'
+ cp /tmp/custom_shard_config.txt /tmp/karaf-0.24.0-SNAPSHOT/bin/
Configuring cluster
+ echo 'Configuring cluster'
+ /tmp/karaf-0.24.0-SNAPSHOT/bin/configure_cluster.sh 2 10.30.170.178 10.30.170.99 10.30.171.201
################################################
## Configure Cluster ##
################################################
NOTE: Cluster configuration files not found. Copying from
/tmp/karaf-0.24.0-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/12.0.3
Configuring unique name in pekko.conf
Configuring hostname in pekko.conf
Configuring data and rpc seed nodes in pekko.conf
modules = [
{
name = "inventory"
namespace = "urn:opendaylight:inventory"
shard-strategy = "module"
},
{
name = "topology"
namespace = "urn:TBD:params:xml:ns:yang:network-topology"
shard-strategy = "module"
},
{
name = "toaster"
namespace = "http://netconfcentral.org/ns/toaster"
shard-strategy = "module"
},
{
name = "car"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
shard-strategy = "module"
},
{
name = "people"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
shard-strategy = "module"
},
{
name = "car-people"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
shard-strategy = "module"
}
]
Configuring replication type in module-shards.conf
################################################
## NOTE: Manually restart controller to ##
## apply configuration. ##
################################################
Dump pekko.conf
+ echo 'Dump pekko.conf'
+ cat /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/pekko.conf
odl-cluster-data {
pekko {
remote {
artery {
enabled = on
transport = tcp
canonical.hostname = "10.30.170.99"
canonical.port = 2550
}
}
cluster {
# Using artery.
seed-nodes = ["pekko://opendaylight-cluster-data@10.30.170.178:2550",
"pekko://opendaylight-cluster-data@10.30.170.99:2550",
"pekko://opendaylight-cluster-data@10.30.171.201:2550"]
roles = ["member-2"]
# when under load we might trip a false positive on the failure detector
# failure-detector {
# heartbeat-interval = 4 s
# acceptable-heartbeat-pause = 16s
# }
}
persistence {
# By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by
# modifying the following two properties. The directory location specified may be a relative or absolute path.
# The relative path is always relative to KARAF_HOME.
# snapshot-store.local.dir = "target/snapshots"
}
disable-default-actor-system-quarantined-event-handling = "false"
}
}
Dump modules.conf
+ echo 'Dump modules.conf'
+ cat /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/modules.conf
modules = [
{
name = "inventory"
namespace = "urn:opendaylight:inventory"
shard-strategy = "module"
},
{
name = "topology"
namespace = "urn:TBD:params:xml:ns:yang:network-topology"
shard-strategy = "module"
},
{
name = "toaster"
namespace = "http://netconfcentral.org/ns/toaster"
shard-strategy = "module"
},
{
name = "car"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
shard-strategy = "module"
},
{
name = "people"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
shard-strategy = "module"
},
{
name = "car-people"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
shard-strategy = "module"
}
]
Dump module-shards.conf
+ echo 'Dump module-shards.conf'
+ cat /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/module-shards.conf
module-shards = [
{
name = "default"
shards = [
{
name = "default"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "inventory"
shards = [
{
name="inventory"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "topology"
shards = [
{
name="topology"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "toaster"
shards = [
{
name="toaster"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "car"
shards = [
{
name="car"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "people"
shards = [
{
name="people"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "car-people"
shards = [
{
name="car-people"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
}
]
Configuring member-3 with IP address 10.30.171.201
Warning: Permanently added '10.30.171.201' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.171.201' (ECDSA) to the list of known hosts.
+ source /tmp/common-functions.sh karaf-0.24.0-SNAPSHOT vanadium
common-functions.sh is being sourced
++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]]
++ echo 'common-functions.sh is being sourced'
++ BUNDLEFOLDER=karaf-0.24.0-SNAPSHOT
++ DISTROSTREAM=vanadium
++ export MAVENCONF=/tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
++ MAVENCONF=/tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
++ export FEATURESCONF=/tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
++ FEATURESCONF=/tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
++ export CUSTOMPROP=/tmp/karaf-0.24.0-SNAPSHOT/etc/custom.properties
++ CUSTOMPROP=/tmp/karaf-0.24.0-SNAPSHOT/etc/custom.properties
++ export LOGCONF=/tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
++ LOGCONF=/tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
++ export MEMCONF=/tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
++ MEMCONF=/tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
++ export CONTROLLERMEM=
++ CONTROLLERMEM=
++ case "${DISTROSTREAM}" in
++ CLUSTER_SYSTEM=pekko
++ export AKKACONF=/tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/pekko.conf
++ AKKACONF=/tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/pekko.conf
++ export MODULESCONF=/tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/modules.conf
++ MODULESCONF=/tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/modules.conf
++ export MODULESHARDSCONF=/tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/module-shards.conf
++ MODULESHARDSCONF=/tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/module-shards.conf
++ print_common_env
++ cat
common-functions environment:
MAVENCONF: /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
ACTUALFEATURES:
FEATURESCONF: /tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
CUSTOMPROP: /tmp/karaf-0.24.0-SNAPSHOT/etc/custom.properties
LOGCONF: /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
MEMCONF: /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
CONTROLLERMEM:
AKKACONF: /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/pekko.conf
MODULESCONF: /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/modules.conf
MODULESHARDSCONF: /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/module-shards.conf
SUITES:
++ SSH='ssh -t -t'
++ extra_services_cntl=' dnsmasq.service httpd.service libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service rabbitmq-server.service '
++ extra_services_cmp=' libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service '
Changing to /tmp
Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.24.0-SNAPSHOT/karaf-0.24.0-20260117.223656-12.zip
+ echo 'Changing to /tmp'
+ cd /tmp
+ echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.24.0-SNAPSHOT/karaf-0.24.0-20260117.223656-12.zip'
+ wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.24.0-SNAPSHOT/karaf-0.24.0-20260117.223656-12.zip
--2026-01-17 23:43:55-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.24.0-SNAPSHOT/karaf-0.24.0-20260117.223656-12.zip
Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6
Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 240365717 (229M) [application/zip]
Saving to: ‘karaf-0.24.0-20260117.223656-12.zip’
0K ........ ........ ........ ........ ........ ........ 1% 90.5M 2s
3072K ........ ........ ........ ........ ........ ........ 2% 164M 2s
6144K ........ ........ ........ ........ ........ ........ 3% 182M 2s
9216K ........ ........ ........ ........ ........ ........ 5% 159M 2s
12288K ........ ........ ........ ........ ........ ........ 6% 173M 1s
15360K ........ ........ ........ ........ ........ ........ 7% 197M 1s
18432K ........ ........ ........ ........ ........ ........ 9% 202M 1s
21504K ........ ........ ........ ........ ........ ........ 10% 227M 1s
24576K ........ ........ ........ ........ ........ ........ 11% 235M 1s
27648K ........ ........ ........ ........ ........ ........ 13% 225M 1s
30720K ........ ........ ........ ........ ........ ........ 14% 300M 1s
33792K ........ ........ ........ ........ ........ ........ 15% 303M 1s
36864K ........ ........ ........ ........ ........ ........ 17% 296M 1s
39936K ........ ........ ........ ........ ........ ........ 18% 272M 1s
43008K ........ ........ ........ ........ ........ ........ 19% 225M 1s
46080K ........ ........ ........ ........ ........ ........ 20% 283M 1s
49152K ........ ........ ........ ........ ........ ........ 22% 307M 1s
52224K ........ ........ ........ ........ ........ ........ 23% 243M 1s
55296K ........ ........ ........ ........ ........ ........ 24% 289M 1s
58368K ........ ........ ........ ........ ........ ........ 26% 242M 1s
61440K ........ ........ ........ ........ ........ ........ 27% 280M 1s
64512K ........ ........ ........ ........ ........ ........ 28% 242M 1s
67584K ........ ........ ........ ........ ........ ........ 30% 291M 1s
70656K ........ ........ ........ ........ ........ ........ 31% 302M 1s
73728K ........ ........ ........ ........ ........ ........ 32% 186M 1s
76800K ........ ........ ........ ........ ........ ........ 34% 270M 1s
79872K ........ ........ ........ ........ ........ ........ 35% 319M 1s
82944K ........ ........ ........ ........ ........ ........ 36% 284M 1s
86016K ........ ........ ........ ........ ........ ........ 37% 299M 1s
89088K ........ ........ ........ ........ ........ ........ 39% 298M 1s
92160K ........ ........ ........ ........ ........ ........ 40% 222M 1s
95232K ........ ........ ........ ........ ........ ........ 41% 309M 1s
98304K ........ ........ ........ ........ ........ ........ 43% 294M 1s
101376K ........ ........ ........ ........ ........ ........ 44% 226M 1s
104448K ........ ........ ........ ........ ........ ........ 45% 288M 1s
107520K ........ ........ ........ ........ ........ ........ 47% 323M 1s
110592K ........ ........ ........ ........ ........ ........ 48% 243M 1s
113664K ........ ........ ........ ........ ........ ........ 49% 214M 0s
116736K ........ ........ ........ ........ ........ ........ 51% 306M 0s
119808K ........ ........ ........ ........ ........ ........ 52% 319M 0s
122880K ........ ........ ........ ........ ........ ........ 53% 256M 0s
125952K ........ ........ ........ ........ ........ ........ 54% 225M 0s
129024K ........ ........ ........ ........ ........ ........ 56% 307M 0s
132096K ........ ........ ........ ........ ........ ........ 57% 315M 0s
135168K ........ ........ ........ ........ ........ ........ 58% 200M 0s
138240K ........ ........ ........ ........ ........ ........ 60% 264M 0s
141312K ........ ........ ........ ........ ........ ........ 61% 279M 0s
144384K ........ ........ ........ ........ ........ ........ 62% 294M 0s
147456K ........ ........ ........ ........ ........ ........ 64% 318M 0s
150528K ........ ........ ........ ........ ........ ........ 65% 242M 0s
153600K ........ ........ ........ ........ ........ ........ 66% 231M 0s
156672K ........ ........ ........ ........ ........ ........ 68% 295M 0s
159744K ........ ........ ........ ........ ........ ........ 69% 310M 0s
162816K ........ ........ ........ ........ ........ ........ 70% 307M 0s
165888K ........ ........ ........ ........ ........ ........ 71% 198M 0s
168960K ........ ........ ........ ........ ........ ........ 73% 268M 0s
172032K ........ ........ ........ ........ ........ ........ 74% 311M 0s
175104K ........ ........ ........ ........ ........ ........ 75% 314M 0s
178176K ........ ........ ........ ........ ........ ........ 77% 183M 0s
181248K ........ ........ ........ ........ ........ ........ 78% 319M 0s
184320K ........ ........ ........ ........ ........ ........ 79% 303M 0s
187392K ........ ........ ........ ........ ........ ........ 81% 281M 0s
190464K ........ ........ ........ ........ ........ ........ 82% 210M 0s
193536K ........ ........ ........ ........ ........ ........ 83% 285M 0s
196608K ........ ........ ........ ........ ........ ........ 85% 323M 0s
199680K ........ ........ ........ ........ ........ ........ 86% 319M 0s
202752K ........ ........ ........ ........ ........ ........ 87% 330M 0s
205824K ........ ........ ........ ........ ........ ........ 88% 324M 0s
208896K ........ ........ ........ ........ ........ ........ 90% 324M 0s
211968K ........ ........ ........ ........ ........ ........ 91% 326M 0s
215040K ........ ........ ........ ........ ........ ........ 92% 331M 0s
218112K ........ ........ ........ ........ ........ ........ 94% 324M 0s
221184K ........ ........ ........ ........ ........ ........ 95% 329M 0s
224256K ........ ........ ........ ........ ........ ........ 96% 330M 0s
227328K ........ ........ ........ ........ ........ ........ 98% 332M 0s
230400K ........ ........ ........ ........ ........ ........ 99% 328M 0s
233472K ........ ........ ... 100% 335M=0.9s
2026-01-17 23:43:56 (257 MB/s) - ‘karaf-0.24.0-20260117.223656-12.zip’ saved [240365717/240365717]
Extracting the new controller...
+ echo 'Extracting the new controller...'
+ unzip -q karaf-0.24.0-20260117.223656-12.zip
Adding external repositories...
+ echo 'Adding external repositories...'
+ sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
+ cat /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
################################################################################
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
################################################################################
#
# If set to true, the following property will not allow any certificate to be used
# when accessing Maven repositories through SSL
#
#org.ops4j.pax.url.mvn.certificateCheck=
#
# Path to the local Maven settings file.
# The repositories defined in this file will be automatically added to the list
# of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property
# below is not set.
# The following locations are checked for the existence of the settings.xml file
# * 1. looks for the specified url
# * 2. if not found looks for ${user.home}/.m2/settings.xml
# * 3. if not found looks for ${maven.home}/conf/settings.xml
# * 4. if not found looks for ${M2_HOME}/conf/settings.xml
#
#org.ops4j.pax.url.mvn.settings=
#
# Path to the local Maven repository which is used to avoid downloading
# artifacts when they already exist locally.
# The value of this property will be extracted from the settings.xml file
# above, or defaulted to:
# System.getProperty( "user.home" ) + "/.m2/repository"
#
org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository}
#
# Default this to false. It's just weird to use undocumented repos
#
org.ops4j.pax.url.mvn.useFallbackRepositories=false
#
# Uncomment if you don't wanna use the proxy settings
# from the Maven conf/settings.xml file
#
# org.ops4j.pax.url.mvn.proxySupport=false
#
# Comma separated list of repositories scanned when resolving an artifact.
# Those repositories will be checked before iterating through the
# below list of repositories and even before the local repository
# A repository url can be appended with zero or more of the following flags:
# @snapshots : the repository contains snaphots
# @noreleases : the repository does not contain any released artifacts
#
# The following property value will add the system folder as a repo.
#
org.ops4j.pax.url.mvn.defaultRepositories=\
file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\
file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\
file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots
# Use the default local repo (e.g.~/.m2/repository) as a "remote" repo
#org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false
#
# Comma separated list of repositories scanned when resolving an artifact.
# The default list includes the following repositories:
# http://repo1.maven.org/maven2@id=central
# http://repository.springsource.com/maven/bundles/release@id=spring.ebr
# http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external
# http://zodiac.springsource.com/maven/bundles/release@id=gemini
# http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases
# https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases
# https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
# To add repositories to the default ones, prepend '+' to the list of repositories
# to add.
# A repository url can be appended with zero or more of the following flags:
# @snapshots : the repository contains snapshots
# @noreleases : the repository does not contain any released artifacts
# @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended
#
org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.Configuring the startup features...
+ [[ True == \T\r\u\e ]]
+ echo 'Configuring the startup features...'
+ sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
+ FEATURE_TEST_STRING=features-test
+ FEATURE_TEST_VERSION=0.24.0-SNAPSHOT
+ KARAF_VERSION=karaf4
+ [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]]
+ sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.24.0-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
+ [[ ! -z '' ]]
+ cat /tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
################################################################################
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
################################################################################
#
# Comma separated list of features repositories to register by default
#
featuresRepositories = mvn:org.opendaylight.integration/features-test/0.24.0-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/eef4f053-53e3-43e4-9c13-1e5bf5e49fc9.xml
#
# Comma separated list of features to install at startup
#
featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, e0ed419d-f0e5-4080-bffe-2232822c3309
#
# Resource repositories (OBR) that the features resolver can use
# to resolve requirements/capabilities
#
# The format of the resourceRepositories is
# resourceRepositories=[xml:url|json:url],...
# for Instance:
#
#resourceRepositories=xml:http://host/path/to/index.xml
# or
#resourceRepositories=json:http://host/path/to/index.json
#
#
# Defines if the boot features are started in asynchronous mode (in a dedicated thread)
#
featuresBootAsynchronous=false
#
# Service requirements enforcement
#
# By default, the feature resolver checks the service requirements/capabilities of
# bundles for new features (xml schema >= 1.3.0) in order to automatically installs
# the required bundles.
# The following flag can have those values:
# - disable: service requirements are completely ignored
# - default: service requirements are ignored for old features
# - enforce: service requirements are always verified
#
#serviceRequirements=default
#
# Store cfg file for config element in feature
#
#configCfgStore=true
#
# Define if the feature service automatically refresh bundles
#
autoRefresh=true
#
# Configuration of features processing mechanism (overrides, blacklisting, modification of features)
# XML file defines instructions related to features processing
# versions.properties may declare properties to resolve placeholders in XML file
# both files are relative to ${karaf.etc}
#
#featureProcessing=org.apache.karaf.features.xml
#featureProcessingVersions=versions.properties
+ configure_karaf_log karaf4 ''
+ local -r karaf_version=karaf4
+ local -r controllerdebugmap=
+ local logapi=log4j
+ grep log4j2 /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
log4j2.rootLogger.level = INFO
#log4j2.rootLogger.type = asyncRoot
#log4j2.rootLogger.includeLocation = false
log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
log4j2.rootLogger.appenderRef.Console.ref = Console
log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
log4j2.logger.spifly.name = org.apache.aries.spifly
log4j2.logger.spifly.level = WARN
log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
log4j2.logger.audit.level = INFO
log4j2.logger.audit.additivity = false
log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
# Console appender not used by default (see log4j2.rootLogger.appenderRefs)
log4j2.appender.console.type = Console
log4j2.appender.console.name = Console
log4j2.appender.console.layout.type = PatternLayout
log4j2.appender.console.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.type = RollingRandomAccessFile
log4j2.appender.rolling.name = RollingFile
log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
#log4j2.appender.rolling.immediateFlush = false
log4j2.appender.rolling.append = true
log4j2.appender.rolling.layout.type = PatternLayout
log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.policies.type = Policies
log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.rolling.policies.size.size = 64MB
log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
log4j2.appender.rolling.strategy.max = 7
log4j2.appender.audit.type = RollingRandomAccessFile
log4j2.appender.audit.name = AuditRollingFile
log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
log4j2.appender.audit.append = true
log4j2.appender.audit.layout.type = PatternLayout
log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
log4j2.appender.audit.policies.type = Policies
log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.audit.policies.size.size = 8MB
log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
log4j2.appender.audit.strategy.max = 7
log4j2.appender.osgi.type = PaxOsgi
log4j2.appender.osgi.name = PaxOsgi
log4j2.appender.osgi.filter = *
#log4j2.logger.aether.name = shaded.org.eclipse.aether
#log4j2.logger.aether.level = TRACE
#log4j2.logger.http-headers.name = shaded.org.apache.http.headers
#log4j2.logger.http-headers.level = DEBUG
#log4j2.logger.maven.name = org.ops4j.pax.url.mvn
#log4j2.logger.maven.level = TRACE
Configuring the karaf log... karaf_version: karaf4, logapi: log4j2
+ logapi=log4j2
+ echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2'
+ '[' log4j2 == log4j2 ']'
+ sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
+ orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver
+ orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver
+ echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN'
controllerdebugmap:
cat /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
+ echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN'
+ unset IFS
+ echo 'controllerdebugmap: '
+ '[' -n '' ']'
+ echo 'cat /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg'
+ cat /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
################################################################################
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
################################################################################
# Common pattern layout for appenders
log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
# Root logger
log4j2.rootLogger.level = INFO
# uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library
#log4j2.rootLogger.type = asyncRoot
#log4j2.rootLogger.includeLocation = false
log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
log4j2.rootLogger.appenderRef.Console.ref = Console
log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
# Filters for logs marked by org.opendaylight.odlparent.Markers
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
# Loggers configuration
# Spifly logger
log4j2.logger.spifly.name = org.apache.aries.spifly
log4j2.logger.spifly.level = WARN
# Security audit logger
log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
log4j2.logger.audit.level = INFO
log4j2.logger.audit.additivity = false
log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
# Appenders configuration
# Console appender not used by default (see log4j2.rootLogger.appenderRefs)
log4j2.appender.console.type = Console
log4j2.appender.console.name = Console
log4j2.appender.console.layout.type = PatternLayout
log4j2.appender.console.layout.pattern = ${log4j2.pattern}
# Rolling file appender
log4j2.appender.rolling.type = RollingRandomAccessFile
log4j2.appender.rolling.name = RollingFile
log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
# uncomment to not force a disk flush
#log4j2.appender.rolling.immediateFlush = false
log4j2.appender.rolling.append = true
log4j2.appender.rolling.layout.type = PatternLayout
log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.policies.type = Policies
log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.rolling.policies.size.size = 1GB
log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
log4j2.appender.rolling.strategy.max = 7
# Audit file appender
log4j2.appender.audit.type = RollingRandomAccessFile
log4j2.appender.audit.name = AuditRollingFile
log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
log4j2.appender.audit.append = true
log4j2.appender.audit.layout.type = PatternLayout
log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
log4j2.appender.audit.policies.type = Policies
log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.audit.policies.size.size = 8MB
log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
log4j2.appender.audit.strategy.max = 7
# OSGi appender
log4j2.appender.osgi.type = PaxOsgi
log4j2.appender.osgi.name = PaxOsgi
log4j2.appender.osgi.filter = *
# help with identification of maven-related problems with pax-url-aether
#log4j2.logger.aether.name = shaded.org.eclipse.aether
#log4j2.logger.aether.level = TRACE
#log4j2.logger.http-headers.name = shaded.org.apache.http.headers
#log4j2.logger.http-headers.level = DEBUG
#log4j2.logger.maven.name = org.ops4j.pax.url.mvn
#log4j2.logger.maven.level = TRACE
log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN
log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN
Configure
java home: /usr/lib/jvm/java-21-openjdk-amd64
max memory: 3072m
memconf: /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
+ set_java_vars /usr/lib/jvm/java-21-openjdk-amd64 3072m /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
+ local -r java_home=/usr/lib/jvm/java-21-openjdk-amd64
+ local -r controllermem=3072m
+ local -r memconf=/tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
+ echo Configure
+ echo ' java home: /usr/lib/jvm/java-21-openjdk-amd64'
+ echo ' max memory: 3072m'
+ echo ' memconf: /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv'
+ sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64}%g' /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
+ sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
cat /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
+ echo 'cat /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv'
+ cat /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
#!/bin/sh
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
#
# handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf
# script: client, instance, shell, start, status, stop, karaf
#
# if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then
# Actions go here...
# fi
#
# general settings which should be applied for all scripts go here; please keep
# in mind that it is possible that scripts might be executed more than once, e.g.
# in example of the start script where the start script is executed first and the
# karaf script afterwards.
#
#
# The following section shows the possible configuration options for the default
# karaf scripts
#
export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64} # Location of Java installation
# export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration
# export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options
# export EXTRA_JAVA_OPTS # Additional JVM options
# export KARAF_HOME # Karaf home folder
# export KARAF_DATA # Karaf data folder
# export KARAF_BASE # Karaf base folder
# export KARAF_ETC # Karaf etc folder
# export KARAF_LOG # Karaf log folder
# export KARAF_SYSTEM_OPTS # First citizen Karaf options
# export KARAF_OPTS # Additional available Karaf options
# export KARAF_DEBUG # Enable debug mode
# export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start
# export KARAF_NOROOT # Prevent execution as root if set to true
Set Java version
+ echo 'Set Java version'
+ sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-21-openjdk-amd64/bin/java 1
sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper
sudo: a password is required
+ sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-21-openjdk-amd64/bin/java
sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper
sudo: a password is required
JDK default version ...
+ echo 'JDK default version ...'
+ java -version
openjdk version "21.0.9" 2025-10-21
OpenJDK Runtime Environment (build 21.0.9+10-Ubuntu-122.04)
OpenJDK 64-Bit Server VM (build 21.0.9+10-Ubuntu-122.04, mixed mode, sharing)
Set JAVA_HOME
+ echo 'Set JAVA_HOME'
+ export JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64
+ JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64
++ readlink -e /usr/lib/jvm/java-21-openjdk-amd64/bin/java
Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java
+ JAVA_RESOLVED=/usr/lib/jvm/java-21-openjdk-amd64/bin/java
+ echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java'
Listing all open ports on controller system...
+ echo 'Listing all open ports on controller system...'
+ netstat -pnatu
/tmp/configuration-script.sh: line 40: netstat: command not found
Custom shard config exists!!!
Copying the shard config...
+ '[' -f /tmp/custom_shard_config.txt ']'
+ echo 'Custom shard config exists!!!'
+ echo 'Copying the shard config...'
+ cp /tmp/custom_shard_config.txt /tmp/karaf-0.24.0-SNAPSHOT/bin/
Configuring cluster
+ echo 'Configuring cluster'
+ /tmp/karaf-0.24.0-SNAPSHOT/bin/configure_cluster.sh 3 10.30.170.178 10.30.170.99 10.30.171.201
################################################
## Configure Cluster ##
################################################
NOTE: Cluster configuration files not found. Copying from
/tmp/karaf-0.24.0-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/12.0.3
Configuring unique name in pekko.conf
Configuring hostname in pekko.conf
Configuring data and rpc seed nodes in pekko.conf
modules = [
{
name = "inventory"
namespace = "urn:opendaylight:inventory"
shard-strategy = "module"
},
{
name = "topology"
namespace = "urn:TBD:params:xml:ns:yang:network-topology"
shard-strategy = "module"
},
{
name = "toaster"
namespace = "http://netconfcentral.org/ns/toaster"
shard-strategy = "module"
},
{
name = "car"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
shard-strategy = "module"
},
{
name = "people"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
shard-strategy = "module"
},
{
name = "car-people"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
shard-strategy = "module"
}
]
Configuring replication type in module-shards.conf
################################################
## NOTE: Manually restart controller to ##
## apply configuration. ##
################################################
Dump pekko.conf
+ echo 'Dump pekko.conf'
+ cat /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/pekko.conf
odl-cluster-data {
pekko {
remote {
artery {
enabled = on
transport = tcp
canonical.hostname = "10.30.171.201"
canonical.port = 2550
}
}
cluster {
# Using artery.
seed-nodes = ["pekko://opendaylight-cluster-data@10.30.170.178:2550",
"pekko://opendaylight-cluster-data@10.30.170.99:2550",
"pekko://opendaylight-cluster-data@10.30.171.201:2550"]
roles = ["member-3"]
# when under load we might trip a false positive on the failure detector
# failure-detector {
# heartbeat-interval = 4 s
# acceptable-heartbeat-pause = 16s
# }
}
persistence {
# By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by
# modifying the following two properties. The directory location specified may be a relative or absolute path.
# The relative path is always relative to KARAF_HOME.
# snapshot-store.local.dir = "target/snapshots"
}
disable-default-actor-system-quarantined-event-handling = "false"
}
}
Dump modules.conf
+ echo 'Dump modules.conf'
+ cat /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/modules.conf
modules = [
{
name = "inventory"
namespace = "urn:opendaylight:inventory"
shard-strategy = "module"
},
{
name = "topology"
namespace = "urn:TBD:params:xml:ns:yang:network-topology"
shard-strategy = "module"
},
{
name = "toaster"
namespace = "http://netconfcentral.org/ns/toaster"
shard-strategy = "module"
},
{
name = "car"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
shard-strategy = "module"
},
{
name = "people"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
shard-strategy = "module"
},
{
name = "car-people"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
shard-strategy = "module"
}
]
Dump module-shards.conf
+ echo 'Dump module-shards.conf'
+ cat /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/module-shards.conf
module-shards = [
{
name = "default"
shards = [
{
name = "default"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "inventory"
shards = [
{
name="inventory"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "topology"
shards = [
{
name="topology"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "toaster"
shards = [
{
name="toaster"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "car"
shards = [
{
name="car"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "people"
shards = [
{
name="people"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "car-people"
shards = [
{
name="car-people"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
}
]
Locating config plan to use...
Finished running config plans
Starting member-1 with IP address 10.30.170.178
Warning: Permanently added '10.30.170.178' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.170.178' (ECDSA) to the list of known hosts.
Redirecting karaf console output to karaf_console.log
Starting controller...
start: Redirecting Karaf output to /tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf_console.log
Starting member-2 with IP address 10.30.170.99
Warning: Permanently added '10.30.170.99' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.170.99' (ECDSA) to the list of known hosts.
Redirecting karaf console output to karaf_console.log
Starting controller...
start: Redirecting Karaf output to /tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf_console.log
Starting member-3 with IP address 10.30.171.201
Warning: Permanently added '10.30.171.201' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.171.201' (ECDSA) to the list of known hosts.
Redirecting karaf console output to karaf_console.log
Starting controller...
start: Redirecting Karaf output to /tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf_console.log
[controller-csit-3node-clustering-tell-all-vanadium] $ /bin/bash /tmp/jenkins12741693804211791826.sh
common-functions.sh is being sourced
common-functions environment:
MAVENCONF: /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
ACTUALFEATURES:
FEATURESCONF: /tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
CUSTOMPROP: /tmp/karaf-0.24.0-SNAPSHOT/etc/custom.properties
LOGCONF: /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
MEMCONF: /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
CONTROLLERMEM: 2048m
AKKACONF: /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/pekko.conf
MODULESCONF: /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/modules.conf
MODULESHARDSCONF: /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/module-shards.conf
SUITES:
+ echo '#################################################'
#################################################
+ echo '## Verify Cluster is UP ##'
## Verify Cluster is UP ##
+ echo '#################################################'
#################################################
+ create_post_startup_script
+ cat
+ copy_and_run_post_startup_script
+ seed_index=1
++ seq 1 3
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_1_IP
+ echo 'Execute the post startup script on controller 10.30.170.178'
Execute the post startup script on controller 10.30.170.178
+ scp /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/post-startup-script.sh 10.30.170.178:/tmp/
Warning: Permanently added '10.30.170.178' (ECDSA) to the list of known hosts.
+ ssh 10.30.170.178 'bash /tmp/post-startup-script.sh 1'
Warning: Permanently added '10.30.170.178' (ECDSA) to the list of known hosts.
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
Waiting up to 3 minutes for controller to come up, checking every 5 seconds...
2026-01-17T23:44:42,561 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 323 - org.opendaylight.infrautils.ready-api - 7.1.9 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
Controller is UP
2026-01-17T23:44:42,561 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 323 - org.opendaylight.infrautils.ready-api - 7.1.9 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
Listing all open ports on controller system...
/tmp/post-startup-script.sh: line 51: netstat: command not found
looking for "BindException: Address already in use" in log file
looking for "server is unhealthy" in log file
+ '[' 1 == 0 ']'
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_2_IP
+ echo 'Execute the post startup script on controller 10.30.170.99'
Execute the post startup script on controller 10.30.170.99
+ scp /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/post-startup-script.sh 10.30.170.99:/tmp/
Warning: Permanently added '10.30.170.99' (ECDSA) to the list of known hosts.
+ ssh 10.30.170.99 'bash /tmp/post-startup-script.sh 2'
Warning: Permanently added '10.30.170.99' (ECDSA) to the list of known hosts.
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
Waiting up to 3 minutes for controller to come up, checking every 5 seconds...
2026-01-17T23:44:43,135 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 323 - org.opendaylight.infrautils.ready-api - 7.1.9 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
Controller is UP
2026-01-17T23:44:43,135 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 323 - org.opendaylight.infrautils.ready-api - 7.1.9 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
Listing all open ports on controller system...
/tmp/post-startup-script.sh: line 51: netstat: command not found
looking for "BindException: Address already in use" in log file
looking for "server is unhealthy" in log file
+ '[' 2 == 0 ']'
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_3_IP
+ echo 'Execute the post startup script on controller 10.30.171.201'
Execute the post startup script on controller 10.30.171.201
+ scp /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/post-startup-script.sh 10.30.171.201:/tmp/
Warning: Permanently added '10.30.171.201' (ECDSA) to the list of known hosts.
+ ssh 10.30.171.201 'bash /tmp/post-startup-script.sh 3'
Warning: Permanently added '10.30.171.201' (ECDSA) to the list of known hosts.
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
Waiting up to 3 minutes for controller to come up, checking every 5 seconds...
2026-01-17T23:44:43,353 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 323 - org.opendaylight.infrautils.ready-api - 7.1.9 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
Controller is UP
2026-01-17T23:44:43,353 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 323 - org.opendaylight.infrautils.ready-api - 7.1.9 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
Listing all open ports on controller system...
/tmp/post-startup-script.sh: line 51: netstat: command not found
looking for "BindException: Address already in use" in log file
looking for "server is unhealthy" in log file
+ '[' 0 == 0 ']'
+ seed_index=1
+ dump_controller_threads
++ seq 1 3
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_1_IP
+ echo 'Let'\''s take the karaf thread dump'
Let's take the karaf thread dump
+ ssh 10.30.170.178 'sudo ps aux'
Warning: Permanently added '10.30.170.178' (ECDSA) to the list of known hosts.
++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/ps_before.log
++ grep -v grep
++ tr -s ' '
++ cut -f2 '-d '
+ pid=2081
+ echo 'karaf main: org.apache.karaf.main.Main, pid:2081'
karaf main: org.apache.karaf.main.Main, pid:2081
+ ssh 10.30.170.178 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 2081'
Warning: Permanently added '10.30.170.178' (ECDSA) to the list of known hosts.
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_2_IP
+ echo 'Let'\''s take the karaf thread dump'
Let's take the karaf thread dump
+ ssh 10.30.170.99 'sudo ps aux'
Warning: Permanently added '10.30.170.99' (ECDSA) to the list of known hosts.
++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/ps_before.log
++ grep -v grep
++ tr -s ' '
++ cut -f2 '-d '
+ pid=2092
+ echo 'karaf main: org.apache.karaf.main.Main, pid:2092'
karaf main: org.apache.karaf.main.Main, pid:2092
+ ssh 10.30.170.99 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 2092'
Warning: Permanently added '10.30.170.99' (ECDSA) to the list of known hosts.
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_3_IP
+ echo 'Let'\''s take the karaf thread dump'
Let's take the karaf thread dump
+ ssh 10.30.171.201 'sudo ps aux'
Warning: Permanently added '10.30.171.201' (ECDSA) to the list of known hosts.
++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/ps_before.log
++ grep -v grep
++ tr -s ' '
++ cut -f2 '-d '
+ pid=2091
+ echo 'karaf main: org.apache.karaf.main.Main, pid:2091'
karaf main: org.apache.karaf.main.Main, pid:2091
+ ssh 10.30.171.201 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 2091'
Warning: Permanently added '10.30.171.201' (ECDSA) to the list of known hosts.
+ '[' 0 -gt 0 ']'
+ echo 'Generating controller variables...'
Generating controller variables...
++ seq 1 3
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_1_IP
+ odl_variables=' -v ODL_SYSTEM_1_IP:10.30.170.178'
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_2_IP
+ odl_variables=' -v ODL_SYSTEM_1_IP:10.30.170.178 -v ODL_SYSTEM_2_IP:10.30.170.99'
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_3_IP
+ odl_variables=' -v ODL_SYSTEM_1_IP:10.30.170.178 -v ODL_SYSTEM_2_IP:10.30.170.99 -v ODL_SYSTEM_3_IP:10.30.171.201'
+ echo 'Generating mininet variables...'
Generating mininet variables...
++ seq 1 0
+ get_test_suites SUITES
+ local __suite_list=SUITES
+ echo 'Locating test plan to use...'
Locating test plan to use...
+ testplan_filepath=/w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/testplans/controller-clustering-tell-vanadium.txt
+ '[' '!' -f /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/testplans/controller-clustering-tell-vanadium.txt ']'
+ testplan_filepath=/w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/testplans/controller-clustering-tell.txt
+ '[' disabled '!=' disabled ']'
+ echo 'Changing the testplan path...'
Changing the testplan path...
+ sed s:integration:/w/workspace/controller-csit-3node-clustering-tell-all-vanadium: /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/testplans/controller-clustering-tell.txt
+ cat testplan.txt
# Place the suites in run order:
# disabling all "prefix based" suites. This functionality was newly
# introduced with these tests in 2017. The assumption is that
# development stopped in that area, but may continue at a later
# time. Still, the tests are failing and no resources to solve the
# failures at this time. If/When this changes, we can uncomment
# those suites. Note that every suite is commented out with it's
# accompanying "restart_with_tell_based_true" setup suite.
# /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/ddb-sanity-prefix-based.robot
/w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
/w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot
/w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
/w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown_prefbasedshard.robot
/w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
/w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement_prefbasedshard.robot
/w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
/w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/leader_isolation_prefbasedshard.robot
/w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
/w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/client_isolation.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/client_isolation_prefbasedshard.robot
/w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
/w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/listener_stability.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/listener_stability_prefbasedshard.robot
/w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
/w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/cluster_singleton/master_stability.robot
/w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
/w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot
/w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
/w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot
/w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
/w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot
/w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot
/w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot
/w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot
/w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot
/w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot
/w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot
/w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot
+ '[' -z '' ']'
++ grep -E -v '(^[[:space:]]*#|^[[:space:]]*$)' testplan.txt
++ tr '\012' ' '
+ suite_list='/w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot '
+ eval 'SUITES='\''/w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot '\'''
++ SUITES='/w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot '
+ echo 'Starting Robot test suites /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot ...'
Starting Robot test suites /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot ...
+ robot -N controller-clustering-tell.txt --removekeywords wuks -e exclude -e skip_if_vanadium -v BUNDLEFOLDER:karaf-0.24.0-SNAPSHOT -v BUNDLE_URL:https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.24.0-SNAPSHOT/karaf-0.24.0-20260117.223656-12.zip -v CONTROLLER:10.30.170.178 -v CONTROLLER1:10.30.170.99 -v CONTROLLER2:10.30.171.201 -v CONTROLLER_USER:jenkins -v JAVA_HOME:/usr/lib/jvm/java-21-openjdk-amd64 -v JDKVERSION:openjdk21 -v JENKINS_WORKSPACE:/w/workspace/controller-csit-3node-clustering-tell-all-vanadium -v MININET: -v MININET1: -v MININET2: -v MININET_USER:jenkins -v NEXUSURL_PREFIX:https://nexus.opendaylight.org -v NUM_ODL_SYSTEM:3 -v NUM_TOOLS_SYSTEM:0 -v ODL_STREAM:vanadium -v ODL_SYSTEM_IP:10.30.170.178 -v ODL_SYSTEM_1_IP:10.30.170.178 -v ODL_SYSTEM_2_IP:10.30.170.99 -v ODL_SYSTEM_3_IP:10.30.171.201 -v ODL_SYSTEM_USER:jenkins -v TOOLS_SYSTEM_IP: -v TOOLS_SYSTEM_USER:jenkins -v USER_HOME:/home/jenkins -v IS_KARAF_APPL:True -v WORKSPACE:/tmp /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot
==============================================================================
controller-clustering-tell.txt
==============================================================================
controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
==============================================================================
Stop_All_Members :: Stop every odl node. | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync. | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ConnectionError: HTTPConnectionPool(host='10.30.171.201', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore (Caused by NewConnectionError("HTTPConnection(host='10.30.171.201', port=8181): Failed to establish a new connection: [Errno 111] Connection refused"))
------------------------------------------------------------------------------
controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-tell.txt.Ddb-Sanity-Module-Based :: DOMDataBroker tes...
==============================================================================
Get_Shard_Role :: Get shard role. | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_ddb_sanity_module_based_get_shard_role"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_get_shard_role&order=bug_status"
HTTPError: 404 Client Error: Not Found for url: http://10.30.170.178:8181/restconf/operations/cluster-admin:get-shard-role
------------------------------------------------------------------------------
Subscribe_Listener_To_Leader :: Subscribe listener to leader. | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_ddb_sanity_module_based_subscribe_listener_to_leader"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_subscribe_listener_to_leader&order=bug_status"
ConnectionError: HTTPConnectionPool(host='10.30.171.201', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-3-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError("HTTPConnection(host='10.30.171.201', port=8181): Failed to establish a new connection: [Errno 111] Connection refused"))
------------------------------------------------------------------------------
Subscribe_Listener_To_Follower :: Subscribe listener to follower. | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_ddb_sanity_module_based_subscribe_listener_to_follower"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_subscribe_listener_to_follower&order=bug_status"
ConnectionError: HTTPConnectionPool(host='10.30.171.201', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-3-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError("HTTPConnection(host='10.30.171.201', port=8181): Failed to establish a new connection: [Errno 111] Connection refused"))
------------------------------------------------------------------------------
Make_Leader_Local :: Make the loeader local and verify. | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_ddb_sanity_module_based_make_leader_local"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_make_leader_local&order=bug_status"
ConnectionError: HTTPConnectionPool(host='10.30.171.201', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-3-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError("HTTPConnection(host='10.30.171.201', port=8181): Failed to establish a new connection: [Errno 111] Connection refused"))
------------------------------------------------------------------------------
Remove_Leader_Shard_Replica_And_Add_It_Back :: Remove and add shar... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_ddb_sanity_module_based_remove_leader_shard_replica_and_add_it_back"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_remove_leader_shard_replica_and_add_it_back&order=bug_status"
ConnectionError: HTTPConnectionPool(host='10.30.171.201', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-3-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError("HTTPConnection(host='10.30.171.201', port=8181): Failed to establish a new connection: [Errno 111] Connection refused"))
------------------------------------------------------------------------------
Remove_Follower_Shard_Replica_And_Add_It_Back :: Remove and add sh... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_ddb_sanity_module_based_remove_follower_shard_replica_and_add_it_back"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_remove_follower_shard_replica_and_add_it_back&order=bug_status"
ConnectionError: HTTPConnectionPool(host='10.30.171.201', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-3-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError("HTTPConnection(host='10.30.171.201', port=8181): Failed to establish a new connection: [Errno 111] Connection refused"))
------------------------------------------------------------------------------
Write_Transactions_One_Node_Leader :: Write transactions. | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_one_node_leader"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_one_node_leader&order=bug_status"
ConnectionError: HTTPConnectionPool(host='10.30.171.201', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-3-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError("HTTPConnection(host='10.30.171.201', port=8181): Failed to establish a new connection: [Errno 111] Connection refused"))
------------------------------------------------------------------------------
Write_Transactions_One_Node_Follower :: Write transactions. | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_one_node_follower"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_one_node_follower&order=bug_status"
ConnectionError: HTTPConnectionPool(host='10.30.171.201', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-3-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError("HTTPConnection(host='10.30.171.201', port=8181): Failed to establish a new connection: [Errno 111] Connection refused"))
------------------------------------------------------------------------------
Write_Transactions_All_Nodes :: Write transactions. | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_all_nodes"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_all_nodes&order=bug_status"
Resolving variable '${response.text}' failed: AttributeError: 'ConnectionError' object has no attribute 'text'
------------------------------------------------------------------------------
controller-clustering-tell.txt.Ddb-Sanity-Module-Based :: DOMDataB... | FAIL |
9 tests, 0 passed, 9 failed
==============================================================================
controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
==============================================================================
Stop_All_Members :: Stop every odl node. | PASS |
------------------------------------------------------------------------------
Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync. | PASS |
------------------------------------------------------------------------------
controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | PASS |
3 tests, 3 passed, 0 failed
==============================================================================
controller-clustering-tell.txt.Clean Leader Shutdown :: DOMDataBroker testi...
==============================================================================
Local_Leader_Shutdown :: Shutdown the leader on the same node as t... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_clean_leader_shutdown_local_leader_shutdown"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_clean_leader_shutdown_local_leader_shutdown&order=bug_status"
HTTPError: 404 Client Error: Not Found for url: http://10.30.170.178:8181/restconf/operations/cluster-admin:remove-shard-replica
------------------------------------------------------------------------------
Restart :: Restart odl | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_clean_leader_shutdown_restart"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_clean_leader_shutdown_restart&order=bug_status"
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Remote_Leader_Shutdown :: Shutdown the leader on different node as... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_clean_leader_shutdown_remote_leader_shutdown"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_clean_leader_shutdown_remote_leader_shutdown&order=bug_status"
ConnectionError: HTTPConnectionPool(host='10.30.170.178', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError("HTTPConnection(host='10.30.170.178', port=8181): Failed to establish a new connection: [Errno 111] Connection refused"))
------------------------------------------------------------------------------
controller-clustering-tell.txt.Clean Leader Shutdown :: DOMDataBro... | FAIL |
3 tests, 0 passed, 3 failed
==============================================================================
controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
==============================================================================
Stop_All_Members :: Stop every odl node. | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync. | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ConnectionError: HTTPConnectionPool(host='10.30.171.201', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore (Caused by NewConnectionError("HTTPConnection(host='10.30.171.201', port=8181): Failed to establish a new connection: [Errno 111] Connection refused"))
------------------------------------------------------------------------------
controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-tell.txt.Explicit Leader Movement :: DOMDataBroker te...
==============================================================================
Local_To_Remote_Movement :: Leader moves from local to remote node... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_explicit_leader_movement_local_to_remote_movement"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_local_to_remote_movement&order=bug_status"
ConnectionError: HTTPConnectionPool(host='10.30.171.201', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-3-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError("HTTPConnection(host='10.30.171.201', port=8181): Failed to establish a new connection: [Errno 111] Connection refused"))
------------------------------------------------------------------------------
Restart1 :: Restart odl | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_explicit_leader_movement_restart1"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_restart1&order=bug_status"
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Remote_To_Remote_Movement :: Leader moves from one remote to other... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_explicit_leader_movement_remote_to_remote_movement"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_remote_to_remote_movement&order=bug_status"
ConnectionError: HTTPConnectionPool(host='10.30.170.178', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError("HTTPConnection(host='10.30.170.178', port=8181): Failed to establish a new connection: [Errno 111] Connection refused"))
------------------------------------------------------------------------------
Restart2 :: Restart odl | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_explicit_leader_movement_restart2"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_restart2&order=bug_status"
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Remote_To_Local_Movement :: Leader moves from remote to local node... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_explicit_leader_movement_remote_to_local_movement"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_remote_to_local_movement&order=bug_status"
ConnectionError: HTTPConnectionPool(host='10.30.170.178', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError("HTTPConnection(host='10.30.170.178', port=8181): Failed to establish a new connection: [Errno 111] Connection refused"))
------------------------------------------------------------------------------
controller-clustering-tell.txt.Explicit Leader Movement :: DOMData... | FAIL |
5 tests, 0 passed, 5 failed
==============================================================================
controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
==============================================================================
Stop_All_Members :: Stop every odl node. | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync. | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ConnectionError: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response'))
------------------------------------------------------------------------------
controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-tell.txt.Leader Isolation :: DOMDataBroker testing: L...
==============================================================================
Healing_Within_Request_Timeout :: The isolated node (leader) is re... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_leader_isolation_healing_within_request_timeout"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_leader_isolation_healing_within_request_timeout&order=bug_status"
ConnectionError: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response'))
------------------------------------------------------------------------------
Restart :: Restart odl | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_leader_isolation_restart"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_leader_isolation_restart&order=bug_status"
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Healing_After_Request_Timeout :: The isolated node (leader) is rej... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_leader_isolation_healing_after_request_timeout"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_leader_isolation_healing_after_request_timeout&order=bug_status"
ConnectionError: HTTPConnectionPool(host='10.30.170.178', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError("HTTPConnection(host='10.30.170.178', port=8181): Failed to establish a new connection: [Errno 111] Connection refused"))
------------------------------------------------------------------------------
controller-clustering-tell.txt.Leader Isolation :: DOMDataBroker t... | FAIL |
3 tests, 0 passed, 3 failed
==============================================================================
controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
==============================================================================
Stop_All_Members :: Stop every odl node. | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync. | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ConnectionError: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response'))
------------------------------------------------------------------------------
controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-tell.txt.Client Isolation :: DOMDataBroker testing: C...
==============================================================================
Producer_On_Shard_Leader_Node_ChainedTx :: Client isolation with p... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_client_isolation_producer_on_shard_leader_node_chainedtx"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_producer_on_shard_leader_node_chainedtx&order=bug_status"
ConnectionError: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response'))
Also keyword teardown failed:
Several failures occurred:
1) Variable '${client_node_dst}' not found.
2) Variable '${client_node_dst}' not found.
3) Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 1 minute 10 seconds. The last error was: Several failures occurred:
1) ConnectionError: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response'))
2) Resolving variable '${response.text}' failed: AttributeError: 'NoneType' object has no attribute 'text'
3) Resolving variable '${response.status_code}' failed: AttributeError: 'No...
[ Message content over the limit has been removed. ]
65) Resolving variable '${response.text}' failed: AttributeError: 'NoneType' object has no attribute 'text'
66) Evaluating expression "json.loads('''None''')" failed: JSONDecodeError: Expecting value: line 1 column 1 (char 0)
67) ValueError: Argument 'dictionary' got value 'None' (None) that cannot be converted to Mapping.
68) ValueError: Argument 'dictionary' got value 'None' (None) that cannot be converted to Mapping.
69) Unrecognized Raft state: None
70) No leader found.
71) Too many Leaders.
72) IndexError: Given index 0 is out of the range 0--1.
------------------------------------------------------------------------------
Restart1 :: Restart odl | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_client_isolation_restart1"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_restart1&order=bug_status"
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Producer_On_Shard_Leader_Node_SimpleTx :: Client isolation with pr... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_client_isolation_producer_on_shard_leader_node_simpletx"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_producer_on_shard_leader_node_simpletx&order=bug_status"
ConnectionError: HTTPConnectionPool(host='10.30.170.178', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError("HTTPConnection(host='10.30.170.178', port=8181): Failed to establish a new connection: [Errno 111] Connection refused"))
Also keyword teardown failed:
Several failures occurred:
1) Variable '${client_node_dst}' not found.
2) Variable '${client_node_dst}' not found.
3) Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 1 minute 10 seconds. The last error was: Several failures occurred:
1) ConnectionError: HTTPConnectionPool(host='10.30.170.178', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError("HTTPConnection(host='10.30.170.178', port=8181): ...
[ Message content over the limit has been removed. ]
...se.text}' failed: AttributeError: 'NoneType' object has no attribute 'text'
174) Evaluating expression "json.loads('''None''')" failed: JSONDecodeError: Expecting value: line 1 column 1 (char 0)
175) ValueError: Argument 'dictionary' got value 'None' (None) that cannot be converted to Mapping.
176) ValueError: Argument 'dictionary' got value 'None' (None) that cannot be converted to Mapping.
177) Unrecognized Raft state: None
178) No leader found.
179) Too many Leaders.
180) IndexError: Given index 0 is out of the range 0--1.
4) KeyError: 'threads'
------------------------------------------------------------------------------
Restart2 :: Restart odl | PASS |
------------------------------------------------------------------------------
Producer_On_Shard_Non_Leader_Node_ChainedTx :: Client isolation wi... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_client_isolation_producer_on_shard_non_leader_node_chainedtx"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_producer_on_shard_non_leader_node_chainedtx&order=bug_status"
Keyword 'Ongoing_Transactions_Failed' failed after retrying for 20 seconds. The last error was: Variable '${resp}' is None, which is not subscriptable, and thus accessing item '2' from it is not possible. To use '[2]' as a literal value, it needs to be escaped like '\[2]'.
Also keyword teardown failed:
Several failures occurred:
1) Keyword 'Check_Cluster_Is_In_Sync' failed after retrying for 1 minute. The last error was: Several failures occurred:
1) HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore
2) Resolving variable '${response.text}' failed: AttributeError: 'NoneType' object has no attribute 'text'
3) Resolving variable '${response.status_code}' failed: AttributeError: 'NoneType' object has no attribute 'status_code'
[ Message content over the limit has been removed. ]
48) Resolving variable '${response.status_code}' failed: AttributeError: 'NoneType' object has no attribute 'status_code'
49) Resolving variable '${response.status_code}' failed: AttributeError: 'NoneType' object has no attribute 'status_code'
50) Resolving variable '${response.text}' failed: AttributeError: 'NoneType' object has no attribute 'text'
51) Evaluating expression "json.loads('''None''')" failed: JSONDecodeError: Expecting value: line 1 column 1 (char 0)
52) ValueError: Argument 'dictionary' got value 'None' (None) that cannot be converted to Mapping.
53) ValueError: Argument 'dictionary' got value 'None' (None) that cannot be converted to Mapping.
54) Unrecognized Raft state: None
------------------------------------------------------------------------------
Restart3 :: Restart odl | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_client_isolation_restart3"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_restart3&order=bug_status"
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Producer_On_Shard_Non_Leader_Node_SimpleTx :: Client isolation wit... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_client_isolation_producer_on_shard_non_leader_node_simpletx"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_producer_on_shard_non_leader_node_simpletx&order=bug_status"
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore
Also keyword teardown failed:
Several failures occurred:
1) Variable '${client_node_dst}' not found.
2) Variable '${client_node_dst}' not found.
3) Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 1 minute 10 seconds. The last error was: Several failures occurred:
1) HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore
2) Resolving variable '${response.text}' failed: AttributeError: 'NoneType' object has no attribute 'text'
[ Message content over the limit has been removed. ]
...se.text}' failed: AttributeError: 'NoneType' object has no attribute 'text'
174) Evaluating expression "json.loads('''None''')" failed: JSONDecodeError: Expecting value: line 1 column 1 (char 0)
175) ValueError: Argument 'dictionary' got value 'None' (None) that cannot be converted to Mapping.
176) ValueError: Argument 'dictionary' got value 'None' (None) that cannot be converted to Mapping.
177) Unrecognized Raft state: None
178) No leader found.
179) Too many Leaders.
180) IndexError: Given index 0 is out of the range 0--1.
4) KeyError: 'threads'
------------------------------------------------------------------------------
controller-clustering-tell.txt.Client Isolation :: DOMDataBroker t... | FAIL |
7 tests, 1 passed, 6 failed
==============================================================================
controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
==============================================================================
Stop_All_Members :: Stop every odl node. | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync. | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore
------------------------------------------------------------------------------
controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-tell.txt.Listener Stability :: DOMDataBroker testing:...
==============================================================================
Move_Leader_From_Listener_Local_To_Remote :: Listener runs on lead... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_listener_stability_move_leader_from_listener_local_to_remote"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_listener_stability_move_leader_from_listener_local_to_remote&order=bug_status"
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore
------------------------------------------------------------------------------
Restart_1 :: Restart odl. | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_listener_stability_restart_1"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_listener_stability_restart_1&order=bug_status"
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Move_Leader_From_Listener_Remote_To_Other_Remote :: Listener runs ... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_listener_stability_move_leader_from_listener_remote_to_other_remote"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_listener_stability_move_leader_from_listener_remote_to_other_remote&order=bug_status"
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore
------------------------------------------------------------------------------
Restart_2 :: Restart odl. | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_listener_stability_restart_2"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_listener_stability_restart_2&order=bug_status"
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Move_Leader_From_Listener_Remote_To_Local :: Listener runs on foll... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_listener_stability_move_leader_from_listener_remote_to_local"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_listener_stability_move_leader_from_listener_remote_to_local&order=bug_status"
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore
------------------------------------------------------------------------------
controller-clustering-tell.txt.Listener Stability :: DOMDataBroker... | FAIL |
5 tests, 0 passed, 5 failed
==============================================================================
controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
==============================================================================
Stop_All_Members :: Stop every odl node. | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync. | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore
------------------------------------------------------------------------------
controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-tell.txt.Master Stability :: Cluster Singleton testin...
==============================================================================
Register_Singleton_Constant_On_Each_Node_And_Verify :: Register a ... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_master_stability_register_singleton_constant_on_each_node_and_verify"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_register_singleton_constant_on_each_node_and_verify&order=bug_status"
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/operations/odl-mdsal-lowlevel-control:register-singleton-constant
------------------------------------------------------------------------------
Unregister_Singleton_Constant_On_Non_Master_Node :: Unregister the... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_master_stability_unregister_singleton_constant_on_non_master_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_unregister_singleton_constant_on_non_master_node&order=bug_status"
Variable '@{cs_candidates}' not found. Did you mean:
@{cs_exp_candidates}
------------------------------------------------------------------------------
Monitor_Stability_While_Unregistered :: Verify that the owner rema... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_master_stability_monitor_stability_while_unregistered"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_monitor_stability_while_unregistered&order=bug_status"
Variable '${cs_owner}' not found.
------------------------------------------------------------------------------
Reregister_Singleton_Constant :: Re-register the unregistered cand... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_master_stability_reregister_singleton_constant"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_reregister_singleton_constant&order=bug_status"
Variable '${unregistered_node}' not found.
------------------------------------------------------------------------------
Verify_Stability_After_Reregistration :: Verify that the owner rem... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_master_stability_verify_stability_after_reregistration"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_verify_stability_after_reregistration&order=bug_status"
Variable '${cs_owner}' not found.
------------------------------------------------------------------------------
Unregister_Singleton_Constant_On_Each_Node :: Unregister the appli... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_master_stability_unregister_singleton_constant_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_unregister_singleton_constant_on_each_node&order=bug_status"
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/operations/odl-mdsal-lowlevel-control:unregister-singleton-constant
------------------------------------------------------------------------------
controller-clustering-tell.txt.Master Stability :: Cluster Singlet... | FAIL |
6 tests, 0 passed, 6 failed
==============================================================================
controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
==============================================================================
Stop_All_Members :: Stop every odl node. | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync. | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore
------------------------------------------------------------------------------
controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-tell.txt.Partition And Heal :: Cluster Singleton test...
==============================================================================
Register_Singleton_Constant_On_Each_Node :: Register a candidate a... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_partition_and_heal_register_singleton_constant_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_register_singleton_constant_on_each_node&order=bug_status"
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/operations/odl-mdsal-lowlevel-control:register-singleton-constant
------------------------------------------------------------------------------
Verify_Singleton_Constant_On_Each_Node :: Store the owner and cand... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_partition_and_heal_verify_singleton_constant_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_verify_singleton_constant_on_each_node&order=bug_status"
Could not parse owner and candidates for device get-singleton-constant-service']
------------------------------------------------------------------------------
Isolate_Owner_Node :: Isolate the cluster node which is the owner.... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_partition_and_heal_isolate_owner_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_isolate_owner_node&order=bug_status"
Variable '${cs_owner}' not found.
------------------------------------------------------------------------------
Monitor_Stability_While_Isolated :: Monitor the stability of the s... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_partition_and_heal_monitor_stability_while_isolated"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_monitor_stability_while_isolated&order=bug_status"
Invalid IF condition: Evaluating expression '"${index}" == "${cs_isolated_index}"' failed: Variable '${cs_isolated_index}' not found.
------------------------------------------------------------------------------
Rejoin_Isolated_node :: Rejoin isolated node. | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_partition_and_heal_rejoin_isolated_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_rejoin_isolated_node&order=bug_status"
Variable '${cs_isolated_index}' not found.
------------------------------------------------------------------------------
Unregister_Singleton_Constant_On_Each_Node :: Unregister the appli... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_partition_and_heal_unregister_singleton_constant_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_unregister_singleton_constant_on_each_node&order=bug_status"
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/operations/odl-mdsal-lowlevel-control:unregister-singleton-constant
------------------------------------------------------------------------------
controller-clustering-tell.txt.Partition And Heal :: Cluster Singl... | FAIL |
6 tests, 0 passed, 6 failed
==============================================================================
controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
==============================================================================
Stop_All_Members :: Stop every odl node. | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync. | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore
------------------------------------------------------------------------------
controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-tell.txt.Chasing The Leader :: Cluster Singleton test...
==============================================================================
Register_Candidates :: Register a candidate application on each no... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_chasing_the_leader_register_candidates"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_chasing_the_leader_register_candidates&order=bug_status"
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/operations/odl-mdsal-lowlevel-control:register-flapping-singleton
------------------------------------------------------------------------------
Do_Nothing :: Do nothing for the time of the test duration, becaus... | PASS |
------------------------------------------------------------------------------
Unregister_Candidates_And_Validate_Criteria :: Unregister the test... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_chasing_the_leader_unregister_candidates_and_validate_criteria"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_chasing_the_leader_unregister_candidates_and_validate_criteria&order=bug_status"
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/operations/odl-mdsal-lowlevel-control:unregister-flapping-singleton
------------------------------------------------------------------------------
controller-clustering-tell.txt.Chasing The Leader :: Cluster Singl... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
==============================================================================
Stop_All_Members :: Stop every odl node. | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync. | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore
------------------------------------------------------------------------------
controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-tell.txt.Carpeople Crud :: Suite for performing basic...
==============================================================================
Add_Cars_To_Leader :: Add 30 cars to car Leader by one big PUT. | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Added_Cars_On_Leader :: GET response from Leader should match ... | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Added_Cars_On_Followers :: The same check on other members. | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Add_People_To_First_Follower :: Add 30 people to people first Foll... | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Added_People_On_Leader :: GET response from Leader should matc... | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Added_People_On_Followers :: The same check on other members. | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Leader :: Buy some cars on car-people Leader, loop of ... | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Followers :: On each Follower buy corresponding ID seg... | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Added_CarPeople_On_Leader :: GET car-person mappings from Lead... | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Added_CarPeople_On_Followers :: The same check on other members. | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_All_CarPeople_On_Leader :: DELETE car-people container. No ... | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_All_People_On_Leader :: DELETE people container. No verific... | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_All_Cars_On_Leader :: DELETE cars container. No verificatio... | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
controller-clustering-tell.txt.Carpeople Crud :: Suite for perform... | FAIL |
Suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
13 tests, 0 passed, 13 failed
==============================================================================
controller-clustering-tell.txt.Car Failover Crud :: Suite mixing basic oper...
==============================================================================
Add_Original_Cars_On_Old_Leader_And_Verify :: Add initial cars on ... | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Stop_Original_Car_Leader :: Stop the car Leader to cause a new lea... | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Wait_For_New_Leader :: Wait until new car Leader is elected. | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Original_Cars_On_New_Leader :: GET cars from new Leader, shoul... | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Original_Cars_On_New_Followers :: The same check on other exis... | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_Original_Cars_On_New_Leader :: Delete cars on the new Leader. | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Add_Leader_Cars_On_New_Leader :: Add cars on the new Leader. | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Leader_Cars_On_New_Leader :: GET cars from new Leader, should ... | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Leader_Cars_On_New_Followers :: The same check on other existi... | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_Leader_Cars_On_New_First_Follower :: Delete cars in new fir... | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Add_Follower_Cars_On_New_First_Follower :: Add cars on the new fir... | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Folower_Cars_On_New_Leader :: Get cars from the new Leader, sh... | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Follower_Cars_On_New_Followers :: The same check on other exis... | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Start_Old_Car_Leader :: Start the stopped member without deleting ... | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Folower_Cars_On_Old_Leader :: GET cars from the restarted memb... | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_Follower_Cars_On_New_Leader :: Delete cars on the last Leader. | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
controller-clustering-tell.txt.Car Failover Crud :: Suite mixing b... | FAIL |
Suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
16 tests, 0 passed, 16 failed
==============================================================================
controller-clustering-tell.txt.Car Persistence Recovery :: This test restar...
==============================================================================
Add_Cars_On_Leader_And_Verify :: Single big PUT to datastore to ad... | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Stop_All_Members :: Stop all controllers. | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Start_All_Members :: Start all controllers (should restore the per... | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Memorize_Leader_And_Followers :: Locate current Leader of car Shard. | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Cars_On_Leader :: GET cars from Leader, should match the PUT d... | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Cars_On_Followers :: The same check on other members. | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_Cars_On_Leader :: Delete cars on the new Leader. | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
controller-clustering-tell.txt.Car Persistence Recovery :: This te... | FAIL |
Suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
7 tests, 0 passed, 7 failed
==============================================================================
controller-clustering-tell.txt.Buycar Failover :: This test focuses on test...
==============================================================================
Add_Cars_To_Leader_And_Verify :: Add all needed cars to car Leader... | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Add_People_To_First_Follower_And_Verify :: Add all needed people t... | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Leader_And_Verify :: Buy some cars on the leader member. | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Follower_And_Verify :: Buy some cars on the first foll... | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Reboot_People_Leader :: Previous people Leader is rebooted. We sho... | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Leader_After_Reboot_And_Verify :: Buy some cars on the... | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Follower_After_Reboot_And_Verify :: Buy some cars on t... | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_All_CarPeople :: DELETE car-people container. No verificati... | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_All_People :: DELETE people container. No verification beyo... | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_All_Cars :: DELETE cars container. No verification beyond h... | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
controller-clustering-tell.txt.Buycar Failover :: This test focuse... | FAIL |
Suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
10 tests, 0 passed, 10 failed
==============================================================================
controller-clustering-tell.txt.Entity Isolate :: Suite for performing membe...
==============================================================================
Check All Shards Before Isolate :: Check all shards in controller. | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Isolate Entity Leader :: Isolate the entity-ownership Leader to ca... | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Check All Shards After Isolate :: Check all shards in controller. | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Rejoin Entity Leader :: Rejoin the entity-ownership Leader. | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Check All Shards After Rejoin :: Check all shards in controller. | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
controller-clustering-tell.txt.Entity Isolate :: Suite for perform... | FAIL |
Suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
5 tests, 0 passed, 5 failed
==============================================================================
controller-clustering-tell.txt.Buycar Failover Isolation :: This test focus...
==============================================================================
Add_Cars_To_Leader_And_Verify :: Add all needed cars to car Leader... | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Add_People_To_First_Follower_And_Verify :: Add all needed people t... | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Leader_And_Verify :: Buy some cars on the leader member. | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Follower_And_Verify :: Buy some cars on the first foll... | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Isolate_and_Rejoin_People_Leader :: Previous people Leader is isol... | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Leader_After_Rejoin_And_Verify :: Buy some cars on the... | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Follower_After_Rejoin_And_Verify :: Buy some cars on t... | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_All_CarPeople :: DELETE car-people container. No verificati... | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_All_People :: DELETE people container. No verification beyo... | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_All_Cars :: DELETE cars container. No verification beyond h... | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
controller-clustering-tell.txt.Buycar Failover Isolation :: This t... | FAIL |
Suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
10 tests, 0 passed, 10 failed
==============================================================================
controller-clustering-tell.txt.Car Failover Crud Isolation :: Suite mixing ...
==============================================================================
Add_Original_Cars_On_Old_Leader_And_Verify :: Add initial cars on ... | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Isolate_Original_Car_Leader :: Isolate the car Leader to cause a n... | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Wait_For_New_Leader :: Wait until new car Leader is elected. | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Original_Cars_On_New_Leader :: GET cars from new Leader, shoul... | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Original_Cars_On_New_Followers :: The same check on other exis... | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_Original_Cars_On_New_Leader :: Delete cars on the new Leader. | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Add_Leader_Cars_On_New_Leader :: Add cars on the new Leader. | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Leader_Cars_On_New_Leader :: GET cars from new Leader, should ... | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Leader_Cars_On_New_Followers :: The same check on other existi... | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_Leader_Cars_On_New_First_Follower :: Delete cars in new fir... | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Add_Follower_Cars_On_New_First_Follower :: Add cars on the new fir... | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Folower_Cars_On_New_Leader :: Get cars from the new Leader, sh... | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Follower_Cars_On_New_Followers :: The same check on other exis... | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Rejoin_Old_Car_Leader :: Rejoin the isolated member without deleti... | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Folower_Cars_On_Old_Leader :: GET cars from the restarted memb... | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_Follower_Cars_On_New_Leader :: Delete cars on the last Leader. | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
controller-clustering-tell.txt.Car Failover Crud Isolation :: Suit... | FAIL |
Suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
16 tests, 0 passed, 16 failed
==============================================================================
controller-clustering-tell.txt.Car Outage Corners :: Cluster suite for test...
==============================================================================
Stop_Majority_Of_The_Followers :: Stop half plus one car Follower ... | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Attempt_To_Add_Cars_To_Leader :: Adding cars should fail, as major... | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Start_Tipping_Follower :: Start one Follower member without persis... | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Add_Cars_On_Tipping_Follower :: Add cars on the tipping Follower. | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Cars_On_Existing_Members :: On each up member: GET cars, shoul... | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Start_Other_Followers :: Start other followers without persisted d... | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Cars_On_New_Follower_Leader :: GET cars from a new follower to... | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_Cars_On_Leader :: Delete cars on Leader. | FAIL |
Parent suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
controller-clustering-tell.txt.Car Outage Corners :: Cluster suite... | FAIL |
Suite setup failed:
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
8 tests, 0 passed, 8 failed
==============================================================================
controller-clustering-tell.txt | FAIL |
162 tests, 14 passed, 148 failed
==============================================================================
Output: /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/output.xml
Log: /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/log.html
Report: /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/report.html
+ true
+ echo 'Examining the files in data/log and checking filesize'
Examining the files in data/log and checking filesize
+ ssh 10.30.170.178 'ls -altr /tmp/karaf-0.24.0-SNAPSHOT/data/log/'
Warning: Permanently added '10.30.170.178' (ECDSA) to the list of known hosts.
total 87640
drwxrwxr-x 2 jenkins jenkins 4096 Jan 17 23:44 .
-rw-rw-r-- 1 jenkins jenkins 1720 Jan 17 23:44 karaf_console.log
drwxrwxr-x 4 jenkins jenkins 4096 Jan 18 02:54 ..
-rw-rw-r-- 1 jenkins jenkins 89724147 Jan 18 03:01 karaf.log
+ ssh 10.30.170.178 'du -hs /tmp/karaf-0.24.0-SNAPSHOT/data/log/*'
Warning: Permanently added '10.30.170.178' (ECDSA) to the list of known hosts.
86M /tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf.log
4.0K /tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf_console.log
+ ssh 10.30.170.99 'ls -altr /tmp/karaf-0.24.0-SNAPSHOT/data/log/'
Warning: Permanently added '10.30.170.99' (ECDSA) to the list of known hosts.
total 139408
drwxrwxr-x 2 jenkins jenkins 4096 Jan 17 23:44 .
-rw-rw-r-- 1 jenkins jenkins 1720 Jan 17 23:44 karaf_console.log
drwxrwxr-x 9 jenkins jenkins 4096 Jan 18 02:55 ..
-rw-rw-r-- 1 jenkins jenkins 142734505 Jan 18 03:01 karaf.log
+ ssh 10.30.170.99 'du -hs /tmp/karaf-0.24.0-SNAPSHOT/data/log/*'
Warning: Permanently added '10.30.170.99' (ECDSA) to the list of known hosts.
137M /tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf.log
4.0K /tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf_console.log
+ ssh 10.30.171.201 'ls -altr /tmp/karaf-0.24.0-SNAPSHOT/data/log/'
Warning: Permanently added '10.30.171.201' (ECDSA) to the list of known hosts.
total 12440
drwxrwxr-x 2 jenkins jenkins 4096 Jan 17 23:44 .
-rw-rw-r-- 1 jenkins jenkins 9345 Jan 17 23:54 karaf_console.log
drwxrwxr-x 9 jenkins jenkins 4096 Jan 18 02:55 ..
-rw-rw-r-- 1 jenkins jenkins 12710318 Jan 18 03:01 karaf.log
+ ssh 10.30.171.201 'du -hs /tmp/karaf-0.24.0-SNAPSHOT/data/log/*'
Warning: Permanently added '10.30.171.201' (ECDSA) to the list of known hosts.
13M /tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf.log
12K /tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf_console.log
+ set +e
++ seq 1 3
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_1_IP
+ echo 'Let'\''s take the karaf thread dump again'
Let's take the karaf thread dump again
+ ssh 10.30.170.178 'sudo ps aux'
Warning: Permanently added '10.30.170.178' (ECDSA) to the list of known hosts.
++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/ps_after.log
++ grep -v grep
++ cut -f2 '-d '
++ tr -s ' '
+ pid=17379
+ echo 'karaf main: org.apache.karaf.main.Main, pid:17379'
karaf main: org.apache.karaf.main.Main, pid:17379
+ ssh 10.30.170.178 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 17379'
Warning: Permanently added '10.30.170.178' (ECDSA) to the list of known hosts.
+ echo 'killing karaf process...'
killing karaf process...
+ ssh 10.30.170.178 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh'
Warning: Permanently added '10.30.170.178' (ECDSA) to the list of known hosts.
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_2_IP
+ echo 'Let'\''s take the karaf thread dump again'
Let's take the karaf thread dump again
+ ssh 10.30.170.99 'sudo ps aux'
Warning: Permanently added '10.30.170.99' (ECDSA) to the list of known hosts.
++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/ps_after.log
++ grep -v grep
++ cut -f2 '-d '
++ tr -s ' '
+ pid=94133
+ echo 'karaf main: org.apache.karaf.main.Main, pid:94133'
karaf main: org.apache.karaf.main.Main, pid:94133
+ ssh 10.30.170.99 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 94133'
Warning: Permanently added '10.30.170.99' (ECDSA) to the list of known hosts.
+ echo 'killing karaf process...'
killing karaf process...
+ ssh 10.30.170.99 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh'
Warning: Permanently added '10.30.170.99' (ECDSA) to the list of known hosts.
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_3_IP
+ echo 'Let'\''s take the karaf thread dump again'
Let's take the karaf thread dump again
+ ssh 10.30.171.201 'sudo ps aux'
Warning: Permanently added '10.30.171.201' (ECDSA) to the list of known hosts.
++ tr -s ' '
++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/ps_after.log
++ grep -v grep
++ cut -f2 '-d '
+ pid=54949
+ echo 'karaf main: org.apache.karaf.main.Main, pid:54949'
karaf main: org.apache.karaf.main.Main, pid:54949
+ ssh 10.30.171.201 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 54949'
Warning: Permanently added '10.30.171.201' (ECDSA) to the list of known hosts.
+ echo 'killing karaf process...'
killing karaf process...
+ ssh 10.30.171.201 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh'
Warning: Permanently added '10.30.171.201' (ECDSA) to the list of known hosts.
+ sleep 5
++ seq 1 3
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_1_IP
+ echo 'Compressing karaf.log 1'
Compressing karaf.log 1
+ ssh 10.30.170.178 gzip --best /tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf.log
Warning: Permanently added '10.30.170.178' (ECDSA) to the list of known hosts.
+ echo 'Fetching compressed karaf.log 1'
Fetching compressed karaf.log 1
+ scp 10.30.170.178:/tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf.log.gz odl1_karaf.log.gz
Warning: Permanently added '10.30.170.178' (ECDSA) to the list of known hosts.
+ ssh 10.30.170.178 rm -f /tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf.log.gz
Warning: Permanently added '10.30.170.178' (ECDSA) to the list of known hosts.
+ scp 10.30.170.178:/tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf_console.log odl1_karaf_console.log
Warning: Permanently added '10.30.170.178' (ECDSA) to the list of known hosts.
+ ssh 10.30.170.178 rm -f /tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf_console.log
Warning: Permanently added '10.30.170.178' (ECDSA) to the list of known hosts.
+ echo 'Fetch GC logs'
Fetch GC logs
+ mkdir -p gclogs-1
+ scp '10.30.170.178:/tmp/karaf-0.24.0-SNAPSHOT/data/log/*.log' gclogs-1/
Warning: Permanently added '10.30.170.178' (ECDSA) to the list of known hosts.
scp: /tmp/karaf-0.24.0-SNAPSHOT/data/log/*.log: No such file or directory
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_2_IP
+ echo 'Compressing karaf.log 2'
Compressing karaf.log 2
+ ssh 10.30.170.99 gzip --best /tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf.log
Warning: Permanently added '10.30.170.99' (ECDSA) to the list of known hosts.
+ echo 'Fetching compressed karaf.log 2'
Fetching compressed karaf.log 2
+ scp 10.30.170.99:/tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf.log.gz odl2_karaf.log.gz
Warning: Permanently added '10.30.170.99' (ECDSA) to the list of known hosts.
+ ssh 10.30.170.99 rm -f /tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf.log.gz
Warning: Permanently added '10.30.170.99' (ECDSA) to the list of known hosts.
+ scp 10.30.170.99:/tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf_console.log odl2_karaf_console.log
Warning: Permanently added '10.30.170.99' (ECDSA) to the list of known hosts.
+ ssh 10.30.170.99 rm -f /tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf_console.log
Warning: Permanently added '10.30.170.99' (ECDSA) to the list of known hosts.
+ echo 'Fetch GC logs'
Fetch GC logs
+ mkdir -p gclogs-2
+ scp '10.30.170.99:/tmp/karaf-0.24.0-SNAPSHOT/data/log/*.log' gclogs-2/
Warning: Permanently added '10.30.170.99' (ECDSA) to the list of known hosts.
scp: /tmp/karaf-0.24.0-SNAPSHOT/data/log/*.log: No such file or directory
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_3_IP
+ echo 'Compressing karaf.log 3'
Compressing karaf.log 3
+ ssh 10.30.171.201 gzip --best /tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf.log
Warning: Permanently added '10.30.171.201' (ECDSA) to the list of known hosts.
gzip: /tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf.log: file size changed while zipping
+ echo 'Fetching compressed karaf.log 3'
Fetching compressed karaf.log 3
+ scp 10.30.171.201:/tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf.log.gz odl3_karaf.log.gz
Warning: Permanently added '10.30.171.201' (ECDSA) to the list of known hosts.
+ ssh 10.30.171.201 rm -f /tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf.log.gz
Warning: Permanently added '10.30.171.201' (ECDSA) to the list of known hosts.
+ scp 10.30.171.201:/tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf_console.log odl3_karaf_console.log
Warning: Permanently added '10.30.171.201' (ECDSA) to the list of known hosts.
+ ssh 10.30.171.201 rm -f /tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf_console.log
Warning: Permanently added '10.30.171.201' (ECDSA) to the list of known hosts.
+ echo 'Fetch GC logs'
Fetch GC logs
+ mkdir -p gclogs-3
+ scp '10.30.171.201:/tmp/karaf-0.24.0-SNAPSHOT/data/log/*.log' gclogs-3/
Warning: Permanently added '10.30.171.201' (ECDSA) to the list of known hosts.
scp: /tmp/karaf-0.24.0-SNAPSHOT/data/log/*.log: No such file or directory
+ echo 'Examine copied files'
Examine copied files
+ ls -lt
total 100892
drwxrwxr-x. 2 jenkins jenkins 6 Jan 18 03:01 gclogs-3
-rw-rw-r--. 1 jenkins jenkins 9345 Jan 18 03:01 odl3_karaf_console.log
-rw-rw-r--. 1 jenkins jenkins 709452 Jan 18 03:01 odl3_karaf.log.gz
drwxrwxr-x. 2 jenkins jenkins 6 Jan 18 03:01 gclogs-2
-rw-rw-r--. 1 jenkins jenkins 1720 Jan 18 03:01 odl2_karaf_console.log
-rw-rw-r--. 1 jenkins jenkins 2102505 Jan 18 03:01 odl2_karaf.log.gz
drwxrwxr-x. 2 jenkins jenkins 6 Jan 18 03:01 gclogs-1
-rw-rw-r--. 1 jenkins jenkins 1720 Jan 18 03:01 odl1_karaf_console.log
-rw-rw-r--. 1 jenkins jenkins 1548166 Jan 18 03:01 odl1_karaf.log.gz
-rw-rw-r--. 1 jenkins jenkins 93141 Jan 18 03:01 karaf_3_54949_threads_after.log
-rw-rw-r--. 1 jenkins jenkins 13938 Jan 18 03:01 ps_after.log
-rw-rw-r--. 1 jenkins jenkins 92299 Jan 18 03:01 karaf_2_94133_threads_after.log
-rw-rw-r--. 1 jenkins jenkins 145274 Jan 18 03:01 karaf_1_17379_threads_after.log
-rw-rw-r--. 1 jenkins jenkins 306500 Jan 18 03:01 report.html
-rw-rw-r--. 1 jenkins jenkins 4036375 Jan 18 03:01 log.html
-rw-rw-r--. 1 jenkins jenkins 93790851 Jan 18 03:01 output.xml
-rw-rw-r--. 1 jenkins jenkins 6069 Jan 17 23:47 testplan.txt
-rw-rw-r--. 1 jenkins jenkins 114448 Jan 17 23:47 karaf_3_2091_threads_before.log
-rw-rw-r--. 1 jenkins jenkins 13742 Jan 17 23:47 ps_before.log
-rw-rw-r--. 1 jenkins jenkins 116709 Jan 17 23:47 karaf_2_2092_threads_before.log
-rw-rw-r--. 1 jenkins jenkins 117788 Jan 17 23:47 karaf_1_2081_threads_before.log
-rw-rw-r--. 1 jenkins jenkins 3106 Jan 17 23:44 post-startup-script.sh
-rw-rw-r--. 1 jenkins jenkins 252 Jan 17 23:43 startup-script.sh
-rw-rw-r--. 1 jenkins jenkins 3470 Jan 17 23:43 configuration-script.sh
-rw-rw-r--. 1 jenkins jenkins 695 Jan 17 23:43 custom_shard_config.txt
-rw-rw-r--. 1 jenkins jenkins 136 Jan 17 23:43 scriptplan.txt
-rw-rw-r--. 1 jenkins jenkins 335 Jan 17 23:43 detect_variables.env
-rw-rw-r--. 1 jenkins jenkins 2619 Jan 17 23:43 pom.xml
-rw-rw-r--. 1 jenkins jenkins 92 Jan 17 23:43 set_variables.env
-rw-rw-r--. 1 jenkins jenkins 313 Jan 17 23:43 slave_addresses.txt
-rw-rw-r--. 1 jenkins jenkins 570 Jan 17 23:42 requirements.txt
-rw-rw-r--. 1 jenkins jenkins 26 Jan 17 23:42 env.properties
-rw-rw-r--. 1 jenkins jenkins 333 Jan 17 23:41 stack-parameters.yaml
drwxrwxr-x. 7 jenkins jenkins 4096 Jan 17 23:40 test
drwxrwxr-x. 2 jenkins jenkins 6 Jan 17 23:40 test@tmp
-rw-rw-r--. 1 jenkins jenkins 1404 Jan 17 22:37 maven-metadata.xml
+ true
[controller-csit-3node-clustering-tell-all-vanadium] $ /bin/sh /tmp/jenkins12790579215887996604.sh
Cleaning up Robot installation...
$ ssh-agent -k
unset SSH_AUTH_SOCK;
unset SSH_AGENT_PID;
echo Agent pid 5286 killed;
[ssh-agent] Stopped.
Recording plot data
Robot results publisher started...
INFO: Checking test criticality is deprecated and will be dropped in a future release!
-Parsing output xml:
Done!
-Copying log files to build dir:
Done!
-Assigning results to build:
Done!
-Checking thresholds:
Done!
Done publishing Robot results.
Build step 'Publish Robot Framework test results' changed build result to UNSTABLE
[PostBuildScript] - [INFO] Executing post build scripts.
[controller-csit-3node-clustering-tell-all-vanadium] $ /bin/bash /tmp/jenkins6813398431906127505.sh
Archiving csit artifacts
mv: cannot stat '*_1.png': No such file or directory
mv: cannot stat '/tmp/odl1_*': No such file or directory
mv: cannot stat '*_2.png': No such file or directory
mv: cannot stat '/tmp/odl2_*': No such file or directory
mv: cannot stat '*_3.png': No such file or directory
mv: cannot stat '/tmp/odl3_*': No such file or directory
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
100 1284k 0 1284k 0 0 5116k 0 --:--:-- --:--:-- --:--:-- 5095k
100 6120k 0 6120k 0 0 4899k 0 --:--:-- 0:00:01 --:--:-- 4896k
100 7848k 0 7848k 0 0 4914k 0 --:--:-- 0:00:01 --:--:-- 4911k
Archive: robot-plugin.zip
inflating: ./archives/robot-plugin/log.html
inflating: ./archives/robot-plugin/output.xml
inflating: ./archives/robot-plugin/report.html
mv: cannot stat '*.log.gz': No such file or directory
mv: cannot stat '*.csv': No such file or directory
mv: cannot stat '*.png': No such file or directory
[PostBuildScript] - [INFO] Executing post build scripts.
[controller-csit-3node-clustering-tell-all-vanadium] $ /bin/bash /tmp/jenkins6375299748125626036.sh
[PostBuildScript] - [INFO] Executing post build scripts.
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties content
OS_CLOUD=vex
OS_STACK_NAME=releng-controller-csit-3node-clustering-tell-all-vanadium-25
[EnvInject] - Variables injected successfully.
provisioning config files...
copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
[controller-csit-3node-clustering-tell-all-vanadium] $ /bin/bash /tmp/jenkins4404530566276533152.sh
---> openstack-stack-delete.sh
Setup pyenv:
system
3.8.13
3.9.13
3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-jWgQ from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
lf-activate-venv(): INFO: Attempting to install with network-safe options...
lf-activate-venv(): INFO: Base packages installed successfully
lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes python-heatclient python-openstackclient urllib3~=1.26.15
lf-activate-venv(): INFO: Adding /tmp/venv-jWgQ/bin to PATH
INFO: Stack cost retrieval disabled, setting cost to 0
INFO: Deleting stack releng-controller-csit-3node-clustering-tell-all-vanadium-25
Successfully deleted stack releng-controller-csit-3node-clustering-tell-all-vanadium-25
[PostBuildScript] - [INFO] Executing post build scripts.
[controller-csit-3node-clustering-tell-all-vanadium] $ /bin/bash /tmp/jenkins14517202688995794291.sh
---> sysstat.sh
[controller-csit-3node-clustering-tell-all-vanadium] $ /bin/bash /tmp/jenkins10334198102214444636.sh
---> package-listing.sh
++ facter osfamily
++ tr '[:upper:]' '[:lower:]'
+ OS_FAMILY=redhat
+ workspace=/w/workspace/controller-csit-3node-clustering-tell-all-vanadium
+ START_PACKAGES=/tmp/packages_start.txt
+ END_PACKAGES=/tmp/packages_end.txt
+ DIFF_PACKAGES=/tmp/packages_diff.txt
+ PACKAGES=/tmp/packages_start.txt
+ '[' /w/workspace/controller-csit-3node-clustering-tell-all-vanadium ']'
+ PACKAGES=/tmp/packages_end.txt
+ case "${OS_FAMILY}" in
+ rpm -qa
+ sort
+ '[' -f /tmp/packages_start.txt ']'
+ '[' -f /tmp/packages_end.txt ']'
+ diff /tmp/packages_start.txt /tmp/packages_end.txt
+ '[' /w/workspace/controller-csit-3node-clustering-tell-all-vanadium ']'
+ mkdir -p /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/archives/
+ cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/archives/
[controller-csit-3node-clustering-tell-all-vanadium] $ /bin/bash /tmp/jenkins204390047140293278.sh
---> capture-instance-metadata.sh
Setup pyenv:
system
3.8.13
3.9.13
3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-jWgQ from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
lf-activate-venv(): INFO: Attempting to install with network-safe options...
lf-activate-venv(): INFO: Base packages installed successfully
lf-activate-venv(): INFO: Installing additional packages: lftools
lf-activate-venv(): INFO: Adding /tmp/venv-jWgQ/bin to PATH
INFO: Running in OpenStack, capturing instance metadata
[controller-csit-3node-clustering-tell-all-vanadium] $ /bin/bash /tmp/jenkins2619754674622921731.sh
provisioning config files...
Could not find credentials [logs] for controller-csit-3node-clustering-tell-all-vanadium #25
copy managed file [jenkins-log-archives-settings] to file:/w/workspace/controller-csit-3node-clustering-tell-all-vanadium@tmp/config2144444348881421509tmp
Regular expression run condition: Expression=[^.*logs-s3.*], Label=[odl-logs-s3-cloudfront-index]
Run condition [Regular expression match] enabling perform for step [Provide Configuration files]
provisioning config files...
copy managed file [jenkins-s3-log-ship] to file:/home/jenkins/.aws/credentials
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties content
SERVER_ID=logs
[EnvInject] - Variables injected successfully.
[controller-csit-3node-clustering-tell-all-vanadium] $ /bin/bash /tmp/jenkins4617941597442608783.sh
---> create-netrc.sh
WARN: Log server credential not found.
[controller-csit-3node-clustering-tell-all-vanadium] $ /bin/bash /tmp/jenkins14594351288763631629.sh
---> python-tools-install.sh
Setup pyenv:
system
3.8.13
3.9.13
3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-jWgQ from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
lf-activate-venv(): INFO: Attempting to install with network-safe options...
lf-activate-venv(): INFO: Base packages installed successfully
lf-activate-venv(): INFO: Installing additional packages: lftools
lf-activate-venv(): INFO: Adding /tmp/venv-jWgQ/bin to PATH
[controller-csit-3node-clustering-tell-all-vanadium] $ /bin/bash /tmp/jenkins2075019510182706702.sh
---> sudo-logs.sh
Archiving 'sudo' log..
[controller-csit-3node-clustering-tell-all-vanadium] $ /bin/bash /tmp/jenkins12669349860359234916.sh
---> job-cost.sh
Setup pyenv:
system
3.8.13
3.9.13
3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-jWgQ from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
lf-activate-venv(): INFO: Attempting to install with network-safe options...
lf-activate-venv(): INFO: Base packages installed successfully
lf-activate-venv(): INFO: Installing additional packages: zipp==1.1.0 python-openstackclient urllib3~=1.26.15
lf-activate-venv(): INFO: Adding /tmp/venv-jWgQ/bin to PATH
DEBUG: total: 0
INFO: Retrieving Stack Cost...
INFO: Retrieving Pricing Info for: v3-standard-2
INFO: Archiving Costs
[controller-csit-3node-clustering-tell-all-vanadium] $ /bin/bash -l /tmp/jenkins13910120806182229886.sh
---> logs-deploy.sh
Setup pyenv:
system
3.8.13
3.9.13
3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-vanadium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-jWgQ from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
lf-activate-venv(): INFO: Attempting to install with network-safe options...
lf-activate-venv(): INFO: Base packages installed successfully
lf-activate-venv(): INFO: Installing additional packages: lftools urllib3~=1.26.15
lf-activate-venv(): INFO: Adding /tmp/venv-jWgQ/bin to PATH
WARNING: Nexus logging server not set
INFO: S3 path logs/releng/vex-yul-odl-jenkins-1/controller-csit-3node-clustering-tell-all-vanadium/25/
INFO: archiving logs to S3
---> uname -a:
Linux prd-centos8-robot-2c-8g-1589.novalocal 4.18.0-553.5.1.el8.x86_64 #1 SMP Tue May 21 05:46:01 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
---> lscpu:
Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Byte Order: Little Endian
CPU(s): 2
On-line CPU(s) list: 0,1
Thread(s) per core: 1
Core(s) per socket: 1
Socket(s): 2
NUMA node(s): 1
Vendor ID: AuthenticAMD
CPU family: 23
Model: 49
Model name: AMD EPYC-Rome Processor
Stepping: 0
CPU MHz: 2799.998
BogoMIPS: 5599.99
Virtualization: AMD-V
Hypervisor vendor: KVM
Virtualization type: full
L1d cache: 32K
L1i cache: 32K
L2 cache: 512K
L3 cache: 16384K
NUMA node0 CPU(s): 0,1
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities
---> nproc:
2
---> df -h:
Filesystem Size Used Avail Use% Mounted on
devtmpfs 3.8G 0 3.8G 0% /dev
tmpfs 3.8G 0 3.8G 0% /dev/shm
tmpfs 3.8G 17M 3.8G 1% /run
tmpfs 3.8G 0 3.8G 0% /sys/fs/cgroup
/dev/vda1 40G 8.5G 32G 22% /
tmpfs 770M 0 770M 0% /run/user/1001
---> free -m:
total used free shared buff/cache available
Mem: 7697 673 4625 19 2399 6725
Swap: 1023 0 1023
---> ip addr:
1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
inet 127.0.0.1/8 scope host lo
valid_lft forever preferred_lft forever
inet6 ::1/128 scope host
valid_lft forever preferred_lft forever
2: eth0: mtu 1458 qdisc mq state UP group default qlen 1000
link/ether fa:16:3e:ca:84:3e brd ff:ff:ff:ff:ff:ff
altname enp0s3
altname ens3
inet 10.30.171.202/23 brd 10.30.171.255 scope global dynamic noprefixroute eth0
valid_lft 74151sec preferred_lft 74151sec
inet6 fe80::f816:3eff:feca:843e/64 scope link
valid_lft forever preferred_lft forever
---> sar -b -r -n DEV:
Linux 4.18.0-553.5.1.el8.x86_64 (prd-centos8-robot-2c-8g-1589.novalocal) 01/18/2026 _x86_64_ (2 CPU)
12:00:01 AM tps rtps wtps bread/s bwrtn/s
12:01:01 AM 1.18 0.03 1.15 0.27 235.83
12:02:01 AM 0.60 0.07 0.53 1.73 24.48
12:03:01 AM 0.45 0.00 0.45 0.00 15.53
12:04:01 AM 0.53 0.00 0.53 0.00 17.28
12:05:01 AM 0.73 0.00 0.73 0.00 20.48
12:06:01 AM 0.38 0.00 0.38 0.00 28.59
12:07:01 AM 0.18 0.00 0.18 0.00 18.01
12:08:01 AM 0.48 0.07 0.42 7.60 107.75
12:09:01 AM 0.28 0.00 0.28 0.00 27.48
12:10:01 AM 0.23 0.00 0.23 0.00 15.43
12:11:01 AM 0.53 0.00 0.53 0.00 26.69
12:12:01 AM 0.27 0.00 0.27 0.00 11.83
12:13:01 AM 0.28 0.00 0.28 0.00 20.29
12:14:01 AM 0.27 0.00 0.27 0.00 15.08
12:15:01 AM 0.25 0.02 0.23 0.13 12.10
12:16:01 AM 8.85 5.73 3.12 555.41 82.12
12:17:01 AM 0.48 0.00 0.48 0.00 6.80
12:18:01 AM 0.27 0.00 0.27 0.00 12.65
12:19:01 AM 0.20 0.00 0.20 0.00 14.68
12:20:01 AM 0.30 0.00 0.30 0.00 12.63
12:21:01 AM 0.32 0.00 0.32 0.00 18.76
12:22:01 AM 0.22 0.00 0.22 0.00 17.35
12:23:01 AM 0.13 0.00 0.13 0.00 8.53
12:24:01 AM 0.13 0.00 0.13 0.00 16.14
12:25:01 AM 0.25 0.00 0.25 0.00 25.98
12:26:01 AM 0.22 0.00 0.22 0.00 14.30
12:27:01 AM 0.23 0.00 0.23 0.00 24.56
12:28:01 AM 0.20 0.00 0.20 0.00 13.10
12:29:01 AM 0.15 0.00 0.15 0.00 22.53
12:30:01 AM 0.15 0.00 0.15 0.00 12.06
12:31:01 AM 0.28 0.00 0.28 0.00 30.24
12:32:01 AM 0.28 0.00 0.28 0.00 21.08
12:33:01 AM 0.53 0.00 0.53 0.00 17.21
12:34:01 AM 0.22 0.00 0.22 0.00 10.26
12:35:01 AM 0.25 0.00 0.25 0.00 17.29
12:36:01 AM 0.22 0.00 0.22 0.00 17.51
12:37:01 AM 0.33 0.00 0.33 0.00 21.00
12:38:01 AM 0.17 0.00 0.17 0.00 9.35
12:39:01 AM 0.15 0.00 0.15 0.00 16.28
12:40:01 AM 0.20 0.00 0.20 0.00 16.61
12:41:01 AM 0.33 0.00 0.33 0.00 12.90
12:42:01 AM 0.35 0.00 0.35 0.00 23.76
12:43:01 AM 0.23 0.00 0.23 0.00 9.18
12:44:01 AM 0.12 0.00 0.12 0.00 25.61
12:45:01 AM 0.55 0.00 0.55 0.00 20.98
12:46:01 AM 0.62 0.32 0.30 6.93 19.24
12:47:01 AM 0.88 0.00 0.88 0.00 29.63
12:48:01 AM 0.13 0.00 0.13 0.00 16.40
12:49:01 AM 0.13 0.00 0.13 0.00 8.40
12:50:01 AM 0.22 0.00 0.22 0.00 27.78
12:51:01 AM 0.25 0.00 0.25 0.00 9.68
12:52:01 AM 0.22 0.00 0.22 0.00 14.55
12:53:01 AM 0.12 0.00 0.12 0.00 6.93
12:54:01 AM 0.22 0.00 0.22 0.00 14.40
12:55:01 AM 0.20 0.00 0.20 0.00 8.07
12:56:01 AM 0.23 0.00 0.23 0.00 27.62
12:57:01 AM 0.17 0.00 0.17 0.00 9.73
12:58:01 AM 0.20 0.00 0.20 0.00 17.84
12:59:01 AM 0.15 0.00 0.15 0.00 15.36
01:00:01 AM 0.17 0.00 0.17 0.00 8.71
01:01:01 AM 0.44 0.03 0.41 0.27 21.90
01:02:01 AM 0.27 0.00 0.27 0.00 19.91
01:03:01 AM 0.12 0.00 0.12 0.00 8.13
01:04:01 AM 0.13 0.00 0.13 0.00 16.40
01:05:01 AM 0.32 0.00 0.32 0.00 20.01
01:06:01 AM 0.13 0.00 0.13 0.00 8.53
01:07:01 AM 0.38 0.00 0.38 0.00 21.05
01:08:01 AM 0.18 0.00 0.18 0.00 16.81
01:09:01 AM 0.12 0.00 0.12 0.00 23.46
01:10:01 AM 0.35 0.00 0.35 0.00 13.83
01:11:01 AM 0.20 0.00 0.20 0.00 7.78
01:12:01 AM 0.28 0.00 0.28 0.00 15.60
01:13:01 AM 0.23 0.00 0.23 0.00 11.36
01:14:01 AM 0.15 0.00 0.15 0.00 7.08
01:15:01 AM 0.35 0.00 0.35 0.00 20.53
01:16:01 AM 0.32 0.00 0.32 0.00 23.13
01:17:01 AM 0.18 0.00 0.18 0.00 71.17
01:18:01 AM 0.22 0.00 0.22 0.00 55.96
01:19:01 AM 0.17 0.00 0.17 0.00 17.58
01:20:01 AM 0.18 0.00 0.18 0.00 9.26
01:21:01 AM 0.43 0.00 0.43 0.00 22.41
01:22:01 AM 0.28 0.00 0.28 0.00 17.28
01:23:01 AM 0.17 0.00 0.17 0.00 16.68
01:24:01 AM 0.15 0.00 0.15 0.00 9.23
01:25:01 AM 0.27 0.00 0.27 0.00 79.42
01:26:01 AM 0.32 0.00 0.32 0.00 82.30
01:27:01 AM 1.02 0.00 1.02 0.00 31.63
01:28:01 AM 0.32 0.02 0.30 0.93 106.25
01:29:01 AM 0.17 0.00 0.17 0.00 6.67
01:30:01 AM 0.30 0.00 0.30 0.00 18.36
01:31:01 AM 0.40 0.00 0.40 0.00 37.93
01:32:01 AM 0.27 0.00 0.27 0.00 104.80
01:33:01 AM 0.22 0.00 0.22 0.00 19.08
01:34:01 AM 0.32 0.00 0.32 0.00 3.55
01:35:01 AM 0.38 0.00 0.38 0.00 3.80
01:36:01 AM 0.45 0.00 0.45 0.00 5.80
01:37:01 AM 0.30 0.00 0.30 0.00 3.18
01:38:01 AM 0.37 0.00 0.37 0.00 13.46
01:39:01 AM 0.27 0.00 0.27 0.00 10.28
01:40:01 AM 0.22 0.00 0.22 0.00 17.13
01:41:01 AM 0.25 0.00 0.25 0.00 18.73
01:42:01 AM 0.17 0.00 0.17 0.00 9.47
01:43:01 AM 0.18 0.00 0.18 0.00 18.29
01:44:01 AM 0.12 0.00 0.12 0.00 8.40
01:45:01 AM 0.17 0.00 0.17 0.00 81.49
01:46:01 AM 0.62 0.00 0.62 0.00 101.93
01:47:01 AM 0.13 0.00 0.13 0.00 8.55
01:48:01 AM 0.18 0.00 0.18 0.00 18.81
01:49:01 AM 0.13 0.00 0.13 0.00 8.53
01:50:01 AM 0.20 0.00 0.20 0.00 17.16
01:51:01 AM 0.33 0.00 0.33 0.00 21.16
01:52:01 AM 0.17 0.00 0.17 0.00 22.00
01:53:01 AM 0.23 0.00 0.23 0.00 6.66
01:54:01 AM 0.18 0.00 0.18 0.00 4.28
01:55:01 AM 0.17 0.00 0.17 0.00 5.38
01:56:01 AM 0.22 0.00 0.22 0.00 5.23
01:57:01 AM 0.17 0.00 0.17 0.00 5.33
01:58:01 AM 0.12 0.00 0.12 0.00 6.98
01:59:01 AM 0.17 0.00 0.17 0.00 21.21
02:00:01 AM 0.17 0.00 0.17 0.00 16.31
02:01:01 AM 0.33 0.00 0.33 0.00 12.86
02:02:01 AM 0.27 0.00 0.27 0.00 20.14
02:03:01 AM 0.13 0.00 0.13 0.00 14.13
02:04:01 AM 0.12 0.00 0.12 0.00 8.80
02:05:01 AM 0.18 0.00 0.18 0.00 17.91
02:06:01 AM 0.20 0.00 0.20 0.00 18.71
02:07:02 AM 0.23 0.00 0.23 0.00 10.00
02:08:01 AM 0.20 0.00 0.20 0.00 17.40
02:09:01 AM 0.17 0.00 0.17 0.00 16.84
02:10:01 AM 0.20 0.00 0.20 0.00 9.02
02:11:01 AM 0.25 0.00 0.25 0.00 28.59
02:12:01 AM 0.18 0.00 0.18 0.00 17.19
02:13:01 AM 0.27 0.00 0.27 0.00 16.13
02:14:01 AM 0.65 0.00 0.65 0.00 20.01
02:15:01 AM 0.67 0.00 0.67 0.00 21.16
02:16:01 AM 0.50 0.00 0.50 0.00 16.29
02:17:01 AM 0.38 0.00 0.38 0.00 24.41
02:18:01 AM 0.13 0.00 0.13 0.00 5.20
02:19:01 AM 0.12 0.00 0.12 0.00 3.07
02:20:01 AM 0.33 0.00 0.33 0.00 9.95
02:21:01 AM 0.27 0.00 0.27 0.00 5.12
02:22:01 AM 0.27 0.00 0.27 0.00 7.23
02:23:01 AM 0.12 0.00 0.12 0.00 3.10
02:24:01 AM 0.23 0.00 0.23 0.00 39.59
02:25:01 AM 0.30 0.00 0.30 0.00 14.10
02:26:01 AM 0.20 0.00 0.20 0.00 15.64
02:27:01 AM 0.15 0.00 0.15 0.00 15.23
02:28:01 AM 0.17 0.00 0.17 0.00 15.21
02:29:01 AM 0.10 0.00 0.10 0.00 7.53
02:30:01 AM 0.25 0.00 0.25 0.00 25.01
02:31:01 AM 0.42 0.00 0.42 0.00 11.03
02:32:01 AM 0.27 0.00 0.27 0.00 6.13
02:33:01 AM 0.18 0.00 0.18 0.00 6.25
02:34:01 AM 0.17 0.00 0.17 0.00 4.12
02:35:01 AM 0.18 0.00 0.18 0.00 5.93
02:36:01 AM 0.25 0.00 0.25 0.00 32.86
02:37:01 AM 0.18 0.00 0.18 0.00 16.78
02:38:01 AM 0.23 0.00 0.23 0.00 16.53
02:39:01 AM 0.18 0.00 0.18 0.00 15.88
02:40:01 AM 0.80 0.00 0.80 0.00 19.48
02:41:01 AM 0.50 0.00 0.50 0.00 24.34
02:42:01 AM 0.23 0.00 0.23 0.00 23.88
02:43:01 AM 0.12 0.00 0.12 0.00 2.93
02:44:01 AM 0.13 0.00 0.13 0.00 4.93
02:45:01 AM 0.17 0.00 0.17 0.00 3.80
02:46:01 AM 0.23 0.00 0.23 0.00 7.66
02:47:01 AM 0.13 0.00 0.13 0.00 2.93
02:48:01 AM 0.13 0.00 0.13 0.00 14.80
02:49:01 AM 0.13 0.00 0.13 0.00 1.52
02:50:01 AM 0.30 0.00 0.30 0.00 24.41
02:51:01 AM 0.38 0.00 0.38 0.00 20.56
02:52:01 AM 0.25 0.00 0.25 0.00 10.56
02:53:01 AM 0.13 0.00 0.13 0.00 16.13
02:54:01 AM 0.13 0.00 0.13 0.00 10.53
02:55:01 AM 0.28 0.00 0.28 0.00 18.53
02:56:01 AM 0.22 0.00 0.22 0.00 22.56
02:57:01 AM 0.23 0.00 0.23 0.00 4.80
02:58:01 AM 0.53 0.00 0.53 0.00 10.36
02:59:01 AM 0.38 0.00 0.38 0.00 6.25
03:00:01 AM 0.45 0.00 0.45 0.00 7.91
03:01:01 AM 0.60 0.00 0.60 0.00 10.40
03:02:01 AM 2.12 0.18 1.93 4.26 145.90
03:03:01 AM 33.44 0.32 33.13 50.26 5042.44
Average: 0.51 0.04 0.48 3.43 48.40
12:00:01 AM kbmemfree kbavail kbmemused %memused kbbuffers kbcached kbcommit %commit kbactive kbinact kbdirty
12:01:01 AM 4839020 6959352 3043412 38.61 2688 2287316 767612 8.59 269304 2392100 16
12:02:01 AM 4840316 6961208 3042116 38.59 2688 2287892 767612 8.59 269424 2391608 24
12:03:01 AM 4839160 6960404 3043272 38.61 2688 2288236 767612 8.59 269424 2392836 4
12:04:01 AM 4838296 6959908 3044136 38.62 2688 2288612 767612 8.59 269424 2393584 40
12:05:01 AM 4838060 6960052 3044372 38.62 2688 2288992 767612 8.59 269424 2393844 24
12:06:01 AM 4837224 6959928 3045208 38.63 2688 2289704 767612 8.59 269424 2394828 24
12:07:01 AM 4831480 6957288 3050952 38.71 2688 2292808 780484 8.74 269428 2400120 2648
12:08:01 AM 4831052 6957656 3051380 38.71 2688 2293604 768156 8.60 269464 2400748 220
12:09:01 AM 4830544 6957824 3051888 38.72 2688 2294272 785396 8.79 269464 2401240 172
12:10:01 AM 4829912 6957596 3052520 38.73 2688 2294684 777664 8.71 269464 2402008 204
12:11:01 AM 4829616 6957692 3052816 38.73 2688 2295068 777664 8.71 269464 2402240 40
12:12:01 AM 4829244 6957688 3053188 38.73 2688 2295444 777664 8.71 269464 2402656 160
12:13:01 AM 4829304 6958128 3053128 38.73 2688 2295824 777664 8.71 269464 2402792 24
12:14:01 AM 4828656 6957872 3053776 38.74 2688 2296216 777664 8.71 269464 2403184 24
12:15:01 AM 4828052 6957628 3054380 38.75 2688 2296576 779200 8.72 269464 2403776 100
12:16:01 AM 4811020 6957504 3071412 38.97 2688 2313420 777720 8.71 271764 2418300 4
12:17:01 AM 4811188 6957680 3071244 38.96 2688 2313428 777720 8.71 271764 2418240 4
12:18:01 AM 4810876 6957764 3071556 38.97 2688 2313824 777720 8.71 271764 2418508 108
12:19:01 AM 4809728 6956996 3072704 38.98 2688 2314204 777720 8.71 271764 2419856 96
12:20:01 AM 4808624 6956268 3073808 39.00 2688 2314580 770952 8.63 271764 2420660 188
12:21:01 AM 4808476 6956508 3073956 39.00 2688 2314960 770952 8.63 271764 2420884 140
12:22:01 AM 4808264 6956672 3074168 39.00 2688 2315340 770952 8.63 271764 2421192 72
12:23:01 AM 4807984 6956768 3074448 39.00 2688 2315716 770952 8.63 271764 2421572 220
12:24:01 AM 4807316 6956856 3075116 39.01 2688 2316464 770952 8.63 271764 2422212 512
12:25:01 AM 4806560 6956304 3075872 39.02 2688 2316668 770952 8.63 271764 2422736 4
12:26:01 AM 4806448 6956748 3075984 39.02 2688 2317240 770952 8.63 271764 2423096 256
12:27:01 AM 4805884 6956608 3076548 39.03 2688 2317648 770952 8.63 271764 2423600 16
12:28:01 AM 4805564 6956772 3076868 39.03 2688 2318132 770952 8.63 271764 2424004 172
12:29:01 AM 4805188 6956880 3077244 39.04 2688 2318616 770952 8.63 271764 2424372 4
12:30:01 AM 4804424 6956604 3078008 39.05 2688 2319100 774756 8.67 271764 2425092 168
12:31:01 AM 4803340 6956324 3079092 39.06 2688 2319904 774756 8.67 271764 2425972 176
12:32:01 AM 4802272 6955636 3080160 39.08 2688 2320292 774756 8.67 271764 2426964 20
12:33:01 AM 4801860 6955612 3080572 39.08 2688 2320672 774756 8.67 271764 2427736 36
12:34:01 AM 4800848 6954968 3081584 39.09 2688 2321048 774756 8.67 271764 2428376 188
12:35:01 AM 4801236 6955732 3081196 39.09 2688 2321424 774756 8.67 271764 2428376 112
12:36:01 AM 4800312 6955192 3082120 39.10 2688 2321804 774756 8.67 271764 2429080 84
12:37:01 AM 4800016 6955420 3082416 39.10 2688 2322320 774756 8.67 271772 2429344 68
12:38:01 AM 4799584 6955364 3082848 39.11 2688 2322696 774756 8.67 271772 2429980 216
12:39:01 AM 4799436 6955596 3082996 39.11 2688 2323076 774756 8.67 271764 2430096 144
12:40:01 AM 4798404 6954940 3084028 39.13 2688 2323452 794904 8.90 271764 2430716 68
12:41:01 AM 4798272 6955196 3084160 39.13 2688 2323848 794904 8.90 271764 2431152 232
12:42:01 AM 4798108 6955408 3084324 39.13 2688 2324224 794904 8.90 271764 2431440 24
12:43:01 AM 4797500 6955476 3084932 39.14 2688 2324900 774528 8.67 271764 2431908 504
12:44:01 AM 4796984 6955344 3085448 39.14 2688 2325284 774528 8.67 271764 2432292 144
12:45:01 AM 4796152 6954888 3086280 39.15 2688 2325660 774528 8.67 271764 2433096 100
12:46:01 AM 4795868 6955188 3086564 39.16 2688 2326232 774528 8.67 271864 2433264 32
12:47:01 AM 4795752 6955444 3086680 39.16 2688 2326612 774528 8.67 271864 2433568 144
12:48:01 AM 4794696 6954764 3087736 39.17 2688 2326988 774528 8.67 271864 2434336 68
12:49:01 AM 4794668 6955392 3087764 39.17 2688 2327636 774528 8.67 271864 2434728 492
12:50:01 AM 4793924 6954944 3088508 39.18 2688 2327932 792428 8.87 271868 2435232 4
12:51:01 AM 4793888 6955192 3088544 39.18 2688 2328208 792428 8.87 271868 2435492 100
12:52:01 AM 4793672 6955248 3088760 39.19 2688 2328480 792428 8.87 271868 2435456 4
12:53:01 AM 4793404 6955248 3089028 39.19 2688 2328748 792428 8.87 271868 2435724 92
12:54:01 AM 4793200 6955320 3089232 39.19 2688 2329020 792428 8.87 271868 2436112 4
12:55:01 AM 4792888 6955272 3089544 39.20 2688 2329292 792428 8.87 271868 2436260 96
12:56:01 AM 4792108 6955200 3090324 39.21 2688 2329992 774984 8.68 271868 2437048 68
12:57:01 AM 4791796 6955256 3090636 39.21 2688 2330368 774984 8.68 271868 2437348 188
12:58:01 AM 4791136 6954976 3091296 39.22 2688 2330748 774984 8.68 271868 2438056 112
12:59:01 AM 4790948 6955168 3091484 39.22 2688 2331124 774984 8.68 271868 2438532 68
01:00:01 AM 4789244 6953840 3093188 39.24 2688 2331500 797644 8.93 271868 2439332 220
01:01:01 AM 4788864 6953832 3093568 39.25 2688 2331872 779708 8.73 271872 2439772 128
01:02:01 AM 4792108 6957456 3090324 39.21 2688 2332244 779708 8.73 271888 2437320 4
01:03:01 AM 4791604 6957328 3090828 39.21 2688 2332628 779708 8.73 271888 2437580 172
01:04:01 AM 4790624 6956724 3091808 39.22 2688 2333004 779708 8.73 271888 2438296 96
01:05:01 AM 4790112 6956588 3092320 39.23 2688 2333380 779708 8.73 271888 2438776 24
01:06:01 AM 4790284 6957136 3092148 39.23 2688 2333756 779708 8.73 271888 2438900 172
01:07:01 AM 4789952 6957192 3092480 39.23 2688 2334136 779708 8.73 271916 2439304 96
01:08:01 AM 4789360 6956984 3093072 39.24 2688 2334528 779708 8.73 271916 2439864 48
01:09:01 AM 4788896 6957168 3093536 39.25 2688 2335168 779708 8.73 271916 2440240 8
01:10:01 AM 4788532 6957044 3093900 39.25 2688 2335408 773036 8.66 271916 2440712 4
01:11:01 AM 4788448 6957236 3093984 39.25 2688 2335680 773036 8.66 271916 2440828 96
01:12:01 AM 4788164 6957220 3094268 39.26 2688 2335948 773036 8.66 271916 2441028 4
01:13:01 AM 4788068 6957400 3094364 39.26 2688 2336224 773036 8.66 271916 2441304 4
01:14:01 AM 4787692 6957292 3094740 39.26 2688 2336492 773036 8.66 271916 2441572 96
01:15:01 AM 4787024 6957004 3095408 39.27 2688 2336872 773036 8.66 271916 2441960 4
01:16:01 AM 4785876 6956948 3096556 39.28 2688 2337980 773036 8.66 271916 2443128 500
01:17:01 AM 4779976 6953996 3102456 39.36 2688 2340912 773036 8.66 271916 2449092 1352
01:18:01 AM 4777548 6951932 3104884 39.39 2688 2341276 775564 8.68 271916 2451676 112
01:19:01 AM 4776744 6951500 3105688 39.40 2688 2341656 775564 8.68 271916 2452528 28
01:20:01 AM 4775136 6950284 3107296 39.42 2688 2342044 775900 8.69 271916 2454160 188
01:21:01 AM 4773388 6948916 3109044 39.44 2688 2342416 775900 8.69 271916 2455748 116
01:22:01 AM 4772672 6948568 3109760 39.45 2688 2342792 775900 8.69 271916 2456364 100
01:23:01 AM 4772664 6948936 3109768 39.45 2688 2343168 775900 8.69 271916 2456396 24
01:24:01 AM 4772572 6949112 3109860 39.45 2688 2343428 775900 8.69 271916 2456704 40
01:25:01 AM 4768988 6948372 3113444 39.50 2688 2346292 775900 8.69 271916 2459964 584
01:26:01 AM 4766608 6948164 3115824 39.53 2688 2348440 788732 8.83 280856 2453620 632
01:27:01 AM 4762308 6946604 3120124 39.58 2688 2351184 788732 8.83 280880 2457416 2680
01:28:01 AM 4759996 6944732 3122436 39.61 2688 2351624 806388 9.03 280880 2459920 28
01:29:01 AM 4760204 6945088 3122228 39.61 2688 2351772 806388 9.03 280880 2459816 4
01:30:01 AM 4760596 6946048 3121836 39.60 2688 2352348 794584 8.90 280880 2459440 124
01:31:01 AM 4757904 6945240 3124528 39.64 2688 2354220 794584 8.90 280880 2462280 1024
01:32:01 AM 4755552 6945440 3126880 39.67 2688 2356772 794584 8.90 280880 2464648 520
01:33:01 AM 4755252 6945140 3127180 39.67 2688 2356772 794584 8.90 280884 2464936 8
01:34:01 AM 4755560 6945448 3126872 39.67 2688 2356772 794584 8.90 280880 2464652 4
01:35:01 AM 4755404 6945296 3127028 39.67 2688 2356776 794584 8.90 280880 2464752 4
01:36:01 AM 4755464 6945356 3126968 39.67 2688 2356776 794584 8.90 280880 2464724 4
01:37:01 AM 4755488 6945380 3126944 39.67 2688 2356776 794584 8.90 280880 2464760 4
01:38:01 AM 4757064 6947228 3125368 39.65 2688 2357056 794584 8.90 280880 2463092 20
01:39:01 AM 4756892 6947436 3125540 39.65 2688 2357432 794584 8.90 280880 2463380 172
01:40:01 AM 4755348 6946276 3127084 39.67 2688 2357808 787652 8.82 280880 2464684 96
01:41:01 AM 4753904 6945212 3128528 39.69 2688 2358192 787652 8.82 280880 2466388 24
01:42:01 AM 4753624 6945316 3128808 39.69 2688 2358568 787652 8.82 280880 2466700 176
01:43:01 AM 4753104 6945176 3129328 39.70 2688 2358956 787652 8.82 280880 2467068 52
01:44:01 AM 4752216 6945172 3130216 39.71 2688 2359832 787652 8.82 280880 2467952 700
01:45:01 AM 4748836 6944916 3133596 39.75 2688 2362952 787652 8.82 280880 2471528 1416
01:46:01 AM 4747220 6944700 3135212 39.77 2688 2364352 787652 8.82 280880 2473028 52
01:47:01 AM 4747196 6945048 3135236 39.77 2688 2364732 787652 8.82 280880 2473196 204
01:48:01 AM 4746456 6944684 3135976 39.78 2688 2365108 787652 8.82 280880 2474004 68
01:49:01 AM 4746880 6945484 3135552 39.78 2688 2365484 787652 8.82 280880 2473488 220
01:50:01 AM 4745776 6944760 3136656 39.79 2688 2365864 783040 8.77 280880 2474304 144
01:51:01 AM 4745648 6945024 3136784 39.79 2688 2366240 783040 8.77 280880 2474320 4
01:52:01 AM 4745224 6945232 3137208 39.80 2688 2366872 783040 8.77 280880 2474884 40
01:53:01 AM 4745216 6945316 3137216 39.80 2688 2366964 783040 8.77 280880 2474976 4
01:54:01 AM 4744756 6944944 3137676 39.81 2688 2367052 783040 8.77 280880 2475272 36
01:55:01 AM 4745100 6945384 3137332 39.80 2688 2367148 783040 8.77 280880 2475052 4
01:56:01 AM 4745000 6945376 3137432 39.80 2688 2367240 783040 8.77 280880 2475248 44
01:57:01 AM 4745072 6945540 3137360 39.80 2688 2367332 783040 8.77 280880 2475388 4
01:58:01 AM 4744424 6945392 3138008 39.81 2688 2367832 783040 8.77 280880 2475784 324
01:59:01 AM 4744012 6945348 3138420 39.82 2688 2368208 798464 8.94 280880 2476268 100
02:00:01 AM 4743944 6945656 3138488 39.82 2688 2368584 790728 8.85 280880 2476516 24
02:01:01 AM 4741780 6943872 3140652 39.84 2688 2368964 790728 8.85 280880 2477896 172
02:02:01 AM 4742676 6945144 3139756 39.83 2688 2369340 790728 8.85 280896 2477376 40
02:03:01 AM 4742296 6945144 3140136 39.84 2688 2369720 790728 8.85 280896 2477756 24
02:04:01 AM 4741668 6944872 3140764 39.85 2688 2370068 790728 8.85 280896 2478524 144
02:05:01 AM 4741716 6945408 3140716 39.84 2688 2370556 790728 8.85 280896 2478488 144
02:06:01 AM 4741192 6945260 3141240 39.85 2688 2370940 790728 8.85 280896 2478932 68
02:07:02 AM 4740944 6945392 3141488 39.85 2688 2371316 790728 8.85 280896 2479240 220
02:08:01 AM 4740160 6944984 3142272 39.86 2688 2371692 790728 8.85 280896 2479908 156
02:09:01 AM 4739968 6945176 3142464 39.87 2688 2372072 790728 8.85 280896 2480016 72
02:10:01 AM 4739256 6944840 3143176 39.88 2688 2372448 788488 8.83 280896 2480740 220
02:11:01 AM 4738952 6945204 3143480 39.88 2688 2373116 788488 8.83 280896 2481236 144
02:12:01 AM 4738576 6945204 3143856 39.88 2688 2373492 788488 8.83 280896 2481588 68
02:13:01 AM 4738136 6945140 3144296 39.89 2688 2373868 788488 8.83 280896 2482016 20
02:14:01 AM 4737780 6945164 3144652 39.89 2688 2374248 788488 8.83 280896 2482416 20
02:15:01 AM 4737440 6945208 3144992 39.90 2688 2374624 788488 8.83 280896 2482692 4
02:16:01 AM 4737016 6945152 3145416 39.90 2688 2375000 788488 8.83 280896 2483244 36
02:17:01 AM 4736492 6945276 3145940 39.91 2688 2375648 788488 8.83 280896 2483824 64
02:18:01 AM 4736132 6945000 3146300 39.92 2688 2375724 788488 8.83 280896 2484068 24
02:19:01 AM 4735984 6944936 3146448 39.92 2688 2375816 788488 8.83 280896 2484156 56
02:20:01 AM 4735896 6944948 3146536 39.92 2688 2375908 780296 8.74 280896 2484216 20
02:21:01 AM 4735804 6944952 3146628 39.92 2688 2376004 780296 8.74 280896 2484380 52
02:22:01 AM 4735964 6945204 3146468 39.92 2688 2376096 780296 8.74 280896 2484288 24
02:23:01 AM 4735004 6945080 3147428 39.93 2688 2376932 780296 8.74 280896 2485136 796
02:24:01 AM 4734580 6945024 3147852 39.94 2688 2377308 780296 8.74 280896 2485608 68
02:25:01 AM 4734468 6945292 3147964 39.94 2688 2377684 780296 8.74 280896 2485752 172
02:26:01 AM 4733996 6945200 3148436 39.94 2688 2378064 780296 8.74 280896 2486200 144
02:27:01 AM 4733832 6945412 3148600 39.94 2688 2378440 780296 8.74 280896 2486508 96
02:28:01 AM 4733260 6945188 3149172 39.95 2688 2378788 780296 8.74 280896 2486856 24
02:29:01 AM 4732796 6945284 3149636 39.96 2688 2379340 780296 8.74 280896 2487444 376
02:30:01 AM 4732204 6945016 3150228 39.97 2688 2379672 780296 8.74 280896 2487860 52
02:31:01 AM 4731936 6944852 3150496 39.97 2688 2379768 780296 8.74 280896 2488036 24
02:32:01 AM 4732044 6945052 3150388 39.97 2688 2379860 780296 8.74 280896 2488176 52
02:33:01 AM 4731764 6944856 3150668 39.97 2688 2379952 780296 8.74 280896 2488468 24
02:34:01 AM 4731704 6944892 3150728 39.97 2688 2380048 780296 8.74 280896 2488360 56
02:35:01 AM 4731888 6945164 3150544 39.97 2688 2380136 780296 8.74 280896 2488212 20
02:36:01 AM 4730976 6945260 3151456 39.98 2688 2381140 797340 8.93 280916 2489276 172
02:37:01 AM 4730480 6945144 3151952 39.99 2688 2381520 797340 8.93 280916 2489588 112
02:38:01 AM 4730220 6945260 3152212 39.99 2688 2381896 797340 8.93 280916 2489968 68
02:39:01 AM 4728840 6944256 3153592 40.01 2688 2382272 788488 8.83 280916 2491144 20
02:40:01 AM 4728992 6944784 3153440 40.01 2688 2382640 792376 8.87 281836 2490036 160
02:41:01 AM 4728820 6944992 3153612 40.01 2688 2383028 792376 8.87 281836 2490376 36
02:42:01 AM 4728240 6945040 3154192 40.02 2688 2383644 792376 8.87 281840 2490968 24
02:43:01 AM 4728188 6945080 3154244 40.02 2688 2383736 792376 8.87 281836 2491100 52
02:44:01 AM 4728020 6945004 3154412 40.02 2688 2383828 792376 8.87 281840 2491152 24
02:45:01 AM 4728184 6945264 3154248 40.02 2688 2383924 792376 8.87 281836 2491164 56
02:46:01 AM 4728068 6945240 3154364 40.02 2688 2384016 792376 8.87 281836 2491256 24
02:47:01 AM 4727956 6945216 3154476 40.02 2688 2384104 792376 8.87 281836 2491276 52
02:48:01 AM 4727416 6945040 3155016 40.03 2688 2384468 792376 8.87 281836 2491784 4
02:49:01 AM 4727084 6945072 3155348 40.03 2688 2384840 792376 8.87 281836 2492132 372
02:50:01 AM 4726356 6944720 3156076 40.04 2688 2385216 788488 8.83 281836 2492624 112
02:51:01 AM 4726104 6944852 3156328 40.04 2688 2385596 788488 8.83 281836 2492972 36
02:52:01 AM 4725724 6944848 3156708 40.05 2688 2385972 788488 8.83 281836 2493280 188
02:53:01 AM 4725580 6945084 3156852 40.05 2688 2386352 788488 8.83 281836 2493660 112
02:54:01 AM 4725180 6945068 3157252 40.05 2688 2386728 788488 8.83 281836 2494032 204
02:55:01 AM 4724564 6945192 3157868 40.06 2688 2387476 788488 8.83 281836 2494640 500
02:56:01 AM 4724220 6944944 3158212 40.07 2688 2387572 788488 8.83 281836 2494920 24
02:57:01 AM 4724288 6945104 3158144 40.07 2688 2387664 788488 8.83 281836 2494828 24
02:58:01 AM 4723604 6944512 3158828 40.07 2688 2387756 788488 8.83 281836 2495332 4
02:59:01 AM 4724276 6945272 3158156 40.07 2688 2387844 788488 8.83 281836 2495012 20
03:00:01 AM 4723576 6944668 3158856 40.07 2688 2387940 780344 8.74 281836 2495576 24
03:01:01 AM 4722764 6943948 3159668 40.08 2688 2388016 780344 8.74 281836 2495992 4
03:02:01 AM 4911188 6959512 2971244 37.69 2688 2216660 685716 7.68 369564 2221800 11584
03:03:01 AM 4756056 6900848 3126376 39.66 2688 2317636 750236 8.40 571860 2199500 10736
Average: 4769223 6950013 3113209 39.50 2688 2347724 782312 8.76 278677 2453337 278
12:00:01 AM IFACE rxpck/s txpck/s rxkB/s txkB/s rxcmp/s txcmp/s rxmcst/s %ifutil
12:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:01:01 AM eth0 47.08 46.51 7.57 3.62 0.00 0.00 0.00 0.00
12:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:02:01 AM eth0 17.89 15.96 3.72 2.31 0.00 0.00 0.00 0.00
12:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:03:01 AM eth0 10.76 8.76 2.63 1.72 0.00 0.00 0.00 0.00
12:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:04:01 AM eth0 11.80 9.25 2.98 1.98 0.00 0.00 0.00 0.00
12:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:05:01 AM eth0 11.68 9.37 2.84 1.82 0.00 0.00 0.00 0.00
12:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:06:01 AM eth0 20.86 16.49 5.28 3.34 0.00 0.00 0.00 0.00
12:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:07:01 AM eth0 28.39 25.64 24.60 2.55 0.00 0.00 0.00 0.00
12:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:08:01 AM eth0 3.27 1.48 1.36 0.62 0.00 0.00 0.00 0.00
12:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:09:01 AM eth0 9.07 8.62 2.05 0.93 0.00 0.00 0.00 0.00
12:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:10:01 AM eth0 13.50 9.75 3.03 1.88 0.00 0.00 0.00 0.00
12:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:11:01 AM eth0 11.35 9.23 2.82 1.90 0.00 0.00 0.00 0.00
12:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:12:01 AM eth0 11.50 9.18 2.74 1.80 0.00 0.00 0.00 0.00
12:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:13:01 AM eth0 11.16 9.18 2.68 1.81 0.00 0.00 0.00 0.00
12:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:14:01 AM eth0 12.21 9.38 2.91 1.81 0.00 0.00 0.00 0.00
12:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:15:01 AM eth0 12.05 9.36 2.83 1.81 0.00 0.00 0.00 0.00
12:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:16:01 AM eth0 5.73 4.73 1.07 0.64 0.00 0.00 0.00 0.00
12:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:17:01 AM eth0 0.25 0.05 0.02 0.00 0.00 0.00 0.00 0.00
12:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:18:01 AM eth0 10.86 9.62 2.26 1.43 0.00 0.00 0.00 0.00
12:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:19:01 AM eth0 10.86 8.98 2.66 1.79 0.00 0.00 0.00 0.00
12:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:20:01 AM eth0 11.78 9.35 2.81 1.81 0.00 0.00 0.00 0.00
12:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:21:01 AM eth0 11.15 9.11 2.79 1.85 0.00 0.00 0.00 0.00
12:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:22:01 AM eth0 11.03 9.15 2.69 1.80 0.00 0.00 0.00 0.00
12:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:23:01 AM eth0 11.13 9.03 2.69 1.79 0.00 0.00 0.00 0.00
12:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:24:01 AM eth0 21.94 17.98 5.39 3.44 0.00 0.00 0.00 0.00
12:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:25:01 AM eth0 1.85 1.02 0.63 0.38 0.00 0.00 0.00 0.00
12:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:26:01 AM eth0 1.72 1.27 0.75 0.44 0.00 0.00 0.00 0.00
12:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:27:01 AM eth0 1.83 1.08 0.61 0.35 0.00 0.00 0.00 0.00
12:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:28:01 AM eth0 1.17 0.97 0.36 0.19 0.00 0.00 0.00 0.00
12:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:29:01 AM eth0 1.30 1.02 0.37 0.19 0.00 0.00 0.00 0.00
12:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:30:01 AM eth0 1.18 0.93 0.36 0.18 0.00 0.00 0.00 0.00
12:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:31:01 AM eth0 28.44 26.39 5.64 3.34 0.00 0.00 0.00 0.00
12:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:32:01 AM eth0 11.11 9.25 2.69 1.81 0.00 0.00 0.00 0.00
12:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:33:01 AM eth0 14.46 9.35 3.33 1.99 0.00 0.00 0.00 0.00
12:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:34:01 AM eth0 11.18 9.23 2.97 1.98 0.00 0.00 0.00 0.00
12:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:35:01 AM eth0 14.05 8.98 2.98 1.79 0.00 0.00 0.00 0.00
12:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:36:01 AM eth0 14.13 10.13 4.14 2.71 0.00 0.00 0.00 0.00
12:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:37:01 AM eth0 15.51 12.90 3.28 2.04 0.00 0.00 0.00 0.00
12:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:38:01 AM eth0 17.03 9.41 3.89 2.17 0.00 0.00 0.00 0.00
12:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:39:01 AM eth0 11.75 9.30 2.78 1.81 0.00 0.00 0.00 0.00
12:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:40:01 AM eth0 11.51 9.25 2.73 1.83 0.00 0.00 0.00 0.00
12:41:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:41:01 AM eth0 11.51 9.38 2.84 1.90 0.00 0.00 0.00 0.00
12:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:42:01 AM eth0 11.96 9.25 2.99 1.98 0.00 0.00 0.00 0.00
12:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:43:01 AM eth0 18.21 16.39 3.96 2.52 0.00 0.00 0.00 0.00
12:44:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:44:01 AM eth0 12.53 9.13 2.86 1.80 0.00 0.00 0.00 0.00
12:45:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:45:01 AM eth0 13.23 9.65 3.47 2.25 0.00 0.00 0.00 0.00
12:46:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:46:01 AM eth0 11.71 9.21 2.92 1.86 0.00 0.00 0.00 0.00
12:47:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:47:01 AM eth0 13.08 9.22 2.98 1.80 0.00 0.00 0.00 0.00
12:48:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:48:01 AM eth0 12.13 9.57 3.34 2.25 0.00 0.00 0.00 0.00
12:49:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:49:01 AM eth0 18.79 15.93 4.84 3.05 0.00 0.00 0.00 0.00
12:50:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:50:01 AM eth0 7.02 3.38 1.27 0.61 0.00 0.00 0.00 0.00
12:51:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:51:01 AM eth0 1.50 0.93 0.37 0.21 0.00 0.00 0.00 0.00
12:52:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:52:01 AM eth0 1.30 0.82 0.23 0.14 0.00 0.00 0.00 0.00
12:53:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:53:01 AM eth0 1.43 0.87 0.23 0.15 0.00 0.00 0.00 0.00
12:54:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:54:01 AM eth0 1.30 0.85 0.22 0.15 0.00 0.00 0.00 0.00
12:55:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:55:01 AM eth0 1.38 0.85 0.24 0.15 0.00 0.00 0.00 0.00
12:56:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:56:01 AM eth0 33.92 31.74 6.49 3.73 0.00 0.00 0.00 0.00
12:57:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:57:01 AM eth0 16.61 9.02 3.31 1.79 0.00 0.00 0.00 0.00
12:58:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:58:01 AM eth0 12.63 9.56 3.40 2.25 0.00 0.00 0.00 0.00
12:59:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:59:01 AM eth0 11.35 9.38 2.93 1.99 0.00 0.00 0.00 0.00
01:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:00:01 AM eth0 17.73 9.05 3.55 1.79 0.00 0.00 0.00 0.00
01:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:01:01 AM eth0 12.01 9.18 2.93 1.87 0.00 0.00 0.00 0.00
01:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:02:01 AM eth0 9.60 7.66 1.97 1.23 0.00 0.00 0.00 0.00
01:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:03:01 AM eth0 9.45 7.73 2.21 1.46 0.00 0.00 0.00 0.00
01:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:04:01 AM eth0 12.86 9.95 3.12 8.22 0.00 0.00 0.00 0.00
01:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:05:01 AM eth0 14.46 10.28 33.01 6.30 0.00 0.00 0.00 0.00
01:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:06:01 AM eth0 11.23 9.31 2.80 1.87 0.00 0.00 0.00 0.00
01:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:07:01 AM eth0 11.18 9.00 2.72 1.79 0.00 0.00 0.00 0.00
01:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:08:01 AM eth0 12.13 9.35 3.06 1.99 0.00 0.00 0.00 0.00
01:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:09:01 AM eth0 18.04 15.29 4.52 2.88 0.00 0.00 0.00 0.00
01:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:10:01 AM eth0 1.23 0.82 0.19 0.13 0.00 0.00 0.00 0.00
01:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:11:01 AM eth0 1.55 0.92 0.40 0.21 0.00 0.00 0.00 0.00
01:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:12:01 AM eth0 1.33 0.85 0.24 0.15 0.00 0.00 0.00 0.00
01:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:13:01 AM eth0 1.23 0.80 0.25 0.14 0.00 0.00 0.00 0.00
01:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:14:01 AM eth0 1.27 0.85 0.22 0.15 0.00 0.00 0.00 0.00
01:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:15:01 AM eth0 7.55 7.03 1.46 0.97 0.00 0.00 0.00 0.00
01:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:16:01 AM eth0 10.85 10.46 2.23 1.03 0.00 0.00 0.00 0.00
01:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:17:01 AM eth0 6.18 6.33 3.10 1.19 0.00 0.00 0.00 0.00
01:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:18:01 AM eth0 13.31 11.41 3.01 1.93 0.00 0.00 0.00 0.00
01:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:19:01 AM eth0 10.83 9.12 2.65 1.79 0.00 0.00 0.00 0.00
01:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:20:01 AM eth0 10.86 9.16 2.66 1.80 0.00 0.00 0.00 0.00
01:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:21:01 AM eth0 11.33 9.13 2.82 1.85 0.00 0.00 0.00 0.00
01:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:22:01 AM eth0 11.30 9.38 2.96 1.99 0.00 0.00 0.00 0.00
01:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:23:01 AM eth0 11.43 9.18 2.80 1.80 0.00 0.00 0.00 0.00
01:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:24:01 AM eth0 6.10 5.10 1.43 1.01 0.00 0.00 0.00 0.00
01:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:25:01 AM eth0 3.40 2.88 0.21 0.32 0.00 0.00 0.00 0.00
01:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:26:01 AM eth0 12.98 10.81 2.76 1.93 0.00 0.00 0.00 0.00
01:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:27:01 AM eth0 7.75 7.07 21.52 1.11 0.00 0.00 0.00 0.00
01:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:28:01 AM eth0 7.78 6.01 2.36 1.02 0.00 0.00 0.00 0.00
01:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:29:01 AM eth0 0.35 0.00 0.02 0.00 0.00 0.00 0.00 0.00
01:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:30:01 AM eth0 4.50 4.45 1.02 0.56 0.00 0.00 0.00 0.00
01:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:31:01 AM eth0 2.60 3.18 1.81 0.63 0.00 0.00 0.00 0.00
01:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:32:01 AM eth0 3.25 4.07 2.45 0.73 0.00 0.00 0.00 0.00
01:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:33:01 AM eth0 0.55 0.13 0.27 0.19 0.00 0.00 0.00 0.00
01:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:34:01 AM eth0 0.08 0.00 0.01 0.00 0.00 0.00 0.00 0.00
01:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:35:01 AM eth0 0.37 0.00 0.03 0.00 0.00 0.00 0.00 0.00
01:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:36:01 AM eth0 0.45 0.17 0.15 0.07 0.00 0.00 0.00 0.00
01:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:37:01 AM eth0 0.80 0.15 0.07 0.01 0.00 0.00 0.00 0.00
01:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:38:01 AM eth0 12.16 10.93 2.67 1.72 0.00 0.00 0.00 0.00
01:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:39:01 AM eth0 10.55 8.87 2.59 1.78 0.00 0.00 0.00 0.00
01:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:40:01 AM eth0 11.06 9.28 2.74 1.81 0.00 0.00 0.00 0.00
01:41:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:41:01 AM eth0 11.06 9.10 2.79 1.85 0.00 0.00 0.00 0.00
01:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:42:01 AM eth0 11.81 9.47 2.89 1.86 0.00 0.00 0.00 0.00
01:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:43:01 AM eth0 11.36 9.21 2.79 1.81 0.00 0.00 0.00 0.00
01:44:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:44:01 AM eth0 8.93 8.03 1.93 1.25 0.00 0.00 0.00 0.00
01:45:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:45:01 AM eth0 2.43 2.33 0.53 0.33 0.00 0.00 0.00 0.00
01:46:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:46:01 AM eth0 14.51 13.01 3.50 2.29 0.00 0.00 0.00 0.00
01:47:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:47:01 AM eth0 11.06 9.18 2.72 1.80 0.00 0.00 0.00 0.00
01:48:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:48:01 AM eth0 11.70 9.18 2.99 1.98 0.00 0.00 0.00 0.00
01:49:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:49:01 AM eth0 11.60 9.20 2.77 1.80 0.00 0.00 0.00 0.00
01:50:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:50:01 AM eth0 11.48 9.53 3.09 2.06 0.00 0.00 0.00 0.00
01:51:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:51:01 AM eth0 12.20 9.40 2.99 1.87 0.00 0.00 0.00 0.00
01:52:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:52:01 AM eth0 17.25 14.55 4.36 2.75 0.00 0.00 0.00 0.00
01:53:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:53:01 AM eth0 5.78 0.20 0.73 0.04 0.00 0.00 0.00 0.00
01:54:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:54:01 AM eth0 1.17 0.58 0.46 0.31 0.00 0.00 0.00 0.00
01:55:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:55:01 AM eth0 0.73 0.25 0.12 0.05 0.00 0.00 0.00 0.00
01:56:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:56:01 AM eth0 7.08 0.30 1.09 0.11 0.00 0.00 0.00 0.00
01:57:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:57:01 AM eth0 0.85 0.20 0.12 0.04 0.00 0.00 0.00 0.00
01:58:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:58:01 AM eth0 29.71 28.28 5.12 2.82 0.00 0.00 0.00 0.00
01:59:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:59:01 AM eth0 11.48 9.10 2.79 1.79 0.00 0.00 0.00 0.00
02:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:00:01 AM eth0 11.81 8.98 2.78 1.79 0.00 0.00 0.00 0.00
02:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:01:01 AM eth0 12.01 9.25 2.89 1.88 0.00 0.00 0.00 0.00
02:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:02:01 AM eth0 13.85 9.40 2.89 1.83 0.00 0.00 0.00 0.00
02:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:03:01 AM eth0 14.06 9.43 2.90 1.82 0.00 0.00 0.00 0.00
02:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:04:01 AM eth0 11.33 9.33 2.69 1.72 0.00 0.00 0.00 0.00
02:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:05:01 AM eth0 12.66 10.83 2.92 1.93 0.00 0.00 0.00 0.00
02:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:06:01 AM eth0 12.33 9.30 2.96 1.86 0.00 0.00 0.00 0.00
02:07:02 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:07:02 AM eth0 14.35 9.06 3.03 1.79 0.00 0.00 0.00 0.00
02:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:08:01 AM eth0 11.95 9.61 3.08 2.10 0.00 0.00 0.00 0.00
02:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:09:01 AM eth0 11.16 9.11 2.75 1.79 0.00 0.00 0.00 0.00
02:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:10:01 AM eth0 15.03 9.07 3.26 1.79 0.00 0.00 0.00 0.00
02:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:11:01 AM eth0 19.18 15.79 4.13 2.49 0.00 0.00 0.00 0.00
02:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:12:01 AM eth0 11.48 9.03 2.67 1.79 0.00 0.00 0.00 0.00
02:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:13:01 AM eth0 11.40 9.20 2.75 1.80 0.00 0.00 0.00 0.00
02:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:14:01 AM eth0 11.26 9.00 2.70 1.79 0.00 0.00 0.00 0.00
02:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:15:01 AM eth0 11.43 9.12 2.73 1.79 0.00 0.00 0.00 0.00
02:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:16:01 AM eth0 11.45 9.10 2.87 1.85 0.00 0.00 0.00 0.00
02:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:17:01 AM eth0 18.60 14.81 4.51 2.81 0.00 0.00 0.00 0.00
02:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:18:01 AM eth0 2.00 0.65 0.76 0.51 0.00 0.00 0.00 0.00
02:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:19:01 AM eth0 0.92 0.45 0.36 0.24 0.00 0.00 0.00 0.00
02:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:20:01 AM eth0 2.27 0.27 0.32 0.05 0.00 0.00 0.00 0.00
02:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:21:01 AM eth0 1.47 0.32 0.32 0.11 0.00 0.00 0.00 0.00
02:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:22:01 AM eth0 0.98 0.20 0.14 0.04 0.00 0.00 0.00 0.00
02:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:23:01 AM eth0 65.44 64.81 10.56 5.42 0.00 0.00 0.00 0.00
02:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:24:01 AM eth0 11.36 9.15 2.75 1.80 0.00 0.00 0.00 0.00
02:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:25:01 AM eth0 10.71 8.85 2.59 1.78 0.00 0.00 0.00 0.00
02:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:26:01 AM eth0 11.53 9.23 2.85 1.86 0.00 0.00 0.00 0.00
02:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:27:01 AM eth0 10.91 9.02 2.63 1.79 0.00 0.00 0.00 0.00
02:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:28:01 AM eth0 10.55 8.70 2.54 1.72 0.00 0.00 0.00 0.00
02:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:29:01 AM eth0 14.61 12.41 3.67 2.45 0.00 0.00 0.00 0.00
02:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:30:01 AM eth0 8.55 6.83 2.04 1.25 0.00 0.00 0.00 0.00
02:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:31:01 AM eth0 0.62 0.32 0.22 0.11 0.00 0.00 0.00 0.00
02:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:32:01 AM eth0 1.25 0.20 0.19 0.04 0.00 0.00 0.00 0.00
02:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:33:01 AM eth0 0.83 0.43 0.35 0.24 0.00 0.00 0.00 0.00
02:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:34:01 AM eth0 0.37 0.20 0.09 0.04 0.00 0.00 0.00 0.00
02:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:35:01 AM eth0 0.42 0.20 0.09 0.04 0.00 0.00 0.00 0.00
02:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:36:01 AM eth0 70.04 68.11 12.02 6.36 0.00 0.00 0.00 0.00
02:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:37:01 AM eth0 11.23 9.15 2.72 1.80 0.00 0.00 0.00 0.00
02:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:38:01 AM eth0 10.76 9.05 2.66 1.79 0.00 0.00 0.00 0.00
02:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:39:01 AM eth0 11.13 9.12 2.70 1.80 0.00 0.00 0.00 0.00
02:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:40:01 AM eth0 11.03 9.18 2.67 1.80 0.00 0.00 0.00 0.00
02:41:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:41:01 AM eth0 11.53 9.25 2.88 1.86 0.00 0.00 0.00 0.00
02:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:42:01 AM eth0 16.38 14.03 4.08 2.67 0.00 0.00 0.00 0.00
02:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:43:01 AM eth0 0.35 0.20 0.09 0.04 0.00 0.00 0.00 0.00
02:44:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:44:01 AM eth0 0.32 0.20 0.09 0.04 0.00 0.00 0.00 0.00
02:45:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:45:01 AM eth0 0.43 0.23 0.09 0.05 0.00 0.00 0.00 0.00
02:46:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:46:01 AM eth0 0.50 0.30 0.22 0.11 0.00 0.00 0.00 0.00
02:47:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:47:01 AM eth0 0.80 0.25 0.14 0.05 0.00 0.00 0.00 0.00
02:48:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:48:01 AM eth0 23.19 22.71 4.04 2.16 0.00 0.00 0.00 0.00
02:49:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:49:01 AM eth0 23.16 22.46 3.96 2.22 0.00 0.00 0.00 0.00
02:50:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:50:01 AM eth0 10.80 8.96 2.65 1.79 0.00 0.00 0.00 0.00
02:51:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:51:01 AM eth0 11.78 9.32 2.92 1.87 0.00 0.00 0.00 0.00
02:52:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:52:01 AM eth0 11.18 9.06 2.71 1.79 0.00 0.00 0.00 0.00
02:53:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:53:01 AM eth0 11.23 9.20 2.70 1.80 0.00 0.00 0.00 0.00
02:54:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:54:01 AM eth0 11.15 9.28 2.74 1.81 0.00 0.00 0.00 0.00
02:55:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:55:01 AM eth0 21.61 18.04 5.33 3.44 0.00 0.00 0.00 0.00
02:56:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:56:01 AM eth0 0.45 0.28 0.22 0.11 0.00 0.00 0.00 0.00
02:57:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:57:01 AM eth0 0.38 0.25 0.09 0.05 0.00 0.00 0.00 0.00
02:58:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:58:01 AM eth0 0.77 0.37 0.37 0.23 0.00 0.00 0.00 0.00
02:59:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:59:01 AM eth0 0.57 0.20 0.13 0.04 0.00 0.00 0.00 0.00
03:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:00:01 AM eth0 0.67 0.45 0.43 0.30 0.00 0.00 0.00 0.00
03:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:01:01 AM eth0 1.32 0.40 0.33 0.12 0.00 0.00 0.00 0.00
03:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:02:01 AM eth0 208.03 160.03 166.58 386.28 0.00 0.00 0.00 0.00
03:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:03:01 AM eth0 44.09 34.04 150.42 26.67 0.00 0.00 0.00 0.00
Average: lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
Average: eth0 11.57 9.37 4.44 3.75 0.00 0.00 0.00 0.00
---> sar -P ALL:
Linux 4.18.0-553.5.1.el8.x86_64 (prd-centos8-robot-2c-8g-1589.novalocal) 01/18/2026 _x86_64_ (2 CPU)
12:00:01 AM CPU %user %nice %system %iowait %steal %idle
12:01:01 AM all 2.60 0.03 0.44 0.09 0.04 96.80
12:01:01 AM 0 2.09 0.00 0.35 0.17 0.05 97.34
12:01:01 AM 1 3.11 0.05 0.54 0.02 0.03 96.25
12:02:01 AM all 4.57 0.00 0.33 0.01 0.04 95.05
12:02:01 AM 0 4.19 0.00 0.37 0.00 0.05 95.39
12:02:01 AM 1 4.94 0.00 0.30 0.02 0.03 94.71
12:03:01 AM all 4.18 0.00 0.36 0.00 0.06 95.40
12:03:01 AM 0 3.86 0.00 0.33 0.00 0.05 95.75
12:03:01 AM 1 4.49 0.00 0.38 0.00 0.07 95.06
12:04:01 AM all 4.36 0.00 0.35 0.00 0.06 95.23
12:04:01 AM 0 3.96 0.00 0.30 0.00 0.05 95.69
12:04:01 AM 1 4.77 0.00 0.40 0.00 0.07 94.76
12:05:01 AM all 4.42 0.00 0.36 0.00 0.07 95.15
12:05:01 AM 0 5.38 0.00 0.47 0.00 0.08 94.07
12:05:01 AM 1 3.46 0.00 0.25 0.00 0.05 96.24
12:06:01 AM all 6.67 0.00 0.39 0.00 0.06 92.88
12:06:01 AM 0 5.55 0.00 0.33 0.00 0.05 94.06
12:06:01 AM 1 7.79 0.00 0.45 0.00 0.07 91.69
12:07:01 AM all 6.32 0.00 0.81 0.00 0.07 92.80
12:07:01 AM 0 3.49 0.00 0.70 0.00 0.07 95.74
12:07:01 AM 1 9.17 0.00 0.92 0.00 0.07 89.85
12:08:01 AM all 1.44 0.00 0.37 0.00 0.07 98.12
12:08:01 AM 0 1.64 0.00 0.47 0.00 0.07 97.83
12:08:01 AM 1 1.25 0.00 0.27 0.00 0.07 98.41
12:09:01 AM all 2.30 0.00 0.38 0.00 0.05 97.27
12:09:01 AM 0 2.81 0.00 0.54 0.00 0.05 96.61
12:09:01 AM 1 1.79 0.00 0.23 0.00 0.05 97.93
12:10:01 AM all 4.57 0.00 0.22 0.00 0.08 95.13
12:10:01 AM 0 2.29 0.00 0.15 0.00 0.07 97.49
12:10:01 AM 1 6.86 0.00 0.28 0.00 0.08 92.78
12:11:01 AM all 4.60 0.00 0.21 0.00 0.07 95.12
12:11:01 AM 0 5.18 0.00 0.23 0.00 0.07 94.52
12:11:01 AM 1 4.03 0.00 0.18 0.00 0.07 95.72
12:11:01 AM CPU %user %nice %system %iowait %steal %idle
12:12:01 AM all 4.50 0.00 0.18 0.00 0.06 95.27
12:12:01 AM 0 3.89 0.00 0.15 0.00 0.05 95.91
12:12:01 AM 1 5.11 0.00 0.20 0.00 0.07 94.63
12:13:01 AM all 4.40 0.00 0.20 0.00 0.07 95.33
12:13:01 AM 0 5.20 0.00 0.20 0.00 0.07 94.53
12:13:01 AM 1 3.60 0.00 0.20 0.00 0.07 96.14
12:14:01 AM all 4.38 0.00 0.18 0.00 0.06 95.38
12:14:01 AM 0 3.17 0.00 0.18 0.00 0.05 96.59
12:14:01 AM 1 5.59 0.00 0.18 0.00 0.07 94.16
12:15:01 AM all 4.46 0.00 0.21 0.00 0.06 95.27
12:15:01 AM 0 4.78 0.00 0.22 0.00 0.07 94.94
12:15:01 AM 1 4.15 0.00 0.20 0.00 0.05 95.60
12:16:01 AM all 3.22 0.25 0.38 0.18 0.05 95.92
12:16:01 AM 0 1.29 0.42 0.28 0.33 0.05 97.63
12:16:01 AM 1 5.21 0.07 0.48 0.02 0.05 94.17
12:17:01 AM all 0.50 0.00 0.10 0.00 0.05 99.35
12:17:01 AM 0 0.37 0.00 0.10 0.00 0.07 99.47
12:17:01 AM 1 0.63 0.00 0.10 0.00 0.03 99.23
12:18:01 AM all 3.19 0.00 0.28 0.00 0.06 96.47
12:18:01 AM 0 3.14 0.00 0.23 0.00 0.05 96.57
12:18:01 AM 1 3.25 0.00 0.32 0.00 0.07 96.37
12:19:01 AM all 4.34 0.00 0.33 0.00 0.06 95.28
12:19:01 AM 0 6.14 0.00 0.45 0.00 0.07 93.34
12:19:01 AM 1 2.54 0.00 0.20 0.00 0.05 97.21
12:20:01 AM all 4.32 0.00 0.35 0.01 0.05 95.27
12:20:01 AM 0 5.59 0.00 0.43 0.00 0.05 93.93
12:20:01 AM 1 3.06 0.00 0.27 0.02 0.05 96.61
12:21:01 AM all 4.36 0.00 0.33 0.00 0.06 95.24
12:21:01 AM 0 5.58 0.00 0.40 0.00 0.07 93.95
12:21:01 AM 1 3.14 0.00 0.27 0.00 0.05 96.54
12:22:01 AM all 4.32 0.00 0.34 0.00 0.06 95.28
12:22:01 AM 0 5.48 0.00 0.45 0.00 0.07 94.00
12:22:01 AM 1 3.16 0.00 0.23 0.00 0.05 96.56
12:22:01 AM CPU %user %nice %system %iowait %steal %idle
12:23:01 AM all 4.32 0.00 0.35 0.00 0.06 95.27
12:23:01 AM 0 6.62 0.00 0.48 0.00 0.07 92.83
12:23:01 AM 1 2.02 0.00 0.22 0.00 0.05 97.71
12:24:01 AM all 7.27 0.00 0.49 0.00 0.08 92.16
12:24:01 AM 0 7.93 0.00 0.49 0.00 0.08 91.50
12:24:01 AM 1 6.61 0.00 0.50 0.00 0.07 92.82
12:25:01 AM all 0.94 0.00 0.13 0.00 0.04 98.89
12:25:01 AM 0 1.29 0.00 0.18 0.00 0.05 98.48
12:25:01 AM 1 0.58 0.00 0.08 0.00 0.03 99.30
12:26:01 AM all 1.29 0.00 0.15 0.00 0.06 98.51
12:26:01 AM 0 1.00 0.00 0.12 0.00 0.03 98.85
12:26:01 AM 1 1.57 0.00 0.18 0.00 0.08 98.16
12:27:01 AM all 1.20 0.00 0.13 0.00 0.05 98.62
12:27:01 AM 0 1.55 0.00 0.12 0.00 0.05 98.28
12:27:01 AM 1 0.85 0.00 0.13 0.00 0.05 98.96
12:28:01 AM all 1.26 0.00 0.14 0.00 0.06 98.54
12:28:01 AM 0 1.30 0.00 0.15 0.00 0.07 98.48
12:28:01 AM 1 1.22 0.00 0.13 0.00 0.05 98.60
12:29:01 AM all 1.04 0.00 0.16 0.00 0.05 98.75
12:29:01 AM 0 0.99 0.00 0.17 0.00 0.05 98.80
12:29:01 AM 1 1.09 0.00 0.15 0.00 0.05 98.71
12:30:01 AM all 1.23 0.00 0.13 0.00 0.06 98.59
12:30:01 AM 0 2.00 0.00 0.17 0.00 0.07 97.76
12:30:01 AM 1 0.45 0.00 0.08 0.00 0.05 99.41
12:31:01 AM all 5.87 0.00 0.32 0.01 0.06 93.75
12:31:01 AM 0 5.77 0.00 0.32 0.02 0.05 93.85
12:31:01 AM 1 5.96 0.00 0.32 0.00 0.07 93.65
12:32:01 AM all 4.47 0.00 0.18 0.00 0.06 95.30
12:32:01 AM 0 2.27 0.00 0.12 0.00 0.05 97.56
12:32:01 AM 1 6.66 0.00 0.23 0.00 0.07 93.04
12:33:01 AM all 4.37 0.00 0.21 0.00 0.08 95.35
12:33:01 AM 0 5.59 0.00 0.23 0.00 0.08 94.10
12:33:01 AM 1 3.15 0.00 0.18 0.00 0.07 96.60
12:33:01 AM CPU %user %nice %system %iowait %steal %idle
12:34:01 AM all 4.44 0.00 0.19 0.00 0.06 95.31
12:34:01 AM 0 4.93 0.00 0.20 0.00 0.05 94.82
12:34:01 AM 1 3.95 0.00 0.18 0.00 0.07 95.80
12:35:01 AM all 4.45 0.00 0.20 0.00 0.06 95.29
12:35:01 AM 0 7.14 0.00 0.25 0.00 0.07 92.54
12:35:01 AM 1 1.76 0.00 0.15 0.00 0.05 98.04
12:36:01 AM all 4.39 0.00 0.19 0.00 0.07 95.35
12:36:01 AM 0 1.92 0.00 0.15 0.00 0.05 97.88
12:36:01 AM 1 6.86 0.00 0.23 0.00 0.08 92.82
12:37:01 AM all 5.63 0.00 0.30 0.00 0.08 94.00
12:37:01 AM 0 3.48 0.00 0.18 0.00 0.08 96.26
12:37:01 AM 1 7.81 0.00 0.42 0.00 0.07 91.70
12:38:01 AM all 4.51 0.00 0.18 0.00 0.07 95.25
12:38:01 AM 0 3.79 0.00 0.18 0.00 0.07 95.96
12:38:01 AM 1 5.22 0.00 0.17 0.00 0.07 94.55
12:39:01 AM all 4.38 0.00 0.21 0.00 0.06 95.35
12:39:01 AM 0 5.95 0.00 0.22 0.00 0.05 93.78
12:39:01 AM 1 2.81 0.00 0.20 0.00 0.07 96.92
12:40:01 AM all 4.48 0.00 0.18 0.00 0.06 95.28
12:40:01 AM 0 3.78 0.00 0.17 0.00 0.07 95.99
12:40:01 AM 1 5.19 0.00 0.18 0.00 0.05 94.58
12:41:01 AM all 4.29 0.00 0.19 0.00 0.07 95.45
12:41:01 AM 0 4.51 0.00 0.22 0.00 0.07 95.20
12:41:01 AM 1 4.06 0.00 0.17 0.00 0.07 95.70
12:42:01 AM all 4.33 0.00 0.18 0.00 0.07 95.43
12:42:01 AM 0 4.37 0.00 0.18 0.00 0.07 95.38
12:42:01 AM 1 4.29 0.00 0.17 0.00 0.07 95.48
12:43:01 AM all 5.54 0.00 0.29 0.00 0.06 94.10
12:43:01 AM 0 2.49 0.00 0.20 0.00 0.05 97.26
12:43:01 AM 1 8.60 0.00 0.39 0.00 0.07 90.94
12:44:01 AM all 4.48 0.00 0.35 0.00 0.08 95.09
12:44:01 AM 0 3.74 0.00 0.32 0.00 0.07 95.87
12:44:01 AM 1 5.22 0.00 0.38 0.00 0.08 94.31
12:44:01 AM CPU %user %nice %system %iowait %steal %idle
12:45:01 AM all 4.31 0.00 0.36 0.00 0.07 95.26
12:45:01 AM 0 3.03 0.00 0.30 0.00 0.07 96.60
12:45:01 AM 1 5.59 0.00 0.42 0.00 0.07 93.92
12:46:01 AM all 4.23 0.01 0.38 0.01 0.05 95.32
12:46:01 AM 0 5.60 0.02 0.43 0.02 0.05 93.88
12:46:01 AM 1 2.86 0.00 0.32 0.00 0.05 96.77
12:47:01 AM all 4.43 0.00 0.34 0.01 0.05 95.17
12:47:01 AM 0 2.64 0.00 0.22 0.00 0.05 97.09
12:47:01 AM 1 6.22 0.00 0.47 0.02 0.05 93.24
12:48:01 AM all 4.38 0.00 0.38 0.00 0.06 95.18
12:48:01 AM 0 1.92 0.00 0.23 0.00 0.05 97.80
12:48:01 AM 1 6.85 0.00 0.54 0.00 0.07 92.55
12:49:01 AM all 6.71 0.00 0.44 0.00 0.07 92.79
12:49:01 AM 0 5.35 0.00 0.37 0.00 0.07 94.21
12:49:01 AM 1 8.07 0.00 0.50 0.00 0.07 91.36
12:50:01 AM all 1.78 0.00 0.15 0.00 0.05 98.02
12:50:01 AM 0 2.32 0.00 0.15 0.00 0.03 97.50
12:50:01 AM 1 1.24 0.00 0.15 0.00 0.07 98.54
12:51:01 AM all 0.91 0.00 0.14 0.00 0.04 98.91
12:51:01 AM 0 0.87 0.00 0.13 0.00 0.03 98.96
12:51:01 AM 1 0.95 0.00 0.15 0.00 0.05 98.85
12:52:01 AM all 0.97 0.00 0.11 0.00 0.06 98.86
12:52:01 AM 0 1.02 0.00 0.12 0.00 0.07 98.80
12:52:01 AM 1 0.92 0.00 0.10 0.00 0.05 98.93
12:53:01 AM all 0.95 0.00 0.13 0.00 0.05 98.86
12:53:01 AM 0 1.32 0.00 0.18 0.00 0.07 98.43
12:53:01 AM 1 0.58 0.00 0.08 0.00 0.03 99.30
12:54:01 AM all 0.99 0.00 0.11 0.00 0.07 98.84
12:54:01 AM 0 1.07 0.00 0.15 0.00 0.08 98.70
12:54:01 AM 1 0.90 0.00 0.07 0.00 0.05 98.98
12:55:01 AM all 1.00 0.00 0.13 0.00 0.05 98.82
12:55:01 AM 0 0.82 0.00 0.15 0.00 0.05 98.98
12:55:01 AM 1 1.19 0.00 0.10 0.00 0.05 98.66
12:55:01 AM CPU %user %nice %system %iowait %steal %idle
12:56:01 AM all 5.88 0.00 0.31 0.00 0.07 93.74
12:56:01 AM 0 5.32 0.00 0.30 0.00 0.07 94.31
12:56:01 AM 1 6.45 0.00 0.32 0.00 0.07 93.16
12:57:01 AM all 4.52 0.00 0.17 0.00 0.07 95.24
12:57:01 AM 0 5.23 0.00 0.18 0.00 0.07 94.52
12:57:01 AM 1 3.81 0.00 0.15 0.00 0.07 95.97
12:58:01 AM all 4.46 0.00 0.20 0.00 0.07 95.27
12:58:01 AM 0 3.41 0.00 0.18 0.00 0.07 96.34
12:58:01 AM 1 5.52 0.00 0.22 0.00 0.07 94.19
12:59:01 AM all 4.43 0.00 0.15 0.00 0.06 95.36
12:59:01 AM 0 6.12 0.00 0.15 0.00 0.07 93.67
12:59:01 AM 1 2.74 0.00 0.15 0.00 0.05 97.06
01:00:01 AM all 4.54 0.00 0.20 0.00 0.08 95.19
01:00:01 AM 0 5.53 0.00 0.20 0.00 0.07 94.20
01:00:01 AM 1 3.55 0.00 0.20 0.00 0.08 96.17
01:01:01 AM all 4.45 0.00 0.22 0.01 0.05 95.27
01:01:01 AM 0 6.19 0.00 0.24 0.00 0.05 93.53
01:01:01 AM 1 2.70 0.00 0.20 0.02 0.05 97.02
01:02:01 AM all 5.35 0.00 0.36 0.00 0.07 94.22
01:02:01 AM 0 6.42 0.00 0.42 0.00 0.07 93.09
01:02:01 AM 1 4.29 0.00 0.31 0.00 0.07 95.33
01:03:01 AM all 5.52 0.00 0.42 0.00 0.06 94.00
01:03:01 AM 0 4.81 0.00 0.37 0.00 0.05 94.77
01:03:01 AM 1 6.25 0.00 0.47 0.00 0.07 93.21
01:04:01 AM all 4.29 0.00 0.34 0.00 0.06 95.31
01:04:01 AM 0 6.50 0.00 0.45 0.00 0.07 92.98
01:04:01 AM 1 2.07 0.00 0.23 0.00 0.05 97.64
01:05:01 AM all 4.42 0.00 0.31 0.00 0.06 95.22
01:05:01 AM 0 2.81 0.00 0.20 0.00 0.05 96.94
01:05:01 AM 1 6.03 0.00 0.42 0.00 0.07 93.49
01:06:01 AM all 4.32 0.00 0.33 0.00 0.06 95.29
01:06:01 AM 0 4.76 0.00 0.40 0.00 0.07 94.77
01:06:01 AM 1 3.88 0.00 0.25 0.00 0.05 95.82
01:06:01 AM CPU %user %nice %system %iowait %steal %idle
01:07:01 AM all 4.37 0.00 0.32 0.00 0.07 95.24
01:07:01 AM 0 5.12 0.00 0.35 0.00 0.07 94.47
01:07:01 AM 1 3.63 0.00 0.28 0.00 0.07 96.02
01:08:01 AM all 4.33 0.00 0.33 0.00 0.07 95.28
01:08:01 AM 0 3.11 0.00 0.27 0.00 0.07 96.56
01:08:01 AM 1 5.55 0.00 0.38 0.00 0.07 94.00
01:09:01 AM all 6.10 0.00 0.33 0.00 0.06 93.51
01:09:01 AM 0 6.40 0.00 0.38 0.00 0.07 93.14
01:09:01 AM 1 5.80 0.00 0.27 0.00 0.05 93.88
01:10:01 AM all 0.84 0.00 0.12 0.00 0.07 98.98
01:10:01 AM 0 0.70 0.00 0.12 0.00 0.07 99.12
01:10:01 AM 1 0.97 0.00 0.12 0.00 0.07 98.85
01:11:01 AM all 0.99 0.00 0.13 0.00 0.05 98.84
01:11:01 AM 0 1.04 0.00 0.17 0.00 0.07 98.73
01:11:01 AM 1 0.94 0.00 0.08 0.00 0.03 98.95
01:12:01 AM all 0.94 0.00 0.13 0.00 0.05 98.87
01:12:01 AM 0 0.94 0.00 0.18 0.00 0.07 98.81
01:12:01 AM 1 0.95 0.00 0.08 0.00 0.03 98.93
01:13:01 AM all 0.94 0.00 0.13 0.00 0.07 98.87
01:13:01 AM 0 1.29 0.00 0.17 0.00 0.08 98.46
01:13:01 AM 1 0.58 0.00 0.08 0.00 0.05 99.28
01:14:01 AM all 0.95 0.00 0.13 0.00 0.05 98.87
01:14:01 AM 0 1.17 0.00 0.15 0.00 0.05 98.63
01:14:01 AM 1 0.74 0.00 0.10 0.00 0.05 99.11
01:15:01 AM all 3.31 0.00 0.23 0.00 0.07 96.39
01:15:01 AM 0 4.09 0.00 0.29 0.00 0.07 95.55
01:15:01 AM 1 2.54 0.00 0.17 0.00 0.07 97.23
01:16:01 AM all 5.41 0.00 0.54 0.00 0.06 93.99
01:16:01 AM 0 0.38 0.00 0.15 0.00 0.05 99.42
01:16:01 AM 1 10.84 0.00 0.96 0.00 0.07 88.13
01:17:01 AM all 5.09 0.00 0.48 0.00 0.07 94.35
01:17:01 AM 0 7.80 0.00 0.68 0.00 0.07 91.45
01:17:01 AM 1 2.39 0.00 0.28 0.00 0.07 97.26
01:17:01 AM CPU %user %nice %system %iowait %steal %idle
01:18:01 AM all 5.72 0.00 0.32 0.00 0.05 93.91
01:18:01 AM 0 8.41 0.00 0.39 0.00 0.05 91.15
01:18:01 AM 1 3.03 0.00 0.25 0.00 0.05 96.67
01:19:01 AM all 4.30 0.00 0.17 0.00 0.06 95.47
01:19:01 AM 0 6.72 0.00 0.20 0.00 0.07 93.01
01:19:01 AM 1 1.89 0.00 0.13 0.00 0.05 97.93
01:20:01 AM all 4.34 0.00 0.19 0.00 0.06 95.40
01:20:01 AM 0 5.95 0.00 0.22 0.00 0.07 93.77
01:20:01 AM 1 2.74 0.00 0.17 0.00 0.05 97.04
01:21:01 AM all 4.42 0.00 0.20 0.00 0.06 95.32
01:21:01 AM 0 4.58 0.00 0.20 0.00 0.07 95.15
01:21:01 AM 1 4.26 0.00 0.20 0.00 0.05 95.48
01:22:01 AM all 4.37 0.00 0.21 0.00 0.06 95.36
01:22:01 AM 0 5.84 0.00 0.23 0.00 0.07 93.86
01:22:01 AM 1 2.91 0.00 0.18 0.00 0.05 96.86
01:23:01 AM all 4.46 0.00 0.18 0.00 0.06 95.29
01:23:01 AM 0 5.45 0.00 0.17 0.00 0.07 94.32
01:23:01 AM 1 3.48 0.00 0.20 0.00 0.05 96.27
01:24:01 AM all 5.39 0.00 0.36 0.00 0.05 94.20
01:24:01 AM 0 3.13 0.00 0.20 0.00 0.05 96.62
01:24:01 AM 1 7.77 0.00 0.53 0.00 0.05 91.65
01:25:01 AM all 5.37 0.00 0.52 0.00 0.07 94.04
01:25:01 AM 0 6.26 0.00 0.65 0.00 0.07 93.02
01:25:01 AM 1 4.47 0.00 0.39 0.00 0.07 95.08
01:26:01 AM all 7.20 0.16 0.58 0.00 0.05 92.01
01:26:01 AM 0 10.78 0.02 0.78 0.00 0.07 88.36
01:26:01 AM 1 3.64 0.30 0.39 0.00 0.03 95.64
01:27:01 AM all 4.46 0.00 0.38 0.01 0.06 95.09
01:27:01 AM 0 6.15 0.00 0.42 0.02 0.05 93.36
01:27:01 AM 1 2.76 0.00 0.35 0.00 0.07 96.82
01:28:01 AM all 2.11 0.00 0.31 0.00 0.07 97.52
01:28:01 AM 0 2.66 0.00 0.42 0.00 0.07 96.86
01:28:01 AM 1 1.56 0.00 0.20 0.00 0.07 98.18
01:28:01 AM CPU %user %nice %system %iowait %steal %idle
01:29:01 AM all 0.82 0.00 0.18 0.00 0.05 98.96
01:29:01 AM 0 0.77 0.00 0.20 0.00 0.05 98.98
01:29:01 AM 1 0.87 0.00 0.15 0.00 0.05 98.93
01:30:01 AM all 1.85 0.00 0.28 0.00 0.05 97.82
01:30:01 AM 0 2.34 0.00 0.33 0.00 0.05 97.28
01:30:01 AM 1 1.35 0.00 0.23 0.00 0.05 98.36
01:31:01 AM all 3.22 0.00 0.39 0.01 0.04 96.34
01:31:01 AM 0 4.76 0.00 0.55 0.00 0.05 94.64
01:31:01 AM 1 1.67 0.00 0.23 0.02 0.03 98.04
01:32:01 AM all 4.25 0.00 0.42 0.00 0.07 95.27
01:32:01 AM 0 7.71 0.00 0.72 0.00 0.07 91.51
01:32:01 AM 1 0.79 0.00 0.12 0.00 0.07 99.03
01:33:01 AM all 0.32 0.00 0.07 0.00 0.02 99.60
01:33:01 AM 0 0.13 0.00 0.08 0.00 0.02 99.77
01:33:01 AM 1 0.50 0.00 0.05 0.00 0.02 99.43
01:34:01 AM all 0.33 0.00 0.06 0.00 0.03 99.57
01:34:01 AM 0 0.12 0.00 0.10 0.00 0.03 99.75
01:34:01 AM 1 0.55 0.00 0.02 0.00 0.03 99.40
01:35:01 AM all 0.30 0.00 0.08 0.01 0.04 99.57
01:35:01 AM 0 0.10 0.00 0.08 0.02 0.05 99.75
01:35:01 AM 1 0.50 0.00 0.08 0.00 0.03 99.38
01:36:01 AM all 0.14 0.00 0.08 0.00 0.03 99.76
01:36:01 AM 0 0.10 0.00 0.07 0.00 0.02 99.82
01:36:01 AM 1 0.18 0.00 0.08 0.00 0.03 99.70
01:37:01 AM all 0.33 0.00 0.07 0.00 0.04 99.56
01:37:01 AM 0 0.10 0.00 0.08 0.00 0.05 99.77
01:37:01 AM 1 0.57 0.00 0.05 0.00 0.03 99.35
01:38:01 AM all 2.87 0.00 0.18 0.00 0.05 96.90
01:38:01 AM 0 2.81 0.00 0.18 0.00 0.05 96.96
01:38:01 AM 1 2.94 0.00 0.17 0.00 0.05 96.84
01:39:01 AM all 4.36 0.00 0.20 0.00 0.06 95.38
01:39:01 AM 0 4.51 0.00 0.18 0.00 0.05 95.25
01:39:01 AM 1 4.22 0.00 0.22 0.00 0.07 95.50
01:39:01 AM CPU %user %nice %system %iowait %steal %idle
01:40:01 AM all 4.46 0.00 0.20 0.00 0.07 95.28
01:40:01 AM 0 3.81 0.00 0.18 0.00 0.07 95.94
01:40:01 AM 1 5.10 0.00 0.22 0.00 0.07 94.61
01:41:01 AM all 4.42 0.00 0.19 0.00 0.05 95.34
01:41:01 AM 0 7.24 0.00 0.23 0.00 0.07 92.46
01:41:01 AM 1 1.61 0.00 0.15 0.00 0.03 98.21
01:42:01 AM all 4.52 0.00 0.21 0.00 0.04 95.23
01:42:01 AM 0 5.31 0.00 0.23 0.00 0.03 94.42
01:42:01 AM 1 3.73 0.00 0.18 0.00 0.05 96.03
01:43:01 AM all 4.37 0.00 0.19 0.00 0.07 95.37
01:43:01 AM 0 7.05 0.00 0.25 0.00 0.07 92.63
01:43:01 AM 1 1.69 0.00 0.13 0.00 0.07 98.11
01:44:01 AM all 5.96 0.00 0.38 0.00 0.07 93.60
01:44:01 AM 0 10.75 0.00 0.61 0.00 0.09 88.55
01:44:01 AM 1 1.25 0.00 0.15 0.00 0.05 98.55
01:45:01 AM all 4.53 0.00 0.46 0.00 0.06 94.95
01:45:01 AM 0 5.64 0.00 0.50 0.00 0.05 93.81
01:45:01 AM 1 3.43 0.00 0.42 0.00 0.07 96.09
01:46:01 AM all 5.56 0.00 0.42 0.03 0.06 93.94
01:46:01 AM 0 7.87 0.00 0.57 0.00 0.07 91.49
01:46:01 AM 1 3.24 0.00 0.27 0.05 0.05 96.39
01:47:01 AM all 4.37 0.00 0.33 0.00 0.06 95.24
01:47:01 AM 0 7.07 0.00 0.50 0.00 0.07 92.36
01:47:01 AM 1 1.67 0.00 0.15 0.00 0.05 98.13
01:48:01 AM all 4.52 0.00 0.34 0.00 0.06 95.08
01:48:01 AM 0 5.98 0.00 0.42 0.00 0.07 93.53
01:48:01 AM 1 3.06 0.00 0.27 0.00 0.05 96.62
01:49:01 AM all 4.45 0.00 0.33 0.00 0.07 95.16
01:49:01 AM 0 5.95 0.00 0.38 0.00 0.07 93.60
01:49:01 AM 1 2.94 0.00 0.27 0.00 0.07 96.72
01:50:01 AM all 4.36 0.00 0.33 0.00 0.06 95.25
01:50:01 AM 0 2.49 0.00 0.23 0.00 0.05 97.23
01:50:01 AM 1 6.23 0.00 0.44 0.00 0.07 93.27
01:50:01 AM CPU %user %nice %system %iowait %steal %idle
01:51:01 AM all 4.30 0.00 0.33 0.00 0.06 95.32
01:51:01 AM 0 6.32 0.00 0.43 0.00 0.07 93.18
01:51:01 AM 1 2.28 0.00 0.22 0.00 0.05 97.46
01:52:01 AM all 5.83 0.00 0.34 0.00 0.07 93.76
01:52:01 AM 0 8.98 0.00 0.45 0.00 0.08 90.48
01:52:01 AM 1 2.67 0.00 0.23 0.00 0.05 97.04
01:53:01 AM all 0.60 0.00 0.10 0.00 0.08 99.22
01:53:01 AM 0 0.67 0.00 0.08 0.00 0.07 99.18
01:53:01 AM 1 0.53 0.00 0.12 0.00 0.08 99.26
01:54:01 AM all 0.63 0.00 0.11 0.00 0.04 99.22
01:54:01 AM 0 0.73 0.00 0.12 0.00 0.03 99.12
01:54:01 AM 1 0.53 0.00 0.10 0.00 0.05 99.31
01:55:01 AM all 0.55 0.00 0.12 0.00 0.04 99.29
01:55:01 AM 0 0.65 0.00 0.10 0.00 0.03 99.22
01:55:01 AM 1 0.45 0.00 0.13 0.00 0.05 99.36
01:56:01 AM all 0.61 0.00 0.09 0.00 0.06 99.24
01:56:01 AM 0 0.65 0.00 0.07 0.00 0.03 99.25
01:56:01 AM 1 0.57 0.00 0.12 0.00 0.08 99.23
01:57:01 AM all 0.55 0.00 0.11 0.00 0.04 99.30
01:57:01 AM 0 0.62 0.00 0.08 0.00 0.03 99.27
01:57:01 AM 1 0.48 0.00 0.13 0.00 0.05 99.33
01:58:01 AM all 3.82 0.00 0.23 0.00 0.06 95.90
01:58:01 AM 0 6.16 0.00 0.23 0.00 0.05 93.55
01:58:01 AM 1 1.47 0.00 0.22 0.00 0.07 98.24
01:59:01 AM all 4.43 0.00 0.17 0.00 0.06 95.34
01:59:01 AM 0 4.03 0.00 0.17 0.00 0.07 95.74
01:59:01 AM 1 4.84 0.00 0.17 0.00 0.05 94.95
02:00:01 AM all 4.39 0.00 0.19 0.01 0.07 95.34
02:00:01 AM 0 6.22 0.00 0.22 0.00 0.07 93.49
02:00:01 AM 1 2.56 0.00 0.17 0.02 0.07 97.19
02:01:01 AM all 4.56 0.00 0.22 0.00 0.06 95.16
02:01:01 AM 0 5.74 0.00 0.23 0.00 0.07 93.95
02:01:01 AM 1 3.38 0.00 0.20 0.00 0.05 96.37
02:01:01 AM CPU %user %nice %system %iowait %steal %idle
02:02:01 AM all 4.51 0.00 0.20 0.00 0.07 95.22
02:02:01 AM 0 5.04 0.00 0.20 0.00 0.07 94.69
02:02:01 AM 1 3.98 0.00 0.20 0.00 0.07 95.75
02:03:01 AM all 4.43 0.00 0.18 0.00 0.06 95.33
02:03:01 AM 0 6.52 0.00 0.20 0.00 0.07 93.21
02:03:01 AM 1 2.34 0.00 0.17 0.00 0.05 97.44
02:04:01 AM all 5.22 0.00 0.26 0.00 0.05 94.47
02:04:01 AM 0 8.61 0.00 0.37 0.00 0.07 90.95
02:04:01 AM 1 1.89 0.00 0.15 0.00 0.03 97.93
02:05:01 AM all 5.11 0.00 0.27 0.00 0.07 94.55
02:05:01 AM 0 6.63 0.00 0.35 0.00 0.05 92.97
02:05:01 AM 1 3.61 0.00 0.18 0.00 0.08 96.12
02:06:01 AM all 4.50 0.00 0.20 0.00 0.07 95.23
02:06:01 AM 0 7.35 0.00 0.25 0.00 0.08 92.31
02:06:01 AM 1 1.64 0.00 0.15 0.00 0.05 98.16
02:07:02 AM all 4.52 0.00 0.23 0.00 0.08 95.18
02:07:02 AM 0 6.01 0.00 0.22 0.00 0.08 93.69
02:07:02 AM 1 3.03 0.00 0.23 0.00 0.07 96.67
02:08:01 AM all 4.68 0.00 0.20 0.00 0.08 95.04
02:08:01 AM 0 5.93 0.00 0.22 0.00 0.07 93.78
02:08:01 AM 1 3.42 0.00 0.19 0.00 0.09 96.31
02:09:01 AM all 4.51 0.00 0.18 0.00 0.06 95.25
02:09:01 AM 0 6.39 0.00 0.22 0.00 0.07 93.33
02:09:01 AM 1 2.62 0.00 0.15 0.00 0.05 97.17
02:10:01 AM all 4.32 0.00 0.18 0.00 0.06 95.45
02:10:01 AM 0 5.90 0.00 0.18 0.00 0.07 93.85
02:10:01 AM 1 2.73 0.00 0.17 0.00 0.05 97.05
02:11:01 AM all 5.41 0.00 0.36 0.00 0.07 94.16
02:11:01 AM 0 7.86 0.00 0.47 0.00 0.08 91.59
02:11:01 AM 1 2.96 0.00 0.25 0.00 0.05 96.74
02:12:01 AM all 4.33 0.00 0.38 0.00 0.05 95.24
02:12:01 AM 0 5.15 0.00 0.48 0.00 0.05 94.32
02:12:01 AM 1 3.51 0.00 0.27 0.00 0.05 96.17
02:12:01 AM CPU %user %nice %system %iowait %steal %idle
02:13:01 AM all 4.40 0.00 0.34 0.00 0.06 95.20
02:13:01 AM 0 5.83 0.00 0.43 0.00 0.07 93.67
02:13:01 AM 1 2.96 0.00 0.25 0.00 0.05 96.74
02:14:01 AM all 4.39 0.00 0.36 0.00 0.07 95.19
02:14:01 AM 0 6.32 0.00 0.47 0.00 0.07 93.14
02:14:01 AM 1 2.46 0.00 0.25 0.00 0.07 97.23
02:15:01 AM all 4.45 0.00 0.35 0.00 0.06 95.14
02:15:01 AM 0 5.18 0.00 0.40 0.00 0.07 94.35
02:15:01 AM 1 3.71 0.00 0.30 0.00 0.05 95.94
02:16:01 AM all 4.42 0.00 0.33 0.00 0.07 95.18
02:16:01 AM 0 4.76 0.00 0.35 0.00 0.07 94.82
02:16:01 AM 1 4.08 0.00 0.32 0.00 0.07 95.53
02:17:01 AM all 5.95 0.00 0.38 0.00 0.06 93.62
02:17:01 AM 0 6.38 0.00 0.40 0.00 0.07 93.15
02:17:01 AM 1 5.52 0.00 0.35 0.00 0.05 94.08
02:18:01 AM all 0.57 0.00 0.09 0.00 0.05 99.29
02:18:01 AM 0 0.56 0.00 0.10 0.00 0.07 99.27
02:18:01 AM 1 0.58 0.00 0.07 0.00 0.04 99.31
02:19:01 AM all 0.50 0.00 0.10 0.00 0.04 99.36
02:19:01 AM 0 0.53 0.00 0.10 0.00 0.05 99.32
02:19:01 AM 1 0.47 0.00 0.10 0.00 0.03 99.40
02:20:01 AM all 0.59 0.00 0.10 0.00 0.06 99.25
02:20:01 AM 0 0.58 0.00 0.15 0.00 0.07 99.20
02:20:01 AM 1 0.60 0.00 0.05 0.00 0.05 99.30
02:21:01 AM all 0.60 0.00 0.11 0.00 0.03 99.26
02:21:01 AM 0 0.57 0.00 0.12 0.00 0.03 99.28
02:21:01 AM 1 0.63 0.00 0.10 0.00 0.03 99.23
02:22:01 AM all 0.62 0.00 0.09 0.00 0.05 99.24
02:22:01 AM 0 0.55 0.00 0.08 0.00 0.05 99.32
02:22:01 AM 1 0.68 0.00 0.10 0.00 0.05 99.16
02:23:01 AM all 4.72 0.00 0.51 0.00 0.06 94.71
02:23:01 AM 0 4.75 0.00 0.49 0.00 0.07 94.70
02:23:01 AM 1 4.68 0.00 0.54 0.00 0.05 94.73
02:23:01 AM CPU %user %nice %system %iowait %steal %idle
02:24:01 AM all 4.28 0.00 0.35 0.00 0.06 95.31
02:24:01 AM 0 4.56 0.00 0.38 0.00 0.07 94.99
02:24:01 AM 1 4.00 0.00 0.32 0.00 0.05 95.63
02:25:01 AM all 4.45 0.00 0.35 0.00 0.05 95.14
02:25:01 AM 0 4.41 0.00 0.37 0.00 0.05 95.17
02:25:01 AM 1 4.50 0.00 0.33 0.00 0.05 95.12
02:26:01 AM all 4.29 0.00 0.36 0.00 0.05 95.30
02:26:01 AM 0 3.92 0.00 0.33 0.00 0.05 95.70
02:26:01 AM 1 4.67 0.00 0.38 0.00 0.05 94.90
02:27:01 AM all 4.35 0.00 0.35 0.00 0.07 95.23
02:27:01 AM 0 4.89 0.00 0.38 0.00 0.07 94.66
02:27:01 AM 1 3.81 0.00 0.32 0.00 0.07 95.80
02:28:01 AM all 4.32 0.00 0.33 0.00 0.06 95.29
02:28:01 AM 0 2.96 0.00 0.25 0.00 0.05 96.74
02:28:01 AM 1 5.67 0.00 0.42 0.00 0.07 93.84
02:29:01 AM all 5.77 0.00 0.38 0.00 0.06 93.80
02:29:01 AM 0 8.84 0.00 0.47 0.00 0.07 90.62
02:29:01 AM 1 2.69 0.00 0.28 0.00 0.05 96.97
02:30:01 AM all 2.69 0.00 0.22 0.01 0.05 97.03
02:30:01 AM 0 3.78 0.00 0.23 0.02 0.03 95.94
02:30:01 AM 1 1.61 0.00 0.20 0.00 0.07 98.13
02:31:01 AM all 0.49 0.00 0.09 0.00 0.06 99.36
02:31:01 AM 0 0.57 0.00 0.05 0.00 0.05 99.33
02:31:01 AM 1 0.42 0.00 0.13 0.00 0.07 99.38
02:32:01 AM all 0.56 0.00 0.11 0.00 0.03 99.30
02:32:01 AM 0 0.50 0.00 0.08 0.00 0.02 99.40
02:32:01 AM 1 0.62 0.00 0.13 0.00 0.05 99.20
02:33:01 AM all 0.43 0.00 0.10 0.00 0.06 99.41
02:33:01 AM 0 0.27 0.00 0.10 0.00 0.05 99.58
02:33:01 AM 1 0.59 0.00 0.10 0.00 0.07 99.25
02:34:01 AM all 0.60 0.00 0.10 0.00 0.05 99.25
02:34:01 AM 0 0.63 0.00 0.08 0.00 0.03 99.25
02:34:01 AM 1 0.57 0.00 0.12 0.00 0.07 99.25
02:34:01 AM CPU %user %nice %system %iowait %steal %idle
02:35:01 AM all 0.59 0.00 0.08 0.01 0.05 99.27
02:35:01 AM 0 0.63 0.00 0.08 0.00 0.05 99.23
02:35:01 AM 1 0.55 0.00 0.08 0.02 0.05 99.30
02:36:01 AM all 7.01 0.00 0.65 0.00 0.07 92.27
02:36:01 AM 0 9.07 0.00 0.84 0.00 0.07 90.02
02:36:01 AM 1 4.96 0.00 0.47 0.00 0.07 94.51
02:37:01 AM all 4.30 0.00 0.32 0.00 0.06 95.32
02:37:01 AM 0 2.82 0.00 0.25 0.00 0.07 96.86
02:37:01 AM 1 5.79 0.00 0.38 0.00 0.05 93.78
02:38:01 AM all 4.43 0.00 0.37 0.00 0.06 95.14
02:38:01 AM 0 2.30 0.00 0.23 0.00 0.05 97.41
02:38:01 AM 1 6.56 0.00 0.50 0.00 0.07 92.87
02:39:01 AM all 4.39 0.00 0.34 0.00 0.06 95.21
02:39:01 AM 0 1.99 0.00 0.23 0.00 0.05 97.73
02:39:01 AM 1 6.79 0.00 0.45 0.00 0.07 92.69
02:40:01 AM all 4.40 0.15 0.39 0.24 0.08 94.73
02:40:01 AM 0 5.30 0.27 0.45 0.49 0.05 93.44
02:40:01 AM 1 3.50 0.03 0.33 0.00 0.12 96.02
02:41:01 AM all 4.40 0.00 0.35 0.00 0.06 95.19
02:41:01 AM 0 3.74 0.00 0.30 0.00 0.07 95.89
02:41:01 AM 1 5.05 0.00 0.40 0.00 0.05 94.50
02:42:01 AM all 5.73 0.00 0.36 0.06 0.07 93.79
02:42:01 AM 0 3.39 0.00 0.27 0.12 0.08 96.14
02:42:01 AM 1 8.07 0.00 0.45 0.00 0.05 91.43
02:43:01 AM all 0.52 0.00 0.08 0.00 0.05 99.36
02:43:01 AM 0 0.45 0.00 0.07 0.00 0.03 99.45
02:43:01 AM 1 0.59 0.00 0.08 0.00 0.07 99.26
02:44:01 AM all 0.51 0.00 0.09 0.00 0.04 99.36
02:44:01 AM 0 0.58 0.00 0.08 0.00 0.03 99.30
02:44:01 AM 1 0.43 0.00 0.10 0.00 0.05 99.41
02:45:01 AM all 0.56 0.00 0.12 0.02 0.05 99.26
02:45:01 AM 0 0.48 0.00 0.12 0.03 0.07 99.30
02:45:01 AM 1 0.63 0.00 0.12 0.00 0.03 99.21
02:45:01 AM CPU %user %nice %system %iowait %steal %idle
02:46:01 AM all 0.59 0.00 0.10 0.00 0.03 99.27
02:46:01 AM 0 0.48 0.00 0.12 0.00 0.03 99.36
02:46:01 AM 1 0.70 0.00 0.08 0.00 0.03 99.18
02:47:01 AM all 0.57 0.00 0.10 0.00 0.04 99.29
02:47:01 AM 0 0.40 0.00 0.10 0.00 0.03 99.47
02:47:01 AM 1 0.73 0.00 0.10 0.00 0.05 99.11
02:48:01 AM all 2.21 0.00 0.29 0.00 0.05 97.45
02:48:01 AM 0 1.25 0.00 0.17 0.00 0.07 98.51
02:48:01 AM 1 3.17 0.00 0.42 0.00 0.03 96.38
02:49:01 AM all 2.99 0.00 0.28 0.00 0.05 96.68
02:49:01 AM 0 3.31 0.00 0.30 0.00 0.07 96.32
02:49:01 AM 1 2.68 0.00 0.25 0.00 0.03 97.04
02:50:01 AM all 4.46 0.00 0.37 0.00 0.06 95.12
02:50:01 AM 0 6.86 0.00 0.50 0.00 0.07 92.58
02:50:01 AM 1 2.06 0.00 0.23 0.00 0.05 97.66
02:51:01 AM all 4.55 0.00 0.37 0.00 0.04 95.04
02:51:01 AM 0 6.67 0.00 0.48 0.00 0.05 92.79
02:51:01 AM 1 2.42 0.00 0.25 0.00 0.03 97.29
02:52:01 AM all 4.42 0.00 0.31 0.00 0.03 95.24
02:52:01 AM 0 4.50 0.00 0.32 0.00 0.03 95.15
02:52:01 AM 1 4.33 0.00 0.30 0.00 0.03 95.33
02:53:01 AM all 4.57 0.00 0.39 0.00 0.08 94.96
02:53:01 AM 0 6.91 0.00 0.49 0.00 0.08 92.52
02:53:01 AM 1 2.24 0.00 0.30 0.00 0.07 97.39
02:54:01 AM all 4.74 0.00 0.38 0.00 0.07 94.81
02:54:01 AM 0 6.79 0.00 0.43 0.00 0.07 92.71
02:54:01 AM 1 2.69 0.00 0.33 0.00 0.07 96.91
02:55:01 AM all 7.81 0.00 0.49 0.00 0.08 91.62
02:55:01 AM 0 12.40 0.00 0.69 0.00 0.08 86.83
02:55:01 AM 1 3.23 0.00 0.30 0.00 0.07 96.40
02:56:01 AM all 0.73 0.00 0.13 0.00 0.05 99.10
02:56:01 AM 0 0.67 0.00 0.15 0.00 0.07 99.11
02:56:01 AM 1 0.79 0.00 0.10 0.00 0.03 99.08
02:56:01 AM CPU %user %nice %system %iowait %steal %idle
02:57:01 AM all 0.71 0.00 0.14 0.01 0.05 99.09
02:57:01 AM 0 0.68 0.00 0.15 0.02 0.03 99.12
02:57:01 AM 1 0.74 0.00 0.13 0.00 0.07 99.06
02:58:01 AM all 0.65 0.00 0.07 0.00 0.03 99.25
02:58:01 AM 0 0.75 0.00 0.05 0.00 0.02 99.18
02:58:01 AM 1 0.55 0.00 0.08 0.00 0.05 99.31
02:59:01 AM all 0.61 0.00 0.10 0.00 0.07 99.22
02:59:01 AM 0 0.52 0.00 0.12 0.00 0.07 99.30
02:59:01 AM 1 0.70 0.00 0.08 0.00 0.07 99.15
03:00:01 AM all 0.63 0.00 0.10 0.00 0.03 99.25
03:00:01 AM 0 0.42 0.00 0.12 0.00 0.03 99.43
03:00:01 AM 1 0.84 0.00 0.08 0.00 0.02 99.06
03:01:01 AM all 0.65 0.00 0.17 0.02 0.06 99.10
03:01:01 AM 0 0.84 0.00 0.18 0.03 0.07 98.88
03:01:01 AM 1 0.47 0.00 0.15 0.00 0.05 99.33
03:02:01 AM all 27.02 0.00 2.95 0.04 0.09 69.90
03:02:01 AM 0 19.88 0.00 3.32 0.02 0.08 76.70
03:02:01 AM 1 34.13 0.00 2.58 0.07 0.10 63.12
03:03:01 AM all 28.80 0.00 3.65 1.04 0.10 66.41
03:03:01 AM 0 36.11 0.00 4.25 0.57 0.10 58.97
03:03:01 AM 1 21.52 0.00 3.05 1.52 0.10 73.81
Average: all 3.77 0.00 0.29 0.01 0.06 95.87
Average: 0 4.18 0.00 0.31 0.01 0.06 95.44
Average: 1 3.36 0.00 0.27 0.01 0.06 96.31