Started by upstream project "integration-distribution-mri-test-calcium" build number 78
originally caused by:
Started by timer
Running as SYSTEM
[EnvInject] - Loading node environment variables.
Building remotely on prd-centos8-robot-2c-8g-5937 (centos8-robot-2c-8g) in workspace /w/workspace/controller-csit-3node-clustering-tell-all-calcium
[ssh-agent] Looking for ssh-agent implementation...
[ssh-agent] Exec ssh-agent (binary ssh-agent on a remote machine)
$ ssh-agent
SSH_AUTH_SOCK=/tmp/ssh-F6NcIBWr5jWX/agent.5167
SSH_AGENT_PID=5168
[ssh-agent] Started.
Running ssh-add (command line suppressed)
Identity added: /w/workspace/controller-csit-3node-clustering-tell-all-calcium@tmp/private_key_6435305192901130259.key (/w/workspace/controller-csit-3node-clustering-tell-all-calcium@tmp/private_key_6435305192901130259.key)
[ssh-agent] Using credentials jenkins (Release Engineering Jenkins Key)
The recommended git tool is: NONE
using credential opendaylight-jenkins-ssh
Wiping out workspace first.
Cloning the remote Git repository
Cloning repository git://devvexx.opendaylight.org/mirror/integration/test
> git init /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test # timeout=10
Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test
> git --version # timeout=10
> git --version # 'git version 2.43.0'
using GIT_SSH to set credentials Release Engineering Jenkins Key
[INFO] Currently running in a labeled security context
[INFO] Currently SELinux is 'enforcing' on the host
> /usr/bin/chcon --type=ssh_home_t /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test@tmp/jenkins-gitclient-ssh1642615107034777531.key
Verifying host key using known hosts file
You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification.
> git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10
Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test
using GIT_SSH to set credentials Release Engineering Jenkins Key
[INFO] Currently running in a labeled security context
[INFO] Currently SELinux is 'enforcing' on the host
> /usr/bin/chcon --type=ssh_home_t /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test@tmp/jenkins-gitclient-ssh9534158159228091675.key
Verifying host key using known hosts file
You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification.
> git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test master # timeout=10
> git rev-parse FETCH_HEAD^{commit} # timeout=10
Checking out Revision 1d2a1a30bcc48e3c8d571eb0d9b6891fe29dfed4 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 1d2a1a30bcc48e3c8d571eb0d9b6891fe29dfed4 # timeout=10
Commit message: "Add bgpcep variables for titanium"
> git rev-parse FETCH_HEAD^{commit} # timeout=10
> git rev-list --no-walk d42b2c24fe4fcc7fe3ae0d352311e768f07a15b7 # timeout=10
No emails were triggered.
provisioning config files...
copy managed file [npmrc] to file:/home/jenkins/.npmrc
copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf
copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
[controller-csit-3node-clustering-tell-all-calcium] $ /bin/bash /tmp/jenkins14376114364536750440.sh
---> python-tools-install.sh
Setup pyenv:
system
* 3.8.13 (set by /opt/pyenv/version)
* 3.9.13 (set by /opt/pyenv/version)
* 3.10.13 (set by /opt/pyenv/version)
* 3.11.7 (set by /opt/pyenv/version)
lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-38GL
lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: lftools
lf-activate-venv(): INFO: Adding /tmp/venv-38GL/bin to PATH
Generating Requirements File
Python 3.11.7
pip 25.0.1 from /tmp/venv-38GL/lib/python3.11/site-packages/pip (python 3.11)
appdirs==1.4.4
argcomplete==3.6.0
aspy.yaml==1.3.0
attrs==25.1.0
autopage==0.5.2
beautifulsoup4==4.13.3
boto3==1.37.9
botocore==1.37.9
bs4==0.0.2
cachetools==5.5.2
certifi==2025.1.31
cffi==1.17.1
cfgv==3.4.0
chardet==5.2.0
charset-normalizer==3.4.1
click==8.1.8
cliff==4.9.1
cmd2==2.5.11
cryptography==3.3.2
debtcollector==3.0.0
decorator==5.2.1
defusedxml==0.7.1
Deprecated==1.2.18
distlib==0.3.9
dnspython==2.7.0
docker==4.2.2
dogpile.cache==1.3.4
durationpy==0.9
email_validator==2.2.0
filelock==3.17.0
future==1.0.0
gitdb==4.0.12
GitPython==3.1.44
google-auth==2.38.0
httplib2==0.22.0
identify==2.6.9
idna==3.10
importlib-resources==1.5.0
iso8601==2.1.0
Jinja2==3.1.6
jmespath==1.0.1
jsonpatch==1.33
jsonpointer==3.0.0
jsonschema==4.23.0
jsonschema-specifications==2024.10.1
keystoneauth1==5.10.0
kubernetes==32.0.1
lftools==0.37.10
lxml==5.3.1
MarkupSafe==3.0.2
msgpack==1.1.0
multi_key_dict==2.0.3
munch==4.0.0
netaddr==1.3.0
niet==1.4.2
nodeenv==1.9.1
oauth2client==4.1.3
oauthlib==3.2.2
openstacksdk==4.4.0
os-client-config==2.1.0
os-service-types==1.7.0
osc-lib==3.2.0
oslo.config==9.7.1
oslo.context==5.7.1
oslo.i18n==6.5.1
oslo.log==7.1.0
oslo.serialization==5.7.0
oslo.utils==8.2.0
packaging==24.2
pbr==6.1.1
platformdirs==4.3.6
prettytable==3.15.1
psutil==7.0.0
pyasn1==0.6.1
pyasn1_modules==0.4.1
pycparser==2.22
pygerrit2==2.0.15
PyGithub==2.6.1
PyJWT==2.10.1
PyNaCl==1.5.0
pyparsing==2.4.7
pyperclip==1.9.0
pyrsistent==0.20.0
python-cinderclient==9.7.0
python-dateutil==2.9.0.post0
python-heatclient==4.1.0
python-jenkins==1.8.2
python-keystoneclient==5.6.0
python-magnumclient==4.8.1
python-openstackclient==7.4.0
python-swiftclient==4.7.0
PyYAML==6.0.2
referencing==0.36.2
requests==2.32.3
requests-oauthlib==2.0.0
requestsexceptions==1.4.0
rfc3986==2.0.0
rpds-py==0.23.1
rsa==4.9
ruamel.yaml==0.18.10
ruamel.yaml.clib==0.2.12
s3transfer==0.11.4
simplejson==3.20.1
six==1.17.0
smmap==5.0.2
soupsieve==2.6
stevedore==5.4.1
tabulate==0.9.0
toml==0.10.2
tomlkit==0.13.2
tqdm==4.67.1
typing_extensions==4.12.2
tzdata==2025.1
urllib3==1.26.20
virtualenv==20.29.3
wcwidth==0.2.13
websocket-client==1.8.0
wrapt==1.17.2
xdg==6.0.0
xmltodict==0.14.2
yq==3.4.3
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties content
OS_STACK_TEMPLATE=csit-2-instance-type.yaml
OS_CLOUD=vex
OS_STACK_NAME=releng-controller-csit-3node-clustering-tell-all-calcium-78
OS_STACK_TEMPLATE_DIR=openstack-hot
[EnvInject] - Variables injected successfully.
provisioning config files...
copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
[controller-csit-3node-clustering-tell-all-calcium] $ /bin/bash /tmp/jenkins4259275252550195975.sh
---> Create parameters file for OpenStack HOT
OpenStack Heat parameters generated
-----------------------------------
parameters:
vm_0_count: '3'
vm_0_flavor: 'v3-standard-4'
vm_0_image: 'ZZCI - Ubuntu 20.04 - builder - x86_64 - 20250101-160150.998'
vm_1_count: '0'
vm_1_flavor: 'v3-standard-2'
vm_1_image: 'ZZCI - Ubuntu 22.04 - mininet-ovs-217 - x86_64 - 20250201-060151.911'
job_name: '28865-78'
silo: 'releng'
[controller-csit-3node-clustering-tell-all-calcium] $ /bin/bash -l /tmp/jenkins60762270093050945.sh
---> Create HEAT stack
+ source /home/jenkins/lf-env.sh
+ lf-activate-venv --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
++ mktemp -d /tmp/venv-XXXX
+ lf_venv=/tmp/venv-h8oi
+ local venv_file=/tmp/.os_lf_venv
+ local python=python3
+ local options
+ local set_path=true
+ local install_args=
++ getopt -o np:v: -l no-path,system-site-packages,python:,venv-file: -n lf-activate-venv -- --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
+ options=' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\'''
+ eval set -- ' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\'''
++ set -- --python python3 -- 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
+ true
+ case $1 in
+ python=python3
+ shift 2
+ true
+ case $1 in
+ shift
+ break
+ case $python in
+ local pkg_list=
+ [[ -d /opt/pyenv ]]
+ echo 'Setup pyenv:'
Setup pyenv:
+ export PYENV_ROOT=/opt/pyenv
+ PYENV_ROOT=/opt/pyenv
+ export PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
+ PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
+ pyenv versions
system
3.8.13
3.9.13
3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-calcium/.python-version)
+ command -v pyenv
++ pyenv init - --no-rehash
+ eval 'PATH="$(bash --norc -ec '\''IFS=:; paths=($PATH);
for i in ${!paths[@]}; do
if [[ ${paths[i]} == "'\'''\''/opt/pyenv/shims'\'''\''" ]]; then unset '\''\'\'''\''paths[i]'\''\'\'''\'';
fi; done;
echo "${paths[*]}"'\'')"
export PATH="/opt/pyenv/shims:${PATH}"
export PYENV_SHELL=bash
source '\''/opt/pyenv/libexec/../completions/pyenv.bash'\''
pyenv() {
local command
command="${1:-}"
if [ "$#" -gt 0 ]; then
shift
fi
case "$command" in
rehash|shell)
eval "$(pyenv "sh-$command" "$@")"
;;
*)
command pyenv "$command" "$@"
;;
esac
}'
+++ bash --norc -ec 'IFS=:; paths=($PATH);
for i in ${!paths[@]}; do
if [[ ${paths[i]} == "/opt/pyenv/shims" ]]; then unset '\''paths[i]'\'';
fi; done;
echo "${paths[*]}"'
++ PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
++ export PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
++ PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
++ export PYENV_SHELL=bash
++ PYENV_SHELL=bash
++ source /opt/pyenv/libexec/../completions/pyenv.bash
+++ complete -F _pyenv pyenv
++ lf-pyver python3
++ local py_version_xy=python3
++ local py_version_xyz=
++ awk '{ print $1 }'
++ pyenv versions
++ local command
++ command=versions
++ '[' 1 -gt 0 ']'
++ shift
++ case "$command" in
++ command pyenv versions
++ pyenv versions
++ sed 's/^[ *]* //'
++ grep -E '^[0-9.]*[0-9]$'
++ [[ ! -s /tmp/.pyenv_versions ]]
+++ tail -n 1
+++ grep '^3' /tmp/.pyenv_versions
+++ sort -V
++ py_version_xyz=3.11.7
++ [[ -z 3.11.7 ]]
++ echo 3.11.7
++ return 0
+ pyenv local 3.11.7
+ local command
+ command=local
+ '[' 2 -gt 0 ']'
+ shift
+ case "$command" in
+ command pyenv local 3.11.7
+ pyenv local 3.11.7
+ for arg in "$@"
+ case $arg in
+ pkg_list+='lftools[openstack] '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='kubernetes '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='niet '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='python-heatclient '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='python-openstackclient '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='python-magnumclient '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='yq '
+ [[ -f /tmp/.os_lf_venv ]]
++ cat /tmp/.os_lf_venv
+ lf_venv=/tmp/venv-38GL
+ echo 'lf-activate-venv(): INFO: Reuse venv:/tmp/venv-38GL from' file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-38GL from file:/tmp/.os_lf_venv
+ /tmp/venv-38GL/bin/python3 -m pip install --upgrade --quiet pip virtualenv
+ [[ -z lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq ]]
+ echo 'lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq '
lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
+ /tmp/venv-38GL/bin/python3 -m pip install --upgrade --quiet --upgrade-strategy eager 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
+ type python3
+ true
+ echo 'lf-activate-venv(): INFO: Adding /tmp/venv-38GL/bin to PATH'
lf-activate-venv(): INFO: Adding /tmp/venv-38GL/bin to PATH
+ PATH=/tmp/venv-38GL/bin:/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
+ return 0
+ openstack --os-cloud vex limits show --absolute
+--------------------------+---------+
| Name | Value |
+--------------------------+---------+
| maxTotalInstances | -1 |
| maxTotalCores | 450 |
| maxTotalRAMSize | 1000000 |
| maxServerMeta | 128 |
| maxImageMeta | 128 |
| maxPersonality | 5 |
| maxPersonalitySize | 10240 |
| maxTotalKeypairs | 100 |
| maxServerGroups | 10 |
| maxServerGroupMembers | 10 |
| maxTotalFloatingIps | -1 |
| maxSecurityGroups | -1 |
| maxSecurityGroupRules | -1 |
| totalRAMUsed | 745472 |
| totalCoresUsed | 182 |
| totalInstancesUsed | 63 |
| totalFloatingIpsUsed | 0 |
| totalSecurityGroupsUsed | 0 |
| totalServerGroupsUsed | 0 |
| maxTotalVolumes | -1 |
| maxTotalSnapshots | 10 |
| maxTotalVolumeGigabytes | 4096 |
| maxTotalBackups | 10 |
| maxTotalBackupGigabytes | 1000 |
| totalVolumesUsed | 3 |
| totalGigabytesUsed | 60 |
| totalSnapshotsUsed | 0 |
| totalBackupsUsed | 0 |
| totalBackupGigabytesUsed | 0 |
+--------------------------+---------+
+ pushd /opt/ciman/openstack-hot
/opt/ciman/openstack-hot /w/workspace/controller-csit-3node-clustering-tell-all-calcium
+ lftools openstack --os-cloud vex stack create releng-controller-csit-3node-clustering-tell-all-calcium-78 csit-2-instance-type.yaml /w/workspace/controller-csit-3node-clustering-tell-all-calcium/stack-parameters.yaml
Creating stack releng-controller-csit-3node-clustering-tell-all-calcium-78
Waiting to initialize infrastructure...
Stack initialization successful.
------------------------------------
Stack Details
------------------------------------
{'added': None,
'capabilities': [],
'created_at': '2025-03-08T23:43:01Z',
'deleted': None,
'deleted_at': None,
'description': 'No description',
'environment': None,
'environment_files': None,
'files': None,
'files_container': None,
'id': 'bbd81b70-18d6-4094-98ce-6865920c7d40',
'is_rollback_disabled': True,
'links': [{'href': 'https://orchestration.public.mtl1.vexxhost.net/v1/12c36e260d8e4bb2913965203b1b491f/stacks/releng-controller-csit-3node-clustering-tell-all-calcium-78/bbd81b70-18d6-4094-98ce-6865920c7d40',
'rel': 'self'}],
'location': Munch({'cloud': 'vex', 'region_name': 'ca-ymq-1', 'zone': None, 'project': Munch({'id': '12c36e260d8e4bb2913965203b1b491f', 'name': '61975f2c-7c17-4d69-82fa-c3ae420ad6fd', 'domain_id': None, 'domain_name': 'Default'})}),
'name': 'releng-controller-csit-3node-clustering-tell-all-calcium-78',
'notification_topics': [],
'outputs': [{'description': 'IP addresses of the 2nd vm types',
'output_key': 'vm_1_ips',
'output_value': []},
{'description': 'IP addresses of the 1st vm types',
'output_key': 'vm_0_ips',
'output_value': ['10.30.171.141',
'10.30.171.204',
'10.30.171.35']}],
'owner_id': ****,
'parameters': {'OS::project_id': '12c36e260d8e4bb2913965203b1b491f',
'OS::stack_id': 'bbd81b70-18d6-4094-98ce-6865920c7d40',
'OS::stack_name': 'releng-controller-csit-3node-clustering-tell-all-calcium-78',
'job_name': '28865-78',
'silo': 'releng',
'vm_0_count': '3',
'vm_0_flavor': 'v3-standard-4',
'vm_0_image': 'ZZCI - Ubuntu 20.04 - builder - x86_64 - '
'20250101-160150.998',
'vm_1_count': '0',
'vm_1_flavor': 'v3-standard-2',
'vm_1_image': 'ZZCI - Ubuntu 22.04 - mininet-ovs-217 - x86_64 '
'- 20250201-060151.911'},
'parent_id': None,
'replaced': None,
'status': 'CREATE_COMPLETE',
'status_reason': 'Stack CREATE completed successfully',
'tags': [],
'template': None,
'template_description': 'No description',
'template_url': None,
'timeout_mins': 15,
'unchanged': None,
'updated': None,
'updated_at': None,
'user_project_id': 'efa0ccd74b98457098a038d9425129c4'}
------------------------------------
+ popd
/w/workspace/controller-csit-3node-clustering-tell-all-calcium
[controller-csit-3node-clustering-tell-all-calcium] $ /bin/bash -l /tmp/jenkins7899022415339457432.sh
---> Copy SSH public keys to CSIT lab
Setup pyenv:
system
3.8.13
3.9.13
3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-calcium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-38GL from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes python-heatclient python-openstackclient
lf-activate-venv(): INFO: Adding /tmp/venv-38GL/bin to PATH
SSH not responding on 10.30.171.141. Retrying in 10 seconds...
SSH not responding on 10.30.171.204. Retrying in 10 seconds...
SSH not responding on 10.30.171.35. Retrying in 10 seconds...
Ping to 10.30.171.141 successful.
Ping to 10.30.171.204 successful.
SSH not responding on 10.30.171.204. Retrying in 10 seconds...
Ping to 10.30.171.35 successful.
Warning: Permanently added '10.30.171.141' (ECDSA) to the list of known hosts.
releng-28865-78-0-builder-0
Successfully copied public keys to slave 10.30.171.141
Process 6497 ready.
Warning: Permanently added '10.30.171.35' (ECDSA) to the list of known hosts.
releng-28865-78-0-builder-2
Successfully copied public keys to slave 10.30.171.35
Ping to 10.30.171.204 successful.
Warning: Permanently added '10.30.171.204' (ECDSA) to the list of known hosts.
releng-28865-78-0-builder-1
Successfully copied public keys to slave 10.30.171.204
Process 6498 ready.
Process 6499 ready.
SSH ready on all stack servers.
[controller-csit-3node-clustering-tell-all-calcium] $ /bin/bash -l /tmp/jenkins4369747450640864343.sh
Setup pyenv:
system
3.8.13
3.9.13
3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-calcium/.python-version)
lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-sT7w
lf-activate-venv(): INFO: Save venv in file: /w/workspace/controller-csit-3node-clustering-tell-all-calcium/.robot_venv
lf-activate-venv(): INFO: Installing: setuptools wheel
lf-activate-venv(): INFO: Adding /tmp/venv-sT7w/bin to PATH
+ echo 'Installing Python Requirements'
Installing Python Requirements
+ cat
+ python -m pip install -r requirements.txt
Looking in indexes: https://nexus3.opendaylight.org/repository/PyPi/simple
Collecting docker-py (from -r requirements.txt (line 1))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/docker-py/1.10.6/docker_py-1.10.6-py2.py3-none-any.whl (50 kB)
Collecting ipaddr (from -r requirements.txt (line 2))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/ipaddr/2.2.0/ipaddr-2.2.0.tar.gz (26 kB)
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
Collecting netaddr (from -r requirements.txt (line 3))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/netaddr/1.3.0/netaddr-1.3.0-py3-none-any.whl (2.3 MB)
Collecting netifaces (from -r requirements.txt (line 4))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/netifaces/0.11.0/netifaces-0.11.0.tar.gz (30 kB)
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
Collecting pyhocon (from -r requirements.txt (line 5))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyhocon/0.3.61/pyhocon-0.3.61-py3-none-any.whl (25 kB)
Collecting requests (from -r requirements.txt (line 6))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/requests/2.32.3/requests-2.32.3-py3-none-any.whl (64 kB)
Collecting robotframework (from -r requirements.txt (line 7))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework/7.2.2/robotframework-7.2.2-py3-none-any.whl (777 kB)
â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â” 777.7/777.7 kB 31.2 MB/s eta 0:00:00
Collecting robotframework-httplibrary (from -r requirements.txt (line 8))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-httplibrary/0.4.2/robotframework-httplibrary-0.4.2.tar.gz (9.1 kB)
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
Collecting robotframework-requests==0.9.7 (from -r requirements.txt (line 9))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-requests/0.9.7/robotframework_requests-0.9.7-py3-none-any.whl (21 kB)
Collecting robotframework-selenium2library (from -r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-selenium2library/3.0.0/robotframework_selenium2library-3.0.0-py2.py3-none-any.whl (6.2 kB)
Collecting robotframework-sshlibrary==3.8.0 (from -r requirements.txt (line 11))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-sshlibrary/3.8.0/robotframework-sshlibrary-3.8.0.tar.gz (51 kB)
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
Collecting scapy (from -r requirements.txt (line 12))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/scapy/2.6.1/scapy-2.6.1-py3-none-any.whl (2.4 MB)
â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â” 2.4/2.4 MB 44.8 MB/s eta 0:00:00
Collecting jsonpath-rw (from -r requirements.txt (line 15))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpath-rw/1.4.0/jsonpath-rw-1.4.0.tar.gz (13 kB)
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
Collecting elasticsearch (from -r requirements.txt (line 18))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch/8.17.2/elasticsearch-8.17.2-py3-none-any.whl (717 kB)
â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â” 718.0/718.0 kB 29.6 MB/s eta 0:00:00
Collecting elasticsearch-dsl (from -r requirements.txt (line 19))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch-dsl/8.17.1/elasticsearch_dsl-8.17.1-py3-none-any.whl (158 kB)
Collecting pyangbind (from -r requirements.txt (line 22))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyangbind/0.8.6/pyangbind-0.8.6-py3-none-any.whl (52 kB)
Collecting isodate (from -r requirements.txt (line 25))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/isodate/0.7.2/isodate-0.7.2-py3-none-any.whl (22 kB)
Collecting jmespath (from -r requirements.txt (line 28))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jmespath/1.0.1/jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting jsonpatch (from -r requirements.txt (line 31))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpatch/1.33/jsonpatch-1.33-py2.py3-none-any.whl (12 kB)
Collecting paramiko>=1.15.3 (from robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/paramiko/3.5.1/paramiko-3.5.1-py3-none-any.whl (227 kB)
Collecting scp>=0.13.0 (from robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/scp/0.15.0/scp-0.15.0-py2.py3-none-any.whl (8.8 kB)
Collecting docker-pycreds>=0.2.1 (from docker-py->-r requirements.txt (line 1))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/docker-pycreds/0.4.0/docker_pycreds-0.4.0-py2.py3-none-any.whl (9.0 kB)
Collecting six>=1.4.0 (from docker-py->-r requirements.txt (line 1))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/six/1.17.0/six-1.17.0-py2.py3-none-any.whl (11 kB)
Collecting websocket-client>=0.32.0 (from docker-py->-r requirements.txt (line 1))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/websocket-client/1.8.0/websocket_client-1.8.0-py3-none-any.whl (58 kB)
Collecting pyparsing<4,>=2 (from pyhocon->-r requirements.txt (line 5))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pyparsing/3.2.1/pyparsing-3.2.1-py3-none-any.whl (107 kB)
Collecting charset-normalizer<4,>=2 (from requests->-r requirements.txt (line 6))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/charset-normalizer/3.4.1/charset_normalizer-3.4.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (143 kB)
Collecting idna<4,>=2.5 (from requests->-r requirements.txt (line 6))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/idna/3.10/idna-3.10-py3-none-any.whl (70 kB)
Collecting urllib3<3,>=1.21.1 (from requests->-r requirements.txt (line 6))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/urllib3/2.3.0/urllib3-2.3.0-py3-none-any.whl (128 kB)
Collecting certifi>=2017.4.17 (from requests->-r requirements.txt (line 6))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/certifi/2025.1.31/certifi-2025.1.31-py3-none-any.whl (166 kB)
Collecting webtest>=2.0 (from robotframework-httplibrary->-r requirements.txt (line 8))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/webtest/3.0.4/WebTest-3.0.4-py3-none-any.whl (32 kB)
Collecting jsonpointer (from robotframework-httplibrary->-r requirements.txt (line 8))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpointer/3.0.0/jsonpointer-3.0.0-py2.py3-none-any.whl (7.6 kB)
Collecting robotframework-seleniumlibrary>=3.0.0 (from robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-seleniumlibrary/6.7.1/robotframework_seleniumlibrary-6.7.1-py2.py3-none-any.whl (104 kB)
Collecting ply (from jsonpath-rw->-r requirements.txt (line 15))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/ply/3.11/ply-3.11-py2.py3-none-any.whl (49 kB)
Collecting decorator (from jsonpath-rw->-r requirements.txt (line 15))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/decorator/5.2.1/decorator-5.2.1-py3-none-any.whl (9.2 kB)
Collecting elastic-transport<9,>=8.15.1 (from elasticsearch->-r requirements.txt (line 18))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elastic-transport/8.17.0/elastic_transport-8.17.0-py3-none-any.whl (64 kB)
Collecting python-dateutil (from elasticsearch-dsl->-r requirements.txt (line 19))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/python-dateutil/2.9.0.post0/python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB)
Collecting typing-extensions (from elasticsearch-dsl->-r requirements.txt (line 19))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/typing-extensions/4.12.2/typing_extensions-4.12.2-py3-none-any.whl (37 kB)
Collecting pyang (from pyangbind->-r requirements.txt (line 22))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyang/2.6.1/pyang-2.6.1-py2.py3-none-any.whl (594 kB)
â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â” 594.7/594.7 kB 27.6 MB/s eta 0:00:00
Collecting lxml (from pyangbind->-r requirements.txt (line 22))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/lxml/5.3.1/lxml-5.3.1-cp311-cp311-manylinux_2_28_x86_64.whl (5.0 MB)
Collecting regex (from pyangbind->-r requirements.txt (line 22))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/regex/2024.11.6/regex-2024.11.6-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (792 kB)
â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â” 792.7/792.7 kB 5.8 MB/s eta 0:00:00
Collecting enum34 (from pyangbind->-r requirements.txt (line 22))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/enum34/1.1.10/enum34-1.1.10-py3-none-any.whl (11 kB)
Collecting bcrypt>=3.2 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/bcrypt/4.3.0/bcrypt-4.3.0-cp39-abi3-manylinux_2_28_x86_64.whl (284 kB)
Collecting cryptography>=3.3 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/cryptography/44.0.2/cryptography-44.0.2-cp39-abi3-manylinux_2_28_x86_64.whl (4.2 MB)
Collecting pynacl>=1.5 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pynacl/1.5.0/PyNaCl-1.5.0-cp36-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.manylinux_2_24_x86_64.whl (856 kB)
Collecting selenium>=4.3.0 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/selenium/4.29.0/selenium-4.29.0-py3-none-any.whl (9.5 MB)
â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â” 9.5/9.5 MB 75.7 MB/s eta 0:00:00
Collecting robotframework-pythonlibcore>=4.4.1 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-pythonlibcore/4.4.1/robotframework_pythonlibcore-4.4.1-py2.py3-none-any.whl (12 kB)
Collecting click>=8.0 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/click/8.1.8/click-8.1.8-py3-none-any.whl (98 kB)
Collecting WebOb>=1.2 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/webob/1.8.9/WebOb-1.8.9-py2.py3-none-any.whl (115 kB)
Collecting waitress>=3.0.2 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/waitress/3.0.2/waitress-3.0.2-py3-none-any.whl (56 kB)
Collecting beautifulsoup4 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/beautifulsoup4/4.13.3/beautifulsoup4-4.13.3-py3-none-any.whl (186 kB)
Collecting cffi>=1.12 (from cryptography>=3.3->paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/cffi/1.17.1/cffi-1.17.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (467 kB)
Collecting trio~=0.17 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/trio/0.29.0/trio-0.29.0-py3-none-any.whl (492 kB)
Collecting trio-websocket~=0.9 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/trio-websocket/0.12.2/trio_websocket-0.12.2-py3-none-any.whl (21 kB)
Collecting soupsieve>1.2 (from beautifulsoup4->webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/soupsieve/2.6/soupsieve-2.6-py3-none-any.whl (36 kB)
Collecting pycparser (from cffi>=1.12->cryptography>=3.3->paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pycparser/2.22/pycparser-2.22-py3-none-any.whl (117 kB)
Collecting attrs>=23.2.0 (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/attrs/25.1.0/attrs-25.1.0-py3-none-any.whl (63 kB)
Collecting sortedcontainers (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/sortedcontainers/2.4.0/sortedcontainers-2.4.0-py2.py3-none-any.whl (29 kB)
Collecting outcome (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/outcome/1.3.0.post0/outcome-1.3.0.post0-py2.py3-none-any.whl (10 kB)
Collecting sniffio>=1.3.0 (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/sniffio/1.3.1/sniffio-1.3.1-py3-none-any.whl (10 kB)
Collecting wsproto>=0.14 (from trio-websocket~=0.9->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/wsproto/1.2.0/wsproto-1.2.0-py3-none-any.whl (24 kB)
Collecting pysocks!=1.5.7,<2.0,>=1.5.6 (from urllib3[socks]<3,>=1.26->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pysocks/1.7.1/PySocks-1.7.1-py3-none-any.whl (16 kB)
Collecting h11<1,>=0.9.0 (from wsproto>=0.14->trio-websocket~=0.9->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/h11/0.14.0/h11-0.14.0-py3-none-any.whl (58 kB)
Building wheels for collected packages: robotframework-sshlibrary, ipaddr, netifaces, robotframework-httplibrary, jsonpath-rw
Building wheel for robotframework-sshlibrary (setup.py): started
Building wheel for robotframework-sshlibrary (setup.py): finished with status 'done'
Created wheel for robotframework-sshlibrary: filename=robotframework_sshlibrary-3.8.0-py3-none-any.whl size=55176 sha256=faf5b4e8f3d2efa7f49ad42a9e32538f5ee31bd3806405fd3f067674eb0751ea
Stored in directory: /home/jenkins/.cache/pip/wheels/f7/c9/b3/a977b7bcc410d45ae27d240df3d00a12585509180e373ecccc
Building wheel for ipaddr (setup.py): started
Building wheel for ipaddr (setup.py): finished with status 'done'
Created wheel for ipaddr: filename=ipaddr-2.2.0-py3-none-any.whl size=18322 sha256=dcc9b378aea856c943ad0d62bc27110076d29048ee8820613b390effb5912a46
Stored in directory: /home/jenkins/.cache/pip/wheels/dc/6c/04/da2d847fa8d45c59af3e1d83e2acc29cb8adcbaf04c0898dbf
Building wheel for netifaces (setup.py): started
Building wheel for netifaces (setup.py): finished with status 'done'
Created wheel for netifaces: filename=netifaces-0.11.0-cp311-cp311-linux_x86_64.whl size=41060 sha256=7870f1cfa0c200fed378a7e493e422f053f2628aabe143ac28410e182524663a
Stored in directory: /home/jenkins/.cache/pip/wheels/f8/18/88/e61d54b995bea304bdb1d040a92b72228a1bf72ca2a3eba7c9
Building wheel for robotframework-httplibrary (setup.py): started
Building wheel for robotframework-httplibrary (setup.py): finished with status 'done'
Created wheel for robotframework-httplibrary: filename=robotframework_httplibrary-0.4.2-py3-none-any.whl size=10012 sha256=6441d076478d2db257cbce2c977ab0cbc5de157fa362ecb9588b36bd6726bc5d
Stored in directory: /home/jenkins/.cache/pip/wheels/aa/bc/0d/9a20dd51effef392aae2733cb4c7b66c6fa29fca33d88b57ed
Building wheel for jsonpath-rw (setup.py): started
Building wheel for jsonpath-rw (setup.py): finished with status 'done'
Created wheel for jsonpath-rw: filename=jsonpath_rw-1.4.0-py3-none-any.whl size=15178 sha256=4d09de618177f69533c13e54ec7d16ca82ba67e3ac642bb118b83bee2afaf928
Stored in directory: /home/jenkins/.cache/pip/wheels/f1/54/63/9a8da38cefae13755097b36cc852decc25d8ef69c37d58d4eb
Successfully built robotframework-sshlibrary ipaddr netifaces robotframework-httplibrary jsonpath-rw
Installing collected packages: sortedcontainers, ply, netifaces, ipaddr, enum34, websocket-client, WebOb, waitress, urllib3, typing-extensions, soupsieve, sniffio, six, scapy, robotframework-pythonlibcore, robotframework, regex, pysocks, pyparsing, pycparser, netaddr, lxml, jsonpointer, jmespath, isodate, idna, h11, decorator, click, charset-normalizer, certifi, bcrypt, attrs, wsproto, requests, python-dateutil, pyhocon, pyang, outcome, jsonpath-rw, jsonpatch, elastic-transport, docker-pycreds, cffi, beautifulsoup4, webtest, trio, robotframework-requests, pynacl, pyangbind, elasticsearch, docker-py, cryptography, trio-websocket, robotframework-httplibrary, paramiko, elasticsearch-dsl, selenium, scp, robotframework-sshlibrary, robotframework-seleniumlibrary, robotframework-selenium2library
Successfully installed WebOb-1.8.9 attrs-25.1.0 bcrypt-4.3.0 beautifulsoup4-4.13.3 certifi-2025.1.31 cffi-1.17.1 charset-normalizer-3.4.1 click-8.1.8 cryptography-44.0.2 decorator-5.2.1 docker-py-1.10.6 docker-pycreds-0.4.0 elastic-transport-8.17.0 elasticsearch-8.17.2 elasticsearch-dsl-8.17.1 enum34-1.1.10 h11-0.14.0 idna-3.10 ipaddr-2.2.0 isodate-0.7.2 jmespath-1.0.1 jsonpatch-1.33 jsonpath-rw-1.4.0 jsonpointer-3.0.0 lxml-5.3.1 netaddr-1.3.0 netifaces-0.11.0 outcome-1.3.0.post0 paramiko-3.5.1 ply-3.11 pyang-2.6.1 pyangbind-0.8.6 pycparser-2.22 pyhocon-0.3.61 pynacl-1.5.0 pyparsing-3.2.1 pysocks-1.7.1 python-dateutil-2.9.0.post0 regex-2024.11.6 requests-2.32.3 robotframework-7.2.2 robotframework-httplibrary-0.4.2 robotframework-pythonlibcore-4.4.1 robotframework-requests-0.9.7 robotframework-selenium2library-3.0.0 robotframework-seleniumlibrary-6.7.1 robotframework-sshlibrary-3.8.0 scapy-2.6.1 scp-0.15.0 selenium-4.29.0 six-1.17.0 sniffio-1.3.1 sortedcontainers-2.4.0 soupsieve-2.6 trio-0.29.0 trio-websocket-0.12.2 typing-extensions-4.12.2 urllib3-2.3.0 waitress-3.0.2 websocket-client-1.8.0 webtest-3.0.4 wsproto-1.2.0
+ pip freeze
attrs==25.1.0
bcrypt==4.3.0
beautifulsoup4==4.13.3
certifi==2025.1.31
cffi==1.17.1
charset-normalizer==3.4.1
click==8.1.8
cryptography==44.0.2
decorator==5.2.1
distlib==0.3.9
docker-py==1.10.6
docker-pycreds==0.4.0
elastic-transport==8.17.0
elasticsearch==8.17.2
elasticsearch-dsl==8.17.1
enum34==1.1.10
filelock==3.17.0
h11==0.14.0
idna==3.10
ipaddr==2.2.0
isodate==0.7.2
jmespath==1.0.1
jsonpatch==1.33
jsonpath-rw==1.4.0
jsonpointer==3.0.0
lxml==5.3.1
netaddr==1.3.0
netifaces==0.11.0
outcome==1.3.0.post0
paramiko==3.5.1
platformdirs==4.3.6
ply==3.11
pyang==2.6.1
pyangbind==0.8.6
pycparser==2.22
pyhocon==0.3.61
PyNaCl==1.5.0
pyparsing==3.2.1
PySocks==1.7.1
python-dateutil==2.9.0.post0
regex==2024.11.6
requests==2.32.3
robotframework==7.2.2
robotframework-httplibrary==0.4.2
robotframework-pythonlibcore==4.4.1
robotframework-requests==0.9.7
robotframework-selenium2library==3.0.0
robotframework-seleniumlibrary==6.7.1
robotframework-sshlibrary==3.8.0
scapy==2.6.1
scp==0.15.0
selenium==4.29.0
six==1.17.0
sniffio==1.3.1
sortedcontainers==2.4.0
soupsieve==2.6
trio==0.29.0
trio-websocket==0.12.2
typing_extensions==4.12.2
urllib3==2.3.0
virtualenv==20.29.3
waitress==3.0.2
WebOb==1.8.9
websocket-client==1.8.0
WebTest==3.0.4
wsproto==1.2.0
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties file path 'env.properties'
[EnvInject] - Variables injected successfully.
[controller-csit-3node-clustering-tell-all-calcium] $ /bin/bash -l /tmp/jenkins14052784851636024217.sh
Setup pyenv:
system
3.8.13
3.9.13
3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-calcium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-38GL from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: python-heatclient python-openstackclient yq
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
lftools 0.37.10 requires urllib3<2.1.0, but you have urllib3 2.3.0 which is incompatible.
lf-activate-venv(): INFO: Adding /tmp/venv-38GL/bin to PATH
+ ODL_SYSTEM=()
+ TOOLS_SYSTEM=()
+ OPENSTACK_SYSTEM=()
+ OPENSTACK_CONTROLLERS=()
+ mapfile -t ADDR
++ openstack stack show -f json -c outputs releng-controller-csit-3node-clustering-tell-all-calcium-78
++ jq -r '.outputs[] | select(.output_key | match("^vm_[0-9]+_ips$")) | .output_value | .[]'
+ for i in "${ADDR[@]}"
++ ssh 10.30.171.141 hostname -s
Warning: Permanently added '10.30.171.141' (ECDSA) to the list of known hosts.
+ REMHOST=releng-28865-78-0-builder-0
+ case ${REMHOST} in
+ ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}")
+ for i in "${ADDR[@]}"
++ ssh 10.30.171.204 hostname -s
Warning: Permanently added '10.30.171.204' (ECDSA) to the list of known hosts.
+ REMHOST=releng-28865-78-0-builder-1
+ case ${REMHOST} in
+ ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}")
+ for i in "${ADDR[@]}"
++ ssh 10.30.171.35 hostname -s
Warning: Permanently added '10.30.171.35' (ECDSA) to the list of known hosts.
+ REMHOST=releng-28865-78-0-builder-2
+ case ${REMHOST} in
+ ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}")
+ echo NUM_ODL_SYSTEM=3
+ echo NUM_TOOLS_SYSTEM=0
+ '[' '' == yes ']'
+ NUM_OPENSTACK_SYSTEM=0
+ echo NUM_OPENSTACK_SYSTEM=0
+ '[' 0 -eq 2 ']'
+ echo ODL_SYSTEM_IP=10.30.171.141
++ seq 0 2
+ for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 )))
+ echo ODL_SYSTEM_1_IP=10.30.171.141
+ for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 )))
+ echo ODL_SYSTEM_2_IP=10.30.171.204
+ for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 )))
+ echo ODL_SYSTEM_3_IP=10.30.171.35
+ echo TOOLS_SYSTEM_IP=
++ seq 0 -1
+ openstack_index=0
+ NUM_OPENSTACK_CONTROL_NODES=1
+ echo NUM_OPENSTACK_CONTROL_NODES=1
++ seq 0 0
+ for i in $(seq 0 $((NUM_OPENSTACK_CONTROL_NODES - 1)))
+ echo OPENSTACK_CONTROL_NODE_1_IP=
+ NUM_OPENSTACK_COMPUTE_NODES=-1
+ echo NUM_OPENSTACK_COMPUTE_NODES=-1
+ '[' -1 -ge 2 ']'
++ seq 0 -2
+ NUM_OPENSTACK_HAPROXY_NODES=0
+ echo NUM_OPENSTACK_HAPROXY_NODES=0
++ seq 0 -1
+ echo 'Contents of slave_addresses.txt:'
Contents of slave_addresses.txt:
+ cat slave_addresses.txt
NUM_ODL_SYSTEM=3
NUM_TOOLS_SYSTEM=0
NUM_OPENSTACK_SYSTEM=0
ODL_SYSTEM_IP=10.30.171.141
ODL_SYSTEM_1_IP=10.30.171.141
ODL_SYSTEM_2_IP=10.30.171.204
ODL_SYSTEM_3_IP=10.30.171.35
TOOLS_SYSTEM_IP=
NUM_OPENSTACK_CONTROL_NODES=1
OPENSTACK_CONTROL_NODE_1_IP=
NUM_OPENSTACK_COMPUTE_NODES=-1
NUM_OPENSTACK_HAPROXY_NODES=0
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties file path 'slave_addresses.txt'
[EnvInject] - Variables injected successfully.
[controller-csit-3node-clustering-tell-all-calcium] $ /bin/sh /tmp/jenkins9655698185754686717.sh
Preparing for JRE Version 17
Karaf artifact is karaf
Karaf project is integration
Java home is /usr/lib/jvm/java-17-openjdk-amd64
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties file path 'set_variables.env'
[EnvInject] - Variables injected successfully.
[controller-csit-3node-clustering-tell-all-calcium] $ /bin/bash /tmp/jenkins10186336098137194426.sh
2025-03-08 23:44:37 URL:https://git.opendaylight.org/gerrit/gitweb?p=integration/distribution.git;a=blob_plain;f=pom.xml;hb=stable/calcium [2619/2619] -> "pom.xml" [1]
Bundle version is 0.20.4-SNAPSHOT
--2025-03-08 23:44:37-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.4-SNAPSHOT/maven-metadata.xml
Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6
Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 1410 (1.4K) [application/xml]
Saving to: ‘maven-metadata.xml’
0K . 100% 78.6M=0s
2025-03-08 23:44:37 (78.6 MB/s) - ‘maven-metadata.xml’ saved [1410/1410]
<?xml version="1.0" encoding="UTF-8"?>
<metadata modelVersion="1.1.0">
<groupId>org.opendaylight.integration</groupId>
<artifactId>karaf</artifactId>
<version>0.20.4-SNAPSHOT</version>
<versioning>
<snapshot>
<timestamp>20250308.204433</timestamp>
<buildNumber>450</buildNumber>
</snapshot>
<lastUpdated>20250308204433</lastUpdated>
<snapshotVersions>
<snapshotVersion>
<extension>pom</extension>
<value>0.20.4-20250308.204433-450</value>
<updated>20250308204433</updated>
</snapshotVersion>
<snapshotVersion>
<extension>tar.gz</extension>
<value>0.20.4-20250308.204433-450</value>
<updated>20250308204433</updated>
</snapshotVersion>
<snapshotVersion>
<extension>zip</extension>
<value>0.20.4-20250308.204433-450</value>
<updated>20250308204433</updated>
</snapshotVersion>
<snapshotVersion>
<classifier>cyclonedx</classifier>
<extension>xml</extension>
<value>0.20.4-20250308.204433-450</value>
<updated>20250308204433</updated>
</snapshotVersion>
<snapshotVersion>
<classifier>cyclonedx</classifier>
<extension>json</extension>
<value>0.20.4-20250308.204433-450</value>
<updated>20250308204433</updated>
</snapshotVersion>
</snapshotVersions>
</versioning>
</metadata>
Nexus timestamp is 0.20.4-20250308.204433-450
Distribution bundle URL is https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.4-SNAPSHOT/karaf-0.20.4-20250308.204433-450.zip
Distribution bundle is karaf-0.20.4-20250308.204433-450.zip
Distribution bundle version is 0.20.4-SNAPSHOT
Distribution folder is karaf-0.20.4-SNAPSHOT
Nexus prefix is https://nexus.opendaylight.org
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties file path 'detect_variables.env'
[EnvInject] - Variables injected successfully.
[controller-csit-3node-clustering-tell-all-calcium] $ /bin/bash -l /tmp/jenkins17300920284805210468.sh
Setup pyenv:
system
3.8.13
3.9.13
3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-calcium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-38GL from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: python-heatclient python-openstackclient
lf-activate-venv(): INFO: Adding /tmp/venv-38GL/bin to PATH
Copying common-functions.sh to /tmp
Copying common-functions.sh to 10.30.171.141:/tmp
Warning: Permanently added '10.30.171.141' (ECDSA) to the list of known hosts.
Copying common-functions.sh to 10.30.171.204:/tmp
Warning: Permanently added '10.30.171.204' (ECDSA) to the list of known hosts.
Copying common-functions.sh to 10.30.171.35:/tmp
Warning: Permanently added '10.30.171.35' (ECDSA) to the list of known hosts.
[controller-csit-3node-clustering-tell-all-calcium] $ /bin/bash /tmp/jenkins12214124209169687453.sh
common-functions.sh is being sourced
common-functions environment:
MAVENCONF: /tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
ACTUALFEATURES:
FEATURESCONF: /tmp/karaf-0.20.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
CUSTOMPROP: /tmp/karaf-0.20.4-SNAPSHOT/etc/custom.properties
LOGCONF: /tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
MEMCONF: /tmp/karaf-0.20.4-SNAPSHOT/bin/setenv
CONTROLLERMEM: 2048m
AKKACONF: /tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/akka.conf
MODULESCONF: /tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/modules.conf
MODULESHARDSCONF: /tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/module-shards.conf
SUITES:
#################################################
## Configure Cluster and Start ##
#################################################
ACTUALFEATURES: odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app
SPACE_SEPARATED_FEATURES: odl-integration-compatible-with-all odl-jolokia odl-restconf odl-clustering-test-app
Locating script plan to use...
script plan exists!!!
Changing the script plan path...
# Place the scripts in run order:
/w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/scripts/car_people_shard.sh
Executing /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/scripts/car_people_shard.sh...
Add car-people shards file
Copy shard config to member-1 with IP address 10.30.171.141
Warning: Permanently added '10.30.171.141' (ECDSA) to the list of known hosts.
Copy shard config to member-2 with IP address 10.30.171.204
Warning: Permanently added '10.30.171.204' (ECDSA) to the list of known hosts.
Copy shard config to member-3 with IP address 10.30.171.35
Warning: Permanently added '10.30.171.35' (ECDSA) to the list of known hosts.
Finished running script plans
Configuring member-1 with IP address 10.30.171.141
Warning: Permanently added '10.30.171.141' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.171.141' (ECDSA) to the list of known hosts.
+ source /tmp/common-functions.sh karaf-0.20.4-SNAPSHOT
common-functions.sh is being sourced
++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]]
++ echo 'common-functions.sh is being sourced'
++ BUNDLEFOLDER=karaf-0.20.4-SNAPSHOT
++ export MAVENCONF=/tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
++ MAVENCONF=/tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
++ export FEATURESCONF=/tmp/karaf-0.20.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
++ FEATURESCONF=/tmp/karaf-0.20.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
++ export CUSTOMPROP=/tmp/karaf-0.20.4-SNAPSHOT/etc/custom.properties
++ CUSTOMPROP=/tmp/karaf-0.20.4-SNAPSHOT/etc/custom.properties
++ export LOGCONF=/tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
++ LOGCONF=/tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
++ export MEMCONF=/tmp/karaf-0.20.4-SNAPSHOT/bin/setenv
++ MEMCONF=/tmp/karaf-0.20.4-SNAPSHOT/bin/setenv
++ export CONTROLLERMEM=
++ CONTROLLERMEM=
++ export AKKACONF=/tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/akka.conf
++ AKKACONF=/tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/akka.conf
++ export MODULESCONF=/tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/modules.conf
++ MODULESCONF=/tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/modules.conf
++ export MODULESHARDSCONF=/tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/module-shards.conf
++ MODULESHARDSCONF=/tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/module-shards.conf
++ print_common_env
++ cat
common-functions environment:
MAVENCONF: /tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
ACTUALFEATURES:
FEATURESCONF: /tmp/karaf-0.20.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
CUSTOMPROP: /tmp/karaf-0.20.4-SNAPSHOT/etc/custom.properties
LOGCONF: /tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
MEMCONF: /tmp/karaf-0.20.4-SNAPSHOT/bin/setenv
CONTROLLERMEM:
AKKACONF: /tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/akka.conf
MODULESCONF: /tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/modules.conf
MODULESHARDSCONF: /tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/module-shards.conf
SUITES:
++ SSH='ssh -t -t'
++ extra_services_cntl=' dnsmasq.service httpd.service libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service rabbitmq-server.service '
++ extra_services_cmp=' libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service '
Changing to /tmp
Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.4-SNAPSHOT/karaf-0.20.4-20250308.204433-450.zip
+ echo 'Changing to /tmp'
+ cd /tmp
+ echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.4-SNAPSHOT/karaf-0.20.4-20250308.204433-450.zip'
+ wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.4-SNAPSHOT/karaf-0.20.4-20250308.204433-450.zip
--2025-03-08 23:44:46-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.4-SNAPSHOT/karaf-0.20.4-20250308.204433-450.zip
Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6
Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 234245857 (223M) [application/zip]
Saving to: ‘karaf-0.20.4-20250308.204433-450.zip’
0K ........ ........ ........ ........ ........ ........ 1% 81.9M 3s
3072K ........ ........ ........ ........ ........ ........ 2% 154M 2s
6144K ........ ........ ........ ........ ........ ........ 4% 132M 2s
9216K ........ ........ ........ ........ ........ ........ 5% 137M 2s
12288K ........ ........ ........ ........ ........ ........ 6% 128M 2s
15360K ........ ........ ........ ........ ........ ........ 8% 146M 2s
18432K ........ ........ ........ ........ ........ ........ 9% 163M 2s
21504K ........ ........ ........ ........ ........ ........ 10% 166M 2s
24576K ........ ........ ........ ........ ........ ........ 12% 158M 1s
27648K ........ ........ ........ ........ ........ ........ 13% 208M 1s
30720K ........ ........ ........ ........ ........ ........ 14% 230M 1s
33792K ........ ........ ........ ........ ........ ........ 16% 242M 1s
36864K ........ ........ ........ ........ ........ ........ 17% 259M 1s
39936K ........ ........ ........ ........ ........ ........ 18% 274M 1s
43008K ........ ........ ........ ........ ........ ........ 20% 289M 1s
46080K ........ ........ ........ ........ ........ ........ 21% 291M 1s
49152K ........ ........ ........ ........ ........ ........ 22% 198M 1s
52224K ........ ........ ........ ........ ........ ........ 24% 271M 1s
55296K ........ ........ ........ ........ ........ ........ 25% 272M 1s
58368K ........ ........ ........ ........ ........ ........ 26% 287M 1s
61440K ........ ........ ........ ........ ........ ........ 28% 304M 1s
64512K ........ ........ ........ ........ ........ ........ 29% 296M 1s
67584K ........ ........ ........ ........ ........ ........ 30% 299M 1s
70656K ........ ........ ........ ........ ........ ........ 32% 300M 1s
73728K ........ ........ ........ ........ ........ ........ 33% 296M 1s
76800K ........ ........ ........ ........ ........ ........ 34% 301M 1s
79872K ........ ........ ........ ........ ........ ........ 36% 312M 1s
82944K ........ ........ ........ ........ ........ ........ 37% 298M 1s
86016K ........ ........ ........ ........ ........ ........ 38% 304M 1s
89088K ........ ........ ........ ........ ........ ........ 40% 291M 1s
92160K ........ ........ ........ ........ ........ ........ 41% 293M 1s
95232K ........ ........ ........ ........ ........ ........ 42% 305M 1s
98304K ........ ........ ........ ........ ........ ........ 44% 307M 1s
101376K ........ ........ ........ ........ ........ ........ 45% 299M 1s
104448K ........ ........ ........ ........ ........ ........ 47% 297M 1s
107520K ........ ........ ........ ........ ........ ........ 48% 310M 1s
110592K ........ ........ ........ ........ ........ ........ 49% 305M 1s
113664K ........ ........ ........ ........ ........ ........ 51% 295M 0s
116736K ........ ........ ........ ........ ........ ........ 52% 281M 0s
119808K ........ ........ ........ ........ ........ ........ 53% 296M 0s
122880K ........ ........ ........ ........ ........ ........ 55% 281M 0s
125952K ........ ........ ........ ........ ........ ........ 56% 275M 0s
129024K ........ ........ ........ ........ ........ ........ 57% 285M 0s
132096K ........ ........ ........ ........ ........ ........ 59% 273M 0s
135168K ........ ........ ........ ........ ........ ........ 60% 281M 0s
138240K ........ ........ ........ ........ ........ ........ 61% 277M 0s
141312K ........ ........ ........ ........ ........ ........ 63% 274M 0s
144384K ........ ........ ........ ........ ........ ........ 64% 267M 0s
147456K ........ ........ ........ ........ ........ ........ 65% 270M 0s
150528K ........ ........ ........ ........ ........ ........ 67% 265M 0s
153600K ........ ........ ........ ........ ........ ........ 68% 271M 0s
156672K ........ ........ ........ ........ ........ ........ 69% 263M 0s
159744K ........ ........ ........ ........ ........ ........ 71% 269M 0s
162816K ........ ........ ........ ........ ........ ........ 72% 269M 0s
165888K ........ ........ ........ ........ ........ ........ 73% 270M 0s
168960K ........ ........ ........ ........ ........ ........ 75% 258M 0s
172032K ........ ........ ........ ........ ........ ........ 76% 260M 0s
175104K ........ ........ ........ ........ ........ ........ 77% 247M 0s
178176K ........ ........ ........ ........ ........ ........ 79% 264M 0s
181248K ........ ........ ........ ........ ........ ........ 80% 264M 0s
184320K ........ ........ ........ ........ ........ ........ 81% 207M 0s
187392K ........ ........ ........ ........ ........ ........ 83% 306M 0s
190464K ........ ........ ........ ........ ........ ........ 84% 277M 0s
193536K ........ ........ ........ ........ ........ ........ 85% 273M 0s
196608K ........ ........ ........ ........ ........ ........ 87% 279M 0s
199680K ........ ........ ........ ........ ........ ........ 88% 275M 0s
202752K ........ ........ ........ ........ ........ ........ 89% 276M 0s
205824K ........ ........ ........ ........ ........ ........ 91% 281M 0s
208896K ........ ........ ........ ........ ........ ........ 92% 286M 0s
211968K ........ ........ ........ ........ ........ ........ 94% 284M 0s
215040K ........ ........ ........ ........ ........ ........ 95% 274M 0s
218112K ........ ........ ........ ........ ........ ........ 96% 269M 0s
221184K ........ ........ ........ ........ ........ ........ 98% 267M 0s
224256K ........ ........ ........ ........ ........ ........ 99% 268M 0s
227328K ........ ........ ...... 100% 283M=0.9s
2025-03-08 23:44:46 (244 MB/s) - ‘karaf-0.20.4-20250308.204433-450.zip’ saved [234245857/234245857]
Extracting the new controller...
+ echo 'Extracting the new controller...'
+ unzip -q karaf-0.20.4-20250308.204433-450.zip
Adding external repositories...
+ echo 'Adding external repositories...'
+ sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
+ cat /tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
################################################################################
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
################################################################################
#
# If set to true, the following property will not allow any certificate to be used
# when accessing Maven repositories through SSL
#
#org.ops4j.pax.url.mvn.certificateCheck=
#
# Path to the local Maven settings file.
# The repositories defined in this file will be automatically added to the list
# of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property
# below is not set.
# The following locations are checked for the existence of the settings.xml file
# * 1. looks for the specified url
# * 2. if not found looks for ${user.home}/.m2/settings.xml
# * 3. if not found looks for ${maven.home}/conf/settings.xml
# * 4. if not found looks for ${M2_HOME}/conf/settings.xml
#
#org.ops4j.pax.url.mvn.settings=
#
# Path to the local Maven repository which is used to avoid downloading
# artifacts when they already exist locally.
# The value of this property will be extracted from the settings.xml file
# above, or defaulted to:
# System.getProperty( "user.home" ) + "/.m2/repository"
#
org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository}
#
# Default this to false. It's just weird to use undocumented repos
#
org.ops4j.pax.url.mvn.useFallbackRepositories=false
#
# Uncomment if you don't wanna use the proxy settings
# from the Maven conf/settings.xml file
#
# org.ops4j.pax.url.mvn.proxySupport=false
#
# Comma separated list of repositories scanned when resolving an artifact.
# Those repositories will be checked before iterating through the
# below list of repositories and even before the local repository
# A repository url can be appended with zero or more of the following flags:
# @snapshots : the repository contains snaphots
# @noreleases : the repository does not contain any released artifacts
#
# The following property value will add the system folder as a repo.
#
org.ops4j.pax.url.mvn.defaultRepositories=\
file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\
file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\
file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots
# Use the default local repo (e.g.~/.m2/repository) as a "remote" repo
#org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false
#
# Comma separated list of repositories scanned when resolving an artifact.
# The default list includes the following repositories:
# http://repo1.maven.org/maven2@id=central
# http://repository.springsource.com/maven/bundles/release@id=spring.ebr
# http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external
# http://zodiac.springsource.com/maven/bundles/release@id=gemini
# http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases
# https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases
# https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
# To add repositories to the default ones, prepend '+' to the list of repositories
# to add.
# A repository url can be appended with zero or more of the following flags:
# @snapshots : the repository contains snapshots
# @noreleases : the repository does not contain any released artifacts
# @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended
#
org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.Configuring the startup features...
+ [[ True == \T\r\u\e ]]
+ echo 'Configuring the startup features...'
+ sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.20.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
+ FEATURE_TEST_STRING=features-test
+ FEATURE_TEST_VERSION=0.20.4-SNAPSHOT
+ KARAF_VERSION=karaf4
+ [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]]
+ sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.20.4-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.20.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
+ [[ ! -z '' ]]
+ cat /tmp/karaf-0.20.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
################################################################################
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
################################################################################
#
# Comma separated list of features repositories to register by default
#
featuresRepositories = mvn:org.opendaylight.integration/features-test/0.20.4-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/99092f2f-6abe-4b43-a24a-61818b2aa266.xml
#
# Comma separated list of features to install at startup
#
featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, d870963f-35a0-4302-91e8-aa6c8147a79f
#
# Resource repositories (OBR) that the features resolver can use
# to resolve requirements/capabilities
#
# The format of the resourceRepositories is
# resourceRepositories=[xml:url|json:url],...
# for Instance:
#
#resourceRepositories=xml:http://host/path/to/index.xml
# or
#resourceRepositories=json:http://host/path/to/index.json
#
#
# Defines if the boot features are started in asynchronous mode (in a dedicated thread)
#
featuresBootAsynchronous=false
#
# Service requirements enforcement
#
# By default, the feature resolver checks the service requirements/capabilities of
# bundles for new features (xml schema >= 1.3.0) in order to automatically installs
# the required bundles.
# The following flag can have those values:
# - disable: service requirements are completely ignored
# - default: service requirements are ignored for old features
# - enforce: service requirements are always verified
#
#serviceRequirements=default
#
# Store cfg file for config element in feature
#
#configCfgStore=true
#
# Define if the feature service automatically refresh bundles
#
autoRefresh=true
#
# Configuration of features processing mechanism (overrides, blacklisting, modification of features)
# XML file defines instructions related to features processing
# versions.properties may declare properties to resolve placeholders in XML file
# both files are relative to ${karaf.etc}
#
#featureProcessing=org.apache.karaf.features.xml
#featureProcessingVersions=versions.properties
+ configure_karaf_log karaf4 ''
+ local -r karaf_version=karaf4
+ local -r controllerdebugmap=
+ local logapi=log4j
+ grep log4j2 /tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
log4j2.rootLogger.level = INFO
#log4j2.rootLogger.type = asyncRoot
#log4j2.rootLogger.includeLocation = false
log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
log4j2.rootLogger.appenderRef.Console.ref = Console
log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
log4j2.logger.spifly.name = org.apache.aries.spifly
log4j2.logger.spifly.level = WARN
log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
log4j2.logger.audit.level = INFO
log4j2.logger.audit.additivity = false
log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
# Console appender not used by default (see log4j2.rootLogger.appenderRefs)
log4j2.appender.console.type = Console
log4j2.appender.console.name = Console
log4j2.appender.console.layout.type = PatternLayout
log4j2.appender.console.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.type = RollingRandomAccessFile
log4j2.appender.rolling.name = RollingFile
log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
#log4j2.appender.rolling.immediateFlush = false
log4j2.appender.rolling.append = true
log4j2.appender.rolling.layout.type = PatternLayout
log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.policies.type = Policies
log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.rolling.policies.size.size = 64MB
log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
log4j2.appender.rolling.strategy.max = 7
log4j2.appender.audit.type = RollingRandomAccessFile
log4j2.appender.audit.name = AuditRollingFile
log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
log4j2.appender.audit.append = true
log4j2.appender.audit.layout.type = PatternLayout
log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
log4j2.appender.audit.policies.type = Policies
log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.audit.policies.size.size = 8MB
log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
log4j2.appender.audit.strategy.max = 7
log4j2.appender.osgi.type = PaxOsgi
log4j2.appender.osgi.name = PaxOsgi
log4j2.appender.osgi.filter = *
#log4j2.logger.aether.name = shaded.org.eclipse.aether
#log4j2.logger.aether.level = TRACE
#log4j2.logger.http-headers.name = shaded.org.apache.http.headers
#log4j2.logger.http-headers.level = DEBUG
#log4j2.logger.maven.name = org.ops4j.pax.url.mvn
#log4j2.logger.maven.level = TRACE
Configuring the karaf log... karaf_version: karaf4, logapi: log4j2
+ logapi=log4j2
+ echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2'
+ '[' log4j2 == log4j2 ']'
+ sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
+ orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver
+ orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver
+ echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN'
+ echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN'
controllerdebugmap:
cat /tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
+ unset IFS
+ echo 'controllerdebugmap: '
+ '[' -n '' ']'
+ echo 'cat /tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg'
+ cat /tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
################################################################################
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
################################################################################
# Common pattern layout for appenders
log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
# Root logger
log4j2.rootLogger.level = INFO
# uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library
#log4j2.rootLogger.type = asyncRoot
#log4j2.rootLogger.includeLocation = false
log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
log4j2.rootLogger.appenderRef.Console.ref = Console
log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
# Filters for logs marked by org.opendaylight.odlparent.Markers
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
# Loggers configuration
# Spifly logger
log4j2.logger.spifly.name = org.apache.aries.spifly
log4j2.logger.spifly.level = WARN
# Security audit logger
log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
log4j2.logger.audit.level = INFO
log4j2.logger.audit.additivity = false
log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
# Appenders configuration
# Console appender not used by default (see log4j2.rootLogger.appenderRefs)
log4j2.appender.console.type = Console
log4j2.appender.console.name = Console
log4j2.appender.console.layout.type = PatternLayout
log4j2.appender.console.layout.pattern = ${log4j2.pattern}
# Rolling file appender
log4j2.appender.rolling.type = RollingRandomAccessFile
log4j2.appender.rolling.name = RollingFile
log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
# uncomment to not force a disk flush
#log4j2.appender.rolling.immediateFlush = false
log4j2.appender.rolling.append = true
log4j2.appender.rolling.layout.type = PatternLayout
log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.policies.type = Policies
log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.rolling.policies.size.size = 1GB
log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
log4j2.appender.rolling.strategy.max = 7
# Audit file appender
log4j2.appender.audit.type = RollingRandomAccessFile
log4j2.appender.audit.name = AuditRollingFile
log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
log4j2.appender.audit.append = true
log4j2.appender.audit.layout.type = PatternLayout
log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
log4j2.appender.audit.policies.type = Policies
log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.audit.policies.size.size = 8MB
log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
log4j2.appender.audit.strategy.max = 7
# OSGi appender
log4j2.appender.osgi.type = PaxOsgi
log4j2.appender.osgi.name = PaxOsgi
log4j2.appender.osgi.filter = *
# help with identification of maven-related problems with pax-url-aether
#log4j2.logger.aether.name = shaded.org.eclipse.aether
#log4j2.logger.aether.level = TRACE
#log4j2.logger.http-headers.name = shaded.org.apache.http.headers
#log4j2.logger.http-headers.level = DEBUG
#log4j2.logger.maven.name = org.ops4j.pax.url.mvn
#log4j2.logger.maven.level = TRACE
log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN
log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN
Configure
java home: /usr/lib/jvm/java-17-openjdk-amd64
max memory: 3072m
memconf: /tmp/karaf-0.20.4-SNAPSHOT/bin/setenv
+ set_java_vars /usr/lib/jvm/java-17-openjdk-amd64 3072m /tmp/karaf-0.20.4-SNAPSHOT/bin/setenv
+ local -r java_home=/usr/lib/jvm/java-17-openjdk-amd64
+ local -r controllermem=3072m
+ local -r memconf=/tmp/karaf-0.20.4-SNAPSHOT/bin/setenv
+ echo Configure
+ echo ' java home: /usr/lib/jvm/java-17-openjdk-amd64'
+ echo ' max memory: 3072m'
+ echo ' memconf: /tmp/karaf-0.20.4-SNAPSHOT/bin/setenv'
+ sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk-amd64}%g' /tmp/karaf-0.20.4-SNAPSHOT/bin/setenv
+ sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.20.4-SNAPSHOT/bin/setenv
cat /tmp/karaf-0.20.4-SNAPSHOT/bin/setenv
+ echo 'cat /tmp/karaf-0.20.4-SNAPSHOT/bin/setenv'
+ cat /tmp/karaf-0.20.4-SNAPSHOT/bin/setenv
#!/bin/sh
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
#
# handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf
# script: client, instance, shell, start, status, stop, karaf
#
# if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then
# Actions go here...
# fi
#
# general settings which should be applied for all scripts go here; please keep
# in mind that it is possible that scripts might be executed more than once, e.g.
# in example of the start script where the start script is executed first and the
# karaf script afterwards.
#
#
# The following section shows the possible configuration options for the default
# karaf scripts
#
export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk-amd64} # Location of Java installation
# export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration
# export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options
# export EXTRA_JAVA_OPTS # Additional JVM options
# export KARAF_HOME # Karaf home folder
# export KARAF_DATA # Karaf data folder
# export KARAF_BASE # Karaf base folder
# export KARAF_ETC # Karaf etc folder
# export KARAF_LOG # Karaf log folder
# export KARAF_SYSTEM_OPTS # First citizen Karaf options
# export KARAF_OPTS # Additional available Karaf options
# export KARAF_DEBUG # Enable debug mode
# export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start
# export KARAF_NOROOT # Prevent execution as root if set to true
Set Java version
+ echo 'Set Java version'
+ sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-17-openjdk-amd64/bin/java 1
sudo: /usr/sbin/alternatives: command not found
+ sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-17-openjdk-amd64/bin/java
sudo: /usr/sbin/alternatives: command not found
JDK default version ...
+ echo 'JDK default version ...'
+ java -version
openjdk version "11.0.25" 2024-10-15
OpenJDK Runtime Environment (build 11.0.25+9-post-Ubuntu-1ubuntu120.04)
OpenJDK 64-Bit Server VM (build 11.0.25+9-post-Ubuntu-1ubuntu120.04, mixed mode, sharing)
Set JAVA_HOME
+ echo 'Set JAVA_HOME'
+ export JAVA_HOME=/usr/lib/jvm/java-17-openjdk-amd64
+ JAVA_HOME=/usr/lib/jvm/java-17-openjdk-amd64
++ readlink -e /usr/lib/jvm/java-17-openjdk-amd64/bin/java
Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-amd64/bin/java
+ JAVA_RESOLVED=/usr/lib/jvm/java-17-openjdk-amd64/bin/java
+ echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-amd64/bin/java'
Listing all open ports on controller system...
+ echo 'Listing all open ports on controller system...'
+ netstat -pnatu
/tmp/configuration-script.sh: line 40: netstat: command not found
Custom shard config exists!!!
+ '[' -f /tmp/custom_shard_config.txt ']'
+ echo 'Custom shard config exists!!!'
Copying the shard config...
+ echo 'Copying the shard config...'
+ cp /tmp/custom_shard_config.txt /tmp/karaf-0.20.4-SNAPSHOT/bin/
Configuring cluster
+ echo 'Configuring cluster'
+ /tmp/karaf-0.20.4-SNAPSHOT/bin/configure_cluster.sh 1 10.30.171.141 10.30.171.204 10.30.171.35
################################################
## Configure Cluster ##
################################################
NOTE: Cluster configuration files not found. Copying from
/tmp/karaf-0.20.4-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/9.0.6
Configuring unique name in akka.conf
Configuring hostname in akka.conf
Configuring data and rpc seed nodes in akka.conf
modules = [
{
name = "inventory"
namespace = "urn:opendaylight:inventory"
shard-strategy = "module"
},
{
name = "topology"
namespace = "urn:TBD:params:xml:ns:yang:network-topology"
shard-strategy = "module"
},
{
name = "toaster"
namespace = "http://netconfcentral.org/ns/toaster"
shard-strategy = "module"
},
{
name = "car"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
shard-strategy = "module"
},
{
name = "people"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
shard-strategy = "module"
},
{
name = "car-people"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
shard-strategy = "module"
}
]
Configuring replication type in module-shards.conf
################################################
## NOTE: Manually restart controller to ##
## apply configuration. ##
################################################
Dump akka.conf
+ echo 'Dump akka.conf'
+ cat /tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/akka.conf
odl-cluster-data {
akka {
remote {
artery {
enabled = on
transport = tcp
canonical.hostname = "10.30.171.141"
canonical.port = 2550
}
}
cluster {
# Using artery.
seed-nodes = ["akka://opendaylight-cluster-data@10.30.171.141:2550",
"akka://opendaylight-cluster-data@10.30.171.204:2550",
"akka://opendaylight-cluster-data@10.30.171.35:2550"]
roles = ["member-1"]
# when under load we might trip a false positive on the failure detector
# failure-detector {
# heartbeat-interval = 4 s
# acceptable-heartbeat-pause = 16s
# }
}
persistence {
# By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by
# modifying the following two properties. The directory location specified may be a relative or absolute path.
# The relative path is always relative to KARAF_HOME.
# snapshot-store.local.dir = "target/snapshots"
# Use lz4 compression for LocalSnapshotStore snapshots
snapshot-store.local.use-lz4-compression = false
# Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB
snapshot-store.local.lz4-blocksize = 256KB
}
disable-default-actor-system-quarantined-event-handling = "false"
}
}
Dump modules.conf
+ echo 'Dump modules.conf'
+ cat /tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/modules.conf
modules = [
{
name = "inventory"
namespace = "urn:opendaylight:inventory"
shard-strategy = "module"
},
{
name = "topology"
namespace = "urn:TBD:params:xml:ns:yang:network-topology"
shard-strategy = "module"
},
{
name = "toaster"
namespace = "http://netconfcentral.org/ns/toaster"
shard-strategy = "module"
},
{
name = "car"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
shard-strategy = "module"
},
{
name = "people"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
shard-strategy = "module"
},
{
name = "car-people"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
shard-strategy = "module"
}
]
Dump module-shards.conf
+ echo 'Dump module-shards.conf'
+ cat /tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/module-shards.conf
module-shards = [
{
name = "default"
shards = [
{
name = "default"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "inventory"
shards = [
{
name="inventory"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "topology"
shards = [
{
name="topology"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "toaster"
shards = [
{
name="toaster"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "car"
shards = [
{
name="car"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "people"
shards = [
{
name="people"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "car-people"
shards = [
{
name="car-people"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
}
]
Configuring member-2 with IP address 10.30.171.204
Warning: Permanently added '10.30.171.204' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.171.204' (ECDSA) to the list of known hosts.
+ source /tmp/common-functions.sh karaf-0.20.4-SNAPSHOT
common-functions.sh is being sourced
++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]]
++ echo 'common-functions.sh is being sourced'
++ BUNDLEFOLDER=karaf-0.20.4-SNAPSHOT
++ export MAVENCONF=/tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
++ MAVENCONF=/tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
++ export FEATURESCONF=/tmp/karaf-0.20.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
++ FEATURESCONF=/tmp/karaf-0.20.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
++ export CUSTOMPROP=/tmp/karaf-0.20.4-SNAPSHOT/etc/custom.properties
++ CUSTOMPROP=/tmp/karaf-0.20.4-SNAPSHOT/etc/custom.properties
++ export LOGCONF=/tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
++ LOGCONF=/tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
++ export MEMCONF=/tmp/karaf-0.20.4-SNAPSHOT/bin/setenv
++ MEMCONF=/tmp/karaf-0.20.4-SNAPSHOT/bin/setenv
++ export CONTROLLERMEM=
++ CONTROLLERMEM=
++ export AKKACONF=/tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/akka.conf
++ AKKACONF=/tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/akka.conf
++ export MODULESCONF=/tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/modules.conf
++ MODULESCONF=/tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/modules.conf
++ export MODULESHARDSCONF=/tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/module-shards.conf
++ MODULESHARDSCONF=/tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/module-shards.conf
++ print_common_env
++ cat
common-functions environment:
MAVENCONF: /tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
ACTUALFEATURES:
FEATURESCONF: /tmp/karaf-0.20.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
CUSTOMPROP: /tmp/karaf-0.20.4-SNAPSHOT/etc/custom.properties
LOGCONF: /tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
MEMCONF: /tmp/karaf-0.20.4-SNAPSHOT/bin/setenv
CONTROLLERMEM:
AKKACONF: /tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/akka.conf
MODULESCONF: /tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/modules.conf
MODULESHARDSCONF: /tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/module-shards.conf
SUITES:
++ SSH='ssh -t -t'
++ extra_services_cntl=' dnsmasq.service httpd.service libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service rabbitmq-server.service '
++ extra_services_cmp=' libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service '
Changing to /tmp
Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.4-SNAPSHOT/karaf-0.20.4-20250308.204433-450.zip
+ echo 'Changing to /tmp'
+ cd /tmp
+ echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.4-SNAPSHOT/karaf-0.20.4-20250308.204433-450.zip'
+ wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.4-SNAPSHOT/karaf-0.20.4-20250308.204433-450.zip
--2025-03-08 23:44:49-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.4-SNAPSHOT/karaf-0.20.4-20250308.204433-450.zip
Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6
Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 234245857 (223M) [application/zip]
Saving to: ‘karaf-0.20.4-20250308.204433-450.zip’
0K ........ ........ ........ ........ ........ ........ 1% 81.1M 3s
3072K ........ ........ ........ ........ ........ ........ 2% 115M 2s
6144K ........ ........ ........ ........ ........ ........ 4% 96.6M 2s
9216K ........ ........ ........ ........ ........ ........ 5% 184M 2s
12288K ........ ........ ........ ........ ........ ........ 6% 178M 2s
15360K ........ ........ ........ ........ ........ ........ 8% 178M 2s
18432K ........ ........ ........ ........ ........ ........ 9% 195M 2s
21504K ........ ........ ........ ........ ........ ........ 10% 218M 1s
24576K ........ ........ ........ ........ ........ ........ 12% 221M 1s
27648K ........ ........ ........ ........ ........ ........ 13% 255M 1s
30720K ........ ........ ........ ........ ........ ........ 14% 241M 1s
33792K ........ ........ ........ ........ ........ ........ 16% 276M 1s
36864K ........ ........ ........ ........ ........ ........ 17% 288M 1s
39936K ........ ........ ........ ........ ........ ........ 18% 319M 1s
43008K ........ ........ ........ ........ ........ ........ 20% 295M 1s
46080K ........ ........ ........ ........ ........ ........ 21% 351M 1s
49152K ........ ........ ........ ........ ........ ........ 22% 365M 1s
52224K ........ ........ ........ ........ ........ ........ 24% 375M 1s
55296K ........ ........ ........ ........ ........ ........ 25% 386M 1s
58368K ........ ........ ........ ........ ........ ........ 26% 361M 1s
61440K ........ ........ ........ ........ ........ ........ 28% 371M 1s
64512K ........ ........ ........ ........ ........ ........ 29% 344M 1s
67584K ........ ........ ........ ........ ........ ........ 30% 340M 1s
70656K ........ ........ ........ ........ ........ ........ 32% 353M 1s
73728K ........ ........ ........ ........ ........ ........ 33% 360M 1s
76800K ........ ........ ........ ........ ........ ........ 34% 345M 1s
79872K ........ ........ ........ ........ ........ ........ 36% 352M 1s
82944K ........ ........ ........ ........ ........ ........ 37% 358M 1s
86016K ........ ........ ........ ........ ........ ........ 38% 344M 1s
89088K ........ ........ ........ ........ ........ ........ 40% 342M 1s
92160K ........ ........ ........ ........ ........ ........ 41% 364M 1s
95232K ........ ........ ........ ........ ........ ........ 42% 306M 1s
98304K ........ ........ ........ ........ ........ ........ 44% 303M 1s
101376K ........ ........ ........ ........ ........ ........ 45% 333M 0s
104448K ........ ........ ........ ........ ........ ........ 47% 331M 0s
107520K ........ ........ ........ ........ ........ ........ 48% 261M 0s
110592K ........ ........ ........ ........ ........ ........ 49% 305M 0s
113664K ........ ........ ........ ........ ........ ........ 51% 320M 0s
116736K ........ ........ ........ ........ ........ ........ 52% 272M 0s
119808K ........ ........ ........ ........ ........ ........ 53% 296M 0s
122880K ........ ........ ........ ........ ........ ........ 55% 286M 0s
125952K ........ ........ ........ ........ ........ ........ 56% 272M 0s
129024K ........ ........ ........ ........ ........ ........ 57% 252M 0s
132096K ........ ........ ........ ........ ........ ........ 59% 259M 0s
135168K ........ ........ ........ ........ ........ ........ 60% 318M 0s
138240K ........ ........ ........ ........ ........ ........ 61% 267M 0s
141312K ........ ........ ........ ........ ........ ........ 63% 305M 0s
144384K ........ ........ ........ ........ ........ ........ 64% 248M 0s
147456K ........ ........ ........ ........ ........ ........ 65% 323M 0s
150528K ........ ........ ........ ........ ........ ........ 67% 274M 0s
153600K ........ ........ ........ ........ ........ ........ 68% 289M 0s
156672K ........ ........ ........ ........ ........ ........ 69% 323M 0s
159744K ........ ........ ........ ........ ........ ........ 71% 339M 0s
162816K ........ ........ ........ ........ ........ ........ 72% 312M 0s
165888K ........ ........ ........ ........ ........ ........ 73% 350M 0s
168960K ........ ........ ........ ........ ........ ........ 75% 338M 0s
172032K ........ ........ ........ ........ ........ ........ 76% 342M 0s
175104K ........ ........ ........ ........ ........ ........ 77% 328M 0s
178176K ........ ........ ........ ........ ........ ........ 79% 339M 0s
181248K ........ ........ ........ ........ ........ ........ 80% 335M 0s
184320K ........ ........ ........ ........ ........ ........ 81% 351M 0s
187392K ........ ........ ........ ........ ........ ........ 83% 266M 0s
190464K ........ ........ ........ ........ ........ ........ 84% 247M 0s
193536K ........ ........ ........ ........ ........ ........ 85% 246M 0s
196608K ........ ........ ........ ........ ........ ........ 87% 287M 0s
199680K ........ ........ ........ ........ ........ ........ 88% 254M 0s
202752K ........ ........ ........ ........ ........ ........ 89% 260M 0s
205824K ........ ........ ........ ........ ........ ........ 91% 315M 0s
208896K ........ ........ ........ ........ ........ ........ 92% 331M 0s
211968K ........ ........ ........ ........ ........ ........ 94% 336M 0s
215040K ........ ........ ........ ........ ........ ........ 95% 277M 0s
218112K ........ ........ ........ ........ ........ ........ 96% 269M 0s
221184K ........ ........ ........ ........ ........ ........ 98% 231M 0s
224256K ........ ........ ........ ........ ........ ........ 99% 244M 0s
227328K ........ ........ ...... 100% 242M=0.8s
2025-03-08 23:44:50 (268 MB/s) - ‘karaf-0.20.4-20250308.204433-450.zip’ saved [234245857/234245857]
Extracting the new controller...
+ echo 'Extracting the new controller...'
+ unzip -q karaf-0.20.4-20250308.204433-450.zip
Adding external repositories...
+ echo 'Adding external repositories...'
+ sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
+ cat /tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
################################################################################
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
################################################################################
#
# If set to true, the following property will not allow any certificate to be used
# when accessing Maven repositories through SSL
#
#org.ops4j.pax.url.mvn.certificateCheck=
#
# Path to the local Maven settings file.
# The repositories defined in this file will be automatically added to the list
# of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property
# below is not set.
# The following locations are checked for the existence of the settings.xml file
# * 1. looks for the specified url
# * 2. if not found looks for ${user.home}/.m2/settings.xml
# * 3. if not found looks for ${maven.home}/conf/settings.xml
# * 4. if not found looks for ${M2_HOME}/conf/settings.xml
#
#org.ops4j.pax.url.mvn.settings=
#
# Path to the local Maven repository which is used to avoid downloading
# artifacts when they already exist locally.
# The value of this property will be extracted from the settings.xml file
# above, or defaulted to:
# System.getProperty( "user.home" ) + "/.m2/repository"
#
org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository}
#
# Default this to false. It's just weird to use undocumented repos
#
org.ops4j.pax.url.mvn.useFallbackRepositories=false
#
# Uncomment if you don't wanna use the proxy settings
# from the Maven conf/settings.xml file
#
# org.ops4j.pax.url.mvn.proxySupport=false
#
# Comma separated list of repositories scanned when resolving an artifact.
# Those repositories will be checked before iterating through the
# below list of repositories and even before the local repository
# A repository url can be appended with zero or more of the following flags:
# @snapshots : the repository contains snaphots
# @noreleases : the repository does not contain any released artifacts
#
# The following property value will add the system folder as a repo.
#
org.ops4j.pax.url.mvn.defaultRepositories=\
file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\
file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\
file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots
# Use the default local repo (e.g.~/.m2/repository) as a "remote" repo
#org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false
#
# Comma separated list of repositories scanned when resolving an artifact.
# The default list includes the following repositories:
# http://repo1.maven.org/maven2@id=central
# http://repository.springsource.com/maven/bundles/release@id=spring.ebr
# http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external
# http://zodiac.springsource.com/maven/bundles/release@id=gemini
# http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases
# https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases
# https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
# To add repositories to the default ones, prepend '+' to the list of repositories
# to add.
# A repository url can be appended with zero or more of the following flags:
# @snapshots : the repository contains snapshots
# @noreleases : the repository does not contain any released artifacts
# @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended
#
org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.Configuring the startup features...
+ [[ True == \T\r\u\e ]]
+ echo 'Configuring the startup features...'
+ sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.20.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
+ FEATURE_TEST_STRING=features-test
+ FEATURE_TEST_VERSION=0.20.4-SNAPSHOT
+ KARAF_VERSION=karaf4
+ [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]]
+ sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.20.4-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.20.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
+ [[ ! -z '' ]]
+ cat /tmp/karaf-0.20.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
################################################################################
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
################################################################################
#
# Comma separated list of features repositories to register by default
#
featuresRepositories = mvn:org.opendaylight.integration/features-test/0.20.4-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/99092f2f-6abe-4b43-a24a-61818b2aa266.xml
#
# Comma separated list of features to install at startup
#
featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, d870963f-35a0-4302-91e8-aa6c8147a79f
#
# Resource repositories (OBR) that the features resolver can use
# to resolve requirements/capabilities
#
# The format of the resourceRepositories is
# resourceRepositories=[xml:url|json:url],...
# for Instance:
#
#resourceRepositories=xml:http://host/path/to/index.xml
# or
#resourceRepositories=json:http://host/path/to/index.json
#
#
# Defines if the boot features are started in asynchronous mode (in a dedicated thread)
#
featuresBootAsynchronous=false
#
# Service requirements enforcement
#
# By default, the feature resolver checks the service requirements/capabilities of
# bundles for new features (xml schema >= 1.3.0) in order to automatically installs
# the required bundles.
# The following flag can have those values:
# - disable: service requirements are completely ignored
# - default: service requirements are ignored for old features
# - enforce: service requirements are always verified
#
#serviceRequirements=default
#
# Store cfg file for config element in feature
#
#configCfgStore=true
#
# Define if the feature service automatically refresh bundles
#
autoRefresh=true
#
# Configuration of features processing mechanism (overrides, blacklisting, modification of features)
# XML file defines instructions related to features processing
# versions.properties may declare properties to resolve placeholders in XML file
# both files are relative to ${karaf.etc}
#
#featureProcessing=org.apache.karaf.features.xml
#featureProcessingVersions=versions.properties
+ configure_karaf_log karaf4 ''
+ local -r karaf_version=karaf4
+ local -r controllerdebugmap=
+ local logapi=log4j
+ grep log4j2 /tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
log4j2.rootLogger.level = INFO
#log4j2.rootLogger.type = asyncRoot
#log4j2.rootLogger.includeLocation = false
log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
log4j2.rootLogger.appenderRef.Console.ref = Console
log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
log4j2.logger.spifly.name = org.apache.aries.spifly
log4j2.logger.spifly.level = WARN
log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
log4j2.logger.audit.level = INFO
log4j2.logger.audit.additivity = false
log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
# Console appender not used by default (see log4j2.rootLogger.appenderRefs)
log4j2.appender.console.type = Console
log4j2.appender.console.name = Console
log4j2.appender.console.layout.type = PatternLayout
log4j2.appender.console.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.type = RollingRandomAccessFile
log4j2.appender.rolling.name = RollingFile
log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
#log4j2.appender.rolling.immediateFlush = false
log4j2.appender.rolling.append = true
log4j2.appender.rolling.layout.type = PatternLayout
log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.policies.type = Policies
log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.rolling.policies.size.size = 64MB
log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
log4j2.appender.rolling.strategy.max = 7
log4j2.appender.audit.type = RollingRandomAccessFile
log4j2.appender.audit.name = AuditRollingFile
log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
log4j2.appender.audit.append = true
log4j2.appender.audit.layout.type = PatternLayout
log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
log4j2.appender.audit.policies.type = Policies
log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.audit.policies.size.size = 8MB
log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
log4j2.appender.audit.strategy.max = 7
log4j2.appender.osgi.type = PaxOsgi
log4j2.appender.osgi.name = PaxOsgi
log4j2.appender.osgi.filter = *
#log4j2.logger.aether.name = shaded.org.eclipse.aether
#log4j2.logger.aether.level = TRACE
#log4j2.logger.http-headers.name = shaded.org.apache.http.headers
#log4j2.logger.http-headers.level = DEBUG
#log4j2.logger.maven.name = org.ops4j.pax.url.mvn
#log4j2.logger.maven.level = TRACE
Configuring the karaf log... karaf_version: karaf4, logapi: log4j2
+ logapi=log4j2
+ echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2'
+ '[' log4j2 == log4j2 ']'
+ sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
+ orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver
+ orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver
+ echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN'
controllerdebugmap:
cat /tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
+ echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN'
+ unset IFS
+ echo 'controllerdebugmap: '
+ '[' -n '' ']'
+ echo 'cat /tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg'
+ cat /tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
################################################################################
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
################################################################################
# Common pattern layout for appenders
log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
# Root logger
log4j2.rootLogger.level = INFO
# uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library
#log4j2.rootLogger.type = asyncRoot
#log4j2.rootLogger.includeLocation = false
log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
log4j2.rootLogger.appenderRef.Console.ref = Console
log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
# Filters for logs marked by org.opendaylight.odlparent.Markers
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
# Loggers configuration
# Spifly logger
log4j2.logger.spifly.name = org.apache.aries.spifly
log4j2.logger.spifly.level = WARN
# Security audit logger
log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
log4j2.logger.audit.level = INFO
log4j2.logger.audit.additivity = false
log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
# Appenders configuration
# Console appender not used by default (see log4j2.rootLogger.appenderRefs)
log4j2.appender.console.type = Console
log4j2.appender.console.name = Console
log4j2.appender.console.layout.type = PatternLayout
log4j2.appender.console.layout.pattern = ${log4j2.pattern}
# Rolling file appender
log4j2.appender.rolling.type = RollingRandomAccessFile
log4j2.appender.rolling.name = RollingFile
log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
# uncomment to not force a disk flush
#log4j2.appender.rolling.immediateFlush = false
log4j2.appender.rolling.append = true
log4j2.appender.rolling.layout.type = PatternLayout
log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.policies.type = Policies
log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.rolling.policies.size.size = 1GB
log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
log4j2.appender.rolling.strategy.max = 7
# Audit file appender
log4j2.appender.audit.type = RollingRandomAccessFile
log4j2.appender.audit.name = AuditRollingFile
log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
log4j2.appender.audit.append = true
log4j2.appender.audit.layout.type = PatternLayout
log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
log4j2.appender.audit.policies.type = Policies
log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.audit.policies.size.size = 8MB
log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
log4j2.appender.audit.strategy.max = 7
# OSGi appender
log4j2.appender.osgi.type = PaxOsgi
log4j2.appender.osgi.name = PaxOsgi
log4j2.appender.osgi.filter = *
# help with identification of maven-related problems with pax-url-aether
#log4j2.logger.aether.name = shaded.org.eclipse.aether
#log4j2.logger.aether.level = TRACE
#log4j2.logger.http-headers.name = shaded.org.apache.http.headers
#log4j2.logger.http-headers.level = DEBUG
#log4j2.logger.maven.name = org.ops4j.pax.url.mvn
#log4j2.logger.maven.level = TRACE
log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN
log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN
Configure
java home: /usr/lib/jvm/java-17-openjdk-amd64
max memory: 3072m
memconf: /tmp/karaf-0.20.4-SNAPSHOT/bin/setenv
+ set_java_vars /usr/lib/jvm/java-17-openjdk-amd64 3072m /tmp/karaf-0.20.4-SNAPSHOT/bin/setenv
+ local -r java_home=/usr/lib/jvm/java-17-openjdk-amd64
+ local -r controllermem=3072m
+ local -r memconf=/tmp/karaf-0.20.4-SNAPSHOT/bin/setenv
+ echo Configure
+ echo ' java home: /usr/lib/jvm/java-17-openjdk-amd64'
+ echo ' max memory: 3072m'
+ echo ' memconf: /tmp/karaf-0.20.4-SNAPSHOT/bin/setenv'
+ sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk-amd64}%g' /tmp/karaf-0.20.4-SNAPSHOT/bin/setenv
+ sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.20.4-SNAPSHOT/bin/setenv
cat /tmp/karaf-0.20.4-SNAPSHOT/bin/setenv
+ echo 'cat /tmp/karaf-0.20.4-SNAPSHOT/bin/setenv'
+ cat /tmp/karaf-0.20.4-SNAPSHOT/bin/setenv
#!/bin/sh
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
#
# handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf
# script: client, instance, shell, start, status, stop, karaf
#
# if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then
# Actions go here...
# fi
#
# general settings which should be applied for all scripts go here; please keep
# in mind that it is possible that scripts might be executed more than once, e.g.
# in example of the start script where the start script is executed first and the
# karaf script afterwards.
#
#
# The following section shows the possible configuration options for the default
# karaf scripts
#
export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk-amd64} # Location of Java installation
# export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration
# export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options
# export EXTRA_JAVA_OPTS # Additional JVM options
# export KARAF_HOME # Karaf home folder
# export KARAF_DATA # Karaf data folder
# export KARAF_BASE # Karaf base folder
# export KARAF_ETC # Karaf etc folder
# export KARAF_LOG # Karaf log folder
# export KARAF_SYSTEM_OPTS # First citizen Karaf options
# export KARAF_OPTS # Additional available Karaf options
# export KARAF_DEBUG # Enable debug mode
# export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start
# export KARAF_NOROOT # Prevent execution as root if set to true
Set Java version
+ echo 'Set Java version'
+ sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-17-openjdk-amd64/bin/java 1
sudo: /usr/sbin/alternatives: command not found
+ sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-17-openjdk-amd64/bin/java
sudo: /usr/sbin/alternatives: command not found
JDK default version ...
+ echo 'JDK default version ...'
+ java -version
openjdk version "11.0.25" 2024-10-15
OpenJDK Runtime Environment (build 11.0.25+9-post-Ubuntu-1ubuntu120.04)
OpenJDK 64-Bit Server VM (build 11.0.25+9-post-Ubuntu-1ubuntu120.04, mixed mode, sharing)
Set JAVA_HOME
+ echo 'Set JAVA_HOME'
+ export JAVA_HOME=/usr/lib/jvm/java-17-openjdk-amd64
+ JAVA_HOME=/usr/lib/jvm/java-17-openjdk-amd64
++ readlink -e /usr/lib/jvm/java-17-openjdk-amd64/bin/java
Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-amd64/bin/java
Listing all open ports on controller system...
+ JAVA_RESOLVED=/usr/lib/jvm/java-17-openjdk-amd64/bin/java
+ echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-amd64/bin/java'
+ echo 'Listing all open ports on controller system...'
+ netstat -pnatu
/tmp/configuration-script.sh: line 40: netstat: command not found
Custom shard config exists!!!
+ '[' -f /tmp/custom_shard_config.txt ']'
+ echo 'Custom shard config exists!!!'
Copying the shard config...
+ echo 'Copying the shard config...'
+ cp /tmp/custom_shard_config.txt /tmp/karaf-0.20.4-SNAPSHOT/bin/
Configuring cluster
+ echo 'Configuring cluster'
+ /tmp/karaf-0.20.4-SNAPSHOT/bin/configure_cluster.sh 2 10.30.171.141 10.30.171.204 10.30.171.35
################################################
## Configure Cluster ##
################################################
NOTE: Cluster configuration files not found. Copying from
/tmp/karaf-0.20.4-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/9.0.6
Configuring unique name in akka.conf
Configuring hostname in akka.conf
Configuring data and rpc seed nodes in akka.conf
modules = [
{
name = "inventory"
namespace = "urn:opendaylight:inventory"
shard-strategy = "module"
},
{
name = "topology"
namespace = "urn:TBD:params:xml:ns:yang:network-topology"
shard-strategy = "module"
},
{
name = "toaster"
namespace = "http://netconfcentral.org/ns/toaster"
shard-strategy = "module"
},
{
name = "car"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
shard-strategy = "module"
},
{
name = "people"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
shard-strategy = "module"
},
{
name = "car-people"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
shard-strategy = "module"
}
]
Configuring replication type in module-shards.conf
################################################
## NOTE: Manually restart controller to ##
## apply configuration. ##
################################################
Dump akka.conf
+ echo 'Dump akka.conf'
+ cat /tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/akka.conf
odl-cluster-data {
akka {
remote {
artery {
enabled = on
transport = tcp
canonical.hostname = "10.30.171.204"
canonical.port = 2550
}
}
cluster {
# Using artery.
seed-nodes = ["akka://opendaylight-cluster-data@10.30.171.141:2550",
"akka://opendaylight-cluster-data@10.30.171.204:2550",
"akka://opendaylight-cluster-data@10.30.171.35:2550"]
roles = ["member-2"]
# when under load we might trip a false positive on the failure detector
# failure-detector {
# heartbeat-interval = 4 s
# acceptable-heartbeat-pause = 16s
# }
}
persistence {
# By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by
# modifying the following two properties. The directory location specified may be a relative or absolute path.
# The relative path is always relative to KARAF_HOME.
# snapshot-store.local.dir = "target/snapshots"
# Use lz4 compression for LocalSnapshotStore snapshots
snapshot-store.local.use-lz4-compression = false
# Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB
snapshot-store.local.lz4-blocksize = 256KB
}
disable-default-actor-system-quarantined-event-handling = "false"
}
}
Dump modules.conf
+ echo 'Dump modules.conf'
+ cat /tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/modules.conf
modules = [
{
name = "inventory"
namespace = "urn:opendaylight:inventory"
shard-strategy = "module"
},
{
name = "topology"
namespace = "urn:TBD:params:xml:ns:yang:network-topology"
shard-strategy = "module"
},
{
name = "toaster"
namespace = "http://netconfcentral.org/ns/toaster"
shard-strategy = "module"
},
{
name = "car"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
shard-strategy = "module"
},
{
name = "people"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
shard-strategy = "module"
},
{
name = "car-people"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
shard-strategy = "module"
}
]
Dump module-shards.conf
+ echo 'Dump module-shards.conf'
+ cat /tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/module-shards.conf
module-shards = [
{
name = "default"
shards = [
{
name = "default"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "inventory"
shards = [
{
name="inventory"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "topology"
shards = [
{
name="topology"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "toaster"
shards = [
{
name="toaster"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "car"
shards = [
{
name="car"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "people"
shards = [
{
name="people"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "car-people"
shards = [
{
name="car-people"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
}
]
Configuring member-3 with IP address 10.30.171.35
Warning: Permanently added '10.30.171.35' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.171.35' (ECDSA) to the list of known hosts.
+ source /tmp/common-functions.sh karaf-0.20.4-SNAPSHOT
common-functions.sh is being sourced
++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]]
++ echo 'common-functions.sh is being sourced'
++ BUNDLEFOLDER=karaf-0.20.4-SNAPSHOT
++ export MAVENCONF=/tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
++ MAVENCONF=/tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
++ export FEATURESCONF=/tmp/karaf-0.20.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
++ FEATURESCONF=/tmp/karaf-0.20.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
++ export CUSTOMPROP=/tmp/karaf-0.20.4-SNAPSHOT/etc/custom.properties
++ CUSTOMPROP=/tmp/karaf-0.20.4-SNAPSHOT/etc/custom.properties
++ export LOGCONF=/tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
++ LOGCONF=/tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
++ export MEMCONF=/tmp/karaf-0.20.4-SNAPSHOT/bin/setenv
++ MEMCONF=/tmp/karaf-0.20.4-SNAPSHOT/bin/setenv
++ export CONTROLLERMEM=
++ CONTROLLERMEM=
++ export AKKACONF=/tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/akka.conf
++ AKKACONF=/tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/akka.conf
++ export MODULESCONF=/tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/modules.conf
++ MODULESCONF=/tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/modules.conf
++ export MODULESHARDSCONF=/tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/module-shards.conf
++ MODULESHARDSCONF=/tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/module-shards.conf
++ print_common_env
++ cat
common-functions environment:
MAVENCONF: /tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
ACTUALFEATURES:
FEATURESCONF: /tmp/karaf-0.20.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
CUSTOMPROP: /tmp/karaf-0.20.4-SNAPSHOT/etc/custom.properties
LOGCONF: /tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
MEMCONF: /tmp/karaf-0.20.4-SNAPSHOT/bin/setenv
CONTROLLERMEM:
AKKACONF: /tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/akka.conf
MODULESCONF: /tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/modules.conf
MODULESHARDSCONF: /tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/module-shards.conf
SUITES:
++ SSH='ssh -t -t'
++ extra_services_cntl=' dnsmasq.service httpd.service libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service rabbitmq-server.service '
++ extra_services_cmp=' libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service '
Changing to /tmp
Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.4-SNAPSHOT/karaf-0.20.4-20250308.204433-450.zip
+ echo 'Changing to /tmp'
+ cd /tmp
+ echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.4-SNAPSHOT/karaf-0.20.4-20250308.204433-450.zip'
+ wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.4-SNAPSHOT/karaf-0.20.4-20250308.204433-450.zip
--2025-03-08 23:44:53-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.4-SNAPSHOT/karaf-0.20.4-20250308.204433-450.zip
Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6
Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 234245857 (223M) [application/zip]
Saving to: ‘karaf-0.20.4-20250308.204433-450.zip’
0K ........ ........ ........ ........ ........ ........ 1% 65.4M 3s
3072K ........ ........ ........ ........ ........ ........ 2% 96.9M 3s
6144K ........ ........ ........ ........ ........ ........ 4% 117M 2s
9216K ........ ........ ........ ........ ........ ........ 5% 111M 2s
12288K ........ ........ ........ ........ ........ ........ 6% 122M 2s
15360K ........ ........ ........ ........ ........ ........ 8% 181M 2s
18432K ........ ........ ........ ........ ........ ........ 9% 198M 2s
21504K ........ ........ ........ ........ ........ ........ 10% 232M 2s
24576K ........ ........ ........ ........ ........ ........ 12% 281M 2s
27648K ........ ........ ........ ........ ........ ........ 13% 278M 1s
30720K ........ ........ ........ ........ ........ ........ 14% 280M 1s
33792K ........ ........ ........ ........ ........ ........ 16% 292M 1s
36864K ........ ........ ........ ........ ........ ........ 17% 297M 1s
39936K ........ ........ ........ ........ ........ ........ 18% 332M 1s
43008K ........ ........ ........ ........ ........ ........ 20% 342M 1s
46080K ........ ........ ........ ........ ........ ........ 21% 352M 1s
49152K ........ ........ ........ ........ ........ ........ 22% 381M 1s
52224K ........ ........ ........ ........ ........ ........ 24% 357M 1s
55296K ........ ........ ........ ........ ........ ........ 25% 306M 1s
58368K ........ ........ ........ ........ ........ ........ 26% 321M 1s
61440K ........ ........ ........ ........ ........ ........ 28% 374M 1s
64512K ........ ........ ........ ........ ........ ........ 29% 378M 1s
67584K ........ ........ ........ ........ ........ ........ 30% 376M 1s
70656K ........ ........ ........ ........ ........ ........ 32% 299M 1s
73728K ........ ........ ........ ........ ........ ........ 33% 321M 1s
76800K ........ ........ ........ ........ ........ ........ 34% 352M 1s
79872K ........ ........ ........ ........ ........ ........ 36% 367M 1s
82944K ........ ........ ........ ........ ........ ........ 37% 361M 1s
86016K ........ ........ ........ ........ ........ ........ 38% 374M 1s
89088K ........ ........ ........ ........ ........ ........ 40% 279M 1s
92160K ........ ........ ........ ........ ........ ........ 41% 324M 1s
95232K ........ ........ ........ ........ ........ ........ 42% 353M 1s
98304K ........ ........ ........ ........ ........ ........ 44% 355M 1s
101376K ........ ........ ........ ........ ........ ........ 45% 368M 1s
104448K ........ ........ ........ ........ ........ ........ 47% 366M 0s
107520K ........ ........ ........ ........ ........ ........ 48% 362M 0s
110592K ........ ........ ........ ........ ........ ........ 49% 304M 0s
113664K ........ ........ ........ ........ ........ ........ 51% 294M 0s
116736K ........ ........ ........ ........ ........ ........ 52% 312M 0s
119808K ........ ........ ........ ........ ........ ........ 53% 374M 0s
122880K ........ ........ ........ ........ ........ ........ 55% 346M 0s
125952K ........ ........ ........ ........ ........ ........ 56% 361M 0s
129024K ........ ........ ........ ........ ........ ........ 57% 344M 0s
132096K ........ ........ ........ ........ ........ ........ 59% 359M 0s
135168K ........ ........ ........ ........ ........ ........ 60% 360M 0s
138240K ........ ........ ........ ........ ........ ........ 61% 318M 0s
141312K ........ ........ ........ ........ ........ ........ 63% 346M 0s
144384K ........ ........ ........ ........ ........ ........ 64% 365M 0s
147456K ........ ........ ........ ........ ........ ........ 65% 307M 0s
150528K ........ ........ ........ ........ ........ ........ 67% 222M 0s
153600K ........ ........ ........ ........ ........ ........ 68% 276M 0s
156672K ........ ........ ........ ........ ........ ........ 69% 337M 0s
159744K ........ ........ ........ ........ ........ ........ 71% 326M 0s
162816K ........ ........ ........ ........ ........ ........ 72% 340M 0s
165888K ........ ........ ........ ........ ........ ........ 73% 339M 0s
168960K ........ ........ ........ ........ ........ ........ 75% 340M 0s
172032K ........ ........ ........ ........ ........ ........ 76% 338M 0s
175104K ........ ........ ........ ........ ........ ........ 77% 339M 0s
178176K ........ ........ ........ ........ ........ ........ 79% 338M 0s
181248K ........ ........ ........ ........ ........ ........ 80% 328M 0s
184320K ........ ........ ........ ........ ........ ........ 81% 339M 0s
187392K ........ ........ ........ ........ ........ ........ 83% 317M 0s
190464K ........ ........ ........ ........ ........ ........ 84% 245M 0s
193536K ........ ........ ........ ........ ........ ........ 85% 246M 0s
196608K ........ ........ ........ ........ ........ ........ 87% 283M 0s
199680K ........ ........ ........ ........ ........ ........ 88% 314M 0s
202752K ........ ........ ........ ........ ........ ........ 89% 329M 0s
205824K ........ ........ ........ ........ ........ ........ 91% 348M 0s
208896K ........ ........ ........ ........ ........ ........ 92% 343M 0s
211968K ........ ........ ........ ........ ........ ........ 94% 334M 0s
215040K ........ ........ ........ ........ ........ ........ 95% 337M 0s
218112K ........ ........ ........ ........ ........ ........ 96% 330M 0s
221184K ........ ........ ........ ........ ........ ........ 98% 325M 0s
224256K ........ ........ ........ ........ ........ ........ 99% 331M 0s
227328K ........ ........ ...... 100% 325M=0.8s
2025-03-08 23:44:54 (276 MB/s) - ‘karaf-0.20.4-20250308.204433-450.zip’ saved [234245857/234245857]
Extracting the new controller...
+ echo 'Extracting the new controller...'
+ unzip -q karaf-0.20.4-20250308.204433-450.zip
Adding external repositories...
+ echo 'Adding external repositories...'
+ sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
+ cat /tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
################################################################################
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
################################################################################
#
# If set to true, the following property will not allow any certificate to be used
# when accessing Maven repositories through SSL
#
#org.ops4j.pax.url.mvn.certificateCheck=
#
# Path to the local Maven settings file.
# The repositories defined in this file will be automatically added to the list
# of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property
# below is not set.
# The following locations are checked for the existence of the settings.xml file
# * 1. looks for the specified url
# * 2. if not found looks for ${user.home}/.m2/settings.xml
# * 3. if not found looks for ${maven.home}/conf/settings.xml
# * 4. if not found looks for ${M2_HOME}/conf/settings.xml
#
#org.ops4j.pax.url.mvn.settings=
#
# Path to the local Maven repository which is used to avoid downloading
# artifacts when they already exist locally.
# The value of this property will be extracted from the settings.xml file
# above, or defaulted to:
# System.getProperty( "user.home" ) + "/.m2/repository"
#
org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository}
#
# Default this to false. It's just weird to use undocumented repos
#
org.ops4j.pax.url.mvn.useFallbackRepositories=false
#
# Uncomment if you don't wanna use the proxy settings
# from the Maven conf/settings.xml file
#
# org.ops4j.pax.url.mvn.proxySupport=false
#
# Comma separated list of repositories scanned when resolving an artifact.
# Those repositories will be checked before iterating through the
# below list of repositories and even before the local repository
# A repository url can be appended with zero or more of the following flags:
# @snapshots : the repository contains snaphots
# @noreleases : the repository does not contain any released artifacts
#
# The following property value will add the system folder as a repo.
#
org.ops4j.pax.url.mvn.defaultRepositories=\
file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\
file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\
file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots
# Use the default local repo (e.g.~/.m2/repository) as a "remote" repo
#org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false
#
# Comma separated list of repositories scanned when resolving an artifact.
# The default list includes the following repositories:
# http://repo1.maven.org/maven2@id=central
# http://repository.springsource.com/maven/bundles/release@id=spring.ebr
# http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external
# http://zodiac.springsource.com/maven/bundles/release@id=gemini
# http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases
# https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases
# https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
# To add repositories to the default ones, prepend '+' to the list of repositories
# to add.
# A repository url can be appended with zero or more of the following flags:
# @snapshots : the repository contains snapshots
# @noreleases : the repository does not contain any released artifacts
# @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended
#
org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.Configuring the startup features...
+ [[ True == \T\r\u\e ]]
+ echo 'Configuring the startup features...'
+ sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.20.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
+ FEATURE_TEST_STRING=features-test
+ FEATURE_TEST_VERSION=0.20.4-SNAPSHOT
+ KARAF_VERSION=karaf4
+ [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]]
+ sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.20.4-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.20.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
+ [[ ! -z '' ]]
+ cat /tmp/karaf-0.20.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
################################################################################
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
################################################################################
#
# Comma separated list of features repositories to register by default
#
featuresRepositories = mvn:org.opendaylight.integration/features-test/0.20.4-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/99092f2f-6abe-4b43-a24a-61818b2aa266.xml
#
# Comma separated list of features to install at startup
#
featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, d870963f-35a0-4302-91e8-aa6c8147a79f
#
# Resource repositories (OBR) that the features resolver can use
# to resolve requirements/capabilities
#
# The format of the resourceRepositories is
# resourceRepositories=[xml:url|json:url],...
# for Instance:
#
#resourceRepositories=xml:http://host/path/to/index.xml
# or
#resourceRepositories=json:http://host/path/to/index.json
#
#
# Defines if the boot features are started in asynchronous mode (in a dedicated thread)
#
featuresBootAsynchronous=false
#
# Service requirements enforcement
#
# By default, the feature resolver checks the service requirements/capabilities of
# bundles for new features (xml schema >= 1.3.0) in order to automatically installs
# the required bundles.
# The following flag can have those values:
# - disable: service requirements are completely ignored
# - default: service requirements are ignored for old features
# - enforce: service requirements are always verified
#
#serviceRequirements=default
#
# Store cfg file for config element in feature
#
#configCfgStore=true
#
# Define if the feature service automatically refresh bundles
#
autoRefresh=true
#
# Configuration of features processing mechanism (overrides, blacklisting, modification of features)
# XML file defines instructions related to features processing
# versions.properties may declare properties to resolve placeholders in XML file
# both files are relative to ${karaf.etc}
#
#featureProcessing=org.apache.karaf.features.xml
#featureProcessingVersions=versions.properties
+ configure_karaf_log karaf4 ''
+ local -r karaf_version=karaf4
+ local -r controllerdebugmap=
+ local logapi=log4j
+ grep log4j2 /tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
log4j2.rootLogger.level = INFO
#log4j2.rootLogger.type = asyncRoot
#log4j2.rootLogger.includeLocation = false
log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
log4j2.rootLogger.appenderRef.Console.ref = Console
log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
log4j2.logger.spifly.name = org.apache.aries.spifly
log4j2.logger.spifly.level = WARN
log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
log4j2.logger.audit.level = INFO
log4j2.logger.audit.additivity = false
log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
# Console appender not used by default (see log4j2.rootLogger.appenderRefs)
log4j2.appender.console.type = Console
log4j2.appender.console.name = Console
log4j2.appender.console.layout.type = PatternLayout
log4j2.appender.console.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.type = RollingRandomAccessFile
log4j2.appender.rolling.name = RollingFile
log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
#log4j2.appender.rolling.immediateFlush = false
log4j2.appender.rolling.append = true
log4j2.appender.rolling.layout.type = PatternLayout
log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.policies.type = Policies
log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.rolling.policies.size.size = 64MB
log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
log4j2.appender.rolling.strategy.max = 7
log4j2.appender.audit.type = RollingRandomAccessFile
log4j2.appender.audit.name = AuditRollingFile
log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
log4j2.appender.audit.append = true
log4j2.appender.audit.layout.type = PatternLayout
log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
log4j2.appender.audit.policies.type = Policies
log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.audit.policies.size.size = 8MB
log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
log4j2.appender.audit.strategy.max = 7
log4j2.appender.osgi.type = PaxOsgi
log4j2.appender.osgi.name = PaxOsgi
log4j2.appender.osgi.filter = *
#log4j2.logger.aether.name = shaded.org.eclipse.aether
#log4j2.logger.aether.level = TRACE
#log4j2.logger.http-headers.name = shaded.org.apache.http.headers
#log4j2.logger.http-headers.level = DEBUG
#log4j2.logger.maven.name = org.ops4j.pax.url.mvn
#log4j2.logger.maven.level = TRACE
+ logapi=log4j2
+ echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2'
Configuring the karaf log... karaf_version: karaf4, logapi: log4j2
+ '[' log4j2 == log4j2 ']'
+ sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
controllerdebugmap:
cat /tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
+ orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver
+ orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver
+ echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN'
+ echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN'
+ unset IFS
+ echo 'controllerdebugmap: '
+ '[' -n '' ']'
+ echo 'cat /tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg'
+ cat /tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
################################################################################
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
################################################################################
# Common pattern layout for appenders
log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
# Root logger
log4j2.rootLogger.level = INFO
# uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library
#log4j2.rootLogger.type = asyncRoot
#log4j2.rootLogger.includeLocation = false
log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
log4j2.rootLogger.appenderRef.Console.ref = Console
log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
# Filters for logs marked by org.opendaylight.odlparent.Markers
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
# Loggers configuration
# Spifly logger
log4j2.logger.spifly.name = org.apache.aries.spifly
log4j2.logger.spifly.level = WARN
# Security audit logger
log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
log4j2.logger.audit.level = INFO
log4j2.logger.audit.additivity = false
log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
# Appenders configuration
# Console appender not used by default (see log4j2.rootLogger.appenderRefs)
log4j2.appender.console.type = Console
log4j2.appender.console.name = Console
log4j2.appender.console.layout.type = PatternLayout
log4j2.appender.console.layout.pattern = ${log4j2.pattern}
# Rolling file appender
log4j2.appender.rolling.type = RollingRandomAccessFile
log4j2.appender.rolling.name = RollingFile
log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
# uncomment to not force a disk flush
#log4j2.appender.rolling.immediateFlush = false
log4j2.appender.rolling.append = true
log4j2.appender.rolling.layout.type = PatternLayout
log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.policies.type = Policies
log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.rolling.policies.size.size = 1GB
log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
log4j2.appender.rolling.strategy.max = 7
# Audit file appender
log4j2.appender.audit.type = RollingRandomAccessFile
log4j2.appender.audit.name = AuditRollingFile
log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
log4j2.appender.audit.append = true
log4j2.appender.audit.layout.type = PatternLayout
log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
log4j2.appender.audit.policies.type = Policies
log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.audit.policies.size.size = 8MB
log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
log4j2.appender.audit.strategy.max = 7
# OSGi appender
log4j2.appender.osgi.type = PaxOsgi
log4j2.appender.osgi.name = PaxOsgi
log4j2.appender.osgi.filter = *
# help with identification of maven-related problems with pax-url-aether
#log4j2.logger.aether.name = shaded.org.eclipse.aether
#log4j2.logger.aether.level = TRACE
#log4j2.logger.http-headers.name = shaded.org.apache.http.headers
#log4j2.logger.http-headers.level = DEBUG
#log4j2.logger.maven.name = org.ops4j.pax.url.mvn
#log4j2.logger.maven.level = TRACE
log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN
log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN
+ set_java_vars /usr/lib/jvm/java-17-openjdk-amd64 3072m /tmp/karaf-0.20.4-SNAPSHOT/bin/setenv
Configure
+ local -r java_home=/usr/lib/jvm/java-17-openjdk-amd64
+ local -r controllermem=3072m
+ local -r memconf=/tmp/karaf-0.20.4-SNAPSHOT/bin/setenv
+ echo Configure
java home: /usr/lib/jvm/java-17-openjdk-amd64
+ echo ' java home: /usr/lib/jvm/java-17-openjdk-amd64'
+ echo ' max memory: 3072m'
max memory: 3072m
memconf: /tmp/karaf-0.20.4-SNAPSHOT/bin/setenv
+ echo ' memconf: /tmp/karaf-0.20.4-SNAPSHOT/bin/setenv'
+ sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk-amd64}%g' /tmp/karaf-0.20.4-SNAPSHOT/bin/setenv
+ sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.20.4-SNAPSHOT/bin/setenv
cat /tmp/karaf-0.20.4-SNAPSHOT/bin/setenv
+ echo 'cat /tmp/karaf-0.20.4-SNAPSHOT/bin/setenv'
+ cat /tmp/karaf-0.20.4-SNAPSHOT/bin/setenv
#!/bin/sh
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
#
# handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf
# script: client, instance, shell, start, status, stop, karaf
#
# if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then
# Actions go here...
# fi
#
# general settings which should be applied for all scripts go here; please keep
# in mind that it is possible that scripts might be executed more than once, e.g.
# in example of the start script where the start script is executed first and the
# karaf script afterwards.
#
#
# The following section shows the possible configuration options for the default
# karaf scripts
#
export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk-amd64} # Location of Java installation
# export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration
# export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options
# export EXTRA_JAVA_OPTS # Additional JVM options
# export KARAF_HOME # Karaf home folder
# export KARAF_DATA # Karaf data folder
# export KARAF_BASE # Karaf base folder
# export KARAF_ETC # Karaf etc folder
# export KARAF_LOG # Karaf log folder
# export KARAF_SYSTEM_OPTS # First citizen Karaf options
# export KARAF_OPTS # Additional available Karaf options
# export KARAF_DEBUG # Enable debug mode
# export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start
# export KARAF_NOROOT # Prevent execution as root if set to true
Set Java version
+ echo 'Set Java version'
+ sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-17-openjdk-amd64/bin/java 1
sudo: /usr/sbin/alternatives: command not found
+ sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-17-openjdk-amd64/bin/java
sudo: /usr/sbin/alternatives: command not found
JDK default version ...
+ echo 'JDK default version ...'
+ java -version
openjdk version "11.0.25" 2024-10-15
OpenJDK Runtime Environment (build 11.0.25+9-post-Ubuntu-1ubuntu120.04)
OpenJDK 64-Bit Server VM (build 11.0.25+9-post-Ubuntu-1ubuntu120.04, mixed mode, sharing)
Set JAVA_HOME
+ echo 'Set JAVA_HOME'
+ export JAVA_HOME=/usr/lib/jvm/java-17-openjdk-amd64
+ JAVA_HOME=/usr/lib/jvm/java-17-openjdk-amd64
++ readlink -e /usr/lib/jvm/java-17-openjdk-amd64/bin/java
Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-amd64/bin/java
Listing all open ports on controller system...
+ JAVA_RESOLVED=/usr/lib/jvm/java-17-openjdk-amd64/bin/java
+ echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-amd64/bin/java'
+ echo 'Listing all open ports on controller system...'
+ netstat -pnatu
/tmp/configuration-script.sh: line 40: netstat: command not found
Custom shard config exists!!!
+ '[' -f /tmp/custom_shard_config.txt ']'
+ echo 'Custom shard config exists!!!'
+ echo 'Copying the shard config...'
Copying the shard config...
+ cp /tmp/custom_shard_config.txt /tmp/karaf-0.20.4-SNAPSHOT/bin/
Configuring cluster
+ echo 'Configuring cluster'
+ /tmp/karaf-0.20.4-SNAPSHOT/bin/configure_cluster.sh 3 10.30.171.141 10.30.171.204 10.30.171.35
################################################
## Configure Cluster ##
################################################
NOTE: Cluster configuration files not found. Copying from
/tmp/karaf-0.20.4-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/9.0.6
Configuring unique name in akka.conf
Configuring hostname in akka.conf
Configuring data and rpc seed nodes in akka.conf
modules = [
{
name = "inventory"
namespace = "urn:opendaylight:inventory"
shard-strategy = "module"
},
{
name = "topology"
namespace = "urn:TBD:params:xml:ns:yang:network-topology"
shard-strategy = "module"
},
{
name = "toaster"
namespace = "http://netconfcentral.org/ns/toaster"
shard-strategy = "module"
},
{
name = "car"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
shard-strategy = "module"
},
{
name = "people"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
shard-strategy = "module"
},
{
name = "car-people"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
shard-strategy = "module"
}
]
Configuring replication type in module-shards.conf
################################################
## NOTE: Manually restart controller to ##
## apply configuration. ##
################################################
Dump akka.conf
+ echo 'Dump akka.conf'
+ cat /tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/akka.conf
odl-cluster-data {
akka {
remote {
artery {
enabled = on
transport = tcp
canonical.hostname = "10.30.171.35"
canonical.port = 2550
}
}
cluster {
# Using artery.
seed-nodes = ["akka://opendaylight-cluster-data@10.30.171.141:2550",
"akka://opendaylight-cluster-data@10.30.171.204:2550",
"akka://opendaylight-cluster-data@10.30.171.35:2550"]
roles = ["member-3"]
# when under load we might trip a false positive on the failure detector
# failure-detector {
# heartbeat-interval = 4 s
# acceptable-heartbeat-pause = 16s
# }
}
persistence {
# By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by
# modifying the following two properties. The directory location specified may be a relative or absolute path.
# The relative path is always relative to KARAF_HOME.
# snapshot-store.local.dir = "target/snapshots"
# Use lz4 compression for LocalSnapshotStore snapshots
snapshot-store.local.use-lz4-compression = false
# Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB
snapshot-store.local.lz4-blocksize = 256KB
}
disable-default-actor-system-quarantined-event-handling = "false"
}
}
Dump modules.conf
+ echo 'Dump modules.conf'
+ cat /tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/modules.conf
modules = [
{
name = "inventory"
namespace = "urn:opendaylight:inventory"
shard-strategy = "module"
},
{
name = "topology"
namespace = "urn:TBD:params:xml:ns:yang:network-topology"
shard-strategy = "module"
},
{
name = "toaster"
namespace = "http://netconfcentral.org/ns/toaster"
shard-strategy = "module"
},
{
name = "car"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
shard-strategy = "module"
},
{
name = "people"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
shard-strategy = "module"
},
{
name = "car-people"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
shard-strategy = "module"
}
]
Dump module-shards.conf
+ echo 'Dump module-shards.conf'
+ cat /tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/module-shards.conf
module-shards = [
{
name = "default"
shards = [
{
name = "default"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "inventory"
shards = [
{
name="inventory"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "topology"
shards = [
{
name="topology"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "toaster"
shards = [
{
name="toaster"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "car"
shards = [
{
name="car"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "people"
shards = [
{
name="people"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "car-people"
shards = [
{
name="car-people"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
}
]
Locating config plan to use...
Finished running config plans
Starting member-1 with IP address 10.30.171.141
Warning: Permanently added '10.30.171.141' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.171.141' (ECDSA) to the list of known hosts.
Redirecting karaf console output to karaf_console.log
Starting controller...
start: Redirecting Karaf output to /tmp/karaf-0.20.4-SNAPSHOT/data/log/karaf_console.log
Starting member-2 with IP address 10.30.171.204
Warning: Permanently added '10.30.171.204' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.171.204' (ECDSA) to the list of known hosts.
Redirecting karaf console output to karaf_console.log
Starting controller...
start: Redirecting Karaf output to /tmp/karaf-0.20.4-SNAPSHOT/data/log/karaf_console.log
Starting member-3 with IP address 10.30.171.35
Warning: Permanently added '10.30.171.35' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.171.35' (ECDSA) to the list of known hosts.
Redirecting karaf console output to karaf_console.log
Starting controller...
start: Redirecting Karaf output to /tmp/karaf-0.20.4-SNAPSHOT/data/log/karaf_console.log
[controller-csit-3node-clustering-tell-all-calcium] $ /bin/bash /tmp/jenkins18014242530038708512.sh
common-functions.sh is being sourced
common-functions environment:
MAVENCONF: /tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
ACTUALFEATURES:
FEATURESCONF: /tmp/karaf-0.20.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
CUSTOMPROP: /tmp/karaf-0.20.4-SNAPSHOT/etc/custom.properties
LOGCONF: /tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
MEMCONF: /tmp/karaf-0.20.4-SNAPSHOT/bin/setenv
CONTROLLERMEM: 2048m
AKKACONF: /tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/akka.conf
MODULESCONF: /tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/modules.conf
MODULESHARDSCONF: /tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/module-shards.conf
SUITES:
+ echo '#################################################'
#################################################
+ echo '## Verify Cluster is UP ##'
## Verify Cluster is UP ##
+ echo '#################################################'
#################################################
+ create_post_startup_script
+ cat
+ copy_and_run_post_startup_script
+ seed_index=1
++ seq 1 3
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_1_IP
+ echo 'Execute the post startup script on controller 10.30.171.141'
Execute the post startup script on controller 10.30.171.141
+ scp /w/workspace/controller-csit-3node-clustering-tell-all-calcium/post-startup-script.sh 10.30.171.141:/tmp/
Warning: Permanently added '10.30.171.141' (ECDSA) to the list of known hosts.
+ ssh 10.30.171.141 'bash /tmp/post-startup-script.sh 1'
Warning: Permanently added '10.30.171.141' (ECDSA) to the list of known hosts.
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
Waiting up to 3 minutes for controller to come up, checking every 5 seconds...
2025-03-08T23:45:51,124 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 297 - org.opendaylight.infrautils.ready-api - 6.0.11 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
Controller is UP
2025-03-08T23:45:51,124 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 297 - org.opendaylight.infrautils.ready-api - 6.0.11 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
Listing all open ports on controller system...
/tmp/post-startup-script.sh: line 51: netstat: command not found
looking for "BindException: Address already in use" in log file
looking for "server is unhealthy" in log file
+ '[' 1 == 0 ']'
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_2_IP
+ echo 'Execute the post startup script on controller 10.30.171.204'
Execute the post startup script on controller 10.30.171.204
+ scp /w/workspace/controller-csit-3node-clustering-tell-all-calcium/post-startup-script.sh 10.30.171.204:/tmp/
Warning: Permanently added '10.30.171.204' (ECDSA) to the list of known hosts.
+ ssh 10.30.171.204 'bash /tmp/post-startup-script.sh 2'
Warning: Permanently added '10.30.171.204' (ECDSA) to the list of known hosts.
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
Waiting up to 3 minutes for controller to come up, checking every 5 seconds...
2025-03-08T23:45:51,270 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 297 - org.opendaylight.infrautils.ready-api - 6.0.11 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
Controller is UP
2025-03-08T23:45:51,270 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 297 - org.opendaylight.infrautils.ready-api - 6.0.11 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
Listing all open ports on controller system...
/tmp/post-startup-script.sh: line 51: netstat: command not found
looking for "BindException: Address already in use" in log file
looking for "server is unhealthy" in log file
+ '[' 2 == 0 ']'
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_3_IP
+ echo 'Execute the post startup script on controller 10.30.171.35'
Execute the post startup script on controller 10.30.171.35
+ scp /w/workspace/controller-csit-3node-clustering-tell-all-calcium/post-startup-script.sh 10.30.171.35:/tmp/
Warning: Permanently added '10.30.171.35' (ECDSA) to the list of known hosts.
+ ssh 10.30.171.35 'bash /tmp/post-startup-script.sh 3'
Warning: Permanently added '10.30.171.35' (ECDSA) to the list of known hosts.
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
Waiting up to 3 minutes for controller to come up, checking every 5 seconds...
2025-03-08T23:45:51,887 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 297 - org.opendaylight.infrautils.ready-api - 6.0.11 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
Controller is UP
2025-03-08T23:45:51,887 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 297 - org.opendaylight.infrautils.ready-api - 6.0.11 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
Listing all open ports on controller system...
/tmp/post-startup-script.sh: line 51: netstat: command not found
looking for "BindException: Address already in use" in log file
looking for "server is unhealthy" in log file
+ '[' 0 == 0 ']'
+ seed_index=1
+ dump_controller_threads
++ seq 1 3
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_1_IP
+ echo 'Let'\''s take the karaf thread dump'
Let's take the karaf thread dump
+ ssh 10.30.171.141 'sudo ps aux'
Warning: Permanently added '10.30.171.141' (ECDSA) to the list of known hosts.
++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-calcium/ps_before.log
++ grep -v grep
++ tr -s ' '
++ cut -f2 '-d '
+ pid=28756
+ echo 'karaf main: org.apache.karaf.main.Main, pid:28756'
karaf main: org.apache.karaf.main.Main, pid:28756
+ ssh 10.30.171.141 '/usr/lib/jvm/java-17-openjdk-amd64/bin/jstack -l 28756'
Warning: Permanently added '10.30.171.141' (ECDSA) to the list of known hosts.
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_2_IP
+ echo 'Let'\''s take the karaf thread dump'
Let's take the karaf thread dump
+ ssh 10.30.171.204 'sudo ps aux'
Warning: Permanently added '10.30.171.204' (ECDSA) to the list of known hosts.
++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-calcium/ps_before.log
++ grep -v grep
++ tr -s ' '
++ cut -f2 '-d '
+ pid=28807
+ echo 'karaf main: org.apache.karaf.main.Main, pid:28807'
karaf main: org.apache.karaf.main.Main, pid:28807
+ ssh 10.30.171.204 '/usr/lib/jvm/java-17-openjdk-amd64/bin/jstack -l 28807'
Warning: Permanently added '10.30.171.204' (ECDSA) to the list of known hosts.
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_3_IP
+ echo 'Let'\''s take the karaf thread dump'
Let's take the karaf thread dump
+ ssh 10.30.171.35 'sudo ps aux'
Warning: Permanently added '10.30.171.35' (ECDSA) to the list of known hosts.
++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-calcium/ps_before.log
++ grep -v grep
++ tr -s ' '
++ cut -f2 '-d '
+ pid=28774
+ echo 'karaf main: org.apache.karaf.main.Main, pid:28774'
karaf main: org.apache.karaf.main.Main, pid:28774
+ ssh 10.30.171.35 '/usr/lib/jvm/java-17-openjdk-amd64/bin/jstack -l 28774'
Warning: Permanently added '10.30.171.35' (ECDSA) to the list of known hosts.
+ '[' 0 -gt 0 ']'
+ echo 'Generating controller variables...'
Generating controller variables...
++ seq 1 3
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_1_IP
+ odl_variables=' -v ODL_SYSTEM_1_IP:10.30.171.141'
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_2_IP
+ odl_variables=' -v ODL_SYSTEM_1_IP:10.30.171.141 -v ODL_SYSTEM_2_IP:10.30.171.204'
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_3_IP
+ odl_variables=' -v ODL_SYSTEM_1_IP:10.30.171.141 -v ODL_SYSTEM_2_IP:10.30.171.204 -v ODL_SYSTEM_3_IP:10.30.171.35'
+ echo 'Generating mininet variables...'
Generating mininet variables...
++ seq 1 0
+ get_test_suites SUITES
+ local __suite_list=SUITES
+ echo 'Locating test plan to use...'
Locating test plan to use...
+ testplan_filepath=/w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/testplans/controller-clustering-tell-calcium.txt
+ '[' '!' -f /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/testplans/controller-clustering-tell-calcium.txt ']'
+ testplan_filepath=/w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/testplans/controller-clustering-tell.txt
+ '[' disabled '!=' disabled ']'
+ echo 'Changing the testplan path...'
Changing the testplan path...
+ sed s:integration:/w/workspace/controller-csit-3node-clustering-tell-all-calcium: /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/testplans/controller-clustering-tell.txt
+ cat testplan.txt
# Place the suites in run order:
# disabling all "prefix based" suites. This functionality was newly
# introduced with these tests in 2017. The assumption is that
# development stopped in that area, but may continue at a later
# time. Still, the tests are failing and no resources to solve the
# failures at this time. If/When this changes, we can uncomment
# those suites. Note that every suite is commented out with it's
# accompanying "restart_with_tell_based_true" setup suite.
# /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/ddb-sanity-prefix-based.robot
/w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
/w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot
/w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
/w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown_prefbasedshard.robot
/w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
/w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement_prefbasedshard.robot
/w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
/w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/leader_isolation_prefbasedshard.robot
/w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
/w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/client_isolation.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/client_isolation_prefbasedshard.robot
/w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
/w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/listener_stability.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/listener_stability_prefbasedshard.robot
/w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
/w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/cluster_singleton/master_stability.robot
/w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
/w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot
/w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
/w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot
/w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
/w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot
/w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot
/w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot
/w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot
/w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot
/w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot
/w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot
/w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot
+ '[' -z '' ']'
++ grep -E -v '(^[[:space:]]*#|^[[:space:]]*$)' testplan.txt
++ tr '\012' ' '
+ suite_list='/w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot '
+ eval 'SUITES='\''/w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot '\'''
++ SUITES='/w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot '
+ echo 'Starting Robot test suites /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot ...'
Starting Robot test suites /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot ...
+ robot -N controller-clustering-tell.txt --removekeywords wuks -e exclude -e skip_if_calcium -v BUNDLEFOLDER:karaf-0.20.4-SNAPSHOT -v BUNDLE_URL:https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.4-SNAPSHOT/karaf-0.20.4-20250308.204433-450.zip -v CONTROLLER:10.30.171.141 -v CONTROLLER1:10.30.171.204 -v CONTROLLER2:10.30.171.35 -v CONTROLLER_USER:jenkins -v JAVA_HOME:/usr/lib/jvm/java-17-openjdk-amd64 -v JDKVERSION:openjdk17 -v JENKINS_WORKSPACE:/w/workspace/controller-csit-3node-clustering-tell-all-calcium -v MININET: -v MININET1: -v MININET2: -v MININET_USER:jenkins -v NEXUSURL_PREFIX:https://nexus.opendaylight.org -v NUM_ODL_SYSTEM:3 -v NUM_TOOLS_SYSTEM:0 -v ODL_STREAM:calcium -v ODL_SYSTEM_IP:10.30.171.141 -v ODL_SYSTEM_1_IP:10.30.171.141 -v ODL_SYSTEM_2_IP:10.30.171.204 -v ODL_SYSTEM_3_IP:10.30.171.35 -v ODL_SYSTEM_USER:jenkins -v TOOLS_SYSTEM_IP: -v TOOLS_SYSTEM_USER:jenkins -v USER_HOME:/home/jenkins -v IS_KARAF_APPL:True -v WORKSPACE:/tmp /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot
==============================================================================
controller-clustering-tell.txt
==============================================================================
controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
==============================================================================
Stop_All_Members :: Stop every odl node. | PASS |
------------------------------------------------------------------------------
Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync. | PASS |
------------------------------------------------------------------------------
controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | PASS |
3 tests, 3 passed, 0 failed
==============================================================================
controller-clustering-tell.txt.Ddb-Sanity-Module-Based :: DOMDataBroker tes...
==============================================================================
Get_Shard_Role :: Get shard role. | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_ddb_sanity_module_based_get_shard_role"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_get_shard_role&order=bug_status"
HTTPError: 404 Client Error: Not Found for url: http://10.30.171.141:8181/restconf/operations/cluster-admin:get-shard-role
------------------------------------------------------------------------------
Subscribe_Listener_To_Leader :: Subscribe listener to leader. | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_ddb_sanity_module_based_subscribe_listener_to_leader"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_subscribe_listener_to_leader&order=bug_status"
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.35:8181/rests/operations/odl-mdsal-lowlevel-control:unsubscribe-dtcl
------------------------------------------------------------------------------
Subscribe_Listener_To_Follower :: Subscribe listener to follower. | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_ddb_sanity_module_based_subscribe_listener_to_follower"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_subscribe_listener_to_follower&order=bug_status"
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/operations/odl-mdsal-lowlevel-control:unsubscribe-dtcl
------------------------------------------------------------------------------
Make_Leader_Local :: Make the loeader local and verify. | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_ddb_sanity_module_based_make_leader_local"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_make_leader_local&order=bug_status"
HTTPError: 404 Client Error: Not Found for url: http://10.30.171.141:8181/restconf/operations/cluster-admin:make-leader-local
------------------------------------------------------------------------------
Remove_Leader_Shard_Replica_And_Add_It_Back :: Remove and add shar... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_ddb_sanity_module_based_remove_leader_shard_replica_and_add_it_back"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_remove_leader_shard_replica_and_add_it_back&order=bug_status"
HTTPError: 404 Client Error: Not Found for url: http://10.30.171.35:8181/restconf/operations/cluster-admin:remove-shard-replica
------------------------------------------------------------------------------
Remove_Follower_Shard_Replica_And_Add_It_Back :: Remove and add sh... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_ddb_sanity_module_based_remove_follower_shard_replica_and_add_it_back"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_remove_follower_shard_replica_and_add_it_back&order=bug_status"
HTTPError: 404 Client Error: Not Found for url: http://10.30.171.141:8181/restconf/operations/cluster-admin:remove-shard-replica
------------------------------------------------------------------------------
Write_Transactions_One_Node_Leader :: Write transactions. | PASS |
------------------------------------------------------------------------------
Write_Transactions_One_Node_Follower :: Write transactions. | PASS |
------------------------------------------------------------------------------
Write_Transactions_All_Nodes :: Write transactions. | PASS |
------------------------------------------------------------------------------
controller-clustering-tell.txt.Ddb-Sanity-Module-Based :: DOMDataB... | FAIL |
9 tests, 3 passed, 6 failed
==============================================================================
controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
==============================================================================
Stop_All_Members :: Stop every odl node. | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync. | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.35:8181/jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore
------------------------------------------------------------------------------
controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-tell.txt.Clean Leader Shutdown :: DOMDataBroker testi...
==============================================================================
Local_Leader_Shutdown :: Shutdown the leader on the same node as t... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_clean_leader_shutdown_local_leader_shutdown"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_clean_leader_shutdown_local_leader_shutdown&order=bug_status"
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.35:8181/jolokia/read/org.opendaylight.controller:Category=Shards,name=member-3-shard-default-config,type=DistributedConfigDatastore
------------------------------------------------------------------------------
Restart :: Restart odl | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_clean_leader_shutdown_restart"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_clean_leader_shutdown_restart&order=bug_status"
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Remote_Leader_Shutdown :: Shutdown the leader on different node as... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_clean_leader_shutdown_remote_leader_shutdown"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_clean_leader_shutdown_remote_leader_shutdown&order=bug_status"
ConnectionError: HTTPConnectionPool(host='10.30.171.141', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7ff837fc1810>: Failed to establish a new connection: [Errno 111] Connection refused'))
------------------------------------------------------------------------------
controller-clustering-tell.txt.Clean Leader Shutdown :: DOMDataBro... | FAIL |
3 tests, 0 passed, 3 failed
==============================================================================
controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
==============================================================================
Stop_All_Members :: Stop every odl node. | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync. | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.35:8181/jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore
------------------------------------------------------------------------------
controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-tell.txt.Explicit Leader Movement :: DOMDataBroker te...
==============================================================================
Local_To_Remote_Movement :: Leader moves from local to remote node... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_explicit_leader_movement_local_to_remote_movement"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_local_to_remote_movement&order=bug_status"
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.35:8181/jolokia/read/org.opendaylight.controller:Category=Shards,name=member-3-shard-default-config,type=DistributedConfigDatastore
------------------------------------------------------------------------------
Restart1 :: Restart odl | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_explicit_leader_movement_restart1"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_restart1&order=bug_status"
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Remote_To_Remote_Movement :: Leader moves from one remote to other... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_explicit_leader_movement_remote_to_remote_movement"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_remote_to_remote_movement&order=bug_status"
ConnectionError: HTTPConnectionPool(host='10.30.171.141', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7ff84f214550>: Failed to establish a new connection: [Errno 111] Connection refused'))
------------------------------------------------------------------------------
Restart2 :: Restart odl | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_explicit_leader_movement_restart2"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_restart2&order=bug_status"
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Remote_To_Local_Movement :: Leader moves from remote to local node... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_explicit_leader_movement_remote_to_local_movement"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_remote_to_local_movement&order=bug_status"
ConnectionError: HTTPConnectionPool(host='10.30.171.141', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7ff84cfbff50>: Failed to establish a new connection: [Errno 111] Connection refused'))
------------------------------------------------------------------------------
controller-clustering-tell.txt.Explicit Leader Movement :: DOMData... | FAIL |
5 tests, 0 passed, 5 failed
==============================================================================
controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
==============================================================================
Stop_All_Members :: Stop every odl node. | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync. | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.35:8181/jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore
------------------------------------------------------------------------------
controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-tell.txt.Leader Isolation :: DOMDataBroker testing: L...
==============================================================================
Healing_Within_Request_Timeout :: The isolated node (leader) is re... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_leader_isolation_healing_within_request_timeout"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_leader_isolation_healing_within_request_timeout&order=bug_status"
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.35:8181/jolokia/read/org.opendaylight.controller:Category=Shards,name=member-3-shard-default-config,type=DistributedConfigDatastore
------------------------------------------------------------------------------
Restart :: Restart odl | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_leader_isolation_restart"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_leader_isolation_restart&order=bug_status"
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Healing_After_Request_Timeout :: The isolated node (leader) is rej... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_leader_isolation_healing_after_request_timeout"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_leader_isolation_healing_after_request_timeout&order=bug_status"
ConnectionError: HTTPConnectionPool(host='10.30.171.141', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7ff837f22c90>: Failed to establish a new connection: [Errno 111] Connection refused'))
------------------------------------------------------------------------------
controller-clustering-tell.txt.Leader Isolation :: DOMDataBroker t... | FAIL |
3 tests, 0 passed, 3 failed
==============================================================================
controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
==============================================================================
Stop_All_Members :: Stop every odl node. | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync. | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.35:8181/jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore
------------------------------------------------------------------------------
controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-tell.txt.Client Isolation :: DOMDataBroker testing: C...
==============================================================================
Producer_On_Shard_Leader_Node_ChainedTx :: Client isolation with p... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_client_isolation_producer_on_shard_leader_node_chainedtx"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_producer_on_shard_leader_node_chainedtx&order=bug_status"
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.35:8181/jolokia/read/org.opendaylight.controller:Category=Shards,name=member-3-shard-default-config,type=DistributedConfigDatastore
Also keyword teardown failed:
Several failures occurred:
1) Variable '${client_node_dst}' not found.
2) Variable '${client_node_dst}' not found.
3) Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 1 minute 10 seconds. The last error was: Several failures occurred:
1) HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.35:8181/jolokia/read/org.opendaylight.controller:Category=Shards,name=member-3-shard-default-config,type=DistributedConfigDatastore
2) Resolving variable '${response.text}' failed: AttributeError: 'NoneType' object has no attribute 'text'
[ Message content over the limit has been removed. ]
65) Resolving variable '${response.text}' failed: AttributeError: 'NoneType' object has no attribute 'text'
66) Evaluating expression "json.loads('''None''')" failed: JSONDecodeError: Expecting value: line 1 column 1 (char 0)
67) TypeError: Expected argument 1 to be a dictionary, got None instead.
68) TypeError: Expected argument 1 to be a dictionary, got None instead.
69) Unrecognized Raft state: None
70) No leader found.
71) Too many Leaders.
72) IndexError: Given index 0 is out of the range 0--1.
4) KeyError: 'threads'
------------------------------------------------------------------------------
Restart1 :: Restart odl | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_client_isolation_restart1"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_restart1&order=bug_status"
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Producer_On_Shard_Leader_Node_SimpleTx :: Client isolation with pr... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_client_isolation_producer_on_shard_leader_node_simpletx"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_producer_on_shard_leader_node_simpletx&order=bug_status"
ConnectionError: HTTPConnectionPool(host='10.30.171.141', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7ff84cc20890>: Failed to establish a new connection: [Errno 111] Connection refused'))
Also keyword teardown failed:
Several failures occurred:
1) Variable '${client_node_dst}' not found.
2) Variable '${client_node_dst}' not found.
3) Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 1 minute 10 seconds. The last error was: Several failures occurred:
1) ConnectionError: HTTPConnectionPool(host='10.30.171.141', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f...
[ Message content over the limit has been removed. ]
173) Resolving variable '${response.text}' failed: AttributeError: 'NoneType' object has no attribute 'text'
174) Evaluating expression "json.loads('''None''')" failed: JSONDecodeError: Expecting value: line 1 column 1 (char 0)
175) TypeError: Expected argument 1 to be a dictionary, got None instead.
176) TypeError: Expected argument 1 to be a dictionary, got None instead.
177) Unrecognized Raft state: None
178) No leader found.
179) Too many Leaders.
180) IndexError: Given index 0 is out of the range 0--1.
4) KeyError: 'threads'
------------------------------------------------------------------------------
Restart2 :: Restart odl | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_client_isolation_restart2"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_restart2&order=bug_status"
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Producer_On_Shard_Non_Leader_Node_ChainedTx :: Client isolation wi... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_client_isolation_producer_on_shard_non_leader_node_chainedtx"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_producer_on_shard_non_leader_node_chainedtx&order=bug_status"
ConnectionError: HTTPConnectionPool(host='10.30.171.141', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7ff837683c10>: Failed to establish a new connection: [Errno 111] Connection refused'))
Also keyword teardown failed:
Several failures occurred:
1) Variable '${client_node_dst}' not found.
2) Variable '${client_node_dst}' not found.
3) Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 1 minute 10 seconds. The last error was: Several failures occurred:
1) ConnectionError: HTTPConnectionPool(host='10.30.171.141', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f...
[ Message content over the limit has been removed. ]
173) Resolving variable '${response.text}' failed: AttributeError: 'NoneType' object has no attribute 'text'
174) Evaluating expression "json.loads('''None''')" failed: JSONDecodeError: Expecting value: line 1 column 1 (char 0)
175) TypeError: Expected argument 1 to be a dictionary, got None instead.
176) TypeError: Expected argument 1 to be a dictionary, got None instead.
177) Unrecognized Raft state: None
178) No leader found.
179) Too many Leaders.
180) IndexError: Given index 0 is out of the range 0--1.
4) KeyError: 'threads'
------------------------------------------------------------------------------
Restart3 :: Restart odl | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_client_isolation_restart3"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_restart3&order=bug_status"
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Producer_On_Shard_Non_Leader_Node_SimpleTx :: Client isolation wit... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_client_isolation_producer_on_shard_non_leader_node_simpletx"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_producer_on_shard_non_leader_node_simpletx&order=bug_status"
ConnectionError: HTTPConnectionPool(host='10.30.171.141', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7ff84c8a3110>: Failed to establish a new connection: [Errno 111] Connection refused'))
Also keyword teardown failed:
Several failures occurred:
1) Variable '${client_node_dst}' not found.
2) Variable '${client_node_dst}' not found.
3) Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 1 minute 10 seconds. The last error was: Several failures occurred:
1) ConnectionError: HTTPConnectionPool(host='10.30.171.141', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f...
[ Message content over the limit has been removed. ]
173) Resolving variable '${response.text}' failed: AttributeError: 'NoneType' object has no attribute 'text'
174) Evaluating expression "json.loads('''None''')" failed: JSONDecodeError: Expecting value: line 1 column 1 (char 0)
175) TypeError: Expected argument 1 to be a dictionary, got None instead.
176) TypeError: Expected argument 1 to be a dictionary, got None instead.
177) Unrecognized Raft state: None
178) No leader found.
179) Too many Leaders.
180) IndexError: Given index 0 is out of the range 0--1.
4) KeyError: 'threads'
------------------------------------------------------------------------------
controller-clustering-tell.txt.Client Isolation :: DOMDataBroker t... | FAIL |
7 tests, 0 passed, 7 failed
==============================================================================
controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
==============================================================================
Stop_All_Members :: Stop every odl node. | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync. | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.35:8181/jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore
------------------------------------------------------------------------------
controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-tell.txt.Listener Stability :: DOMDataBroker testing:...
==============================================================================
Move_Leader_From_Listener_Local_To_Remote :: Listener runs on lead... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_listener_stability_move_leader_from_listener_local_to_remote"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_listener_stability_move_leader_from_listener_local_to_remote&order=bug_status"
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.35:8181/jolokia/read/org.opendaylight.controller:Category=Shards,name=member-3-shard-default-config,type=DistributedConfigDatastore
------------------------------------------------------------------------------
Restart_1 :: Restart odl. | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_listener_stability_restart_1"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_listener_stability_restart_1&order=bug_status"
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Move_Leader_From_Listener_Remote_To_Other_Remote :: Listener runs ... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_listener_stability_move_leader_from_listener_remote_to_other_remote"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_listener_stability_move_leader_from_listener_remote_to_other_remote&order=bug_status"
ConnectionError: HTTPConnectionPool(host='10.30.171.141', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7ff837f9ca10>: Failed to establish a new connection: [Errno 111] Connection refused'))
------------------------------------------------------------------------------
Restart_2 :: Restart odl. | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_listener_stability_restart_2"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_listener_stability_restart_2&order=bug_status"
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Move_Leader_From_Listener_Remote_To_Local :: Listener runs on foll... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_listener_stability_move_leader_from_listener_remote_to_local"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_listener_stability_move_leader_from_listener_remote_to_local&order=bug_status"
ConnectionError: HTTPConnectionPool(host='10.30.171.141', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7ff84ceeed90>: Failed to establish a new connection: [Errno 111] Connection refused'))
------------------------------------------------------------------------------
controller-clustering-tell.txt.Listener Stability :: DOMDataBroker... | FAIL |
5 tests, 0 passed, 5 failed
==============================================================================
controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
==============================================================================
Stop_All_Members :: Stop every odl node. | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync. | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.35:8181/jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore
------------------------------------------------------------------------------
controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-tell.txt.Master Stability :: Cluster Singleton testin...
==============================================================================
Register_Singleton_Constant_On_Each_Node_And_Verify :: Register a ... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_master_stability_register_singleton_constant_on_each_node_and_verify"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_register_singleton_constant_on_each_node_and_verify&order=bug_status"
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.35:8181/rests/operations/odl-mdsal-lowlevel-control:register-singleton-constant
------------------------------------------------------------------------------
Unregister_Singleton_Constant_On_Non_Master_Node :: Unregister the... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_master_stability_unregister_singleton_constant_on_non_master_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_unregister_singleton_constant_on_non_master_node&order=bug_status"
Variable '@{cs_candidates}' not found. Did you mean:
@{cs_exp_candidates}
------------------------------------------------------------------------------
Monitor_Stability_While_Unregistered :: Verify that the owner rema... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_master_stability_monitor_stability_while_unregistered"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_monitor_stability_while_unregistered&order=bug_status"
Variable '${cs_owner}' not found.
------------------------------------------------------------------------------
Reregister_Singleton_Constant :: Re-register the unregistered cand... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_master_stability_reregister_singleton_constant"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_reregister_singleton_constant&order=bug_status"
Variable '${unregistered_node}' not found.
------------------------------------------------------------------------------
Verify_Stability_After_Reregistration :: Verify that the owner rem... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_master_stability_verify_stability_after_reregistration"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_verify_stability_after_reregistration&order=bug_status"
Variable '${cs_owner}' not found.
------------------------------------------------------------------------------
Unregister_Singleton_Constant_On_Each_Node :: Unregister the appli... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_master_stability_unregister_singleton_constant_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_unregister_singleton_constant_on_each_node&order=bug_status"
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.35:8181/rests/operations/odl-mdsal-lowlevel-control:unregister-singleton-constant
------------------------------------------------------------------------------
controller-clustering-tell.txt.Master Stability :: Cluster Singlet... | FAIL |
6 tests, 0 passed, 6 failed
==============================================================================
controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
==============================================================================
Stop_All_Members :: Stop every odl node. | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync. | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.35:8181/jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore
------------------------------------------------------------------------------
controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-tell.txt.Partition And Heal :: Cluster Singleton test...
==============================================================================
Register_Singleton_Constant_On_Each_Node :: Register a candidate a... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_partition_and_heal_register_singleton_constant_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_register_singleton_constant_on_each_node&order=bug_status"
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.35:8181/rests/operations/odl-mdsal-lowlevel-control:register-singleton-constant
------------------------------------------------------------------------------
Verify_Singleton_Constant_On_Each_Node :: Store the owner and cand... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_partition_and_heal_verify_singleton_constant_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_verify_singleton_constant_on_each_node&order=bug_status"
Could not parse owner and candidates for device get-singleton-constant-service']
------------------------------------------------------------------------------
Isolate_Owner_Node :: Isolate the cluster node which is the owner.... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_partition_and_heal_isolate_owner_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_isolate_owner_node&order=bug_status"
Variable '${cs_owner}' not found.
------------------------------------------------------------------------------
Monitor_Stability_While_Isolated :: Monitor the stability of the s... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_partition_and_heal_monitor_stability_while_isolated"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_monitor_stability_while_isolated&order=bug_status"
Invalid IF condition: Evaluating expression '"${index}" == "${cs_isolated_index}"' failed: Variable '${cs_isolated_index}' not found.
------------------------------------------------------------------------------
Rejoin_Isolated_node :: Rejoin isolated node. | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_partition_and_heal_rejoin_isolated_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_rejoin_isolated_node&order=bug_status"
Variable '${cs_isolated_index}' not found.
------------------------------------------------------------------------------
Unregister_Singleton_Constant_On_Each_Node :: Unregister the appli... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_partition_and_heal_unregister_singleton_constant_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_unregister_singleton_constant_on_each_node&order=bug_status"
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.35:8181/rests/operations/odl-mdsal-lowlevel-control:unregister-singleton-constant
------------------------------------------------------------------------------
controller-clustering-tell.txt.Partition And Heal :: Cluster Singl... | FAIL |
6 tests, 0 passed, 6 failed
==============================================================================
controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
==============================================================================
Stop_All_Members :: Stop every odl node. | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync. | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.35:8181/jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore
------------------------------------------------------------------------------
controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-tell.txt.Chasing The Leader :: Cluster Singleton test...
==============================================================================
Register_Candidates :: Register a candidate application on each no... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_chasing_the_leader_register_candidates"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_chasing_the_leader_register_candidates&order=bug_status"
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.35:8181/rests/operations/odl-mdsal-lowlevel-control:register-flapping-singleton
------------------------------------------------------------------------------
Do_Nothing :: Do nothing for the time of the test duration, becaus... | PASS |
------------------------------------------------------------------------------
Unregister_Candidates_And_Validate_Criteria :: Unregister the test... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_chasing_the_leader_unregister_candidates_and_validate_criteria"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_chasing_the_leader_unregister_candidates_and_validate_criteria&order=bug_status"
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.35:8181/rests/operations/odl-mdsal-lowlevel-control:unregister-flapping-singleton
------------------------------------------------------------------------------
controller-clustering-tell.txt.Chasing The Leader :: Cluster Singl... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
==============================================================================
Stop_All_Members :: Stop every odl node. | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync. | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.35:8181/jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore
------------------------------------------------------------------------------
controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-tell.txt.Carpeople Crud :: Suite for performing basic...
==============================================================================
Add_Cars_To_Leader :: Add 30 cars to car Leader by one big PUT. | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Added_Cars_On_Leader :: GET response from Leader should match ... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Added_Cars_On_Followers :: The same check on other members. | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Add_People_To_First_Follower :: Add 30 people to people first Foll... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Added_People_On_Leader :: GET response from Leader should matc... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Added_People_On_Followers :: The same check on other members. | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Leader :: Buy some cars on car-people Leader, loop of ... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Followers :: On each Follower buy corresponding ID seg... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Added_CarPeople_On_Leader :: GET car-person mappings from Lead... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Added_CarPeople_On_Followers :: The same check on other members. | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_All_CarPeople_On_Leader :: DELETE car-people container. No ... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_All_People_On_Leader :: DELETE people container. No verific... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_All_Cars_On_Leader :: DELETE cars container. No verificatio... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
controller-clustering-tell.txt.Carpeople Crud :: Suite for perform... | FAIL |
Suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
13 tests, 0 passed, 13 failed
==============================================================================
controller-clustering-tell.txt.Car Failover Crud :: Suite mixing basic oper...
==============================================================================
Add_Original_Cars_On_Old_Leader_And_Verify :: Add initial cars on ... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Stop_Original_Car_Leader :: Stop the car Leader to cause a new lea... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Wait_For_New_Leader :: Wait until new car Leader is elected. | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Original_Cars_On_New_Leader :: GET cars from new Leader, shoul... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Original_Cars_On_New_Followers :: The same check on other exis... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_Original_Cars_On_New_Leader :: Delete cars on the new Leader. | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Add_Leader_Cars_On_New_Leader :: Add cars on the new Leader. | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Leader_Cars_On_New_Leader :: GET cars from new Leader, should ... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Leader_Cars_On_New_Followers :: The same check on other existi... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_Leader_Cars_On_New_First_Follower :: Delete cars in new fir... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Add_Follower_Cars_On_New_First_Follower :: Add cars on the new fir... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Folower_Cars_On_New_Leader :: Get cars from the new Leader, sh... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Follower_Cars_On_New_Followers :: The same check on other exis... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Start_Old_Car_Leader :: Start the stopped member without deleting ... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Folower_Cars_On_Old_Leader :: GET cars from the restarted memb... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_Follower_Cars_On_New_Leader :: Delete cars on the last Leader. | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
controller-clustering-tell.txt.Car Failover Crud :: Suite mixing b... | FAIL |
Suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
16 tests, 0 passed, 16 failed
==============================================================================
controller-clustering-tell.txt.Car Persistence Recovery :: This test restar...
==============================================================================
Add_Cars_On_Leader_And_Verify :: Single big PUT to datastore to ad... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Stop_All_Members :: Stop all controllers. | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Start_All_Members :: Start all controllers (should restore the per... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Memorize_Leader_And_Followers :: Locate current Leader of car Shard. | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Cars_On_Leader :: GET cars from Leader, should match the PUT d... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Cars_On_Followers :: The same check on other members. | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_Cars_On_Leader :: Delete cars on the new Leader. | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
controller-clustering-tell.txt.Car Persistence Recovery :: This te... | FAIL |
Suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
7 tests, 0 passed, 7 failed
==============================================================================
controller-clustering-tell.txt.Buycar Failover :: This test focuses on test...
==============================================================================
Add_Cars_To_Leader_And_Verify :: Add all needed cars to car Leader... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Add_People_To_First_Follower_And_Verify :: Add all needed people t... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Leader_And_Verify :: Buy some cars on the leader member. | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Follower_And_Verify :: Buy some cars on the first foll... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Reboot_People_Leader :: Previous people Leader is rebooted. We sho... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Leader_After_Reboot_And_Verify :: Buy some cars on the... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Follower_After_Reboot_And_Verify :: Buy some cars on t... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_All_CarPeople :: DELETE car-people container. No verificati... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_All_People :: DELETE people container. No verification beyo... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_All_Cars :: DELETE cars container. No verification beyond h... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
controller-clustering-tell.txt.Buycar Failover :: This test focuse... | FAIL |
Suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
10 tests, 0 passed, 10 failed
==============================================================================
controller-clustering-tell.txt.Entity Isolate :: Suite for performing membe...
==============================================================================
Check All Shards Before Isolate :: Check all shards in controller. | FAIL |
Parent suite setup failed:
Evaluating expression 'json.loads(\'\'\'{\n "error": "javax.management.InstanceNotFoundException : org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "error_type": "javax.management.InstanceNotFoundException",\n "request": {\n "mbean": "org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "type": "read"\n },\n "stacktrace": "javax.management.InstanceNotFoundException: org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1088)\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1358)\\n\\tat java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:921)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:46)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:41)\\n\\tat org.jolokia.backend.executor.AbstractMBeanServerExecutor.call(AbstractMBeanServerExecutor.java:90)\\n\\tat org.jolokia.handler.ReadHandler.getMBeanInfo(ReadHandler.java:233)\\n\\tat org.jolokia.handler.ReadHandler.getAllAttributesNames(ReadHandler.java:245)\\n\\tat org.jolokia.handler.ReadHandler.resolveAttributes(ReadHandler.java:221)\\n\\tat org.jolokia.handler.ReadHandler.f...
[ Message content over the limit has been removed. ]
...clipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\\n\\tat org.eclipse.jetty.server.Server.handle(Server.java:516)\\n\\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)\\n\\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)\\n\\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)\\n\\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\\n\\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\\n\\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\\n\\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)\\n\\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\\n\\tat java.base/java.lang.Thread.run(Thread.java:840)\\n",\n "status": 404\n}\n\'\'\')' failed: JSONDecodeError: Invalid control character at: line 8 column 190 (char 619)
------------------------------------------------------------------------------
Isolate Entity Leader :: Isolate the entity-ownership Leader to ca... | FAIL |
Parent suite setup failed:
Evaluating expression 'json.loads(\'\'\'{\n "error": "javax.management.InstanceNotFoundException : org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "error_type": "javax.management.InstanceNotFoundException",\n "request": {\n "mbean": "org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "type": "read"\n },\n "stacktrace": "javax.management.InstanceNotFoundException: org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1088)\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1358)\\n\\tat java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:921)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:46)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:41)\\n\\tat org.jolokia.backend.executor.AbstractMBeanServerExecutor.call(AbstractMBeanServerExecutor.java:90)\\n\\tat org.jolokia.handler.ReadHandler.getMBeanInfo(ReadHandler.java:233)\\n\\tat org.jolokia.handler.ReadHandler.getAllAttributesNames(ReadHandler.java:245)\\n\\tat org.jolokia.handler.ReadHandler.resolveAttributes(ReadHandler.java:221)\\n\\tat org.jolokia.handler.ReadHandler.f...
[ Message content over the limit has been removed. ]
...clipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\\n\\tat org.eclipse.jetty.server.Server.handle(Server.java:516)\\n\\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)\\n\\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)\\n\\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)\\n\\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\\n\\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\\n\\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\\n\\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)\\n\\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\\n\\tat java.base/java.lang.Thread.run(Thread.java:840)\\n",\n "status": 404\n}\n\'\'\')' failed: JSONDecodeError: Invalid control character at: line 8 column 190 (char 619)
------------------------------------------------------------------------------
Check All Shards After Isolate :: Check all shards in controller. | FAIL |
Parent suite setup failed:
Evaluating expression 'json.loads(\'\'\'{\n "error": "javax.management.InstanceNotFoundException : org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "error_type": "javax.management.InstanceNotFoundException",\n "request": {\n "mbean": "org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "type": "read"\n },\n "stacktrace": "javax.management.InstanceNotFoundException: org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1088)\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1358)\\n\\tat java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:921)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:46)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:41)\\n\\tat org.jolokia.backend.executor.AbstractMBeanServerExecutor.call(AbstractMBeanServerExecutor.java:90)\\n\\tat org.jolokia.handler.ReadHandler.getMBeanInfo(ReadHandler.java:233)\\n\\tat org.jolokia.handler.ReadHandler.getAllAttributesNames(ReadHandler.java:245)\\n\\tat org.jolokia.handler.ReadHandler.resolveAttributes(ReadHandler.java:221)\\n\\tat org.jolokia.handler.ReadHandler.f...
[ Message content over the limit has been removed. ]
...clipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\\n\\tat org.eclipse.jetty.server.Server.handle(Server.java:516)\\n\\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)\\n\\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)\\n\\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)\\n\\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\\n\\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\\n\\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\\n\\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)\\n\\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\\n\\tat java.base/java.lang.Thread.run(Thread.java:840)\\n",\n "status": 404\n}\n\'\'\')' failed: JSONDecodeError: Invalid control character at: line 8 column 190 (char 619)
------------------------------------------------------------------------------
Rejoin Entity Leader :: Rejoin the entity-ownership Leader. | FAIL |
Parent suite setup failed:
Evaluating expression 'json.loads(\'\'\'{\n "error": "javax.management.InstanceNotFoundException : org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "error_type": "javax.management.InstanceNotFoundException",\n "request": {\n "mbean": "org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "type": "read"\n },\n "stacktrace": "javax.management.InstanceNotFoundException: org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1088)\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1358)\\n\\tat java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:921)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:46)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:41)\\n\\tat org.jolokia.backend.executor.AbstractMBeanServerExecutor.call(AbstractMBeanServerExecutor.java:90)\\n\\tat org.jolokia.handler.ReadHandler.getMBeanInfo(ReadHandler.java:233)\\n\\tat org.jolokia.handler.ReadHandler.getAllAttributesNames(ReadHandler.java:245)\\n\\tat org.jolokia.handler.ReadHandler.resolveAttributes(ReadHandler.java:221)\\n\\tat org.jolokia.handler.ReadHandler.f...
[ Message content over the limit has been removed. ]
...clipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\\n\\tat org.eclipse.jetty.server.Server.handle(Server.java:516)\\n\\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)\\n\\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)\\n\\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)\\n\\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\\n\\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\\n\\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\\n\\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)\\n\\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\\n\\tat java.base/java.lang.Thread.run(Thread.java:840)\\n",\n "status": 404\n}\n\'\'\')' failed: JSONDecodeError: Invalid control character at: line 8 column 190 (char 619)
------------------------------------------------------------------------------
Check All Shards After Rejoin :: Check all shards in controller. | FAIL |
Parent suite setup failed:
Evaluating expression 'json.loads(\'\'\'{\n "error": "javax.management.InstanceNotFoundException : org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "error_type": "javax.management.InstanceNotFoundException",\n "request": {\n "mbean": "org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "type": "read"\n },\n "stacktrace": "javax.management.InstanceNotFoundException: org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1088)\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1358)\\n\\tat java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:921)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:46)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:41)\\n\\tat org.jolokia.backend.executor.AbstractMBeanServerExecutor.call(AbstractMBeanServerExecutor.java:90)\\n\\tat org.jolokia.handler.ReadHandler.getMBeanInfo(ReadHandler.java:233)\\n\\tat org.jolokia.handler.ReadHandler.getAllAttributesNames(ReadHandler.java:245)\\n\\tat org.jolokia.handler.ReadHandler.resolveAttributes(ReadHandler.java:221)\\n\\tat org.jolokia.handler.ReadHandler.f...
[ Message content over the limit has been removed. ]
...clipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\\n\\tat org.eclipse.jetty.server.Server.handle(Server.java:516)\\n\\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)\\n\\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)\\n\\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)\\n\\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\\n\\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\\n\\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\\n\\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)\\n\\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\\n\\tat java.base/java.lang.Thread.run(Thread.java:840)\\n",\n "status": 404\n}\n\'\'\')' failed: JSONDecodeError: Invalid control character at: line 8 column 190 (char 619)
------------------------------------------------------------------------------
controller-clustering-tell.txt.Entity Isolate :: Suite for perform... | FAIL |
Suite setup failed:
Evaluating expression 'json.loads(\'\'\'{\n "error": "javax.management.InstanceNotFoundException : org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "error_type": "javax.management.InstanceNotFoundException",\n "request": {\n "mbean": "org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "type": "read"\n },\n "stacktrace": "javax.management.InstanceNotFoundException: org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1088)\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1358)\\n\\tat java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:921)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:46)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:41)\\n\\tat org.jolokia.backend.executor.AbstractMBeanServerExecutor.call(AbstractMBeanServerExecutor.java:90)\\n\\tat org.jolokia.handler.ReadHandler.getMBeanInfo(ReadHandler.java:233)\\n\\tat org.jolokia.handler.ReadHandler.getAllAttributesNames(ReadHandler.java:245)\\n\\tat org.jolokia.handler.ReadHandler.resolveAttributes(ReadHandler.java:221)\\n\\tat org.jolokia.handler.ReadHandler.f...
[ Message content over the limit has been removed. ]
...clipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\\n\\tat org.eclipse.jetty.server.Server.handle(Server.java:516)\\n\\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)\\n\\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)\\n\\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)\\n\\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\\n\\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\\n\\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\\n\\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)\\n\\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\\n\\tat java.base/java.lang.Thread.run(Thread.java:840)\\n",\n "status": 404\n}\n\'\'\')' failed: JSONDecodeError: Invalid control character at: line 8 column 190 (char 619)
5 tests, 0 passed, 5 failed
==============================================================================
controller-clustering-tell.txt.Buycar Failover Isolation :: This test focus...
==============================================================================
Add_Cars_To_Leader_And_Verify :: Add all needed cars to car Leader... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.204:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Add_People_To_First_Follower_And_Verify :: Add all needed people t... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.204:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Leader_And_Verify :: Buy some cars on the leader member. | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.204:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Follower_And_Verify :: Buy some cars on the first foll... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.204:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Isolate_and_Rejoin_People_Leader :: Previous people Leader is isol... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.204:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Leader_After_Rejoin_And_Verify :: Buy some cars on the... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.204:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Follower_After_Rejoin_And_Verify :: Buy some cars on t... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.204:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_All_CarPeople :: DELETE car-people container. No verificati... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.204:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_All_People :: DELETE people container. No verification beyo... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.204:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_All_Cars :: DELETE cars container. No verification beyond h... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.204:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
controller-clustering-tell.txt.Buycar Failover Isolation :: This t... | FAIL |
Suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.204:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
10 tests, 0 passed, 10 failed
==============================================================================
controller-clustering-tell.txt.Car Failover Crud Isolation :: Suite mixing ...
==============================================================================
Add_Original_Cars_On_Old_Leader_And_Verify :: Add initial cars on ... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Isolate_Original_Car_Leader :: Isolate the car Leader to cause a n... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Wait_For_New_Leader :: Wait until new car Leader is elected. | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Original_Cars_On_New_Leader :: GET cars from new Leader, shoul... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Original_Cars_On_New_Followers :: The same check on other exis... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_Original_Cars_On_New_Leader :: Delete cars on the new Leader. | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Add_Leader_Cars_On_New_Leader :: Add cars on the new Leader. | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Leader_Cars_On_New_Leader :: GET cars from new Leader, should ... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Leader_Cars_On_New_Followers :: The same check on other existi... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_Leader_Cars_On_New_First_Follower :: Delete cars in new fir... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Add_Follower_Cars_On_New_First_Follower :: Add cars on the new fir... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Folower_Cars_On_New_Leader :: Get cars from the new Leader, sh... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Follower_Cars_On_New_Followers :: The same check on other exis... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Rejoin_Old_Car_Leader :: Rejoin the isolated member without deleti... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Folower_Cars_On_Old_Leader :: GET cars from the restarted memb... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_Follower_Cars_On_New_Leader :: Delete cars on the last Leader. | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
controller-clustering-tell.txt.Car Failover Crud Isolation :: Suit... | FAIL |
Suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
16 tests, 0 passed, 16 failed
==============================================================================
controller-clustering-tell.txt.Car Outage Corners :: Cluster suite for test...
==============================================================================
Stop_Majority_Of_The_Followers :: Stop half plus one car Follower ... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Attempt_To_Add_Cars_To_Leader :: Adding cars should fail, as major... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Start_Tipping_Follower :: Start one Follower member without persis... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Add_Cars_On_Tipping_Follower :: Add cars on the tipping Follower. | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Cars_On_Existing_Members :: On each up member: GET cars, shoul... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Start_Other_Followers :: Start other followers without persisted d... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Cars_On_New_Follower_Leader :: GET cars from a new follower to... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_Cars_On_Leader :: Delete cars on Leader. | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
controller-clustering-tell.txt.Car Outage Corners :: Cluster suite... | FAIL |
Suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.141:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
8 tests, 0 passed, 8 failed
==============================================================================
controller-clustering-tell.txt | FAIL |
162 tests, 16 passed, 146 failed
==============================================================================
Output: /w/workspace/controller-csit-3node-clustering-tell-all-calcium/output.xml
Log: /w/workspace/controller-csit-3node-clustering-tell-all-calcium/log.html
Report: /w/workspace/controller-csit-3node-clustering-tell-all-calcium/report.html
+ true
+ echo 'Examining the files in data/log and checking filesize'
Examining the files in data/log and checking filesize
+ ssh 10.30.171.141 'ls -altr /tmp/karaf-0.20.4-SNAPSHOT/data/log/'
Warning: Permanently added '10.30.171.141' (ECDSA) to the list of known hosts.
total 28648
drwxrwxr-x 2 jenkins jenkins 4096 Mar 8 23:44 .
-rw-rw-r-- 1 jenkins jenkins 1720 Mar 8 23:44 karaf_console.log
drwxrwxr-x 9 jenkins jenkins 4096 Mar 9 03:14 ..
-rw-rw-r-- 1 jenkins jenkins 29316308 Mar 9 03:24 karaf.log
+ ssh 10.30.171.141 'du -hs /tmp/karaf-0.20.4-SNAPSHOT/data/log/*'
Warning: Permanently added '10.30.171.141' (ECDSA) to the list of known hosts.
28M /tmp/karaf-0.20.4-SNAPSHOT/data/log/karaf.log
4.0K /tmp/karaf-0.20.4-SNAPSHOT/data/log/karaf_console.log
+ ssh 10.30.171.204 'ls -altr /tmp/karaf-0.20.4-SNAPSHOT/data/log/'
Warning: Permanently added '10.30.171.204' (ECDSA) to the list of known hosts.
total 21124
drwxrwxr-x 2 jenkins jenkins 4096 Mar 8 23:44 .
-rw-rw-r-- 1 jenkins jenkins 1720 Mar 8 23:45 karaf_console.log
drwxrwxr-x 9 jenkins jenkins 4096 Mar 9 03:14 ..
-rw-rw-r-- 1 jenkins jenkins 21610881 Mar 9 03:24 karaf.log
+ ssh 10.30.171.204 'du -hs /tmp/karaf-0.20.4-SNAPSHOT/data/log/*'
Warning: Permanently added '10.30.171.204' (ECDSA) to the list of known hosts.
21M /tmp/karaf-0.20.4-SNAPSHOT/data/log/karaf.log
4.0K /tmp/karaf-0.20.4-SNAPSHOT/data/log/karaf_console.log
+ ssh 10.30.171.35 'ls -altr /tmp/karaf-0.20.4-SNAPSHOT/data/log/'
Warning: Permanently added '10.30.171.35' (ECDSA) to the list of known hosts.
total 274844
drwxrwxr-x 2 jenkins jenkins 4096 Mar 8 23:44 .
-rw-rw-r-- 1 jenkins jenkins 1720 Mar 8 23:45 karaf_console.log
drwxrwxr-x 4 jenkins jenkins 4096 Mar 9 03:13 ..
-rw-rw-r-- 1 jenkins jenkins 281420633 Mar 9 03:24 karaf.log
+ ssh 10.30.171.35 'du -hs /tmp/karaf-0.20.4-SNAPSHOT/data/log/*'
Warning: Permanently added '10.30.171.35' (ECDSA) to the list of known hosts.
269M /tmp/karaf-0.20.4-SNAPSHOT/data/log/karaf.log
4.0K /tmp/karaf-0.20.4-SNAPSHOT/data/log/karaf_console.log
+ set +e
++ seq 1 3
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_1_IP
+ echo 'Let'\''s take the karaf thread dump again'
Let's take the karaf thread dump again
+ ssh 10.30.171.141 'sudo ps aux'
Warning: Permanently added '10.30.171.141' (ECDSA) to the list of known hosts.
++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-calcium/ps_after.log
++ grep -v grep
++ tr -s ' '
++ cut -f2 '-d '
+ pid=59213
+ echo 'karaf main: org.apache.karaf.main.Main, pid:59213'
karaf main: org.apache.karaf.main.Main, pid:59213
+ ssh 10.30.171.141 '/usr/lib/jvm/java-17-openjdk-amd64/bin/jstack -l 59213'
Warning: Permanently added '10.30.171.141' (ECDSA) to the list of known hosts.
+ echo 'killing karaf process...'
killing karaf process...
+ ssh 10.30.171.141 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh'
Warning: Permanently added '10.30.171.141' (ECDSA) to the list of known hosts.
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_2_IP
+ echo 'Let'\''s take the karaf thread dump again'
Let's take the karaf thread dump again
+ ssh 10.30.171.204 'sudo ps aux'
Warning: Permanently added '10.30.171.204' (ECDSA) to the list of known hosts.
++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-calcium/ps_after.log
++ grep -v grep
++ cut -f2 '-d '
++ tr -s ' '
+ pid=57564
+ echo 'karaf main: org.apache.karaf.main.Main, pid:57564'
karaf main: org.apache.karaf.main.Main, pid:57564
+ ssh 10.30.171.204 '/usr/lib/jvm/java-17-openjdk-amd64/bin/jstack -l 57564'
Warning: Permanently added '10.30.171.204' (ECDSA) to the list of known hosts.
+ echo 'killing karaf process...'
killing karaf process...
+ ssh 10.30.171.204 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh'
Warning: Permanently added '10.30.171.204' (ECDSA) to the list of known hosts.
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_3_IP
+ echo 'Let'\''s take the karaf thread dump again'
Let's take the karaf thread dump again
+ ssh 10.30.171.35 'sudo ps aux'
Warning: Permanently added '10.30.171.35' (ECDSA) to the list of known hosts.
++ tr -s ' '
++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-calcium/ps_after.log
++ cut -f2 '-d '
++ grep -v grep
+ pid=40228
+ echo 'karaf main: org.apache.karaf.main.Main, pid:40228'
karaf main: org.apache.karaf.main.Main, pid:40228
+ ssh 10.30.171.35 '/usr/lib/jvm/java-17-openjdk-amd64/bin/jstack -l 40228'
Warning: Permanently added '10.30.171.35' (ECDSA) to the list of known hosts.
+ echo 'killing karaf process...'
killing karaf process...
+ ssh 10.30.171.35 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh'
Warning: Permanently added '10.30.171.35' (ECDSA) to the list of known hosts.
+ sleep 5
++ seq 1 3
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_1_IP
+ echo 'Compressing karaf.log 1'
Compressing karaf.log 1
+ ssh 10.30.171.141 gzip --best /tmp/karaf-0.20.4-SNAPSHOT/data/log/karaf.log
Warning: Permanently added '10.30.171.141' (ECDSA) to the list of known hosts.
+ echo 'Fetching compressed karaf.log 1'
Fetching compressed karaf.log 1
+ scp 10.30.171.141:/tmp/karaf-0.20.4-SNAPSHOT/data/log/karaf.log.gz odl1_karaf.log.gz
Warning: Permanently added '10.30.171.141' (ECDSA) to the list of known hosts.
+ ssh 10.30.171.141 rm -f /tmp/karaf-0.20.4-SNAPSHOT/data/log/karaf.log.gz
Warning: Permanently added '10.30.171.141' (ECDSA) to the list of known hosts.
+ scp 10.30.171.141:/tmp/karaf-0.20.4-SNAPSHOT/data/log/karaf_console.log odl1_karaf_console.log
Warning: Permanently added '10.30.171.141' (ECDSA) to the list of known hosts.
+ ssh 10.30.171.141 rm -f /tmp/karaf-0.20.4-SNAPSHOT/data/log/karaf_console.log
Warning: Permanently added '10.30.171.141' (ECDSA) to the list of known hosts.
+ echo 'Fetch GC logs'
Fetch GC logs
+ mkdir -p gclogs-1
+ scp '10.30.171.141:/tmp/karaf-0.20.4-SNAPSHOT/data/log/*.log' gclogs-1/
Warning: Permanently added '10.30.171.141' (ECDSA) to the list of known hosts.
scp: /tmp/karaf-0.20.4-SNAPSHOT/data/log/*.log: No such file or directory
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_2_IP
+ echo 'Compressing karaf.log 2'
Compressing karaf.log 2
+ ssh 10.30.171.204 gzip --best /tmp/karaf-0.20.4-SNAPSHOT/data/log/karaf.log
Warning: Permanently added '10.30.171.204' (ECDSA) to the list of known hosts.
+ echo 'Fetching compressed karaf.log 2'
Fetching compressed karaf.log 2
+ scp 10.30.171.204:/tmp/karaf-0.20.4-SNAPSHOT/data/log/karaf.log.gz odl2_karaf.log.gz
Warning: Permanently added '10.30.171.204' (ECDSA) to the list of known hosts.
+ ssh 10.30.171.204 rm -f /tmp/karaf-0.20.4-SNAPSHOT/data/log/karaf.log.gz
Warning: Permanently added '10.30.171.204' (ECDSA) to the list of known hosts.
+ scp 10.30.171.204:/tmp/karaf-0.20.4-SNAPSHOT/data/log/karaf_console.log odl2_karaf_console.log
Warning: Permanently added '10.30.171.204' (ECDSA) to the list of known hosts.
+ ssh 10.30.171.204 rm -f /tmp/karaf-0.20.4-SNAPSHOT/data/log/karaf_console.log
Warning: Permanently added '10.30.171.204' (ECDSA) to the list of known hosts.
+ echo 'Fetch GC logs'
Fetch GC logs
+ mkdir -p gclogs-2
+ scp '10.30.171.204:/tmp/karaf-0.20.4-SNAPSHOT/data/log/*.log' gclogs-2/
Warning: Permanently added '10.30.171.204' (ECDSA) to the list of known hosts.
scp: /tmp/karaf-0.20.4-SNAPSHOT/data/log/*.log: No such file or directory
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_3_IP
+ echo 'Compressing karaf.log 3'
Compressing karaf.log 3
+ ssh 10.30.171.35 gzip --best /tmp/karaf-0.20.4-SNAPSHOT/data/log/karaf.log
Warning: Permanently added '10.30.171.35' (ECDSA) to the list of known hosts.
+ echo 'Fetching compressed karaf.log 3'
Fetching compressed karaf.log 3
+ scp 10.30.171.35:/tmp/karaf-0.20.4-SNAPSHOT/data/log/karaf.log.gz odl3_karaf.log.gz
Warning: Permanently added '10.30.171.35' (ECDSA) to the list of known hosts.
+ ssh 10.30.171.35 rm -f /tmp/karaf-0.20.4-SNAPSHOT/data/log/karaf.log.gz
Warning: Permanently added '10.30.171.35' (ECDSA) to the list of known hosts.
+ scp 10.30.171.35:/tmp/karaf-0.20.4-SNAPSHOT/data/log/karaf_console.log odl3_karaf_console.log
Warning: Permanently added '10.30.171.35' (ECDSA) to the list of known hosts.
+ ssh 10.30.171.35 rm -f /tmp/karaf-0.20.4-SNAPSHOT/data/log/karaf_console.log
Warning: Permanently added '10.30.171.35' (ECDSA) to the list of known hosts.
+ echo 'Fetch GC logs'
Fetch GC logs
+ mkdir -p gclogs-3
+ scp '10.30.171.35:/tmp/karaf-0.20.4-SNAPSHOT/data/log/*.log' gclogs-3/
Warning: Permanently added '10.30.171.35' (ECDSA) to the list of known hosts.
scp: /tmp/karaf-0.20.4-SNAPSHOT/data/log/*.log: No such file or directory
+ echo 'Examine copied files'
Examine copied files
+ ls -lt
total 114596
drwxrwxr-x. 2 jenkins jenkins 6 Mar 9 03:24 gclogs-3
-rw-rw-r--. 1 jenkins jenkins 1720 Mar 9 03:24 odl3_karaf_console.log
-rw-rw-r--. 1 jenkins jenkins 3274713 Mar 9 03:24 odl3_karaf.log.gz
drwxrwxr-x. 2 jenkins jenkins 6 Mar 9 03:24 gclogs-2
-rw-rw-r--. 1 jenkins jenkins 1720 Mar 9 03:24 odl2_karaf_console.log
-rw-rw-r--. 1 jenkins jenkins 1200026 Mar 9 03:24 odl2_karaf.log.gz
drwxrwxr-x. 2 jenkins jenkins 6 Mar 9 03:24 gclogs-1
-rw-rw-r--. 1 jenkins jenkins 1720 Mar 9 03:24 odl1_karaf_console.log
-rw-rw-r--. 1 jenkins jenkins 1444804 Mar 9 03:24 odl1_karaf.log.gz
-rw-rw-r--. 1 jenkins jenkins 149544 Mar 9 03:24 karaf_3_40228_threads_after.log
-rw-rw-r--. 1 jenkins jenkins 16281 Mar 9 03:24 ps_after.log
-rw-rw-r--. 1 jenkins jenkins 132109 Mar 9 03:24 karaf_2_57564_threads_after.log
-rw-rw-r--. 1 jenkins jenkins 139387 Mar 9 03:24 karaf_1_59213_threads_after.log
-rw-rw-r--. 1 jenkins jenkins 307833 Mar 9 03:24 report.html
-rw-rw-r--. 1 jenkins jenkins 4108239 Mar 9 03:24 log.html
-rw-rw-r--. 1 jenkins jenkins 106067750 Mar 9 03:24 output.xml
-rw-rw-r--. 1 jenkins jenkins 6030 Mar 8 23:48 testplan.txt
-rw-rw-r--. 1 jenkins jenkins 128988 Mar 8 23:48 karaf_3_28774_threads_before.log
-rw-rw-r--. 1 jenkins jenkins 17456 Mar 8 23:48 ps_before.log
-rw-rw-r--. 1 jenkins jenkins 125701 Mar 8 23:48 karaf_2_28807_threads_before.log
-rw-rw-r--. 1 jenkins jenkins 127249 Mar 8 23:48 karaf_1_28756_threads_before.log
-rw-rw-r--. 1 jenkins jenkins 3106 Mar 8 23:44 post-startup-script.sh
-rw-rw-r--. 1 jenkins jenkins 252 Mar 8 23:44 startup-script.sh
-rw-rw-r--. 1 jenkins jenkins 3460 Mar 8 23:44 configuration-script.sh
-rw-rw-r--. 1 jenkins jenkins 695 Mar 8 23:44 custom_shard_config.txt
-rw-rw-r--. 1 jenkins jenkins 135 Mar 8 23:44 scriptplan.txt
-rw-rw-r--. 1 jenkins jenkins 337 Mar 8 23:44 detect_variables.env
-rw-rw-r--. 1 jenkins jenkins 2619 Mar 8 23:44 pom.xml
-rw-rw-r--. 1 jenkins jenkins 92 Mar 8 23:44 set_variables.env
-rw-rw-r--. 1 jenkins jenkins 313 Mar 8 23:44 slave_addresses.txt
-rw-rw-r--. 1 jenkins jenkins 570 Mar 8 23:44 requirements.txt
-rw-rw-r--. 1 jenkins jenkins 26 Mar 8 23:44 env.properties
-rw-rw-r--. 1 jenkins jenkins 333 Mar 8 23:42 stack-parameters.yaml
drwxrwxr-x. 7 jenkins jenkins 4096 Mar 8 23:41 test
drwxrwxr-x. 2 jenkins jenkins 6 Mar 8 23:41 test@tmp
-rw-rw-r--. 1 jenkins jenkins 1410 Mar 8 20:44 maven-metadata.xml
+ true
[controller-csit-3node-clustering-tell-all-calcium] $ /bin/sh /tmp/jenkins16984596998371947366.sh
Cleaning up Robot installation...
$ ssh-agent -k
unset SSH_AUTH_SOCK;
unset SSH_AGENT_PID;
echo Agent pid 5168 killed;
[ssh-agent] Stopped.
Recording plot data
Robot results publisher started...
INFO: Checking test criticality is deprecated and will be dropped in a future release!
-Parsing output xml:
Done!
-Copying log files to build dir:
Done!
-Assigning results to build:
Done!
-Checking thresholds:
Done!
Done publishing Robot results.
Build step 'Publish Robot Framework test results' changed build result to UNSTABLE
[PostBuildScript] - [INFO] Executing post build scripts.
[controller-csit-3node-clustering-tell-all-calcium] $ /bin/bash /tmp/jenkins5473172568987470383.sh
Archiving csit artifacts
mv: cannot stat '*_1.png': No such file or directory
mv: cannot stat '/tmp/odl1_*': No such file or directory
mv: cannot stat '*_2.png': No such file or directory
mv: cannot stat '/tmp/odl2_*': No such file or directory
mv: cannot stat '*_3.png': No such file or directory
mv: cannot stat '/tmp/odl3_*': No such file or directory
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
100 2280k 0 2280k 0 0 4401k 0 --:--:-- --:--:-- --:--:-- 4393k
100 7080k 0 7080k 0 0 4679k 0 --:--:-- 0:00:01 --:--:-- 4676k
100 8455k 0 8455k 0 0 4790k 0 --:--:-- 0:00:01 --:--:-- 4787k
Archive: robot-plugin.zip
inflating: ./archives/robot-plugin/log.html
inflating: ./archives/robot-plugin/output.xml
inflating: ./archives/robot-plugin/report.html
mv: cannot stat '*.log.gz': No such file or directory
mv: cannot stat '*.csv': No such file or directory
mv: cannot stat '*.png': No such file or directory
[PostBuildScript] - [INFO] Executing post build scripts.
[controller-csit-3node-clustering-tell-all-calcium] $ /bin/bash /tmp/jenkins9857742633023731057.sh
[PostBuildScript] - [INFO] Executing post build scripts.
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties content
OS_CLOUD=vex
OS_STACK_NAME=releng-controller-csit-3node-clustering-tell-all-calcium-78
[EnvInject] - Variables injected successfully.
provisioning config files...
copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
[controller-csit-3node-clustering-tell-all-calcium] $ /bin/bash /tmp/jenkins3414649663178624341.sh
---> openstack-stack-delete.sh
Setup pyenv:
system
3.8.13
3.9.13
3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-calcium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-38GL from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes python-heatclient python-openstackclient
lf-activate-venv(): INFO: Adding /tmp/venv-38GL/bin to PATH
INFO: Retrieving stack cost for: releng-controller-csit-3node-clustering-tell-all-calcium-78
DEBUG: Successfully retrieved stack cost: total: 1.32
INFO: Deleting stack releng-controller-csit-3node-clustering-tell-all-calcium-78
Successfully deleted stack releng-controller-csit-3node-clustering-tell-all-calcium-78
[PostBuildScript] - [INFO] Executing post build scripts.
[controller-csit-3node-clustering-tell-all-calcium] $ /bin/bash /tmp/jenkins17694593952746310182.sh
---> sysstat.sh
[controller-csit-3node-clustering-tell-all-calcium] $ /bin/bash /tmp/jenkins4058072527242014168.sh
---> package-listing.sh
++ tr '[:upper:]' '[:lower:]'
++ facter osfamily
+ OS_FAMILY=redhat
+ workspace=/w/workspace/controller-csit-3node-clustering-tell-all-calcium
+ START_PACKAGES=/tmp/packages_start.txt
+ END_PACKAGES=/tmp/packages_end.txt
+ DIFF_PACKAGES=/tmp/packages_diff.txt
+ PACKAGES=/tmp/packages_start.txt
+ '[' /w/workspace/controller-csit-3node-clustering-tell-all-calcium ']'
+ PACKAGES=/tmp/packages_end.txt
+ case "${OS_FAMILY}" in
+ rpm -qa
+ sort
+ '[' -f /tmp/packages_start.txt ']'
+ '[' -f /tmp/packages_end.txt ']'
+ diff /tmp/packages_start.txt /tmp/packages_end.txt
+ '[' /w/workspace/controller-csit-3node-clustering-tell-all-calcium ']'
+ mkdir -p /w/workspace/controller-csit-3node-clustering-tell-all-calcium/archives/
+ cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/controller-csit-3node-clustering-tell-all-calcium/archives/
[controller-csit-3node-clustering-tell-all-calcium] $ /bin/bash /tmp/jenkins12339913410741573780.sh
---> capture-instance-metadata.sh
Setup pyenv:
system
3.8.13
3.9.13
3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-calcium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-38GL from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: lftools
lf-activate-venv(): INFO: Adding /tmp/venv-38GL/bin to PATH
INFO: Running in OpenStack, capturing instance metadata
[controller-csit-3node-clustering-tell-all-calcium] $ /bin/bash /tmp/jenkins14838906399493391204.sh
provisioning config files...
Could not find credentials [logs] for controller-csit-3node-clustering-tell-all-calcium #78
copy managed file [jenkins-log-archives-settings] to file:/w/workspace/controller-csit-3node-clustering-tell-all-calcium@tmp/config1175364821420823558tmp
Regular expression run condition: Expression=[^.*logs-s3.*], Label=[odl-logs-s3-cloudfront-index]
Run condition [Regular expression match] enabling perform for step [Provide Configuration files]
provisioning config files...
copy managed file [jenkins-s3-log-ship] to file:/home/jenkins/.aws/credentials
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties content
SERVER_ID=logs
[EnvInject] - Variables injected successfully.
[controller-csit-3node-clustering-tell-all-calcium] $ /bin/bash /tmp/jenkins4089879972578703507.sh
---> create-netrc.sh
WARN: Log server credential not found.
[controller-csit-3node-clustering-tell-all-calcium] $ /bin/bash /tmp/jenkins14565782150607797830.sh
---> python-tools-install.sh
Setup pyenv:
system
3.8.13
3.9.13
3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-calcium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-38GL from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: lftools
lf-activate-venv(): INFO: Adding /tmp/venv-38GL/bin to PATH
[controller-csit-3node-clustering-tell-all-calcium] $ /bin/bash /tmp/jenkins16661296384845438244.sh
---> sudo-logs.sh
Archiving 'sudo' log..
[controller-csit-3node-clustering-tell-all-calcium] $ /bin/bash /tmp/jenkins1464802177946679904.sh
---> job-cost.sh
Setup pyenv:
system
3.8.13
3.9.13
3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-calcium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-38GL from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: zipp==1.1.0 python-openstackclient urllib3~=1.26.15
lf-activate-venv(): INFO: Adding /tmp/venv-38GL/bin to PATH
DEBUG: total: 1.32
INFO: Retrieving Stack Cost...
INFO: Retrieving Pricing Info for: v3-standard-2
INFO: Archiving Costs
[controller-csit-3node-clustering-tell-all-calcium] $ /bin/bash -l /tmp/jenkins16190652415896692561.sh
---> logs-deploy.sh
Setup pyenv:
system
3.8.13
3.9.13
3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-calcium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-38GL from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: lftools
lf-activate-venv(): INFO: Adding /tmp/venv-38GL/bin to PATH
WARNING: Nexus logging server not set
INFO: S3 path logs/releng/vex-yul-odl-jenkins-1/controller-csit-3node-clustering-tell-all-calcium/78/
INFO: archiving logs to S3
---> uname -a:
Linux prd-centos8-robot-2c-8g-5937.novalocal 4.18.0-553.5.1.el8.x86_64 #1 SMP Tue May 21 05:46:01 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
---> lscpu:
Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Byte Order: Little Endian
CPU(s): 2
On-line CPU(s) list: 0,1
Thread(s) per core: 1
Core(s) per socket: 1
Socket(s): 2
NUMA node(s): 1
Vendor ID: AuthenticAMD
CPU family: 23
Model: 49
Model name: AMD EPYC-Rome Processor
Stepping: 0
CPU MHz: 2800.000
BogoMIPS: 5600.00
Virtualization: AMD-V
Hypervisor vendor: KVM
Virtualization type: full
L1d cache: 32K
L1i cache: 32K
L2 cache: 512K
L3 cache: 16384K
NUMA node0 CPU(s): 0,1
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities
---> nproc:
2
---> df -h:
Filesystem Size Used Avail Use% Mounted on
devtmpfs 3.8G 0 3.8G 0% /dev
tmpfs 3.8G 0 3.8G 0% /dev/shm
tmpfs 3.8G 17M 3.8G 1% /run
tmpfs 3.8G 0 3.8G 0% /sys/fs/cgroup
/dev/vda1 40G 8.5G 32G 22% /
tmpfs 770M 0 770M 0% /run/user/1001
---> free -m:
total used free shared buff/cache available
Mem: 7697 655 4654 19 2387 6743
Swap: 1023 0 1023
---> ip addr:
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
inet 127.0.0.1/8 scope host lo
valid_lft forever preferred_lft forever
inet6 ::1/128 scope host
valid_lft forever preferred_lft forever
2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1458 qdisc mq state UP group default qlen 1000
link/ether fa:16:3e:8a:a2:92 brd ff:ff:ff:ff:ff:ff
altname enp0s3
altname ens3
inet 10.30.170.159/23 brd 10.30.171.255 scope global dynamic noprefixroute eth0
valid_lft 72901sec preferred_lft 72901sec
inet6 fe80::f816:3eff:fe8a:a292/64 scope link
valid_lft forever preferred_lft forever
---> sar -b -r -n DEV:
Linux 4.18.0-553.5.1.el8.x86_64 (prd-centos8-robot-2c-8g-5937.novalocal) 03/09/2025 _x86_64_ (2 CPU)
12:00:01 AM tps rtps wtps bread/s bwrtn/s
12:01:01 AM 1.00 0.02 0.98 0.13 212.33
12:02:01 AM 0.97 0.07 0.90 1.73 24.03
12:03:01 AM 0.50 0.00 0.50 0.00 16.11
12:04:01 AM 0.38 0.00 0.38 0.00 14.96
12:05:01 AM 0.13 0.00 0.13 0.00 20.01
12:06:01 AM 0.22 0.00 0.22 0.00 12.86
12:07:01 AM 0.33 0.02 0.32 0.53 25.96
12:08:01 AM 0.43 0.05 0.38 7.07 17.55
12:09:01 AM 0.32 0.00 0.32 0.00 20.56
12:10:01 AM 0.13 0.00 0.13 0.00 16.79
12:11:01 AM 0.17 0.00 0.17 0.00 16.18
12:12:01 AM 0.53 0.00 0.53 0.00 11.70
12:13:01 AM 0.20 0.00 0.20 0.00 2.47
12:14:01 AM 0.18 0.00 0.18 0.00 8.03
12:15:01 AM 0.13 0.00 0.13 0.00 14.40
12:16:01 AM 0.50 0.32 0.18 6.93 16.26
12:17:01 AM 0.90 0.00 0.90 0.00 36.09
12:18:01 AM 0.23 0.00 0.23 0.00 9.72
12:19:01 AM 0.18 0.00 0.18 0.00 16.44
12:20:01 AM 0.17 0.00 0.17 0.00 12.28
12:21:01 AM 0.15 0.00 0.15 0.00 2.88
12:22:01 AM 0.45 0.00 0.45 0.00 7.20
12:23:01 AM 0.20 0.00 0.20 0.00 12.70
12:24:01 AM 0.15 0.00 0.15 0.00 9.48
12:25:01 AM 0.27 0.00 0.27 0.00 17.74
12:26:01 AM 0.18 0.00 0.18 0.00 15.61
12:27:01 AM 0.33 0.00 0.33 0.00 18.78
12:28:01 AM 0.22 0.00 0.22 0.00 13.48
12:29:01 AM 0.22 0.00 0.22 0.00 15.58
12:30:01 AM 0.13 0.00 0.13 0.00 14.56
12:31:01 AM 0.22 0.02 0.20 0.13 18.88
12:32:02 AM 8.87 5.73 3.13 555.51 92.83
12:33:01 AM 0.25 0.00 0.25 0.00 20.23
12:34:01 AM 0.30 0.00 0.30 0.00 11.35
12:35:01 AM 0.33 0.00 0.33 0.00 27.86
12:36:01 AM 0.42 0.00 0.42 0.00 16.42
12:37:01 AM 0.55 0.00 0.55 0.00 19.48
12:38:01 AM 0.18 0.00 0.18 0.00 14.93
12:39:01 AM 0.20 0.00 0.20 0.00 9.00
12:40:01 AM 0.17 0.00 0.17 0.00 15.21
12:41:01 AM 0.23 0.00 0.23 0.00 16.29
12:42:01 AM 0.47 0.00 0.47 0.00 20.66
12:43:01 AM 0.13 0.00 0.13 0.00 12.93
12:44:01 AM 0.22 0.00 0.22 0.00 9.88
12:45:01 AM 0.15 0.00 0.15 0.00 8.15
12:46:01 AM 0.13 0.00 0.13 0.00 15.59
12:47:01 AM 0.37 0.00 0.37 0.00 21.96
12:48:01 AM 0.48 0.00 0.48 0.00 16.63
12:49:01 AM 0.57 0.00 0.57 0.00 16.58
12:50:01 AM 0.38 0.00 0.38 0.00 15.91
12:51:01 AM 0.23 0.00 0.23 0.00 11.61
12:52:01 AM 0.32 0.00 0.32 0.00 20.00
12:53:01 AM 0.27 0.00 0.27 0.00 16.83
12:54:01 AM 0.17 0.00 0.17 0.00 9.10
12:55:01 AM 0.18 0.00 0.18 0.00 16.24
12:56:01 AM 0.28 0.00 0.28 0.00 17.15
12:57:01 AM 0.37 0.00 0.37 0.00 20.36
12:58:01 AM 0.28 0.00 0.28 0.00 21.50
12:59:01 AM 0.30 0.00 0.30 0.00 12.39
01:00:01 AM 0.15 0.00 0.15 0.00 24.93
01:01:01 AM 0.32 0.03 0.28 0.27 14.48
01:02:01 AM 0.33 0.00 0.33 0.00 25.94
01:03:01 AM 0.23 0.00 0.23 0.00 14.03
01:04:01 AM 0.15 0.00 0.15 0.00 17.48
01:05:01 AM 0.15 0.00 0.15 0.00 7.35
01:06:01 AM 0.27 0.00 0.27 0.00 21.04
01:07:01 AM 0.48 0.00 0.48 0.00 21.43
01:08:01 AM 0.22 0.00 0.22 0.00 13.45
01:09:01 AM 0.17 0.00 0.17 0.00 10.38
01:10:01 AM 0.13 0.00 0.13 0.00 15.06
01:11:01 AM 0.37 0.00 0.37 0.00 16.44
01:12:01 AM 0.52 0.00 0.52 0.00 16.65
01:13:01 AM 0.23 0.00 0.23 0.00 12.25
01:14:01 AM 0.20 0.00 0.20 0.00 16.14
01:15:01 AM 0.13 0.00 0.13 0.00 14.26
01:16:01 AM 0.13 0.00 0.13 0.00 14.53
01:17:01 AM 0.32 0.00 0.32 0.00 11.75
01:18:01 AM 0.17 0.00 0.17 0.00 14.93
01:19:01 AM 0.27 0.00 0.27 0.00 24.31
01:20:01 AM 0.17 0.00 0.17 0.00 15.31
01:21:01 AM 0.25 0.00 0.25 0.00 13.35
01:22:01 AM 0.40 0.00 0.40 0.00 27.59
01:23:01 AM 0.13 0.00 0.13 0.00 11.60
01:24:01 AM 0.13 0.00 0.13 0.00 22.13
01:25:01 AM 0.12 0.00 0.12 0.00 15.20
01:26:01 AM 0.13 0.00 0.13 0.00 40.52
01:27:01 AM 0.37 0.00 0.37 0.00 106.77
01:28:01 AM 0.17 0.00 0.17 0.00 8.55
01:29:01 AM 0.20 0.00 0.20 0.00 15.01
01:30:01 AM 0.33 0.00 0.33 0.00 19.58
01:31:01 AM 0.18 0.00 0.18 0.00 15.26
01:32:01 AM 0.38 0.00 0.38 0.00 12.15
01:33:01 AM 0.13 0.00 0.13 0.00 15.46
01:34:01 AM 0.20 0.00 0.20 0.00 31.23
01:35:01 AM 0.17 0.00 0.17 0.00 58.25
01:36:01 AM 0.23 0.00 0.23 0.00 86.70
01:37:02 AM 0.43 0.00 0.43 0.00 21.04
01:38:01 AM 0.17 0.00 0.17 0.00 8.19
01:39:01 AM 0.15 0.00 0.15 0.00 14.53
01:40:01 AM 0.18 0.00 0.18 0.00 16.99
01:41:01 AM 0.22 0.00 0.22 0.00 15.13
01:42:01 AM 0.42 0.00 0.42 0.00 17.58
01:43:01 AM 0.22 0.00 0.22 0.00 96.63
01:44:01 AM 0.27 0.00 0.27 0.00 69.43
01:45:01 AM 0.18 0.00 0.18 0.00 9.35
01:46:01 AM 0.23 0.00 0.23 0.00 17.91
01:47:01 AM 0.35 0.00 0.35 0.00 12.76
01:48:01 AM 0.15 0.00 0.15 0.00 15.60
01:49:01 AM 0.12 0.00 0.12 0.00 14.40
01:50:01 AM 0.13 0.00 0.13 0.00 14.68
01:51:01 AM 0.32 0.00 0.32 0.00 65.36
01:52:01 AM 0.55 0.00 0.55 0.00 105.37
01:53:01 AM 0.18 0.00 0.18 0.00 16.01
01:54:01 AM 0.12 0.00 0.12 0.00 7.33
01:55:01 AM 0.13 0.00 0.13 0.00 14.66
01:56:01 AM 0.13 0.00 0.13 0.00 14.53
01:57:01 AM 0.57 0.00 0.57 0.00 22.46
01:58:01 AM 0.55 0.00 0.55 0.00 17.88
01:59:01 AM 0.30 0.00 0.30 0.00 21.04
02:00:01 AM 0.18 0.00 0.18 0.00 15.26
02:01:01 AM 0.30 0.00 0.30 0.00 22.19
02:02:01 AM 0.37 0.00 0.37 0.00 18.83
02:03:01 AM 0.27 0.00 0.27 0.00 15.08
02:04:01 AM 0.13 0.00 0.13 0.00 22.53
02:05:01 AM 0.28 0.00 0.28 0.00 16.35
02:06:01 AM 0.22 0.00 0.22 0.00 14.96
02:07:01 AM 0.22 0.00 0.22 0.00 16.73
02:08:01 AM 0.23 0.00 0.23 0.00 9.82
02:09:01 AM 0.18 0.00 0.18 0.00 15.64
02:10:01 AM 0.23 0.00 0.23 0.00 16.00
02:11:01 AM 0.17 0.00 0.17 0.00 15.49
02:12:01 AM 0.38 0.00 0.38 0.00 14.96
02:13:01 AM 0.25 0.00 0.25 0.00 12.16
02:14:01 AM 0.13 0.00 0.13 0.00 15.20
02:15:01 AM 0.33 0.00 0.33 0.00 16.69
02:16:01 AM 0.85 0.00 0.85 0.00 21.61
02:17:01 AM 0.35 0.00 0.35 0.00 20.61
02:18:01 AM 0.25 0.00 0.25 0.00 16.13
02:19:01 AM 0.17 0.00 0.17 0.00 8.68
02:20:01 AM 0.25 0.00 0.25 0.00 15.26
02:21:01 AM 0.18 0.00 0.18 0.00 15.24
02:22:01 AM 0.37 0.00 0.37 0.00 19.18
02:23:01 AM 0.15 0.00 0.15 0.00 15.50
02:24:01 AM 0.13 0.00 0.13 0.00 9.46
02:25:01 AM 0.30 0.00 0.30 0.00 19.48
02:26:01 AM 0.18 0.00 0.18 0.00 8.81
02:27:01 AM 0.33 0.00 0.33 0.00 26.51
02:28:01 AM 0.15 0.00 0.15 0.00 20.13
02:29:01 AM 0.10 0.00 0.10 0.00 11.33
02:30:01 AM 0.13 0.00 0.13 0.00 22.13
02:31:01 AM 0.15 0.00 0.15 0.00 11.93
02:32:01 AM 0.52 0.00 0.52 0.00 18.53
02:33:01 AM 0.22 0.00 0.22 0.00 24.15
02:34:01 AM 0.43 0.00 0.43 0.00 16.00
02:35:01 AM 0.45 0.00 0.45 0.00 14.55
02:36:01 AM 0.35 0.00 0.35 0.00 12.83
02:37:01 AM 0.35 0.00 0.35 0.00 15.60
02:38:01 AM 0.17 0.00 0.17 0.00 14.80
02:39:01 AM 0.13 0.00 0.13 0.00 15.46
02:40:01 AM 0.18 0.00 0.18 0.00 14.00
02:41:01 AM 0.37 0.00 0.37 0.00 14.15
02:42:01 AM 0.33 0.00 0.33 0.00 22.89
02:43:01 AM 0.13 0.00 0.13 0.00 11.86
02:44:02 AM 0.15 0.00 0.15 0.00 20.13
02:45:01 AM 0.12 0.00 0.12 0.00 11.66
02:46:01 AM 0.18 0.00 0.18 0.00 22.98
02:47:01 AM 0.28 0.00 0.28 0.00 15.58
02:48:01 AM 0.18 0.00 0.18 0.00 22.83
02:49:01 AM 0.27 0.00 0.27 0.00 13.61
02:50:01 AM 0.32 0.00 0.32 0.00 15.91
02:51:01 AM 0.35 0.00 0.35 0.00 7.90
02:52:01 AM 0.37 0.00 0.37 0.00 22.49
02:53:01 AM 0.12 0.00 0.12 0.00 14.93
02:54:01 AM 0.13 0.00 0.13 0.00 7.46
02:55:01 AM 0.13 0.00 0.13 0.00 14.53
02:56:01 AM 0.23 0.00 0.23 0.00 17.18
02:57:01 AM 0.43 0.00 0.43 0.00 19.06
02:58:01 AM 0.18 0.00 0.18 0.00 10.81
02:59:01 AM 0.18 0.00 0.18 0.00 23.21
03:00:01 AM 0.12 0.00 0.12 0.00 11.48
03:01:01 AM 0.22 0.00 0.22 0.00 22.85
03:02:01 AM 0.47 0.00 0.47 0.00 17.84
03:03:01 AM 0.20 0.00 0.20 0.00 23.33
03:04:01 AM 0.27 0.00 0.27 0.00 13.68
03:05:01 AM 0.13 0.00 0.13 0.00 16.28
03:06:01 AM 0.15 0.00 0.15 0.00 8.38
03:07:01 AM 0.30 0.00 0.30 0.00 14.23
03:08:01 AM 0.17 0.00 0.17 0.00 13.46
03:09:01 AM 0.13 0.00 0.13 0.00 14.66
03:10:01 AM 0.23 0.00 0.23 0.00 16.26
03:11:01 AM 0.23 0.00 0.23 0.00 8.88
03:12:01 AM 0.38 0.00 0.38 0.00 19.58
03:13:01 AM 0.13 0.00 0.13 0.00 15.80
03:14:01 AM 0.15 0.00 0.15 0.00 23.18
03:15:01 AM 0.17 0.00 0.17 0.00 7.76
03:16:01 AM 0.17 0.00 0.17 0.00 23.18
03:17:01 AM 0.33 0.00 0.33 0.00 15.08
03:18:01 AM 0.30 0.00 0.30 0.00 26.20
03:19:01 AM 0.13 0.00 0.13 0.00 11.60
03:20:01 AM 0.20 0.00 0.20 0.00 25.61
03:21:01 AM 0.23 0.00 0.23 0.00 10.93
03:22:01 AM 0.27 0.00 0.27 0.00 19.55
03:23:01 AM 0.28 0.00 0.28 0.00 20.70
03:24:01 AM 0.22 0.00 0.22 0.00 14.91
03:25:01 AM 4.77 0.28 4.48 33.86 289.92
03:26:01 AM 36.96 0.43 36.53 49.19 5801.58
Average: 0.51 0.03 0.47 3.18 49.28
12:00:01 AM kbmemfree kbavail kbmemused %memused kbbuffers kbcached kbcommit %commit kbactive kbinact kbdirty
12:01:01 AM 4937836 7010832 2944588 37.36 2688 2242412 727948 8.15 265188 2305764 4
12:02:01 AM 4937988 7011424 2944436 37.35 2688 2242844 727948 8.15 265340 2305664 4
12:03:01 AM 4937932 7011736 2944492 37.36 2688 2243220 727948 8.15 265340 2305560 40
12:04:01 AM 4937120 7011600 2945304 37.37 2688 2243888 727948 8.15 265340 2306428 384
12:05:01 AM 4936300 7011056 2946124 37.38 2688 2244164 727948 8.15 265340 2307092 92
12:06:01 AM 4935620 7010852 2946804 37.38 2688 2244640 727948 8.15 265340 2308120 244
12:07:01 AM 4934436 7010260 2947988 37.40 2688 2245232 728688 8.16 265340 2309360 88
12:08:01 AM 4934224 7010684 2948200 37.40 2688 2245868 727500 8.15 265372 2309316 248
12:09:01 AM 4933876 7010812 2948548 37.41 2688 2246344 727500 8.15 265372 2309796 248
12:10:01 AM 4932808 7010324 2949616 37.42 2688 2246932 718616 8.05 265372 2310676 360
12:11:01 AM 4932776 7010484 2949648 37.42 2688 2247116 718616 8.05 265596 2310608 96
12:12:01 AM 4932840 7010556 2949584 37.42 2688 2247124 718616 8.05 265596 2310568 4
12:13:01 AM 4932728 7010500 2949696 37.42 2688 2247180 718616 8.05 265596 2310716 48
12:14:01 AM 4932100 7010228 2950324 37.43 2688 2247544 718616 8.05 265596 2311124 216
12:15:01 AM 4931944 7010436 2950480 37.43 2688 2247908 718616 8.05 265600 2311484 176
12:16:01 AM 4931292 7010352 2951132 37.44 2688 2248468 717460 8.03 265728 2311944 104
12:17:01 AM 4930524 7009944 2951900 37.45 2688 2248828 717460 8.03 265728 2312548 24
12:18:01 AM 4930456 7010244 2951968 37.45 2688 2249204 717460 8.03 265728 2312772 188
12:19:01 AM 4929948 7010100 2952476 37.46 2688 2249568 717460 8.03 265728 2313172 112
12:20:01 AM 4929288 7009676 2953136 37.46 2688 2249796 714640 8.00 265764 2313732 24
12:21:01 AM 4929600 7010036 2952824 37.46 2688 2249844 714640 8.00 265764 2313436 4
12:22:01 AM 4929620 7010064 2952804 37.46 2688 2249852 714640 8.00 265764 2313512 4
12:23:01 AM 4929316 7010128 2953108 37.46 2688 2250228 714640 8.00 265764 2313832 48
12:24:01 AM 4927560 7008744 2954864 37.49 2688 2250592 714640 8.00 265764 2315336 168
12:25:01 AM 4927540 7009076 2954884 37.49 2688 2250952 714640 8.00 265764 2315596 92
12:26:01 AM 4927532 7009444 2954892 37.49 2688 2251328 714640 8.00 265764 2315584 56
12:27:01 AM 4927192 7009480 2955232 37.49 2688 2251696 714640 8.00 265764 2316028 4
12:28:01 AM 4926608 7009248 2955816 37.50 2688 2252056 730016 8.17 265764 2316652 24
12:29:01 AM 4925964 7009260 2956460 37.51 2688 2252704 730016 8.17 265764 2317112 276
12:30:01 AM 4925512 7009128 2956912 37.51 2688 2253024 723484 8.10 265764 2317772 184
12:31:01 AM 4924368 7008464 2958056 37.53 2688 2253504 721184 8.08 265764 2318672 168
12:32:02 AM 4907804 7009108 2974620 37.74 2688 2270636 719608 8.06 268192 2332812 88
12:33:01 AM 4906708 7008492 2975716 37.75 2688 2271116 719608 8.06 268192 2333612 88
12:34:01 AM 4907104 7009292 2975320 37.75 2688 2271512 719608 8.06 268192 2333520 244
12:35:01 AM 4905892 7008560 2976532 37.76 2688 2271988 719608 8.06 268192 2334288 4
12:36:01 AM 4905876 7008924 2976548 37.76 2688 2272376 719608 8.06 268192 2334384 24
12:37:01 AM 4905388 7008804 2977036 37.77 2688 2272744 719608 8.06 268220 2335004 68
12:38:01 AM 4904076 7007864 2978348 37.78 2688 2273108 719608 8.06 268220 2336336 24
12:39:01 AM 4903868 7008024 2978556 37.79 2688 2273484 719608 8.06 268220 2336616 188
12:40:01 AM 4902404 7006932 2980020 37.81 2688 2273848 719608 8.06 268220 2337804 144
12:41:01 AM 4902460 7007368 2979964 37.81 2688 2274228 719608 8.06 268220 2337764 124
12:42:01 AM 4902056 7007332 2980368 37.81 2688 2274588 719608 8.06 268220 2338380 80
12:43:01 AM 4901952 7007516 2980472 37.81 2688 2274876 719608 8.06 268220 2338156 4
12:44:01 AM 4902024 7007888 2980400 37.81 2688 2275184 719608 8.06 268220 2338600 68
12:45:01 AM 4901416 7007652 2981008 37.82 2688 2275548 719608 8.06 268220 2338972 220
12:46:01 AM 4900928 7007528 2981496 37.82 2688 2275920 719608 8.06 268220 2339348 156
12:47:01 AM 4900640 7007608 2981784 37.83 2688 2276288 719608 8.06 268220 2339716 24
12:48:01 AM 4899920 7007248 2982504 37.84 2688 2276648 719608 8.06 268220 2340476 40
12:49:01 AM 4899936 7007628 2982488 37.84 2688 2277008 719608 8.06 268220 2340432 24
12:50:01 AM 4898496 7006564 2983928 37.86 2688 2277376 716992 8.03 268220 2341532 28
12:51:01 AM 4899052 7007524 2983372 37.85 2688 2277784 716992 8.03 268220 2341212 184
12:52:01 AM 4898384 7007224 2984040 37.86 2688 2278152 716992 8.03 268220 2341864 68
12:53:01 AM 4898076 7007272 2984348 37.86 2688 2278512 716992 8.03 268220 2342072 24
12:54:01 AM 4897768 7007324 2984656 37.86 2688 2278872 716992 8.03 268220 2342632 184
12:55:01 AM 4897228 7007164 2985196 37.87 2688 2279252 716992 8.03 268220 2343008 144
12:56:01 AM 4896920 7007220 2985504 37.88 2688 2279612 716992 8.03 268220 2343488 96
12:57:01 AM 4897064 7008004 2985360 37.87 2688 2280248 716992 8.03 268216 2343536 288
12:58:01 AM 4896704 7007980 2985720 37.88 2688 2280584 716992 8.03 268216 2343916 88
12:59:01 AM 4896164 7007916 2986260 37.89 2688 2281060 716992 8.03 268216 2344276 324
01:00:01 AM 4894956 7007180 2987468 37.90 2688 2281540 713688 7.99 268216 2345212 88
01:01:01 AM 4894172 7006888 2988252 37.91 2688 2282028 713688 7.99 268220 2345900 248
01:02:01 AM 4894316 7007436 2988108 37.91 2688 2282424 713688 7.99 268224 2346220 16
01:03:01 AM 4893852 7007452 2988572 37.91 2688 2282904 713688 7.99 268224 2346596 168
01:04:01 AM 4893628 7007608 2988796 37.92 2688 2283284 713688 7.99 268224 2346712 56
01:05:01 AM 4893344 7007692 2989080 37.92 2688 2283660 713688 7.99 268224 2347076 256
01:06:01 AM 4893052 7007764 2989372 37.92 2688 2284024 713688 7.99 268224 2347384 72
01:07:01 AM 4891932 7007016 2990492 37.94 2688 2284388 713688 7.99 268224 2348476 24
01:08:01 AM 4891804 7007244 2990620 37.94 2688 2284748 713688 7.99 268224 2348760 52
01:09:01 AM 4891256 7007056 2991168 37.95 2688 2285108 713688 7.99 268224 2349024 160
01:10:01 AM 4890364 7006556 2992060 37.96 2688 2285488 735268 8.23 268224 2349952 128
01:11:01 AM 4890536 7007016 2991888 37.96 2688 2285776 719884 8.06 268228 2349976 4
01:12:01 AM 4890040 7006808 2992384 37.96 2688 2286064 719884 8.06 268224 2350304 4
01:13:01 AM 4889628 7006816 2992796 37.97 2688 2286492 719884 8.06 268224 2350772 156
01:14:01 AM 4889600 7007156 2992824 37.97 2688 2286852 719884 8.06 268224 2350900 88
01:15:01 AM 4889236 7007164 2993188 37.97 2688 2287232 719884 8.06 268224 2351308 68
01:16:01 AM 4888932 7007224 2993492 37.98 2688 2287596 719884 8.06 268224 2351556 24
01:17:01 AM 4888120 7006772 2994304 37.99 2688 2287956 719884 8.06 268224 2352304 196
01:18:01 AM 4888152 7007176 2994272 37.99 2688 2288320 719884 8.06 268224 2352300 148
01:19:01 AM 4887500 7007104 2994924 37.99 2688 2288896 719884 8.06 268224 2352980 48
01:20:01 AM 4886728 7006772 2995696 38.00 2688 2289336 713176 7.99 268224 2353768 88
01:21:01 AM 4886428 7006952 2995996 38.01 2688 2289816 713176 7.99 268224 2354096 248
01:22:01 AM 4885720 7006712 2996704 38.02 2688 2290292 713176 7.99 268224 2354720 88
01:23:01 AM 4885384 7006856 2997040 38.02 2688 2290772 713176 7.99 268224 2354932 248
01:24:01 AM 4885128 7007076 2997296 38.03 2688 2291248 713176 7.99 268224 2355408 88
01:25:01 AM 4884572 7006940 2997852 38.03 2688 2291660 713176 7.99 268224 2355720 68
01:26:01 AM 4882456 7006940 2999968 38.06 2688 2293788 713176 7.99 268224 2358140 1008
01:27:01 AM 4878108 7004668 3004316 38.11 2688 2295848 713176 7.99 268232 2362192 16
01:28:01 AM 4876252 7003224 3006172 38.14 2688 2296264 728564 8.16 268232 2364084 216
01:29:01 AM 4875948 7003288 3006476 38.14 2688 2296632 728564 8.16 268232 2364532 184
01:30:01 AM 4874052 7001752 3008372 38.17 2688 2296992 733204 8.21 268232 2366140 88
01:31:01 AM 4874128 7002204 3008296 38.16 2688 2297360 733204 8.21 268232 2366288 36
01:32:01 AM 4873596 7002040 3008828 38.17 2688 2297736 733204 8.21 268232 2366604 220
01:33:01 AM 4873052 7001856 3009372 38.18 2688 2298096 733204 8.21 268232 2367104 156
01:34:01 AM 4872696 7002256 3009728 38.18 2688 2298844 733204 8.21 268232 2367780 4
01:35:01 AM 4866916 6999884 3015508 38.26 2688 2302256 733204 8.21 268232 2373560 1716
01:36:01 AM 4865448 6999320 3016976 38.27 2688 2303152 733204 8.21 268232 2374960 68
01:37:02 AM 4865044 6999272 3017380 38.28 2688 2303516 733204 8.21 268232 2375384 24
01:38:01 AM 4864884 6999472 3017540 38.28 2688 2303876 733204 8.21 268232 2375676 192
01:39:01 AM 4863696 6998644 3018728 38.30 2688 2304236 733204 8.21 268232 2376508 144
01:40:01 AM 4863056 6998388 3019368 38.31 2688 2304616 729044 8.16 268232 2377120 52
01:41:01 AM 4862680 6998384 3019744 38.31 2688 2304980 729044 8.16 268232 2377456 4
01:42:01 AM 4861968 6998568 3020456 38.32 2688 2305872 729044 8.16 268232 2378420 560
01:43:01 AM 4859080 6998504 3023344 38.36 2688 2308720 729044 8.16 268232 2381292 580
01:44:01 AM 4857668 6998548 3024756 38.37 2688 2310156 729044 8.16 268232 2382628 4
01:45:01 AM 4857280 6998536 3025144 38.38 2688 2310532 729044 8.16 268232 2383012 172
01:46:01 AM 4857192 6998808 3025232 38.38 2688 2310892 729044 8.16 268232 2383168 60
01:47:01 AM 4856660 6998640 3025764 38.39 2688 2311256 729044 8.16 268232 2383600 204
01:48:01 AM 4856436 6998800 3025988 38.39 2688 2311632 729044 8.16 268232 2383920 144
01:49:01 AM 4856100 6998824 3026324 38.39 2688 2311992 729044 8.16 268232 2384408 96
01:50:01 AM 4854696 6997860 3027728 38.41 2688 2312432 748828 8.38 268232 2385440 132
01:51:01 AM 4852124 6998624 3030300 38.44 2688 2315764 748828 8.38 268232 2388256 1600
01:52:01 AM 4849460 6997412 3032964 38.48 2688 2317212 748828 8.38 268232 2390644 100
01:53:01 AM 4849556 6997876 3032868 38.48 2688 2317588 748828 8.38 268232 2390732 36
01:54:01 AM 4849232 6997916 3033192 38.48 2688 2317952 748828 8.38 268232 2391096 204
01:55:01 AM 4848768 6997832 3033656 38.49 2688 2318332 748828 8.38 268232 2391492 176
01:56:01 AM 4848700 6998124 3033724 38.49 2688 2318692 748828 8.38 268232 2391848 128
01:57:01 AM 4847952 6997736 3034472 38.50 2688 2319052 748828 8.38 268232 2392288 24
01:58:01 AM 4847596 6997760 3034828 38.50 2688 2319432 748828 8.38 268232 2392720 24
01:59:01 AM 4847264 6998008 3035160 38.51 2688 2320012 748828 8.38 268232 2393296 104
02:00:01 AM 4846116 6997336 3036308 38.52 2688 2320488 748828 8.38 268232 2394004 164
02:01:01 AM 4845072 6996780 3037352 38.53 2688 2320972 748828 8.38 268232 2395020 88
02:02:01 AM 4845248 6997360 3037176 38.53 2688 2321368 748828 8.38 268240 2394888 88
02:03:01 AM 4844732 6997324 3037692 38.54 2688 2321848 748828 8.38 268240 2395488 248
02:04:01 AM 4844572 6997632 3037852 38.54 2688 2322324 748828 8.38 268240 2395712 88
02:05:01 AM 4844444 6997876 3037980 38.54 2688 2322688 748828 8.38 268240 2395892 80
02:06:01 AM 4844180 6998000 3038244 38.54 2688 2323084 748828 8.38 268240 2396276 112
02:07:01 AM 4843744 6997924 3038680 38.55 2688 2323444 748828 8.38 268240 2396704 36
02:08:01 AM 4843280 6997824 3039144 38.56 2688 2323808 748828 8.38 268240 2397116 204
02:09:01 AM 4842600 6997524 3039824 38.56 2688 2324188 748828 8.38 268240 2397796 172
02:10:01 AM 4842120 6997404 3040304 38.57 2688 2324548 722000 8.08 268240 2398096 128
02:11:01 AM 4842104 6997748 3040320 38.57 2688 2324900 722000 8.08 268240 2398108 52
02:12:01 AM 4841732 6997704 3040692 38.58 2688 2325216 722000 8.08 268240 2398636 96
02:13:01 AM 4841264 6997516 3041160 38.58 2688 2325496 722000 8.08 268240 2398836 116
02:14:01 AM 4841200 6997824 3041224 38.58 2688 2325876 722000 8.08 268240 2399092 68
02:15:01 AM 4839716 6996704 3042708 38.60 2688 2326240 719656 8.06 268240 2400384 24
02:16:01 AM 4840608 6997976 3041816 38.59 2688 2326616 718120 8.04 277440 2390632 140
02:17:01 AM 4839872 6997616 3042552 38.60 2688 2326984 718120 8.04 277440 2391196 68
02:18:01 AM 4839560 6997664 3042864 38.60 2688 2327344 733692 8.22 277440 2391536 24
02:19:01 AM 4839312 6997800 3043112 38.61 2688 2327728 733692 8.22 277440 2391792 196
02:20:01 AM 4838584 6997444 3043840 38.62 2688 2328108 729780 8.17 277440 2392396 184
02:21:01 AM 4838212 6997448 3044212 38.62 2688 2328484 729780 8.17 277440 2392840 144
02:22:01 AM 4837580 6997180 3044844 38.63 2688 2328844 729780 8.17 277440 2393288 112
02:23:01 AM 4837408 6997372 3045016 38.63 2688 2329208 729780 8.17 277440 2393720 52
02:24:01 AM 4837240 6997572 3045184 38.63 2688 2329568 729780 8.17 277440 2393936 160
02:25:01 AM 4836992 6997692 3045432 38.64 2688 2329944 729780 8.17 277440 2394000 36
02:26:01 AM 4836512 6997680 3045912 38.64 2688 2330404 729780 8.17 277440 2394604 284
02:27:01 AM 4836032 6997652 3046392 38.65 2688 2330856 729780 8.17 277440 2394988 104
02:28:01 AM 4835632 6997720 3046792 38.65 2688 2331332 729780 8.17 277440 2395388 12
02:29:01 AM 4835404 6997972 3047020 38.66 2688 2331812 729780 8.17 277440 2395872 168
02:30:01 AM 4834260 6997312 3048164 38.67 2688 2332288 729800 8.17 277440 2396704 4
02:31:01 AM 4833964 6997500 3048460 38.67 2688 2332772 729800 8.17 277440 2397136 168
02:32:01 AM 4833404 6997420 3049020 38.68 2688 2333248 729800 8.17 277440 2397680 328
02:33:01 AM 4832844 6997232 3049580 38.69 2688 2333620 729800 8.17 277440 2397988 48
02:34:01 AM 4832952 6997644 3049472 38.69 2688 2333924 729800 8.17 277448 2398012 4
02:35:01 AM 4832620 6997620 3049804 38.69 2688 2334232 729800 8.17 277452 2398432 24
02:36:01 AM 4832532 6997848 3049892 38.69 2688 2334556 729800 8.17 277452 2398624 80
02:37:01 AM 4831852 6997544 3050572 38.70 2688 2334924 745452 8.35 277452 2399084 152
02:38:01 AM 4831696 6997756 3050728 38.70 2688 2335300 729772 8.17 277452 2399372 116
02:39:01 AM 4831196 6997616 3051228 38.71 2688 2335660 729772 8.17 277452 2399732 40
02:40:01 AM 4830832 6997616 3051592 38.71 2688 2336024 722108 8.09 277452 2400240 24
02:41:01 AM 4830384 6997556 3052040 38.72 2688 2336388 722108 8.09 277452 2400696 112
02:42:01 AM 4829504 6997392 3052920 38.73 2688 2337112 722108 8.09 277452 2401416 308
02:43:01 AM 4829604 6997708 3052820 38.73 2688 2337320 722108 8.09 277452 2401428 188
02:44:02 AM 4829208 6997788 3053216 38.73 2688 2337796 722108 8.09 277452 2401904 88
02:45:01 AM 4828896 6997956 3053528 38.74 2688 2338276 722108 8.09 277452 2402384 248
02:46:01 AM 4828204 6997740 3054220 38.75 2688 2338752 722108 8.09 277452 2402860 88
02:47:01 AM 4827636 6997640 3054788 38.75 2688 2339228 722108 8.09 277452 2403400 244
02:48:01 AM 4826976 6997460 3055448 38.76 2688 2339708 722108 8.09 277452 2404016 84
02:49:01 AM 4826852 6997648 3055572 38.76 2688 2340012 722108 8.09 277452 2404132 64
02:50:01 AM 4825632 6996744 3056792 38.78 2688 2340328 745664 8.35 277460 2405052 16
02:51:01 AM 4826024 6997500 3056400 38.77 2688 2340688 728860 8.16 277460 2404812 256
02:52:01 AM 4825664 6997488 3056760 38.78 2688 2341044 728860 8.16 277460 2405224 100
02:53:01 AM 4825416 6997612 3057008 38.78 2688 2341408 728860 8.16 277460 2405528 44
02:54:01 AM 4825236 6997784 3057188 38.78 2688 2341768 728860 8.16 277460 2405880 204
02:55:01 AM 4824708 6997632 3057716 38.79 2688 2342144 728860 8.16 277460 2406256 172
02:56:01 AM 4824580 6997868 3057844 38.79 2688 2342508 728860 8.16 277460 2406620 96
02:57:01 AM 4823764 6997412 3058660 38.80 2688 2342868 728860 8.16 277460 2407064 84
02:58:01 AM 4823360 6997676 3059064 38.81 2688 2343528 728860 8.16 277460 2407780 476
02:59:01 AM 4822956 6997616 3059468 38.81 2688 2343880 728860 8.16 277460 2408124 168
03:00:01 AM 4821928 6997068 3060496 38.83 2688 2344360 729312 8.17 277460 2408720 332
03:01:01 AM 4821048 6996588 3061376 38.84 2688 2344756 729312 8.17 277460 2409528 88
03:02:01 AM 4821292 6997300 3061132 38.83 2688 2345232 729312 8.17 277472 2409600 244
03:03:01 AM 4821020 6997516 3061404 38.84 2688 2345716 729312 8.17 277472 2410132 92
03:04:01 AM 4820148 6997236 3062276 38.85 2688 2346324 729312 8.17 277472 2410616 380
03:05:01 AM 4820056 6997440 3062368 38.85 2688 2346592 729312 8.17 277476 2410840 184
03:06:01 AM 4820284 6997688 3062140 38.85 2688 2346612 729312 8.17 277476 2410744 4
03:07:01 AM 4819728 6997476 3062696 38.85 2688 2346948 729312 8.17 277480 2411144 56
03:08:01 AM 4819480 6997628 3062944 38.86 2688 2347348 729312 8.17 277480 2411468 100
03:09:01 AM 4819100 6997604 3063324 38.86 2688 2347712 729312 8.17 277480 2411824 52
03:10:01 AM 4818076 6996948 3064348 38.88 2688 2348080 723608 8.10 277480 2412540 108
03:11:01 AM 4818036 6997300 3064388 38.88 2688 2348464 723608 8.10 277480 2412768 192
03:12:01 AM 4817748 6997368 3064676 38.88 2688 2348828 723608 8.10 277480 2413192 144
03:13:01 AM 4817564 6997552 3064860 38.88 2688 2349196 723608 8.10 277480 2413492 68
03:14:01 AM 4816968 6997556 3065456 38.89 2688 2349788 723608 8.10 277480 2414028 4
03:15:01 AM 4816712 6997716 3065712 38.89 2688 2350204 723608 8.10 277480 2414444 248
03:16:01 AM 4816152 6997636 3066272 38.90 2688 2350680 723608 8.10 277480 2414804 88
03:17:01 AM 4815384 6997340 3067040 38.91 2688 2351160 723608 8.10 277480 2415460 256
03:18:01 AM 4815244 6997676 3067180 38.91 2688 2351636 723608 8.10 277480 2415752 92
03:19:01 AM 4814836 6997744 3067588 38.92 2688 2352112 723608 8.10 277480 2416228 244
03:20:01 AM 4813588 6996992 3068836 38.93 2688 2352600 723640 8.10 277480 2417196 40
03:21:01 AM 4812980 6996732 3069444 38.94 2688 2352944 763948 8.55 277500 2417360 168
03:22:01 AM 4808788 6992916 3073636 38.99 2688 2353320 787180 8.81 277500 2421556 48
03:23:01 AM 4807928 6992544 3074496 39.00 2688 2353800 806460 9.03 277500 2422096 4
03:24:01 AM 4804280 6989448 3078144 39.05 2688 2354344 846140 9.47 277500 2425272 188
03:25:01 AM 4788960 6926016 3093464 39.25 2688 2309992 722564 8.09 375208 2357208 125508
03:26:01 AM 4793912 6933468 3088512 39.18 2688 2313688 741728 8.31 574544 2159164 16784
Average: 4867099 7001644 3015325 38.25 2688 2303872 727584 8.15 272929 2368694 831
12:00:01 AM IFACE rxpck/s txpck/s rxkB/s txkB/s rxcmp/s txcmp/s rxmcst/s %ifutil
12:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:01:01 AM eth0 13.23 9.33 2.69 1.78 0.00 0.00 0.00 0.00
12:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:02:01 AM eth0 14.17 9.49 2.94 1.88 0.00 0.00 0.00 0.00
12:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:03:01 AM eth0 13.50 9.53 2.76 1.79 0.00 0.00 0.00 0.00
12:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:04:01 AM eth0 23.90 16.73 5.10 3.26 0.00 0.00 0.00 0.00
12:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:05:01 AM eth0 0.93 0.77 0.22 0.14 0.00 0.00 0.00 0.00
12:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:06:01 AM eth0 1.45 1.10 0.38 0.22 0.00 0.00 0.00 0.00
12:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:07:01 AM eth0 1.43 1.25 0.51 0.29 0.00 0.00 0.00 0.00
12:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:08:01 AM eth0 1.52 1.02 0.37 0.22 0.00 0.00 0.00 0.00
12:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:09:01 AM eth0 1.45 1.17 0.44 0.23 0.00 0.00 0.00 0.00
12:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:10:01 AM eth0 6.41 3.73 1.27 0.73 0.00 0.00 0.00 0.00
12:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:11:01 AM eth0 12.56 11.85 1.86 0.98 0.00 0.00 0.00 0.00
12:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:12:01 AM eth0 0.72 0.13 0.16 0.07 0.00 0.00 0.00 0.00
12:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:13:01 AM eth0 3.90 3.73 0.53 0.26 0.00 0.00 0.00 0.00
12:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:14:01 AM eth0 13.73 9.33 2.72 1.76 0.00 0.00 0.00 0.00
12:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:15:01 AM eth0 13.61 9.50 2.77 1.78 0.00 0.00 0.00 0.00
12:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:16:01 AM eth0 13.95 9.36 2.79 1.77 0.00 0.00 0.00 0.00
12:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:17:01 AM eth0 14.43 9.60 3.20 1.89 0.00 0.00 0.00 0.00
12:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:18:01 AM eth0 14.08 9.53 2.82 1.79 0.00 0.00 0.00 0.00
12:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:19:01 AM eth0 13.18 9.45 2.66 1.78 0.00 0.00 0.00 0.00
12:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:20:01 AM eth0 7.40 4.73 1.38 0.90 0.00 0.00 0.00 0.00
12:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:21:01 AM eth0 0.28 0.05 0.01 0.00 0.00 0.00 0.00 0.00
12:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:22:01 AM eth0 0.83 0.18 0.16 0.07 0.00 0.00 0.00 0.00
12:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:23:01 AM eth0 9.11 6.25 1.80 1.16 0.00 0.00 0.00 0.00
12:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:24:01 AM eth0 14.11 9.45 3.00 1.96 0.00 0.00 0.00 0.00
12:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:25:01 AM eth0 13.66 9.31 3.04 1.99 0.00 0.00 0.00 0.00
12:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:26:01 AM eth0 14.15 9.62 2.86 1.80 0.00 0.00 0.00 0.00
12:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:27:01 AM eth0 14.15 9.45 2.95 1.84 0.00 0.00 0.00 0.00
12:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:28:01 AM eth0 14.46 9.63 3.09 2.03 0.00 0.00 0.00 0.00
12:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:29:01 AM eth0 25.10 17.40 5.22 3.23 0.00 0.00 0.00 0.00
12:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:30:01 AM eth0 3.77 2.48 0.69 0.44 0.00 0.00 0.00 0.00
12:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:31:01 AM eth0 1.08 1.00 0.35 0.22 0.00 0.00 0.00 0.00
12:32:02 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:32:02 AM eth0 3.30 1.95 0.67 0.35 0.00 0.00 0.00 0.00
12:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:33:01 AM eth0 1.95 1.29 0.95 0.60 0.00 0.00 0.00 0.00
12:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:34:01 AM eth0 1.92 0.93 0.41 0.19 0.00 0.00 0.00 0.00
12:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:35:01 AM eth0 2.02 1.40 0.90 0.60 0.00 0.00 0.00 0.00
12:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:36:01 AM eth0 16.77 14.87 2.66 1.55 0.00 0.00 0.00 0.00
12:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:37:01 AM eth0 13.26 10.83 2.56 1.62 0.00 0.00 0.00 0.00
12:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:38:01 AM eth0 13.51 9.32 2.77 1.79 0.00 0.00 0.00 0.00
12:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:39:01 AM eth0 13.78 9.43 2.84 1.81 0.00 0.00 0.00 0.00
12:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:40:01 AM eth0 14.00 9.26 2.98 1.95 0.00 0.00 0.00 0.00
12:41:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:41:01 AM eth0 13.30 9.60 2.79 1.84 0.00 0.00 0.00 0.00
12:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:42:01 AM eth0 14.51 9.43 3.19 2.02 0.00 0.00 0.00 0.00
12:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:43:01 AM eth0 10.01 6.78 2.00 1.28 0.00 0.00 0.00 0.00
12:44:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:44:01 AM eth0 7.27 5.08 1.41 0.97 0.00 0.00 0.00 0.00
12:45:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:45:01 AM eth0 13.16 9.27 2.69 1.77 0.00 0.00 0.00 0.00
12:46:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:46:01 AM eth0 13.80 9.66 2.79 1.84 0.00 0.00 0.00 0.00
12:47:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:47:01 AM eth0 13.36 9.42 2.79 1.84 0.00 0.00 0.00 0.00
12:48:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:48:01 AM eth0 14.30 9.35 3.06 1.95 0.00 0.00 0.00 0.00
12:49:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:49:01 AM eth0 13.90 9.68 2.83 1.84 0.00 0.00 0.00 0.00
12:50:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:50:01 AM eth0 11.85 8.08 2.49 1.68 0.00 0.00 0.00 0.00
12:51:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:51:01 AM eth0 8.36 6.10 1.64 1.16 0.00 0.00 0.00 0.00
12:52:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:52:01 AM eth0 14.40 9.40 3.16 2.02 0.00 0.00 0.00 0.00
12:53:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:53:01 AM eth0 13.63 9.32 2.78 1.77 0.00 0.00 0.00 0.00
12:54:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:54:01 AM eth0 18.51 9.83 3.63 2.03 0.00 0.00 0.00 0.00
12:55:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:55:01 AM eth0 16.49 9.81 3.74 2.35 0.00 0.00 0.00 0.00
12:56:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:56:01 AM eth0 17.48 9.72 3.74 2.18 0.00 0.00 0.00 0.00
12:57:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:57:01 AM eth0 26.67 17.01 5.46 3.19 0.00 0.00 0.00 0.00
12:58:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:58:01 AM eth0 4.73 2.93 0.86 0.56 0.00 0.00 0.00 0.00
12:59:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:59:01 AM eth0 1.50 1.03 0.39 0.22 0.00 0.00 0.00 0.00
01:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:00:01 AM eth0 1.62 1.07 0.38 0.22 0.00 0.00 0.00 0.00
01:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:01:01 AM eth0 2.33 1.03 0.48 0.22 0.00 0.00 0.00 0.00
01:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:02:01 AM eth0 5.15 1.55 1.50 0.86 0.00 0.00 0.00 0.00
01:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:03:01 AM eth0 2.15 1.33 0.90 0.60 0.00 0.00 0.00 0.00
01:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:04:01 AM eth0 18.66 14.45 2.95 1.53 0.00 0.00 0.00 0.00
01:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:05:01 AM eth0 14.01 10.61 2.78 1.78 0.00 0.00 0.00 0.00
01:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:06:01 AM eth0 13.60 9.16 2.72 1.74 0.00 0.00 0.00 0.00
01:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:07:01 AM eth0 13.73 9.30 2.88 1.83 0.00 0.00 0.00 0.00
01:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:08:01 AM eth0 13.88 9.23 2.74 1.77 0.00 0.00 0.00 0.00
01:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:09:01 AM eth0 13.80 9.48 2.80 1.83 0.00 0.00 0.00 0.00
01:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:10:01 AM eth0 14.26 9.63 3.01 1.97 0.00 0.00 0.00 0.00
01:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:11:01 AM eth0 9.83 6.51 1.95 1.27 0.00 0.00 0.00 0.00
01:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:12:01 AM eth0 7.35 2.75 1.33 0.72 0.00 0.00 0.00 0.00
01:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:13:01 AM eth0 15.95 11.03 3.46 2.30 0.00 0.00 0.00 0.00
01:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:14:01 AM eth0 16.73 9.10 3.11 1.76 0.00 0.00 0.00 0.00
01:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:15:01 AM eth0 13.71 9.43 2.81 1.83 0.00 0.00 0.00 0.00
01:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:16:01 AM eth0 14.46 9.23 2.86 1.77 0.00 0.00 0.00 0.00
01:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:17:01 AM eth0 14.01 9.50 3.11 2.02 0.00 0.00 0.00 0.00
01:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:18:01 AM eth0 14.30 9.63 2.86 1.83 0.00 0.00 0.00 0.00
01:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:19:01 AM eth0 17.41 12.35 3.65 2.24 0.00 0.00 0.00 0.00
01:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:20:01 AM eth0 1.45 1.05 0.34 0.20 0.00 0.00 0.00 0.00
01:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:21:01 AM eth0 1.62 1.00 0.40 0.22 0.00 0.00 0.00 0.00
01:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:22:01 AM eth0 2.05 1.35 0.78 0.47 0.00 0.00 0.00 0.00
01:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:23:01 AM eth0 1.20 1.02 0.36 0.22 0.00 0.00 0.00 0.00
01:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:24:01 AM eth0 2.05 1.05 0.50 0.22 0.00 0.00 0.00 0.00
01:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:25:01 AM eth0 11.58 10.13 1.98 1.22 0.00 0.00 0.00 0.00
01:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:26:01 AM eth0 7.90 8.31 2.31 0.98 0.00 0.00 0.00 0.00
01:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:27:01 AM eth0 6.72 6.95 2.48 1.15 0.00 0.00 0.00 0.00
01:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:28:01 AM eth0 16.11 10.65 3.13 2.00 0.00 0.00 0.00 0.00
01:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:29:01 AM eth0 13.56 9.38 2.74 1.78 0.00 0.00 0.00 0.00
01:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:30:01 AM eth0 14.08 9.37 2.85 1.78 0.00 0.00 0.00 0.00
01:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:31:01 AM eth0 13.28 9.33 2.73 1.82 0.00 0.00 0.00 0.00
01:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:32:01 AM eth0 14.25 9.50 2.92 1.85 0.00 0.00 0.00 0.00
01:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:33:01 AM eth0 14.40 9.65 3.06 1.98 0.00 0.00 0.00 0.00
01:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:34:01 AM eth0 4.55 2.85 0.72 0.51 0.00 0.00 0.00 0.00
01:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:35:01 AM eth0 2.75 2.82 0.46 0.59 0.00 0.00 0.00 0.00
01:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:36:01 AM eth0 9.83 7.17 1.86 1.35 0.00 0.00 0.00 0.00
01:37:02 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:37:02 AM eth0 13.30 9.46 2.79 1.84 0.00 0.00 0.00 0.00
01:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:38:01 AM eth0 13.61 9.39 2.75 1.80 0.00 0.00 0.00 0.00
01:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:39:01 AM eth0 12.78 9.22 2.66 1.81 0.00 0.00 0.00 0.00
01:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:40:01 AM eth0 14.18 9.58 2.84 1.80 0.00 0.00 0.00 0.00
01:41:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:41:01 AM eth0 13.25 9.22 2.70 1.77 0.00 0.00 0.00 0.00
01:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:42:01 AM eth0 9.91 6.96 1.98 1.33 0.00 0.00 0.00 0.00
01:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:43:01 AM eth0 1.87 2.13 0.12 0.30 0.00 0.00 0.00 0.00
01:44:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:44:01 AM eth0 9.38 6.80 1.74 1.27 0.00 0.00 0.00 0.00
01:45:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:45:01 AM eth0 14.23 9.98 3.14 2.08 0.00 0.00 0.00 0.00
01:46:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:46:01 AM eth0 13.38 9.30 2.71 1.77 0.00 0.00 0.00 0.00
01:47:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:47:01 AM eth0 14.11 9.83 2.97 1.91 0.00 0.00 0.00 0.00
01:48:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:48:01 AM eth0 13.63 9.32 2.70 1.77 0.00 0.00 0.00 0.00
01:49:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:49:01 AM eth0 13.73 9.56 2.78 1.81 0.00 0.00 0.00 0.00
01:50:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:50:01 AM eth0 10.38 7.05 2.22 1.51 0.00 0.00 0.00 0.00
01:51:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:51:01 AM eth0 2.08 2.37 0.14 0.33 0.00 0.00 0.00 0.00
01:52:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:52:01 AM eth0 7.33 5.17 1.29 1.03 0.00 0.00 0.00 0.00
01:53:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:53:01 AM eth0 13.71 9.40 2.78 1.79 0.00 0.00 0.00 0.00
01:54:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:54:01 AM eth0 13.26 9.20 2.71 1.76 0.00 0.00 0.00 0.00
01:55:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:55:01 AM eth0 13.46 9.50 2.78 1.83 0.00 0.00 0.00 0.00
01:56:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:56:01 AM eth0 12.91 9.10 2.69 1.76 0.00 0.00 0.00 0.00
01:57:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:57:01 AM eth0 13.38 9.45 2.89 1.84 0.00 0.00 0.00 0.00
01:58:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:58:01 AM eth0 13.98 9.63 2.84 1.84 0.00 0.00 0.00 0.00
01:59:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:59:01 AM eth0 16.41 11.90 3.44 2.17 0.00 0.00 0.00 0.00
02:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:00:01 AM eth0 1.42 1.08 0.37 0.22 0.00 0.00 0.00 0.00
02:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:01:01 AM eth0 1.30 1.03 0.37 0.22 0.00 0.00 0.00 0.00
02:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:02:01 AM eth0 2.13 1.15 0.76 0.44 0.00 0.00 0.00 0.00
02:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:03:01 AM eth0 1.60 1.23 0.65 0.41 0.00 0.00 0.00 0.00
02:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:04:01 AM eth0 1.68 1.27 0.66 0.45 0.00 0.00 0.00 0.00
02:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:05:01 AM eth0 17.23 14.68 2.77 1.50 0.00 0.00 0.00 0.00
02:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:06:01 AM eth0 13.60 10.66 2.49 1.59 0.00 0.00 0.00 0.00
02:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:07:01 AM eth0 13.75 9.61 2.91 1.85 0.00 0.00 0.00 0.00
02:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:08:01 AM eth0 18.38 9.28 3.32 1.79 0.00 0.00 0.00 0.00
02:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:09:01 AM eth0 15.44 9.98 3.69 2.38 0.00 0.00 0.00 0.00
02:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:10:01 AM eth0 13.88 9.25 2.76 1.77 0.00 0.00 0.00 0.00
02:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:11:01 AM eth0 18.61 9.20 3.40 1.76 0.00 0.00 0.00 0.00
02:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:12:01 AM eth0 11.96 7.33 2.51 1.61 0.00 0.00 0.00 0.00
02:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:13:01 AM eth0 7.08 4.72 1.27 0.89 0.00 0.00 0.00 0.00
02:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:14:01 AM eth0 14.58 9.53 2.83 1.79 0.00 0.00 0.00 0.00
02:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:15:01 AM eth0 13.73 9.30 2.76 1.77 0.00 0.00 0.00 0.00
02:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:16:01 AM eth0 14.30 9.56 2.85 1.84 0.00 0.00 0.00 0.00
02:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:17:01 AM eth0 14.75 9.42 2.89 1.84 0.00 0.00 0.00 0.00
02:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:18:01 AM eth0 16.59 9.41 2.89 1.80 0.00 0.00 0.00 0.00
02:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:19:01 AM eth0 13.16 8.62 2.50 1.62 0.00 0.00 0.00 0.00
02:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:20:01 AM eth0 7.10 5.10 1.38 0.98 0.00 0.00 0.00 0.00
02:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:21:01 AM eth0 13.78 9.41 2.76 1.83 0.00 0.00 0.00 0.00
02:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:22:01 AM eth0 16.55 9.17 3.38 2.00 0.00 0.00 0.00 0.00
02:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:23:01 AM eth0 14.35 9.80 3.51 2.34 0.00 0.00 0.00 0.00
02:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:24:01 AM eth0 18.59 9.38 3.48 1.82 0.00 0.00 0.00 0.00
02:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:25:01 AM eth0 16.16 9.70 3.04 1.81 0.00 0.00 0.00 0.00
02:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:26:01 AM eth0 16.98 11.40 3.42 2.19 0.00 0.00 0.00 0.00
02:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:27:01 AM eth0 13.80 9.47 2.73 1.69 0.00 0.00 0.00 0.00
02:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:28:01 AM eth0 1.72 1.03 0.38 0.22 0.00 0.00 0.00 0.00
02:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:29:01 AM eth0 1.57 1.05 0.38 0.22 0.00 0.00 0.00 0.00
02:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:30:01 AM eth0 1.45 1.03 0.38 0.22 0.00 0.00 0.00 0.00
02:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:31:01 AM eth0 1.50 1.00 0.37 0.22 0.00 0.00 0.00 0.00
02:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:32:01 AM eth0 2.83 1.17 0.63 0.29 0.00 0.00 0.00 0.00
02:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:33:01 AM eth0 16.63 14.75 2.90 1.69 0.00 0.00 0.00 0.00
02:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:34:01 AM eth0 18.31 14.31 58.57 1.14 0.00 0.00 0.00 0.00
02:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:35:01 AM eth0 11.38 10.45 1.67 0.98 0.00 0.00 0.00 0.00
02:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:36:01 AM eth0 17.23 14.08 3.07 1.90 0.00 0.00 0.00 0.00
02:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:37:01 AM eth0 14.13 9.65 2.94 1.87 0.00 0.00 0.00 0.00
02:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:38:01 AM eth0 13.98 9.42 2.82 1.78 0.00 0.00 0.00 0.00
02:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:39:01 AM eth0 13.13 9.06 2.68 1.76 0.00 0.00 0.00 0.00
02:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:40:01 AM eth0 13.28 9.20 2.70 1.79 0.00 0.00 0.00 0.00
02:41:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:41:01 AM eth0 13.33 9.33 2.73 1.79 0.00 0.00 0.00 0.00
02:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:42:01 AM eth0 26.61 18.54 5.61 3.64 0.00 0.00 0.00 0.00
02:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:43:01 AM eth0 0.88 0.57 0.17 0.10 0.00 0.00 0.00 0.00
02:44:02 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:44:02 AM eth0 1.97 1.05 0.50 0.22 0.00 0.00 0.00 0.00
02:45:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:45:01 AM eth0 1.08 1.02 0.35 0.22 0.00 0.00 0.00 0.00
02:46:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:46:01 AM eth0 2.27 1.08 2.42 0.22 0.00 0.00 0.00 0.00
02:47:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:47:01 AM eth0 1.73 1.12 0.53 0.28 0.00 0.00 0.00 0.00
02:48:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:48:01 AM eth0 1.53 1.15 0.61 0.40 0.00 0.00 0.00 0.00
02:49:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:49:01 AM eth0 16.31 14.83 2.62 1.53 0.00 0.00 0.00 0.00
02:50:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:50:01 AM eth0 14.90 14.01 2.31 1.30 0.00 0.00 0.00 0.00
02:51:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:51:01 AM eth0 12.61 11.35 1.96 1.17 0.00 0.00 0.00 0.00
02:52:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:52:01 AM eth0 18.86 14.73 3.41 2.04 0.00 0.00 0.00 0.00
02:53:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:53:01 AM eth0 13.65 9.22 2.77 1.77 0.00 0.00 0.00 0.00
02:54:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:54:01 AM eth0 13.56 9.33 2.78 1.77 0.00 0.00 0.00 0.00
02:55:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:55:01 AM eth0 13.80 9.57 2.81 1.84 0.00 0.00 0.00 0.00
02:56:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:56:01 AM eth0 12.83 9.08 2.67 1.76 0.00 0.00 0.00 0.00
02:57:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:57:01 AM eth0 13.91 9.52 2.92 1.84 0.00 0.00 0.00 0.00
02:58:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:58:01 AM eth0 23.64 16.53 4.70 3.07 0.00 0.00 0.00 0.00
02:59:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:59:01 AM eth0 1.22 0.90 0.28 0.17 0.00 0.00 0.00 0.00
03:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:00:01 AM eth0 1.28 1.03 0.37 0.22 0.00 0.00 0.00 0.00
03:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:01:01 AM eth0 1.10 0.88 0.30 0.18 0.00 0.00 0.00 0.00
03:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:02:01 AM eth0 1.38 1.15 0.50 0.28 0.00 0.00 0.00 0.00
03:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:03:01 AM eth0 1.33 1.05 0.36 0.22 0.00 0.00 0.00 0.00
03:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:04:01 AM eth0 5.70 4.38 1.29 0.88 0.00 0.00 0.00 0.00
03:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:05:01 AM eth0 14.88 14.60 2.10 1.08 0.00 0.00 0.00 0.00
03:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:06:01 AM eth0 0.67 0.25 0.07 0.06 0.00 0.00 0.00 0.00
03:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:07:01 AM eth0 15.33 14.13 2.46 1.40 0.00 0.00 0.00 0.00
03:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:08:01 AM eth0 14.63 10.26 2.97 1.93 0.00 0.00 0.00 0.00
03:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:09:01 AM eth0 13.06 9.23 2.74 1.77 0.00 0.00 0.00 0.00
03:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:10:01 AM eth0 13.28 9.33 2.81 1.82 0.00 0.00 0.00 0.00
03:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:11:01 AM eth0 13.54 9.28 2.82 1.77 0.00 0.00 0.00 0.00
03:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:12:01 AM eth0 12.81 9.08 2.85 1.82 0.00 0.00 0.00 0.00
03:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:13:01 AM eth0 12.80 9.08 2.68 1.76 0.00 0.00 0.00 0.00
03:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:14:01 AM eth0 19.60 14.41 3.99 2.65 0.00 0.00 0.00 0.00
03:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:15:01 AM eth0 1.25 1.03 0.32 0.20 0.00 0.00 0.00 0.00
03:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:16:01 AM eth0 1.17 1.03 0.37 0.22 0.00 0.00 0.00 0.00
03:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:17:01 AM eth0 1.42 1.20 0.50 0.29 0.00 0.00 0.00 0.00
03:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:18:01 AM eth0 1.17 1.07 0.36 0.22 0.00 0.00 0.00 0.00
03:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:19:01 AM eth0 1.15 1.05 0.35 0.22 0.00 0.00 0.00 0.00
03:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:20:01 AM eth0 11.46 10.11 2.02 1.20 0.00 0.00 0.00 0.00
03:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:21:01 AM eth0 13.65 11.26 2.34 1.65 0.00 0.00 0.00 0.00
03:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:22:01 AM eth0 16.78 14.75 3.09 1.83 0.00 0.00 0.00 0.00
03:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:23:01 AM eth0 15.63 13.41 4.96 1.74 0.00 0.00 0.00 0.00
03:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:24:01 AM eth0 17.08 15.23 4.96 2.04 0.00 0.00 0.00 0.00
03:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:25:01 AM eth0 179.57 110.13 330.81 458.06 0.00 0.00 0.00 0.00
03:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:26:01 AM eth0 21.96 20.58 39.11 9.55 0.00 0.00 0.00 0.00
Average: lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
Average: eth0 11.51 8.04 4.22 3.61 0.00 0.00 0.00 0.00
---> sar -P ALL:
Linux 4.18.0-553.5.1.el8.x86_64 (prd-centos8-robot-2c-8g-5937.novalocal) 03/09/2025 _x86_64_ (2 CPU)
12:00:01 AM CPU %user %nice %system %iowait %steal %idle
12:01:01 AM all 4.27 0.02 0.47 0.02 0.09 95.14
12:01:01 AM 0 5.15 0.03 0.64 0.00 0.08 94.10
12:01:01 AM 1 3.39 0.00 0.30 0.03 0.10 96.18
12:02:01 AM all 4.33 0.00 0.33 0.00 0.08 95.27
12:02:01 AM 0 4.86 0.00 0.37 0.00 0.08 94.68
12:02:01 AM 1 3.79 0.00 0.28 0.00 0.07 95.86
12:03:01 AM all 4.24 0.00 0.31 0.00 0.09 95.35
12:03:01 AM 0 4.04 0.00 0.27 0.00 0.08 95.60
12:03:01 AM 1 4.44 0.00 0.35 0.00 0.10 95.11
12:04:01 AM all 6.37 0.00 0.33 0.00 0.08 93.21
12:04:01 AM 0 8.48 0.00 0.38 0.00 0.08 91.05
12:04:01 AM 1 4.26 0.00 0.28 0.00 0.08 95.37
12:05:01 AM all 0.88 0.00 0.11 0.00 0.08 98.93
12:05:01 AM 0 0.62 0.00 0.07 0.00 0.07 99.25
12:05:01 AM 1 1.15 0.00 0.15 0.00 0.08 98.61
12:06:01 AM all 1.16 0.00 0.12 0.00 0.07 98.65
12:06:01 AM 0 1.20 0.00 0.08 0.00 0.05 98.66
12:06:01 AM 1 1.12 0.00 0.15 0.00 0.08 98.65
12:07:01 AM all 1.21 0.00 0.13 0.00 0.08 98.57
12:07:01 AM 0 0.48 0.00 0.10 0.00 0.08 99.33
12:07:01 AM 1 1.94 0.00 0.17 0.00 0.08 97.81
12:08:01 AM all 1.29 0.00 0.15 0.00 0.08 98.48
12:08:01 AM 0 0.92 0.00 0.12 0.00 0.05 98.91
12:08:01 AM 1 1.67 0.00 0.18 0.00 0.10 98.05
12:09:01 AM all 1.30 0.00 0.14 0.00 0.07 98.49
12:09:01 AM 0 1.17 0.00 0.12 0.00 0.05 98.66
12:09:01 AM 1 1.44 0.00 0.17 0.00 0.08 98.31
12:10:01 AM all 2.22 0.00 0.14 0.00 0.08 97.56
12:10:01 AM 0 0.85 0.00 0.10 0.00 0.05 99.00
12:10:01 AM 1 3.59 0.00 0.18 0.00 0.10 96.12
12:11:01 AM all 5.89 0.00 0.48 0.00 0.08 93.56
12:11:01 AM 0 0.47 0.00 0.17 0.00 0.08 99.28
12:11:01 AM 1 11.73 0.00 0.81 0.00 0.07 87.39
12:11:01 AM CPU %user %nice %system %iowait %steal %idle
12:12:01 AM all 0.49 0.00 0.09 0.00 0.09 99.32
12:12:01 AM 0 0.63 0.00 0.08 0.00 0.08 99.20
12:12:01 AM 1 0.35 0.00 0.10 0.00 0.10 99.45
12:13:01 AM all 1.27 0.00 0.13 0.00 0.08 98.52
12:13:01 AM 0 0.65 0.00 0.08 0.00 0.05 99.22
12:13:01 AM 1 1.90 0.00 0.19 0.00 0.10 97.81
12:14:01 AM all 5.41 0.00 0.26 0.00 0.08 94.25
12:14:01 AM 0 3.02 0.00 0.15 0.00 0.08 96.74
12:14:01 AM 1 7.85 0.00 0.37 0.00 0.07 91.70
12:15:01 AM all 4.16 0.00 0.16 0.00 0.08 95.60
12:15:01 AM 0 2.81 0.00 0.15 0.00 0.07 96.97
12:15:01 AM 1 5.52 0.00 0.17 0.00 0.10 94.22
12:16:01 AM all 4.24 0.00 0.19 0.01 0.08 95.48
12:16:01 AM 0 5.06 0.00 0.18 0.00 0.08 94.67
12:16:01 AM 1 3.41 0.00 0.20 0.02 0.08 96.29
12:17:01 AM all 4.31 0.00 0.19 0.01 0.09 95.40
12:17:01 AM 0 4.84 0.00 0.18 0.00 0.10 94.87
12:17:01 AM 1 3.77 0.00 0.20 0.02 0.08 95.93
12:18:01 AM all 4.15 0.00 0.18 0.00 0.08 95.59
12:18:01 AM 0 2.82 0.00 0.17 0.00 0.07 96.94
12:18:01 AM 1 5.48 0.00 0.18 0.00 0.10 94.23
12:19:01 AM all 4.24 0.00 0.17 0.00 0.08 95.51
12:19:01 AM 0 2.39 0.00 0.15 0.00 0.08 97.38
12:19:01 AM 1 6.10 0.00 0.18 0.00 0.08 93.63
12:20:01 AM all 5.69 0.00 0.31 0.00 0.07 93.93
12:20:01 AM 0 9.06 0.00 0.51 0.00 0.05 90.38
12:20:01 AM 1 2.49 0.00 0.12 0.00 0.08 97.31
12:21:01 AM all 1.07 0.00 0.13 0.00 0.10 98.71
12:21:01 AM 0 1.50 0.00 0.17 0.00 0.10 98.23
12:21:01 AM 1 0.63 0.00 0.08 0.00 0.10 99.18
12:22:01 AM all 0.47 0.00 0.11 0.00 0.07 99.36
12:22:01 AM 0 0.30 0.00 0.15 0.00 0.08 99.47
12:22:01 AM 1 0.63 0.00 0.07 0.00 0.05 99.25
12:22:01 AM CPU %user %nice %system %iowait %steal %idle
12:23:01 AM all 5.90 0.00 0.39 0.00 0.07 93.64
12:23:01 AM 0 4.09 0.00 0.32 0.00 0.07 95.52
12:23:01 AM 1 7.73 0.00 0.46 0.00 0.07 91.74
12:24:01 AM all 4.26 0.00 0.33 0.00 0.09 95.32
12:24:01 AM 0 2.26 0.00 0.22 0.00 0.08 97.44
12:24:01 AM 1 6.27 0.00 0.43 0.00 0.10 93.20
12:25:01 AM all 4.15 0.00 0.33 0.00 0.08 95.43
12:25:01 AM 0 3.44 0.00 0.32 0.00 0.08 96.15
12:25:01 AM 1 4.85 0.00 0.35 0.00 0.08 94.71
12:26:01 AM all 4.16 0.00 0.29 0.00 0.09 95.45
12:26:01 AM 0 2.67 0.00 0.20 0.00 0.08 97.04
12:26:01 AM 1 5.66 0.00 0.38 0.00 0.10 93.86
12:27:01 AM all 4.15 0.00 0.31 0.00 0.08 95.45
12:27:01 AM 0 2.51 0.00 0.22 0.00 0.07 97.21
12:27:01 AM 1 5.80 0.00 0.40 0.00 0.10 93.70
12:28:01 AM all 4.17 0.00 0.29 0.00 0.08 95.46
12:28:01 AM 0 5.48 0.00 0.37 0.00 0.08 94.06
12:28:01 AM 1 2.86 0.00 0.22 0.00 0.07 96.86
12:29:01 AM all 6.72 0.00 0.36 0.00 0.08 92.84
12:29:01 AM 0 4.06 0.00 0.23 0.00 0.07 95.64
12:29:01 AM 1 9.38 0.00 0.49 0.00 0.10 90.03
12:30:01 AM all 1.34 0.00 0.14 0.00 0.08 98.44
12:30:01 AM 0 1.54 0.00 0.15 0.00 0.08 98.23
12:30:01 AM 1 1.15 0.00 0.13 0.00 0.07 98.65
12:31:01 AM all 1.10 0.00 0.13 0.00 0.08 98.69
12:31:01 AM 0 1.09 0.00 0.13 0.00 0.08 98.70
12:31:01 AM 1 1.12 0.00 0.12 0.00 0.08 98.68
12:32:02 AM all 1.25 0.23 0.23 0.37 0.08 97.84
12:32:02 AM 0 0.85 0.00 0.15 0.52 0.08 98.40
12:32:02 AM 1 1.65 0.45 0.32 0.22 0.08 97.28
12:33:01 AM all 1.36 0.00 0.11 0.00 0.08 98.46
12:33:01 AM 0 0.63 0.00 0.05 0.00 0.05 99.27
12:33:01 AM 1 2.09 0.00 0.17 0.00 0.10 97.64
12:33:01 AM CPU %user %nice %system %iowait %steal %idle
12:34:01 AM all 1.09 0.00 0.12 0.00 0.07 98.72
12:34:01 AM 0 1.00 0.00 0.08 0.00 0.05 98.86
12:34:01 AM 1 1.19 0.00 0.15 0.00 0.08 98.58
12:35:01 AM all 1.27 0.00 0.10 0.00 0.08 98.56
12:35:01 AM 0 1.89 0.00 0.15 0.00 0.10 97.86
12:35:01 AM 1 0.65 0.00 0.05 0.00 0.05 99.25
12:36:01 AM all 6.47 0.00 0.42 0.00 0.07 93.04
12:36:01 AM 0 5.36 0.00 0.32 0.00 0.07 94.25
12:36:01 AM 1 7.61 0.00 0.52 0.00 0.07 91.80
12:37:01 AM all 5.98 0.00 0.38 0.00 0.09 93.56
12:37:01 AM 0 7.59 0.00 0.41 0.00 0.09 91.92
12:37:01 AM 1 4.39 0.00 0.34 0.00 0.08 95.18
12:38:01 AM all 4.22 0.00 0.16 0.00 0.08 95.55
12:38:01 AM 0 4.33 0.00 0.17 0.00 0.07 95.43
12:38:01 AM 1 4.11 0.00 0.15 0.00 0.08 95.66
12:39:01 AM all 4.29 0.00 0.16 0.00 0.08 95.47
12:39:01 AM 0 2.89 0.00 0.13 0.00 0.08 96.89
12:39:01 AM 1 5.68 0.00 0.18 0.00 0.08 94.05
12:40:01 AM all 4.17 0.00 0.18 0.00 0.08 95.56
12:40:01 AM 0 3.98 0.00 0.18 0.00 0.08 95.75
12:40:01 AM 1 4.36 0.00 0.18 0.00 0.08 95.37
12:41:01 AM all 4.31 0.00 0.16 0.00 0.08 95.45
12:41:01 AM 0 2.14 0.00 0.15 0.00 0.07 97.64
12:41:01 AM 1 6.49 0.00 0.17 0.00 0.08 93.26
12:42:01 AM all 4.15 0.00 0.16 0.00 0.08 95.61
12:42:01 AM 0 4.36 0.00 0.17 0.00 0.08 95.39
12:42:01 AM 1 3.94 0.00 0.15 0.00 0.08 95.82
12:43:01 AM all 5.13 0.00 0.25 0.00 0.08 94.54
12:43:01 AM 0 7.19 0.00 0.36 0.00 0.09 92.37
12:43:01 AM 1 3.12 0.00 0.13 0.00 0.08 96.66
12:44:01 AM all 6.51 0.00 0.42 0.01 0.07 92.99
12:44:01 AM 0 10.96 0.00 0.69 0.00 0.05 88.29
12:44:01 AM 1 2.34 0.00 0.17 0.02 0.08 97.40
12:44:01 AM CPU %user %nice %system %iowait %steal %idle
12:45:01 AM all 4.19 0.00 0.15 0.00 0.08 95.59
12:45:01 AM 0 2.57 0.00 0.15 0.00 0.07 97.21
12:45:01 AM 1 5.80 0.00 0.15 0.00 0.08 93.97
12:46:01 AM all 4.28 0.00 0.13 0.00 0.09 95.50
12:46:01 AM 0 2.07 0.00 0.10 0.00 0.08 97.75
12:46:01 AM 1 6.49 0.00 0.17 0.00 0.10 93.24
12:47:01 AM all 4.18 0.00 0.18 0.00 0.08 95.57
12:47:01 AM 0 3.81 0.00 0.17 0.00 0.07 95.96
12:47:01 AM 1 4.55 0.00 0.18 0.00 0.08 95.19
12:48:01 AM all 4.12 0.00 0.18 0.00 0.10 95.60
12:48:01 AM 0 2.39 0.00 0.17 0.00 0.08 97.36
12:48:01 AM 1 5.85 0.00 0.20 0.00 0.12 93.84
12:49:01 AM all 4.32 0.00 0.17 0.00 0.08 95.43
12:49:01 AM 0 3.58 0.00 0.15 0.00 0.08 96.19
12:49:01 AM 1 5.06 0.00 0.18 0.00 0.08 94.67
12:50:01 AM all 4.87 0.00 0.22 0.00 0.08 94.84
12:50:01 AM 0 2.54 0.00 0.12 0.00 0.07 97.28
12:50:01 AM 1 7.24 0.00 0.32 0.00 0.09 92.35
12:51:01 AM all 6.64 0.00 0.39 0.00 0.07 92.90
12:51:01 AM 0 4.17 0.00 0.29 0.00 0.07 95.48
12:51:01 AM 1 9.21 0.00 0.49 0.00 0.07 90.23
12:52:01 AM all 4.15 0.00 0.33 0.00 0.08 95.44
12:52:01 AM 0 4.14 0.00 0.33 0.00 0.08 95.44
12:52:01 AM 1 4.16 0.00 0.32 0.00 0.08 95.44
12:53:01 AM all 4.15 0.00 0.28 0.00 0.08 95.48
12:53:01 AM 0 6.54 0.00 0.42 0.00 0.08 92.96
12:53:01 AM 1 1.77 0.00 0.15 0.00 0.08 98.00
12:54:01 AM all 4.29 0.00 0.30 0.00 0.08 95.34
12:54:01 AM 0 3.85 0.00 0.30 0.00 0.07 95.79
12:54:01 AM 1 4.73 0.00 0.30 0.00 0.08 94.88
12:55:01 AM all 4.06 0.00 0.32 0.00 0.09 95.54
12:55:01 AM 0 2.58 0.00 0.25 0.00 0.08 97.09
12:55:01 AM 1 5.53 0.00 0.38 0.00 0.10 93.98
12:55:01 AM CPU %user %nice %system %iowait %steal %idle
12:56:01 AM all 4.02 0.00 0.29 0.00 0.08 95.60
12:56:01 AM 0 2.70 0.00 0.22 0.00 0.07 97.02
12:56:01 AM 1 5.35 0.00 0.37 0.00 0.10 94.18
12:57:01 AM all 6.47 0.00 0.38 0.00 0.09 93.06
12:57:01 AM 0 4.76 0.00 0.32 0.00 0.08 94.84
12:57:01 AM 1 8.18 0.00 0.43 0.00 0.10 91.28
12:58:01 AM all 1.74 0.00 0.10 0.00 0.08 98.09
12:58:01 AM 0 0.95 0.00 0.10 0.00 0.07 98.88
12:58:01 AM 1 2.52 0.00 0.10 0.00 0.08 97.29
12:59:01 AM all 1.28 0.00 0.12 0.00 0.08 98.53
12:59:01 AM 0 1.49 0.00 0.15 0.00 0.08 98.28
12:59:01 AM 1 1.07 0.00 0.08 0.00 0.07 98.78
01:00:01 AM all 1.22 0.00 0.14 0.00 0.10 98.54
01:00:01 AM 0 0.68 0.00 0.07 0.00 0.07 99.18
01:00:01 AM 1 1.75 0.00 0.22 0.00 0.13 97.90
01:01:01 AM all 1.29 0.00 0.13 0.00 0.08 98.51
01:01:01 AM 0 1.15 0.00 0.13 0.00 0.07 98.65
01:01:01 AM 1 1.42 0.00 0.12 0.00 0.08 98.38
01:02:01 AM all 1.11 0.00 0.13 0.00 0.08 98.69
01:02:01 AM 0 1.42 0.00 0.13 0.00 0.08 98.36
01:02:01 AM 1 0.80 0.00 0.12 0.00 0.07 99.02
01:03:01 AM all 1.23 0.00 0.13 0.00 0.07 98.58
01:03:01 AM 0 0.60 0.00 0.12 0.00 0.08 99.20
01:03:01 AM 1 1.85 0.00 0.13 0.00 0.05 97.96
01:04:01 AM all 6.49 0.00 0.43 0.00 0.07 93.01
01:04:01 AM 0 2.52 0.00 0.13 0.00 0.08 97.26
01:04:01 AM 1 10.68 0.00 0.74 0.00 0.05 88.52
01:05:01 AM all 6.09 0.00 0.36 0.00 0.09 93.47
01:05:01 AM 0 4.48 0.00 0.17 0.00 0.08 95.27
01:05:01 AM 1 7.77 0.00 0.56 0.00 0.09 91.59
01:06:01 AM all 4.02 0.00 0.18 0.00 0.08 95.73
01:06:01 AM 0 5.17 0.00 0.20 0.00 0.08 94.55
01:06:01 AM 1 2.87 0.00 0.15 0.00 0.07 96.91
01:06:01 AM CPU %user %nice %system %iowait %steal %idle
01:07:01 AM all 4.29 0.00 0.15 0.00 0.10 95.45
01:07:01 AM 0 3.83 0.00 0.13 0.00 0.10 95.94
01:07:01 AM 1 4.76 0.00 0.17 0.00 0.10 94.97
01:08:01 AM all 4.11 0.00 0.16 0.00 0.08 95.65
01:08:01 AM 0 1.77 0.00 0.15 0.00 0.07 98.01
01:08:01 AM 1 6.46 0.00 0.17 0.00 0.10 93.27
01:09:01 AM all 4.26 0.00 0.17 0.00 0.10 95.47
01:09:01 AM 0 3.26 0.00 0.15 0.00 0.10 96.49
01:09:01 AM 1 5.26 0.00 0.18 0.00 0.10 94.45
01:10:01 AM all 4.11 0.00 0.18 0.00 0.08 95.63
01:10:01 AM 0 4.90 0.00 0.18 0.00 0.08 94.83
01:10:01 AM 1 3.32 0.00 0.17 0.00 0.08 96.42
01:11:01 AM all 5.04 0.00 0.25 0.00 0.08 94.62
01:11:01 AM 0 2.17 0.00 0.13 0.00 0.08 97.61
01:11:01 AM 1 7.99 0.00 0.38 0.00 0.09 91.54
01:12:01 AM all 6.76 0.00 0.48 0.00 0.09 92.68
01:12:01 AM 0 0.70 0.00 0.15 0.00 0.08 99.07
01:12:01 AM 1 13.26 0.00 0.82 0.00 0.09 85.83
01:13:01 AM all 4.92 0.00 0.31 0.00 0.08 94.68
01:13:01 AM 0 5.98 0.00 0.28 0.00 0.08 93.65
01:13:01 AM 1 3.86 0.00 0.33 0.00 0.08 95.72
01:14:01 AM all 4.21 0.00 0.32 0.00 0.08 95.39
01:14:01 AM 0 4.38 0.00 0.32 0.00 0.08 95.22
01:14:01 AM 1 4.04 0.00 0.32 0.00 0.08 95.56
01:15:01 AM all 4.35 0.00 0.33 0.00 0.08 95.24
01:15:01 AM 0 1.79 0.00 0.18 0.00 0.07 97.96
01:15:01 AM 1 6.92 0.00 0.48 0.00 0.08 92.51
01:16:01 AM all 4.18 0.00 0.28 0.00 0.08 95.46
01:16:01 AM 0 1.77 0.00 0.13 0.00 0.07 98.03
01:16:01 AM 1 6.59 0.00 0.42 0.00 0.10 92.90
01:17:01 AM all 4.09 0.00 0.29 0.01 0.08 95.52
01:17:01 AM 0 1.85 0.00 0.20 0.02 0.07 97.86
01:17:01 AM 1 6.33 0.00 0.38 0.00 0.10 93.18
01:17:01 AM CPU %user %nice %system %iowait %steal %idle
01:18:01 AM all 4.29 0.00 0.33 0.00 0.08 95.30
01:18:01 AM 0 3.59 0.00 0.30 0.00 0.08 96.03
01:18:01 AM 1 4.99 0.00 0.35 0.00 0.08 94.57
01:19:01 AM all 4.52 0.00 0.23 0.00 0.08 95.16
01:19:01 AM 0 1.06 0.00 0.15 0.00 0.08 98.71
01:19:01 AM 1 7.98 0.00 0.32 0.00 0.08 91.62
01:20:01 AM all 1.19 0.00 0.11 0.00 0.08 98.62
01:20:01 AM 0 1.19 0.00 0.10 0.00 0.07 98.65
01:20:01 AM 1 1.20 0.00 0.12 0.00 0.08 98.60
01:21:01 AM all 1.06 0.00 0.13 0.00 0.08 98.74
01:21:01 AM 0 0.18 0.00 0.10 0.00 0.05 99.66
01:21:01 AM 1 1.94 0.00 0.15 0.00 0.10 97.81
01:22:01 AM all 1.26 0.00 0.13 0.00 0.08 98.52
01:22:01 AM 0 0.93 0.00 0.10 0.00 0.07 98.90
01:22:01 AM 1 1.59 0.00 0.17 0.00 0.10 98.15
01:23:01 AM all 1.24 0.00 0.09 0.00 0.08 98.59
01:23:01 AM 0 0.53 0.00 0.05 0.00 0.07 99.35
01:23:01 AM 1 1.94 0.00 0.13 0.00 0.10 97.83
01:24:01 AM all 1.10 0.00 0.13 0.00 0.08 98.68
01:24:01 AM 0 0.27 0.00 0.10 0.00 0.07 99.56
01:24:01 AM 1 1.94 0.00 0.17 0.00 0.10 97.80
01:25:01 AM all 5.23 0.00 0.31 0.00 0.08 94.38
01:25:01 AM 0 0.63 0.00 0.10 0.00 0.08 99.18
01:25:01 AM 1 9.96 0.00 0.53 0.00 0.07 89.44
01:26:01 AM all 6.11 0.00 0.49 0.00 0.08 93.32
01:26:01 AM 0 0.92 0.00 0.10 0.00 0.07 98.91
01:26:01 AM 1 11.43 0.00 0.89 0.00 0.09 87.60
01:27:01 AM all 5.48 0.00 0.46 0.00 0.08 93.99
01:27:01 AM 0 0.73 0.00 0.12 0.00 0.05 99.10
01:27:01 AM 1 10.32 0.00 0.80 0.00 0.10 88.78
01:28:01 AM all 4.99 0.00 0.18 0.00 0.08 94.75
01:28:01 AM 0 2.71 0.00 0.13 0.00 0.08 97.08
01:28:01 AM 1 7.27 0.00 0.22 0.00 0.08 92.42
01:28:01 AM CPU %user %nice %system %iowait %steal %idle
01:29:01 AM all 4.31 0.00 0.20 0.00 0.09 95.40
01:29:01 AM 0 3.84 0.00 0.18 0.00 0.08 95.89
01:29:01 AM 1 4.78 0.00 0.22 0.00 0.10 94.90
01:30:01 AM all 4.25 0.00 0.19 0.00 0.08 95.48
01:30:01 AM 0 2.79 0.00 0.17 0.00 0.07 96.97
01:30:01 AM 1 5.70 0.00 0.22 0.00 0.08 94.00
01:31:01 AM all 4.31 0.00 0.19 0.01 0.08 95.40
01:31:01 AM 0 4.93 0.00 0.22 0.00 0.08 94.77
01:31:01 AM 1 3.69 0.00 0.17 0.02 0.08 96.04
01:32:01 AM all 4.18 0.00 0.22 0.00 0.08 95.53
01:32:01 AM 0 2.41 0.00 0.22 0.00 0.05 97.32
01:32:01 AM 1 5.95 0.00 0.22 0.00 0.10 93.74
01:33:01 AM all 4.13 0.00 0.19 0.00 0.08 95.60
01:33:01 AM 0 4.90 0.00 0.20 0.00 0.08 94.82
01:33:01 AM 1 3.36 0.00 0.18 0.00 0.08 96.38
01:34:01 AM all 6.15 0.00 0.40 0.00 0.07 93.38
01:34:01 AM 0 11.41 0.00 0.73 0.00 0.07 87.79
01:34:01 AM 1 1.20 0.00 0.10 0.00 0.07 98.63
01:35:01 AM all 4.76 0.00 0.42 0.01 0.08 94.74
01:35:01 AM 0 0.99 0.00 0.13 0.02 0.05 98.81
01:35:01 AM 1 8.53 0.00 0.70 0.00 0.10 90.66
01:36:01 AM all 6.03 0.00 0.34 0.00 0.08 93.56
01:36:01 AM 0 2.54 0.00 0.13 0.00 0.07 97.26
01:36:01 AM 1 9.58 0.00 0.54 0.00 0.09 89.79
01:37:02 AM all 4.24 0.00 0.16 0.00 0.08 95.53
01:37:02 AM 0 2.45 0.00 0.13 0.00 0.07 97.34
01:37:02 AM 1 6.02 0.00 0.18 0.00 0.08 93.71
01:38:01 AM all 4.23 0.00 0.19 0.00 0.08 95.50
01:38:01 AM 0 3.26 0.00 0.19 0.00 0.07 96.48
01:38:01 AM 1 5.20 0.00 0.19 0.00 0.08 94.53
01:39:01 AM all 4.35 0.00 0.17 0.00 0.06 95.43
01:39:01 AM 0 2.51 0.00 0.13 0.00 0.05 97.31
01:39:01 AM 1 6.19 0.00 0.20 0.00 0.07 93.55
01:39:01 AM CPU %user %nice %system %iowait %steal %idle
01:40:01 AM all 4.13 0.00 0.17 0.00 0.08 95.62
01:40:01 AM 0 1.92 0.00 0.15 0.00 0.07 97.86
01:40:01 AM 1 6.33 0.00 0.18 0.00 0.10 93.38
01:41:01 AM all 4.12 0.00 0.15 0.00 0.08 95.65
01:41:01 AM 0 2.39 0.00 0.12 0.00 0.08 97.41
01:41:01 AM 1 5.85 0.00 0.18 0.00 0.08 93.89
01:42:01 AM all 5.66 0.00 0.36 0.00 0.08 93.91
01:42:01 AM 0 1.66 0.00 0.17 0.00 0.08 98.09
01:42:01 AM 1 9.75 0.00 0.55 0.00 0.07 89.63
01:43:01 AM all 3.97 0.00 0.39 0.00 0.08 95.56
01:43:01 AM 0 4.68 0.00 0.43 0.00 0.08 94.80
01:43:01 AM 1 3.25 0.00 0.35 0.00 0.08 96.31
01:44:01 AM all 6.36 0.00 0.40 0.00 0.08 93.15
01:44:01 AM 0 1.37 0.00 0.15 0.00 0.08 98.40
01:44:01 AM 1 11.47 0.00 0.67 0.00 0.09 87.78
01:45:01 AM all 4.31 0.00 0.16 0.00 0.09 95.44
01:45:01 AM 0 2.96 0.00 0.15 0.00 0.08 96.81
01:45:01 AM 1 5.67 0.00 0.17 0.00 0.10 94.07
01:46:01 AM all 4.11 0.00 0.19 0.00 0.09 95.60
01:46:01 AM 0 3.90 0.00 0.18 0.00 0.08 95.84
01:46:01 AM 1 4.33 0.00 0.20 0.00 0.10 95.37
01:47:01 AM all 4.29 0.00 0.18 0.00 0.08 95.46
01:47:01 AM 0 2.12 0.00 0.13 0.00 0.07 97.68
01:47:01 AM 1 6.45 0.00 0.22 0.00 0.10 93.24
01:48:01 AM all 4.14 0.00 0.18 0.00 0.08 95.60
01:48:01 AM 0 3.06 0.00 0.20 0.00 0.07 96.68
01:48:01 AM 1 5.23 0.00 0.17 0.00 0.08 94.52
01:49:01 AM all 4.23 0.00 0.13 0.00 0.10 95.54
01:49:01 AM 0 5.57 0.00 0.13 0.00 0.10 94.20
01:49:01 AM 1 2.89 0.00 0.13 0.00 0.10 96.88
01:50:01 AM all 5.26 0.00 0.30 0.00 0.07 94.37
01:50:01 AM 0 7.84 0.00 0.45 0.00 0.07 91.65
01:50:01 AM 1 2.77 0.00 0.15 0.00 0.07 97.01
01:50:01 AM CPU %user %nice %system %iowait %steal %idle
01:51:01 AM all 4.47 0.00 0.45 0.01 0.08 94.98
01:51:01 AM 0 3.29 0.00 0.32 0.02 0.08 96.29
01:51:01 AM 1 5.66 0.00 0.58 0.00 0.08 93.67
01:52:01 AM all 6.69 0.00 0.43 0.01 0.06 92.81
01:52:01 AM 0 7.58 0.00 0.43 0.00 0.05 91.94
01:52:01 AM 1 5.82 0.00 0.42 0.02 0.07 93.67
01:53:01 AM all 4.11 0.00 0.29 0.00 0.08 95.51
01:53:01 AM 0 1.17 0.00 0.17 0.00 0.07 98.60
01:53:01 AM 1 7.05 0.00 0.42 0.00 0.10 92.43
01:54:01 AM all 4.09 0.00 0.31 0.00 0.09 95.50
01:54:01 AM 0 3.48 0.00 0.25 0.00 0.08 96.19
01:54:01 AM 1 4.71 0.00 0.37 0.00 0.10 94.82
01:55:01 AM all 4.27 0.00 0.31 0.00 0.08 95.34
01:55:01 AM 0 1.94 0.00 0.17 0.00 0.07 97.83
01:55:01 AM 1 6.60 0.00 0.45 0.00 0.10 92.85
01:56:01 AM all 4.09 0.00 0.28 0.00 0.09 95.53
01:56:01 AM 0 2.87 0.00 0.23 0.00 0.08 96.81
01:56:01 AM 1 5.31 0.00 0.33 0.00 0.10 94.25
01:57:01 AM all 4.29 0.00 0.29 0.00 0.08 95.34
01:57:01 AM 0 3.51 0.00 0.28 0.00 0.08 96.12
01:57:01 AM 1 5.06 0.00 0.30 0.00 0.08 94.55
01:58:01 AM all 4.33 0.00 0.31 0.00 0.08 95.28
01:58:01 AM 0 1.70 0.00 0.13 0.00 0.07 98.10
01:58:01 AM 1 6.95 0.00 0.48 0.00 0.10 92.46
01:59:01 AM all 4.44 0.00 0.21 0.01 0.08 95.27
01:59:01 AM 0 4.19 0.00 0.15 0.02 0.05 95.59
01:59:01 AM 1 4.68 0.00 0.27 0.00 0.10 94.96
02:00:01 AM all 1.32 0.00 0.09 0.00 0.09 98.50
02:00:01 AM 0 0.67 0.00 0.07 0.00 0.07 99.20
02:00:01 AM 1 1.97 0.00 0.12 0.00 0.12 97.80
02:01:01 AM all 1.14 0.00 0.12 0.00 0.07 98.68
02:01:01 AM 0 0.37 0.00 0.07 0.00 0.05 99.52
02:01:01 AM 1 1.90 0.00 0.17 0.00 0.08 97.85
02:01:01 AM CPU %user %nice %system %iowait %steal %idle
02:02:01 AM all 1.02 0.00 0.14 0.00 0.07 98.77
02:02:01 AM 0 1.59 0.00 0.18 0.00 0.08 98.15
02:02:01 AM 1 0.45 0.00 0.10 0.00 0.05 99.40
02:03:01 AM all 1.23 0.00 0.12 0.00 0.08 98.58
02:03:01 AM 0 0.53 0.00 0.07 0.00 0.05 99.35
02:03:01 AM 1 1.92 0.00 0.17 0.00 0.10 97.81
02:04:01 AM all 1.27 0.00 0.13 0.00 0.08 98.52
02:04:01 AM 0 0.93 0.00 0.10 0.00 0.07 98.90
02:04:01 AM 1 1.60 0.00 0.17 0.00 0.08 98.15
02:05:01 AM all 6.74 0.00 0.38 0.00 0.07 92.81
02:05:01 AM 0 1.12 0.00 0.12 0.00 0.08 98.68
02:05:01 AM 1 12.59 0.00 0.66 0.00 0.05 86.69
02:06:01 AM all 6.71 0.00 0.36 0.00 0.06 92.88
02:06:01 AM 0 2.04 0.00 0.15 0.00 0.05 97.76
02:06:01 AM 1 11.52 0.00 0.57 0.00 0.07 87.85
02:07:01 AM all 4.14 0.00 0.18 0.00 0.08 95.59
02:07:01 AM 0 2.87 0.00 0.18 0.00 0.08 96.86
02:07:01 AM 1 5.41 0.00 0.18 0.00 0.08 94.32
02:08:01 AM all 4.10 0.00 0.18 0.00 0.07 95.66
02:08:01 AM 0 5.22 0.00 0.20 0.00 0.07 94.51
02:08:01 AM 1 2.98 0.00 0.15 0.00 0.07 96.80
02:09:01 AM all 4.27 0.00 0.18 0.00 0.08 95.47
02:09:01 AM 0 2.72 0.00 0.17 0.00 0.07 97.04
02:09:01 AM 1 5.81 0.00 0.20 0.00 0.08 93.90
02:10:01 AM all 4.15 0.00 0.18 0.00 0.08 95.59
02:10:01 AM 0 2.41 0.00 0.15 0.00 0.07 97.38
02:10:01 AM 1 5.90 0.00 0.22 0.00 0.08 93.80
02:11:01 AM all 4.23 0.00 0.18 0.00 0.08 95.50
02:11:01 AM 0 2.21 0.00 0.17 0.00 0.07 97.56
02:11:01 AM 1 6.26 0.00 0.20 0.00 0.10 93.43
02:12:01 AM all 5.11 0.00 0.24 0.00 0.08 94.58
02:12:01 AM 0 3.90 0.00 0.17 0.00 0.10 95.84
02:12:01 AM 1 6.35 0.00 0.31 0.00 0.05 93.29
02:12:01 AM CPU %user %nice %system %iowait %steal %idle
02:13:01 AM all 7.14 0.00 0.39 0.00 0.06 92.40
02:13:01 AM 0 4.87 0.00 0.24 0.00 0.07 94.83
02:13:01 AM 1 9.46 0.00 0.55 0.00 0.05 89.93
02:14:01 AM all 4.19 0.00 0.16 0.00 0.09 95.56
02:14:01 AM 0 2.12 0.00 0.12 0.00 0.08 97.68
02:14:01 AM 1 6.27 0.00 0.20 0.00 0.10 93.43
02:15:01 AM all 4.19 0.00 0.15 0.00 0.07 95.60
02:15:01 AM 0 1.17 0.00 0.12 0.00 0.05 98.66
02:15:01 AM 1 7.20 0.00 0.18 0.00 0.08 92.53
02:16:01 AM all 4.20 0.15 0.23 0.00 0.08 95.33
02:16:01 AM 0 2.82 0.00 0.18 0.00 0.07 96.92
02:16:01 AM 1 5.58 0.30 0.28 0.00 0.10 93.73
02:17:01 AM all 4.14 0.00 0.14 0.00 0.09 95.63
02:17:01 AM 0 2.66 0.00 0.12 0.00 0.08 97.14
02:17:01 AM 1 5.62 0.00 0.17 0.00 0.10 94.12
02:18:01 AM all 4.18 0.00 0.16 0.00 0.08 95.57
02:18:01 AM 0 4.93 0.00 0.18 0.00 0.10 94.79
02:18:01 AM 1 3.44 0.00 0.13 0.00 0.07 96.36
02:19:01 AM all 4.78 0.00 0.23 0.00 0.08 94.90
02:19:01 AM 0 2.04 0.00 0.15 0.00 0.07 97.75
02:19:01 AM 1 7.55 0.00 0.32 0.00 0.10 92.03
02:20:01 AM all 6.94 0.00 0.43 0.00 0.07 92.57
02:20:01 AM 0 8.50 0.00 0.56 0.00 0.05 90.89
02:20:01 AM 1 5.42 0.00 0.30 0.00 0.08 94.19
02:21:01 AM all 4.26 0.00 0.31 0.00 0.09 95.34
02:21:01 AM 0 6.66 0.00 0.45 0.00 0.10 92.79
02:21:01 AM 1 1.87 0.00 0.17 0.00 0.08 97.88
02:22:01 AM all 4.15 0.00 0.28 0.00 0.08 95.50
02:22:01 AM 0 2.42 0.00 0.20 0.00 0.07 97.31
02:22:01 AM 1 5.88 0.00 0.35 0.00 0.08 93.68
02:23:01 AM all 4.17 0.00 0.31 0.00 0.09 95.43
02:23:01 AM 0 5.40 0.00 0.32 0.00 0.08 94.20
02:23:01 AM 1 2.94 0.00 0.30 0.00 0.10 96.66
02:23:01 AM CPU %user %nice %system %iowait %steal %idle
02:24:01 AM all 4.33 0.00 0.33 0.00 0.08 95.25
02:24:01 AM 0 4.18 0.00 0.32 0.00 0.08 95.42
02:24:01 AM 1 4.48 0.00 0.35 0.00 0.08 95.09
02:25:01 AM all 4.22 0.00 0.31 0.01 0.08 95.39
02:25:01 AM 0 2.46 0.00 0.20 0.02 0.07 97.26
02:25:01 AM 1 5.98 0.00 0.42 0.00 0.08 93.52
02:26:01 AM all 5.08 0.00 0.32 0.00 0.10 94.50
02:26:01 AM 0 5.15 0.00 0.32 0.00 0.10 94.43
02:26:01 AM 1 5.01 0.00 0.32 0.00 0.10 94.57
02:27:01 AM all 3.38 0.00 0.18 0.00 0.07 96.37
02:27:01 AM 0 2.39 0.00 0.17 0.00 0.08 97.36
02:27:01 AM 1 4.37 0.00 0.20 0.00 0.05 95.38
02:28:01 AM all 1.40 0.00 0.13 0.00 0.07 98.41
02:28:01 AM 0 1.52 0.00 0.18 0.00 0.10 98.19
02:28:01 AM 1 1.28 0.00 0.07 0.00 0.03 98.62
02:29:01 AM all 1.25 0.00 0.12 0.00 0.08 98.56
02:29:01 AM 0 0.62 0.00 0.08 0.00 0.05 99.25
02:29:01 AM 1 1.89 0.00 0.15 0.00 0.10 97.86
02:30:01 AM all 1.22 0.00 0.13 0.00 0.08 98.57
02:30:01 AM 0 0.73 0.00 0.10 0.00 0.08 99.08
02:30:01 AM 1 1.70 0.00 0.15 0.00 0.08 98.06
02:31:01 AM all 1.29 0.00 0.13 0.00 0.08 98.50
02:31:01 AM 0 1.05 0.00 0.15 0.00 0.08 98.71
02:31:01 AM 1 1.53 0.00 0.12 0.00 0.07 98.28
02:32:01 AM all 1.25 0.00 0.13 0.00 0.08 98.55
02:32:01 AM 0 0.78 0.00 0.10 0.00 0.07 99.05
02:32:01 AM 1 1.72 0.00 0.15 0.00 0.08 98.05
02:33:01 AM all 5.51 0.00 2.50 0.00 0.07 91.92
02:33:01 AM 0 5.79 0.00 4.57 0.00 0.07 89.57
02:33:01 AM 1 5.23 0.00 0.49 0.00 0.07 94.21
02:34:01 AM all 8.02 0.00 0.50 0.00 0.06 91.42
02:34:01 AM 0 0.57 0.00 0.12 0.00 0.07 99.25
02:34:01 AM 1 15.90 0.00 0.90 0.00 0.05 83.15
02:34:01 AM CPU %user %nice %system %iowait %steal %idle
02:35:01 AM all 9.44 0.00 0.52 0.00 0.06 89.97
02:35:01 AM 0 0.72 0.00 0.12 0.00 0.07 99.10
02:35:01 AM 1 18.43 0.00 0.95 0.00 0.05 80.57
02:36:01 AM all 6.15 0.00 0.38 0.00 0.09 93.38
02:36:01 AM 0 8.40 0.00 0.47 0.00 0.07 91.06
02:36:01 AM 1 4.01 0.00 0.30 0.00 0.10 95.59
02:37:01 AM all 4.39 0.00 0.32 0.00 0.08 95.22
02:37:01 AM 0 1.64 0.00 0.18 0.00 0.07 98.11
02:37:01 AM 1 7.14 0.00 0.45 0.00 0.08 92.33
02:38:01 AM all 4.18 0.00 0.29 0.00 0.09 95.44
02:38:01 AM 0 1.50 0.00 0.13 0.00 0.07 98.30
02:38:01 AM 1 6.85 0.00 0.45 0.00 0.12 92.58
02:39:01 AM all 4.10 0.00 0.29 0.00 0.08 95.53
02:39:01 AM 0 2.20 0.00 0.20 0.00 0.08 97.51
02:39:01 AM 1 6.00 0.00 0.38 0.00 0.08 93.54
02:40:01 AM all 4.20 0.00 0.28 0.00 0.09 95.43
02:40:01 AM 0 2.37 0.00 0.18 0.00 0.08 97.36
02:40:01 AM 1 6.03 0.00 0.37 0.00 0.10 93.50
02:41:01 AM all 4.31 0.00 0.33 0.00 0.08 95.27
02:41:01 AM 0 2.79 0.00 0.25 0.00 0.07 96.89
02:41:01 AM 1 5.83 0.00 0.42 0.00 0.10 93.65
02:42:01 AM all 7.06 0.00 0.38 0.00 0.08 92.47
02:42:01 AM 0 4.98 0.00 0.23 0.00 0.08 94.70
02:42:01 AM 1 9.14 0.00 0.53 0.00 0.08 90.24
02:43:01 AM all 0.76 0.00 0.11 0.00 0.08 99.06
02:43:01 AM 0 0.57 0.00 0.07 0.00 0.05 99.32
02:43:01 AM 1 0.95 0.00 0.15 0.00 0.10 98.80
02:44:02 AM all 1.23 0.00 0.13 0.00 0.07 98.58
02:44:02 AM 0 0.60 0.00 0.07 0.00 0.07 99.26
02:44:02 AM 1 1.85 0.00 0.18 0.00 0.07 97.90
02:45:01 AM all 1.27 0.00 0.12 0.00 0.08 98.53
02:45:01 AM 0 0.59 0.00 0.05 0.00 0.07 99.29
02:45:01 AM 1 1.95 0.00 0.19 0.00 0.08 97.78
02:45:01 AM CPU %user %nice %system %iowait %steal %idle
02:46:01 AM all 1.29 0.00 0.10 0.00 0.08 98.52
02:46:01 AM 0 0.60 0.00 0.07 0.00 0.05 99.28
02:46:01 AM 1 1.99 0.00 0.13 0.00 0.12 97.76
02:47:01 AM all 1.27 0.00 0.10 0.01 0.08 98.55
02:47:01 AM 0 0.60 0.00 0.07 0.02 0.07 99.25
02:47:01 AM 1 1.94 0.00 0.13 0.00 0.08 97.85
02:48:01 AM all 1.26 0.00 0.11 0.00 0.08 98.56
02:48:01 AM 0 1.15 0.00 0.10 0.00 0.07 98.68
02:48:01 AM 1 1.37 0.00 0.12 0.00 0.08 98.43
02:49:01 AM all 6.57 0.00 2.63 0.00 0.08 90.72
02:49:01 AM 0 11.34 0.00 5.29 0.00 0.07 83.30
02:49:01 AM 1 2.14 0.00 0.15 0.00 0.08 97.63
02:50:01 AM all 7.26 0.00 0.50 0.00 0.07 92.17
02:50:01 AM 0 14.48 0.00 0.89 0.00 0.05 84.57
02:50:01 AM 1 0.60 0.00 0.15 0.00 0.08 99.17
02:51:01 AM all 7.83 0.00 0.51 0.00 0.06 91.60
02:51:01 AM 0 8.47 0.00 0.58 0.00 0.05 90.90
02:51:01 AM 1 7.22 0.00 0.44 0.00 0.07 92.27
02:52:01 AM all 5.63 0.00 0.41 0.00 0.09 93.87
02:52:01 AM 0 8.43 0.00 0.55 0.00 0.09 90.93
02:52:01 AM 1 2.91 0.00 0.27 0.00 0.10 96.72
02:53:01 AM all 4.17 0.00 0.31 0.00 0.08 95.44
02:53:01 AM 0 3.32 0.00 0.25 0.00 0.08 96.34
02:53:01 AM 1 5.01 0.00 0.37 0.00 0.08 94.54
02:54:01 AM all 4.17 0.00 0.28 0.00 0.09 95.46
02:54:01 AM 0 1.32 0.00 0.13 0.00 0.07 98.48
02:54:01 AM 1 7.02 0.00 0.43 0.00 0.12 92.43
02:55:01 AM all 4.31 0.00 0.31 0.00 0.08 95.30
02:55:01 AM 0 2.35 0.00 0.20 0.00 0.07 97.38
02:55:01 AM 1 6.27 0.00 0.42 0.00 0.08 93.23
02:56:01 AM all 4.11 0.00 0.28 0.00 0.08 95.52
02:56:01 AM 0 3.56 0.00 0.22 0.00 0.07 96.16
02:56:01 AM 1 4.66 0.00 0.35 0.00 0.10 94.89
02:56:01 AM CPU %user %nice %system %iowait %steal %idle
02:57:01 AM all 4.12 0.00 0.29 0.01 0.09 95.49
02:57:01 AM 0 5.89 0.00 0.37 0.00 0.10 93.64
02:57:01 AM 1 2.35 0.00 0.22 0.02 0.08 97.33
02:58:01 AM all 6.37 0.00 0.32 0.00 0.08 93.24
02:58:01 AM 0 7.43 0.00 0.35 0.00 0.08 92.14
02:58:01 AM 1 5.31 0.00 0.28 0.00 0.07 94.34
02:59:01 AM all 1.04 0.00 0.12 0.00 0.08 98.77
02:59:01 AM 0 1.10 0.00 0.13 0.00 0.08 98.68
02:59:01 AM 1 0.97 0.00 0.10 0.00 0.07 98.87
03:00:01 AM all 1.34 0.00 0.12 0.00 0.08 98.46
03:00:01 AM 0 1.77 0.00 0.13 0.00 0.10 98.00
03:00:01 AM 1 0.92 0.00 0.10 0.00 0.05 98.93
03:01:01 AM all 1.09 0.00 0.09 0.00 0.08 98.75
03:01:01 AM 0 1.14 0.00 0.10 0.00 0.07 98.70
03:01:01 AM 1 1.04 0.00 0.08 0.00 0.08 98.80
03:02:01 AM all 1.17 0.00 0.13 0.00 0.08 98.63
03:02:01 AM 0 1.18 0.00 0.12 0.00 0.07 98.63
03:02:01 AM 1 1.15 0.00 0.13 0.00 0.08 98.63
03:03:01 AM all 1.24 0.00 0.12 0.00 0.08 98.56
03:03:01 AM 0 1.00 0.00 0.12 0.00 0.08 98.80
03:03:01 AM 1 1.49 0.00 0.12 0.00 0.08 98.31
03:04:01 AM all 2.39 0.00 0.17 0.00 0.08 97.36
03:04:01 AM 0 1.70 0.00 0.15 0.00 0.10 98.05
03:04:01 AM 1 3.08 0.00 0.18 0.00 0.07 96.67
03:05:01 AM all 7.78 0.00 2.81 0.00 0.07 89.34
03:05:01 AM 0 2.45 0.00 0.24 0.00 0.07 97.25
03:05:01 AM 1 13.24 0.00 5.44 0.00 0.07 81.25
03:06:01 AM all 1.66 0.00 0.16 0.00 0.07 98.11
03:06:01 AM 0 0.57 0.00 0.07 0.00 0.05 99.32
03:06:01 AM 1 2.78 0.00 0.25 0.00 0.08 96.88
03:07:01 AM all 6.61 0.00 0.38 0.00 0.08 92.93
03:07:01 AM 0 2.57 0.00 0.20 0.00 0.07 97.16
03:07:01 AM 1 10.73 0.00 0.55 0.00 0.09 88.62
03:07:01 AM CPU %user %nice %system %iowait %steal %idle
03:08:01 AM all 5.17 0.00 0.34 0.00 0.08 94.40
03:08:01 AM 0 4.28 0.00 0.28 0.00 0.08 95.35
03:08:01 AM 1 6.06 0.00 0.40 0.00 0.08 93.45
03:09:01 AM all 4.19 0.00 0.29 0.00 0.08 95.43
03:09:01 AM 0 1.90 0.00 0.17 0.00 0.07 97.86
03:09:01 AM 1 6.48 0.00 0.42 0.00 0.10 93.00
03:10:01 AM all 4.37 0.00 0.31 0.00 0.09 95.23
03:10:01 AM 0 1.52 0.00 0.15 0.00 0.07 98.26
03:10:01 AM 1 7.22 0.00 0.47 0.00 0.12 92.20
03:11:01 AM all 4.22 0.00 0.28 0.00 0.08 95.41
03:11:01 AM 0 1.47 0.00 0.15 0.00 0.08 98.30
03:11:01 AM 1 6.97 0.00 0.42 0.00 0.08 92.53