Started by upstream project "integration-distribution-mri-test-calcium" build number 77
originally caused by:
Started by timer
Running as SYSTEM
[EnvInject] - Loading node environment variables.
Building remotely on prd-centos8-robot-2c-8g-3889 (centos8-robot-2c-8g) in workspace /w/workspace/controller-csit-3node-clustering-tell-all-calcium
[ssh-agent] Looking for ssh-agent implementation...
[ssh-agent] Exec ssh-agent (binary ssh-agent on a remote machine)
$ ssh-agent
SSH_AUTH_SOCK=/tmp/ssh-Bl2pmzjJedRy/agent.5162
SSH_AGENT_PID=5163
[ssh-agent] Started.
Running ssh-add (command line suppressed)
Identity added: /w/workspace/controller-csit-3node-clustering-tell-all-calcium@tmp/private_key_15423523957485656980.key (/w/workspace/controller-csit-3node-clustering-tell-all-calcium@tmp/private_key_15423523957485656980.key)
[ssh-agent] Using credentials jenkins (Release Engineering Jenkins Key)
The recommended git tool is: NONE
using credential opendaylight-jenkins-ssh
Wiping out workspace first.
Cloning the remote Git repository
Cloning repository git://devvexx.opendaylight.org/mirror/integration/test
> git init /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test # timeout=10
Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test
> git --version # timeout=10
> git --version # 'git version 2.43.0'
using GIT_SSH to set credentials Release Engineering Jenkins Key
[INFO] Currently running in a labeled security context
[INFO] Currently SELinux is 'enforcing' on the host
> /usr/bin/chcon --type=ssh_home_t /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test@tmp/jenkins-gitclient-ssh16410110584525669114.key
Verifying host key using known hosts file
You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification.
> git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10
Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test
using GIT_SSH to set credentials Release Engineering Jenkins Key
[INFO] Currently running in a labeled security context
[INFO] Currently SELinux is 'enforcing' on the host
> /usr/bin/chcon --type=ssh_home_t /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test@tmp/jenkins-gitclient-ssh5286427584269954691.key
Verifying host key using known hosts file
You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification.
> git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test master # timeout=10
> git rev-parse FETCH_HEAD^{commit} # timeout=10
Checking out Revision 1d2a1a30bcc48e3c8d571eb0d9b6891fe29dfed4 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 1d2a1a30bcc48e3c8d571eb0d9b6891fe29dfed4 # timeout=10
Commit message: "Add bgpcep variables for titanium"
> git rev-parse FETCH_HEAD^{commit} # timeout=10
> git rev-list --no-walk d42b2c24fe4fcc7fe3ae0d352311e768f07a15b7 # timeout=10
No emails were triggered.
provisioning config files...
copy managed file [npmrc] to file:/home/jenkins/.npmrc
copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf
copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
[controller-csit-3node-clustering-tell-all-calcium] $ /bin/bash /tmp/jenkins7804554360696147548.sh
---> python-tools-install.sh
Setup pyenv:
system
* 3.8.13 (set by /opt/pyenv/version)
* 3.9.13 (set by /opt/pyenv/version)
* 3.10.13 (set by /opt/pyenv/version)
* 3.11.7 (set by /opt/pyenv/version)
lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-r1gK
lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: lftools
lf-activate-venv(): INFO: Adding /tmp/venv-r1gK/bin to PATH
Generating Requirements File
Python 3.11.7
pip 25.0.1 from /tmp/venv-r1gK/lib/python3.11/site-packages/pip (python 3.11)
appdirs==1.4.4
argcomplete==3.5.3
aspy.yaml==1.3.0
attrs==25.1.0
autopage==0.5.2
beautifulsoup4==4.13.3
boto3==1.37.4
botocore==1.37.4
bs4==0.0.2
cachetools==5.5.2
certifi==2025.1.31
cffi==1.17.1
cfgv==3.4.0
chardet==5.2.0
charset-normalizer==3.4.1
click==8.1.8
cliff==4.9.1
cmd2==2.5.11
cryptography==3.3.2
debtcollector==3.0.0
decorator==5.2.1
defusedxml==0.7.1
Deprecated==1.2.18
distlib==0.3.9
dnspython==2.7.0
docker==4.2.2
dogpile.cache==1.3.4
durationpy==0.9
email_validator==2.2.0
filelock==3.17.0
future==1.0.0
gitdb==4.0.12
GitPython==3.1.44
google-auth==2.38.0
httplib2==0.22.0
identify==2.6.8
idna==3.10
importlib-resources==1.5.0
iso8601==2.1.0
Jinja2==3.1.5
jmespath==1.0.1
jsonpatch==1.33
jsonpointer==3.0.0
jsonschema==4.23.0
jsonschema-specifications==2024.10.1
keystoneauth1==5.10.0
kubernetes==32.0.1
lftools==0.37.10
lxml==5.3.1
MarkupSafe==3.0.2
msgpack==1.1.0
multi_key_dict==2.0.3
munch==4.0.0
netaddr==1.3.0
niet==1.4.2
nodeenv==1.9.1
oauth2client==4.1.3
oauthlib==3.2.2
openstacksdk==4.4.0
os-client-config==2.1.0
os-service-types==1.7.0
osc-lib==3.2.0
oslo.config==9.7.1
oslo.context==5.7.1
oslo.i18n==6.5.1
oslo.log==7.1.0
oslo.serialization==5.7.0
oslo.utils==8.2.0
packaging==24.2
pbr==6.1.1
platformdirs==4.3.6
prettytable==3.15.1
psutil==7.0.0
pyasn1==0.6.1
pyasn1_modules==0.4.1
pycparser==2.22
pygerrit2==2.0.15
PyGithub==2.6.1
PyJWT==2.10.1
PyNaCl==1.5.0
pyparsing==2.4.7
pyperclip==1.9.0
pyrsistent==0.20.0
python-cinderclient==9.6.0
python-dateutil==2.9.0.post0
python-heatclient==4.1.0
python-jenkins==1.8.2
python-keystoneclient==5.6.0
python-magnumclient==4.8.0
python-openstackclient==7.4.0
python-swiftclient==4.7.0
PyYAML==6.0.2
referencing==0.36.2
requests==2.32.3
requests-oauthlib==2.0.0
requestsexceptions==1.4.0
rfc3986==2.0.0
rpds-py==0.23.1
rsa==4.9
ruamel.yaml==0.18.10
ruamel.yaml.clib==0.2.12
s3transfer==0.11.3
simplejson==3.20.1
six==1.17.0
smmap==5.0.2
soupsieve==2.6
stevedore==5.4.1
tabulate==0.9.0
toml==0.10.2
tomlkit==0.13.2
tqdm==4.67.1
typing_extensions==4.12.2
tzdata==2025.1
urllib3==1.26.20
virtualenv==20.29.2
wcwidth==0.2.13
websocket-client==1.8.0
wrapt==1.17.2
xdg==6.0.0
xmltodict==0.14.2
yq==3.4.3
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties content
OS_STACK_TEMPLATE=csit-2-instance-type.yaml
OS_CLOUD=vex
OS_STACK_NAME=releng-controller-csit-3node-clustering-tell-all-calcium-77
OS_STACK_TEMPLATE_DIR=openstack-hot
[EnvInject] - Variables injected successfully.
provisioning config files...
copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
[controller-csit-3node-clustering-tell-all-calcium] $ /bin/bash /tmp/jenkins7528493721404462283.sh
---> Create parameters file for OpenStack HOT
OpenStack Heat parameters generated
-----------------------------------
parameters:
vm_0_count: '3'
vm_0_flavor: 'v3-standard-4'
vm_0_image: 'ZZCI - Ubuntu 20.04 - builder - x86_64 - 20250101-160150.998'
vm_1_count: '0'
vm_1_flavor: 'v3-standard-2'
vm_1_image: 'ZZCI - Ubuntu 22.04 - mininet-ovs-217 - x86_64 - 20250201-060151.911'
job_name: '28865-77'
silo: 'releng'
[controller-csit-3node-clustering-tell-all-calcium] $ /bin/bash -l /tmp/jenkins15997431399608180160.sh
---> Create HEAT stack
+ source /home/jenkins/lf-env.sh
+ lf-activate-venv --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
++ mktemp -d /tmp/venv-XXXX
+ lf_venv=/tmp/venv-9Km8
+ local venv_file=/tmp/.os_lf_venv
+ local python=python3
+ local options
+ local set_path=true
+ local install_args=
++ getopt -o np:v: -l no-path,system-site-packages,python:,venv-file: -n lf-activate-venv -- --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
+ options=' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\'''
+ eval set -- ' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\'''
++ set -- --python python3 -- 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
+ true
+ case $1 in
+ python=python3
+ shift 2
+ true
+ case $1 in
+ shift
+ break
+ case $python in
+ local pkg_list=
+ [[ -d /opt/pyenv ]]
+ echo 'Setup pyenv:'
Setup pyenv:
+ export PYENV_ROOT=/opt/pyenv
+ PYENV_ROOT=/opt/pyenv
+ export PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
+ PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
+ pyenv versions
system
3.8.13
3.9.13
3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-calcium/.python-version)
+ command -v pyenv
++ pyenv init - --no-rehash
+ eval 'PATH="$(bash --norc -ec '\''IFS=:; paths=($PATH);
for i in ${!paths[@]}; do
if [[ ${paths[i]} == "'\'''\''/opt/pyenv/shims'\'''\''" ]]; then unset '\''\'\'''\''paths[i]'\''\'\'''\'';
fi; done;
echo "${paths[*]}"'\'')"
export PATH="/opt/pyenv/shims:${PATH}"
export PYENV_SHELL=bash
source '\''/opt/pyenv/libexec/../completions/pyenv.bash'\''
pyenv() {
local command
command="${1:-}"
if [ "$#" -gt 0 ]; then
shift
fi
case "$command" in
rehash|shell)
eval "$(pyenv "sh-$command" "$@")"
;;
*)
command pyenv "$command" "$@"
;;
esac
}'
+++ bash --norc -ec 'IFS=:; paths=($PATH);
for i in ${!paths[@]}; do
if [[ ${paths[i]} == "/opt/pyenv/shims" ]]; then unset '\''paths[i]'\'';
fi; done;
echo "${paths[*]}"'
++ PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
++ export PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
++ PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
++ export PYENV_SHELL=bash
++ PYENV_SHELL=bash
++ source /opt/pyenv/libexec/../completions/pyenv.bash
+++ complete -F _pyenv pyenv
++ lf-pyver python3
++ local py_version_xy=python3
++ local py_version_xyz=
++ awk '{ print $1 }'
++ pyenv versions
++ local command
++ command=versions
++ '[' 1 -gt 0 ']'
++ shift
++ case "$command" in
++ command pyenv versions
++ pyenv versions
++ sed 's/^[ *]* //'
++ grep -E '^[0-9.]*[0-9]$'
++ [[ ! -s /tmp/.pyenv_versions ]]
+++ grep '^3' /tmp/.pyenv_versions
+++ sort -V
+++ tail -n 1
++ py_version_xyz=3.11.7
++ [[ -z 3.11.7 ]]
++ echo 3.11.7
++ return 0
+ pyenv local 3.11.7
+ local command
+ command=local
+ '[' 2 -gt 0 ']'
+ shift
+ case "$command" in
+ command pyenv local 3.11.7
+ pyenv local 3.11.7
+ for arg in "$@"
+ case $arg in
+ pkg_list+='lftools[openstack] '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='kubernetes '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='niet '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='python-heatclient '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='python-openstackclient '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='python-magnumclient '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='yq '
+ [[ -f /tmp/.os_lf_venv ]]
++ cat /tmp/.os_lf_venv
+ lf_venv=/tmp/venv-r1gK
+ echo 'lf-activate-venv(): INFO: Reuse venv:/tmp/venv-r1gK from' file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-r1gK from file:/tmp/.os_lf_venv
+ /tmp/venv-r1gK/bin/python3 -m pip install --upgrade --quiet pip virtualenv
+ [[ -z lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq ]]
+ echo 'lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq '
lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
+ /tmp/venv-r1gK/bin/python3 -m pip install --upgrade --quiet --upgrade-strategy eager 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
+ type python3
+ true
+ echo 'lf-activate-venv(): INFO: Adding /tmp/venv-r1gK/bin to PATH'
lf-activate-venv(): INFO: Adding /tmp/venv-r1gK/bin to PATH
+ PATH=/tmp/venv-r1gK/bin:/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
+ return 0
+ openstack --os-cloud vex limits show --absolute
+--------------------------+---------+
| Name | Value |
+--------------------------+---------+
| maxTotalInstances | -1 |
| maxTotalCores | 450 |
| maxTotalRAMSize | 1000000 |
| maxServerMeta | 128 |
| maxImageMeta | 128 |
| maxPersonality | 5 |
| maxPersonalitySize | 10240 |
| maxTotalKeypairs | 100 |
| maxServerGroups | 10 |
| maxServerGroupMembers | 10 |
| maxTotalFloatingIps | -1 |
| maxSecurityGroups | -1 |
| maxSecurityGroupRules | -1 |
| totalRAMUsed | 761856 |
| totalCoresUsed | 186 |
| totalInstancesUsed | 64 |
| totalFloatingIpsUsed | 0 |
| totalSecurityGroupsUsed | 0 |
| totalServerGroupsUsed | 0 |
| maxTotalVolumes | -1 |
| maxTotalSnapshots | 10 |
| maxTotalVolumeGigabytes | 4096 |
| maxTotalBackups | 10 |
| maxTotalBackupGigabytes | 1000 |
| totalVolumesUsed | 3 |
| totalGigabytesUsed | 60 |
| totalSnapshotsUsed | 0 |
| totalBackupsUsed | 0 |
| totalBackupGigabytesUsed | 0 |
+--------------------------+---------+
+ pushd /opt/ciman/openstack-hot
/opt/ciman/openstack-hot /w/workspace/controller-csit-3node-clustering-tell-all-calcium
+ lftools openstack --os-cloud vex stack create releng-controller-csit-3node-clustering-tell-all-calcium-77 csit-2-instance-type.yaml /w/workspace/controller-csit-3node-clustering-tell-all-calcium/stack-parameters.yaml
Creating stack releng-controller-csit-3node-clustering-tell-all-calcium-77
Waiting to initialize infrastructure...
Stack initialization successful.
------------------------------------
Stack Details
------------------------------------
{'added': None,
'capabilities': [],
'created_at': '2025-03-01T23:42:56Z',
'deleted': None,
'deleted_at': None,
'description': 'No description',
'environment': None,
'environment_files': None,
'files': None,
'files_container': None,
'id': '35de3f45-93de-4586-bc4a-fdecd75941d6',
'is_rollback_disabled': True,
'links': [{'href': 'https://orchestration.public.mtl1.vexxhost.net/v1/12c36e260d8e4bb2913965203b1b491f/stacks/releng-controller-csit-3node-clustering-tell-all-calcium-77/35de3f45-93de-4586-bc4a-fdecd75941d6',
'rel': 'self'}],
'location': Munch({'cloud': 'vex', 'region_name': 'ca-ymq-1', 'zone': None, 'project': Munch({'id': '12c36e260d8e4bb2913965203b1b491f', 'name': '61975f2c-7c17-4d69-82fa-c3ae420ad6fd', 'domain_id': None, 'domain_name': 'Default'})}),
'name': 'releng-controller-csit-3node-clustering-tell-all-calcium-77',
'notification_topics': [],
'outputs': [{'description': 'IP addresses of the 1st vm types',
'output_key': 'vm_0_ips',
'output_value': ['10.30.170.151',
'10.30.170.8',
'10.30.170.204']},
{'description': 'IP addresses of the 2nd vm types',
'output_key': 'vm_1_ips',
'output_value': []}],
'owner_id': ****,
'parameters': {'OS::project_id': '12c36e260d8e4bb2913965203b1b491f',
'OS::stack_id': '35de3f45-93de-4586-bc4a-fdecd75941d6',
'OS::stack_name': 'releng-controller-csit-3node-clustering-tell-all-calcium-77',
'job_name': '28865-77',
'silo': 'releng',
'vm_0_count': '3',
'vm_0_flavor': 'v3-standard-4',
'vm_0_image': 'ZZCI - Ubuntu 20.04 - builder - x86_64 - '
'20250101-160150.998',
'vm_1_count': '0',
'vm_1_flavor': 'v3-standard-2',
'vm_1_image': 'ZZCI - Ubuntu 22.04 - mininet-ovs-217 - x86_64 '
'- 20250201-060151.911'},
'parent_id': None,
'replaced': None,
'status': 'CREATE_COMPLETE',
'status_reason': 'Stack CREATE completed successfully',
'tags': [],
'template': None,
'template_description': 'No description',
'template_url': None,
'timeout_mins': 15,
'unchanged': None,
'updated': None,
'updated_at': None,
'user_project_id': '593d92b8e29042658760ccbdf1da9d3f'}
------------------------------------
+ popd
/w/workspace/controller-csit-3node-clustering-tell-all-calcium
[controller-csit-3node-clustering-tell-all-calcium] $ /bin/bash -l /tmp/jenkins3866013936727448545.sh
---> Copy SSH public keys to CSIT lab
Setup pyenv:
system
3.8.13
3.9.13
3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-calcium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-r1gK from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes python-heatclient python-openstackclient
lf-activate-venv(): INFO: Adding /tmp/venv-r1gK/bin to PATH
SSH not responding on 10.30.170.204. Retrying in 10 seconds...
SSH not responding on 10.30.170.8. Retrying in 10 seconds...
SSH not responding on 10.30.170.151. Retrying in 10 seconds...
Ping to 10.30.170.204 successful.
Ping to 10.30.170.8 successful.
Ping to 10.30.170.151 successful.
SSH not responding on 10.30.170.204. Retrying in 10 seconds...
SSH not responding on 10.30.170.8. Retrying in 10 seconds...
Warning: Permanently added '10.30.170.151' (ECDSA) to the list of known hosts.
releng-28865-77-0-builder-0
Successfully copied public keys to slave 10.30.170.151
Process 6497 ready.
Ping to 10.30.170.204 successful.
Ping to 10.30.170.8 successful.
Warning: Permanently added '10.30.170.204' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.170.8' (ECDSA) to the list of known hosts.
releng-28865-77-0-builder-2
Successfully copied public keys to slave 10.30.170.204
releng-28865-77-0-builder-1
Successfully copied public keys to slave 10.30.170.8
Process 6498 ready.
Process 6499 ready.
SSH ready on all stack servers.
[controller-csit-3node-clustering-tell-all-calcium] $ /bin/bash -l /tmp/jenkins6107210373909339656.sh
Setup pyenv:
system
3.8.13
3.9.13
3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-calcium/.python-version)
lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-a81k
lf-activate-venv(): INFO: Save venv in file: /w/workspace/controller-csit-3node-clustering-tell-all-calcium/.robot_venv
lf-activate-venv(): INFO: Installing: setuptools wheel
lf-activate-venv(): INFO: Adding /tmp/venv-a81k/bin to PATH
+ echo 'Installing Python Requirements'
Installing Python Requirements
+ cat
+ python -m pip install -r requirements.txt
Looking in indexes: https://nexus3.opendaylight.org/repository/PyPi/simple
Collecting docker-py (from -r requirements.txt (line 1))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/docker-py/1.10.6/docker_py-1.10.6-py2.py3-none-any.whl (50 kB)
Collecting ipaddr (from -r requirements.txt (line 2))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/ipaddr/2.2.0/ipaddr-2.2.0.tar.gz (26 kB)
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
Collecting netaddr (from -r requirements.txt (line 3))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/netaddr/1.3.0/netaddr-1.3.0-py3-none-any.whl (2.3 MB)
Collecting netifaces (from -r requirements.txt (line 4))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/netifaces/0.11.0/netifaces-0.11.0.tar.gz (30 kB)
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
Collecting pyhocon (from -r requirements.txt (line 5))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyhocon/0.3.61/pyhocon-0.3.61-py3-none-any.whl (25 kB)
Collecting requests (from -r requirements.txt (line 6))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/requests/2.32.3/requests-2.32.3-py3-none-any.whl (64 kB)
Collecting robotframework (from -r requirements.txt (line 7))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework/7.2.2/robotframework-7.2.2-py3-none-any.whl (777 kB)
â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â” 777.7/777.7 kB 26.9 MB/s eta 0:00:00
Collecting robotframework-httplibrary (from -r requirements.txt (line 8))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-httplibrary/0.4.2/robotframework-httplibrary-0.4.2.tar.gz (9.1 kB)
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
Collecting robotframework-requests==0.9.7 (from -r requirements.txt (line 9))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-requests/0.9.7/robotframework_requests-0.9.7-py3-none-any.whl (21 kB)
Collecting robotframework-selenium2library (from -r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-selenium2library/3.0.0/robotframework_selenium2library-3.0.0-py2.py3-none-any.whl (6.2 kB)
Collecting robotframework-sshlibrary==3.8.0 (from -r requirements.txt (line 11))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-sshlibrary/3.8.0/robotframework-sshlibrary-3.8.0.tar.gz (51 kB)
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
Collecting scapy (from -r requirements.txt (line 12))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/scapy/2.6.1/scapy-2.6.1-py3-none-any.whl (2.4 MB)
â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â” 2.4/2.4 MB 44.5 MB/s eta 0:00:00
Collecting jsonpath-rw (from -r requirements.txt (line 15))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpath-rw/1.4.0/jsonpath-rw-1.4.0.tar.gz (13 kB)
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
Collecting elasticsearch (from -r requirements.txt (line 18))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch/8.17.1/elasticsearch-8.17.1-py3-none-any.whl (653 kB)
â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â” 654.0/654.0 kB 25.2 MB/s eta 0:00:00
Collecting elasticsearch-dsl (from -r requirements.txt (line 19))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch-dsl/8.17.1/elasticsearch_dsl-8.17.1-py3-none-any.whl (158 kB)
Collecting pyangbind (from -r requirements.txt (line 22))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyangbind/0.8.6/pyangbind-0.8.6-py3-none-any.whl (52 kB)
Collecting isodate (from -r requirements.txt (line 25))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/isodate/0.7.2/isodate-0.7.2-py3-none-any.whl (22 kB)
Collecting jmespath (from -r requirements.txt (line 28))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jmespath/1.0.1/jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting jsonpatch (from -r requirements.txt (line 31))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpatch/1.33/jsonpatch-1.33-py2.py3-none-any.whl (12 kB)
Collecting paramiko>=1.15.3 (from robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/paramiko/3.5.1/paramiko-3.5.1-py3-none-any.whl (227 kB)
Collecting scp>=0.13.0 (from robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/scp/0.15.0/scp-0.15.0-py2.py3-none-any.whl (8.8 kB)
Collecting docker-pycreds>=0.2.1 (from docker-py->-r requirements.txt (line 1))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/docker-pycreds/0.4.0/docker_pycreds-0.4.0-py2.py3-none-any.whl (9.0 kB)
Collecting six>=1.4.0 (from docker-py->-r requirements.txt (line 1))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/six/1.17.0/six-1.17.0-py2.py3-none-any.whl (11 kB)
Collecting websocket-client>=0.32.0 (from docker-py->-r requirements.txt (line 1))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/websocket-client/1.8.0/websocket_client-1.8.0-py3-none-any.whl (58 kB)
Collecting pyparsing<4,>=2 (from pyhocon->-r requirements.txt (line 5))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pyparsing/3.2.1/pyparsing-3.2.1-py3-none-any.whl (107 kB)
Collecting charset-normalizer<4,>=2 (from requests->-r requirements.txt (line 6))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/charset-normalizer/3.4.1/charset_normalizer-3.4.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (143 kB)
Collecting idna<4,>=2.5 (from requests->-r requirements.txt (line 6))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/idna/3.10/idna-3.10-py3-none-any.whl (70 kB)
Collecting urllib3<3,>=1.21.1 (from requests->-r requirements.txt (line 6))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/urllib3/2.3.0/urllib3-2.3.0-py3-none-any.whl (128 kB)
Collecting certifi>=2017.4.17 (from requests->-r requirements.txt (line 6))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/certifi/2025.1.31/certifi-2025.1.31-py3-none-any.whl (166 kB)
Collecting webtest>=2.0 (from robotframework-httplibrary->-r requirements.txt (line 8))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/webtest/3.0.4/WebTest-3.0.4-py3-none-any.whl (32 kB)
Collecting jsonpointer (from robotframework-httplibrary->-r requirements.txt (line 8))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpointer/3.0.0/jsonpointer-3.0.0-py2.py3-none-any.whl (7.6 kB)
Collecting robotframework-seleniumlibrary>=3.0.0 (from robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-seleniumlibrary/6.7.1/robotframework_seleniumlibrary-6.7.1-py2.py3-none-any.whl (104 kB)
Collecting ply (from jsonpath-rw->-r requirements.txt (line 15))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/ply/3.11/ply-3.11-py2.py3-none-any.whl (49 kB)
Collecting decorator (from jsonpath-rw->-r requirements.txt (line 15))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/decorator/5.2.1/decorator-5.2.1-py3-none-any.whl (9.2 kB)
Collecting elastic-transport<9,>=8.15.1 (from elasticsearch->-r requirements.txt (line 18))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elastic-transport/8.17.0/elastic_transport-8.17.0-py3-none-any.whl (64 kB)
Collecting python-dateutil (from elasticsearch-dsl->-r requirements.txt (line 19))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/python-dateutil/2.9.0.post0/python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB)
Collecting typing-extensions (from elasticsearch-dsl->-r requirements.txt (line 19))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/typing-extensions/4.12.2/typing_extensions-4.12.2-py3-none-any.whl (37 kB)
Collecting pyang (from pyangbind->-r requirements.txt (line 22))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyang/2.6.1/pyang-2.6.1-py2.py3-none-any.whl (594 kB)
â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â” 594.7/594.7 kB 25.3 MB/s eta 0:00:00
Collecting lxml (from pyangbind->-r requirements.txt (line 22))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/lxml/5.3.1/lxml-5.3.1-cp311-cp311-manylinux_2_28_x86_64.whl (5.0 MB)
Collecting regex (from pyangbind->-r requirements.txt (line 22))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/regex/2024.11.6/regex-2024.11.6-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (792 kB)
â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â” 792.7/792.7 kB 13.3 MB/s eta 0:00:00
Collecting enum34 (from pyangbind->-r requirements.txt (line 22))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/enum34/1.1.10/enum34-1.1.10-py3-none-any.whl (11 kB)
Collecting bcrypt>=3.2 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/bcrypt/4.3.0/bcrypt-4.3.0-cp39-abi3-manylinux_2_28_x86_64.whl (284 kB)
Collecting cryptography>=3.3 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/cryptography/44.0.1/cryptography-44.0.1-cp39-abi3-manylinux_2_28_x86_64.whl (4.2 MB)
Collecting pynacl>=1.5 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pynacl/1.5.0/PyNaCl-1.5.0-cp36-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.manylinux_2_24_x86_64.whl (856 kB)
Collecting selenium>=4.3.0 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/selenium/4.29.0/selenium-4.29.0-py3-none-any.whl (9.5 MB)
â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â” 9.5/9.5 MB 70.2 MB/s eta 0:00:00
Collecting robotframework-pythonlibcore>=4.4.1 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-pythonlibcore/4.4.1/robotframework_pythonlibcore-4.4.1-py2.py3-none-any.whl (12 kB)
Collecting click>=8.0 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/click/8.1.8/click-8.1.8-py3-none-any.whl (98 kB)
Collecting WebOb>=1.2 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/webob/1.8.9/WebOb-1.8.9-py2.py3-none-any.whl (115 kB)
Collecting waitress>=3.0.2 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/waitress/3.0.2/waitress-3.0.2-py3-none-any.whl (56 kB)
Collecting beautifulsoup4 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/beautifulsoup4/4.13.3/beautifulsoup4-4.13.3-py3-none-any.whl (186 kB)
Collecting cffi>=1.12 (from cryptography>=3.3->paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/cffi/1.17.1/cffi-1.17.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (467 kB)
Collecting trio~=0.17 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/trio/0.29.0/trio-0.29.0-py3-none-any.whl (492 kB)
Collecting trio-websocket~=0.9 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/trio-websocket/0.12.2/trio_websocket-0.12.2-py3-none-any.whl (21 kB)
Collecting soupsieve>1.2 (from beautifulsoup4->webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/soupsieve/2.6/soupsieve-2.6-py3-none-any.whl (36 kB)
Collecting pycparser (from cffi>=1.12->cryptography>=3.3->paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pycparser/2.22/pycparser-2.22-py3-none-any.whl (117 kB)
Collecting attrs>=23.2.0 (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/attrs/25.1.0/attrs-25.1.0-py3-none-any.whl (63 kB)
Collecting sortedcontainers (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/sortedcontainers/2.4.0/sortedcontainers-2.4.0-py2.py3-none-any.whl (29 kB)
Collecting outcome (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/outcome/1.3.0.post0/outcome-1.3.0.post0-py2.py3-none-any.whl (10 kB)
Collecting sniffio>=1.3.0 (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/sniffio/1.3.1/sniffio-1.3.1-py3-none-any.whl (10 kB)
Collecting wsproto>=0.14 (from trio-websocket~=0.9->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/wsproto/1.2.0/wsproto-1.2.0-py3-none-any.whl (24 kB)
Collecting pysocks!=1.5.7,<2.0,>=1.5.6 (from urllib3[socks]<3,>=1.26->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pysocks/1.7.1/PySocks-1.7.1-py3-none-any.whl (16 kB)
Collecting h11<1,>=0.9.0 (from wsproto>=0.14->trio-websocket~=0.9->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/h11/0.14.0/h11-0.14.0-py3-none-any.whl (58 kB)
Building wheels for collected packages: robotframework-sshlibrary, ipaddr, netifaces, robotframework-httplibrary, jsonpath-rw
Building wheel for robotframework-sshlibrary (setup.py): started
Building wheel for robotframework-sshlibrary (setup.py): finished with status 'done'
Created wheel for robotframework-sshlibrary: filename=robotframework_sshlibrary-3.8.0-py3-none-any.whl size=55176 sha256=4601f69f802a41c6dc7cb5fa3d2c2c9f590ff2ddbea8168e18de7a79088cf378
Stored in directory: /home/jenkins/.cache/pip/wheels/f7/c9/b3/a977b7bcc410d45ae27d240df3d00a12585509180e373ecccc
Building wheel for ipaddr (setup.py): started
Building wheel for ipaddr (setup.py): finished with status 'done'
Created wheel for ipaddr: filename=ipaddr-2.2.0-py3-none-any.whl size=18322 sha256=ed90a8e471c33ab874506339f4fdc9d592e95878972b931f616d7d0763fa094b
Stored in directory: /home/jenkins/.cache/pip/wheels/dc/6c/04/da2d847fa8d45c59af3e1d83e2acc29cb8adcbaf04c0898dbf
Building wheel for netifaces (setup.py): started
Building wheel for netifaces (setup.py): finished with status 'done'
Created wheel for netifaces: filename=netifaces-0.11.0-cp311-cp311-linux_x86_64.whl size=41054 sha256=2eea2fcfb15c9a2d6b525b02b32f5cc8918767c8da6cb28ce19df40454398521
Stored in directory: /home/jenkins/.cache/pip/wheels/f8/18/88/e61d54b995bea304bdb1d040a92b72228a1bf72ca2a3eba7c9
Building wheel for robotframework-httplibrary (setup.py): started
Building wheel for robotframework-httplibrary (setup.py): finished with status 'done'
Created wheel for robotframework-httplibrary: filename=robotframework_httplibrary-0.4.2-py3-none-any.whl size=10012 sha256=82dcfcb479d9913efd4cb13e18e841758c11b7e7b3e94ca7f3acf8c41fdd4359
Stored in directory: /home/jenkins/.cache/pip/wheels/aa/bc/0d/9a20dd51effef392aae2733cb4c7b66c6fa29fca33d88b57ed
Building wheel for jsonpath-rw (setup.py): started
Building wheel for jsonpath-rw (setup.py): finished with status 'done'
Created wheel for jsonpath-rw: filename=jsonpath_rw-1.4.0-py3-none-any.whl size=15178 sha256=ed297e00f875b130233a1e704846cfe4fa73920b863a4591434dfc989970413d
Stored in directory: /home/jenkins/.cache/pip/wheels/f1/54/63/9a8da38cefae13755097b36cc852decc25d8ef69c37d58d4eb
Successfully built robotframework-sshlibrary ipaddr netifaces robotframework-httplibrary jsonpath-rw
Installing collected packages: sortedcontainers, ply, netifaces, ipaddr, enum34, websocket-client, WebOb, waitress, urllib3, typing-extensions, soupsieve, sniffio, six, scapy, robotframework-pythonlibcore, robotframework, regex, pysocks, pyparsing, pycparser, netaddr, lxml, jsonpointer, jmespath, isodate, idna, h11, decorator, click, charset-normalizer, certifi, bcrypt, attrs, wsproto, requests, python-dateutil, pyhocon, pyang, outcome, jsonpath-rw, jsonpatch, elastic-transport, docker-pycreds, cffi, beautifulsoup4, webtest, trio, robotframework-requests, pynacl, pyangbind, elasticsearch, docker-py, cryptography, trio-websocket, robotframework-httplibrary, paramiko, elasticsearch-dsl, selenium, scp, robotframework-sshlibrary, robotframework-seleniumlibrary, robotframework-selenium2library
Successfully installed WebOb-1.8.9 attrs-25.1.0 bcrypt-4.3.0 beautifulsoup4-4.13.3 certifi-2025.1.31 cffi-1.17.1 charset-normalizer-3.4.1 click-8.1.8 cryptography-44.0.1 decorator-5.2.1 docker-py-1.10.6 docker-pycreds-0.4.0 elastic-transport-8.17.0 elasticsearch-8.17.1 elasticsearch-dsl-8.17.1 enum34-1.1.10 h11-0.14.0 idna-3.10 ipaddr-2.2.0 isodate-0.7.2 jmespath-1.0.1 jsonpatch-1.33 jsonpath-rw-1.4.0 jsonpointer-3.0.0 lxml-5.3.1 netaddr-1.3.0 netifaces-0.11.0 outcome-1.3.0.post0 paramiko-3.5.1 ply-3.11 pyang-2.6.1 pyangbind-0.8.6 pycparser-2.22 pyhocon-0.3.61 pynacl-1.5.0 pyparsing-3.2.1 pysocks-1.7.1 python-dateutil-2.9.0.post0 regex-2024.11.6 requests-2.32.3 robotframework-7.2.2 robotframework-httplibrary-0.4.2 robotframework-pythonlibcore-4.4.1 robotframework-requests-0.9.7 robotframework-selenium2library-3.0.0 robotframework-seleniumlibrary-6.7.1 robotframework-sshlibrary-3.8.0 scapy-2.6.1 scp-0.15.0 selenium-4.29.0 six-1.17.0 sniffio-1.3.1 sortedcontainers-2.4.0 soupsieve-2.6 trio-0.29.0 trio-websocket-0.12.2 typing-extensions-4.12.2 urllib3-2.3.0 waitress-3.0.2 websocket-client-1.8.0 webtest-3.0.4 wsproto-1.2.0
+ pip freeze
attrs==25.1.0
bcrypt==4.3.0
beautifulsoup4==4.13.3
certifi==2025.1.31
cffi==1.17.1
charset-normalizer==3.4.1
click==8.1.8
cryptography==44.0.1
decorator==5.2.1
distlib==0.3.9
docker-py==1.10.6
docker-pycreds==0.4.0
elastic-transport==8.17.0
elasticsearch==8.17.1
elasticsearch-dsl==8.17.1
enum34==1.1.10
filelock==3.17.0
h11==0.14.0
idna==3.10
ipaddr==2.2.0
isodate==0.7.2
jmespath==1.0.1
jsonpatch==1.33
jsonpath-rw==1.4.0
jsonpointer==3.0.0
lxml==5.3.1
netaddr==1.3.0
netifaces==0.11.0
outcome==1.3.0.post0
paramiko==3.5.1
platformdirs==4.3.6
ply==3.11
pyang==2.6.1
pyangbind==0.8.6
pycparser==2.22
pyhocon==0.3.61
PyNaCl==1.5.0
pyparsing==3.2.1
PySocks==1.7.1
python-dateutil==2.9.0.post0
regex==2024.11.6
requests==2.32.3
robotframework==7.2.2
robotframework-httplibrary==0.4.2
robotframework-pythonlibcore==4.4.1
robotframework-requests==0.9.7
robotframework-selenium2library==3.0.0
robotframework-seleniumlibrary==6.7.1
robotframework-sshlibrary==3.8.0
scapy==2.6.1
scp==0.15.0
selenium==4.29.0
six==1.17.0
sniffio==1.3.1
sortedcontainers==2.4.0
soupsieve==2.6
trio==0.29.0
trio-websocket==0.12.2
typing_extensions==4.12.2
urllib3==2.3.0
virtualenv==20.29.2
waitress==3.0.2
WebOb==1.8.9
websocket-client==1.8.0
WebTest==3.0.4
wsproto==1.2.0
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties file path 'env.properties'
[EnvInject] - Variables injected successfully.
[controller-csit-3node-clustering-tell-all-calcium] $ /bin/bash -l /tmp/jenkins5372483172854797328.sh
Setup pyenv:
system
3.8.13
3.9.13
3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-calcium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-r1gK from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: python-heatclient python-openstackclient yq
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
lftools 0.37.10 requires urllib3<2.1.0, but you have urllib3 2.3.0 which is incompatible.
lf-activate-venv(): INFO: Adding /tmp/venv-r1gK/bin to PATH
+ ODL_SYSTEM=()
+ TOOLS_SYSTEM=()
+ OPENSTACK_SYSTEM=()
+ OPENSTACK_CONTROLLERS=()
+ mapfile -t ADDR
++ openstack stack show -f json -c outputs releng-controller-csit-3node-clustering-tell-all-calcium-77
++ jq -r '.outputs[] | select(.output_key | match("^vm_[0-9]+_ips$")) | .output_value | .[]'
+ for i in "${ADDR[@]}"
++ ssh 10.30.170.151 hostname -s
Warning: Permanently added '10.30.170.151' (ECDSA) to the list of known hosts.
+ REMHOST=releng-28865-77-0-builder-0
+ case ${REMHOST} in
+ ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}")
+ for i in "${ADDR[@]}"
++ ssh 10.30.170.8 hostname -s
Warning: Permanently added '10.30.170.8' (ECDSA) to the list of known hosts.
+ REMHOST=releng-28865-77-0-builder-1
+ case ${REMHOST} in
+ ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}")
+ for i in "${ADDR[@]}"
++ ssh 10.30.170.204 hostname -s
Warning: Permanently added '10.30.170.204' (ECDSA) to the list of known hosts.
+ REMHOST=releng-28865-77-0-builder-2
+ case ${REMHOST} in
+ ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}")
+ echo NUM_ODL_SYSTEM=3
+ echo NUM_TOOLS_SYSTEM=0
+ '[' '' == yes ']'
+ NUM_OPENSTACK_SYSTEM=0
+ echo NUM_OPENSTACK_SYSTEM=0
+ '[' 0 -eq 2 ']'
+ echo ODL_SYSTEM_IP=10.30.170.151
++ seq 0 2
+ for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 )))
+ echo ODL_SYSTEM_1_IP=10.30.170.151
+ for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 )))
+ echo ODL_SYSTEM_2_IP=10.30.170.8
+ for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 )))
+ echo ODL_SYSTEM_3_IP=10.30.170.204
+ echo TOOLS_SYSTEM_IP=
++ seq 0 -1
+ openstack_index=0
+ NUM_OPENSTACK_CONTROL_NODES=1
+ echo NUM_OPENSTACK_CONTROL_NODES=1
++ seq 0 0
+ for i in $(seq 0 $((NUM_OPENSTACK_CONTROL_NODES - 1)))
+ echo OPENSTACK_CONTROL_NODE_1_IP=
+ NUM_OPENSTACK_COMPUTE_NODES=-1
+ echo NUM_OPENSTACK_COMPUTE_NODES=-1
+ '[' -1 -ge 2 ']'
++ seq 0 -2
+ NUM_OPENSTACK_HAPROXY_NODES=0
+ echo NUM_OPENSTACK_HAPROXY_NODES=0
++ seq 0 -1
+ echo 'Contents of slave_addresses.txt:'
Contents of slave_addresses.txt:
+ cat slave_addresses.txt
NUM_ODL_SYSTEM=3
NUM_TOOLS_SYSTEM=0
NUM_OPENSTACK_SYSTEM=0
ODL_SYSTEM_IP=10.30.170.151
ODL_SYSTEM_1_IP=10.30.170.151
ODL_SYSTEM_2_IP=10.30.170.8
ODL_SYSTEM_3_IP=10.30.170.204
TOOLS_SYSTEM_IP=
NUM_OPENSTACK_CONTROL_NODES=1
OPENSTACK_CONTROL_NODE_1_IP=
NUM_OPENSTACK_COMPUTE_NODES=-1
NUM_OPENSTACK_HAPROXY_NODES=0
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties file path 'slave_addresses.txt'
[EnvInject] - Variables injected successfully.
[controller-csit-3node-clustering-tell-all-calcium] $ /bin/sh /tmp/jenkins3271184988646131532.sh
Preparing for JRE Version 17
Karaf artifact is karaf
Karaf project is integration
Java home is /usr/lib/jvm/java-17-openjdk-amd64
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties file path 'set_variables.env'
[EnvInject] - Variables injected successfully.
[controller-csit-3node-clustering-tell-all-calcium] $ /bin/bash /tmp/jenkins13714556276034882204.sh
2025-03-01 23:44:32 URL:https://git.opendaylight.org/gerrit/gitweb?p=integration/distribution.git;a=blob_plain;f=pom.xml;hb=stable/calcium [2619/2619] -> "pom.xml" [1]
Bundle version is 0.20.4-SNAPSHOT
--2025-03-01 23:44:32-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.4-SNAPSHOT/maven-metadata.xml
Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6
Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 1410 (1.4K) [application/xml]
Saving to: ‘maven-metadata.xml’
0K . 100% 76.3M=0s
2025-03-01 23:44:32 (76.3 MB/s) - ‘maven-metadata.xml’ saved [1410/1410]
<?xml version="1.0" encoding="UTF-8"?>
<metadata modelVersion="1.1.0">
<groupId>org.opendaylight.integration</groupId>
<artifactId>karaf</artifactId>
<version>0.20.4-SNAPSHOT</version>
<versioning>
<snapshot>
<timestamp>20250301.204651</timestamp>
<buildNumber>414</buildNumber>
</snapshot>
<lastUpdated>20250301204651</lastUpdated>
<snapshotVersions>
<snapshotVersion>
<extension>pom</extension>
<value>0.20.4-20250301.204651-414</value>
<updated>20250301204651</updated>
</snapshotVersion>
<snapshotVersion>
<extension>tar.gz</extension>
<value>0.20.4-20250301.204651-414</value>
<updated>20250301204651</updated>
</snapshotVersion>
<snapshotVersion>
<extension>zip</extension>
<value>0.20.4-20250301.204651-414</value>
<updated>20250301204651</updated>
</snapshotVersion>
<snapshotVersion>
<classifier>cyclonedx</classifier>
<extension>xml</extension>
<value>0.20.4-20250301.204651-414</value>
<updated>20250301204651</updated>
</snapshotVersion>
<snapshotVersion>
<classifier>cyclonedx</classifier>
<extension>json</extension>
<value>0.20.4-20250301.204651-414</value>
<updated>20250301204651</updated>
</snapshotVersion>
</snapshotVersions>
</versioning>
</metadata>
Nexus timestamp is 0.20.4-20250301.204651-414
Distribution bundle URL is https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.4-SNAPSHOT/karaf-0.20.4-20250301.204651-414.zip
Distribution bundle is karaf-0.20.4-20250301.204651-414.zip
Distribution bundle version is 0.20.4-SNAPSHOT
Distribution folder is karaf-0.20.4-SNAPSHOT
Nexus prefix is https://nexus.opendaylight.org
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties file path 'detect_variables.env'
[EnvInject] - Variables injected successfully.
[controller-csit-3node-clustering-tell-all-calcium] $ /bin/bash -l /tmp/jenkins1749161835105229604.sh
Setup pyenv:
system
3.8.13
3.9.13
3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-calcium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-r1gK from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: python-heatclient python-openstackclient
lf-activate-venv(): INFO: Adding /tmp/venv-r1gK/bin to PATH
Copying common-functions.sh to /tmp
Copying common-functions.sh to 10.30.170.151:/tmp
Warning: Permanently added '10.30.170.151' (ECDSA) to the list of known hosts.
Copying common-functions.sh to 10.30.170.8:/tmp
Warning: Permanently added '10.30.170.8' (ECDSA) to the list of known hosts.
Copying common-functions.sh to 10.30.170.204:/tmp
Warning: Permanently added '10.30.170.204' (ECDSA) to the list of known hosts.
[controller-csit-3node-clustering-tell-all-calcium] $ /bin/bash /tmp/jenkins4602605726308317772.sh
common-functions.sh is being sourced
common-functions environment:
MAVENCONF: /tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
ACTUALFEATURES:
FEATURESCONF: /tmp/karaf-0.20.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
CUSTOMPROP: /tmp/karaf-0.20.4-SNAPSHOT/etc/custom.properties
LOGCONF: /tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
MEMCONF: /tmp/karaf-0.20.4-SNAPSHOT/bin/setenv
CONTROLLERMEM: 2048m
AKKACONF: /tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/akka.conf
MODULESCONF: /tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/modules.conf
MODULESHARDSCONF: /tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/module-shards.conf
SUITES:
#################################################
## Configure Cluster and Start ##
#################################################
ACTUALFEATURES: odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app
SPACE_SEPARATED_FEATURES: odl-integration-compatible-with-all odl-jolokia odl-restconf odl-clustering-test-app
Locating script plan to use...
script plan exists!!!
Changing the script plan path...
# Place the scripts in run order:
/w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/scripts/car_people_shard.sh
Executing /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/scripts/car_people_shard.sh...
Add car-people shards file
Copy shard config to member-1 with IP address 10.30.170.151
Warning: Permanently added '10.30.170.151' (ECDSA) to the list of known hosts.
Copy shard config to member-2 with IP address 10.30.170.8
Warning: Permanently added '10.30.170.8' (ECDSA) to the list of known hosts.
Copy shard config to member-3 with IP address 10.30.170.204
Warning: Permanently added '10.30.170.204' (ECDSA) to the list of known hosts.
Finished running script plans
Configuring member-1 with IP address 10.30.170.151
Warning: Permanently added '10.30.170.151' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.170.151' (ECDSA) to the list of known hosts.
+ source /tmp/common-functions.sh karaf-0.20.4-SNAPSHOT
++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]]
common-functions.sh is being sourced
++ echo 'common-functions.sh is being sourced'
++ BUNDLEFOLDER=karaf-0.20.4-SNAPSHOT
++ export MAVENCONF=/tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
++ MAVENCONF=/tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
++ export FEATURESCONF=/tmp/karaf-0.20.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
++ FEATURESCONF=/tmp/karaf-0.20.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
++ export CUSTOMPROP=/tmp/karaf-0.20.4-SNAPSHOT/etc/custom.properties
++ CUSTOMPROP=/tmp/karaf-0.20.4-SNAPSHOT/etc/custom.properties
++ export LOGCONF=/tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
++ LOGCONF=/tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
++ export MEMCONF=/tmp/karaf-0.20.4-SNAPSHOT/bin/setenv
++ MEMCONF=/tmp/karaf-0.20.4-SNAPSHOT/bin/setenv
++ export CONTROLLERMEM=
++ CONTROLLERMEM=
++ export AKKACONF=/tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/akka.conf
++ AKKACONF=/tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/akka.conf
++ export MODULESCONF=/tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/modules.conf
++ MODULESCONF=/tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/modules.conf
++ export MODULESHARDSCONF=/tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/module-shards.conf
++ MODULESHARDSCONF=/tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/module-shards.conf
++ print_common_env
++ cat
common-functions environment:
MAVENCONF: /tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
ACTUALFEATURES:
FEATURESCONF: /tmp/karaf-0.20.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
CUSTOMPROP: /tmp/karaf-0.20.4-SNAPSHOT/etc/custom.properties
LOGCONF: /tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
MEMCONF: /tmp/karaf-0.20.4-SNAPSHOT/bin/setenv
CONTROLLERMEM:
AKKACONF: /tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/akka.conf
MODULESCONF: /tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/modules.conf
MODULESHARDSCONF: /tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/module-shards.conf
SUITES:
++ SSH='ssh -t -t'
++ extra_services_cntl=' dnsmasq.service httpd.service libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service rabbitmq-server.service '
++ extra_services_cmp=' libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service '
Changing to /tmp
Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.4-SNAPSHOT/karaf-0.20.4-20250301.204651-414.zip
+ echo 'Changing to /tmp'
+ cd /tmp
+ echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.4-SNAPSHOT/karaf-0.20.4-20250301.204651-414.zip'
+ wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.4-SNAPSHOT/karaf-0.20.4-20250301.204651-414.zip
--2025-03-01 23:44:41-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.4-SNAPSHOT/karaf-0.20.4-20250301.204651-414.zip
Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6
Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 234245363 (223M) [application/zip]
Saving to: ‘karaf-0.20.4-20250301.204651-414.zip’
0K ........ ........ ........ ........ ........ ........ 1% 62.8M 4s
3072K ........ ........ ........ ........ ........ ........ 2% 86.9M 3s
6144K ........ ........ ........ ........ ........ ........ 4% 97.2M 3s
9216K ........ ........ ........ ........ ........ ........ 5% 130M 2s
12288K ........ ........ ........ ........ ........ ........ 6% 164M 2s
15360K ........ ........ ........ ........ ........ ........ 8% 182M 2s
18432K ........ ........ ........ ........ ........ ........ 9% 248M 2s
21504K ........ ........ ........ ........ ........ ........ 10% 250M 2s
24576K ........ ........ ........ ........ ........ ........ 12% 280M 1s
27648K ........ ........ ........ ........ ........ ........ 13% 281M 1s
30720K ........ ........ ........ ........ ........ ........ 14% 287M 1s
33792K ........ ........ ........ ........ ........ ........ 16% 272M 1s
36864K ........ ........ ........ ........ ........ ........ 17% 319M 1s
39936K ........ ........ ........ ........ ........ ........ 18% 335M 1s
43008K ........ ........ ........ ........ ........ ........ 20% 348M 1s
46080K ........ ........ ........ ........ ........ ........ 21% 349M 1s
49152K ........ ........ ........ ........ ........ ........ 22% 348M 1s
52224K ........ ........ ........ ........ ........ ........ 24% 362M 1s
55296K ........ ........ ........ ........ ........ ........ 25% 358M 1s
58368K ........ ........ ........ ........ ........ ........ 26% 358M 1s
61440K ........ ........ ........ ........ ........ ........ 28% 356M 1s
64512K ........ ........ ........ ........ ........ ........ 29% 344M 1s
67584K ........ ........ ........ ........ ........ ........ 30% 342M 1s
70656K ........ ........ ........ ........ ........ ........ 32% 349M 1s
73728K ........ ........ ........ ........ ........ ........ 33% 344M 1s
76800K ........ ........ ........ ........ ........ ........ 34% 350M 1s
79872K ........ ........ ........ ........ ........ ........ 36% 339M 1s
82944K ........ ........ ........ ........ ........ ........ 37% 370M 1s
86016K ........ ........ ........ ........ ........ ........ 38% 353M 1s
89088K ........ ........ ........ ........ ........ ........ 40% 352M 1s
92160K ........ ........ ........ ........ ........ ........ 41% 359M 1s
95232K ........ ........ ........ ........ ........ ........ 42% 346M 1s
98304K ........ ........ ........ ........ ........ ........ 44% 349M 1s
101376K ........ ........ ........ ........ ........ ........ 45% 345M 1s
104448K ........ ........ ........ ........ ........ ........ 47% 346M 0s
107520K ........ ........ ........ ........ ........ ........ 48% 348M 0s
110592K ........ ........ ........ ........ ........ ........ 49% 345M 0s
113664K ........ ........ ........ ........ ........ ........ 51% 341M 0s
116736K ........ ........ ........ ........ ........ ........ 52% 333M 0s
119808K ........ ........ ........ ........ ........ ........ 53% 333M 0s
122880K ........ ........ ........ ........ ........ ........ 55% 338M 0s
125952K ........ ........ ........ ........ ........ ........ 56% 344M 0s
129024K ........ ........ ........ ........ ........ ........ 57% 335M 0s
132096K ........ ........ ........ ........ ........ ........ 59% 345M 0s
135168K ........ ........ ........ ........ ........ ........ 60% 347M 0s
138240K ........ ........ ........ ........ ........ ........ 61% 327M 0s
141312K ........ ........ ........ ........ ........ ........ 63% 336M 0s
144384K ........ ........ ........ ........ ........ ........ 64% 317M 0s
147456K ........ ........ ........ ........ ........ ........ 65% 325M 0s
150528K ........ ........ ........ ........ ........ ........ 67% 322M 0s
153600K ........ ........ ........ ........ ........ ........ 68% 319M 0s
156672K ........ ........ ........ ........ ........ ........ 69% 334M 0s
159744K ........ ........ ........ ........ ........ ........ 71% 330M 0s
162816K ........ ........ ........ ........ ........ ........ 72% 338M 0s
165888K ........ ........ ........ ........ ........ ........ 73% 331M 0s
168960K ........ ........ ........ ........ ........ ........ 75% 339M 0s
172032K ........ ........ ........ ........ ........ ........ 76% 328M 0s
175104K ........ ........ ........ ........ ........ ........ 77% 336M 0s
178176K ........ ........ ........ ........ ........ ........ 79% 342M 0s
181248K ........ ........ ........ ........ ........ ........ 80% 323M 0s
184320K ........ ........ ........ ........ ........ ........ 81% 324M 0s
187392K ........ ........ ........ ........ ........ ........ 83% 330M 0s
190464K ........ ........ ........ ........ ........ ........ 84% 314M 0s
193536K ........ ........ ........ ........ ........ ........ 85% 327M 0s
196608K ........ ........ ........ ........ ........ ........ 87% 316M 0s
199680K ........ ........ ........ ........ ........ ........ 88% 321M 0s
202752K ........ ........ ........ ........ ........ ........ 89% 333M 0s
205824K ........ ........ ........ ........ ........ ........ 91% 320M 0s
208896K ........ ........ ........ ........ ........ ........ 92% 323M 0s
211968K ........ ........ ........ ........ ........ ........ 94% 94.1M 0s
215040K ........ ........ ........ ........ ........ ........ 95% 161M 0s
218112K ........ ........ ........ ........ ........ ........ 96% 255M 0s
221184K ........ ........ ........ ........ ........ ........ 98% 321M 0s
224256K ........ ........ ........ ........ ........ ........ 99% 321M 0s
227328K ........ ........ ...... 100% 289M=0.8s
2025-03-01 23:44:42 (269 MB/s) - ‘karaf-0.20.4-20250301.204651-414.zip’ saved [234245363/234245363]
Extracting the new controller...
+ echo 'Extracting the new controller...'
+ unzip -q karaf-0.20.4-20250301.204651-414.zip
Adding external repositories...
+ echo 'Adding external repositories...'
+ sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
+ cat /tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
################################################################################
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
################################################################################
#
# If set to true, the following property will not allow any certificate to be used
# when accessing Maven repositories through SSL
#
#org.ops4j.pax.url.mvn.certificateCheck=
#
# Path to the local Maven settings file.
# The repositories defined in this file will be automatically added to the list
# of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property
# below is not set.
# The following locations are checked for the existence of the settings.xml file
# * 1. looks for the specified url
# * 2. if not found looks for ${user.home}/.m2/settings.xml
# * 3. if not found looks for ${maven.home}/conf/settings.xml
# * 4. if not found looks for ${M2_HOME}/conf/settings.xml
#
#org.ops4j.pax.url.mvn.settings=
#
# Path to the local Maven repository which is used to avoid downloading
# artifacts when they already exist locally.
# The value of this property will be extracted from the settings.xml file
# above, or defaulted to:
# System.getProperty( "user.home" ) + "/.m2/repository"
#
org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository}
#
# Default this to false. It's just weird to use undocumented repos
#
org.ops4j.pax.url.mvn.useFallbackRepositories=false
#
# Uncomment if you don't wanna use the proxy settings
# from the Maven conf/settings.xml file
#
# org.ops4j.pax.url.mvn.proxySupport=false
#
# Comma separated list of repositories scanned when resolving an artifact.
# Those repositories will be checked before iterating through the
# below list of repositories and even before the local repository
# A repository url can be appended with zero or more of the following flags:
# @snapshots : the repository contains snaphots
# @noreleases : the repository does not contain any released artifacts
#
# The following property value will add the system folder as a repo.
#
org.ops4j.pax.url.mvn.defaultRepositories=\
file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\
file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\
file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots
# Use the default local repo (e.g.~/.m2/repository) as a "remote" repo
#org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false
#
# Comma separated list of repositories scanned when resolving an artifact.
# The default list includes the following repositories:
# http://repo1.maven.org/maven2@id=central
# http://repository.springsource.com/maven/bundles/release@id=spring.ebr
# http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external
# http://zodiac.springsource.com/maven/bundles/release@id=gemini
# http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases
# https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases
# https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
# To add repositories to the default ones, prepend '+' to the list of repositories
# to add.
# A repository url can be appended with zero or more of the following flags:
# @snapshots : the repository contains snapshots
# @noreleases : the repository does not contain any released artifacts
# @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended
#
org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.Configuring the startup features...
+ [[ True == \T\r\u\e ]]
+ echo 'Configuring the startup features...'
+ sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.20.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
+ FEATURE_TEST_STRING=features-test
+ FEATURE_TEST_VERSION=0.20.4-SNAPSHOT
+ KARAF_VERSION=karaf4
+ [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]]
+ sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.20.4-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.20.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
+ [[ ! -z '' ]]
+ cat /tmp/karaf-0.20.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
################################################################################
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
################################################################################
#
# Comma separated list of features repositories to register by default
#
featuresRepositories = mvn:org.opendaylight.integration/features-test/0.20.4-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/39904793-f28b-4085-a132-db8f47856b9e.xml
#
# Comma separated list of features to install at startup
#
featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, b93e9f3c-62cf-4eaa-a1e4-9401e68ebe32
#
# Resource repositories (OBR) that the features resolver can use
# to resolve requirements/capabilities
#
# The format of the resourceRepositories is
# resourceRepositories=[xml:url|json:url],...
# for Instance:
#
#resourceRepositories=xml:http://host/path/to/index.xml
# or
#resourceRepositories=json:http://host/path/to/index.json
#
#
# Defines if the boot features are started in asynchronous mode (in a dedicated thread)
#
featuresBootAsynchronous=false
#
# Service requirements enforcement
#
# By default, the feature resolver checks the service requirements/capabilities of
# bundles for new features (xml schema >= 1.3.0) in order to automatically installs
# the required bundles.
# The following flag can have those values:
# - disable: service requirements are completely ignored
# - default: service requirements are ignored for old features
# - enforce: service requirements are always verified
#
#serviceRequirements=default
#
# Store cfg file for config element in feature
#
#configCfgStore=true
#
# Define if the feature service automatically refresh bundles
#
autoRefresh=true
#
# Configuration of features processing mechanism (overrides, blacklisting, modification of features)
# XML file defines instructions related to features processing
# versions.properties may declare properties to resolve placeholders in XML file
# both files are relative to ${karaf.etc}
#
#featureProcessing=org.apache.karaf.features.xml
#featureProcessingVersions=versions.properties
+ configure_karaf_log karaf4 ''
+ local -r karaf_version=karaf4
+ local -r controllerdebugmap=
+ local logapi=log4j
+ grep log4j2 /tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
log4j2.rootLogger.level = INFO
#log4j2.rootLogger.type = asyncRoot
#log4j2.rootLogger.includeLocation = false
log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
log4j2.rootLogger.appenderRef.Console.ref = Console
log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
log4j2.logger.spifly.name = org.apache.aries.spifly
log4j2.logger.spifly.level = WARN
log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
log4j2.logger.audit.level = INFO
log4j2.logger.audit.additivity = false
log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
# Console appender not used by default (see log4j2.rootLogger.appenderRefs)
log4j2.appender.console.type = Console
log4j2.appender.console.name = Console
log4j2.appender.console.layout.type = PatternLayout
log4j2.appender.console.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.type = RollingRandomAccessFile
log4j2.appender.rolling.name = RollingFile
log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
#log4j2.appender.rolling.immediateFlush = false
log4j2.appender.rolling.append = true
log4j2.appender.rolling.layout.type = PatternLayout
log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.policies.type = Policies
log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.rolling.policies.size.size = 64MB
log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
log4j2.appender.rolling.strategy.max = 7
log4j2.appender.audit.type = RollingRandomAccessFile
log4j2.appender.audit.name = AuditRollingFile
log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
log4j2.appender.audit.append = true
log4j2.appender.audit.layout.type = PatternLayout
log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
log4j2.appender.audit.policies.type = Policies
log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.audit.policies.size.size = 8MB
log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
log4j2.appender.audit.strategy.max = 7
log4j2.appender.osgi.type = PaxOsgi
log4j2.appender.osgi.name = PaxOsgi
log4j2.appender.osgi.filter = *
#log4j2.logger.aether.name = shaded.org.eclipse.aether
#log4j2.logger.aether.level = TRACE
#log4j2.logger.http-headers.name = shaded.org.apache.http.headers
#log4j2.logger.http-headers.level = DEBUG
#log4j2.logger.maven.name = org.ops4j.pax.url.mvn
#log4j2.logger.maven.level = TRACE
+ logapi=log4j2
+ echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2'
Configuring the karaf log... karaf_version: karaf4, logapi: log4j2
+ '[' log4j2 == log4j2 ']'
+ sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
+ orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver
+ orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver
+ echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN'
+ echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN'
controllerdebugmap:
+ unset IFS
+ echo 'controllerdebugmap: '
cat /tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
+ '[' -n '' ']'
+ echo 'cat /tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg'
+ cat /tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
################################################################################
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
################################################################################
# Common pattern layout for appenders
log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
# Root logger
log4j2.rootLogger.level = INFO
# uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library
#log4j2.rootLogger.type = asyncRoot
#log4j2.rootLogger.includeLocation = false
log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
log4j2.rootLogger.appenderRef.Console.ref = Console
log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
# Filters for logs marked by org.opendaylight.odlparent.Markers
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
# Loggers configuration
# Spifly logger
log4j2.logger.spifly.name = org.apache.aries.spifly
log4j2.logger.spifly.level = WARN
# Security audit logger
log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
log4j2.logger.audit.level = INFO
log4j2.logger.audit.additivity = false
log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
# Appenders configuration
# Console appender not used by default (see log4j2.rootLogger.appenderRefs)
log4j2.appender.console.type = Console
log4j2.appender.console.name = Console
log4j2.appender.console.layout.type = PatternLayout
log4j2.appender.console.layout.pattern = ${log4j2.pattern}
# Rolling file appender
log4j2.appender.rolling.type = RollingRandomAccessFile
log4j2.appender.rolling.name = RollingFile
log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
# uncomment to not force a disk flush
#log4j2.appender.rolling.immediateFlush = false
log4j2.appender.rolling.append = true
log4j2.appender.rolling.layout.type = PatternLayout
log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.policies.type = Policies
log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.rolling.policies.size.size = 1GB
log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
log4j2.appender.rolling.strategy.max = 7
# Audit file appender
log4j2.appender.audit.type = RollingRandomAccessFile
log4j2.appender.audit.name = AuditRollingFile
log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
log4j2.appender.audit.append = true
log4j2.appender.audit.layout.type = PatternLayout
log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
log4j2.appender.audit.policies.type = Policies
log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.audit.policies.size.size = 8MB
log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
log4j2.appender.audit.strategy.max = 7
# OSGi appender
log4j2.appender.osgi.type = PaxOsgi
log4j2.appender.osgi.name = PaxOsgi
log4j2.appender.osgi.filter = *
# help with identification of maven-related problems with pax-url-aether
#log4j2.logger.aether.name = shaded.org.eclipse.aether
#log4j2.logger.aether.level = TRACE
#log4j2.logger.http-headers.name = shaded.org.apache.http.headers
#log4j2.logger.http-headers.level = DEBUG
#log4j2.logger.maven.name = org.ops4j.pax.url.mvn
#log4j2.logger.maven.level = TRACE
log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN
log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN
+ set_java_vars /usr/lib/jvm/java-17-openjdk-amd64 3072m /tmp/karaf-0.20.4-SNAPSHOT/bin/setenv
+ local -r java_home=/usr/lib/jvm/java-17-openjdk-amd64
+ local -r controllermem=3072m
Configure
java home: /usr/lib/jvm/java-17-openjdk-amd64
+ local -r memconf=/tmp/karaf-0.20.4-SNAPSHOT/bin/setenv
+ echo Configure
+ echo ' java home: /usr/lib/jvm/java-17-openjdk-amd64'
+ echo ' max memory: 3072m'
max memory: 3072m
memconf: /tmp/karaf-0.20.4-SNAPSHOT/bin/setenv
+ echo ' memconf: /tmp/karaf-0.20.4-SNAPSHOT/bin/setenv'
+ sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk-amd64}%g' /tmp/karaf-0.20.4-SNAPSHOT/bin/setenv
+ sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.20.4-SNAPSHOT/bin/setenv
cat /tmp/karaf-0.20.4-SNAPSHOT/bin/setenv
+ echo 'cat /tmp/karaf-0.20.4-SNAPSHOT/bin/setenv'
+ cat /tmp/karaf-0.20.4-SNAPSHOT/bin/setenv
#!/bin/sh
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
#
# handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf
# script: client, instance, shell, start, status, stop, karaf
#
# if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then
# Actions go here...
# fi
#
# general settings which should be applied for all scripts go here; please keep
# in mind that it is possible that scripts might be executed more than once, e.g.
# in example of the start script where the start script is executed first and the
# karaf script afterwards.
#
#
# The following section shows the possible configuration options for the default
# karaf scripts
#
export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk-amd64} # Location of Java installation
# export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration
# export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options
# export EXTRA_JAVA_OPTS # Additional JVM options
# export KARAF_HOME # Karaf home folder
# export KARAF_DATA # Karaf data folder
# export KARAF_BASE # Karaf base folder
# export KARAF_ETC # Karaf etc folder
# export KARAF_LOG # Karaf log folder
# export KARAF_SYSTEM_OPTS # First citizen Karaf options
# export KARAF_OPTS # Additional available Karaf options
# export KARAF_DEBUG # Enable debug mode
# export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start
# export KARAF_NOROOT # Prevent execution as root if set to true
Set Java version
+ echo 'Set Java version'
+ sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-17-openjdk-amd64/bin/java 1
sudo: /usr/sbin/alternatives: command not found
+ sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-17-openjdk-amd64/bin/java
sudo: /usr/sbin/alternatives: command not found
JDK default version ...
+ echo 'JDK default version ...'
+ java -version
openjdk version "11.0.25" 2024-10-15
OpenJDK Runtime Environment (build 11.0.25+9-post-Ubuntu-1ubuntu120.04)
OpenJDK 64-Bit Server VM (build 11.0.25+9-post-Ubuntu-1ubuntu120.04, mixed mode, sharing)
Set JAVA_HOME
+ echo 'Set JAVA_HOME'
+ export JAVA_HOME=/usr/lib/jvm/java-17-openjdk-amd64
+ JAVA_HOME=/usr/lib/jvm/java-17-openjdk-amd64
++ readlink -e /usr/lib/jvm/java-17-openjdk-amd64/bin/java
+ JAVA_RESOLVED=/usr/lib/jvm/java-17-openjdk-amd64/bin/java
+ echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-amd64/bin/java'
Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-amd64/bin/java
Listing all open ports on controller system...
+ echo 'Listing all open ports on controller system...'
+ netstat -pnatu
/tmp/configuration-script.sh: line 40: netstat: command not found
Custom shard config exists!!!
Copying the shard config...
+ '[' -f /tmp/custom_shard_config.txt ']'
+ echo 'Custom shard config exists!!!'
+ echo 'Copying the shard config...'
+ cp /tmp/custom_shard_config.txt /tmp/karaf-0.20.4-SNAPSHOT/bin/
Configuring cluster
+ echo 'Configuring cluster'
+ /tmp/karaf-0.20.4-SNAPSHOT/bin/configure_cluster.sh 1 10.30.170.151 10.30.170.8 10.30.170.204
################################################
## Configure Cluster ##
################################################
NOTE: Cluster configuration files not found. Copying from
/tmp/karaf-0.20.4-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/9.0.6
Configuring unique name in akka.conf
Configuring hostname in akka.conf
Configuring data and rpc seed nodes in akka.conf
modules = [
{
name = "inventory"
namespace = "urn:opendaylight:inventory"
shard-strategy = "module"
},
{
name = "topology"
namespace = "urn:TBD:params:xml:ns:yang:network-topology"
shard-strategy = "module"
},
{
name = "toaster"
namespace = "http://netconfcentral.org/ns/toaster"
shard-strategy = "module"
},
{
name = "car"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
shard-strategy = "module"
},
{
name = "people"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
shard-strategy = "module"
},
{
name = "car-people"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
shard-strategy = "module"
}
]
Configuring replication type in module-shards.conf
################################################
## NOTE: Manually restart controller to ##
## apply configuration. ##
################################################
Dump akka.conf
+ echo 'Dump akka.conf'
+ cat /tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/akka.conf
odl-cluster-data {
akka {
remote {
artery {
enabled = on
transport = tcp
canonical.hostname = "10.30.170.151"
canonical.port = 2550
}
}
cluster {
# Using artery.
seed-nodes = ["akka://opendaylight-cluster-data@10.30.170.151:2550",
"akka://opendaylight-cluster-data@10.30.170.8:2550",
"akka://opendaylight-cluster-data@10.30.170.204:2550"]
roles = ["member-1"]
# when under load we might trip a false positive on the failure detector
# failure-detector {
# heartbeat-interval = 4 s
# acceptable-heartbeat-pause = 16s
# }
}
persistence {
# By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by
# modifying the following two properties. The directory location specified may be a relative or absolute path.
# The relative path is always relative to KARAF_HOME.
# snapshot-store.local.dir = "target/snapshots"
# Use lz4 compression for LocalSnapshotStore snapshots
snapshot-store.local.use-lz4-compression = false
# Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB
snapshot-store.local.lz4-blocksize = 256KB
}
disable-default-actor-system-quarantined-event-handling = "false"
}
}
Dump modules.conf
+ echo 'Dump modules.conf'
+ cat /tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/modules.conf
modules = [
{
name = "inventory"
namespace = "urn:opendaylight:inventory"
shard-strategy = "module"
},
{
name = "topology"
namespace = "urn:TBD:params:xml:ns:yang:network-topology"
shard-strategy = "module"
},
{
name = "toaster"
namespace = "http://netconfcentral.org/ns/toaster"
shard-strategy = "module"
},
{
name = "car"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
shard-strategy = "module"
},
{
name = "people"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
shard-strategy = "module"
},
{
name = "car-people"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
shard-strategy = "module"
}
]
Dump module-shards.conf
+ echo 'Dump module-shards.conf'
+ cat /tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/module-shards.conf
module-shards = [
{
name = "default"
shards = [
{
name = "default"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "inventory"
shards = [
{
name="inventory"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "topology"
shards = [
{
name="topology"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "toaster"
shards = [
{
name="toaster"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "car"
shards = [
{
name="car"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "people"
shards = [
{
name="people"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "car-people"
shards = [
{
name="car-people"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
}
]
Configuring member-2 with IP address 10.30.170.8
Warning: Permanently added '10.30.170.8' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.170.8' (ECDSA) to the list of known hosts.
+ source /tmp/common-functions.sh karaf-0.20.4-SNAPSHOT
common-functions.sh is being sourced
++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]]
++ echo 'common-functions.sh is being sourced'
++ BUNDLEFOLDER=karaf-0.20.4-SNAPSHOT
++ export MAVENCONF=/tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
++ MAVENCONF=/tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
++ export FEATURESCONF=/tmp/karaf-0.20.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
++ FEATURESCONF=/tmp/karaf-0.20.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
++ export CUSTOMPROP=/tmp/karaf-0.20.4-SNAPSHOT/etc/custom.properties
++ CUSTOMPROP=/tmp/karaf-0.20.4-SNAPSHOT/etc/custom.properties
++ export LOGCONF=/tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
++ LOGCONF=/tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
++ export MEMCONF=/tmp/karaf-0.20.4-SNAPSHOT/bin/setenv
++ MEMCONF=/tmp/karaf-0.20.4-SNAPSHOT/bin/setenv
++ export CONTROLLERMEM=
++ CONTROLLERMEM=
++ export AKKACONF=/tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/akka.conf
++ AKKACONF=/tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/akka.conf
++ export MODULESCONF=/tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/modules.conf
++ MODULESCONF=/tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/modules.conf
++ export MODULESHARDSCONF=/tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/module-shards.conf
++ MODULESHARDSCONF=/tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/module-shards.conf
++ print_common_env
++ cat
common-functions environment:
MAVENCONF: /tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
ACTUALFEATURES:
FEATURESCONF: /tmp/karaf-0.20.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
CUSTOMPROP: /tmp/karaf-0.20.4-SNAPSHOT/etc/custom.properties
LOGCONF: /tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
MEMCONF: /tmp/karaf-0.20.4-SNAPSHOT/bin/setenv
CONTROLLERMEM:
AKKACONF: /tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/akka.conf
MODULESCONF: /tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/modules.conf
MODULESHARDSCONF: /tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/module-shards.conf
SUITES:
++ SSH='ssh -t -t'
++ extra_services_cntl=' dnsmasq.service httpd.service libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service rabbitmq-server.service '
++ extra_services_cmp=' libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service '
Changing to /tmp
Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.4-SNAPSHOT/karaf-0.20.4-20250301.204651-414.zip
+ echo 'Changing to /tmp'
+ cd /tmp
+ echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.4-SNAPSHOT/karaf-0.20.4-20250301.204651-414.zip'
+ wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.4-SNAPSHOT/karaf-0.20.4-20250301.204651-414.zip
--2025-03-01 23:44:45-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.4-SNAPSHOT/karaf-0.20.4-20250301.204651-414.zip
Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6
Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 234245363 (223M) [application/zip]
Saving to: ‘karaf-0.20.4-20250301.204651-414.zip’
0K ........ ........ ........ ........ ........ ........ 1% 54.4M 4s
3072K ........ ........ ........ ........ ........ ........ 2% 93.5M 3s
6144K ........ ........ ........ ........ ........ ........ 4% 130M 3s
9216K ........ ........ ........ ........ ........ ........ 5% 152M 2s
12288K ........ ........ ........ ........ ........ ........ 6% 198M 2s
15360K ........ ........ ........ ........ ........ ........ 8% 205M 2s
18432K ........ ........ ........ ........ ........ ........ 9% 246M 2s
21504K ........ ........ ........ ........ ........ ........ 10% 269M 2s
24576K ........ ........ ........ ........ ........ ........ 12% 280M 1s
27648K ........ ........ ........ ........ ........ ........ 13% 319M 1s
30720K ........ ........ ........ ........ ........ ........ 14% 322M 1s
33792K ........ ........ ........ ........ ........ ........ 16% 334M 1s
36864K ........ ........ ........ ........ ........ ........ 17% 375M 1s
39936K ........ ........ ........ ........ ........ ........ 18% 372M 1s
43008K ........ ........ ........ ........ ........ ........ 20% 375M 1s
46080K ........ ........ ........ ........ ........ ........ 21% 429M 1s
49152K ........ ........ ........ ........ ........ ........ 22% 399M 1s
52224K ........ ........ ........ ........ ........ ........ 24% 334M 1s
55296K ........ ........ ........ ........ ........ ........ 25% 423M 1s
58368K ........ ........ ........ ........ ........ ........ 26% 418M 1s
61440K ........ ........ ........ ........ ........ ........ 28% 437M 1s
64512K ........ ........ ........ ........ ........ ........ 29% 358M 1s
67584K ........ ........ ........ ........ ........ ........ 30% 354M 1s
70656K ........ ........ ........ ........ ........ ........ 32% 393M 1s
73728K ........ ........ ........ ........ ........ ........ 33% 424M 1s
76800K ........ ........ ........ ........ ........ ........ 34% 362M 1s
79872K ........ ........ ........ ........ ........ ........ 36% 283M 1s
82944K ........ ........ ........ ........ ........ ........ 37% 256M 1s
86016K ........ ........ ........ ........ ........ ........ 38% 139M 1s
89088K ........ ........ ........ ........ ........ ........ 40% 263M 1s
92160K ........ ........ ........ ........ ........ ........ 41% 337M 1s
95232K ........ ........ ........ ........ ........ ........ 42% 381M 1s
98304K ........ ........ ........ ........ ........ ........ 44% 271M 1s
101376K ........ ........ ........ ........ ........ ........ 45% 263M 1s
104448K ........ ........ ........ ........ ........ ........ 47% 263M 0s
107520K ........ ........ ........ ........ ........ ........ 48% 253M 0s
110592K ........ ........ ........ ........ ........ ........ 49% 183M 0s
113664K ........ ........ ........ ........ ........ ........ 51% 363M 0s
116736K ........ ........ ........ ........ ........ ........ 52% 278M 0s
119808K ........ ........ ........ ........ ........ ........ 53% 363M 0s
122880K ........ ........ ........ ........ ........ ........ 55% 379M 0s
125952K ........ ........ ........ ........ ........ ........ 56% 386M 0s
129024K ........ ........ ........ ........ ........ ........ 57% 333M 0s
132096K ........ ........ ........ ........ ........ ........ 59% 308M 0s
135168K ........ ........ ........ ........ ........ ........ 60% 324M 0s
138240K ........ ........ ........ ........ ........ ........ 61% 371M 0s
141312K ........ ........ ........ ........ ........ ........ 63% 362M 0s
144384K ........ ........ ........ ........ ........ ........ 64% 375M 0s
147456K ........ ........ ........ ........ ........ ........ 65% 367M 0s
150528K ........ ........ ........ ........ ........ ........ 67% 341M 0s
153600K ........ ........ ........ ........ ........ ........ 68% 317M 0s
156672K ........ ........ ........ ........ ........ ........ 69% 349M 0s
159744K ........ ........ ........ ........ ........ ........ 71% 365M 0s
162816K ........ ........ ........ ........ ........ ........ 72% 372M 0s
165888K ........ ........ ........ ........ ........ ........ 73% 266M 0s
168960K ........ ........ ........ ........ ........ ........ 75% 354M 0s
172032K ........ ........ ........ ........ ........ ........ 76% 468M 0s
175104K ........ ........ ........ ........ ........ ........ 77% 307M 0s
178176K ........ ........ ........ ........ ........ ........ 79% 322M 0s
181248K ........ ........ ........ ........ ........ ........ 80% 361M 0s
184320K ........ ........ ........ ........ ........ ........ 81% 362M 0s
187392K ........ ........ ........ ........ ........ ........ 83% 358M 0s
190464K ........ ........ ........ ........ ........ ........ 84% 361M 0s
193536K ........ ........ ........ ........ ........ ........ 85% 361M 0s
196608K ........ ........ ........ ........ ........ ........ 87% 298M 0s
199680K ........ ........ ........ ........ ........ ........ 88% 250M 0s
202752K ........ ........ ........ ........ ........ ........ 89% 245M 0s
205824K ........ ........ ........ ........ ........ ........ 91% 102M 0s
208896K ........ ........ ........ ........ ........ ........ 92% 183M 0s
211968K ........ ........ ........ ........ ........ ........ 94% 286M 0s
215040K ........ ........ ........ ........ ........ ........ 95% 364M 0s
218112K ........ ........ ........ ........ ........ ........ 96% 361M 0s
221184K ........ ........ ........ ........ ........ ........ 98% 363M 0s
224256K ........ ........ ........ ........ ........ ........ 99% 357M 0s
227328K ........ ........ ...Extracting the new controller...
... 100% 351M=0.8s
2025-03-01 23:44:45 (271 MB/s) - ‘karaf-0.20.4-20250301.204651-414.zip’ saved [234245363/234245363]
+ echo 'Extracting the new controller...'
+ unzip -q karaf-0.20.4-20250301.204651-414.zip
Adding external repositories...
+ echo 'Adding external repositories...'
+ sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
+ cat /tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
################################################################################
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
################################################################################
#
# If set to true, the following property will not allow any certificate to be used
# when accessing Maven repositories through SSL
#
#org.ops4j.pax.url.mvn.certificateCheck=
#
# Path to the local Maven settings file.
# The repositories defined in this file will be automatically added to the list
# of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property
# below is not set.
# The following locations are checked for the existence of the settings.xml file
# * 1. looks for the specified url
# * 2. if not found looks for ${user.home}/.m2/settings.xml
# * 3. if not found looks for ${maven.home}/conf/settings.xml
# * 4. if not found looks for ${M2_HOME}/conf/settings.xml
#
#org.ops4j.pax.url.mvn.settings=
#
# Path to the local Maven repository which is used to avoid downloading
# artifacts when they already exist locally.
# The value of this property will be extracted from the settings.xml file
# above, or defaulted to:
# System.getProperty( "user.home" ) + "/.m2/repository"
#
org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository}
#
# Default this to false. It's just weird to use undocumented repos
#
org.ops4j.pax.url.mvn.useFallbackRepositories=false
#
# Uncomment if you don't wanna use the proxy settings
# from the Maven conf/settings.xml file
#
# org.ops4j.pax.url.mvn.proxySupport=false
#
# Comma separated list of repositories scanned when resolving an artifact.
# Those repositories will be checked before iterating through the
# below list of repositories and even before the local repository
# A repository url can be appended with zero or more of the following flags:
# @snapshots : the repository contains snaphots
# @noreleases : the repository does not contain any released artifacts
#
# The following property value will add the system folder as a repo.
#
org.ops4j.pax.url.mvn.defaultRepositories=\
file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\
file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\
file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots
# Use the default local repo (e.g.~/.m2/repository) as a "remote" repo
#org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false
#
# Comma separated list of repositories scanned when resolving an artifact.
# The default list includes the following repositories:
# http://repo1.maven.org/maven2@id=central
# http://repository.springsource.com/maven/bundles/release@id=spring.ebr
# http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external
# http://zodiac.springsource.com/maven/bundles/release@id=gemini
# http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases
# https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases
# https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
# To add repositories to the default ones, prepend '+' to the list of repositories
# to add.
# A repository url can be appended with zero or more of the following flags:
# @snapshots : the repository contains snapshots
# @noreleases : the repository does not contain any released artifacts
# @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended
#
org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.Configuring the startup features...
+ [[ True == \T\r\u\e ]]
+ echo 'Configuring the startup features...'
+ sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.20.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
+ FEATURE_TEST_STRING=features-test
+ FEATURE_TEST_VERSION=0.20.4-SNAPSHOT
+ KARAF_VERSION=karaf4
+ [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]]
+ sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.20.4-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.20.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
+ [[ ! -z '' ]]
+ cat /tmp/karaf-0.20.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
################################################################################
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
################################################################################
#
# Comma separated list of features repositories to register by default
#
featuresRepositories = mvn:org.opendaylight.integration/features-test/0.20.4-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/39904793-f28b-4085-a132-db8f47856b9e.xml
#
# Comma separated list of features to install at startup
#
featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, b93e9f3c-62cf-4eaa-a1e4-9401e68ebe32
#
# Resource repositories (OBR) that the features resolver can use
# to resolve requirements/capabilities
#
# The format of the resourceRepositories is
# resourceRepositories=[xml:url|json:url],...
# for Instance:
#
#resourceRepositories=xml:http://host/path/to/index.xml
# or
#resourceRepositories=json:http://host/path/to/index.json
#
#
# Defines if the boot features are started in asynchronous mode (in a dedicated thread)
#
featuresBootAsynchronous=false
#
# Service requirements enforcement
#
# By default, the feature resolver checks the service requirements/capabilities of
# bundles for new features (xml schema >= 1.3.0) in order to automatically installs
# the required bundles.
# The following flag can have those values:
# - disable: service requirements are completely ignored
# - default: service requirements are ignored for old features
# - enforce: service requirements are always verified
#
#serviceRequirements=default
#
# Store cfg file for config element in feature
#
#configCfgStore=true
#
# Define if the feature service automatically refresh bundles
#
autoRefresh=true
#
# Configuration of features processing mechanism (overrides, blacklisting, modification of features)
# XML file defines instructions related to features processing
# versions.properties may declare properties to resolve placeholders in XML file
# both files are relative to ${karaf.etc}
#
#featureProcessing=org.apache.karaf.features.xml
#featureProcessingVersions=versions.properties
+ configure_karaf_log karaf4 ''
+ local -r karaf_version=karaf4
+ local -r controllerdebugmap=
+ local logapi=log4j
+ grep log4j2 /tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
log4j2.rootLogger.level = INFO
#log4j2.rootLogger.type = asyncRoot
#log4j2.rootLogger.includeLocation = false
log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
log4j2.rootLogger.appenderRef.Console.ref = Console
log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
log4j2.logger.spifly.name = org.apache.aries.spifly
log4j2.logger.spifly.level = WARN
log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
log4j2.logger.audit.level = INFO
log4j2.logger.audit.additivity = false
log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
# Console appender not used by default (see log4j2.rootLogger.appenderRefs)
log4j2.appender.console.type = Console
log4j2.appender.console.name = Console
log4j2.appender.console.layout.type = PatternLayout
log4j2.appender.console.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.type = RollingRandomAccessFile
log4j2.appender.rolling.name = RollingFile
log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
#log4j2.appender.rolling.immediateFlush = false
log4j2.appender.rolling.append = true
log4j2.appender.rolling.layout.type = PatternLayout
log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.policies.type = Policies
log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.rolling.policies.size.size = 64MB
log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
log4j2.appender.rolling.strategy.max = 7
log4j2.appender.audit.type = RollingRandomAccessFile
log4j2.appender.audit.name = AuditRollingFile
log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
log4j2.appender.audit.append = true
log4j2.appender.audit.layout.type = PatternLayout
log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
log4j2.appender.audit.policies.type = Policies
log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.audit.policies.size.size = 8MB
log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
log4j2.appender.audit.strategy.max = 7
log4j2.appender.osgi.type = PaxOsgi
log4j2.appender.osgi.name = PaxOsgi
log4j2.appender.osgi.filter = *
#log4j2.logger.aether.name = shaded.org.eclipse.aether
#log4j2.logger.aether.level = TRACE
#log4j2.logger.http-headers.name = shaded.org.apache.http.headers
#log4j2.logger.http-headers.level = DEBUG
#log4j2.logger.maven.name = org.ops4j.pax.url.mvn
#log4j2.logger.maven.level = TRACE
+ logapi=log4j2
+ echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2'
Configuring the karaf log... karaf_version: karaf4, logapi: log4j2
+ '[' log4j2 == log4j2 ']'
+ sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
+ orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver
+ orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver
+ echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN'
+ echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN'
+ unset IFS
controllerdebugmap:
+ echo 'controllerdebugmap: '
+ '[' -n '' ']'
cat /tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
+ echo 'cat /tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg'
+ cat /tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
################################################################################
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
################################################################################
# Common pattern layout for appenders
log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
# Root logger
log4j2.rootLogger.level = INFO
# uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library
#log4j2.rootLogger.type = asyncRoot
#log4j2.rootLogger.includeLocation = false
log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
log4j2.rootLogger.appenderRef.Console.ref = Console
log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
# Filters for logs marked by org.opendaylight.odlparent.Markers
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
# Loggers configuration
# Spifly logger
log4j2.logger.spifly.name = org.apache.aries.spifly
log4j2.logger.spifly.level = WARN
# Security audit logger
log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
log4j2.logger.audit.level = INFO
log4j2.logger.audit.additivity = false
log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
# Appenders configuration
# Console appender not used by default (see log4j2.rootLogger.appenderRefs)
log4j2.appender.console.type = Console
log4j2.appender.console.name = Console
log4j2.appender.console.layout.type = PatternLayout
log4j2.appender.console.layout.pattern = ${log4j2.pattern}
# Rolling file appender
log4j2.appender.rolling.type = RollingRandomAccessFile
log4j2.appender.rolling.name = RollingFile
log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
# uncomment to not force a disk flush
#log4j2.appender.rolling.immediateFlush = false
log4j2.appender.rolling.append = true
log4j2.appender.rolling.layout.type = PatternLayout
log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.policies.type = Policies
log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.rolling.policies.size.size = 1GB
log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
log4j2.appender.rolling.strategy.max = 7
# Audit file appender
log4j2.appender.audit.type = RollingRandomAccessFile
log4j2.appender.audit.name = AuditRollingFile
log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
log4j2.appender.audit.append = true
log4j2.appender.audit.layout.type = PatternLayout
log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
log4j2.appender.audit.policies.type = Policies
log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.audit.policies.size.size = 8MB
log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
log4j2.appender.audit.strategy.max = 7
# OSGi appender
log4j2.appender.osgi.type = PaxOsgi
log4j2.appender.osgi.name = PaxOsgi
log4j2.appender.osgi.filter = *
# help with identification of maven-related problems with pax-url-aether
#log4j2.logger.aether.name = shaded.org.eclipse.aether
#log4j2.logger.aether.level = TRACE
#log4j2.logger.http-headers.name = shaded.org.apache.http.headers
#log4j2.logger.http-headers.level = DEBUG
#log4j2.logger.maven.name = org.ops4j.pax.url.mvn
#log4j2.logger.maven.level = TRACE
log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN
log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN
+ set_java_vars /usr/lib/jvm/java-17-openjdk-amd64 3072m /tmp/karaf-0.20.4-SNAPSHOT/bin/setenv
+ local -r java_home=/usr/lib/jvm/java-17-openjdk-amd64
Configure
java home: /usr/lib/jvm/java-17-openjdk-amd64
max memory: 3072m
memconf: /tmp/karaf-0.20.4-SNAPSHOT/bin/setenv
+ local -r controllermem=3072m
+ local -r memconf=/tmp/karaf-0.20.4-SNAPSHOT/bin/setenv
+ echo Configure
+ echo ' java home: /usr/lib/jvm/java-17-openjdk-amd64'
+ echo ' max memory: 3072m'
+ echo ' memconf: /tmp/karaf-0.20.4-SNAPSHOT/bin/setenv'
+ sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk-amd64}%g' /tmp/karaf-0.20.4-SNAPSHOT/bin/setenv
+ sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.20.4-SNAPSHOT/bin/setenv
cat /tmp/karaf-0.20.4-SNAPSHOT/bin/setenv
+ echo 'cat /tmp/karaf-0.20.4-SNAPSHOT/bin/setenv'
+ cat /tmp/karaf-0.20.4-SNAPSHOT/bin/setenv
#!/bin/sh
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
#
# handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf
# script: client, instance, shell, start, status, stop, karaf
#
# if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then
# Actions go here...
# fi
#
# general settings which should be applied for all scripts go here; please keep
# in mind that it is possible that scripts might be executed more than once, e.g.
# in example of the start script where the start script is executed first and the
# karaf script afterwards.
#
#
# The following section shows the possible configuration options for the default
# karaf scripts
#
export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk-amd64} # Location of Java installation
# export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration
# export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options
# export EXTRA_JAVA_OPTS # Additional JVM options
# export KARAF_HOME # Karaf home folder
# export KARAF_DATA # Karaf data folder
# export KARAF_BASE # Karaf base folder
# export KARAF_ETC # Karaf etc folder
# export KARAF_LOG # Karaf log folder
# export KARAF_SYSTEM_OPTS # First citizen Karaf options
# export KARAF_OPTS # Additional available Karaf options
# export KARAF_DEBUG # Enable debug mode
# export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start
# export KARAF_NOROOT # Prevent execution as root if set to true
Set Java version
+ echo 'Set Java version'
+ sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-17-openjdk-amd64/bin/java 1
sudo: /usr/sbin/alternatives: command not found
+ sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-17-openjdk-amd64/bin/java
sudo: /usr/sbin/alternatives: command not found
JDK default version ...
+ echo 'JDK default version ...'
+ java -version
openjdk version "11.0.25" 2024-10-15
OpenJDK Runtime Environment (build 11.0.25+9-post-Ubuntu-1ubuntu120.04)
OpenJDK 64-Bit Server VM (build 11.0.25+9-post-Ubuntu-1ubuntu120.04, mixed mode, sharing)
Set JAVA_HOME
+ echo 'Set JAVA_HOME'
+ export JAVA_HOME=/usr/lib/jvm/java-17-openjdk-amd64
+ JAVA_HOME=/usr/lib/jvm/java-17-openjdk-amd64
++ readlink -e /usr/lib/jvm/java-17-openjdk-amd64/bin/java
Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-amd64/bin/java
Listing all open ports on controller system...
+ JAVA_RESOLVED=/usr/lib/jvm/java-17-openjdk-amd64/bin/java
+ echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-amd64/bin/java'
+ echo 'Listing all open ports on controller system...'
+ netstat -pnatu
/tmp/configuration-script.sh: line 40: netstat: command not found
Custom shard config exists!!!
Copying the shard config...
+ '[' -f /tmp/custom_shard_config.txt ']'
+ echo 'Custom shard config exists!!!'
+ echo 'Copying the shard config...'
+ cp /tmp/custom_shard_config.txt /tmp/karaf-0.20.4-SNAPSHOT/bin/
Configuring cluster
+ echo 'Configuring cluster'
+ /tmp/karaf-0.20.4-SNAPSHOT/bin/configure_cluster.sh 2 10.30.170.151 10.30.170.8 10.30.170.204
################################################
## Configure Cluster ##
################################################
NOTE: Cluster configuration files not found. Copying from
/tmp/karaf-0.20.4-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/9.0.6
Configuring unique name in akka.conf
Configuring hostname in akka.conf
Configuring data and rpc seed nodes in akka.conf
modules = [
{
name = "inventory"
namespace = "urn:opendaylight:inventory"
shard-strategy = "module"
},
{
name = "topology"
namespace = "urn:TBD:params:xml:ns:yang:network-topology"
shard-strategy = "module"
},
{
name = "toaster"
namespace = "http://netconfcentral.org/ns/toaster"
shard-strategy = "module"
},
{
name = "car"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
shard-strategy = "module"
},
{
name = "people"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
shard-strategy = "module"
},
{
name = "car-people"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
shard-strategy = "module"
}
]
Configuring replication type in module-shards.conf
################################################
## NOTE: Manually restart controller to ##
## apply configuration. ##
################################################
Dump akka.conf
+ echo 'Dump akka.conf'
+ cat /tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/akka.conf
odl-cluster-data {
akka {
remote {
artery {
enabled = on
transport = tcp
canonical.hostname = "10.30.170.8"
canonical.port = 2550
}
}
cluster {
# Using artery.
seed-nodes = ["akka://opendaylight-cluster-data@10.30.170.151:2550",
"akka://opendaylight-cluster-data@10.30.170.8:2550",
"akka://opendaylight-cluster-data@10.30.170.204:2550"]
roles = ["member-2"]
# when under load we might trip a false positive on the failure detector
# failure-detector {
# heartbeat-interval = 4 s
# acceptable-heartbeat-pause = 16s
# }
}
persistence {
# By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by
# modifying the following two properties. The directory location specified may be a relative or absolute path.
# The relative path is always relative to KARAF_HOME.
# snapshot-store.local.dir = "target/snapshots"
# Use lz4 compression for LocalSnapshotStore snapshots
snapshot-store.local.use-lz4-compression = false
# Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB
snapshot-store.local.lz4-blocksize = 256KB
}
disable-default-actor-system-quarantined-event-handling = "false"
}
}
Dump modules.conf
+ echo 'Dump modules.conf'
+ cat /tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/modules.conf
modules = [
{
name = "inventory"
namespace = "urn:opendaylight:inventory"
shard-strategy = "module"
},
{
name = "topology"
namespace = "urn:TBD:params:xml:ns:yang:network-topology"
shard-strategy = "module"
},
{
name = "toaster"
namespace = "http://netconfcentral.org/ns/toaster"
shard-strategy = "module"
},
{
name = "car"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
shard-strategy = "module"
},
{
name = "people"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
shard-strategy = "module"
},
{
name = "car-people"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
shard-strategy = "module"
}
]
Dump module-shards.conf
+ echo 'Dump module-shards.conf'
+ cat /tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/module-shards.conf
module-shards = [
{
name = "default"
shards = [
{
name = "default"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "inventory"
shards = [
{
name="inventory"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "topology"
shards = [
{
name="topology"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "toaster"
shards = [
{
name="toaster"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "car"
shards = [
{
name="car"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "people"
shards = [
{
name="people"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "car-people"
shards = [
{
name="car-people"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
}
]
Configuring member-3 with IP address 10.30.170.204
Warning: Permanently added '10.30.170.204' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.170.204' (ECDSA) to the list of known hosts.
+ source /tmp/common-functions.sh karaf-0.20.4-SNAPSHOT
common-functions.sh is being sourced
++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]]
++ echo 'common-functions.sh is being sourced'
++ BUNDLEFOLDER=karaf-0.20.4-SNAPSHOT
++ export MAVENCONF=/tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
++ MAVENCONF=/tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
++ export FEATURESCONF=/tmp/karaf-0.20.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
++ FEATURESCONF=/tmp/karaf-0.20.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
++ export CUSTOMPROP=/tmp/karaf-0.20.4-SNAPSHOT/etc/custom.properties
++ CUSTOMPROP=/tmp/karaf-0.20.4-SNAPSHOT/etc/custom.properties
++ export LOGCONF=/tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
++ LOGCONF=/tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
++ export MEMCONF=/tmp/karaf-0.20.4-SNAPSHOT/bin/setenv
++ MEMCONF=/tmp/karaf-0.20.4-SNAPSHOT/bin/setenv
++ export CONTROLLERMEM=
++ CONTROLLERMEM=
++ export AKKACONF=/tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/akka.conf
++ AKKACONF=/tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/akka.conf
++ export MODULESCONF=/tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/modules.conf
++ MODULESCONF=/tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/modules.conf
++ export MODULESHARDSCONF=/tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/module-shards.conf
++ MODULESHARDSCONF=/tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/module-shards.conf
++ print_common_env
++ cat
common-functions environment:
MAVENCONF: /tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
ACTUALFEATURES:
FEATURESCONF: /tmp/karaf-0.20.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
CUSTOMPROP: /tmp/karaf-0.20.4-SNAPSHOT/etc/custom.properties
LOGCONF: /tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
MEMCONF: /tmp/karaf-0.20.4-SNAPSHOT/bin/setenv
CONTROLLERMEM:
AKKACONF: /tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/akka.conf
MODULESCONF: /tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/modules.conf
MODULESHARDSCONF: /tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/module-shards.conf
SUITES:
++ SSH='ssh -t -t'
++ extra_services_cntl=' dnsmasq.service httpd.service libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service rabbitmq-server.service '
++ extra_services_cmp=' libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service '
Changing to /tmp
Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.4-SNAPSHOT/karaf-0.20.4-20250301.204651-414.zip
+ echo 'Changing to /tmp'
+ cd /tmp
+ echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.4-SNAPSHOT/karaf-0.20.4-20250301.204651-414.zip'
+ wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.4-SNAPSHOT/karaf-0.20.4-20250301.204651-414.zip
--2025-03-01 23:44:48-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.4-SNAPSHOT/karaf-0.20.4-20250301.204651-414.zip
Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6
Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 234245363 (223M) [application/zip]
Saving to: ‘karaf-0.20.4-20250301.204651-414.zip’
0K ........ ........ ........ ........ ........ ........ 1% 65.7M 3s
3072K ........ ........ ........ ........ ........ ........ 2% 112M 3s
6144K ........ ........ ........ ........ ........ ........ 4% 104M 2s
9216K ........ ........ ........ ........ ........ ........ 5% 105M 2s
12288K ........ ........ ........ ........ ........ ........ 6% 152M 2s
15360K ........ ........ ........ ........ ........ ........ 8% 147M 2s
18432K ........ ........ ........ ........ ........ ........ 9% 200M 2s
21504K ........ ........ ........ ........ ........ ........ 10% 213M 2s
24576K ........ ........ ........ ........ ........ ........ 12% 254M 2s
27648K ........ ........ ........ ........ ........ ........ 13% 262M 1s
30720K ........ ........ ........ ........ ........ ........ 14% 283M 1s
33792K ........ ........ ........ ........ ........ ........ 16% 288M 1s
36864K ........ ........ ........ ........ ........ ........ 17% 289M 1s
39936K ........ ........ ........ ........ ........ ........ 18% 283M 1s
43008K ........ ........ ........ ........ ........ ........ 20% 291M 1s
46080K ........ ........ ........ ........ ........ ........ 21% 361M 1s
49152K ........ ........ ........ ........ ........ ........ 22% 367M 1s
52224K ........ ........ ........ ........ ........ ........ 24% 373M 1s
55296K ........ ........ ........ ........ ........ ........ 25% 357M 1s
58368K ........ ........ ........ ........ ........ ........ 26% 300M 1s
61440K ........ ........ ........ ........ ........ ........ 28% 383M 1s
64512K ........ ........ ........ ........ ........ ........ 29% 495M 1s
67584K ........ ........ ........ ........ ........ ........ 30% 443M 1s
70656K ........ ........ ........ ........ ........ ........ 32% 354M 1s
73728K ........ ........ ........ ........ ........ ........ 33% 355M 1s
76800K ........ ........ ........ ........ ........ ........ 34% 360M 1s
79872K ........ ........ ........ ........ ........ ........ 36% 365M 1s
82944K ........ ........ ........ ........ ........ ........ 37% 359M 1s
86016K ........ ........ ........ ........ ........ ........ 38% 346M 1s
89088K ........ ........ ........ ........ ........ ........ 40% 244M 1s
92160K ........ ........ ........ ........ ........ ........ 41% 488M 1s
95232K ........ ........ ........ ........ ........ ........ 42% 455M 1s
98304K ........ ........ ........ ........ ........ ........ 44% 353M 1s
101376K ........ ........ ........ ........ ........ ........ 45% 335M 1s
104448K ........ ........ ........ ........ ........ ........ 47% 358M 0s
107520K ........ ........ ........ ........ ........ ........ 48% 345M 0s
110592K ........ ........ ........ ........ ........ ........ 49% 357M 0s
113664K ........ ........ ........ ........ ........ ........ 51% 351M 0s
116736K ........ ........ ........ ........ ........ ........ 52% 358M 0s
119808K ........ ........ ........ ........ ........ ........ 53% 348M 0s
122880K ........ ........ ........ ........ ........ ........ 55% 350M 0s
125952K ........ ........ ........ ........ ........ ........ 56% 354M 0s
129024K ........ ........ ........ ........ ........ ........ 57% 354M 0s
132096K ........ ........ ........ ........ ........ ........ 59% 297M 0s
135168K ........ ........ ........ ........ ........ ........ 60% 274M 0s
138240K ........ ........ ........ ........ ........ ........ 61% 389M 0s
141312K ........ ........ ........ ........ ........ ........ 63% 360M 0s
144384K ........ ........ ........ ........ ........ ........ 64% 348M 0s
147456K ........ ........ ........ ........ ........ ........ 65% 368M 0s
150528K ........ ........ ........ ........ ........ ........ 67% 371M 0s
153600K ........ ........ ........ ........ ........ ........ 68% 374M 0s
156672K ........ ........ ........ ........ ........ ........ 69% 301M 0s
159744K ........ ........ ........ ........ ........ ........ 71% 353M 0s
162816K ........ ........ ........ ........ ........ ........ 72% 342M 0s
165888K ........ ........ ........ ........ ........ ........ 73% 325M 0s
168960K ........ ........ ........ ........ ........ ........ 75% 318M 0s
172032K ........ ........ ........ ........ ........ ........ 76% 291M 0s
175104K ........ ........ ........ ........ ........ ........ 77% 293M 0s
178176K ........ ........ ........ ........ ........ ........ 79% 285M 0s
181248K ........ ........ ........ ........ ........ ........ 80% 300M 0s
184320K ........ ........ ........ ........ ........ ........ 81% 293M 0s
187392K ........ ........ ........ ........ ........ ........ 83% 282M 0s
190464K ........ ........ ........ ........ ........ ........ 84% 301M 0s
193536K ........ ........ ........ ........ ........ ........ 85% 300M 0s
196608K ........ ........ ........ ........ ........ ........ 87% 297M 0s
199680K ........ ........ ........ ........ ........ ........ 88% 289M 0s
202752K ........ ........ ........ ........ ........ ........ 89% 281M 0s
205824K ........ ........ ........ ........ ........ ........ 91% 292M 0s
208896K ........ ........ ........ ........ ........ ........ 92% 283M 0s
211968K ........ ........ ........ ........ ........ ........ 94% 274M 0s
215040K ........ ........ ........ ........ ........ ........ 95% 297M 0s
218112K ........ ........ ........ ........ ........ ........ 96% 289M 0s
221184K ........ ........ ........ ........ ........ ........ 98% 289M 0s
224256K ........ ........ ........ ........ ........ ........ 99% 295M 0s
227328K ........ ........ ...... 100% 307M=0.8s
2025-03-01 23:44:49 (274 MB/s) - ‘karaf-0.20.4-20250301.204651-414.zip’ saved [234245363/234245363]
Extracting the new controller...
+ echo 'Extracting the new controller...'
+ unzip -q karaf-0.20.4-20250301.204651-414.zip
Adding external repositories...
+ echo 'Adding external repositories...'
+ sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
+ cat /tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
################################################################################
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
################################################################################
#
# If set to true, the following property will not allow any certificate to be used
# when accessing Maven repositories through SSL
#
#org.ops4j.pax.url.mvn.certificateCheck=
#
# Path to the local Maven settings file.
# The repositories defined in this file will be automatically added to the list
# of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property
# below is not set.
# The following locations are checked for the existence of the settings.xml file
# * 1. looks for the specified url
# * 2. if not found looks for ${user.home}/.m2/settings.xml
# * 3. if not found looks for ${maven.home}/conf/settings.xml
# * 4. if not found looks for ${M2_HOME}/conf/settings.xml
#
#org.ops4j.pax.url.mvn.settings=
#
# Path to the local Maven repository which is used to avoid downloading
# artifacts when they already exist locally.
# The value of this property will be extracted from the settings.xml file
# above, or defaulted to:
# System.getProperty( "user.home" ) + "/.m2/repository"
#
org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository}
#
# Default this to false. It's just weird to use undocumented repos
#
org.ops4j.pax.url.mvn.useFallbackRepositories=false
#
# Uncomment if you don't wanna use the proxy settings
# from the Maven conf/settings.xml file
#
# org.ops4j.pax.url.mvn.proxySupport=false
#
# Comma separated list of repositories scanned when resolving an artifact.
# Those repositories will be checked before iterating through the
# below list of repositories and even before the local repository
# A repository url can be appended with zero or more of the following flags:
# @snapshots : the repository contains snaphots
# @noreleases : the repository does not contain any released artifacts
#
# The following property value will add the system folder as a repo.
#
org.ops4j.pax.url.mvn.defaultRepositories=\
file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\
file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\
file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots
# Use the default local repo (e.g.~/.m2/repository) as a "remote" repo
#org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false
#
# Comma separated list of repositories scanned when resolving an artifact.
# The default list includes the following repositories:
# http://repo1.maven.org/maven2@id=central
# http://repository.springsource.com/maven/bundles/release@id=spring.ebr
# http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external
# http://zodiac.springsource.com/maven/bundles/release@id=gemini
# http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases
# https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases
# https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
# To add repositories to the default ones, prepend '+' to the list of repositories
# to add.
# A repository url can be appended with zero or more of the following flags:
# @snapshots : the repository contains snapshots
# @noreleases : the repository does not contain any released artifacts
# @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended
#
org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.Configuring the startup features...
+ [[ True == \T\r\u\e ]]
+ echo 'Configuring the startup features...'
+ sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.20.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
+ FEATURE_TEST_STRING=features-test
+ FEATURE_TEST_VERSION=0.20.4-SNAPSHOT
+ KARAF_VERSION=karaf4
+ [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]]
+ sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.20.4-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.20.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
+ [[ ! -z '' ]]
+ cat /tmp/karaf-0.20.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
################################################################################
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
################################################################################
#
# Comma separated list of features repositories to register by default
#
featuresRepositories = mvn:org.opendaylight.integration/features-test/0.20.4-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/39904793-f28b-4085-a132-db8f47856b9e.xml
#
# Comma separated list of features to install at startup
#
featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, b93e9f3c-62cf-4eaa-a1e4-9401e68ebe32
#
# Resource repositories (OBR) that the features resolver can use
# to resolve requirements/capabilities
#
# The format of the resourceRepositories is
# resourceRepositories=[xml:url|json:url],...
# for Instance:
#
#resourceRepositories=xml:http://host/path/to/index.xml
# or
#resourceRepositories=json:http://host/path/to/index.json
#
#
# Defines if the boot features are started in asynchronous mode (in a dedicated thread)
#
featuresBootAsynchronous=false
#
# Service requirements enforcement
#
# By default, the feature resolver checks the service requirements/capabilities of
# bundles for new features (xml schema >= 1.3.0) in order to automatically installs
# the required bundles.
# The following flag can have those values:
# - disable: service requirements are completely ignored
# - default: service requirements are ignored for old features
# - enforce: service requirements are always verified
#
#serviceRequirements=default
#
# Store cfg file for config element in feature
#
#configCfgStore=true
#
# Define if the feature service automatically refresh bundles
#
autoRefresh=true
#
# Configuration of features processing mechanism (overrides, blacklisting, modification of features)
# XML file defines instructions related to features processing
# versions.properties may declare properties to resolve placeholders in XML file
# both files are relative to ${karaf.etc}
#
#featureProcessing=org.apache.karaf.features.xml
#featureProcessingVersions=versions.properties
+ configure_karaf_log karaf4 ''
+ local -r karaf_version=karaf4
+ local -r controllerdebugmap=
+ local logapi=log4j
+ grep log4j2 /tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
log4j2.rootLogger.level = INFO
#log4j2.rootLogger.type = asyncRoot
#log4j2.rootLogger.includeLocation = false
log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
log4j2.rootLogger.appenderRef.Console.ref = Console
log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
log4j2.logger.spifly.name = org.apache.aries.spifly
log4j2.logger.spifly.level = WARN
log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
log4j2.logger.audit.level = INFO
log4j2.logger.audit.additivity = false
log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
# Console appender not used by default (see log4j2.rootLogger.appenderRefs)
log4j2.appender.console.type = Console
log4j2.appender.console.name = Console
log4j2.appender.console.layout.type = PatternLayout
log4j2.appender.console.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.type = RollingRandomAccessFile
log4j2.appender.rolling.name = RollingFile
log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
#log4j2.appender.rolling.immediateFlush = false
log4j2.appender.rolling.append = true
log4j2.appender.rolling.layout.type = PatternLayout
log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.policies.type = Policies
log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.rolling.policies.size.size = 64MB
log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
log4j2.appender.rolling.strategy.max = 7
log4j2.appender.audit.type = RollingRandomAccessFile
log4j2.appender.audit.name = AuditRollingFile
log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
log4j2.appender.audit.append = true
log4j2.appender.audit.layout.type = PatternLayout
log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
log4j2.appender.audit.policies.type = Policies
log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.audit.policies.size.size = 8MB
log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
log4j2.appender.audit.strategy.max = 7
log4j2.appender.osgi.type = PaxOsgi
log4j2.appender.osgi.name = PaxOsgi
log4j2.appender.osgi.filter = *
#log4j2.logger.aether.name = shaded.org.eclipse.aether
#log4j2.logger.aether.level = TRACE
#log4j2.logger.http-headers.name = shaded.org.apache.http.headers
#log4j2.logger.http-headers.level = DEBUG
#log4j2.logger.maven.name = org.ops4j.pax.url.mvn
#log4j2.logger.maven.level = TRACE
Configuring the karaf log... karaf_version: karaf4, logapi: log4j2
+ logapi=log4j2
+ echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2'
+ '[' log4j2 == log4j2 ']'
+ sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
controllerdebugmap:
cat /tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
+ orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver
+ orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver
+ echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN'
+ echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN'
+ unset IFS
+ echo 'controllerdebugmap: '
+ '[' -n '' ']'
+ echo 'cat /tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg'
+ cat /tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
################################################################################
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
################################################################################
# Common pattern layout for appenders
log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
# Root logger
log4j2.rootLogger.level = INFO
# uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library
#log4j2.rootLogger.type = asyncRoot
#log4j2.rootLogger.includeLocation = false
log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
log4j2.rootLogger.appenderRef.Console.ref = Console
log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
# Filters for logs marked by org.opendaylight.odlparent.Markers
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
# Loggers configuration
# Spifly logger
log4j2.logger.spifly.name = org.apache.aries.spifly
log4j2.logger.spifly.level = WARN
# Security audit logger
log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
log4j2.logger.audit.level = INFO
log4j2.logger.audit.additivity = false
log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
# Appenders configuration
# Console appender not used by default (see log4j2.rootLogger.appenderRefs)
log4j2.appender.console.type = Console
log4j2.appender.console.name = Console
log4j2.appender.console.layout.type = PatternLayout
log4j2.appender.console.layout.pattern = ${log4j2.pattern}
# Rolling file appender
log4j2.appender.rolling.type = RollingRandomAccessFile
log4j2.appender.rolling.name = RollingFile
log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
# uncomment to not force a disk flush
#log4j2.appender.rolling.immediateFlush = false
log4j2.appender.rolling.append = true
log4j2.appender.rolling.layout.type = PatternLayout
log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.policies.type = Policies
log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.rolling.policies.size.size = 1GB
log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
log4j2.appender.rolling.strategy.max = 7
# Audit file appender
log4j2.appender.audit.type = RollingRandomAccessFile
log4j2.appender.audit.name = AuditRollingFile
log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
log4j2.appender.audit.append = true
log4j2.appender.audit.layout.type = PatternLayout
log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
log4j2.appender.audit.policies.type = Policies
log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.audit.policies.size.size = 8MB
log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
log4j2.appender.audit.strategy.max = 7
# OSGi appender
log4j2.appender.osgi.type = PaxOsgi
log4j2.appender.osgi.name = PaxOsgi
log4j2.appender.osgi.filter = *
# help with identification of maven-related problems with pax-url-aether
#log4j2.logger.aether.name = shaded.org.eclipse.aether
#log4j2.logger.aether.level = TRACE
#log4j2.logger.http-headers.name = shaded.org.apache.http.headers
#log4j2.logger.http-headers.level = DEBUG
#log4j2.logger.maven.name = org.ops4j.pax.url.mvn
#log4j2.logger.maven.level = TRACE
log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN
log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN
Configure
java home: /usr/lib/jvm/java-17-openjdk-amd64
max memory: 3072m
memconf: /tmp/karaf-0.20.4-SNAPSHOT/bin/setenv
+ set_java_vars /usr/lib/jvm/java-17-openjdk-amd64 3072m /tmp/karaf-0.20.4-SNAPSHOT/bin/setenv
+ local -r java_home=/usr/lib/jvm/java-17-openjdk-amd64
+ local -r controllermem=3072m
+ local -r memconf=/tmp/karaf-0.20.4-SNAPSHOT/bin/setenv
+ echo Configure
+ echo ' java home: /usr/lib/jvm/java-17-openjdk-amd64'
+ echo ' max memory: 3072m'
+ echo ' memconf: /tmp/karaf-0.20.4-SNAPSHOT/bin/setenv'
+ sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk-amd64}%g' /tmp/karaf-0.20.4-SNAPSHOT/bin/setenv
+ sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.20.4-SNAPSHOT/bin/setenv
cat /tmp/karaf-0.20.4-SNAPSHOT/bin/setenv
+ echo 'cat /tmp/karaf-0.20.4-SNAPSHOT/bin/setenv'
+ cat /tmp/karaf-0.20.4-SNAPSHOT/bin/setenv
#!/bin/sh
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
#
# handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf
# script: client, instance, shell, start, status, stop, karaf
#
# if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then
# Actions go here...
# fi
#
# general settings which should be applied for all scripts go here; please keep
# in mind that it is possible that scripts might be executed more than once, e.g.
# in example of the start script where the start script is executed first and the
# karaf script afterwards.
#
#
# The following section shows the possible configuration options for the default
# karaf scripts
#
export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk-amd64} # Location of Java installation
# export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration
# export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options
# export EXTRA_JAVA_OPTS # Additional JVM options
# export KARAF_HOME # Karaf home folder
# export KARAF_DATA # Karaf data folder
# export KARAF_BASE # Karaf base folder
# export KARAF_ETC # Karaf etc folder
# export KARAF_LOG # Karaf log folder
# export KARAF_SYSTEM_OPTS # First citizen Karaf options
# export KARAF_OPTS # Additional available Karaf options
# export KARAF_DEBUG # Enable debug mode
# export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start
# export KARAF_NOROOT # Prevent execution as root if set to true
Set Java version
+ echo 'Set Java version'
+ sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-17-openjdk-amd64/bin/java 1
sudo: /usr/sbin/alternatives: command not found
+ sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-17-openjdk-amd64/bin/java
sudo: /usr/sbin/alternatives: command not found
JDK default version ...
+ echo 'JDK default version ...'
+ java -version
openjdk version "11.0.25" 2024-10-15
OpenJDK Runtime Environment (build 11.0.25+9-post-Ubuntu-1ubuntu120.04)
OpenJDK 64-Bit Server VM (build 11.0.25+9-post-Ubuntu-1ubuntu120.04, mixed mode, sharing)
Set JAVA_HOME
+ echo 'Set JAVA_HOME'
+ export JAVA_HOME=/usr/lib/jvm/java-17-openjdk-amd64
+ JAVA_HOME=/usr/lib/jvm/java-17-openjdk-amd64
++ readlink -e /usr/lib/jvm/java-17-openjdk-amd64/bin/java
Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-amd64/bin/java
Listing all open ports on controller system...
+ JAVA_RESOLVED=/usr/lib/jvm/java-17-openjdk-amd64/bin/java
+ echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-amd64/bin/java'
+ echo 'Listing all open ports on controller system...'
+ netstat -pnatu
/tmp/configuration-script.sh: line 40: netstat: command not found
Custom shard config exists!!!
Copying the shard config...
+ '[' -f /tmp/custom_shard_config.txt ']'
+ echo 'Custom shard config exists!!!'
+ echo 'Copying the shard config...'
+ cp /tmp/custom_shard_config.txt /tmp/karaf-0.20.4-SNAPSHOT/bin/
Configuring cluster
+ echo 'Configuring cluster'
+ /tmp/karaf-0.20.4-SNAPSHOT/bin/configure_cluster.sh 3 10.30.170.151 10.30.170.8 10.30.170.204
################################################
## Configure Cluster ##
################################################
NOTE: Cluster configuration files not found. Copying from
/tmp/karaf-0.20.4-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/9.0.6
Configuring unique name in akka.conf
Configuring hostname in akka.conf
Configuring data and rpc seed nodes in akka.conf
modules = [
{
name = "inventory"
namespace = "urn:opendaylight:inventory"
shard-strategy = "module"
},
{
name = "topology"
namespace = "urn:TBD:params:xml:ns:yang:network-topology"
shard-strategy = "module"
},
{
name = "toaster"
namespace = "http://netconfcentral.org/ns/toaster"
shard-strategy = "module"
},
{
name = "car"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
shard-strategy = "module"
},
{
name = "people"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
shard-strategy = "module"
},
{
name = "car-people"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
shard-strategy = "module"
}
]
Configuring replication type in module-shards.conf
################################################
## NOTE: Manually restart controller to ##
## apply configuration. ##
################################################
Dump akka.conf
+ echo 'Dump akka.conf'
+ cat /tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/akka.conf
odl-cluster-data {
akka {
remote {
artery {
enabled = on
transport = tcp
canonical.hostname = "10.30.170.204"
canonical.port = 2550
}
}
cluster {
# Using artery.
seed-nodes = ["akka://opendaylight-cluster-data@10.30.170.151:2550",
"akka://opendaylight-cluster-data@10.30.170.8:2550",
"akka://opendaylight-cluster-data@10.30.170.204:2550"]
roles = ["member-3"]
# when under load we might trip a false positive on the failure detector
# failure-detector {
# heartbeat-interval = 4 s
# acceptable-heartbeat-pause = 16s
# }
}
persistence {
# By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by
# modifying the following two properties. The directory location specified may be a relative or absolute path.
# The relative path is always relative to KARAF_HOME.
# snapshot-store.local.dir = "target/snapshots"
# Use lz4 compression for LocalSnapshotStore snapshots
snapshot-store.local.use-lz4-compression = false
# Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB
snapshot-store.local.lz4-blocksize = 256KB
}
disable-default-actor-system-quarantined-event-handling = "false"
}
}
Dump modules.conf
+ echo 'Dump modules.conf'
+ cat /tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/modules.conf
modules = [
{
name = "inventory"
namespace = "urn:opendaylight:inventory"
shard-strategy = "module"
},
{
name = "topology"
namespace = "urn:TBD:params:xml:ns:yang:network-topology"
shard-strategy = "module"
},
{
name = "toaster"
namespace = "http://netconfcentral.org/ns/toaster"
shard-strategy = "module"
},
{
name = "car"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car"
shard-strategy = "module"
},
{
name = "people"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people"
shard-strategy = "module"
},
{
name = "car-people"
namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people"
shard-strategy = "module"
}
]
Dump module-shards.conf
+ echo 'Dump module-shards.conf'
+ cat /tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/module-shards.conf
module-shards = [
{
name = "default"
shards = [
{
name = "default"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "inventory"
shards = [
{
name="inventory"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "topology"
shards = [
{
name="topology"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "toaster"
shards = [
{
name="toaster"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "car"
shards = [
{
name="car"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "people"
shards = [
{
name="people"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
},
{
name = "car-people"
shards = [
{
name="car-people"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
}
]
Locating config plan to use...
Finished running config plans
Starting member-1 with IP address 10.30.170.151
Warning: Permanently added '10.30.170.151' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.170.151' (ECDSA) to the list of known hosts.
Redirecting karaf console output to karaf_console.log
Starting controller...
start: Redirecting Karaf output to /tmp/karaf-0.20.4-SNAPSHOT/data/log/karaf_console.log
Starting member-2 with IP address 10.30.170.8
Warning: Permanently added '10.30.170.8' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.170.8' (ECDSA) to the list of known hosts.
Redirecting karaf console output to karaf_console.log
Starting controller...
start: Redirecting Karaf output to /tmp/karaf-0.20.4-SNAPSHOT/data/log/karaf_console.log
Starting member-3 with IP address 10.30.170.204
Warning: Permanently added '10.30.170.204' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.30.170.204' (ECDSA) to the list of known hosts.
Redirecting karaf console output to karaf_console.log
Starting controller...
start: Redirecting Karaf output to /tmp/karaf-0.20.4-SNAPSHOT/data/log/karaf_console.log
[controller-csit-3node-clustering-tell-all-calcium] $ /bin/bash /tmp/jenkins6190203318480996677.sh
common-functions.sh is being sourced
common-functions environment:
MAVENCONF: /tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
ACTUALFEATURES:
FEATURESCONF: /tmp/karaf-0.20.4-SNAPSHOT/etc/org.apache.karaf.features.cfg
CUSTOMPROP: /tmp/karaf-0.20.4-SNAPSHOT/etc/custom.properties
LOGCONF: /tmp/karaf-0.20.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
MEMCONF: /tmp/karaf-0.20.4-SNAPSHOT/bin/setenv
CONTROLLERMEM: 2048m
AKKACONF: /tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/akka.conf
MODULESCONF: /tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/modules.conf
MODULESHARDSCONF: /tmp/karaf-0.20.4-SNAPSHOT/configuration/initial/module-shards.conf
SUITES:
+ echo '#################################################'
#################################################
+ echo '## Verify Cluster is UP ##'
## Verify Cluster is UP ##
+ echo '#################################################'
#################################################
+ create_post_startup_script
+ cat
+ copy_and_run_post_startup_script
+ seed_index=1
++ seq 1 3
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_1_IP
+ echo 'Execute the post startup script on controller 10.30.170.151'
Execute the post startup script on controller 10.30.170.151
+ scp /w/workspace/controller-csit-3node-clustering-tell-all-calcium/post-startup-script.sh 10.30.170.151:/tmp/
Warning: Permanently added '10.30.170.151' (ECDSA) to the list of known hosts.
+ ssh 10.30.170.151 'bash /tmp/post-startup-script.sh 1'
Warning: Permanently added '10.30.170.151' (ECDSA) to the list of known hosts.
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
Waiting up to 3 minutes for controller to come up, checking every 5 seconds...
2025-03-01T23:45:46,009 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 297 - org.opendaylight.infrautils.ready-api - 6.0.11 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
Controller is UP
2025-03-01T23:45:46,009 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 297 - org.opendaylight.infrautils.ready-api - 6.0.11 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
Listing all open ports on controller system...
/tmp/post-startup-script.sh: line 51: netstat: command not found
looking for "BindException: Address already in use" in log file
looking for "server is unhealthy" in log file
+ '[' 1 == 0 ']'
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_2_IP
+ echo 'Execute the post startup script on controller 10.30.170.8'
Execute the post startup script on controller 10.30.170.8
+ scp /w/workspace/controller-csit-3node-clustering-tell-all-calcium/post-startup-script.sh 10.30.170.8:/tmp/
Warning: Permanently added '10.30.170.8' (ECDSA) to the list of known hosts.
+ ssh 10.30.170.8 'bash /tmp/post-startup-script.sh 2'
Warning: Permanently added '10.30.170.8' (ECDSA) to the list of known hosts.
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
Waiting up to 3 minutes for controller to come up, checking every 5 seconds...
2025-03-01T23:45:45,407 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 297 - org.opendaylight.infrautils.ready-api - 6.0.11 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
Controller is UP
2025-03-01T23:45:45,407 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 297 - org.opendaylight.infrautils.ready-api - 6.0.11 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
Listing all open ports on controller system...
/tmp/post-startup-script.sh: line 51: netstat: command not found
looking for "BindException: Address already in use" in log file
looking for "server is unhealthy" in log file
+ '[' 2 == 0 ']'
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_3_IP
+ echo 'Execute the post startup script on controller 10.30.170.204'
Execute the post startup script on controller 10.30.170.204
+ scp /w/workspace/controller-csit-3node-clustering-tell-all-calcium/post-startup-script.sh 10.30.170.204:/tmp/
Warning: Permanently added '10.30.170.204' (ECDSA) to the list of known hosts.
+ ssh 10.30.170.204 'bash /tmp/post-startup-script.sh 3'
Warning: Permanently added '10.30.170.204' (ECDSA) to the list of known hosts.
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
Waiting up to 3 minutes for controller to come up, checking every 5 seconds...
2025-03-01T23:45:44,951 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 297 - org.opendaylight.infrautils.ready-api - 6.0.11 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
Controller is UP
2025-03-01T23:45:44,951 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 297 - org.opendaylight.infrautils.ready-api - 6.0.11 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
Listing all open ports on controller system...
/tmp/post-startup-script.sh: line 51: netstat: command not found
looking for "BindException: Address already in use" in log file
looking for "server is unhealthy" in log file
+ '[' 0 == 0 ']'
+ seed_index=1
+ dump_controller_threads
++ seq 1 3
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_1_IP
+ echo 'Let'\''s take the karaf thread dump'
Let's take the karaf thread dump
+ ssh 10.30.170.151 'sudo ps aux'
Warning: Permanently added '10.30.170.151' (ECDSA) to the list of known hosts.
++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-calcium/ps_before.log
++ grep -v grep
++ tr -s ' '
++ cut -f2 '-d '
+ pid=28758
+ echo 'karaf main: org.apache.karaf.main.Main, pid:28758'
karaf main: org.apache.karaf.main.Main, pid:28758
+ ssh 10.30.170.151 '/usr/lib/jvm/java-17-openjdk-amd64/bin/jstack -l 28758'
Warning: Permanently added '10.30.170.151' (ECDSA) to the list of known hosts.
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_2_IP
+ echo 'Let'\''s take the karaf thread dump'
Let's take the karaf thread dump
+ ssh 10.30.170.8 'sudo ps aux'
Warning: Permanently added '10.30.170.8' (ECDSA) to the list of known hosts.
++ tr -s ' '
++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-calcium/ps_before.log
++ grep -v grep
++ cut -f2 '-d '
+ pid=28781
+ echo 'karaf main: org.apache.karaf.main.Main, pid:28781'
karaf main: org.apache.karaf.main.Main, pid:28781
+ ssh 10.30.170.8 '/usr/lib/jvm/java-17-openjdk-amd64/bin/jstack -l 28781'
Warning: Permanently added '10.30.170.8' (ECDSA) to the list of known hosts.
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_3_IP
+ echo 'Let'\''s take the karaf thread dump'
Let's take the karaf thread dump
+ ssh 10.30.170.204 'sudo ps aux'
Warning: Permanently added '10.30.170.204' (ECDSA) to the list of known hosts.
++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-calcium/ps_before.log
++ grep -v grep
++ tr -s ' '
++ cut -f2 '-d '
+ pid=28761
+ echo 'karaf main: org.apache.karaf.main.Main, pid:28761'
karaf main: org.apache.karaf.main.Main, pid:28761
+ ssh 10.30.170.204 '/usr/lib/jvm/java-17-openjdk-amd64/bin/jstack -l 28761'
Warning: Permanently added '10.30.170.204' (ECDSA) to the list of known hosts.
+ '[' 0 -gt 0 ']'
+ echo 'Generating controller variables...'
Generating controller variables...
++ seq 1 3
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_1_IP
+ odl_variables=' -v ODL_SYSTEM_1_IP:10.30.170.151'
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_2_IP
+ odl_variables=' -v ODL_SYSTEM_1_IP:10.30.170.151 -v ODL_SYSTEM_2_IP:10.30.170.8'
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_3_IP
+ odl_variables=' -v ODL_SYSTEM_1_IP:10.30.170.151 -v ODL_SYSTEM_2_IP:10.30.170.8 -v ODL_SYSTEM_3_IP:10.30.170.204'
+ echo 'Generating mininet variables...'
Generating mininet variables...
++ seq 1 0
+ get_test_suites SUITES
+ local __suite_list=SUITES
+ echo 'Locating test plan to use...'
Locating test plan to use...
+ testplan_filepath=/w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/testplans/controller-clustering-tell-calcium.txt
+ '[' '!' -f /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/testplans/controller-clustering-tell-calcium.txt ']'
+ testplan_filepath=/w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/testplans/controller-clustering-tell.txt
+ '[' disabled '!=' disabled ']'
+ echo 'Changing the testplan path...'
Changing the testplan path...
+ sed s:integration:/w/workspace/controller-csit-3node-clustering-tell-all-calcium: /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/testplans/controller-clustering-tell.txt
+ cat testplan.txt
# Place the suites in run order:
# disabling all "prefix based" suites. This functionality was newly
# introduced with these tests in 2017. The assumption is that
# development stopped in that area, but may continue at a later
# time. Still, the tests are failing and no resources to solve the
# failures at this time. If/When this changes, we can uncomment
# those suites. Note that every suite is commented out with it's
# accompanying "restart_with_tell_based_true" setup suite.
# /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/ddb-sanity-prefix-based.robot
/w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
/w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot
/w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
/w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown_prefbasedshard.robot
/w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
/w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement_prefbasedshard.robot
/w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
/w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/leader_isolation_prefbasedshard.robot
/w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
/w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/client_isolation.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/client_isolation_prefbasedshard.robot
/w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
/w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/listener_stability.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
# /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/listener_stability_prefbasedshard.robot
/w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
/w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/cluster_singleton/master_stability.robot
/w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
/w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot
/w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
/w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot
/w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
/w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot
/w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot
/w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot
/w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot
/w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot
/w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot
/w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot
/w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot
+ '[' -z '' ']'
++ grep -E -v '(^[[:space:]]*#|^[[:space:]]*$)' testplan.txt
++ tr '\012' ' '
+ suite_list='/w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot '
+ eval 'SUITES='\''/w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot '\'''
++ SUITES='/w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot '
+ echo 'Starting Robot test suites /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot ...'
Starting Robot test suites /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot ...
+ robot -N controller-clustering-tell.txt --removekeywords wuks -e exclude -e skip_if_calcium -v BUNDLEFOLDER:karaf-0.20.4-SNAPSHOT -v BUNDLE_URL:https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.4-SNAPSHOT/karaf-0.20.4-20250301.204651-414.zip -v CONTROLLER:10.30.170.151 -v CONTROLLER1:10.30.170.8 -v CONTROLLER2:10.30.170.204 -v CONTROLLER_USER:jenkins -v JAVA_HOME:/usr/lib/jvm/java-17-openjdk-amd64 -v JDKVERSION:openjdk17 -v JENKINS_WORKSPACE:/w/workspace/controller-csit-3node-clustering-tell-all-calcium -v MININET: -v MININET1: -v MININET2: -v MININET_USER:jenkins -v NEXUSURL_PREFIX:https://nexus.opendaylight.org -v NUM_ODL_SYSTEM:3 -v NUM_TOOLS_SYSTEM:0 -v ODL_STREAM:calcium -v ODL_SYSTEM_IP:10.30.170.151 -v ODL_SYSTEM_1_IP:10.30.170.151 -v ODL_SYSTEM_2_IP:10.30.170.8 -v ODL_SYSTEM_3_IP:10.30.170.204 -v ODL_SYSTEM_USER:jenkins -v TOOLS_SYSTEM_IP: -v TOOLS_SYSTEM_USER:jenkins -v USER_HOME:/home/jenkins -v IS_KARAF_APPL:True -v WORKSPACE:/tmp /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot
==============================================================================
controller-clustering-tell.txt
==============================================================================
controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
==============================================================================
Stop_All_Members :: Stop every odl node. | PASS |
------------------------------------------------------------------------------
Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync. | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ConnectionError: HTTPConnectionPool(host='10.30.170.204', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f07eeeeebd0>: Failed to establish a new connection: [Errno 111] Connection refused'))
------------------------------------------------------------------------------
controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
3 tests, 2 passed, 1 failed
==============================================================================
controller-clustering-tell.txt.Ddb-Sanity-Module-Based :: DOMDataBroker tes...
==============================================================================
Get_Shard_Role :: Get shard role. | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_ddb_sanity_module_based_get_shard_role"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_get_shard_role&order=bug_status"
HTTPError: 404 Client Error: Not Found for url: http://10.30.170.151:8181/restconf/operations/cluster-admin:get-shard-role
------------------------------------------------------------------------------
Subscribe_Listener_To_Leader :: Subscribe listener to leader. | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_ddb_sanity_module_based_subscribe_listener_to_leader"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_subscribe_listener_to_leader&order=bug_status"
ConnectionError: HTTPConnectionPool(host='10.30.170.204', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-3-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f07eeb2ea10>: Failed to establish a new connection: [Errno 111] Connection refused'))
------------------------------------------------------------------------------
Subscribe_Listener_To_Follower :: Subscribe listener to follower. | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_ddb_sanity_module_based_subscribe_listener_to_follower"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_subscribe_listener_to_follower&order=bug_status"
ConnectionError: HTTPConnectionPool(host='10.30.170.204', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-3-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f07eebb4ad0>: Failed to establish a new connection: [Errno 111] Connection refused'))
------------------------------------------------------------------------------
Make_Leader_Local :: Make the loeader local and verify. | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_ddb_sanity_module_based_make_leader_local"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_make_leader_local&order=bug_status"
ConnectionError: HTTPConnectionPool(host='10.30.170.204', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-3-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f07eedcf010>: Failed to establish a new connection: [Errno 111] Connection refused'))
------------------------------------------------------------------------------
Remove_Leader_Shard_Replica_And_Add_It_Back :: Remove and add shar... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_ddb_sanity_module_based_remove_leader_shard_replica_and_add_it_back"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_remove_leader_shard_replica_and_add_it_back&order=bug_status"
ConnectionError: HTTPConnectionPool(host='10.30.170.204', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-3-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f07f4180810>: Failed to establish a new connection: [Errno 111] Connection refused'))
------------------------------------------------------------------------------
Remove_Follower_Shard_Replica_And_Add_It_Back :: Remove and add sh... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_ddb_sanity_module_based_remove_follower_shard_replica_and_add_it_back"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_remove_follower_shard_replica_and_add_it_back&order=bug_status"
ConnectionError: HTTPConnectionPool(host='10.30.170.204', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-3-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f07eed234d0>: Failed to establish a new connection: [Errno 111] Connection refused'))
------------------------------------------------------------------------------
Write_Transactions_One_Node_Leader :: Write transactions. | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_one_node_leader"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_one_node_leader&order=bug_status"
ConnectionError: HTTPConnectionPool(host='10.30.170.204', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-3-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f07edf82350>: Failed to establish a new connection: [Errno 111] Connection refused'))
------------------------------------------------------------------------------
Write_Transactions_One_Node_Follower :: Write transactions. | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_one_node_follower"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_one_node_follower&order=bug_status"
ConnectionError: HTTPConnectionPool(host='10.30.170.204', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-3-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f07eee36ed0>: Failed to establish a new connection: [Errno 111] Connection refused'))
------------------------------------------------------------------------------
Write_Transactions_All_Nodes :: Write transactions. | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_all_nodes"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_all_nodes&order=bug_status"
Resolving variable '${response.text}' failed: AttributeError: 'ConnectionError' object has no attribute 'text'
------------------------------------------------------------------------------
controller-clustering-tell.txt.Ddb-Sanity-Module-Based :: DOMDataB... | FAIL |
9 tests, 0 passed, 9 failed
==============================================================================
controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
==============================================================================
Stop_All_Members :: Stop every odl node. | PASS |
------------------------------------------------------------------------------
Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync. | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ConnectionError: HTTPConnectionPool(host='10.30.170.204', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f07eeb50210>: Failed to establish a new connection: [Errno 111] Connection refused'))
------------------------------------------------------------------------------
controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
3 tests, 2 passed, 1 failed
==============================================================================
controller-clustering-tell.txt.Clean Leader Shutdown :: DOMDataBroker testi...
==============================================================================
Local_Leader_Shutdown :: Shutdown the leader on the same node as t... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_clean_leader_shutdown_local_leader_shutdown"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_clean_leader_shutdown_local_leader_shutdown&order=bug_status"
ConnectionError: HTTPConnectionPool(host='10.30.170.204', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-3-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f07f40b1850>: Failed to establish a new connection: [Errno 111] Connection refused'))
------------------------------------------------------------------------------
Restart :: Restart odl | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_clean_leader_shutdown_restart"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_clean_leader_shutdown_restart&order=bug_status"
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Remote_Leader_Shutdown :: Shutdown the leader on different node as... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_clean_leader_shutdown_remote_leader_shutdown"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_clean_leader_shutdown_remote_leader_shutdown&order=bug_status"
ConnectionError: HTTPConnectionPool(host='10.30.170.151', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f07eeb39a10>: Failed to establish a new connection: [Errno 111] Connection refused'))
------------------------------------------------------------------------------
controller-clustering-tell.txt.Clean Leader Shutdown :: DOMDataBro... | FAIL |
3 tests, 0 passed, 3 failed
==============================================================================
controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
==============================================================================
Stop_All_Members :: Stop every odl node. | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync. | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ConnectionError: HTTPConnectionPool(host='10.30.170.204', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f07f533f950>: Failed to establish a new connection: [Errno 111] Connection refused'))
------------------------------------------------------------------------------
controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-tell.txt.Explicit Leader Movement :: DOMDataBroker te...
==============================================================================
Local_To_Remote_Movement :: Leader moves from local to remote node... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_explicit_leader_movement_local_to_remote_movement"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_local_to_remote_movement&order=bug_status"
ConnectionError: HTTPConnectionPool(host='10.30.170.204', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-3-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f07eee6bc90>: Failed to establish a new connection: [Errno 111] Connection refused'))
------------------------------------------------------------------------------
Restart1 :: Restart odl | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_explicit_leader_movement_restart1"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_restart1&order=bug_status"
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Remote_To_Remote_Movement :: Leader moves from one remote to other... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_explicit_leader_movement_remote_to_remote_movement"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_remote_to_remote_movement&order=bug_status"
ConnectionError: HTTPConnectionPool(host='10.30.170.151', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f07eeda5c50>: Failed to establish a new connection: [Errno 111] Connection refused'))
------------------------------------------------------------------------------
Restart2 :: Restart odl | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_explicit_leader_movement_restart2"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_restart2&order=bug_status"
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Remote_To_Local_Movement :: Leader moves from remote to local node... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_explicit_leader_movement_remote_to_local_movement"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_remote_to_local_movement&order=bug_status"
ConnectionError: HTTPConnectionPool(host='10.30.170.151', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f07eed6dad0>: Failed to establish a new connection: [Errno 111] Connection refused'))
------------------------------------------------------------------------------
controller-clustering-tell.txt.Explicit Leader Movement :: DOMData... | FAIL |
5 tests, 0 passed, 5 failed
==============================================================================
controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
==============================================================================
Stop_All_Members :: Stop every odl node. | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync. | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ConnectionError: HTTPConnectionPool(host='10.30.170.204', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f07f4a54850>: Failed to establish a new connection: [Errno 111] Connection refused'))
------------------------------------------------------------------------------
controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-tell.txt.Leader Isolation :: DOMDataBroker testing: L...
==============================================================================
Healing_Within_Request_Timeout :: The isolated node (leader) is re... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_leader_isolation_healing_within_request_timeout"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_leader_isolation_healing_within_request_timeout&order=bug_status"
ConnectionError: HTTPConnectionPool(host='10.30.170.204', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-3-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f07f4a6bdd0>: Failed to establish a new connection: [Errno 111] Connection refused'))
------------------------------------------------------------------------------
Restart :: Restart odl | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_leader_isolation_restart"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_leader_isolation_restart&order=bug_status"
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Healing_After_Request_Timeout :: The isolated node (leader) is rej... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_leader_isolation_healing_after_request_timeout"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_leader_isolation_healing_after_request_timeout&order=bug_status"
ConnectionError: HTTPConnectionPool(host='10.30.170.151', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f07edd7b510>: Failed to establish a new connection: [Errno 111] Connection refused'))
------------------------------------------------------------------------------
controller-clustering-tell.txt.Leader Isolation :: DOMDataBroker t... | FAIL |
3 tests, 0 passed, 3 failed
==============================================================================
controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
==============================================================================
Stop_All_Members :: Stop every odl node. | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync. | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ConnectionError: HTTPConnectionPool(host='10.30.170.204', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f07eec03090>: Failed to establish a new connection: [Errno 111] Connection refused'))
------------------------------------------------------------------------------
controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-tell.txt.Client Isolation :: DOMDataBroker testing: C...
==============================================================================
Producer_On_Shard_Leader_Node_ChainedTx :: Client isolation with p... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_client_isolation_producer_on_shard_leader_node_chainedtx"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_producer_on_shard_leader_node_chainedtx&order=bug_status"
ConnectionError: HTTPConnectionPool(host='10.30.170.204', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-3-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f07edfc0450>: Failed to establish a new connection: [Errno 111] Connection refused'))
Also keyword teardown failed:
Several failures occurred:
1) Variable '${client_node_dst}' not found.
2) Variable '${client_node_dst}' not found.
3) Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 1 minute 10 seconds. The last error was: Several failures occurred:
1) ConnectionError: HTTPConnectionPool(host='10.30.170.204', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-3-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f...
[ Message content over the limit has been removed. ]
65) Resolving variable '${response.text}' failed: AttributeError: 'NoneType' object has no attribute 'text'
66) Evaluating expression "json.loads('''None''')" failed: JSONDecodeError: Expecting value: line 1 column 1 (char 0)
67) TypeError: Expected argument 1 to be a dictionary, got None instead.
68) TypeError: Expected argument 1 to be a dictionary, got None instead.
69) Unrecognized Raft state: None
70) No leader found.
71) Too many Leaders.
72) IndexError: Given index 0 is out of the range 0--1.
4) KeyError: 'threads'
------------------------------------------------------------------------------
Restart1 :: Restart odl | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_client_isolation_restart1"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_restart1&order=bug_status"
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Producer_On_Shard_Leader_Node_SimpleTx :: Client isolation with pr... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_client_isolation_producer_on_shard_leader_node_simpletx"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_producer_on_shard_leader_node_simpletx&order=bug_status"
ConnectionError: HTTPConnectionPool(host='10.30.170.151', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f07ede804d0>: Failed to establish a new connection: [Errno 111] Connection refused'))
Also keyword teardown failed:
Several failures occurred:
1) Variable '${client_node_dst}' not found.
2) Variable '${client_node_dst}' not found.
3) Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 1 minute 10 seconds. The last error was: Several failures occurred:
1) ConnectionError: HTTPConnectionPool(host='10.30.170.151', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f...
[ Message content over the limit has been removed. ]
173) Resolving variable '${response.text}' failed: AttributeError: 'NoneType' object has no attribute 'text'
174) Evaluating expression "json.loads('''None''')" failed: JSONDecodeError: Expecting value: line 1 column 1 (char 0)
175) TypeError: Expected argument 1 to be a dictionary, got None instead.
176) TypeError: Expected argument 1 to be a dictionary, got None instead.
177) Unrecognized Raft state: None
178) No leader found.
179) Too many Leaders.
180) IndexError: Given index 0 is out of the range 0--1.
4) KeyError: 'threads'
------------------------------------------------------------------------------
Restart2 :: Restart odl | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_client_isolation_restart2"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_restart2&order=bug_status"
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Producer_On_Shard_Non_Leader_Node_ChainedTx :: Client isolation wi... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_client_isolation_producer_on_shard_non_leader_node_chainedtx"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_producer_on_shard_non_leader_node_chainedtx&order=bug_status"
ConnectionError: HTTPConnectionPool(host='10.30.170.151', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f07eee35ad0>: Failed to establish a new connection: [Errno 111] Connection refused'))
Also keyword teardown failed:
Several failures occurred:
1) Variable '${client_node_dst}' not found.
2) Variable '${client_node_dst}' not found.
3) Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 1 minute 10 seconds. The last error was: Several failures occurred:
1) ConnectionError: HTTPConnectionPool(host='10.30.170.151', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f...
[ Message content over the limit has been removed. ]
173) Resolving variable '${response.text}' failed: AttributeError: 'NoneType' object has no attribute 'text'
174) Evaluating expression "json.loads('''None''')" failed: JSONDecodeError: Expecting value: line 1 column 1 (char 0)
175) TypeError: Expected argument 1 to be a dictionary, got None instead.
176) TypeError: Expected argument 1 to be a dictionary, got None instead.
177) Unrecognized Raft state: None
178) No leader found.
179) Too many Leaders.
180) IndexError: Given index 0 is out of the range 0--1.
4) KeyError: 'threads'
------------------------------------------------------------------------------
Restart3 :: Restart odl | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_client_isolation_restart3"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_restart3&order=bug_status"
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Producer_On_Shard_Non_Leader_Node_SimpleTx :: Client isolation wit... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_client_isolation_producer_on_shard_non_leader_node_simpletx"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_producer_on_shard_non_leader_node_simpletx&order=bug_status"
ConnectionError: HTTPConnectionPool(host='10.30.170.151', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f07edd163d0>: Failed to establish a new connection: [Errno 111] Connection refused'))
Also keyword teardown failed:
Several failures occurred:
1) Variable '${client_node_dst}' not found.
2) Variable '${client_node_dst}' not found.
3) Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 1 minute 10 seconds. The last error was: Several failures occurred:
1) ConnectionError: HTTPConnectionPool(host='10.30.170.151', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f...
[ Message content over the limit has been removed. ]
173) Resolving variable '${response.text}' failed: AttributeError: 'NoneType' object has no attribute 'text'
174) Evaluating expression "json.loads('''None''')" failed: JSONDecodeError: Expecting value: line 1 column 1 (char 0)
175) TypeError: Expected argument 1 to be a dictionary, got None instead.
176) TypeError: Expected argument 1 to be a dictionary, got None instead.
177) Unrecognized Raft state: None
178) No leader found.
179) Too many Leaders.
180) IndexError: Given index 0 is out of the range 0--1.
4) KeyError: 'threads'
------------------------------------------------------------------------------
controller-clustering-tell.txt.Client Isolation :: DOMDataBroker t... | FAIL |
7 tests, 0 passed, 7 failed
==============================================================================
controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
==============================================================================
Stop_All_Members :: Stop every odl node. | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync. | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ConnectionError: HTTPConnectionPool(host='10.30.170.204', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f07eebec5d0>: Failed to establish a new connection: [Errno 111] Connection refused'))
------------------------------------------------------------------------------
controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-tell.txt.Listener Stability :: DOMDataBroker testing:...
==============================================================================
Move_Leader_From_Listener_Local_To_Remote :: Listener runs on lead... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_listener_stability_move_leader_from_listener_local_to_remote"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_listener_stability_move_leader_from_listener_local_to_remote&order=bug_status"
ConnectionError: HTTPConnectionPool(host='10.30.170.204', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-3-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f07f404c310>: Failed to establish a new connection: [Errno 111] Connection refused'))
------------------------------------------------------------------------------
Restart_1 :: Restart odl. | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_listener_stability_restart_1"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_listener_stability_restart_1&order=bug_status"
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Move_Leader_From_Listener_Remote_To_Other_Remote :: Listener runs ... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_listener_stability_move_leader_from_listener_remote_to_other_remote"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_listener_stability_move_leader_from_listener_remote_to_other_remote&order=bug_status"
ConnectionError: HTTPConnectionPool(host='10.30.170.151', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f07eec74d50>: Failed to establish a new connection: [Errno 111] Connection refused'))
------------------------------------------------------------------------------
Restart_2 :: Restart odl. | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_listener_stability_restart_2"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_listener_stability_restart_2&order=bug_status"
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Move_Leader_From_Listener_Remote_To_Local :: Listener runs on foll... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_listener_stability_move_leader_from_listener_remote_to_local"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_listener_stability_move_leader_from_listener_remote_to_local&order=bug_status"
ConnectionError: HTTPConnectionPool(host='10.30.170.151', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f07eec45ad0>: Failed to establish a new connection: [Errno 111] Connection refused'))
------------------------------------------------------------------------------
controller-clustering-tell.txt.Listener Stability :: DOMDataBroker... | FAIL |
5 tests, 0 passed, 5 failed
==============================================================================
controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
==============================================================================
Stop_All_Members :: Stop every odl node. | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync. | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ConnectionError: HTTPConnectionPool(host='10.30.170.204', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f07f408d810>: Failed to establish a new connection: [Errno 111] Connection refused'))
------------------------------------------------------------------------------
controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-tell.txt.Master Stability :: Cluster Singleton testin...
==============================================================================
Register_Singleton_Constant_On_Each_Node_And_Verify :: Register a ... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_master_stability_register_singleton_constant_on_each_node_and_verify"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_register_singleton_constant_on_each_node_and_verify&order=bug_status"
ConnectionError: HTTPConnectionPool(host='10.30.170.204', port=8181): Max retries exceeded with url: /rests/operations/odl-mdsal-lowlevel-control:register-singleton-constant (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f07ed028150>: Failed to establish a new connection: [Errno 111] Connection refused'))
------------------------------------------------------------------------------
Unregister_Singleton_Constant_On_Non_Master_Node :: Unregister the... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_master_stability_unregister_singleton_constant_on_non_master_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_unregister_singleton_constant_on_non_master_node&order=bug_status"
Variable '@{cs_candidates}' not found. Did you mean:
@{cs_exp_candidates}
------------------------------------------------------------------------------
Monitor_Stability_While_Unregistered :: Verify that the owner rema... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_master_stability_monitor_stability_while_unregistered"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_monitor_stability_while_unregistered&order=bug_status"
Variable '${cs_owner}' not found.
------------------------------------------------------------------------------
Reregister_Singleton_Constant :: Re-register the unregistered cand... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_master_stability_reregister_singleton_constant"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_reregister_singleton_constant&order=bug_status"
Variable '${unregistered_node}' not found.
------------------------------------------------------------------------------
Verify_Stability_After_Reregistration :: Verify that the owner rem... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_master_stability_verify_stability_after_reregistration"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_verify_stability_after_reregistration&order=bug_status"
Variable '${cs_owner}' not found.
------------------------------------------------------------------------------
Unregister_Singleton_Constant_On_Each_Node :: Unregister the appli... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_master_stability_unregister_singleton_constant_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_unregister_singleton_constant_on_each_node&order=bug_status"
ConnectionError: HTTPConnectionPool(host='10.30.170.204', port=8181): Max retries exceeded with url: /rests/operations/odl-mdsal-lowlevel-control:unregister-singleton-constant (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f07eeb98610>: Failed to establish a new connection: [Errno 111] Connection refused'))
------------------------------------------------------------------------------
controller-clustering-tell.txt.Master Stability :: Cluster Singlet... | FAIL |
6 tests, 0 passed, 6 failed
==============================================================================
controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
==============================================================================
Stop_All_Members :: Stop every odl node. | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync. | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.8', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-tell.txt.Partition And Heal :: Cluster Singleton test...
==============================================================================
Register_Singleton_Constant_On_Each_Node :: Register a candidate a... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_partition_and_heal_register_singleton_constant_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_register_singleton_constant_on_each_node&order=bug_status"
ReadTimeout: HTTPConnectionPool(host='10.30.170.8', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Verify_Singleton_Constant_On_Each_Node :: Store the owner and cand... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_partition_and_heal_verify_singleton_constant_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_verify_singleton_constant_on_each_node&order=bug_status"
Could not parse owner and candidates for device get-singleton-constant-service']
------------------------------------------------------------------------------
Isolate_Owner_Node :: Isolate the cluster node which is the owner.... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_partition_and_heal_isolate_owner_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_isolate_owner_node&order=bug_status"
Variable '${cs_owner}' not found.
------------------------------------------------------------------------------
Monitor_Stability_While_Isolated :: Monitor the stability of the s... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_partition_and_heal_monitor_stability_while_isolated"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_monitor_stability_while_isolated&order=bug_status"
Invalid IF condition: Evaluating expression '"${index}" == "${cs_isolated_index}"' failed: Variable '${cs_isolated_index}' not found.
------------------------------------------------------------------------------
Rejoin_Isolated_node :: Rejoin isolated node. | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_partition_and_heal_rejoin_isolated_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_rejoin_isolated_node&order=bug_status"
Variable '${cs_isolated_index}' not found.
------------------------------------------------------------------------------
Unregister_Singleton_Constant_On_Each_Node :: Unregister the appli... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_partition_and_heal_unregister_singleton_constant_on_each_node"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_unregister_singleton_constant_on_each_node&order=bug_status"
ReadTimeout: HTTPConnectionPool(host='10.30.170.8', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-tell.txt.Partition And Heal :: Cluster Singl... | FAIL |
6 tests, 0 passed, 6 failed
==============================================================================
controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
==============================================================================
Stop_All_Members :: Stop every odl node. | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync. | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.8', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-tell.txt.Chasing The Leader :: Cluster Singleton test...
==============================================================================
Register_Candidates :: Register a candidate application on each no... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_chasing_the_leader_register_candidates"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_chasing_the_leader_register_candidates&order=bug_status"
ReadTimeout: HTTPConnectionPool(host='10.30.170.8', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
Do_Nothing :: Do nothing for the time of the test duration, becaus... | PASS |
------------------------------------------------------------------------------
Unregister_Candidates_And_Validate_Criteria :: Unregister the test... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_clustering_tell_txt_chasing_the_leader_unregister_candidates_and_validate_criteria"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_chasing_the_leader_unregister_candidates_and_validate_criteria&order=bug_status"
ReadTimeout: HTTPConnectionPool(host='10.30.170.8', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-tell.txt.Chasing The Leader :: Cluster Singl... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell...
==============================================================================
Stop_All_Members :: Stop every odl node. | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync. | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.8', port=8181): Read timed out. (read timeout=125.0)
------------------------------------------------------------------------------
controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-clustering-tell.txt.Carpeople Crud :: Suite for performing basic...
==============================================================================
Add_Cars_To_Leader :: Add 30 cars to car Leader by one big PUT. | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Added_Cars_On_Leader :: GET response from Leader should match ... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Added_Cars_On_Followers :: The same check on other members. | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Add_People_To_First_Follower :: Add 30 people to people first Foll... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Added_People_On_Leader :: GET response from Leader should matc... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Added_People_On_Followers :: The same check on other members. | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Leader :: Buy some cars on car-people Leader, loop of ... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Followers :: On each Follower buy corresponding ID seg... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Added_CarPeople_On_Leader :: GET car-person mappings from Lead... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Added_CarPeople_On_Followers :: The same check on other members. | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_All_CarPeople_On_Leader :: DELETE car-people container. No ... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_All_People_On_Leader :: DELETE people container. No verific... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_All_Cars_On_Leader :: DELETE cars container. No verificatio... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
controller-clustering-tell.txt.Carpeople Crud :: Suite for perform... | FAIL |
Suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
13 tests, 0 passed, 13 failed
==============================================================================
controller-clustering-tell.txt.Car Failover Crud :: Suite mixing basic oper...
==============================================================================
Add_Original_Cars_On_Old_Leader_And_Verify :: Add initial cars on ... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Stop_Original_Car_Leader :: Stop the car Leader to cause a new lea... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Wait_For_New_Leader :: Wait until new car Leader is elected. | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Original_Cars_On_New_Leader :: GET cars from new Leader, shoul... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Original_Cars_On_New_Followers :: The same check on other exis... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_Original_Cars_On_New_Leader :: Delete cars on the new Leader. | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Add_Leader_Cars_On_New_Leader :: Add cars on the new Leader. | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Leader_Cars_On_New_Leader :: GET cars from new Leader, should ... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Leader_Cars_On_New_Followers :: The same check on other existi... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_Leader_Cars_On_New_First_Follower :: Delete cars in new fir... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Add_Follower_Cars_On_New_First_Follower :: Add cars on the new fir... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Folower_Cars_On_New_Leader :: Get cars from the new Leader, sh... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Follower_Cars_On_New_Followers :: The same check on other exis... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Start_Old_Car_Leader :: Start the stopped member without deleting ... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Folower_Cars_On_Old_Leader :: GET cars from the restarted memb... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_Follower_Cars_On_New_Leader :: Delete cars on the last Leader. | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
controller-clustering-tell.txt.Car Failover Crud :: Suite mixing b... | FAIL |
Suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
16 tests, 0 passed, 16 failed
==============================================================================
controller-clustering-tell.txt.Car Persistence Recovery :: This test restar...
==============================================================================
Add_Cars_On_Leader_And_Verify :: Single big PUT to datastore to ad... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Stop_All_Members :: Stop all controllers. | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Start_All_Members :: Start all controllers (should restore the per... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Memorize_Leader_And_Followers :: Locate current Leader of car Shard. | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Cars_On_Leader :: GET cars from Leader, should match the PUT d... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Cars_On_Followers :: The same check on other members. | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_Cars_On_Leader :: Delete cars on the new Leader. | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
controller-clustering-tell.txt.Car Persistence Recovery :: This te... | FAIL |
Suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
7 tests, 0 passed, 7 failed
==============================================================================
controller-clustering-tell.txt.Buycar Failover :: This test focuses on test...
==============================================================================
Add_Cars_To_Leader_And_Verify :: Add all needed cars to car Leader... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Add_People_To_First_Follower_And_Verify :: Add all needed people t... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Leader_And_Verify :: Buy some cars on the leader member. | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Follower_And_Verify :: Buy some cars on the first foll... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Reboot_People_Leader :: Previous people Leader is rebooted. We sho... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Leader_After_Reboot_And_Verify :: Buy some cars on the... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Follower_After_Reboot_And_Verify :: Buy some cars on t... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_All_CarPeople :: DELETE car-people container. No verificati... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_All_People :: DELETE people container. No verification beyo... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_All_Cars :: DELETE cars container. No verification beyond h... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
controller-clustering-tell.txt.Buycar Failover :: This test focuse... | FAIL |
Suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
10 tests, 0 passed, 10 failed
==============================================================================
controller-clustering-tell.txt.Entity Isolate :: Suite for performing membe...
==============================================================================
Check All Shards Before Isolate :: Check all shards in controller. | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Isolate Entity Leader :: Isolate the entity-ownership Leader to ca... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Check All Shards After Isolate :: Check all shards in controller. | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Rejoin Entity Leader :: Rejoin the entity-ownership Leader. | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Check All Shards After Rejoin :: Check all shards in controller. | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
controller-clustering-tell.txt.Entity Isolate :: Suite for perform... | FAIL |
Suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
5 tests, 0 passed, 5 failed
==============================================================================
controller-clustering-tell.txt.Buycar Failover Isolation :: This test focus...
==============================================================================
Add_Cars_To_Leader_And_Verify :: Add all needed cars to car Leader... | FAIL |
Parent suite setup failed:
HTTPError: 409 Client Error: Conflict for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Add_People_To_First_Follower_And_Verify :: Add all needed people t... | FAIL |
Parent suite setup failed:
HTTPError: 409 Client Error: Conflict for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Leader_And_Verify :: Buy some cars on the leader member. | FAIL |
Parent suite setup failed:
HTTPError: 409 Client Error: Conflict for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Follower_And_Verify :: Buy some cars on the first foll... | FAIL |
Parent suite setup failed:
HTTPError: 409 Client Error: Conflict for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Isolate_and_Rejoin_People_Leader :: Previous people Leader is isol... | FAIL |
Parent suite setup failed:
HTTPError: 409 Client Error: Conflict for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Leader_After_Rejoin_And_Verify :: Buy some cars on the... | FAIL |
Parent suite setup failed:
HTTPError: 409 Client Error: Conflict for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Buy_Cars_On_Follower_After_Rejoin_And_Verify :: Buy some cars on t... | FAIL |
Parent suite setup failed:
HTTPError: 409 Client Error: Conflict for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_All_CarPeople :: DELETE car-people container. No verificati... | FAIL |
Parent suite setup failed:
HTTPError: 409 Client Error: Conflict for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_All_People :: DELETE people container. No verification beyo... | FAIL |
Parent suite setup failed:
HTTPError: 409 Client Error: Conflict for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_All_Cars :: DELETE cars container. No verification beyond h... | FAIL |
Parent suite setup failed:
HTTPError: 409 Client Error: Conflict for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
controller-clustering-tell.txt.Buycar Failover Isolation :: This t... | FAIL |
Suite setup failed:
HTTPError: 409 Client Error: Conflict for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
10 tests, 0 passed, 10 failed
==============================================================================
controller-clustering-tell.txt.Car Failover Crud Isolation :: Suite mixing ...
==============================================================================
Add_Original_Cars_On_Old_Leader_And_Verify :: Add initial cars on ... | FAIL |
Parent suite setup failed:
HTTPError: 409 Client Error: Conflict for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Isolate_Original_Car_Leader :: Isolate the car Leader to cause a n... | FAIL |
Parent suite setup failed:
HTTPError: 409 Client Error: Conflict for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Wait_For_New_Leader :: Wait until new car Leader is elected. | FAIL |
Parent suite setup failed:
HTTPError: 409 Client Error: Conflict for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Original_Cars_On_New_Leader :: GET cars from new Leader, shoul... | FAIL |
Parent suite setup failed:
HTTPError: 409 Client Error: Conflict for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Original_Cars_On_New_Followers :: The same check on other exis... | FAIL |
Parent suite setup failed:
HTTPError: 409 Client Error: Conflict for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_Original_Cars_On_New_Leader :: Delete cars on the new Leader. | FAIL |
Parent suite setup failed:
HTTPError: 409 Client Error: Conflict for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Add_Leader_Cars_On_New_Leader :: Add cars on the new Leader. | FAIL |
Parent suite setup failed:
HTTPError: 409 Client Error: Conflict for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Leader_Cars_On_New_Leader :: GET cars from new Leader, should ... | FAIL |
Parent suite setup failed:
HTTPError: 409 Client Error: Conflict for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Leader_Cars_On_New_Followers :: The same check on other existi... | FAIL |
Parent suite setup failed:
HTTPError: 409 Client Error: Conflict for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_Leader_Cars_On_New_First_Follower :: Delete cars in new fir... | FAIL |
Parent suite setup failed:
HTTPError: 409 Client Error: Conflict for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Add_Follower_Cars_On_New_First_Follower :: Add cars on the new fir... | FAIL |
Parent suite setup failed:
HTTPError: 409 Client Error: Conflict for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Folower_Cars_On_New_Leader :: Get cars from the new Leader, sh... | FAIL |
Parent suite setup failed:
HTTPError: 409 Client Error: Conflict for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Follower_Cars_On_New_Followers :: The same check on other exis... | FAIL |
Parent suite setup failed:
HTTPError: 409 Client Error: Conflict for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Rejoin_Old_Car_Leader :: Rejoin the isolated member without deleti... | FAIL |
Parent suite setup failed:
HTTPError: 409 Client Error: Conflict for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Folower_Cars_On_Old_Leader :: GET cars from the restarted memb... | FAIL |
Parent suite setup failed:
HTTPError: 409 Client Error: Conflict for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_Follower_Cars_On_New_Leader :: Delete cars on the last Leader. | FAIL |
Parent suite setup failed:
HTTPError: 409 Client Error: Conflict for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
controller-clustering-tell.txt.Car Failover Crud Isolation :: Suit... | FAIL |
Suite setup failed:
HTTPError: 409 Client Error: Conflict for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
16 tests, 0 passed, 16 failed
==============================================================================
controller-clustering-tell.txt.Car Outage Corners :: Cluster suite for test...
==============================================================================
Stop_Majority_Of_The_Followers :: Stop half plus one car Follower ... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Attempt_To_Add_Cars_To_Leader :: Adding cars should fail, as major... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Start_Tipping_Follower :: Start one Follower member without persis... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Add_Cars_On_Tipping_Follower :: Add cars on the tipping Follower. | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Cars_On_Existing_Members :: On each up member: GET cars, shoul... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Start_Other_Followers :: Start other followers without persisted d... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
See_Cars_On_New_Follower_Leader :: GET cars from a new follower to... | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
Delete_Cars_On_Leader :: Delete cars on Leader. | FAIL |
Parent suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
------------------------------------------------------------------------------
controller-clustering-tell.txt.Car Outage Corners :: Cluster suite... | FAIL |
Suite setup failed:
HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.151:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig
8 tests, 0 passed, 8 failed
==============================================================================
controller-clustering-tell.txt | FAIL |
162 tests, 13 passed, 149 failed
==============================================================================
Output: /w/workspace/controller-csit-3node-clustering-tell-all-calcium/output.xml
Log: /w/workspace/controller-csit-3node-clustering-tell-all-calcium/log.html
Report: /w/workspace/controller-csit-3node-clustering-tell-all-calcium/report.html
+ true
+ echo 'Examining the files in data/log and checking filesize'
Examining the files in data/log and checking filesize
+ ssh 10.30.170.151 'ls -altr /tmp/karaf-0.20.4-SNAPSHOT/data/log/'
Warning: Permanently added '10.30.170.151' (ECDSA) to the list of known hosts.
total 17736
drwxrwxr-x 2 jenkins jenkins 4096 Mar 1 23:44 .
-rw-rw-r-- 1 jenkins jenkins 1720 Mar 1 23:44 karaf_console.log
drwxrwxr-x 9 jenkins jenkins 4096 Mar 2 03:15 ..
-rw-rw-r-- 1 jenkins jenkins 18146723 Mar 2 03:28 karaf.log
+ ssh 10.30.170.151 'du -hs /tmp/karaf-0.20.4-SNAPSHOT/data/log/*'
Warning: Permanently added '10.30.170.151' (ECDSA) to the list of known hosts.
18M /tmp/karaf-0.20.4-SNAPSHOT/data/log/karaf.log
4.0K /tmp/karaf-0.20.4-SNAPSHOT/data/log/karaf_console.log
+ ssh 10.30.170.8 'ls -altr /tmp/karaf-0.20.4-SNAPSHOT/data/log/'
Warning: Permanently added '10.30.170.8' (ECDSA) to the list of known hosts.
total 598412
drwxrwxr-x 2 jenkins jenkins 4096 Mar 1 23:44 .
-rw-rw-r-- 1 jenkins jenkins 1720 Mar 1 23:44 karaf_console.log
-rw-rw-r-- 1 jenkins jenkins 612755053 Mar 2 02:40 karaf.log
drwxrwxr-x 4 jenkins jenkins 4096 Mar 2 03:14 ..
+ ssh 10.30.170.8 'du -hs /tmp/karaf-0.20.4-SNAPSHOT/data/log/*'
Warning: Permanently added '10.30.170.8' (ECDSA) to the list of known hosts.
585M /tmp/karaf-0.20.4-SNAPSHOT/data/log/karaf.log
4.0K /tmp/karaf-0.20.4-SNAPSHOT/data/log/karaf_console.log
+ ssh 10.30.170.204 'ls -altr /tmp/karaf-0.20.4-SNAPSHOT/data/log/'
Warning: Permanently added '10.30.170.204' (ECDSA) to the list of known hosts.
total 9772
drwxrwxr-x 2 jenkins jenkins 4096 Mar 1 23:44 .
-rw-rw-r-- 1 jenkins jenkins 1720 Mar 1 23:44 karaf_console.log
drwxrwxr-x 4 jenkins jenkins 4096 Mar 2 03:14 ..
-rw-rw-r-- 1 jenkins jenkins 9988556 Mar 2 03:29 karaf.log
+ ssh 10.30.170.204 'du -hs /tmp/karaf-0.20.4-SNAPSHOT/data/log/*'
Warning: Permanently added '10.30.170.204' (ECDSA) to the list of known hosts.
9.6M /tmp/karaf-0.20.4-SNAPSHOT/data/log/karaf.log
4.0K /tmp/karaf-0.20.4-SNAPSHOT/data/log/karaf_console.log
+ set +e
++ seq 1 3
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_1_IP
+ echo 'Let'\''s take the karaf thread dump again'
Let's take the karaf thread dump again
+ ssh 10.30.170.151 'sudo ps aux'
Warning: Permanently added '10.30.170.151' (ECDSA) to the list of known hosts.
++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-calcium/ps_after.log
++ grep -v grep
++ cut -f2 '-d '
++ tr -s ' '
+ pid=58551
+ echo 'karaf main: org.apache.karaf.main.Main, pid:58551'
karaf main: org.apache.karaf.main.Main, pid:58551
+ ssh 10.30.170.151 '/usr/lib/jvm/java-17-openjdk-amd64/bin/jstack -l 58551'
Warning: Permanently added '10.30.170.151' (ECDSA) to the list of known hosts.
+ echo 'killing karaf process...'
killing karaf process...
+ ssh 10.30.170.151 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh'
Warning: Permanently added '10.30.170.151' (ECDSA) to the list of known hosts.
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_2_IP
+ echo 'Let'\''s take the karaf thread dump again'
Let's take the karaf thread dump again
+ ssh 10.30.170.8 'sudo ps aux'
Warning: Permanently added '10.30.170.8' (ECDSA) to the list of known hosts.
++ tr -s ' '
++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-calcium/ps_after.log
++ grep -v grep
++ cut -f2 '-d '
+ pid=50099
+ echo 'karaf main: org.apache.karaf.main.Main, pid:50099'
karaf main: org.apache.karaf.main.Main, pid:50099
+ ssh 10.30.170.8 '/usr/lib/jvm/java-17-openjdk-amd64/bin/jstack -l 50099'
Warning: Permanently added '10.30.170.8' (ECDSA) to the list of known hosts.
50099: Unable to open socket file /tmp/.java_pid50099: target process 50099 doesn't respond within 10500ms or HotSpot VM not loaded
+ true
+ echo 'killing karaf process...'
killing karaf process...
+ ssh 10.30.170.8 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh'
Warning: Permanently added '10.30.170.8' (ECDSA) to the list of known hosts.
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_3_IP
+ echo 'Let'\''s take the karaf thread dump again'
Let's take the karaf thread dump again
+ ssh 10.30.170.204 'sudo ps aux'
Warning: Permanently added '10.30.170.204' (ECDSA) to the list of known hosts.
++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-calcium/ps_after.log
++ grep -v grep
++ cut -f2 '-d '
++ tr -s ' '
+ pid=51432
+ echo 'karaf main: org.apache.karaf.main.Main, pid:51432'
karaf main: org.apache.karaf.main.Main, pid:51432
+ ssh 10.30.170.204 '/usr/lib/jvm/java-17-openjdk-amd64/bin/jstack -l 51432'
Warning: Permanently added '10.30.170.204' (ECDSA) to the list of known hosts.
+ echo 'killing karaf process...'
killing karaf process...
+ ssh 10.30.170.204 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh'
Warning: Permanently added '10.30.170.204' (ECDSA) to the list of known hosts.
+ sleep 5
++ seq 1 3
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_1_IP
+ echo 'Compressing karaf.log 1'
Compressing karaf.log 1
+ ssh 10.30.170.151 gzip --best /tmp/karaf-0.20.4-SNAPSHOT/data/log/karaf.log
Warning: Permanently added '10.30.170.151' (ECDSA) to the list of known hosts.
+ echo 'Fetching compressed karaf.log 1'
Fetching compressed karaf.log 1
+ scp 10.30.170.151:/tmp/karaf-0.20.4-SNAPSHOT/data/log/karaf.log.gz odl1_karaf.log.gz
Warning: Permanently added '10.30.170.151' (ECDSA) to the list of known hosts.
+ ssh 10.30.170.151 rm -f /tmp/karaf-0.20.4-SNAPSHOT/data/log/karaf.log.gz
Warning: Permanently added '10.30.170.151' (ECDSA) to the list of known hosts.
+ scp 10.30.170.151:/tmp/karaf-0.20.4-SNAPSHOT/data/log/karaf_console.log odl1_karaf_console.log
Warning: Permanently added '10.30.170.151' (ECDSA) to the list of known hosts.
+ ssh 10.30.170.151 rm -f /tmp/karaf-0.20.4-SNAPSHOT/data/log/karaf_console.log
Warning: Permanently added '10.30.170.151' (ECDSA) to the list of known hosts.
+ echo 'Fetch GC logs'
Fetch GC logs
+ mkdir -p gclogs-1
+ scp '10.30.170.151:/tmp/karaf-0.20.4-SNAPSHOT/data/log/*.log' gclogs-1/
Warning: Permanently added '10.30.170.151' (ECDSA) to the list of known hosts.
scp: /tmp/karaf-0.20.4-SNAPSHOT/data/log/*.log: No such file or directory
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_2_IP
+ echo 'Compressing karaf.log 2'
Compressing karaf.log 2
+ ssh 10.30.170.8 gzip --best /tmp/karaf-0.20.4-SNAPSHOT/data/log/karaf.log
Warning: Permanently added '10.30.170.8' (ECDSA) to the list of known hosts.
+ echo 'Fetching compressed karaf.log 2'
Fetching compressed karaf.log 2
+ scp 10.30.170.8:/tmp/karaf-0.20.4-SNAPSHOT/data/log/karaf.log.gz odl2_karaf.log.gz
Warning: Permanently added '10.30.170.8' (ECDSA) to the list of known hosts.
+ ssh 10.30.170.8 rm -f /tmp/karaf-0.20.4-SNAPSHOT/data/log/karaf.log.gz
Warning: Permanently added '10.30.170.8' (ECDSA) to the list of known hosts.
+ scp 10.30.170.8:/tmp/karaf-0.20.4-SNAPSHOT/data/log/karaf_console.log odl2_karaf_console.log
Warning: Permanently added '10.30.170.8' (ECDSA) to the list of known hosts.
+ ssh 10.30.170.8 rm -f /tmp/karaf-0.20.4-SNAPSHOT/data/log/karaf_console.log
Warning: Permanently added '10.30.170.8' (ECDSA) to the list of known hosts.
+ echo 'Fetch GC logs'
Fetch GC logs
+ mkdir -p gclogs-2
+ scp '10.30.170.8:/tmp/karaf-0.20.4-SNAPSHOT/data/log/*.log' gclogs-2/
Warning: Permanently added '10.30.170.8' (ECDSA) to the list of known hosts.
scp: /tmp/karaf-0.20.4-SNAPSHOT/data/log/*.log: No such file or directory
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_3_IP
+ echo 'Compressing karaf.log 3'
Compressing karaf.log 3
+ ssh 10.30.170.204 gzip --best /tmp/karaf-0.20.4-SNAPSHOT/data/log/karaf.log
Warning: Permanently added '10.30.170.204' (ECDSA) to the list of known hosts.
+ echo 'Fetching compressed karaf.log 3'
Fetching compressed karaf.log 3
+ scp 10.30.170.204:/tmp/karaf-0.20.4-SNAPSHOT/data/log/karaf.log.gz odl3_karaf.log.gz
Warning: Permanently added '10.30.170.204' (ECDSA) to the list of known hosts.
+ ssh 10.30.170.204 rm -f /tmp/karaf-0.20.4-SNAPSHOT/data/log/karaf.log.gz
Warning: Permanently added '10.30.170.204' (ECDSA) to the list of known hosts.
+ scp 10.30.170.204:/tmp/karaf-0.20.4-SNAPSHOT/data/log/karaf_console.log odl3_karaf_console.log
Warning: Permanently added '10.30.170.204' (ECDSA) to the list of known hosts.
+ ssh 10.30.170.204 rm -f /tmp/karaf-0.20.4-SNAPSHOT/data/log/karaf_console.log
Warning: Permanently added '10.30.170.204' (ECDSA) to the list of known hosts.
+ echo 'Fetch GC logs'
Fetch GC logs
+ mkdir -p gclogs-3
+ scp '10.30.170.204:/tmp/karaf-0.20.4-SNAPSHOT/data/log/*.log' gclogs-3/
Warning: Permanently added '10.30.170.204' (ECDSA) to the list of known hosts.
scp: /tmp/karaf-0.20.4-SNAPSHOT/data/log/*.log: No such file or directory
+ echo 'Examine copied files'
Examine copied files
+ ls -lt
total 104972
drwxrwxr-x. 2 jenkins jenkins 6 Mar 2 03:30 gclogs-3
-rw-rw-r--. 1 jenkins jenkins 1720 Mar 2 03:30 odl3_karaf_console.log
-rw-rw-r--. 1 jenkins jenkins 419244 Mar 2 03:30 odl3_karaf.log.gz
drwxrwxr-x. 2 jenkins jenkins 6 Mar 2 03:30 gclogs-2
-rw-rw-r--. 1 jenkins jenkins 1720 Mar 2 03:30 odl2_karaf_console.log
-rw-rw-r--. 1 jenkins jenkins 5057817 Mar 2 03:30 odl2_karaf.log.gz
drwxrwxr-x. 2 jenkins jenkins 6 Mar 2 03:30 gclogs-1
-rw-rw-r--. 1 jenkins jenkins 1720 Mar 2 03:30 odl1_karaf_console.log
-rw-rw-r--. 1 jenkins jenkins 1134197 Mar 2 03:30 odl1_karaf.log.gz
-rw-rw-r--. 1 jenkins jenkins 148843 Mar 2 03:30 karaf_3_51432_threads_after.log
-rw-rw-r--. 1 jenkins jenkins 15205 Mar 2 03:30 ps_after.log
-rw-rw-r--. 1 jenkins jenkins 0 Mar 2 03:29 karaf_2_50099_threads_after.log
-rw-rw-r--. 1 jenkins jenkins 122432 Mar 2 03:29 karaf_1_58551_threads_after.log
-rw-rw-r--. 1 jenkins jenkins 312014 Mar 2 03:29 report.html
-rw-rw-r--. 1 jenkins jenkins 3593008 Mar 2 03:29 log.html
-rw-rw-r--. 1 jenkins jenkins 96191824 Mar 2 03:29 output.xml
-rw-rw-r--. 1 jenkins jenkins 6030 Mar 1 23:48 testplan.txt
-rw-rw-r--. 1 jenkins jenkins 125626 Mar 1 23:48 karaf_3_28761_threads_before.log
-rw-rw-r--. 1 jenkins jenkins 16374 Mar 1 23:48 ps_before.log
-rw-rw-r--. 1 jenkins jenkins 126479 Mar 1 23:48 karaf_2_28781_threads_before.log
-rw-rw-r--. 1 jenkins jenkins 127315 Mar 1 23:48 karaf_1_28758_threads_before.log
-rw-rw-r--. 1 jenkins jenkins 3106 Mar 1 23:44 post-startup-script.sh
-rw-rw-r--. 1 jenkins jenkins 252 Mar 1 23:44 startup-script.sh
-rw-rw-r--. 1 jenkins jenkins 3459 Mar 1 23:44 configuration-script.sh
-rw-rw-r--. 1 jenkins jenkins 695 Mar 1 23:44 custom_shard_config.txt
-rw-rw-r--. 1 jenkins jenkins 135 Mar 1 23:44 scriptplan.txt
-rw-rw-r--. 1 jenkins jenkins 337 Mar 1 23:44 detect_variables.env
-rw-rw-r--. 1 jenkins jenkins 2619 Mar 1 23:44 pom.xml
-rw-rw-r--. 1 jenkins jenkins 92 Mar 1 23:44 set_variables.env
-rw-rw-r--. 1 jenkins jenkins 312 Mar 1 23:44 slave_addresses.txt
-rw-rw-r--. 1 jenkins jenkins 570 Mar 1 23:44 requirements.txt
-rw-rw-r--. 1 jenkins jenkins 26 Mar 1 23:44 env.properties
-rw-rw-r--. 1 jenkins jenkins 333 Mar 1 23:42 stack-parameters.yaml
drwxrwxr-x. 7 jenkins jenkins 4096 Mar 1 23:41 test
drwxrwxr-x. 2 jenkins jenkins 6 Mar 1 23:41 test@tmp
-rw-rw-r--. 1 jenkins jenkins 1410 Mar 1 20:47 maven-metadata.xml
+ true
[controller-csit-3node-clustering-tell-all-calcium] $ /bin/sh /tmp/jenkins15762376232883481280.sh
Cleaning up Robot installation...
$ ssh-agent -k
unset SSH_AUTH_SOCK;
unset SSH_AGENT_PID;
echo Agent pid 5163 killed;
[ssh-agent] Stopped.
Recording plot data
Robot results publisher started...
INFO: Checking test criticality is deprecated and will be dropped in a future release!
-Parsing output xml:
Done!
-Copying log files to build dir:
Done!
-Assigning results to build:
Done!
-Checking thresholds:
Done!
Done publishing Robot results.
Build step 'Publish Robot Framework test results' changed build result to UNSTABLE
[PostBuildScript] - [INFO] Executing post build scripts.
[controller-csit-3node-clustering-tell-all-calcium] $ /bin/bash /tmp/jenkins6454503764770683387.sh
Archiving csit artifacts
mv: cannot stat '*_1.png': No such file or directory
mv: cannot stat '/tmp/odl1_*': No such file or directory
mv: cannot stat '*_2.png': No such file or directory
mv: cannot stat '/tmp/odl2_*': No such file or directory
mv: cannot stat '*_3.png': No such file or directory
mv: cannot stat '/tmp/odl3_*': No such file or directory
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
100 104k 0 104k 0 0 1925k 0 --:--:-- --:--:-- --:--:-- 1890k
100 5032k 0 5032k 0 0 4774k 0 --:--:-- 0:00:01 --:--:-- 4769k
100 7601k 0 7601k 0 0 4907k 0 --:--:-- 0:00:01 --:--:-- 4904k
Archive: robot-plugin.zip
inflating: ./archives/robot-plugin/log.html
inflating: ./archives/robot-plugin/output.xml
inflating: ./archives/robot-plugin/report.html
mv: cannot stat '*.log.gz': No such file or directory
mv: cannot stat '*.csv': No such file or directory
mv: cannot stat '*.png': No such file or directory
[PostBuildScript] - [INFO] Executing post build scripts.
[controller-csit-3node-clustering-tell-all-calcium] $ /bin/bash /tmp/jenkins15208688320933534036.sh
[PostBuildScript] - [INFO] Executing post build scripts.
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties content
OS_CLOUD=vex
OS_STACK_NAME=releng-controller-csit-3node-clustering-tell-all-calcium-77
[EnvInject] - Variables injected successfully.
provisioning config files...
copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
[controller-csit-3node-clustering-tell-all-calcium] $ /bin/bash /tmp/jenkins14287067363832041189.sh
---> openstack-stack-delete.sh
Setup pyenv:
system
3.8.13
3.9.13
3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-calcium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-r1gK from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes python-heatclient python-openstackclient
lf-activate-venv(): INFO: Adding /tmp/venv-r1gK/bin to PATH
INFO: Retrieving stack cost for: releng-controller-csit-3node-clustering-tell-all-calcium-77
DEBUG: Successfully retrieved stack cost: total: 1.32
INFO: Deleting stack releng-controller-csit-3node-clustering-tell-all-calcium-77
Successfully deleted stack releng-controller-csit-3node-clustering-tell-all-calcium-77
[PostBuildScript] - [INFO] Executing post build scripts.
[controller-csit-3node-clustering-tell-all-calcium] $ /bin/bash /tmp/jenkins10468104462972242753.sh
---> sysstat.sh
[controller-csit-3node-clustering-tell-all-calcium] $ /bin/bash /tmp/jenkins424634149472061088.sh
---> package-listing.sh
++ facter osfamily
++ tr '[:upper:]' '[:lower:]'
+ OS_FAMILY=redhat
+ workspace=/w/workspace/controller-csit-3node-clustering-tell-all-calcium
+ START_PACKAGES=/tmp/packages_start.txt
+ END_PACKAGES=/tmp/packages_end.txt
+ DIFF_PACKAGES=/tmp/packages_diff.txt
+ PACKAGES=/tmp/packages_start.txt
+ '[' /w/workspace/controller-csit-3node-clustering-tell-all-calcium ']'
+ PACKAGES=/tmp/packages_end.txt
+ case "${OS_FAMILY}" in
+ rpm -qa
+ sort
+ '[' -f /tmp/packages_start.txt ']'
+ '[' -f /tmp/packages_end.txt ']'
+ diff /tmp/packages_start.txt /tmp/packages_end.txt
+ '[' /w/workspace/controller-csit-3node-clustering-tell-all-calcium ']'
+ mkdir -p /w/workspace/controller-csit-3node-clustering-tell-all-calcium/archives/
+ cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/controller-csit-3node-clustering-tell-all-calcium/archives/
[controller-csit-3node-clustering-tell-all-calcium] $ /bin/bash /tmp/jenkins6216221847657379973.sh
---> capture-instance-metadata.sh
Setup pyenv:
system
3.8.13
3.9.13
3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-calcium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-r1gK from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: lftools
lf-activate-venv(): INFO: Adding /tmp/venv-r1gK/bin to PATH
INFO: Running in OpenStack, capturing instance metadata
[controller-csit-3node-clustering-tell-all-calcium] $ /bin/bash /tmp/jenkins12155087583223387296.sh
provisioning config files...
Could not find credentials [logs] for controller-csit-3node-clustering-tell-all-calcium #77
copy managed file [jenkins-log-archives-settings] to file:/w/workspace/controller-csit-3node-clustering-tell-all-calcium@tmp/config10811323163050661063tmp
Regular expression run condition: Expression=[^.*logs-s3.*], Label=[odl-logs-s3-cloudfront-index]
Run condition [Regular expression match] enabling perform for step [Provide Configuration files]
provisioning config files...
copy managed file [jenkins-s3-log-ship] to file:/home/jenkins/.aws/credentials
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties content
SERVER_ID=logs
[EnvInject] - Variables injected successfully.
[controller-csit-3node-clustering-tell-all-calcium] $ /bin/bash /tmp/jenkins18437681448053005416.sh
---> create-netrc.sh
WARN: Log server credential not found.
[controller-csit-3node-clustering-tell-all-calcium] $ /bin/bash /tmp/jenkins9576341706185395055.sh
---> python-tools-install.sh
Setup pyenv:
system
3.8.13
3.9.13
3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-calcium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-r1gK from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: lftools
lf-activate-venv(): INFO: Adding /tmp/venv-r1gK/bin to PATH
[controller-csit-3node-clustering-tell-all-calcium] $ /bin/bash /tmp/jenkins13329873991920078300.sh
---> sudo-logs.sh
Archiving 'sudo' log..
[controller-csit-3node-clustering-tell-all-calcium] $ /bin/bash /tmp/jenkins13689118432687062490.sh
---> job-cost.sh
Setup pyenv:
system
3.8.13
3.9.13
3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-calcium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-r1gK from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: zipp==1.1.0 python-openstackclient urllib3~=1.26.15
lf-activate-venv(): INFO: Adding /tmp/venv-r1gK/bin to PATH
DEBUG: total: 1.32
INFO: Retrieving Stack Cost...
INFO: Retrieving Pricing Info for: v3-standard-2
INFO: Archiving Costs
[controller-csit-3node-clustering-tell-all-calcium] $ /bin/bash -l /tmp/jenkins9893101890357254907.sh
---> logs-deploy.sh
Setup pyenv:
system
3.8.13
3.9.13
3.10.13
* 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-calcium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-r1gK from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: lftools
lf-activate-venv(): INFO: Adding /tmp/venv-r1gK/bin to PATH
WARNING: Nexus logging server not set
INFO: S3 path logs/releng/vex-yul-odl-jenkins-1/controller-csit-3node-clustering-tell-all-calcium/77/
INFO: archiving logs to S3
---> uname -a:
Linux prd-centos8-robot-2c-8g-3889.novalocal 4.18.0-553.5.1.el8.x86_64 #1 SMP Tue May 21 05:46:01 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
---> lscpu:
Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Byte Order: Little Endian
CPU(s): 2
On-line CPU(s) list: 0,1
Thread(s) per core: 1
Core(s) per socket: 1
Socket(s): 2
NUMA node(s): 1
Vendor ID: AuthenticAMD
CPU family: 23
Model: 49
Model name: AMD EPYC-Rome Processor
Stepping: 0
CPU MHz: 2799.998
BogoMIPS: 5599.99
Virtualization: AMD-V
Hypervisor vendor: KVM
Virtualization type: full
L1d cache: 32K
L1i cache: 32K
L2 cache: 512K
L3 cache: 16384K
NUMA node0 CPU(s): 0,1
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities
---> nproc:
2
---> df -h:
Filesystem Size Used Avail Use% Mounted on
devtmpfs 3.8G 0 3.8G 0% /dev
tmpfs 3.8G 0 3.8G 0% /dev/shm
tmpfs 3.8G 17M 3.8G 1% /run
tmpfs 3.8G 0 3.8G 0% /sys/fs/cgroup
/dev/vda1 40G 8.5G 32G 22% /
tmpfs 770M 0 770M 0% /run/user/1001
---> free -m:
total used free shared buff/cache available
Mem: 7697 654 4674 19 2368 6746
Swap: 1023 0 1023
---> ip addr:
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
inet 127.0.0.1/8 scope host lo
valid_lft forever preferred_lft forever
inet6 ::1/128 scope host
valid_lft forever preferred_lft forever
2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1458 qdisc mq state UP group default qlen 1000
link/ether fa:16:3e:72:79:7f brd ff:ff:ff:ff:ff:ff
altname enp0s3
altname ens3
inet 10.30.170.12/23 brd 10.30.171.255 scope global dynamic noprefixroute eth0
valid_lft 72547sec preferred_lft 72547sec
inet6 fe80::f816:3eff:fe72:797f/64 scope link
valid_lft forever preferred_lft forever
---> sar -b -r -n DEV:
Linux 4.18.0-553.5.1.el8.x86_64 (prd-centos8-robot-2c-8g-3889.novalocal) 03/02/2025 _x86_64_ (2 CPU)
12:00:01 AM tps rtps wtps bread/s bwrtn/s
12:01:01 AM 0.95 0.03 0.92 0.27 207.16
12:02:01 AM 0.60 0.07 0.53 1.73 22.34
12:03:01 AM 0.23 0.00 0.23 0.00 15.76
12:04:01 AM 0.15 0.00 0.15 0.00 8.30
12:05:01 AM 0.13 0.00 0.13 0.00 28.67
12:06:01 AM 0.30 0.00 0.30 0.00 13.75
12:07:01 AM 0.32 0.00 0.32 0.00 16.14
12:08:01 AM 0.35 0.07 0.28 7.60 26.41
12:09:01 AM 0.23 0.00 0.23 0.00 18.98
12:10:01 AM 0.15 0.00 0.15 0.00 17.86
12:11:01 AM 0.30 0.00 0.30 0.00 13.23
12:12:01 AM 0.43 0.00 0.43 0.00 20.38
12:13:01 AM 0.17 0.00 0.17 0.00 1.63
12:14:01 AM 0.20 0.00 0.20 0.00 18.83
12:15:01 AM 0.13 0.00 0.13 0.00 9.99
12:16:01 AM 0.17 0.00 0.17 0.00 15.36
12:17:01 AM 0.33 0.00 0.33 0.00 18.68
12:18:01 AM 0.13 0.00 0.13 0.00 8.40
12:19:01 AM 0.22 0.00 0.22 0.00 19.11
12:20:01 AM 0.52 0.00 0.52 0.00 10.25
12:21:01 AM 0.43 0.00 0.43 0.00 4.97
12:22:01 AM 0.47 0.00 0.47 0.00 20.24
12:23:01 AM 0.25 0.00 0.25 0.00 15.50
12:24:01 AM 0.15 0.00 0.15 0.00 8.55
12:25:01 AM 0.17 0.00 0.17 0.00 14.81
12:26:01 AM 0.17 0.00 0.17 0.00 15.71
12:27:01 AM 0.37 0.00 0.37 0.00 20.38
12:28:01 AM 0.27 0.00 0.27 0.00 23.75
12:29:01 AM 0.15 0.00 0.15 0.00 11.90
12:30:01 AM 0.13 0.00 0.13 0.00 11.73
12:31:01 AM 0.22 0.00 0.22 0.00 23.39
12:32:01 AM 0.33 0.00 0.33 0.00 16.00
12:33:01 AM 0.50 0.32 0.18 6.93 23.86
12:34:01 AM 0.87 0.02 0.85 0.13 30.09
12:35:01 AM 8.63 5.73 2.90 555.41 98.72
12:36:01 AM 0.52 0.00 0.52 0.00 21.11
12:37:01 AM 0.65 0.00 0.65 0.00 20.11
12:38:01 AM 0.52 0.00 0.52 0.00 17.31
12:39:01 AM 0.57 0.00 0.57 0.00 17.66
12:40:01 AM 0.47 0.00 0.47 0.00 16.38
12:41:01 AM 0.67 0.00 0.67 0.00 23.59
12:42:01 AM 0.35 0.00 0.35 0.00 13.26
12:43:01 AM 0.28 0.00 0.28 0.00 19.23
12:44:01 AM 0.12 0.00 0.12 0.00 8.95
12:45:01 AM 0.18 0.00 0.18 0.00 15.88
12:46:01 AM 0.17 0.00 0.17 0.00 15.85
12:47:01 AM 0.22 0.00 0.22 0.00 10.38
12:48:01 AM 0.15 0.00 0.15 0.00 26.26
12:49:01 AM 0.25 0.00 0.25 0.00 17.50
12:50:01 AM 0.20 0.00 0.20 0.00 15.48
12:51:01 AM 0.28 0.00 0.28 0.00 12.81
12:52:01 AM 0.28 0.00 0.28 0.00 17.44
12:53:01 AM 0.28 0.00 0.28 0.00 13.61
12:54:01 AM 0.37 0.00 0.37 0.00 26.56
12:55:01 AM 0.17 0.00 0.17 0.00 12.95
12:56:01 AM 0.18 0.00 0.18 0.00 22.89
12:57:01 AM 0.23 0.00 0.23 0.00 14.25
12:58:01 AM 0.15 0.00 0.15 0.00 22.93
12:59:01 AM 0.12 0.00 0.12 0.00 12.00
01:00:01 AM 0.23 0.02 0.22 0.13 31.12
01:01:02 AM 0.37 0.02 0.35 0.13 17.92
01:02:01 AM 0.42 0.00 0.42 0.00 12.91
01:03:01 AM 0.15 0.00 0.15 0.00 14.66
01:04:01 AM 0.10 0.00 0.10 0.00 14.33
01:05:01 AM 0.20 0.00 0.20 0.00 16.79
01:06:01 AM 0.22 0.00 0.22 0.00 9.35
01:07:01 AM 0.40 0.00 0.40 0.00 27.93
01:08:01 AM 0.22 0.00 0.22 0.00 16.29
01:09:01 AM 0.15 0.00 0.15 0.00 15.60
01:10:01 AM 0.17 0.00 0.17 0.00 8.91
01:11:01 AM 0.25 0.00 0.25 0.00 17.74
01:12:01 AM 0.33 0.00 0.33 0.00 18.76
01:13:01 AM 0.15 0.00 0.15 0.00 20.26
01:14:01 AM 0.37 0.00 0.37 0.00 23.06
01:15:01 AM 0.20 0.00 0.20 0.00 13.46
01:16:01 AM 0.18 0.00 0.18 0.00 22.98
01:17:01 AM 0.30 0.00 0.30 0.00 16.11
01:18:01 AM 0.17 0.00 0.17 0.00 22.79
01:19:01 AM 0.12 0.00 0.12 0.00 12.81
01:20:01 AM 0.23 0.00 0.23 0.00 128.49
01:21:01 AM 0.38 0.00 0.38 0.00 34.04
01:22:01 AM 0.33 0.00 0.33 0.00 18.53
01:23:01 AM 0.18 0.00 0.18 0.00 11.10
01:24:01 AM 0.13 0.00 0.13 0.00 14.66
01:25:01 AM 0.15 0.00 0.15 0.00 16.29
01:26:01 AM 0.15 0.00 0.15 0.00 15.98
01:27:01 AM 0.25 0.00 0.25 0.00 27.73
01:28:01 AM 0.33 0.00 0.33 0.00 117.56
01:29:01 AM 0.18 0.00 0.18 0.00 38.80
01:30:01 AM 0.13 0.00 0.13 0.00 14.68
01:31:01 AM 0.22 0.00 0.22 0.00 8.03
01:32:01 AM 0.32 0.00 0.32 0.00 18.38
01:33:01 AM 0.15 0.00 0.15 0.00 16.13
01:34:01 AM 0.15 0.00 0.15 0.00 35.86
01:35:01 AM 0.28 0.00 0.28 0.00 80.10
01:36:01 AM 0.30 0.00 0.30 0.00 73.33
01:37:01 AM 0.30 0.00 0.30 0.00 16.91
01:38:01 AM 0.13 0.00 0.13 0.00 8.13
01:39:01 AM 0.13 0.00 0.13 0.00 14.40
01:40:01 AM 0.13 0.00 0.13 0.00 14.53
01:41:01 AM 0.22 0.00 0.22 0.00 17.21
01:42:01 AM 0.53 0.00 0.53 0.00 53.67
01:43:01 AM 0.20 0.00 0.20 0.00 123.98
01:44:01 AM 0.17 0.00 0.17 0.00 16.41
01:45:01 AM 0.17 0.00 0.17 0.00 14.56
01:46:01 AM 0.20 0.00 0.20 0.00 15.08
01:47:01 AM 0.33 0.00 0.33 0.00 13.73
01:48:01 AM 0.15 0.00 0.15 0.00 15.59
01:49:01 AM 0.13 0.00 0.13 0.00 7.77
01:50:01 AM 0.13 0.00 0.13 0.00 23.46
01:51:01 AM 0.28 0.00 0.28 0.00 14.45
01:52:01 AM 0.37 0.00 0.37 0.00 27.60
01:53:01 AM 0.13 0.00 0.13 0.00 11.73
01:54:01 AM 0.13 0.00 0.13 0.00 22.53
01:55:01 AM 0.88 0.00 0.88 0.00 24.41
01:56:01 AM 0.43 0.00 0.43 0.00 35.99
01:57:01 AM 0.27 0.00 0.27 0.00 18.38
01:58:01 AM 0.15 0.00 0.15 0.00 14.70
01:59:01 AM 0.18 0.00 0.18 0.00 9.65
02:00:01 AM 0.13 0.00 0.13 0.00 15.46
02:01:01 AM 0.20 0.00 0.20 0.00 16.14
02:02:01 AM 0.37 0.00 0.37 0.00 12.24
02:03:01 AM 0.18 0.00 0.18 0.00 22.55
02:04:01 AM 0.15 0.00 0.15 0.00 14.66
02:05:01 AM 0.12 0.00 0.12 0.00 7.73
02:06:01 AM 0.17 0.00 0.17 0.00 14.91
02:07:02 AM 0.25 0.00 0.25 0.00 17.04
02:08:01 AM 0.31 0.00 0.31 0.00 19.98
02:09:01 AM 0.38 0.00 0.38 0.00 23.86
02:10:01 AM 0.17 0.00 0.17 0.00 11.45
02:11:01 AM 0.23 0.00 0.23 0.00 18.41
02:12:01 AM 0.27 0.00 0.27 0.00 11.58
02:13:01 AM 0.23 0.00 0.23 0.00 17.19
02:14:01 AM 0.53 0.00 0.53 0.00 17.61
02:15:01 AM 0.20 0.00 0.20 0.00 19.05
02:16:01 AM 0.20 0.00 0.20 0.00 11.23
02:17:01 AM 0.23 0.00 0.23 0.00 19.68
02:18:01 AM 0.27 0.00 0.27 0.00 14.71
02:19:01 AM 0.18 0.00 0.18 0.00 21.18
02:20:01 AM 0.18 0.00 0.18 0.00 18.16
02:21:01 AM 0.27 0.00 0.27 0.00 47.54
02:22:01 AM 0.43 0.00 0.43 0.00 21.81
02:23:01 AM 0.32 0.00 0.32 0.00 15.86
02:24:01 AM 0.17 0.00 0.17 0.00 8.68
02:25:01 AM 0.18 0.00 0.18 0.00 15.49
02:26:01 AM 0.18 0.00 0.18 0.00 16.25
02:27:01 AM 0.33 0.00 0.33 0.00 22.78
02:28:01 AM 0.45 0.00 0.45 0.00 17.74
02:29:01 AM 0.45 0.00 0.45 0.00 13.78
02:30:01 AM 0.42 0.00 0.42 0.00 11.63
02:31:01 AM 0.60 0.00 0.60 0.00 12.50
02:32:01 AM 0.57 0.00 0.57 0.00 13.30
02:33:01 AM 0.38 0.00 0.38 0.00 10.38
02:34:01 AM 0.32 0.00 0.32 0.00 3.87
02:35:01 AM 0.40 0.03 0.37 1.33 7.47
02:36:01 AM 0.40 0.00 0.40 0.00 5.83
02:37:01 AM 0.45 0.00 0.45 0.00 6.52
02:38:01 AM 0.37 0.00 0.37 0.00 8.48
02:39:01 AM 0.33 0.00 0.33 0.00 3.73
02:40:01 AM 0.47 0.00 0.47 0.00 7.97
02:41:01 AM 0.42 0.00 0.42 0.00 7.98
02:42:01 AM 0.53 0.00 0.53 0.00 9.33
02:43:01 AM 0.23 0.00 0.23 0.00 4.38
02:44:01 AM 0.12 0.00 0.12 0.00 4.93
02:45:01 AM 0.13 0.00 0.13 0.00 1.47
02:46:01 AM 0.18 0.00 0.18 0.00 5.32
02:47:01 AM 0.32 0.00 0.32 0.00 12.78
02:48:01 AM 0.20 0.00 0.20 0.00 16.67
02:49:01 AM 0.15 0.00 0.15 0.00 15.06
02:50:01 AM 0.12 0.00 0.12 0.00 7.73
02:51:01 AM 0.20 0.00 0.20 0.00 15.40
02:52:01 AM 0.37 0.00 0.37 0.00 19.59
02:53:01 AM 0.13 0.00 0.13 0.00 18.53
02:54:01 AM 0.48 0.00 0.48 0.00 13.43
02:55:01 AM 0.35 0.00 0.35 0.00 3.77
02:56:01 AM 0.42 0.00 0.42 0.00 5.38
02:57:01 AM 0.47 0.00 0.47 0.00 7.15
02:58:01 AM 0.35 0.00 0.35 0.00 5.03
02:59:01 AM 0.30 0.00 0.30 0.00 3.43
03:00:01 AM 0.33 0.00 0.33 0.00 4.38
03:01:01 AM 0.60 0.00 0.60 0.00 13.20
03:02:01 AM 0.48 0.00 0.48 0.00 10.15
03:03:01 AM 0.15 0.00 0.15 0.00 1.83
03:04:01 AM 0.10 0.00 0.10 0.00 0.75
03:05:01 AM 0.32 0.00 0.32 0.00 6.23
03:06:01 AM 0.20 0.00 0.20 0.00 7.18
03:07:01 AM 0.27 0.00 0.27 0.00 4.80
03:08:01 AM 0.23 0.00 0.23 0.00 6.68
03:09:01 AM 0.20 0.00 0.20 0.00 9.10
03:10:01 AM 0.22 0.00 0.22 0.00 17.19
03:11:01 AM 0.32 0.00 0.32 0.00 14.40
03:12:02 AM 0.67 0.00 0.67 0.00 18.93
03:13:01 AM 0.24 0.00 0.24 0.00 9.81
03:14:01 AM 0.13 0.00 0.13 0.00 12.93
03:15:01 AM 0.23 0.00 0.23 0.00 25.22
03:16:01 AM 0.23 0.00 0.23 0.00 4.65
03:17:01 AM 0.22 0.00 0.22 0.00 3.97
03:18:01 AM 0.15 0.00 0.15 0.00 2.40
03:19:01 AM 0.30 0.00 0.30 0.00 3.55
03:20:00 AM 0.27 0.00 0.27 0.00 3.05
03:21:01 AM 0.20 0.00 0.20 0.00 3.30
03:22:01 AM 0.38 0.00 0.38 0.00 6.00
03:23:01 AM 0.20 0.00 0.20 0.00 7.65
03:24:01 AM 0.17 0.00 0.17 0.00 8.83
03:25:01 AM 0.18 0.00 0.18 0.00 7.62
03:26:01 AM 0.32 0.00 0.32 0.00 14.23
03:27:01 AM 0.22 0.00 0.22 0.00 5.05
03:28:01 AM 0.13 0.00 0.13 0.00 8.67
03:29:01 AM 0.13 0.00 0.13 0.00 7.03
03:30:01 AM 0.17 0.00 0.17 0.00 8.13
03:31:01 AM 10.63 0.30 10.33 34.78 808.03
Average: 0.37 0.03 0.34 2.88 22.19
12:00:01 AM kbmemfree kbavail kbmemused %memused kbbuffers kbcached kbcommit %commit kbactive kbinact kbdirty
12:01:01 AM 4916100 6986312 2966332 37.63 2688 2239464 748832 8.38 265120 2325132 156
12:02:01 AM 4915992 6986636 2966440 37.63 2688 2239896 748832 8.38 265236 2325312 112
12:03:01 AM 4915916 6986932 2966516 37.63 2688 2240260 748832 8.38 265236 2325500 68
12:04:01 AM 4915340 6986716 2967092 37.64 2688 2240620 748832 8.38 265244 2326124 232
12:05:01 AM 4914588 6986604 2967844 37.65 2688 2241260 748832 8.38 265236 2326596 44
12:06:01 AM 4914536 6986908 2967896 37.65 2688 2241616 748832 8.38 265236 2326872 88
12:07:01 AM 4913584 6986440 2968848 37.66 2688 2242100 741040 8.30 265236 2327772 244
12:08:01 AM 4913420 6987024 2969012 37.67 2688 2242864 745112 8.34 265268 2328196 88
12:09:01 AM 4912608 6986700 2969824 37.68 2688 2243344 745112 8.34 265268 2328800 84
12:10:01 AM 4912008 6986584 2970424 37.68 2688 2243836 742532 8.31 265268 2329548 88
12:11:01 AM 4911704 6986904 2970728 37.69 2688 2244448 742532 8.31 265268 2329840 396
12:12:01 AM 4911052 6986260 2971380 37.70 2688 2244456 742532 8.31 265268 2330060 4
12:13:01 AM 4911488 6986876 2970944 37.69 2688 2244640 742532 8.31 265268 2330044 176
12:14:01 AM 4910936 6986696 2971496 37.70 2688 2245016 742532 8.31 265268 2330420 36
12:15:01 AM 4910480 6986604 2971952 37.70 2688 2245380 742532 8.31 265268 2330804 128
12:16:01 AM 4909544 6986040 2972888 37.72 2688 2245744 742532 8.31 265268 2331832 88
12:17:01 AM 4909572 6986436 2972860 37.72 2688 2246120 742532 8.31 265268 2331864 52
12:18:01 AM 4908948 6986172 2973484 37.72 2688 2246480 742532 8.31 265268 2332520 188
12:19:01 AM 4908540 6986152 2973892 37.73 2688 2246860 742532 8.31 265492 2332684 44
12:20:01 AM 4908292 6985984 2974140 37.73 2688 2246940 759252 8.50 265528 2332964 4
12:21:01 AM 4908400 6986104 2974032 37.73 2688 2246952 759252 8.50 265528 2332868 4
12:22:01 AM 4909308 6987484 2973124 37.72 2688 2247424 759252 8.50 265528 2331612 80
12:23:01 AM 4909592 6988128 2972840 37.71 2688 2247784 759252 8.50 265528 2331528 56
12:24:01 AM 4909028 6987936 2973404 37.72 2688 2248164 759252 8.50 265528 2332020 204
12:25:01 AM 4908752 6988020 2973680 37.73 2688 2248524 759252 8.50 265528 2332260 156
12:26:01 AM 4908600 6988240 2973832 37.73 2688 2248888 759252 8.50 265528 2332632 84
12:27:01 AM 4908252 6988248 2974180 37.73 2688 2249252 759252 8.50 265528 2333056 4
12:28:01 AM 4907476 6988148 2974956 37.74 2688 2249920 759252 8.50 265528 2333748 60
12:29:01 AM 4906716 6987808 2975716 37.75 2688 2250340 759252 8.50 265528 2334384 164
12:30:01 AM 4906140 6987700 2976292 37.76 2688 2250808 743752 8.33 265528 2334880 308
12:31:01 AM 4906068 6988064 2976364 37.76 2688 2251244 743752 8.33 265528 2335084 88
12:32:01 AM 4905196 6987684 2977236 37.77 2688 2251736 743752 8.33 265528 2335888 264
12:33:01 AM 4904208 6987376 2978224 37.78 2688 2252416 743752 8.33 265688 2336544 96
12:34:01 AM 4902468 6986308 2979964 37.81 2688 2253092 763140 8.54 265696 2338268 428
12:35:01 AM 4882708 6983836 2999724 38.06 2688 2270312 766076 8.58 267716 2355656 144
12:36:01 AM 4882600 6984100 2999832 38.06 2688 2270676 766076 8.58 267716 2356232 40
12:37:01 AM 4881760 6983612 3000672 38.07 2688 2271036 766076 8.58 267716 2356712 24
12:38:01 AM 4881692 6983920 3000740 38.07 2688 2271412 766076 8.58 267716 2356992 24
12:39:01 AM 4880740 6983332 3001692 38.08 2688 2271776 766076 8.58 267716 2357888 4
12:40:01 AM 4879716 6982676 3002716 38.09 2688 2272136 760188 8.51 267716 2358704 20
12:41:01 AM 4879696 6983128 3002736 38.09 2688 2272612 760188 8.51 267716 2358824 20
12:42:01 AM 4879176 6982972 3003256 38.10 2688 2272976 760188 8.51 267716 2359516 156
12:43:01 AM 4878732 6982896 3003700 38.11 2688 2273336 760188 8.51 267716 2359760 52
12:44:01 AM 4878676 6983204 3003756 38.11 2688 2273700 760188 8.51 267716 2359844 176
12:45:01 AM 4878520 6983416 3003912 38.11 2688 2274076 760188 8.51 267716 2360316 112
12:46:01 AM 4878164 6983428 3004268 38.11 2688 2274436 760188 8.51 267716 2360568 36
12:47:01 AM 4877320 6983260 3005112 38.12 2688 2275120 760188 8.51 267716 2361320 508
12:48:01 AM 4876756 6983080 3005676 38.13 2688 2275496 760188 8.51 267716 2362132 140
12:49:01 AM 4876580 6983260 3005852 38.13 2688 2275856 760188 8.51 267716 2361992 56
12:50:01 AM 4875444 6982488 3006988 38.15 2688 2276220 752256 8.42 267716 2363052 16
12:51:01 AM 4875664 6983084 3006768 38.15 2688 2276580 752256 8.42 267716 2362920 100
12:52:01 AM 4875136 6982916 3007296 38.15 2688 2276948 752256 8.42 267716 2363360 60
12:53:01 AM 4875008 6983416 3007424 38.15 2688 2277568 752256 8.42 267744 2363772 364
12:54:01 AM 4874624 6983384 3007808 38.16 2688 2277928 752256 8.42 267744 2364112 88
12:55:01 AM 4873888 6983136 3008544 38.17 2688 2278424 752256 8.42 267744 2364804 256
12:56:01 AM 4873428 6983164 3009004 38.17 2688 2278904 752256 8.42 267744 2365204 88
12:57:01 AM 4872940 6983096 3009492 38.18 2688 2279316 752256 8.42 267744 2365580 176
12:58:01 AM 4872628 6983272 3009804 38.18 2688 2279804 752256 8.42 267744 2366000 4
12:59:01 AM 4871548 6982668 3010884 38.20 2688 2280296 752256 8.42 267744 2367000 176
01:00:01 AM 4869904 6981832 3012528 38.22 2688 2281088 768480 8.60 267744 2368100 84
01:01:02 AM 4869868 6982184 3012564 38.22 2688 2281460 768480 8.60 267748 2368496 36
01:02:01 AM 4870456 6983124 3011976 38.21 2688 2281820 768480 8.60 267764 2368088 204
01:03:01 AM 4870320 6983364 3012112 38.21 2688 2282196 768480 8.60 267764 2368396 172
01:04:01 AM 4869812 6983224 3012620 38.22 2688 2282564 768480 8.60 267764 2368880 132
01:05:01 AM 4869216 6982988 3013216 38.23 2688 2282924 768480 8.60 267764 2369296 56
01:06:01 AM 4869012 6983160 3013420 38.23 2688 2283324 768480 8.60 267764 2369548 244
01:07:01 AM 4868388 6983084 3014044 38.24 2688 2283848 768480 8.60 267764 2370292 160
01:08:01 AM 4867836 6982912 3014596 38.24 2688 2284228 753056 8.43 267764 2370632 128
01:09:01 AM 4867696 6983132 3014736 38.25 2688 2284588 753056 8.43 267764 2370852 52
01:10:01 AM 4867144 6982940 3015288 38.25 2688 2284948 751916 8.42 267764 2371444 204
01:11:01 AM 4866772 6982944 3015660 38.26 2688 2285312 751916 8.42 267764 2371828 128
01:12:01 AM 4866196 6982744 3016236 38.27 2688 2285688 751916 8.42 267764 2372276 96
01:13:01 AM 4866348 6983488 3016084 38.26 2688 2286288 751916 8.42 267756 2372384 124
01:14:01 AM 4866080 6983696 3016352 38.27 2688 2286780 751916 8.42 267760 2372764 88
01:15:01 AM 4865512 6983620 3016920 38.27 2688 2287260 751916 8.42 267760 2373372 244
01:16:01 AM 4865028 6983624 3017404 38.28 2688 2287756 751916 8.42 267760 2373740 88
01:17:01 AM 4864432 6983520 3018000 38.29 2688 2288240 751916 8.42 267760 2374504 244
01:18:01 AM 4864060 6983648 3018372 38.29 2688 2288732 751916 8.42 267760 2374732 88
01:19:01 AM 4861904 6983528 3020528 38.32 2688 2290792 751916 8.42 267760 2376844 1788
01:20:01 AM 4854688 6979016 3027744 38.41 2688 2293468 763608 8.55 267768 2383736 644
01:21:01 AM 4854024 6978728 3028408 38.42 2688 2293852 763608 8.55 267768 2384456 156
01:22:01 AM 4852644 6977724 3029788 38.44 2688 2294228 763608 8.55 267768 2385956 136
01:23:01 AM 4852504 6977944 3029928 38.44 2688 2294588 763608 8.55 267768 2385984 204
01:24:01 AM 4852224 6978044 3030208 38.44 2688 2294968 763608 8.55 267768 2386480 172
01:25:01 AM 4851356 6977536 3031076 38.45 2688 2295328 763608 8.55 267768 2387060 112
01:26:01 AM 4851000 6977544 3031432 38.46 2688 2295692 779292 8.73 267768 2387572 32
01:27:01 AM 4848592 6977552 3033840 38.49 2688 2298116 779292 8.73 267768 2389840 1732
01:28:01 AM 4843672 6975184 3038760 38.55 2688 2300652 779292 8.73 267768 2394964 820
01:29:01 AM 4843188 6975060 3039244 38.56 2688 2301012 779292 8.73 267768 2395324 68
01:30:01 AM 4842648 6974900 3039784 38.56 2688 2301392 770876 8.63 267768 2396052 36
01:31:01 AM 4842400 6975012 3040032 38.57 2688 2301752 770876 8.63 267768 2396072 204
01:32:01 AM 4842028 6975008 3040404 38.57 2688 2302120 770876 8.63 267768 2396576 172
01:33:01 AM 4841548 6974896 3040884 38.58 2688 2302480 770876 8.63 267768 2397020 84
01:34:01 AM 4840188 6975060 3042244 38.60 2688 2304020 770876 8.63 267768 2398364 580
01:35:01 AM 4836632 6974380 3045800 38.64 2688 2306896 770876 8.63 267768 2401856 1156
01:36:01 AM 4835984 6974768 3046448 38.65 2688 2307916 770876 8.63 267768 2402684 52
01:37:01 AM 4835360 6974520 3047072 38.66 2688 2308292 770876 8.63 267768 2403128 52
01:38:01 AM 4835144 6974672 3047288 38.66 2688 2308660 770876 8.63 267768 2403428 204
01:39:01 AM 4834680 6974584 3047752 38.67 2688 2309036 770876 8.63 267768 2403804 176
01:40:01 AM 4833972 6974248 3048460 38.67 2688 2309396 773292 8.66 267772 2404452 128
01:41:01 AM 4833748 6974388 3048684 38.68 2688 2309760 773292 8.66 267768 2404660 24
01:42:01 AM 4830732 6974392 3051700 38.72 2688 2312800 773292 8.66 267768 2407880 1732
01:43:01 AM 4828196 6974016 3054236 38.75 2688 2314936 773292 8.66 267768 2410340 188
01:44:01 AM 4828292 6974472 3054140 38.75 2688 2315300 773292 8.66 267768 2410388 100
01:45:01 AM 4827988 6974536 3054444 38.75 2688 2315660 773292 8.66 267768 2410660 52
01:46:01 AM 4827604 6974520 3054828 38.75 2688 2316036 773292 8.66 267768 2411132 20
01:47:01 AM 4827032 6974316 3055400 38.76 2688 2316404 773292 8.66 267768 2411572 128
01:48:01 AM 4826836 6974488 3055596 38.76 2688 2316764 773292 8.66 267768 2411756 52
01:49:01 AM 4826052 6974404 3056380 38.77 2688 2317472 773292 8.66 267768 2412572 552
01:50:01 AM 4825116 6973760 3057316 38.79 2688 2317772 752696 8.43 267768 2413292 188
01:51:01 AM 4825148 6974288 3057284 38.79 2688 2318260 752696 8.43 267768 2413484 336
01:52:01 AM 4824772 6974328 3057660 38.79 2688 2318668 752696 8.43 267768 2413968 84
01:53:01 AM 4824400 6974448 3058032 38.80 2688 2319160 752696 8.43 267768 2414272 252
01:54:01 AM 4821804 6972336 3060628 38.83 2688 2319644 751900 8.42 267768 2416960 88
01:55:01 AM 4822372 6973408 3060060 38.82 2688 2320144 784760 8.79 277596 2405436 260
01:56:01 AM 4822220 6974020 3060212 38.82 2688 2320916 763596 8.55 277596 2406220 144
01:57:01 AM 4820824 6972984 3061608 38.84 2688 2321276 763596 8.55 277596 2407660 76
01:58:01 AM 4820832 6973364 3061600 38.84 2688 2321640 763596 8.55 277596 2407868 32
01:59:01 AM 4820480 6973388 3061952 38.85 2688 2322016 763596 8.55 277596 2408316 156
02:00:01 AM 4819724 6972984 3062708 38.85 2688 2322376 768796 8.61 277596 2408784 80
02:01:01 AM 4818160 6971796 3064272 38.87 2688 2322744 768796 8.61 277596 2410012 4
02:02:01 AM 4819060 6973160 3063372 38.86 2688 2323216 768796 8.61 277596 2409492 300
02:03:01 AM 4818708 6973176 3063724 38.87 2688 2323584 768796 8.61 277596 2410008 56
02:04:01 AM 4818544 6973380 3063888 38.87 2688 2323944 768796 8.61 277596 2410288 4
02:05:01 AM 4818100 6973308 3064332 38.88 2688 2324320 768796 8.61 277596 2410544 176
02:06:01 AM 4817932 6973504 3064500 38.88 2688 2324684 768796 8.61 277596 2410904 128
02:07:02 AM 4817276 6973208 3065156 38.89 2688 2325044 768796 8.61 277596 2411332 84
02:08:01 AM 4816656 6973260 3065776 38.89 2688 2325708 768796 8.61 277596 2411936 224
02:09:01 AM 4816424 6973408 3066008 38.90 2688 2326096 768796 8.61 277596 2412420 52
02:10:01 AM 4815624 6972976 3066808 38.91 2688 2326456 751152 8.41 277596 2412916 128
02:11:01 AM 4815516 6973252 3066916 38.91 2688 2326836 751152 8.41 277596 2413064 4
02:12:01 AM 4815068 6973152 3067364 38.91 2688 2327184 751152 8.41 277596 2413496 144
02:13:01 AM 4814784 6973204 3067648 38.92 2688 2327528 751152 8.41 277596 2413760 24
02:14:01 AM 4814320 6973120 3068112 38.92 2688 2327908 766640 8.58 277596 2414140 24
02:15:01 AM 4813972 6973360 3068460 38.93 2688 2328488 766640 8.58 277596 2414728 100
02:16:01 AM 4813728 6973380 3068704 38.93 2688 2328768 766640 8.58 277596 2415108 88
02:17:01 AM 4813144 6973292 3069288 38.94 2688 2329256 766640 8.58 277596 2415672 88
02:18:01 AM 4812852 6973484 3069580 38.94 2688 2329748 766640 8.58 277596 2415972 260
02:19:01 AM 4812108 6973228 3070324 38.95 2688 2330228 766640 8.58 277596 2416460 164
02:20:01 AM 4811368 6972976 3071064 38.96 2688 2330724 769596 8.62 277596 2417180 176
02:21:01 AM 4808208 6971064 3074224 39.00 2688 2331964 786152 8.80 277608 2420376 80
02:22:01 AM 4807744 6970976 3074688 39.01 2688 2332328 786152 8.80 277608 2420936 40
02:23:01 AM 4807304 6970896 3075128 39.01 2688 2332692 786152 8.80 277608 2421108 24
02:24:01 AM 4807024 6970976 3075408 39.02 2688 2333052 786152 8.80 277608 2421456 172
02:25:01 AM 4806748 6971068 3075684 39.02 2688 2333412 786152 8.80 277608 2421720 128
02:26:01 AM 4806200 6970876 3076232 39.03 2688 2333776 786152 8.80 277608 2422180 68
02:27:01 AM 4805616 6970996 3076816 39.03 2688 2334472 786152 8.80 277608 2422952 216
02:28:01 AM 4805604 6971176 3076828 39.03 2688 2334664 786152 8.80 277608 2422964 4
02:29:01 AM 4805324 6971184 3077108 39.04 2688 2334952 786152 8.80 277608 2423252 56
02:30:01 AM 4804644 6970736 3077788 39.05 2688 2335184 776508 8.69 277608 2423716 4
02:31:01 AM 4804708 6970948 3077724 39.05 2688 2335340 776508 8.69 277608 2423768 4
02:32:01 AM 4804408 6970836 3078024 39.05 2688 2335528 776508 8.69 277608 2424260 56
02:33:01 AM 4804140 6970760 3078292 39.05 2688 2335712 776508 8.69 277608 2424288 4
02:34:01 AM 4804300 6970924 3078132 39.05 2688 2335716 776508 8.69 277608 2424300 4
02:35:01 AM 4806248 6973040 3076184 39.03 2688 2335884 776508 8.69 277612 2422312 16
02:36:01 AM 4806308 6973140 3076124 39.03 2688 2335924 776508 8.69 277772 2422084 4
02:37:01 AM 4806220 6973056 3076212 39.03 2688 2335928 776508 8.69 277772 2422272 4
02:38:01 AM 4806160 6973148 3076272 39.03 2688 2336080 776508 8.69 277816 2422196 4
02:39:01 AM 4806100 6973088 3076332 39.03 2688 2336080 776508 8.69 277816 2422192 4
02:40:01 AM 4805100 6972092 3077332 39.04 2688 2336084 776508 8.69 277816 2422816 4
02:41:01 AM 4806148 6973292 3076284 39.03 2688 2336232 776508 8.69 277824 2422340 4
02:42:01 AM 4805892 6973104 3076540 39.03 2688 2336300 776508 8.69 277824 2422484 4
02:43:01 AM 4805564 6972832 3076868 39.03 2688 2336356 776508 8.69 277824 2422884 16
02:44:01 AM 4805776 6973156 3076656 39.03 2688 2336468 760952 8.52 277824 2422580 8
02:45:01 AM 4805780 6973164 3076652 39.03 2688 2336472 760952 8.52 277824 2422584 4
02:46:01 AM 4805500 6973004 3076932 39.04 2688 2336592 760952 8.52 277824 2422708 4
02:47:01 AM 4805148 6973012 3077284 39.04 2688 2336956 779168 8.72 277824 2423252 160
02:48:01 AM 4804712 6972948 3077720 39.05 2688 2337320 779168 8.72 277824 2423580 84
02:49:01 AM 4804544 6973148 3077888 39.05 2688 2337696 779168 8.72 277824 2423808 40
02:50:01 AM 4803956 6972928 3078476 39.05 2688 2338056 800896 8.97 277824 2424512 204
02:51:01 AM 4803640 6972976 3078792 39.06 2688 2338428 781416 8.75 277824 2424716 160
02:52:01 AM 4802988 6972684 3079444 39.07 2688 2338788 781416 8.75 277824 2425288 92
02:53:01 AM 4802260 6972568 3080172 39.08 2688 2339400 781416 8.75 277824 2425968 176
02:54:01 AM 4802852 6973224 3079580 39.07 2688 2339456 781416 8.75 277824 2425748 4
02:55:01 AM 4802468 6972840 3079964 39.07 2688 2339456 781416 8.75 277824 2425752 4
02:56:01 AM 4802716 6973132 3079716 39.07 2688 2339500 781416 8.75 277824 2425664 4
02:57:01 AM 4802600 6973016 3079832 39.07 2688 2339500 781416 8.75 277824 2425748 4
02:58:01 AM 4802688 6973152 3079744 39.07 2688 2339548 781416 8.75 277824 2425728 4
02:59:01 AM 4802716 6973180 3079716 39.07 2688 2339548 781416 8.75 277824 2425732 4
03:00:01 AM 4802212 6972768 3080220 39.08 2688 2339640 762540 8.54 277824 2426060 64
03:01:01 AM 4801420 6972096 3081012 39.09 2688 2339760 762540 8.54 277824 2426532 4
03:02:01 AM 4802168 6972960 3080264 39.08 2688 2339876 762540 8.54 277832 2426244 4
03:03:01 AM 4802260 6973052 3080172 39.08 2688 2339876 762540 8.54 277832 2426056 4
03:04:01 AM 4802168 6973008 3080264 39.08 2688 2339932 762540 8.54 277832 2426108 68
03:05:01 AM 4802088 6972972 3080344 39.08 2688 2339968 762540 8.54 277832 2426148 40
03:06:01 AM 4802208 6973200 3080224 39.08 2688 2340076 762540 8.54 277836 2426252 4
03:07:01 AM 4801936 6972928 3080496 39.08 2688 2340076 762540 8.54 277836 2426320 4
03:08:01 AM 4801876 6972992 3080556 39.08 2688 2340200 762540 8.54 277836 2426496 4
03:09:01 AM 4801756 6973216 3080676 39.08 2688 2340552 778096 8.71 277836 2426728 144
03:10:01 AM 4800940 6972728 3081492 39.09 2688 2340880 778096 8.71 277836 2427288 36
03:11:01 AM 4800776 6972900 3081656 39.10 2688 2341216 778096 8.71 277836 2427520 24
03:12:02 AM 4800684 6973132 3081748 39.10 2688 2341532 778096 8.71 277836 2427796 4
03:13:01 AM 4800352 6973132 3082080 39.10 2688 2341868 778096 8.71 277836 2428160 128
03:14:01 AM 4799860 6972968 3082572 39.11 2688 2342196 778096 8.71 277836 2428372 96
03:15:01 AM 4799344 6973060 3083088 39.11 2688 2342804 778096 8.71 277836 2428980 24
03:16:01 AM 4799404 6973188 3083028 39.11 2688 2342864 778096 8.71 277836 2429168 4
03:17:01 AM 4799388 6973172 3083044 39.11 2688 2342864 778096 8.71 277836 2429124 4
03:18:01 AM 4799472 6973296 3082960 39.11 2688 2342904 762696 8.54 277836 2429096 4
03:19:01 AM 4799512 6973340 3082920 39.11 2688 2342908 762696 8.54 277836 2429100 4
03:20:00 AM 4799636 6973512 3082796 39.11 2688 2342956 762072 8.53 277836 2428916 48
03:21:01 AM 4799416 6973296 3083016 39.11 2688 2342960 762072 8.53 277836 2429152 4
03:22:01 AM 4799012 6973012 3083420 39.12 2688 2343088 762072 8.53 277836 2429336 136
03:23:01 AM 4796728 6970916 3085704 39.15 2688 2343276 780624 8.74 277836 2431528 164
03:24:01 AM 4795916 6970308 3086516 39.16 2688 2343472 798480 8.94 277840 2432068 176
03:25:01 AM 4795932 6970508 3086500 39.16 2688 2343656 815972 9.14 277840 2432172 168
03:26:01 AM 4793232 6968012 3089200 39.19 2688 2343860 833496 9.33 277840 2434604 40
03:27:01 AM 4792604 6967628 3089828 39.20 2688 2344104 849836 9.52 277840 2435060 240
03:28:01 AM 4792364 6967568 3090068 39.20 2688 2344284 867424 9.71 277840 2435260 188
03:29:01 AM 4791744 6967140 3090688 39.21 2688 2344476 867424 9.71 277840 2435664 200
03:30:01 AM 4862680 7042124 3019752 38.31 2688 2348520 662680 7.42 278172 2365592 4032
03:31:01 AM 4865168 6980924 3017264 38.28 2688 2290348 694460 7.78 400392 2263592 134408
Average: 4842968 6977933 3039464 38.56 2688 2304132 766165 8.58 272542 2390903 794
12:00:01 AM IFACE rxpck/s txpck/s rxkB/s txkB/s rxcmp/s txcmp/s rxmcst/s %ifutil
12:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:01:01 AM eth0 26.51 20.89 4.87 2.89 0.00 0.00 0.00 0.00
12:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:02:01 AM eth0 14.59 9.41 3.00 1.84 0.00 0.00 0.00 0.00
12:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:03:01 AM eth0 13.55 9.35 2.73 1.77 0.00 0.00 0.00 0.00
12:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:04:01 AM eth0 14.68 9.78 3.09 2.03 0.00 0.00 0.00 0.00
12:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:05:01 AM eth0 21.48 15.43 4.55 2.81 0.00 0.00 0.00 0.00
12:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:06:01 AM eth0 1.30 0.93 0.29 0.15 0.00 0.00 0.00 0.00
12:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:07:01 AM eth0 1.53 1.12 0.50 0.25 0.00 0.00 0.00 0.00
12:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:08:01 AM eth0 1.42 0.95 0.36 0.18 0.00 0.00 0.00 0.00
12:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:09:01 AM eth0 1.72 1.02 0.40 0.19 0.00 0.00 0.00 0.00
12:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:10:01 AM eth0 1.83 1.25 0.66 0.42 0.00 0.00 0.00 0.00
12:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:11:01 AM eth0 21.50 19.68 3.48 1.83 0.00 0.00 0.00 0.00
12:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:12:01 AM eth0 1.40 0.38 0.52 0.30 0.00 0.00 0.00 0.00
12:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:13:01 AM eth0 11.26 9.10 1.86 1.05 0.00 0.00 0.00 0.00
12:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:14:01 AM eth0 13.65 9.38 2.79 1.78 0.00 0.00 0.00 0.00
12:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:15:01 AM eth0 17.74 9.36 3.22 1.77 0.00 0.00 0.00 0.00
12:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:16:01 AM eth0 14.78 10.03 3.59 2.35 0.00 0.00 0.00 0.00
12:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:17:01 AM eth0 16.71 9.76 3.35 1.91 0.00 0.00 0.00 0.00
12:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:18:01 AM eth0 15.16 9.62 2.85 1.79 0.00 0.00 0.00 0.00
12:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:19:01 AM eth0 13.53 9.21 2.75 1.78 0.00 0.00 0.00 0.00
12:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:20:01 AM eth0 2.83 2.25 0.33 0.15 0.00 0.00 0.00 0.00
12:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:21:01 AM eth0 0.75 0.03 0.03 0.00 0.00 0.00 0.00 0.00
12:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:22:01 AM eth0 18.08 12.26 3.73 2.28 0.00 0.00 0.00 0.00
12:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:23:01 AM eth0 13.63 9.35 2.78 1.81 0.00 0.00 0.00 0.00
12:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:24:01 AM eth0 15.61 9.37 3.08 1.78 0.00 0.00 0.00 0.00
12:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:25:01 AM eth0 14.21 9.55 2.86 1.79 0.00 0.00 0.00 0.00
12:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:26:01 AM eth0 13.60 9.17 2.74 1.76 0.00 0.00 0.00 0.00
12:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:27:01 AM eth0 14.56 9.81 3.05 1.91 0.00 0.00 0.00 0.00
12:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:28:01 AM eth0 23.68 16.16 4.88 3.00 0.00 0.00 0.00 0.00
12:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:29:01 AM eth0 1.83 1.37 0.64 0.41 0.00 0.00 0.00 0.00
12:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:30:01 AM eth0 2.08 1.05 0.40 0.19 0.00 0.00 0.00 0.00
12:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:31:01 AM eth0 4.07 0.78 0.49 0.15 0.00 0.00 0.00 0.00
12:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:32:01 AM eth0 5.95 1.58 1.65 0.85 0.00 0.00 0.00 0.00
12:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:33:01 AM eth0 2.38 1.37 0.95 0.57 0.00 0.00 0.00 0.00
12:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:34:01 AM eth0 19.08 15.46 3.16 1.59 0.00 0.00 0.00 0.00
12:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:35:01 AM eth0 26.57 21.89 5.00 3.05 0.00 0.00 0.00 0.00
12:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:36:01 AM eth0 13.60 9.07 2.82 1.75 0.00 0.00 0.00 0.00
12:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:37:01 AM eth0 14.53 9.90 2.96 1.92 0.00 0.00 0.00 0.00
12:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:38:01 AM eth0 13.71 9.30 2.77 1.77 0.00 0.00 0.00 0.00
12:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:39:01 AM eth0 13.48 9.40 2.76 1.78 0.00 0.00 0.00 0.00
12:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:40:01 AM eth0 14.41 9.67 3.04 2.02 0.00 0.00 0.00 0.00
12:41:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:41:01 AM eth0 16.64 12.35 12.33 1.82 0.00 0.00 0.00 0.00
12:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:42:01 AM eth0 15.28 9.63 3.50 2.22 0.00 0.00 0.00 0.00
12:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:43:01 AM eth0 13.88 9.31 3.01 1.95 0.00 0.00 0.00 0.00
12:44:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:44:01 AM eth0 14.30 9.28 2.86 1.81 0.00 0.00 0.00 0.00
12:45:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:45:01 AM eth0 13.90 9.32 2.79 1.78 0.00 0.00 0.00 0.00
12:46:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:46:01 AM eth0 13.38 9.25 2.72 1.77 0.00 0.00 0.00 0.00
12:47:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:47:01 AM eth0 21.48 16.84 4.16 2.64 0.00 0.00 0.00 0.00
12:48:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:48:01 AM eth0 14.46 9.73 3.05 2.01 0.00 0.00 0.00 0.00
12:49:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:49:01 AM eth0 12.93 9.25 2.68 1.77 0.00 0.00 0.00 0.00
12:50:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:50:01 AM eth0 13.98 9.50 2.98 1.96 0.00 0.00 0.00 0.00
12:51:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:51:01 AM eth0 13.56 9.22 2.79 1.77 0.00 0.00 0.00 0.00
12:52:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:52:01 AM eth0 13.28 9.20 2.82 1.84 0.00 0.00 0.00 0.00
12:53:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:53:01 AM eth0 21.59 14.56 6.67 2.80 0.00 0.00 0.00 0.00
12:54:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:54:01 AM eth0 8.45 5.52 1.42 0.92 0.00 0.00 0.00 0.00
12:55:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:55:01 AM eth0 1.48 1.20 0.60 0.38 0.00 0.00 0.00 0.00
12:56:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:56:01 AM eth0 1.57 1.00 0.37 0.19 0.00 0.00 0.00 0.00
12:57:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:57:01 AM eth0 1.33 0.90 0.43 0.22 0.00 0.00 0.00 0.00
12:58:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:58:01 AM eth0 1.50 0.98 0.37 0.19 0.00 0.00 0.00 0.00
12:59:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
12:59:01 AM eth0 2.05 1.08 0.65 0.37 0.00 0.00 0.00 0.00
01:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:00:01 AM eth0 36.02 31.67 6.27 3.57 0.00 0.00 0.00 0.00
01:01:02 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:01:02 AM eth0 13.98 9.48 2.83 1.80 0.00 0.00 0.00 0.00
01:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:02:01 AM eth0 13.42 9.45 2.85 1.86 0.00 0.00 0.00 0.00
01:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:03:01 AM eth0 14.06 9.68 2.86 1.84 0.00 0.00 0.00 0.00
01:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:04:01 AM eth0 14.11 9.28 2.91 1.77 0.00 0.00 0.00 0.00
01:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:05:01 AM eth0 13.96 9.61 3.05 2.00 0.00 0.00 0.00 0.00
01:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:06:01 AM eth0 12.16 9.10 2.31 1.48 0.00 0.00 0.00 0.00
01:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:07:01 AM eth0 19.11 13.93 3.78 2.35 0.00 0.00 0.00 0.00
01:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:08:01 AM eth0 13.23 9.53 2.97 2.02 0.00 0.00 0.00 0.00
01:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:09:01 AM eth0 13.03 9.22 2.70 1.77 0.00 0.00 0.00 0.00
01:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:10:01 AM eth0 13.03 9.01 2.67 1.75 0.00 0.00 0.00 0.00
01:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:11:01 AM eth0 13.36 9.31 2.70 1.77 0.00 0.00 0.00 0.00
01:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:12:01 AM eth0 14.18 9.98 3.01 1.92 0.00 0.00 0.00 0.00
01:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:13:01 AM eth0 17.78 12.65 3.63 2.30 0.00 0.00 0.00 0.00
01:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:14:01 AM eth0 1.23 0.97 0.35 0.18 0.00 0.00 0.00 0.00
01:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:15:01 AM eth0 1.13 0.93 0.35 0.18 0.00 0.00 0.00 0.00
01:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:16:01 AM eth0 1.55 0.93 0.39 0.18 0.00 0.00 0.00 0.00
01:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:17:01 AM eth0 1.73 1.27 0.74 0.44 0.00 0.00 0.00 0.00
01:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:18:01 AM eth0 1.25 0.93 0.36 0.18 0.00 0.00 0.00 0.00
01:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:19:01 AM eth0 22.70 21.80 4.57 2.14 0.00 0.00 0.00 0.00
01:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:20:01 AM eth0 10.66 10.81 3.20 1.30 0.00 0.00 0.00 0.00
01:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:21:01 AM eth0 14.55 9.90 2.94 1.91 0.00 0.00 0.00 0.00
01:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:22:01 AM eth0 14.65 9.76 3.49 2.22 0.00 0.00 0.00 0.00
01:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:23:01 AM eth0 13.50 9.55 2.77 1.83 0.00 0.00 0.00 0.00
01:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:24:01 AM eth0 16.18 8.90 3.02 1.74 0.00 0.00 0.00 0.00
01:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:25:01 AM eth0 18.11 9.93 4.12 2.53 0.00 0.00 0.00 0.00
01:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:26:01 AM eth0 15.68 9.78 3.88 2.56 0.00 0.00 0.00 0.00
01:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:27:01 AM eth0 11.00 4.45 1.51 0.43 0.00 0.00 0.00 0.00
01:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:28:01 AM eth0 10.25 7.68 1.65 1.12 0.00 0.00 0.00 0.00
01:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:29:01 AM eth0 14.40 9.55 2.90 1.80 0.00 0.00 0.00 0.00
01:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:30:01 AM eth0 13.70 9.32 2.71 1.77 0.00 0.00 0.00 0.00
01:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:31:01 AM eth0 14.28 9.26 2.77 1.77 0.00 0.00 0.00 0.00
01:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:32:01 AM eth0 16.48 9.60 3.35 2.03 0.00 0.00 0.00 0.00
01:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:33:01 AM eth0 15.21 9.80 3.20 2.06 0.00 0.00 0.00 0.00
01:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:34:01 AM eth0 17.80 10.48 2.91 1.64 0.00 0.00 0.00 0.00
01:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:35:01 AM eth0 3.83 2.10 0.43 0.32 0.00 0.00 0.00 0.00
01:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:36:01 AM eth0 16.28 12.23 3.17 2.10 0.00 0.00 0.00 0.00
01:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:37:01 AM eth0 14.03 9.58 2.94 1.85 0.00 0.00 0.00 0.00
01:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:38:01 AM eth0 13.55 9.53 2.71 1.83 0.00 0.00 0.00 0.00
01:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:39:01 AM eth0 14.05 9.60 2.84 1.80 0.00 0.00 0.00 0.00
01:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:40:01 AM eth0 13.45 9.15 2.70 1.76 0.00 0.00 0.00 0.00
01:41:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:41:01 AM eth0 14.55 9.20 2.84 1.76 0.00 0.00 0.00 0.00
01:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:42:01 AM eth0 11.40 6.32 2.37 1.31 0.00 0.00 0.00 0.00
01:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:43:01 AM eth0 14.28 11.10 2.91 1.97 0.00 0.00 0.00 0.00
01:44:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:44:01 AM eth0 15.80 9.27 3.09 1.77 0.00 0.00 0.00 0.00
01:45:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:45:01 AM eth0 13.26 9.33 2.70 1.81 0.00 0.00 0.00 0.00
01:46:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:46:01 AM eth0 13.91 9.47 2.82 1.79 0.00 0.00 0.00 0.00
01:47:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:47:01 AM eth0 13.53 9.25 2.84 1.83 0.00 0.00 0.00 0.00
01:48:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:48:01 AM eth0 13.25 9.28 2.65 1.77 0.00 0.00 0.00 0.00
01:49:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:49:01 AM eth0 25.58 18.00 5.26 3.37 0.00 0.00 0.00 0.00
01:50:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:50:01 AM eth0 1.70 0.85 0.49 0.31 0.00 0.00 0.00 0.00
01:51:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:51:01 AM eth0 1.48 1.05 0.39 0.19 0.00 0.00 0.00 0.00
01:52:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:52:01 AM eth0 1.62 1.00 0.47 0.22 0.00 0.00 0.00 0.00
01:53:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:53:01 AM eth0 1.40 1.00 0.37 0.19 0.00 0.00 0.00 0.00
01:54:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:54:01 AM eth0 1.35 0.95 0.35 0.18 0.00 0.00 0.00 0.00
01:55:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:55:01 AM eth0 7.70 1.02 125.57 0.19 0.00 0.00 0.00 0.00
01:56:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:56:01 AM eth0 36.70 31.67 6.62 3.75 0.00 0.00 0.00 0.00
01:57:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:57:01 AM eth0 13.76 9.52 2.91 1.84 0.00 0.00 0.00 0.00
01:58:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:58:01 AM eth0 13.38 9.50 2.77 1.82 0.00 0.00 0.00 0.00
01:59:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
01:59:01 AM eth0 13.46 9.43 2.72 1.79 0.00 0.00 0.00 0.00
02:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:00:01 AM eth0 14.01 9.32 2.91 1.77 0.00 0.00 0.00 0.00
02:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:01:01 AM eth0 13.33 9.28 2.70 1.77 0.00 0.00 0.00 0.00
02:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:02:01 AM eth0 16.54 12.54 3.21 1.94 0.00 0.00 0.00 0.00
02:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:03:01 AM eth0 13.63 9.42 3.01 1.99 0.00 0.00 0.00 0.00
02:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:04:01 AM eth0 13.30 9.27 2.75 1.77 0.00 0.00 0.00 0.00
02:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:05:01 AM eth0 13.78 9.66 2.81 1.84 0.00 0.00 0.00 0.00
02:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:06:01 AM eth0 13.01 9.13 2.66 1.76 0.00 0.00 0.00 0.00
02:07:02 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:07:02 AM eth0 14.11 9.41 3.26 1.84 0.00 0.00 0.00 0.00
02:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:08:01 AM eth0 20.45 15.84 3.95 2.46 0.00 0.00 0.00 0.00
02:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:09:01 AM eth0 14.50 10.00 3.06 1.90 0.00 0.00 0.00 0.00
02:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:10:01 AM eth0 13.73 9.48 2.81 1.81 0.00 0.00 0.00 0.00
02:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:11:01 AM eth0 13.30 9.28 2.71 1.77 0.00 0.00 0.00 0.00
02:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:12:01 AM eth0 12.93 9.05 2.77 1.81 0.00 0.00 0.00 0.00
02:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:13:01 AM eth0 12.40 8.81 2.53 1.69 0.00 0.00 0.00 0.00
02:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:14:01 AM eth0 13.66 9.50 2.77 1.79 0.00 0.00 0.00 0.00
02:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:15:01 AM eth0 16.53 12.11 3.43 2.18 0.00 0.00 0.00 0.00
02:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:16:01 AM eth0 0.98 0.65 0.22 0.11 0.00 0.00 0.00 0.00
02:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:17:01 AM eth0 1.50 1.15 0.49 0.25 0.00 0.00 0.00 0.00
02:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:18:01 AM eth0 1.27 0.98 0.36 0.19 0.00 0.00 0.00 0.00
02:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:19:01 AM eth0 1.37 1.03 0.36 0.19 0.00 0.00 0.00 0.00
02:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:20:01 AM eth0 1.12 0.95 0.35 0.18 0.00 0.00 0.00 0.00
02:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:21:01 AM eth0 71.45 67.44 11.60 6.07 0.00 0.00 0.00 0.00
02:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:22:01 AM eth0 13.31 9.33 2.82 1.85 0.00 0.00 0.00 0.00
02:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:23:01 AM eth0 13.21 9.13 2.68 1.76 0.00 0.00 0.00 0.00
02:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:24:01 AM eth0 13.28 9.03 2.73 1.75 0.00 0.00 0.00 0.00
02:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:25:01 AM eth0 13.30 9.30 2.70 1.79 0.00 0.00 0.00 0.00
02:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:26:01 AM eth0 13.70 9.28 2.73 1.77 0.00 0.00 0.00 0.00
02:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:27:01 AM eth0 25.86 17.85 5.27 3.32 0.00 0.00 0.00 0.00
02:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:28:01 AM eth0 0.73 0.50 0.17 0.09 0.00 0.00 0.00 0.00
02:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:29:01 AM eth0 0.90 0.67 0.27 0.13 0.00 0.00 0.00 0.00
02:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:30:01 AM eth0 0.73 0.53 0.20 0.11 0.00 0.00 0.00 0.00
02:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:31:01 AM eth0 0.77 0.37 0.16 0.07 0.00 0.00 0.00 0.00
02:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:32:01 AM eth0 2.33 0.68 0.69 0.34 0.00 0.00 0.00 0.00
02:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:33:01 AM eth0 1.33 0.78 0.68 0.47 0.00 0.00 0.00 0.00
02:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:34:01 AM eth0 0.85 0.23 0.29 0.19 0.00 0.00 0.00 0.00
02:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:35:01 AM eth0 5.20 2.90 0.96 0.55 0.00 0.00 0.00 0.00
02:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:36:01 AM eth0 4.78 3.57 0.66 0.30 0.00 0.00 0.00 0.00
02:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:37:01 AM eth0 0.55 0.15 0.15 0.07 0.00 0.00 0.00 0.00
02:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:38:01 AM eth0 6.15 5.80 1.00 0.40 0.00 0.00 0.00 0.00
02:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:39:01 AM eth0 5.33 0.02 0.60 0.00 0.00 0.00 0.00 0.00
02:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:40:01 AM eth0 3.90 2.72 1.13 0.73 0.00 0.00 0.00 0.00
02:41:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:41:01 AM eth0 6.65 6.48 1.10 0.46 0.00 0.00 0.00 0.00
02:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:42:01 AM eth0 10.13 3.85 1.49 0.33 0.00 0.00 0.00 0.00
02:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:43:01 AM eth0 5.63 4.10 0.96 0.46 0.00 0.00 0.00 0.00
02:44:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:44:01 AM eth0 2.98 2.18 0.37 0.15 0.00 0.00 0.00 0.00
02:45:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:45:01 AM eth0 0.50 0.00 0.02 0.00 0.00 0.00 0.00 0.00
02:46:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:46:01 AM eth0 6.42 5.18 1.01 0.59 0.00 0.00 0.00 0.00
02:47:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:47:01 AM eth0 15.89 11.63 3.10 1.89 0.00 0.00 0.00 0.00
02:48:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:48:01 AM eth0 13.98 9.56 3.04 2.03 0.00 0.00 0.00 0.00
02:49:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:49:01 AM eth0 15.44 9.40 2.84 1.79 0.00 0.00 0.00 0.00
02:50:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:50:01 AM eth0 14.80 9.25 3.06 1.95 0.00 0.00 0.00 0.00
02:51:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:51:01 AM eth0 13.71 9.23 2.76 1.77 0.00 0.00 0.00 0.00
02:52:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:52:01 AM eth0 16.76 9.71 3.62 2.22 0.00 0.00 0.00 0.00
02:53:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:53:01 AM eth0 21.05 14.88 4.56 2.91 0.00 0.00 0.00 0.00
02:54:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:54:01 AM eth0 4.72 0.25 0.63 0.04 0.00 0.00 0.00 0.00
02:55:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:55:01 AM eth0 1.20 0.00 0.07 0.00 0.00 0.00 0.00 0.00
02:56:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:56:01 AM eth0 1.28 0.22 0.12 0.03 0.00 0.00 0.00 0.00
02:57:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:57:01 AM eth0 0.77 0.13 0.16 0.07 0.00 0.00 0.00 0.00
02:58:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:58:01 AM eth0 0.98 0.22 0.07 0.03 0.00 0.00 0.00 0.00
02:59:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
02:59:01 AM eth0 0.40 0.02 0.02 0.00 0.00 0.00 0.00 0.00
03:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:00:01 AM eth0 3.05 2.02 0.57 0.39 0.00 0.00 0.00 0.00
03:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:01:01 AM eth0 8.11 7.33 1.35 0.63 0.00 0.00 0.00 0.00
03:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:02:01 AM eth0 2.95 2.28 0.45 0.22 0.00 0.00 0.00 0.00
03:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:03:01 AM eth0 0.78 0.08 0.06 0.00 0.00 0.00 0.00 0.00
03:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:04:01 AM eth0 3.88 3.38 0.53 0.24 0.00 0.00 0.00 0.00
03:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:05:01 AM eth0 2.68 2.53 0.37 0.18 0.00 0.00 0.00 0.00
03:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:06:01 AM eth0 2.50 2.07 0.34 0.15 0.00 0.00 0.00 0.00
03:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:07:01 AM eth0 0.53 0.17 0.15 0.07 0.00 0.00 0.00 0.00
03:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:08:01 AM eth0 6.22 5.17 1.00 0.60 0.00 0.00 0.00 0.00
03:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:09:01 AM eth0 24.43 11.65 17.52 1.78 0.00 0.00 0.00 0.00
03:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:10:01 AM eth0 12.20 8.55 2.46 1.62 0.00 0.00 0.00 0.00
03:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:11:01 AM eth0 12.25 8.57 2.51 1.63 0.00 0.00 0.00 0.00
03:12:02 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:12:02 AM eth0 11.98 8.48 2.56 1.67 0.00 0.00 0.00 0.00
03:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:13:01 AM eth0 12.05 8.42 2.46 1.62 0.00 0.00 0.00 0.00
03:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:14:01 AM eth0 11.65 8.37 2.35 1.59 0.00 0.00 0.00 0.00
03:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:15:01 AM eth0 20.78 14.76 4.30 2.72 0.00 0.00 0.00 0.00
03:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:16:01 AM eth0 0.58 0.22 0.07 0.03 0.00 0.00 0.00 0.00
03:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:17:01 AM eth0 0.53 0.17 0.15 0.07 0.00 0.00 0.00 0.00
03:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:18:01 AM eth0 0.65 0.20 0.05 0.03 0.00 0.00 0.00 0.00
03:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:19:01 AM eth0 0.33 0.00 0.01 0.00 0.00 0.00 0.00 0.00
03:20:00 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:20:00 AM eth0 0.54 0.18 0.05 0.03 0.00 0.00 0.00 0.00
03:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:21:01 AM eth0 0.40 0.03 0.04 0.00 0.00 0.00 0.00 0.00
03:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:22:01 AM eth0 4.28 2.92 0.92 0.60 0.00 0.00 0.00 0.00
03:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:23:01 AM eth0 8.11 6.68 1.46 0.82 0.00 0.00 0.00 0.00
03:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:24:01 AM eth0 7.50 6.30 1.64 0.99 0.00 0.00 0.00 0.00
03:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:25:01 AM eth0 7.65 6.70 1.45 0.79 0.00 0.00 0.00 0.00
03:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:26:01 AM eth0 7.25 5.83 1.52 0.84 0.00 0.00 0.00 0.00
03:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:27:01 AM eth0 8.48 7.13 1.98 0.96 0.00 0.00 0.00 0.00
03:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:28:01 AM eth0 7.43 6.17 1.42 0.78 0.00 0.00 0.00 0.00
03:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:29:01 AM eth0 5.66 4.93 1.24 0.68 0.00 0.00 0.00 0.00
03:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:30:01 AM eth0 17.11 10.73 5.24 1.58 0.00 0.00 0.00 0.00
03:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
03:31:01 AM eth0 131.53 92.17 390.69 424.35 0.00 0.00 0.00 0.00
Average: lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
Average: eth0 11.32 7.90 4.71 3.31 0.00 0.00 0.00 0.00
---> sar -P ALL:
Linux 4.18.0-553.5.1.el8.x86_64 (prd-centos8-robot-2c-8g-3889.novalocal) 03/02/2025 _x86_64_ (2 CPU)
12:00:01 AM CPU %user %nice %system %iowait %steal %idle
12:01:01 AM all 5.09 0.03 0.54 0.03 0.10 94.22
12:01:01 AM 0 5.67 0.03 0.53 0.05 0.10 93.61
12:01:01 AM 1 4.52 0.02 0.54 0.00 0.10 94.83
12:02:01 AM all 4.19 0.00 0.28 0.01 0.09 95.43
12:02:01 AM 0 4.59 0.00 0.33 0.00 0.10 94.97
12:02:01 AM 1 3.78 0.00 0.23 0.02 0.08 95.89
12:03:01 AM all 4.13 0.00 0.33 0.00 0.11 95.44
12:03:01 AM 0 5.94 0.00 0.43 0.00 0.13 93.49
12:03:01 AM 1 2.31 0.00 0.22 0.00 0.08 97.39
12:04:01 AM all 4.26 0.00 0.35 0.00 0.09 95.30
12:04:01 AM 0 6.50 0.00 0.47 0.00 0.12 92.92
12:04:01 AM 1 2.02 0.00 0.23 0.00 0.07 97.68
12:05:01 AM all 5.72 0.00 0.26 0.00 0.08 93.94
12:05:01 AM 0 6.68 0.00 0.30 0.00 0.08 92.93
12:05:01 AM 1 4.75 0.00 0.22 0.00 0.08 94.95
12:06:01 AM all 1.04 0.00 0.10 0.00 0.08 98.78
12:06:01 AM 0 1.07 0.00 0.12 0.00 0.08 98.73
12:06:01 AM 1 1.00 0.00 0.08 0.00 0.08 98.83
12:07:01 AM all 1.34 0.00 0.12 0.00 0.08 98.46
12:07:01 AM 0 1.52 0.00 0.08 0.00 0.05 98.35
12:07:01 AM 1 1.17 0.00 0.15 0.00 0.10 98.58
12:08:01 AM all 1.19 0.00 0.15 0.00 0.10 98.56
12:08:01 AM 0 1.05 0.00 0.15 0.00 0.10 98.70
12:08:01 AM 1 1.34 0.00 0.15 0.00 0.10 98.41
12:09:01 AM all 1.05 0.00 0.13 0.00 0.08 98.73
12:09:01 AM 0 0.80 0.00 0.13 0.00 0.05 99.01
12:09:01 AM 1 1.30 0.00 0.13 0.00 0.12 98.45
12:10:01 AM all 1.29 0.00 0.12 0.00 0.08 98.51
12:10:01 AM 0 1.50 0.00 0.15 0.00 0.08 98.26
12:10:01 AM 1 1.07 0.00 0.08 0.00 0.08 98.76
12:11:01 AM all 2.62 0.00 0.19 0.00 0.09 97.10
12:11:01 AM 0 3.65 0.00 0.18 0.00 0.08 96.08
12:11:01 AM 1 1.59 0.00 0.20 0.00 0.10 98.11
12:11:01 AM CPU %user %nice %system %iowait %steal %idle
12:12:01 AM all 0.53 0.00 0.11 0.00 0.08 99.28
12:12:01 AM 0 0.45 0.00 0.15 0.00 0.12 99.28
12:12:01 AM 1 0.60 0.00 0.07 0.00 0.05 99.28
12:13:01 AM all 1.98 0.00 0.16 0.00 0.09 97.77
12:13:01 AM 0 2.76 0.00 0.18 0.00 0.10 96.96
12:13:01 AM 1 1.20 0.00 0.13 0.00 0.08 98.58
12:14:01 AM all 4.24 0.00 0.17 0.00 0.09 95.51
12:14:01 AM 0 5.61 0.00 0.17 0.00 0.10 94.12
12:14:01 AM 1 2.86 0.00 0.17 0.00 0.08 96.89
12:15:01 AM all 4.39 0.00 0.23 0.00 0.09 95.28
12:15:01 AM 0 6.77 0.00 0.30 0.00 0.08 92.85
12:15:01 AM 1 2.02 0.00 0.17 0.00 0.10 97.71
12:16:01 AM all 4.35 0.00 0.23 0.00 0.08 95.34
12:16:01 AM 0 4.66 0.00 0.22 0.00 0.08 95.04
12:16:01 AM 1 4.05 0.00 0.23 0.00 0.08 95.64
12:17:01 AM all 4.35 0.00 0.18 0.00 0.07 95.41
12:17:01 AM 0 3.86 0.00 0.17 0.00 0.05 95.92
12:17:01 AM 1 4.83 0.00 0.18 0.00 0.08 94.90
12:18:01 AM all 4.19 0.00 0.19 0.00 0.08 95.54
12:18:01 AM 0 3.04 0.00 0.20 0.00 0.08 96.68
12:18:01 AM 1 5.34 0.00 0.18 0.00 0.08 94.40
12:19:01 AM all 4.41 0.00 0.18 0.00 0.08 95.33
12:19:01 AM 0 1.42 0.00 0.13 0.00 0.08 98.36
12:19:01 AM 1 7.41 0.00 0.22 0.00 0.08 92.28
12:20:01 AM all 2.57 0.00 0.22 0.00 0.07 97.14
12:20:01 AM 0 0.60 0.00 0.07 0.00 0.05 99.28
12:20:01 AM 1 4.60 0.00 0.38 0.00 0.09 94.93
12:21:01 AM all 0.28 0.00 0.11 0.01 0.08 99.51
12:21:01 AM 0 0.28 0.00 0.12 0.00 0.08 99.51
12:21:01 AM 1 0.28 0.00 0.10 0.02 0.08 99.52
12:22:01 AM all 3.99 0.00 0.29 0.00 0.08 95.64
12:22:01 AM 0 5.10 0.00 0.38 0.00 0.08 94.43
12:22:01 AM 1 2.88 0.00 0.20 0.00 0.07 96.86
12:22:01 AM CPU %user %nice %system %iowait %steal %idle
12:23:01 AM all 4.30 0.00 0.31 0.00 0.08 95.30
12:23:01 AM 0 3.29 0.00 0.28 0.00 0.07 96.36
12:23:01 AM 1 5.32 0.00 0.33 0.00 0.10 94.25
12:24:01 AM all 4.20 0.00 0.30 0.00 0.08 95.42
12:24:01 AM 0 5.85 0.00 0.37 0.00 0.08 93.70
12:24:01 AM 1 2.56 0.00 0.23 0.00 0.07 97.14
12:25:01 AM all 4.14 0.00 0.33 0.00 0.08 95.46
12:25:01 AM 0 5.59 0.00 0.38 0.00 0.07 93.96
12:25:01 AM 1 2.69 0.00 0.27 0.00 0.08 96.96
12:26:01 AM all 4.14 0.00 0.31 0.00 0.08 95.47
12:26:01 AM 0 5.31 0.00 0.40 0.00 0.08 94.20
12:26:01 AM 1 2.96 0.00 0.22 0.00 0.08 96.74
12:27:01 AM all 4.31 0.00 0.37 0.00 0.08 95.25
12:27:01 AM 0 5.36 0.00 0.43 0.00 0.08 94.12
12:27:01 AM 1 3.26 0.00 0.30 0.00 0.07 96.37
12:28:01 AM all 6.29 0.00 0.34 0.00 0.08 93.28
12:28:01 AM 0 8.60 0.00 0.38 0.00 0.08 90.94
12:28:01 AM 1 3.99 0.00 0.30 0.00 0.08 95.62
12:29:01 AM all 1.17 0.00 0.12 0.00 0.06 98.66
12:29:01 AM 0 0.63 0.00 0.08 0.00 0.05 99.23
12:29:01 AM 1 1.71 0.00 0.15 0.00 0.07 98.08
12:30:01 AM all 1.24 0.00 0.14 0.00 0.08 98.54
12:30:01 AM 0 0.70 0.00 0.10 0.00 0.05 99.15
12:30:01 AM 1 1.79 0.00 0.18 0.00 0.10 97.93
12:31:01 AM all 1.18 0.00 0.13 0.01 0.08 98.60
12:31:01 AM 0 1.80 0.00 0.17 0.02 0.10 97.91
12:31:01 AM 1 0.55 0.00 0.10 0.00 0.07 99.28
12:32:01 AM all 1.32 0.00 0.14 0.00 0.08 98.45
12:32:01 AM 0 1.85 0.00 0.20 0.00 0.10 97.85
12:32:01 AM 1 0.79 0.00 0.08 0.00 0.07 99.06
12:33:01 AM all 1.29 0.00 0.15 0.01 0.06 98.49
12:33:01 AM 0 1.52 0.00 0.15 0.00 0.07 98.26
12:33:01 AM 1 1.07 0.00 0.15 0.02 0.05 98.71
12:33:01 AM CPU %user %nice %system %iowait %steal %idle
12:34:01 AM all 2.72 0.00 0.18 0.00 0.08 97.02
12:34:01 AM 0 4.23 0.00 0.20 0.00 0.10 95.47
12:34:01 AM 1 1.20 0.00 0.15 0.00 0.07 98.58
12:35:01 AM all 5.07 0.23 0.31 0.13 0.08 94.16
12:35:01 AM 0 6.42 0.00 0.27 0.00 0.08 93.23
12:35:01 AM 1 3.73 0.47 0.35 0.27 0.08 95.10
12:36:01 AM all 4.24 0.00 0.18 0.00 0.08 95.50
12:36:01 AM 0 5.48 0.00 0.20 0.00 0.10 94.22
12:36:01 AM 1 2.99 0.00 0.17 0.00 0.07 96.77
12:37:01 AM all 4.29 0.00 0.22 0.00 0.10 95.39
12:37:01 AM 0 6.26 0.00 0.28 0.00 0.10 93.35
12:37:01 AM 1 2.32 0.00 0.15 0.00 0.10 97.43
12:38:01 AM all 4.15 0.00 0.18 0.00 0.08 95.60
12:38:01 AM 0 3.49 0.00 0.17 0.00 0.07 96.27
12:38:01 AM 1 4.80 0.00 0.20 0.00 0.08 94.92
12:39:01 AM all 4.19 0.00 0.19 0.00 0.09 95.53
12:39:01 AM 0 6.37 0.00 0.22 0.00 0.10 93.32
12:39:01 AM 1 2.00 0.00 0.17 0.00 0.08 97.74
12:40:01 AM all 4.22 0.00 0.18 0.00 0.08 95.52
12:40:01 AM 0 2.82 0.00 0.17 0.00 0.07 96.94
12:40:01 AM 1 5.62 0.00 0.20 0.00 0.08 94.09
12:41:01 AM all 6.03 0.00 0.36 0.00 0.08 93.52
12:41:01 AM 0 7.44 0.00 0.48 0.00 0.09 91.99
12:41:01 AM 1 4.66 0.00 0.25 0.00 0.08 95.01
12:42:01 AM all 4.19 0.00 0.23 0.00 0.08 95.51
12:42:01 AM 0 1.89 0.00 0.18 0.00 0.07 97.86
12:42:01 AM 1 6.51 0.00 0.27 0.00 0.08 93.14
12:43:01 AM all 4.19 0.00 0.17 0.00 0.08 95.56
12:43:01 AM 0 3.32 0.00 0.15 0.00 0.07 96.46
12:43:01 AM 1 5.05 0.00 0.18 0.00 0.10 94.66
12:44:01 AM all 4.36 0.00 0.18 0.00 0.09 95.36
12:44:01 AM 0 5.43 0.00 0.20 0.00 0.08 94.29
12:44:01 AM 1 3.29 0.00 0.17 0.00 0.10 96.44
12:44:01 AM CPU %user %nice %system %iowait %steal %idle
12:45:01 AM all 4.20 0.00 0.16 0.00 0.08 95.56
12:45:01 AM 0 1.84 0.00 0.13 0.00 0.08 97.95
12:45:01 AM 1 6.56 0.00 0.18 0.00 0.08 93.17
12:46:01 AM all 4.19 0.00 0.18 0.00 0.08 95.55
12:46:01 AM 0 4.68 0.00 0.20 0.00 0.08 95.04
12:46:01 AM 1 3.71 0.00 0.15 0.00 0.08 96.05
12:47:01 AM all 5.39 0.00 0.25 0.00 0.09 94.27
12:47:01 AM 0 5.01 0.00 0.28 0.00 0.10 94.60
12:47:01 AM 1 5.77 0.00 0.22 0.00 0.08 93.93
12:48:01 AM all 4.33 0.00 0.31 0.00 0.08 95.28
12:48:01 AM 0 6.20 0.00 0.38 0.00 0.08 93.33
12:48:01 AM 1 2.46 0.00 0.23 0.00 0.08 97.23
12:49:01 AM all 4.22 0.00 0.33 0.00 0.08 95.36
12:49:01 AM 0 5.66 0.00 0.43 0.00 0.08 93.82
12:49:01 AM 1 2.77 0.00 0.23 0.00 0.08 96.91
12:50:01 AM all 4.19 0.00 0.34 0.00 0.08 95.39
12:50:01 AM 0 6.10 0.00 0.45 0.00 0.10 93.35
12:50:01 AM 1 2.27 0.00 0.23 0.00 0.07 97.43
12:51:01 AM all 4.20 0.00 0.33 0.01 0.08 95.38
12:51:01 AM 0 6.15 0.00 0.43 0.00 0.07 93.35
12:51:01 AM 1 2.25 0.00 0.23 0.02 0.08 97.41
12:52:01 AM all 4.20 0.00 0.28 0.00 0.08 95.43
12:52:01 AM 0 4.49 0.00 0.27 0.00 0.08 95.16
12:52:01 AM 1 3.91 0.00 0.30 0.00 0.08 95.70
12:53:01 AM all 6.22 0.00 0.39 0.00 0.07 93.32
12:53:01 AM 0 7.59 0.00 0.47 0.00 0.07 91.87
12:53:01 AM 1 4.85 0.00 0.32 0.00 0.07 94.77
12:54:01 AM all 2.00 0.00 0.16 0.00 0.07 97.78
12:54:01 AM 0 2.78 0.00 0.17 0.00 0.08 96.97
12:54:01 AM 1 1.22 0.00 0.15 0.00 0.05 98.58
12:55:01 AM all 1.20 0.00 0.13 0.00 0.06 98.60
12:55:01 AM 0 1.30 0.00 0.13 0.00 0.07 98.50
12:55:01 AM 1 1.10 0.00 0.13 0.00 0.05 98.71
12:55:01 AM CPU %user %nice %system %iowait %steal %idle
12:56:01 AM all 1.28 0.00 0.13 0.00 0.08 98.51
12:56:01 AM 0 1.09 0.00 0.12 0.00 0.07 98.73
12:56:01 AM 1 1.47 0.00 0.15 0.00 0.08 98.30
12:57:01 AM all 1.11 0.00 0.10 0.00 0.07 98.72
12:57:01 AM 0 1.49 0.00 0.13 0.00 0.07 98.31
12:57:01 AM 1 0.74 0.00 0.07 0.00 0.07 99.13
12:58:01 AM all 1.27 0.00 0.12 0.00 0.08 98.54
12:58:01 AM 0 1.85 0.00 0.13 0.00 0.08 97.93
12:58:01 AM 1 0.69 0.00 0.10 0.00 0.07 99.15
12:59:01 AM all 1.35 0.00 0.14 0.00 0.08 98.43
12:59:01 AM 0 1.75 0.00 0.18 0.00 0.10 97.96
12:59:01 AM 1 0.94 0.00 0.10 0.00 0.07 98.90
01:00:01 AM all 5.72 0.00 0.26 0.00 0.08 93.95
01:00:01 AM 0 6.58 0.00 0.32 0.00 0.07 93.03
01:00:01 AM 1 4.85 0.00 0.20 0.00 0.08 94.86
01:01:02 AM all 4.23 0.00 0.20 0.01 0.08 95.49
01:01:02 AM 0 5.18 0.00 0.20 0.02 0.08 94.52
01:01:02 AM 1 3.28 0.00 0.20 0.00 0.07 96.46
01:02:01 AM all 4.27 0.00 0.20 0.00 0.07 95.47
01:02:01 AM 0 6.78 0.00 0.22 0.00 0.08 92.92
01:02:01 AM 1 1.75 0.00 0.17 0.00 0.05 98.03
01:03:01 AM all 4.33 0.00 0.18 0.00 0.08 95.41
01:03:01 AM 0 6.09 0.00 0.18 0.00 0.08 93.65
01:03:01 AM 1 2.57 0.00 0.17 0.00 0.08 97.18
01:04:01 AM all 4.20 0.00 0.15 0.00 0.08 95.56
01:04:01 AM 0 4.51 0.00 0.15 0.00 0.08 95.25
01:04:01 AM 1 3.90 0.00 0.15 0.00 0.08 95.87
01:05:01 AM all 4.24 0.00 0.18 0.00 0.08 95.49
01:05:01 AM 0 4.37 0.00 0.17 0.00 0.08 95.38
01:05:01 AM 1 4.11 0.00 0.20 0.00 0.08 95.61
01:06:01 AM all 5.72 0.00 0.30 0.00 0.07 93.91
01:06:01 AM 0 9.80 0.00 0.43 0.00 0.07 89.71
01:06:01 AM 1 1.75 0.00 0.17 0.00 0.07 98.01
01:06:01 AM CPU %user %nice %system %iowait %steal %idle
01:07:01 AM all 4.82 0.00 0.33 0.00 0.08 94.77
01:07:01 AM 0 6.48 0.00 0.42 0.00 0.08 93.01
01:07:01 AM 1 3.14 0.00 0.25 0.00 0.08 96.52
01:08:01 AM all 4.25 0.00 0.36 0.00 0.09 95.30
01:08:01 AM 0 3.64 0.00 0.30 0.00 0.08 95.97
01:08:01 AM 1 4.86 0.00 0.42 0.00 0.10 94.62
01:09:01 AM all 4.19 0.00 0.33 0.00 0.09 95.40
01:09:01 AM 0 1.84 0.00 0.17 0.00 0.08 97.91
01:09:01 AM 1 6.54 0.00 0.48 0.00 0.10 92.88
01:10:01 AM all 4.19 0.00 0.34 0.00 0.10 95.37
01:10:01 AM 0 3.06 0.00 0.28 0.00 0.10 96.56
01:10:01 AM 1 5.32 0.00 0.40 0.00 0.10 94.18
01:11:01 AM all 4.16 0.00 0.35 0.03 0.08 95.39
01:11:01 AM 0 2.37 0.00 0.25 0.00 0.07 97.31
01:11:01 AM 1 5.95 0.00 0.45 0.05 0.08 93.46
01:12:01 AM all 4.34 0.00 0.33 0.00 0.09 95.24
01:12:01 AM 0 5.05 0.00 0.33 0.00 0.10 94.52
01:12:01 AM 1 3.63 0.00 0.33 0.00 0.08 95.96
01:13:01 AM all 4.85 0.00 0.26 0.00 0.08 94.82
01:13:01 AM 0 4.44 0.00 0.20 0.00 0.07 95.29
01:13:01 AM 1 5.25 0.00 0.32 0.00 0.08 94.35
01:14:01 AM all 1.29 0.00 0.12 0.00 0.08 98.51
01:14:01 AM 0 1.74 0.00 0.15 0.00 0.07 98.05
01:14:01 AM 1 0.85 0.00 0.08 0.00 0.08 98.98
01:15:01 AM all 1.19 0.00 0.13 0.00 0.07 98.62
01:15:01 AM 0 0.80 0.00 0.08 0.00 0.07 99.05
01:15:01 AM 1 1.57 0.00 0.17 0.00 0.07 98.19
01:16:01 AM all 1.25 0.00 0.11 0.00 0.07 98.57
01:16:01 AM 0 1.69 0.00 0.13 0.00 0.07 98.11
01:16:01 AM 1 0.82 0.00 0.08 0.00 0.07 99.03
01:17:01 AM all 1.34 0.00 0.12 0.00 0.08 98.47
01:17:01 AM 0 1.20 0.00 0.10 0.00 0.07 98.63
01:17:01 AM 1 1.47 0.00 0.13 0.00 0.08 98.31
01:17:01 AM CPU %user %nice %system %iowait %steal %idle
01:18:01 AM all 1.25 0.00 0.13 0.00 0.07 98.55
01:18:01 AM 0 0.60 0.00 0.12 0.00 0.07 99.21
01:18:01 AM 1 1.90 0.00 0.15 0.00 0.07 97.88
01:19:01 AM all 4.34 0.00 0.39 0.00 0.08 95.19
01:19:01 AM 0 3.71 0.00 0.23 0.00 0.08 95.97
01:19:01 AM 1 4.97 0.00 0.54 0.00 0.08 94.41
01:20:01 AM all 4.85 0.00 0.46 0.00 0.08 94.60
01:20:01 AM 0 4.36 0.00 0.38 0.00 0.08 95.18
01:20:01 AM 1 5.35 0.00 0.53 0.00 0.08 94.03
01:21:01 AM all 4.55 0.00 0.21 0.01 0.09 95.14
01:21:01 AM 0 5.13 0.00 0.22 0.02 0.08 94.55
01:21:01 AM 1 3.98 0.00 0.20 0.00 0.10 95.72
01:22:01 AM all 4.19 0.00 0.18 0.00 0.08 95.55
01:22:01 AM 0 4.43 0.00 0.20 0.00 0.10 95.27
01:22:01 AM 1 3.95 0.00 0.17 0.00 0.07 95.82
01:23:01 AM all 4.35 0.00 0.17 0.00 0.08 95.40
01:23:01 AM 0 3.29 0.00 0.17 0.00 0.07 96.48
01:23:01 AM 1 5.42 0.00 0.17 0.00 0.08 94.33
01:24:01 AM all 4.18 0.00 0.18 0.00 0.09 95.55
01:24:01 AM 0 4.19 0.00 0.18 0.00 0.08 95.54
01:24:01 AM 1 4.16 0.00 0.17 0.00 0.10 95.57
01:25:01 AM all 4.30 0.00 0.18 0.00 0.08 95.44
01:25:01 AM 0 2.25 0.00 0.17 0.00 0.07 97.51
01:25:01 AM 1 6.34 0.00 0.20 0.00 0.10 93.36
01:26:01 AM all 4.30 0.00 0.19 0.00 0.07 95.44
01:26:01 AM 0 3.81 0.00 0.20 0.00 0.07 95.92
01:26:01 AM 1 4.80 0.00 0.18 0.00 0.07 94.95
01:27:01 AM all 5.84 0.00 0.47 0.00 0.08 93.62
01:27:01 AM 0 9.74 0.00 0.67 0.00 0.09 89.50
01:27:01 AM 1 2.02 0.00 0.27 0.00 0.07 97.64
01:28:01 AM all 5.24 0.00 0.42 0.01 0.07 94.27
01:28:01 AM 0 5.03 0.00 0.33 0.02 0.05 94.57
01:28:01 AM 1 5.45 0.00 0.50 0.00 0.08 93.97
01:28:01 AM CPU %user %nice %system %iowait %steal %idle
01:29:01 AM all 4.24 0.00 0.18 0.00 0.06 95.52
01:29:01 AM 0 4.24 0.00 0.18 0.00 0.07 95.51
01:29:01 AM 1 4.23 0.00 0.18 0.00 0.05 95.53
01:30:01 AM all 4.20 0.00 0.16 0.00 0.08 95.57
01:30:01 AM 0 3.46 0.00 0.15 0.00 0.07 96.32
01:30:01 AM 1 4.93 0.00 0.17 0.00 0.08 94.82
01:31:01 AM all 4.20 0.00 0.16 0.00 0.07 95.57
01:31:01 AM 0 5.97 0.00 0.17 0.00 0.08 93.78
01:31:01 AM 1 2.44 0.00 0.15 0.00 0.05 97.36
01:32:01 AM all 4.20 0.00 0.18 0.00 0.08 95.54
01:32:01 AM 0 6.56 0.00 0.17 0.00 0.08 93.19
01:32:01 AM 1 1.85 0.00 0.18 0.00 0.08 97.88
01:33:01 AM all 4.35 0.00 0.19 0.00 0.08 95.39
01:33:01 AM 0 5.86 0.00 0.22 0.00 0.08 93.84
01:33:01 AM 1 2.83 0.00 0.17 0.00 0.07 96.94
01:34:01 AM all 5.10 0.00 0.31 0.00 0.10 94.49
01:34:01 AM 0 6.53 0.00 0.43 0.00 0.10 92.93
01:34:01 AM 1 3.68 0.00 0.18 0.00 0.10 96.04
01:35:01 AM all 4.01 0.00 0.41 0.01 0.07 95.51
01:35:01 AM 0 1.92 0.00 0.22 0.02 0.05 97.80
01:35:01 AM 1 6.10 0.00 0.60 0.00 0.08 93.21
01:36:01 AM all 5.36 0.00 0.29 0.00 0.08 94.26
01:36:01 AM 0 6.60 0.00 0.37 0.00 0.08 92.95
01:36:01 AM 1 4.13 0.00 0.22 0.00 0.08 95.57
01:37:01 AM all 4.20 0.00 0.18 0.00 0.08 95.55
01:37:01 AM 0 6.77 0.00 0.20 0.00 0.08 92.95
01:37:01 AM 1 1.64 0.00 0.15 0.00 0.07 98.15
01:38:01 AM all 4.37 0.00 0.18 0.00 0.09 95.35
01:38:01 AM 0 2.94 0.00 0.17 0.00 0.08 96.81
01:38:01 AM 1 5.80 0.00 0.20 0.00 0.10 93.90
01:39:01 AM all 4.21 0.00 0.18 0.00 0.06 95.56
01:39:01 AM 0 1.69 0.00 0.17 0.00 0.05 98.09
01:39:01 AM 1 6.73 0.00 0.18 0.00 0.07 93.02
01:39:01 AM CPU %user %nice %system %iowait %steal %idle
01:40:01 AM all 4.26 0.00 0.18 0.00 0.08 95.47
01:40:01 AM 0 2.56 0.00 0.15 0.00 0.08 97.21
01:40:01 AM 1 5.97 0.00 0.22 0.00 0.08 93.73
01:41:01 AM all 4.31 0.00 0.18 0.01 0.11 95.40
01:41:01 AM 0 3.99 0.00 0.18 0.02 0.10 95.71
01:41:01 AM 1 4.63 0.00 0.17 0.00 0.12 95.09
01:42:01 AM all 5.01 0.00 0.45 0.00 0.06 94.48
01:42:01 AM 0 6.21 0.00 0.58 0.00 0.07 93.13
01:42:01 AM 1 3.81 0.00 0.32 0.00 0.05 95.82
01:43:01 AM all 5.64 0.00 0.42 0.00 0.07 93.88
01:43:01 AM 0 7.35 0.00 0.60 0.00 0.07 91.99
01:43:01 AM 1 3.93 0.00 0.23 0.00 0.07 95.77
01:44:01 AM all 4.17 0.00 0.34 0.00 0.07 95.42
01:44:01 AM 0 4.61 0.00 0.33 0.00 0.07 94.98
01:44:01 AM 1 3.73 0.00 0.35 0.00 0.07 95.86
01:45:01 AM all 4.36 0.00 0.34 0.00 0.07 95.24
01:45:01 AM 0 3.19 0.00 0.23 0.00 0.07 96.51
01:45:01 AM 1 5.52 0.00 0.45 0.00 0.07 93.96
01:46:01 AM all 4.27 0.00 0.33 0.01 0.07 95.33
01:46:01 AM 0 5.87 0.00 0.43 0.00 0.07 93.63
01:46:01 AM 1 2.67 0.00 0.22 0.02 0.07 97.02
01:47:01 AM all 4.29 0.00 0.33 0.00 0.08 95.30
01:47:01 AM 0 5.63 0.00 0.38 0.00 0.08 93.90
01:47:01 AM 1 2.94 0.00 0.27 0.00 0.08 96.71
01:48:01 AM all 4.24 0.00 0.35 0.00 0.06 95.35
01:48:01 AM 0 6.33 0.00 0.47 0.00 0.07 93.13
01:48:01 AM 1 2.14 0.00 0.23 0.00 0.05 97.58
01:49:01 AM all 7.06 0.00 0.40 0.00 0.07 92.47
01:49:01 AM 0 10.07 0.00 0.52 0.00 0.07 89.34
01:49:01 AM 1 4.05 0.00 0.28 0.00 0.07 95.60
01:50:01 AM all 0.95 0.00 0.13 0.00 0.06 98.86
01:50:01 AM 0 1.07 0.00 0.08 0.00 0.05 98.80
01:50:01 AM 1 0.84 0.00 0.17 0.00 0.07 98.93
01:50:01 AM CPU %user %nice %system %iowait %steal %idle
01:51:01 AM all 1.29 0.00 0.14 0.01 0.08 98.48
01:51:01 AM 0 1.95 0.00 0.18 0.00 0.08 97.78
01:51:01 AM 1 0.64 0.00 0.10 0.02 0.07 99.18
01:52:01 AM all 1.06 0.00 0.11 0.00 0.06 98.77
01:52:01 AM 0 1.62 0.00 0.13 0.00 0.07 98.18
01:52:01 AM 1 0.50 0.00 0.08 0.00 0.05 99.36
01:53:01 AM all 1.20 0.00 0.14 0.00 0.06 98.60
01:53:01 AM 0 1.00 0.00 0.08 0.00 0.05 98.86
01:53:01 AM 1 1.41 0.00 0.20 0.00 0.07 98.33
01:54:01 AM all 1.33 0.01 0.11 0.00 0.08 98.48
01:54:01 AM 0 1.89 0.02 0.13 0.00 0.08 97.88
01:54:01 AM 1 0.77 0.00 0.08 0.00 0.07 99.08
01:55:01 AM all 1.29 0.16 0.18 0.02 0.08 98.29
01:55:01 AM 0 1.60 0.32 0.20 0.00 0.08 97.80
01:55:01 AM 1 0.97 0.00 0.15 0.03 0.07 98.78
01:56:01 AM all 6.08 0.00 0.28 0.01 0.07 93.56
01:56:01 AM 0 7.07 0.00 0.25 0.00 0.07 92.62
01:56:01 AM 1 5.10 0.00 0.30 0.02 0.07 94.51
01:57:01 AM all 4.27 0.00 0.19 0.00 0.08 95.46
01:57:01 AM 0 4.43 0.00 0.20 0.00 0.08 95.29
01:57:01 AM 1 4.11 0.00 0.18 0.00 0.07 95.64
01:58:01 AM all 4.40 0.00 0.19 0.00 0.08 95.34
01:58:01 AM 0 5.20 0.00 0.20 0.00 0.07 94.54
01:58:01 AM 1 3.59 0.00 0.18 0.00 0.08 96.14
01:59:01 AM all 4.27 0.00 0.15 0.00 0.05 95.53
01:59:01 AM 0 4.63 0.00 0.15 0.00 0.05 95.17
01:59:01 AM 1 3.91 0.00 0.15 0.00 0.05 95.89
02:00:01 AM all 4.19 0.00 0.19 0.00 0.07 95.55
02:00:01 AM 0 5.79 0.00 0.20 0.00 0.07 93.95
02:00:01 AM 1 2.59 0.00 0.18 0.00 0.07 97.16
02:01:01 AM all 4.04 0.00 0.18 0.08 0.07 95.62
02:01:01 AM 0 6.42 0.00 0.20 0.17 0.08 93.13
02:01:01 AM 1 1.66 0.00 0.17 0.00 0.05 98.12
02:01:01 AM CPU %user %nice %system %iowait %steal %idle
02:02:01 AM all 6.17 0.00 0.34 0.00 0.07 93.42
02:02:01 AM 0 9.73 0.00 0.48 0.00 0.05 89.74
02:02:01 AM 1 2.71 0.00 0.20 0.00 0.08 97.01
02:03:01 AM all 4.16 0.00 0.19 0.00 0.05 95.59
02:03:01 AM 0 5.90 0.00 0.22 0.00 0.05 93.83
02:03:01 AM 1 2.42 0.00 0.17 0.00 0.05 97.36
02:04:01 AM all 4.27 0.00 0.16 0.00 0.07 95.50
02:04:01 AM 0 4.75 0.00 0.17 0.00 0.07 95.02
02:04:01 AM 1 3.80 0.00 0.15 0.00 0.07 95.99
02:05:01 AM all 4.42 0.00 0.18 0.00 0.07 95.34
02:05:01 AM 0 3.02 0.00 0.17 0.00 0.07 96.74
02:05:01 AM 1 5.82 0.00 0.18 0.00 0.07 93.93
02:06:01 AM all 4.20 0.00 0.18 0.00 0.07 95.55
02:06:01 AM 0 3.47 0.00 0.17 0.00 0.07 96.29
02:06:01 AM 1 4.92 0.00 0.20 0.00 0.07 94.81
02:07:02 AM all 4.16 0.00 0.18 0.00 0.07 95.58
02:07:02 AM 0 3.75 0.00 0.18 0.00 0.07 96.00
02:07:02 AM 1 4.58 0.00 0.18 0.00 0.07 95.17
02:08:01 AM all 5.31 0.00 0.21 0.01 0.07 94.40
02:08:01 AM 0 4.76 0.00 0.19 0.02 0.07 94.97
02:08:01 AM 1 5.86 0.00 0.24 0.00 0.07 93.84
02:09:01 AM all 4.38 0.00 0.34 0.00 0.06 95.22
02:09:01 AM 0 4.23 0.00 0.33 0.00 0.05 95.39
02:09:01 AM 1 4.53 0.00 0.35 0.00 0.07 95.05
02:10:01 AM all 4.28 0.00 0.29 0.00 0.07 95.36
02:10:01 AM 0 2.61 0.00 0.18 0.00 0.07 97.14
02:10:01 AM 1 5.96 0.00 0.40 0.00 0.07 93.57
02:11:01 AM all 4.17 0.00 0.33 0.00 0.07 95.43
02:11:01 AM 0 4.73 0.00 0.37 0.00 0.07 94.83
02:11:01 AM 1 3.61 0.00 0.30 0.00 0.07 96.02
02:12:01 AM all 4.15 0.00 0.33 0.00 0.06 95.45
02:12:01 AM 0 3.59 0.00 0.32 0.00 0.05 96.04
02:12:01 AM 1 4.71 0.00 0.35 0.00 0.07 94.87
02:12:01 AM CPU %user %nice %system %iowait %steal %idle
02:13:01 AM all 4.10 0.00 0.30 0.00 0.07 95.54
02:13:01 AM 0 2.37 0.00 0.22 0.00 0.07 97.34
02:13:01 AM 1 5.82 0.00 0.38 0.00 0.07 93.72
02:14:01 AM all 4.27 0.00 0.34 0.00 0.08 95.31
02:14:01 AM 0 2.36 0.00 0.22 0.00 0.07 97.36
02:14:01 AM 1 6.19 0.00 0.47 0.00 0.08 93.26
02:15:01 AM all 4.49 0.00 0.23 0.00 0.04 95.23
02:15:01 AM 0 4.92 0.00 0.25 0.00 0.05 94.78
02:15:01 AM 1 4.06 0.00 0.22 0.00 0.03 95.69
02:16:01 AM all 0.80 0.00 0.12 0.08 0.06 98.94
02:16:01 AM 0 1.19 0.00 0.13 0.17 0.07 98.45
02:16:01 AM 1 0.42 0.00 0.10 0.00 0.05 99.43
02:17:01 AM all 1.29 0.00 0.13 0.00 0.07 98.52
02:17:01 AM 0 1.85 0.00 0.13 0.00 0.07 97.95
02:17:01 AM 1 0.72 0.00 0.12 0.00 0.07 99.10
02:18:01 AM all 1.29 0.00 0.13 0.00 0.05 98.54
02:18:01 AM 0 1.92 0.00 0.17 0.00 0.05 97.86
02:18:01 AM 1 0.65 0.00 0.08 0.00 0.05 99.21
02:19:01 AM all 1.33 0.00 0.13 0.00 0.04 98.50
02:19:01 AM 0 1.75 0.00 0.17 0.00 0.05 98.03
02:19:01 AM 1 0.90 0.00 0.10 0.00 0.03 98.96
02:20:01 AM all 1.27 0.00 0.13 0.00 0.06 98.55
02:20:01 AM 0 0.53 0.00 0.08 0.00 0.05 99.33
02:20:01 AM 1 2.01 0.00 0.17 0.00 0.07 97.76
02:21:01 AM all 6.94 0.00 0.57 0.00 0.07 92.42
02:21:01 AM 0 11.28 0.00 0.77 0.00 0.07 87.88
02:21:01 AM 1 2.63 0.00 0.37 0.00 0.07 96.94
02:22:01 AM all 4.31 0.00 0.33 0.00 0.06 95.30
02:22:01 AM 0 5.37 0.00 0.42 0.00 0.07 94.15
02:22:01 AM 1 3.24 0.00 0.25 0.00 0.05 96.46
02:23:01 AM all 4.30 0.00 0.36 0.00 0.06 95.28
02:23:01 AM 0 5.22 0.00 0.42 0.00 0.05 94.31
02:23:01 AM 1 3.38 0.00 0.30 0.00 0.07 96.25
02:23:01 AM CPU %user %nice %system %iowait %steal %idle
02:24:01 AM all 4.17 0.00 0.33 0.00 0.07 95.44
02:24:01 AM 0 3.23 0.00 0.32 0.00 0.07 96.38
02:24:01 AM 1 5.11 0.00 0.33 0.00 0.07 94.49
02:25:01 AM all 4.41 0.00 0.36 0.00 0.06 95.17
02:25:01 AM 0 5.95 0.00 0.47 0.00 0.07 93.51
02:25:01 AM 1 2.88 0.00 0.25 0.00 0.05 96.82
02:26:01 AM all 4.37 0.00 0.33 0.01 0.05 95.23
02:26:01 AM 0 3.84 0.00 0.27 0.00 0.05 95.84
02:26:01 AM 1 4.91 0.00 0.40 0.02 0.05 94.63
02:27:01 AM all 6.75 0.00 0.38 0.00 0.07 92.80
02:27:01 AM 0 8.45 0.00 0.40 0.00 0.07 91.08
02:27:01 AM 1 5.05 0.00 0.37 0.00 0.07 94.51
02:28:01 AM all 0.79 0.00 0.12 0.00 0.04 99.05
02:28:01 AM 0 0.87 0.00 0.13 0.00 0.05 98.95
02:28:01 AM 1 0.72 0.00 0.10 0.00 0.03 99.15
02:29:01 AM all 0.91 0.00 0.13 0.00 0.05 98.91
02:29:01 AM 0 1.05 0.00 0.15 0.00 0.05 98.75
02:29:01 AM 1 0.77 0.00 0.10 0.00 0.05 99.08
02:30:01 AM all 0.79 0.00 0.13 0.00 0.04 99.03
02:30:01 AM 0 0.95 0.00 0.12 0.00 0.05 98.88
02:30:01 AM 1 0.64 0.00 0.15 0.00 0.03 99.18
02:31:01 AM all 0.71 0.00 0.08 0.02 0.04 99.15
02:31:01 AM 0 0.63 0.00 0.08 0.00 0.03 99.25
02:31:01 AM 1 0.79 0.00 0.08 0.03 0.05 99.05
02:32:01 AM all 0.81 0.00 0.12 0.00 0.03 99.04
02:32:01 AM 0 0.87 0.00 0.10 0.00 0.03 99.00
02:32:01 AM 1 0.75 0.00 0.13 0.00 0.03 99.08
02:33:01 AM all 0.78 0.00 0.10 0.00 0.04 99.08
02:33:01 AM 0 0.92 0.00 0.12 0.00 0.05 98.92
02:33:01 AM 1 0.63 0.00 0.08 0.00 0.03 99.25
02:34:01 AM all 0.34 0.00 0.09 0.00 0.03 99.54
02:34:01 AM 0 0.10 0.00 0.07 0.00 0.02 99.82
02:34:01 AM 1 0.58 0.00 0.12 0.00 0.03 99.27
02:34:01 AM CPU %user %nice %system %iowait %steal %idle
02:35:01 AM all 1.50 0.00 0.08 0.05 0.03 98.35
02:35:01 AM 0 2.29 0.00 0.10 0.10 0.03 97.47
02:35:01 AM 1 0.70 0.00 0.07 0.00 0.02 99.22
02:36:01 AM all 0.58 0.00 0.15 0.04 0.03 99.20
02:36:01 AM 0 0.43 0.00 0.20 0.00 0.02 99.35
02:36:01 AM 1 0.72 0.00 0.10 0.08 0.05 99.05
02:37:01 AM all 0.41 0.00 0.07 0.00 0.03 99.49
02:37:01 AM 0 0.17 0.00 0.05 0.00 0.03 99.75
02:37:01 AM 1 0.65 0.00 0.08 0.00 0.03 99.23
02:38:01 AM all 0.84 0.00 0.13 0.00 0.03 99.01
02:38:01 AM 0 0.45 0.00 0.13 0.00 0.03 99.38
02:38:01 AM 1 1.24 0.00 0.12 0.00 0.02 98.63
02:39:01 AM all 0.38 0.00 0.09 0.00 0.04 99.48
02:39:01 AM 0 0.58 0.00 0.05 0.00 0.03 99.33
02:39:01 AM 1 0.18 0.00 0.13 0.00 0.05 99.63
02:40:01 AM all 0.47 0.00 0.08 0.00 0.03 99.42
02:40:01 AM 0 0.38 0.00 0.10 0.00 0.02 99.50
02:40:01 AM 1 0.55 0.00 0.07 0.00 0.03 99.35
02:41:01 AM all 0.57 0.00 0.13 0.01 0.03 99.26
02:41:01 AM 0 0.62 0.00 0.12 0.00 0.02 99.25
02:41:01 AM 1 0.52 0.00 0.15 0.02 0.03 99.28
02:42:01 AM all 0.55 0.00 0.11 0.00 0.06 99.28
02:42:01 AM 0 0.40 0.00 0.12 0.00 0.05 99.43
02:42:01 AM 1 0.70 0.00 0.10 0.00 0.07 99.13
02:43:01 AM all 0.48 0.00 0.14 0.00 0.03 99.36
02:43:01 AM 0 0.33 0.00 0.12 0.00 0.02 99.53
02:43:01 AM 1 0.62 0.00 0.17 0.00 0.03 99.18
02:44:01 AM all 0.61 0.00 0.13 0.00 0.03 99.23
02:44:01 AM 0 0.38 0.00 0.15 0.00 0.03 99.43
02:44:01 AM 1 0.84 0.00 0.10 0.00 0.03 99.03
02:45:01 AM all 0.40 0.00 0.08 0.00 0.03 99.49
02:45:01 AM 0 0.62 0.00 0.05 0.00 0.02 99.32
02:45:01 AM 1 0.18 0.00 0.10 0.00 0.05 99.67
02:45:01 AM CPU %user %nice %system %iowait %steal %idle
02:46:01 AM all 1.11 0.00 0.09 0.00 0.03 98.77
02:46:01 AM 0 1.84 0.00 0.08 0.00 0.03 98.04
02:46:01 AM 1 0.38 0.00 0.10 0.00 0.02 99.50
02:47:01 AM all 4.08 0.00 0.34 0.00 0.06 95.52
02:47:01 AM 0 4.23 0.00 0.40 0.00 0.05 95.32
02:47:01 AM 1 3.93 0.00 0.28 0.00 0.07 95.72
02:48:01 AM all 4.68 0.00 0.35 0.00 0.07 94.90
02:48:01 AM 0 5.60 0.00 0.37 0.00 0.07 93.96
02:48:01 AM 1 3.75 0.00 0.33 0.00 0.07 95.85
02:49:01 AM all 4.38 0.00 0.37 0.00 0.07 95.19
02:49:01 AM 0 1.84 0.00 0.23 0.00 0.05 97.87
02:49:01 AM 1 6.92 0.00 0.50 0.00 0.08 92.49
02:50:01 AM all 4.22 0.00 0.31 0.00 0.05 95.42
02:50:01 AM 0 4.43 0.00 0.32 0.00 0.05 95.20
02:50:01 AM 1 4.00 0.00 0.30 0.00 0.05 95.64
02:51:01 AM all 4.30 0.00 0.37 0.03 0.07 95.24
02:51:01 AM 0 4.95 0.00 0.40 0.05 0.07 94.53
02:51:01 AM 1 3.65 0.00 0.33 0.00 0.07 95.95
02:52:01 AM all 4.26 0.00 0.33 0.00 0.08 95.32
02:52:01 AM 0 5.07 0.00 0.37 0.00 0.08 94.48
02:52:01 AM 1 3.46 0.00 0.30 0.00 0.08 96.15
02:53:01 AM all 5.87 0.00 0.34 0.00 0.07 93.72
02:53:01 AM 0 5.50 0.00 0.35 0.00 0.05 94.10
02:53:01 AM 1 6.24 0.00 0.34 0.00 0.08 93.34
02:54:01 AM all 0.51 0.00 0.09 0.01 0.05 99.34
02:54:01 AM 0 0.70 0.00 0.07 0.00 0.05 99.18
02:54:01 AM 1 0.32 0.00 0.12 0.02 0.05 99.50
02:55:01 AM all 0.29 0.00 0.08 0.00 0.03 99.60
02:55:01 AM 0 0.45 0.00 0.05 0.00 0.02 99.48
02:55:01 AM 1 0.13 0.00 0.10 0.00 0.05 99.72
02:56:01 AM all 0.56 0.00 0.10 0.00 0.04 99.30
02:56:01 AM 0 0.52 0.00 0.08 0.00 0.03 99.37
02:56:01 AM 1 0.60 0.00 0.12 0.00 0.05 99.23
02:56:01 AM CPU %user %nice %system %iowait %steal %idle
02:57:01 AM all 0.30 0.00 0.08 0.00 0.04 99.58
02:57:01 AM 0 0.47 0.00 0.12 0.00 0.05 99.36
02:57:01 AM 1 0.13 0.00 0.03 0.00 0.03 99.80
02:58:01 AM all 0.52 0.00 0.12 0.00 0.04 99.32
02:58:01 AM 0 0.68 0.00 0.10 0.00 0.03 99.18
02:58:01 AM 1 0.35 0.00 0.13 0.00 0.05 99.46
02:59:01 AM all 0.42 0.00 0.09 0.00 0.03 99.46
02:59:01 AM 0 0.18 0.00 0.08 0.00 0.03 99.70
02:59:01 AM 1 0.65 0.00 0.10 0.00 0.03 99.21
03:00:01 AM all 1.25 0.00 0.09 0.00 0.03 98.62
03:00:01 AM 0 1.12 0.00 0.12 0.00 0.03 98.73
03:00:01 AM 1 1.39 0.00 0.07 0.00 0.03 98.51
03:01:01 AM all 0.85 0.00 0.24 0.00 0.03 98.88
03:01:01 AM 0 0.82 0.00 0.35 0.00 0.02 98.81
03:01:01 AM 1 0.89 0.00 0.13 0.00 0.03 98.95
03:02:01 AM all 0.77 0.00 0.10 0.00 0.03 99.10
03:02:01 AM 0 0.83 0.00 0.08 0.00 0.03 99.05
03:02:01 AM 1 0.70 0.00 0.12 0.00 0.03 99.15
03:03:01 AM all 0.38 0.00 0.09 0.00 0.03 99.49
03:03:01 AM 0 0.47 0.00 0.05 0.00 0.03 99.45
03:03:01 AM 1 0.30 0.00 0.13 0.00 0.03 99.53
03:04:01 AM all 0.52 0.00 0.11 0.00 0.03 99.35
03:04:01 AM 0 0.63 0.00 0.12 0.00 0.02 99.23
03:04:01 AM 1 0.40 0.00 0.10 0.00 0.03 99.47
03:05:01 AM all 0.55 0.00 0.13 0.00 0.05 99.27
03:05:01 AM 0 0.42 0.00 0.17 0.00 0.05 99.37
03:05:01 AM 1 0.69 0.00 0.08 0.00 0.05 99.18
03:06:01 AM all 0.53 0.00 0.10 0.00 0.03 99.35
03:06:01 AM 0 0.77 0.00 0.10 0.00 0.02 99.11
03:06:01 AM 1 0.28 0.00 0.10 0.00 0.03 99.58
03:07:01 AM all 0.34 0.00 0.08 0.00 0.03 99.55
03:07:01 AM 0 0.33 0.00 0.08 0.00 0.03 99.55
03:07:01 AM 1 0.35 0.00 0.08 0.00 0.02 99.55
03:07:01 AM CPU %user %nice %system %iowait %steal %idle
03:08:01 AM all 1.10 0.00 0.11 0.00 0.03 98.75
03:08:01 AM 0 1.67 0.00 0.10 0.00 0.03 98.20
03:08:01 AM 1 0.54 0.00 0.12 0.00 0.03 99.31
03:09:01 AM all 3.92 0.00 0.30 0.00 0.06 95.72
03:09:01 AM 0 3.93 0.00 0.30 0.00 0.07 95.70
03:09:01 AM 1 3.90 0.00 0.30 0.00 0.05 95.75
03:10:01 AM all 4.07 0.00 0.29 0.00 0.04 95.60
03:10:01 AM 0 5.03 0.00 0.30 0.00 0.03 94.63
03:10:01 AM 1 3.10 0.00 0.28 0.00 0.05 96.57
03:11:01 AM all 4.01 0.00 0.33 0.01 0.07 95.59
03:11:01 AM 0 4.36 0.00 0.33 0.00 0.07 95.23
03:11:01 AM 1 3.65 0.00 0.32 0.02 0.07 95.95
03:12:02 AM all 3.96 0.00 0.31 0.00 0.05 95.68