Started by upstream project "integration-distribution-weekly-test-trigger-chromium" build number 8
originally caused by:
Started by timer
Running as SYSTEM
[EnvInject] - Loading node environment variables.
Building remotely on prd-ubuntu2404-robot-2c-8g-53985 (ubuntu2404-robot-2c-8g) in workspace /w/workspace/controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium
[ssh-agent] Looking for ssh-agent implementation...
[ssh-agent] Exec ssh-agent (binary ssh-agent on a remote machine)
$ ssh-agent
SSH_AUTH_SOCK=/tmp/ssh-j3jbKlK8ZtWd/agent.45102
SSH_AGENT_PID=45104
[ssh-agent] Started.
Running ssh-add (command line suppressed)
Identity added: /w/workspace/controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium@tmp/private_key_7430056432495873302.key (/w/workspace/controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium@tmp/private_key_7430056432495873302.key)
[ssh-agent] Using credentials jenkins (Release Engineering Jenkins Key)
The recommended git tool is: NONE
using credential opendaylight-jenkins-ssh
Wiping out workspace first.
Cloning the remote Git repository
Cloning repository git://devvexx.opendaylight.org/mirror/integration/test
> git init /w/workspace/controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium/test # timeout=10
Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test
> git --version # timeout=10
> git --version # 'git version 2.43.0'
using GIT_SSH to set credentials Release Engineering Jenkins Key
Verifying host key using known hosts file, will automatically accept unseen keys
> git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10
Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test
using GIT_SSH to set credentials Release Engineering Jenkins Key
Verifying host key using known hosts file, will automatically accept unseen keys
> git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test master # timeout=10
> git rev-parse FETCH_HEAD^{commit} # timeout=10
Checking out Revision 901c7e139945b436d95a44b3b592904c3d7a4f9f (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 901c7e139945b436d95a44b3b592904c3d7a4f9f # timeout=10
Commit message: "Adapt updater.py to use new lsp-flags container"
> git rev-parse FETCH_HEAD^{commit} # timeout=10
> git rev-list --no-walk f65244a2a093016c71f9a7a564be7d086941e15c # timeout=10
No emails were triggered.
provisioning config files...
copy managed file [npmrc] to file:/home/jenkins/.npmrc
copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf
copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
[controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium] $ /bin/bash /tmp/jenkins7655587378656249120.sh
---> python-tools-install.sh
Setup pyenv:
* system (set by /opt/pyenv/version)
* 3.8.20 (set by /opt/pyenv/version)
* 3.9.20 (set by /opt/pyenv/version)
3.10.15
3.11.10
lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-4MXP
lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
lf-activate-venv(): INFO: Attempting to install with network-safe options...
WARNING: Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/packages/setuptools/65.7.0/setuptools-65.7.0-py3-none-any.whl
WARNING: Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/packages/setuptools/65.7.0/setuptools-65.7.0-py3-none-any.whl
WARNING: Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/packages/setuptools/65.7.0/setuptools-65.7.0-py3-none-any.whl
WARNING: Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/packages/setuptools/65.7.0/setuptools-65.7.0-py3-none-any.whl
WARNING: Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/packages/setuptools/65.7.0/setuptools-65.7.0-py3-none-any.whl
lf-activate-venv(): INFO: Base packages installed successfully
lf-activate-venv(): INFO: Installing additional packages: lftools
WARNING: Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/packages/defusedxml/0.7.1/defusedxml-0.7.1-py2.py3-none-any.whl
WARNING: Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/packages/defusedxml/0.7.1/defusedxml-0.7.1-py2.py3-none-any.whl
WARNING: Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/packages/defusedxml/0.7.1/defusedxml-0.7.1-py2.py3-none-any.whl
WARNING: Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/packages/defusedxml/0.7.1/defusedxml-0.7.1-py2.py3-none-any.whl
WARNING: Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/packages/wrapt/2.1.2/wrapt-2.1.2-cp311-cp311-manylinux1_x86_64.manylinux_2_28_x86_64.manylinux_2_5_x86_64.whl
WARNING: Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/packages/wrapt/2.1.2/wrapt-2.1.2-cp311-cp311-manylinux1_x86_64.manylinux_2_28_x86_64.manylinux_2_5_x86_64.whl
WARNING: Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/packages/wrapt/2.1.2/wrapt-2.1.2-cp311-cp311-manylinux1_x86_64.manylinux_2_28_x86_64.manylinux_2_5_x86_64.whl
WARNING: Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/packages/wrapt/2.1.2/wrapt-2.1.2-cp311-cp311-manylinux1_x86_64.manylinux_2_28_x86_64.manylinux_2_5_x86_64.whl
WARNING: Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/packages/wrapt/2.1.2/wrapt-2.1.2-cp311-cp311-manylinux1_x86_64.manylinux_2_28_x86_64.manylinux_2_5_x86_64.whl
WARNING: Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/packages/cryptography/46.0.6/cryptography-46.0.6-cp311-abi3-manylinux_2_34_x86_64.whl
WARNING: Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/packages/cryptography/46.0.6/cryptography-46.0.6-cp311-abi3-manylinux_2_34_x86_64.whl
WARNING: Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/packages/cryptography/46.0.6/cryptography-46.0.6-cp311-abi3-manylinux_2_34_x86_64.whl
WARNING: Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'ProtocolError('Connection aborted.', ConnectionResetError(104, 'Connection reset by peer'))': /repository/PyPi/packages/cryptography/46.0.6/cryptography-46.0.6-cp311-abi3-manylinux_2_34_x86_64.whl
WARNING: Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/packages/cryptography/46.0.6/cryptography-46.0.6-cp311-abi3-manylinux_2_34_x86_64.whl
WARNING: Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/packages/setuptools/82.0.1/setuptools-82.0.1-py3-none-any.whl
WARNING: Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/packages/setuptools/82.0.1/setuptools-82.0.1-py3-none-any.whl
WARNING: Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/packages/setuptools/82.0.1/setuptools-82.0.1-py3-none-any.whl
WARNING: Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/packages/charset-normalizer/3.4.6/charset_normalizer-3.4.6-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl
WARNING: Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/packages/charset-normalizer/3.4.6/charset_normalizer-3.4.6-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl
WARNING: Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/packages/botocore/1.42.78/botocore-1.42.78-py3-none-any.whl
WARNING: Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/packages/botocore/1.42.78/botocore-1.42.78-py3-none-any.whl
WARNING: Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/packages/s3transfer/0.16.0/s3transfer-0.16.0-py3-none-any.whl
WARNING: Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/packages/s3transfer/0.16.0/s3transfer-0.16.0-py3-none-any.whl
WARNING: Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/packages/s3transfer/0.16.0/s3transfer-0.16.0-py3-none-any.whl
lf-activate-venv(): INFO: Adding /tmp/venv-4MXP/bin to PATH
Generating Requirements File
WARNING: Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/packages/osc-lib/2.2.1/osc_lib-2.2.1-py3-none-any.whl
WARNING: Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/packages/osc-lib/2.2.1/osc_lib-2.2.1-py3-none-any.whl
WARNING: Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/packages/osc-lib/2.2.1/osc_lib-2.2.1-py3-none-any.whl
WARNING: Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/packages/simplejson/3.20.2/simplejson-3.20.2-cp311-cp311-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl
WARNING: Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/packages/simplejson/3.20.2/simplejson-3.20.2-cp311-cp311-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl
WARNING: Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/packages/simplejson/3.20.2/simplejson-3.20.2-cp311-cp311-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl
WARNING: Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/packages/simplejson/3.20.2/simplejson-3.20.2-cp311-cp311-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl
WARNING: Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/packages/cmd2/3.4.0/cmd2-3.4.0-py3-none-any.whl
WARNING: Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/packages/cmd2/3.4.0/cmd2-3.4.0-py3-none-any.whl
WARNING: Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/simple/python-heatclient/
WARNING: Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/simple/python-heatclient/
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
httplib2 0.30.2 requires pyparsing<4,>=3.0.4, but you have pyparsing 2.4.7 which is incompatible.
Python 3.11.10
pip 26.0.1 from /tmp/venv-4MXP/lib/python3.11/site-packages/pip (python 3.11)
appdirs==1.4.4
argcomplete==3.6.3
aspy.yaml==1.3.0
attrs==26.1.0
autopage==0.6.0
beautifulsoup4==4.14.3
boto3==1.42.78
botocore==1.42.78
bs4==0.0.2
certifi==2026.2.25
cffi==2.0.0
cfgv==3.5.0
chardet==7.4.0.post2
charset-normalizer==3.4.6
click==8.3.1
cliff==4.13.2
cmd2==3.4.0
cryptography==3.3.2
debtcollector==3.1.0
decorator==5.2.1
defusedxml==0.7.1
Deprecated==1.3.1
distlib==0.4.0
dnspython==2.8.0
docker==7.1.0
dogpile.cache==1.5.0
durationpy==0.10
email-validator==2.3.0
filelock==3.25.2
future==1.0.0
gitdb==4.0.12
GitPython==3.1.46
httplib2==0.30.2
identify==2.6.18
idna==3.11
importlib-resources==1.5.0
iso8601==2.1.0
Jinja2==3.1.6
jmespath==1.1.0
jsonpatch==1.33
jsonpointer==3.1.1
jsonschema==4.26.0
jsonschema-specifications==2025.9.1
keystoneauth1==5.13.1
kubernetes==35.0.0
lftools==0.37.22
lxml==6.0.2
markdown-it-py==4.0.0
MarkupSafe==3.0.3
mdurl==0.1.2
msgpack==1.1.2
multi_key_dict==2.0.3
munch==4.0.0
netaddr==1.3.0
niet==1.4.2
nodeenv==1.10.0
oauth2client==4.1.3
oauthlib==3.3.1
openstacksdk==4.10.0
os-service-types==1.8.2
osc-lib==4.4.0
oslo.config==10.3.0
oslo.context==6.3.0
oslo.i18n==6.7.2
oslo.log==8.1.0
oslo.serialization==5.9.1
oslo.utils==10.0.0
packaging==26.0
pbr==7.0.3
platformdirs==4.9.4
prettytable==3.17.0
psutil==7.2.2
pyasn1==0.6.3
pyasn1_modules==0.4.2
pycparser==3.0
pygerrit2==2.0.15
PyGithub==2.9.0
Pygments==2.20.0
PyJWT==2.12.1
PyNaCl==1.6.2
pyparsing==2.4.7
pyperclip==1.11.0
pyrsistent==0.20.0
python-cinderclient==9.9.0
python-dateutil==2.9.0.post0
python-discovery==1.2.1
python-heatclient==5.1.0
python-jenkins==1.8.3
python-keystoneclient==5.8.0
python-magnumclient==4.10.0
python-openstackclient==9.0.0
python-swiftclient==4.10.0
PyYAML==6.0.3
referencing==0.37.0
requests==2.33.0
requests-oauthlib==2.0.0
requestsexceptions==1.4.0
rfc3986==2.0.0
rich==14.3.3
rich-argparse==1.7.2
rpds-py==0.30.0
rsa==4.9.1
ruamel.yaml==0.19.1
ruamel.yaml.clib==0.2.15
s3transfer==0.16.0
simplejson==3.20.2
six==1.17.0
smmap==5.0.3
soupsieve==2.8.3
stevedore==5.7.0
tabulate==0.10.0
toml==0.10.2
tomlkit==0.14.0
tqdm==4.67.3
typing_extensions==4.15.0
urllib3==1.26.20
virtualenv==21.2.0
wcwidth==0.6.0
websocket-client==1.9.0
wrapt==2.1.2
xdg==6.0.0
xmltodict==1.0.4
yq==3.4.3
[controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium] $ /bin/sh /tmp/jenkins7146405359421366890.sh
---> uv-install.sh
Installing uv/uvx (latest) using shell installer
2026-03-29 23:26:36 URL:https://release-assets.githubusercontent.com/github-production-release-asset/699532645/23829516-dcc2-44de-97ee-6c98471a68af?sp=r&sv=2018-11-09&sr=b&spr=https&se=2026-03-30T00%3A00%3A51Z&rscd=attachment%3B+filename%3Duv-installer.sh&rsct=application%2Foctet-stream&skoid=96c2d410-5711-43a1-aedd-ab1947aa7ab0&sktid=398a6654-997b-47e9-b12b-9515b896b4de&skt=2026-03-29T23%3A00%3A00Z&ske=2026-03-30T00%3A00%3A51Z&sks=b&skv=2018-11-09&sig=CT%2FUUdJ8XB74xJ2xJ%2B%2Btq0uWa%2Fe65vOMEZdNqa%2Bzl1E%3D&jwt=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmVsZWFzZS1hc3NldHMuZ2l0aHVidXNlcmNvbnRlbnQuY29tIiwia2V5Ijoia2V5MSIsImV4cCI6MTc3NDgyNzA1NiwibmJmIjoxNzc0ODI2NzU2LCJwYXRoIjoicmVsZWFzZWFzc2V0cHJvZHVjdGlvbi5ibG9iLmNvcmUud2luZG93cy5uZXQifQ.QD6wHdciua8Ux0cAiginFQckI81t_RCTJ1GFzgXRaCs&response-content-disposition=attachment%3B%20filename%3Duv-installer.sh&response-content-type=application%2Foctet-stream [72114/72114] -> "/tmp/uv-install-ua2x64.sh" [1]
downloading uv 0.11.2 x86_64-unknown-linux-gnu
installing to /home/jenkins/.local/bin
uv
uvx
everything's installed!
To add $HOME/.local/bin to your PATH, either restart your shell or run:
source $HOME/.local/bin/env (sh, bash, zsh)
source $HOME/.local/bin/env.fish (fish)
Adding install location to PATH
---> Validating uv/uvx install
uvx 0.11.2 (x86_64-unknown-linux-gnu)
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties content
OS_STACK_TEMPLATE=csit-2-instance-type.yaml
OS_CLOUD=vex
OS_STACK_NAME=releng-controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium-2
OS_STACK_TEMPLATE_DIR=openstack-hot
[EnvInject] - Variables injected successfully.
provisioning config files...
copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
[controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium] $ /bin/bash /tmp/jenkins5951945200575506341.sh
---> Create parameters file for OpenStack HOT
OpenStack Heat parameters generated
-----------------------------------
parameters:
vm_0_count: '3'
vm_0_flavor: 'v3-standard-4'
vm_0_image: 'ZZCI - Ubuntu 22.04 - builder - x86_64 - 20260301-010217.216'
vm_1_count: '1'
vm_1_flavor: 'v3-standard-2'
vm_1_image: 'ZZCI - Ubuntu 22.04 - mininet-ovs-217 - x86_64 - 20250917-133034.654'
job_name: '60164-2'
silo: 'releng'
[controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium] $ /bin/bash -l /tmp/jenkins15025795722194625369.sh
---> Create HEAT stack
+ source /home/jenkins/lf-env.sh
+ lf-activate-venv --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq
++ mktemp -d /tmp/venv-XXXX
+ lf_venv=/tmp/venv-y8XM
+ local venv_file=/tmp/.os_lf_venv
+ local python=python3
+ local options
+ local set_path=true
+ local install_args=
++ getopt -o np:v: -l no-path,system-site-packages,python:,venv-file: -n lf-activate-venv -- --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq
+ options=' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''urllib3~=1.26.15'\'' '\''yq'\'''
+ eval set -- ' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''urllib3~=1.26.15'\'' '\''yq'\'''
++ set -- --python python3 -- 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq
+ true
+ case $1 in
+ python=python3
+ shift 2
+ true
+ case $1 in
+ shift
+ break
+ case $python in
+ local pkg_list=
+ [[ -d /opt/pyenv ]]
+ echo 'Setup pyenv:'
Setup pyenv:
+ export PYENV_ROOT=/opt/pyenv
+ PYENV_ROOT=/opt/pyenv
+ export PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin
+ PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin
+ pyenv versions
system
3.8.20
3.9.20
3.10.15
* 3.11.10 (set by /w/workspace/controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium/.python-version)
+ command -v pyenv
++ pyenv init - --no-rehash
+ eval 'PATH="$(bash --norc -ec '\''IFS=:; paths=($PATH);
for i in ${!paths[@]}; do
if [[ ${paths[i]} == "'\'''\''/opt/pyenv/shims'\'''\''" ]]; then unset '\''\'\'''\''paths[i]'\''\'\'''\'';
fi; done;
echo "${paths[*]}"'\'')"
export PATH="/opt/pyenv/shims:${PATH}"
export PYENV_SHELL=bash
source '\''/opt/pyenv/libexec/../completions/pyenv.bash'\''
pyenv() {
local command
command="${1:-}"
if [ "$#" -gt 0 ]; then
shift
fi
case "$command" in
rehash|shell)
eval "$(pyenv "sh-$command" "$@")"
;;
*)
command pyenv "$command" "$@"
;;
esac
}'
+++ bash --norc -ec 'IFS=:; paths=($PATH);
for i in ${!paths[@]}; do
if [[ ${paths[i]} == "/opt/pyenv/shims" ]]; then unset '\''paths[i]'\'';
fi; done;
echo "${paths[*]}"'
++ PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin
++ export PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin
++ PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin
++ export PYENV_SHELL=bash
++ PYENV_SHELL=bash
++ source /opt/pyenv/libexec/../completions/pyenv.bash
+++ complete -F _pyenv pyenv
++ lf-pyver python3
++ local py_version_xy=python3
++ local py_version_xyz=
++ pyenv versions
++ local command
++ command=versions
++ '[' 1 -gt 0 ']'
++ shift
++ case "$command" in
++ command pyenv versions
++ sed 's/^[ *]* //'
++ grep -E '^[0-9.]*[0-9]$'
++ awk '{ print $1 }'
++ [[ ! -s /tmp/.pyenv_versions ]]
+++ grep '^3' /tmp/.pyenv_versions
+++ sort -V
+++ tail -n 1
++ py_version_xyz=3.11.10
++ [[ -z 3.11.10 ]]
++ echo 3.11.10
++ return 0
+ pyenv local 3.11.10
+ local command
+ command=local
+ '[' 2 -gt 0 ']'
+ shift
+ case "$command" in
+ command pyenv local 3.11.10
+ for arg in "$@"
+ case $arg in
+ pkg_list+='lftools[openstack] '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='kubernetes '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='niet '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='python-heatclient '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='python-openstackclient '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='python-magnumclient '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='urllib3~=1.26.15 '
+ for arg in "$@"
+ case $arg in
+ pkg_list+='yq '
+ [[ -f /tmp/.os_lf_venv ]]
++ cat /tmp/.os_lf_venv
+ lf_venv=/tmp/venv-4MXP
+ echo 'lf-activate-venv(): INFO: Reuse venv:/tmp/venv-4MXP from' file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-4MXP from file:/tmp/.os_lf_venv
+ echo 'lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)'
lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
+ local 'pip_opts=--upgrade --quiet'
+ pip_opts='--upgrade --quiet --trusted-host pypi.org'
+ pip_opts='--upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org'
+ pip_opts='--upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org'
+ [[ -n '' ]]
+ [[ -n '' ]]
+ echo 'lf-activate-venv(): INFO: Attempting to install with network-safe options...'
lf-activate-venv(): INFO: Attempting to install with network-safe options...
+ /tmp/venv-4MXP/bin/python3 -m pip install --upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org pip 'setuptools<66' virtualenv
+ echo 'lf-activate-venv(): INFO: Base packages installed successfully'
lf-activate-venv(): INFO: Base packages installed successfully
+ [[ -z lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq ]]
+ echo 'lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq '
lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq
+ /tmp/venv-4MXP/bin/python3 -m pip install --upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org --upgrade-strategy eager 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq
WARNING: Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/simple/pynacl/
+ type python3
+ true
+ echo 'lf-activate-venv(): INFO: Adding /tmp/venv-4MXP/bin to PATH'
lf-activate-venv(): INFO: Adding /tmp/venv-4MXP/bin to PATH
+ PATH=/tmp/venv-4MXP/bin:/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin
+ return 0
+ openstack --os-cloud vex limits show --absolute
+--------------------------+---------+
| Name | Value |
+--------------------------+---------+
| maxTotalInstances | -1 |
| maxTotalCores | 450 |
| maxTotalRAMSize | 1000000 |
| maxServerMeta | 128 |
| maxImageMeta | 128 |
| maxPersonality | 5 |
| maxPersonalitySize | 10240 |
| maxTotalKeypairs | 100 |
| maxServerGroups | 10 |
| maxServerGroupMembers | 10 |
| maxTotalFloatingIps | -1 |
| maxSecurityGroups | -1 |
| maxSecurityGroupRules | -1 |
| totalRAMUsed | 106496 |
| totalCoresUsed | 26 |
| totalInstancesUsed | 13 |
| totalFloatingIpsUsed | 0 |
| totalSecurityGroupsUsed | 0 |
| totalServerGroupsUsed | 0 |
| maxTotalVolumes | -1 |
| maxTotalSnapshots | 10 |
| maxTotalVolumeGigabytes | 4096 |
| maxTotalBackups | 10 |
| maxTotalBackupGigabytes | 1000 |
| totalVolumesUsed | 0 |
| totalGigabytesUsed | 0 |
| totalSnapshotsUsed | 0 |
| totalBackupsUsed | 0 |
| totalBackupGigabytesUsed | 0 |
+--------------------------+---------+
+ pushd /opt/ciman/openstack-hot
/opt/ciman/openstack-hot /w/workspace/controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium
+ lftools openstack --os-cloud vex stack create releng-controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium-2 csit-2-instance-type.yaml /w/workspace/controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium/stack-parameters.yaml
Creating stack releng-controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium-2
Waiting to initialize infrastructure...
Stack initialization successful.
------------------------------------
Stack Details
------------------------------------
{'added': None,
'capabilities': [],
'created_at': '2026-03-29T23:27:03Z',
'deleted': None,
'deleted_at': None,
'description': 'No description',
'environment': None,
'environment_files': None,
'files': None,
'files_container': None,
'id': '342d898e-e561-4e81-9dee-9d98ddc86552',
'is_rollback_disabled': True,
'links': [{'href': 'https://orchestration.public.mtl1.vexxhost.net/v1/12c36e260d8e4bb2913965203b1b491f/stacks/releng-controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium-2/342d898e-e561-4e81-9dee-9d98ddc86552',
'rel': 'self'}],
'location': Munch({'cloud': 'vex', 'region_name': 'ca-ymq-1', 'zone': None, 'project': Munch({'id': '12c36e260d8e4bb2913965203b1b491f', 'name': '61975f2c-7c17-4d69-82fa-c3ae420ad6fd', 'domain_id': None, 'domain_name': 'Default'})}),
'name': 'releng-controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium-2',
'notification_topics': [],
'outputs': [{'description': 'IP addresses of the 1st vm types',
'output_key': 'vm_0_ips',
'output_value': ['10.30.170.21',
'10.30.171.237',
'10.30.170.243']},
{'description': 'IP addresses of the 2nd vm types',
'output_key': 'vm_1_ips',
'output_value': ['10.30.171.72']}],
'owner_id': ****,
'parameters': {'OS::project_id': '12c36e260d8e4bb2913965203b1b491f',
'OS::stack_id': '342d898e-e561-4e81-9dee-9d98ddc86552',
'OS::stack_name': 'releng-controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium-2',
'job_name': '60164-2',
'silo': 'releng',
'vm_0_count': '3',
'vm_0_flavor': 'v3-standard-4',
'vm_0_image': 'ZZCI - Ubuntu 22.04 - builder - x86_64 - '
'20260301-010217.216',
'vm_1_count': '1',
'vm_1_flavor': 'v3-standard-2',
'vm_1_image': 'ZZCI - Ubuntu 22.04 - mininet-ovs-217 - x86_64 '
'- 20250917-133034.654'},
'parent_id': None,
'replaced': None,
'status': 'CREATE_COMPLETE',
'status_reason': 'Stack CREATE completed successfully',
'tags': [],
'template': None,
'template_description': 'No description',
'template_url': None,
'timeout_mins': 15,
'unchanged': None,
'updated': None,
'updated_at': None,
'user_project_id': '4ad9061f45f64338a3c0ab3d0c0e0f84'}
------------------------------------
+ popd
/w/workspace/controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium
[controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium] $ /bin/bash -l /tmp/jenkins2420038054620138615.sh
---> Copy SSH public keys to CSIT lab
Setup pyenv:
system
3.8.20
3.9.20
3.10.15
* 3.11.10 (set by /w/workspace/controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-4MXP from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
lf-activate-venv(): INFO: Attempting to install with network-safe options...
WARNING: Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/simple/pip/
WARNING: Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/simple/pip/
WARNING: Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/simple/pip/
WARNING: Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/packages/setuptools/65.7.0/setuptools-65.7.0-py3-none-any.whl
WARNING: Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/packages/setuptools/65.7.0/setuptools-65.7.0-py3-none-any.whl
lf-activate-venv(): INFO: Base packages installed successfully
lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes python-heatclient python-openstackclient urllib3~=1.26.15
lf-activate-venv(): INFO: Adding /tmp/venv-4MXP/bin to PATH
SSH not responding on 10.30.170.243. Retrying in 10 seconds...
SSH not responding on 10.30.171.237. Retrying in 10 seconds...
SSH not responding on 10.30.170.21. Retrying in 10 seconds...
Warning: Permanently added '10.30.171.72' (ED25519) to the list of known hosts.
releng-60164-2-1-mininet-ovs-217-0
Successfully copied public keys to slave 10.30.171.72
Ping to 10.30.170.243 successful.
Ping to 10.30.171.237 successful.
Ping to 10.30.170.21 successful.
Warning: Permanently added '10.30.170.243' (ED25519) to the list of known hosts.
Warning: Permanently added '10.30.171.237' (ED25519) to the list of known hosts.
Warning: Permanently added '10.30.170.21' (ED25519) to the list of known hosts.
releng-60164-2-0-builder-2
Successfully copied public keys to slave 10.30.170.243
releng-60164-2-0-builder-1
Successfully copied public keys to slave 10.30.171.237
releng-60164-2-0-builder-0
Successfully copied public keys to slave 10.30.170.21
Process 46687 ready.
Process 46688 ready.
Process 46689 ready.
Process 46693 ready.
SSH ready on all stack servers.
[controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium] $ /bin/bash -l /tmp/jenkins1830739549866973158.sh
Setup pyenv:
system
3.8.20
3.9.20
3.10.15
* 3.11.10 (set by /w/workspace/controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium/.python-version)
lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-SWMY
lf-activate-venv(): INFO: Save venv in file: /w/workspace/controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium/.robot_venv
lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
lf-activate-venv(): INFO: Attempting to install with network-safe options...
WARNING: Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/packages/pip/26.0.1/pip-26.0.1-py3-none-any.whl
WARNING: Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/packages/pip/26.0.1/pip-26.0.1-py3-none-any.whl
WARNING: Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/packages/pip/26.0.1/pip-26.0.1-py3-none-any.whl
lf-activate-venv(): INFO: Base packages installed successfully
lf-activate-venv(): INFO: Installing additional packages: setuptools wheel
lf-activate-venv(): INFO: Adding /tmp/venv-SWMY/bin to PATH
+ echo 'Installing Python Requirements'
Installing Python Requirements
+ cat
+ python -m pip install -r requirements.txt
Looking in indexes: https://nexus3.opendaylight.org/repository/PyPi/simple
Collecting docker-py (from -r requirements.txt (line 1))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/docker-py/1.10.6/docker_py-1.10.6-py2.py3-none-any.whl (50 kB)
Collecting ipaddr (from -r requirements.txt (line 2))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/ipaddr/2.2.0/ipaddr-2.2.0.tar.gz (26 kB)
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing metadata (pyproject.toml): started
Preparing metadata (pyproject.toml): finished with status 'done'
Collecting netaddr (from -r requirements.txt (line 3))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/netaddr/1.3.0/netaddr-1.3.0-py3-none-any.whl (2.3 MB)
Collecting netifaces (from -r requirements.txt (line 4))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/netifaces/0.11.0/netifaces-0.11.0.tar.gz (30 kB)
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing metadata (pyproject.toml): started
Preparing metadata (pyproject.toml): finished with status 'done'
Collecting pyhocon (from -r requirements.txt (line 5))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyhocon/0.3.63/pyhocon-0.3.63.tar.gz (307 kB)
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing metadata (pyproject.toml): started
Preparing metadata (pyproject.toml): finished with status 'done'
Collecting requests (from -r requirements.txt (line 6))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/requests/2.33.0/requests-2.33.0-py3-none-any.whl (65 kB)
Collecting robotframework (from -r requirements.txt (line 7))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework/7.4.2/robotframework-7.4.2-py3-none-any.whl (807 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 807.1/807.1 kB 17.1 MB/s 0:00:00
Collecting robotframework-httplibrary (from -r requirements.txt (line 8))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-httplibrary/0.4.2/robotframework-httplibrary-0.4.2.tar.gz (9.1 kB)
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing metadata (pyproject.toml): started
Preparing metadata (pyproject.toml): finished with status 'done'
Collecting robotframework-requests==0.9.7 (from -r requirements.txt (line 9))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-requests/0.9.7/robotframework_requests-0.9.7-py3-none-any.whl (21 kB)
Collecting robotframework-selenium2library (from -r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-selenium2library/3.0.0/robotframework_selenium2library-3.0.0-py2.py3-none-any.whl (6.2 kB)
Collecting robotframework-sshlibrary==3.8.0 (from -r requirements.txt (line 11))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-sshlibrary/3.8.0/robotframework-sshlibrary-3.8.0.tar.gz (51 kB)
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing metadata (pyproject.toml): started
Preparing metadata (pyproject.toml): finished with status 'done'
Collecting scapy (from -r requirements.txt (line 12))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/scapy/2.7.0/scapy-2.7.0-py3-none-any.whl (2.6 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.6/2.6 MB 37.4 MB/s 0:00:00
WARNING: Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'ProtocolError('Connection aborted.', RemoteDisconnected('Remote end closed connection without response'))': /repository/PyPi/simple/jsonpath-rw/
Collecting jsonpath-rw (from -r requirements.txt (line 15))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpath-rw/1.4.0/jsonpath-rw-1.4.0.tar.gz (13 kB)
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing metadata (pyproject.toml): started
Preparing metadata (pyproject.toml): finished with status 'done'
Collecting elasticsearch (from -r requirements.txt (line 18))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch/9.3.0/elasticsearch-9.3.0-py3-none-any.whl (979 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 979.4/979.4 kB 13.4 MB/s 0:00:00
Collecting elasticsearch-dsl (from -r requirements.txt (line 19))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch-dsl/8.18.0/elasticsearch_dsl-8.18.0-py3-none-any.whl (10 kB)
Collecting pyangbind (from -r requirements.txt (line 22))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyangbind/0.8.7/pyangbind-0.8.7-py3-none-any.whl (52 kB)
Collecting isodate (from -r requirements.txt (line 25))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/isodate/0.7.2/isodate-0.7.2-py3-none-any.whl (22 kB)
Collecting jmespath (from -r requirements.txt (line 28))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jmespath/1.1.0/jmespath-1.1.0-py3-none-any.whl (20 kB)
Collecting jsonpatch (from -r requirements.txt (line 31))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpatch/1.33/jsonpatch-1.33-py2.py3-none-any.whl (12 kB)
Collecting paramiko>=1.15.3 (from robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/paramiko/4.0.0/paramiko-4.0.0-py3-none-any.whl (223 kB)
Collecting scp>=0.13.0 (from robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/scp/0.15.0/scp-0.15.0-py2.py3-none-any.whl (8.8 kB)
Collecting docker-pycreds>=0.2.1 (from docker-py->-r requirements.txt (line 1))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/docker-pycreds/0.4.0/docker_pycreds-0.4.0-py2.py3-none-any.whl (9.0 kB)
Collecting six>=1.4.0 (from docker-py->-r requirements.txt (line 1))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/six/1.17.0/six-1.17.0-py2.py3-none-any.whl (11 kB)
Collecting websocket-client>=0.32.0 (from docker-py->-r requirements.txt (line 1))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/websocket-client/1.9.0/websocket_client-1.9.0-py3-none-any.whl (82 kB)
Collecting pyparsing>=3.0.0 (from pyhocon->-r requirements.txt (line 5))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pyparsing/3.3.2/pyparsing-3.3.2-py3-none-any.whl (122 kB)
Collecting charset_normalizer<4,>=2 (from requests->-r requirements.txt (line 6))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/charset-normalizer/3.4.6/charset_normalizer-3.4.6-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl (204 kB)
Collecting idna<4,>=2.5 (from requests->-r requirements.txt (line 6))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/idna/3.11/idna-3.11-py3-none-any.whl (71 kB)
Collecting urllib3<3,>=1.26 (from requests->-r requirements.txt (line 6))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/urllib3/2.6.3/urllib3-2.6.3-py3-none-any.whl (131 kB)
Collecting certifi>=2023.5.7 (from requests->-r requirements.txt (line 6))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/certifi/2026.2.25/certifi-2026.2.25-py3-none-any.whl (153 kB)
Collecting webtest>=2.0 (from robotframework-httplibrary->-r requirements.txt (line 8))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/webtest/3.0.7/webtest-3.0.7-py3-none-any.whl (32 kB)
Collecting jsonpointer (from robotframework-httplibrary->-r requirements.txt (line 8))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpointer/3.1.1/jsonpointer-3.1.1-py3-none-any.whl (7.7 kB)
Collecting robotframework-seleniumlibrary>=3.0.0 (from robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-seleniumlibrary/6.8.0/robotframework_seleniumlibrary-6.8.0-py3-none-any.whl (104 kB)
Collecting ply (from jsonpath-rw->-r requirements.txt (line 15))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/ply/3.11/ply-3.11-py2.py3-none-any.whl (49 kB)
Collecting decorator (from jsonpath-rw->-r requirements.txt (line 15))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/decorator/5.2.1/decorator-5.2.1-py3-none-any.whl (9.2 kB)
Collecting anyio (from elasticsearch->-r requirements.txt (line 18))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/anyio/4.13.0/anyio-4.13.0-py3-none-any.whl (114 kB)
Collecting elastic-transport<10,>=9.2.0 (from elasticsearch->-r requirements.txt (line 18))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elastic-transport/9.2.1/elastic_transport-9.2.1-py3-none-any.whl (65 kB)
Collecting python-dateutil (from elasticsearch->-r requirements.txt (line 18))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/python-dateutil/2.9.0.post0/python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB)
Collecting sniffio (from elasticsearch->-r requirements.txt (line 18))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/sniffio/1.3.1/sniffio-1.3.1-py3-none-any.whl (10 kB)
Collecting typing-extensions (from elasticsearch->-r requirements.txt (line 18))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/typing-extensions/4.15.0/typing_extensions-4.15.0-py3-none-any.whl (44 kB)
Collecting elasticsearch (from -r requirements.txt (line 18))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch/8.19.3/elasticsearch-8.19.3-py3-none-any.whl (952 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 952.8/952.8 kB 24.2 MB/s 0:00:00
INFO: pip is looking at multiple versions of elasticsearch-dsl to determine which version is compatible with other requirements. This could take a while.
Collecting elasticsearch-dsl (from -r requirements.txt (line 19))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch-dsl/8.17.1/elasticsearch_dsl-8.17.1-py3-none-any.whl (158 kB)
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch-dsl/8.17.0/elasticsearch_dsl-8.17.0-py3-none-any.whl (158 kB)
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch-dsl/8.16.0/elasticsearch_dsl-8.16.0-py3-none-any.whl (158 kB)
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch-dsl/8.15.4/elasticsearch_dsl-8.15.4-py3-none-any.whl (104 kB)
Collecting elastic-transport<9,>=8.15.1 (from elasticsearch->-r requirements.txt (line 18))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elastic-transport/8.17.1/elastic_transport-8.17.1-py3-none-any.whl (64 kB)
Collecting pyang (from pyangbind->-r requirements.txt (line 22))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyang/2.7.1/pyang-2.7.1-py2.py3-none-any.whl (598 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 598.5/598.5 kB 25.9 MB/s 0:00:00
Collecting lxml (from pyangbind->-r requirements.txt (line 22))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/lxml/6.0.2/lxml-6.0.2-cp311-cp311-manylinux_2_26_x86_64.manylinux_2_28_x86_64.whl (5.2 MB)
Collecting regex (from pyangbind->-r requirements.txt (line 22))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/regex/2026.3.32/regex-2026.3.32-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl (798 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 798.3/798.3 kB 21.7 MB/s 0:00:00
Collecting enum34 (from pyangbind->-r requirements.txt (line 22))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/enum34/1.1.10/enum34-1.1.10-py3-none-any.whl (11 kB)
Collecting bcrypt>=3.2 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/bcrypt/5.0.0/bcrypt-5.0.0-cp39-abi3-manylinux_2_34_x86_64.whl (278 kB)
Collecting cryptography>=3.3 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/cryptography/46.0.6/cryptography-46.0.6-cp311-abi3-manylinux_2_34_x86_64.whl (4.5 MB)
Collecting invoke>=2.0 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/invoke/2.2.1/invoke-2.2.1-py3-none-any.whl (160 kB)
Collecting pynacl>=1.5 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pynacl/1.6.2/pynacl-1.6.2-cp38-abi3-manylinux_2_34_x86_64.whl (1.4 MB)
Collecting cffi>=2.0.0 (from cryptography>=3.3->paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/cffi/2.0.0/cffi-2.0.0-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (215 kB)
Collecting pycparser (from cffi>=2.0.0->cryptography>=3.3->paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pycparser/3.0/pycparser-3.0-py3-none-any.whl (48 kB)
Collecting selenium>=4.3.0 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/selenium/4.41.0/selenium-4.41.0-py3-none-any.whl (9.5 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 9.5/9.5 MB 52.6 MB/s 0:00:00
Collecting robotframework-pythonlibcore>=4.4.1 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-pythonlibcore/4.5.0/robotframework_pythonlibcore-4.5.0-py3-none-any.whl (19 kB)
Collecting click>=8.0 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/click/8.3.1/click-8.3.1-py3-none-any.whl (108 kB)
Collecting trio<1.0,>=0.31.0 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/trio/0.33.0/trio-0.33.0-py3-none-any.whl (510 kB)
Collecting trio-websocket<1.0,>=0.12.2 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/trio-websocket/0.12.2/trio_websocket-0.12.2-py3-none-any.whl (21 kB)
Collecting attrs>=23.2.0 (from trio<1.0,>=0.31.0->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/attrs/26.1.0/attrs-26.1.0-py3-none-any.whl (67 kB)
Collecting sortedcontainers (from trio<1.0,>=0.31.0->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/sortedcontainers/2.4.0/sortedcontainers-2.4.0-py2.py3-none-any.whl (29 kB)
Collecting outcome (from trio<1.0,>=0.31.0->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/outcome/1.3.0.post0/outcome-1.3.0.post0-py2.py3-none-any.whl (10 kB)
Collecting wsproto>=0.14 (from trio-websocket<1.0,>=0.12.2->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/wsproto/1.3.2/wsproto-1.3.2-py3-none-any.whl (24 kB)
Collecting pysocks!=1.5.7,<2.0,>=1.5.6 (from urllib3[socks]<3.0,>=2.6.3->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pysocks/1.7.1/PySocks-1.7.1-py3-none-any.whl (16 kB)
Collecting WebOb>=1.2 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/webob/1.8.9/WebOb-1.8.9-py2.py3-none-any.whl (115 kB)
Collecting waitress>=3.0.2 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/waitress/3.0.2/waitress-3.0.2-py3-none-any.whl (56 kB)
Collecting beautifulsoup4 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/beautifulsoup4/4.14.3/beautifulsoup4-4.14.3-py3-none-any.whl (107 kB)
Collecting h11<1,>=0.16.0 (from wsproto>=0.14->trio-websocket<1.0,>=0.12.2->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10))
Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/h11/0.16.0/h11-0.16.0-py3-none-any.whl (37 kB)
Collecting soupsieve>=1.6.1 (from beautifulsoup4->webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8))
Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/soupsieve/2.8.3/soupsieve-2.8.3-py3-none-any.whl (37 kB)
Building wheels for collected packages: robotframework-sshlibrary, ipaddr, netifaces, pyhocon, robotframework-httplibrary, jsonpath-rw
Building wheel for robotframework-sshlibrary (pyproject.toml): started
Building wheel for robotframework-sshlibrary (pyproject.toml): finished with status 'done'
Created wheel for robotframework-sshlibrary: filename=robotframework_sshlibrary-3.8.0-py3-none-any.whl size=55205 sha256=787270781b500f5a71002bbe7b13a6e4eaefc4aade1cc6540ecfd7a57a3fac80
Stored in directory: /home/jenkins/.cache/pip/wheels/f7/c9/b3/a977b7bcc410d45ae27d240df3d00a12585509180e373ecccc
Building wheel for ipaddr (pyproject.toml): started
Building wheel for ipaddr (pyproject.toml): finished with status 'done'
Created wheel for ipaddr: filename=ipaddr-2.2.0-py3-none-any.whl size=18355 sha256=123e1f6b7427c3c2d9572621efb8d91ac2e7487a3c059bb6e4b930558a90bc37
Stored in directory: /home/jenkins/.cache/pip/wheels/dc/6c/04/da2d847fa8d45c59af3e1d83e2acc29cb8adcbaf04c0898dbf
Building wheel for netifaces (pyproject.toml): started
Building wheel for netifaces (pyproject.toml): finished with status 'done'
Created wheel for netifaces: filename=netifaces-0.11.0-cp311-cp311-linux_x86_64.whl size=34978 sha256=2594bf2aa3451f5bbe3a757f918d3d3d99401877574e52f660f767c82175c52a
Stored in directory: /home/jenkins/.cache/pip/wheels/f8/18/88/e61d54b995bea304bdb1d040a92b72228a1bf72ca2a3eba7c9
Building wheel for pyhocon (pyproject.toml): started
Building wheel for pyhocon (pyproject.toml): finished with status 'done'
Created wheel for pyhocon: filename=pyhocon-0.3.63-py3-none-any.whl size=24721 sha256=4c0384513b58f657aff07498f4228cb9ba8864b9a96006761875cac958a29ad4
Stored in directory: /home/jenkins/.cache/pip/wheels/ce/9e/92/cb17e17d79fafd46a767074b3ed1dca8f78036163f9bea914d
Building wheel for robotframework-httplibrary (pyproject.toml): started
Building wheel for robotframework-httplibrary (pyproject.toml): finished with status 'done'
Created wheel for robotframework-httplibrary: filename=robotframework_httplibrary-0.4.2-py3-none-any.whl size=10014 sha256=823863690cac5e09e7368c2c4140f73d8382c2c15f677a425926076ae5df113d
Stored in directory: /home/jenkins/.cache/pip/wheels/aa/bc/0d/9a20dd51effef392aae2733cb4c7b66c6fa29fca33d88b57ed
Building wheel for jsonpath-rw (pyproject.toml): started
Building wheel for jsonpath-rw (pyproject.toml): finished with status 'done'
Created wheel for jsonpath-rw: filename=jsonpath_rw-1.4.0-py3-none-any.whl size=15176 sha256=82dba5f0ed60f315a16f772c73817d134abefbfce75d3375b720a65206fa036f
Stored in directory: /home/jenkins/.cache/pip/wheels/f1/54/63/9a8da38cefae13755097b36cc852decc25d8ef69c37d58d4eb
Successfully built robotframework-sshlibrary ipaddr netifaces pyhocon robotframework-httplibrary jsonpath-rw
Installing collected packages: sortedcontainers, ply, netifaces, ipaddr, enum34, websocket-client, WebOb, waitress, urllib3, typing-extensions, soupsieve, sniffio, six, scapy, robotframework-pythonlibcore, robotframework, regex, pysocks, pyparsing, pycparser, netaddr, lxml, jsonpointer, jmespath, isodate, invoke, idna, h11, decorator, click, charset_normalizer, certifi, bcrypt, attrs, wsproto, requests, python-dateutil, pyhocon, pyang, outcome, jsonpath-rw, jsonpatch, elastic-transport, docker-pycreds, cffi, beautifulsoup4, webtest, trio, robotframework-requests, pynacl, pyangbind, elasticsearch, docker-py, cryptography, trio-websocket, robotframework-httplibrary, paramiko, elasticsearch-dsl, selenium, scp, robotframework-sshlibrary, robotframework-seleniumlibrary, robotframework-selenium2library
Successfully installed WebOb-1.8.9 attrs-26.1.0 bcrypt-5.0.0 beautifulsoup4-4.14.3 certifi-2026.2.25 cffi-2.0.0 charset_normalizer-3.4.6 click-8.3.1 cryptography-46.0.6 decorator-5.2.1 docker-py-1.10.6 docker-pycreds-0.4.0 elastic-transport-8.17.1 elasticsearch-8.19.3 elasticsearch-dsl-8.15.4 enum34-1.1.10 h11-0.16.0 idna-3.11 invoke-2.2.1 ipaddr-2.2.0 isodate-0.7.2 jmespath-1.1.0 jsonpatch-1.33 jsonpath-rw-1.4.0 jsonpointer-3.1.1 lxml-6.0.2 netaddr-1.3.0 netifaces-0.11.0 outcome-1.3.0.post0 paramiko-4.0.0 ply-3.11 pyang-2.7.1 pyangbind-0.8.7 pycparser-3.0 pyhocon-0.3.63 pynacl-1.6.2 pyparsing-3.3.2 pysocks-1.7.1 python-dateutil-2.9.0.post0 regex-2026.3.32 requests-2.33.0 robotframework-7.4.2 robotframework-httplibrary-0.4.2 robotframework-pythonlibcore-4.5.0 robotframework-requests-0.9.7 robotframework-selenium2library-3.0.0 robotframework-seleniumlibrary-6.8.0 robotframework-sshlibrary-3.8.0 scapy-2.7.0 scp-0.15.0 selenium-4.41.0 six-1.17.0 sniffio-1.3.1 sortedcontainers-2.4.0 soupsieve-2.8.3 trio-0.33.0 trio-websocket-0.12.2 typing-extensions-4.15.0 urllib3-2.6.3 waitress-3.0.2 websocket-client-1.9.0 webtest-3.0.7 wsproto-1.3.2
+ pip freeze
attrs==26.1.0
bcrypt==5.0.0
beautifulsoup4==4.14.3
certifi==2026.2.25
cffi==2.0.0
charset-normalizer==3.4.6
click==8.3.1
cryptography==46.0.6
decorator==5.2.1
distlib==0.4.0
docker-py==1.10.6
docker-pycreds==0.4.0
elastic-transport==8.17.1
elasticsearch==8.19.3
elasticsearch-dsl==8.15.4
enum34==1.1.10
filelock==3.25.2
h11==0.16.0
idna==3.11
invoke==2.2.1
ipaddr==2.2.0
isodate==0.7.2
jmespath==1.1.0
jsonpatch==1.33
jsonpath-rw==1.4.0
jsonpointer==3.1.1
lxml==6.0.2
netaddr==1.3.0
netifaces==0.11.0
outcome==1.3.0.post0
packaging==26.0
paramiko==4.0.0
platformdirs==4.9.4
ply==3.11
pyang==2.7.1
pyangbind==0.8.7
pycparser==3.0
pyhocon==0.3.63
PyNaCl==1.6.2
pyparsing==3.3.2
PySocks==1.7.1
python-dateutil==2.9.0.post0
python-discovery==1.2.1
regex==2026.3.32
requests==2.33.0
robotframework==7.4.2
robotframework-httplibrary==0.4.2
robotframework-pythonlibcore==4.5.0
robotframework-requests==0.9.7
robotframework-selenium2library==3.0.0
robotframework-seleniumlibrary==6.8.0
robotframework-sshlibrary==3.8.0
scapy==2.7.0
scp==0.15.0
selenium==4.41.0
six==1.17.0
sniffio==1.3.1
sortedcontainers==2.4.0
soupsieve==2.8.3
trio==0.33.0
trio-websocket==0.12.2
typing_extensions==4.15.0
urllib3==2.6.3
virtualenv==21.2.0
waitress==3.0.2
WebOb==1.8.9
websocket-client==1.9.0
WebTest==3.0.7
wsproto==1.3.2
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties file path 'env.properties'
[EnvInject] - Variables injected successfully.
[controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium] $ /bin/bash -l /tmp/jenkins6340819521938475811.sh
Setup pyenv:
system
3.8.20
3.9.20
3.10.15
* 3.11.10 (set by /w/workspace/controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-4MXP from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
lf-activate-venv(): INFO: Attempting to install with network-safe options...
WARNING: Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/simple/setuptools/
WARNING: Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/simple/setuptools/
WARNING: Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/simple/setuptools/
WARNING: Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/packages/setuptools/65.7.0/setuptools-65.7.0-py3-none-any.whl
WARNING: Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/packages/setuptools/65.7.0/setuptools-65.7.0-py3-none-any.whl
lf-activate-venv(): INFO: Base packages installed successfully
lf-activate-venv(): INFO: Installing additional packages: python-heatclient python-openstackclient yq
WARNING: Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/simple/python-heatclient/
WARNING: Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/simple/openstacksdk/
WARNING: Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/simple/openstacksdk/
WARNING: Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/simple/pycparser/
WARNING: Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/simple/pycparser/
WARNING: Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/simple/setuptools/
WARNING: Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/simple/setuptools/
WARNING: Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/simple/setuptools/
WARNING: Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/simple/setuptools/
WARNING: Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/packages/setuptools/82.0.1/setuptools-82.0.1-py3-none-any.whl
WARNING: Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/packages/setuptools/82.0.1/setuptools-82.0.1-py3-none-any.whl
lf-activate-venv(): INFO: Adding /tmp/venv-4MXP/bin to PATH
+ ODL_SYSTEM=()
+ TOOLS_SYSTEM=()
+ OPENSTACK_SYSTEM=()
+ OPENSTACK_CONTROLLERS=()
+ mapfile -t ADDR
++ openstack stack show -f json -c outputs releng-controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium-2
++ jq -r '.outputs[] | select(.output_key | match("^vm_[0-9]+_ips$")) | .output_value | .[]'
+ for i in "${ADDR[@]}"
++ ssh 10.30.171.72 hostname -s
Warning: Permanently added '10.30.171.72' (ED25519) to the list of known hosts.
+ REMHOST=releng-60164-2-1-mininet-ovs-217-0
+ case ${REMHOST} in
+ TOOLS_SYSTEM=("${TOOLS_SYSTEM[@]}" "${i}")
+ for i in "${ADDR[@]}"
++ ssh 10.30.170.21 hostname -s
Warning: Permanently added '10.30.170.21' (ED25519) to the list of known hosts.
+ REMHOST=releng-60164-2-0-builder-0
+ case ${REMHOST} in
+ ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}")
+ for i in "${ADDR[@]}"
++ ssh 10.30.171.237 hostname -s
Warning: Permanently added '10.30.171.237' (ED25519) to the list of known hosts.
+ REMHOST=releng-60164-2-0-builder-1
+ case ${REMHOST} in
+ ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}")
+ for i in "${ADDR[@]}"
++ ssh 10.30.170.243 hostname -s
Warning: Permanently added '10.30.170.243' (ED25519) to the list of known hosts.
+ REMHOST=releng-60164-2-0-builder-2
+ case ${REMHOST} in
+ ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}")
+ echo NUM_ODL_SYSTEM=3
+ echo NUM_TOOLS_SYSTEM=1
+ '[' '' == yes ']'
+ NUM_OPENSTACK_SYSTEM=0
+ echo NUM_OPENSTACK_SYSTEM=0
+ '[' 0 -eq 2 ']'
+ echo ODL_SYSTEM_IP=10.30.170.21
++ seq 0 2
+ for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 )))
+ echo ODL_SYSTEM_1_IP=10.30.170.21
+ for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 )))
+ echo ODL_SYSTEM_2_IP=10.30.171.237
+ for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 )))
+ echo ODL_SYSTEM_3_IP=10.30.170.243
+ echo TOOLS_SYSTEM_IP=10.30.171.72
++ seq 0 0
+ for i in $(seq 0 $(( ${#TOOLS_SYSTEM[@]} - 1 )))
+ echo TOOLS_SYSTEM_1_IP=10.30.171.72
+ openstack_index=0
+ NUM_OPENSTACK_CONTROL_NODES=1
+ echo NUM_OPENSTACK_CONTROL_NODES=1
++ seq 0 0
+ for i in $(seq 0 $((NUM_OPENSTACK_CONTROL_NODES - 1)))
+ echo OPENSTACK_CONTROL_NODE_1_IP=
+ NUM_OPENSTACK_COMPUTE_NODES=-1
+ echo NUM_OPENSTACK_COMPUTE_NODES=-1
+ '[' -1 -ge 2 ']'
++ seq 0 -2
+ NUM_OPENSTACK_HAPROXY_NODES=0
+ echo NUM_OPENSTACK_HAPROXY_NODES=0
++ seq 0 -1
+ echo 'Contents of slave_addresses.txt:'
Contents of slave_addresses.txt:
+ cat slave_addresses.txt
NUM_ODL_SYSTEM=3
NUM_TOOLS_SYSTEM=1
NUM_OPENSTACK_SYSTEM=0
ODL_SYSTEM_IP=10.30.170.21
ODL_SYSTEM_1_IP=10.30.170.21
ODL_SYSTEM_2_IP=10.30.171.237
ODL_SYSTEM_3_IP=10.30.170.243
TOOLS_SYSTEM_IP=10.30.171.72
TOOLS_SYSTEM_1_IP=10.30.171.72
NUM_OPENSTACK_CONTROL_NODES=1
OPENSTACK_CONTROL_NODE_1_IP=
NUM_OPENSTACK_COMPUTE_NODES=-1
NUM_OPENSTACK_HAPROXY_NODES=0
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties file path 'slave_addresses.txt'
[EnvInject] - Variables injected successfully.
[controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium] $ /bin/sh /tmp/jenkins7376567968304743225.sh
Preparing for JRE Version 21
Karaf artifact is karaf
Karaf project is integration
Java home is /usr/lib/jvm/java-21-openjdk-amd64
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties file path 'set_variables.env'
[EnvInject] - Variables injected successfully.
[controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium] $ /bin/bash /tmp/jenkins3828887069638351028.sh
2026-03-29 23:29:04 URL:https://raw.githubusercontent.com/opendaylight/integration-distribution/master/pom.xml [2619/2619] -> "pom.xml" [1]
Bundle version is 0.24.0-SNAPSHOT
--2026-03-29 23:29:05-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.24.0-SNAPSHOT/maven-metadata.xml
Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6
Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 1410 (1.4K) [application/xml]
Saving to: ‘maven-metadata.xml’
0K . 100% 1.48G=0s
2026-03-29 23:29:05 (1.48 GB/s) - ‘maven-metadata.xml’ saved [1410/1410]
org.opendaylight.integration
karaf
0.24.0-SNAPSHOT
20260329.223546
282
20260329223546
pom
0.24.0-20260329.223546-282
20260329223546
tar.gz
0.24.0-20260329.223546-282
20260329223546
zip
0.24.0-20260329.223546-282
20260329223546
cyclonedx
xml
0.24.0-20260329.223546-282
20260329223546
cyclonedx
json
0.24.0-20260329.223546-282
20260329223546
Nexus timestamp is 0.24.0-20260329.223546-282
Distribution bundle URL is https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.24.0-SNAPSHOT/karaf-0.24.0-20260329.223546-282.zip
Distribution bundle is karaf-0.24.0-20260329.223546-282.zip
Distribution bundle version is 0.24.0-SNAPSHOT
Distribution folder is karaf-0.24.0-SNAPSHOT
Nexus prefix is https://nexus.opendaylight.org
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties file path 'detect_variables.env'
[EnvInject] - Variables injected successfully.
[controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium] $ /bin/bash -l /tmp/jenkins14919580824385126620.sh
Setup pyenv:
system
3.8.20
3.9.20
3.10.15
* 3.11.10 (set by /w/workspace/controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-4MXP from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
lf-activate-venv(): INFO: Attempting to install with network-safe options...
WARNING: Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/simple/pip/
WARNING: Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/simple/pip/
WARNING: Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/simple/pip/
lf-activate-venv(): INFO: Base packages installed successfully
lf-activate-venv(): INFO: Installing additional packages: python-heatclient python-openstackclient
WARNING: Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/simple/python-heatclient/
WARNING: Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/simple/python-heatclient/
WARNING: Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/simple/python-heatclient/
WARNING: Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/simple/python-heatclient/
WARNING: Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/simple/python-heatclient/
WARNING: Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/simple/openstacksdk/
WARNING: Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/simple/openstacksdk/
WARNING: Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/simple/rich-argparse/
WARNING: Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/simple/rich-argparse/
WARNING: Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/simple/rich-argparse/
WARNING: Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/simple/setuptools/
WARNING: Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))': /repository/PyPi/simple/setuptools/
lf-activate-venv(): INFO: Adding /tmp/venv-4MXP/bin to PATH
Copying common-functions.sh to /tmp
Copying common-functions.sh to 10.30.171.72:/tmp
Warning: Permanently added '10.30.171.72' (ED25519) to the list of known hosts.
Copying common-functions.sh to 10.30.170.21:/tmp
Warning: Permanently added '10.30.170.21' (ED25519) to the list of known hosts.
Copying common-functions.sh to 10.30.171.237:/tmp
Warning: Permanently added '10.30.171.237' (ED25519) to the list of known hosts.
Copying common-functions.sh to 10.30.170.243:/tmp
Warning: Permanently added '10.30.170.243' (ED25519) to the list of known hosts.
[controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium] $ /bin/bash /tmp/jenkins10950061684070762504.sh
common-functions.sh is being sourced
common-functions environment:
MAVENCONF: /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
ACTUALFEATURES:
FEATURESCONF: /tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
CUSTOMPROP: /tmp/karaf-0.24.0-SNAPSHOT/etc/custom.properties
LOGCONF: /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
MEMCONF: /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
CONTROLLERMEM: 2048m
AKKACONF: /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/pekko.conf
MODULESCONF: /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/modules.conf
MODULESHARDSCONF: /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/module-shards.conf
SUITES:
#################################################
## Configure Cluster and Start ##
#################################################
ACTUALFEATURES: odl-infrautils-ready,odl-jolokia,odl-restconf-noauth,odl-clustering-test-app
SPACE_SEPARATED_FEATURES: odl-infrautils-ready odl-jolokia odl-restconf-noauth odl-clustering-test-app
Locating script plan to use...
Finished running script plans
Configuring member-1 with IP address 10.30.170.21
Warning: Permanently added '10.30.170.21' (ED25519) to the list of known hosts.
Warning: Permanently added '10.30.170.21' (ED25519) to the list of known hosts.
common-functions.sh is being sourced
+ source /tmp/common-functions.sh karaf-0.24.0-SNAPSHOT chromium
++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]]
++ echo 'common-functions.sh is being sourced'
++ BUNDLEFOLDER=karaf-0.24.0-SNAPSHOT
++ DISTROSTREAM=chromium
++ export MAVENCONF=/tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
++ MAVENCONF=/tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
++ export FEATURESCONF=/tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
++ FEATURESCONF=/tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
++ export CUSTOMPROP=/tmp/karaf-0.24.0-SNAPSHOT/etc/custom.properties
++ CUSTOMPROP=/tmp/karaf-0.24.0-SNAPSHOT/etc/custom.properties
++ export LOGCONF=/tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
++ LOGCONF=/tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
++ export MEMCONF=/tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
++ MEMCONF=/tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
++ export CONTROLLERMEM=
++ CONTROLLERMEM=
++ case "${DISTROSTREAM}" in
++ CLUSTER_SYSTEM=pekko
++ export AKKACONF=/tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/pekko.conf
++ AKKACONF=/tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/pekko.conf
++ export MODULESCONF=/tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/modules.conf
++ MODULESCONF=/tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/modules.conf
++ export MODULESHARDSCONF=/tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/module-shards.conf
++ MODULESHARDSCONF=/tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/module-shards.conf
++ print_common_env
++ cat
common-functions environment:
MAVENCONF: /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
ACTUALFEATURES:
FEATURESCONF: /tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
CUSTOMPROP: /tmp/karaf-0.24.0-SNAPSHOT/etc/custom.properties
LOGCONF: /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
MEMCONF: /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
CONTROLLERMEM:
AKKACONF: /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/pekko.conf
MODULESCONF: /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/modules.conf
MODULESHARDSCONF: /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/module-shards.conf
SUITES:
++ SSH='ssh -t -t'
++ extra_services_cntl=' dnsmasq.service httpd.service libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service rabbitmq-server.service '
++ extra_services_cmp=' libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service '
Changing to /tmp
Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.24.0-SNAPSHOT/karaf-0.24.0-20260329.223546-282.zip
+ echo 'Changing to /tmp'
+ cd /tmp
+ echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.24.0-SNAPSHOT/karaf-0.24.0-20260329.223546-282.zip'
+ wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.24.0-SNAPSHOT/karaf-0.24.0-20260329.223546-282.zip
--2026-03-29 23:29:30-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.24.0-SNAPSHOT/karaf-0.24.0-20260329.223546-282.zip
Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6
Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 240370190 (229M) [application/zip]
Saving to: ‘karaf-0.24.0-20260329.223546-282.zip’
0K ........ ........ ........ ........ ........ ........ 1% 52.2M 4s
3072K ........ ........ ........ ........ ........ ........ 2% 119M 3s
6144K ........ ........ ........ ........ ........ ........ 3% 172M 2s
9216K ........ ........ ........ ........ ........ ........ 5% 156M 2s
12288K ........ ........ ........ ........ ........ ........ 6% 166M 2s
15360K ........ ........ ........ ........ ........ ........ 7% 232M 2s
18432K ........ ........ ........ ........ ........ ........ 9% 208M 2s
21504K ........ ........ ........ ........ ........ ........ 10% 263M 2s
24576K ........ ........ ........ ........ ........ ........ 11% 264M 1s
27648K ........ ........ ........ ........ ........ ........ 13% 254M 1s
30720K ........ ........ ........ ........ ........ ........ 14% 236M 1s
33792K ........ ........ ........ ........ ........ ........ 15% 292M 1s
36864K ........ ........ ........ ........ ........ ........ 17% 268M 1s
39936K ........ ........ ........ ........ ........ ........ 18% 275M 1s
43008K ........ ........ ........ ........ ........ ........ 19% 304M 1s
46080K ........ ........ ........ ........ ........ ........ 20% 279M 1s
49152K ........ ........ ........ ........ ........ ........ 22% 344M 1s
52224K ........ ........ ........ ........ ........ ........ 23% 323M 1s
55296K ........ ........ ........ ........ ........ ........ 24% 310M 1s
58368K ........ ........ ........ ........ ........ ........ 26% 354M 1s
61440K ........ ........ ........ ........ ........ ........ 27% 329M 1s
64512K ........ ........ ........ ........ ........ ........ 28% 298M 1s
67584K ........ ........ ........ ........ ........ ........ 30% 305M 1s
70656K ........ ........ ........ ........ ........ ........ 31% 329M 1s
73728K ........ ........ ........ ........ ........ ........ 32% 284M 1s
76800K ........ ........ ........ ........ ........ ........ 34% 345M 1s
79872K ........ ........ ........ ........ ........ ........ 35% 333M 1s
82944K ........ ........ ........ ........ ........ ........ 36% 271M 1s
86016K ........ ........ ........ ........ ........ ........ 37% 314M 1s
89088K ........ ........ ........ ........ ........ ........ 39% 255M 1s
92160K ........ ........ ........ ........ ........ ........ 40% 223M 1s
95232K ........ ........ ........ ........ ........ ........ 41% 175M 1s
98304K ........ ........ ........ ........ ........ ........ 43% 150M 1s
101376K ........ ........ ........ ........ ........ ........ 44% 147M 1s
104448K ........ ........ ........ ........ ........ ........ 45% 137M 1s
107520K ........ ........ ........ ........ ........ ........ 47% 143M 1s
110592K ........ ........ ........ ........ ........ ........ 48% 157M 1s
113664K ........ ........ ........ ........ ........ ........ 49% 192M 1s
116736K ........ ........ ........ ........ ........ ........ 51% 176M 1s
119808K ........ ........ ........ ........ ........ ........ 52% 160M 1s
122880K ........ ........ ........ ........ ........ ........ 53% 217M 1s
125952K ........ ........ ........ ........ ........ ........ 54% 313M 0s
129024K ........ ........ ........ ........ ........ ........ 56% 246M 0s
132096K ........ ........ ........ ........ ........ ........ 57% 288M 0s
135168K ........ ........ ........ ........ ........ ........ 58% 344M 0s
138240K ........ ........ ........ ........ ........ ........ 60% 302M 0s
141312K ........ ........ ........ ........ ........ ........ 61% 304M 0s
144384K ........ ........ ........ ........ ........ ........ 62% 322M 0s
147456K ........ ........ ........ ........ ........ ........ 64% 257M 0s
150528K ........ ........ ........ ........ ........ ........ 65% 224M 0s
153600K ........ ........ ........ ........ ........ ........ 66% 180M 0s
156672K ........ ........ ........ ........ ........ ........ 68% 170M 0s
159744K ........ ........ ........ ........ ........ ........ 69% 260M 0s
162816K ........ ........ ........ ........ ........ ........ 70% 317M 0s
165888K ........ ........ ........ ........ ........ ........ 71% 289M 0s
168960K ........ ........ ........ ........ ........ ........ 73% 314M 0s
172032K ........ ........ ........ ........ ........ ........ 74% 269M 0s
175104K ........ ........ ........ ........ ........ ........ 75% 297M 0s
178176K ........ ........ ........ ........ ........ ........ 77% 287M 0s
181248K ........ ........ ........ ........ ........ ........ 78% 286M 0s
184320K ........ ........ ........ ........ ........ ........ 79% 291M 0s
187392K ........ ........ ........ ........ ........ ........ 81% 277M 0s
190464K ........ ........ ........ ........ ........ ........ 82% 278M 0s
193536K ........ ........ ........ ........ ........ ........ 83% 246M 0s
196608K ........ ........ ........ ........ ........ ........ 85% 300M 0s
199680K ........ ........ ........ ........ ........ ........ 86% 272M 0s
202752K ........ ........ ........ ........ ........ ........ 87% 288M 0s
205824K ........ ........ ........ ........ ........ ........ 88% 279M 0s
208896K ........ ........ ........ ........ ........ ........ 90% 278M 0s
211968K ........ ........ ........ ........ ........ ........ 91% 292M 0s
215040K ........ ........ ........ ........ ........ ........ 92% 290M 0s
218112K ........ ........ ........ ........ ........ ........ 94% 284M 0s
221184K ........ ........ ........ ........ ........ ........ 95% 298M 0s
224256K ........ ........ ........ ........ ........ ........ 96% 289M 0s
227328K ........ ........ ........ ........ ........ ........ 98% 285M 0s
230400K ........ ........ ........ ........ ........ ........ 99% 254M 0s
233472K ........ ........ ... 100% 265M=1.0s
2026-03-29 23:29:31 (232 MB/s) - ‘karaf-0.24.0-20260329.223546-282.zip’ saved [240370190/240370190]
Extracting the new controller...
+ echo 'Extracting the new controller...'
+ unzip -q karaf-0.24.0-20260329.223546-282.zip
Adding external repositories...
+ echo 'Adding external repositories...'
+ sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
+ cat /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
################################################################################
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
################################################################################
#
# If set to true, the following property will not allow any certificate to be used
# when accessing Maven repositories through SSL
#
#org.ops4j.pax.url.mvn.certificateCheck=
#
# Path to the local Maven settings file.
# The repositories defined in this file will be automatically added to the list
# of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property
# below is not set.
# The following locations are checked for the existence of the settings.xml file
# * 1. looks for the specified url
# * 2. if not found looks for ${user.home}/.m2/settings.xml
# * 3. if not found looks for ${maven.home}/conf/settings.xml
# * 4. if not found looks for ${M2_HOME}/conf/settings.xml
#
#org.ops4j.pax.url.mvn.settings=
#
# Path to the local Maven repository which is used to avoid downloading
# artifacts when they already exist locally.
# The value of this property will be extracted from the settings.xml file
# above, or defaulted to:
# System.getProperty( "user.home" ) + "/.m2/repository"
#
org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository}
#
# Default this to false. It's just weird to use undocumented repos
#
org.ops4j.pax.url.mvn.useFallbackRepositories=false
#
# Uncomment if you don't wanna use the proxy settings
# from the Maven conf/settings.xml file
#
# org.ops4j.pax.url.mvn.proxySupport=false
#
# Comma separated list of repositories scanned when resolving an artifact.
# Those repositories will be checked before iterating through the
# below list of repositories and even before the local repository
# A repository url can be appended with zero or more of the following flags:
# @snapshots : the repository contains snaphots
# @noreleases : the repository does not contain any released artifacts
#
# The following property value will add the system folder as a repo.
#
org.ops4j.pax.url.mvn.defaultRepositories=\
file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\
file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\
file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots
# Use the default local repo (e.g.~/.m2/repository) as a "remote" repo
#org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false
#
# Comma separated list of repositories scanned when resolving an artifact.
# The default list includes the following repositories:
# http://repo1.maven.org/maven2@id=central
# http://repository.springsource.com/maven/bundles/release@id=spring.ebr
# http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external
# http://zodiac.springsource.com/maven/bundles/release@id=gemini
# http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases
# https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases
# https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
# To add repositories to the default ones, prepend '+' to the list of repositories
# to add.
# A repository url can be appended with zero or more of the following flags:
# @snapshots : the repository contains snapshots
# @noreleases : the repository does not contain any released artifacts
# @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended
#
org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.
Configuring the startup features...
+ [[ True == \T\r\u\e ]]
+ echo 'Configuring the startup features...'
+ sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-infrautils-ready,odl-jolokia,odl-restconf-noauth,odl-clustering-test-app,/g' /tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
+ FEATURE_TEST_STRING=features-test
+ FEATURE_TEST_VERSION=0.24.0-SNAPSHOT
+ KARAF_VERSION=karaf4
+ [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]]
+ sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.24.0-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
+ [[ ! -z '' ]]
+ cat /tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
################################################################################
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
################################################################################
#
# Comma separated list of features repositories to register by default
#
featuresRepositories = mvn:org.opendaylight.integration/features-test/0.24.0-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/792c4f45-5ba1-49bc-be4a-16ed2d6891f2.xml
#
# Comma separated list of features to install at startup
#
featuresBoot = odl-infrautils-ready,odl-jolokia,odl-restconf-noauth,odl-clustering-test-app, 6146c482-a3a3-444e-885d-60bc28c2ed0b
#
# Resource repositories (OBR) that the features resolver can use
# to resolve requirements/capabilities
#
# The format of the resourceRepositories is
# resourceRepositories=[xml:url|json:url],...
# for Instance:
#
#resourceRepositories=xml:http://host/path/to/index.xml
# or
#resourceRepositories=json:http://host/path/to/index.json
#
#
# Defines if the boot features are started in asynchronous mode (in a dedicated thread)
#
featuresBootAsynchronous=false
#
# Service requirements enforcement
#
# By default, the feature resolver checks the service requirements/capabilities of
# bundles for new features (xml schema >= 1.3.0) in order to automatically installs
# the required bundles.
# The following flag can have those values:
# - disable: service requirements are completely ignored
# - default: service requirements are ignored for old features
# - enforce: service requirements are always verified
#
#serviceRequirements=default
#
# Store cfg file for config element in feature
#
#configCfgStore=true
#
# Define if the feature service automatically refresh bundles
#
autoRefresh=true
#
# Configuration of features processing mechanism (overrides, blacklisting, modification of features)
# XML file defines instructions related to features processing
# versions.properties may declare properties to resolve placeholders in XML file
# both files are relative to ${karaf.etc}
#
#featureProcessing=org.apache.karaf.features.xml
#featureProcessingVersions=versions.properties
+ configure_karaf_log karaf4 ''
+ local -r karaf_version=karaf4
+ local -r controllerdebugmap=
+ local logapi=log4j
+ grep log4j2 /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
log4j2.rootLogger.level = INFO
#log4j2.rootLogger.type = asyncRoot
#log4j2.rootLogger.includeLocation = false
log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
log4j2.rootLogger.appenderRef.Console.ref = Console
log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
log4j2.logger.spifly.name = org.apache.aries.spifly
log4j2.logger.spifly.level = WARN
log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
log4j2.logger.audit.level = INFO
log4j2.logger.audit.additivity = false
log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
# Console appender not used by default (see log4j2.rootLogger.appenderRefs)
log4j2.appender.console.type = Console
log4j2.appender.console.name = Console
log4j2.appender.console.layout.type = PatternLayout
log4j2.appender.console.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.type = RollingRandomAccessFile
log4j2.appender.rolling.name = RollingFile
log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
#log4j2.appender.rolling.immediateFlush = false
log4j2.appender.rolling.append = true
log4j2.appender.rolling.layout.type = PatternLayout
log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.policies.type = Policies
log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.rolling.policies.size.size = 64MB
log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
log4j2.appender.rolling.strategy.max = 7
log4j2.appender.audit.type = RollingRandomAccessFile
log4j2.appender.audit.name = AuditRollingFile
log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
log4j2.appender.audit.append = true
log4j2.appender.audit.layout.type = PatternLayout
log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
log4j2.appender.audit.policies.type = Policies
log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.audit.policies.size.size = 8MB
log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
log4j2.appender.audit.strategy.max = 7
log4j2.appender.osgi.type = PaxOsgi
log4j2.appender.osgi.name = PaxOsgi
log4j2.appender.osgi.filter = *
#log4j2.logger.aether.name = shaded.org.eclipse.aether
#log4j2.logger.aether.level = TRACE
#log4j2.logger.http-headers.name = shaded.org.apache.http.headers
#log4j2.logger.http-headers.level = DEBUG
#log4j2.logger.maven.name = org.ops4j.pax.url.mvn
#log4j2.logger.maven.level = TRACE
Configuring the karaf log... karaf_version: karaf4, logapi: log4j2
+ logapi=log4j2
+ echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2'
+ '[' log4j2 == log4j2 ']'
+ sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
controllerdebugmap:
cat /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
+ orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver
+ orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver
+ echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN'
+ echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN'
+ unset IFS
+ echo 'controllerdebugmap: '
+ '[' -n '' ']'
+ echo 'cat /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg'
+ cat /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
################################################################################
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
################################################################################
# Common pattern layout for appenders
log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
# Root logger
log4j2.rootLogger.level = INFO
# uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library
#log4j2.rootLogger.type = asyncRoot
#log4j2.rootLogger.includeLocation = false
log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
log4j2.rootLogger.appenderRef.Console.ref = Console
log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
# Filters for logs marked by org.opendaylight.odlparent.Markers
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
# Loggers configuration
# Spifly logger
log4j2.logger.spifly.name = org.apache.aries.spifly
log4j2.logger.spifly.level = WARN
# Security audit logger
log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
log4j2.logger.audit.level = INFO
log4j2.logger.audit.additivity = false
log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
# Appenders configuration
# Console appender not used by default (see log4j2.rootLogger.appenderRefs)
log4j2.appender.console.type = Console
log4j2.appender.console.name = Console
log4j2.appender.console.layout.type = PatternLayout
log4j2.appender.console.layout.pattern = ${log4j2.pattern}
# Rolling file appender
log4j2.appender.rolling.type = RollingRandomAccessFile
log4j2.appender.rolling.name = RollingFile
log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
# uncomment to not force a disk flush
#log4j2.appender.rolling.immediateFlush = false
log4j2.appender.rolling.append = true
log4j2.appender.rolling.layout.type = PatternLayout
log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.policies.type = Policies
log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.rolling.policies.size.size = 1GB
log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
log4j2.appender.rolling.strategy.max = 7
# Audit file appender
log4j2.appender.audit.type = RollingRandomAccessFile
log4j2.appender.audit.name = AuditRollingFile
log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
log4j2.appender.audit.append = true
log4j2.appender.audit.layout.type = PatternLayout
log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
log4j2.appender.audit.policies.type = Policies
log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.audit.policies.size.size = 8MB
log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
log4j2.appender.audit.strategy.max = 7
# OSGi appender
log4j2.appender.osgi.type = PaxOsgi
log4j2.appender.osgi.name = PaxOsgi
log4j2.appender.osgi.filter = *
# help with identification of maven-related problems with pax-url-aether
#log4j2.logger.aether.name = shaded.org.eclipse.aether
#log4j2.logger.aether.level = TRACE
#log4j2.logger.http-headers.name = shaded.org.apache.http.headers
#log4j2.logger.http-headers.level = DEBUG
#log4j2.logger.maven.name = org.ops4j.pax.url.mvn
#log4j2.logger.maven.level = TRACE
log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN
log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN
Configure
java home: /usr/lib/jvm/java-21-openjdk-amd64
max memory: 2048m
+ set_java_vars /usr/lib/jvm/java-21-openjdk-amd64 2048m /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
+ local -r java_home=/usr/lib/jvm/java-21-openjdk-amd64
+ local -r controllermem=2048m
+ local -r memconf=/tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
+ echo Configure
+ echo ' java home: /usr/lib/jvm/java-21-openjdk-amd64'
+ echo ' max memory: 2048m'
memconf: /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
+ echo ' memconf: /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv'
+ sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64}%g' /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
+ sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=2048m/g' /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
cat /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
+ echo 'cat /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv'
+ cat /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
#!/bin/sh
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
#
# handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf
# script: client, instance, shell, start, status, stop, karaf
#
# if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then
# Actions go here...
# fi
#
# general settings which should be applied for all scripts go here; please keep
# in mind that it is possible that scripts might be executed more than once, e.g.
# in example of the start script where the start script is executed first and the
# karaf script afterwards.
#
#
# The following section shows the possible configuration options for the default
# karaf scripts
#
export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64} # Location of Java installation
# export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration
# export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options
# export EXTRA_JAVA_OPTS # Additional JVM options
# export KARAF_HOME # Karaf home folder
# export KARAF_DATA # Karaf data folder
# export KARAF_BASE # Karaf base folder
# export KARAF_ETC # Karaf etc folder
# export KARAF_LOG # Karaf log folder
# export KARAF_SYSTEM_OPTS # First citizen Karaf options
# export KARAF_OPTS # Additional available Karaf options
# export KARAF_DEBUG # Enable debug mode
# export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start
# export KARAF_NOROOT # Prevent execution as root if set to true
Set Java version
+ echo 'Set Java version'
+ sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-21-openjdk-amd64/bin/java 1
sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper
sudo: a password is required
+ sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-21-openjdk-amd64/bin/java
sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper
sudo: a password is required
JDK default version ...
+ echo 'JDK default version ...'
+ java -version
openjdk version "21.0.10" 2026-01-20
OpenJDK Runtime Environment (build 21.0.10+7-Ubuntu-122.04)
OpenJDK 64-Bit Server VM (build 21.0.10+7-Ubuntu-122.04, mixed mode, sharing)
Set JAVA_HOME
+ echo 'Set JAVA_HOME'
+ export JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64
+ JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64
++ readlink -e /usr/lib/jvm/java-21-openjdk-amd64/bin/java
Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java
Listing all open ports on controller system...
+ JAVA_RESOLVED=/usr/lib/jvm/java-21-openjdk-amd64/bin/java
+ echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java'
+ echo 'Listing all open ports on controller system...'
+ netstat -pnatu
/tmp/configuration-script.sh: line 40: netstat: command not found
Configuring cluster
+ '[' -f /tmp/custom_shard_config.txt ']'
+ echo 'Configuring cluster'
+ /tmp/karaf-0.24.0-SNAPSHOT/bin/configure_cluster.sh 1 10.30.170.21 10.30.171.237 10.30.170.243
################################################
## Configure Cluster ##
################################################
NOTE: Cluster configuration files not found. Copying from
/tmp/karaf-0.24.0-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/12.0.3
Configuring unique name in pekko.conf
Configuring hostname in pekko.conf
Configuring data and rpc seed nodes in pekko.conf
modules = [
]
Configuring replication type in module-shards.conf
################################################
## NOTE: Manually restart controller to ##
## apply configuration. ##
################################################
Dump pekko.conf
+ echo 'Dump pekko.conf'
+ cat /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/pekko.conf
odl-cluster-data {
pekko {
remote {
artery {
enabled = on
transport = tcp
canonical.hostname = "10.30.170.21"
canonical.port = 2550
}
}
cluster {
# Using artery.
seed-nodes = ["pekko://opendaylight-cluster-data@10.30.170.21:2550",
"pekko://opendaylight-cluster-data@10.30.171.237:2550",
"pekko://opendaylight-cluster-data@10.30.170.243:2550"]
roles = ["member-1"]
# when under load we might trip a false positive on the failure detector
# failure-detector {
# heartbeat-interval = 4 s
# acceptable-heartbeat-pause = 16s
# }
}
persistence {
# By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by
# modifying the following two properties. The directory location specified may be a relative or absolute path.
# The relative path is always relative to KARAF_HOME.
# snapshot-store.local.dir = "target/snapshots"
}
disable-default-actor-system-quarantined-event-handling = "false"
}
}
Dump modules.conf
+ echo 'Dump modules.conf'
+ cat /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/modules.conf
modules = [
]
Dump module-shards.conf
+ echo 'Dump module-shards.conf'
+ cat /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/module-shards.conf
module-shards = [
{
name = "default"
shards = [
{
name = "default"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
}
]
Configuring member-2 with IP address 10.30.171.237
Warning: Permanently added '10.30.171.237' (ED25519) to the list of known hosts.
Warning: Permanently added '10.30.171.237' (ED25519) to the list of known hosts.
+ source /tmp/common-functions.sh karaf-0.24.0-SNAPSHOT chromium
++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]]
common-functions.sh is being sourced
++ echo 'common-functions.sh is being sourced'
++ BUNDLEFOLDER=karaf-0.24.0-SNAPSHOT
++ DISTROSTREAM=chromium
++ export MAVENCONF=/tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
++ MAVENCONF=/tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
++ export FEATURESCONF=/tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
++ FEATURESCONF=/tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
++ export CUSTOMPROP=/tmp/karaf-0.24.0-SNAPSHOT/etc/custom.properties
++ CUSTOMPROP=/tmp/karaf-0.24.0-SNAPSHOT/etc/custom.properties
++ export LOGCONF=/tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
++ LOGCONF=/tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
++ export MEMCONF=/tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
++ MEMCONF=/tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
++ export CONTROLLERMEM=
++ CONTROLLERMEM=
++ case "${DISTROSTREAM}" in
++ CLUSTER_SYSTEM=pekko
++ export AKKACONF=/tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/pekko.conf
++ AKKACONF=/tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/pekko.conf
++ export MODULESCONF=/tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/modules.conf
++ MODULESCONF=/tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/modules.conf
++ export MODULESHARDSCONF=/tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/module-shards.conf
++ MODULESHARDSCONF=/tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/module-shards.conf
++ print_common_env
++ cat
common-functions environment:
MAVENCONF: /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
ACTUALFEATURES:
FEATURESCONF: /tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
CUSTOMPROP: /tmp/karaf-0.24.0-SNAPSHOT/etc/custom.properties
LOGCONF: /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
MEMCONF: /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
CONTROLLERMEM:
AKKACONF: /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/pekko.conf
MODULESCONF: /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/modules.conf
MODULESHARDSCONF: /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/module-shards.conf
SUITES:
++ SSH='ssh -t -t'
++ extra_services_cntl=' dnsmasq.service httpd.service libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service rabbitmq-server.service '
++ extra_services_cmp=' libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service '
Changing to /tmp
Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.24.0-SNAPSHOT/karaf-0.24.0-20260329.223546-282.zip
+ echo 'Changing to /tmp'
+ cd /tmp
+ echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.24.0-SNAPSHOT/karaf-0.24.0-20260329.223546-282.zip'
+ wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.24.0-SNAPSHOT/karaf-0.24.0-20260329.223546-282.zip
--2026-03-29 23:29:34-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.24.0-SNAPSHOT/karaf-0.24.0-20260329.223546-282.zip
Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6
Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 240370190 (229M) [application/zip]
Saving to: ‘karaf-0.24.0-20260329.223546-282.zip’
0K ........ ........ ........ ........ ........ ........ 1% 105M 2s
3072K ........ ........ ........ ........ ........ ........ 2% 122M 2s
6144K ........ ........ ........ ........ ........ ........ 3% 154M 2s
9216K ........ ........ ........ ........ ........ ........ 5% 164M 2s
12288K ........ ........ ........ ........ ........ ........ 6% 163M 2s
15360K ........ ........ ........ ........ ........ ........ 7% 213M 1s
18432K ........ ........ ........ ........ ........ ........ 9% 246M 1s
21504K ........ ........ ........ ........ ........ ........ 10% 279M 1s
24576K ........ ........ ........ ........ ........ ........ 11% 308M 1s
27648K ........ ........ ........ ........ ........ ........ 13% 314M 1s
30720K ........ ........ ........ ........ ........ ........ 14% 300M 1s
33792K ........ ........ ........ ........ ........ ........ 15% 309M 1s
36864K ........ ........ ........ ........ ........ ........ 17% 305M 1s
39936K ........ ........ ........ ........ ........ ........ 18% 346M 1s
43008K ........ ........ ........ ........ ........ ........ 19% 361M 1s
46080K ........ ........ ........ ........ ........ ........ 20% 305M 1s
49152K ........ ........ ........ ........ ........ ........ 22% 337M 1s
52224K ........ ........ ........ ........ ........ ........ 23% 375M 1s
55296K ........ ........ ........ ........ ........ ........ 24% 280M 1s
58368K ........ ........ ........ ........ ........ ........ 26% 354M 1s
61440K ........ ........ ........ ........ ........ ........ 27% 372M 1s
64512K ........ ........ ........ ........ ........ ........ 28% 356M 1s
67584K ........ ........ ........ ........ ........ ........ 30% 266M 1s
70656K ........ ........ ........ ........ ........ ........ 31% 334M 1s
73728K ........ ........ ........ ........ ........ ........ 32% 379M 1s
76800K ........ ........ ........ ........ ........ ........ 34% 343M 1s
79872K ........ ........ ........ ........ ........ ........ 35% 274M 1s
82944K ........ ........ ........ ........ ........ ........ 36% 293M 1s
86016K ........ ........ ........ ........ ........ ........ 37% 345M 1s
89088K ........ ........ ........ ........ ........ ........ 39% 324M 1s
92160K ........ ........ ........ ........ ........ ........ 40% 395M 1s
95232K ........ ........ ........ ........ ........ ........ 41% 265M 1s
98304K ........ ........ ........ ........ ........ ........ 43% 333M 0s
101376K ........ ........ ........ ........ ........ ........ 44% 396M 0s
104448K ........ ........ ........ ........ ........ ........ 45% 291M 0s
107520K ........ ........ ........ ........ ........ ........ 47% 318M 0s
110592K ........ ........ ........ ........ ........ ........ 48% 328M 0s
113664K ........ ........ ........ ........ ........ ........ 49% 382M 0s
116736K ........ ........ ........ ........ ........ ........ 51% 223M 0s
119808K ........ ........ ........ ........ ........ ........ 52% 305M 0s
122880K ........ ........ ........ ........ ........ ........ 53% 360M 0s
125952K ........ ........ ........ ........ ........ ........ 54% 328M 0s
129024K ........ ........ ........ ........ ........ ........ 56% 359M 0s
132096K ........ ........ ........ ........ ........ ........ 57% 341M 0s
135168K ........ ........ ........ ........ ........ ........ 58% 324M 0s
138240K ........ ........ ........ ........ ........ ........ 60% 337M 0s
141312K ........ ........ ........ ........ ........ ........ 61% 349M 0s
144384K ........ ........ ........ ........ ........ ........ 62% 348M 0s
147456K ........ ........ ........ ........ ........ ........ 64% 353M 0s
150528K ........ ........ ........ ........ ........ ........ 65% 325M 0s
153600K ........ ........ ........ ........ ........ ........ 66% 357M 0s
156672K ........ ........ ........ ........ ........ ........ 68% 335M 0s
159744K ........ ........ ........ ........ ........ ........ 69% 354M 0s
162816K ........ ........ ........ ........ ........ ........ 70% 342M 0s
165888K ........ ........ ........ ........ ........ ........ 71% 358M 0s
168960K ........ ........ ........ ........ ........ ........ 73% 343M 0s
172032K ........ ........ ........ ........ ........ ........ 74% 344M 0s
175104K ........ ........ ........ ........ ........ ........ 75% 343M 0s
178176K ........ ........ ........ ........ ........ ........ 77% 335M 0s
181248K ........ ........ ........ ........ ........ ........ 78% 353M 0s
184320K ........ ........ ........ ........ ........ ........ 79% 342M 0s
187392K ........ ........ ........ ........ ........ ........ 81% 307M 0s
190464K ........ ........ ........ ........ ........ ........ 82% 247M 0s
193536K ........ ........ ........ ........ ........ ........ 83% 296M 0s
196608K ........ ........ ........ ........ ........ ........ 85% 312M 0s
199680K ........ ........ ........ ........ ........ ........ 86% 344M 0s
202752K ........ ........ ........ ........ ........ ........ 87% 350M 0s
205824K ........ ........ ........ ........ ........ ........ 88% 350M 0s
208896K ........ ........ ........ ........ ........ ........ 90% 320M 0s
211968K ........ ........ ........ ........ ........ ........ 91% 306M 0s
215040K ........ ........ ........ ........ ........ ........ 92% 392M 0s
218112K ........ ........ ........ ........ ........ ........ 94% 348M 0s
221184K ........ ........ ........ ........ ........ ........ 95% 339M 0s
224256K ........ ........ ........ ........ ........ ........ 96% 344M 0s
227328K ........ ........ ........ ........ ........ ........ 98% 334M 0s
230400K ........ ........ ........ ........ ........ ........ 99% 342M 0s
233472K ........ ........ ... 100% 307M=0.8s
2026-03-29 23:29:35 (297 MB/s) - ‘karaf-0.24.0-20260329.223546-282.zip’ saved [240370190/240370190]
Extracting the new controller...
+ echo 'Extracting the new controller...'
+ unzip -q karaf-0.24.0-20260329.223546-282.zip
Adding external repositories...
+ echo 'Adding external repositories...'
+ sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
+ cat /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
################################################################################
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
################################################################################
#
# If set to true, the following property will not allow any certificate to be used
# when accessing Maven repositories through SSL
#
#org.ops4j.pax.url.mvn.certificateCheck=
#
# Path to the local Maven settings file.
# The repositories defined in this file will be automatically added to the list
# of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property
# below is not set.
# The following locations are checked for the existence of the settings.xml file
# * 1. looks for the specified url
# * 2. if not found looks for ${user.home}/.m2/settings.xml
# * 3. if not found looks for ${maven.home}/conf/settings.xml
# * 4. if not found looks for ${M2_HOME}/conf/settings.xml
#
#org.ops4j.pax.url.mvn.settings=
#
# Path to the local Maven repository which is used to avoid downloading
# artifacts when they already exist locally.
# The value of this property will be extracted from the settings.xml file
# above, or defaulted to:
# System.getProperty( "user.home" ) + "/.m2/repository"
#
org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository}
#
# Default this to false. It's just weird to use undocumented repos
#
org.ops4j.pax.url.mvn.useFallbackRepositories=false
#
# Uncomment if you don't wanna use the proxy settings
# from the Maven conf/settings.xml file
#
# org.ops4j.pax.url.mvn.proxySupport=false
#
# Comma separated list of repositories scanned when resolving an artifact.
# Those repositories will be checked before iterating through the
# below list of repositories and even before the local repository
# A repository url can be appended with zero or more of the following flags:
# @snapshots : the repository contains snaphots
# @noreleases : the repository does not contain any released artifacts
#
# The following property value will add the system folder as a repo.
#
org.ops4j.pax.url.mvn.defaultRepositories=\
file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\
file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\
file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots
# Use the default local repo (e.g.~/.m2/repository) as a "remote" repo
#org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false
#
# Comma separated list of repositories scanned when resolving an artifact.
# The default list includes the following repositories:
# http://repo1.maven.org/maven2@id=central
# http://repository.springsource.com/maven/bundles/release@id=spring.ebr
# http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external
# http://zodiac.springsource.com/maven/bundles/release@id=gemini
# http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases
# https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases
# https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
# To add repositories to the default ones, prepend '+' to the list of repositories
# to add.
# A repository url can be appended with zero or more of the following flags:
# @snapshots : the repository contains snapshots
# @noreleases : the repository does not contain any released artifacts
# @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended
#
org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.
Configuring the startup features...
+ [[ True == \T\r\u\e ]]
+ echo 'Configuring the startup features...'
+ sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-infrautils-ready,odl-jolokia,odl-restconf-noauth,odl-clustering-test-app,/g' /tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
+ FEATURE_TEST_STRING=features-test
+ FEATURE_TEST_VERSION=0.24.0-SNAPSHOT
+ KARAF_VERSION=karaf4
+ [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]]
+ sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.24.0-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
+ [[ ! -z '' ]]
+ cat /tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
################################################################################
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
################################################################################
#
# Comma separated list of features repositories to register by default
#
featuresRepositories = mvn:org.opendaylight.integration/features-test/0.24.0-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/792c4f45-5ba1-49bc-be4a-16ed2d6891f2.xml
#
# Comma separated list of features to install at startup
#
featuresBoot = odl-infrautils-ready,odl-jolokia,odl-restconf-noauth,odl-clustering-test-app, 6146c482-a3a3-444e-885d-60bc28c2ed0b
#
# Resource repositories (OBR) that the features resolver can use
# to resolve requirements/capabilities
#
# The format of the resourceRepositories is
# resourceRepositories=[xml:url|json:url],...
# for Instance:
#
#resourceRepositories=xml:http://host/path/to/index.xml
# or
#resourceRepositories=json:http://host/path/to/index.json
#
#
# Defines if the boot features are started in asynchronous mode (in a dedicated thread)
#
featuresBootAsynchronous=false
#
# Service requirements enforcement
#
# By default, the feature resolver checks the service requirements/capabilities of
# bundles for new features (xml schema >= 1.3.0) in order to automatically installs
# the required bundles.
# The following flag can have those values:
# - disable: service requirements are completely ignored
# - default: service requirements are ignored for old features
# - enforce: service requirements are always verified
#
#serviceRequirements=default
#
# Store cfg file for config element in feature
#
#configCfgStore=true
#
# Define if the feature service automatically refresh bundles
#
autoRefresh=true
#
# Configuration of features processing mechanism (overrides, blacklisting, modification of features)
# XML file defines instructions related to features processing
# versions.properties may declare properties to resolve placeholders in XML file
# both files are relative to ${karaf.etc}
#
#featureProcessing=org.apache.karaf.features.xml
#featureProcessingVersions=versions.properties
+ configure_karaf_log karaf4 ''
+ local -r karaf_version=karaf4
+ local -r controllerdebugmap=
+ local logapi=log4j
+ grep log4j2 /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
log4j2.rootLogger.level = INFO
#log4j2.rootLogger.type = asyncRoot
#log4j2.rootLogger.includeLocation = false
log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
log4j2.rootLogger.appenderRef.Console.ref = Console
log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
log4j2.logger.spifly.name = org.apache.aries.spifly
log4j2.logger.spifly.level = WARN
log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
log4j2.logger.audit.level = INFO
log4j2.logger.audit.additivity = false
log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
# Console appender not used by default (see log4j2.rootLogger.appenderRefs)
log4j2.appender.console.type = Console
log4j2.appender.console.name = Console
log4j2.appender.console.layout.type = PatternLayout
log4j2.appender.console.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.type = RollingRandomAccessFile
log4j2.appender.rolling.name = RollingFile
log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
#log4j2.appender.rolling.immediateFlush = false
log4j2.appender.rolling.append = true
log4j2.appender.rolling.layout.type = PatternLayout
log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.policies.type = Policies
log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.rolling.policies.size.size = 64MB
log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
log4j2.appender.rolling.strategy.max = 7
log4j2.appender.audit.type = RollingRandomAccessFile
log4j2.appender.audit.name = AuditRollingFile
log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
log4j2.appender.audit.append = true
log4j2.appender.audit.layout.type = PatternLayout
log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
log4j2.appender.audit.policies.type = Policies
log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.audit.policies.size.size = 8MB
log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
log4j2.appender.audit.strategy.max = 7
log4j2.appender.osgi.type = PaxOsgi
log4j2.appender.osgi.name = PaxOsgi
log4j2.appender.osgi.filter = *
#log4j2.logger.aether.name = shaded.org.eclipse.aether
#log4j2.logger.aether.level = TRACE
#log4j2.logger.http-headers.name = shaded.org.apache.http.headers
#log4j2.logger.http-headers.level = DEBUG
#log4j2.logger.maven.name = org.ops4j.pax.url.mvn
#log4j2.logger.maven.level = TRACE
+ logapi=log4j2
Configuring the karaf log... karaf_version: karaf4, logapi: log4j2
+ echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2'
+ '[' log4j2 == log4j2 ']'
+ sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
+ orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver
+ orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver
+ echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN'
+ echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN'
controllerdebugmap:
cat /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
+ unset IFS
+ echo 'controllerdebugmap: '
+ '[' -n '' ']'
+ echo 'cat /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg'
+ cat /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
################################################################################
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
################################################################################
# Common pattern layout for appenders
log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
# Root logger
log4j2.rootLogger.level = INFO
# uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library
#log4j2.rootLogger.type = asyncRoot
#log4j2.rootLogger.includeLocation = false
log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
log4j2.rootLogger.appenderRef.Console.ref = Console
log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
# Filters for logs marked by org.opendaylight.odlparent.Markers
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
# Loggers configuration
# Spifly logger
log4j2.logger.spifly.name = org.apache.aries.spifly
log4j2.logger.spifly.level = WARN
# Security audit logger
log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
log4j2.logger.audit.level = INFO
log4j2.logger.audit.additivity = false
log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
# Appenders configuration
# Console appender not used by default (see log4j2.rootLogger.appenderRefs)
log4j2.appender.console.type = Console
log4j2.appender.console.name = Console
log4j2.appender.console.layout.type = PatternLayout
log4j2.appender.console.layout.pattern = ${log4j2.pattern}
# Rolling file appender
log4j2.appender.rolling.type = RollingRandomAccessFile
log4j2.appender.rolling.name = RollingFile
log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
# uncomment to not force a disk flush
#log4j2.appender.rolling.immediateFlush = false
log4j2.appender.rolling.append = true
log4j2.appender.rolling.layout.type = PatternLayout
log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.policies.type = Policies
log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.rolling.policies.size.size = 1GB
log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
log4j2.appender.rolling.strategy.max = 7
# Audit file appender
log4j2.appender.audit.type = RollingRandomAccessFile
log4j2.appender.audit.name = AuditRollingFile
log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
log4j2.appender.audit.append = true
log4j2.appender.audit.layout.type = PatternLayout
log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
log4j2.appender.audit.policies.type = Policies
log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.audit.policies.size.size = 8MB
log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
log4j2.appender.audit.strategy.max = 7
# OSGi appender
log4j2.appender.osgi.type = PaxOsgi
log4j2.appender.osgi.name = PaxOsgi
log4j2.appender.osgi.filter = *
# help with identification of maven-related problems with pax-url-aether
#log4j2.logger.aether.name = shaded.org.eclipse.aether
#log4j2.logger.aether.level = TRACE
#log4j2.logger.http-headers.name = shaded.org.apache.http.headers
#log4j2.logger.http-headers.level = DEBUG
#log4j2.logger.maven.name = org.ops4j.pax.url.mvn
#log4j2.logger.maven.level = TRACE
log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN
log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN
+ set_java_vars /usr/lib/jvm/java-21-openjdk-amd64 2048m /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
+ local -r java_home=/usr/lib/jvm/java-21-openjdk-amd64
+ local -r controllermem=2048m
Configure
java home: /usr/lib/jvm/java-21-openjdk-amd64
max memory: 2048m
memconf: /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
+ local -r memconf=/tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
+ echo Configure
+ echo ' java home: /usr/lib/jvm/java-21-openjdk-amd64'
+ echo ' max memory: 2048m'
+ echo ' memconf: /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv'
+ sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64}%g' /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
+ sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=2048m/g' /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
cat /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
+ echo 'cat /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv'
+ cat /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
#!/bin/sh
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
#
# handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf
# script: client, instance, shell, start, status, stop, karaf
#
# if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then
# Actions go here...
# fi
#
# general settings which should be applied for all scripts go here; please keep
# in mind that it is possible that scripts might be executed more than once, e.g.
# in example of the start script where the start script is executed first and the
# karaf script afterwards.
#
#
# The following section shows the possible configuration options for the default
# karaf scripts
#
export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64} # Location of Java installation
# export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration
# export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options
# export EXTRA_JAVA_OPTS # Additional JVM options
# export KARAF_HOME # Karaf home folder
# export KARAF_DATA # Karaf data folder
# export KARAF_BASE # Karaf base folder
# export KARAF_ETC # Karaf etc folder
# export KARAF_LOG # Karaf log folder
# export KARAF_SYSTEM_OPTS # First citizen Karaf options
# export KARAF_OPTS # Additional available Karaf options
# export KARAF_DEBUG # Enable debug mode
# export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start
# export KARAF_NOROOT # Prevent execution as root if set to true
Set Java version
+ echo 'Set Java version'
+ sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-21-openjdk-amd64/bin/java 1
sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper
sudo: a password is required
+ sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-21-openjdk-amd64/bin/java
sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper
sudo: a password is required
JDK default version ...
+ echo 'JDK default version ...'
+ java -version
openjdk version "21.0.10" 2026-01-20
OpenJDK Runtime Environment (build 21.0.10+7-Ubuntu-122.04)
OpenJDK 64-Bit Server VM (build 21.0.10+7-Ubuntu-122.04, mixed mode, sharing)
Set JAVA_HOME
+ echo 'Set JAVA_HOME'
+ export JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64
+ JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64
++ readlink -e /usr/lib/jvm/java-21-openjdk-amd64/bin/java
Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java
+ JAVA_RESOLVED=/usr/lib/jvm/java-21-openjdk-amd64/bin/java
+ echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java'
Listing all open ports on controller system...
+ echo 'Listing all open ports on controller system...'
+ netstat -pnatu
/tmp/configuration-script.sh: line 40: netstat: command not found
Configuring cluster
+ '[' -f /tmp/custom_shard_config.txt ']'
+ echo 'Configuring cluster'
+ /tmp/karaf-0.24.0-SNAPSHOT/bin/configure_cluster.sh 2 10.30.170.21 10.30.171.237 10.30.170.243
################################################
## Configure Cluster ##
################################################
NOTE: Cluster configuration files not found. Copying from
/tmp/karaf-0.24.0-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/12.0.3
Configuring unique name in pekko.conf
Configuring hostname in pekko.conf
Configuring data and rpc seed nodes in pekko.conf
modules = [
]
Configuring replication type in module-shards.conf
################################################
## NOTE: Manually restart controller to ##
## apply configuration. ##
################################################
Dump pekko.conf
+ echo 'Dump pekko.conf'
+ cat /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/pekko.conf
odl-cluster-data {
pekko {
remote {
artery {
enabled = on
transport = tcp
canonical.hostname = "10.30.171.237"
canonical.port = 2550
}
}
cluster {
# Using artery.
seed-nodes = ["pekko://opendaylight-cluster-data@10.30.170.21:2550",
"pekko://opendaylight-cluster-data@10.30.171.237:2550",
"pekko://opendaylight-cluster-data@10.30.170.243:2550"]
roles = ["member-2"]
# when under load we might trip a false positive on the failure detector
# failure-detector {
# heartbeat-interval = 4 s
# acceptable-heartbeat-pause = 16s
# }
}
persistence {
# By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by
# modifying the following two properties. The directory location specified may be a relative or absolute path.
# The relative path is always relative to KARAF_HOME.
# snapshot-store.local.dir = "target/snapshots"
}
disable-default-actor-system-quarantined-event-handling = "false"
}
}
Dump modules.conf
+ echo 'Dump modules.conf'
+ cat /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/modules.conf
modules = [
]
Dump module-shards.conf
+ echo 'Dump module-shards.conf'
+ cat /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/module-shards.conf
module-shards = [
{
name = "default"
shards = [
{
name = "default"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
}
]
Configuring member-3 with IP address 10.30.170.243
Warning: Permanently added '10.30.170.243' (ED25519) to the list of known hosts.
Warning: Permanently added '10.30.170.243' (ED25519) to the list of known hosts.
+ source /tmp/common-functions.sh karaf-0.24.0-SNAPSHOT chromium
++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]]
++ echo 'common-functions.sh is being sourced'
common-functions.sh is being sourced
++ BUNDLEFOLDER=karaf-0.24.0-SNAPSHOT
++ DISTROSTREAM=chromium
++ export MAVENCONF=/tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
++ MAVENCONF=/tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
++ export FEATURESCONF=/tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
++ FEATURESCONF=/tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
++ export CUSTOMPROP=/tmp/karaf-0.24.0-SNAPSHOT/etc/custom.properties
++ CUSTOMPROP=/tmp/karaf-0.24.0-SNAPSHOT/etc/custom.properties
++ export LOGCONF=/tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
++ LOGCONF=/tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
++ export MEMCONF=/tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
++ MEMCONF=/tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
++ export CONTROLLERMEM=
++ CONTROLLERMEM=
++ case "${DISTROSTREAM}" in
++ CLUSTER_SYSTEM=pekko
++ export AKKACONF=/tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/pekko.conf
++ AKKACONF=/tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/pekko.conf
++ export MODULESCONF=/tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/modules.conf
++ MODULESCONF=/tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/modules.conf
++ export MODULESHARDSCONF=/tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/module-shards.conf
++ MODULESHARDSCONF=/tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/module-shards.conf
++ print_common_env
++ cat
common-functions environment:
MAVENCONF: /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
ACTUALFEATURES:
FEATURESCONF: /tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
CUSTOMPROP: /tmp/karaf-0.24.0-SNAPSHOT/etc/custom.properties
LOGCONF: /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
MEMCONF: /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
CONTROLLERMEM:
AKKACONF: /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/pekko.conf
MODULESCONF: /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/modules.conf
MODULESHARDSCONF: /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/module-shards.conf
SUITES:
++ SSH='ssh -t -t'
++ extra_services_cntl=' dnsmasq.service httpd.service libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service rabbitmq-server.service '
++ extra_services_cmp=' libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service '
Changing to /tmp
+ echo 'Changing to /tmp'
+ cd /tmp
Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.24.0-SNAPSHOT/karaf-0.24.0-20260329.223546-282.zip
+ echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.24.0-SNAPSHOT/karaf-0.24.0-20260329.223546-282.zip'
+ wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.24.0-SNAPSHOT/karaf-0.24.0-20260329.223546-282.zip
--2026-03-29 23:29:38-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.24.0-SNAPSHOT/karaf-0.24.0-20260329.223546-282.zip
Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6
Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 240370190 (229M) [application/zip]
Saving to: ‘karaf-0.24.0-20260329.223546-282.zip’
0K ........ ........ ........ ........ ........ ........ 1% 83.3M 3s
3072K ........ ........ ........ ........ ........ ........ 2% 140M 2s
6144K ........ ........ ........ ........ ........ ........ 3% 111M 2s
9216K ........ ........ ........ ........ ........ ........ 5% 145M 2s
12288K ........ ........ ........ ........ ........ ........ 6% 154M 2s
15360K ........ ........ ........ ........ ........ ........ 7% 141M 2s
18432K ........ ........ ........ ........ ........ ........ 9% 153M 2s
21504K ........ ........ ........ ........ ........ ........ 10% 226M 2s
24576K ........ ........ ........ ........ ........ ........ 11% 212M 1s
27648K ........ ........ ........ ........ ........ ........ 13% 212M 1s
30720K ........ ........ ........ ........ ........ ........ 14% 223M 1s
33792K ........ ........ ........ ........ ........ ........ 15% 236M 1s
36864K ........ ........ ........ ........ ........ ........ 17% 238M 1s
39936K ........ ........ ........ ........ ........ ........ 18% 216M 1s
43008K ........ ........ ........ ........ ........ ........ 19% 234M 1s
46080K ........ ........ ........ ........ ........ ........ 20% 237M 1s
49152K ........ ........ ........ ........ ........ ........ 22% 280M 1s
52224K ........ ........ ........ ........ ........ ........ 23% 285M 1s
55296K ........ ........ ........ ........ ........ ........ 24% 273M 1s
58368K ........ ........ ........ ........ ........ ........ 26% 277M 1s
61440K ........ ........ ........ ........ ........ ........ 27% 269M 1s
64512K ........ ........ ........ ........ ........ ........ 28% 281M 1s
67584K ........ ........ ........ ........ ........ ........ 30% 229M 1s
70656K ........ ........ ........ ........ ........ ........ 31% 280M 1s
73728K ........ ........ ........ ........ ........ ........ 32% 245M 1s
76800K ........ ........ ........ ........ ........ ........ 34% 271M 1s
79872K ........ ........ ........ ........ ........ ........ 35% 225M 1s
82944K ........ ........ ........ ........ ........ ........ 36% 257M 1s
86016K ........ ........ ........ ........ ........ ........ 37% 286M 1s
89088K ........ ........ ........ ........ ........ ........ 39% 258M 1s
92160K ........ ........ ........ ........ ........ ........ 40% 262M 1s
95232K ........ ........ ........ ........ ........ ........ 41% 246M 1s
98304K ........ ........ ........ ........ ........ ........ 43% 206M 1s
101376K ........ ........ ........ ........ ........ ........ 44% 212M 1s
104448K ........ ........ ........ ........ ........ ........ 45% 197M 1s
107520K ........ ........ ........ ........ ........ ........ 47% 249M 1s
110592K ........ ........ ........ ........ ........ ........ 48% 282M 1s
113664K ........ ........ ........ ........ ........ ........ 49% 275M 1s
116736K ........ ........ ........ ........ ........ ........ 51% 278M 1s
119808K ........ ........ ........ ........ ........ ........ 52% 286M 1s
122880K ........ ........ ........ ........ ........ ........ 53% 265M 0s
125952K ........ ........ ........ ........ ........ ........ 54% 222M 0s
129024K ........ ........ ........ ........ ........ ........ 56% 239M 0s
132096K ........ ........ ........ ........ ........ ........ 57% 263M 0s
135168K ........ ........ ........ ........ ........ ........ 58% 271M 0s
138240K ........ ........ ........ ........ ........ ........ 60% 222M 0s
141312K ........ ........ ........ ........ ........ ........ 61% 204M 0s
144384K ........ ........ ........ ........ ........ ........ 62% 262M 0s
147456K ........ ........ ........ ........ ........ ........ 64% 285M 0s
150528K ........ ........ ........ ........ ........ ........ 65% 278M 0s
153600K ........ ........ ........ ........ ........ ........ 66% 285M 0s
156672K ........ ........ ........ ........ ........ ........ 68% 273M 0s
159744K ........ ........ ........ ........ ........ ........ 69% 270M 0s
162816K ........ ........ ........ ........ ........ ........ 70% 273M 0s
165888K ........ ........ ........ ........ ........ ........ 71% 268M 0s
168960K ........ ........ ........ ........ ........ ........ 73% 268M 0s
172032K ........ ........ ........ ........ ........ ........ 74% 266M 0s
175104K ........ ........ ........ ........ ........ ........ 75% 280M 0s
178176K ........ ........ ........ ........ ........ ........ 77% 274M 0s
181248K ........ ........ ........ ........ ........ ........ 78% 262M 0s
184320K ........ ........ ........ ........ ........ ........ 79% 259M 0s
187392K ........ ........ ........ ........ ........ ........ 81% 258M 0s
190464K ........ ........ ........ ........ ........ ........ 82% 262M 0s
193536K ........ ........ ........ ........ ........ ........ 83% 272M 0s
196608K ........ ........ ........ ........ ........ ........ 85% 272M 0s
199680K ........ ........ ........ ........ ........ ........ 86% 271M 0s
202752K ........ ........ ........ ........ ........ ........ 87% 267M 0s
205824K ........ ........ ........ ........ ........ ........ 88% 275M 0s
208896K ........ ........ ........ ........ ........ ........ 90% 262M 0s
211968K ........ ........ ........ ........ ........ ........ 91% 268M 0s
215040K ........ ........ ........ ........ ........ ........ 92% 271M 0s
218112K ........ ........ ........ ........ ........ ........ 94% 259M 0s
221184K ........ ........ ........ ........ ........ ........ 95% 250M 0s
224256K ........ ........ ........ ........ ........ ........ 96% 273M 0s
227328K ........ ........ ........ ........ ........ ........ 98% 271M 0s
230400K ........ ........ ........ ........ ........ ........ 99% 270M 0s
233472K ........ ........ ... 100% 271M=1.0s
2026-03-29 23:29:39 (233 MB/s) - ‘karaf-0.24.0-20260329.223546-282.zip’ saved [240370190/240370190]
+ echo 'Extracting the new controller...'
Extracting the new controller...
+ unzip -q karaf-0.24.0-20260329.223546-282.zip
Adding external repositories...
+ echo 'Adding external repositories...'
+ sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
+ cat /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
################################################################################
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
################################################################################
#
# If set to true, the following property will not allow any certificate to be used
# when accessing Maven repositories through SSL
#
#org.ops4j.pax.url.mvn.certificateCheck=
#
# Path to the local Maven settings file.
# The repositories defined in this file will be automatically added to the list
# of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property
# below is not set.
# The following locations are checked for the existence of the settings.xml file
# * 1. looks for the specified url
# * 2. if not found looks for ${user.home}/.m2/settings.xml
# * 3. if not found looks for ${maven.home}/conf/settings.xml
# * 4. if not found looks for ${M2_HOME}/conf/settings.xml
#
#org.ops4j.pax.url.mvn.settings=
#
# Path to the local Maven repository which is used to avoid downloading
# artifacts when they already exist locally.
# The value of this property will be extracted from the settings.xml file
# above, or defaulted to:
# System.getProperty( "user.home" ) + "/.m2/repository"
#
org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository}
#
# Default this to false. It's just weird to use undocumented repos
#
org.ops4j.pax.url.mvn.useFallbackRepositories=false
#
# Uncomment if you don't wanna use the proxy settings
# from the Maven conf/settings.xml file
#
# org.ops4j.pax.url.mvn.proxySupport=false
#
# Comma separated list of repositories scanned when resolving an artifact.
# Those repositories will be checked before iterating through the
# below list of repositories and even before the local repository
# A repository url can be appended with zero or more of the following flags:
# @snapshots : the repository contains snaphots
# @noreleases : the repository does not contain any released artifacts
#
# The following property value will add the system folder as a repo.
#
org.ops4j.pax.url.mvn.defaultRepositories=\
file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\
file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\
file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots
# Use the default local repo (e.g.~/.m2/repository) as a "remote" repo
#org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false
#
# Comma separated list of repositories scanned when resolving an artifact.
# The default list includes the following repositories:
# http://repo1.maven.org/maven2@id=central
# http://repository.springsource.com/maven/bundles/release@id=spring.ebr
# http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external
# http://zodiac.springsource.com/maven/bundles/release@id=gemini
# http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases
# https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases
# https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
# To add repositories to the default ones, prepend '+' to the list of repositories
# to add.
# A repository url can be appended with zero or more of the following flags:
# @snapshots : the repository contains snapshots
# @noreleases : the repository does not contain any released artifacts
# @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended
#
org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases
### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.
Configuring the startup features...
+ [[ True == \T\r\u\e ]]
+ echo 'Configuring the startup features...'
+ sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-infrautils-ready,odl-jolokia,odl-restconf-noauth,odl-clustering-test-app,/g' /tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
+ FEATURE_TEST_STRING=features-test
+ FEATURE_TEST_VERSION=0.24.0-SNAPSHOT
+ KARAF_VERSION=karaf4
+ [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]]
+ sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.24.0-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
+ [[ ! -z '' ]]
+ cat /tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
################################################################################
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
################################################################################
#
# Comma separated list of features repositories to register by default
#
featuresRepositories = mvn:org.opendaylight.integration/features-test/0.24.0-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/792c4f45-5ba1-49bc-be4a-16ed2d6891f2.xml
#
# Comma separated list of features to install at startup
#
featuresBoot = odl-infrautils-ready,odl-jolokia,odl-restconf-noauth,odl-clustering-test-app, 6146c482-a3a3-444e-885d-60bc28c2ed0b
#
# Resource repositories (OBR) that the features resolver can use
# to resolve requirements/capabilities
#
# The format of the resourceRepositories is
# resourceRepositories=[xml:url|json:url],...
# for Instance:
#
#resourceRepositories=xml:http://host/path/to/index.xml
# or
#resourceRepositories=json:http://host/path/to/index.json
#
#
# Defines if the boot features are started in asynchronous mode (in a dedicated thread)
#
featuresBootAsynchronous=false
#
# Service requirements enforcement
#
# By default, the feature resolver checks the service requirements/capabilities of
# bundles for new features (xml schema >= 1.3.0) in order to automatically installs
# the required bundles.
# The following flag can have those values:
# - disable: service requirements are completely ignored
# - default: service requirements are ignored for old features
# - enforce: service requirements are always verified
#
#serviceRequirements=default
#
# Store cfg file for config element in feature
#
#configCfgStore=true
#
# Define if the feature service automatically refresh bundles
#
autoRefresh=true
#
# Configuration of features processing mechanism (overrides, blacklisting, modification of features)
# XML file defines instructions related to features processing
# versions.properties may declare properties to resolve placeholders in XML file
# both files are relative to ${karaf.etc}
#
#featureProcessing=org.apache.karaf.features.xml
#featureProcessingVersions=versions.properties
+ configure_karaf_log karaf4 ''
+ local -r karaf_version=karaf4
+ local -r controllerdebugmap=
+ local logapi=log4j
+ grep log4j2 /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
log4j2.rootLogger.level = INFO
#log4j2.rootLogger.type = asyncRoot
#log4j2.rootLogger.includeLocation = false
log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
log4j2.rootLogger.appenderRef.Console.ref = Console
log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
log4j2.logger.spifly.name = org.apache.aries.spifly
log4j2.logger.spifly.level = WARN
log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
log4j2.logger.audit.level = INFO
log4j2.logger.audit.additivity = false
log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
# Console appender not used by default (see log4j2.rootLogger.appenderRefs)
log4j2.appender.console.type = Console
log4j2.appender.console.name = Console
log4j2.appender.console.layout.type = PatternLayout
log4j2.appender.console.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.type = RollingRandomAccessFile
log4j2.appender.rolling.name = RollingFile
log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
#log4j2.appender.rolling.immediateFlush = false
log4j2.appender.rolling.append = true
log4j2.appender.rolling.layout.type = PatternLayout
log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.policies.type = Policies
log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.rolling.policies.size.size = 64MB
log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
log4j2.appender.rolling.strategy.max = 7
log4j2.appender.audit.type = RollingRandomAccessFile
log4j2.appender.audit.name = AuditRollingFile
log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
log4j2.appender.audit.append = true
log4j2.appender.audit.layout.type = PatternLayout
log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
log4j2.appender.audit.policies.type = Policies
log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.audit.policies.size.size = 8MB
log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
log4j2.appender.audit.strategy.max = 7
log4j2.appender.osgi.type = PaxOsgi
log4j2.appender.osgi.name = PaxOsgi
log4j2.appender.osgi.filter = *
#log4j2.logger.aether.name = shaded.org.eclipse.aether
#log4j2.logger.aether.level = TRACE
#log4j2.logger.http-headers.name = shaded.org.apache.http.headers
#log4j2.logger.http-headers.level = DEBUG
#log4j2.logger.maven.name = org.ops4j.pax.url.mvn
#log4j2.logger.maven.level = TRACE
+ logapi=log4j2
+ echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2'
Configuring the karaf log... karaf_version: karaf4, logapi: log4j2
+ '[' log4j2 == log4j2 ']'
+ sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
+ orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver
+ orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver
+ echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN'
+ echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN'
+ unset IFS
+ echo 'controllerdebugmap: '
controllerdebugmap:
+ '[' -n '' ']'
cat /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
+ echo 'cat /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg'
+ cat /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
################################################################################
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
################################################################################
# Common pattern layout for appenders
log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n
# Root logger
log4j2.rootLogger.level = INFO
# uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library
#log4j2.rootLogger.type = asyncRoot
#log4j2.rootLogger.includeLocation = false
log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile
log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi
log4j2.rootLogger.appenderRef.Console.ref = Console
log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter
log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF}
# Filters for logs marked by org.opendaylight.odlparent.Markers
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY
log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL
# Loggers configuration
# Spifly logger
log4j2.logger.spifly.name = org.apache.aries.spifly
log4j2.logger.spifly.level = WARN
# Security audit logger
log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit
log4j2.logger.audit.level = INFO
log4j2.logger.audit.additivity = false
log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile
# Appenders configuration
# Console appender not used by default (see log4j2.rootLogger.appenderRefs)
log4j2.appender.console.type = Console
log4j2.appender.console.name = Console
log4j2.appender.console.layout.type = PatternLayout
log4j2.appender.console.layout.pattern = ${log4j2.pattern}
# Rolling file appender
log4j2.appender.rolling.type = RollingRandomAccessFile
log4j2.appender.rolling.name = RollingFile
log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log
log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i
# uncomment to not force a disk flush
#log4j2.appender.rolling.immediateFlush = false
log4j2.appender.rolling.append = true
log4j2.appender.rolling.layout.type = PatternLayout
log4j2.appender.rolling.layout.pattern = ${log4j2.pattern}
log4j2.appender.rolling.policies.type = Policies
log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.rolling.policies.size.size = 1GB
log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy
log4j2.appender.rolling.strategy.max = 7
# Audit file appender
log4j2.appender.audit.type = RollingRandomAccessFile
log4j2.appender.audit.name = AuditRollingFile
log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log
log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i
log4j2.appender.audit.append = true
log4j2.appender.audit.layout.type = PatternLayout
log4j2.appender.audit.layout.pattern = ${log4j2.pattern}
log4j2.appender.audit.policies.type = Policies
log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy
log4j2.appender.audit.policies.size.size = 8MB
log4j2.appender.audit.strategy.type = DefaultRolloverStrategy
log4j2.appender.audit.strategy.max = 7
# OSGi appender
log4j2.appender.osgi.type = PaxOsgi
log4j2.appender.osgi.name = PaxOsgi
log4j2.appender.osgi.filter = *
# help with identification of maven-related problems with pax-url-aether
#log4j2.logger.aether.name = shaded.org.eclipse.aether
#log4j2.logger.aether.level = TRACE
#log4j2.logger.http-headers.name = shaded.org.apache.http.headers
#log4j2.logger.http-headers.level = DEBUG
#log4j2.logger.maven.name = org.ops4j.pax.url.mvn
#log4j2.logger.maven.level = TRACE
log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN
log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN
+ set_java_vars /usr/lib/jvm/java-21-openjdk-amd64 2048m /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
+ local -r java_home=/usr/lib/jvm/java-21-openjdk-amd64
+ local -r controllermem=2048m
+ local -r memconf=/tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
+ echo Configure
Configure
java home: /usr/lib/jvm/java-21-openjdk-amd64
+ echo ' java home: /usr/lib/jvm/java-21-openjdk-amd64'
max memory: 2048m
+ echo ' max memory: 2048m'
+ echo ' memconf: /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv'
memconf: /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
+ sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64}%g' /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
+ sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=2048m/g' /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
cat /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
+ echo 'cat /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv'
+ cat /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
#!/bin/sh
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
#
# handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf
# script: client, instance, shell, start, status, stop, karaf
#
# if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then
# Actions go here...
# fi
#
# general settings which should be applied for all scripts go here; please keep
# in mind that it is possible that scripts might be executed more than once, e.g.
# in example of the start script where the start script is executed first and the
# karaf script afterwards.
#
#
# The following section shows the possible configuration options for the default
# karaf scripts
#
export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64} # Location of Java installation
# export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration
# export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options
# export EXTRA_JAVA_OPTS # Additional JVM options
# export KARAF_HOME # Karaf home folder
# export KARAF_DATA # Karaf data folder
# export KARAF_BASE # Karaf base folder
# export KARAF_ETC # Karaf etc folder
# export KARAF_LOG # Karaf log folder
# export KARAF_SYSTEM_OPTS # First citizen Karaf options
# export KARAF_OPTS # Additional available Karaf options
# export KARAF_DEBUG # Enable debug mode
# export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start
# export KARAF_NOROOT # Prevent execution as root if set to true
+ echo 'Set Java version'
Set Java version
+ sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-21-openjdk-amd64/bin/java 1
sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper
sudo: a password is required
+ sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-21-openjdk-amd64/bin/java
sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper
sudo: a password is required
+ echo 'JDK default version ...'
JDK default version ...
+ java -version
openjdk version "21.0.10" 2026-01-20
OpenJDK Runtime Environment (build 21.0.10+7-Ubuntu-122.04)
OpenJDK 64-Bit Server VM (build 21.0.10+7-Ubuntu-122.04, mixed mode, sharing)
Set JAVA_HOME
+ echo 'Set JAVA_HOME'
+ export JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64
+ JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64
++ readlink -e /usr/lib/jvm/java-21-openjdk-amd64/bin/java
Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java
Listing all open ports on controller system...
+ JAVA_RESOLVED=/usr/lib/jvm/java-21-openjdk-amd64/bin/java
+ echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java'
+ echo 'Listing all open ports on controller system...'
+ netstat -pnatu
/tmp/configuration-script.sh: line 40: netstat: command not found
Configuring cluster
+ '[' -f /tmp/custom_shard_config.txt ']'
+ echo 'Configuring cluster'
+ /tmp/karaf-0.24.0-SNAPSHOT/bin/configure_cluster.sh 3 10.30.170.21 10.30.171.237 10.30.170.243
################################################
## Configure Cluster ##
################################################
NOTE: Cluster configuration files not found. Copying from
/tmp/karaf-0.24.0-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/12.0.3
Configuring unique name in pekko.conf
Configuring hostname in pekko.conf
Configuring data and rpc seed nodes in pekko.conf
modules = [
]
Configuring replication type in module-shards.conf
################################################
## NOTE: Manually restart controller to ##
## apply configuration. ##
################################################
Dump pekko.conf
+ echo 'Dump pekko.conf'
+ cat /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/pekko.conf
odl-cluster-data {
pekko {
remote {
artery {
enabled = on
transport = tcp
canonical.hostname = "10.30.170.243"
canonical.port = 2550
}
}
cluster {
# Using artery.
seed-nodes = ["pekko://opendaylight-cluster-data@10.30.170.21:2550",
"pekko://opendaylight-cluster-data@10.30.171.237:2550",
"pekko://opendaylight-cluster-data@10.30.170.243:2550"]
roles = ["member-3"]
# when under load we might trip a false positive on the failure detector
# failure-detector {
# heartbeat-interval = 4 s
# acceptable-heartbeat-pause = 16s
# }
}
persistence {
# By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by
# modifying the following two properties. The directory location specified may be a relative or absolute path.
# The relative path is always relative to KARAF_HOME.
# snapshot-store.local.dir = "target/snapshots"
}
disable-default-actor-system-quarantined-event-handling = "false"
}
}
Dump modules.conf
+ echo 'Dump modules.conf'
+ cat /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/modules.conf
modules = [
]
Dump module-shards.conf
+ echo 'Dump module-shards.conf'
+ cat /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/module-shards.conf
module-shards = [
{
name = "default"
shards = [
{
name = "default"
replicas = ["member-1",
"member-2",
"member-3"]
}
]
}
]
Locating config plan to use...
Finished running config plans
Starting member-1 with IP address 10.30.170.21
Warning: Permanently added '10.30.170.21' (ED25519) to the list of known hosts.
Warning: Permanently added '10.30.170.21' (ED25519) to the list of known hosts.
Redirecting karaf console output to karaf_console.log
Starting controller...
start: Redirecting Karaf output to /tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf_console.log
Starting member-2 with IP address 10.30.171.237
Warning: Permanently added '10.30.171.237' (ED25519) to the list of known hosts.
Warning: Permanently added '10.30.171.237' (ED25519) to the list of known hosts.
Redirecting karaf console output to karaf_console.log
Starting controller...
start: Redirecting Karaf output to /tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf_console.log
Starting member-3 with IP address 10.30.170.243
Warning: Permanently added '10.30.170.243' (ED25519) to the list of known hosts.
Warning: Permanently added '10.30.170.243' (ED25519) to the list of known hosts.
Redirecting karaf console output to karaf_console.log
Starting controller...
start: Redirecting Karaf output to /tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf_console.log
[controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium] $ /bin/bash /tmp/jenkins12111394721646417374.sh
common-functions.sh is being sourced
common-functions environment:
MAVENCONF: /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg
ACTUALFEATURES:
FEATURESCONF: /tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg
CUSTOMPROP: /tmp/karaf-0.24.0-SNAPSHOT/etc/custom.properties
LOGCONF: /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg
MEMCONF: /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv
CONTROLLERMEM: 2048m
AKKACONF: /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/pekko.conf
MODULESCONF: /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/modules.conf
MODULESHARDSCONF: /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/module-shards.conf
SUITES:
+ echo '#################################################'
#################################################
+ echo '## Verify Cluster is UP ##'
## Verify Cluster is UP ##
+ echo '#################################################'
#################################################
+ create_post_startup_script
+ cat
+ copy_and_run_post_startup_script
+ seed_index=1
++ seq 1 3
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_1_IP
+ echo 'Execute the post startup script on controller 10.30.170.21'
Execute the post startup script on controller 10.30.170.21
+ scp /w/workspace/controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium/post-startup-script.sh 10.30.170.21:/tmp/
Warning: Permanently added '10.30.170.21' (ED25519) to the list of known hosts.
+ ssh 10.30.170.21 'bash /tmp/post-startup-script.sh 1'
Warning: Permanently added '10.30.170.21' (ED25519) to the list of known hosts.
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
Waiting up to 3 minutes for controller to come up, checking every 5 seconds...
2026-03-29T23:30:11,493 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 154 - org.opendaylight.infrautils.ready-api - 7.1.9 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
Controller is UP
2026-03-29T23:30:11,493 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 154 - org.opendaylight.infrautils.ready-api - 7.1.9 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
Listing all open ports on controller system...
/tmp/post-startup-script.sh: line 51: netstat: command not found
looking for "BindException: Address already in use" in log file
looking for "server is unhealthy" in log file
+ '[' 1 == 0 ']'
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_2_IP
+ echo 'Execute the post startup script on controller 10.30.171.237'
Execute the post startup script on controller 10.30.171.237
+ scp /w/workspace/controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium/post-startup-script.sh 10.30.171.237:/tmp/
Warning: Permanently added '10.30.171.237' (ED25519) to the list of known hosts.
+ ssh 10.30.171.237 'bash /tmp/post-startup-script.sh 2'
Warning: Permanently added '10.30.171.237' (ED25519) to the list of known hosts.
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
Waiting up to 3 minutes for controller to come up, checking every 5 seconds...
2026-03-29T23:30:11,475 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 154 - org.opendaylight.infrautils.ready-api - 7.1.9 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
Controller is UP
2026-03-29T23:30:11,475 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 154 - org.opendaylight.infrautils.ready-api - 7.1.9 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
Listing all open ports on controller system...
/tmp/post-startup-script.sh: line 51: netstat: command not found
looking for "BindException: Address already in use" in log file
looking for "server is unhealthy" in log file
+ '[' 2 == 0 ']'
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_3_IP
+ echo 'Execute the post startup script on controller 10.30.170.243'
Execute the post startup script on controller 10.30.170.243
+ scp /w/workspace/controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium/post-startup-script.sh 10.30.170.243:/tmp/
Warning: Permanently added '10.30.170.243' (ED25519) to the list of known hosts.
+ ssh 10.30.170.243 'bash /tmp/post-startup-script.sh 3'
Warning: Permanently added '10.30.170.243' (ED25519) to the list of known hosts.
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
/tmp/post-startup-script.sh: line 4: netstat: command not found
Waiting up to 3 minutes for controller to come up, checking every 5 seconds...
2026-03-29T23:30:11,994 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 154 - org.opendaylight.infrautils.ready-api - 7.1.9 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
Controller is UP
2026-03-29T23:30:11,994 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 154 - org.opendaylight.infrautils.ready-api - 7.1.9 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.]
Listing all open ports on controller system...
/tmp/post-startup-script.sh: line 51: netstat: command not found
looking for "BindException: Address already in use" in log file
looking for "server is unhealthy" in log file
+ '[' 0 == 0 ']'
+ seed_index=1
+ dump_controller_threads
++ seq 1 3
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_1_IP
+ echo 'Let'\''s take the karaf thread dump'
Let's take the karaf thread dump
+ ssh 10.30.170.21 'sudo ps aux'
Warning: Permanently added '10.30.170.21' (ED25519) to the list of known hosts.
++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium/ps_before.log
++ grep -v grep
++ tr -s ' '
++ cut -f2 '-d '
+ pid=2027
+ echo 'karaf main: org.apache.karaf.main.Main, pid:2027'
karaf main: org.apache.karaf.main.Main, pid:2027
+ ssh 10.30.170.21 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 2027'
Warning: Permanently added '10.30.170.21' (ED25519) to the list of known hosts.
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_2_IP
+ echo 'Let'\''s take the karaf thread dump'
Let's take the karaf thread dump
+ ssh 10.30.171.237 'sudo ps aux'
Warning: Permanently added '10.30.171.237' (ED25519) to the list of known hosts.
++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium/ps_before.log
++ grep -v grep
++ tr -s ' '
++ cut -f2 '-d '
+ pid=2027
+ echo 'karaf main: org.apache.karaf.main.Main, pid:2027'
karaf main: org.apache.karaf.main.Main, pid:2027
+ ssh 10.30.171.237 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 2027'
Warning: Permanently added '10.30.171.237' (ED25519) to the list of known hosts.
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_3_IP
+ echo 'Let'\''s take the karaf thread dump'
Let's take the karaf thread dump
+ ssh 10.30.170.243 'sudo ps aux'
Warning: Permanently added '10.30.170.243' (ED25519) to the list of known hosts.
++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium/ps_before.log
++ grep -v grep
++ tr -s ' '
++ cut -f2 '-d '
+ pid=2027
+ echo 'karaf main: org.apache.karaf.main.Main, pid:2027'
karaf main: org.apache.karaf.main.Main, pid:2027
+ ssh 10.30.170.243 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 2027'
Warning: Permanently added '10.30.170.243' (ED25519) to the list of known hosts.
+ '[' 0 -gt 0 ']'
+ echo 'Generating controller variables...'
Generating controller variables...
++ seq 1 3
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_1_IP
+ odl_variables=' -v ODL_SYSTEM_1_IP:10.30.170.21'
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_2_IP
+ odl_variables=' -v ODL_SYSTEM_1_IP:10.30.170.21 -v ODL_SYSTEM_2_IP:10.30.171.237'
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_3_IP
+ odl_variables=' -v ODL_SYSTEM_1_IP:10.30.170.21 -v ODL_SYSTEM_2_IP:10.30.171.237 -v ODL_SYSTEM_3_IP:10.30.170.243'
+ echo 'Generating mininet variables...'
Generating mininet variables...
++ seq 1 1
+ for i in $(seq 1 "${NUM_TOOLS_SYSTEM}")
+ MININETIP=TOOLS_SYSTEM_1_IP
+ tools_variables=' -v TOOLS_SYSTEM_1_IP:10.30.171.72'
+ get_test_suites SUITES
+ local __suite_list=SUITES
+ echo 'Locating test plan to use...'
Locating test plan to use...
+ testplan_filepath=/w/workspace/controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium/test/csit/testplans/controller-ddb-expl-lead-movement-longevity-chromium.txt
+ '[' '!' -f /w/workspace/controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium/test/csit/testplans/controller-ddb-expl-lead-movement-longevity-chromium.txt ']'
+ testplan_filepath=/w/workspace/controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium/test/csit/testplans/controller-ddb-expl-lead-movement-longevity.txt
+ '[' disabled '!=' disabled ']'
+ echo 'Changing the testplan path...'
Changing the testplan path...
+ sed s:integration:/w/workspace/controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium: /w/workspace/controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium/test/csit/testplans/controller-ddb-expl-lead-movement-longevity.txt
+ cat testplan.txt
# Copyright (c) 2017 Cisco Systems, Inc. and others. All rights reserved.
#
# This program and the accompanying materials are made available under the
# terms of the Eclipse Public License v1.0 which accompanies this distribution,
# and is available at http://www.eclipse.org/legal/epl-v10.html
# Place the suites in run order:
/w/workspace/controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot
/w/workspace/controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement_longevity.robot
+ '[' -z '' ']'
++ grep -E -v '(^[[:space:]]*#|^[[:space:]]*$)' testplan.txt
++ tr '\012' ' '
+ suite_list='/w/workspace/controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement_longevity.robot '
+ eval 'SUITES='\''/w/workspace/controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement_longevity.robot '\'''
++ SUITES='/w/workspace/controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement_longevity.robot '
+ echo 'Starting Robot test suites /w/workspace/controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement_longevity.robot ...'
Starting Robot test suites /w/workspace/controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement_longevity.robot ...
+ robot -N controller-ddb-expl-lead-movement-longevity.txt --removekeywords wuks -e exclude -e skip_if_chromium -v BUNDLEFOLDER:karaf-0.24.0-SNAPSHOT -v BUNDLE_URL:https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.24.0-SNAPSHOT/karaf-0.24.0-20260329.223546-282.zip -v CONTROLLER:10.30.170.21 -v CONTROLLER1:10.30.171.237 -v CONTROLLER2:10.30.170.243 -v CONTROLLER_USER:jenkins -v JAVA_HOME:/usr/lib/jvm/java-21-openjdk-amd64 -v JDKVERSION:openjdk21 -v JENKINS_WORKSPACE:/w/workspace/controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium -v MININET:10.30.171.72 -v MININET1: -v MININET2: -v MININET_USER:jenkins -v NEXUSURL_PREFIX:https://nexus.opendaylight.org -v NUM_ODL_SYSTEM:3 -v NUM_TOOLS_SYSTEM:1 -v ODL_STREAM:chromium -v ODL_SYSTEM_IP:10.30.170.21 -v ODL_SYSTEM_1_IP:10.30.170.21 -v ODL_SYSTEM_2_IP:10.30.171.237 -v ODL_SYSTEM_3_IP:10.30.170.243 -v ODL_SYSTEM_USER:jenkins -v TOOLS_SYSTEM_IP:10.30.171.72 -v TOOLS_SYSTEM_1_IP:10.30.171.72 -v TOOLS_SYSTEM_USER:jenkins -v USER_HOME:/home/jenkins -v IS_KARAF_APPL:True -v WORKSPACE:/tmp /w/workspace/controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement_longevity.robot
==============================================================================
controller-ddb-expl-lead-movement-longevity.txt
==============================================================================
controller-ddb-expl-lead-movement-longevity.txt.Restart Odl With Tell Based...
==============================================================================
Stop_All_Members :: Stop every odl node. | FAIL |
Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1
------------------------------------------------------------------------------
Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS |
------------------------------------------------------------------------------
Start_All_And_Sync :: Start each member and wait for sync. | FAIL |
Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.21:8181/jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore
------------------------------------------------------------------------------
controller-ddb-expl-lead-movement-longevity.txt.Restart Odl With T... | FAIL |
3 tests, 1 passed, 2 failed
==============================================================================
controller-ddb-expl-lead-movement-longevity.txt.Explicit Leader Movement Lo...
==============================================================================
Explicit_Leader_Movement_Test :: Leader move for 24 hours from one... | FAIL |
... click for list of related bugs or create a new one if needed (with the
"controller_ddb_expl_lead_movement_longevity_txt_explicit_leader_movement_longevity_explicit_leader_movement_test"
reference somewhere inside)
"https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_ddb_expl_lead_movement_longevity_txt_explicit_leader_movement_longevity_explicit_leader_movement_test&order=bug_status"
HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.21:8181/jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore
------------------------------------------------------------------------------
controller-ddb-expl-lead-movement-longevity.txt.Explicit Leader Mo... | FAIL |
1 test, 0 passed, 1 failed
==============================================================================
controller-ddb-expl-lead-movement-longevity.txt | FAIL |
4 tests, 1 passed, 3 failed
==============================================================================
Output: /w/workspace/controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium/output.xml
Log: /w/workspace/controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium/log.html
Report: /w/workspace/controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium/report.html
+ true
+ echo 'Examining the files in data/log and checking filesize'
Examining the files in data/log and checking filesize
+ ssh 10.30.170.21 'ls -altr /tmp/karaf-0.24.0-SNAPSHOT/data/log/'
Warning: Permanently added '10.30.170.21' (ED25519) to the list of known hosts.
total 440
drwxrwxr-x 2 jenkins jenkins 4096 Mar 29 23:29 .
-rw-rw-r-- 1 jenkins jenkins 1720 Mar 29 23:29 karaf_console.log
drwxrwxr-x 9 jenkins jenkins 4096 Mar 29 23:39 ..
-rw-rw-r-- 1 jenkins jenkins 435341 Mar 29 23:45 karaf.log
+ ssh 10.30.170.21 'du -hs /tmp/karaf-0.24.0-SNAPSHOT/data/log/*'
Warning: Permanently added '10.30.170.21' (ED25519) to the list of known hosts.
428K /tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf.log
4.0K /tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf_console.log
+ ssh 10.30.171.237 'ls -altr /tmp/karaf-0.24.0-SNAPSHOT/data/log/'
Warning: Permanently added '10.30.171.237' (ED25519) to the list of known hosts.
total 432
drwxrwxr-x 2 jenkins jenkins 4096 Mar 29 23:29 .
drwxrwxr-x 4 jenkins jenkins 4096 Mar 29 23:39 ..
-rw-rw-r-- 1 jenkins jenkins 119173 Mar 29 23:39 karaf_console.log
-rw-rw-r-- 1 jenkins jenkins 310129 Mar 29 23:45 karaf.log
+ ssh 10.30.171.237 'du -hs /tmp/karaf-0.24.0-SNAPSHOT/data/log/*'
Warning: Permanently added '10.30.171.237' (ED25519) to the list of known hosts.
304K /tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf.log
120K /tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf_console.log
+ ssh 10.30.170.243 'ls -altr /tmp/karaf-0.24.0-SNAPSHOT/data/log/'
Warning: Permanently added '10.30.170.243' (ED25519) to the list of known hosts.
total 448
drwxrwxr-x 2 jenkins jenkins 4096 Mar 29 23:29 .
-rw-rw-r-- 1 jenkins jenkins 1720 Mar 29 23:29 karaf_console.log
drwxrwxr-x 9 jenkins jenkins 4096 Mar 29 23:39 ..
-rw-rw-r-- 1 jenkins jenkins 445900 Mar 29 23:45 karaf.log
+ ssh 10.30.170.243 'du -hs /tmp/karaf-0.24.0-SNAPSHOT/data/log/*'
Warning: Permanently added '10.30.170.243' (ED25519) to the list of known hosts.
436K /tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf.log
4.0K /tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf_console.log
+ set +e
++ seq 1 3
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_1_IP
+ echo 'Let'\''s take the karaf thread dump again'
Let's take the karaf thread dump again
+ ssh 10.30.170.21 'sudo ps aux'
Warning: Permanently added '10.30.170.21' (ED25519) to the list of known hosts.
++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium/ps_after.log
++ grep -v grep
++ tr -s ' '
++ cut -f2 '-d '
+ pid=3631
+ echo 'karaf main: org.apache.karaf.main.Main, pid:3631'
karaf main: org.apache.karaf.main.Main, pid:3631
+ ssh 10.30.170.21 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 3631'
Warning: Permanently added '10.30.170.21' (ED25519) to the list of known hosts.
+ echo 'killing karaf process...'
killing karaf process...
+ ssh 10.30.170.21 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh'
Warning: Permanently added '10.30.170.21' (ED25519) to the list of known hosts.
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_2_IP
+ echo 'Let'\''s take the karaf thread dump again'
Let's take the karaf thread dump again
+ ssh 10.30.171.237 'sudo ps aux'
Warning: Permanently added '10.30.171.237' (ED25519) to the list of known hosts.
++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium/ps_after.log
++ grep -v grep
++ cut -f2 '-d '
++ tr -s ' '
+ pid=2027
+ echo 'karaf main: org.apache.karaf.main.Main, pid:2027'
karaf main: org.apache.karaf.main.Main, pid:2027
+ ssh 10.30.171.237 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 2027'
Warning: Permanently added '10.30.171.237' (ED25519) to the list of known hosts.
+ echo 'killing karaf process...'
killing karaf process...
+ ssh 10.30.171.237 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh'
Warning: Permanently added '10.30.171.237' (ED25519) to the list of known hosts.
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_3_IP
+ echo 'Let'\''s take the karaf thread dump again'
Let's take the karaf thread dump again
+ ssh 10.30.170.243 'sudo ps aux'
Warning: Permanently added '10.30.170.243' (ED25519) to the list of known hosts.
++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium/ps_after.log
++ grep -v grep
++ tr -s ' '
++ cut -f2 '-d '
+ pid=3510
+ echo 'karaf main: org.apache.karaf.main.Main, pid:3510'
karaf main: org.apache.karaf.main.Main, pid:3510
+ ssh 10.30.170.243 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 3510'
Warning: Permanently added '10.30.170.243' (ED25519) to the list of known hosts.
+ echo 'killing karaf process...'
killing karaf process...
+ ssh 10.30.170.243 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh'
Warning: Permanently added '10.30.170.243' (ED25519) to the list of known hosts.
+ sleep 5
++ seq 1 3
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_1_IP
+ echo 'Compressing karaf.log 1'
Compressing karaf.log 1
+ ssh 10.30.170.21 gzip --best /tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf.log
Warning: Permanently added '10.30.170.21' (ED25519) to the list of known hosts.
+ echo 'Fetching compressed karaf.log 1'
Fetching compressed karaf.log 1
+ scp 10.30.170.21:/tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf.log.gz odl1_karaf.log.gz
Warning: Permanently added '10.30.170.21' (ED25519) to the list of known hosts.
+ ssh 10.30.170.21 rm -f /tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf.log.gz
Warning: Permanently added '10.30.170.21' (ED25519) to the list of known hosts.
+ scp 10.30.170.21:/tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf_console.log odl1_karaf_console.log
Warning: Permanently added '10.30.170.21' (ED25519) to the list of known hosts.
+ ssh 10.30.170.21 rm -f /tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf_console.log
Warning: Permanently added '10.30.170.21' (ED25519) to the list of known hosts.
+ echo 'Fetch GC logs'
Fetch GC logs
+ mkdir -p gclogs-1
+ scp '10.30.170.21:/tmp/karaf-0.24.0-SNAPSHOT/data/log/*.log' gclogs-1/
Warning: Permanently added '10.30.170.21' (ED25519) to the list of known hosts.
scp: /tmp/karaf-0.24.0-SNAPSHOT/data/log/*.log: No such file or directory
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_2_IP
+ echo 'Compressing karaf.log 2'
Compressing karaf.log 2
+ ssh 10.30.171.237 gzip --best /tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf.log
Warning: Permanently added '10.30.171.237' (ED25519) to the list of known hosts.
+ echo 'Fetching compressed karaf.log 2'
Fetching compressed karaf.log 2
+ scp 10.30.171.237:/tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf.log.gz odl2_karaf.log.gz
Warning: Permanently added '10.30.171.237' (ED25519) to the list of known hosts.
+ ssh 10.30.171.237 rm -f /tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf.log.gz
Warning: Permanently added '10.30.171.237' (ED25519) to the list of known hosts.
+ scp 10.30.171.237:/tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf_console.log odl2_karaf_console.log
Warning: Permanently added '10.30.171.237' (ED25519) to the list of known hosts.
+ ssh 10.30.171.237 rm -f /tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf_console.log
Warning: Permanently added '10.30.171.237' (ED25519) to the list of known hosts.
+ echo 'Fetch GC logs'
Fetch GC logs
+ mkdir -p gclogs-2
+ scp '10.30.171.237:/tmp/karaf-0.24.0-SNAPSHOT/data/log/*.log' gclogs-2/
Warning: Permanently added '10.30.171.237' (ED25519) to the list of known hosts.
scp: /tmp/karaf-0.24.0-SNAPSHOT/data/log/*.log: No such file or directory
+ for i in $(seq 1 "${NUM_ODL_SYSTEM}")
+ CONTROLLERIP=ODL_SYSTEM_3_IP
+ echo 'Compressing karaf.log 3'
Compressing karaf.log 3
+ ssh 10.30.170.243 gzip --best /tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf.log
Warning: Permanently added '10.30.170.243' (ED25519) to the list of known hosts.
+ echo 'Fetching compressed karaf.log 3'
Fetching compressed karaf.log 3
+ scp 10.30.170.243:/tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf.log.gz odl3_karaf.log.gz
Warning: Permanently added '10.30.170.243' (ED25519) to the list of known hosts.
+ ssh 10.30.170.243 rm -f /tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf.log.gz
Warning: Permanently added '10.30.170.243' (ED25519) to the list of known hosts.
+ scp 10.30.170.243:/tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf_console.log odl3_karaf_console.log
Warning: Permanently added '10.30.170.243' (ED25519) to the list of known hosts.
+ ssh 10.30.170.243 rm -f /tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf_console.log
Warning: Permanently added '10.30.170.243' (ED25519) to the list of known hosts.
+ echo 'Fetch GC logs'
Fetch GC logs
+ mkdir -p gclogs-3
+ scp '10.30.170.243:/tmp/karaf-0.24.0-SNAPSHOT/data/log/*.log' gclogs-3/
Warning: Permanently added '10.30.170.243' (ED25519) to the list of known hosts.
scp: /tmp/karaf-0.24.0-SNAPSHOT/data/log/*.log: No such file or directory
+ echo 'Examine copied files'
Examine copied files
+ ls -lt
total 5256
drwxrwxr-x 2 jenkins jenkins 4096 Mar 29 23:45 gclogs-3
-rw-rw-r-- 1 jenkins jenkins 1720 Mar 29 23:45 odl3_karaf_console.log
-rw-rw-r-- 1 jenkins jenkins 36552 Mar 29 23:45 odl3_karaf.log.gz
drwxrwxr-x 2 jenkins jenkins 4096 Mar 29 23:45 gclogs-2
-rw-rw-r-- 1 jenkins jenkins 119173 Mar 29 23:45 odl2_karaf_console.log
-rw-rw-r-- 1 jenkins jenkins 22237 Mar 29 23:45 odl2_karaf.log.gz
drwxrwxr-x 2 jenkins jenkins 4096 Mar 29 23:45 gclogs-1
-rw-rw-r-- 1 jenkins jenkins 1720 Mar 29 23:45 odl1_karaf_console.log
-rw-rw-r-- 1 jenkins jenkins 35680 Mar 29 23:45 odl1_karaf.log.gz
-rw-rw-r-- 1 jenkins jenkins 81444 Mar 29 23:45 karaf_3_3510_threads_after.log
-rw-rw-r-- 1 jenkins jenkins 13664 Mar 29 23:45 ps_after.log
-rw-rw-r-- 1 jenkins jenkins 119061 Mar 29 23:45 karaf_2_2027_threads_after.log
-rw-rw-r-- 1 jenkins jenkins 92875 Mar 29 23:45 karaf_1_3631_threads_after.log
-rw-rw-r-- 1 jenkins jenkins 247575 Mar 29 23:45 report.html
-rw-rw-r-- 1 jenkins jenkins 450408 Mar 29 23:45 log.html
-rw-rw-r-- 1 jenkins jenkins 3814004 Mar 29 23:45 output.xml
-rw-rw-r-- 1 jenkins jenkins 661 Mar 29 23:33 testplan.txt
-rw-rw-r-- 1 jenkins jenkins 74315 Mar 29 23:33 karaf_3_2027_threads_before.log
-rw-rw-r-- 1 jenkins jenkins 13757 Mar 29 23:33 ps_before.log
-rw-rw-r-- 1 jenkins jenkins 76849 Mar 29 23:33 karaf_2_2027_threads_before.log
-rw-rw-r-- 1 jenkins jenkins 74388 Mar 29 23:33 karaf_1_2027_threads_before.log
-rw-rw-r-- 1 jenkins jenkins 3106 Mar 29 23:29 post-startup-script.sh
-rw-rw-r-- 1 jenkins jenkins 252 Mar 29 23:29 startup-script.sh
-rw-rw-r-- 1 jenkins jenkins 3465 Mar 29 23:29 configuration-script.sh
-rw-rw-r-- 1 jenkins jenkins 337 Mar 29 23:29 detect_variables.env
-rw-rw-r-- 1 jenkins jenkins 2619 Mar 29 23:29 pom.xml
-rw-rw-r-- 1 jenkins jenkins 92 Mar 29 23:29 set_variables.env
-rw-rw-r-- 1 jenkins jenkins 355 Mar 29 23:29 slave_addresses.txt
-rw-rw-r-- 1 jenkins jenkins 570 Mar 29 23:28 requirements.txt
-rw-rw-r-- 1 jenkins jenkins 26 Mar 29 23:28 env.properties
-rw-rw-r-- 1 jenkins jenkins 332 Mar 29 23:26 stack-parameters.yaml
drwxrwxr-x 7 jenkins jenkins 4096 Mar 29 23:24 test
drwxrwxr-x 2 jenkins jenkins 4096 Mar 29 23:24 test@tmp
-rw-rw-r-- 1 jenkins jenkins 1410 Mar 29 22:35 maven-metadata.xml
+ true
[controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium] $ /bin/sh /tmp/jenkins9588746183751494938.sh
Cleaning up Robot installation...
$ ssh-agent -k
unset SSH_AUTH_SOCK;
unset SSH_AGENT_PID;
echo Agent pid 45104 killed;
[ssh-agent] Stopped.
Recording plot data
Robot results publisher started...
INFO: Checking test criticality is deprecated and will be dropped in a future release!
-Parsing output xml:
Done!
-Copying log files to build dir:
Done!
-Assigning results to build:
Done!
-Checking thresholds:
Done!
Done publishing Robot results.
Build step 'Publish Robot Framework test results' changed build result to UNSTABLE
[PostBuildScript] - [INFO] Executing post build scripts.
[controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium] $ /bin/bash /tmp/jenkins10098004846513497252.sh
Archiving csit artifacts
mv: cannot stat '*_1.png': No such file or directory
mv: cannot stat '/tmp/odl1_*': No such file or directory
mv: cannot stat '*_2.png': No such file or directory
mv: cannot stat '/tmp/odl2_*': No such file or directory
mv: cannot stat '*_3.png': No such file or directory
mv: cannot stat '/tmp/odl3_*': No such file or directory
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
100 429k 0 429k 0 0 1850k 0 --:--:-- --:--:-- --:--:-- 1852k
Archive: robot-plugin.zip
inflating: ./archives/robot-plugin/log.html
inflating: ./archives/robot-plugin/output.xml
inflating: ./archives/robot-plugin/report.html
mv: cannot stat '*.log.gz': No such file or directory
mv: cannot stat '*.csv': No such file or directory
mv: cannot stat '*.png': No such file or directory
[PostBuildScript] - [INFO] Executing post build scripts.
[controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium] $ /bin/bash /tmp/jenkins11253377070230287154.sh
[PostBuildScript] - [INFO] Executing post build scripts.
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties content
OS_CLOUD=vex
OS_STACK_NAME=releng-controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium-2
[EnvInject] - Variables injected successfully.
provisioning config files...
copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
[controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium] $ /bin/bash /tmp/jenkins8419507524280578656.sh
---> openstack-stack-delete.sh
Setup pyenv:
system
3.8.20
3.9.20
3.10.15
* 3.11.10 (set by /w/workspace/controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-4MXP from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
lf-activate-venv(): INFO: Attempting to install with network-safe options...
lf-activate-venv(): INFO: Base packages installed successfully
lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes python-heatclient python-openstackclient urllib3~=1.26.15
lf-activate-venv(): INFO: Adding /tmp/venv-4MXP/bin to PATH
INFO: Stack cost retrieval disabled, setting cost to 0
INFO: Deleting stack releng-controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium-2
Successfully deleted stack releng-controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium-2
[PostBuildScript] - [INFO] Executing post build scripts.
[controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium] $ /bin/bash /tmp/jenkins15570155186004511982.sh
---> sysstat.sh
/tmp/jenkins15570155186004511982.sh: line 19: facter: command not found
[controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium] $ /bin/bash /tmp/jenkins10861945687563893541.sh
---> package-listing.sh
++ facter osfamily
/tmp/jenkins10861945687563893541.sh: line 19: facter: command not found
++ tr '[:upper:]' '[:lower:]'
+ OS_FAMILY=
[controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium] $ /bin/bash /tmp/jenkins10344625637334313371.sh
---> capture-instance-metadata.sh
Setup pyenv:
system
3.8.20
3.9.20
3.10.15
* 3.11.10 (set by /w/workspace/controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-4MXP from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
lf-activate-venv(): INFO: Attempting to install with network-safe options...
lf-activate-venv(): INFO: Base packages installed successfully
lf-activate-venv(): INFO: Installing additional packages: lftools
lf-activate-venv(): INFO: Adding /tmp/venv-4MXP/bin to PATH
INFO: Running in OpenStack, capturing instance metadata
[controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium] $ /bin/bash /tmp/jenkins14213346334145915454.sh
provisioning config files...
Could not find credentials [logs] for controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium #2
copy managed file [jenkins-log-archives-settings] to file:/w/workspace/controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium@tmp/config3596831734711568801tmp
Regular expression run condition: Expression=[^.*logs-s3.*], Label=[odl-logs-s3-cloudfront-index]
Run condition [Regular expression match] enabling perform for step [Provide Configuration files]
provisioning config files...
copy managed file [jenkins-s3-log-ship] to file:/home/jenkins/.aws/credentials
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties content
SERVER_ID=logs
[EnvInject] - Variables injected successfully.
[controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium] $ /bin/bash /tmp/jenkins3023676415350596804.sh
---> create-netrc.sh
WARN: Log server credential not found.
[controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium] $ /bin/bash /tmp/jenkins693868575291149978.sh
---> python-tools-install.sh
Setup pyenv:
system
3.8.20
3.9.20
3.10.15
* 3.11.10 (set by /w/workspace/controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-4MXP from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
lf-activate-venv(): INFO: Attempting to install with network-safe options...
lf-activate-venv(): INFO: Base packages installed successfully
lf-activate-venv(): INFO: Installing additional packages: lftools
lf-activate-venv(): INFO: Adding /tmp/venv-4MXP/bin to PATH
[controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium] $ /bin/sh /tmp/jenkins7525163437514261174.sh
---> uv-install.sh
uv 0.11.2 is already installed
uvx 0.11.2 (x86_64-unknown-linux-gnu)
[controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium] $ /bin/bash /tmp/jenkins2724711217497329492.sh
---> sudo-logs.sh
Archiving 'sudo' log..
/tmp/jenkins2724711217497329492.sh: line 41: facter: command not found
[controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium] $ /bin/bash /tmp/jenkins17006127152883759169.sh
---> job-cost.sh
INFO: Activating Python virtual environment...
Setup pyenv:
system
3.8.20
3.9.20
3.10.15
* 3.11.10 (set by /w/workspace/controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-4MXP from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
lf-activate-venv(): INFO: Attempting to install with network-safe options...
lf-activate-venv(): INFO: Base packages installed successfully
lf-activate-venv(): INFO: Installing additional packages: zipp==1.1.0 python-openstackclient urllib3~=1.26.15
lf-activate-venv(): INFO: Adding /tmp/venv-4MXP/bin to PATH
DEBUG: Contents of stack-cost file:
total: 0
INFO: Retrieving Stack Cost...
INFO: Stack cost: 0
INFO: Instance uptime: 77618s
INFO: Fetching instance metadata (attempt 1 of 3)...
DEBUG: URL: http://169.254.169.254/latest/meta-data/instance-type
INFO: Successfully fetched instance metadata
INFO: Instance type: v3-standard-2
INFO: Retrieving pricing info for: v3-standard-2
INFO: Fetching Vexxhost pricing API (attempt 1 of 3)...
DEBUG: URL: https://pricing.vexxhost.net/v1/pricing/v3-standard-2/cost?seconds=77618
INFO: Successfully fetched Vexxhost pricing API
INFO: Retrieved cost: 1.21
INFO: Retrieved resource: v3-standard-2
INFO: Creating archive directory: /w/workspace/controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium/archives/cost
INFO: Archiving costs to: /w/workspace/controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium/archives/cost.csv
INFO: Successfully archived job cost data
DEBUG: Cost data: controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium,2,2026-03-29 23:46:59,v3-standard-2,77618,1.21,0.00,UNSTABLE
[controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium] $ /bin/bash -l /tmp/jenkins2219598868288807444.sh
---> logs-deploy.sh
Setup pyenv:
system
3.8.20
3.9.20
3.10.15
* 3.11.10 (set by /w/workspace/controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-4MXP from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
lf-activate-venv(): INFO: Attempting to install with network-safe options...
lf-activate-venv(): INFO: Base packages installed successfully
lf-activate-venv(): INFO: Installing additional packages: lftools urllib3~=1.26.15
lf-activate-venv(): INFO: Adding /tmp/venv-4MXP/bin to PATH
WARNING: Nexus logging server not set
INFO: S3 path logs/releng/vex-yul-odl-jenkins-1/controller-csit-3node-ddb-expl-lead-movement-longevity-only-chromium/2/
INFO: archiving logs to S3
---> uname -a:
Linux prd-ubuntu2404-robot-2c-8g-53985 6.8.0-90-generic #91-Ubuntu SMP PREEMPT_DYNAMIC Tue Nov 18 14:14:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
---> lscpu:
Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Address sizes: 40 bits physical, 48 bits virtual
Byte Order: Little Endian
CPU(s): 2
On-line CPU(s) list: 0,1
Vendor ID: AuthenticAMD
Model name: AMD EPYC-Rome Processor
CPU family: 23
Model: 49
Thread(s) per core: 1
Core(s) per socket: 1
Socket(s): 2
Stepping: 0
BogoMIPS: 5600.00
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities
Virtualization: AMD-V
Hypervisor vendor: KVM
Virtualization type: full
L1d cache: 64 KiB (2 instances)
L1i cache: 64 KiB (2 instances)
L2 cache: 1 MiB (2 instances)
L3 cache: 32 MiB (2 instances)
NUMA node(s): 1
NUMA node0 CPU(s): 0,1
Vulnerability Gather data sampling: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Mitigation; untrained return thunk; SMT disabled
Vulnerability Spec rstack overflow: Vulnerable: Safe RET, no microcode
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2: Mitigation; Retpolines; IBPB conditional; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected
Vulnerability Srbds: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
---> nproc:
2
---> df -h:
Filesystem Size Used Avail Use% Mounted on
tmpfs 795M 1.1M 794M 1% /run
/dev/vda1 38G 7.9G 30G 21% /
tmpfs 3.9G 0 3.9G 0% /dev/shm
tmpfs 5.0M 0 5.0M 0% /run/lock
/dev/vda16 881M 117M 703M 15% /boot
/dev/vda15 105M 6.2M 99M 6% /boot/efi
tmpfs 795M 16K 795M 1% /run/user/1001
---> free -m:
total used free shared buff/cache available
Mem: 7941 761 5171 4 2307 7180
Swap: 1023 0 1023
---> ip addr:
1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
inet 127.0.0.1/8 scope host lo
valid_lft forever preferred_lft forever
inet6 ::1/128 scope host noprefixroute
valid_lft forever preferred_lft forever
2: ens3: mtu 1458 qdisc mq state UP group default qlen 1000
link/ether fa:16:3e:bc:13:93 brd ff:ff:ff:ff:ff:ff
altname enp0s3
inet 10.30.171.166/23 metric 100 brd 10.30.171.255 scope global dynamic ens3
valid_lft 51979sec preferred_lft 51979sec
inet6 fe80::f816:3eff:febc:1393/64 scope link
valid_lft forever preferred_lft forever
---> sar -b -r -n DEV:
Linux 6.8.0-90-generic (prd-ubuntu2404-robot-2c-8g-53985) 03/29/26 _x86_64_ (2 CPU)
02:13:32 LINUX RESTART (2 CPU)
02:20:01 tps rtps wtps dtps bread/s bwrtn/s bdscd/s
02:30:01 1.37 0.01 1.35 0.01 0.05 16.68 436.05
02:40:06 1.15 0.00 1.14 0.02 0.00 14.07 1.20
02:50:06 1.76 0.32 1.42 0.02 40.07 71.35 0.63
03:00:01 1.41 0.00 1.40 0.01 0.00 17.12 439.30
03:10:06 1.22 0.00 1.22 0.00 0.00 14.77 0.00
03:20:01 1.28 0.00 1.28 0.00 0.00 15.27 0.00
03:30:01 14.06 0.03 1.47 12.56 2.29 18.48 109746.07
03:40:06 1.23 0.00 1.23 0.00 0.00 14.91 0.00
03:50:06 1.43 0.00 1.42 0.01 0.00 17.64 217.77
04:00:06 1.44 0.00 1.43 0.01 0.00 17.99 653.28
04:10:06 1.19 0.00 1.19 0.00 0.00 14.79 0.00
04:20:06 1.29 0.00 1.29 0.00 0.00 15.51 0.00
04:30:06 1.58 0.00 1.57 0.01 0.00 19.68 435.61
04:40:06 1.37 0.00 1.37 0.00 0.00 16.27 0.00
04:50:06 1.38 0.00 1.38 0.00 0.00 16.49 0.00
05:00:06 1.68 0.00 1.67 0.02 0.00 20.56 653.24
05:10:06 1.21 0.00 1.21 0.00 0.00 14.83 0.00
05:20:01 1.28 0.00 1.28 0.00 0.00 15.58 0.00
05:30:01 1.51 0.00 1.49 0.01 0.00 18.21 653.15
05:40:06 1.29 0.00 1.29 0.00 0.00 16.55 0.05
05:50:01 1.28 0.00 1.27 0.00 0.00 15.56 219.58
06:00:01 1.35 0.00 1.34 0.01 0.00 16.90 435.50
06:10:06 1.25 0.00 1.25 0.00 0.00 15.28 0.00
06:20:02 1.30 0.00 1.30 0.00 0.00 15.72 0.00
06:30:01 1.43 0.01 1.41 0.02 0.09 17.88 654.16
06:40:06 1.39 0.00 1.38 0.01 0.00 17.56 215.79
06:50:01 1.25 0.00 1.25 0.00 0.03 15.23 0.00
07:00:01 1.39 0.00 1.37 0.01 0.00 17.18 653.10
07:10:06 1.26 0.00 1.26 0.00 0.00 15.34 0.00
07:20:01 1.27 0.00 1.27 0.00 0.00 15.50 0.00
07:30:01 1.39 0.00 1.38 0.01 0.00 17.33 435.50
07:40:06 1.26 0.00 1.26 0.00 0.00 15.28 0.00
07:50:01 1.24 0.00 1.24 0.00 0.00 15.26 0.00
08:00:01 1.49 0.00 1.47 0.02 0.00 19.14 435.55
08:10:06 1.35 0.00 1.35 0.00 0.00 15.92 215.80
08:20:01 1.39 0.00 1.39 0.00 0.00 15.84 0.00
08:30:01 1.52 0.00 1.51 0.01 0.00 17.96 435.50
08:40:06 1.30 0.00 1.30 0.00 0.00 15.14 0.00
08:50:01 1.39 0.00 1.39 0.00 0.00 15.73 0.00
09:00:01 1.59 0.00 1.57 0.02 0.00 18.82 217.87
09:10:06 1.50 0.00 1.50 0.01 0.00 18.07 432.23
09:20:01 1.32 0.00 1.32 0.00 0.00 15.07 0.00
09:30:01 1.44 0.00 1.43 0.01 0.00 17.33 435.50
09:40:06 1.30 0.00 1.30 0.00 0.00 15.00 0.00
09:50:01 1.33 0.00 1.33 0.00 0.00 15.33 0.00
10:00:01 1.56 0.00 1.55 0.01 0.00 18.28 435.49
10:10:06 1.45 0.00 1.44 0.01 0.00 17.43 216.18
10:20:01 1.33 0.00 1.33 0.00 0.00 15.32 0.00
10:30:06 1.51 0.00 1.50 0.01 0.00 17.86 648.23
10:40:06 1.35 0.00 1.35 0.00 0.00 15.65 0.00
10:50:06 1.37 0.00 1.37 0.00 0.00 15.84 0.00
11:00:06 1.49 0.00 1.48 0.01 0.00 17.71 435.59
11:10:06 1.26 0.00 1.26 0.00 0.00 14.84 0.00
11:20:06 1.32 0.00 1.32 0.00 0.00 15.32 0.00
11:30:06 1.57 0.00 1.56 0.01 0.00 18.71 435.81
11:40:06 1.32 0.00 1.32 0.00 0.00 15.41 217.73
11:50:06 1.42 0.00 1.42 0.00 0.00 15.80 0.00
12:00:01 1.58 0.00 1.57 0.01 0.00 18.00 439.59
12:10:06 1.38 0.00 1.38 0.00 0.00 15.66 0.00
12:20:01 1.39 0.00 1.39 0.00 0.00 15.29 0.00
12:30:01 1.52 0.00 1.51 0.01 0.00 17.84 435.50
12:40:06 1.49 0.00 1.48 0.01 0.00 17.77 215.94
12:50:01 1.32 0.00 1.32 0.00 0.00 15.08 0.00
13:00:01 1.56 0.00 1.55 0.01 0.00 17.96 435.50
13:10:06 1.41 0.00 1.41 0.00 0.00 15.81 0.00
13:20:01 1.36 0.00 1.36 0.00 0.00 15.26 0.00
13:30:01 15.71 13.54 2.10 0.06 151.09 45.68 224.06
13:40:06 1.48 0.00 1.48 0.00 0.00 17.38 0.15
13:50:01 1.43 0.00 1.43 0.00 0.00 16.33 0.05
14:00:01 1.54 0.00 1.52 0.02 0.00 18.09 8.02
14:10:06 1.38 0.00 1.38 0.00 0.00 15.75 0.00
14:20:01 1.50 0.00 1.50 0.00 0.00 17.47 0.07
14:30:02 1.62 0.00 1.60 0.02 0.00 18.88 0.32
14:40:06 1.53 0.00 1.53 0.00 0.00 17.05 0.00
14:50:01 1.55 0.00 1.55 0.00 0.00 16.85 0.00
15:00:01 1.76 0.00 1.75 0.01 0.00 20.12 0.27
15:10:06 1.50 0.00 1.50 0.00 0.00 16.73 0.00
15:20:01 1.51 0.00 1.51 0.00 0.00 16.59 0.00
15:30:01 1.68 0.00 1.66 0.01 0.00 19.01 0.25
15:40:06 1.62 0.00 1.62 0.00 0.00 18.57 0.32
15:50:01 1.56 0.00 1.56 0.00 0.00 17.50 0.05
16:00:01 1.76 0.00 1.74 0.02 0.00 20.24 0.27
16:10:06 1.52 0.00 1.52 0.00 0.00 17.35 0.00
16:20:01 1.54 0.00 1.54 0.00 0.00 16.74 0.00
16:30:01 1.71 0.00 1.70 0.01 0.00 19.76 0.27
16:40:06 1.67 0.00 1.66 0.01 0.00 19.22 0.22
16:50:01 1.52 0.00 1.52 0.00 0.00 16.89 0.00
17:00:01 1.77 0.00 1.76 0.01 0.00 20.00 0.25
17:10:06 1.52 0.00 1.52 0.00 0.00 17.17 0.00
17:20:01 1.52 0.00 1.52 0.00 0.00 16.81 0.00
17:30:06 1.75 0.00 1.73 0.02 0.00 20.50 0.37
17:40:16 1.58 0.00 1.58 0.00 0.00 17.65 212.59
17:50:06 1.54 0.00 1.54 0.00 0.00 17.11 0.00
18:00:06 1.77 0.00 1.76 0.01 0.00 20.24 0.24
18:10:06 1.63 0.00 1.62 0.00 0.00 18.41 0.12
18:20:16 1.56 0.00 1.55 0.00 0.00 17.19 0.05
18:30:06 1.71 0.00 1.70 0.01 0.00 19.48 0.26
18:40:06 1.47 0.00 1.47 0.00 0.00 16.33 0.00
18:50:01 1.50 0.00 1.50 0.00 0.00 16.66 0.00
19:00:01 1.79 0.00 1.77 0.02 0.00 20.37 0.27
19:10:06 1.53 0.00 1.53 0.00 0.00 16.93 0.00
19:20:01 1.56 0.00 1.56 0.00 0.00 17.19 0.00
19:30:01 1.85 0.00 1.84 0.02 0.00 20.73 0.27
19:40:06 1.67 0.00 1.67 0.00 0.00 18.80 0.22
19:50:01 1.62 0.00 1.62 0.00 0.00 17.47 0.05
20:00:01 1.90 0.00 1.88 0.02 0.00 20.92 0.36
20:10:06 1.56 0.00 1.56 0.00 0.00 17.03 0.00
20:20:01 1.59 0.00 1.59 0.00 0.00 17.05 0.00
20:30:01 1.78 0.00 1.77 0.02 0.00 19.65 0.27
20:40:06 1.57 0.00 1.57 0.00 0.00 17.10 0.00
20:50:01 1.56 0.00 1.56 0.00 0.00 16.58 0.00
21:00:01 1.82 0.00 1.81 0.01 0.00 20.65 432.53
21:10:06 1.51 0.00 1.51 0.00 0.00 16.52 0.05
21:20:01 1.57 0.00 1.57 0.00 0.00 16.89 0.00
21:30:01 1.88 0.00 1.86 0.02 0.00 20.42 0.27
21:40:06 1.56 0.00 1.56 0.00 0.00 17.07 0.00
21:50:01 1.74 0.00 1.74 0.01 0.00 19.17 0.26
22:00:01 1.86 0.00 1.84 0.02 0.00 20.68 0.27
22:10:06 1.67 0.00 1.67 0.00 0.00 18.57 0.11
22:20:01 1.66 0.00 1.66 0.00 0.00 18.11 0.05
22:30:01 1.84 0.00 1.82 0.02 0.00 20.48 0.27
22:40:06 1.57 0.00 1.57 0.00 0.00 17.04 0.00
22:50:01 1.54 0.00 1.54 0.00 0.00 16.72 0.00
23:00:01 1.92 0.00 1.91 0.01 0.00 20.98 0.23
23:10:06 1.65 0.00 1.65 0.00 0.00 17.76 0.00
23:20:06 1.75 0.00 1.75 0.00 0.00 19.27 0.15
23:30:01 23.95 3.18 18.46 2.32 231.66 3305.17 3713.08
23:40:06 1.60 0.01 1.58 0.00 0.67 33.72 0.05
Average: 1.89 0.13 1.63 0.12 3.31 43.54 988.50
02:20:01 kbmemfree kbavail kbmemused %memused kbbuffers kbcached kbcommit %commit kbactive kbinact kbdirty
02:30:01 6297356 7548348 272228 3.35 30720 1426100 520128 5.67 448448 1187372 188
02:40:06 6296460 7547984 272620 3.35 30920 1426428 520280 5.67 448728 1187900 180
02:50:06 6241416 7521888 298144 3.67 31292 1454636 520204 5.67 460164 1205096 232
03:00:01 6245580 7526560 293476 3.61 31456 1454960 520204 5.67 460408 1205592 244
03:10:06 6261176 7542800 277252 3.41 31644 1455416 520372 5.67 460600 1206100 288
03:20:01 6259376 7541500 278552 3.43 31796 1455744 520372 5.67 460544 1206588 236
03:30:01 6253412 7536764 283224 3.48 31976 1456756 520532 5.67 461900 1207192 128
03:40:06 6253412 7537268 282748 3.48 32144 1457084 520660 5.67 461944 1207688 188
03:50:06 6250908 7535284 284640 3.50 32332 1457412 520660 5.67 462008 1208204 196
04:00:06 6247548 7532572 287256 3.53 32508 1457872 520660 5.67 462168 1208712 240
04:10:06 6246288 7531820 288000 3.54 32684 1458196 520660 5.67 462180 1209212 232
04:20:06 6246220 7532224 287584 3.54 32828 1458520 520660 5.67 462180 1209680 216
04:30:06 6241180 7527752 292032 3.59 33032 1458856 520660 5.67 462216 1210220 248
04:40:06 6248768 7535948 283828 3.49 33184 1459308 520724 5.67 462440 1210696 252
04:50:06 6251152 7538824 280940 3.45 33344 1459640 520732 5.67 462512 1211180 344
05:00:06 6247248 7535432 284312 3.50 33524 1459968 520952 5.67 462812 1211680 196
05:10:06 6248984 7537668 282084 3.47 33684 1460288 520952 5.67 462688 1212176 224
05:20:01 6248228 7537392 282348 3.47 33844 1460608 520952 5.67 462732 1212648 164
05:30:01 6241184 7530984 288712 3.55 34000 1461068 520952 5.67 462860 1213144 184
05:40:06 6236144 7526476 293148 3.60 34200 1461408 576028 6.27 468060 1213672 284
05:50:01 6243204 7534032 285656 3.51 34364 1461720 520960 5.67 462916 1214160 280
06:00:01 6241696 7533028 286652 3.52 34532 1462048 520952 5.67 462804 1214656 276
06:10:06 6240952 7532780 286896 3.53 34692 1462376 520960 5.67 462928 1215144 224
06:20:02 6240952 7533292 286376 3.52 34868 1462708 520952 5.67 462808 1215652 272
06:30:01 6233908 7526784 292852 3.60 35044 1463056 521148 5.68 463036 1216176 132
06:40:06 6241748 7535304 284308 3.50 35256 1463516 521272 5.68 463264 1216720 220
06:50:01 6249336 7543380 276224 3.40 35404 1463848 521276 5.68 463272 1217200 128
07:00:01 6241280 7535840 283712 3.49 35576 1464180 521276 5.68 463452 1217704 276
07:10:06 6241028 7536072 283464 3.49 35720 1464516 521408 5.68 463324 1218176 288
07:20:01 6241028 7536552 282992 3.48 35880 1464832 521416 5.68 463372 1218660 128
07:30:01 6232932 7528956 290600 3.57 36040 1465160 521416 5.68 463376 1219148 244
07:40:06 6232932 7529580 289976 3.57 36200 1465620 521440 5.68 463532 1219640 224
07:50:01 6232188 7529324 290232 3.57 36360 1465940 521508 5.68 463616 1220120 244
08:00:01 6225928 7523628 295724 3.64 36568 1466272 585036 6.37 468908 1220656 128
08:10:06 6229804 7528116 291328 3.58 36716 1466728 521636 5.68 463860 1221136 216
08:20:01 6237644 7536460 282976 3.48 36892 1467052 521644 5.68 463800 1221632 280
08:30:01 6234628 7533936 285480 3.51 37052 1467372 521644 5.68 463764 1222116 280
08:40:06 6232864 7532668 286732 3.53 37204 1467708 521644 5.68 463856 1222604 260
08:50:01 6236620 7536912 282484 3.47 37364 1468028 521644 5.68 464056 1223084 240
09:00:01 6224308 7525280 294004 3.62 37564 1468496 576720 6.28 469152 1223620 280
09:10:06 6227216 7528728 290604 3.57 37780 1468820 521644 5.68 464104 1224156 256
09:20:01 6233768 7535784 283544 3.49 37940 1469148 521644 5.68 464112 1224652 300
09:30:01 6226592 7529108 290204 3.57 38108 1469472 521796 5.68 464140 1225136 276
09:40:06 6234556 7537572 281740 3.46 38268 1469800 521860 5.68 464144 1225632 224
09:50:01 6233828 7537316 281972 3.47 38412 1470128 521860 5.68 464056 1226096 280
10:00:01 6223784 7527788 291500 3.58 38588 1470452 521860 5.68 464176 1226604 248
10:10:06 6226584 7531248 288012 3.54 38792 1470908 521860 5.68 464312 1227128 272
10:20:01 6234172 7539332 279928 3.44 38944 1471240 521860 5.68 464356 1227620 244
10:30:06 6229636 7535316 283916 3.49 39132 1471564 521860 5.68 464440 1228132 264
10:40:06 6229636 7535820 283400 3.48 39308 1471892 521860 5.68 464436 1228632 292
10:50:06 6229440 7536124 283080 3.48 39468 1472224 524608 5.71 467064 1229120 300
11:00:06 6223152 7530332 288864 3.55 39628 1472544 524608 5.71 467208 1229608 244
11:10:06 6223152 7530808 288416 3.55 39772 1472872 524608 5.71 467268 1230080 256
11:20:06 6222648 7530860 288356 3.55 39932 1473260 524672 5.71 467376 1230564 244
11:30:06 6228724 7537608 281460 3.46 40128 1473724 579812 6.32 472740 1231092 220
11:40:06 6228500 7537888 281224 3.46 40292 1474056 524736 5.72 467576 1231592 308
11:50:06 6228248 7538236 280860 3.45 40440 1474500 524896 5.72 467744 1232056 160
12:00:01 6223120 7533608 285516 3.51 40600 1474836 524896 5.72 467628 1232544 184
12:10:06 6221132 7532124 286992 3.53 40756 1475168 524896 5.72 467632 1233040 220
12:20:01 6224868 7536320 282792 3.48 40896 1475488 524896 5.72 467764 1233500 184
12:30:01 6223504 7535464 283600 3.49 41060 1475820 524896 5.72 467792 1233996 244
12:40:06 6223252 7535760 283284 3.48 41268 1476148 524896 5.72 467816 1234532 248
12:50:01 6223252 7536376 282664 3.48 41428 1476596 524896 5.72 467844 1235012 272
13:00:01 6220484 7534108 284920 3.50 41580 1476928 524896 5.72 467976 1235496 128
13:10:06 6220484 7534600 284424 3.50 41740 1477256 524896 5.72 468064 1235984 224
13:20:01 6218976 7533568 285452 3.51 41884 1477580 524896 5.72 467956 1236452 308
13:30:01 6134924 7506496 303400 3.73 45908 1522204 524896 5.72 468564 1284492 244
13:40:06 6142512 7514736 295108 3.63 46096 1522664 579976 6.32 473892 1285008 228
13:50:01 6142008 7514712 295196 3.63 46244 1522988 524896 5.72 468828 1285484 128
14:00:01 6141732 7514884 295012 3.63 46356 1523316 524960 5.72 468808 1285924 280
14:10:06 6141732 7515488 294404 3.62 46496 1523772 525100 5.72 469108 1286392 272
14:20:01 6139720 7513964 295844 3.64 46648 1524108 580456 6.32 475220 1286876 244
14:30:02 6131932 7506668 303160 3.73 46808 1524428 525380 5.72 470052 1287360 296
14:40:06 6131692 7506896 302956 3.73 46952 1524744 525380 5.72 470104 1287820 224
14:50:01 6139028 7514692 295192 3.63 47080 1525080 525380 5.72 470108 1288284 280
15:00:01 6136852 7513124 296712 3.65 47216 1525536 525380 5.72 470248 1288748 240
15:10:06 6137404 7514172 295644 3.64 47376 1525864 525380 5.72 470248 1289236 228
15:20:01 6136648 7513900 295908 3.64 47528 1526188 525380 5.72 470248 1289712 276
15:30:01 6146864 7524608 285188 3.51 47684 1526516 525380 5.72 470248 1290196 128
15:40:06 6141084 7519324 290332 3.57 47844 1526860 580456 6.32 475456 1290688 292
15:50:01 6141084 7519792 289920 3.56 47984 1527168 525380 5.72 470272 1291148 124
16:00:01 6136088 7515372 294292 3.62 48108 1527612 525588 5.72 470468 1291596 292
16:10:06 6135888 7515668 294024 3.62 48264 1527956 525588 5.72 470508 1292080 276
16:20:01 6135636 7515880 293816 3.61 48392 1528276 525588 5.72 470412 1292536 276
16:30:01 6139952 7520708 288960 3.55 48560 1528612 525588 5.72 470444 1293040 176
16:40:06 6135920 7517192 292440 3.60 48732 1528948 525588 5.72 470448 1293544 292
16:50:01 6143984 7525716 283948 3.49 48868 1529264 525588 5.72 470560 1294000 240
17:00:01 6139004 7521324 288192 3.54 49016 1529724 525588 5.72 470712 1294448 276
17:10:06 6139004 7521848 287684 3.54 49180 1530056 525588 5.72 470692 1294968 264
17:20:01 6139004 7522332 287204 3.53 49332 1530372 525588 5.72 470716 1295444 256
17:30:06 6131976 7515832 293492 3.61 49504 1530712 580664 6.32 475868 1295952 272
17:40:16 6140084 7524424 285020 3.50 49652 1531036 525588 5.72 470748 1296428 212
17:50:06 6139652 7524460 284980 3.50 49792 1531360 525588 5.72 470632 1296892 244
18:00:06 6138176 7523476 285968 3.52 49952 1531692 525588 5.72 470756 1297380 288
18:10:06 6130112 7515912 293460 3.61 50112 1532020 580664 6.32 475960 1297868 280
18:20:16 6130112 7516364 293084 3.60 50232 1532344 525588 5.72 470776 1298316 244
18:30:06 6127088 7513896 295520 3.63 50388 1532736 525864 5.73 471004 1298800 260
18:40:06 6127088 7514492 294908 3.63 50528 1533188 525864 5.73 471144 1299264 240
18:50:01 6127088 7514948 294416 3.62 50648 1533516 525864 5.73 471044 1299712 276
19:00:01 6131304 7519780 289528 3.56 50800 1533976 525864 5.73 471200 1300188 276
19:10:06 6131052 7520004 289336 3.56 50936 1534300 525864 5.73 471336 1300656 224
19:20:01 6138164 7527600 281736 3.46 51088 1534628 525864 5.73 471224 1301136 272
19:30:01 6131656 7521692 287596 3.54 51220 1535084 525864 5.73 471352 1301596 276
19:40:06 6126320 7516856 292360 3.59 51380 1535420 581076 6.33 476752 1302088 224
19:50:01 6126320 7517312 291944 3.59 51512 1535736 525996 5.73 471580 1302540 236
20:00:01 6121880 7513356 295904 3.64 51672 1536064 525996 5.73 471420 1303028 296
20:10:06 6120216 7512168 297088 3.65 51812 1536396 525996 5.73 471604 1303500 228
20:20:01 6122572 7514996 294236 3.62 51956 1536716 525996 5.73 471500 1303964 240
20:30:01 6119728 7512704 296560 3.65 52108 1537108 525996 5.73 471732 1304444 272
20:40:06 6120920 7514372 294868 3.63 52248 1537440 526128 5.73 471756 1304916 220
20:50:01 6119408 7513436 295800 3.64 52368 1537892 526128 5.73 471780 1305360 160
21:00:01 6119476 7514024 295024 3.63 52536 1538224 581208 6.33 477096 1305856 268
21:10:06 6119476 7514496 294588 3.62 52672 1538548 526128 5.73 471928 1306320 252
21:20:01 6134120 7529608 279464 3.44 52808 1538880 526128 5.73 471920 1306784 324
21:30:01 6123036 7519004 290096 3.57 52940 1539208 526128 5.73 471840 1307248 240
21:40:06 6123036 7519540 289556 3.56 53080 1539600 526128 5.73 472036 1307716 240
21:50:01 6117996 7514996 294088 3.62 53244 1539924 526128 5.73 472052 1308204 280
22:00:01 6115984 7513604 295464 3.63 53400 1540380 526128 5.73 472080 1308688 276
22:10:06 6113968 7512192 296784 3.65 53544 1540840 581332 6.33 477544 1309160 220
22:20:01 6116120 7514832 294180 3.62 53696 1541164 526256 5.73 472380 1309640 304
22:30:01 6113244 7512432 296576 3.65 53832 1541496 526256 5.73 472392 1310108 240
22:40:06 6116152 7515804 293188 3.61 53968 1541820 526256 5.73 472288 1310568 220
22:50:01 6116152 7516256 292732 3.60 54084 1542148 526396 5.73 472420 1311012 280
23:00:01 6118212 7518772 290204 3.57 54204 1542476 526396 5.73 472420 1311460 240
23:10:06 6117988 7519132 289840 3.56 54332 1542928 526396 5.73 472568 1311912 152
23:20:06 6119792 7521420 287488 3.54 54484 1543268 581472 6.33 477760 1312392 220
23:30:01 5218176 7446292 314584 3.87 104132 2279068 552808 6.02 560440 2052408 1232
23:40:06 5159244 7391212 369660 4.55 104228 2282884 650808 7.09 615044 2056316 408
Average: 6170879 7524222 289644 3.56 43987 1509596 530686 5.78 469595 1269766 250
02:20:01 IFACE rxpck/s txpck/s rxkB/s txkB/s rxcmp/s txcmp/s rxmcst/s %ifutil
02:30:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
02:30:01 ens3 0.87 0.03 0.09 0.01 0.00 0.00 0.00 0.00
02:40:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
02:40:06 ens3 1.30 0.07 12.54 0.03 0.00 0.00 0.00 0.00
02:50:06 lo 1.02 1.02 0.05 0.05 0.00 0.00 0.00 0.00
02:50:06 ens3 0.74 0.20 3.07 0.03 0.00 0.00 0.00 0.00
03:00:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
03:00:01 ens3 0.83 0.08 0.28 0.05 0.00 0.00 0.00 0.00
03:10:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
03:10:06 ens3 0.46 0.02 0.08 0.01 0.00 0.00 0.00 0.00
03:20:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
03:20:01 ens3 0.20 0.02 0.04 0.01 0.00 0.00 0.00 0.00
03:30:01 lo 1.01 1.01 0.05 0.05 0.00 0.00 0.00 0.00
03:30:01 ens3 0.47 0.16 0.12 0.52 0.00 0.00 0.00 0.00
03:40:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
03:40:06 ens3 0.32 0.06 0.09 0.04 0.00 0.00 0.00 0.00
03:50:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
03:50:06 ens3 0.18 0.02 0.04 0.01 0.00 0.00 0.00 0.00
04:00:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
04:00:06 ens3 0.22 0.06 0.07 0.03 0.00 0.00 0.00 0.00
04:10:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
04:10:06 ens3 0.15 0.03 0.04 0.01 0.00 0.00 0.00 0.00
04:20:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
04:20:06 ens3 0.14 0.03 0.04 0.01 0.00 0.00 0.00 0.00
04:30:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
04:30:06 ens3 0.15 0.03 0.04 0.01 0.00 0.00 0.00 0.00
04:40:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
04:40:06 ens3 0.24 0.05 0.07 0.03 0.00 0.00 0.00 0.00
04:50:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
04:50:06 ens3 0.33 0.08 0.10 0.05 0.00 0.00 0.00 0.00
05:00:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
05:00:06 ens3 0.41 0.13 0.15 0.09 0.00 0.00 0.00 0.00
05:10:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
05:10:06 ens3 0.18 0.04 0.04 0.01 0.00 0.00 0.00 0.00
05:20:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
05:20:01 ens3 0.23 0.05 0.07 0.03 0.00 0.00 0.00 0.00
05:30:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
05:30:01 ens3 0.23 0.06 0.07 0.03 0.00 0.00 0.00 0.00
05:40:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
05:40:06 ens3 0.25 0.06 0.07 0.04 0.00 0.00 0.00 0.00
05:50:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
05:50:01 ens3 0.16 0.05 0.04 0.02 0.00 0.00 0.00 0.00
06:00:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
06:00:01 ens3 0.27 0.06 0.07 0.03 0.00 0.00 0.00 0.00
06:10:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
06:10:06 ens3 0.15 0.03 0.04 0.01 0.00 0.00 0.00 0.00
06:20:02 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
06:20:02 ens3 0.16 0.04 0.04 0.01 0.00 0.00 0.00 0.00
06:30:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
06:30:01 ens3 0.25 0.05 0.07 0.03 0.00 0.00 0.00 0.00
06:40:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
06:40:06 ens3 0.34 0.08 0.10 0.05 0.00 0.00 0.00 0.00
06:50:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
06:50:01 ens3 0.28 0.06 0.07 0.03 0.00 0.00 0.00 0.00
07:00:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
07:00:01 ens3 0.30 0.08 0.10 0.06 0.00 0.00 0.00 0.00
07:10:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
07:10:06 ens3 0.15 0.03 0.04 0.01 0.00 0.00 0.00 0.00
07:20:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
07:20:01 ens3 0.24 0.05 0.07 0.03 0.00 0.00 0.00 0.00
07:30:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
07:30:01 ens3 0.16 0.03 0.04 0.01 0.00 0.00 0.00 0.00
07:40:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
07:40:06 ens3 0.26 0.07 0.07 0.03 0.00 0.00 0.00 0.00
07:50:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
07:50:01 ens3 0.15 0.04 0.04 0.02 0.00 0.00 0.00 0.00
08:00:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
08:00:01 ens3 0.26 0.08 0.09 0.05 0.00 0.00 0.00 0.00
08:10:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
08:10:06 ens3 0.32 0.08 0.11 0.06 0.00 0.00 0.00 0.00
08:20:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
08:20:01 ens3 0.34 0.08 0.10 0.05 0.00 0.00 0.00 0.00
08:30:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
08:30:01 ens3 0.24 0.06 0.07 0.03 0.00 0.00 0.00 0.00
08:40:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
08:40:06 ens3 0.25 0.06 0.07 0.03 0.00 0.00 0.00 0.00
08:50:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
08:50:01 ens3 0.16 0.05 0.04 0.01 0.00 0.00 0.00 0.00
09:00:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
09:00:01 ens3 0.20 0.06 0.06 0.03 0.00 0.00 0.00 0.00
09:10:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
09:10:06 ens3 0.15 0.03 0.04 0.01 0.00 0.00 0.00 0.00
09:20:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
09:20:01 ens3 0.24 0.05 0.07 0.03 0.00 0.00 0.00 0.00
09:30:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
09:30:01 ens3 0.15 0.03 0.04 0.01 0.00 0.00 0.00 0.00
09:40:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
09:40:06 ens3 0.24 0.06 0.07 0.03 0.00 0.00 0.00 0.00
09:50:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
09:50:01 ens3 0.16 0.03 0.04 0.01 0.00 0.00 0.00 0.00
10:00:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
10:00:01 ens3 0.29 0.07 0.10 0.05 0.00 0.00 0.00 0.00
10:10:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
10:10:06 ens3 0.15 0.04 0.04 0.01 0.00 0.00 0.00 0.00
10:20:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
10:20:01 ens3 0.18 0.04 0.04 0.01 0.00 0.00 0.00 0.00
10:30:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
10:30:06 ens3 0.15 0.04 0.04 0.01 0.00 0.00 0.00 0.00
10:40:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
10:40:06 ens3 0.24 0.06 0.07 0.03 0.00 0.00 0.00 0.00
10:50:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
10:50:06 ens3 0.34 0.28 0.05 1.31 0.00 0.00 0.00 0.00
11:00:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
11:00:06 ens3 0.25 0.12 0.07 0.29 0.00 0.00 0.00 0.00
11:10:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
11:10:06 ens3 0.14 0.04 0.04 0.01 0.00 0.00 0.00 0.00
11:20:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
11:20:06 ens3 0.15 0.04 0.04 0.01 0.00 0.00 0.00 0.00
11:30:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
11:30:06 ens3 0.25 0.06 0.07 0.03 0.00 0.00 0.00 0.00
11:40:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
11:40:06 ens3 0.26 0.06 0.07 0.04 0.00 0.00 0.00 0.00
11:50:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
11:50:06 ens3 0.14 0.03 0.04 0.01 0.00 0.00 0.00 0.00
12:00:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
12:00:01 ens3 0.20 0.06 0.07 0.03 0.00 0.00 0.00 0.00
12:10:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
12:10:06 ens3 0.15 0.04 0.04 0.01 0.00 0.00 0.00 0.00
12:20:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
12:20:01 ens3 0.14 0.02 0.04 0.01 0.00 0.00 0.00 0.00
12:30:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
12:30:01 ens3 0.15 0.03 0.04 0.01 0.00 0.00 0.00 0.00
12:40:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
12:40:06 ens3 0.33 0.09 0.10 0.05 0.00 0.00 0.00 0.00
12:50:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
12:50:01 ens3 0.15 0.04 0.04 0.01 0.00 0.00 0.00 0.00
13:00:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
13:00:01 ens3 0.23 0.05 0.07 0.03 0.00 0.00 0.00 0.00
13:10:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
13:10:06 ens3 0.23 0.06 0.07 0.04 0.00 0.00 0.00 0.00
13:20:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
13:20:01 ens3 0.25 0.06 0.07 0.03 0.00 0.00 0.00 0.00
13:30:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
13:30:01 ens3 0.15 0.04 0.04 0.01 0.00 0.00 0.00 0.00
13:40:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
13:40:06 ens3 0.24 0.04 0.07 0.03 0.00 0.00 0.00 0.00
13:50:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
13:50:01 ens3 0.16 0.03 0.04 0.01 0.00 0.00 0.00 0.00
14:00:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
14:00:01 ens3 0.26 0.10 0.09 0.06 0.00 0.00 0.00 0.00
14:10:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
14:10:06 ens3 0.22 0.05 0.07 0.03 0.00 0.00 0.00 0.00
14:20:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
14:20:01 ens3 5.73 3.67 3.52 5.33 0.00 0.00 0.00 0.00
14:30:02 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
14:30:02 ens3 0.14 0.04 0.04 0.01 0.00 0.00 0.00 0.00
14:40:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
14:40:06 ens3 0.34 0.08 0.11 0.06 0.00 0.00 0.00 0.00
14:50:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
14:50:01 ens3 0.24 0.05 0.07 0.03 0.00 0.00 0.00 0.00
15:00:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
15:00:01 ens3 0.29 0.07 0.10 0.05 0.00 0.00 0.00 0.00
15:10:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
15:10:06 ens3 0.17 0.04 0.04 0.01 0.00 0.00 0.00 0.00
15:20:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
15:20:01 ens3 0.15 0.03 0.04 0.01 0.00 0.00 0.00 0.00
15:30:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
15:30:01 ens3 0.14 0.03 0.04 0.01 0.00 0.00 0.00 0.00
15:40:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
15:40:06 ens3 0.23 0.06 0.07 0.03 0.00 0.00 0.00 0.00
15:50:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
15:50:01 ens3 0.24 0.06 0.07 0.03 0.00 0.00 0.00 0.00
16:00:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
16:00:01 ens3 0.28 0.08 0.09 0.05 0.00 0.00 0.00 0.00
16:10:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
16:10:06 ens3 0.23 0.05 0.07 0.03 0.00 0.00 0.00 0.00
16:20:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
16:20:01 ens3 0.23 0.05 0.07 0.03 0.00 0.00 0.00 0.00
16:30:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
16:30:01 ens3 0.18 0.04 0.04 0.01 0.00 0.00 0.00 0.00
16:40:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
16:40:06 ens3 0.33 0.09 0.10 0.05 0.00 0.00 0.00 0.00
16:50:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
16:50:01 ens3 0.14 0.04 0.04 0.01 0.00 0.00 0.00 0.00
17:00:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
17:00:01 ens3 0.26 0.08 0.09 0.05 0.00 0.00 0.00 0.00
17:10:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
17:10:06 ens3 0.17 0.04 0.04 0.01 0.00 0.00 0.00 0.00
17:20:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
17:20:01 ens3 0.15 0.04 0.04 0.01 0.00 0.00 0.00 0.00
17:30:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
17:30:06 ens3 0.15 0.03 0.04 0.01 0.00 0.00 0.00 0.00
17:40:16 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
17:40:16 ens3 0.48 0.08 0.10 0.05 0.00 0.00 0.00 0.00
17:50:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
17:50:06 ens3 0.26 0.07 0.07 0.03 0.00 0.00 0.00 0.00
18:00:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
18:00:06 ens3 0.22 0.06 0.07 0.03 0.00 0.00 0.00 0.00
18:10:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
18:10:06 ens3 0.15 0.03 0.04 0.01 0.00 0.00 0.00 0.00
18:20:16 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
18:20:16 ens3 0.15 0.04 0.04 0.01 0.00 0.00 0.00 0.00
18:30:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
18:30:06 ens3 0.49 0.48 0.09 2.17 0.00 0.00 0.00 0.00
18:40:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
18:40:06 ens3 0.24 0.05 0.07 0.04 0.00 0.00 0.00 0.00
18:50:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
18:50:01 ens3 0.17 0.05 0.05 0.02 0.00 0.00 0.00 0.00
19:00:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
19:00:01 ens3 0.20 0.06 0.06 0.03 0.00 0.00 0.00 0.00
19:10:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
19:10:06 ens3 0.25 0.08 0.07 0.04 0.00 0.00 0.00 0.00
19:20:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
19:20:01 ens3 0.24 0.06 0.07 0.03 0.00 0.00 0.00 0.00
19:30:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
19:30:01 ens3 0.25 0.06 0.07 0.03 0.00 0.00 0.00 0.00
19:40:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
19:40:06 ens3 0.33 0.07 0.10 0.05 0.00 0.00 0.00 0.00
19:50:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
19:50:01 ens3 0.15 0.02 0.04 0.01 0.00 0.00 0.00 0.00
20:00:01 lo 1.01 1.01 0.05 0.05 0.00 0.00 0.00 0.00
20:00:01 ens3 0.31 0.11 0.11 0.06 0.00 0.00 0.00 0.00
20:10:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
20:10:06 ens3 0.25 0.05 0.07 0.03 0.00 0.00 0.00 0.00
20:20:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
20:20:01 ens3 0.15 0.04 0.04 0.01 0.00 0.00 0.00 0.00
20:30:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
20:30:01 ens3 0.24 0.06 0.07 0.03 0.00 0.00 0.00 0.00
20:40:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
20:40:06 ens3 0.26 0.06 0.07 0.03 0.00 0.00 0.00 0.00
20:50:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
20:50:01 ens3 0.15 0.03 0.04 0.01 0.00 0.00 0.00 0.00
21:00:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
21:00:01 ens3 0.29 0.06 0.10 0.05 0.00 0.00 0.00 0.00
21:10:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
21:10:06 ens3 0.17 0.03 0.04 0.01 0.00 0.00 0.00 0.00
21:20:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
21:20:01 ens3 0.15 0.04 0.04 0.01 0.00 0.00 0.00 0.00
21:30:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
21:30:01 ens3 0.15 0.03 0.04 0.01 0.00 0.00 0.00 0.00
21:40:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
21:40:06 ens3 0.23 0.07 0.07 0.03 0.00 0.00 0.00 0.00
21:50:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
21:50:01 ens3 0.15 0.03 0.04 0.01 0.00 0.00 0.00 0.00
22:00:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
22:00:01 ens3 0.28 0.07 0.09 0.05 0.00 0.00 0.00 0.00
22:10:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
22:10:06 ens3 0.16 0.04 0.04 0.01 0.00 0.00 0.00 0.00
22:20:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
22:20:01 ens3 0.24 0.07 0.07 0.04 0.00 0.00 0.00 0.00
22:30:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
22:30:01 ens3 0.46 0.13 0.15 0.09 0.00 0.00 0.00 0.00
22:40:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
22:40:06 ens3 0.27 0.06 0.07 0.03 0.00 0.00 0.00 0.00
22:50:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
22:50:01 ens3 0.15 0.04 0.04 0.01 0.00 0.00 0.00 0.00
23:00:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
23:00:01 ens3 0.21 0.07 0.07 0.03 0.00 0.00 0.00 0.00
23:10:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
23:10:06 ens3 0.18 0.05 0.05 0.01 0.00 0.00 0.00 0.00
23:20:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
23:20:06 ens3 0.20 0.04 0.05 0.01 0.00 0.00 0.00 0.00
23:30:01 lo 2.20 2.20 0.18 0.18 0.00 0.00 0.00 0.00
23:30:01 ens3 70.68 50.59 305.82 16.99 0.00 0.00 0.00 0.00
23:40:06 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00
23:40:06 ens3 13.87 9.62 3.36 1.78 0.00 0.00 0.00 0.00
Average: lo 1.01 1.01 0.05 0.05 0.00 0.00 0.00 0.00
Average: ens3 0.94 0.56 2.61 0.25 0.00 0.00 0.00 0.00
---> sar -P ALL:
Linux 6.8.0-90-generic (prd-ubuntu2404-robot-2c-8g-53985) 03/29/26 _x86_64_ (2 CPU)
02:13:32 LINUX RESTART (2 CPU)
02:20:01 CPU %user %nice %system %iowait %steal %idle
02:30:01 all 0.25 0.00 0.17 0.04 0.03 99.52
02:30:01 0 0.25 0.00 0.18 0.07 0.03 99.48
02:30:01 1 0.24 0.00 0.17 0.00 0.03 99.56
02:40:06 all 0.28 0.00 0.07 0.01 0.03 99.61
02:40:06 0 0.08 0.00 0.10 0.02 0.03 99.76
02:40:06 1 0.47 0.00 0.04 0.00 0.02 99.46
02:50:06 all 0.38 0.00 0.10 0.03 0.02 99.47
02:50:06 0 0.38 0.00 0.10 0.03 0.02 99.47
02:50:06 1 0.37 0.00 0.11 0.02 0.03 99.48
03:00:01 all 0.29 0.00 0.18 0.01 0.02 99.50
03:00:01 0 0.49 0.00 0.13 0.02 0.02 99.34
03:00:01 1 0.09 0.00 0.22 0.00 0.03 99.66
03:10:06 all 0.25 0.00 0.07 0.01 0.02 99.64
03:10:06 0 0.25 0.00 0.08 0.01 0.02 99.64
03:10:06 1 0.26 0.00 0.07 0.01 0.02 99.64
03:20:01 all 0.24 0.00 0.08 0.01 0.03 99.65
03:20:01 0 0.06 0.00 0.09 0.02 0.03 99.80
03:20:01 1 0.42 0.00 0.07 0.00 0.02 99.49
03:30:01 all 0.32 0.00 0.18 0.03 0.02 99.44
03:30:01 0 0.16 0.00 0.19 0.02 0.03 99.60
03:30:01 1 0.48 0.00 0.18 0.05 0.02 99.28
03:40:06 all 0.21 0.00 0.07 0.01 0.03 99.69
03:40:06 0 0.05 0.00 0.08 0.02 0.03 99.81
03:40:06 1 0.36 0.00 0.05 0.00 0.02 99.56
03:50:06 all 0.28 0.00 0.07 0.01 0.03 99.61
03:50:06 0 0.50 0.00 0.05 0.02 0.02 99.41
03:50:06 1 0.06 0.00 0.09 0.01 0.04 99.81
04:00:06 all 0.23 0.00 0.16 0.01 0.03 99.57
04:00:06 0 0.29 0.00 0.14 0.01 0.02 99.54
04:00:06 1 0.18 0.00 0.17 0.01 0.03 99.61
04:10:06 all 0.19 0.00 0.07 0.01 0.03 99.70
04:10:06 0 0.35 0.00 0.05 0.01 0.02 99.57
04:10:06 1 0.04 0.00 0.09 0.01 0.04 99.83
04:10:06 CPU %user %nice %system %iowait %steal %idle
04:20:06 all 0.21 0.00 0.06 0.01 0.03 99.68
04:20:06 0 0.38 0.00 0.04 0.01 0.02 99.55
04:20:06 1 0.04 0.00 0.09 0.01 0.04 99.82
04:30:06 all 0.27 0.00 0.16 0.02 0.03 99.52
04:30:06 0 0.47 0.00 0.16 0.03 0.03 99.32
04:30:06 1 0.07 0.00 0.17 0.01 0.04 99.71
04:40:06 all 0.25 0.00 0.06 0.01 0.03 99.65
04:40:06 0 0.46 0.00 0.04 0.00 0.01 99.49
04:40:06 1 0.05 0.00 0.08 0.02 0.04 99.82
04:50:06 all 0.23 0.00 0.06 0.01 0.03 99.67
04:50:06 0 0.41 0.00 0.05 0.00 0.03 99.51
04:50:06 1 0.04 0.00 0.07 0.03 0.03 99.84
05:00:06 all 0.24 0.00 0.16 0.02 0.03 99.55
05:00:06 0 0.30 0.00 0.16 0.01 0.03 99.51
05:00:06 1 0.19 0.00 0.16 0.03 0.03 99.59
05:10:06 all 0.25 0.00 0.06 0.01 0.03 99.65
05:10:06 0 0.46 0.00 0.04 0.02 0.02 99.47
05:10:06 1 0.04 0.00 0.09 0.01 0.04 99.82
05:20:01 all 0.25 0.00 0.06 0.01 0.03 99.65
05:20:01 0 0.23 0.00 0.06 0.02 0.03 99.67
05:20:01 1 0.26 0.00 0.07 0.01 0.03 99.63
05:30:01 all 0.25 0.00 0.15 0.01 0.03 99.56
05:30:01 0 0.06 0.00 0.17 0.01 0.05 99.71
05:30:01 1 0.44 0.00 0.12 0.01 0.02 99.41
05:40:06 all 0.23 0.00 0.07 0.01 0.03 99.66
05:40:06 0 0.05 0.00 0.09 0.01 0.04 99.80
05:40:06 1 0.40 0.00 0.05 0.01 0.02 99.52
05:50:01 all 0.23 0.00 0.07 0.01 0.03 99.66
05:50:01 0 0.04 0.00 0.08 0.01 0.03 99.84
05:50:01 1 0.42 0.00 0.06 0.01 0.03 99.49
06:00:01 all 0.27 0.00 0.16 0.01 0.03 99.54
06:00:01 0 0.07 0.00 0.17 0.02 0.05 99.70
06:00:01 1 0.46 0.00 0.14 0.00 0.02 99.37
06:00:01 CPU %user %nice %system %iowait %steal %idle
06:10:06 all 0.23 0.00 0.06 0.01 0.03 99.67
06:10:06 0 0.04 0.00 0.08 0.01 0.05 99.82
06:10:06 1 0.41 0.00 0.04 0.01 0.02 99.52
06:20:02 all 0.23 0.00 0.06 0.01 0.03 99.67
06:20:02 0 0.04 0.00 0.09 0.00 0.04 99.82
06:20:02 1 0.42 0.00 0.04 0.02 0.02 99.51
06:30:01 all 0.27 0.00 0.15 0.01 0.03 99.54
06:30:01 0 0.10 0.00 0.17 0.01 0.04 99.68
06:30:01 1 0.44 0.00 0.12 0.02 0.03 99.39
06:40:06 all 0.28 0.00 0.07 0.01 0.03 99.61
06:40:06 0 0.05 0.00 0.09 0.01 0.04 99.82
06:40:06 1 0.52 0.00 0.05 0.02 0.03 99.39
06:50:01 all 0.22 0.00 0.06 0.01 0.03 99.67
06:50:01 0 0.04 0.00 0.08 0.00 0.04 99.84
06:50:01 1 0.41 0.00 0.04 0.02 0.03 99.51
07:00:01 all 0.27 0.00 0.15 0.01 0.03 99.54
07:00:01 0 0.14 0.00 0.16 0.01 0.03 99.66
07:00:01 1 0.39 0.00 0.15 0.02 0.03 99.41
07:10:06 all 0.24 0.00 0.06 0.01 0.03 99.66
07:10:06 0 0.20 0.00 0.05 0.01 0.02 99.72
07:10:06 1 0.29 0.00 0.07 0.01 0.03 99.60
07:20:01 all 0.22 0.00 0.06 0.01 0.03 99.68
07:20:01 0 0.04 0.00 0.08 0.01 0.04 99.83
07:20:01 1 0.40 0.00 0.04 0.02 0.02 99.52
07:30:01 all 0.24 0.00 0.16 0.01 0.03 99.56
07:30:01 0 0.15 0.00 0.17 0.01 0.04 99.63
07:30:01 1 0.33 0.00 0.15 0.01 0.03 99.48
07:40:06 all 0.23 0.00 0.06 0.01 0.03 99.67
07:40:06 0 0.42 0.00 0.04 0.00 0.02 99.52
07:40:06 1 0.04 0.00 0.09 0.02 0.04 99.81
07:50:01 all 0.24 0.00 0.06 0.01 0.03 99.65
07:50:01 0 0.22 0.00 0.07 0.01 0.03 99.67
07:50:01 1 0.26 0.00 0.06 0.01 0.03 99.64
07:50:01 CPU %user %nice %system %iowait %steal %idle
08:00:01 all 0.28 0.00 0.16 0.01 0.03 99.52
08:00:01 0 0.07 0.00 0.20 0.01 0.04 99.68
08:00:01 1 0.48 0.00 0.12 0.01 0.02 99.37
08:10:06 all 0.26 0.00 0.07 0.01 0.03 99.63
08:10:06 0 0.06 0.00 0.10 0.02 0.04 99.78
08:10:06 1 0.47 0.00 0.04 0.00 0.01 99.47
08:20:01 all 0.23 0.00 0.07 0.01 0.03 99.66
08:20:01 0 0.33 0.00 0.06 0.02 0.03 99.56
08:20:01 1 0.12 0.00 0.07 0.01 0.04 99.76
08:30:01 all 0.22 0.00 0.17 0.01 0.03 99.57
08:30:01 0 0.18 0.00 0.15 0.01 0.03 99.63
08:30:01 1 0.26 0.00 0.18 0.02 0.03 99.51
08:40:06 all 0.24 0.00 0.07 0.01 0.03 99.64
08:40:06 0 0.07 0.00 0.09 0.01 0.04 99.78
08:40:06 1 0.42 0.00 0.05 0.01 0.02 99.50
08:50:01 all 0.21 0.00 0.07 0.01 0.03 99.68
08:50:01 0 0.37 0.00 0.05 0.02 0.02 99.55
08:50:01 1 0.05 0.00 0.09 0.00 0.05 99.81
09:00:01 all 0.25 0.00 0.17 0.01 0.03 99.54
09:00:01 0 0.26 0.00 0.16 0.02 0.03 99.53
09:00:01 1 0.24 0.00 0.17 0.01 0.04 99.54
09:10:06 all 0.26 0.00 0.09 0.01 0.04 99.60
09:10:06 0 0.06 0.00 0.11 0.03 0.05 99.75
09:10:06 1 0.47 0.00 0.06 0.00 0.02 99.45
09:20:01 all 0.21 0.00 0.07 0.01 0.03 99.68
09:20:01 0 0.30 0.00 0.07 0.02 0.03 99.58
09:20:01 1 0.11 0.00 0.07 0.01 0.03 99.78
09:30:01 all 0.27 0.00 0.16 0.01 0.03 99.53
09:30:01 0 0.26 0.00 0.16 0.02 0.03 99.53
09:30:01 1 0.28 0.00 0.15 0.01 0.03 99.53
09:40:06 all 0.23 0.00 0.07 0.01 0.03 99.65
09:40:06 0 0.04 0.00 0.08 0.01 0.03 99.83
09:40:06 1 0.42 0.00 0.06 0.01 0.03 99.48
09:40:06 CPU %user %nice %system %iowait %steal %idle
09:50:01 all 0.22 0.00 0.07 0.01 0.03 99.67
09:50:01 0 0.03 0.00 0.08 0.00 0.03 99.85
09:50:01 1 0.40 0.00 0.06 0.02 0.03 99.49
10:00:01 all 0.24 0.00 0.15 0.01 0.04 99.56
10:00:01 0 0.11 0.00 0.17 0.01 0.04 99.67
10:00:01 1 0.37 0.00 0.14 0.01 0.03 99.45
10:10:06 all 0.24 0.00 0.09 0.10 0.03 99.54
10:10:06 0 0.41 0.00 0.07 0.18 0.02 99.32
10:10:06 1 0.07 0.00 0.10 0.02 0.04 99.77
10:20:01 all 0.26 0.00 0.07 0.01 0.03 99.63
10:20:01 0 0.47 0.00 0.05 0.01 0.02 99.46
10:20:01 1 0.06 0.00 0.09 0.02 0.04 99.80
10:30:06 all 0.26 0.00 0.15 0.01 0.03 99.54
10:30:06 0 0.26 0.00 0.14 0.00 0.03 99.56
10:30:06 1 0.26 0.00 0.16 0.02 0.03 99.51
10:40:06 all 0.23 0.00 0.07 0.01 0.03 99.66
10:40:06 0 0.18 0.00 0.07 0.02 0.03 99.70
10:40:06 1 0.28 0.00 0.07 0.00 0.03 99.62
10:50:06 all 0.22 0.00 0.07 0.01 0.03 99.67
10:50:06 0 0.38 0.00 0.05 0.02 0.02 99.53
10:50:06 1 0.07 0.00 0.09 0.00 0.04 99.80
11:00:06 all 0.19 0.00 0.15 0.01 0.03 99.63
11:00:06 0 0.21 0.00 0.15 0.02 0.03 99.59
11:00:06 1 0.16 0.00 0.15 0.00 0.03 99.66
11:10:06 all 0.23 0.00 0.06 0.01 0.03 99.67
11:10:06 0 0.05 0.00 0.09 0.01 0.04 99.82
11:10:06 1 0.41 0.00 0.04 0.01 0.02 99.52
11:20:06 all 0.21 0.00 0.06 0.01 0.03 99.69
11:20:06 0 0.04 0.00 0.08 0.01 0.04 99.83
11:20:06 1 0.38 0.00 0.04 0.01 0.02 99.55
11:30:06 all 0.25 0.00 0.16 0.01 0.03 99.55
11:30:06 0 0.28 0.00 0.16 0.01 0.03 99.53
11:30:06 1 0.22 0.00 0.16 0.01 0.04 99.57
11:30:06 CPU %user %nice %system %iowait %steal %idle
11:40:06 all 0.21 0.00 0.06 0.01 0.03 99.69
11:40:06 0 0.38 0.00 0.06 0.00 0.03 99.53
11:40:06 1 0.04 0.00 0.07 0.01 0.04 99.85
11:50:06 all 0.23 0.00 0.06 0.01 0.03 99.67
11:50:06 0 0.43 0.00 0.05 0.01 0.02 99.49
11:50:06 1 0.04 0.00 0.07 0.01 0.04 99.85
12:00:01 all 0.23 0.00 0.16 0.01 0.03 99.57
12:00:01 0 0.27 0.00 0.16 0.01 0.03 99.52
12:00:01 1 0.19 0.00 0.15 0.01 0.03 99.61
12:10:06 all 0.21 0.00 0.06 0.01 0.03 99.68
12:10:06 0 0.10 0.00 0.07 0.00 0.03 99.79
12:10:06 1 0.33 0.00 0.06 0.01 0.03 99.57
12:20:01 all 0.21 0.00 0.06 0.01 0.03 99.69
12:20:01 0 0.38 0.00 0.04 0.01 0.02 99.55
12:20:01 1 0.04 0.00 0.09 0.01 0.04 99.82
12:30:01 all 0.28 0.00 0.15 0.01 0.03 99.53
12:30:01 0 0.50 0.00 0.12 0.01 0.02 99.35
12:30:01 1 0.06 0.00 0.18 0.00 0.04 99.72
12:40:06 all 0.22 0.00 0.07 0.01 0.03 99.67
12:40:06 0 0.38 0.00 0.06 0.01 0.02 99.52
12:40:06 1 0.06 0.00 0.08 0.00 0.04 99.82
12:50:01 all 0.20 0.00 0.06 0.01 0.03 99.70
12:50:01 0 0.35 0.00 0.04 0.01 0.02 99.59
12:50:01 1 0.05 0.00 0.08 0.01 0.05 99.81
13:00:01 all 0.24 0.00 0.15 0.01 0.03 99.57
13:00:01 0 0.41 0.00 0.13 0.00 0.02 99.44
13:00:01 1 0.06 0.00 0.18 0.02 0.04 99.70
13:10:06 all 0.26 0.00 0.05 0.01 0.03 99.65
13:10:06 0 0.18 0.00 0.05 0.01 0.03 99.72
13:10:06 1 0.33 0.00 0.05 0.00 0.03 99.58
13:20:01 all 0.20 0.00 0.06 0.01 0.03 99.70
13:20:01 0 0.04 0.00 0.08 0.01 0.04 99.84
13:20:01 1 0.36 0.00 0.05 0.01 0.02 99.56
13:20:01 CPU %user %nice %system %iowait %steal %idle
13:30:01 all 0.24 0.16 0.22 0.11 0.03 99.24
13:30:01 0 0.05 0.32 0.29 0.19 0.04 99.10
13:30:01 1 0.43 0.01 0.15 0.03 0.02 99.37
13:40:06 all 0.24 0.00 0.07 0.01 0.03 99.65
13:40:06 0 0.04 0.00 0.08 0.00 0.03 99.83
13:40:06 1 0.43 0.00 0.06 0.01 0.02 99.47
13:50:01 all 0.27 0.00 0.06 0.01 0.03 99.63
13:50:01 0 0.04 0.00 0.08 0.01 0.04 99.85
13:50:01 1 0.51 0.00 0.04 0.01 0.02 99.42
14:00:01 all 0.26 0.00 0.16 0.01 0.03 99.55
14:00:01 0 0.07 0.00 0.16 0.01 0.04 99.74
14:00:01 1 0.45 0.00 0.16 0.01 0.02 99.36
14:10:06 all 0.21 0.00 0.07 0.01 0.03 99.68
14:10:06 0 0.04 0.00 0.08 0.01 0.04 99.82
14:10:06 1 0.39 0.00 0.05 0.00 0.02 99.54
14:20:01 all 0.34 0.00 0.09 0.01 0.03 99.53
14:20:01 0 0.19 0.00 0.09 0.01 0.04 99.68
14:20:01 1 0.50 0.00 0.09 0.01 0.02 99.38
14:30:02 all 0.25 0.00 0.16 0.01 0.03 99.56
14:30:02 0 0.25 0.00 0.14 0.01 0.03 99.57
14:30:02 1 0.25 0.00 0.17 0.01 0.03 99.55
14:40:06 all 0.23 0.00 0.06 0.01 0.03 99.67
14:40:06 0 0.42 0.00 0.05 0.00 0.02 99.51
14:40:06 1 0.04 0.00 0.08 0.01 0.04 99.83
14:50:01 all 0.22 0.00 0.06 0.01 0.03 99.68
14:50:01 0 0.41 0.00 0.05 0.00 0.02 99.53
14:50:01 1 0.04 0.00 0.08 0.02 0.04 99.83
15:00:01 all 0.24 0.00 0.14 0.01 0.03 99.58
15:00:01 0 0.42 0.00 0.13 0.01 0.02 99.43
15:00:01 1 0.06 0.00 0.16 0.01 0.04 99.73
15:10:06 all 0.23 0.00 0.06 0.01 0.03 99.67
15:10:06 0 0.04 0.00 0.06 0.01 0.04 99.84
15:10:06 1 0.41 0.00 0.06 0.00 0.02 99.50
15:10:06 CPU %user %nice %system %iowait %steal %idle
15:20:01 all 0.22 0.00 0.06 0.01 0.03 99.68
15:20:01 0 0.04 0.00 0.07 0.01 0.03 99.85
15:20:01 1 0.40 0.00 0.05 0.01 0.02 99.52
15:30:01 all 0.27 0.00 0.14 0.01 0.03 99.56
15:30:01 0 0.24 0.00 0.14 0.01 0.03 99.59
15:30:01 1 0.30 0.00 0.14 0.01 0.03 99.53
15:40:06 all 0.25 0.00 0.07 0.01 0.03 99.63
15:40:06 0 0.46 0.00 0.05 0.00 0.02 99.46
15:40:06 1 0.05 0.00 0.09 0.01 0.04 99.81
15:50:01 all 0.23 0.00 0.06 0.01 0.03 99.67
15:50:01 0 0.41 0.00 0.05 0.00 0.02 99.53
15:50:01 1 0.05 0.00 0.08 0.01 0.04 99.82
16:00:01 all 0.26 0.00 0.15 0.01 0.03 99.55
16:00:01 0 0.39 0.00 0.13 0.00 0.02 99.45
16:00:01 1 0.12 0.00 0.18 0.02 0.04 99.65
16:10:06 all 0.24 0.00 0.06 0.01 0.03 99.67
16:10:06 0 0.35 0.00 0.05 0.00 0.02 99.58
16:10:06 1 0.13 0.00 0.06 0.01 0.04 99.75
16:20:01 all 0.23 0.00 0.06 0.01 0.03 99.67
16:20:01 0 0.27 0.00 0.07 0.01 0.03 99.63
16:20:01 1 0.19 0.00 0.06 0.01 0.03 99.71
16:30:01 all 0.24 0.00 0.15 0.01 0.03 99.57
16:30:01 0 0.25 0.00 0.14 0.02 0.03 99.57
16:30:01 1 0.23 0.00 0.16 0.00 0.04 99.57
16:40:06 all 0.26 0.00 0.08 0.01 0.03 99.63
16:40:06 0 0.05 0.00 0.09 0.01 0.04 99.80
16:40:06 1 0.46 0.00 0.06 0.00 0.02 99.46
16:50:01 all 0.26 0.00 0.06 0.01 0.03 99.64
16:50:01 0 0.05 0.00 0.08 0.01 0.05 99.81
16:50:01 1 0.47 0.00 0.03 0.00 0.02 99.48
17:00:01 all 0.25 0.00 0.16 0.01 0.03 99.55
17:00:01 0 0.07 0.00 0.19 0.01 0.04 99.69
17:00:01 1 0.43 0.00 0.13 0.01 0.02 99.41
17:00:01 CPU %user %nice %system %iowait %steal %idle
17:10:06 all 0.24 0.00 0.07 0.01 0.03 99.65
17:10:06 0 0.31 0.00 0.06 0.00 0.02 99.60
17:10:06 1 0.17 0.00 0.07 0.01 0.04 99.70
17:20:01 all 0.27 0.00 0.07 0.01 0.03 99.63
17:20:01 0 0.05 0.00 0.09 0.00 0.04 99.81
17:20:01 1 0.49 0.00 0.04 0.01 0.02 99.44
17:30:06 all 0.26 0.00 0.15 0.01 0.03 99.54
17:30:06 0 0.14 0.00 0.17 0.01 0.04 99.64
17:30:06 1 0.39 0.00 0.13 0.01 0.02 99.45
17:40:16 all 0.26 0.00 0.07 0.01 0.03 99.63
17:40:16 0 0.05 0.00 0.10 0.00 0.04 99.81
17:40:16 1 0.47 0.00 0.05 0.01 0.02 99.45
17:50:06 all 0.22 0.00 0.08 0.01 0.03 99.67
17:50:06 0 0.05 0.00 0.09 0.00 0.04 99.83
17:50:06 1 0.39 0.00 0.06 0.01 0.02 99.51
18:00:06 all 0.24 0.00 0.16 0.01 0.03 99.56
18:00:06 0 0.14 0.00 0.17 0.01 0.03 99.66
18:00:06 1 0.34 0.00 0.16 0.02 0.03 99.46
18:10:06 all 0.25 0.00 0.07 0.01 0.03 99.64
18:10:06 0 0.05 0.00 0.07 0.00 0.04 99.84
18:10:06 1 0.44 0.00 0.08 0.01 0.03 99.44
18:20:16 all 0.23 0.00 0.07 0.01 0.03 99.65
18:20:16 0 0.05 0.00 0.07 0.01 0.04 99.84
18:20:16 1 0.42 0.00 0.08 0.01 0.03 99.47
18:30:06 all 0.08 0.00 0.15 0.01 0.02 99.73
18:30:06 0 0.06 0.00 0.16 0.01 0.03 99.74
18:30:06 1 0.11 0.00 0.14 0.01 0.02 99.73
18:40:06 all 0.24 0.00 0.06 0.01 0.03 99.66
18:40:06 0 0.04 0.00 0.08 0.01 0.04 99.83
18:40:06 1 0.44 0.00 0.04 0.01 0.02 99.49
18:50:01 all 0.24 0.00 0.06 0.01 0.03 99.66
18:50:01 0 0.03 0.00 0.07 0.01 0.03 99.85
18:50:01 1 0.44 0.00 0.06 0.01 0.02 99.47
18:50:01 CPU %user %nice %system %iowait %steal %idle
19:00:01 all 0.23 0.00 0.15 0.01 0.03 99.59
19:00:01 0 0.21 0.00 0.14 0.01 0.03 99.62
19:00:01 1 0.25 0.00 0.16 0.00 0.03 99.56
19:10:06 all 0.23 0.00 0.06 0.01 0.03 99.67
19:10:06 0 0.42 0.00 0.04 0.01 0.02 99.51
19:10:06 1 0.04 0.00 0.08 0.01 0.03 99.83
19:20:01 all 0.20 0.00 0.06 0.01 0.03 99.70
19:20:01 0 0.27 0.00 0.05 0.00 0.02 99.65
19:20:01 1 0.13 0.00 0.08 0.01 0.03 99.75
19:30:01 all 0.24 0.00 0.16 0.01 0.03 99.57
19:30:01 0 0.23 0.00 0.17 0.01 0.02 99.57
19:30:01 1 0.25 0.00 0.15 0.01 0.03 99.57
19:40:06 all 0.22 0.00 0.07 0.01 0.03 99.68
19:40:06 0 0.12 0.00 0.07 0.01 0.02 99.77
19:40:06 1 0.31 0.00 0.07 0.00 0.03 99.58
19:50:01 all 0.24 0.00 0.06 0.01 0.03 99.66
19:50:01 0 0.05 0.00 0.07 0.01 0.04 99.84
19:50:01 1 0.44 0.00 0.04 0.01 0.02 99.49
20:00:01 all 0.29 0.00 0.16 0.01 0.03 99.52
20:00:01 0 0.06 0.00 0.15 0.01 0.03 99.74
20:00:01 1 0.51 0.00 0.17 0.01 0.02 99.29
20:10:06 all 0.22 0.00 0.06 0.01 0.03 99.68
20:10:06 0 0.04 0.00 0.08 0.00 0.03 99.85
20:10:06 1 0.41 0.00 0.04 0.01 0.02 99.51
20:20:01 all 0.25 0.00 0.06 0.01 0.03 99.66
20:20:01 0 0.04 0.00 0.09 0.00 0.04 99.83
20:20:01 1 0.45 0.00 0.04 0.01 0.02 99.48
20:30:01 all 0.28 0.00 0.15 0.01 0.03 99.54
20:30:01 0 0.39 0.00 0.13 0.01 0.02 99.45
20:30:01 1 0.16 0.00 0.18 0.01 0.03 99.62
20:40:06 all 0.23 0.00 0.06 0.01 0.03 99.67
20:40:06 0 0.12 0.00 0.06 0.01 0.03 99.77
20:40:06 1 0.35 0.00 0.05 0.00 0.02 99.57
20:40:06 CPU %user %nice %system %iowait %steal %idle
20:50:01 all 0.24 0.00 0.06 0.01 0.03 99.67
20:50:01 0 0.04 0.00 0.08 0.01 0.04 99.84
20:50:01 1 0.44 0.00 0.04 0.01 0.02 99.49
21:00:01 all 0.27 0.00 0.16 0.01 0.03 99.54
21:00:01 0 0.16 0.00 0.17 0.01 0.03 99.63
21:00:01 1 0.38 0.00 0.15 0.01 0.02 99.44
21:10:06 all 0.23 0.00 0.06 0.01 0.03 99.67
21:10:06 0 0.19 0.00 0.06 0.00 0.03 99.72
21:10:06 1 0.28 0.00 0.06 0.01 0.03 99.62
21:20:01 all 0.22 0.00 0.06 0.01 0.03 99.68
21:20:01 0 0.41 0.00 0.04 0.01 0.02 99.53
21:20:01 1 0.04 0.00 0.09 0.01 0.04 99.83
21:30:01 all 0.23 0.00 0.15 0.01 0.03 99.57
21:30:01 0 0.35 0.00 0.15 0.01 0.02 99.47
21:30:01 1 0.12 0.00 0.16 0.01 0.04 99.68
21:40:06 all 0.23 0.00 0.07 0.01 0.03 99.66
21:40:06 0 0.41 0.00 0.06 0.01 0.02 99.51
21:40:06 1 0.05 0.00 0.09 0.00 0.04 99.82
21:50:01 all 0.23 0.00 0.07 0.01 0.03 99.65
21:50:01 0 0.39 0.00 0.07 0.01 0.02 99.51
21:50:01 1 0.08 0.00 0.08 0.01 0.04 99.79
22:00:01 all 0.24 0.00 0.16 0.01 0.03 99.57
22:00:01 0 0.07 0.00 0.17 0.01 0.03 99.71
22:00:01 1 0.40 0.00 0.14 0.01 0.02 99.43
22:10:06 all 0.21 0.00 0.07 0.01 0.03 99.68
22:10:06 0 0.05 0.00 0.09 0.00 0.04 99.81
22:10:06 1 0.37 0.00 0.05 0.01 0.02 99.55
22:20:01 all 0.23 0.00 0.06 0.01 0.03 99.67
22:20:01 0 0.05 0.00 0.08 0.01 0.04 99.82
22:20:01 1 0.42 0.00 0.05 0.01 0.02 99.51
22:30:01 all 0.24 0.00 0.14 0.01 0.03 99.58
22:30:01 0 0.07 0.00 0.16 0.01 0.04 99.72
22:30:01 1 0.40 0.00 0.13 0.01 0.02 99.44
22:30:01 CPU %user %nice %system %iowait %steal %idle
22:40:06 all 0.25 0.00 0.07 0.01 0.03 99.65
22:40:06 0 0.03 0.00 0.07 0.01 0.03 99.85
22:40:06 1 0.46 0.00 0.06 0.01 0.02 99.46
22:50:01 all 0.23 0.00 0.06 0.01 0.03 99.67
22:50:01 0 0.04 0.00 0.08 0.01 0.04 99.82
22:50:01 1 0.43 0.00 0.05 0.01 0.02 99.51
23:00:01 all 0.24 0.00 0.16 0.01 0.03 99.56
23:00:01 0 0.20 0.00 0.18 0.01 0.03 99.58
23:00:01 1 0.28 0.00 0.14 0.02 0.03 99.53
23:10:06 all 0.21 0.00 0.07 0.01 0.03 99.68
23:10:06 0 0.32 0.00 0.06 0.00 0.02 99.59
23:10:06 1 0.10 0.00 0.08 0.01 0.03 99.77
23:20:06 all 0.26 0.00 0.07 0.01 0.03 99.63
23:20:06 0 0.04 0.00 0.10 0.01 0.04 99.81
23:20:06 1 0.48 0.00 0.05 0.01 0.03 99.45
23:30:01 all 11.57 0.00 1.82 0.62 0.05 85.94
23:30:01 0 13.68 0.00 2.07 0.66 0.05 83.54
23:30:01 1 9.47 0.00 1.56 0.58 0.05 88.34
23:40:06 all 3.45 0.00 0.38 0.01 0.07 96.10
23:40:06 0 2.25 0.00 0.30 0.01 0.06 97.38
23:40:06 1 4.65 0.00 0.45 0.01 0.07 94.82
Average: all 0.35 0.00 0.11 0.02 0.03 99.49
Average: 0 0.32 0.00 0.12 0.02 0.03 99.51
Average: 1 0.39 0.00 0.11 0.01 0.03 99.46