Started by upstream project "integration-distribution-weekly-test-trigger-chromium" build number 11 originally caused by: Started by timer Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on prd-ubuntu2404-robot-2c-8g-4562 (ubuntu2404-robot-2c-8g) in workspace /w/workspace/controller-csit-3node-drb-precedence-longevity-only-chromium [ssh-agent] Looking for ssh-agent implementation... [ssh-agent] Exec ssh-agent (binary ssh-agent on a remote machine) $ ssh-agent SSH_AUTH_SOCK=/tmp/ssh-h5E5gffT9Ez6/agent.43205 SSH_AGENT_PID=43207 [ssh-agent] Started. Running ssh-add (command line suppressed) Identity added: /w/workspace/controller-csit-3node-drb-precedence-longevity-only-chromium@tmp/private_key_14154166023629150109.key (/w/workspace/controller-csit-3node-drb-precedence-longevity-only-chromium@tmp/private_key_14154166023629150109.key) [ssh-agent] Using credentials jenkins (Release Engineering Jenkins Key) The recommended git tool is: NONE using credential opendaylight-jenkins-ssh Wiping out workspace first. Cloning the remote Git repository Cloning repository git://devvexx.opendaylight.org/mirror/integration/test > git init /w/workspace/controller-csit-3node-drb-precedence-longevity-only-chromium/test # timeout=10 Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test > git --version # timeout=10 > git --version # 'git version 2.43.0' using GIT_SSH to set credentials Release Engineering Jenkins Key Verifying host key using known hosts file, will automatically accept unseen keys > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10 Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test using GIT_SSH to set credentials Release Engineering Jenkins Key Verifying host key using known hosts file, will automatically accept unseen keys > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test master # timeout=10 > git rev-parse FETCH_HEAD^{commit} # timeout=10 Checking out Revision 901c7e139945b436d95a44b3b592904c3d7a4f9f (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f 901c7e139945b436d95a44b3b592904c3d7a4f9f # timeout=10 Commit message: "Adapt updater.py to use new lsp-flags container" > git rev-parse FETCH_HEAD^{commit} # timeout=10 > git rev-list --no-walk f65244a2a093016c71f9a7a564be7d086941e15c # timeout=10 No emails were triggered. provisioning config files... copy managed file [npmrc] to file:/home/jenkins/.npmrc copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml [controller-csit-3node-drb-precedence-longevity-only-chromium] $ /bin/bash /tmp/jenkins13719136305029252535.sh ---> python-tools-install.sh Setup pyenv: * system (set by /opt/pyenv/version) * 3.8.20 (set by /opt/pyenv/version) * 3.9.20 (set by /opt/pyenv/version) 3.10.15 3.11.10 lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-KguD lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) lf-activate-venv(): INFO: Attempting to install with network-safe options... lf-activate-venv(): INFO: Base packages installed successfully lf-activate-venv(): INFO: Installing additional packages: lftools lf-activate-venv(): INFO: Adding /tmp/venv-KguD/bin to PATH Generating Requirements File ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. httplib2 0.30.2 requires pyparsing<4,>=3.0.4, but you have pyparsing 2.4.7 which is incompatible. Python 3.11.10 pip 26.0.1 from /tmp/venv-KguD/lib/python3.11/site-packages/pip (python 3.11) appdirs==1.4.4 argcomplete==3.6.3 aspy.yaml==1.3.0 attrs==26.1.0 autopage==0.6.0 beautifulsoup4==4.14.3 boto3==1.42.91 botocore==1.42.91 bs4==0.0.2 certifi==2026.2.25 cffi==2.0.0 cfgv==3.5.0 chardet==7.4.3 charset-normalizer==3.4.7 click==8.3.2 cliff==4.13.3 cmd2==3.5.0 cryptography==3.3.2 debtcollector==3.1.0 decorator==5.2.1 defusedxml==0.7.1 Deprecated==1.3.1 distlib==0.4.0 dnspython==2.8.0 docker==7.1.0 dogpile.cache==1.5.0 durationpy==0.10 email-validator==2.3.0 filelock==3.29.0 future==1.0.0 gitdb==4.0.12 GitPython==3.1.46 httplib2==0.30.2 identify==2.6.19 idna==3.11 importlib-resources==1.5.0 iso8601==2.1.0 Jinja2==3.1.6 jmespath==1.1.0 jsonpatch==1.33 jsonpointer==3.1.1 jsonschema==4.26.0 jsonschema-specifications==2025.9.1 keystoneauth1==5.13.1 kubernetes==35.0.0 lftools==0.37.22 lxml==6.1.0 markdown-it-py==4.0.0 MarkupSafe==3.0.3 mdurl==0.1.2 msgpack==1.1.2 multi_key_dict==2.0.3 munch==4.0.0 netaddr==1.3.0 niet==1.4.2 nodeenv==1.10.0 oauth2client==4.1.3 oauthlib==3.3.1 openstacksdk==4.11.0 os-service-types==1.8.2 osc-lib==4.5.0 oslo.config==10.3.0 oslo.context==6.3.0 oslo.i18n==6.7.2 oslo.log==8.1.0 oslo.serialization==5.9.1 oslo.utils==10.0.1 packaging==26.1 pbr==7.0.3 platformdirs==4.9.6 prettytable==3.17.0 psutil==7.2.2 pyasn1==0.6.3 pyasn1_modules==0.4.2 pycparser==3.0 pygerrit2==2.0.15 PyGithub==2.9.1 Pygments==2.20.0 PyJWT==2.12.1 PyNaCl==1.6.2 pyparsing==2.4.7 pyperclip==1.11.0 pyrsistent==0.20.0 python-cinderclient==9.9.0 python-dateutil==2.9.0.post0 python-discovery==1.2.2 python-heatclient==5.1.0 python-jenkins==1.8.3 python-keystoneclient==5.8.0 python-magnumclient==4.10.0 python-openstackclient==9.0.0 python-swiftclient==4.10.0 PyYAML==6.0.3 referencing==0.37.0 requests==2.33.1 requests-oauthlib==2.0.0 rfc3986==2.0.0 rich==15.0.0 rich-argparse==1.7.2 rpds-py==0.30.0 rsa==4.9.1 ruamel.yaml==0.19.1 ruamel.yaml.clib==0.2.15 s3transfer==0.16.0 simplejson==4.0.1 six==1.17.0 smmap==5.0.3 soupsieve==2.8.3 stevedore==5.7.0 tabulate==0.10.0 toml==0.10.2 tomlkit==0.14.0 tqdm==4.67.3 typing_extensions==4.15.0 urllib3==1.26.20 virtualenv==21.2.4 wcwidth==0.6.0 websocket-client==1.9.0 wrapt==2.1.2 xdg==6.0.0 xmltodict==1.0.4 yq==3.4.3 [controller-csit-3node-drb-precedence-longevity-only-chromium] $ /bin/sh /tmp/jenkins1320298163868010566.sh ---> uv-install.sh Installing uv/uvx (latest) using shell installer 2026-04-19 23:30:01 URL:https://release-assets.githubusercontent.com/github-production-release-asset/699532645/d1d55b97-e296-4f5c-8ea5-08512eb5e0a4?sp=r&sv=2018-11-09&sr=b&spr=https&se=2026-04-20T00%3A03%3A06Z&rscd=attachment%3B+filename%3Duv-installer.sh&rsct=application%2Foctet-stream&skoid=96c2d410-5711-43a1-aedd-ab1947aa7ab0&sktid=398a6654-997b-47e9-b12b-9515b896b4de&skt=2026-04-19T23%3A02%3A41Z&ske=2026-04-20T00%3A03%3A06Z&sks=b&skv=2018-11-09&sig=QBX5y5c8cVe1GFG09NqpNhBjWTBUcAmVaIapLsNRJis%3D&jwt=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmVsZWFzZS1hc3NldHMuZ2l0aHVidXNlcmNvbnRlbnQuY29tIiwia2V5Ijoia2V5MSIsImV4cCI6MTc3NjY0MTY5MCwibmJmIjoxNzc2NjQxMzkwLCJwYXRoIjoicmVsZWFzZWFzc2V0cHJvZHVjdGlvbi5ibG9iLmNvcmUud2luZG93cy5uZXQifQ.KyehgOctn-auff7ht6nAoyP1vAPACdWnuLgxu9jSHL4&response-content-disposition=attachment%3B%20filename%3Duv-installer.sh&response-content-type=application%2Foctet-stream [71225/71225] -> "/tmp/uv-install-WtpP4J.sh" [1] downloading uv 0.11.7 x86_64-unknown-linux-gnu installing to /home/jenkins/.local/bin uv uvx everything's installed! To add $HOME/.local/bin to your PATH, either restart your shell or run: source $HOME/.local/bin/env (sh, bash, zsh) source $HOME/.local/bin/env.fish (fish) Adding install location to PATH ---> Validating uv/uvx install uvx 0.11.7 (x86_64-unknown-linux-gnu) [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content OS_STACK_TEMPLATE=csit-2-instance-type.yaml OS_CLOUD=vex OS_STACK_NAME=releng-controller-csit-3node-drb-precedence-longevity-only-chromium-5 OS_STACK_TEMPLATE_DIR=openstack-hot [EnvInject] - Variables injected successfully. provisioning config files... copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml [controller-csit-3node-drb-precedence-longevity-only-chromium] $ /bin/bash /tmp/jenkins15212953565823563315.sh ---> Create parameters file for OpenStack HOT OpenStack Heat parameters generated ----------------------------------- parameters: vm_0_count: '3' vm_0_flavor: 'v3-standard-4' vm_0_image: 'ZZCI - Ubuntu 22.04 - builder - x86_64 - 20260301-010217.216' vm_1_count: '1' vm_1_flavor: 'v3-standard-2' vm_1_image: 'ZZCI - Ubuntu 22.04 - mininet-ovs-217 - x86_64 - 20250917-133034.654' job_name: '13633-5' silo: 'releng' [controller-csit-3node-drb-precedence-longevity-only-chromium] $ /bin/bash -l /tmp/jenkins6401557505652736248.sh ---> Create HEAT stack + source /home/jenkins/lf-env.sh + lf-activate-venv --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq ++ mktemp -d /tmp/venv-XXXX + lf_venv=/tmp/venv-JutF + local venv_file=/tmp/.os_lf_venv + local python=python3 + local options + local set_path=true + local install_args= ++ getopt -o np:v: -l no-path,system-site-packages,python:,venv-file: -n lf-activate-venv -- --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq + options=' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''urllib3~=1.26.15'\'' '\''yq'\''' + eval set -- ' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''urllib3~=1.26.15'\'' '\''yq'\''' ++ set -- --python python3 -- 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq + true + case $1 in + python=python3 + shift 2 + true + case $1 in + shift + break + case $python in + local pkg_list= + [[ -d /opt/pyenv ]] + echo 'Setup pyenv:' Setup pyenv: + export PYENV_ROOT=/opt/pyenv + PYENV_ROOT=/opt/pyenv + export PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin + PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin + pyenv versions system 3.8.20 3.9.20 3.10.15 * 3.11.10 (set by /w/workspace/controller-csit-3node-drb-precedence-longevity-only-chromium/.python-version) + command -v pyenv ++ pyenv init - --no-rehash + eval 'PATH="$(bash --norc -ec '\''IFS=:; paths=($PATH); for i in ${!paths[@]}; do if [[ ${paths[i]} == "'\'''\''/opt/pyenv/shims'\'''\''" ]]; then unset '\''\'\'''\''paths[i]'\''\'\'''\''; fi; done; echo "${paths[*]}"'\'')" export PATH="/opt/pyenv/shims:${PATH}" export PYENV_SHELL=bash source '\''/opt/pyenv/libexec/../completions/pyenv.bash'\'' pyenv() { local command command="${1:-}" if [ "$#" -gt 0 ]; then shift fi case "$command" in rehash|shell) eval "$(pyenv "sh-$command" "$@")" ;; *) command pyenv "$command" "$@" ;; esac }' +++ bash --norc -ec 'IFS=:; paths=($PATH); for i in ${!paths[@]}; do if [[ ${paths[i]} == "/opt/pyenv/shims" ]]; then unset '\''paths[i]'\''; fi; done; echo "${paths[*]}"' ++ PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin ++ export PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin ++ PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin ++ export PYENV_SHELL=bash ++ PYENV_SHELL=bash ++ source /opt/pyenv/libexec/../completions/pyenv.bash +++ complete -F _pyenv pyenv ++ lf-pyver python3 ++ local py_version_xy=python3 ++ local py_version_xyz= ++ awk '{ print $1 }' ++ pyenv versions ++ local command ++ command=versions ++ '[' 1 -gt 0 ']' ++ shift ++ case "$command" in ++ command pyenv versions ++ sed 's/^[ *]* //' ++ grep -E '^[0-9.]*[0-9]$' ++ [[ ! -s /tmp/.pyenv_versions ]] +++ grep '^3' /tmp/.pyenv_versions +++ tail -n 1 +++ sort -V ++ py_version_xyz=3.11.10 ++ [[ -z 3.11.10 ]] ++ echo 3.11.10 ++ return 0 + pyenv local 3.11.10 + local command + command=local + '[' 2 -gt 0 ']' + shift + case "$command" in + command pyenv local 3.11.10 + for arg in "$@" + case $arg in + pkg_list+='lftools[openstack] ' + for arg in "$@" + case $arg in + pkg_list+='kubernetes ' + for arg in "$@" + case $arg in + pkg_list+='niet ' + for arg in "$@" + case $arg in + pkg_list+='python-heatclient ' + for arg in "$@" + case $arg in + pkg_list+='python-openstackclient ' + for arg in "$@" + case $arg in + pkg_list+='python-magnumclient ' + for arg in "$@" + case $arg in + pkg_list+='urllib3~=1.26.15 ' + for arg in "$@" + case $arg in + pkg_list+='yq ' + [[ -f /tmp/.os_lf_venv ]] ++ cat /tmp/.os_lf_venv + lf_venv=/tmp/venv-KguD + echo 'lf-activate-venv(): INFO: Reuse venv:/tmp/venv-KguD from' file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Reuse venv:/tmp/venv-KguD from file:/tmp/.os_lf_venv + echo 'lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)' lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) + local 'pip_opts=--upgrade --quiet' + pip_opts='--upgrade --quiet --trusted-host pypi.org' + pip_opts='--upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org' + pip_opts='--upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org' + [[ -n '' ]] + [[ -n '' ]] + echo 'lf-activate-venv(): INFO: Attempting to install with network-safe options...' lf-activate-venv(): INFO: Attempting to install with network-safe options... + /tmp/venv-KguD/bin/python3 -m pip install --upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org pip 'setuptools<66' virtualenv + echo 'lf-activate-venv(): INFO: Base packages installed successfully' lf-activate-venv(): INFO: Base packages installed successfully + [[ -z lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq ]] + echo 'lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq ' lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq + /tmp/venv-KguD/bin/python3 -m pip install --upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org --upgrade-strategy eager 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq + type python3 + true + echo 'lf-activate-venv(): INFO: Adding /tmp/venv-KguD/bin to PATH' lf-activate-venv(): INFO: Adding /tmp/venv-KguD/bin to PATH + PATH=/tmp/venv-KguD/bin:/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin + return 0 + openstack --os-cloud vex limits show --absolute +--------------------------+---------+ | Name | Value | +--------------------------+---------+ | maxTotalInstances | -1 | | maxTotalCores | 450 | | maxTotalRAMSize | 1000000 | | maxServerMeta | 128 | | maxImageMeta | 128 | | maxPersonality | 5 | | maxPersonalitySize | 10240 | | maxTotalKeypairs | 100 | | maxServerGroups | 10 | | maxServerGroupMembers | 10 | | maxTotalFloatingIps | -1 | | maxSecurityGroups | -1 | | maxSecurityGroupRules | -1 | | totalRAMUsed | 99328 | | totalCoresUsed | 25 | | totalInstancesUsed | 13 | | totalFloatingIpsUsed | 0 | | totalSecurityGroupsUsed | 0 | | totalServerGroupsUsed | 0 | | maxTotalVolumes | -1 | | maxTotalSnapshots | 10 | | maxTotalVolumeGigabytes | 4096 | | maxTotalBackups | 10 | | maxTotalBackupGigabytes | 1000 | | totalVolumesUsed | 1 | | totalGigabytesUsed | 20 | | totalSnapshotsUsed | 0 | | totalBackupsUsed | 0 | | totalBackupGigabytesUsed | 0 | +--------------------------+---------+ + pushd /opt/ciman/openstack-hot /opt/ciman/openstack-hot /w/workspace/controller-csit-3node-drb-precedence-longevity-only-chromium + lftools openstack --os-cloud vex stack create releng-controller-csit-3node-drb-precedence-longevity-only-chromium-5 csit-2-instance-type.yaml /w/workspace/controller-csit-3node-drb-precedence-longevity-only-chromium/stack-parameters.yaml Creating stack releng-controller-csit-3node-drb-precedence-longevity-only-chromium-5 Waiting to initialize infrastructure... Waiting to initialize infrastructure... Stack initialization successful. ------------------------------------ Stack Details ------------------------------------ {'added': None, 'capabilities': [], 'created_at': '2026-04-19T23:30:26Z', 'deleted': None, 'deleted_at': None, 'description': 'No description', 'environment': None, 'environment_files': None, 'files': None, 'files_container': None, 'id': '967a4019-bf2a-4bcf-a942-d1122e7985cc', 'is_rollback_disabled': True, 'links': [{'href': 'https://orchestration.public.mtl1.vexxhost.net/v1/12c36e260d8e4bb2913965203b1b491f/stacks/releng-controller-csit-3node-drb-precedence-longevity-only-chromium-5/967a4019-bf2a-4bcf-a942-d1122e7985cc', 'rel': 'self'}], 'location': Munch({'cloud': 'vex', 'region_name': 'ca-ymq-1', 'zone': None, 'project': Munch({'id': '12c36e260d8e4bb2913965203b1b491f', 'name': '61975f2c-7c17-4d69-82fa-c3ae420ad6fd', 'domain_id': None, 'domain_name': 'Default'})}), 'name': 'releng-controller-csit-3node-drb-precedence-longevity-only-chromium-5', 'notification_topics': [], 'outputs': [{'description': 'IP addresses of the 1st vm types', 'output_key': 'vm_0_ips', 'output_value': ['10.30.171.213', '10.30.170.177', '10.30.170.89']}, {'description': 'IP addresses of the 2nd vm types', 'output_key': 'vm_1_ips', 'output_value': ['10.30.171.43']}], 'owner_id': ****, 'parameters': {'OS::project_id': '12c36e260d8e4bb2913965203b1b491f', 'OS::stack_id': '967a4019-bf2a-4bcf-a942-d1122e7985cc', 'OS::stack_name': 'releng-controller-csit-3node-drb-precedence-longevity-only-chromium-5', 'job_name': '13633-5', 'silo': 'releng', 'vm_0_count': '3', 'vm_0_flavor': 'v3-standard-4', 'vm_0_image': 'ZZCI - Ubuntu 22.04 - builder - x86_64 - ' '20260301-010217.216', 'vm_1_count': '1', 'vm_1_flavor': 'v3-standard-2', 'vm_1_image': 'ZZCI - Ubuntu 22.04 - mininet-ovs-217 - x86_64 ' '- 20250917-133034.654'}, 'parent_id': None, 'replaced': None, 'status': 'CREATE_COMPLETE', 'status_reason': 'Stack CREATE completed successfully', 'tags': [], 'template': None, 'template_description': 'No description', 'template_url': None, 'timeout_mins': 15, 'unchanged': None, 'updated': None, 'updated_at': None, 'user_project_id': '2a7e97cc103c4adc9274190c77fe252c'} ------------------------------------ + popd /w/workspace/controller-csit-3node-drb-precedence-longevity-only-chromium [controller-csit-3node-drb-precedence-longevity-only-chromium] $ /bin/bash -l /tmp/jenkins2465687520161432639.sh ---> Copy SSH public keys to CSIT lab Setup pyenv: system 3.8.20 3.9.20 3.10.15 * 3.11.10 (set by /w/workspace/controller-csit-3node-drb-precedence-longevity-only-chromium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-KguD from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) lf-activate-venv(): INFO: Attempting to install with network-safe options... lf-activate-venv(): INFO: Base packages installed successfully lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes python-heatclient python-openstackclient urllib3~=1.26.15 lf-activate-venv(): INFO: Adding /tmp/venv-KguD/bin to PATH SSH not responding on 10.30.171.213. Retrying in 10 seconds... SSH not responding on 10.30.170.177. Retrying in 10 seconds... SSH not responding on 10.30.170.89. Retrying in 10 seconds... Warning: Permanently added '10.30.171.43' (ED25519) to the list of known hosts. releng-13633-5-1-mininet-ovs-217-0 Successfully copied public keys to slave 10.30.171.43 Ping to 10.30.171.213 successful. Ping to 10.30.170.177 successful. Ping to 10.30.170.89 successful. SSH not responding on 10.30.171.213. Retrying in 10 seconds... SSH not responding on 10.30.170.177. Retrying in 10 seconds... Warning: Permanently added '10.30.170.89' (ED25519) to the list of known hosts. releng-13633-5-0-builder-2 Successfully copied public keys to slave 10.30.170.89 Ping to 10.30.171.213 successful. Ping to 10.30.170.177 successful. Warning: Permanently added '10.30.170.177' (ED25519) to the list of known hosts. Warning: Permanently added '10.30.171.213' (ED25519) to the list of known hosts. releng-13633-5-0-builder-1 Successfully copied public keys to slave 10.30.170.177 releng-13633-5-0-builder-0 Successfully copied public keys to slave 10.30.171.213 Process 44150 ready. Process 44151 ready. Process 44152 ready. Process 44153 ready. SSH ready on all stack servers. [controller-csit-3node-drb-precedence-longevity-only-chromium] $ /bin/bash -l /tmp/jenkins2726373947267671535.sh Setup pyenv: system 3.8.20 3.9.20 3.10.15 * 3.11.10 (set by /w/workspace/controller-csit-3node-drb-precedence-longevity-only-chromium/.python-version) lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-PHGW lf-activate-venv(): INFO: Save venv in file: /w/workspace/controller-csit-3node-drb-precedence-longevity-only-chromium/.robot_venv lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) lf-activate-venv(): INFO: Attempting to install with network-safe options... lf-activate-venv(): INFO: Base packages installed successfully lf-activate-venv(): INFO: Installing additional packages: setuptools wheel lf-activate-venv(): INFO: Adding /tmp/venv-PHGW/bin to PATH + echo 'Installing Python Requirements' Installing Python Requirements + cat + python -m pip install -r requirements.txt Looking in indexes: https://nexus3.opendaylight.org/repository/PyPi/simple Collecting docker-py (from -r requirements.txt (line 1)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/docker-py/1.10.6/docker_py-1.10.6-py2.py3-none-any.whl (50 kB) Collecting ipaddr (from -r requirements.txt (line 2)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/ipaddr/2.2.0/ipaddr-2.2.0.tar.gz (26 kB) Installing build dependencies: started Installing build dependencies: finished with status 'done' Getting requirements to build wheel: started Getting requirements to build wheel: finished with status 'done' Preparing metadata (pyproject.toml): started Preparing metadata (pyproject.toml): finished with status 'done' Collecting netaddr (from -r requirements.txt (line 3)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/netaddr/1.3.0/netaddr-1.3.0-py3-none-any.whl (2.3 MB) Collecting netifaces (from -r requirements.txt (line 4)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/netifaces/0.11.0/netifaces-0.11.0.tar.gz (30 kB) Installing build dependencies: started Installing build dependencies: finished with status 'done' Getting requirements to build wheel: started Getting requirements to build wheel: finished with status 'done' Preparing metadata (pyproject.toml): started Preparing metadata (pyproject.toml): finished with status 'done' Collecting pyhocon (from -r requirements.txt (line 5)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyhocon/0.3.63/pyhocon-0.3.63.tar.gz (307 kB) Installing build dependencies: started Installing build dependencies: finished with status 'done' Getting requirements to build wheel: started Getting requirements to build wheel: finished with status 'done' Preparing metadata (pyproject.toml): started Preparing metadata (pyproject.toml): finished with status 'done' Collecting requests (from -r requirements.txt (line 6)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/requests/2.33.1/requests-2.33.1-py3-none-any.whl (64 kB) Collecting robotframework (from -r requirements.txt (line 7)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework/7.4.2/robotframework-7.4.2-py3-none-any.whl (807 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 807.1/807.1 kB 33.0 MB/s 0:00:00 Collecting robotframework-httplibrary (from -r requirements.txt (line 8)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-httplibrary/0.4.2/robotframework-httplibrary-0.4.2.tar.gz (9.1 kB) Installing build dependencies: started Installing build dependencies: finished with status 'done' Getting requirements to build wheel: started Getting requirements to build wheel: finished with status 'done' Preparing metadata (pyproject.toml): started Preparing metadata (pyproject.toml): finished with status 'done' Collecting robotframework-requests==0.9.7 (from -r requirements.txt (line 9)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-requests/0.9.7/robotframework_requests-0.9.7-py3-none-any.whl (21 kB) Collecting robotframework-selenium2library (from -r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-selenium2library/3.0.0/robotframework_selenium2library-3.0.0-py2.py3-none-any.whl (6.2 kB) Collecting robotframework-sshlibrary==3.8.0 (from -r requirements.txt (line 11)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-sshlibrary/3.8.0/robotframework-sshlibrary-3.8.0.tar.gz (51 kB) Installing build dependencies: started Installing build dependencies: finished with status 'done' Getting requirements to build wheel: started Getting requirements to build wheel: finished with status 'done' Preparing metadata (pyproject.toml): started Preparing metadata (pyproject.toml): finished with status 'done' Collecting scapy (from -r requirements.txt (line 12)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/scapy/2.7.0/scapy-2.7.0-py3-none-any.whl (2.6 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.6/2.6 MB 35.8 MB/s 0:00:00 Collecting jsonpath-rw (from -r requirements.txt (line 15)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpath-rw/1.4.0/jsonpath-rw-1.4.0.tar.gz (13 kB) Installing build dependencies: started Installing build dependencies: finished with status 'done' Getting requirements to build wheel: started Getting requirements to build wheel: finished with status 'done' Preparing metadata (pyproject.toml): started Preparing metadata (pyproject.toml): finished with status 'done' Collecting elasticsearch (from -r requirements.txt (line 18)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch/9.3.0/elasticsearch-9.3.0-py3-none-any.whl (979 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 979.4/979.4 kB 31.4 MB/s 0:00:00 Collecting elasticsearch-dsl (from -r requirements.txt (line 19)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch-dsl/8.18.0/elasticsearch_dsl-8.18.0-py3-none-any.whl (10 kB) Collecting pyangbind (from -r requirements.txt (line 22)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyangbind/0.8.7/pyangbind-0.8.7-py3-none-any.whl (52 kB) Collecting isodate (from -r requirements.txt (line 25)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/isodate/0.7.2/isodate-0.7.2-py3-none-any.whl (22 kB) Collecting jmespath (from -r requirements.txt (line 28)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jmespath/1.1.0/jmespath-1.1.0-py3-none-any.whl (20 kB) Collecting jsonpatch (from -r requirements.txt (line 31)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpatch/1.33/jsonpatch-1.33-py2.py3-none-any.whl (12 kB) Collecting paramiko>=1.15.3 (from robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/paramiko/4.0.0/paramiko-4.0.0-py3-none-any.whl (223 kB) Collecting scp>=0.13.0 (from robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/scp/0.15.0/scp-0.15.0-py2.py3-none-any.whl (8.8 kB) Collecting docker-pycreds>=0.2.1 (from docker-py->-r requirements.txt (line 1)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/docker-pycreds/0.4.0/docker_pycreds-0.4.0-py2.py3-none-any.whl (9.0 kB) Collecting six>=1.4.0 (from docker-py->-r requirements.txt (line 1)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/six/1.17.0/six-1.17.0-py2.py3-none-any.whl (11 kB) Collecting websocket-client>=0.32.0 (from docker-py->-r requirements.txt (line 1)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/websocket-client/1.9.0/websocket_client-1.9.0-py3-none-any.whl (82 kB) Collecting pyparsing>=3.0.0 (from pyhocon->-r requirements.txt (line 5)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pyparsing/3.3.2/pyparsing-3.3.2-py3-none-any.whl (122 kB) Collecting charset_normalizer<4,>=2 (from requests->-r requirements.txt (line 6)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/charset-normalizer/3.4.7/charset_normalizer-3.4.7-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl (214 kB) Collecting idna<4,>=2.5 (from requests->-r requirements.txt (line 6)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/idna/3.11/idna-3.11-py3-none-any.whl (71 kB) Collecting urllib3<3,>=1.26 (from requests->-r requirements.txt (line 6)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/urllib3/2.6.3/urllib3-2.6.3-py3-none-any.whl (131 kB) Collecting certifi>=2023.5.7 (from requests->-r requirements.txt (line 6)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/certifi/2026.2.25/certifi-2026.2.25-py3-none-any.whl (153 kB) Collecting webtest>=2.0 (from robotframework-httplibrary->-r requirements.txt (line 8)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/webtest/3.0.7/webtest-3.0.7-py3-none-any.whl (32 kB) Collecting jsonpointer (from robotframework-httplibrary->-r requirements.txt (line 8)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpointer/3.1.1/jsonpointer-3.1.1-py3-none-any.whl (7.7 kB) Collecting robotframework-seleniumlibrary>=3.0.0 (from robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-seleniumlibrary/6.8.0/robotframework_seleniumlibrary-6.8.0-py3-none-any.whl (104 kB) Collecting ply (from jsonpath-rw->-r requirements.txt (line 15)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/ply/3.11/ply-3.11-py2.py3-none-any.whl (49 kB) Collecting decorator (from jsonpath-rw->-r requirements.txt (line 15)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/decorator/5.2.1/decorator-5.2.1-py3-none-any.whl (9.2 kB) Collecting anyio (from elasticsearch->-r requirements.txt (line 18)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/anyio/4.13.0/anyio-4.13.0-py3-none-any.whl (114 kB) Collecting elastic-transport<10,>=9.2.0 (from elasticsearch->-r requirements.txt (line 18)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elastic-transport/9.2.1/elastic_transport-9.2.1-py3-none-any.whl (65 kB) Collecting python-dateutil (from elasticsearch->-r requirements.txt (line 18)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/python-dateutil/2.9.0.post0/python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) Collecting sniffio (from elasticsearch->-r requirements.txt (line 18)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/sniffio/1.3.1/sniffio-1.3.1-py3-none-any.whl (10 kB) Collecting typing-extensions (from elasticsearch->-r requirements.txt (line 18)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/typing-extensions/4.15.0/typing_extensions-4.15.0-py3-none-any.whl (44 kB) Collecting elasticsearch (from -r requirements.txt (line 18)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch/8.19.3/elasticsearch-8.19.3-py3-none-any.whl (952 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 952.8/952.8 kB 35.6 MB/s 0:00:00 INFO: pip is looking at multiple versions of elasticsearch-dsl to determine which version is compatible with other requirements. This could take a while. Collecting elasticsearch-dsl (from -r requirements.txt (line 19)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch-dsl/8.17.1/elasticsearch_dsl-8.17.1-py3-none-any.whl (158 kB) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch-dsl/8.17.0/elasticsearch_dsl-8.17.0-py3-none-any.whl (158 kB) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch-dsl/8.16.0/elasticsearch_dsl-8.16.0-py3-none-any.whl (158 kB) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch-dsl/8.15.4/elasticsearch_dsl-8.15.4-py3-none-any.whl (104 kB) Collecting elastic-transport<9,>=8.15.1 (from elasticsearch->-r requirements.txt (line 18)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elastic-transport/8.17.1/elastic_transport-8.17.1-py3-none-any.whl (64 kB) Collecting pyang (from pyangbind->-r requirements.txt (line 22)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyang/2.7.1/pyang-2.7.1-py2.py3-none-any.whl (598 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 598.5/598.5 kB 25.9 MB/s 0:00:00 Collecting lxml (from pyangbind->-r requirements.txt (line 22)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/lxml/6.1.0/lxml-6.1.0-cp311-cp311-manylinux_2_26_x86_64.manylinux_2_28_x86_64.whl (5.2 MB) Collecting regex (from pyangbind->-r requirements.txt (line 22)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/regex/2026.4.4/regex-2026.4.4-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl (799 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 799.8/799.8 kB 23.5 MB/s 0:00:00 Collecting enum34 (from pyangbind->-r requirements.txt (line 22)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/enum34/1.1.10/enum34-1.1.10-py3-none-any.whl (11 kB) Collecting bcrypt>=3.2 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/bcrypt/5.0.0/bcrypt-5.0.0-cp39-abi3-manylinux_2_34_x86_64.whl (278 kB) Collecting cryptography>=3.3 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/cryptography/46.0.7/cryptography-46.0.7-cp311-abi3-manylinux_2_34_x86_64.whl (4.5 MB) Collecting invoke>=2.0 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/invoke/3.0.3/invoke-3.0.3-py3-none-any.whl (160 kB) Collecting pynacl>=1.5 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pynacl/1.6.2/pynacl-1.6.2-cp38-abi3-manylinux_2_34_x86_64.whl (1.4 MB) Collecting cffi>=2.0.0 (from cryptography>=3.3->paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/cffi/2.0.0/cffi-2.0.0-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (215 kB) Collecting pycparser (from cffi>=2.0.0->cryptography>=3.3->paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pycparser/3.0/pycparser-3.0-py3-none-any.whl (48 kB) Collecting selenium>=4.3.0 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/selenium/4.43.0/selenium-4.43.0-py3-none-any.whl (9.6 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 9.6/9.6 MB 75.2 MB/s 0:00:00 Collecting robotframework-pythonlibcore>=4.4.1 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-pythonlibcore/4.5.0/robotframework_pythonlibcore-4.5.0-py3-none-any.whl (19 kB) Collecting click>=8.0 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/click/8.3.2/click-8.3.2-py3-none-any.whl (108 kB) Collecting trio<1.0,>=0.31.0 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/trio/0.33.0/trio-0.33.0-py3-none-any.whl (510 kB) Collecting trio-websocket<1.0,>=0.12.2 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/trio-websocket/0.12.2/trio_websocket-0.12.2-py3-none-any.whl (21 kB) Collecting attrs>=23.2.0 (from trio<1.0,>=0.31.0->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/attrs/26.1.0/attrs-26.1.0-py3-none-any.whl (67 kB) Collecting sortedcontainers (from trio<1.0,>=0.31.0->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/sortedcontainers/2.4.0/sortedcontainers-2.4.0-py2.py3-none-any.whl (29 kB) Collecting outcome (from trio<1.0,>=0.31.0->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/outcome/1.3.0.post0/outcome-1.3.0.post0-py2.py3-none-any.whl (10 kB) Collecting wsproto>=0.14 (from trio-websocket<1.0,>=0.12.2->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/wsproto/1.3.2/wsproto-1.3.2-py3-none-any.whl (24 kB) Collecting pysocks!=1.5.7,<2.0,>=1.5.6 (from urllib3[socks]<3.0,>=2.6.3->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pysocks/1.7.1/PySocks-1.7.1-py3-none-any.whl (16 kB) Collecting WebOb>=1.2 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/webob/1.8.9/WebOb-1.8.9-py2.py3-none-any.whl (115 kB) Collecting waitress>=3.0.2 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/waitress/3.0.2/waitress-3.0.2-py3-none-any.whl (56 kB) Collecting beautifulsoup4 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/beautifulsoup4/4.14.3/beautifulsoup4-4.14.3-py3-none-any.whl (107 kB) Collecting h11<1,>=0.16.0 (from wsproto>=0.14->trio-websocket<1.0,>=0.12.2->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/h11/0.16.0/h11-0.16.0-py3-none-any.whl (37 kB) Collecting soupsieve>=1.6.1 (from beautifulsoup4->webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/soupsieve/2.8.3/soupsieve-2.8.3-py3-none-any.whl (37 kB) Building wheels for collected packages: robotframework-sshlibrary, ipaddr, netifaces, pyhocon, robotframework-httplibrary, jsonpath-rw Building wheel for robotframework-sshlibrary (pyproject.toml): started Building wheel for robotframework-sshlibrary (pyproject.toml): finished with status 'done' Created wheel for robotframework-sshlibrary: filename=robotframework_sshlibrary-3.8.0-py3-none-any.whl size=55205 sha256=2fdcce76bc8d9ee1946affb571b5de55c7d87d90c76d75ba61640a750168d898 Stored in directory: /home/jenkins/.cache/pip/wheels/f7/c9/b3/a977b7bcc410d45ae27d240df3d00a12585509180e373ecccc Building wheel for ipaddr (pyproject.toml): started Building wheel for ipaddr (pyproject.toml): finished with status 'done' Created wheel for ipaddr: filename=ipaddr-2.2.0-py3-none-any.whl size=18355 sha256=58e5793ac6a2c3f762286be5b6c3b6ad7a6ff95b1b74f3af8fa2168be85e4cae Stored in directory: /home/jenkins/.cache/pip/wheels/dc/6c/04/da2d847fa8d45c59af3e1d83e2acc29cb8adcbaf04c0898dbf Building wheel for netifaces (pyproject.toml): started Building wheel for netifaces (pyproject.toml): finished with status 'done' Created wheel for netifaces: filename=netifaces-0.11.0-cp311-cp311-linux_x86_64.whl size=34974 sha256=c0f1bb9818f59715aeda3800003c0cbfd1f5dc7f65bbd01ba0eec304f513f3f9 Stored in directory: /home/jenkins/.cache/pip/wheels/f8/18/88/e61d54b995bea304bdb1d040a92b72228a1bf72ca2a3eba7c9 Building wheel for pyhocon (pyproject.toml): started Building wheel for pyhocon (pyproject.toml): finished with status 'done' Created wheel for pyhocon: filename=pyhocon-0.3.63-py3-none-any.whl size=24721 sha256=e8eff80e7d7798a0b0544f4520b9290e597072611b4e466569f6279efed8eaa5 Stored in directory: /home/jenkins/.cache/pip/wheels/ce/9e/92/cb17e17d79fafd46a767074b3ed1dca8f78036163f9bea914d Building wheel for robotframework-httplibrary (pyproject.toml): started Building wheel for robotframework-httplibrary (pyproject.toml): finished with status 'done' Created wheel for robotframework-httplibrary: filename=robotframework_httplibrary-0.4.2-py3-none-any.whl size=10014 sha256=e017e4d60851f6d6c9d0913e08315487d900499c076b9c92090323157e965dfb Stored in directory: /home/jenkins/.cache/pip/wheels/aa/bc/0d/9a20dd51effef392aae2733cb4c7b66c6fa29fca33d88b57ed Building wheel for jsonpath-rw (pyproject.toml): started Building wheel for jsonpath-rw (pyproject.toml): finished with status 'done' Created wheel for jsonpath-rw: filename=jsonpath_rw-1.4.0-py3-none-any.whl size=15176 sha256=616e3df2a5b8593c1fb31e8a050818de43cbea78d933ef0f3a3352b326a53a8f Stored in directory: /home/jenkins/.cache/pip/wheels/f1/54/63/9a8da38cefae13755097b36cc852decc25d8ef69c37d58d4eb Successfully built robotframework-sshlibrary ipaddr netifaces pyhocon robotframework-httplibrary jsonpath-rw Installing collected packages: sortedcontainers, ply, netifaces, ipaddr, enum34, websocket-client, WebOb, waitress, urllib3, typing-extensions, soupsieve, sniffio, six, scapy, robotframework-pythonlibcore, robotframework, regex, pysocks, pyparsing, pycparser, netaddr, lxml, jsonpointer, jmespath, isodate, invoke, idna, h11, decorator, click, charset_normalizer, certifi, bcrypt, attrs, wsproto, requests, python-dateutil, pyhocon, pyang, outcome, jsonpath-rw, jsonpatch, elastic-transport, docker-pycreds, cffi, beautifulsoup4, webtest, trio, robotframework-requests, pynacl, pyangbind, elasticsearch, docker-py, cryptography, trio-websocket, robotframework-httplibrary, paramiko, elasticsearch-dsl, selenium, scp, robotframework-sshlibrary, robotframework-seleniumlibrary, robotframework-selenium2library Successfully installed WebOb-1.8.9 attrs-26.1.0 bcrypt-5.0.0 beautifulsoup4-4.14.3 certifi-2026.2.25 cffi-2.0.0 charset_normalizer-3.4.7 click-8.3.2 cryptography-46.0.7 decorator-5.2.1 docker-py-1.10.6 docker-pycreds-0.4.0 elastic-transport-8.17.1 elasticsearch-8.19.3 elasticsearch-dsl-8.15.4 enum34-1.1.10 h11-0.16.0 idna-3.11 invoke-3.0.3 ipaddr-2.2.0 isodate-0.7.2 jmespath-1.1.0 jsonpatch-1.33 jsonpath-rw-1.4.0 jsonpointer-3.1.1 lxml-6.1.0 netaddr-1.3.0 netifaces-0.11.0 outcome-1.3.0.post0 paramiko-4.0.0 ply-3.11 pyang-2.7.1 pyangbind-0.8.7 pycparser-3.0 pyhocon-0.3.63 pynacl-1.6.2 pyparsing-3.3.2 pysocks-1.7.1 python-dateutil-2.9.0.post0 regex-2026.4.4 requests-2.33.1 robotframework-7.4.2 robotframework-httplibrary-0.4.2 robotframework-pythonlibcore-4.5.0 robotframework-requests-0.9.7 robotframework-selenium2library-3.0.0 robotframework-seleniumlibrary-6.8.0 robotframework-sshlibrary-3.8.0 scapy-2.7.0 scp-0.15.0 selenium-4.43.0 six-1.17.0 sniffio-1.3.1 sortedcontainers-2.4.0 soupsieve-2.8.3 trio-0.33.0 trio-websocket-0.12.2 typing-extensions-4.15.0 urllib3-2.6.3 waitress-3.0.2 websocket-client-1.9.0 webtest-3.0.7 wsproto-1.3.2 + pip freeze attrs==26.1.0 bcrypt==5.0.0 beautifulsoup4==4.14.3 certifi==2026.2.25 cffi==2.0.0 charset-normalizer==3.4.7 click==8.3.2 cryptography==46.0.7 decorator==5.2.1 distlib==0.4.0 docker-py==1.10.6 docker-pycreds==0.4.0 elastic-transport==8.17.1 elasticsearch==8.19.3 elasticsearch-dsl==8.15.4 enum34==1.1.10 filelock==3.29.0 h11==0.16.0 idna==3.11 invoke==3.0.3 ipaddr==2.2.0 isodate==0.7.2 jmespath==1.1.0 jsonpatch==1.33 jsonpath-rw==1.4.0 jsonpointer==3.1.1 lxml==6.1.0 netaddr==1.3.0 netifaces==0.11.0 outcome==1.3.0.post0 packaging==26.1 paramiko==4.0.0 platformdirs==4.9.6 ply==3.11 pyang==2.7.1 pyangbind==0.8.7 pycparser==3.0 pyhocon==0.3.63 PyNaCl==1.6.2 pyparsing==3.3.2 PySocks==1.7.1 python-dateutil==2.9.0.post0 python-discovery==1.2.2 regex==2026.4.4 requests==2.33.1 robotframework==7.4.2 robotframework-httplibrary==0.4.2 robotframework-pythonlibcore==4.5.0 robotframework-requests==0.9.7 robotframework-selenium2library==3.0.0 robotframework-seleniumlibrary==6.8.0 robotframework-sshlibrary==3.8.0 scapy==2.7.0 scp==0.15.0 selenium==4.43.0 six==1.17.0 sniffio==1.3.1 sortedcontainers==2.4.0 soupsieve==2.8.3 trio==0.33.0 trio-websocket==0.12.2 typing_extensions==4.15.0 urllib3==2.6.3 virtualenv==21.2.4 waitress==3.0.2 WebOb==1.8.9 websocket-client==1.9.0 WebTest==3.0.7 wsproto==1.3.2 [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'env.properties' [EnvInject] - Variables injected successfully. [controller-csit-3node-drb-precedence-longevity-only-chromium] $ /bin/bash -l /tmp/jenkins12559787504783419722.sh Setup pyenv: system 3.8.20 3.9.20 3.10.15 * 3.11.10 (set by /w/workspace/controller-csit-3node-drb-precedence-longevity-only-chromium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-KguD from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) lf-activate-venv(): INFO: Attempting to install with network-safe options... lf-activate-venv(): INFO: Base packages installed successfully lf-activate-venv(): INFO: Installing additional packages: python-heatclient python-openstackclient yq lf-activate-venv(): INFO: Adding /tmp/venv-KguD/bin to PATH + ODL_SYSTEM=() + TOOLS_SYSTEM=() + OPENSTACK_SYSTEM=() + OPENSTACK_CONTROLLERS=() + mapfile -t ADDR ++ jq -r '.outputs[] | select(.output_key | match("^vm_[0-9]+_ips$")) | .output_value | .[]' ++ openstack stack show -f json -c outputs releng-controller-csit-3node-drb-precedence-longevity-only-chromium-5 + for i in "${ADDR[@]}" ++ ssh 10.30.171.213 hostname -s Warning: Permanently added '10.30.171.213' (ED25519) to the list of known hosts. + REMHOST=releng-13633-5-0-builder-0 + case ${REMHOST} in + ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}") + for i in "${ADDR[@]}" ++ ssh 10.30.170.177 hostname -s Warning: Permanently added '10.30.170.177' (ED25519) to the list of known hosts. + REMHOST=releng-13633-5-0-builder-1 + case ${REMHOST} in + ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}") + for i in "${ADDR[@]}" ++ ssh 10.30.170.89 hostname -s Warning: Permanently added '10.30.170.89' (ED25519) to the list of known hosts. + REMHOST=releng-13633-5-0-builder-2 + case ${REMHOST} in + ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}") + for i in "${ADDR[@]}" ++ ssh 10.30.171.43 hostname -s Warning: Permanently added '10.30.171.43' (ED25519) to the list of known hosts. + REMHOST=releng-13633-5-1-mininet-ovs-217-0 + case ${REMHOST} in + TOOLS_SYSTEM=("${TOOLS_SYSTEM[@]}" "${i}") + echo NUM_ODL_SYSTEM=3 + echo NUM_TOOLS_SYSTEM=1 + '[' '' == yes ']' + NUM_OPENSTACK_SYSTEM=0 + echo NUM_OPENSTACK_SYSTEM=0 + '[' 0 -eq 2 ']' + echo ODL_SYSTEM_IP=10.30.171.213 ++ seq 0 2 + for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 ))) + echo ODL_SYSTEM_1_IP=10.30.171.213 + for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 ))) + echo ODL_SYSTEM_2_IP=10.30.170.177 + for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 ))) + echo ODL_SYSTEM_3_IP=10.30.170.89 + echo TOOLS_SYSTEM_IP=10.30.171.43 ++ seq 0 0 + for i in $(seq 0 $(( ${#TOOLS_SYSTEM[@]} - 1 ))) + echo TOOLS_SYSTEM_1_IP=10.30.171.43 + openstack_index=0 + NUM_OPENSTACK_CONTROL_NODES=1 + echo NUM_OPENSTACK_CONTROL_NODES=1 ++ seq 0 0 + for i in $(seq 0 $((NUM_OPENSTACK_CONTROL_NODES - 1))) + echo OPENSTACK_CONTROL_NODE_1_IP= + NUM_OPENSTACK_COMPUTE_NODES=-1 + echo NUM_OPENSTACK_COMPUTE_NODES=-1 + '[' -1 -ge 2 ']' ++ seq 0 -2 + NUM_OPENSTACK_HAPROXY_NODES=0 + echo NUM_OPENSTACK_HAPROXY_NODES=0 ++ seq 0 -1 + echo 'Contents of slave_addresses.txt:' Contents of slave_addresses.txt: + cat slave_addresses.txt NUM_ODL_SYSTEM=3 NUM_TOOLS_SYSTEM=1 NUM_OPENSTACK_SYSTEM=0 ODL_SYSTEM_IP=10.30.171.213 ODL_SYSTEM_1_IP=10.30.171.213 ODL_SYSTEM_2_IP=10.30.170.177 ODL_SYSTEM_3_IP=10.30.170.89 TOOLS_SYSTEM_IP=10.30.171.43 TOOLS_SYSTEM_1_IP=10.30.171.43 NUM_OPENSTACK_CONTROL_NODES=1 OPENSTACK_CONTROL_NODE_1_IP= NUM_OPENSTACK_COMPUTE_NODES=-1 NUM_OPENSTACK_HAPROXY_NODES=0 [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'slave_addresses.txt' [EnvInject] - Variables injected successfully. [controller-csit-3node-drb-precedence-longevity-only-chromium] $ /bin/sh /tmp/jenkins11767208034634764832.sh Preparing for JRE Version 21 Karaf artifact is karaf Karaf project is integration Java home is /usr/lib/jvm/java-21-openjdk-amd64 [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'set_variables.env' [EnvInject] - Variables injected successfully. [controller-csit-3node-drb-precedence-longevity-only-chromium] $ /bin/bash /tmp/jenkins813641127052864563.sh 2026-04-19 23:32:33 URL:https://raw.githubusercontent.com/opendaylight/integration-distribution/master/pom.xml [2619/2619] -> "pom.xml" [1] Bundle version is 0.24.0-SNAPSHOT --2026-04-19 23:32:33-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.24.0-SNAPSHOT/maven-metadata.xml Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6 Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 1410 (1.4K) [application/xml] Saving to: ‘maven-metadata.xml’ 0K . 100% 2.63G=0s 2026-04-19 23:32:33 (2.63 GB/s) - ‘maven-metadata.xml’ saved [1410/1410] org.opendaylight.integration karaf 0.24.0-SNAPSHOT 20260419.223411 344 20260419223411 pom 0.24.0-20260419.223411-344 20260419223411 tar.gz 0.24.0-20260419.223411-344 20260419223411 zip 0.24.0-20260419.223411-344 20260419223411 cyclonedx xml 0.24.0-20260419.223411-344 20260419223411 cyclonedx json 0.24.0-20260419.223411-344 20260419223411 Nexus timestamp is 0.24.0-20260419.223411-344 Distribution bundle URL is https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.24.0-SNAPSHOT/karaf-0.24.0-20260419.223411-344.zip Distribution bundle is karaf-0.24.0-20260419.223411-344.zip Distribution bundle version is 0.24.0-SNAPSHOT Distribution folder is karaf-0.24.0-SNAPSHOT Nexus prefix is https://nexus.opendaylight.org [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'detect_variables.env' [EnvInject] - Variables injected successfully. [controller-csit-3node-drb-precedence-longevity-only-chromium] $ /bin/bash -l /tmp/jenkins9573511739787752424.sh Setup pyenv: system 3.8.20 3.9.20 3.10.15 * 3.11.10 (set by /w/workspace/controller-csit-3node-drb-precedence-longevity-only-chromium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-KguD from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) lf-activate-venv(): INFO: Attempting to install with network-safe options... lf-activate-venv(): INFO: Base packages installed successfully lf-activate-venv(): INFO: Installing additional packages: python-heatclient python-openstackclient lf-activate-venv(): INFO: Adding /tmp/venv-KguD/bin to PATH Copying common-functions.sh to /tmp Copying common-functions.sh to 10.30.171.213:/tmp Warning: Permanently added '10.30.171.213' (ED25519) to the list of known hosts. Copying common-functions.sh to 10.30.170.177:/tmp Warning: Permanently added '10.30.170.177' (ED25519) to the list of known hosts. Copying common-functions.sh to 10.30.170.89:/tmp Warning: Permanently added '10.30.170.89' (ED25519) to the list of known hosts. Copying common-functions.sh to 10.30.171.43:/tmp Warning: Permanently added '10.30.171.43' (ED25519) to the list of known hosts. [controller-csit-3node-drb-precedence-longevity-only-chromium] $ /bin/bash /tmp/jenkins501229300273233223.sh common-functions.sh is being sourced common-functions environment: MAVENCONF: /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ACTUALFEATURES: FEATURESCONF: /tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg CUSTOMPROP: /tmp/karaf-0.24.0-SNAPSHOT/etc/custom.properties LOGCONF: /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg MEMCONF: /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv CONTROLLERMEM: 2048m AKKACONF: /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/pekko.conf MODULESCONF: /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/modules.conf MODULESHARDSCONF: /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/module-shards.conf SUITES: ################################################# ## Configure Cluster and Start ## ################################################# ACTUALFEATURES: odl-infrautils-ready,odl-jolokia,odl-restconf-noauth,odl-clustering-test-app SPACE_SEPARATED_FEATURES: odl-infrautils-ready odl-jolokia odl-restconf-noauth odl-clustering-test-app Locating script plan to use... Finished running script plans Configuring member-1 with IP address 10.30.171.213 Warning: Permanently added '10.30.171.213' (ED25519) to the list of known hosts. Warning: Permanently added '10.30.171.213' (ED25519) to the list of known hosts. + source /tmp/common-functions.sh karaf-0.24.0-SNAPSHOT chromium common-functions.sh is being sourced ++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]] ++ echo 'common-functions.sh is being sourced' ++ BUNDLEFOLDER=karaf-0.24.0-SNAPSHOT ++ DISTROSTREAM=chromium ++ export MAVENCONF=/tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ++ MAVENCONF=/tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ++ export FEATURESCONF=/tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg ++ FEATURESCONF=/tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg ++ export CUSTOMPROP=/tmp/karaf-0.24.0-SNAPSHOT/etc/custom.properties ++ CUSTOMPROP=/tmp/karaf-0.24.0-SNAPSHOT/etc/custom.properties ++ export LOGCONF=/tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ++ LOGCONF=/tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ++ export MEMCONF=/tmp/karaf-0.24.0-SNAPSHOT/bin/setenv ++ MEMCONF=/tmp/karaf-0.24.0-SNAPSHOT/bin/setenv ++ export CONTROLLERMEM= ++ CONTROLLERMEM= ++ case "${DISTROSTREAM}" in ++ CLUSTER_SYSTEM=pekko ++ export AKKACONF=/tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/pekko.conf ++ AKKACONF=/tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/pekko.conf ++ export MODULESCONF=/tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/modules.conf ++ MODULESCONF=/tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/modules.conf ++ export MODULESHARDSCONF=/tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/module-shards.conf ++ MODULESHARDSCONF=/tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/module-shards.conf ++ print_common_env ++ cat common-functions environment: MAVENCONF: /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ACTUALFEATURES: FEATURESCONF: /tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg CUSTOMPROP: /tmp/karaf-0.24.0-SNAPSHOT/etc/custom.properties LOGCONF: /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg MEMCONF: /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv CONTROLLERMEM: AKKACONF: /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/pekko.conf MODULESCONF: /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/modules.conf MODULESHARDSCONF: /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/module-shards.conf SUITES: ++ SSH='ssh -t -t' ++ extra_services_cntl=' dnsmasq.service httpd.service libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service rabbitmq-server.service ' ++ extra_services_cmp=' libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service ' Changing to /tmp Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.24.0-SNAPSHOT/karaf-0.24.0-20260419.223411-344.zip + echo 'Changing to /tmp' + cd /tmp + echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.24.0-SNAPSHOT/karaf-0.24.0-20260419.223411-344.zip' + wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.24.0-SNAPSHOT/karaf-0.24.0-20260419.223411-344.zip --2026-04-19 23:32:46-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.24.0-SNAPSHOT/karaf-0.24.0-20260419.223411-344.zip Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6 Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 240368550 (229M) [application/zip] Saving to: ‘karaf-0.24.0-20260419.223411-344.zip’ 0K ........ ........ ........ ........ ........ ........ 1% 59.1M 4s 3072K ........ ........ ........ ........ ........ ........ 2% 113M 3s 6144K ........ ........ ........ ........ ........ ........ 3% 145M 2s 9216K ........ ........ ........ ........ ........ ........ 5% 164M 2s 12288K ........ ........ ........ ........ ........ ........ 6% 173M 2s 15360K ........ ........ ........ ........ ........ ........ 7% 244M 2s 18432K ........ ........ ........ ........ ........ ........ 9% 243M 2s 21504K ........ ........ ........ ........ ........ ........ 10% 224M 1s 24576K ........ ........ ........ ........ ........ ........ 11% 236M 1s 27648K ........ ........ ........ ........ ........ ........ 13% 248M 1s 30720K ........ ........ ........ ........ ........ ........ 14% 283M 1s 33792K ........ ........ ........ ........ ........ ........ 15% 296M 1s 36864K ........ ........ ........ ........ ........ ........ 17% 266M 1s 39936K ........ ........ ........ ........ ........ ........ 18% 318M 1s 43008K ........ ........ ........ ........ ........ ........ 19% 327M 1s 46080K ........ ........ ........ ........ ........ ........ 20% 238M 1s 49152K ........ ........ ........ ........ ........ ........ 22% 313M 1s 52224K ........ ........ ........ ........ ........ ........ 23% 351M 1s 55296K ........ ........ ........ ........ ........ ........ 24% 352M 1s 58368K ........ ........ ........ ........ ........ ........ 26% 357M 1s 61440K ........ ........ ........ ........ ........ ........ 27% 341M 1s 64512K ........ ........ ........ ........ ........ ........ 28% 333M 1s 67584K ........ ........ ........ ........ ........ ........ 30% 342M 1s 70656K ........ ........ ........ ........ ........ ........ 31% 343M 1s 73728K ........ ........ ........ ........ ........ ........ 32% 338M 1s 76800K ........ ........ ........ ........ ........ ........ 34% 357M 1s 79872K ........ ........ ........ ........ ........ ........ 35% 349M 1s 82944K ........ ........ ........ ........ ........ ........ 36% 332M 1s 86016K ........ ........ ........ ........ ........ ........ 37% 361M 1s 89088K ........ ........ ........ ........ ........ ........ 39% 301M 1s 92160K ........ ........ ........ ........ ........ ........ 40% 295M 1s 95232K ........ ........ ........ ........ ........ ........ 41% 281M 1s 98304K ........ ........ ........ ........ ........ ........ 43% 303M 1s 101376K ........ ........ ........ ........ ........ ........ 44% 288M 1s 104448K ........ ........ ........ ........ ........ ........ 45% 249M 1s 107520K ........ ........ ........ ........ ........ ........ 47% 292M 1s 110592K ........ ........ ........ ........ ........ ........ 48% 240M 0s 113664K ........ ........ ........ ........ ........ ........ 49% 280M 0s 116736K ........ ........ ........ ........ ........ ........ 51% 281M 0s 119808K ........ ........ ........ ........ ........ ........ 52% 283M 0s 122880K ........ ........ ........ ........ ........ ........ 53% 277M 0s 125952K ........ ........ ........ ........ ........ ........ 54% 233M 0s 129024K ........ ........ ........ ........ ........ ........ 56% 246M 0s 132096K ........ ........ ........ ........ ........ ........ 57% 228M 0s 135168K ........ ........ ........ ........ ........ ........ 58% 249M 0s 138240K ........ ........ ........ ........ ........ ........ 60% 166M 0s 141312K ........ ........ ........ ........ ........ ........ 61% 207M 0s 144384K ........ ........ ........ ........ ........ ........ 62% 264M 0s 147456K ........ ........ ........ ........ ........ ........ 64% 286M 0s 150528K ........ ........ ........ ........ ........ ........ 65% 286M 0s 153600K ........ ........ ........ ........ ........ ........ 66% 295M 0s 156672K ........ ........ ........ ........ ........ ........ 68% 284M 0s 159744K ........ ........ ........ ........ ........ ........ 69% 292M 0s 162816K ........ ........ ........ ........ ........ ........ 70% 291M 0s 165888K ........ ........ ........ ........ ........ ........ 71% 292M 0s 168960K ........ ........ ........ ........ ........ ........ 73% 275M 0s 172032K ........ ........ ........ ........ ........ ........ 74% 273M 0s 175104K ........ ........ ........ ........ ........ ........ 75% 272M 0s 178176K ........ ........ ........ ........ ........ ........ 77% 271M 0s 181248K ........ ........ ........ ........ ........ ........ 78% 273M 0s 184320K ........ ........ ........ ........ ........ ........ 79% 285M 0s 187392K ........ ........ ........ ........ ........ ........ 81% 267M 0s 190464K ........ ........ ........ ........ ........ ........ 82% 276M 0s 193536K ........ ........ ........ ........ ........ ........ 83% 276M 0s 196608K ........ ........ ........ ........ ........ ........ 85% 282M 0s 199680K ........ ........ ........ ........ ........ ........ 86% 287M 0s 202752K ........ ........ ........ ........ ........ ........ 87% 284M 0s 205824K ........ ........ ........ ........ ........ ........ 88% 289M 0s 208896K ........ ........ ........ ........ ........ ........ 90% 284M 0s 211968K ........ ........ ........ ........ ........ ........ 91% 209M 0s 215040K ........ ........ ........ ........ ........ ........ 92% 158M 0s 218112K ........ ........ ........ ........ ........ ........ 94% 285M 0s 221184K ........ ........ ........ ........ ........ ........ 95% 280M 0s 224256K ........ ........ ........ ........ ........ ........ 96% 242M 0s 227328K ........ ........ ........ ........ ........ ........ 98% 342M 0s 230400K ........ ........ ........ ........ ........ ........ 99% 280M 0s 233472K ........ ........ ... 100% 295M=0.9s 2026-04-19 23:32:47 (252 MB/s) - ‘karaf-0.24.0-20260419.223411-344.zip’ saved [240368550/240368550] Extracting the new controller... + echo 'Extracting the new controller...' + unzip -q karaf-0.24.0-20260419.223411-344.zip Adding external repositories... + echo 'Adding external repositories...' + sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg + cat /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # If set to true, the following property will not allow any certificate to be used # when accessing Maven repositories through SSL # #org.ops4j.pax.url.mvn.certificateCheck= # # Path to the local Maven settings file. # The repositories defined in this file will be automatically added to the list # of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property # below is not set. # The following locations are checked for the existence of the settings.xml file # * 1. looks for the specified url # * 2. if not found looks for ${user.home}/.m2/settings.xml # * 3. if not found looks for ${maven.home}/conf/settings.xml # * 4. if not found looks for ${M2_HOME}/conf/settings.xml # #org.ops4j.pax.url.mvn.settings= # # Path to the local Maven repository which is used to avoid downloading # artifacts when they already exist locally. # The value of this property will be extracted from the settings.xml file # above, or defaulted to: # System.getProperty( "user.home" ) + "/.m2/repository" # org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository} # # Default this to false. It's just weird to use undocumented repos # org.ops4j.pax.url.mvn.useFallbackRepositories=false # # Uncomment if you don't wanna use the proxy settings # from the Maven conf/settings.xml file # # org.ops4j.pax.url.mvn.proxySupport=false # # Comma separated list of repositories scanned when resolving an artifact. # Those repositories will be checked before iterating through the # below list of repositories and even before the local repository # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snaphots # @noreleases : the repository does not contain any released artifacts # # The following property value will add the system folder as a repo. # org.ops4j.pax.url.mvn.defaultRepositories=\ file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\ file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\ file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots # Use the default local repo (e.g.~/.m2/repository) as a "remote" repo #org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false # # Comma separated list of repositories scanned when resolving an artifact. # The default list includes the following repositories: # http://repo1.maven.org/maven2@id=central # http://repository.springsource.com/maven/bundles/release@id=spring.ebr # http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external # http://zodiac.springsource.com/maven/bundles/release@id=gemini # http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases # https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases # https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases # To add repositories to the default ones, prepend '+' to the list of repositories # to add. # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snapshots # @noreleases : the repository does not contain any released artifacts # @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended # org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases ### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults. Configuring the startup features... + [[ True == \T\r\u\e ]] + echo 'Configuring the startup features...' + sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-infrautils-ready,odl-jolokia,odl-restconf-noauth,odl-clustering-test-app,/g' /tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg + FEATURE_TEST_STRING=features-test + FEATURE_TEST_VERSION=0.24.0-SNAPSHOT + KARAF_VERSION=karaf4 + [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]] + sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.24.0-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg + [[ ! -z '' ]] + cat /tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # Comma separated list of features repositories to register by default # featuresRepositories = mvn:org.opendaylight.integration/features-test/0.24.0-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/8dfc9c28-fff2-4a84-98c9-97ae1188a91b.xml # # Comma separated list of features to install at startup # featuresBoot = odl-infrautils-ready,odl-jolokia,odl-restconf-noauth,odl-clustering-test-app, c8e218d8-317f-449c-b8f7-1685ef26ef2c # # Resource repositories (OBR) that the features resolver can use # to resolve requirements/capabilities # # The format of the resourceRepositories is # resourceRepositories=[xml:url|json:url],... # for Instance: # #resourceRepositories=xml:http://host/path/to/index.xml # or #resourceRepositories=json:http://host/path/to/index.json # # # Defines if the boot features are started in asynchronous mode (in a dedicated thread) # featuresBootAsynchronous=false # # Service requirements enforcement # # By default, the feature resolver checks the service requirements/capabilities of # bundles for new features (xml schema >= 1.3.0) in order to automatically installs # the required bundles. # The following flag can have those values: # - disable: service requirements are completely ignored # - default: service requirements are ignored for old features # - enforce: service requirements are always verified # #serviceRequirements=default # # Store cfg file for config element in feature # #configCfgStore=true # # Define if the feature service automatically refresh bundles # autoRefresh=true # # Configuration of features processing mechanism (overrides, blacklisting, modification of features) # XML file defines instructions related to features processing # versions.properties may declare properties to resolve placeholders in XML file # both files are relative to ${karaf.etc} # #featureProcessing=org.apache.karaf.features.xml #featureProcessingVersions=versions.properties + configure_karaf_log karaf4 '' + local -r karaf_version=karaf4 + local -r controllerdebugmap= + local logapi=log4j + grep log4j2 /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n log4j2.rootLogger.level = INFO #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 64MB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE + logapi=log4j2 Configuring the karaf log... karaf_version: karaf4, logapi: log4j2 + echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2' + '[' log4j2 == log4j2 ']' + sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg + orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver + orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN' + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN' + unset IFS + echo 'controllerdebugmap: ' controllerdebugmap: cat /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg + '[' -n '' ']' + echo 'cat /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg' + cat /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # Common pattern layout for appenders log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n # Root logger log4j2.rootLogger.level = INFO # uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} # Filters for logs marked by org.opendaylight.odlparent.Markers log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL # Loggers configuration # Spifly logger log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN # Security audit logger log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Appenders configuration # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} # Rolling file appender log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i # uncomment to not force a disk flush #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 1GB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 # Audit file appender log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 # OSGi appender log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * # help with identification of maven-related problems with pax-url-aether #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN + set_java_vars /usr/lib/jvm/java-21-openjdk-amd64 2048m /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv + local -r java_home=/usr/lib/jvm/java-21-openjdk-amd64 + local -r controllermem=2048m + local -r memconf=/tmp/karaf-0.24.0-SNAPSHOT/bin/setenv + echo Configure Configure java home: /usr/lib/jvm/java-21-openjdk-amd64 max memory: 2048m memconf: /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv + echo ' java home: /usr/lib/jvm/java-21-openjdk-amd64' + echo ' max memory: 2048m' + echo ' memconf: /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv' + sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64}%g' /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv + sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=2048m/g' /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv cat /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv + echo 'cat /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv' + cat /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv #!/bin/sh # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # # # handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf # script: client, instance, shell, start, status, stop, karaf # # if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then # Actions go here... # fi # # general settings which should be applied for all scripts go here; please keep # in mind that it is possible that scripts might be executed more than once, e.g. # in example of the start script where the start script is executed first and the # karaf script afterwards. # # # The following section shows the possible configuration options for the default # karaf scripts # export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64} # Location of Java installation # export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration # export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options # export EXTRA_JAVA_OPTS # Additional JVM options # export KARAF_HOME # Karaf home folder # export KARAF_DATA # Karaf data folder # export KARAF_BASE # Karaf base folder # export KARAF_ETC # Karaf etc folder # export KARAF_LOG # Karaf log folder # export KARAF_SYSTEM_OPTS # First citizen Karaf options # export KARAF_OPTS # Additional available Karaf options # export KARAF_DEBUG # Enable debug mode # export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start # export KARAF_NOROOT # Prevent execution as root if set to true Set Java version + echo 'Set Java version' + sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-21-openjdk-amd64/bin/java 1 sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper sudo: a password is required + sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-21-openjdk-amd64/bin/java sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper sudo: a password is required JDK default version ... + echo 'JDK default version ...' + java -version openjdk version "21.0.10" 2026-01-20 OpenJDK Runtime Environment (build 21.0.10+7-Ubuntu-122.04) OpenJDK 64-Bit Server VM (build 21.0.10+7-Ubuntu-122.04, mixed mode, sharing) Set JAVA_HOME + echo 'Set JAVA_HOME' + export JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64 + JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64 ++ readlink -e /usr/lib/jvm/java-21-openjdk-amd64/bin/java Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java Listing all open ports on controller system... + JAVA_RESOLVED=/usr/lib/jvm/java-21-openjdk-amd64/bin/java + echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java' + echo 'Listing all open ports on controller system...' + netstat -pnatu /tmp/configuration-script.sh: line 40: netstat: command not found + '[' -f /tmp/custom_shard_config.txt ']' Configuring cluster + echo 'Configuring cluster' + /tmp/karaf-0.24.0-SNAPSHOT/bin/configure_cluster.sh 1 10.30.171.213 10.30.170.177 10.30.170.89 ################################################ ## Configure Cluster ## ################################################ NOTE: Cluster configuration files not found. Copying from /tmp/karaf-0.24.0-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/12.0.3 Configuring unique name in pekko.conf Configuring hostname in pekko.conf Configuring data and rpc seed nodes in pekko.conf modules = [ ] Configuring replication type in module-shards.conf ################################################ ## NOTE: Manually restart controller to ## ## apply configuration. ## ################################################ Dump pekko.conf + echo 'Dump pekko.conf' + cat /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/pekko.conf odl-cluster-data { pekko { remote { artery { enabled = on transport = tcp canonical.hostname = "10.30.171.213" canonical.port = 2550 } } cluster { # Using artery. seed-nodes = ["pekko://opendaylight-cluster-data@10.30.171.213:2550", "pekko://opendaylight-cluster-data@10.30.170.177:2550", "pekko://opendaylight-cluster-data@10.30.170.89:2550"] roles = ["member-1"] # when under load we might trip a false positive on the failure detector # failure-detector { # heartbeat-interval = 4 s # acceptable-heartbeat-pause = 16s # } } persistence { # By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by # modifying the following two properties. The directory location specified may be a relative or absolute path. # The relative path is always relative to KARAF_HOME. # snapshot-store.local.dir = "target/snapshots" } disable-default-actor-system-quarantined-event-handling = "false" } } Dump modules.conf + echo 'Dump modules.conf' + cat /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/modules.conf modules = [ ] Dump module-shards.conf + echo 'Dump module-shards.conf' + cat /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/module-shards.conf module-shards = [ { name = "default" shards = [ { name = "default" replicas = ["member-1", "member-2", "member-3"] } ] } ] Configuring member-2 with IP address 10.30.170.177 Warning: Permanently added '10.30.170.177' (ED25519) to the list of known hosts. Warning: Permanently added '10.30.170.177' (ED25519) to the list of known hosts. + source /tmp/common-functions.sh karaf-0.24.0-SNAPSHOT chromium common-functions.sh is being sourced ++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]] ++ echo 'common-functions.sh is being sourced' ++ BUNDLEFOLDER=karaf-0.24.0-SNAPSHOT ++ DISTROSTREAM=chromium ++ export MAVENCONF=/tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ++ MAVENCONF=/tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ++ export FEATURESCONF=/tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg ++ FEATURESCONF=/tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg ++ export CUSTOMPROP=/tmp/karaf-0.24.0-SNAPSHOT/etc/custom.properties ++ CUSTOMPROP=/tmp/karaf-0.24.0-SNAPSHOT/etc/custom.properties ++ export LOGCONF=/tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ++ LOGCONF=/tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ++ export MEMCONF=/tmp/karaf-0.24.0-SNAPSHOT/bin/setenv ++ MEMCONF=/tmp/karaf-0.24.0-SNAPSHOT/bin/setenv ++ export CONTROLLERMEM= ++ CONTROLLERMEM= ++ case "${DISTROSTREAM}" in ++ CLUSTER_SYSTEM=pekko ++ export AKKACONF=/tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/pekko.conf ++ AKKACONF=/tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/pekko.conf ++ export MODULESCONF=/tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/modules.conf ++ MODULESCONF=/tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/modules.conf ++ export MODULESHARDSCONF=/tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/module-shards.conf ++ MODULESHARDSCONF=/tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/module-shards.conf ++ print_common_env ++ cat common-functions environment: MAVENCONF: /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ACTUALFEATURES: FEATURESCONF: /tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg CUSTOMPROP: /tmp/karaf-0.24.0-SNAPSHOT/etc/custom.properties LOGCONF: /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg MEMCONF: /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv CONTROLLERMEM: AKKACONF: /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/pekko.conf MODULESCONF: /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/modules.conf MODULESHARDSCONF: /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/module-shards.conf SUITES: ++ SSH='ssh -t -t' ++ extra_services_cntl=' dnsmasq.service httpd.service libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service rabbitmq-server.service ' ++ extra_services_cmp=' libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service ' Changing to /tmp Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.24.0-SNAPSHOT/karaf-0.24.0-20260419.223411-344.zip + echo 'Changing to /tmp' + cd /tmp + echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.24.0-SNAPSHOT/karaf-0.24.0-20260419.223411-344.zip' + wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.24.0-SNAPSHOT/karaf-0.24.0-20260419.223411-344.zip --2026-04-19 23:32:50-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.24.0-SNAPSHOT/karaf-0.24.0-20260419.223411-344.zip Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6 Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 240368550 (229M) [application/zip] Saving to: ‘karaf-0.24.0-20260419.223411-344.zip’ 0K ........ ........ ........ ........ ........ ........ 1% 62.9M 4s 3072K ........ ........ ........ ........ ........ ........ 2% 93.9M 3s 6144K ........ ........ ........ ........ ........ ........ 3% 167M 2s 9216K ........ ........ ........ ........ ........ ........ 5% 184M 2s 12288K ........ ........ ........ ........ ........ ........ 6% 171M 2s 15360K ........ ........ ........ ........ ........ ........ 7% 203M 2s 18432K ........ ........ ........ ........ ........ ........ 9% 173M 2s 21504K ........ ........ ........ ........ ........ ........ 10% 206M 2s 24576K ........ ........ ........ ........ ........ ........ 11% 235M 1s 27648K ........ ........ ........ ........ ........ ........ 13% 243M 1s 30720K ........ ........ ........ ........ ........ ........ 14% 252M 1s 33792K ........ ........ ........ ........ ........ ........ 15% 240M 1s 36864K ........ ........ ........ ........ ........ ........ 17% 216M 1s 39936K ........ ........ ........ ........ ........ ........ 18% 281M 1s 43008K ........ ........ ........ ........ ........ ........ 19% 324M 1s 46080K ........ ........ ........ ........ ........ ........ 20% 305M 1s 49152K ........ ........ ........ ........ ........ ........ 22% 336M 1s 52224K ........ ........ ........ ........ ........ ........ 23% 358M 1s 55296K ........ ........ ........ ........ ........ ........ 24% 350M 1s 58368K ........ ........ ........ ........ ........ ........ 26% 368M 1s 61440K ........ ........ ........ ........ ........ ........ 27% 232M 1s 64512K ........ ........ ........ ........ ........ ........ 28% 164M 1s 67584K ........ ........ ........ ........ ........ ........ 30% 278M 1s 70656K ........ ........ ........ ........ ........ ........ 31% 224M 1s 73728K ........ ........ ........ ........ ........ ........ 32% 305M 1s 76800K ........ ........ ........ ........ ........ ........ 34% 306M 1s 79872K ........ ........ ........ ........ ........ ........ 35% 347M 1s 82944K ........ ........ ........ ........ ........ ........ 36% 265M 1s 86016K ........ ........ ........ ........ ........ ........ 37% 246M 1s 89088K ........ ........ ........ ........ ........ ........ 39% 206M 1s 92160K ........ ........ ........ ........ ........ ........ 40% 340M 1s 95232K ........ ........ ........ ........ ........ ........ 41% 380M 1s 98304K ........ ........ ........ ........ ........ ........ 43% 379M 1s 101376K ........ ........ ........ ........ ........ ........ 44% 314M 1s 104448K ........ ........ ........ ........ ........ ........ 45% 285M 1s 107520K ........ ........ ........ ........ ........ ........ 47% 267M 1s 110592K ........ ........ ........ ........ ........ ........ 48% 305M 1s 113664K ........ ........ ........ ........ ........ ........ 49% 287M 1s 116736K ........ ........ ........ ........ ........ ........ 51% 273M 0s 119808K ........ ........ ........ ........ ........ ........ 52% 276M 0s 122880K ........ ........ ........ ........ ........ ........ 53% 277M 0s 125952K ........ ........ ........ ........ ........ ........ 54% 280M 0s 129024K ........ ........ ........ ........ ........ ........ 56% 278M 0s 132096K ........ ........ ........ ........ ........ ........ 57% 282M 0s 135168K ........ ........ ........ ........ ........ ........ 58% 274M 0s 138240K ........ ........ ........ ........ ........ ........ 60% 259M 0s 141312K ........ ........ ........ ........ ........ ........ 61% 275M 0s 144384K ........ ........ ........ ........ ........ ........ 62% 257M 0s 147456K ........ ........ ........ ........ ........ ........ 64% 279M 0s 150528K ........ ........ ........ ........ ........ ........ 65% 273M 0s 153600K ........ ........ ........ ........ ........ ........ 66% 277M 0s 156672K ........ ........ ........ ........ ........ ........ 68% 271M 0s 159744K ........ ........ ........ ........ ........ ........ 69% 276M 0s 162816K ........ ........ ........ ........ ........ ........ 70% 282M 0s 165888K ........ ........ ........ ........ ........ ........ 71% 279M 0s 168960K ........ ........ ........ ........ ........ ........ 73% 280M 0s 172032K ........ ........ ........ ........ ........ ........ 74% 288M 0s 175104K ........ ........ ........ ........ ........ ........ 75% 263M 0s 178176K ........ ........ ........ ........ ........ ........ 77% 270M 0s 181248K ........ ........ ........ ........ ........ ........ 78% 271M 0s 184320K ........ ........ ........ ........ ........ ........ 79% 264M 0s 187392K ........ ........ ........ ........ ........ ........ 81% 282M 0s 190464K ........ ........ ........ ........ ........ ........ 82% 280M 0s 193536K ........ ........ ........ ........ ........ ........ 83% 157M 0s 196608K ........ ........ ........ ........ ........ ........ 85% 211M 0s 199680K ........ ........ ........ ........ ........ ........ 86% 277M 0s 202752K ........ ........ ........ ........ ........ ........ 87% 242M 0s 205824K ........ ........ ........ ........ ........ ........ 88% 171M 0s 208896K ........ ........ ........ ........ ........ ........ 90% 221M 0s 211968K ........ ........ ........ ........ ........ ........ 91% 302M 0s 215040K ........ ........ ........ ........ ........ ........ 92% 300M 0s 218112K ........ ........ ........ ........ ........ ........ 94% 275M 0s 221184K ........ ........ ........ ........ ........ ........ 95% 249M 0s 224256K ........ ........ ........ ........ ........ ........ 96% 260M 0s 227328K ........ ........ ........ ........ ........ ........ 98% 269M 0s 230400K ........ ........ ........ ........ ........ ........ 99% 261M 0s 233472K ........ ........ ... 100% 287M=0.9s 2026-04-19 23:32:51 (242 MB/s) - ‘karaf-0.24.0-20260419.223411-344.zip’ saved [240368550/240368550] Extracting the new controller... + echo 'Extracting the new controller...' + unzip -q karaf-0.24.0-20260419.223411-344.zip Adding external repositories... + echo 'Adding external repositories...' + sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg + cat /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # If set to true, the following property will not allow any certificate to be used # when accessing Maven repositories through SSL # #org.ops4j.pax.url.mvn.certificateCheck= # # Path to the local Maven settings file. # The repositories defined in this file will be automatically added to the list # of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property # below is not set. # The following locations are checked for the existence of the settings.xml file # * 1. looks for the specified url # * 2. if not found looks for ${user.home}/.m2/settings.xml # * 3. if not found looks for ${maven.home}/conf/settings.xml # * 4. if not found looks for ${M2_HOME}/conf/settings.xml # #org.ops4j.pax.url.mvn.settings= # # Path to the local Maven repository which is used to avoid downloading # artifacts when they already exist locally. # The value of this property will be extracted from the settings.xml file # above, or defaulted to: # System.getProperty( "user.home" ) + "/.m2/repository" # org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository} # # Default this to false. It's just weird to use undocumented repos # org.ops4j.pax.url.mvn.useFallbackRepositories=false # # Uncomment if you don't wanna use the proxy settings # from the Maven conf/settings.xml file # # org.ops4j.pax.url.mvn.proxySupport=false # # Comma separated list of repositories scanned when resolving an artifact. # Those repositories will be checked before iterating through the # below list of repositories and even before the local repository # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snaphots # @noreleases : the repository does not contain any released artifacts # # The following property value will add the system folder as a repo. # org.ops4j.pax.url.mvn.defaultRepositories=\ file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\ file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\ file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots # Use the default local repo (e.g.~/.m2/repository) as a "remote" repo #org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false # # Comma separated list of repositories scanned when resolving an artifact. # The default list includes the following repositories: # http://repo1.maven.org/maven2@id=central # http://repository.springsource.com/maven/bundles/release@id=spring.ebr # http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external # http://zodiac.springsource.com/maven/bundles/release@id=gemini # http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases # https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases # https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases # To add repositories to the default ones, prepend '+' to the list of repositories # to add. # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snapshots # @noreleases : the repository does not contain any released artifacts # @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended # org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases ### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults. Configuring the startup features... + [[ True == \T\r\u\e ]] + echo 'Configuring the startup features...' + sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-infrautils-ready,odl-jolokia,odl-restconf-noauth,odl-clustering-test-app,/g' /tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg + FEATURE_TEST_STRING=features-test + FEATURE_TEST_VERSION=0.24.0-SNAPSHOT + KARAF_VERSION=karaf4 + [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]] + sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.24.0-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg + [[ ! -z '' ]] + cat /tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # Comma separated list of features repositories to register by default # featuresRepositories = mvn:org.opendaylight.integration/features-test/0.24.0-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/8dfc9c28-fff2-4a84-98c9-97ae1188a91b.xml # # Comma separated list of features to install at startup # featuresBoot = odl-infrautils-ready,odl-jolokia,odl-restconf-noauth,odl-clustering-test-app, c8e218d8-317f-449c-b8f7-1685ef26ef2c # # Resource repositories (OBR) that the features resolver can use # to resolve requirements/capabilities # # The format of the resourceRepositories is # resourceRepositories=[xml:url|json:url],... # for Instance: # #resourceRepositories=xml:http://host/path/to/index.xml # or #resourceRepositories=json:http://host/path/to/index.json # # # Defines if the boot features are started in asynchronous mode (in a dedicated thread) # featuresBootAsynchronous=false # # Service requirements enforcement # # By default, the feature resolver checks the service requirements/capabilities of # bundles for new features (xml schema >= 1.3.0) in order to automatically installs # the required bundles. # The following flag can have those values: # - disable: service requirements are completely ignored # - default: service requirements are ignored for old features # - enforce: service requirements are always verified # #serviceRequirements=default # # Store cfg file for config element in feature # #configCfgStore=true # # Define if the feature service automatically refresh bundles # autoRefresh=true # # Configuration of features processing mechanism (overrides, blacklisting, modification of features) # XML file defines instructions related to features processing # versions.properties may declare properties to resolve placeholders in XML file # both files are relative to ${karaf.etc} # #featureProcessing=org.apache.karaf.features.xml #featureProcessingVersions=versions.properties + configure_karaf_log karaf4 '' + local -r karaf_version=karaf4 + local -r controllerdebugmap= + local logapi=log4j + grep log4j2 /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n log4j2.rootLogger.level = INFO #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 64MB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE Configuring the karaf log... karaf_version: karaf4, logapi: log4j2 + logapi=log4j2 + echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2' + '[' log4j2 == log4j2 ']' + sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg + orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver + orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver controllerdebugmap: cat /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN' + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN' + unset IFS + echo 'controllerdebugmap: ' + '[' -n '' ']' + echo 'cat /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg' + cat /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # Common pattern layout for appenders log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n # Root logger log4j2.rootLogger.level = INFO # uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} # Filters for logs marked by org.opendaylight.odlparent.Markers log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL # Loggers configuration # Spifly logger log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN # Security audit logger log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Appenders configuration # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} # Rolling file appender log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i # uncomment to not force a disk flush #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 1GB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 # Audit file appender log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 # OSGi appender log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * # help with identification of maven-related problems with pax-url-aether #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN Configure java home: /usr/lib/jvm/java-21-openjdk-amd64 max memory: 2048m memconf: /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv + set_java_vars /usr/lib/jvm/java-21-openjdk-amd64 2048m /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv + local -r java_home=/usr/lib/jvm/java-21-openjdk-amd64 + local -r controllermem=2048m + local -r memconf=/tmp/karaf-0.24.0-SNAPSHOT/bin/setenv + echo Configure + echo ' java home: /usr/lib/jvm/java-21-openjdk-amd64' + echo ' max memory: 2048m' + echo ' memconf: /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv' + sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64}%g' /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv + sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=2048m/g' /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv cat /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv + echo 'cat /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv' + cat /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv #!/bin/sh # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # # # handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf # script: client, instance, shell, start, status, stop, karaf # # if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then # Actions go here... # fi # # general settings which should be applied for all scripts go here; please keep # in mind that it is possible that scripts might be executed more than once, e.g. # in example of the start script where the start script is executed first and the # karaf script afterwards. # # # The following section shows the possible configuration options for the default # karaf scripts # export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64} # Location of Java installation # export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration # export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options # export EXTRA_JAVA_OPTS # Additional JVM options # export KARAF_HOME # Karaf home folder # export KARAF_DATA # Karaf data folder # export KARAF_BASE # Karaf base folder # export KARAF_ETC # Karaf etc folder # export KARAF_LOG # Karaf log folder # export KARAF_SYSTEM_OPTS # First citizen Karaf options # export KARAF_OPTS # Additional available Karaf options # export KARAF_DEBUG # Enable debug mode # export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start # export KARAF_NOROOT # Prevent execution as root if set to true Set Java version + echo 'Set Java version' + sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-21-openjdk-amd64/bin/java 1 sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper sudo: a password is required + sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-21-openjdk-amd64/bin/java sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper sudo: a password is required JDK default version ... + echo 'JDK default version ...' + java -version openjdk version "21.0.10" 2026-01-20 OpenJDK Runtime Environment (build 21.0.10+7-Ubuntu-122.04) OpenJDK 64-Bit Server VM (build 21.0.10+7-Ubuntu-122.04, mixed mode, sharing) Set JAVA_HOME + echo 'Set JAVA_HOME' + export JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64 + JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64 ++ readlink -e /usr/lib/jvm/java-21-openjdk-amd64/bin/java + JAVA_RESOLVED=/usr/lib/jvm/java-21-openjdk-amd64/bin/java Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java + echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java' Listing all open ports on controller system... + echo 'Listing all open ports on controller system...' + netstat -pnatu /tmp/configuration-script.sh: line 40: netstat: command not found Configuring cluster + '[' -f /tmp/custom_shard_config.txt ']' + echo 'Configuring cluster' + /tmp/karaf-0.24.0-SNAPSHOT/bin/configure_cluster.sh 2 10.30.171.213 10.30.170.177 10.30.170.89 ################################################ ## Configure Cluster ## ################################################ NOTE: Cluster configuration files not found. Copying from /tmp/karaf-0.24.0-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/12.0.3 Configuring unique name in pekko.conf Configuring hostname in pekko.conf Configuring data and rpc seed nodes in pekko.conf modules = [ ] Configuring replication type in module-shards.conf ################################################ ## NOTE: Manually restart controller to ## ## apply configuration. ## ################################################ Dump pekko.conf + echo 'Dump pekko.conf' + cat /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/pekko.conf odl-cluster-data { pekko { remote { artery { enabled = on transport = tcp canonical.hostname = "10.30.170.177" canonical.port = 2550 } } cluster { # Using artery. seed-nodes = ["pekko://opendaylight-cluster-data@10.30.171.213:2550", "pekko://opendaylight-cluster-data@10.30.170.177:2550", "pekko://opendaylight-cluster-data@10.30.170.89:2550"] roles = ["member-2"] # when under load we might trip a false positive on the failure detector # failure-detector { # heartbeat-interval = 4 s # acceptable-heartbeat-pause = 16s # } } persistence { # By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by # modifying the following two properties. The directory location specified may be a relative or absolute path. # The relative path is always relative to KARAF_HOME. # snapshot-store.local.dir = "target/snapshots" } disable-default-actor-system-quarantined-event-handling = "false" } } Dump modules.conf + echo 'Dump modules.conf' + cat /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/modules.conf modules = [ ] Dump module-shards.conf + echo 'Dump module-shards.conf' + cat /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/module-shards.conf module-shards = [ { name = "default" shards = [ { name = "default" replicas = ["member-1", "member-2", "member-3"] } ] } ] Configuring member-3 with IP address 10.30.170.89 Warning: Permanently added '10.30.170.89' (ED25519) to the list of known hosts. Warning: Permanently added '10.30.170.89' (ED25519) to the list of known hosts. + source /tmp/common-functions.sh karaf-0.24.0-SNAPSHOT chromium ++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]] common-functions.sh is being sourced ++ echo 'common-functions.sh is being sourced' ++ BUNDLEFOLDER=karaf-0.24.0-SNAPSHOT ++ DISTROSTREAM=chromium ++ export MAVENCONF=/tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ++ MAVENCONF=/tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ++ export FEATURESCONF=/tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg ++ FEATURESCONF=/tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg ++ export CUSTOMPROP=/tmp/karaf-0.24.0-SNAPSHOT/etc/custom.properties ++ CUSTOMPROP=/tmp/karaf-0.24.0-SNAPSHOT/etc/custom.properties ++ export LOGCONF=/tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ++ LOGCONF=/tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ++ export MEMCONF=/tmp/karaf-0.24.0-SNAPSHOT/bin/setenv ++ MEMCONF=/tmp/karaf-0.24.0-SNAPSHOT/bin/setenv ++ export CONTROLLERMEM= ++ CONTROLLERMEM= ++ case "${DISTROSTREAM}" in ++ CLUSTER_SYSTEM=pekko ++ export AKKACONF=/tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/pekko.conf ++ AKKACONF=/tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/pekko.conf ++ export MODULESCONF=/tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/modules.conf ++ MODULESCONF=/tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/modules.conf ++ export MODULESHARDSCONF=/tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/module-shards.conf ++ MODULESHARDSCONF=/tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/module-shards.conf ++ print_common_env ++ cat common-functions environment: MAVENCONF: /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ACTUALFEATURES: FEATURESCONF: /tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg CUSTOMPROP: /tmp/karaf-0.24.0-SNAPSHOT/etc/custom.properties LOGCONF: /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg MEMCONF: /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv CONTROLLERMEM: AKKACONF: /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/pekko.conf MODULESCONF: /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/modules.conf MODULESHARDSCONF: /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/module-shards.conf SUITES: ++ SSH='ssh -t -t' ++ extra_services_cntl=' dnsmasq.service httpd.service libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service rabbitmq-server.service ' ++ extra_services_cmp=' libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service ' Changing to /tmp Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.24.0-SNAPSHOT/karaf-0.24.0-20260419.223411-344.zip + echo 'Changing to /tmp' + cd /tmp + echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.24.0-SNAPSHOT/karaf-0.24.0-20260419.223411-344.zip' + wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.24.0-SNAPSHOT/karaf-0.24.0-20260419.223411-344.zip --2026-04-19 23:32:54-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.24.0-SNAPSHOT/karaf-0.24.0-20260419.223411-344.zip Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6 Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 240368550 (229M) [application/zip] Saving to: ‘karaf-0.24.0-20260419.223411-344.zip’ 0K ........ ........ ........ ........ ........ ........ 1% 69.0M 3s 3072K ........ ........ ........ ........ ........ ........ 2% 118M 3s 6144K ........ ........ ........ ........ ........ ........ 3% 174M 2s 9216K ........ ........ ........ ........ ........ ........ 5% 193M 2s 12288K ........ ........ ........ ........ ........ ........ 6% 162M 2s 15360K ........ ........ ........ ........ ........ ........ 7% 191M 2s 18432K ........ ........ ........ ........ ........ ........ 9% 237M 1s 21504K ........ ........ ........ ........ ........ ........ 10% 255M 1s 24576K ........ ........ ........ ........ ........ ........ 11% 260M 1s 27648K ........ ........ ........ ........ ........ ........ 13% 236M 1s 30720K ........ ........ ........ ........ ........ ........ 14% 323M 1s 33792K ........ ........ ........ ........ ........ ........ 15% 304M 1s 36864K ........ ........ ........ ........ ........ ........ 17% 319M 1s 39936K ........ ........ ........ ........ ........ ........ 18% 327M 1s 43008K ........ ........ ........ ........ ........ ........ 19% 408M 1s 46080K ........ ........ ........ ........ ........ ........ 20% 350M 1s 49152K ........ ........ ........ ........ ........ ........ 22% 329M 1s 52224K ........ ........ ........ ........ ........ ........ 23% 327M 1s 55296K ........ ........ ........ ........ ........ ........ 24% 335M 1s 58368K ........ ........ ........ ........ ........ ........ 26% 409M 1s 61440K ........ ........ ........ ........ ........ ........ 27% 399M 1s 64512K ........ ........ ........ ........ ........ ........ 28% 293M 1s 67584K ........ ........ ........ ........ ........ ........ 30% 319M 1s 70656K ........ ........ ........ ........ ........ ........ 31% 357M 1s 73728K ........ ........ ........ ........ ........ ........ 32% 267M 1s 76800K ........ ........ ........ ........ ........ ........ 34% 358M 1s 79872K ........ ........ ........ ........ ........ ........ 35% 470M 1s 82944K ........ ........ ........ ........ ........ ........ 36% 202M 1s 86016K ........ ........ ........ ........ ........ ........ 37% 307M 1s 89088K ........ ........ ........ ........ ........ ........ 39% 374M 1s 92160K ........ ........ ........ ........ ........ ........ 40% 385M 1s 95232K ........ ........ ........ ........ ........ ........ 41% 389M 1s 98304K ........ ........ ........ ........ ........ ........ 43% 392M 1s 101376K ........ ........ ........ ........ ........ ........ 44% 376M 0s 104448K ........ ........ ........ ........ ........ ........ 45% 384M 0s 107520K ........ ........ ........ ........ ........ ........ 47% 395M 0s 110592K ........ ........ ........ ........ ........ ........ 48% 372M 0s 113664K ........ ........ ........ ........ ........ ........ 49% 213M 0s 116736K ........ ........ ........ ........ ........ ........ 51% 331M 0s 119808K ........ ........ ........ ........ ........ ........ 52% 399M 0s 122880K ........ ........ ........ ........ ........ ........ 53% 329M 0s 125952K ........ ........ ........ ........ ........ ........ 54% 293M 0s 129024K ........ ........ ........ ........ ........ ........ 56% 315M 0s 132096K ........ ........ ........ ........ ........ ........ 57% 387M 0s 135168K ........ ........ ........ ........ ........ ........ 58% 387M 0s 138240K ........ ........ ........ ........ ........ ........ 60% 386M 0s 141312K ........ ........ ........ ........ ........ ........ 61% 367M 0s 144384K ........ ........ ........ ........ ........ ........ 62% 336M 0s 147456K ........ ........ ........ ........ ........ ........ 64% 343M 0s 150528K ........ ........ ........ ........ ........ ........ 65% 348M 0s 153600K ........ ........ ........ ........ ........ ........ 66% 287M 0s 156672K ........ ........ ........ ........ ........ ........ 68% 284M 0s 159744K ........ ........ ........ ........ ........ ........ 69% 263M 0s 162816K ........ ........ ........ ........ ........ ........ 70% 281M 0s 165888K ........ ........ ........ ........ ........ ........ 71% 311M 0s 168960K ........ ........ ........ ........ ........ ........ 73% 380M 0s 172032K ........ ........ ........ ........ ........ ........ 74% 382M 0s 175104K ........ ........ ........ ........ ........ ........ 75% 372M 0s 178176K ........ ........ ........ ........ ........ ........ 77% 357M 0s 181248K ........ ........ ........ ........ ........ ........ 78% 372M 0s 184320K ........ ........ ........ ........ ........ ........ 79% 366M 0s 187392K ........ ........ ........ ........ ........ ........ 81% 373M 0s 190464K ........ ........ ........ ........ ........ ........ 82% 358M 0s 193536K ........ ........ ........ ........ ........ ........ 83% 369M 0s 196608K ........ ........ ........ ........ ........ ........ 85% 357M 0s 199680K ........ ........ ........ ........ ........ ........ 86% 370M 0s 202752K ........ ........ ........ ........ ........ ........ 87% 360M 0s 205824K ........ ........ ........ ........ ........ ........ 88% 354M 0s 208896K ........ ........ ........ ........ ........ ........ 90% 366M 0s 211968K ........ ........ ........ ........ ........ ........ 91% 360M 0s 215040K ........ ........ ........ ........ ........ ........ 92% 356M 0s 218112K ........ ........ ........ ........ ........ ........ 94% 341M 0s 221184K ........ ........ ........ ........ ........ ........ 95% 119M 0s 224256K ........ ........ ........ ........ ........ ........ 96% 166M 0s 227328K ........ ........ ........ ........ ........ ........ 98% 284M 0s 230400K ........ ........ ........ ........ ........ ........ 99% 364M 0s 233472K ........ ........ ... 100% 328M=0.8s 2026-04-19 23:32:55 (287 MB/s) - ‘karaf-0.24.0-20260419.223411-344.zip’ saved [240368550/240368550] Extracting the new controller... + echo 'Extracting the new controller...' + unzip -q karaf-0.24.0-20260419.223411-344.zip Adding external repositories... + echo 'Adding external repositories...' + sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg + cat /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # If set to true, the following property will not allow any certificate to be used # when accessing Maven repositories through SSL # #org.ops4j.pax.url.mvn.certificateCheck= # # Path to the local Maven settings file. # The repositories defined in this file will be automatically added to the list # of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property # below is not set. # The following locations are checked for the existence of the settings.xml file # * 1. looks for the specified url # * 2. if not found looks for ${user.home}/.m2/settings.xml # * 3. if not found looks for ${maven.home}/conf/settings.xml # * 4. if not found looks for ${M2_HOME}/conf/settings.xml # #org.ops4j.pax.url.mvn.settings= # # Path to the local Maven repository which is used to avoid downloading # artifacts when they already exist locally. # The value of this property will be extracted from the settings.xml file # above, or defaulted to: # System.getProperty( "user.home" ) + "/.m2/repository" # org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository} # # Default this to false. It's just weird to use undocumented repos # org.ops4j.pax.url.mvn.useFallbackRepositories=false # # Uncomment if you don't wanna use the proxy settings # from the Maven conf/settings.xml file # # org.ops4j.pax.url.mvn.proxySupport=false # # Comma separated list of repositories scanned when resolving an artifact. # Those repositories will be checked before iterating through the # below list of repositories and even before the local repository # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snaphots # @noreleases : the repository does not contain any released artifacts # # The following property value will add the system folder as a repo. # org.ops4j.pax.url.mvn.defaultRepositories=\ file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\ file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\ file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots # Use the default local repo (e.g.~/.m2/repository) as a "remote" repo #org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false # # Comma separated list of repositories scanned when resolving an artifact. # The default list includes the following repositories: # http://repo1.maven.org/maven2@id=central # http://repository.springsource.com/maven/bundles/release@id=spring.ebr # http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external # http://zodiac.springsource.com/maven/bundles/release@id=gemini # http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases # https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases # https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases # To add repositories to the default ones, prepend '+' to the list of repositories # to add. # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snapshots # @noreleases : the repository does not contain any released artifacts # @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended # org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases ### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults. Configuring the startup features... + [[ True == \T\r\u\e ]] + echo 'Configuring the startup features...' + sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-infrautils-ready,odl-jolokia,odl-restconf-noauth,odl-clustering-test-app,/g' /tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg + FEATURE_TEST_STRING=features-test + FEATURE_TEST_VERSION=0.24.0-SNAPSHOT + KARAF_VERSION=karaf4 + [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]] + sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.24.0-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg + [[ ! -z '' ]] + cat /tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # Comma separated list of features repositories to register by default # featuresRepositories = mvn:org.opendaylight.integration/features-test/0.24.0-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/8dfc9c28-fff2-4a84-98c9-97ae1188a91b.xml # # Comma separated list of features to install at startup # featuresBoot = odl-infrautils-ready,odl-jolokia,odl-restconf-noauth,odl-clustering-test-app, c8e218d8-317f-449c-b8f7-1685ef26ef2c # # Resource repositories (OBR) that the features resolver can use # to resolve requirements/capabilities # # The format of the resourceRepositories is # resourceRepositories=[xml:url|json:url],... # for Instance: # #resourceRepositories=xml:http://host/path/to/index.xml # or #resourceRepositories=json:http://host/path/to/index.json # # # Defines if the boot features are started in asynchronous mode (in a dedicated thread) # featuresBootAsynchronous=false # # Service requirements enforcement # # By default, the feature resolver checks the service requirements/capabilities of # bundles for new features (xml schema >= 1.3.0) in order to automatically installs # the required bundles. # The following flag can have those values: # - disable: service requirements are completely ignored # - default: service requirements are ignored for old features # - enforce: service requirements are always verified # #serviceRequirements=default # # Store cfg file for config element in feature # #configCfgStore=true # # Define if the feature service automatically refresh bundles # autoRefresh=true # # Configuration of features processing mechanism (overrides, blacklisting, modification of features) # XML file defines instructions related to features processing # versions.properties may declare properties to resolve placeholders in XML file # both files are relative to ${karaf.etc} # #featureProcessing=org.apache.karaf.features.xml #featureProcessingVersions=versions.properties + configure_karaf_log karaf4 '' + local -r karaf_version=karaf4 + local -r controllerdebugmap= + local logapi=log4j + grep log4j2 /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n log4j2.rootLogger.level = INFO #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 64MB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE + logapi=log4j2 + echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2' Configuring the karaf log... karaf_version: karaf4, logapi: log4j2 + '[' log4j2 == log4j2 ']' + sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg controllerdebugmap: + orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver + orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN' + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN' + unset IFS + echo 'controllerdebugmap: ' + '[' -n '' ']' cat /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg + echo 'cat /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg' + cat /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # Common pattern layout for appenders log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n # Root logger log4j2.rootLogger.level = INFO # uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} # Filters for logs marked by org.opendaylight.odlparent.Markers log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL # Loggers configuration # Spifly logger log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN # Security audit logger log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Appenders configuration # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} # Rolling file appender log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i # uncomment to not force a disk flush #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 1GB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 # Audit file appender log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 # OSGi appender log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * # help with identification of maven-related problems with pax-url-aether #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN + set_java_vars /usr/lib/jvm/java-21-openjdk-amd64 2048m /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv Configure java home: /usr/lib/jvm/java-21-openjdk-amd64 max memory: 2048m memconf: /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv + local -r java_home=/usr/lib/jvm/java-21-openjdk-amd64 + local -r controllermem=2048m + local -r memconf=/tmp/karaf-0.24.0-SNAPSHOT/bin/setenv + echo Configure + echo ' java home: /usr/lib/jvm/java-21-openjdk-amd64' + echo ' max memory: 2048m' + echo ' memconf: /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv' + sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64}%g' /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv + sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=2048m/g' /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv cat /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv + echo 'cat /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv' + cat /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv #!/bin/sh # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # # # handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf # script: client, instance, shell, start, status, stop, karaf # # if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then # Actions go here... # fi # # general settings which should be applied for all scripts go here; please keep # in mind that it is possible that scripts might be executed more than once, e.g. # in example of the start script where the start script is executed first and the # karaf script afterwards. # # # The following section shows the possible configuration options for the default # karaf scripts # export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64} # Location of Java installation # export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration # export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options # export EXTRA_JAVA_OPTS # Additional JVM options # export KARAF_HOME # Karaf home folder # export KARAF_DATA # Karaf data folder # export KARAF_BASE # Karaf base folder # export KARAF_ETC # Karaf etc folder # export KARAF_LOG # Karaf log folder # export KARAF_SYSTEM_OPTS # First citizen Karaf options # export KARAF_OPTS # Additional available Karaf options # export KARAF_DEBUG # Enable debug mode # export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start # export KARAF_NOROOT # Prevent execution as root if set to true Set Java version + echo 'Set Java version' + sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-21-openjdk-amd64/bin/java 1 sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper sudo: a password is required + sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-21-openjdk-amd64/bin/java sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper sudo: a password is required JDK default version ... + echo 'JDK default version ...' + java -version openjdk version "21.0.10" 2026-01-20 OpenJDK Runtime Environment (build 21.0.10+7-Ubuntu-122.04) OpenJDK 64-Bit Server VM (build 21.0.10+7-Ubuntu-122.04, mixed mode, sharing) Set JAVA_HOME + echo 'Set JAVA_HOME' + export JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64 + JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64 ++ readlink -e /usr/lib/jvm/java-21-openjdk-amd64/bin/java Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java + JAVA_RESOLVED=/usr/lib/jvm/java-21-openjdk-amd64/bin/java + echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java' Listing all open ports on controller system... + echo 'Listing all open ports on controller system...' + netstat -pnatu /tmp/configuration-script.sh: line 40: netstat: command not found Configuring cluster + '[' -f /tmp/custom_shard_config.txt ']' + echo 'Configuring cluster' + /tmp/karaf-0.24.0-SNAPSHOT/bin/configure_cluster.sh 3 10.30.171.213 10.30.170.177 10.30.170.89 ################################################ ## Configure Cluster ## ################################################ NOTE: Cluster configuration files not found. Copying from /tmp/karaf-0.24.0-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/12.0.3 Configuring unique name in pekko.conf Configuring hostname in pekko.conf Configuring data and rpc seed nodes in pekko.conf modules = [ ] Configuring replication type in module-shards.conf ################################################ ## NOTE: Manually restart controller to ## ## apply configuration. ## ################################################ Dump pekko.conf + echo 'Dump pekko.conf' + cat /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/pekko.conf odl-cluster-data { pekko { remote { artery { enabled = on transport = tcp canonical.hostname = "10.30.170.89" canonical.port = 2550 } } cluster { # Using artery. seed-nodes = ["pekko://opendaylight-cluster-data@10.30.171.213:2550", "pekko://opendaylight-cluster-data@10.30.170.177:2550", "pekko://opendaylight-cluster-data@10.30.170.89:2550"] roles = ["member-3"] # when under load we might trip a false positive on the failure detector # failure-detector { # heartbeat-interval = 4 s # acceptable-heartbeat-pause = 16s # } } persistence { # By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by # modifying the following two properties. The directory location specified may be a relative or absolute path. # The relative path is always relative to KARAF_HOME. # snapshot-store.local.dir = "target/snapshots" } disable-default-actor-system-quarantined-event-handling = "false" } } Dump modules.conf + echo 'Dump modules.conf' + cat /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/modules.conf modules = [ ] Dump module-shards.conf + echo 'Dump module-shards.conf' + cat /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/module-shards.conf module-shards = [ { name = "default" shards = [ { name = "default" replicas = ["member-1", "member-2", "member-3"] } ] } ] Locating config plan to use... Finished running config plans Starting member-1 with IP address 10.30.171.213 Warning: Permanently added '10.30.171.213' (ED25519) to the list of known hosts. Warning: Permanently added '10.30.171.213' (ED25519) to the list of known hosts. Redirecting karaf console output to karaf_console.log Starting controller... start: Redirecting Karaf output to /tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf_console.log Starting member-2 with IP address 10.30.170.177 Warning: Permanently added '10.30.170.177' (ED25519) to the list of known hosts. Warning: Permanently added '10.30.170.177' (ED25519) to the list of known hosts. Redirecting karaf console output to karaf_console.log Starting controller... start: Redirecting Karaf output to /tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf_console.log Starting member-3 with IP address 10.30.170.89 Warning: Permanently added '10.30.170.89' (ED25519) to the list of known hosts. Warning: Permanently added '10.30.170.89' (ED25519) to the list of known hosts. Redirecting karaf console output to karaf_console.log Starting controller... start: Redirecting Karaf output to /tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf_console.log [controller-csit-3node-drb-precedence-longevity-only-chromium] $ /bin/bash /tmp/jenkins6214709985055725243.sh common-functions.sh is being sourced common-functions environment: MAVENCONF: /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ACTUALFEATURES: FEATURESCONF: /tmp/karaf-0.24.0-SNAPSHOT/etc/org.apache.karaf.features.cfg CUSTOMPROP: /tmp/karaf-0.24.0-SNAPSHOT/etc/custom.properties LOGCONF: /tmp/karaf-0.24.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg MEMCONF: /tmp/karaf-0.24.0-SNAPSHOT/bin/setenv CONTROLLERMEM: 2048m AKKACONF: /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/pekko.conf MODULESCONF: /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/modules.conf MODULESHARDSCONF: /tmp/karaf-0.24.0-SNAPSHOT/configuration/initial/module-shards.conf SUITES: + echo '#################################################' ################################################# + echo '## Verify Cluster is UP ##' ## Verify Cluster is UP ## + echo '#################################################' ################################################# + create_post_startup_script + cat + copy_and_run_post_startup_script + seed_index=1 ++ seq 1 3 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_1_IP + echo 'Execute the post startup script on controller 10.30.171.213' Execute the post startup script on controller 10.30.171.213 + scp /w/workspace/controller-csit-3node-drb-precedence-longevity-only-chromium/post-startup-script.sh 10.30.171.213:/tmp/ Warning: Permanently added '10.30.171.213' (ED25519) to the list of known hosts. + ssh 10.30.171.213 'bash /tmp/post-startup-script.sh 1' Warning: Permanently added '10.30.171.213' (ED25519) to the list of known hosts. /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found Waiting up to 3 minutes for controller to come up, checking every 5 seconds... 2026-04-19T23:33:30,410 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 154 - org.opendaylight.infrautils.ready-api - 7.1.9 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Controller is UP 2026-04-19T23:33:30,410 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 154 - org.opendaylight.infrautils.ready-api - 7.1.9 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Listing all open ports on controller system... /tmp/post-startup-script.sh: line 51: netstat: command not found looking for "BindException: Address already in use" in log file looking for "server is unhealthy" in log file + '[' 1 == 0 ']' + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_2_IP + echo 'Execute the post startup script on controller 10.30.170.177' Execute the post startup script on controller 10.30.170.177 + scp /w/workspace/controller-csit-3node-drb-precedence-longevity-only-chromium/post-startup-script.sh 10.30.170.177:/tmp/ Warning: Permanently added '10.30.170.177' (ED25519) to the list of known hosts. + ssh 10.30.170.177 'bash /tmp/post-startup-script.sh 2' Warning: Permanently added '10.30.170.177' (ED25519) to the list of known hosts. /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found Waiting up to 3 minutes for controller to come up, checking every 5 seconds... 2026-04-19T23:33:07,764 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 154 - org.opendaylight.infrautils.ready-api - 7.1.9 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Controller is UP 2026-04-19T23:33:07,764 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 154 - org.opendaylight.infrautils.ready-api - 7.1.9 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Listing all open ports on controller system... /tmp/post-startup-script.sh: line 51: netstat: command not found looking for "BindException: Address already in use" in log file looking for "server is unhealthy" in log file + '[' 2 == 0 ']' + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_3_IP + echo 'Execute the post startup script on controller 10.30.170.89' Execute the post startup script on controller 10.30.170.89 + scp /w/workspace/controller-csit-3node-drb-precedence-longevity-only-chromium/post-startup-script.sh 10.30.170.89:/tmp/ Warning: Permanently added '10.30.170.89' (ED25519) to the list of known hosts. + ssh 10.30.170.89 'bash /tmp/post-startup-script.sh 3' Warning: Permanently added '10.30.170.89' (ED25519) to the list of known hosts. /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found Waiting up to 3 minutes for controller to come up, checking every 5 seconds... 2026-04-19T23:33:29,674 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 154 - org.opendaylight.infrautils.ready-api - 7.1.9 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Controller is UP 2026-04-19T23:33:29,674 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 154 - org.opendaylight.infrautils.ready-api - 7.1.9 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Listing all open ports on controller system... /tmp/post-startup-script.sh: line 51: netstat: command not found looking for "BindException: Address already in use" in log file looking for "server is unhealthy" in log file + '[' 0 == 0 ']' + seed_index=1 + dump_controller_threads ++ seq 1 3 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_1_IP + echo 'Let'\''s take the karaf thread dump' Let's take the karaf thread dump + ssh 10.30.171.213 'sudo ps aux' Warning: Permanently added '10.30.171.213' (ED25519) to the list of known hosts. ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-drb-precedence-longevity-only-chromium/ps_before.log ++ grep -v grep ++ tr -s ' ' ++ cut -f2 '-d ' + pid=2030 + echo 'karaf main: org.apache.karaf.main.Main, pid:2030' karaf main: org.apache.karaf.main.Main, pid:2030 + ssh 10.30.171.213 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 2030' Warning: Permanently added '10.30.171.213' (ED25519) to the list of known hosts. + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_2_IP + echo 'Let'\''s take the karaf thread dump' Let's take the karaf thread dump + ssh 10.30.170.177 'sudo ps aux' Warning: Permanently added '10.30.170.177' (ED25519) to the list of known hosts. ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-drb-precedence-longevity-only-chromium/ps_before.log ++ grep -v grep ++ tr -s ' ' ++ cut -f2 '-d ' + pid=2026 + echo 'karaf main: org.apache.karaf.main.Main, pid:2026' karaf main: org.apache.karaf.main.Main, pid:2026 + ssh 10.30.170.177 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 2026' Warning: Permanently added '10.30.170.177' (ED25519) to the list of known hosts. + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_3_IP + echo 'Let'\''s take the karaf thread dump' Let's take the karaf thread dump + ssh 10.30.170.89 'sudo ps aux' Warning: Permanently added '10.30.170.89' (ED25519) to the list of known hosts. ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-drb-precedence-longevity-only-chromium/ps_before.log ++ grep -v grep ++ cut -f2 '-d ' ++ tr -s ' ' + pid=2029 + echo 'karaf main: org.apache.karaf.main.Main, pid:2029' karaf main: org.apache.karaf.main.Main, pid:2029 + ssh 10.30.170.89 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 2029' Warning: Permanently added '10.30.170.89' (ED25519) to the list of known hosts. + '[' 0 -gt 0 ']' + echo 'Generating controller variables...' Generating controller variables... ++ seq 1 3 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_1_IP + odl_variables=' -v ODL_SYSTEM_1_IP:10.30.171.213' + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_2_IP + odl_variables=' -v ODL_SYSTEM_1_IP:10.30.171.213 -v ODL_SYSTEM_2_IP:10.30.170.177' + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_3_IP + odl_variables=' -v ODL_SYSTEM_1_IP:10.30.171.213 -v ODL_SYSTEM_2_IP:10.30.170.177 -v ODL_SYSTEM_3_IP:10.30.170.89' + echo 'Generating mininet variables...' Generating mininet variables... ++ seq 1 1 + for i in $(seq 1 "${NUM_TOOLS_SYSTEM}") + MININETIP=TOOLS_SYSTEM_1_IP + tools_variables=' -v TOOLS_SYSTEM_1_IP:10.30.171.43' + get_test_suites SUITES + local __suite_list=SUITES + echo 'Locating test plan to use...' Locating test plan to use... + testplan_filepath=/w/workspace/controller-csit-3node-drb-precedence-longevity-only-chromium/test/csit/testplans/controller-drb-precedence-longevity-chromium.txt + '[' '!' -f /w/workspace/controller-csit-3node-drb-precedence-longevity-only-chromium/test/csit/testplans/controller-drb-precedence-longevity-chromium.txt ']' + testplan_filepath=/w/workspace/controller-csit-3node-drb-precedence-longevity-only-chromium/test/csit/testplans/controller-drb-precedence-longevity.txt + '[' disabled '!=' disabled ']' + echo 'Changing the testplan path...' Changing the testplan path... + sed s:integration:/w/workspace/controller-csit-3node-drb-precedence-longevity-only-chromium: /w/workspace/controller-csit-3node-drb-precedence-longevity-only-chromium/test/csit/testplans/controller-drb-precedence-longevity.txt + cat testplan.txt # Copyright (c) 2017 Cisco Systems, Inc. and others. All rights reserved. # # This program and the accompanying materials are made available under the # terms of the Eclipse Public License v1.0 which accompanies this distribution, # and is available at http://www.eclipse.org/legal/epl-v10.html # Place the suites in run order: /w/workspace/controller-csit-3node-drb-precedence-longevity-only-chromium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence_longevity.robot + '[' -z '' ']' ++ grep -E -v '(^[[:space:]]*#|^[[:space:]]*$)' testplan.txt ++ tr '\012' ' ' + suite_list='/w/workspace/controller-csit-3node-drb-precedence-longevity-only-chromium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence_longevity.robot ' + eval 'SUITES='\''/w/workspace/controller-csit-3node-drb-precedence-longevity-only-chromium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence_longevity.robot '\''' ++ SUITES='/w/workspace/controller-csit-3node-drb-precedence-longevity-only-chromium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence_longevity.robot ' + echo 'Starting Robot test suites /w/workspace/controller-csit-3node-drb-precedence-longevity-only-chromium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence_longevity.robot ...' Starting Robot test suites /w/workspace/controller-csit-3node-drb-precedence-longevity-only-chromium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence_longevity.robot ... + robot -N controller-drb-precedence-longevity.txt --removekeywords wuks -e exclude -e skip_if_chromium -v BUNDLEFOLDER:karaf-0.24.0-SNAPSHOT -v BUNDLE_URL:https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.24.0-SNAPSHOT/karaf-0.24.0-20260419.223411-344.zip -v CONTROLLER:10.30.171.213 -v CONTROLLER1:10.30.170.177 -v CONTROLLER2:10.30.170.89 -v CONTROLLER_USER:jenkins -v JAVA_HOME:/usr/lib/jvm/java-21-openjdk-amd64 -v JDKVERSION:openjdk21 -v JENKINS_WORKSPACE:/w/workspace/controller-csit-3node-drb-precedence-longevity-only-chromium -v MININET:10.30.171.43 -v MININET1: -v MININET2: -v MININET_USER:jenkins -v NEXUSURL_PREFIX:https://nexus.opendaylight.org -v NUM_ODL_SYSTEM:3 -v NUM_TOOLS_SYSTEM:1 -v ODL_STREAM:chromium -v ODL_SYSTEM_IP:10.30.171.213 -v ODL_SYSTEM_1_IP:10.30.171.213 -v ODL_SYSTEM_2_IP:10.30.170.177 -v ODL_SYSTEM_3_IP:10.30.170.89 -v ODL_SYSTEM_USER:jenkins -v TOOLS_SYSTEM_IP:10.30.171.43 -v TOOLS_SYSTEM_1_IP:10.30.171.43 -v TOOLS_SYSTEM_USER:jenkins -v USER_HOME:/home/jenkins -v IS_KARAF_APPL:True -v WORKSPACE:/tmp /w/workspace/controller-csit-3node-drb-precedence-longevity-only-chromium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence_longevity.robot ============================================================================== controller-drb-precedence-longevity.txt :: DOMRpcBroker testing: RPC Provid... ============================================================================== Rpc_Provider_Precedence_Longevity :: Repeat the tested scenario fo... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_drb_precedence_longevity_txt_rpc_provider_precedence_longevity" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_drb_precedence_longevity_txt_rpc_provider_precedence_longevity&order=bug_status" HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.213:8181/rests/operations/odl-mdsal-lowlevel-control:register-constant ------------------------------------------------------------------------------ controller-drb-precedence-longevity.txt :: DOMRpcBroker testing: R... | FAIL | 1 test, 0 passed, 1 failed ============================================================================== Output: /w/workspace/controller-csit-3node-drb-precedence-longevity-only-chromium/output.xml Log: /w/workspace/controller-csit-3node-drb-precedence-longevity-only-chromium/log.html Report: /w/workspace/controller-csit-3node-drb-precedence-longevity-only-chromium/report.html + true + echo 'Examining the files in data/log and checking filesize' Examining the files in data/log and checking filesize + ssh 10.30.171.213 'ls -altr /tmp/karaf-0.24.0-SNAPSHOT/data/log/' Warning: Permanently added '10.30.171.213' (ED25519) to the list of known hosts. total 208 drwxrwxr-x 2 jenkins jenkins 4096 Apr 19 23:32 . -rw-rw-r-- 1 jenkins jenkins 1720 Apr 19 23:33 karaf_console.log drwxrwxr-x 9 jenkins jenkins 4096 Apr 19 23:33 .. -rw-rw-r-- 1 jenkins jenkins 197794 Apr 19 23:36 karaf.log + ssh 10.30.171.213 'du -hs /tmp/karaf-0.24.0-SNAPSHOT/data/log/*' Warning: Permanently added '10.30.171.213' (ED25519) to the list of known hosts. 196K /tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf.log 4.0K /tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf_console.log + ssh 10.30.170.177 'ls -altr /tmp/karaf-0.24.0-SNAPSHOT/data/log/' Warning: Permanently added '10.30.170.177' (ED25519) to the list of known hosts. total 212 drwxrwxr-x 2 jenkins jenkins 4096 Apr 19 23:33 . -rw-rw-r-- 1 jenkins jenkins 1720 Apr 19 23:33 karaf_console.log drwxrwxr-x 9 jenkins jenkins 4096 Apr 19 23:33 .. -rw-rw-r-- 1 jenkins jenkins 204103 Apr 19 23:36 karaf.log + ssh 10.30.170.177 'du -hs /tmp/karaf-0.24.0-SNAPSHOT/data/log/*' Warning: Permanently added '10.30.170.177' (ED25519) to the list of known hosts. 200K /tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf.log 4.0K /tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf_console.log + ssh 10.30.170.89 'ls -altr /tmp/karaf-0.24.0-SNAPSHOT/data/log/' Warning: Permanently added '10.30.170.89' (ED25519) to the list of known hosts. total 208 drwxrwxr-x 2 jenkins jenkins 4096 Apr 19 23:33 . -rw-rw-r-- 1 jenkins jenkins 1720 Apr 19 23:33 karaf_console.log drwxrwxr-x 9 jenkins jenkins 4096 Apr 19 23:33 .. -rw-rw-r-- 1 jenkins jenkins 197312 Apr 19 23:36 karaf.log + ssh 10.30.170.89 'du -hs /tmp/karaf-0.24.0-SNAPSHOT/data/log/*' Warning: Permanently added '10.30.170.89' (ED25519) to the list of known hosts. 196K /tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf.log 4.0K /tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf_console.log + set +e ++ seq 1 3 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_1_IP + echo 'Let'\''s take the karaf thread dump again' Let's take the karaf thread dump again + ssh 10.30.171.213 'sudo ps aux' Warning: Permanently added '10.30.171.213' (ED25519) to the list of known hosts. ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-drb-precedence-longevity-only-chromium/ps_after.log ++ grep -v grep ++ tr -s ' ' ++ cut -f2 '-d ' + pid=2030 + echo 'karaf main: org.apache.karaf.main.Main, pid:2030' karaf main: org.apache.karaf.main.Main, pid:2030 + ssh 10.30.171.213 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 2030' Warning: Permanently added '10.30.171.213' (ED25519) to the list of known hosts. + echo 'killing karaf process...' killing karaf process... + ssh 10.30.171.213 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh' Warning: Permanently added '10.30.171.213' (ED25519) to the list of known hosts. + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_2_IP + echo 'Let'\''s take the karaf thread dump again' Let's take the karaf thread dump again + ssh 10.30.170.177 'sudo ps aux' Warning: Permanently added '10.30.170.177' (ED25519) to the list of known hosts. ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-drb-precedence-longevity-only-chromium/ps_after.log ++ grep -v grep ++ tr -s ' ' ++ cut -f2 '-d ' + pid=2026 + echo 'karaf main: org.apache.karaf.main.Main, pid:2026' karaf main: org.apache.karaf.main.Main, pid:2026 + ssh 10.30.170.177 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 2026' Warning: Permanently added '10.30.170.177' (ED25519) to the list of known hosts. + echo 'killing karaf process...' killing karaf process... + ssh 10.30.170.177 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh' Warning: Permanently added '10.30.170.177' (ED25519) to the list of known hosts. + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_3_IP + echo 'Let'\''s take the karaf thread dump again' Let's take the karaf thread dump again + ssh 10.30.170.89 'sudo ps aux' Warning: Permanently added '10.30.170.89' (ED25519) to the list of known hosts. ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-drb-precedence-longevity-only-chromium/ps_after.log ++ grep -v grep ++ cut -f2 '-d ' ++ tr -s ' ' + pid=2029 + echo 'karaf main: org.apache.karaf.main.Main, pid:2029' karaf main: org.apache.karaf.main.Main, pid:2029 + ssh 10.30.170.89 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 2029' Warning: Permanently added '10.30.170.89' (ED25519) to the list of known hosts. + echo 'killing karaf process...' killing karaf process... + ssh 10.30.170.89 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh' Warning: Permanently added '10.30.170.89' (ED25519) to the list of known hosts. + sleep 5 ++ seq 1 3 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_1_IP + echo 'Compressing karaf.log 1' Compressing karaf.log 1 + ssh 10.30.171.213 gzip --best /tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf.log Warning: Permanently added '10.30.171.213' (ED25519) to the list of known hosts. + echo 'Fetching compressed karaf.log 1' Fetching compressed karaf.log 1 + scp 10.30.171.213:/tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf.log.gz odl1_karaf.log.gz Warning: Permanently added '10.30.171.213' (ED25519) to the list of known hosts. + ssh 10.30.171.213 rm -f /tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf.log.gz Warning: Permanently added '10.30.171.213' (ED25519) to the list of known hosts. + scp 10.30.171.213:/tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf_console.log odl1_karaf_console.log Warning: Permanently added '10.30.171.213' (ED25519) to the list of known hosts. + ssh 10.30.171.213 rm -f /tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf_console.log Warning: Permanently added '10.30.171.213' (ED25519) to the list of known hosts. + echo 'Fetch GC logs' Fetch GC logs + mkdir -p gclogs-1 + scp '10.30.171.213:/tmp/karaf-0.24.0-SNAPSHOT/data/log/*.log' gclogs-1/ Warning: Permanently added '10.30.171.213' (ED25519) to the list of known hosts. scp: /tmp/karaf-0.24.0-SNAPSHOT/data/log/*.log: No such file or directory + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_2_IP + echo 'Compressing karaf.log 2' Compressing karaf.log 2 + ssh 10.30.170.177 gzip --best /tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf.log Warning: Permanently added '10.30.170.177' (ED25519) to the list of known hosts. + echo 'Fetching compressed karaf.log 2' Fetching compressed karaf.log 2 + scp 10.30.170.177:/tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf.log.gz odl2_karaf.log.gz Warning: Permanently added '10.30.170.177' (ED25519) to the list of known hosts. + ssh 10.30.170.177 rm -f /tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf.log.gz Warning: Permanently added '10.30.170.177' (ED25519) to the list of known hosts. + scp 10.30.170.177:/tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf_console.log odl2_karaf_console.log Warning: Permanently added '10.30.170.177' (ED25519) to the list of known hosts. + ssh 10.30.170.177 rm -f /tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf_console.log Warning: Permanently added '10.30.170.177' (ED25519) to the list of known hosts. + echo 'Fetch GC logs' Fetch GC logs + mkdir -p gclogs-2 + scp '10.30.170.177:/tmp/karaf-0.24.0-SNAPSHOT/data/log/*.log' gclogs-2/ Warning: Permanently added '10.30.170.177' (ED25519) to the list of known hosts. scp: /tmp/karaf-0.24.0-SNAPSHOT/data/log/*.log: No such file or directory + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_3_IP + echo 'Compressing karaf.log 3' Compressing karaf.log 3 + ssh 10.30.170.89 gzip --best /tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf.log Warning: Permanently added '10.30.170.89' (ED25519) to the list of known hosts. + echo 'Fetching compressed karaf.log 3' Fetching compressed karaf.log 3 + scp 10.30.170.89:/tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf.log.gz odl3_karaf.log.gz Warning: Permanently added '10.30.170.89' (ED25519) to the list of known hosts. + ssh 10.30.170.89 rm -f /tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf.log.gz Warning: Permanently added '10.30.170.89' (ED25519) to the list of known hosts. + scp 10.30.170.89:/tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf_console.log odl3_karaf_console.log Warning: Permanently added '10.30.170.89' (ED25519) to the list of known hosts. + ssh 10.30.170.89 rm -f /tmp/karaf-0.24.0-SNAPSHOT/data/log/karaf_console.log Warning: Permanently added '10.30.170.89' (ED25519) to the list of known hosts. + echo 'Fetch GC logs' Fetch GC logs + mkdir -p gclogs-3 + scp '10.30.170.89:/tmp/karaf-0.24.0-SNAPSHOT/data/log/*.log' gclogs-3/ Warning: Permanently added '10.30.170.89' (ED25519) to the list of known hosts. scp: /tmp/karaf-0.24.0-SNAPSHOT/data/log/*.log: No such file or directory + echo 'Examine copied files' Examine copied files + ls -lt total 1400 drwxrwxr-x 2 jenkins jenkins 4096 Apr 19 23:36 gclogs-3 -rw-rw-r-- 1 jenkins jenkins 1720 Apr 19 23:36 odl3_karaf_console.log -rw-rw-r-- 1 jenkins jenkins 16150 Apr 19 23:36 odl3_karaf.log.gz drwxrwxr-x 2 jenkins jenkins 4096 Apr 19 23:36 gclogs-2 -rw-rw-r-- 1 jenkins jenkins 1720 Apr 19 23:36 odl2_karaf_console.log -rw-rw-r-- 1 jenkins jenkins 16606 Apr 19 23:36 odl2_karaf.log.gz drwxrwxr-x 2 jenkins jenkins 4096 Apr 19 23:36 gclogs-1 -rw-rw-r-- 1 jenkins jenkins 1720 Apr 19 23:36 odl1_karaf_console.log -rw-rw-r-- 1 jenkins jenkins 15830 Apr 19 23:36 odl1_karaf.log.gz -rw-rw-r-- 1 jenkins jenkins 78878 Apr 19 23:36 karaf_3_2029_threads_after.log -rw-rw-r-- 1 jenkins jenkins 13561 Apr 19 23:36 ps_after.log -rw-rw-r-- 1 jenkins jenkins 77243 Apr 19 23:36 karaf_2_2026_threads_after.log -rw-rw-r-- 1 jenkins jenkins 85575 Apr 19 23:36 karaf_1_2030_threads_after.log -rw-rw-r-- 1 jenkins jenkins 245296 Apr 19 23:36 report.html -rw-rw-r-- 1 jenkins jenkins 308932 Apr 19 23:36 log.html -rw-rw-r-- 1 jenkins jenkins 231898 Apr 19 23:36 output.xml -rw-rw-r-- 1 jenkins jenkins 486 Apr 19 23:36 testplan.txt -rw-rw-r-- 1 jenkins jenkins 74321 Apr 19 23:36 karaf_3_2029_threads_before.log -rw-rw-r-- 1 jenkins jenkins 13757 Apr 19 23:36 ps_before.log -rw-rw-r-- 1 jenkins jenkins 72685 Apr 19 23:36 karaf_2_2026_threads_before.log -rw-rw-r-- 1 jenkins jenkins 76030 Apr 19 23:36 karaf_1_2030_threads_before.log -rw-rw-r-- 1 jenkins jenkins 3106 Apr 19 23:33 post-startup-script.sh -rw-rw-r-- 1 jenkins jenkins 252 Apr 19 23:32 startup-script.sh -rw-rw-r-- 1 jenkins jenkins 3465 Apr 19 23:32 configuration-script.sh -rw-rw-r-- 1 jenkins jenkins 337 Apr 19 23:32 detect_variables.env -rw-rw-r-- 1 jenkins jenkins 2619 Apr 19 23:32 pom.xml -rw-rw-r-- 1 jenkins jenkins 92 Apr 19 23:32 set_variables.env -rw-rw-r-- 1 jenkins jenkins 356 Apr 19 23:32 slave_addresses.txt -rw-rw-r-- 1 jenkins jenkins 570 Apr 19 23:31 requirements.txt -rw-rw-r-- 1 jenkins jenkins 26 Apr 19 23:31 env.properties -rw-rw-r-- 1 jenkins jenkins 332 Apr 19 23:30 stack-parameters.yaml drwxrwxr-x 7 jenkins jenkins 4096 Apr 19 23:29 test drwxrwxr-x 2 jenkins jenkins 4096 Apr 19 23:29 test@tmp -rw-rw-r-- 1 jenkins jenkins 1410 Apr 19 22:34 maven-metadata.xml + true [controller-csit-3node-drb-precedence-longevity-only-chromium] $ /bin/sh /tmp/jenkins10474539301984273087.sh Cleaning up Robot installation... $ ssh-agent -k unset SSH_AUTH_SOCK; unset SSH_AGENT_PID; echo Agent pid 43207 killed; [ssh-agent] Stopped. Recording plot data Robot results publisher started... INFO: Checking test criticality is deprecated and will be dropped in a future release! -Parsing output xml: Done! -Copying log files to build dir: Done! -Assigning results to build: Done! -Checking thresholds: Done! Done publishing Robot results. Build step 'Publish Robot Framework test results' changed build result to UNSTABLE [PostBuildScript] - [INFO] Executing post build scripts. [controller-csit-3node-drb-precedence-longevity-only-chromium] $ /bin/bash /tmp/jenkins13671641701302034542.sh Archiving csit artifacts mv: cannot stat '*_1.png': No such file or directory mv: cannot stat '/tmp/odl1_*': No such file or directory mv: cannot stat '*_2.png': No such file or directory mv: cannot stat '/tmp/odl2_*': No such file or directory mv: cannot stat '*_3.png': No such file or directory mv: cannot stat '/tmp/odl3_*': No such file or directory % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 193k 0 193k 0 0 1047k 0 --:--:-- --:--:-- --:--:-- 1053k Archive: robot-plugin.zip inflating: ./archives/robot-plugin/log.html inflating: ./archives/robot-plugin/output.xml inflating: ./archives/robot-plugin/report.html mv: cannot stat '*.log.gz': No such file or directory mv: cannot stat '*.csv': No such file or directory mv: cannot stat '*.png': No such file or directory [PostBuildScript] - [INFO] Executing post build scripts. [controller-csit-3node-drb-precedence-longevity-only-chromium] $ /bin/bash /tmp/jenkins3217909897946023448.sh [PostBuildScript] - [INFO] Executing post build scripts. [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content OS_CLOUD=vex OS_STACK_NAME=releng-controller-csit-3node-drb-precedence-longevity-only-chromium-5 [EnvInject] - Variables injected successfully. provisioning config files... copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml [controller-csit-3node-drb-precedence-longevity-only-chromium] $ /bin/bash /tmp/jenkins4348800997131757970.sh ---> openstack-stack-delete.sh Setup pyenv: system 3.8.20 3.9.20 3.10.15 * 3.11.10 (set by /w/workspace/controller-csit-3node-drb-precedence-longevity-only-chromium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-KguD from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) lf-activate-venv(): INFO: Attempting to install with network-safe options... lf-activate-venv(): INFO: Base packages installed successfully lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes python-heatclient python-openstackclient urllib3~=1.26.15 lf-activate-venv(): INFO: Adding /tmp/venv-KguD/bin to PATH INFO: Stack cost retrieval disabled, setting cost to 0 INFO: Deleting stack releng-controller-csit-3node-drb-precedence-longevity-only-chromium-5 Waiting for stack to delete... Waiting for stack to delete... Waiting for stack to delete... Successfully deleted stack releng-controller-csit-3node-drb-precedence-longevity-only-chromium-5 [PostBuildScript] - [INFO] Executing post build scripts. [controller-csit-3node-drb-precedence-longevity-only-chromium] $ /bin/bash /tmp/jenkins17522266478795606978.sh ---> sysstat.sh /tmp/jenkins17522266478795606978.sh: line 19: facter: command not found [controller-csit-3node-drb-precedence-longevity-only-chromium] $ /bin/bash /tmp/jenkins11581075336956813294.sh ---> package-listing.sh ++ facter osfamily /tmp/jenkins11581075336956813294.sh: line 19: facter: command not found ++ tr '[:upper:]' '[:lower:]' + OS_FAMILY= [controller-csit-3node-drb-precedence-longevity-only-chromium] $ /bin/bash /tmp/jenkins9079960156679605455.sh ---> capture-instance-metadata.sh Setup pyenv: system 3.8.20 3.9.20 3.10.15 * 3.11.10 (set by /w/workspace/controller-csit-3node-drb-precedence-longevity-only-chromium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-KguD from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) lf-activate-venv(): INFO: Attempting to install with network-safe options... lf-activate-venv(): INFO: Base packages installed successfully lf-activate-venv(): INFO: Installing additional packages: lftools lf-activate-venv(): INFO: Adding /tmp/venv-KguD/bin to PATH INFO: Running in OpenStack, capturing instance metadata [controller-csit-3node-drb-precedence-longevity-only-chromium] $ /bin/bash /tmp/jenkins15545230642672691413.sh provisioning config files... Could not find credentials [logs] for controller-csit-3node-drb-precedence-longevity-only-chromium #5 copy managed file [jenkins-log-archives-settings] to file:/w/workspace/controller-csit-3node-drb-precedence-longevity-only-chromium@tmp/config17856298803317665512tmp Regular expression run condition: Expression=[^.*logs-s3.*], Label=[odl-logs-s3-cloudfront-index] Run condition [Regular expression match] enabling perform for step [Provide Configuration files] provisioning config files... copy managed file [jenkins-s3-log-ship] to file:/home/jenkins/.aws/credentials [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content SERVER_ID=logs [EnvInject] - Variables injected successfully. [controller-csit-3node-drb-precedence-longevity-only-chromium] $ /bin/bash /tmp/jenkins7091642293598205829.sh ---> create-netrc.sh WARN: Log server credential not found. [controller-csit-3node-drb-precedence-longevity-only-chromium] $ /bin/bash /tmp/jenkins10583159140211350861.sh ---> python-tools-install.sh Setup pyenv: system 3.8.20 3.9.20 3.10.15 * 3.11.10 (set by /w/workspace/controller-csit-3node-drb-precedence-longevity-only-chromium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-KguD from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) lf-activate-venv(): INFO: Attempting to install with network-safe options... lf-activate-venv(): INFO: Base packages installed successfully lf-activate-venv(): INFO: Installing additional packages: lftools lf-activate-venv(): INFO: Adding /tmp/venv-KguD/bin to PATH [controller-csit-3node-drb-precedence-longevity-only-chromium] $ /bin/sh /tmp/jenkins15488975087894693369.sh ---> uv-install.sh uv 0.11.7 is already installed uvx 0.11.7 (x86_64-unknown-linux-gnu) [controller-csit-3node-drb-precedence-longevity-only-chromium] $ /bin/bash /tmp/jenkins15101871731675813178.sh ---> sudo-logs.sh Archiving 'sudo' log.. /tmp/jenkins15101871731675813178.sh: line 41: facter: command not found [controller-csit-3node-drb-precedence-longevity-only-chromium] $ /bin/bash /tmp/jenkins14256636708692474056.sh ---> job-cost.sh INFO: Activating Python virtual environment... Setup pyenv: system 3.8.20 3.9.20 3.10.15 * 3.11.10 (set by /w/workspace/controller-csit-3node-drb-precedence-longevity-only-chromium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-KguD from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) lf-activate-venv(): INFO: Attempting to install with network-safe options... lf-activate-venv(): INFO: Base packages installed successfully lf-activate-venv(): INFO: Installing additional packages: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 lf-activate-venv(): INFO: Adding /tmp/venv-KguD/bin to PATH DEBUG: Contents of stack-cost file: total: 0 INFO: Retrieving Stack Cost... INFO: Stack cost: 0 INFO: Instance uptime: 72703s INFO: Fetching instance metadata (attempt 1 of 3)... DEBUG: URL: http://169.254.169.254/latest/meta-data/instance-type INFO: Successfully fetched instance metadata INFO: Instance type: v3-standard-2 INFO: Retrieving pricing info for: v3-standard-2 INFO: Fetching Vexxhost pricing API (attempt 1 of 3)... DEBUG: URL: https://pricing.vexxhost.net/v1/pricing/v3-standard-2/cost?seconds=72703 INFO: Successfully fetched Vexxhost pricing API INFO: Retrieved cost: 1.16 INFO: Retrieved resource: v3-standard-2 INFO: Creating archive directory: /w/workspace/controller-csit-3node-drb-precedence-longevity-only-chromium/archives/cost INFO: Archiving costs to: /w/workspace/controller-csit-3node-drb-precedence-longevity-only-chromium/archives/cost.csv INFO: Successfully archived job cost data DEBUG: Cost data: controller-csit-3node-drb-precedence-longevity-only-chromium,5,2026-04-19 23:38:39,v3-standard-2,72703,1.16,0.00,UNSTABLE [controller-csit-3node-drb-precedence-longevity-only-chromium] $ /bin/bash -l /tmp/jenkins10758390128000646850.sh ---> logs-deploy.sh Setup pyenv: system 3.8.20 3.9.20 3.10.15 * 3.11.10 (set by /w/workspace/controller-csit-3node-drb-precedence-longevity-only-chromium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-KguD from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) lf-activate-venv(): INFO: Attempting to install with network-safe options... lf-activate-venv(): INFO: Base packages installed successfully lf-activate-venv(): INFO: Installing additional packages: lftools urllib3~=1.26.15 lf-activate-venv(): INFO: Adding /tmp/venv-KguD/bin to PATH WARNING: Nexus logging server not set INFO: S3 path logs/releng/vex-yul-odl-jenkins-1/controller-csit-3node-drb-precedence-longevity-only-chromium/5/ INFO: archiving logs to S3 ---> uname -a: Linux prd-ubuntu2404-robot-2c-8g-4562 6.8.0-90-generic #91-Ubuntu SMP PREEMPT_DYNAMIC Tue Nov 18 14:14:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux ---> lscpu: Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Address sizes: 40 bits physical, 48 bits virtual Byte Order: Little Endian CPU(s): 2 On-line CPU(s) list: 0,1 Vendor ID: AuthenticAMD Model name: AMD EPYC-Rome Processor CPU family: 23 Model: 49 Thread(s) per core: 1 Core(s) per socket: 1 Socket(s): 2 Stepping: 0 BogoMIPS: 5600.00 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities Virtualization: AMD-V Hypervisor vendor: KVM Virtualization type: full L1d cache: 64 KiB (2 instances) L1i cache: 64 KiB (2 instances) L2 cache: 1 MiB (2 instances) L3 cache: 32 MiB (2 instances) NUMA node(s): 1 NUMA node0 CPU(s): 0,1 Vulnerability Gather data sampling: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Mitigation; untrained return thunk; SMT disabled Vulnerability Spec rstack overflow: Vulnerable: Safe RET, no microcode Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization Vulnerability Spectre v2: Mitigation; Retpolines; IBPB conditional; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected Vulnerability Srbds: Not affected Vulnerability Tsx async abort: Not affected Vulnerability Vmscape: Not affected ---> nproc: 2 ---> df -h: Filesystem Size Used Avail Use% Mounted on tmpfs 795M 1.1M 794M 1% /run /dev/vda1 38G 7.9G 30G 21% / tmpfs 3.9G 0 3.9G 0% /dev/shm tmpfs 5.0M 0 5.0M 0% /run/lock /dev/vda16 881M 117M 703M 15% /boot /dev/vda15 105M 6.2M 99M 6% /boot/efi tmpfs 795M 16K 795M 1% /run/user/1001 ---> free -m: total used free shared buff/cache available Mem: 7941 780 5160 4 2298 7161 Swap: 1023 0 1023 ---> ip addr: 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever inet6 ::1/128 scope host noprefixroute valid_lft forever preferred_lft forever 2: ens3: mtu 1458 qdisc mq state UP group default qlen 1000 link/ether fa:16:3e:f5:83:05 brd ff:ff:ff:ff:ff:ff altname enp0s3 inet 10.30.171.231/23 metric 100 brd 10.30.171.255 scope global dynamic ens3 valid_lft 56890sec preferred_lft 56890sec inet6 fe80::f816:3eff:fef5:8305/64 scope link valid_lft forever preferred_lft forever ---> sar -b -r -n DEV: Linux 6.8.0-90-generic (prd-ubuntu2404-robot-2c-8g-4562) 04/19/26 _x86_64_ (2 CPU) 03:27:08 LINUX RESTART (2 CPU) 03:30:01 tps rtps wtps dtps bread/s bwrtn/s bdscd/s 03:40:09 2.01 0.34 1.66 0.01 39.69 73.63 0.32 03:50:01 1.39 0.01 1.37 0.02 1.12 16.33 1.03 04:00:01 14.10 0.00 1.53 12.57 0.15 18.41 109540.31 04:10:09 1.40 0.00 1.39 0.02 0.00 16.04 1.18 04:20:01 1.46 0.00 1.43 0.02 0.01 17.62 221.87 04:30:01 1.51 0.00 1.48 0.03 0.00 18.01 436.69 04:40:09 1.25 0.00 1.23 0.02 0.00 15.05 1.08 04:50:01 1.21 0.00 1.19 0.02 0.00 14.93 1.22 05:00:01 1.38 0.00 1.35 0.03 0.00 17.12 436.71 05:10:09 1.19 0.00 1.17 0.02 0.00 14.53 1.18 05:20:01 15.67 13.73 1.87 0.07 153.19 43.38 7.35 05:30:01 1.42 0.00 1.40 0.03 0.00 17.56 1.45 05:40:09 1.40 0.00 1.38 0.01 0.00 17.78 0.57 05:50:01 1.26 0.00 1.26 0.00 0.00 15.43 0.00 06:00:01 1.38 0.00 1.37 0.01 0.00 17.38 0.25 06:10:09 1.19 0.00 1.19 0.00 0.00 14.76 0.00 06:20:01 1.20 0.00 1.20 0.00 0.00 14.81 0.00 06:30:01 1.42 0.01 1.40 0.01 0.09 17.76 0.25 06:40:09 1.28 0.00 1.28 0.00 0.00 15.65 0.00 06:50:01 1.24 0.00 1.24 0.00 0.03 15.34 0.00 07:00:01 1.57 0.00 1.55 0.02 0.00 19.97 216.34 07:10:09 1.27 0.00 1.27 0.00 0.00 15.21 0.00 07:20:01 1.25 0.00 1.25 0.00 0.00 15.06 0.00 07:30:01 1.41 0.00 1.40 0.01 0.00 17.37 0.25 07:40:09 1.41 0.02 1.38 0.00 2.12 16.36 0.04 07:50:09 1.26 0.00 1.26 0.00 0.00 15.13 0.00 08:00:09 1.53 0.00 1.51 0.02 0.00 18.81 0.41 08:10:09 1.30 0.00 1.30 0.00 0.00 15.59 216.11 08:20:09 1.32 0.00 1.32 0.00 0.00 15.85 0.00 08:30:09 1.50 0.00 1.49 0.01 0.00 18.43 0.23 08:40:09 1.39 0.00 1.39 0.01 0.00 17.00 0.15 08:50:09 1.37 0.00 1.37 0.00 0.00 16.23 0.00 09:00:01 1.37 0.00 1.36 0.01 0.00 16.71 0.26 09:10:09 1.31 0.00 1.31 0.00 0.00 15.69 0.00 09:20:01 1.42 0.00 1.42 0.00 0.00 16.62 0.00 09:30:01 1.73 0.00 1.72 0.01 0.00 19.68 0.25 09:40:09 1.52 0.00 1.52 0.00 0.00 17.15 0.00 09:50:01 1.55 0.00 1.55 0.00 0.00 17.03 0.00 10:00:01 1.84 0.00 1.83 0.02 0.00 21.42 648.55 10:10:09 1.54 0.00 1.54 0.00 0.00 16.77 0.00 10:20:01 1.55 0.00 1.55 0.00 0.00 17.05 0.00 10:30:01 1.71 0.00 1.70 0.02 0.00 19.41 0.27 10:40:09 1.56 0.00 1.56 0.00 0.00 17.07 0.00 10:50:01 1.55 0.00 1.55 0.00 0.00 16.84 0.00 11:00:01 1.79 0.00 1.77 0.02 0.00 20.62 0.55 11:10:09 1.57 0.00 1.56 0.00 0.00 17.27 0.05 11:20:01 1.58 0.00 1.58 0.00 0.00 17.25 0.00 11:30:01 1.67 0.00 1.66 0.01 0.00 18.81 0.25 11:40:09 1.50 0.00 1.50 0.00 0.00 16.75 0.00 11:50:01 1.52 0.00 1.52 0.00 0.00 16.71 0.00 12:00:01 1.82 0.00 1.80 0.02 0.00 21.18 432.48 12:10:09 1.60 0.00 1.60 0.00 0.00 17.79 0.05 12:20:01 1.57 0.00 1.57 0.00 0.00 17.54 0.00 12:30:01 1.83 0.00 1.81 0.01 0.00 21.05 216.33 12:40:09 1.56 0.00 1.55 0.00 0.00 17.49 0.05 12:50:01 1.55 0.00 1.55 0.00 0.00 17.11 0.00 13:00:01 1.78 0.00 1.77 0.01 0.00 20.24 0.25 13:10:09 1.52 0.00 1.52 0.00 0.00 16.66 0.00 13:20:01 1.57 0.00 1.57 0.00 0.00 17.51 0.00 13:30:01 1.73 0.00 1.71 0.01 0.00 19.22 0.25 13:40:09 1.47 0.00 1.47 0.00 0.00 16.37 0.00 13:50:01 1.70 0.00 1.69 0.01 0.00 19.56 0.09 14:00:01 1.67 0.00 1.66 0.01 0.00 19.38 0.23 14:10:09 1.53 0.00 1.53 0.00 0.00 17.12 0.00 14:20:01 1.55 0.00 1.55 0.00 0.00 17.07 0.00 14:30:09 1.71 0.00 1.70 0.01 0.00 19.33 0.25 14:40:09 1.50 0.00 1.50 0.00 0.00 16.77 0.00 14:50:09 1.68 0.00 1.68 0.00 0.00 19.23 0.17 15:00:09 1.64 0.00 1.63 0.02 0.00 19.43 0.28 15:10:09 1.42 0.00 1.42 0.00 0.00 16.25 0.00 15:20:09 1.43 0.00 1.43 0.00 0.00 16.17 0.00 15:30:09 1.56 0.00 1.55 0.01 0.00 17.81 0.25 15:40:09 1.49 0.00 1.49 0.00 0.00 16.59 0.00 15:50:01 1.49 0.00 1.48 0.01 0.00 17.48 0.15 16:00:01 1.52 0.00 1.51 0.01 0.00 17.62 0.25 16:10:09 1.42 0.00 1.42 0.00 0.00 15.89 0.00 16:20:01 1.45 0.00 1.45 0.00 0.00 16.12 0.00 16:30:01 1.62 0.00 1.60 0.01 0.00 18.41 0.25 16:40:09 1.33 0.00 1.33 0.00 0.00 15.20 0.00 16:50:01 1.48 0.00 1.48 0.00 0.00 17.23 0.20 17:00:02 1.70 0.00 1.69 0.02 0.00 19.44 0.44 17:10:16 1.45 0.00 1.44 0.00 0.00 16.69 0.10 17:20:01 1.45 0.00 1.45 0.00 0.00 16.62 0.05 17:30:01 1.57 0.00 1.56 0.01 0.00 18.46 0.25 17:40:09 1.39 0.00 1.39 0.00 0.00 15.73 0.00 17:50:01 1.36 0.00 1.36 0.00 0.00 15.78 0.00 18:00:01 1.51 0.00 1.50 0.01 0.00 17.85 0.25 18:10:09 1.36 0.00 1.36 0.00 0.00 15.57 0.00 18:20:01 1.35 0.00 1.35 0.00 0.00 15.45 0.00 18:30:01 1.57 0.00 1.56 0.01 0.00 18.32 0.25 18:40:16 1.62 0.00 1.61 0.01 0.00 18.93 0.32 18:50:01 1.33 0.00 1.33 0.00 0.00 15.22 0.00 19:00:01 1.54 0.00 1.53 0.01 0.00 17.96 0.25 19:10:09 1.36 0.00 1.36 0.00 0.00 15.73 0.00 19:20:01 1.39 0.00 1.39 0.00 0.00 15.73 0.00 19:30:01 1.87 0.00 1.85 0.02 0.00 21.49 216.41 19:40:09 1.55 0.00 1.55 0.00 0.00 16.94 0.00 19:50:01 1.55 0.00 1.55 0.00 0.00 17.07 0.00 20:00:01 1.74 0.00 1.73 0.01 0.00 19.64 0.25 20:10:09 1.62 0.00 1.62 0.00 0.00 17.77 0.00 20:20:01 1.52 0.00 1.52 0.00 0.00 16.65 0.00 20:30:01 1.81 0.00 1.80 0.01 0.00 19.93 0.25 20:40:09 1.54 0.00 1.54 0.00 0.00 17.03 0.00 20:50:02 1.69 0.00 1.69 0.00 0.00 18.76 0.26 21:00:09 1.88 0.00 1.86 0.02 0.00 20.65 0.28 21:10:16 1.88 0.00 1.87 0.01 0.00 20.40 0.14 21:20:09 1.59 0.00 1.59 0.00 0.00 17.17 0.00 21:30:09 1.76 0.00 1.74 0.01 0.00 19.23 0.25 21:40:09 1.63 0.00 1.63 0.00 0.00 17.37 0.00 21:50:09 1.54 0.00 1.54 0.00 0.00 16.69 0.00 22:00:09 1.63 0.00 1.62 0.01 0.00 18.41 0.25 22:10:09 1.36 0.00 1.36 0.00 0.00 15.29 0.00 22:20:09 1.48 0.00 1.48 0.00 0.00 16.28 0.00 22:30:01 1.56 0.00 1.54 0.01 0.00 18.08 438.63 22:40:09 1.46 0.00 1.45 0.00 0.00 16.20 0.05 22:50:01 1.47 0.00 1.47 0.00 0.00 16.21 0.00 23:00:01 1.61 0.00 1.60 0.01 0.00 18.24 0.25 23:10:09 1.46 0.00 1.46 0.00 0.00 16.18 0.00 23:20:01 1.47 0.00 1.47 0.00 0.00 16.12 0.00 23:30:01 8.32 1.36 6.45 0.51 99.27 748.56 189.82 Average: 1.79 0.13 1.55 0.12 2.45 24.14 943.73 03:30:01 kbmemfree kbavail kbmemused %memused kbbuffers kbcached kbcommit %commit kbactive kbinact kbdirty 03:40:09 6244088 7523140 296644 3.65 30844 1453472 733420 7.99 462960 1204108 132 03:50:01 6258816 7538736 281096 3.46 31056 1454116 534044 5.82 458500 1204652 160 04:00:01 6257332 7537880 281868 3.47 31276 1454488 534112 5.82 458636 1205216 156 04:10:09 6256576 7537672 282080 3.47 31492 1454812 534264 5.82 458808 1205756 164 04:20:01 6249016 7530812 288912 3.55 31736 1455260 534264 5.82 459132 1206332 268 04:30:01 6255376 7537732 282000 3.47 31940 1455600 534264 5.82 459140 1206864 124 04:40:09 6255376 7538264 281468 3.46 32144 1455920 561608 6.12 462248 1207388 156 04:50:01 6253448 7536888 282824 3.48 32352 1456252 561620 6.12 463924 1207928 124 05:00:01 6256332 7540300 279432 3.44 32548 1456580 561684 6.12 465964 1208452 124 05:10:09 6256332 7540832 278892 3.43 32752 1456904 561708 6.12 466704 1208980 180 05:20:01 6180424 7522176 288468 3.55 36924 1501660 561772 6.12 468676 1257172 124 05:30:01 6181948 7524264 286264 3.52 37120 1501988 561772 6.12 470040 1257696 240 05:40:09 6175680 7518552 291960 3.59 37352 1502308 561772 6.12 471284 1258248 200 05:50:01 6172656 7516036 294460 3.62 37520 1502640 561796 6.12 472012 1258748 240 06:00:01 6182752 7526768 283696 3.49 37696 1503096 561868 6.12 473360 1259244 136 06:10:09 6182512 7527032 283432 3.49 37856 1503424 562096 6.12 474260 1259740 256 06:20:01 6181756 7526744 283716 3.49 37992 1503748 562096 6.12 475036 1260200 164 06:30:01 6177496 7523020 287428 3.53 38164 1504100 562096 6.12 476248 1260724 240 06:40:09 6177272 7523284 287160 3.53 38316 1504428 562192 6.12 477692 1261204 204 06:50:01 6176276 7522904 287532 3.54 38472 1504884 562192 6.12 478336 1261688 300 07:00:01 6154368 7501572 308736 3.80 38692 1505216 562284 6.12 478216 1262232 268 07:10:09 6160416 7508116 302152 3.72 38852 1505540 562336 6.12 478236 1262724 236 07:20:01 6158708 7506892 303372 3.73 39004 1505868 562284 6.12 478152 1263204 284 07:30:01 6152584 7501296 308920 3.80 39196 1506188 562400 6.13 478300 1263716 284 07:40:09 6152852 7502720 307480 3.78 39364 1507164 562400 6.13 478920 1264300 200 07:50:09 6152852 7503320 306872 3.77 39516 1507608 562400 6.13 479076 1264780 232 08:00:09 6144056 7495072 315052 3.87 39692 1507960 617424 6.72 484292 1265292 124 08:10:09 6144056 7495560 314624 3.87 39856 1508276 562444 6.13 479188 1265776 220 08:20:09 6144056 7496052 314132 3.86 40016 1508608 562444 6.13 479232 1266268 224 08:30:09 6143592 7496120 314060 3.86 40204 1508936 564204 6.15 480452 1266784 204 08:40:09 6166056 7519092 291080 3.58 40384 1509260 562576 6.13 479336 1267288 200 08:50:09 6165300 7518824 291344 3.58 40544 1509580 562576 6.13 479224 1267768 176 09:00:01 6158596 7512608 297560 3.66 40688 1509916 562572 6.13 479336 1268248 124 09:10:09 6158596 7513120 297036 3.65 40872 1510236 562572 6.13 479372 1268752 204 09:20:01 6158596 7513624 296516 3.65 41032 1510572 562572 6.13 479280 1269248 240 09:30:01 6149556 7505176 304944 3.75 41216 1510964 562572 6.13 479360 1269760 240 09:40:09 6132924 7489176 320940 3.95 41384 1511420 568496 6.19 498404 1270256 244 09:50:01 6140764 7497636 312476 3.84 41544 1511872 568496 6.19 498416 1270740 268 10:00:01 6133500 7490924 318992 3.92 41752 1512200 568496 6.19 498584 1271276 240 10:10:09 6133500 7491408 318552 3.92 41904 1512532 568496 6.19 498472 1271756 208 10:20:01 6133260 7491660 318292 3.91 42072 1512852 568496 6.19 498604 1272240 264 10:30:01 6142636 7501544 308420 3.79 42236 1513184 568496 6.19 498608 1272744 124 10:40:09 6148080 7507488 302472 3.72 42404 1513512 568628 6.19 498644 1273240 204 10:50:01 6147808 7507696 302264 3.72 42556 1513832 568628 6.19 498652 1273712 240 11:00:01 6132200 7492760 317152 3.90 42756 1514300 623704 6.79 503856 1274240 156 11:10:09 6131192 7492264 317664 3.91 42928 1514620 568628 6.19 498688 1274744 224 11:20:01 6131192 7492756 317168 3.90 43088 1514948 568628 6.19 498716 1275232 240 11:30:01 6124232 7486292 323584 3.98 43240 1515276 568688 6.19 498972 1275712 160 11:40:09 6122552 7485124 324736 3.99 43420 1515600 568688 6.19 498976 1276216 268 11:50:01 6123076 7486112 323740 3.98 43556 1515924 568688 6.19 498904 1276676 240 12:00:01 6122452 7486176 323568 3.98 43760 1516388 623764 6.79 504236 1277212 240 12:10:09 6121204 7485564 324216 3.99 43940 1516836 568688 6.19 499300 1277716 220 12:20:01 6121204 7486076 323696 3.98 44112 1517168 568820 6.20 499220 1278220 240 12:30:01 6115936 7481328 328400 4.04 44292 1517500 623896 6.80 504524 1278728 240 12:40:09 6120144 7486028 323760 3.98 44468 1517816 568884 6.20 499360 1279216 252 12:50:01 6119388 7485780 324040 3.98 44628 1518148 568884 6.20 499368 1279716 124 13:00:01 6121304 7488344 321468 3.95 44804 1518612 568948 6.20 499408 1280228 124 13:10:09 6121080 7488616 321152 3.95 44972 1518940 568948 6.20 499556 1280716 300 13:20:01 6120324 7488340 321424 3.95 45116 1519264 568948 6.20 499844 1281192 240 13:30:01 6118572 7487072 322684 3.97 45268 1519588 568948 6.20 499584 1281668 124 13:40:09 6118572 7487524 322224 3.96 45380 1519924 568948 6.20 499640 1282116 256 13:50:01 6113784 7483244 326516 4.01 45556 1520248 568948 6.20 499544 1282616 124 14:00:01 6113288 7483356 326400 4.01 45704 1520704 568948 6.20 499816 1283092 124 14:10:09 6113288 7483828 325912 4.01 45848 1521032 569012 6.20 499900 1283560 244 14:20:01 6113036 7484032 325704 4.00 45972 1521352 569012 6.20 499796 1284008 124 14:30:09 6108772 7480264 329468 4.05 46136 1521680 569012 6.20 499928 1284500 212 14:40:09 6108772 7480704 328960 4.04 46240 1522012 569164 6.20 499960 1284936 208 14:50:09 6103008 7475424 334152 4.11 46388 1522340 624408 6.80 505328 1285408 224 15:00:09 6131116 7504128 305492 3.76 46524 1522792 569396 6.20 500464 1285872 232 15:10:09 6131116 7504632 304980 3.75 46692 1523120 569396 6.20 500464 1286368 244 15:20:09 6130876 7504852 304756 3.75 46824 1523444 569396 6.20 500472 1286824 228 15:30:09 6122068 7496644 312836 3.85 46952 1523900 569396 6.20 500640 1287280 208 15:40:09 6122068 7497108 312432 3.84 47088 1524224 569396 6.20 500640 1287740 124 15:50:01 6127696 7503232 306340 3.77 47240 1524560 569396 6.20 500684 1288228 244 16:00:01 6121676 7497664 311928 3.84 47368 1524884 569464 6.20 500704 1288676 152 16:10:09 6121436 7497892 311700 3.83 47496 1525212 569464 6.20 500704 1289136 208 16:20:01 6121184 7498212 311356 3.83 47608 1525668 569464 6.20 500800 1289576 240 16:30:01 6123484 7501004 308548 3.79 47760 1525992 569464 6.20 500748 1290052 272 16:40:09 6122476 7500480 309068 3.80 47912 1526320 569464 6.20 500864 1290532 224 16:50:01 6121220 7499728 309744 3.81 48072 1526652 624540 6.80 505952 1291020 128 17:00:02 6105856 7484840 324516 3.99 48208 1526980 569464 6.20 500880 1291488 252 17:10:16 6111668 7491164 318268 3.91 48364 1527332 569632 6.20 500920 1291996 328 17:20:01 6119244 7499304 310124 3.81 48496 1527760 569632 6.20 500932 1292428 244 17:30:01 6115244 7495776 313648 3.86 48628 1528088 569632 6.20 500972 1292888 240 17:40:09 6113816 7494808 314608 3.87 48764 1528408 569632 6.20 501092 1293344 208 17:50:01 6113060 7494532 314872 3.87 48900 1528744 569632 6.20 500980 1293816 140 18:00:01 6097728 7479660 329732 4.05 49024 1529072 569632 6.20 501000 1294268 124 18:10:09 6104056 7486456 322932 3.97 49156 1529404 569632 6.20 501140 1294732 232 18:20:01 6102796 7485652 323728 3.98 49280 1529728 569632 6.20 501028 1295180 268 18:30:01 6097776 7481260 328072 4.03 49444 1530184 569660 6.20 501200 1295672 240 18:40:16 6105600 7489616 319700 3.93 49612 1530548 569660 6.20 501320 1296204 164 18:50:01 6105376 7489836 319444 3.93 49760 1530840 569660 6.20 501324 1296644 240 19:00:01 6110976 7495920 313316 3.85 49908 1531164 569660 6.20 501364 1297116 120 19:10:09 6110976 7496536 312676 3.84 50068 1531624 569660 6.20 501476 1297600 252 19:20:01 6110724 7496744 312464 3.84 50200 1531944 569660 6.20 501484 1298052 156 19:30:01 6104488 7491040 318168 3.91 50372 1532280 569756 6.21 501392 1298568 120 19:40:09 6103984 7491144 318060 3.91 50524 1532732 569756 6.21 501636 1299044 212 19:50:01 6103984 7491616 317580 3.91 50664 1533056 569756 6.21 501532 1299508 296 20:00:01 6103248 7491364 317748 3.91 50812 1533384 569804 6.21 501700 1299984 240 20:10:09 6116916 7505500 303672 3.73 50944 1533712 569976 6.21 501628 1300444 124 20:20:01 6115608 7504664 304500 3.74 51084 1534040 569976 6.21 501744 1300912 124 20:30:01 6103308 7492856 316268 3.89 51236 1534368 569976 6.21 501776 1301392 124 20:40:09 6103308 7493316 315812 3.88 51368 1534696 569976 6.21 501784 1301852 252 20:50:02 6099276 7489776 319288 3.93 51524 1535028 625056 6.81 506820 1302336 240 21:00:09 6101900 7492888 316212 3.89 51676 1535352 570040 6.21 501812 1302816 208 21:10:16 6096636 7488220 320844 3.95 51844 1535772 570040 6.21 501908 1303340 160 21:20:09 6096636 7488880 320220 3.94 51984 1536284 570040 6.21 502060 1303780 304 21:30:09 6098416 7491124 317968 3.91 52132 1536608 570040 6.21 502120 1304252 224 21:40:09 6097436 7490736 318352 3.91 52264 1537060 570040 6.21 502276 1304708 204 21:50:09 6097184 7490948 318132 3.91 52396 1537388 570040 6.21 502296 1305168 220 22:00:09 6104568 7498820 310176 3.81 52540 1537724 570208 6.21 502340 1305640 300 22:10:09 6104328 7499036 309960 3.81 52664 1538044 570208 6.21 502496 1306092 252 22:20:09 6104328 7499484 309476 3.81 52788 1538364 570268 6.21 502576 1306536 168 22:30:01 6098792 7494568 314308 3.86 52924 1538824 570416 6.21 502720 1307004 316 22:40:09 6098792 7495052 313816 3.86 53068 1539164 570416 6.21 503016 1307484 216 22:50:01 6098568 7495280 313584 3.86 53196 1539480 570416 6.21 502820 1307932 240 23:00:01 6090256 7487424 321468 3.95 53312 1539812 570416 6.21 502828 1308380 120 23:10:09 6090004 7487776 321112 3.95 53448 1540272 570416 6.21 502956 1308848 212 23:20:01 6089500 7487704 321176 3.95 53556 1540592 570416 6.21 502896 1309276 240 23:30:01 5521724 7372440 404604 4.98 85772 1933444 608992 6.63 536628 1721080 255044 Average: 6131927 7499134 311110 3.83 44846 1519211 571061 6.22 492848 1280910 2331 03:30:01 IFACE rxpck/s txpck/s rxkB/s txkB/s rxcmp/s txcmp/s rxmcst/s %ifutil 03:40:09 lo 1.02 1.02 0.05 0.05 0.00 0.00 0.00 0.00 03:40:09 ens3 1.19 0.25 3.11 0.05 0.00 0.00 0.00 0.00 03:50:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 03:50:01 ens3 0.76 0.06 0.08 0.02 0.00 0.00 0.00 0.00 04:00:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 04:00:01 ens3 0.71 0.07 0.10 0.03 0.00 0.00 0.00 0.00 04:10:09 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 04:10:09 ens3 0.85 0.04 0.09 0.01 0.00 0.00 0.00 0.00 04:20:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 04:20:01 ens3 0.83 0.05 0.09 0.01 0.00 0.00 0.00 0.00 04:30:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 04:30:01 ens3 0.20 0.04 0.04 0.01 0.00 0.00 0.00 0.00 04:40:09 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 04:40:09 ens3 0.45 0.26 0.09 0.45 0.00 0.00 0.00 0.00 04:50:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 04:50:01 ens3 1.20 0.09 7.46 0.06 0.00 0.00 0.00 0.00 05:00:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 05:00:01 ens3 0.33 0.09 0.11 0.06 0.00 0.00 0.00 0.00 05:10:09 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 05:10:09 ens3 0.19 0.04 0.04 0.01 0.00 0.00 0.00 0.00 05:20:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 05:20:01 ens3 0.24 0.05 0.07 0.03 0.00 0.00 0.00 0.00 05:30:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 05:30:01 ens3 0.28 0.06 0.08 0.04 0.00 0.00 0.00 0.00 05:40:09 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 05:40:09 ens3 0.27 0.06 0.07 0.03 0.00 0.00 0.00 0.00 05:50:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 05:50:01 ens3 0.19 0.06 0.04 0.02 0.00 0.00 0.00 0.00 06:00:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 06:00:01 ens3 0.23 0.06 0.06 0.03 0.00 0.00 0.00 0.00 06:10:09 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 06:10:09 ens3 0.20 0.04 0.05 0.01 0.00 0.00 0.00 0.00 06:20:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 06:20:01 ens3 0.19 0.05 0.04 0.01 0.00 0.00 0.00 0.00 06:30:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 06:30:01 ens3 0.26 0.06 0.07 0.03 0.00 0.00 0.00 0.00 06:40:09 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 06:40:09 ens3 0.33 0.07 0.10 0.05 0.00 0.00 0.00 0.00 06:50:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 06:50:01 ens3 0.42 0.12 0.14 0.08 0.00 0.00 0.00 0.00 07:00:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 07:00:01 ens3 0.68 0.18 0.24 0.15 0.00 0.00 0.00 0.00 07:10:09 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 07:10:09 ens3 0.22 0.04 0.04 0.01 0.00 0.00 0.00 0.00 07:20:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 07:20:01 ens3 0.28 0.08 0.08 0.04 0.00 0.00 0.00 0.00 07:30:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 07:30:01 ens3 0.22 0.05 0.04 0.02 0.00 0.00 0.00 0.00 07:40:09 lo 1.01 1.01 0.05 0.05 0.00 0.00 0.00 0.00 07:40:09 ens3 0.30 0.08 0.08 0.04 0.00 0.00 0.00 0.00 07:50:09 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 07:50:09 ens3 0.15 0.05 0.04 0.02 0.00 0.00 0.00 0.00 08:00:09 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 08:00:09 ens3 0.30 0.09 0.10 0.05 0.00 0.00 0.00 0.00 08:10:09 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 08:10:09 ens3 0.31 0.09 0.11 0.06 0.00 0.00 0.00 0.00 08:20:09 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 08:20:09 ens3 0.28 0.06 0.07 0.03 0.00 0.00 0.00 0.00 08:30:09 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 08:30:09 ens3 0.38 0.11 0.13 0.07 0.00 0.00 0.00 0.00 08:40:09 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 08:40:09 ens3 0.29 0.07 0.07 0.03 0.00 0.00 0.00 0.00 08:50:09 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 08:50:09 ens3 0.16 0.04 0.04 0.01 0.00 0.00 0.00 0.00 09:00:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 09:00:01 ens3 0.21 0.07 0.07 0.04 0.00 0.00 0.00 0.00 09:10:09 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 09:10:09 ens3 0.16 0.04 0.04 0.01 0.00 0.00 0.00 0.00 09:20:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 09:20:01 ens3 0.25 0.06 0.07 0.03 0.00 0.00 0.00 0.00 09:30:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 09:30:01 ens3 0.16 0.03 0.04 0.01 0.00 0.00 0.00 0.00 09:40:09 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 09:40:09 ens3 5.56 3.91 3.47 5.59 0.00 0.00 0.00 0.00 09:50:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 09:50:01 ens3 0.17 0.05 0.04 0.01 0.00 0.00 0.00 0.00 10:00:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 10:00:01 ens3 0.29 0.08 0.09 0.05 0.00 0.00 0.00 0.00 10:10:09 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 10:10:09 ens3 0.19 0.06 0.04 0.02 0.00 0.00 0.00 0.00 10:20:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 10:20:01 ens3 0.19 0.06 0.04 0.02 0.00 0.00 0.00 0.00 10:30:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 10:30:01 ens3 0.17 0.05 0.04 0.01 0.00 0.00 0.00 0.00 10:40:09 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 10:40:09 ens3 0.25 0.07 0.07 0.03 0.00 0.00 0.00 0.00 10:50:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 10:50:01 ens3 0.18 0.05 0.04 0.01 0.00 0.00 0.00 0.00 11:00:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 11:00:01 ens3 0.21 0.06 0.06 0.03 0.00 0.00 0.00 0.00 11:10:09 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 11:10:09 ens3 0.16 0.04 0.04 0.01 0.00 0.00 0.00 0.00 11:20:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 11:20:01 ens3 0.16 0.04 0.04 0.01 0.00 0.00 0.00 0.00 11:30:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 11:30:01 ens3 0.25 0.07 0.07 0.04 0.00 0.00 0.00 0.00 11:40:09 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 11:40:09 ens3 0.25 0.06 0.07 0.03 0.00 0.00 0.00 0.00 11:50:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 11:50:01 ens3 0.18 0.05 0.04 0.01 0.00 0.00 0.00 0.00 12:00:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 12:00:01 ens3 0.20 0.07 0.06 0.03 0.00 0.00 0.00 0.00 12:10:09 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 12:10:09 ens3 0.16 0.04 0.04 0.01 0.00 0.00 0.00 0.00 12:20:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 12:20:01 ens3 0.17 0.04 0.04 0.01 0.00 0.00 0.00 0.00 12:30:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 12:30:01 ens3 0.31 0.09 0.11 0.06 0.00 0.00 0.00 0.00 12:40:09 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 12:40:09 ens3 0.39 0.11 0.14 0.08 0.00 0.00 0.00 0.00 12:50:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 12:50:01 ens3 0.19 0.05 0.04 0.02 0.00 0.00 0.00 0.00 13:00:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 13:00:01 ens3 0.28 0.08 0.10 0.05 0.00 0.00 0.00 0.00 13:10:09 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 13:10:09 ens3 0.17 0.04 0.04 0.01 0.00 0.00 0.00 0.00 13:20:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 13:20:01 ens3 0.26 0.09 0.08 0.04 0.00 0.00 0.00 0.00 13:30:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 13:30:01 ens3 0.17 0.04 0.04 0.01 0.00 0.00 0.00 0.00 13:40:09 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 13:40:09 ens3 0.22 0.07 0.07 0.03 0.00 0.00 0.00 0.00 13:50:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 13:50:01 ens3 0.16 0.04 0.04 0.01 0.00 0.00 0.00 0.00 14:00:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 14:00:01 ens3 0.28 0.10 0.10 0.06 0.00 0.00 0.00 0.00 14:10:09 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 14:10:09 ens3 0.15 0.03 0.04 0.01 0.00 0.00 0.00 0.00 14:20:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 14:20:01 ens3 0.18 0.04 0.04 0.01 0.00 0.00 0.00 0.00 14:30:09 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 14:30:09 ens3 0.15 0.04 0.04 0.01 0.00 0.00 0.00 0.00 14:40:09 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 14:40:09 ens3 0.30 0.08 0.10 0.05 0.00 0.00 0.00 0.00 14:50:09 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 14:50:09 ens3 0.32 0.22 0.05 1.30 0.00 0.00 0.00 0.00 15:00:09 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 15:00:09 ens3 0.52 0.36 0.11 1.48 0.00 0.00 0.00 0.00 15:10:09 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 15:10:09 ens3 0.16 0.04 0.04 0.01 0.00 0.00 0.00 0.00 15:20:09 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 15:20:09 ens3 0.15 0.03 0.04 0.01 0.00 0.00 0.00 0.00 15:30:09 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 15:30:09 ens3 0.19 0.05 0.05 0.02 0.00 0.00 0.00 0.00 15:40:09 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 15:40:09 ens3 0.24 0.07 0.07 0.03 0.00 0.00 0.00 0.00 15:50:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 15:50:01 ens3 0.23 0.07 0.07 0.03 0.00 0.00 0.00 0.00 16:00:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 16:00:01 ens3 0.29 0.11 0.11 0.06 0.00 0.00 0.00 0.00 16:10:09 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 16:10:09 ens3 0.16 0.03 0.04 0.01 0.00 0.00 0.00 0.00 16:20:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 16:20:01 ens3 0.34 0.10 0.11 0.06 0.00 0.00 0.00 0.00 16:30:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 16:30:01 ens3 0.17 0.04 0.04 0.01 0.00 0.00 0.00 0.00 16:40:09 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 16:40:09 ens3 0.22 0.07 0.07 0.03 0.00 0.00 0.00 0.00 16:50:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 16:50:01 ens3 0.15 0.05 0.04 0.01 0.00 0.00 0.00 0.00 17:00:02 lo 1.01 1.01 0.05 0.05 0.00 0.00 0.00 0.00 17:00:02 ens3 0.21 0.08 0.07 0.04 0.00 0.00 0.00 0.00 17:10:16 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 17:10:16 ens3 0.15 0.04 0.04 0.01 0.00 0.00 0.00 0.00 17:20:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 17:20:01 ens3 0.15 0.04 0.04 0.01 0.00 0.00 0.00 0.00 17:30:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 17:30:01 ens3 0.15 0.04 0.04 0.01 0.00 0.00 0.00 0.00 17:40:09 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 17:40:09 ens3 0.29 0.09 0.10 0.05 0.00 0.00 0.00 0.00 17:50:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 17:50:01 ens3 0.26 0.07 0.07 0.03 0.00 0.00 0.00 0.00 18:00:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 18:00:01 ens3 0.20 0.06 0.07 0.03 0.00 0.00 0.00 0.00 18:10:09 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 18:10:09 ens3 0.15 0.04 0.04 0.01 0.00 0.00 0.00 0.00 18:20:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 18:20:01 ens3 0.18 0.04 0.04 0.01 0.00 0.00 0.00 0.00 18:30:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 18:30:01 ens3 0.22 0.06 0.07 0.03 0.00 0.00 0.00 0.00 18:40:16 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 18:40:16 ens3 0.22 0.06 0.07 0.03 0.00 0.00 0.00 0.00 18:50:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 18:50:01 ens3 0.17 0.05 0.04 0.02 0.00 0.00 0.00 0.00 19:00:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 19:00:01 ens3 0.21 0.07 0.07 0.03 0.00 0.00 0.00 0.00 19:10:09 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 19:10:09 ens3 0.22 0.06 0.07 0.03 0.00 0.00 0.00 0.00 19:20:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 19:20:01 ens3 0.25 0.07 0.08 0.04 0.00 0.00 0.00 0.00 19:30:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 19:30:01 ens3 0.22 0.06 0.07 0.03 0.00 0.00 0.00 0.00 19:40:09 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 19:40:09 ens3 0.27 0.06 0.07 0.03 0.00 0.00 0.00 0.00 19:50:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 19:50:01 ens3 0.16 0.05 0.04 0.01 0.00 0.00 0.00 0.00 20:00:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 20:00:01 ens3 0.31 0.10 0.10 0.05 0.00 0.00 0.00 0.00 20:10:09 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 20:10:09 ens3 0.23 0.05 0.07 0.03 0.00 0.00 0.00 0.00 20:20:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 20:20:01 ens3 0.16 0.05 0.04 0.02 0.00 0.00 0.00 0.00 20:30:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 20:30:01 ens3 0.25 0.07 0.08 0.04 0.00 0.00 0.00 0.00 20:40:09 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 20:40:09 ens3 0.27 0.07 0.08 0.04 0.00 0.00 0.00 0.00 20:50:02 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 20:50:02 ens3 0.16 0.03 0.04 0.01 0.00 0.00 0.00 0.00 21:00:09 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 21:00:09 ens3 0.31 0.10 0.10 0.06 0.00 0.00 0.00 0.00 21:10:16 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 21:10:16 ens3 0.19 0.04 0.04 0.01 0.00 0.00 0.00 0.00 21:20:09 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 21:20:09 ens3 0.16 0.04 0.04 0.01 0.00 0.00 0.00 0.00 21:30:09 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 21:30:09 ens3 0.15 0.04 0.04 0.01 0.00 0.00 0.00 0.00 21:40:09 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 21:40:09 ens3 0.24 0.06 0.07 0.03 0.00 0.00 0.00 0.00 21:50:09 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 21:50:09 ens3 0.15 0.04 0.04 0.01 0.00 0.00 0.00 0.00 22:00:09 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 22:00:09 ens3 0.46 0.29 0.11 1.34 0.00 0.00 0.00 0.00 22:10:09 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 22:10:09 ens3 0.16 0.05 0.04 0.13 0.00 0.00 0.00 0.00 22:20:09 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 22:20:09 ens3 0.36 0.10 0.11 0.05 0.00 0.00 0.00 0.00 22:30:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 22:30:01 ens3 0.29 0.06 0.08 0.04 0.00 0.00 0.00 0.00 22:40:09 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 22:40:09 ens3 0.31 0.07 0.10 0.05 0.00 0.00 0.00 0.00 22:50:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 22:50:01 ens3 0.16 0.04 0.04 0.01 0.00 0.00 0.00 0.00 23:00:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 23:00:01 ens3 0.20 0.05 0.06 0.03 0.00 0.00 0.00 0.00 23:10:09 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 23:10:09 ens3 0.14 0.03 0.04 0.01 0.00 0.00 0.00 0.00 23:20:01 lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 23:20:01 ens3 0.17 0.04 0.05 0.01 0.00 0.00 0.00 0.00 23:30:01 lo 1.09 1.09 0.06 0.06 0.00 0.00 0.00 0.00 23:30:01 ens3 23.92 16.61 155.82 4.79 0.00 0.00 0.00 0.00 Average: lo 1.00 1.00 0.05 0.05 0.00 0.00 0.00 0.00 Average: ens3 0.51 0.24 1.48 0.16 0.00 0.00 0.00 0.00 ---> sar -P ALL: Linux 6.8.0-90-generic (prd-ubuntu2404-robot-2c-8g-4562) 04/19/26 _x86_64_ (2 CPU) 03:27:08 LINUX RESTART (2 CPU) 03:30:01 CPU %user %nice %system %iowait %steal %idle 03:40:09 all 0.36 0.00 0.11 0.03 0.03 99.47 03:40:09 0 0.25 0.00 0.12 0.03 0.05 99.56 03:40:09 1 0.46 0.00 0.11 0.03 0.02 99.38 03:50:01 all 0.27 0.00 0.07 0.01 0.02 99.62 03:50:01 0 0.42 0.00 0.06 0.00 0.02 99.50 03:50:01 1 0.11 0.00 0.09 0.02 0.03 99.75 04:00:01 all 0.24 0.00 0.18 0.04 0.02 99.52 04:00:01 0 0.07 0.00 0.21 0.06 0.02 99.64 04:00:01 1 0.42 0.00 0.16 0.01 0.02 99.39 04:10:09 all 0.26 0.00 0.07 0.01 0.02 99.64 04:10:09 0 0.06 0.00 0.09 0.01 0.02 99.82 04:10:09 1 0.46 0.00 0.05 0.01 0.02 99.46 04:20:01 all 0.22 0.00 0.08 0.01 0.02 99.66 04:20:01 0 0.07 0.00 0.09 0.01 0.02 99.81 04:20:01 1 0.38 0.00 0.08 0.01 0.02 99.51 04:30:01 all 0.27 0.00 0.15 0.01 0.02 99.54 04:30:01 0 0.24 0.00 0.15 0.02 0.02 99.58 04:30:01 1 0.30 0.00 0.16 0.01 0.02 99.51 04:40:09 all 0.24 0.00 0.06 0.01 0.02 99.66 04:40:09 0 0.39 0.00 0.04 0.01 0.01 99.54 04:40:09 1 0.10 0.00 0.08 0.01 0.03 99.79 04:50:01 all 0.18 0.00 0.07 0.01 0.02 99.72 04:50:01 0 0.22 0.00 0.06 0.02 0.02 99.68 04:50:01 1 0.14 0.00 0.07 0.01 0.02 99.76 05:00:01 all 0.27 0.00 0.15 0.01 0.02 99.55 05:00:01 0 0.27 0.00 0.14 0.01 0.02 99.56 05:00:01 1 0.28 0.00 0.15 0.01 0.02 99.54 05:10:09 all 0.23 0.00 0.06 0.01 0.02 99.67 05:10:09 0 0.04 0.00 0.08 0.01 0.03 99.85 05:10:09 1 0.42 0.00 0.04 0.01 0.01 99.50 05:20:01 all 0.23 0.18 0.13 0.14 0.02 99.30 05:20:01 0 0.04 0.19 0.16 0.15 0.02 99.43 05:20:01 1 0.41 0.16 0.11 0.14 0.01 99.16 05:20:01 CPU %user %nice %system %iowait %steal %idle 05:30:01 all 0.26 0.00 0.15 0.01 0.02 99.56 05:30:01 0 0.26 0.00 0.16 0.01 0.02 99.56 05:30:01 1 0.27 0.00 0.14 0.02 0.02 99.56 05:40:09 all 0.24 0.00 0.08 0.01 0.02 99.65 05:40:09 0 0.43 0.00 0.06 0.01 0.01 99.48 05:40:09 1 0.05 0.00 0.10 0.02 0.03 99.81 05:50:01 all 0.24 0.00 0.06 0.01 0.02 99.67 05:50:01 0 0.28 0.00 0.05 0.02 0.02 99.63 05:50:01 1 0.21 0.00 0.07 0.01 0.02 99.70 06:00:01 all 0.25 0.00 0.16 0.01 0.02 99.56 06:00:01 0 0.27 0.00 0.15 0.01 0.02 99.55 06:00:01 1 0.23 0.00 0.16 0.01 0.02 99.58 06:10:09 all 0.23 0.00 0.06 0.05 0.04 99.62 06:10:09 0 0.37 0.00 0.05 0.00 0.02 99.57 06:10:09 1 0.10 0.00 0.08 0.09 0.05 99.68 06:20:01 all 0.24 0.00 0.06 0.01 0.02 99.67 06:20:01 0 0.44 0.00 0.04 0.01 0.01 99.50 06:20:01 1 0.04 0.00 0.08 0.01 0.03 99.84 06:30:01 all 0.26 0.00 0.15 0.01 0.02 99.57 06:30:01 0 0.45 0.00 0.13 0.02 0.01 99.39 06:30:01 1 0.06 0.00 0.16 0.00 0.03 99.74 06:40:09 all 0.21 0.00 0.06 0.01 0.02 99.70 06:40:09 0 0.32 0.00 0.04 0.01 0.01 99.61 06:40:09 1 0.10 0.00 0.08 0.00 0.03 99.79 06:50:01 all 0.23 0.00 0.07 0.01 0.02 99.67 06:50:01 0 0.41 0.00 0.05 0.02 0.02 99.51 06:50:01 1 0.05 0.00 0.09 0.01 0.03 99.82 07:00:01 all 0.30 0.00 0.16 0.01 0.02 99.51 07:00:01 0 0.36 0.00 0.17 0.02 0.02 99.44 07:00:01 1 0.23 0.00 0.15 0.01 0.02 99.59 07:10:09 all 0.22 0.00 0.06 0.01 0.02 99.68 07:10:09 0 0.41 0.00 0.04 0.02 0.01 99.53 07:10:09 1 0.04 0.00 0.09 0.00 0.03 99.84 07:10:09 CPU %user %nice %system %iowait %steal %idle 07:20:01 all 0.23 0.00 0.07 0.01 0.02 99.68 07:20:01 0 0.16 0.00 0.07 0.01 0.02 99.74 07:20:01 1 0.30 0.00 0.06 0.01 0.02 99.61 07:30:01 all 0.26 0.00 0.15 0.01 0.02 99.55 07:30:01 0 0.21 0.00 0.17 0.00 0.02 99.59 07:30:01 1 0.32 0.00 0.13 0.02 0.02 99.51 07:40:09 all 0.23 0.00 0.08 0.01 0.02 99.66 07:40:09 0 0.35 0.00 0.05 0.01 0.01 99.57 07:40:09 1 0.11 0.00 0.10 0.01 0.03 99.75 07:50:09 all 0.24 0.00 0.06 0.01 0.02 99.66 07:50:09 0 0.45 0.00 0.04 0.01 0.02 99.49 07:50:09 1 0.04 0.00 0.08 0.02 0.03 99.84 08:00:09 all 0.27 0.00 0.17 0.01 0.02 99.53 08:00:09 0 0.10 0.00 0.17 0.02 0.03 99.68 08:00:09 1 0.44 0.00 0.16 0.01 0.02 99.38 08:10:09 all 0.23 0.00 0.07 0.01 0.02 99.67 08:10:09 0 0.41 0.00 0.06 0.02 0.02 99.49 08:10:09 1 0.06 0.00 0.07 0.00 0.03 99.85 08:20:09 all 0.25 0.00 0.07 0.01 0.02 99.65 08:20:09 0 0.42 0.00 0.04 0.00 0.01 99.52 08:20:09 1 0.08 0.00 0.09 0.03 0.03 99.78 08:30:09 all 0.28 0.00 0.15 0.01 0.02 99.54 08:30:09 0 0.15 0.00 0.15 0.02 0.03 99.65 08:30:09 1 0.40 0.00 0.14 0.01 0.02 99.43 08:40:09 all 0.24 0.00 0.08 0.01 0.02 99.65 08:40:09 0 0.44 0.00 0.06 0.02 0.01 99.47 08:40:09 1 0.05 0.00 0.09 0.01 0.03 99.82 08:50:09 all 0.25 0.00 0.06 0.02 0.02 99.65 08:50:09 0 0.42 0.00 0.04 0.01 0.02 99.53 08:50:09 1 0.09 0.00 0.08 0.02 0.03 99.77 09:00:01 all 0.26 0.00 0.16 0.01 0.02 99.54 09:00:01 0 0.36 0.00 0.15 0.02 0.02 99.45 09:00:01 1 0.16 0.00 0.17 0.01 0.03 99.63 09:00:01 CPU %user %nice %system %iowait %steal %idle 09:10:09 all 0.23 0.00 0.07 0.01 0.02 99.67 09:10:09 0 0.25 0.00 0.08 0.02 0.02 99.62 09:10:09 1 0.21 0.00 0.05 0.01 0.02 99.71 09:20:01 all 0.24 0.00 0.06 0.01 0.02 99.66 09:20:01 0 0.24 0.00 0.06 0.01 0.02 99.68 09:20:01 1 0.25 0.00 0.07 0.02 0.03 99.64 09:30:01 all 0.25 0.00 0.16 0.01 0.02 99.56 09:30:01 0 0.07 0.00 0.18 0.01 0.03 99.71 09:30:01 1 0.43 0.00 0.13 0.02 0.02 99.41 09:40:09 all 0.38 0.00 0.08 0.01 0.02 99.51 09:40:09 0 0.27 0.00 0.11 0.01 0.03 99.57 09:40:09 1 0.48 0.00 0.06 0.01 0.01 99.44 09:50:01 all 0.23 0.00 0.06 0.01 0.02 99.68 09:50:01 0 0.42 0.00 0.04 0.01 0.01 99.52 09:50:01 1 0.04 0.00 0.08 0.02 0.03 99.84 10:00:01 all 0.26 0.00 0.17 0.42 0.02 99.14 10:00:01 0 0.31 0.00 0.17 0.08 0.02 99.42 10:00:01 1 0.21 0.00 0.18 0.75 0.02 98.85 10:10:09 all 0.25 0.00 0.07 0.37 0.01 99.30 10:10:09 0 0.30 0.00 0.06 0.26 0.01 99.37 10:10:09 1 0.19 0.00 0.08 0.48 0.01 99.23 10:20:01 all 0.25 0.00 0.07 0.54 0.01 99.12 10:20:01 0 0.23 0.00 0.06 0.72 0.02 98.97 10:20:01 1 0.28 0.00 0.08 0.36 0.01 99.27 10:30:01 all 0.26 0.00 0.17 0.28 0.01 99.27 10:30:01 0 0.12 0.00 0.19 0.39 0.02 99.29 10:30:01 1 0.41 0.00 0.15 0.18 0.01 99.25 10:40:09 all 0.25 0.00 0.08 0.01 0.01 99.64 10:40:09 0 0.08 0.00 0.10 0.01 0.02 99.80 10:40:09 1 0.43 0.00 0.07 0.00 0.01 99.49 10:50:01 all 0.26 0.00 0.07 0.03 0.01 99.63 10:50:01 0 0.07 0.00 0.10 0.03 0.02 99.79 10:50:01 1 0.45 0.00 0.05 0.03 0.01 99.47 10:50:01 CPU %user %nice %system %iowait %steal %idle 11:00:01 all 0.30 0.00 0.18 0.07 0.04 99.40 11:00:01 0 0.22 0.00 0.19 0.12 0.02 99.45 11:00:01 1 0.38 0.00 0.17 0.02 0.07 99.36 11:10:09 all 0.25 0.00 0.08 0.07 0.04 99.56 11:10:09 0 0.19 0.00 0.08 0.10 0.05 99.58 11:10:09 1 0.31 0.00 0.09 0.04 0.03 99.54 11:20:01 all 0.22 0.00 0.09 0.06 0.02 99.61 11:20:01 0 0.07 0.00 0.11 0.11 0.02 99.70 11:20:01 1 0.38 0.00 0.07 0.02 0.01 99.52 11:30:01 all 0.26 0.00 0.17 0.01 0.02 99.55 11:30:01 0 0.20 0.00 0.19 0.01 0.02 99.58 11:30:01 1 0.31 0.00 0.14 0.01 0.02 99.52 11:40:09 all 0.23 0.00 0.07 0.01 0.02 99.68 11:40:09 0 0.23 0.00 0.07 0.00 0.02 99.68 11:40:09 1 0.23 0.00 0.06 0.01 0.01 99.68 11:50:01 all 0.27 0.00 0.08 0.01 0.02 99.62 11:50:01 0 0.41 0.00 0.05 0.01 0.02 99.51 11:50:01 1 0.13 0.00 0.11 0.01 0.03 99.73 12:00:01 all 0.27 0.00 0.17 0.01 0.03 99.52 12:00:01 0 0.46 0.00 0.16 0.01 0.02 99.36 12:00:01 1 0.08 0.00 0.19 0.01 0.04 99.68 12:10:09 all 0.25 0.00 0.07 0.01 0.03 99.65 12:10:09 0 0.32 0.00 0.06 0.00 0.02 99.60 12:10:09 1 0.18 0.00 0.08 0.01 0.03 99.70 12:20:01 all 0.25 0.00 0.07 0.01 0.03 99.65 12:20:01 0 0.06 0.00 0.09 0.02 0.03 99.80 12:20:01 1 0.43 0.00 0.06 0.00 0.02 99.49 12:30:01 all 0.26 0.00 0.15 0.01 0.03 99.54 12:30:01 0 0.21 0.00 0.18 0.01 0.03 99.57 12:30:01 1 0.32 0.00 0.13 0.01 0.03 99.51 12:40:09 all 0.25 0.00 0.07 0.01 0.03 99.64 12:40:09 0 0.05 0.00 0.10 0.01 0.05 99.80 12:40:09 1 0.46 0.00 0.04 0.01 0.02 99.48 12:40:09 CPU %user %nice %system %iowait %steal %idle 12:50:01 all 0.23 0.00 0.07 0.01 0.03 99.67 12:50:01 0 0.05 0.00 0.09 0.01 0.04 99.81 12:50:01 1 0.40 0.00 0.05 0.01 0.02 99.52 13:00:01 all 0.23 0.00 0.16 0.04 0.03 99.55 13:00:01 0 0.22 0.00 0.17 0.04 0.03 99.54 13:00:01 1 0.24 0.00 0.14 0.04 0.03 99.55 13:10:09 all 0.24 0.00 0.08 0.36 0.02 99.30 13:10:09 0 0.31 0.00 0.07 0.53 0.02 99.07 13:10:09 1 0.16 0.00 0.09 0.19 0.03 99.53 13:20:01 all 0.24 0.00 0.08 0.16 0.02 99.49 13:20:01 0 0.15 0.00 0.09 0.19 0.03 99.54 13:20:01 1 0.34 0.00 0.08 0.13 0.02 99.44 13:30:01 all 0.30 0.00 0.16 0.01 0.02 99.51 13:30:01 0 0.39 0.00 0.14 0.01 0.02 99.44 13:30:01 1 0.21 0.00 0.18 0.00 0.03 99.57 13:40:09 all 0.24 0.00 0.07 0.01 0.02 99.65 13:40:09 0 0.07 0.00 0.09 0.01 0.03 99.81 13:40:09 1 0.41 0.00 0.06 0.02 0.02 99.49 13:50:01 all 0.28 0.00 0.09 0.03 0.04 99.57 13:50:01 0 0.07 0.00 0.10 0.04 0.05 99.75 13:50:01 1 0.48 0.00 0.08 0.02 0.03 99.39 14:00:01 all 0.28 0.00 0.18 0.01 0.03 99.50 14:00:01 0 0.29 0.00 0.17 0.01 0.03 99.50 14:00:01 1 0.28 0.00 0.18 0.01 0.03 99.51 14:10:09 all 0.27 0.00 0.08 0.01 0.03 99.62 14:10:09 0 0.47 0.00 0.06 0.00 0.02 99.45 14:10:09 1 0.07 0.00 0.10 0.01 0.03 99.79 14:20:01 all 0.22 0.00 0.09 0.02 0.02 99.65 14:20:01 0 0.37 0.00 0.08 0.01 0.02 99.53 14:20:01 1 0.07 0.00 0.10 0.03 0.03 99.77 14:30:09 all 0.27 0.00 0.17 0.01 0.02 99.54 14:30:09 0 0.14 0.00 0.17 0.01 0.02 99.67 14:30:09 1 0.40 0.00 0.17 0.00 0.01 99.41 14:30:09 CPU %user %nice %system %iowait %steal %idle 14:40:09 all 0.23 0.00 0.07 0.01 0.02 99.67 14:40:09 0 0.11 0.00 0.09 0.01 0.02 99.78 14:40:09 1 0.35 0.00 0.06 0.01 0.02 99.57 14:50:09 all 0.16 0.00 0.08 0.01 0.02 99.73 14:50:09 0 0.28 0.00 0.07 0.01 0.02 99.63 14:50:09 1 0.05 0.00 0.09 0.01 0.03 99.83 15:00:09 all 0.10 0.00 0.16 0.01 0.02 99.71 15:00:09 0 0.06 0.00 0.17 0.02 0.02 99.73 15:00:09 1 0.14 0.00 0.15 0.01 0.02 99.69 15:10:09 all 0.24 0.00 0.06 0.01 0.02 99.67 15:10:09 0 0.04 0.00 0.07 0.01 0.02 99.86 15:10:09 1 0.45 0.00 0.05 0.01 0.02 99.47 15:20:09 all 0.25 0.00 0.07 0.01 0.02 99.66 15:20:09 0 0.03 0.00 0.08 0.01 0.02 99.86 15:20:09 1 0.46 0.00 0.05 0.01 0.02 99.47 15:30:09 all 0.24 0.00 0.16 0.01 0.02 99.57 15:30:09 0 0.24 0.00 0.17 0.02 0.02 99.55 15:30:09 1 0.24 0.00 0.15 0.00 0.02 99.60 15:40:09 all 0.24 0.00 0.06 0.01 0.02 99.67 15:40:09 0 0.40 0.00 0.04 0.01 0.02 99.53 15:40:09 1 0.08 0.00 0.08 0.00 0.03 99.81 15:50:01 all 0.25 0.00 0.07 0.01 0.02 99.65 15:50:01 0 0.21 0.00 0.07 0.01 0.02 99.69 15:50:01 1 0.30 0.00 0.07 0.01 0.02 99.60 16:00:01 all 0.25 0.00 0.16 0.01 0.02 99.57 16:00:01 0 0.18 0.00 0.17 0.01 0.02 99.62 16:00:01 1 0.32 0.00 0.15 0.01 0.02 99.51 16:10:09 all 0.22 0.00 0.07 0.01 0.02 99.68 16:10:09 0 0.41 0.00 0.04 0.01 0.01 99.52 16:10:09 1 0.03 0.00 0.09 0.01 0.03 99.84 16:20:01 all 0.24 0.00 0.06 0.01 0.02 99.67 16:20:01 0 0.43 0.00 0.04 0.01 0.02 99.51 16:20:01 1 0.04 0.00 0.08 0.01 0.03 99.83 16:20:01 CPU %user %nice %system %iowait %steal %idle 16:30:01 all 0.21 0.00 0.16 0.01 0.02 99.61 16:30:01 0 0.35 0.00 0.14 0.01 0.02 99.48 16:30:01 1 0.06 0.00 0.17 0.01 0.03 99.73 16:40:09 all 0.22 0.00 0.07 0.01 0.02 99.69 16:40:09 0 0.40 0.00 0.04 0.01 0.01 99.54 16:40:09 1 0.04 0.00 0.09 0.00 0.03 99.84 16:50:01 all 0.22 0.00 0.07 0.01 0.02 99.68 16:50:01 0 0.39 0.00 0.06 0.01 0.01 99.52 16:50:01 1 0.04 0.00 0.08 0.01 0.03 99.84 17:00:02 all 0.24 0.00 0.15 0.01 0.02 99.58 17:00:02 0 0.38 0.00 0.15 0.02 0.01 99.45 17:00:02 1 0.10 0.00 0.16 0.01 0.03 99.72 17:10:16 all 0.21 0.00 0.07 0.01 0.02 99.69 17:10:16 0 0.12 0.00 0.08 0.00 0.02 99.77 17:10:16 1 0.29 0.00 0.07 0.01 0.02 99.61 17:20:01 all 0.22 0.00 0.06 0.01 0.02 99.69 17:20:01 0 0.12 0.00 0.08 0.00 0.02 99.78 17:20:01 1 0.32 0.00 0.05 0.01 0.02 99.60 17:30:01 all 0.24 0.00 0.15 0.01 0.02 99.58 17:30:01 0 0.25 0.00 0.14 0.01 0.02 99.57 17:30:01 1 0.24 0.00 0.15 0.01 0.02 99.58 17:40:09 all 0.24 0.00 0.06 0.01 0.02 99.67 17:40:09 0 0.44 0.00 0.06 0.00 0.02 99.48 17:40:09 1 0.03 0.00 0.07 0.01 0.02 99.86 17:50:01 all 0.22 0.00 0.07 0.01 0.02 99.68 17:50:01 0 0.40 0.00 0.05 0.02 0.02 99.52 17:50:01 1 0.03 0.00 0.09 0.01 0.02 99.85 18:00:01 all 0.25 0.00 0.15 0.01 0.02 99.57 18:00:01 0 0.36 0.00 0.15 0.01 0.02 99.47 18:00:01 1 0.15 0.00 0.15 0.01 0.03 99.67 18:10:09 all 0.24 0.00 0.06 0.01 0.02 99.67 18:10:09 0 0.04 0.00 0.08 0.01 0.03 99.84 18:10:09 1 0.43 0.00 0.04 0.01 0.01 99.51 18:10:09 CPU %user %nice %system %iowait %steal %idle 18:20:01 all 0.22 0.00 0.06 0.01 0.02 99.69 18:20:01 0 0.04 0.00 0.08 0.01 0.03 99.85 18:20:01 1 0.41 0.00 0.05 0.00 0.02 99.52 18:30:01 all 0.24 0.00 0.15 0.01 0.02 99.59 18:30:01 0 0.07 0.00 0.17 0.01 0.03 99.73 18:30:01 1 0.41 0.00 0.12 0.01 0.02 99.45 18:40:16 all 0.25 0.00 0.07 0.01 0.02 99.65 18:40:16 0 0.08 0.00 0.09 0.01 0.03 99.80 18:40:16 1 0.42 0.00 0.06 0.01 0.01 99.50 18:50:01 all 0.25 0.00 0.06 0.01 0.02 99.66 18:50:01 0 0.45 0.00 0.04 0.01 0.01 99.48 18:50:01 1 0.04 0.00 0.08 0.00 0.03 99.84 19:00:01 all 0.26 0.00 0.15 0.01 0.02 99.56 19:00:01 0 0.37 0.00 0.15 0.01 0.02 99.45 19:00:01 1 0.14 0.00 0.16 0.00 0.02 99.68 19:10:09 all 0.23 0.00 0.07 0.01 0.02 99.67 19:10:09 0 0.17 0.00 0.07 0.01 0.02 99.73 19:10:09 1 0.29 0.00 0.07 0.01 0.02 99.61 19:20:01 all 0.24 0.00 0.06 0.01 0.02 99.67 19:20:01 0 0.04 0.00 0.08 0.01 0.03 99.84 19:20:01 1 0.44 0.00 0.04 0.01 0.02 99.50 19:30:01 all 0.29 0.00 0.17 0.01 0.02 99.51 19:30:01 0 0.13 0.00 0.18 0.02 0.02 99.66 19:30:01 1 0.45 0.00 0.15 0.01 0.02 99.37 19:40:09 all 0.23 0.00 0.06 0.01 0.02 99.67 19:40:09 0 0.42 0.00 0.03 0.01 0.01 99.53 19:40:09 1 0.05 0.00 0.09 0.01 0.03 99.82 19:50:01 all 0.21 0.00 0.07 0.01 0.02 99.69 19:50:01 0 0.39 0.00 0.06 0.00 0.02 99.53 19:50:01 1 0.03 0.00 0.08 0.01 0.03 99.84 20:00:01 all 0.24 0.00 0.15 0.01 0.02 99.57 20:00:01 0 0.24 0.00 0.15 0.01 0.02 99.58 20:00:01 1 0.25 0.00 0.15 0.01 0.03 99.56 20:00:01 CPU %user %nice %system %iowait %steal %idle 20:10:09 all 0.22 0.00 0.07 0.01 0.02 99.68 20:10:09 0 0.05 0.00 0.09 0.00 0.03 99.83 20:10:09 1 0.39 0.00 0.04 0.01 0.01 99.54 20:20:01 all 0.22 0.00 0.07 0.01 0.02 99.68 20:20:01 0 0.16 0.00 0.09 0.01 0.02 99.73 20:20:01 1 0.28 0.00 0.06 0.01 0.02 99.63 20:30:01 all 0.23 0.00 0.15 0.02 0.07 99.53 20:30:01 0 0.24 0.00 0.14 0.00 0.08 99.54 20:30:01 1 0.22 0.00 0.16 0.05 0.06 99.51 20:40:09 all 0.24 0.00 0.08 0.47 0.02 99.19 20:40:09 0 0.42 0.00 0.04 0.88 0.01 98.65 20:40:09 1 0.07 0.00 0.11 0.07 0.02 99.73 20:50:02 all 0.26 0.00 0.09 0.50 0.02 99.13 20:50:02 0 0.30 0.00 0.08 0.27 0.02 99.33 20:50:02 1 0.21 0.00 0.11 0.74 0.02 98.93 21:00:09 all 0.28 0.00 0.19 0.45 0.02 99.06 21:00:09 0 0.20 0.00 0.21 0.11 0.02 99.46 21:00:09 1 0.36 0.00 0.17 0.80 0.02 98.65 21:10:16 all 0.28 0.00 0.10 0.13 0.02 99.47 21:10:16 0 0.36 0.00 0.09 0.06 0.02 99.47 21:10:16 1 0.19 0.00 0.12 0.20 0.02 99.46 21:20:09 all 0.27 0.00 0.09 0.09 0.02 99.53 21:20:09 0 0.08 0.00 0.10 0.08 0.02 99.73 21:20:09 1 0.45 0.00 0.09 0.10 0.02 99.34 21:30:09 all 0.28 0.00 0.20 0.13 0.02 99.36 21:30:09 0 0.20 0.00 0.21 0.01 0.02 99.57 21:30:09 1 0.36 0.00 0.19 0.26 0.02 99.15 21:40:09 all 0.27 0.00 0.09 0.09 0.02 99.53 21:40:09 0 0.32 0.00 0.07 0.14 0.02 99.46 21:40:09 1 0.23 0.00 0.11 0.05 0.02 99.60 21:50:09 all 0.25 0.00 0.09 0.01 0.02 99.64 21:50:09 0 0.09 0.00 0.10 0.01 0.02 99.79 21:50:09 1 0.41 0.00 0.08 0.01 0.02 99.49 21:50:09 CPU %user %nice %system %iowait %steal %idle 22:00:09 all 0.23 0.00 0.18 0.10 0.02 99.47 22:00:09 0 0.15 0.00 0.19 0.12 0.02 99.53 22:00:09 1 0.31 0.00 0.17 0.09 0.02 99.42 22:10:09 all 0.19 0.00 0.07 0.01 0.02 99.72 22:10:09 0 0.33 0.00 0.07 0.01 0.02 99.57 22:10:09 1 0.04 0.00 0.07 0.01 0.02 99.87 22:20:09 all 0.20 0.00 0.07 0.01 0.02 99.71 22:20:09 0 0.18 0.00 0.05 0.00 0.02 99.75 22:20:09 1 0.22 0.00 0.09 0.01 0.02 99.66 22:30:01 all 0.28 0.00 0.17 0.01 0.02 99.53 22:30:01 0 0.11 0.00 0.17 0.02 0.02 99.69 22:30:01 1 0.45 0.00 0.16 0.00 0.02 99.36 22:40:09 all 0.23 0.00 0.06 0.01 0.02 99.68 22:40:09 0 0.13 0.00 0.07 0.01 0.02 99.76 22:40:09 1 0.33 0.00 0.05 0.00 0.01 99.60 22:50:01 all 0.27 0.00 0.06 0.01 0.02 99.65 22:50:01 0 0.49 0.00 0.04 0.01 0.02 99.45 22:50:01 1 0.04 0.00 0.08 0.01 0.02 99.85 23:00:01 all 0.28 0.00 0.15 0.01 0.01 99.55 23:00:01 0 0.27 0.00 0.15 0.00 0.01 99.57 23:00:01 1 0.30 0.00 0.15 0.01 0.02 99.52 23:10:09 all 0.23 0.00 0.06 0.01 0.02 99.68 23:10:09 0 0.05 0.00 0.07 0.00 0.02 99.84 23:10:09 1 0.41 0.00 0.04 0.01 0.02 99.52 23:20:01 all 0.19 0.00 0.06 0.01 0.02 99.72 23:20:01 0 0.04 0.00 0.08 0.00 0.02 99.86 23:20:01 1 0.33 0.00 0.05 0.01 0.02 99.59 23:30:01 all 4.12 0.00 0.68 0.20 0.03 94.97 23:30:01 0 5.22 0.00 0.79 0.23 0.03 93.73 23:30:01 1 3.01 0.00 0.58 0.17 0.03 96.22 Average: all 0.28 0.00 0.11 0.05 0.02 99.54 Average: 0 0.29 0.00 0.11 0.05 0.02 99.54 Average: 1 0.27 0.00 0.11 0.05 0.02 99.55