Started by upstream project "integration-distribution-test-titanium" build number 663 originally caused by: Started by upstream project "autorelease-release-titanium-mvn39-openjdk21" build number 548 originally caused by: Started by timer Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on prd-centos8-robot-2c-8g-20335 (centos8-robot-2c-8g) in workspace /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-titanium [ssh-agent] Looking for ssh-agent implementation... [ssh-agent] Exec ssh-agent (binary ssh-agent on a remote machine) $ ssh-agent SSH_AUTH_SOCK=/tmp/ssh-jrtAWZUAcuNn/agent.5283 SSH_AGENT_PID=5284 [ssh-agent] Started. Running ssh-add (command line suppressed) Identity added: /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-titanium@tmp/private_key_12192445729056052668.key (/w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-titanium@tmp/private_key_12192445729056052668.key) [ssh-agent] Using credentials jenkins (Release Engineering Jenkins Key) The recommended git tool is: NONE using credential opendaylight-jenkins-ssh Wiping out workspace first. Cloning the remote Git repository Cloning repository git://devvexx.opendaylight.org/mirror/integration/test > git init /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-titanium/test # timeout=10 Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test > git --version # timeout=10 > git --version # 'git version 2.43.0' using GIT_SSH to set credentials Release Engineering Jenkins Key [INFO] Currently running in a labeled security context [INFO] Currently SELinux is 'enforcing' on the host > /usr/bin/chcon --type=ssh_home_t /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-titanium/test@tmp/jenkins-gitclient-ssh9203883183558156273.key Verifying host key using known hosts file You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification. > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10 Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test using GIT_SSH to set credentials Release Engineering Jenkins Key [INFO] Currently running in a labeled security context [INFO] Currently SELinux is 'enforcing' on the host > /usr/bin/chcon --type=ssh_home_t /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-titanium/test@tmp/jenkins-gitclient-ssh3934593057278490788.key Verifying host key using known hosts file You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification. > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test master # timeout=10 > git rev-parse FETCH_HEAD^{commit} # timeout=10 Checking out Revision f65244a2a093016c71f9a7a564be7d086941e15c (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f f65244a2a093016c71f9a7a564be7d086941e15c # timeout=10 Commit message: "Fix netconf cluster test with RESTCONF_ROOT" > git rev-parse FETCH_HEAD^{commit} # timeout=10 > git rev-list --no-walk cc140aba40d20c279ad305eb08204917e9a97348 # timeout=10 No emails were triggered. provisioning config files... copy managed file [npmrc] to file:/home/jenkins/.npmrc copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml [openflowplugin-csit-3node-clustering-bulkomatic-only-titanium] $ /bin/bash /tmp/jenkins9732674958328219141.sh ---> python-tools-install.sh Setup pyenv: system * 3.8.13 (set by /opt/pyenv/version) * 3.9.13 (set by /opt/pyenv/version) * 3.10.13 (set by /opt/pyenv/version) * 3.11.7 (set by /opt/pyenv/version) lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-AO6W lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) lf-activate-venv(): INFO: Attempting to install with network-safe options... lf-activate-venv(): INFO: Base packages installed successfully lf-activate-venv(): INFO: Installing additional packages: lftools lf-activate-venv(): INFO: Adding /tmp/venv-AO6W/bin to PATH Generating Requirements File ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. httplib2 0.30.2 requires pyparsing<4,>=3.0.4, but you have pyparsing 2.4.7 which is incompatible. Python 3.11.7 pip 26.0.1 from /tmp/venv-AO6W/lib/python3.11/site-packages/pip (python 3.11) appdirs==1.4.4 argcomplete==3.6.3 aspy.yaml==1.3.0 attrs==25.4.0 autopage==0.6.0 beautifulsoup4==4.14.3 boto3==1.42.55 botocore==1.42.55 bs4==0.0.2 certifi==2026.1.4 cffi==2.0.0 cfgv==3.5.0 chardet==6.0.0.post1 charset-normalizer==3.4.4 click==8.3.1 cliff==4.13.2 cmd2==3.2.2 cryptography==3.3.2 debtcollector==3.0.0 decorator==5.2.1 defusedxml==0.7.1 Deprecated==1.3.1 distlib==0.4.0 dnspython==2.8.0 docker==7.1.0 dogpile.cache==1.5.0 durationpy==0.10 email-validator==2.3.0 filelock==3.24.3 future==1.0.0 gitdb==4.0.12 GitPython==3.1.46 httplib2==0.30.2 identify==2.6.16 idna==3.11 importlib-resources==1.5.0 iso8601==2.1.0 Jinja2==3.1.6 jmespath==1.1.0 jsonpatch==1.33 jsonpointer==3.0.0 jsonschema==4.26.0 jsonschema-specifications==2025.9.1 keystoneauth1==5.13.1 kubernetes==35.0.0 lftools==0.37.21 lxml==6.0.2 markdown-it-py==4.0.0 MarkupSafe==3.0.3 mdurl==0.1.2 msgpack==1.1.2 multi_key_dict==2.0.3 munch==4.0.0 netaddr==1.3.0 niet==1.4.2 nodeenv==1.10.0 oauth2client==4.1.3 oauthlib==3.3.1 openstacksdk==4.10.0 os-service-types==1.8.2 osc-lib==4.4.0 oslo.config==10.3.0 oslo.context==6.3.0 oslo.i18n==6.7.2 oslo.log==8.1.0 oslo.serialization==5.9.1 oslo.utils==10.0.0 packaging==26.0 pbr==7.0.3 platformdirs==4.9.2 prettytable==3.17.0 psutil==7.2.2 pyasn1==0.6.2 pyasn1_modules==0.4.2 pycparser==3.0 pygerrit2==2.0.15 PyGithub==2.8.1 Pygments==2.19.2 PyJWT==2.11.0 PyNaCl==1.6.2 pyparsing==2.4.7 pyperclip==1.11.0 pyrsistent==0.20.0 python-cinderclient==9.8.0 python-dateutil==2.9.0.post0 python-heatclient==5.0.0 python-jenkins==1.8.3 python-keystoneclient==5.7.0 python-magnumclient==4.9.0 python-openstackclient==9.0.0 python-swiftclient==4.9.0 PyYAML==6.0.3 referencing==0.37.0 requests==2.32.5 requests-oauthlib==2.0.0 requestsexceptions==1.4.0 rfc3986==2.0.0 rich==14.3.3 rich-argparse==1.7.2 rpds-py==0.30.0 rsa==4.9.1 ruamel.yaml==0.19.1 ruamel.yaml.clib==0.2.15 s3transfer==0.16.0 simplejson==3.20.2 six==1.17.0 smmap==5.0.2 soupsieve==2.8.3 stevedore==5.7.0 tabulate==0.9.0 toml==0.10.2 tomlkit==0.14.0 tqdm==4.67.3 typing_extensions==4.15.0 urllib3==1.26.20 virtualenv==20.39.0 wcwidth==0.6.0 websocket-client==1.9.0 wrapt==2.1.1 xdg==6.0.0 xmltodict==1.0.4 yq==3.4.3 [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content OS_STACK_TEMPLATE=csit-2-instance-type.yaml OS_CLOUD=vex OS_STACK_NAME=releng-openflowplugin-csit-3node-clustering-bulkomatic-only-titanium-650 OS_STACK_TEMPLATE_DIR=openstack-hot [EnvInject] - Variables injected successfully. provisioning config files... copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml [openflowplugin-csit-3node-clustering-bulkomatic-only-titanium] $ /bin/bash /tmp/jenkins8762647957046159521.sh ---> Create parameters file for OpenStack HOT OpenStack Heat parameters generated ----------------------------------- parameters: vm_0_count: '3' vm_0_flavor: 'v3-standard-4' vm_0_image: 'ZZCI - Ubuntu 22.04 - builder - x86_64 - 20260201-010217.481' vm_1_count: '1' vm_1_flavor: 'v3-standard-2' vm_1_image: 'ZZCI - Ubuntu 22.04 - mininet-ovs-217 - x86_64 - 20250917-133034.654' job_name: '15513-650' silo: 'releng' [openflowplugin-csit-3node-clustering-bulkomatic-only-titanium] $ /bin/bash -l /tmp/jenkins13099308188759701398.sh ---> Create HEAT stack + source /home/jenkins/lf-env.sh + lf-activate-venv --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq ++ mktemp -d /tmp/venv-XXXX + lf_venv=/tmp/venv-IMk7 + local venv_file=/tmp/.os_lf_venv + local python=python3 + local options + local set_path=true + local install_args= ++ getopt -o np:v: -l no-path,system-site-packages,python:,venv-file: -n lf-activate-venv -- --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq + options=' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''urllib3~=1.26.15'\'' '\''yq'\''' + eval set -- ' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''urllib3~=1.26.15'\'' '\''yq'\''' ++ set -- --python python3 -- 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq + true + case $1 in + python=python3 + shift 2 + true + case $1 in + shift + break + case $python in + local pkg_list= + [[ -d /opt/pyenv ]] + echo 'Setup pyenv:' Setup pyenv: + export PYENV_ROOT=/opt/pyenv + PYENV_ROOT=/opt/pyenv + export PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin + PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin + pyenv versions system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-titanium/.python-version) + command -v pyenv ++ pyenv init - --no-rehash + eval 'PATH="$(bash --norc -ec '\''IFS=:; paths=($PATH); for i in ${!paths[@]}; do if [[ ${paths[i]} == "'\'''\''/opt/pyenv/shims'\'''\''" ]]; then unset '\''\'\'''\''paths[i]'\''\'\'''\''; fi; done; echo "${paths[*]}"'\'')" export PATH="/opt/pyenv/shims:${PATH}" export PYENV_SHELL=bash source '\''/opt/pyenv/libexec/../completions/pyenv.bash'\'' pyenv() { local command command="${1:-}" if [ "$#" -gt 0 ]; then shift fi case "$command" in rehash|shell) eval "$(pyenv "sh-$command" "$@")" ;; *) command pyenv "$command" "$@" ;; esac }' +++ bash --norc -ec 'IFS=:; paths=($PATH); for i in ${!paths[@]}; do if [[ ${paths[i]} == "/opt/pyenv/shims" ]]; then unset '\''paths[i]'\''; fi; done; echo "${paths[*]}"' ++ PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin ++ export PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin ++ PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin ++ export PYENV_SHELL=bash ++ PYENV_SHELL=bash ++ source /opt/pyenv/libexec/../completions/pyenv.bash +++ complete -F _pyenv pyenv ++ lf-pyver python3 ++ local py_version_xy=python3 ++ local py_version_xyz= ++ awk '{ print $1 }' ++ pyenv versions ++ local command ++ command=versions ++ '[' 1 -gt 0 ']' ++ shift ++ case "$command" in ++ command pyenv versions ++ pyenv versions ++ sed 's/^[ *]* //' ++ grep -E '^[0-9.]*[0-9]$' ++ [[ ! -s /tmp/.pyenv_versions ]] +++ sort -V +++ tail -n 1 +++ grep '^3' /tmp/.pyenv_versions ++ py_version_xyz=3.11.7 ++ [[ -z 3.11.7 ]] ++ echo 3.11.7 ++ return 0 + pyenv local 3.11.7 + local command + command=local + '[' 2 -gt 0 ']' + shift + case "$command" in + command pyenv local 3.11.7 + pyenv local 3.11.7 + for arg in "$@" + case $arg in + pkg_list+='lftools[openstack] ' + for arg in "$@" + case $arg in + pkg_list+='kubernetes ' + for arg in "$@" + case $arg in + pkg_list+='niet ' + for arg in "$@" + case $arg in + pkg_list+='python-heatclient ' + for arg in "$@" + case $arg in + pkg_list+='python-openstackclient ' + for arg in "$@" + case $arg in + pkg_list+='python-magnumclient ' + for arg in "$@" + case $arg in + pkg_list+='urllib3~=1.26.15 ' + for arg in "$@" + case $arg in + pkg_list+='yq ' + [[ -f /tmp/.os_lf_venv ]] ++ cat /tmp/.os_lf_venv + lf_venv=/tmp/venv-AO6W + echo 'lf-activate-venv(): INFO: Reuse venv:/tmp/venv-AO6W from' file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Reuse venv:/tmp/venv-AO6W from file:/tmp/.os_lf_venv + echo 'lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)' lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) + local 'pip_opts=--upgrade --quiet' + pip_opts='--upgrade --quiet --trusted-host pypi.org' + pip_opts='--upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org' + pip_opts='--upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org' + [[ -n '' ]] + [[ -n '' ]] + echo 'lf-activate-venv(): INFO: Attempting to install with network-safe options...' lf-activate-venv(): INFO: Attempting to install with network-safe options... + /tmp/venv-AO6W/bin/python3 -m pip install --upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org pip 'setuptools<66' virtualenv + echo 'lf-activate-venv(): INFO: Base packages installed successfully' lf-activate-venv(): INFO: Base packages installed successfully + [[ -z lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq ]] + echo 'lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq ' lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq + /tmp/venv-AO6W/bin/python3 -m pip install --upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org --upgrade-strategy eager 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq + type python3 + true + echo 'lf-activate-venv(): INFO: Adding /tmp/venv-AO6W/bin to PATH' lf-activate-venv(): INFO: Adding /tmp/venv-AO6W/bin to PATH + PATH=/tmp/venv-AO6W/bin:/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin + return 0 + openstack --os-cloud vex limits show --absolute /tmp/venv-AO6W/lib/python3.11/site-packages/requests/__init__.py:113: RequestsDependencyWarning: urllib3 (1.26.20) or chardet (6.0.0.post1)/charset_normalizer (3.4.4) doesn't match a supported version! warnings.warn( +--------------------------+---------+ | Name | Value | +--------------------------+---------+ | maxTotalInstances | -1 | | maxTotalCores | 450 | | maxTotalRAMSize | 1000000 | | maxServerMeta | 128 | | maxImageMeta | 128 | | maxPersonality | 5 | | maxPersonalitySize | 10240 | | maxTotalKeypairs | 100 | | maxServerGroups | 10 | | maxServerGroupMembers | 10 | | maxTotalFloatingIps | -1 | | maxSecurityGroups | -1 | | maxSecurityGroupRules | -1 | | totalRAMUsed | 417792 | | totalCoresUsed | 102 | | totalInstancesUsed | 39 | | totalFloatingIpsUsed | 0 | | totalSecurityGroupsUsed | 0 | | totalServerGroupsUsed | 0 | | maxTotalVolumes | -1 | | maxTotalSnapshots | 10 | | maxTotalVolumeGigabytes | 4096 | | maxTotalBackups | 10 | | maxTotalBackupGigabytes | 1000 | | totalVolumesUsed | 0 | | totalGigabytesUsed | 0 | | totalSnapshotsUsed | 0 | | totalBackupsUsed | 0 | | totalBackupGigabytesUsed | 0 | +--------------------------+---------+ + pushd /opt/ciman/openstack-hot /opt/ciman/openstack-hot /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-titanium + lftools openstack --os-cloud vex stack create releng-openflowplugin-csit-3node-clustering-bulkomatic-only-titanium-650 csit-2-instance-type.yaml /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-titanium/stack-parameters.yaml /tmp/venv-AO6W/lib/python3.11/site-packages/requests/__init__.py:113: RequestsDependencyWarning: urllib3 (1.26.20) or chardet (6.0.0.post1)/charset_normalizer (3.4.4) doesn't match a supported version! warnings.warn( Creating stack releng-openflowplugin-csit-3node-clustering-bulkomatic-only-titanium-650 Waiting to initialize infrastructure... Waiting to initialize infrastructure... Stack initialization successful. ------------------------------------ Stack Details ------------------------------------ {'added': None, 'capabilities': [], 'created_at': '2026-02-24T01:56:31Z', 'deleted': None, 'deleted_at': None, 'description': 'No description', 'environment': None, 'environment_files': None, 'files': None, 'files_container': None, 'id': '23bfa582-2578-4f53-9a05-479930bea9f0', 'is_rollback_disabled': True, 'links': [{'href': 'https://orchestration.public.mtl1.vexxhost.net/v1/12c36e260d8e4bb2913965203b1b491f/stacks/releng-openflowplugin-csit-3node-clustering-bulkomatic-only-titanium-650/23bfa582-2578-4f53-9a05-479930bea9f0', 'rel': 'self'}], 'location': Munch({'cloud': 'vex', 'region_name': 'ca-ymq-1', 'zone': None, 'project': Munch({'id': '12c36e260d8e4bb2913965203b1b491f', 'name': '61975f2c-7c17-4d69-82fa-c3ae420ad6fd', 'domain_id': None, 'domain_name': 'Default'})}), 'name': 'releng-openflowplugin-csit-3node-clustering-bulkomatic-only-titanium-650', 'notification_topics': [], 'outputs': [{'description': 'IP addresses of the 1st vm types', 'output_key': 'vm_0_ips', 'output_value': ['10.30.171.91', '10.30.170.68', '10.30.170.152']}, {'description': 'IP addresses of the 2nd vm types', 'output_key': 'vm_1_ips', 'output_value': ['10.30.171.10']}], 'owner_id': ****, 'parameters': {'OS::project_id': '12c36e260d8e4bb2913965203b1b491f', 'OS::stack_id': '23bfa582-2578-4f53-9a05-479930bea9f0', 'OS::stack_name': 'releng-openflowplugin-csit-3node-clustering-bulkomatic-only-titanium-650', 'job_name': '15513-650', 'silo': 'releng', 'vm_0_count': '3', 'vm_0_flavor': 'v3-standard-4', 'vm_0_image': 'ZZCI - Ubuntu 22.04 - builder - x86_64 - ' '20260201-010217.481', 'vm_1_count': '1', 'vm_1_flavor': 'v3-standard-2', 'vm_1_image': 'ZZCI - Ubuntu 22.04 - mininet-ovs-217 - x86_64 ' '- 20250917-133034.654'}, 'parent_id': None, 'replaced': None, 'status': 'CREATE_COMPLETE', 'status_reason': 'Stack CREATE completed successfully', 'tags': [], 'template': None, 'template_description': 'No description', 'template_url': None, 'timeout_mins': 15, 'unchanged': None, 'updated': None, 'updated_at': None, 'user_project_id': 'd214b1a3ee484f17973c45dd103c2eac'} ------------------------------------ + popd /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-titanium [openflowplugin-csit-3node-clustering-bulkomatic-only-titanium] $ /bin/bash -l /tmp/jenkins9473228225598485700.sh ---> Copy SSH public keys to CSIT lab Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-titanium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-AO6W from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) lf-activate-venv(): INFO: Attempting to install with network-safe options... lf-activate-venv(): INFO: Base packages installed successfully lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes python-heatclient python-openstackclient urllib3~=1.26.15 lf-activate-venv(): INFO: Adding /tmp/venv-AO6W/bin to PATH /tmp/venv-AO6W/lib/python3.11/site-packages/requests/__init__.py:113: RequestsDependencyWarning: urllib3 (1.26.20) or chardet (6.0.0.post1)/charset_normalizer (3.4.4) doesn't match a supported version! warnings.warn( SSH not responding on 10.30.171.91. Retrying in 10 seconds... SSH not responding on 10.30.170.152. Retrying in 10 seconds... Warning: Permanently added '10.30.170.68' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.171.10' (ECDSA) to the list of known hosts. releng-15513-650-0-builder-1 Successfully copied public keys to slave 10.30.170.68 releng-15513-650-1-mininet-ovs-217-0 Successfully copied public keys to slave 10.30.171.10 Ping to 10.30.171.91 successful. Ping to 10.30.170.152 successful. Warning: Permanently added '10.30.170.152' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.171.91' (ECDSA) to the list of known hosts. releng-15513-650-0-builder-2 Successfully copied public keys to slave 10.30.170.152 releng-15513-650-0-builder-0 Successfully copied public keys to slave 10.30.171.91 Process 6499 ready. Process 6500 ready. Process 6502 ready. Process 6503 ready. SSH ready on all stack servers. [openflowplugin-csit-3node-clustering-bulkomatic-only-titanium] $ /bin/bash -l /tmp/jenkins9635897580691703592.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-titanium/.python-version) lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-iziI lf-activate-venv(): INFO: Save venv in file: /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-titanium/.robot_venv lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) lf-activate-venv(): INFO: Attempting to install with network-safe options... lf-activate-venv(): INFO: Base packages installed successfully lf-activate-venv(): INFO: Installing additional packages: setuptools wheel lf-activate-venv(): INFO: Adding /tmp/venv-iziI/bin to PATH + echo 'Installing Python Requirements' Installing Python Requirements + cat + python -m pip install -r requirements.txt Looking in indexes: https://nexus3.opendaylight.org/repository/PyPi/simple Collecting docker-py (from -r requirements.txt (line 1)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/docker-py/1.10.6/docker_py-1.10.6-py2.py3-none-any.whl (50 kB) Collecting ipaddr (from -r requirements.txt (line 2)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/ipaddr/2.2.0/ipaddr-2.2.0.tar.gz (26 kB) Installing build dependencies: started Installing build dependencies: finished with status 'done' Getting requirements to build wheel: started Getting requirements to build wheel: finished with status 'done' Preparing metadata (pyproject.toml): started Preparing metadata (pyproject.toml): finished with status 'done' Collecting netaddr (from -r requirements.txt (line 3)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/netaddr/1.3.0/netaddr-1.3.0-py3-none-any.whl (2.3 MB) Collecting netifaces (from -r requirements.txt (line 4)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/netifaces/0.11.0/netifaces-0.11.0.tar.gz (30 kB) Installing build dependencies: started Installing build dependencies: finished with status 'done' Getting requirements to build wheel: started Getting requirements to build wheel: finished with status 'done' Preparing metadata (pyproject.toml): started Preparing metadata (pyproject.toml): finished with status 'done' Collecting pyhocon (from -r requirements.txt (line 5)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyhocon/0.3.61/pyhocon-0.3.61-py3-none-any.whl (25 kB) Collecting requests (from -r requirements.txt (line 6)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/requests/2.32.5/requests-2.32.5-py3-none-any.whl (64 kB) Collecting robotframework (from -r requirements.txt (line 7)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework/7.4.1/robotframework-7.4.1-py3-none-any.whl (806 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 806.9/806.9 kB 36.4 MB/s 0:00:00 Collecting robotframework-httplibrary (from -r requirements.txt (line 8)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-httplibrary/0.4.2/robotframework-httplibrary-0.4.2.tar.gz (9.1 kB) Installing build dependencies: started Installing build dependencies: finished with status 'done' Getting requirements to build wheel: started Getting requirements to build wheel: finished with status 'done' Preparing metadata (pyproject.toml): started Preparing metadata (pyproject.toml): finished with status 'done' Collecting robotframework-requests==0.9.7 (from -r requirements.txt (line 9)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-requests/0.9.7/robotframework_requests-0.9.7-py3-none-any.whl (21 kB) Collecting robotframework-selenium2library (from -r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-selenium2library/3.0.0/robotframework_selenium2library-3.0.0-py2.py3-none-any.whl (6.2 kB) Collecting robotframework-sshlibrary==3.8.0 (from -r requirements.txt (line 11)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-sshlibrary/3.8.0/robotframework-sshlibrary-3.8.0.tar.gz (51 kB) Installing build dependencies: started Installing build dependencies: finished with status 'done' Getting requirements to build wheel: started Getting requirements to build wheel: finished with status 'done' Preparing metadata (pyproject.toml): started Preparing metadata (pyproject.toml): finished with status 'done' Collecting scapy (from -r requirements.txt (line 12)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/scapy/2.7.0/scapy-2.7.0-py3-none-any.whl (2.6 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.6/2.6 MB 49.3 MB/s 0:00:00 Collecting jsonpath-rw (from -r requirements.txt (line 15)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpath-rw/1.4.0/jsonpath-rw-1.4.0.tar.gz (13 kB) Installing build dependencies: started Installing build dependencies: finished with status 'done' Getting requirements to build wheel: started Getting requirements to build wheel: finished with status 'done' Preparing metadata (pyproject.toml): started Preparing metadata (pyproject.toml): finished with status 'done' Collecting elasticsearch (from -r requirements.txt (line 18)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch/9.3.0/elasticsearch-9.3.0-py3-none-any.whl (979 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 979.4/979.4 kB 22.2 MB/s 0:00:00 Collecting elasticsearch-dsl (from -r requirements.txt (line 19)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch-dsl/8.18.0/elasticsearch_dsl-8.18.0-py3-none-any.whl (10 kB) Collecting pyangbind (from -r requirements.txt (line 22)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyangbind/0.8.7/pyangbind-0.8.7-py3-none-any.whl (52 kB) Collecting isodate (from -r requirements.txt (line 25)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/isodate/0.7.2/isodate-0.7.2-py3-none-any.whl (22 kB) Collecting jmespath (from -r requirements.txt (line 28)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jmespath/1.1.0/jmespath-1.1.0-py3-none-any.whl (20 kB) Collecting jsonpatch (from -r requirements.txt (line 31)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpatch/1.33/jsonpatch-1.33-py2.py3-none-any.whl (12 kB) Collecting paramiko>=1.15.3 (from robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/paramiko/4.0.0/paramiko-4.0.0-py3-none-any.whl (223 kB) Collecting scp>=0.13.0 (from robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/scp/0.15.0/scp-0.15.0-py2.py3-none-any.whl (8.8 kB) Collecting docker-pycreds>=0.2.1 (from docker-py->-r requirements.txt (line 1)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/docker-pycreds/0.4.0/docker_pycreds-0.4.0-py2.py3-none-any.whl (9.0 kB) Collecting six>=1.4.0 (from docker-py->-r requirements.txt (line 1)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/six/1.17.0/six-1.17.0-py2.py3-none-any.whl (11 kB) Collecting websocket-client>=0.32.0 (from docker-py->-r requirements.txt (line 1)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/websocket-client/1.9.0/websocket_client-1.9.0-py3-none-any.whl (82 kB) Collecting pyparsing<4,>=2 (from pyhocon->-r requirements.txt (line 5)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pyparsing/3.3.2/pyparsing-3.3.2-py3-none-any.whl (122 kB) Collecting charset_normalizer<4,>=2 (from requests->-r requirements.txt (line 6)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/charset-normalizer/3.4.4/charset_normalizer-3.4.4-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl (151 kB) Collecting idna<4,>=2.5 (from requests->-r requirements.txt (line 6)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/idna/3.11/idna-3.11-py3-none-any.whl (71 kB) Collecting urllib3<3,>=1.21.1 (from requests->-r requirements.txt (line 6)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/urllib3/2.6.3/urllib3-2.6.3-py3-none-any.whl (131 kB) Collecting certifi>=2017.4.17 (from requests->-r requirements.txt (line 6)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/certifi/2026.1.4/certifi-2026.1.4-py3-none-any.whl (152 kB) Collecting webtest>=2.0 (from robotframework-httplibrary->-r requirements.txt (line 8)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/webtest/3.0.7/webtest-3.0.7-py3-none-any.whl (32 kB) Collecting jsonpointer (from robotframework-httplibrary->-r requirements.txt (line 8)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpointer/3.0.0/jsonpointer-3.0.0-py2.py3-none-any.whl (7.6 kB) Collecting robotframework-seleniumlibrary>=3.0.0 (from robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-seleniumlibrary/6.8.0/robotframework_seleniumlibrary-6.8.0-py3-none-any.whl (104 kB) Collecting ply (from jsonpath-rw->-r requirements.txt (line 15)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/ply/3.11/ply-3.11-py2.py3-none-any.whl (49 kB) Collecting decorator (from jsonpath-rw->-r requirements.txt (line 15)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/decorator/5.2.1/decorator-5.2.1-py3-none-any.whl (9.2 kB) Collecting anyio (from elasticsearch->-r requirements.txt (line 18)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/anyio/4.12.1/anyio-4.12.1-py3-none-any.whl (113 kB) Collecting elastic-transport<10,>=9.2.0 (from elasticsearch->-r requirements.txt (line 18)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elastic-transport/9.2.1/elastic_transport-9.2.1-py3-none-any.whl (65 kB) Collecting python-dateutil (from elasticsearch->-r requirements.txt (line 18)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/python-dateutil/2.9.0.post0/python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) Collecting sniffio (from elasticsearch->-r requirements.txt (line 18)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/sniffio/1.3.1/sniffio-1.3.1-py3-none-any.whl (10 kB) Collecting typing-extensions (from elasticsearch->-r requirements.txt (line 18)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/typing-extensions/4.15.0/typing_extensions-4.15.0-py3-none-any.whl (44 kB) Collecting elasticsearch (from -r requirements.txt (line 18)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch/8.19.3/elasticsearch-8.19.3-py3-none-any.whl (952 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 952.8/952.8 kB 48.1 MB/s 0:00:00 INFO: pip is looking at multiple versions of elasticsearch-dsl to determine which version is compatible with other requirements. This could take a while. Collecting elasticsearch-dsl (from -r requirements.txt (line 19)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch-dsl/8.17.1/elasticsearch_dsl-8.17.1-py3-none-any.whl (158 kB) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch-dsl/8.17.0/elasticsearch_dsl-8.17.0-py3-none-any.whl (158 kB) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch-dsl/8.16.0/elasticsearch_dsl-8.16.0-py3-none-any.whl (158 kB) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch-dsl/8.15.4/elasticsearch_dsl-8.15.4-py3-none-any.whl (104 kB) Collecting elastic-transport<9,>=8.15.1 (from elasticsearch->-r requirements.txt (line 18)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elastic-transport/8.17.1/elastic_transport-8.17.1-py3-none-any.whl (64 kB) Collecting pyang (from pyangbind->-r requirements.txt (line 22)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyang/2.7.1/pyang-2.7.1-py2.py3-none-any.whl (598 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 598.5/598.5 kB 30.9 MB/s 0:00:00 Collecting lxml (from pyangbind->-r requirements.txt (line 22)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/lxml/6.0.2/lxml-6.0.2-cp311-cp311-manylinux_2_26_x86_64.manylinux_2_28_x86_64.whl (5.2 MB) Collecting regex (from pyangbind->-r requirements.txt (line 22)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/regex/2026.2.19/regex-2026.2.19-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl (800 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 800.6/800.6 kB 36.6 MB/s 0:00:00 Collecting enum34 (from pyangbind->-r requirements.txt (line 22)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/enum34/1.1.10/enum34-1.1.10-py3-none-any.whl (11 kB) Collecting bcrypt>=3.2 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/bcrypt/5.0.0/bcrypt-5.0.0-cp39-abi3-manylinux_2_28_x86_64.whl (278 kB) Collecting cryptography>=3.3 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/cryptography/46.0.5/cryptography-46.0.5-cp311-abi3-manylinux_2_28_x86_64.whl (4.5 MB) Collecting invoke>=2.0 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/invoke/2.2.1/invoke-2.2.1-py3-none-any.whl (160 kB) Collecting pynacl>=1.5 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pynacl/1.6.2/pynacl-1.6.2-cp38-abi3-manylinux_2_26_x86_64.manylinux_2_28_x86_64.whl (1.4 MB) Collecting cffi>=2.0.0 (from cryptography>=3.3->paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/cffi/2.0.0/cffi-2.0.0-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (215 kB) Collecting pycparser (from cffi>=2.0.0->cryptography>=3.3->paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pycparser/3.0/pycparser-3.0-py3-none-any.whl (48 kB) Collecting selenium>=4.3.0 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/selenium/4.41.0/selenium-4.41.0-py3-none-any.whl (9.5 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 9.5/9.5 MB 82.1 MB/s 0:00:00 Collecting robotframework-pythonlibcore>=4.4.1 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-pythonlibcore/4.5.0/robotframework_pythonlibcore-4.5.0-py3-none-any.whl (19 kB) Collecting click>=8.0 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/click/8.3.1/click-8.3.1-py3-none-any.whl (108 kB) Collecting trio<1.0,>=0.31.0 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/trio/0.33.0/trio-0.33.0-py3-none-any.whl (510 kB) Collecting trio-websocket<1.0,>=0.12.2 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/trio-websocket/0.12.2/trio_websocket-0.12.2-py3-none-any.whl (21 kB) Collecting attrs>=23.2.0 (from trio<1.0,>=0.31.0->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/attrs/25.4.0/attrs-25.4.0-py3-none-any.whl (67 kB) Collecting sortedcontainers (from trio<1.0,>=0.31.0->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/sortedcontainers/2.4.0/sortedcontainers-2.4.0-py2.py3-none-any.whl (29 kB) Collecting outcome (from trio<1.0,>=0.31.0->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/outcome/1.3.0.post0/outcome-1.3.0.post0-py2.py3-none-any.whl (10 kB) Collecting wsproto>=0.14 (from trio-websocket<1.0,>=0.12.2->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/wsproto/1.3.2/wsproto-1.3.2-py3-none-any.whl (24 kB) Collecting pysocks!=1.5.7,<2.0,>=1.5.6 (from urllib3[socks]<3.0,>=2.6.3->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pysocks/1.7.1/PySocks-1.7.1-py3-none-any.whl (16 kB) Collecting WebOb>=1.2 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/webob/1.8.9/WebOb-1.8.9-py2.py3-none-any.whl (115 kB) Collecting waitress>=3.0.2 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/waitress/3.0.2/waitress-3.0.2-py3-none-any.whl (56 kB) Collecting beautifulsoup4 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/beautifulsoup4/4.14.3/beautifulsoup4-4.14.3-py3-none-any.whl (107 kB) Collecting h11<1,>=0.16.0 (from wsproto>=0.14->trio-websocket<1.0,>=0.12.2->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/h11/0.16.0/h11-0.16.0-py3-none-any.whl (37 kB) Collecting soupsieve>=1.6.1 (from beautifulsoup4->webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/soupsieve/2.8.3/soupsieve-2.8.3-py3-none-any.whl (37 kB) Building wheels for collected packages: robotframework-sshlibrary, ipaddr, netifaces, robotframework-httplibrary, jsonpath-rw Building wheel for robotframework-sshlibrary (pyproject.toml): started Building wheel for robotframework-sshlibrary (pyproject.toml): finished with status 'done' Created wheel for robotframework-sshlibrary: filename=robotframework_sshlibrary-3.8.0-py3-none-any.whl size=55207 sha256=f9eddd08fcaf1954a56f8ca6e89ee9662f56642a1f0ad995c1844357c075a48c Stored in directory: /home/jenkins/.cache/pip/wheels/f7/c9/b3/a977b7bcc410d45ae27d240df3d00a12585509180e373ecccc Building wheel for ipaddr (pyproject.toml): started Building wheel for ipaddr (pyproject.toml): finished with status 'done' Created wheel for ipaddr: filename=ipaddr-2.2.0-py3-none-any.whl size=18355 sha256=63ab22be375ee56a66929c8b6eade34fce2799248e375db40662961f894ea2b5 Stored in directory: /home/jenkins/.cache/pip/wheels/dc/6c/04/da2d847fa8d45c59af3e1d83e2acc29cb8adcbaf04c0898dbf Building wheel for netifaces (pyproject.toml): started Building wheel for netifaces (pyproject.toml): finished with status 'done' Created wheel for netifaces: filename=netifaces-0.11.0-cp311-cp311-linux_x86_64.whl size=41085 sha256=ebe39b103fd7eac4ace91cc5d31915fff7210f1cfe34cd5482439757bc718820 Stored in directory: /home/jenkins/.cache/pip/wheels/f8/18/88/e61d54b995bea304bdb1d040a92b72228a1bf72ca2a3eba7c9 Building wheel for robotframework-httplibrary (pyproject.toml): started Building wheel for robotframework-httplibrary (pyproject.toml): finished with status 'done' Created wheel for robotframework-httplibrary: filename=robotframework_httplibrary-0.4.2-py3-none-any.whl size=10015 sha256=38f255db46400eb2fac0b91fb35492e88b1f851c35b3a60aa4cead5a92e19ba5 Stored in directory: /home/jenkins/.cache/pip/wheels/aa/bc/0d/9a20dd51effef392aae2733cb4c7b66c6fa29fca33d88b57ed Building wheel for jsonpath-rw (pyproject.toml): started Building wheel for jsonpath-rw (pyproject.toml): finished with status 'done' Created wheel for jsonpath-rw: filename=jsonpath_rw-1.4.0-py3-none-any.whl size=15176 sha256=82cc2ff1f04879272b8fae0ca7605dd34905dd5f1a29ea8e14356d715c9b5a34 Stored in directory: /home/jenkins/.cache/pip/wheels/f1/54/63/9a8da38cefae13755097b36cc852decc25d8ef69c37d58d4eb Successfully built robotframework-sshlibrary ipaddr netifaces robotframework-httplibrary jsonpath-rw Installing collected packages: sortedcontainers, ply, netifaces, ipaddr, enum34, websocket-client, WebOb, waitress, urllib3, typing-extensions, soupsieve, sniffio, six, scapy, robotframework-pythonlibcore, robotframework, regex, pysocks, pyparsing, pycparser, netaddr, lxml, jsonpointer, jmespath, isodate, invoke, idna, h11, decorator, click, charset_normalizer, certifi, bcrypt, attrs, wsproto, requests, python-dateutil, pyhocon, pyang, outcome, jsonpath-rw, jsonpatch, elastic-transport, docker-pycreds, cffi, beautifulsoup4, webtest, trio, robotframework-requests, pynacl, pyangbind, elasticsearch, docker-py, cryptography, trio-websocket, robotframework-httplibrary, paramiko, elasticsearch-dsl, selenium, scp, robotframework-sshlibrary, robotframework-seleniumlibrary, robotframework-selenium2library Successfully installed WebOb-1.8.9 attrs-25.4.0 bcrypt-5.0.0 beautifulsoup4-4.14.3 certifi-2026.1.4 cffi-2.0.0 charset_normalizer-3.4.4 click-8.3.1 cryptography-46.0.5 decorator-5.2.1 docker-py-1.10.6 docker-pycreds-0.4.0 elastic-transport-8.17.1 elasticsearch-8.19.3 elasticsearch-dsl-8.15.4 enum34-1.1.10 h11-0.16.0 idna-3.11 invoke-2.2.1 ipaddr-2.2.0 isodate-0.7.2 jmespath-1.1.0 jsonpatch-1.33 jsonpath-rw-1.4.0 jsonpointer-3.0.0 lxml-6.0.2 netaddr-1.3.0 netifaces-0.11.0 outcome-1.3.0.post0 paramiko-4.0.0 ply-3.11 pyang-2.7.1 pyangbind-0.8.7 pycparser-3.0 pyhocon-0.3.61 pynacl-1.6.2 pyparsing-3.3.2 pysocks-1.7.1 python-dateutil-2.9.0.post0 regex-2026.2.19 requests-2.32.5 robotframework-7.4.1 robotframework-httplibrary-0.4.2 robotframework-pythonlibcore-4.5.0 robotframework-requests-0.9.7 robotframework-selenium2library-3.0.0 robotframework-seleniumlibrary-6.8.0 robotframework-sshlibrary-3.8.0 scapy-2.7.0 scp-0.15.0 selenium-4.41.0 six-1.17.0 sniffio-1.3.1 sortedcontainers-2.4.0 soupsieve-2.8.3 trio-0.33.0 trio-websocket-0.12.2 typing-extensions-4.15.0 urllib3-2.6.3 waitress-3.0.2 websocket-client-1.9.0 webtest-3.0.7 wsproto-1.3.2 + pip freeze attrs==25.4.0 bcrypt==5.0.0 beautifulsoup4==4.14.3 certifi==2026.1.4 cffi==2.0.0 charset-normalizer==3.4.4 click==8.3.1 cryptography==46.0.5 decorator==5.2.1 distlib==0.4.0 docker-py==1.10.6 docker-pycreds==0.4.0 elastic-transport==8.17.1 elasticsearch==8.19.3 elasticsearch-dsl==8.15.4 enum34==1.1.10 filelock==3.24.3 h11==0.16.0 idna==3.11 invoke==2.2.1 ipaddr==2.2.0 isodate==0.7.2 jmespath==1.1.0 jsonpatch==1.33 jsonpath-rw==1.4.0 jsonpointer==3.0.0 lxml==6.0.2 netaddr==1.3.0 netifaces==0.11.0 outcome==1.3.0.post0 packaging==26.0 paramiko==4.0.0 platformdirs==4.9.2 ply==3.11 pyang==2.7.1 pyangbind==0.8.7 pycparser==3.0 pyhocon==0.3.61 PyNaCl==1.6.2 pyparsing==3.3.2 PySocks==1.7.1 python-dateutil==2.9.0.post0 regex==2026.2.19 requests==2.32.5 robotframework==7.4.1 robotframework-httplibrary==0.4.2 robotframework-pythonlibcore==4.5.0 robotframework-requests==0.9.7 robotframework-selenium2library==3.0.0 robotframework-seleniumlibrary==6.8.0 robotframework-sshlibrary==3.8.0 scapy==2.7.0 scp==0.15.0 selenium==4.41.0 six==1.17.0 sniffio==1.3.1 sortedcontainers==2.4.0 soupsieve==2.8.3 trio==0.33.0 trio-websocket==0.12.2 typing_extensions==4.15.0 urllib3==2.6.3 virtualenv==20.39.0 waitress==3.0.2 WebOb==1.8.9 websocket-client==1.9.0 WebTest==3.0.7 wsproto==1.3.2 [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'env.properties' [EnvInject] - Variables injected successfully. [openflowplugin-csit-3node-clustering-bulkomatic-only-titanium] $ /bin/bash -l /tmp/jenkins5707267326514116371.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-titanium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-AO6W from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) lf-activate-venv(): INFO: Attempting to install with network-safe options... lf-activate-venv(): INFO: Base packages installed successfully lf-activate-venv(): INFO: Installing additional packages: python-heatclient python-openstackclient yq lf-activate-venv(): INFO: Adding /tmp/venv-AO6W/bin to PATH + ODL_SYSTEM=() + TOOLS_SYSTEM=() + OPENSTACK_SYSTEM=() + OPENSTACK_CONTROLLERS=() + mapfile -t ADDR ++ openstack stack show -f json -c outputs releng-openflowplugin-csit-3node-clustering-bulkomatic-only-titanium-650 ++ jq -r '.outputs[] | select(.output_key | match("^vm_[0-9]+_ips$")) | .output_value | .[]' /tmp/venv-AO6W/lib/python3.11/site-packages/requests/__init__.py:113: RequestsDependencyWarning: urllib3 (2.6.3) or chardet (6.0.0.post1)/charset_normalizer (3.4.4) doesn't match a supported version! warnings.warn( + for i in "${ADDR[@]}" ++ ssh 10.30.171.91 hostname -s Warning: Permanently added '10.30.171.91' (ECDSA) to the list of known hosts. + REMHOST=releng-15513-650-0-builder-0 + case ${REMHOST} in + ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}") + for i in "${ADDR[@]}" ++ ssh 10.30.170.68 hostname -s Warning: Permanently added '10.30.170.68' (ECDSA) to the list of known hosts. + REMHOST=releng-15513-650-0-builder-1 + case ${REMHOST} in + ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}") + for i in "${ADDR[@]}" ++ ssh 10.30.170.152 hostname -s Warning: Permanently added '10.30.170.152' (ECDSA) to the list of known hosts. + REMHOST=releng-15513-650-0-builder-2 + case ${REMHOST} in + ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}") + for i in "${ADDR[@]}" ++ ssh 10.30.171.10 hostname -s Warning: Permanently added '10.30.171.10' (ECDSA) to the list of known hosts. + REMHOST=releng-15513-650-1-mininet-ovs-217-0 + case ${REMHOST} in + TOOLS_SYSTEM=("${TOOLS_SYSTEM[@]}" "${i}") + echo NUM_ODL_SYSTEM=3 + echo NUM_TOOLS_SYSTEM=1 + '[' '' == yes ']' + NUM_OPENSTACK_SYSTEM=0 + echo NUM_OPENSTACK_SYSTEM=0 + '[' 0 -eq 2 ']' + echo ODL_SYSTEM_IP=10.30.171.91 ++ seq 0 2 + for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 ))) + echo ODL_SYSTEM_1_IP=10.30.171.91 + for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 ))) + echo ODL_SYSTEM_2_IP=10.30.170.68 + for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 ))) + echo ODL_SYSTEM_3_IP=10.30.170.152 + echo TOOLS_SYSTEM_IP=10.30.171.10 ++ seq 0 0 + for i in $(seq 0 $(( ${#TOOLS_SYSTEM[@]} - 1 ))) + echo TOOLS_SYSTEM_1_IP=10.30.171.10 + openstack_index=0 + NUM_OPENSTACK_CONTROL_NODES=1 + echo NUM_OPENSTACK_CONTROL_NODES=1 ++ seq 0 0 + for i in $(seq 0 $((NUM_OPENSTACK_CONTROL_NODES - 1))) + echo OPENSTACK_CONTROL_NODE_1_IP= + NUM_OPENSTACK_COMPUTE_NODES=-1 + echo NUM_OPENSTACK_COMPUTE_NODES=-1 + '[' -1 -ge 2 ']' ++ seq 0 -2 + NUM_OPENSTACK_HAPROXY_NODES=0 + echo NUM_OPENSTACK_HAPROXY_NODES=0 ++ seq 0 -1 + echo 'Contents of slave_addresses.txt:' Contents of slave_addresses.txt: + cat slave_addresses.txt NUM_ODL_SYSTEM=3 NUM_TOOLS_SYSTEM=1 NUM_OPENSTACK_SYSTEM=0 ODL_SYSTEM_IP=10.30.171.91 ODL_SYSTEM_1_IP=10.30.171.91 ODL_SYSTEM_2_IP=10.30.170.68 ODL_SYSTEM_3_IP=10.30.170.152 TOOLS_SYSTEM_IP=10.30.171.10 TOOLS_SYSTEM_1_IP=10.30.171.10 NUM_OPENSTACK_CONTROL_NODES=1 OPENSTACK_CONTROL_NODE_1_IP= NUM_OPENSTACK_COMPUTE_NODES=-1 NUM_OPENSTACK_HAPROXY_NODES=0 [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'slave_addresses.txt' [EnvInject] - Variables injected successfully. [openflowplugin-csit-3node-clustering-bulkomatic-only-titanium] $ /bin/sh /tmp/jenkins6905963391984443344.sh Preparing for JRE Version 21 Karaf artifact is karaf Karaf project is integration Java home is /usr/lib/jvm/java-21-openjdk-amd64 [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'set_variables.env' [EnvInject] - Variables injected successfully. [openflowplugin-csit-3node-clustering-bulkomatic-only-titanium] $ /bin/bash /tmp/jenkins14184809952815307682.sh Distribution bundle URL is https://nexus.opendaylight.org/content/repositories//autorelease-9609/org/opendaylight/integration/karaf/0.22.2/karaf-0.22.2.zip Distribution bundle is karaf-0.22.2.zip Distribution bundle version is 0.22.2 Distribution folder is karaf-0.22.2 Nexus prefix is https://nexus.opendaylight.org [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'detect_variables.env' [EnvInject] - Variables injected successfully. [openflowplugin-csit-3node-clustering-bulkomatic-only-titanium] $ /bin/bash -l /tmp/jenkins5215169567069008276.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-titanium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-AO6W from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) lf-activate-venv(): INFO: Attempting to install with network-safe options... lf-activate-venv(): INFO: Base packages installed successfully lf-activate-venv(): INFO: Installing additional packages: python-heatclient python-openstackclient lf-activate-venv(): INFO: Adding /tmp/venv-AO6W/bin to PATH Copying common-functions.sh to /tmp /tmp/venv-AO6W/lib/python3.11/site-packages/requests/__init__.py:113: RequestsDependencyWarning: urllib3 (2.6.3) or chardet (6.0.0.post1)/charset_normalizer (3.4.4) doesn't match a supported version! warnings.warn( Copying common-functions.sh to 10.30.171.10:/tmp Warning: Permanently added '10.30.171.10' (ECDSA) to the list of known hosts. Copying common-functions.sh to 10.30.171.91:/tmp Warning: Permanently added '10.30.171.91' (ECDSA) to the list of known hosts. Copying common-functions.sh to 10.30.170.68:/tmp Warning: Permanently added '10.30.170.68' (ECDSA) to the list of known hosts. Copying common-functions.sh to 10.30.170.152:/tmp Warning: Permanently added '10.30.170.152' (ECDSA) to the list of known hosts. [openflowplugin-csit-3node-clustering-bulkomatic-only-titanium] $ /bin/bash /tmp/jenkins7300002401956125828.sh common-functions.sh is being sourced common-functions environment: MAVENCONF: /tmp/karaf-0.22.2/etc/org.ops4j.pax.url.mvn.cfg ACTUALFEATURES: FEATURESCONF: /tmp/karaf-0.22.2/etc/org.apache.karaf.features.cfg CUSTOMPROP: /tmp/karaf-0.22.2/etc/custom.properties LOGCONF: /tmp/karaf-0.22.2/etc/org.ops4j.pax.logging.cfg MEMCONF: /tmp/karaf-0.22.2/bin/setenv CONTROLLERMEM: 2048m AKKACONF: /tmp/karaf-0.22.2/configuration/initial/pekko.conf MODULESCONF: /tmp/karaf-0.22.2/configuration/initial/modules.conf MODULESHARDSCONF: /tmp/karaf-0.22.2/configuration/initial/module-shards.conf SUITES: ################################################# ## Configure Cluster and Start ## ################################################# ACTUALFEATURES: odl-infrautils-ready,odl-jolokia,odl-openflowplugin-flow-services-rest,odl-openflowplugin-app-bulk-o-matic SPACE_SEPARATED_FEATURES: odl-infrautils-ready odl-jolokia odl-openflowplugin-flow-services-rest odl-openflowplugin-app-bulk-o-matic Locating script plan to use... Finished running script plans Configuring member-1 with IP address 10.30.171.91 Warning: Permanently added '10.30.171.91' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.171.91' (ECDSA) to the list of known hosts. + source /tmp/common-functions.sh karaf-0.22.2 titanium common-functions.sh is being sourced ++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]] ++ echo 'common-functions.sh is being sourced' ++ BUNDLEFOLDER=karaf-0.22.2 ++ DISTROSTREAM=titanium ++ export MAVENCONF=/tmp/karaf-0.22.2/etc/org.ops4j.pax.url.mvn.cfg ++ MAVENCONF=/tmp/karaf-0.22.2/etc/org.ops4j.pax.url.mvn.cfg ++ export FEATURESCONF=/tmp/karaf-0.22.2/etc/org.apache.karaf.features.cfg ++ FEATURESCONF=/tmp/karaf-0.22.2/etc/org.apache.karaf.features.cfg ++ export CUSTOMPROP=/tmp/karaf-0.22.2/etc/custom.properties ++ CUSTOMPROP=/tmp/karaf-0.22.2/etc/custom.properties ++ export LOGCONF=/tmp/karaf-0.22.2/etc/org.ops4j.pax.logging.cfg ++ LOGCONF=/tmp/karaf-0.22.2/etc/org.ops4j.pax.logging.cfg ++ export MEMCONF=/tmp/karaf-0.22.2/bin/setenv ++ MEMCONF=/tmp/karaf-0.22.2/bin/setenv ++ export CONTROLLERMEM= ++ CONTROLLERMEM= ++ case "${DISTROSTREAM}" in ++ CLUSTER_SYSTEM=pekko ++ export AKKACONF=/tmp/karaf-0.22.2/configuration/initial/pekko.conf ++ AKKACONF=/tmp/karaf-0.22.2/configuration/initial/pekko.conf ++ export MODULESCONF=/tmp/karaf-0.22.2/configuration/initial/modules.conf ++ MODULESCONF=/tmp/karaf-0.22.2/configuration/initial/modules.conf ++ export MODULESHARDSCONF=/tmp/karaf-0.22.2/configuration/initial/module-shards.conf ++ MODULESHARDSCONF=/tmp/karaf-0.22.2/configuration/initial/module-shards.conf ++ print_common_env ++ cat common-functions environment: MAVENCONF: /tmp/karaf-0.22.2/etc/org.ops4j.pax.url.mvn.cfg ACTUALFEATURES: FEATURESCONF: /tmp/karaf-0.22.2/etc/org.apache.karaf.features.cfg CUSTOMPROP: /tmp/karaf-0.22.2/etc/custom.properties LOGCONF: /tmp/karaf-0.22.2/etc/org.ops4j.pax.logging.cfg MEMCONF: /tmp/karaf-0.22.2/bin/setenv CONTROLLERMEM: AKKACONF: /tmp/karaf-0.22.2/configuration/initial/pekko.conf MODULESCONF: /tmp/karaf-0.22.2/configuration/initial/modules.conf MODULESHARDSCONF: /tmp/karaf-0.22.2/configuration/initial/module-shards.conf SUITES: ++ SSH='ssh -t -t' ++ extra_services_cntl=' dnsmasq.service httpd.service libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service rabbitmq-server.service ' ++ extra_services_cmp=' libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service ' Changing to /tmp Downloading the distribution from https://nexus.opendaylight.org/content/repositories//autorelease-9609/org/opendaylight/integration/karaf/0.22.2/karaf-0.22.2.zip + echo 'Changing to /tmp' + cd /tmp + echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories//autorelease-9609/org/opendaylight/integration/karaf/0.22.2/karaf-0.22.2.zip' + wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories//autorelease-9609/org/opendaylight/integration/karaf/0.22.2/karaf-0.22.2.zip --2026-02-24 01:58:33-- https://nexus.opendaylight.org/content/repositories//autorelease-9609/org/opendaylight/integration/karaf/0.22.2/karaf-0.22.2.zip Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6 Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 234884299 (224M) [application/zip] Saving to: ‘karaf-0.22.2.zip’ 0K ........ ........ ........ ........ ........ ........ 1% 71.8M 3s 3072K ........ ........ ........ ........ ........ ........ 2% 126M 2s 6144K ........ ........ ........ ........ ........ ........ 4% 129M 2s 9216K ........ ........ ........ ........ ........ ........ 5% 121M 2s 12288K ........ ........ ........ ........ ........ ........ 6% 199M 2s 15360K ........ ........ ........ ........ ........ ........ 8% 178M 2s 18432K ........ ........ ........ ........ ........ ........ 9% 205M 2s 21504K ........ ........ ........ ........ ........ ........ 10% 233M 1s 24576K ........ ........ ........ ........ ........ ........ 12% 249M 1s 27648K ........ ........ ........ ........ ........ ........ 13% 260M 1s 30720K ........ ........ ........ ........ ........ ........ 14% 272M 1s 33792K ........ ........ ........ ........ ........ ........ 16% 293M 1s 36864K ........ ........ ........ ........ ........ ........ 17% 279M 1s 39936K ........ ........ ........ ........ ........ ........ 18% 297M 1s 43008K ........ ........ ........ ........ ........ ........ 20% 303M 1s 46080K ........ ........ ........ ........ ........ ........ 21% 336M 1s 49152K ........ ........ ........ ........ ........ ........ 22% 340M 1s 52224K ........ ........ ........ ........ ........ ........ 24% 351M 1s 55296K ........ ........ ........ ........ ........ ........ 25% 328M 1s 58368K ........ ........ ........ ........ ........ ........ 26% 346M 1s 61440K ........ ........ ........ ........ ........ ........ 28% 349M 1s 64512K ........ ........ ........ ........ ........ ........ 29% 246M 1s 67584K ........ ........ ........ ........ ........ ........ 30% 294M 1s 70656K ........ ........ ........ ........ ........ ........ 32% 358M 1s 73728K ........ ........ ........ ........ ........ ........ 33% 330M 1s 76800K ........ ........ ........ ........ ........ ........ 34% 336M 1s 79872K ........ ........ ........ ........ ........ ........ 36% 330M 1s 82944K ........ ........ ........ ........ ........ ........ 37% 333M 1s 86016K ........ ........ ........ ........ ........ ........ 38% 337M 1s 89088K ........ ........ ........ ........ ........ ........ 40% 328M 1s 92160K ........ ........ ........ ........ ........ ........ 41% 319M 1s 95232K ........ ........ ........ ........ ........ ........ 42% 334M 1s 98304K ........ ........ ........ ........ ........ ........ 44% 340M 1s 101376K ........ ........ ........ ........ ........ ........ 45% 331M 1s 104448K ........ ........ ........ ........ ........ ........ 46% 334M 0s 107520K ........ ........ ........ ........ ........ ........ 48% 330M 0s 110592K ........ ........ ........ ........ ........ ........ 49% 334M 0s 113664K ........ ........ ........ ........ ........ ........ 50% 322M 0s 116736K ........ ........ ........ ........ ........ ........ 52% 328M 0s 119808K ........ ........ ........ ........ ........ ........ 53% 316M 0s 122880K ........ ........ ........ ........ ........ ........ 54% 307M 0s 125952K ........ ........ ........ ........ ........ ........ 56% 327M 0s 129024K ........ ........ ........ ........ ........ ........ 57% 332M 0s 132096K ........ ........ ........ ........ ........ ........ 58% 261M 0s 135168K ........ ........ ........ ........ ........ ........ 60% 348M 0s 138240K ........ ........ ........ ........ ........ ........ 61% 462M 0s 141312K ........ ........ ........ ........ ........ ........ 62% 378M 0s 144384K ........ ........ ........ ........ ........ ........ 64% 359M 0s 147456K ........ ........ ........ ........ ........ ........ 65% 351M 0s 150528K ........ ........ ........ ........ ........ ........ 66% 359M 0s 153600K ........ ........ ........ ........ ........ ........ 68% 351M 0s 156672K ........ ........ ........ ........ ........ ........ 69% 352M 0s 159744K ........ ........ ........ ........ ........ ........ 70% 360M 0s 162816K ........ ........ ........ ........ ........ ........ 72% 358M 0s 165888K ........ ........ ........ ........ ........ ........ 73% 350M 0s 168960K ........ ........ ........ ........ ........ ........ 74% 358M 0s 172032K ........ ........ ........ ........ ........ ........ 76% 352M 0s 175104K ........ ........ ........ ........ ........ ........ 77% 329M 0s 178176K ........ ........ ........ ........ ........ ........ 79% 388M 0s 181248K ........ ........ ........ ........ ........ ........ 80% 368M 0s 184320K ........ ........ ........ ........ ........ ........ 81% 362M 0s 187392K ........ ........ ........ ........ ........ ........ 83% 354M 0s 190464K ........ ........ ........ ........ ........ ........ 84% 348M 0s 193536K ........ ........ ........ ........ ........ ........ 85% 368M 0s 196608K ........ ........ ........ ........ ........ ........ 87% 358M 0s 199680K ........ ........ ........ ........ ........ ........ 88% 381M 0s 202752K ........ ........ ........ ........ ........ ........ 89% 385M 0s 205824K ........ ........ ........ ........ ........ ........ 91% 345M 0s 208896K ........ ........ ........ ........ ........ ........ 92% 325M 0s 211968K ........ ........ ........ ........ ........ ........ 93% 143M 0s 215040K ........ ........ ........ ........ ........ ........ 95% 281M 0s 218112K ........ ........ ........ ........ ........ ........ 96% 351M 0s 221184K ........ ........ ........ ........ ........ ........ 97% 356M 0s 224256K ........ ........ ........ ........ ........ ........ 99% 337M 0s 227328K ........ ........ ........ ........ 100% 361M=0.8s 2026-02-24 01:58:34 (284 MB/s) - ‘karaf-0.22.2.zip’ saved [234884299/234884299] Extracting the new controller... + echo 'Extracting the new controller...' + unzip -q karaf-0.22.2.zip Adding external repositories... + echo 'Adding external repositories...' + sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.22.2/etc/org.ops4j.pax.url.mvn.cfg + cat /tmp/karaf-0.22.2/etc/org.ops4j.pax.url.mvn.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # If set to true, the following property will not allow any certificate to be used # when accessing Maven repositories through SSL # #org.ops4j.pax.url.mvn.certificateCheck= # # Path to the local Maven settings file. # The repositories defined in this file will be automatically added to the list # of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property # below is not set. # The following locations are checked for the existence of the settings.xml file # * 1. looks for the specified url # * 2. if not found looks for ${user.home}/.m2/settings.xml # * 3. if not found looks for ${maven.home}/conf/settings.xml # * 4. if not found looks for ${M2_HOME}/conf/settings.xml # #org.ops4j.pax.url.mvn.settings= # # Path to the local Maven repository which is used to avoid downloading # artifacts when they already exist locally. # The value of this property will be extracted from the settings.xml file # above, or defaulted to: # System.getProperty( "user.home" ) + "/.m2/repository" # org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository} # # Default this to false. It's just weird to use undocumented repos # org.ops4j.pax.url.mvn.useFallbackRepositories=false # # Uncomment if you don't wanna use the proxy settings # from the Maven conf/settings.xml file # # org.ops4j.pax.url.mvn.proxySupport=false # # Comma separated list of repositories scanned when resolving an artifact. # Those repositories will be checked before iterating through the # below list of repositories and even before the local repository # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snaphots # @noreleases : the repository does not contain any released artifacts # # The following property value will add the system folder as a repo. # org.ops4j.pax.url.mvn.defaultRepositories=\ file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\ file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\ file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots # Use the default local repo (e.g.~/.m2/repository) as a "remote" repo #org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false # # Comma separated list of repositories scanned when resolving an artifact. # The default list includes the following repositories: # http://repo1.maven.org/maven2@id=central # http://repository.springsource.com/maven/bundles/release@id=spring.ebr # http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external # http://zodiac.springsource.com/maven/bundles/release@id=gemini # http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases # https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases # https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases # To add repositories to the default ones, prepend '+' to the list of repositories # to add. # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snapshots # @noreleases : the repository does not contain any released artifacts # @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended # org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases ### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.Configuring the startup features... + [[ True == \T\r\u\e ]] + echo 'Configuring the startup features...' + sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-infrautils-ready,odl-jolokia,odl-openflowplugin-flow-services-rest,odl-openflowplugin-app-bulk-o-matic,/g' /tmp/karaf-0.22.2/etc/org.apache.karaf.features.cfg + FEATURE_TEST_STRING=features-test + FEATURE_TEST_VERSION=0.22.2 + KARAF_VERSION=karaf4 + [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]] + sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.22.2/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.22.2/etc/org.apache.karaf.features.cfg + [[ ! -z '' ]] + cat /tmp/karaf-0.22.2/etc/org.apache.karaf.features.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # Comma separated list of features repositories to register by default # featuresRepositories = mvn:org.opendaylight.integration/features-test/0.22.2/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/93ddc44b-96cd-439d-bff5-15a70b98e20e.xml # # Comma separated list of features to install at startup # featuresBoot = odl-infrautils-ready,odl-jolokia,odl-openflowplugin-flow-services-rest,odl-openflowplugin-app-bulk-o-matic, 1686c8c6-e62b-4dfc-931c-514c8ae9fd8b # # Resource repositories (OBR) that the features resolver can use # to resolve requirements/capabilities # # The format of the resourceRepositories is # resourceRepositories=[xml:url|json:url],... # for Instance: # #resourceRepositories=xml:http://host/path/to/index.xml # or #resourceRepositories=json:http://host/path/to/index.json # # # Defines if the boot features are started in asynchronous mode (in a dedicated thread) # featuresBootAsynchronous=false # # Service requirements enforcement # # By default, the feature resolver checks the service requirements/capabilities of # bundles for new features (xml schema >= 1.3.0) in order to automatically installs # the required bundles. # The following flag can have those values: # - disable: service requirements are completely ignored # - default: service requirements are ignored for old features # - enforce: service requirements are always verified # #serviceRequirements=default # # Store cfg file for config element in feature # #configCfgStore=true # # Define if the feature service automatically refresh bundles # autoRefresh=true # # Configuration of features processing mechanism (overrides, blacklisting, modification of features) # XML file defines instructions related to features processing # versions.properties may declare properties to resolve placeholders in XML file # both files are relative to ${karaf.etc} # #featureProcessing=org.apache.karaf.features.xml #featureProcessingVersions=versions.properties + configure_karaf_log karaf4 '' + local -r karaf_version=karaf4 + local -r controllerdebugmap= + local logapi=log4j + grep log4j2 /tmp/karaf-0.22.2/etc/org.ops4j.pax.logging.cfg log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n log4j2.rootLogger.level = INFO #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 64MB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE Configuring the karaf log... karaf_version: karaf4, logapi: log4j2 + logapi=log4j2 + echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2' + '[' log4j2 == log4j2 ']' + sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.22.2/etc/org.ops4j.pax.logging.cfg controllerdebugmap: cat /tmp/karaf-0.22.2/etc/org.ops4j.pax.logging.cfg + orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver + orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN' + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN' + unset IFS + echo 'controllerdebugmap: ' + '[' -n '' ']' + echo 'cat /tmp/karaf-0.22.2/etc/org.ops4j.pax.logging.cfg' + cat /tmp/karaf-0.22.2/etc/org.ops4j.pax.logging.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # Common pattern layout for appenders log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n # Root logger log4j2.rootLogger.level = INFO # uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} # Filters for logs marked by org.opendaylight.odlparent.Markers log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL # Loggers configuration # Spifly logger log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN # Security audit logger log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Appenders configuration # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} # Rolling file appender log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i # uncomment to not force a disk flush #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 1GB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 # Audit file appender log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 # OSGi appender log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * # help with identification of maven-related problems with pax-url-aether #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN + set_java_vars /usr/lib/jvm/java-21-openjdk-amd64 2048m /tmp/karaf-0.22.2/bin/setenv + local -r java_home=/usr/lib/jvm/java-21-openjdk-amd64 + local -r controllermem=2048m + local -r memconf=/tmp/karaf-0.22.2/bin/setenv + echo Configure Configure java home: /usr/lib/jvm/java-21-openjdk-amd64 max memory: 2048m memconf: /tmp/karaf-0.22.2/bin/setenv + echo ' java home: /usr/lib/jvm/java-21-openjdk-amd64' + echo ' max memory: 2048m' + echo ' memconf: /tmp/karaf-0.22.2/bin/setenv' + sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64}%g' /tmp/karaf-0.22.2/bin/setenv + sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=2048m/g' /tmp/karaf-0.22.2/bin/setenv cat /tmp/karaf-0.22.2/bin/setenv + echo 'cat /tmp/karaf-0.22.2/bin/setenv' + cat /tmp/karaf-0.22.2/bin/setenv #!/bin/sh # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # # # handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf # script: client, instance, shell, start, status, stop, karaf # # if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then # Actions go here... # fi # # general settings which should be applied for all scripts go here; please keep # in mind that it is possible that scripts might be executed more than once, e.g. # in example of the start script where the start script is executed first and the # karaf script afterwards. # # # The following section shows the possible configuration options for the default # karaf scripts # export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64} # Location of Java installation # export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration # export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options # export EXTRA_JAVA_OPTS # Additional JVM options # export KARAF_HOME # Karaf home folder # export KARAF_DATA # Karaf data folder # export KARAF_BASE # Karaf base folder # export KARAF_ETC # Karaf etc folder # export KARAF_LOG # Karaf log folder # export KARAF_SYSTEM_OPTS # First citizen Karaf options # export KARAF_OPTS # Additional available Karaf options # export KARAF_DEBUG # Enable debug mode # export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start # export KARAF_NOROOT # Prevent execution as root if set to true Set Java version + echo 'Set Java version' + sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-21-openjdk-amd64/bin/java 1 sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper sudo: a password is required + sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-21-openjdk-amd64/bin/java sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper sudo: a password is required JDK default version ... + echo 'JDK default version ...' + java -version openjdk version "21.0.9" 2025-10-21 OpenJDK Runtime Environment (build 21.0.9+10-Ubuntu-122.04) OpenJDK 64-Bit Server VM (build 21.0.9+10-Ubuntu-122.04, mixed mode, sharing) Set JAVA_HOME + echo 'Set JAVA_HOME' + export JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64 + JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64 ++ readlink -e /usr/lib/jvm/java-21-openjdk-amd64/bin/java + JAVA_RESOLVED=/usr/lib/jvm/java-21-openjdk-amd64/bin/java + echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java' Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java Listing all open ports on controller system... + echo 'Listing all open ports on controller system...' + netstat -pnatu /tmp/configuration-script.sh: line 40: netstat: command not found + '[' -f /tmp/custom_shard_config.txt ']' Configuring cluster + echo 'Configuring cluster' + /tmp/karaf-0.22.2/bin/configure_cluster.sh 1 10.30.171.91 10.30.170.68 10.30.170.152 ################################################ ## Configure Cluster ## ################################################ NOTE: Cluster configuration files not found. Copying from /tmp/karaf-0.22.2/system/org/opendaylight/controller/sal-clustering-config/11.0.2 Configuring unique name in pekko.conf Configuring hostname in pekko.conf Configuring data and rpc seed nodes in pekko.conf modules = [ { name = "inventory" namespace = "urn:opendaylight:inventory" shard-strategy = "module" }, { name = "topology" namespace = "urn:TBD:params:xml:ns:yang:network-topology" shard-strategy = "module" }, { name = "toaster" namespace = "http://netconfcentral.org/ns/toaster" shard-strategy = "module" } ] Configuring replication type in module-shards.conf ################################################ ## NOTE: Manually restart controller to ## ## apply configuration. ## ################################################ Dump pekko.conf + echo 'Dump pekko.conf' + cat /tmp/karaf-0.22.2/configuration/initial/pekko.conf odl-cluster-data { pekko { remote { artery { enabled = on transport = tcp canonical.hostname = "10.30.171.91" canonical.port = 2550 } } cluster { # Using artery. seed-nodes = ["pekko://opendaylight-cluster-data@10.30.171.91:2550", "pekko://opendaylight-cluster-data@10.30.170.68:2550", "pekko://opendaylight-cluster-data@10.30.170.152:2550"] roles = ["member-1"] # when under load we might trip a false positive on the failure detector # failure-detector { # heartbeat-interval = 4 s # acceptable-heartbeat-pause = 16s # } } persistence { # By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by # modifying the following two properties. The directory location specified may be a relative or absolute path. # The relative path is always relative to KARAF_HOME. # snapshot-store.local.dir = "target/snapshots" # Use lz4 compression for LocalSnapshotStore snapshots snapshot-store.local.use-lz4-compression = false # Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB snapshot-store.local.lz4-blocksize = 256KB } disable-default-actor-system-quarantined-event-handling = "false" } } Dump modules.conf + echo 'Dump modules.conf' + cat /tmp/karaf-0.22.2/configuration/initial/modules.conf modules = [ { name = "inventory" namespace = "urn:opendaylight:inventory" shard-strategy = "module" }, { name = "topology" namespace = "urn:TBD:params:xml:ns:yang:network-topology" shard-strategy = "module" }, { name = "toaster" namespace = "http://netconfcentral.org/ns/toaster" shard-strategy = "module" } ] Dump module-shards.conf + echo 'Dump module-shards.conf' + cat /tmp/karaf-0.22.2/configuration/initial/module-shards.conf module-shards = [ { name = "default" shards = [ { name = "default" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "inventory" shards = [ { name="inventory" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "topology" shards = [ { name="topology" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "toaster" shards = [ { name="toaster" replicas = ["member-1", "member-2", "member-3"] } ] } ] Configuring member-2 with IP address 10.30.170.68 Warning: Permanently added '10.30.170.68' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.170.68' (ECDSA) to the list of known hosts. + source /tmp/common-functions.sh karaf-0.22.2 titanium ++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]] common-functions.sh is being sourced ++ echo 'common-functions.sh is being sourced' ++ BUNDLEFOLDER=karaf-0.22.2 ++ DISTROSTREAM=titanium ++ export MAVENCONF=/tmp/karaf-0.22.2/etc/org.ops4j.pax.url.mvn.cfg ++ MAVENCONF=/tmp/karaf-0.22.2/etc/org.ops4j.pax.url.mvn.cfg ++ export FEATURESCONF=/tmp/karaf-0.22.2/etc/org.apache.karaf.features.cfg ++ FEATURESCONF=/tmp/karaf-0.22.2/etc/org.apache.karaf.features.cfg ++ export CUSTOMPROP=/tmp/karaf-0.22.2/etc/custom.properties ++ CUSTOMPROP=/tmp/karaf-0.22.2/etc/custom.properties ++ export LOGCONF=/tmp/karaf-0.22.2/etc/org.ops4j.pax.logging.cfg ++ LOGCONF=/tmp/karaf-0.22.2/etc/org.ops4j.pax.logging.cfg ++ export MEMCONF=/tmp/karaf-0.22.2/bin/setenv ++ MEMCONF=/tmp/karaf-0.22.2/bin/setenv ++ export CONTROLLERMEM= ++ CONTROLLERMEM= ++ case "${DISTROSTREAM}" in ++ CLUSTER_SYSTEM=pekko ++ export AKKACONF=/tmp/karaf-0.22.2/configuration/initial/pekko.conf ++ AKKACONF=/tmp/karaf-0.22.2/configuration/initial/pekko.conf ++ export MODULESCONF=/tmp/karaf-0.22.2/configuration/initial/modules.conf ++ MODULESCONF=/tmp/karaf-0.22.2/configuration/initial/modules.conf ++ export MODULESHARDSCONF=/tmp/karaf-0.22.2/configuration/initial/module-shards.conf ++ MODULESHARDSCONF=/tmp/karaf-0.22.2/configuration/initial/module-shards.conf ++ print_common_env ++ cat common-functions environment: MAVENCONF: /tmp/karaf-0.22.2/etc/org.ops4j.pax.url.mvn.cfg ACTUALFEATURES: FEATURESCONF: /tmp/karaf-0.22.2/etc/org.apache.karaf.features.cfg CUSTOMPROP: /tmp/karaf-0.22.2/etc/custom.properties LOGCONF: /tmp/karaf-0.22.2/etc/org.ops4j.pax.logging.cfg MEMCONF: /tmp/karaf-0.22.2/bin/setenv CONTROLLERMEM: AKKACONF: /tmp/karaf-0.22.2/configuration/initial/pekko.conf MODULESCONF: /tmp/karaf-0.22.2/configuration/initial/modules.conf MODULESHARDSCONF: /tmp/karaf-0.22.2/configuration/initial/module-shards.conf SUITES: ++ SSH='ssh -t -t' ++ extra_services_cntl=' dnsmasq.service httpd.service libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service rabbitmq-server.service ' ++ extra_services_cmp=' libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service ' Changing to /tmp Downloading the distribution from https://nexus.opendaylight.org/content/repositories//autorelease-9609/org/opendaylight/integration/karaf/0.22.2/karaf-0.22.2.zip + echo 'Changing to /tmp' + cd /tmp + echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories//autorelease-9609/org/opendaylight/integration/karaf/0.22.2/karaf-0.22.2.zip' + wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories//autorelease-9609/org/opendaylight/integration/karaf/0.22.2/karaf-0.22.2.zip --2026-02-24 01:58:37-- https://nexus.opendaylight.org/content/repositories//autorelease-9609/org/opendaylight/integration/karaf/0.22.2/karaf-0.22.2.zip Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6 Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 234884299 (224M) [application/zip] Saving to: ‘karaf-0.22.2.zip’ 0K ........ ........ ........ ........ ........ ........ 1% 15.9M 14s 3072K ........ ........ ........ ........ ........ ........ 2% 33.4M 10s 6144K ........ ........ ........ ........ ........ ........ 4% 87.7M 7s 9216K ........ ........ ........ ........ ........ ........ 5% 103M 6s 12288K ........ ........ ........ ........ ........ ........ 6% 83.0M 5s 15360K ........ ........ ........ ........ ........ ........ 8% 92.0M 5s 18432K ........ ........ ........ ........ ........ ........ 9% 91.0M 4s 21504K ........ ........ ........ ........ ........ ........ 10% 109M 4s 24576K ........ ........ ........ ........ ........ ........ 12% 104M 4s 27648K ........ ........ ........ ........ ........ ........ 13% 115M 3s 30720K ........ ........ ........ ........ ........ ........ 14% 98.0M 3s 33792K ........ ........ ........ ........ ........ ........ 16% 98.7M 3s 36864K ........ ........ ........ ........ ........ ........ 17% 109M 3s 39936K ........ ........ ........ ........ ........ ........ 18% 118M 3s 43008K ........ ........ ........ ........ ........ ........ 20% 101M 3s 46080K ........ ........ ........ ........ ........ ........ 21% 102M 3s 49152K ........ ........ ........ ........ ........ ........ 22% 97.8M 2s 52224K ........ ........ ........ ........ ........ ........ 24% 94.4M 2s 55296K ........ ........ ........ ........ ........ ........ 25% 98.4M 2s 58368K ........ ........ ........ ........ ........ ........ 26% 111M 2s 61440K ........ ........ ........ ........ ........ ........ 28% 157M 2s 64512K ........ ........ ........ ........ ........ ........ 29% 181M 2s 67584K ........ ........ ........ ........ ........ ........ 30% 186M 2s 70656K ........ ........ ........ ........ ........ ........ 32% 197M 2s 73728K ........ ........ ........ ........ ........ ........ 33% 213M 2s 76800K ........ ........ ........ ........ ........ ........ 34% 234M 2s 79872K ........ ........ ........ ........ ........ ........ 36% 252M 2s 82944K ........ ........ ........ ........ ........ ........ 37% 265M 2s 86016K ........ ........ ........ ........ ........ ........ 38% 303M 1s 89088K ........ ........ ........ ........ ........ ........ 40% 279M 1s 92160K ........ ........ ........ ........ ........ ........ 41% 291M 1s 95232K ........ ........ ........ ........ ........ ........ 42% 284M 1s 98304K ........ ........ ........ ........ ........ ........ 44% 282M 1s 101376K ........ ........ ........ ........ ........ ........ 45% 291M 1s 104448K ........ ........ ........ ........ ........ ........ 46% 284M 1s 107520K ........ ........ ........ ........ ........ ........ 48% 284M 1s 110592K ........ ........ ........ ........ ........ ........ 49% 297M 1s 113664K ........ ........ ........ ........ ........ ........ 50% 289M 1s 116736K ........ ........ ........ ........ ........ ........ 52% 280M 1s 119808K ........ ........ ........ ........ ........ ........ 53% 286M 1s 122880K ........ ........ ........ ........ ........ ........ 54% 290M 1s 125952K ........ ........ ........ ........ ........ ........ 56% 296M 1s 129024K ........ ........ ........ ........ ........ ........ 57% 281M 1s 132096K ........ ........ ........ ........ ........ ........ 58% 295M 1s 135168K ........ ........ ........ ........ ........ ........ 60% 282M 1s 138240K ........ ........ ........ ........ ........ ........ 61% 284M 1s 141312K ........ ........ ........ ........ ........ ........ 62% 280M 1s 144384K ........ ........ ........ ........ ........ ........ 64% 285M 1s 147456K ........ ........ ........ ........ ........ ........ 65% 281M 1s 150528K ........ ........ ........ ........ ........ ........ 66% 272M 1s 153600K ........ ........ ........ ........ ........ ........ 68% 295M 1s 156672K ........ ........ ........ ........ ........ ........ 69% 284M 1s 159744K ........ ........ ........ ........ ........ ........ 70% 274M 0s 162816K ........ ........ ........ ........ ........ ........ 72% 293M 0s 165888K ........ ........ ........ ........ ........ ........ 73% 276M 0s 168960K ........ ........ ........ ........ ........ ........ 74% 297M 0s 172032K ........ ........ ........ ........ ........ ........ 76% 282M 0s 175104K ........ ........ ........ ........ ........ ........ 77% 292M 0s 178176K ........ ........ ........ ........ ........ ........ 79% 286M 0s 181248K ........ ........ ........ ........ ........ ........ 80% 293M 0s 184320K ........ ........ ........ ........ ........ ........ 81% 286M 0s 187392K ........ ........ ........ ........ ........ ........ 83% 295M 0s 190464K ........ ........ ........ ........ ........ ........ 84% 295M 0s 193536K ........ ........ ........ ........ ........ ........ 85% 290M 0s 196608K ........ ........ ........ ........ ........ ........ 87% 287M 0s 199680K ........ ........ ........ ........ ........ ........ 88% 276M 0s 202752K ........ ........ ........ ........ ........ ........ 89% 278M 0s 205824K ........ ........ ........ ........ ........ ........ 91% 286M 0s 208896K ........ ........ ........ ........ ........ ........ 92% 291M 0s 211968K ........ ........ ........ ........ ........ ........ 93% 291M 0s 215040K ........ ........ ........ ........ ........ ........ 95% 299M 0s 218112K ........ ........ ........ ........ ........ ........ 96% 283M 0s 221184K ........ ........ ........ ........ ........ ........ 97% 287M 0s 224256K ........ ........ ........ ........ ........ ........ 99% 295M 0s 227328K ........ ........ ........ ........ 100% 291M=1.4s 2026-02-24 01:58:38 (157 MB/s) - ‘karaf-0.22.2.zip’ saved [234884299/234884299] Extracting the new controller... + echo 'Extracting the new controller...' + unzip -q karaf-0.22.2.zip Adding external repositories... + echo 'Adding external repositories...' + sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.22.2/etc/org.ops4j.pax.url.mvn.cfg + cat /tmp/karaf-0.22.2/etc/org.ops4j.pax.url.mvn.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # If set to true, the following property will not allow any certificate to be used # when accessing Maven repositories through SSL # #org.ops4j.pax.url.mvn.certificateCheck= # # Path to the local Maven settings file. # The repositories defined in this file will be automatically added to the list # of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property # below is not set. # The following locations are checked for the existence of the settings.xml file # * 1. looks for the specified url # * 2. if not found looks for ${user.home}/.m2/settings.xml # * 3. if not found looks for ${maven.home}/conf/settings.xml # * 4. if not found looks for ${M2_HOME}/conf/settings.xml # #org.ops4j.pax.url.mvn.settings= # # Path to the local Maven repository which is used to avoid downloading # artifacts when they already exist locally. # The value of this property will be extracted from the settings.xml file # above, or defaulted to: # System.getProperty( "user.home" ) + "/.m2/repository" # org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository} # # Default this to false. It's just weird to use undocumented repos # org.ops4j.pax.url.mvn.useFallbackRepositories=false # # Uncomment if you don't wanna use the proxy settings # from the Maven conf/settings.xml file # # org.ops4j.pax.url.mvn.proxySupport=false # # Comma separated list of repositories scanned when resolving an artifact. # Those repositories will be checked before iterating through the # below list of repositories and even before the local repository # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snaphots # @noreleases : the repository does not contain any released artifacts # # The following property value will add the system folder as a repo. # org.ops4j.pax.url.mvn.defaultRepositories=\ file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\ file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\ file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots # Use the default local repo (e.g.~/.m2/repository) as a "remote" repo #org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false # # Comma separated list of repositories scanned when resolving an artifact. # The default list includes the following repositories: # http://repo1.maven.org/maven2@id=central # http://repository.springsource.com/maven/bundles/release@id=spring.ebr # http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external # http://zodiac.springsource.com/maven/bundles/release@id=gemini # http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases # https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases # https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases # To add repositories to the default ones, prepend '+' to the list of repositories # to add. # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snapshots # @noreleases : the repository does not contain any released artifacts # @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended # org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases ### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.Configuring the startup features... + [[ True == \T\r\u\e ]] + echo 'Configuring the startup features...' + sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-infrautils-ready,odl-jolokia,odl-openflowplugin-flow-services-rest,odl-openflowplugin-app-bulk-o-matic,/g' /tmp/karaf-0.22.2/etc/org.apache.karaf.features.cfg + FEATURE_TEST_STRING=features-test + FEATURE_TEST_VERSION=0.22.2 + KARAF_VERSION=karaf4 + [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]] + sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.22.2/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.22.2/etc/org.apache.karaf.features.cfg + [[ ! -z '' ]] + cat /tmp/karaf-0.22.2/etc/org.apache.karaf.features.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # Comma separated list of features repositories to register by default # featuresRepositories = mvn:org.opendaylight.integration/features-test/0.22.2/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/93ddc44b-96cd-439d-bff5-15a70b98e20e.xml # # Comma separated list of features to install at startup # featuresBoot = odl-infrautils-ready,odl-jolokia,odl-openflowplugin-flow-services-rest,odl-openflowplugin-app-bulk-o-matic, 1686c8c6-e62b-4dfc-931c-514c8ae9fd8b # # Resource repositories (OBR) that the features resolver can use # to resolve requirements/capabilities # # The format of the resourceRepositories is # resourceRepositories=[xml:url|json:url],... # for Instance: # #resourceRepositories=xml:http://host/path/to/index.xml # or #resourceRepositories=json:http://host/path/to/index.json # # # Defines if the boot features are started in asynchronous mode (in a dedicated thread) # featuresBootAsynchronous=false # # Service requirements enforcement # # By default, the feature resolver checks the service requirements/capabilities of # bundles for new features (xml schema >= 1.3.0) in order to automatically installs # the required bundles. # The following flag can have those values: # - disable: service requirements are completely ignored # - default: service requirements are ignored for old features # - enforce: service requirements are always verified # #serviceRequirements=default # # Store cfg file for config element in feature # #configCfgStore=true # # Define if the feature service automatically refresh bundles # autoRefresh=true # # Configuration of features processing mechanism (overrides, blacklisting, modification of features) # XML file defines instructions related to features processing # versions.properties may declare properties to resolve placeholders in XML file # both files are relative to ${karaf.etc} # #featureProcessing=org.apache.karaf.features.xml #featureProcessingVersions=versions.properties + configure_karaf_log karaf4 '' + local -r karaf_version=karaf4 + local -r controllerdebugmap= + local logapi=log4j + grep log4j2 /tmp/karaf-0.22.2/etc/org.ops4j.pax.logging.cfg log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n log4j2.rootLogger.level = INFO #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 64MB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE + logapi=log4j2 + echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2' Configuring the karaf log... karaf_version: karaf4, logapi: log4j2 + '[' log4j2 == log4j2 ']' + sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.22.2/etc/org.ops4j.pax.logging.cfg + orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver + orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN' + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN' controllerdebugmap: + unset IFS + echo 'controllerdebugmap: ' cat /tmp/karaf-0.22.2/etc/org.ops4j.pax.logging.cfg + '[' -n '' ']' + echo 'cat /tmp/karaf-0.22.2/etc/org.ops4j.pax.logging.cfg' + cat /tmp/karaf-0.22.2/etc/org.ops4j.pax.logging.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # Common pattern layout for appenders log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n # Root logger log4j2.rootLogger.level = INFO # uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} # Filters for logs marked by org.opendaylight.odlparent.Markers log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL # Loggers configuration # Spifly logger log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN # Security audit logger log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Appenders configuration # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} # Rolling file appender log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i # uncomment to not force a disk flush #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 1GB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 # Audit file appender log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 # OSGi appender log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * # help with identification of maven-related problems with pax-url-aether #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN + set_java_vars /usr/lib/jvm/java-21-openjdk-amd64 2048m /tmp/karaf-0.22.2/bin/setenv + local -r java_home=/usr/lib/jvm/java-21-openjdk-amd64 + local -r controllermem=2048m Configure java home: /usr/lib/jvm/java-21-openjdk-amd64 max memory: 2048m + local -r memconf=/tmp/karaf-0.22.2/bin/setenv + echo Configure + echo ' java home: /usr/lib/jvm/java-21-openjdk-amd64' + echo ' max memory: 2048m' memconf: /tmp/karaf-0.22.2/bin/setenv + echo ' memconf: /tmp/karaf-0.22.2/bin/setenv' + sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64}%g' /tmp/karaf-0.22.2/bin/setenv + sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=2048m/g' /tmp/karaf-0.22.2/bin/setenv cat /tmp/karaf-0.22.2/bin/setenv + echo 'cat /tmp/karaf-0.22.2/bin/setenv' + cat /tmp/karaf-0.22.2/bin/setenv #!/bin/sh # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # # # handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf # script: client, instance, shell, start, status, stop, karaf # # if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then # Actions go here... # fi # # general settings which should be applied for all scripts go here; please keep # in mind that it is possible that scripts might be executed more than once, e.g. # in example of the start script where the start script is executed first and the # karaf script afterwards. # # # The following section shows the possible configuration options for the default # karaf scripts # export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64} # Location of Java installation # export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration # export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options # export EXTRA_JAVA_OPTS # Additional JVM options # export KARAF_HOME # Karaf home folder # export KARAF_DATA # Karaf data folder # export KARAF_BASE # Karaf base folder # export KARAF_ETC # Karaf etc folder # export KARAF_LOG # Karaf log folder # export KARAF_SYSTEM_OPTS # First citizen Karaf options # export KARAF_OPTS # Additional available Karaf options # export KARAF_DEBUG # Enable debug mode # export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start # export KARAF_NOROOT # Prevent execution as root if set to true Set Java version + echo 'Set Java version' + sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-21-openjdk-amd64/bin/java 1 sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper sudo: a password is required + sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-21-openjdk-amd64/bin/java sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper sudo: a password is required JDK default version ... + echo 'JDK default version ...' + java -version openjdk version "21.0.9" 2025-10-21 OpenJDK Runtime Environment (build 21.0.9+10-Ubuntu-122.04) OpenJDK 64-Bit Server VM (build 21.0.9+10-Ubuntu-122.04, mixed mode, sharing) Set JAVA_HOME + echo 'Set JAVA_HOME' + export JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64 + JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64 ++ readlink -e /usr/lib/jvm/java-21-openjdk-amd64/bin/java Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java + JAVA_RESOLVED=/usr/lib/jvm/java-21-openjdk-amd64/bin/java + echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java' Listing all open ports on controller system... + echo 'Listing all open ports on controller system...' + netstat -pnatu /tmp/configuration-script.sh: line 40: netstat: command not found Configuring cluster + '[' -f /tmp/custom_shard_config.txt ']' + echo 'Configuring cluster' + /tmp/karaf-0.22.2/bin/configure_cluster.sh 2 10.30.171.91 10.30.170.68 10.30.170.152 ################################################ ## Configure Cluster ## ################################################ NOTE: Cluster configuration files not found. Copying from /tmp/karaf-0.22.2/system/org/opendaylight/controller/sal-clustering-config/11.0.2 Configuring unique name in pekko.conf Configuring hostname in pekko.conf Configuring data and rpc seed nodes in pekko.conf modules = [ { name = "inventory" namespace = "urn:opendaylight:inventory" shard-strategy = "module" }, { name = "topology" namespace = "urn:TBD:params:xml:ns:yang:network-topology" shard-strategy = "module" }, { name = "toaster" namespace = "http://netconfcentral.org/ns/toaster" shard-strategy = "module" } ] Configuring replication type in module-shards.conf ################################################ ## NOTE: Manually restart controller to ## ## apply configuration. ## ################################################ Dump pekko.conf + echo 'Dump pekko.conf' + cat /tmp/karaf-0.22.2/configuration/initial/pekko.conf odl-cluster-data { pekko { remote { artery { enabled = on transport = tcp canonical.hostname = "10.30.170.68" canonical.port = 2550 } } cluster { # Using artery. seed-nodes = ["pekko://opendaylight-cluster-data@10.30.171.91:2550", "pekko://opendaylight-cluster-data@10.30.170.68:2550", "pekko://opendaylight-cluster-data@10.30.170.152:2550"] roles = ["member-2"] # when under load we might trip a false positive on the failure detector # failure-detector { # heartbeat-interval = 4 s # acceptable-heartbeat-pause = 16s # } } persistence { # By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by # modifying the following two properties. The directory location specified may be a relative or absolute path. # The relative path is always relative to KARAF_HOME. # snapshot-store.local.dir = "target/snapshots" # Use lz4 compression for LocalSnapshotStore snapshots snapshot-store.local.use-lz4-compression = false # Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB snapshot-store.local.lz4-blocksize = 256KB } disable-default-actor-system-quarantined-event-handling = "false" } } Dump modules.conf + echo 'Dump modules.conf' + cat /tmp/karaf-0.22.2/configuration/initial/modules.conf modules = [ { name = "inventory" namespace = "urn:opendaylight:inventory" shard-strategy = "module" }, { name = "topology" namespace = "urn:TBD:params:xml:ns:yang:network-topology" shard-strategy = "module" }, { name = "toaster" namespace = "http://netconfcentral.org/ns/toaster" shard-strategy = "module" } ] Dump module-shards.conf + echo 'Dump module-shards.conf' + cat /tmp/karaf-0.22.2/configuration/initial/module-shards.conf module-shards = [ { name = "default" shards = [ { name = "default" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "inventory" shards = [ { name="inventory" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "topology" shards = [ { name="topology" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "toaster" shards = [ { name="toaster" replicas = ["member-1", "member-2", "member-3"] } ] } ] Configuring member-3 with IP address 10.30.170.152 Warning: Permanently added '10.30.170.152' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.170.152' (ECDSA) to the list of known hosts. + source /tmp/common-functions.sh karaf-0.22.2 titanium ++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]] common-functions.sh is being sourced ++ echo 'common-functions.sh is being sourced' ++ BUNDLEFOLDER=karaf-0.22.2 ++ DISTROSTREAM=titanium ++ export MAVENCONF=/tmp/karaf-0.22.2/etc/org.ops4j.pax.url.mvn.cfg ++ MAVENCONF=/tmp/karaf-0.22.2/etc/org.ops4j.pax.url.mvn.cfg ++ export FEATURESCONF=/tmp/karaf-0.22.2/etc/org.apache.karaf.features.cfg ++ FEATURESCONF=/tmp/karaf-0.22.2/etc/org.apache.karaf.features.cfg ++ export CUSTOMPROP=/tmp/karaf-0.22.2/etc/custom.properties ++ CUSTOMPROP=/tmp/karaf-0.22.2/etc/custom.properties ++ export LOGCONF=/tmp/karaf-0.22.2/etc/org.ops4j.pax.logging.cfg ++ LOGCONF=/tmp/karaf-0.22.2/etc/org.ops4j.pax.logging.cfg ++ export MEMCONF=/tmp/karaf-0.22.2/bin/setenv ++ MEMCONF=/tmp/karaf-0.22.2/bin/setenv ++ export CONTROLLERMEM= ++ CONTROLLERMEM= ++ case "${DISTROSTREAM}" in ++ CLUSTER_SYSTEM=pekko ++ export AKKACONF=/tmp/karaf-0.22.2/configuration/initial/pekko.conf ++ AKKACONF=/tmp/karaf-0.22.2/configuration/initial/pekko.conf ++ export MODULESCONF=/tmp/karaf-0.22.2/configuration/initial/modules.conf ++ MODULESCONF=/tmp/karaf-0.22.2/configuration/initial/modules.conf ++ export MODULESHARDSCONF=/tmp/karaf-0.22.2/configuration/initial/module-shards.conf ++ MODULESHARDSCONF=/tmp/karaf-0.22.2/configuration/initial/module-shards.conf ++ print_common_env ++ cat common-functions environment: MAVENCONF: /tmp/karaf-0.22.2/etc/org.ops4j.pax.url.mvn.cfg ACTUALFEATURES: FEATURESCONF: /tmp/karaf-0.22.2/etc/org.apache.karaf.features.cfg CUSTOMPROP: /tmp/karaf-0.22.2/etc/custom.properties LOGCONF: /tmp/karaf-0.22.2/etc/org.ops4j.pax.logging.cfg MEMCONF: /tmp/karaf-0.22.2/bin/setenv CONTROLLERMEM: AKKACONF: /tmp/karaf-0.22.2/configuration/initial/pekko.conf MODULESCONF: /tmp/karaf-0.22.2/configuration/initial/modules.conf MODULESHARDSCONF: /tmp/karaf-0.22.2/configuration/initial/module-shards.conf SUITES: ++ SSH='ssh -t -t' ++ extra_services_cntl=' dnsmasq.service httpd.service libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service rabbitmq-server.service ' ++ extra_services_cmp=' libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service ' Changing to /tmp Downloading the distribution from https://nexus.opendaylight.org/content/repositories//autorelease-9609/org/opendaylight/integration/karaf/0.22.2/karaf-0.22.2.zip + echo 'Changing to /tmp' + cd /tmp + echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories//autorelease-9609/org/opendaylight/integration/karaf/0.22.2/karaf-0.22.2.zip' + wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories//autorelease-9609/org/opendaylight/integration/karaf/0.22.2/karaf-0.22.2.zip --2026-02-24 01:58:41-- https://nexus.opendaylight.org/content/repositories//autorelease-9609/org/opendaylight/integration/karaf/0.22.2/karaf-0.22.2.zip Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6 Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 234884299 (224M) [application/zip] Saving to: ‘karaf-0.22.2.zip’ 0K ........ ........ ........ ........ ........ ........ 1% 76.8M 3s 3072K ........ ........ ........ ........ ........ ........ 2% 138M 2s 6144K ........ ........ ........ ........ ........ ........ 4% 186M 2s 9216K ........ ........ ........ ........ ........ ........ 5% 201M 2s 12288K ........ ........ ........ ........ ........ ........ 6% 232M 1s 15360K ........ ........ ........ ........ ........ ........ 8% 211M 1s 18432K ........ ........ ........ ........ ........ ........ 9% 205M 1s 21504K ........ ........ ........ ........ ........ ........ 10% 297M 1s 24576K ........ ........ ........ ........ ........ ........ 12% 320M 1s 27648K ........ ........ ........ ........ ........ ........ 13% 337M 1s 30720K ........ ........ ........ ........ ........ ........ 14% 306M 1s 33792K ........ ........ ........ ........ ........ ........ 16% 315M 1s 36864K ........ ........ ........ ........ ........ ........ 17% 375M 1s 39936K ........ ........ ........ ........ ........ ........ 18% 366M 1s 43008K ........ ........ ........ ........ ........ ........ 20% 373M 1s 46080K ........ ........ ........ ........ ........ ........ 21% 288M 1s 49152K ........ ........ ........ ........ ........ ........ 22% 172M 1s 52224K ........ ........ ........ ........ ........ ........ 24% 328M 1s 55296K ........ ........ ........ ........ ........ ........ 25% 327M 1s 58368K ........ ........ ........ ........ ........ ........ 26% 273M 1s 61440K ........ ........ ........ ........ ........ ........ 28% 260M 1s 64512K ........ ........ ........ ........ ........ ........ 29% 291M 1s 67584K ........ ........ ........ ........ ........ ........ 30% 353M 1s 70656K ........ ........ ........ ........ ........ ........ 32% 388M 1s 73728K ........ ........ ........ ........ ........ ........ 33% 371M 1s 76800K ........ ........ ........ ........ ........ ........ 34% 363M 1s 79872K ........ ........ ........ ........ ........ ........ 36% 371M 1s 82944K ........ ........ ........ ........ ........ ........ 37% 374M 1s 86016K ........ ........ ........ ........ ........ ........ 38% 415M 1s 89088K ........ ........ ........ ........ ........ ........ 40% 364M 1s 92160K ........ ........ ........ ........ ........ ........ 41% 334M 1s 95232K ........ ........ ........ ........ ........ ........ 42% 345M 0s 98304K ........ ........ ........ ........ ........ ........ 44% 452M 0s 101376K ........ ........ ........ ........ ........ ........ 45% 373M 0s 104448K ........ ........ ........ ........ ........ ........ 46% 332M 0s 107520K ........ ........ ........ ........ ........ ........ 48% 315M 0s 110592K ........ ........ ........ ........ ........ ........ 49% 337M 0s 113664K ........ ........ ........ ........ ........ ........ 50% 453M 0s 116736K ........ ........ ........ ........ ........ ........ 52% 344M 0s 119808K ........ ........ ........ ........ ........ ........ 53% 261M 0s 122880K ........ ........ ........ ........ ........ ........ 54% 337M 0s 125952K ........ ........ ........ ........ ........ ........ 56% 398M 0s 129024K ........ ........ ........ ........ ........ ........ 57% 314M 0s 132096K ........ ........ ........ ........ ........ ........ 58% 299M 0s 135168K ........ ........ ........ ........ ........ ........ 60% 355M 0s 138240K ........ ........ ........ ........ ........ ........ 61% 353M 0s 141312K ........ ........ ........ ........ ........ ........ 62% 372M 0s 144384K ........ ........ ........ ........ ........ ........ 64% 321M 0s 147456K ........ ........ ........ ........ ........ ........ 65% 237M 0s 150528K ........ ........ ........ ........ ........ ........ 66% 237M 0s 153600K ........ ........ ........ ........ ........ ........ 68% 239M 0s 156672K ........ ........ ........ ........ ........ ........ 69% 253M 0s 159744K ........ ........ ........ ........ ........ ........ 70% 236M 0s 162816K ........ ........ ........ ........ ........ ........ 72% 245M 0s 165888K ........ ........ ........ ........ ........ ........ 73% 236M 0s 168960K ........ ........ ........ ........ ........ ........ 74% 294M 0s 172032K ........ ........ ........ ........ ........ ........ 76% 329M 0s 175104K ........ ........ ........ ........ ........ ........ 77% 351M 0s 178176K ........ ........ ........ ........ ........ ........ 79% 359M 0s 181248K ........ ........ ........ ........ ........ ........ 80% 356M 0s 184320K ........ ........ ........ ........ ........ ........ 81% 365M 0s 187392K ........ ........ ........ ........ ........ ........ 83% 362M 0s 190464K ........ ........ ........ ........ ........ ........ 84% 250M 0s 193536K ........ ........ ........ ........ ........ ........ 85% 131M 0s 196608K ........ ........ ........ ........ ........ ........ 87% 237M 0s 199680K ........ ........ ........ ........ ........ ........ 88% 213M 0s 202752K ........ ........ ........ ........ ........ ........ 89% 267M 0s 205824K ........ ........ ........ ........ ........ ........ 91% 252M 0s 208896K ........ ........ ........ ........ ........ ........ 92% 297M 0s 211968K ........ ........ ........ ........ ........ ........ 93% 256M 0s 215040K ........ ........ ........ ........ ........ ........ 95% 327M 0s 218112K ........ ........ ........ ........ ........ ........ 96% 295M 0s 221184K ........ ........ ........ ........ ........ ........ 97% 274M 0s 224256K ........ ........ ........ ........ ........ ........ 99% 297M 0s 227328K ........ ........ ........ ........ 100% 291M=0.8s 2026-02-24 01:58:42 (277 MB/s) - ‘karaf-0.22.2.zip’ saved [234884299/234884299] Extracting the new controller... + echo 'Extracting the new controller...' + unzip -q karaf-0.22.2.zip Adding external repositories... + echo 'Adding external repositories...' + sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.22.2/etc/org.ops4j.pax.url.mvn.cfg + cat /tmp/karaf-0.22.2/etc/org.ops4j.pax.url.mvn.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # If set to true, the following property will not allow any certificate to be used # when accessing Maven repositories through SSL # #org.ops4j.pax.url.mvn.certificateCheck= # # Path to the local Maven settings file. # The repositories defined in this file will be automatically added to the list # of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property # below is not set. # The following locations are checked for the existence of the settings.xml file # * 1. looks for the specified url # * 2. if not found looks for ${user.home}/.m2/settings.xml # * 3. if not found looks for ${maven.home}/conf/settings.xml # * 4. if not found looks for ${M2_HOME}/conf/settings.xml # #org.ops4j.pax.url.mvn.settings= # # Path to the local Maven repository which is used to avoid downloading # artifacts when they already exist locally. # The value of this property will be extracted from the settings.xml file # above, or defaulted to: # System.getProperty( "user.home" ) + "/.m2/repository" # org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository} # # Default this to false. It's just weird to use undocumented repos # org.ops4j.pax.url.mvn.useFallbackRepositories=false # # Uncomment if you don't wanna use the proxy settings # from the Maven conf/settings.xml file # # org.ops4j.pax.url.mvn.proxySupport=false # # Comma separated list of repositories scanned when resolving an artifact. # Those repositories will be checked before iterating through the # below list of repositories and even before the local repository # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snaphots # @noreleases : the repository does not contain any released artifacts # # The following property value will add the system folder as a repo. # org.ops4j.pax.url.mvn.defaultRepositories=\ file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\ file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\ file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots # Use the default local repo (e.g.~/.m2/repository) as a "remote" repo #org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false # # Comma separated list of repositories scanned when resolving an artifact. # The default list includes the following repositories: # http://repo1.maven.org/maven2@id=central # http://repository.springsource.com/maven/bundles/release@id=spring.ebr # http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external # http://zodiac.springsource.com/maven/bundles/release@id=gemini # http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases # https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases # https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases # To add repositories to the default ones, prepend '+' to the list of repositories # to add. # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snapshots # @noreleases : the repository does not contain any released artifacts # @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended # org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases ### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.+ [[ True == \T\r\u\e ]] + echo 'Configuring the startup features...' Configuring the startup features... + sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-infrautils-ready,odl-jolokia,odl-openflowplugin-flow-services-rest,odl-openflowplugin-app-bulk-o-matic,/g' /tmp/karaf-0.22.2/etc/org.apache.karaf.features.cfg + FEATURE_TEST_STRING=features-test + FEATURE_TEST_VERSION=0.22.2 + KARAF_VERSION=karaf4 + [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]] + sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.22.2/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.22.2/etc/org.apache.karaf.features.cfg + [[ ! -z '' ]] + cat /tmp/karaf-0.22.2/etc/org.apache.karaf.features.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # Comma separated list of features repositories to register by default # featuresRepositories = mvn:org.opendaylight.integration/features-test/0.22.2/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/93ddc44b-96cd-439d-bff5-15a70b98e20e.xml # # Comma separated list of features to install at startup # featuresBoot = odl-infrautils-ready,odl-jolokia,odl-openflowplugin-flow-services-rest,odl-openflowplugin-app-bulk-o-matic, 1686c8c6-e62b-4dfc-931c-514c8ae9fd8b # # Resource repositories (OBR) that the features resolver can use # to resolve requirements/capabilities # # The format of the resourceRepositories is # resourceRepositories=[xml:url|json:url],... # for Instance: # #resourceRepositories=xml:http://host/path/to/index.xml # or #resourceRepositories=json:http://host/path/to/index.json # # # Defines if the boot features are started in asynchronous mode (in a dedicated thread) # featuresBootAsynchronous=false # # Service requirements enforcement # # By default, the feature resolver checks the service requirements/capabilities of # bundles for new features (xml schema >= 1.3.0) in order to automatically installs # the required bundles. # The following flag can have those values: # - disable: service requirements are completely ignored # - default: service requirements are ignored for old features # - enforce: service requirements are always verified # #serviceRequirements=default # # Store cfg file for config element in feature # #configCfgStore=true # # Define if the feature service automatically refresh bundles # autoRefresh=true # # Configuration of features processing mechanism (overrides, blacklisting, modification of features) # XML file defines instructions related to features processing # versions.properties may declare properties to resolve placeholders in XML file # both files are relative to ${karaf.etc} # #featureProcessing=org.apache.karaf.features.xml #featureProcessingVersions=versions.properties + configure_karaf_log karaf4 '' + local -r karaf_version=karaf4 + local -r controllerdebugmap= + local logapi=log4j + grep log4j2 /tmp/karaf-0.22.2/etc/org.ops4j.pax.logging.cfg log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n log4j2.rootLogger.level = INFO #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 64MB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE Configuring the karaf log... karaf_version: karaf4, logapi: log4j2 + logapi=log4j2 + echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2' + '[' log4j2 == log4j2 ']' + sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.22.2/etc/org.ops4j.pax.logging.cfg + orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver + orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN' + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN' + unset IFS controllerdebugmap: + echo 'controllerdebugmap: ' cat /tmp/karaf-0.22.2/etc/org.ops4j.pax.logging.cfg + '[' -n '' ']' + echo 'cat /tmp/karaf-0.22.2/etc/org.ops4j.pax.logging.cfg' + cat /tmp/karaf-0.22.2/etc/org.ops4j.pax.logging.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # Common pattern layout for appenders log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n # Root logger log4j2.rootLogger.level = INFO # uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} # Filters for logs marked by org.opendaylight.odlparent.Markers log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL # Loggers configuration # Spifly logger log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN # Security audit logger log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Appenders configuration # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} # Rolling file appender log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i # uncomment to not force a disk flush #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 1GB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 # Audit file appender log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 # OSGi appender log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * # help with identification of maven-related problems with pax-url-aether #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN + set_java_vars /usr/lib/jvm/java-21-openjdk-amd64 2048m /tmp/karaf-0.22.2/bin/setenv Configure + local -r java_home=/usr/lib/jvm/java-21-openjdk-amd64 + local -r controllermem=2048m + local -r memconf=/tmp/karaf-0.22.2/bin/setenv + echo Configure java home: /usr/lib/jvm/java-21-openjdk-amd64 max memory: 2048m + echo ' java home: /usr/lib/jvm/java-21-openjdk-amd64' + echo ' max memory: 2048m' + echo ' memconf: /tmp/karaf-0.22.2/bin/setenv' memconf: /tmp/karaf-0.22.2/bin/setenv + sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64}%g' /tmp/karaf-0.22.2/bin/setenv + sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=2048m/g' /tmp/karaf-0.22.2/bin/setenv cat /tmp/karaf-0.22.2/bin/setenv + echo 'cat /tmp/karaf-0.22.2/bin/setenv' + cat /tmp/karaf-0.22.2/bin/setenv #!/bin/sh # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # # # handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf # script: client, instance, shell, start, status, stop, karaf # # if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then # Actions go here... # fi # # general settings which should be applied for all scripts go here; please keep # in mind that it is possible that scripts might be executed more than once, e.g. # in example of the start script where the start script is executed first and the # karaf script afterwards. # # # The following section shows the possible configuration options for the default # karaf scripts # export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64} # Location of Java installation # export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration # export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options # export EXTRA_JAVA_OPTS # Additional JVM options # export KARAF_HOME # Karaf home folder # export KARAF_DATA # Karaf data folder # export KARAF_BASE # Karaf base folder # export KARAF_ETC # Karaf etc folder # export KARAF_LOG # Karaf log folder # export KARAF_SYSTEM_OPTS # First citizen Karaf options # export KARAF_OPTS # Additional available Karaf options # export KARAF_DEBUG # Enable debug mode # export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start # export KARAF_NOROOT # Prevent execution as root if set to true Set Java version + echo 'Set Java version' + sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-21-openjdk-amd64/bin/java 1 sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper sudo: a password is required + sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-21-openjdk-amd64/bin/java sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper sudo: a password is required JDK default version ... + echo 'JDK default version ...' + java -version openjdk version "21.0.9" 2025-10-21 OpenJDK Runtime Environment (build 21.0.9+10-Ubuntu-122.04) OpenJDK 64-Bit Server VM (build 21.0.9+10-Ubuntu-122.04, mixed mode, sharing) Set JAVA_HOME + echo 'Set JAVA_HOME' + export JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64 + JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64 ++ readlink -e /usr/lib/jvm/java-21-openjdk-amd64/bin/java Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java + JAVA_RESOLVED=/usr/lib/jvm/java-21-openjdk-amd64/bin/java + echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java' Listing all open ports on controller system... + echo 'Listing all open ports on controller system...' + netstat -pnatu /tmp/configuration-script.sh: line 40: netstat: command not found Configuring cluster + '[' -f /tmp/custom_shard_config.txt ']' + echo 'Configuring cluster' + /tmp/karaf-0.22.2/bin/configure_cluster.sh 3 10.30.171.91 10.30.170.68 10.30.170.152 ################################################ ## Configure Cluster ## ################################################ NOTE: Cluster configuration files not found. Copying from /tmp/karaf-0.22.2/system/org/opendaylight/controller/sal-clustering-config/11.0.2 Configuring unique name in pekko.conf Configuring hostname in pekko.conf Configuring data and rpc seed nodes in pekko.conf modules = [ { name = "inventory" namespace = "urn:opendaylight:inventory" shard-strategy = "module" }, { name = "topology" namespace = "urn:TBD:params:xml:ns:yang:network-topology" shard-strategy = "module" }, { name = "toaster" namespace = "http://netconfcentral.org/ns/toaster" shard-strategy = "module" } ] Configuring replication type in module-shards.conf ################################################ ## NOTE: Manually restart controller to ## ## apply configuration. ## ################################################ Dump pekko.conf + echo 'Dump pekko.conf' + cat /tmp/karaf-0.22.2/configuration/initial/pekko.conf odl-cluster-data { pekko { remote { artery { enabled = on transport = tcp canonical.hostname = "10.30.170.152" canonical.port = 2550 } } cluster { # Using artery. seed-nodes = ["pekko://opendaylight-cluster-data@10.30.171.91:2550", "pekko://opendaylight-cluster-data@10.30.170.68:2550", "pekko://opendaylight-cluster-data@10.30.170.152:2550"] roles = ["member-3"] # when under load we might trip a false positive on the failure detector # failure-detector { # heartbeat-interval = 4 s # acceptable-heartbeat-pause = 16s # } } persistence { # By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by # modifying the following two properties. The directory location specified may be a relative or absolute path. # The relative path is always relative to KARAF_HOME. # snapshot-store.local.dir = "target/snapshots" # Use lz4 compression for LocalSnapshotStore snapshots snapshot-store.local.use-lz4-compression = false # Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB snapshot-store.local.lz4-blocksize = 256KB } disable-default-actor-system-quarantined-event-handling = "false" } } Dump modules.conf + echo 'Dump modules.conf' + cat /tmp/karaf-0.22.2/configuration/initial/modules.conf modules = [ { name = "inventory" namespace = "urn:opendaylight:inventory" shard-strategy = "module" }, { name = "topology" namespace = "urn:TBD:params:xml:ns:yang:network-topology" shard-strategy = "module" }, { name = "toaster" namespace = "http://netconfcentral.org/ns/toaster" shard-strategy = "module" } ] Dump module-shards.conf + echo 'Dump module-shards.conf' + cat /tmp/karaf-0.22.2/configuration/initial/module-shards.conf module-shards = [ { name = "default" shards = [ { name = "default" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "inventory" shards = [ { name="inventory" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "topology" shards = [ { name="topology" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "toaster" shards = [ { name="toaster" replicas = ["member-1", "member-2", "member-3"] } ] } ] Locating config plan to use... Finished running config plans Starting member-1 with IP address 10.30.171.91 Warning: Permanently added '10.30.171.91' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.171.91' (ECDSA) to the list of known hosts. Redirecting karaf console output to karaf_console.log Starting controller... start: Redirecting Karaf output to /tmp/karaf-0.22.2/data/log/karaf_console.log Starting member-2 with IP address 10.30.170.68 Warning: Permanently added '10.30.170.68' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.170.68' (ECDSA) to the list of known hosts. Redirecting karaf console output to karaf_console.log Starting controller... start: Redirecting Karaf output to /tmp/karaf-0.22.2/data/log/karaf_console.log Starting member-3 with IP address 10.30.170.152 Warning: Permanently added '10.30.170.152' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.170.152' (ECDSA) to the list of known hosts. Redirecting karaf console output to karaf_console.log Starting controller... start: Redirecting Karaf output to /tmp/karaf-0.22.2/data/log/karaf_console.log [openflowplugin-csit-3node-clustering-bulkomatic-only-titanium] $ /bin/bash /tmp/jenkins15302096515591581822.sh common-functions.sh is being sourced common-functions environment: MAVENCONF: /tmp/karaf-0.22.2/etc/org.ops4j.pax.url.mvn.cfg ACTUALFEATURES: FEATURESCONF: /tmp/karaf-0.22.2/etc/org.apache.karaf.features.cfg CUSTOMPROP: /tmp/karaf-0.22.2/etc/custom.properties LOGCONF: /tmp/karaf-0.22.2/etc/org.ops4j.pax.logging.cfg MEMCONF: /tmp/karaf-0.22.2/bin/setenv CONTROLLERMEM: 2048m AKKACONF: /tmp/karaf-0.22.2/configuration/initial/pekko.conf MODULESCONF: /tmp/karaf-0.22.2/configuration/initial/modules.conf MODULESHARDSCONF: /tmp/karaf-0.22.2/configuration/initial/module-shards.conf SUITES: + echo '#################################################' ################################################# + echo '## Verify Cluster is UP ##' ## Verify Cluster is UP ## + echo '#################################################' ################################################# + create_post_startup_script + cat + copy_and_run_post_startup_script + seed_index=1 ++ seq 1 3 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_1_IP + echo 'Execute the post startup script on controller 10.30.171.91' Execute the post startup script on controller 10.30.171.91 + scp /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-titanium/post-startup-script.sh 10.30.171.91:/tmp/ Warning: Permanently added '10.30.171.91' (ECDSA) to the list of known hosts. + ssh 10.30.171.91 'bash /tmp/post-startup-script.sh 1' Warning: Permanently added '10.30.171.91' (ECDSA) to the list of known hosts. /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found Waiting up to 3 minutes for controller to come up, checking every 5 seconds... 2026-02-24T01:59:23,506 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 201 - org.opendaylight.infrautils.ready-api - 7.1.7 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Controller is UP 2026-02-24T01:59:23,506 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 201 - org.opendaylight.infrautils.ready-api - 7.1.7 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Listing all open ports on controller system... /tmp/post-startup-script.sh: line 51: netstat: command not found looking for "BindException: Address already in use" in log file looking for "server is unhealthy" in log file + '[' 1 == 0 ']' + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_2_IP + echo 'Execute the post startup script on controller 10.30.170.68' Execute the post startup script on controller 10.30.170.68 + scp /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-titanium/post-startup-script.sh 10.30.170.68:/tmp/ Warning: Permanently added '10.30.170.68' (ECDSA) to the list of known hosts. + ssh 10.30.170.68 'bash /tmp/post-startup-script.sh 2' Warning: Permanently added '10.30.170.68' (ECDSA) to the list of known hosts. /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found Waiting up to 3 minutes for controller to come up, checking every 5 seconds... 2026-02-24T01:59:23,963 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 201 - org.opendaylight.infrautils.ready-api - 7.1.7 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Controller is UP 2026-02-24T01:59:23,963 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 201 - org.opendaylight.infrautils.ready-api - 7.1.7 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Listing all open ports on controller system... /tmp/post-startup-script.sh: line 51: netstat: command not found looking for "BindException: Address already in use" in log file looking for "server is unhealthy" in log file + '[' 2 == 0 ']' + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_3_IP + echo 'Execute the post startup script on controller 10.30.170.152' Execute the post startup script on controller 10.30.170.152 + scp /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-titanium/post-startup-script.sh 10.30.170.152:/tmp/ Warning: Permanently added '10.30.170.152' (ECDSA) to the list of known hosts. + ssh 10.30.170.152 'bash /tmp/post-startup-script.sh 3' Warning: Permanently added '10.30.170.152' (ECDSA) to the list of known hosts. /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found Waiting up to 3 minutes for controller to come up, checking every 5 seconds... 2026-02-24T01:59:23,863 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 201 - org.opendaylight.infrautils.ready-api - 7.1.7 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Controller is UP 2026-02-24T01:59:23,863 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 201 - org.opendaylight.infrautils.ready-api - 7.1.7 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Listing all open ports on controller system... /tmp/post-startup-script.sh: line 51: netstat: command not found looking for "BindException: Address already in use" in log file looking for "server is unhealthy" in log file + '[' 0 == 0 ']' + seed_index=1 + dump_controller_threads ++ seq 1 3 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_1_IP + echo 'Let'\''s take the karaf thread dump' Let's take the karaf thread dump + ssh 10.30.171.91 'sudo ps aux' Warning: Permanently added '10.30.171.91' (ECDSA) to the list of known hosts. ++ grep org.apache.karaf.main.Main /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-titanium/ps_before.log ++ grep -v grep ++ tr -s ' ' ++ cut -f2 '-d ' + pid=2040 + echo 'karaf main: org.apache.karaf.main.Main, pid:2040' karaf main: org.apache.karaf.main.Main, pid:2040 + ssh 10.30.171.91 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 2040' Warning: Permanently added '10.30.171.91' (ECDSA) to the list of known hosts. + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_2_IP + echo 'Let'\''s take the karaf thread dump' Let's take the karaf thread dump + ssh 10.30.170.68 'sudo ps aux' Warning: Permanently added '10.30.170.68' (ECDSA) to the list of known hosts. ++ grep org.apache.karaf.main.Main /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-titanium/ps_before.log ++ grep -v grep ++ tr -s ' ' ++ cut -f2 '-d ' + pid=2034 + echo 'karaf main: org.apache.karaf.main.Main, pid:2034' karaf main: org.apache.karaf.main.Main, pid:2034 + ssh 10.30.170.68 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 2034' Warning: Permanently added '10.30.170.68' (ECDSA) to the list of known hosts. + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_3_IP + echo 'Let'\''s take the karaf thread dump' Let's take the karaf thread dump + ssh 10.30.170.152 'sudo ps aux' Warning: Permanently added '10.30.170.152' (ECDSA) to the list of known hosts. ++ grep org.apache.karaf.main.Main /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-titanium/ps_before.log ++ grep -v grep ++ tr -s ' ' ++ cut -f2 '-d ' + pid=2038 + echo 'karaf main: org.apache.karaf.main.Main, pid:2038' karaf main: org.apache.karaf.main.Main, pid:2038 + ssh 10.30.170.152 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 2038' Warning: Permanently added '10.30.170.152' (ECDSA) to the list of known hosts. + '[' 0 -gt 0 ']' + echo 'Generating controller variables...' Generating controller variables... ++ seq 1 3 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_1_IP + odl_variables=' -v ODL_SYSTEM_1_IP:10.30.171.91' + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_2_IP + odl_variables=' -v ODL_SYSTEM_1_IP:10.30.171.91 -v ODL_SYSTEM_2_IP:10.30.170.68' + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_3_IP + odl_variables=' -v ODL_SYSTEM_1_IP:10.30.171.91 -v ODL_SYSTEM_2_IP:10.30.170.68 -v ODL_SYSTEM_3_IP:10.30.170.152' + echo 'Generating mininet variables...' Generating mininet variables... ++ seq 1 1 + for i in $(seq 1 "${NUM_TOOLS_SYSTEM}") + MININETIP=TOOLS_SYSTEM_1_IP + tools_variables=' -v TOOLS_SYSTEM_1_IP:10.30.171.10' + get_test_suites SUITES + local __suite_list=SUITES + echo 'Locating test plan to use...' Locating test plan to use... + testplan_filepath=/w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-titanium/test/csit/testplans/openflowplugin-clustering-bulkomatic-titanium.txt + '[' '!' -f /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-titanium/test/csit/testplans/openflowplugin-clustering-bulkomatic-titanium.txt ']' + testplan_filepath=/w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-titanium/test/csit/testplans/openflowplugin-clustering-bulkomatic.txt + '[' disabled '!=' disabled ']' + echo 'Changing the testplan path...' Changing the testplan path... + sed s:integration:/w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-titanium: /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-titanium/test/csit/testplans/openflowplugin-clustering-bulkomatic.txt + cat testplan.txt # Place the suites in run order: /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-titanium/test/csit/suites/openflowplugin/Clustering_Bulkomatic/ + '[' -z '' ']' ++ grep -E -v '(^[[:space:]]*#|^[[:space:]]*$)' testplan.txt ++ tr '\012' ' ' + suite_list='/w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-titanium/test/csit/suites/openflowplugin/Clustering_Bulkomatic/ ' + eval 'SUITES='\''/w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-titanium/test/csit/suites/openflowplugin/Clustering_Bulkomatic/ '\''' ++ SUITES='/w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-titanium/test/csit/suites/openflowplugin/Clustering_Bulkomatic/ ' + echo 'Starting Robot test suites /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-titanium/test/csit/suites/openflowplugin/Clustering_Bulkomatic/ ...' Starting Robot test suites /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-titanium/test/csit/suites/openflowplugin/Clustering_Bulkomatic/ ... + robot -N openflowplugin-clustering-bulkomatic.txt --removekeywords wuks -e exclude -e skip_if_titanium -v BUNDLEFOLDER:karaf-0.22.2 -v BUNDLE_URL:https://nexus.opendaylight.org/content/repositories//autorelease-9609/org/opendaylight/integration/karaf/0.22.2/karaf-0.22.2.zip -v CONTROLLER:10.30.171.91 -v CONTROLLER1:10.30.170.68 -v CONTROLLER2:10.30.170.152 -v CONTROLLER_USER:jenkins -v JAVA_HOME:/usr/lib/jvm/java-21-openjdk-amd64 -v JDKVERSION:openjdk21 -v JENKINS_WORKSPACE:/w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-titanium -v MININET:10.30.171.10 -v MININET1: -v MININET2: -v MININET_USER:jenkins -v NEXUSURL_PREFIX:https://nexus.opendaylight.org -v NUM_ODL_SYSTEM:3 -v NUM_TOOLS_SYSTEM:1 -v ODL_STREAM:titanium -v ODL_SYSTEM_IP:10.30.171.91 -v ODL_SYSTEM_1_IP:10.30.171.91 -v ODL_SYSTEM_2_IP:10.30.170.68 -v ODL_SYSTEM_3_IP:10.30.170.152 -v ODL_SYSTEM_USER:jenkins -v TOOLS_SYSTEM_IP:10.30.171.10 -v TOOLS_SYSTEM_1_IP:10.30.171.10 -v TOOLS_SYSTEM_USER:jenkins -v USER_HOME:/home/jenkins -v IS_KARAF_APPL:True -v WORKSPACE:/tmp -v ODL_OF_PLUGIN:lithium /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-titanium/test/csit/suites/openflowplugin/Clustering_Bulkomatic/ ============================================================================== openflowplugin-clustering-bulkomatic.txt ============================================================================== openflowplugin-clustering-bulkomatic.txt.Cluster Reconcilliation Multi DPN ... ============================================================================== Check Shards Status And Initialize Variables :: Check Status for a... | PASS | ------------------------------------------------------------------------------ Get Inventory Follower and Leader Before Cluster Restart :: Find a... | PASS | ------------------------------------------------------------------------------ Start Mininet Connect To Follower Node1 :: Start mininet with conn... | PASS | ------------------------------------------------------------------------------ Add Bulk Flow From Follower :: 10000 Flows ( 10000 per DPN) in 1 D... :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? | PASS | ------------------------------------------------------------------------------ Get Bulk Flows and Verify In Inventory Leader :: Initiate get oper... :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? | PASS | ------------------------------------------------------------------------------ Verify Flows In Switch Before Cluster Restart :: Verify flows are ... :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? | PASS | ------------------------------------------------------------------------------ Stop Mininet Connected To Follower Node1 and Exit :: Stop mininet ... :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? | PASS | ------------------------------------------------------------------------------ Start Mininet Reconnect To Follower Node1 :: Start mininet with re... | PASS | ------------------------------------------------------------------------------ Verify Flows In Switch Reconnected To Follower Node1 :: Verify 100... :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? | PASS | ------------------------------------------------------------------------------ Stop Mininet Connected To Follower Node1 :: Stop mininet and exit ... :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? | PASS | ------------------------------------------------------------------------------ Start Mininet Connect To Follower Node2 :: Start mininet with conn... | PASS | ------------------------------------------------------------------------------ Verify Flows In Switch Connected To Follower Node2 :: Verify 10000... :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? | PASS | ------------------------------------------------------------------------------ Stop Mininet Connected To Follower Node2 :: Stop mininet and exit ... :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? | PASS | ------------------------------------------------------------------------------ Start Mininet Connect To Inventory Leader :: Start mininet with co... | PASS | ------------------------------------------------------------------------------ Verify Flows In Switch Connected To Leader :: Verify 10000 flows p... :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? | PASS | ------------------------------------------------------------------------------ Stop Mininet Connected To Inventory Leader :: Stop mininet and exi... :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? | PASS | ------------------------------------------------------------------------------ Delete All Flows From Follower Node1 :: 10000 Flows deleted via Fo... | FAIL | Keyword 'BulkomaticKeywords.Operation Status Check' failed after retrying for 1 minute 40 seconds. The last error was: '1' does not start with '2' ------------------------------------------------------------------------------ Verify No Flows In Inventory Leader :: Verify flow count is 0 acro... | FAIL | Keyword 'BulkomaticKeywords.Operation Status Check' failed after retrying for 1 minute 40 seconds. The last error was: '1' does not start with '2' ------------------------------------------------------------------------------ openflowplugin-clustering-bulkomatic.txt.Cluster Reconcilliation M... | FAIL | 18 tests, 16 passed, 2 failed ============================================================================== openflowplugin-clustering-bulkomatic.txt.Cluster HA Data Recovery BulkFlow ... ============================================================================== Check Shards Status and Initialize Variables :: Check Status for a... | FAIL | Unrecognized Raft state: IsolatedLeader ------------------------------------------------------------------------------ Get Inventory Follower Before Leader Restart :: Find a follower in... | FAIL | Keyword 'ClusterManagement.Get_Leader_And_Followers_For_Shard' failed after retrying for 10 seconds. The last error was: Unrecognized Raft state: IsolatedLeader ------------------------------------------------------------------------------ Shutdown Leader From Cluster Node :: Shutdown Leader Node and Star... | FAIL | Variable '${Inventory_Leader}' not found. ------------------------------------------------------------------------------ Check Shards Status After Leader Shutdown :: Wait for node converg... | FAIL | Keyword 'ClusterOpenFlow.Check OpenFlow Shards Status' failed after retrying for 1 minute 40 seconds. The last error was: Variable '${Inventory_Followers}' not found. ------------------------------------------------------------------------------ Check Shard Status For Leader After PreLeader Shutdown :: Find a L... | FAIL | Variable '${Inventory_Followers}' not found. ------------------------------------------------------------------------------ Start Mininet Connect To Follower Node1 :: Start mininet with conn... | FAIL | Variable '${Follower_Node_1}' not found. ------------------------------------------------------------------------------ Add Bulk Flow From Follower :: 10000 Flows added via Follower Node... | FAIL | Variable '${temp_json_config_add}' not found. ------------------------------------------------------------------------------ Get Bulk Flows And Verify In Leader :: Initiate get operation and ... | FAIL | Variable '${temp_json_config_get}' not found. ------------------------------------------------------------------------------ Verify Flows In Switch Before Cluster Restart :: Verify flows are ... | FAIL | Variable '${mininet_conn_id}' not found. ------------------------------------------------------------------------------ Restart Pre Leader From Cluster Node :: Restart Leader Node. | FAIL | Variable '${Inventory_Leader}' not found. ------------------------------------------------------------------------------ Check Shards Status After Leader Restart :: Wait for node converge... | FAIL | Keyword 'ClusterOpenFlow.Check OpenFlow Shards Status' failed after retrying for 5 minutes 50 seconds. The last error was: Unrecognized Raft state: IsolatedLeader ------------------------------------------------------------------------------ Verify Data Recovery After Leader Restart :: 10000 Flows preserved... | FAIL | Keyword 'BulkomaticKeywords.Get Bulk Flow And Verify Count In Cluster' failed after retrying for 1 minute 40 seconds. The last error was: Variable '${temp_json_config_get}' not found. ------------------------------------------------------------------------------ Verify Flows In Switch After Leader Restart :: Verify flows are in... | FAIL | Variable '${mininet_conn_id}' not found. ------------------------------------------------------------------------------ Stop Mininet Connected To Follower Node1 :: Stop mininet and exit ... | FAIL | Variable '${mininet_conn_id}' not found. ------------------------------------------------------------------------------ Delete All Flows From Follower Node1 :: 10000 Flows deleted via Fo... | FAIL | Variable '${temp_json_config_del}' not found. ------------------------------------------------------------------------------ Verify No Flows In Leader Node :: Verify flow count is 0 across cl... | FAIL | Variable '${temp_json_config_get}' not found. ------------------------------------------------------------------------------ Get Inventory Follower And Leader Before Cluster Restart :: Find a... | FAIL | Keyword 'ClusterManagement.Get_Leader_And_Followers_For_Shard' failed after retrying for 10 seconds. The last error was: Unrecognized Raft state: IsolatedLeader ------------------------------------------------------------------------------ Shutdown Follower From Cluster Node :: Shutdown Follower Node2 and... | FAIL | Variable '${Follower_Node_2}' not found. ------------------------------------------------------------------------------ Check Shards Status After Follower Shutdown :: Wait for node conve... | FAIL | Keyword 'ClusterOpenFlow.Check OpenFlow Shards Status' failed after retrying for 1 minute 40 seconds. The last error was: Variable '${Active_Nodes}' not found. ------------------------------------------------------------------------------ Start Mininet Connect To Follower Node :: Start mininet with conne... | FAIL | Variable '${Follower_Node_1}' not found. ------------------------------------------------------------------------------ Add Bulk Flow From Follower Node1 :: 10000 Flows added via Followe... | FAIL | Variable '${temp_json_config_add}' not found. ------------------------------------------------------------------------------ Get Bulk Flows And Verify In Leader Before Follower Restart :: Ini... | FAIL | Variable '${temp_json_config_get}' not found. ------------------------------------------------------------------------------ Verify Flows In Switch Before Follower Restart :: Verify flows are... | FAIL | Variable '${mininet_conn_id}' not found. ------------------------------------------------------------------------------ Restart Follower From Cluster Node :: Restart Follower Node2. | FAIL | Variable '${Follower_Node_2}' not found. ------------------------------------------------------------------------------ Check Shards Status After Follower Restart :: Wait for node conver... | FAIL | Keyword 'ClusterOpenFlow.Check OpenFlow Shards Status' failed after retrying for 5 minutes 50 seconds. The last error was: Unrecognized Raft state: IsolatedLeader ------------------------------------------------------------------------------ Verify Data Recovery After Follower Restart :: 10000 Flows preserv... | FAIL | Keyword 'BulkomaticKeywords.Get Bulk Flow And Verify Count In Cluster' failed after retrying for 1 minute 40 seconds. The last error was: Variable '${temp_json_config_get}' not found. ------------------------------------------------------------------------------ Verify Flows In Switch After Follower Restart :: Verify flows are ... | FAIL | Variable '${mininet_conn_id}' not found. ------------------------------------------------------------------------------ Stop Mininet Connected To Follower Node :: Stop mininet and exit c... | FAIL | Variable '${mininet_conn_id}' not found. ------------------------------------------------------------------------------ Delete All Flows From Follower Node :: 10000 Flows deleted via Fol... | FAIL | Variable '${temp_json_config_del}' not found. ------------------------------------------------------------------------------ Verify No Flows In Leader Node After Follower Restart :: Verify fl... | FAIL | Variable '${temp_json_config_get}' not found. ------------------------------------------------------------------------------ openflowplugin-clustering-bulkomatic.txt.Cluster HA Data Recovery ... | FAIL | 30 tests, 0 passed, 30 failed ============================================================================== openflowplugin-clustering-bulkomatic.txt.Cluster HA Data Recovery BulkFlow ... ============================================================================== Check Shards Status And Initialize Variables :: Check Status for a... | FAIL | Unrecognized Raft state: IsolatedLeader ------------------------------------------------------------------------------ Get Inventory Follower Before Cluster Restart :: Find a follower i... | FAIL | Keyword 'ClusterManagement.Get_Leader_And_Followers_For_Shard' failed after retrying for 10 seconds. The last error was: Unrecognized Raft state: IsolatedLeader ------------------------------------------------------------------------------ Start Mininet Connect To Follower Node1 :: Start mininet with conn... | FAIL | Variable '${Follower_Node_1}' not found. ------------------------------------------------------------------------------ Add Bulk Flow From Follower :: 1000 Flows added via Follower Node1... | FAIL | Variable '${temp_json_config_add}' not found. ------------------------------------------------------------------------------ Get Bulk Flows and Verify In Cluster :: Initiate get operation and... | FAIL | Variable '${temp_json_config_get}' not found. ------------------------------------------------------------------------------ Verify Flows In Switch Before Cluster Restart :: Verify flows are ... | FAIL | Variable '${mininet_conn_id}' not found. ------------------------------------------------------------------------------ Kill All Cluster Nodes :: Kill All Nodes. | PASS | ------------------------------------------------------------------------------ Stop Mininet Connected To Follower Node1 and Exit :: Stop mininet ... | FAIL | Variable '${mininet_conn_id}' not found. ------------------------------------------------------------------------------ Restart All Cluster Nodes :: Restart all cluster nodes. | PASS | ------------------------------------------------------------------------------ Verify Data Recovery After Cluster Restart :: 1000 Flows preserved... | FAIL | Keyword 'BulkomaticKeywords.Get Bulk Flow And Verify Count In Cluster' failed after retrying for 5 minutes 50 seconds. The last error was: Variable '${temp_json_config_get}' not found. ------------------------------------------------------------------------------ Start Mininet Again Connect To Follower Node1 :: Start mininet wit... | FAIL | Variable '${Follower_Node_1}' not found. ------------------------------------------------------------------------------ Verify Flows In Switch After Cluster Restart :: Verify flows are i... | FAIL | Variable '${mininet_conn_id}' not found. ------------------------------------------------------------------------------ Stop Mininet Connected To Follower Node1 :: Stop mininet and exit ... | FAIL | Variable '${mininet_conn_id}' not found. ------------------------------------------------------------------------------ Delete All Flows From Follower Node1 :: 1000 Flows deleted via Fol... | FAIL | Variable '${temp_json_config_del}' not found. ------------------------------------------------------------------------------ Verify No Flows In Cluster :: Verify flow count is 0 across cluste... | FAIL | Variable '${temp_json_config_get}' not found. ------------------------------------------------------------------------------ Get Inventory Leader Before Leader Restart :: Find leader in the i... | PASS | ------------------------------------------------------------------------------ Start Mininet Connect To Leader :: Start mininet with connection t... | PASS | ------------------------------------------------------------------------------ Add Bulk Flow From Leader :: 1000 Flows added via Follower Node1 a... :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? | FAIL | Variable '${temp_json_config_add}' not found. ------------------------------------------------------------------------------ Get Bulk Flows and Verify In Cluster Before Leader Restart :: Init... :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? | FAIL | Variable '${temp_json_config_get}' not found. ------------------------------------------------------------------------------ Verify Flows In Switch Before Leader Restart :: Verify flows are i... :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? | FAIL | Keyword 'MininetKeywords.Check Flows In Mininet' failed after retrying for 1 minute 40 seconds. The last error was: 10000.0 != 1000.0 ------------------------------------------------------------------------------ Kill Leader From Cluster Node :: Kill Leader Node. :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? | PASS | ------------------------------------------------------------------------------ Stop Mininet Connected To Leader Node :: Stop mininet and exit con... :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? | PASS | ------------------------------------------------------------------------------ Restart Leader from Cluster Node :: Start Leader Node Up. | PASS | ------------------------------------------------------------------------------ Verify Data Recovery After Leader Restart :: 1000 Flows preserved ... | FAIL | Keyword 'BulkomaticKeywords.Get Bulk Flow And Verify Count In Cluster' failed after retrying for 5 minutes 50 seconds. The last error was: Variable '${temp_json_config_get}' not found. ------------------------------------------------------------------------------ Start Mininet Again Connect To Leader :: Start mininet with connec... | PASS | ------------------------------------------------------------------------------ Verify Flows In Switch After Leader Restart :: Verify flows are in... :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? | FAIL | Keyword 'MininetKeywords.Check Flows In Mininet' failed after retrying for 1 minute 40 seconds. The last error was: 10000.0 != 1000.0 ------------------------------------------------------------------------------ Stop Mininet Connected To Leader Node After Leader Restart :: Stop... :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? | PASS | ------------------------------------------------------------------------------ Delete All Flows From Leader Node :: 1000 Flows deleted via Leader... | FAIL | Variable '${temp_json_config_del}' not found. ------------------------------------------------------------------------------ Verify No Flows In Cluster After Leader Restart :: Verify flow cou... | FAIL | Variable '${temp_json_config_get}' not found. ------------------------------------------------------------------------------ Get Inventory Follower Before follower Restart :: Find follower in... | PASS | ------------------------------------------------------------------------------ Start Mininet Connect To Follower Node2 :: Start mininet with conn... | PASS | ------------------------------------------------------------------------------ Add Bulk Flow From Follower Node2 :: 1000 Flows added via Follower... :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? | FAIL | Variable '${temp_json_config_add}' not found. ------------------------------------------------------------------------------ Get Bulk Flows and Verify In Cluster Before Follower Restart :: In... :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? | FAIL | Variable '${temp_json_config_get}' not found. ------------------------------------------------------------------------------ Verify Flows In Switch Before Follower Restart :: Verify flows are... :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? | FAIL | Keyword 'MininetKeywords.Check Flows In Mininet' failed after retrying for 1 minute 40 seconds. The last error was: 10000.0 != 1000.0 ------------------------------------------------------------------------------ Kill Follower Node2 :: Kill Follower Node2. :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? | PASS | ------------------------------------------------------------------------------ Stop Mininet Connected To Follower Node2 and Exit :: Stop mininet ... :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? | PASS | ------------------------------------------------------------------------------ Restart Follower Node2 :: Start Follower Node2 Up. | PASS | ------------------------------------------------------------------------------ Verify Data Recovery After Follower Node2 Restart :: 1000 Flows pr... | FAIL | Keyword 'BulkomaticKeywords.Get Bulk Flow And Verify Count In Cluster' failed after retrying for 5 minutes 50 seconds. The last error was: Variable '${temp_json_config_get}' not found. ------------------------------------------------------------------------------ Start Mininet Again Connect To Follower Node2 :: Start mininet wit... | PASS | ------------------------------------------------------------------------------ Verify Flows In Switch After Follower Node2 Restart :: Verify flow... :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? | FAIL | Keyword 'MininetKeywords.Check Flows In Mininet' failed after retrying for 1 minute 40 seconds. The last error was: 10000.0 != 1000.0 ------------------------------------------------------------------------------ Stop Mininet Connected To Follower Node2 :: Stop mininet and exit ... :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? | PASS | ------------------------------------------------------------------------------ Delete All Flows From Follower Node 2 :: 1000 Flows deleted via Le... | FAIL | Variable '${temp_json_config_del}' not found. ------------------------------------------------------------------------------ Verify No Flows In Cluster After Follower Node2 Restart | FAIL | Variable '${temp_json_config_get}' not found. ------------------------------------------------------------------------------ openflowplugin-clustering-bulkomatic.txt.Cluster HA Data Recovery ... | FAIL | 43 tests, 16 passed, 27 failed ============================================================================== openflowplugin-clustering-bulkomatic.txt.Cluster Current Term Verification ... ============================================================================== Check Shard And Get Inventory :: Check Status for all shards and F... The follower Node1 is 1 The follower Node2 is 3 The leader Node is 2 | PASS | ------------------------------------------------------------------------------ Initial Current Term Verification :: Verifying current term for Le... Current Term is 4 | PASS | ------------------------------------------------------------------------------ Add Bulk Flow From Follower :: 10000 Flows added via Follower Node... | PASS | ------------------------------------------------------------------------------ Get Bulk Flows And Verify In Cluster :: Initiate get operation and... | PASS | ------------------------------------------------------------------------------ Current Term Verification After Adding Bulk Flow :: Verifying curr... | PASS | ------------------------------------------------------------------------------ Current Term Comparison Before And After Addition Of Flow :: Compa... Current Term after pushing the flows is 4 | PASS | ------------------------------------------------------------------------------ Delete and Add ten percent of the flows for 5 iterations :: Perfor... | PASS | ------------------------------------------------------------------------------ Current Term Verification After Continuous Deletion and Addition O... | PASS | ------------------------------------------------------------------------------ Current Term Comparison Before and After Continuous Deletion and A... Current Term after pushing the flows is 4 | PASS | ------------------------------------------------------------------------------ Delete All Flows From Follower Node :: 10000 Flows deleted via Lea... | FAIL | Keyword 'BulkomaticKeywords.Operation Status Check' failed after retrying for 6 minutes 40 seconds. The last error was: '-1' does not start with '2' ------------------------------------------------------------------------------ Verify No Flows In Cluster After Flow Deletion :: Verifying No FLo... | FAIL | Keyword 'BulkomaticKeywords.Operation Status Check' failed after retrying for 6 minutes 40 seconds. The last error was: '1' does not start with '2' ------------------------------------------------------------------------------ PreLeader Verification :: Verifying LastIndex and LastApplied and ... | FAIL | 255185 != 240094 ------------------------------------------------------------------------------ openflowplugin-clustering-bulkomatic.txt.Cluster Current Term Veri... | FAIL | 12 tests, 9 passed, 3 failed ============================================================================== openflowplugin-clustering-bulkomatic.txt | FAIL | 103 tests, 41 passed, 62 failed ============================================================================== Output: /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-titanium/output.xml Log: /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-titanium/log.html Report: /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-titanium/report.html + true + echo 'Examining the files in data/log and checking filesize' Examining the files in data/log and checking filesize + ssh 10.30.171.91 'ls -altr /tmp/karaf-0.22.2/data/log/' Warning: Permanently added '10.30.171.91' (ECDSA) to the list of known hosts. total 5440 drwxrwxr-x 2 jenkins jenkins 4096 Feb 24 01:58 . drwxrwxr-x 9 jenkins jenkins 4096 Feb 24 01:59 .. -rw-rw-r-- 1 jenkins jenkins 1727 Feb 24 02:26 karaf_console.log -rw-rw-r-- 1 jenkins jenkins 5555043 Feb 24 03:10 karaf.log + ssh 10.30.171.91 'du -hs /tmp/karaf-0.22.2/data/log/*' Warning: Permanently added '10.30.171.91' (ECDSA) to the list of known hosts. 5.4M /tmp/karaf-0.22.2/data/log/karaf.log 4.0K /tmp/karaf-0.22.2/data/log/karaf_console.log + ssh 10.30.170.68 'ls -altr /tmp/karaf-0.22.2/data/log/' Warning: Permanently added '10.30.170.68' (ECDSA) to the list of known hosts. total 24448 drwxrwxr-x 2 jenkins jenkins 4096 Feb 24 01:58 . drwxrwxr-x 9 jenkins jenkins 4096 Feb 24 01:59 .. -rw-rw-r-- 1 jenkins jenkins 1727 Feb 24 02:26 karaf_console.log -rw-rw-r-- 1 jenkins jenkins 25019771 Feb 24 03:10 karaf.log + ssh 10.30.170.68 'du -hs /tmp/karaf-0.22.2/data/log/*' Warning: Permanently added '10.30.170.68' (ECDSA) to the list of known hosts. 24M /tmp/karaf-0.22.2/data/log/karaf.log 4.0K /tmp/karaf-0.22.2/data/log/karaf_console.log + ssh 10.30.170.152 'ls -altr /tmp/karaf-0.22.2/data/log/' Warning: Permanently added '10.30.170.152' (ECDSA) to the list of known hosts. total 1076 drwxrwxr-x 2 jenkins jenkins 4096 Feb 24 01:58 . drwxrwxr-x 9 jenkins jenkins 4096 Feb 24 01:59 .. -rw-rw-r-- 1 jenkins jenkins 1727 Feb 24 02:26 karaf_console.log -rw-rw-r-- 1 jenkins jenkins 1085463 Feb 24 03:10 karaf.log + ssh 10.30.170.152 'du -hs /tmp/karaf-0.22.2/data/log/*' Warning: Permanently added '10.30.170.152' (ECDSA) to the list of known hosts. 1.1M /tmp/karaf-0.22.2/data/log/karaf.log 4.0K /tmp/karaf-0.22.2/data/log/karaf_console.log + set +e ++ seq 1 3 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_1_IP + echo 'Let'\''s take the karaf thread dump again' Let's take the karaf thread dump again + ssh 10.30.171.91 'sudo ps aux' Warning: Permanently added '10.30.171.91' (ECDSA) to the list of known hosts. ++ grep org.apache.karaf.main.Main /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-titanium/ps_after.log ++ grep -v grep ++ tr -s ' ' ++ cut -f2 '-d ' + pid=5843 + echo 'karaf main: org.apache.karaf.main.Main, pid:5843' karaf main: org.apache.karaf.main.Main, pid:5843 + ssh 10.30.171.91 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 5843' Warning: Permanently added '10.30.171.91' (ECDSA) to the list of known hosts. + echo 'killing karaf process...' killing karaf process... + ssh 10.30.171.91 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh' Warning: Permanently added '10.30.171.91' (ECDSA) to the list of known hosts. + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_2_IP + echo 'Let'\''s take the karaf thread dump again' Let's take the karaf thread dump again + ssh 10.30.170.68 'sudo ps aux' Warning: Permanently added '10.30.170.68' (ECDSA) to the list of known hosts. ++ grep org.apache.karaf.main.Main /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-titanium/ps_after.log ++ tr -s ' ' ++ grep -v grep ++ cut -f2 '-d ' + pid=4071 + echo 'karaf main: org.apache.karaf.main.Main, pid:4071' karaf main: org.apache.karaf.main.Main, pid:4071 + ssh 10.30.170.68 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 4071' Warning: Permanently added '10.30.170.68' (ECDSA) to the list of known hosts. + echo 'killing karaf process...' killing karaf process... + ssh 10.30.170.68 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh' Warning: Permanently added '10.30.170.68' (ECDSA) to the list of known hosts. + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_3_IP + echo 'Let'\''s take the karaf thread dump again' Let's take the karaf thread dump again + ssh 10.30.170.152 'sudo ps aux' Warning: Permanently added '10.30.170.152' (ECDSA) to the list of known hosts. ++ grep org.apache.karaf.main.Main /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-titanium/ps_after.log ++ grep -v grep ++ cut -f2 '-d ' ++ tr -s ' ' + pid=4951 + echo 'karaf main: org.apache.karaf.main.Main, pid:4951' karaf main: org.apache.karaf.main.Main, pid:4951 + ssh 10.30.170.152 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 4951' Warning: Permanently added '10.30.170.152' (ECDSA) to the list of known hosts. + echo 'killing karaf process...' killing karaf process... + ssh 10.30.170.152 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh' Warning: Permanently added '10.30.170.152' (ECDSA) to the list of known hosts. + sleep 5 ++ seq 1 3 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_1_IP + echo 'Compressing karaf.log 1' Compressing karaf.log 1 + ssh 10.30.171.91 gzip --best /tmp/karaf-0.22.2/data/log/karaf.log Warning: Permanently added '10.30.171.91' (ECDSA) to the list of known hosts. + echo 'Fetching compressed karaf.log 1' Fetching compressed karaf.log 1 + scp 10.30.171.91:/tmp/karaf-0.22.2/data/log/karaf.log.gz odl1_karaf.log.gz Warning: Permanently added '10.30.171.91' (ECDSA) to the list of known hosts. + ssh 10.30.171.91 rm -f /tmp/karaf-0.22.2/data/log/karaf.log.gz Warning: Permanently added '10.30.171.91' (ECDSA) to the list of known hosts. + scp 10.30.171.91:/tmp/karaf-0.22.2/data/log/karaf_console.log odl1_karaf_console.log Warning: Permanently added '10.30.171.91' (ECDSA) to the list of known hosts. + ssh 10.30.171.91 rm -f /tmp/karaf-0.22.2/data/log/karaf_console.log Warning: Permanently added '10.30.171.91' (ECDSA) to the list of known hosts. + echo 'Fetch GC logs' Fetch GC logs + mkdir -p gclogs-1 + scp '10.30.171.91:/tmp/karaf-0.22.2/data/log/*.log' gclogs-1/ Warning: Permanently added '10.30.171.91' (ECDSA) to the list of known hosts. scp: /tmp/karaf-0.22.2/data/log/*.log: No such file or directory + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_2_IP + echo 'Compressing karaf.log 2' Compressing karaf.log 2 + ssh 10.30.170.68 gzip --best /tmp/karaf-0.22.2/data/log/karaf.log Warning: Permanently added '10.30.170.68' (ECDSA) to the list of known hosts. + echo 'Fetching compressed karaf.log 2' Fetching compressed karaf.log 2 + scp 10.30.170.68:/tmp/karaf-0.22.2/data/log/karaf.log.gz odl2_karaf.log.gz Warning: Permanently added '10.30.170.68' (ECDSA) to the list of known hosts. + ssh 10.30.170.68 rm -f /tmp/karaf-0.22.2/data/log/karaf.log.gz Warning: Permanently added '10.30.170.68' (ECDSA) to the list of known hosts. + scp 10.30.170.68:/tmp/karaf-0.22.2/data/log/karaf_console.log odl2_karaf_console.log Warning: Permanently added '10.30.170.68' (ECDSA) to the list of known hosts. + ssh 10.30.170.68 rm -f /tmp/karaf-0.22.2/data/log/karaf_console.log Warning: Permanently added '10.30.170.68' (ECDSA) to the list of known hosts. + echo 'Fetch GC logs' Fetch GC logs + mkdir -p gclogs-2 + scp '10.30.170.68:/tmp/karaf-0.22.2/data/log/*.log' gclogs-2/ Warning: Permanently added '10.30.170.68' (ECDSA) to the list of known hosts. scp: /tmp/karaf-0.22.2/data/log/*.log: No such file or directory + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_3_IP + echo 'Compressing karaf.log 3' Compressing karaf.log 3 + ssh 10.30.170.152 gzip --best /tmp/karaf-0.22.2/data/log/karaf.log Warning: Permanently added '10.30.170.152' (ECDSA) to the list of known hosts. + echo 'Fetching compressed karaf.log 3' Fetching compressed karaf.log 3 + scp 10.30.170.152:/tmp/karaf-0.22.2/data/log/karaf.log.gz odl3_karaf.log.gz Warning: Permanently added '10.30.170.152' (ECDSA) to the list of known hosts. + ssh 10.30.170.152 rm -f /tmp/karaf-0.22.2/data/log/karaf.log.gz Warning: Permanently added '10.30.170.152' (ECDSA) to the list of known hosts. + scp 10.30.170.152:/tmp/karaf-0.22.2/data/log/karaf_console.log odl3_karaf_console.log Warning: Permanently added '10.30.170.152' (ECDSA) to the list of known hosts. + ssh 10.30.170.152 rm -f /tmp/karaf-0.22.2/data/log/karaf_console.log Warning: Permanently added '10.30.170.152' (ECDSA) to the list of known hosts. + echo 'Fetch GC logs' Fetch GC logs + mkdir -p gclogs-3 + scp '10.30.170.152:/tmp/karaf-0.22.2/data/log/*.log' gclogs-3/ Warning: Permanently added '10.30.170.152' (ECDSA) to the list of known hosts. scp: /tmp/karaf-0.22.2/data/log/*.log: No such file or directory + echo 'Examine copied files' Examine copied files + ls -lt total 205164 drwxrwxr-x. 2 jenkins jenkins 6 Feb 24 03:10 gclogs-3 -rw-rw-r--. 1 jenkins jenkins 1727 Feb 24 03:10 odl3_karaf_console.log -rw-rw-r--. 1 jenkins jenkins 86181 Feb 24 03:10 odl3_karaf.log.gz drwxrwxr-x. 2 jenkins jenkins 6 Feb 24 03:10 gclogs-2 -rw-rw-r--. 1 jenkins jenkins 1727 Feb 24 03:10 odl2_karaf_console.log -rw-rw-r--. 1 jenkins jenkins 385288 Feb 24 03:10 odl2_karaf.log.gz drwxrwxr-x. 2 jenkins jenkins 6 Feb 24 03:10 gclogs-1 -rw-rw-r--. 1 jenkins jenkins 1727 Feb 24 03:10 odl1_karaf_console.log -rw-rw-r--. 1 jenkins jenkins 181767 Feb 24 03:10 odl1_karaf.log.gz -rw-rw-r--. 1 jenkins jenkins 115709 Feb 24 03:10 karaf_3_4951_threads_after.log -rw-rw-r--. 1 jenkins jenkins 13674 Feb 24 03:10 ps_after.log -rw-rw-r--. 1 jenkins jenkins 293877 Feb 24 03:10 karaf_2_4071_threads_after.log -rw-rw-r--. 1 jenkins jenkins 124952 Feb 24 03:10 karaf_1_5843_threads_after.log -rw-rw-r--. 1 jenkins jenkins 260720 Feb 24 03:10 report.html -rw-rw-r--. 1 jenkins jenkins 2684527 Feb 24 03:10 log.html -rw-rw-r--. 1 jenkins jenkins 205535373 Feb 24 03:10 output.xml -rw-rw-r--. 1 jenkins jenkins 163 Feb 24 02:02 testplan.txt -rw-rw-r--. 1 jenkins jenkins 98863 Feb 24 02:02 karaf_3_2038_threads_before.log -rw-rw-r--. 1 jenkins jenkins 13418 Feb 24 02:02 ps_before.log -rw-rw-r--. 1 jenkins jenkins 97130 Feb 24 02:02 karaf_2_2034_threads_before.log -rw-rw-r--. 1 jenkins jenkins 103095 Feb 24 02:02 karaf_1_2040_threads_before.log -rw-rw-r--. 1 jenkins jenkins 3043 Feb 24 01:58 post-startup-script.sh -rw-rw-r--. 1 jenkins jenkins 225 Feb 24 01:58 startup-script.sh -rw-rw-r--. 1 jenkins jenkins 3282 Feb 24 01:58 configuration-script.sh -rw-rw-r--. 1 jenkins jenkins 266 Feb 24 01:58 detect_variables.env -rw-rw-r--. 1 jenkins jenkins 92 Feb 24 01:58 set_variables.env -rw-rw-r--. 1 jenkins jenkins 354 Feb 24 01:58 slave_addresses.txt -rw-rw-r--. 1 jenkins jenkins 570 Feb 24 01:57 requirements.txt -rw-rw-r--. 1 jenkins jenkins 26 Feb 24 01:57 env.properties -rw-rw-r--. 1 jenkins jenkins 334 Feb 24 01:56 stack-parameters.yaml drwxrwxr-x. 7 jenkins jenkins 4096 Feb 24 01:55 test drwxrwxr-x. 2 jenkins jenkins 6 Feb 24 01:55 test@tmp + true [openflowplugin-csit-3node-clustering-bulkomatic-only-titanium] $ /bin/sh /tmp/jenkins6475123549559008414.sh Cleaning up Robot installation... $ ssh-agent -k unset SSH_AUTH_SOCK; unset SSH_AGENT_PID; echo Agent pid 5284 killed; [ssh-agent] Stopped. Recording plot data Robot results publisher started... INFO: Checking test criticality is deprecated and will be dropped in a future release! -Parsing output xml: Done! -Copying log files to build dir: Done! -Assigning results to build: Done! -Checking thresholds: Done! Done publishing Robot results. Build step 'Publish Robot Framework test results' changed build result to UNSTABLE [PostBuildScript] - [INFO] Executing post build scripts. [openflowplugin-csit-3node-clustering-bulkomatic-only-titanium] $ /bin/bash /tmp/jenkins10640023467596274850.sh Archiving csit artifacts mv: cannot stat '*_1.png': No such file or directory mv: cannot stat '/tmp/odl1_*': No such file or directory mv: cannot stat '*_2.png': No such file or directory mv: cannot stat '/tmp/odl2_*': No such file or directory mv: cannot stat '*_3.png': No such file or directory mv: cannot stat '/tmp/odl3_*': No such file or directory % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 4928k 0 4928k 0 0 4597k 0 --:--:-- 0:00:01 --:--:-- 4592k 100 10.5M 0 10.5M 0 0 5225k 0 --:--:-- 0:00:02 --:--:-- 5222k 100 16.3M 0 16.3M 0 0 5449k 0 --:--:-- 0:00:03 --:--:-- 5449k 100 22.0M 0 22.0M 0 0 5535k 0 --:--:-- 0:00:04 --:--:-- 5535k 100 25.7M 0 25.7M 0 0 5526k 0 --:--:-- 0:00:04 --:--:-- 5616k Archive: robot-plugin.zip inflating: ./archives/robot-plugin/log.html inflating: ./archives/robot-plugin/output.xml inflating: ./archives/robot-plugin/report.html mv: cannot stat '*.log.gz': No such file or directory mv: cannot stat '*.csv': No such file or directory mv: cannot stat '*.png': No such file or directory [PostBuildScript] - [INFO] Executing post build scripts. [openflowplugin-csit-3node-clustering-bulkomatic-only-titanium] $ /bin/bash /tmp/jenkins7204613850791817951.sh [PostBuildScript] - [INFO] Executing post build scripts. [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content OS_CLOUD=vex OS_STACK_NAME=releng-openflowplugin-csit-3node-clustering-bulkomatic-only-titanium-650 [EnvInject] - Variables injected successfully. provisioning config files... copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml [openflowplugin-csit-3node-clustering-bulkomatic-only-titanium] $ /bin/bash /tmp/jenkins7941849633335550939.sh ---> openstack-stack-delete.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-titanium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-AO6W from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) lf-activate-venv(): INFO: Attempting to install with network-safe options... lf-activate-venv(): INFO: Base packages installed successfully lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes python-heatclient python-openstackclient urllib3~=1.26.15 lf-activate-venv(): INFO: Adding /tmp/venv-AO6W/bin to PATH INFO: Stack cost retrieval disabled, setting cost to 0 /tmp/venv-AO6W/lib/python3.11/site-packages/requests/__init__.py:113: RequestsDependencyWarning: urllib3 (1.26.20) or chardet (6.0.0.post1)/charset_normalizer (3.4.4) doesn't match a supported version! warnings.warn( INFO: Deleting stack releng-openflowplugin-csit-3node-clustering-bulkomatic-only-titanium-650 Waiting for stack to delete... Successfully deleted stack releng-openflowplugin-csit-3node-clustering-bulkomatic-only-titanium-650 [PostBuildScript] - [INFO] Executing post build scripts. [openflowplugin-csit-3node-clustering-bulkomatic-only-titanium] $ /bin/bash /tmp/jenkins2341876761097940745.sh ---> sysstat.sh [openflowplugin-csit-3node-clustering-bulkomatic-only-titanium] $ /bin/bash /tmp/jenkins16712774121583574220.sh ---> package-listing.sh ++ facter osfamily ++ tr '[:upper:]' '[:lower:]' + OS_FAMILY=redhat + workspace=/w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-titanium + START_PACKAGES=/tmp/packages_start.txt + END_PACKAGES=/tmp/packages_end.txt + DIFF_PACKAGES=/tmp/packages_diff.txt + PACKAGES=/tmp/packages_start.txt + '[' /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-titanium ']' + PACKAGES=/tmp/packages_end.txt + case "${OS_FAMILY}" in + rpm -qa + sort + '[' -f /tmp/packages_start.txt ']' + '[' -f /tmp/packages_end.txt ']' + diff /tmp/packages_start.txt /tmp/packages_end.txt + '[' /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-titanium ']' + mkdir -p /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-titanium/archives/ + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-titanium/archives/ [openflowplugin-csit-3node-clustering-bulkomatic-only-titanium] $ /bin/bash /tmp/jenkins9746474082923121975.sh ---> capture-instance-metadata.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-titanium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-AO6W from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) lf-activate-venv(): INFO: Attempting to install with network-safe options... lf-activate-venv(): INFO: Base packages installed successfully lf-activate-venv(): INFO: Installing additional packages: lftools lf-activate-venv(): INFO: Adding /tmp/venv-AO6W/bin to PATH INFO: Running in OpenStack, capturing instance metadata [openflowplugin-csit-3node-clustering-bulkomatic-only-titanium] $ /bin/bash /tmp/jenkins1739829865397003462.sh provisioning config files... Could not find credentials [logs] for openflowplugin-csit-3node-clustering-bulkomatic-only-titanium #650 copy managed file [jenkins-log-archives-settings] to file:/w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-titanium@tmp/config122456759931987806tmp Regular expression run condition: Expression=[^.*logs-s3.*], Label=[odl-logs-s3-cloudfront-index] Run condition [Regular expression match] enabling perform for step [Provide Configuration files] provisioning config files... copy managed file [jenkins-s3-log-ship] to file:/home/jenkins/.aws/credentials [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content SERVER_ID=logs [EnvInject] - Variables injected successfully. [openflowplugin-csit-3node-clustering-bulkomatic-only-titanium] $ /bin/bash /tmp/jenkins12026780475249243647.sh ---> create-netrc.sh WARN: Log server credential not found. [openflowplugin-csit-3node-clustering-bulkomatic-only-titanium] $ /bin/bash /tmp/jenkins14056559429994443677.sh ---> python-tools-install.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-titanium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-AO6W from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) lf-activate-venv(): INFO: Attempting to install with network-safe options... lf-activate-venv(): INFO: Base packages installed successfully lf-activate-venv(): INFO: Installing additional packages: lftools lf-activate-venv(): INFO: Adding /tmp/venv-AO6W/bin to PATH [openflowplugin-csit-3node-clustering-bulkomatic-only-titanium] $ /bin/bash /tmp/jenkins14447587150677212463.sh ---> sudo-logs.sh Archiving 'sudo' log.. [openflowplugin-csit-3node-clustering-bulkomatic-only-titanium] $ /bin/bash /tmp/jenkins2857803381425798464.sh ---> job-cost.sh INFO: Activating Python virtual environment... Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-titanium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-AO6W from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) lf-activate-venv(): INFO: Attempting to install with network-safe options... lf-activate-venv(): INFO: Base packages installed successfully lf-activate-venv(): INFO: Installing additional packages: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 lf-activate-venv(): INFO: Adding /tmp/venv-AO6W/bin to PATH DEBUG: Contents of stack-cost file: total: 0 INFO: Retrieving Stack Cost... INFO: Stack cost: 0 INFO: Instance uptime: 4674s INFO: Fetching instance metadata (attempt 1 of 3)... DEBUG: URL: http://169.254.169.254/latest/meta-data/instance-type INFO: Successfully fetched instance metadata INFO: Instance type: v3-standard-2 INFO: Retrieving pricing info for: v3-standard-2 INFO: Fetching Vexxhost pricing API (attempt 1 of 3)... DEBUG: URL: https://pricing.vexxhost.net/v1/pricing/v3-standard-2/cost?seconds=4674 INFO: Successfully fetched Vexxhost pricing API INFO: Retrieved cost: 0.11 INFO: Retrieved resource: v3-standard-2 INFO: Creating archive directory: /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-titanium/archives/cost INFO: Archiving costs to: /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-titanium/archives/cost.csv INFO: Successfully archived job cost data DEBUG: Cost data: openflowplugin-csit-3node-clustering-bulkomatic-only-titanium,650,2026-02-24 03:12:19,v3-standard-2,4674,0.11,0.00,UNSTABLE [openflowplugin-csit-3node-clustering-bulkomatic-only-titanium] $ /bin/bash -l /tmp/jenkins7819748676787984694.sh ---> logs-deploy.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-titanium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-AO6W from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) lf-activate-venv(): INFO: Attempting to install with network-safe options... lf-activate-venv(): INFO: Base packages installed successfully lf-activate-venv(): INFO: Installing additional packages: lftools urllib3~=1.26.15 lf-activate-venv(): INFO: Adding /tmp/venv-AO6W/bin to PATH WARNING: Nexus logging server not set INFO: S3 path logs/releng/vex-yul-odl-jenkins-1/openflowplugin-csit-3node-clustering-bulkomatic-only-titanium/650/ INFO: archiving logs to S3 /tmp/venv-AO6W/lib/python3.11/site-packages/requests/__init__.py:113: RequestsDependencyWarning: urllib3 (1.26.20) or chardet (6.0.0.post1)/charset_normalizer (3.4.4) doesn't match a supported version! warnings.warn( ---> uname -a: Linux prd-centos8-robot-2c-8g-20335.novalocal 4.18.0-553.5.1.el8.x86_64 #1 SMP Tue May 21 05:46:01 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux ---> lscpu: Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Byte Order: Little Endian CPU(s): 2 On-line CPU(s) list: 0,1 Thread(s) per core: 1 Core(s) per socket: 1 Socket(s): 2 NUMA node(s): 1 Vendor ID: AuthenticAMD CPU family: 23 Model: 49 Model name: AMD EPYC-Rome Processor Stepping: 0 CPU MHz: 2799.998 BogoMIPS: 5599.99 Virtualization: AMD-V Hypervisor vendor: KVM Virtualization type: full L1d cache: 32K L1i cache: 32K L2 cache: 512K L3 cache: 16384K NUMA node0 CPU(s): 0,1 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities ---> nproc: 2 ---> df -h: Filesystem Size Used Avail Use% Mounted on devtmpfs 3.8G 0 3.8G 0% /dev tmpfs 3.8G 0 3.8G 0% /dev/shm tmpfs 3.8G 17M 3.8G 1% /run tmpfs 3.8G 0 3.8G 0% /sys/fs/cgroup /dev/vda1 40G 8.7G 32G 22% / tmpfs 770M 0 770M 0% /run/user/1001 ---> free -m: total used free shared buff/cache available Mem: 7697 747 4322 19 2627 6651 Swap: 1023 0 1023 ---> ip addr: 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever inet6 ::1/128 scope host valid_lft forever preferred_lft forever 2: eth0: mtu 1458 qdisc mq state UP group default qlen 1000 link/ether fa:16:3e:60:22:ea brd ff:ff:ff:ff:ff:ff altname enp0s3 altname ens3 inet 10.30.170.232/23 brd 10.30.171.255 scope global dynamic noprefixroute eth0 valid_lft 81727sec preferred_lft 81727sec inet6 fe80::f816:3eff:fe60:22ea/64 scope link valid_lft forever preferred_lft forever ---> sar -b -r -n DEV: Linux 4.18.0-553.5.1.el8.x86_64 (centos-stream-8-robot-7d7a37eb-bc14-4dd6-9530-dc22c5eae738.noval) 02/24/2026 _x86_64_ (2 CPU) 01:54:33 LINUX RESTART (2 CPU) 01:55:01 AM tps rtps wtps bread/s bwrtn/s 01:56:01 AM 103.60 16.74 86.86 5486.08 7913.87 01:57:01 AM 77.74 1.08 76.65 75.32 11529.81 01:58:01 AM 42.31 4.05 38.26 1262.04 2328.99 01:59:01 AM 67.31 3.30 64.01 91.85 7742.94 02:00:01 AM 7.73 0.00 7.73 0.00 550.73 02:01:01 AM 0.52 0.02 0.50 0.13 8.38 02:02:01 AM 0.38 0.07 0.32 1.73 5.60 02:03:01 AM 0.47 0.07 0.40 4.93 109.41 02:04:01 AM 2.05 0.00 2.05 0.00 110.01 02:05:01 AM 0.20 0.00 0.20 0.00 25.06 02:06:01 AM 0.35 0.00 0.35 0.00 36.71 02:07:01 AM 0.25 0.00 0.25 0.00 95.98 02:08:01 AM 0.23 0.00 0.23 0.00 3.37 02:09:01 AM 0.17 0.00 0.17 0.00 43.89 02:10:01 AM 0.52 0.03 0.48 0.27 486.27 02:11:01 AM 1.60 0.00 1.60 0.00 605.15 02:12:01 AM 0.62 0.00 0.62 0.00 495.05 02:13:01 AM 0.30 0.00 0.30 0.00 288.85 02:14:01 AM 0.42 0.00 0.42 0.00 457.34 02:15:01 AM 0.47 0.00 0.47 0.00 487.40 02:16:01 AM 0.27 0.00 0.27 0.00 4.02 02:17:01 AM 0.18 0.00 0.18 0.00 41.36 02:18:01 AM 0.15 0.00 0.15 0.00 1.35 02:19:01 AM 0.28 0.00 0.28 0.00 259.91 02:20:01 AM 0.87 0.32 0.55 6.93 482.87 02:21:01 AM 1.25 0.00 1.25 0.00 519.94 02:22:02 AM 0.57 0.00 0.57 0.00 488.30 02:23:01 AM 0.49 0.00 0.49 0.00 527.08 02:24:01 AM 0.28 0.00 0.28 0.00 291.58 02:25:01 AM 0.48 0.00 0.48 0.00 233.87 02:26:01 AM 0.33 0.00 0.33 0.00 61.67 02:27:01 AM 0.18 0.03 0.15 1.87 22.81 02:28:01 AM 0.15 0.00 0.15 0.00 23.20 02:29:01 AM 0.38 0.00 0.38 0.00 4.68 02:30:01 AM 0.43 0.00 0.43 0.00 4.73 02:31:01 AM 0.57 0.00 0.57 0.00 7.60 02:32:01 AM 0.47 0.00 0.47 0.00 6.36 02:33:01 AM 0.33 0.00 0.33 0.00 4.65 02:34:01 AM 0.23 0.00 0.23 0.00 28.27 02:35:01 AM 0.22 0.00 0.22 0.00 7.13 02:36:01 AM 0.25 0.00 0.25 0.00 23.90 02:37:01 AM 0.13 0.00 0.13 0.00 1.62 02:38:01 AM 0.13 0.00 0.13 0.00 0.95 02:39:01 AM 0.12 0.00 0.12 0.00 1.33 02:40:01 AM 0.25 0.00 0.25 0.00 3.82 02:41:01 AM 0.50 0.00 0.50 0.00 8.90 02:42:01 AM 0.27 0.00 0.27 0.00 8.05 02:43:01 AM 0.13 0.00 0.13 0.00 6.13 02:44:01 AM 0.17 0.00 0.17 0.00 26.96 02:45:01 AM 0.22 0.00 0.22 0.00 5.11 02:46:01 AM 0.25 0.00 0.25 0.00 18.69 02:47:01 AM 0.23 0.00 0.23 0.00 10.13 02:48:01 AM 0.17 0.00 0.17 0.00 2.55 02:49:01 AM 0.12 0.00 0.12 0.00 1.47 02:50:01 AM 0.27 0.00 0.27 0.00 3.97 02:51:01 AM 0.27 0.00 0.27 0.00 4.35 02:52:01 AM 0.23 0.00 0.23 0.00 3.12 02:53:01 AM 0.17 0.00 0.17 0.00 9.76 02:54:01 AM 0.30 0.00 0.30 0.00 101.33 02:55:01 AM 0.30 0.00 0.30 0.00 41.14 02:56:01 AM 0.32 0.00 0.32 0.00 38.21 02:57:01 AM 0.15 0.00 0.15 0.00 28.79 02:58:01 AM 0.13 0.00 0.13 0.00 35.86 02:59:01 AM 0.13 0.00 0.13 0.00 27.86 03:00:01 AM 7.56 5.95 1.62 574.88 82.27 03:01:01 AM 1.95 0.00 1.95 0.00 57.21 03:02:01 AM 0.50 0.00 0.50 0.00 30.53 03:03:01 AM 0.32 0.00 0.32 0.00 22.31 03:04:01 AM 0.13 0.00 0.13 0.00 33.06 03:05:01 AM 0.28 0.00 0.28 0.00 30.49 03:06:01 AM 0.25 0.00 0.25 0.00 31.09 03:07:01 AM 0.15 0.00 0.15 0.00 30.94 03:08:01 AM 0.27 0.00 0.27 0.00 28.58 03:09:01 AM 0.17 0.00 0.17 0.00 29.58 03:10:01 AM 0.18 0.00 0.18 0.00 18.11 03:11:01 AM 2.05 0.25 1.80 18.79 116.68 03:12:01 AM 31.04 0.33 30.71 43.46 8998.23 Average: 4.75 0.42 4.33 98.34 600.93 01:55:01 AM kbmemfree kbavail kbmemused %memused kbbuffers kbcached kbcommit %commit kbactive kbinact kbdirty 01:56:01 AM 5280964 7026420 2601460 33.00 2688 1928024 696544 7.80 186320 2095404 204472 01:57:01 AM 5132104 6990888 2750320 34.89 2688 2035108 706644 7.91 205992 2190244 4 01:58:01 AM 4947476 6967468 2934948 37.23 2688 2191324 757844 8.49 270248 2299892 98160 01:59:01 AM 4910640 7023932 2971784 37.70 2688 2280540 658520 7.37 268680 2320716 9088 02:00:01 AM 4909484 7022776 2972940 37.72 2688 2280540 659872 7.39 268684 2321064 4 02:01:01 AM 4908748 7022048 2973676 37.73 2688 2280544 659872 7.39 268684 2321528 8 02:02:01 AM 4909500 7022868 2972924 37.72 2688 2280612 659872 7.39 268824 2321140 4 02:03:01 AM 4854832 6971832 3027592 38.41 2688 2284252 743848 8.33 269164 2374824 452 02:04:01 AM 4852184 6970164 3030240 38.44 2688 2285224 743848 8.33 269164 2377708 176 02:05:01 AM 4851616 6970452 3030808 38.45 2688 2286096 743848 8.33 269168 2378268 356 02:06:01 AM 4850144 6969788 3032280 38.47 2688 2286896 743848 8.33 269168 2379956 208 02:07:01 AM 4845208 6967500 3037216 38.53 2688 2289536 763140 8.54 269168 2384676 4 02:08:01 AM 4845032 6967332 3037392 38.53 2688 2289544 763140 8.54 269168 2384892 4 02:09:01 AM 4831824 6960216 3050600 38.70 2688 2295644 763140 8.54 269168 2397224 4856 02:10:01 AM 4785884 6928824 3096540 39.28 2688 2310184 807136 9.04 269324 2442808 4864 02:11:01 AM 4739196 6896376 3143228 39.88 2688 2324416 823284 9.22 269324 2489632 1820 02:12:01 AM 4692700 6864044 3189724 40.47 2688 2338588 871184 9.75 269324 2535760 1268 02:13:01 AM 4649072 6834416 3233352 41.02 2688 2352568 886948 9.93 269324 2578920 6636 02:14:01 AM 4601096 6800684 3281328 41.63 2688 2366792 919448 10.30 269324 2627348 7176 02:15:01 AM 4582508 6789524 3299916 41.86 2688 2374212 934932 10.47 269324 2646296 20 02:16:01 AM 4582480 6789512 3299944 41.86 2688 2374228 934932 10.47 269324 2646412 16 02:17:01 AM 4577932 6786148 3304492 41.92 2688 2375412 950340 10.64 269324 2651228 16 02:18:01 AM 4577652 6785876 3304772 41.93 2688 2375420 950340 10.64 269324 2651672 16 02:19:01 AM 4550680 6771744 3331744 42.27 2688 2388252 966044 10.82 269324 2677420 5080 02:20:01 AM 4537724 6773336 3344700 42.43 2688 2402716 966044 10.82 269440 2690656 5056 02:21:01 AM 4523768 6773168 3358656 42.61 2688 2416560 966044 10.82 269448 2704348 3884 02:22:02 AM 4510820 6773436 3371604 42.77 2688 2429760 966044 10.82 269448 2717480 2536 02:23:01 AM 4496272 6772852 3386152 42.96 2688 2443708 966044 10.82 269448 2731428 976 02:24:01 AM 4481812 6772992 3400612 43.14 2688 2458288 966044 10.82 269448 2747048 6832 02:25:01 AM 4481704 6772908 3400720 43.14 2688 2458304 966044 10.82 269448 2746956 4 02:26:01 AM 4477868 6771016 3404556 43.19 2688 2460248 966888 10.83 269448 2750704 208 02:27:01 AM 4476852 6770692 3405572 43.20 2688 2460948 933788 10.46 269984 2751744 200 02:28:01 AM 4474608 6768912 3407816 43.23 2688 2461412 933788 10.46 269984 2753596 16 02:29:01 AM 4474892 6769224 3407532 43.23 2688 2461432 933788 10.46 269984 2753516 4 02:30:01 AM 4474344 6768684 3408080 43.24 2688 2461440 936104 10.48 269984 2753900 4 02:31:01 AM 4474388 6768756 3408036 43.24 2688 2461464 936104 10.48 269984 2753888 4 02:32:01 AM 4474440 6768824 3407984 43.24 2688 2461480 936104 10.48 269984 2753844 4 02:33:01 AM 4474392 6768792 3408032 43.24 2688 2461496 936104 10.48 269984 2754040 4 02:34:01 AM 4472076 6767268 3410348 43.27 2688 2462304 953656 10.68 269984 2756112 48 02:35:01 AM 4470940 6766392 3411484 43.28 2688 2462548 953656 10.68 269984 2757348 152 02:36:01 AM 4468532 6764448 3413892 43.31 2688 2463012 953656 10.68 269984 2759664 4 02:37:01 AM 4468448 6764384 3413976 43.31 2688 2463032 953656 10.68 269984 2759672 4 02:38:01 AM 4468572 6764524 3413852 43.31 2688 2463048 953656 10.68 269984 2759692 24 02:39:01 AM 4466400 6762368 3416024 43.34 2688 2463064 953656 10.68 269984 2761740 24 02:40:01 AM 4465996 6761976 3416428 43.34 2688 2463076 973348 10.90 269984 2762024 16 02:41:01 AM 4466100 6762096 3416324 43.34 2688 2463092 973348 10.90 270012 2762216 16 02:42:01 AM 4465780 6761936 3416644 43.35 2688 2463268 973348 10.90 270012 2762612 48 02:43:01 AM 4470800 6767096 3411624 43.28 2688 2463400 973348 10.90 270012 2757544 24 02:44:01 AM 4469920 6766984 3412504 43.29 2688 2464168 973348 10.90 270012 2758312 16 02:45:01 AM 4469796 6766992 3412628 43.29 2688 2464292 973348 10.90 270012 2758560 72 02:46:01 AM 4470660 6768464 3411764 43.28 2688 2464896 957536 10.72 270012 2757728 220 02:47:01 AM 4470724 6768536 3411700 43.28 2688 2464904 957536 10.72 270012 2757672 4 02:48:01 AM 4470460 6768288 3411964 43.29 2688 2464920 957536 10.72 270012 2757892 4 02:49:01 AM 4470688 6768536 3411736 43.28 2688 2464940 957536 10.72 270012 2757708 4 02:50:01 AM 4470068 6767932 3412356 43.29 2688 2464956 951020 10.65 270012 2758072 16 02:51:01 AM 4470268 6768156 3412156 43.29 2688 2464976 951020 10.65 270012 2758020 16 02:52:01 AM 4469996 6768036 3412428 43.29 2688 2465128 951020 10.65 270012 2758224 152 02:53:01 AM 4470300 6768476 3412124 43.29 2688 2465264 951020 10.65 270012 2758036 32 02:54:01 AM 4466956 6768224 3415468 43.33 2688 2468364 951020 10.65 270024 2761152 172 02:55:01 AM 4466772 6769064 3415652 43.33 2688 2469376 951020 10.65 270024 2761232 80 02:56:01 AM 4465804 6769180 3416620 43.34 2688 2470468 951020 10.65 270024 2762388 136 02:57:01 AM 4464648 6769124 3417776 43.36 2688 2471560 951020 10.65 270028 2763444 400 02:58:01 AM 4463864 6769140 3418560 43.37 2688 2472360 951020 10.65 270024 2764184 156 02:59:01 AM 4463108 6769148 3419316 43.38 2688 2473148 951020 10.65 270024 2764976 136 03:00:01 AM 4444508 6768708 3437916 43.61 2688 2491204 960520 10.75 272208 2781180 700 03:01:01 AM 4443052 6768056 3439372 43.63 2688 2491996 960520 10.75 272204 2782452 24 03:02:01 AM 4443196 6768908 3439228 43.63 2688 2492800 960520 10.75 272208 2782332 80 03:03:01 AM 4442588 6769160 3439836 43.64 2688 2493604 960520 10.75 272212 2783264 348 03:04:01 AM 4441292 6768744 3441132 43.66 2688 2494456 960520 10.75 272208 2784400 248 03:05:01 AM 4441024 6769280 3441400 43.66 2688 2495260 944060 10.57 272208 2784940 232 03:06:01 AM 4440184 6769248 3442240 43.67 2688 2496068 944060 10.57 272208 2785612 216 03:07:01 AM 4439496 6769368 3442928 43.68 2688 2496864 944060 10.57 272208 2786464 120 03:08:01 AM 4438620 6769300 3443804 43.69 2688 2497664 944060 10.57 272208 2787276 172 03:09:01 AM 4437808 6769284 3444616 43.70 2688 2498464 944060 10.57 272208 2787952 144 03:10:01 AM 4436724 6768996 3445700 43.71 2688 2499268 960052 10.75 272208 2789096 468 03:11:01 AM 4681872 6914172 3200552 40.60 2688 2400876 766024 8.58 468956 2346292 82780 03:12:01 AM 4489252 6869844 3393172 43.05 2688 2553196 791116 8.86 673300 2359504 10352 Average: 4575326 6819146 3307098 41.96 2688 2411409 900779 10.09 275943 2648768 6004 01:55:01 AM IFACE rxpck/s txpck/s rxkB/s txkB/s rxcmp/s txcmp/s rxmcst/s %ifutil 01:56:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:56:01 AM eth0 317.95 203.03 1921.79 59.48 0.00 0.00 0.00 0.00 01:57:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:57:01 AM eth0 65.12 39.39 640.26 6.37 0.00 0.00 0.00 0.00 01:58:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:58:01 AM eth0 45.14 39.08 335.76 9.59 0.00 0.00 0.00 0.00 01:59:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:59:01 AM eth0 596.40 431.38 118.67 100.86 0.00 0.00 0.00 0.00 02:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:00:01 AM eth0 2.25 1.93 0.42 0.42 0.00 0.00 0.00 0.00 02:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:01:01 AM eth0 3.02 2.10 1.45 0.48 0.00 0.00 0.00 0.00 02:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:02:01 AM eth0 1.83 0.75 0.23 0.12 0.00 0.00 0.00 0.00 02:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:03:01 AM eth0 133.69 122.59 37.82 10.20 0.00 0.00 0.00 0.00 02:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:04:01 AM eth0 55.32 54.72 9.03 4.46 0.00 0.00 0.00 0.00 02:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:05:01 AM eth0 10.83 10.50 1.72 0.98 0.00 0.00 0.00 0.00 02:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:06:01 AM eth0 2.43 3.03 0.66 0.52 0.00 0.00 0.00 0.00 02:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:07:01 AM eth0 52.75 52.22 18.40 4.11 0.00 0.00 0.00 0.00 02:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:08:01 AM eth0 1.78 0.27 0.49 0.26 0.00 0.00 0.00 0.00 02:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:09:01 AM eth0 64.91 66.69 42.57 5.42 0.00 0.00 0.00 0.00 02:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:10:01 AM eth0 22.39 22.86 83.53 3.00 0.00 0.00 0.00 0.00 02:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:11:01 AM eth0 18.38 22.53 81.50 3.01 0.00 0.00 0.00 0.00 02:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:12:01 AM eth0 17.68 21.90 80.80 2.90 0.00 0.00 0.00 0.00 02:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:13:01 AM eth0 17.91 21.89 80.26 2.89 0.00 0.00 0.00 0.00 02:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:14:01 AM eth0 18.23 21.68 80.84 2.88 0.00 0.00 0.00 0.00 02:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:15:01 AM eth0 17.58 19.41 43.35 2.05 0.00 0.00 0.00 0.00 02:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:16:01 AM eth0 0.28 0.13 0.09 0.07 0.00 0.00 0.00 0.00 02:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:17:01 AM eth0 56.92 57.06 13.90 3.93 0.00 0.00 0.00 0.00 02:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:18:01 AM eth0 0.72 0.07 0.06 0.00 0.00 0.00 0.00 0.00 02:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:19:01 AM eth0 64.20 67.16 124.79 5.80 0.00 0.00 0.00 0.00 02:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:20:01 AM eth0 17.81 21.18 81.89 2.87 0.00 0.00 0.00 0.00 02:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:21:01 AM eth0 18.48 22.29 78.76 2.95 0.00 0.00 0.00 0.00 02:22:02 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:22:02 AM eth0 18.10 21.60 75.49 2.83 0.00 0.00 0.00 0.00 02:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:23:01 AM eth0 18.79 22.81 81.16 2.96 0.00 0.00 0.00 0.00 02:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:24:01 AM eth0 27.23 30.46 84.36 3.52 0.00 0.00 0.00 0.00 02:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:25:01 AM eth0 0.25 0.03 0.02 0.00 0.00 0.00 0.00 0.00 02:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:26:01 AM eth0 63.19 63.31 18.94 4.78 0.00 0.00 0.00 0.00 02:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:27:01 AM eth0 43.79 43.24 7.89 3.52 0.00 0.00 0.00 0.00 02:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:28:01 AM eth0 5.98 5.45 3.14 0.68 0.00 0.00 0.00 0.00 02:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:29:01 AM eth0 0.33 0.05 0.05 0.00 0.00 0.00 0.00 0.00 02:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:30:01 AM eth0 0.47 0.00 0.29 0.00 0.00 0.00 0.00 0.00 02:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:31:01 AM eth0 0.48 0.18 0.16 0.07 0.00 0.00 0.00 0.00 02:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:32:01 AM eth0 1.10 0.07 0.12 0.00 0.00 0.00 0.00 0.00 02:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:33:01 AM eth0 0.93 0.53 0.53 0.39 0.00 0.00 0.00 0.00 02:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:34:01 AM eth0 92.20 92.70 15.45 6.45 0.00 0.00 0.00 0.00 02:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:35:01 AM eth0 14.43 14.63 2.26 1.19 0.00 0.00 0.00 0.00 02:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:36:01 AM eth0 25.06 24.33 4.98 2.22 0.00 0.00 0.00 0.00 02:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:37:01 AM eth0 0.27 0.05 0.02 0.00 0.00 0.00 0.00 0.00 02:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:38:01 AM eth0 0.12 0.00 0.01 0.00 0.00 0.00 0.00 0.00 02:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:39:01 AM eth0 0.27 0.13 0.02 0.01 0.00 0.00 0.00 0.00 02:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:40:01 AM eth0 0.20 0.03 0.02 0.00 0.00 0.00 0.00 0.00 02:41:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:41:01 AM eth0 0.43 0.28 0.15 0.08 0.00 0.00 0.00 0.00 02:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:42:01 AM eth0 20.48 20.03 3.23 1.52 0.00 0.00 0.00 0.00 02:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:43:01 AM eth0 1.42 1.75 0.26 0.16 0.00 0.00 0.00 0.00 02:44:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:44:01 AM eth0 76.44 76.44 13.48 5.48 0.00 0.00 0.00 0.00 02:45:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:45:01 AM eth0 1.73 2.07 0.31 0.18 0.00 0.00 0.00 0.00 02:46:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:46:01 AM eth0 33.91 33.34 6.71 3.01 0.00 0.00 0.00 0.00 02:47:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:47:01 AM eth0 0.48 0.00 0.06 0.00 0.00 0.00 0.00 0.00 02:48:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:48:01 AM eth0 0.67 0.27 0.37 0.26 0.00 0.00 0.00 0.00 02:49:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:49:01 AM eth0 0.35 0.17 0.03 0.01 0.00 0.00 0.00 0.00 02:50:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:50:01 AM eth0 0.17 0.00 0.01 0.00 0.00 0.00 0.00 0.00 02:51:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:51:01 AM eth0 0.28 0.15 0.09 0.07 0.00 0.00 0.00 0.00 02:52:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:52:01 AM eth0 20.83 20.43 3.33 1.54 0.00 0.00 0.00 0.00 02:53:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:53:01 AM eth0 2.15 2.55 0.37 0.21 0.00 0.00 0.00 0.00 02:54:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:54:01 AM eth0 104.30 105.62 27.63 7.89 0.00 0.00 0.00 0.00 02:55:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:55:01 AM eth0 2.40 3.50 0.58 0.59 0.00 0.00 0.00 0.00 02:56:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:56:01 AM eth0 2.98 3.97 0.77 0.72 0.00 0.00 0.00 0.00 02:57:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:57:01 AM eth0 32.51 33.61 5.23 2.59 0.00 0.00 0.00 0.00 02:58:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:58:01 AM eth0 2.02 2.87 0.51 0.45 0.00 0.00 0.00 0.00 02:59:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:59:01 AM eth0 2.02 2.90 0.51 0.45 0.00 0.00 0.00 0.00 03:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:00:01 AM eth0 2.85 3.68 0.58 0.52 0.00 0.00 0.00 0.00 03:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:01:01 AM eth0 2.30 3.03 0.64 0.53 0.00 0.00 0.00 0.00 03:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:02:01 AM eth0 2.27 3.00 0.53 0.46 0.00 0.00 0.00 0.00 03:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:03:01 AM eth0 1.98 2.85 0.51 0.45 0.00 0.00 0.00 0.00 03:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:04:01 AM eth0 10.01 10.78 2.02 1.17 0.00 0.00 0.00 0.00 03:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:05:01 AM eth0 2.08 2.90 0.51 0.45 0.00 0.00 0.00 0.00 03:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:06:01 AM eth0 2.22 2.98 0.64 0.52 0.00 0.00 0.00 0.00 03:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:07:01 AM eth0 2.03 2.90 0.51 0.45 0.00 0.00 0.00 0.00 03:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:08:01 AM eth0 2.02 2.85 0.51 0.45 0.00 0.00 0.00 0.00 03:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:09:01 AM eth0 2.05 2.90 0.51 0.45 0.00 0.00 0.00 0.00 03:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:10:01 AM eth0 2.05 2.90 0.51 0.45 0.00 0.00 0.00 0.00 03:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:11:01 AM eth0 324.34 185.39 562.95 874.02 0.00 0.00 0.00 0.00 03:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:12:01 AM eth0 16.56 14.61 14.61 7.73 0.00 0.00 0.00 0.00 Average: lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 Average: eth0 33.97 28.52 62.64 15.29 0.00 0.00 0.00 0.00 ---> sar -P ALL: Linux 4.18.0-553.5.1.el8.x86_64 (centos-stream-8-robot-7d7a37eb-bc14-4dd6-9530-dc22c5eae738.noval) 02/24/2026 _x86_64_ (2 CPU) 01:54:33 LINUX RESTART (2 CPU) 01:55:01 AM CPU %user %nice %system %iowait %steal %idle 01:56:01 AM all 45.64 0.00 6.84 0.92 0.10 46.50 01:56:01 AM 0 52.90 0.00 6.61 0.82 0.10 39.58 01:56:01 AM 1 38.36 0.00 7.07 1.03 0.10 53.43 01:57:01 AM all 17.98 0.00 3.08 1.28 0.08 77.58 01:57:01 AM 0 11.05 0.00 2.50 1.32 0.07 85.07 01:57:01 AM 1 24.93 0.00 3.66 1.25 0.08 70.07 01:58:01 AM all 26.96 0.00 4.67 0.41 0.08 67.87 01:58:01 AM 0 28.69 0.00 4.97 0.53 0.08 65.72 01:58:01 AM 1 25.22 0.00 4.37 0.28 0.08 70.04 01:59:01 AM all 20.14 0.00 4.42 0.62 0.10 74.72 01:59:01 AM 0 25.50 0.00 4.56 0.80 0.10 69.04 01:59:01 AM 1 14.78 0.00 4.28 0.43 0.10 80.41 02:00:01 AM all 0.35 0.00 0.10 0.06 0.03 99.46 02:00:01 AM 0 0.60 0.00 0.05 0.00 0.03 99.32 02:00:01 AM 1 0.10 0.00 0.15 0.12 0.03 99.60 02:01:01 AM all 0.34 0.00 0.09 0.00 0.05 99.52 02:01:01 AM 0 0.57 0.00 0.08 0.00 0.07 99.28 02:01:01 AM 1 0.12 0.00 0.10 0.00 0.03 99.75 02:02:01 AM all 0.13 0.00 0.08 0.01 0.05 99.72 02:02:01 AM 0 0.23 0.00 0.13 0.02 0.07 99.55 02:02:01 AM 1 0.03 0.00 0.03 0.00 0.03 99.90 02:03:01 AM all 9.82 0.00 1.34 0.00 0.08 88.75 02:03:01 AM 0 13.17 0.00 1.91 0.00 0.08 84.84 02:03:01 AM 1 6.49 0.00 0.79 0.00 0.08 92.64 02:04:01 AM all 4.24 0.00 0.29 0.01 0.10 95.35 02:04:01 AM 0 5.33 0.00 0.28 0.00 0.10 94.28 02:04:01 AM 1 3.16 0.00 0.30 0.02 0.10 96.42 02:05:01 AM all 2.84 0.00 0.14 0.00 0.09 96.93 02:05:01 AM 0 3.81 0.00 0.15 0.00 0.10 95.94 02:05:01 AM 1 1.87 0.00 0.13 0.00 0.08 97.91 02:06:01 AM all 2.67 0.00 0.10 0.00 0.08 97.15 02:06:01 AM 0 2.09 0.00 0.08 0.00 0.07 97.76 02:06:01 AM 1 3.26 0.00 0.12 0.00 0.08 96.54 02:06:01 AM CPU %user %nice %system %iowait %steal %idle 02:07:01 AM all 6.16 0.00 0.88 0.01 0.09 92.86 02:07:01 AM 0 9.02 0.00 1.42 0.00 0.10 89.46 02:07:01 AM 1 3.30 0.00 0.33 0.02 0.08 96.27 02:08:01 AM all 0.66 0.00 0.12 0.00 0.08 99.14 02:08:01 AM 0 0.60 0.00 0.13 0.00 0.10 99.16 02:08:01 AM 1 0.72 0.00 0.10 0.00 0.07 99.12 02:09:01 AM all 10.62 0.00 0.80 0.00 0.08 88.50 02:09:01 AM 0 18.58 0.00 1.17 0.00 0.10 80.15 02:09:01 AM 1 2.68 0.00 0.42 0.00 0.07 96.84 02:10:01 AM all 23.15 0.00 1.50 0.03 0.11 75.21 02:10:01 AM 0 30.76 0.00 1.79 0.03 0.12 67.30 02:10:01 AM 1 15.54 0.00 1.22 0.02 0.10 83.12 02:11:01 AM all 22.47 0.00 1.40 0.04 0.09 75.99 02:11:01 AM 0 30.59 0.00 1.84 0.03 0.10 67.44 02:11:01 AM 1 14.35 0.00 0.97 0.05 0.08 84.55 02:12:01 AM all 22.46 0.00 1.41 0.02 0.09 76.02 02:12:01 AM 0 35.48 0.00 2.10 0.00 0.10 62.32 02:12:01 AM 1 9.42 0.00 0.72 0.03 0.08 89.74 02:13:01 AM all 22.14 0.00 1.39 0.01 0.08 76.38 02:13:01 AM 0 29.77 0.00 1.79 0.00 0.08 68.36 02:13:01 AM 1 14.50 0.00 1.00 0.02 0.08 84.40 02:14:01 AM all 22.58 0.00 1.40 0.03 0.08 75.91 02:14:01 AM 0 37.90 0.00 2.22 0.00 0.10 59.78 02:14:01 AM 1 7.26 0.00 0.58 0.05 0.07 92.03 02:15:01 AM all 12.32 0.00 0.85 0.02 0.08 86.73 02:15:01 AM 0 23.77 0.00 1.47 0.00 0.08 74.67 02:15:01 AM 1 0.85 0.00 0.23 0.03 0.08 98.80 02:16:01 AM all 0.91 0.00 0.11 0.00 0.08 98.90 02:16:01 AM 0 1.05 0.00 0.12 0.00 0.10 98.73 02:16:01 AM 1 0.77 0.00 0.10 0.00 0.07 99.06 02:17:01 AM all 3.06 0.00 0.55 0.00 0.08 96.32 02:17:01 AM 0 3.85 0.00 0.79 0.00 0.08 95.28 02:17:01 AM 1 2.26 0.00 0.32 0.00 0.07 97.35 02:17:01 AM CPU %user %nice %system %iowait %steal %idle 02:18:01 AM all 0.64 0.00 0.12 0.00 0.08 99.16 02:18:01 AM 0 0.55 0.00 0.13 0.00 0.10 99.22 02:18:01 AM 1 0.74 0.00 0.10 0.00 0.07 99.10 02:19:01 AM all 21.62 0.00 1.41 0.01 0.09 76.87 02:19:01 AM 0 31.65 0.00 1.89 0.00 0.10 66.35 02:19:01 AM 1 11.59 0.00 0.94 0.02 0.08 87.37 02:20:01 AM all 22.75 0.00 1.42 0.03 0.08 75.73 02:20:01 AM 0 40.24 0.00 2.32 0.00 0.08 57.36 02:20:01 AM 1 5.25 0.00 0.52 0.05 0.07 94.12 02:21:01 AM all 21.88 0.00 1.34 0.05 0.08 76.64 02:21:01 AM 0 29.12 0.00 1.69 0.08 0.08 69.03 02:21:01 AM 1 14.65 0.00 1.00 0.02 0.08 84.25 02:22:02 AM all 21.01 0.00 1.33 0.02 0.08 77.56 02:22:02 AM 0 29.67 0.00 1.77 0.02 0.08 68.46 02:22:02 AM 1 12.34 0.00 0.89 0.02 0.08 86.67 02:23:01 AM all 22.76 0.00 1.33 0.03 0.09 75.78 02:23:01 AM 0 36.86 0.00 2.05 0.00 0.10 60.98 02:23:01 AM 1 8.64 0.00 0.61 0.05 0.09 90.61 02:24:01 AM all 23.04 0.00 1.48 0.02 0.08 75.38 02:24:01 AM 0 17.39 0.00 1.09 0.03 0.08 81.41 02:24:01 AM 1 28.68 0.00 1.87 0.00 0.08 69.37 02:25:01 AM all 0.93 0.00 0.12 0.03 0.06 98.86 02:25:01 AM 0 0.98 0.00 0.08 0.00 0.07 98.86 02:25:01 AM 1 0.87 0.00 0.15 0.07 0.05 98.86 02:26:01 AM all 5.13 0.00 0.85 0.01 0.08 93.94 02:26:01 AM 0 6.84 0.00 1.37 0.00 0.05 91.74 02:26:01 AM 1 3.42 0.00 0.32 0.02 0.10 96.14 02:27:01 AM all 6.61 0.00 0.57 0.00 0.06 92.76 02:27:01 AM 0 11.17 0.00 0.79 0.00 0.07 87.98 02:27:01 AM 1 2.26 0.00 0.37 0.00 0.05 97.32 02:28:01 AM all 2.19 0.00 0.24 0.00 0.06 97.51 02:28:01 AM 0 0.84 0.00 0.13 0.00 0.05 98.98 02:28:01 AM 1 3.55 0.00 0.35 0.00 0.07 96.03 02:28:01 AM CPU %user %nice %system %iowait %steal %idle 02:29:01 AM all 0.88 0.00 0.09 0.00 0.08 98.96 02:29:01 AM 0 0.95 0.00 0.08 0.00 0.08 98.88 02:29:01 AM 1 0.80 0.00 0.10 0.00 0.07 99.03 02:30:01 AM all 0.87 0.00 0.10 0.00 0.05 98.98 02:30:01 AM 0 0.77 0.00 0.07 0.00 0.05 99.11 02:30:01 AM 1 0.97 0.00 0.13 0.00 0.05 98.85 02:31:01 AM all 0.83 0.00 0.12 0.00 0.07 98.99 02:31:01 AM 0 0.60 0.00 0.13 0.00 0.07 99.20 02:31:01 AM 1 1.05 0.00 0.10 0.00 0.07 98.78 02:32:01 AM all 0.89 0.00 0.10 0.00 0.07 98.94 02:32:01 AM 0 0.95 0.00 0.10 0.00 0.05 98.90 02:32:01 AM 1 0.84 0.00 0.10 0.00 0.08 98.98 02:33:01 AM all 0.89 0.00 0.10 0.00 0.07 98.94 02:33:01 AM 0 0.82 0.00 0.08 0.00 0.05 99.05 02:33:01 AM 1 0.97 0.00 0.12 0.00 0.08 98.83 02:34:01 AM all 3.48 0.00 0.50 0.00 0.08 95.94 02:34:01 AM 0 4.20 0.00 0.57 0.00 0.08 95.14 02:34:01 AM 1 2.75 0.00 0.42 0.00 0.08 96.74 02:35:01 AM all 1.50 0.00 0.16 0.00 0.05 98.29 02:35:01 AM 0 1.94 0.00 0.17 0.00 0.05 97.84 02:35:01 AM 1 1.05 0.00 0.15 0.00 0.05 98.74 02:36:01 AM all 4.01 0.00 0.37 0.00 0.05 95.57 02:36:01 AM 0 4.89 0.00 0.42 0.00 0.05 94.64 02:36:01 AM 1 3.15 0.00 0.32 0.00 0.05 96.48 02:37:01 AM all 0.93 0.00 0.10 0.00 0.06 98.91 02:37:01 AM 0 0.87 0.00 0.08 0.00 0.05 99.00 02:37:01 AM 1 0.99 0.00 0.12 0.00 0.07 98.83 02:38:01 AM all 0.84 0.00 0.09 0.00 0.06 99.01 02:38:01 AM 0 0.85 0.00 0.08 0.00 0.07 99.00 02:38:01 AM 1 0.82 0.00 0.10 0.00 0.05 99.03 02:39:01 AM all 0.90 0.00 0.11 0.00 0.06 98.93 02:39:01 AM 0 1.04 0.00 0.13 0.00 0.07 98.76 02:39:01 AM 1 0.77 0.00 0.08 0.00 0.05 99.10 02:39:01 AM CPU %user %nice %system %iowait %steal %idle 02:40:01 AM all 0.92 0.00 0.10 0.00 0.05 98.93 02:40:01 AM 0 0.97 0.00 0.12 0.00 0.07 98.85 02:40:01 AM 1 0.87 0.00 0.08 0.00 0.03 99.01 02:41:01 AM all 0.90 0.00 0.11 0.02 0.04 98.93 02:41:01 AM 0 0.79 0.00 0.15 0.03 0.03 99.00 02:41:01 AM 1 1.02 0.00 0.07 0.00 0.05 98.86 02:42:01 AM all 1.75 0.00 0.20 0.00 0.04 98.01 02:42:01 AM 0 1.09 0.00 0.23 0.00 0.05 98.63 02:42:01 AM 1 2.41 0.00 0.17 0.00 0.03 97.39 02:43:01 AM all 1.76 0.00 0.13 0.00 0.05 98.06 02:43:01 AM 0 2.69 0.00 0.13 0.00 0.07 97.11 02:43:01 AM 1 0.84 0.00 0.12 0.00 0.03 99.01 02:44:01 AM all 3.78 0.00 0.51 0.00 0.07 95.64 02:44:01 AM 0 3.83 0.00 0.55 0.00 0.05 95.56 02:44:01 AM 1 3.73 0.00 0.47 0.00 0.08 95.72 02:45:01 AM all 1.09 0.00 0.18 0.00 0.04 98.69 02:45:01 AM 0 1.17 0.00 0.15 0.00 0.05 98.63 02:45:01 AM 1 1.00 0.00 0.20 0.00 0.03 98.76 02:46:01 AM all 4.88 0.00 0.45 0.00 0.07 94.61 02:46:01 AM 0 1.71 0.00 0.33 0.00 0.07 97.89 02:46:01 AM 1 8.11 0.00 0.56 0.00 0.07 91.26 02:47:01 AM all 0.98 0.00 0.13 0.00 0.05 98.84 02:47:01 AM 0 1.20 0.00 0.17 0.00 0.05 98.58 02:47:01 AM 1 0.75 0.00 0.10 0.00 0.05 99.10 02:48:01 AM all 1.04 0.00 0.12 0.00 0.05 98.79 02:48:01 AM 0 1.30 0.00 0.13 0.00 0.05 98.51 02:48:01 AM 1 0.79 0.00 0.10 0.00 0.05 99.06 02:49:01 AM all 0.96 0.00 0.11 0.00 0.05 98.88 02:49:01 AM 0 0.94 0.00 0.12 0.00 0.05 98.90 02:49:01 AM 1 0.99 0.00 0.10 0.00 0.05 98.86 02:50:01 AM all 0.95 0.00 0.12 0.00 0.04 98.89 02:50:01 AM 0 0.97 0.00 0.13 0.00 0.05 98.85 02:50:01 AM 1 0.94 0.00 0.10 0.00 0.03 98.93 02:50:01 AM CPU %user %nice %system %iowait %steal %idle 02:51:01 AM all 0.99 0.00 0.13 0.00 0.05 98.83 02:51:01 AM 0 1.14 0.00 0.10 0.00 0.03 98.73 02:51:01 AM 1 0.85 0.00 0.15 0.00 0.07 98.93 02:52:01 AM all 1.96 0.00 0.20 0.00 0.05 97.79 02:52:01 AM 0 1.77 0.00 0.18 0.00 0.05 97.99 02:52:01 AM 1 2.15 0.00 0.22 0.00 0.05 97.59 02:53:01 AM all 0.96 0.00 0.16 0.00 0.07 98.81 02:53:01 AM 0 0.80 0.00 0.17 0.00 0.07 98.96 02:53:01 AM 1 1.12 0.00 0.15 0.00 0.07 98.66 02:54:01 AM all 8.19 0.00 0.81 0.00 0.08 90.92 02:54:01 AM 0 2.33 0.00 0.50 0.00 0.07 97.10 02:54:01 AM 1 14.07 0.00 1.11 0.00 0.10 84.72 02:55:01 AM all 3.52 0.00 0.44 0.00 0.05 95.99 02:55:01 AM 0 2.29 0.00 0.32 0.00 0.05 97.34 02:55:01 AM 1 4.75 0.00 0.55 0.00 0.05 94.65 02:56:01 AM all 3.64 0.00 0.50 0.00 0.07 95.79 02:56:01 AM 0 2.93 0.00 0.43 0.00 0.07 96.57 02:56:01 AM 1 4.35 0.00 0.57 0.00 0.07 95.02 02:57:01 AM all 3.90 0.00 0.44 0.00 0.05 95.61 02:57:01 AM 0 4.32 0.00 0.54 0.00 0.05 95.10 02:57:01 AM 1 3.48 0.00 0.35 0.00 0.05 96.11 02:58:01 AM all 2.93 0.00 0.15 0.00 0.06 96.86 02:58:01 AM 0 3.58 0.00 0.15 0.00 0.07 96.21 02:58:01 AM 1 2.29 0.00 0.15 0.00 0.05 97.51 02:59:01 AM all 2.88 0.00 0.15 0.00 0.06 96.91 02:59:01 AM 0 4.23 0.00 0.15 0.00 0.07 95.56 02:59:01 AM 1 1.54 0.00 0.15 0.00 0.05 98.26 03:00:01 AM all 2.83 0.26 0.27 0.13 0.05 96.47 03:00:01 AM 0 2.66 0.00 0.20 0.03 0.05 97.06 03:00:01 AM 1 3.01 0.52 0.33 0.22 0.05 95.87 03:01:01 AM all 2.95 0.00 0.17 0.05 0.05 96.78 03:01:01 AM 0 3.28 0.00 0.15 0.00 0.05 96.52 03:01:01 AM 1 2.62 0.00 0.18 0.10 0.05 97.04 03:01:01 AM CPU %user %nice %system %iowait %steal %idle 03:02:01 AM all 2.83 0.00 0.16 0.00 0.06 96.95 03:02:01 AM 0 3.33 0.00 0.15 0.00 0.07 96.46 03:02:01 AM 1 2.34 0.00 0.17 0.00 0.05 97.44 03:03:01 AM all 2.85 0.00 0.15 0.00 0.06 96.94 03:03:01 AM 0 3.88 0.00 0.13 0.00 0.07 95.92 03:03:01 AM 1 1.82 0.00 0.17 0.00 0.05 97.96 03:04:01 AM all 3.15 0.00 0.18 0.00 0.08 96.58 03:04:01 AM 0 2.33 0.00 0.20 0.00 0.08 97.39 03:04:01 AM 1 3.98 0.00 0.17 0.00 0.08 95.77 03:05:01 AM all 2.77 0.00 0.15 0.00 0.06 97.02 03:05:01 AM 0 4.17 0.00 0.13 0.00 0.07 95.63 03:05:01 AM 1 1.37 0.00 0.17 0.00 0.05 98.41 03:06:01 AM all 2.92 0.00 0.13 0.00 0.07 96.87 03:06:01 AM 0 3.49 0.00 0.13 0.00 0.07 96.31 03:06:01 AM 1 2.36 0.00 0.13 0.00 0.07 97.44 03:07:01 AM all 2.90 0.00 0.16 0.00 0.05 96.89 03:07:01 AM 0 3.41 0.00 0.15 0.00 0.05 96.39 03:07:01 AM 1 2.39 0.00 0.17 0.00 0.05 97.39 03:08:01 AM all 2.77 0.00 0.13 0.00 0.05 97.04 03:08:01 AM 0 2.04 0.00 0.10 0.00 0.05 97.81 03:08:01 AM 1 3.51 0.00 0.17 0.00 0.05 96.27 03:09:01 AM all 2.80 0.00 0.13 0.00 0.05 97.02 03:09:01 AM 0 3.84 0.00 0.12 0.00 0.05 95.99 03:09:01 AM 1 1.76 0.00 0.13 0.00 0.05 98.06 03:10:01 AM all 2.78 0.00 0.15 0.00 0.06 97.01 03:10:01 AM 0 3.17 0.00 0.13 0.00 0.05 96.64 03:10:01 AM 1 2.39 0.00 0.17 0.00 0.07 97.37 03:11:01 AM all 28.78 0.00 2.01 0.00 0.08 69.13 03:11:01 AM 0 40.73 0.00 2.43 0.00 0.08 56.76 03:11:01 AM 1 16.83 0.00 1.59 0.00 0.08 81.50 03:12:01 AM all 22.98 0.00 3.39 0.58 0.08 72.96 03:12:01 AM 0 17.47 0.00 2.95 0.32 0.08 79.17 03:12:01 AM 1 28.49 0.00 3.82 0.85 0.08 66.76 Average: CPU %user %nice %system %iowait %steal %idle Average: all 7.45 0.00 0.73 0.06 0.07 91.69 Average: 0 9.38 0.00 0.82 0.05 0.07 89.67 Average: 1 5.52 0.01 0.63 0.06 0.07 93.71