04:39:30 Started by upstream project "integration-distribution-test-calcium" build number 132 04:39:30 originally caused by: 04:39:30 Started by upstream project "autorelease-release-calcium-mvn38-openjdk17" build number 149 04:39:30 originally caused by: 04:39:30 Started by timer 04:39:30 Running as SYSTEM 04:39:30 [EnvInject] - Loading node environment variables. 04:39:30 Building remotely on prd-centos8-robot-2c-8g-4565 (centos8-robot-2c-8g) in workspace /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-calcium 04:39:30 [ssh-agent] Looking for ssh-agent implementation... 04:39:30 [ssh-agent] Exec ssh-agent (binary ssh-agent on a remote machine) 04:39:30 $ ssh-agent 04:39:30 SSH_AUTH_SOCK=/tmp/ssh-4anDBDGDN74a/agent.5351 04:39:30 SSH_AGENT_PID=5352 04:39:30 [ssh-agent] Started. 04:39:30 Running ssh-add (command line suppressed) 04:39:30 Identity added: /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-calcium@tmp/private_key_17467336635937034612.key (/w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-calcium@tmp/private_key_17467336635937034612.key) 04:39:31 [ssh-agent] Using credentials jenkins (Release Engineering Jenkins Key) 04:39:31 The recommended git tool is: NONE 04:39:33 using credential opendaylight-jenkins-ssh 04:39:33 Wiping out workspace first. 04:39:33 Cloning the remote Git repository 04:39:33 Cloning repository git://devvexx.opendaylight.org/mirror/integration/test 04:39:33 > git init /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-calcium/test # timeout=10 04:39:33 Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test 04:39:33 > git --version # timeout=10 04:39:33 > git --version # 'git version 2.43.0' 04:39:33 using GIT_SSH to set credentials Release Engineering Jenkins Key 04:39:33 [INFO] Currently running in a labeled security context 04:39:33 [INFO] Currently SELinux is 'enforcing' on the host 04:39:33 > /usr/bin/chcon --type=ssh_home_t /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-calcium/test@tmp/jenkins-gitclient-ssh10172081037202453088.key 04:39:33 Verifying host key using known hosts file 04:39:34 You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification. 04:39:34 > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test +refs/heads/*:refs/remotes/origin/* # timeout=10 04:39:36 > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10 04:39:36 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 04:39:36 > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10 04:39:36 Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test 04:39:36 using GIT_SSH to set credentials Release Engineering Jenkins Key 04:39:36 [INFO] Currently running in a labeled security context 04:39:36 [INFO] Currently SELinux is 'enforcing' on the host 04:39:36 > /usr/bin/chcon --type=ssh_home_t /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-calcium/test@tmp/jenkins-gitclient-ssh12773514972784058471.key 04:39:36 Verifying host key using known hosts file 04:39:36 You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification. 04:39:36 > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test master # timeout=10 04:39:37 > git rev-parse FETCH_HEAD^{commit} # timeout=10 04:39:37 Checking out Revision 3e167848278e822e4d409e0cc71d967d06150361 (origin/master) 04:39:37 > git config core.sparsecheckout # timeout=10 04:39:37 > git checkout -f 3e167848278e822e4d409e0cc71d967d06150361 # timeout=10 04:39:37 Commit message: "Remove scriptplans for tsdr" 04:39:37 > git rev-parse FETCH_HEAD^{commit} # timeout=10 04:39:37 > git rev-list --no-walk 83350b8bf5eb6c28e5756f6745044edb96843f07 # timeout=10 04:39:37 No emails were triggered. 04:39:37 provisioning config files... 04:39:37 copy managed file [npmrc] to file:/home/jenkins/.npmrc 04:39:37 copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf 04:39:38 copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml 04:39:38 [openflowplugin-csit-3node-clustering-bulkomatic-only-calcium] $ /bin/bash /tmp/jenkins15986240655110745608.sh 04:39:38 ---> python-tools-install.sh 04:39:38 Setup pyenv: 04:39:38 system 04:39:38 * 3.8.13 (set by /opt/pyenv/version) 04:39:38 * 3.9.13 (set by /opt/pyenv/version) 04:39:38 * 3.10.6 (set by /opt/pyenv/version) 04:39:42 lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-Azlr 04:39:42 lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv 04:39:46 lf-activate-venv(): INFO: Installing: lftools 04:40:26 lf-activate-venv(): INFO: Adding /tmp/venv-Azlr/bin to PATH 04:40:26 Generating Requirements File 04:41:14 Python 3.10.6 04:41:14 pip 24.0 from /tmp/venv-Azlr/lib/python3.10/site-packages/pip (python 3.10) 04:41:15 appdirs==1.4.4 04:41:15 argcomplete==3.2.2 04:41:15 aspy.yaml==1.3.0 04:41:15 attrs==23.2.0 04:41:15 autopage==0.5.2 04:41:15 beautifulsoup4==4.12.3 04:41:15 boto3==1.34.37 04:41:15 botocore==1.34.37 04:41:15 bs4==0.0.2 04:41:15 cachetools==5.3.2 04:41:15 certifi==2024.2.2 04:41:15 cffi==1.16.0 04:41:15 cfgv==3.4.0 04:41:15 chardet==5.2.0 04:41:15 charset-normalizer==3.3.2 04:41:15 click==8.1.7 04:41:15 cliff==4.5.0 04:41:15 cmd2==2.4.3 04:41:15 cryptography==3.3.2 04:41:15 debtcollector==2.5.0 04:41:15 decorator==5.1.1 04:41:15 defusedxml==0.7.1 04:41:15 Deprecated==1.2.14 04:41:15 distlib==0.3.8 04:41:15 dnspython==2.5.0 04:41:15 docker==4.2.2 04:41:15 dogpile.cache==1.3.1 04:41:15 email-validator==2.1.0.post1 04:41:15 filelock==3.13.1 04:41:15 future==0.18.3 04:41:15 gitdb==4.0.11 04:41:15 GitPython==3.1.41 04:41:15 google-auth==2.27.0 04:41:15 httplib2==0.22.0 04:41:15 identify==2.5.33 04:41:15 idna==3.6 04:41:15 importlib-resources==1.5.0 04:41:15 iso8601==2.1.0 04:41:15 Jinja2==3.1.3 04:41:15 jmespath==1.0.1 04:41:15 jsonpatch==1.33 04:41:15 jsonpointer==2.4 04:41:15 jsonschema==4.21.1 04:41:15 jsonschema-specifications==2023.12.1 04:41:15 keystoneauth1==5.5.0 04:41:15 kubernetes==29.0.0 04:41:15 lftools==0.37.8 04:41:15 lxml==5.1.0 04:41:15 MarkupSafe==2.1.5 04:41:15 msgpack==1.0.7 04:41:15 multi_key_dict==2.0.3 04:41:15 munch==4.0.0 04:41:15 netaddr==0.10.1 04:41:15 netifaces==0.11.0 04:41:15 niet==1.4.2 04:41:15 nodeenv==1.8.0 04:41:15 oauth2client==4.1.3 04:41:15 oauthlib==3.2.2 04:41:15 openstacksdk==0.62.0 04:41:15 os-client-config==2.1.0 04:41:15 os-service-types==1.7.0 04:41:15 osc-lib==3.0.0 04:41:15 oslo.config==9.3.0 04:41:15 oslo.context==5.3.0 04:41:15 oslo.i18n==6.2.0 04:41:15 oslo.log==5.4.0 04:41:15 oslo.serialization==5.3.0 04:41:15 oslo.utils==7.0.0 04:41:15 packaging==23.2 04:41:15 pbr==6.0.0 04:41:15 platformdirs==4.2.0 04:41:15 prettytable==3.9.0 04:41:15 pyasn1==0.5.1 04:41:15 pyasn1-modules==0.3.0 04:41:15 pycparser==2.21 04:41:15 pygerrit2==2.0.15 04:41:15 PyGithub==2.2.0 04:41:15 pyinotify==0.9.6 04:41:15 PyJWT==2.8.0 04:41:15 PyNaCl==1.5.0 04:41:15 pyparsing==2.4.7 04:41:15 pyperclip==1.8.2 04:41:15 pyrsistent==0.20.0 04:41:15 python-cinderclient==9.4.0 04:41:15 python-dateutil==2.8.2 04:41:15 python-heatclient==3.4.0 04:41:15 python-jenkins==1.8.2 04:41:15 python-keystoneclient==5.3.0 04:41:15 python-magnumclient==4.3.0 04:41:15 python-novaclient==18.4.0 04:41:15 python-openstackclient==6.0.0 04:41:15 python-swiftclient==4.4.0 04:41:15 pytz==2024.1 04:41:15 PyYAML==6.0.1 04:41:15 referencing==0.33.0 04:41:15 requests==2.31.0 04:41:15 requests-oauthlib==1.3.1 04:41:15 requestsexceptions==1.4.0 04:41:15 rfc3986==2.0.0 04:41:15 rpds-py==0.17.1 04:41:15 rsa==4.9 04:41:15 ruamel.yaml==0.18.6 04:41:15 ruamel.yaml.clib==0.2.8 04:41:15 s3transfer==0.10.0 04:41:15 simplejson==3.19.2 04:41:15 six==1.16.0 04:41:15 smmap==5.0.1 04:41:15 soupsieve==2.5 04:41:15 stevedore==5.1.0 04:41:15 tabulate==0.9.0 04:41:15 toml==0.10.2 04:41:15 tomlkit==0.12.3 04:41:15 tqdm==4.66.1 04:41:15 typing_extensions==4.9.0 04:41:15 tzdata==2023.4 04:41:15 urllib3==1.26.18 04:41:15 virtualenv==20.25.0 04:41:15 wcwidth==0.2.13 04:41:15 websocket-client==1.7.0 04:41:15 wrapt==1.16.0 04:41:15 xdg==6.0.0 04:41:15 xmltodict==0.13.0 04:41:15 yq==3.2.3 04:41:15 [EnvInject] - Injecting environment variables from a build step. 04:41:15 [EnvInject] - Injecting as environment variables the properties content 04:41:15 OS_STACK_TEMPLATE=csit-2-instance-type.yaml 04:41:15 OS_CLOUD=vex 04:41:15 OS_STACK_NAME=releng-openflowplugin-csit-3node-clustering-bulkomatic-only-calcium-132 04:41:15 OS_STACK_TEMPLATE_DIR=openstack-hot 04:41:15 04:41:15 [EnvInject] - Variables injected successfully. 04:41:15 provisioning config files... 04:41:15 copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml 04:41:15 [openflowplugin-csit-3node-clustering-bulkomatic-only-calcium] $ /bin/bash /tmp/jenkins9548445111215939589.sh 04:41:15 ---> Create parameters file for OpenStack HOT 04:41:15 OpenStack Heat parameters generated 04:41:15 ----------------------------------- 04:41:15 parameters: 04:41:15 vm_0_count: '3' 04:41:15 vm_0_flavor: 'v3-standard-4' 04:41:15 vm_0_image: 'ZZCI - CentOS Stream 8 - builder - x86_64 - 20240117-011746.201' 04:41:15 vm_1_count: '1' 04:41:15 vm_1_flavor: 'v3-standard-2' 04:41:15 vm_1_image: 'ZZCI - Ubuntu 18.04 - mininet-ovs-28 - x86_64 - 20230601-180106.003' 04:41:15 04:41:15 job_name: '30393-132' 04:41:15 silo: 'releng' 04:41:15 [openflowplugin-csit-3node-clustering-bulkomatic-only-calcium] $ /bin/bash -l /tmp/jenkins3030911211502708053.sh 04:41:15 ---> Create HEAT stack 04:41:15 + source /home/jenkins/lf-env.sh 04:41:15 + lf-activate-venv --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 04:41:15 ++ mktemp -d /tmp/venv-XXXX 04:41:15 + lf_venv=/tmp/venv-jY1j 04:41:15 + local venv_file=/tmp/.os_lf_venv 04:41:15 + local python=python3 04:41:15 + local options 04:41:15 + local set_path=true 04:41:15 + local install_args= 04:41:15 ++ getopt -o np:v: -l no-path,system-site-packages,python:,venv-file: -n lf-activate-venv -- --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 04:41:15 + options=' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\''' 04:41:15 + eval set -- ' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\''' 04:41:15 ++ set -- --python python3 -- 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 04:41:15 + true 04:41:15 + case $1 in 04:41:15 + python=python3 04:41:15 + shift 2 04:41:15 + true 04:41:15 + case $1 in 04:41:15 + shift 04:41:15 + break 04:41:15 + case $python in 04:41:15 + local pkg_list= 04:41:15 + [[ -d /opt/pyenv ]] 04:41:15 + echo 'Setup pyenv:' 04:41:15 Setup pyenv: 04:41:15 + export PYENV_ROOT=/opt/pyenv 04:41:15 + PYENV_ROOT=/opt/pyenv 04:41:15 + export PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin 04:41:15 + PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin 04:41:15 + pyenv versions 04:41:15 system 04:41:15 3.8.13 04:41:15 3.9.13 04:41:15 * 3.10.6 (set by /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-calcium/.python-version) 04:41:15 + command -v pyenv 04:41:15 ++ pyenv init - --no-rehash 04:41:15 + eval 'PATH="$(bash --norc -ec '\''IFS=:; paths=($PATH); for i in ${!paths[@]}; do if [[ ${paths[i]} == "'\''/opt/pyenv/shims'\''" ]]; then unset '\''\'\'''\''paths[i]'\''\'\'''\''; fi; done; echo "${paths[*]}"'\'')" 04:41:15 export PATH="/opt/pyenv/shims:${PATH}" 04:41:15 export PYENV_SHELL=bash 04:41:15 source '\''/opt/pyenv/libexec/../completions/pyenv.bash'\'' 04:41:15 pyenv() { 04:41:15 local command 04:41:15 command="${1:-}" 04:41:15 if [ "$#" -gt 0 ]; then 04:41:15 shift 04:41:15 fi 04:41:15 04:41:15 case "$command" in 04:41:15 rehash|shell) 04:41:15 eval "$(pyenv "sh-$command" "$@")" 04:41:15 ;; 04:41:15 *) 04:41:15 command pyenv "$command" "$@" 04:41:15 ;; 04:41:15 esac 04:41:15 }' 04:41:15 +++ bash --norc -ec 'IFS=:; paths=($PATH); for i in ${!paths[@]}; do if [[ ${paths[i]} == "/opt/pyenv/shims" ]]; then unset '\''paths[i]'\''; fi; done; echo "${paths[*]}"' 04:41:15 ++ PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin 04:41:15 ++ export PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin 04:41:15 ++ PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin 04:41:15 ++ export PYENV_SHELL=bash 04:41:15 ++ PYENV_SHELL=bash 04:41:15 ++ source /opt/pyenv/libexec/../completions/pyenv.bash 04:41:15 +++ complete -F _pyenv pyenv 04:41:15 ++ lf-pyver python3 04:41:15 ++ local py_version_xy=python3 04:41:15 ++ local py_version_xyz= 04:41:15 ++ pyenv versions 04:41:15 ++ local command 04:41:15 ++ command=versions 04:41:15 ++ '[' 1 -gt 0 ']' 04:41:15 ++ shift 04:41:15 ++ case "$command" in 04:41:15 ++ command pyenv versions 04:41:15 ++ pyenv versions 04:41:15 ++ sed 's/^[ *]* //' 04:41:15 ++ awk '{ print $1 }' 04:41:15 ++ grep -E '^[0-9.]*[0-9]$' 04:41:15 ++ [[ ! -s /tmp/.pyenv_versions ]] 04:41:15 +++ tail -n 1 04:41:15 +++ grep '^3' /tmp/.pyenv_versions 04:41:15 +++ sort -V 04:41:15 ++ py_version_xyz=3.10.6 04:41:15 ++ [[ -z 3.10.6 ]] 04:41:15 ++ echo 3.10.6 04:41:15 ++ return 0 04:41:15 + pyenv local 3.10.6 04:41:15 + local command 04:41:15 + command=local 04:41:15 + '[' 2 -gt 0 ']' 04:41:15 + shift 04:41:15 + case "$command" in 04:41:15 + command pyenv local 3.10.6 04:41:15 + pyenv local 3.10.6 04:41:15 + for arg in "$@" 04:41:15 + case $arg in 04:41:15 + pkg_list+='lftools[openstack] ' 04:41:15 + for arg in "$@" 04:41:15 + case $arg in 04:41:15 + pkg_list+='kubernetes ' 04:41:15 + for arg in "$@" 04:41:15 + case $arg in 04:41:15 + pkg_list+='niet ' 04:41:15 + for arg in "$@" 04:41:15 + case $arg in 04:41:15 + pkg_list+='python-heatclient ' 04:41:15 + for arg in "$@" 04:41:15 + case $arg in 04:41:15 + pkg_list+='python-openstackclient ' 04:41:15 + for arg in "$@" 04:41:15 + case $arg in 04:41:15 + pkg_list+='python-magnumclient ' 04:41:15 + for arg in "$@" 04:41:15 + case $arg in 04:41:15 + pkg_list+='yq ' 04:41:15 + [[ -f /tmp/.os_lf_venv ]] 04:41:15 ++ cat /tmp/.os_lf_venv 04:41:15 + lf_venv=/tmp/venv-Azlr 04:41:15 + echo 'lf-activate-venv(): INFO: Reuse venv:/tmp/venv-Azlr from' file:/tmp/.os_lf_venv 04:41:15 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-Azlr from file:/tmp/.os_lf_venv 04:41:15 + /tmp/venv-Azlr/bin/python3 -m pip install --upgrade --quiet pip virtualenv 04:41:17 + [[ -z lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq ]] 04:41:17 + echo 'lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq ' 04:41:17 lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 04:41:17 + /tmp/venv-Azlr/bin/python3 -m pip install --upgrade --quiet --upgrade-strategy eager 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 04:41:35 + type python3 04:41:35 + true 04:41:35 + echo 'lf-activate-venv(): INFO: Adding /tmp/venv-Azlr/bin to PATH' 04:41:35 lf-activate-venv(): INFO: Adding /tmp/venv-Azlr/bin to PATH 04:41:35 + PATH=/tmp/venv-Azlr/bin:/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin 04:41:35 + return 0 04:41:35 + openstack --os-cloud vex limits show --absolute 04:41:37 +--------------------------+---------+ 04:41:37 | Name | Value | 04:41:37 +--------------------------+---------+ 04:41:37 | maxTotalInstances | -1 | 04:41:37 | maxTotalCores | 450 | 04:41:37 | maxTotalRAMSize | 1000000 | 04:41:37 | maxServerMeta | 128 | 04:41:37 | maxImageMeta | 128 | 04:41:37 | maxPersonality | 5 | 04:41:37 | maxPersonalitySize | 10240 | 04:41:37 | maxTotalKeypairs | 100 | 04:41:37 | maxServerGroups | 10 | 04:41:37 | maxServerGroupMembers | 10 | 04:41:37 | maxTotalFloatingIps | -1 | 04:41:37 | maxSecurityGroups | -1 | 04:41:37 | maxSecurityGroupRules | -1 | 04:41:37 | totalRAMUsed | 606208 | 04:41:37 | totalCoresUsed | 148 | 04:41:37 | totalInstancesUsed | 49 | 04:41:37 | totalFloatingIpsUsed | 0 | 04:41:37 | totalSecurityGroupsUsed | 0 | 04:41:37 | totalServerGroupsUsed | 0 | 04:41:37 | maxTotalVolumes | -1 | 04:41:37 | maxTotalSnapshots | 10 | 04:41:37 | maxTotalVolumeGigabytes | 4096 | 04:41:37 | maxTotalBackups | 10 | 04:41:37 | maxTotalBackupGigabytes | 1000 | 04:41:37 | totalVolumesUsed | 0 | 04:41:37 | totalGigabytesUsed | 0 | 04:41:37 | totalSnapshotsUsed | 0 | 04:41:37 | totalBackupsUsed | 0 | 04:41:37 | totalBackupGigabytesUsed | 0 | 04:41:37 +--------------------------+---------+ 04:41:37 + pushd /opt/ciman/openstack-hot 04:41:37 /opt/ciman/openstack-hot /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-calcium 04:41:37 + lftools openstack --os-cloud vex stack create releng-openflowplugin-csit-3node-clustering-bulkomatic-only-calcium-132 csit-2-instance-type.yaml /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-calcium/stack-parameters.yaml 04:42:04 Creating stack releng-openflowplugin-csit-3node-clustering-bulkomatic-only-calcium-132 04:42:04 Waiting to initialize infrastructure... 04:42:04 Stack initialization successful. 04:42:04 ------------------------------------ 04:42:04 Stack Details 04:42:04 ------------------------------------ 04:42:04 {'added': None, 04:42:04 'capabilities': [], 04:42:04 'created_at': '2024-02-08T04:41:40Z', 04:42:04 'deleted': None, 04:42:04 'deleted_at': None, 04:42:04 'description': 'No description', 04:42:04 'environment': None, 04:42:04 'environment_files': None, 04:42:04 'files': None, 04:42:04 'files_container': None, 04:42:04 'id': '82cb9ae6-55c9-4345-b224-c466f5e3f80c', 04:42:04 'is_rollback_disabled': True, 04:42:04 'links': [{'href': 'https://orchestration.public.mtl1.vexxhost.net/v1/12c36e260d8e4bb2913965203b1b491f/stacks/releng-openflowplugin-csit-3node-clustering-bulkomatic-only-calcium-132/82cb9ae6-55c9-4345-b224-c466f5e3f80c', 04:42:04 'rel': 'self'}], 04:42:04 'location': Munch({'cloud': 'vex', 'region_name': 'ca-ymq-1', 'zone': None, 'project': Munch({'id': '12c36e260d8e4bb2913965203b1b491f', 'name': '61975f2c-7c17-4d69-82fa-c3ae420ad6fd', 'domain_id': None, 'domain_name': 'Default'})}), 04:42:04 'name': 'releng-openflowplugin-csit-3node-clustering-bulkomatic-only-calcium-132', 04:42:04 'notification_topics': [], 04:42:04 'outputs': [{'description': 'IP addresses of the 1st vm types', 04:42:04 'output_key': 'vm_0_ips', 04:42:04 'output_value': ['10.30.170.215', 04:42:04 '10.30.171.16', 04:42:04 '10.30.170.254']}, 04:42:04 {'description': 'IP addresses of the 2nd vm types', 04:42:04 'output_key': 'vm_1_ips', 04:42:04 'output_value': ['10.30.171.163']}], 04:42:04 'owner_id': ****, 04:42:04 'parameters': {'OS::project_id': '12c36e260d8e4bb2913965203b1b491f', 04:42:04 'OS::stack_id': '82cb9ae6-55c9-4345-b224-c466f5e3f80c', 04:42:04 'OS::stack_name': 'releng-openflowplugin-csit-3node-clustering-bulkomatic-only-calcium-132', 04:42:04 'job_name': '30393-132', 04:42:04 'silo': 'releng', 04:42:04 'vm_0_count': '3', 04:42:04 'vm_0_flavor': 'v3-standard-4', 04:42:04 'vm_0_image': 'ZZCI - CentOS Stream 8 - builder - x86_64 - ' 04:42:04 '20240117-011746.201', 04:42:04 'vm_1_count': '1', 04:42:04 'vm_1_flavor': 'v3-standard-2', 04:42:04 'vm_1_image': 'ZZCI - Ubuntu 18.04 - mininet-ovs-28 - x86_64 - ' 04:42:04 '20230601-180106.003'}, 04:42:04 'parent_id': None, 04:42:04 'replaced': None, 04:42:04 'status': 'CREATE_COMPLETE', 04:42:04 'status_reason': 'Stack CREATE completed successfully', 04:42:04 'tags': [], 04:42:04 'template': None, 04:42:04 'template_description': 'No description', 04:42:04 'template_url': None, 04:42:04 'timeout_mins': 15, 04:42:04 'unchanged': None, 04:42:04 'updated': None, 04:42:04 'updated_at': None, 04:42:04 'user_project_id': 'c57e29892bf3408e84b1c8896ee957d9'} 04:42:04 ------------------------------------ 04:42:04 + popd 04:42:04 /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-calcium 04:42:04 [openflowplugin-csit-3node-clustering-bulkomatic-only-calcium] $ /bin/bash -l /tmp/jenkins14382605934677969359.sh 04:42:04 ---> Copy SSH public keys to CSIT lab 04:42:04 Setup pyenv: 04:42:04 system 04:42:04 3.8.13 04:42:04 3.9.13 04:42:04 * 3.10.6 (set by /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-calcium/.python-version) 04:42:04 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-Azlr from file:/tmp/.os_lf_venv 04:42:06 lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes python-heatclient python-openstackclient 04:42:21 lf-activate-venv(): INFO: Adding /tmp/venv-Azlr/bin to PATH 04:42:21 SSH not responding on 10.30.171.16. Retrying in 10 seconds... 04:42:22 SSH not responding on 10.30.171.163. Retrying in 10 seconds... 04:42:22 SSH not responding on 10.30.170.254. Retrying in 10 seconds... 04:42:22 SSH not responding on 10.30.170.215. Retrying in 10 seconds... 04:42:31 Ping to 10.30.171.16 successful. 04:42:32 Ping to 10.30.171.163 successful. 04:42:32 SSH not responding on 10.30.171.16. Retrying in 10 seconds... 04:42:32 Ping to 10.30.170.215 successful. 04:42:32 Ping to 10.30.170.254 successful. 04:42:32 SSH not responding on 10.30.170.254. Retrying in 10 seconds... 04:42:33 SSH not responding on 10.30.170.215. Retrying in 10 seconds... 04:42:34 Warning: Permanently added '10.30.171.163' (ECDSA) to the list of known hosts. 04:42:35 releng-30393-132-1-mininet-ovs-28-0 04:42:35 Successfully copied public keys to slave 10.30.171.163 04:42:42 Ping to 10.30.171.16 successful. 04:42:42 SSH not responding on 10.30.171.16. Retrying in 10 seconds... 04:42:42 Ping to 10.30.170.254 successful. 04:42:43 Ping to 10.30.170.215 successful. 04:42:43 SSH not responding on 10.30.170.254. Retrying in 10 seconds... 04:42:43 SSH not responding on 10.30.170.215. Retrying in 10 seconds... 04:42:52 Ping to 10.30.171.16 successful. 04:42:53 Ping to 10.30.170.254 successful. 04:42:53 Warning: Permanently added '10.30.171.16' (ECDSA) to the list of known hosts. 04:42:53 Ping to 10.30.170.215 successful. 04:42:53 Warning: Permanently added '10.30.170.254' (ECDSA) to the list of known hosts. 04:42:53 10.30.171.16 releng-30393-132-0-builder-1.novalocal 04:42:53 Successfully copied public keys to slave 10.30.171.16 04:42:54 Warning: Permanently added '10.30.170.215' (ECDSA) to the list of known hosts. 04:42:54 10.30.170.254 releng-30393-132-0-builder-2.novalocal 04:42:54 Successfully copied public keys to slave 10.30.170.254 04:42:54 10.30.170.215 releng-30393-132-0-builder-0.novalocal 04:42:54 Successfully copied public keys to slave 10.30.170.215 04:42:54 Process 6490 ready. 04:42:54 Process 6491 ready. 04:42:54 Process 6493 ready. 04:42:54 Process 6494 ready. 04:42:54 SSH ready on all stack servers. 04:42:54 [openflowplugin-csit-3node-clustering-bulkomatic-only-calcium] $ /bin/bash -l /tmp/jenkins778968203410843987.sh 04:42:54 Setup pyenv: 04:42:54 system 04:42:54 3.8.13 04:42:54 3.9.13 04:42:54 * 3.10.6 (set by /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-calcium/.python-version) 04:42:58 lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-F1Iu 04:42:58 lf-activate-venv(): INFO: Save venv in file: /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-calcium/.robot_venv 04:43:02 lf-activate-venv(): INFO: Installing: setuptools wheel 04:43:04 lf-activate-venv(): INFO: Adding /tmp/venv-F1Iu/bin to PATH 04:43:04 + echo 'Installing Python Requirements' 04:43:04 Installing Python Requirements 04:43:04 + cat 04:43:04 + python -m pip install -r requirements.txt 04:43:04 Looking in indexes: https://nexus3.opendaylight.org/repository/PyPi/simple 04:43:04 Collecting docker-py (from -r requirements.txt (line 1)) 04:43:04 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/docker-py/1.10.6/docker_py-1.10.6-py2.py3-none-any.whl (50 kB) 04:43:04 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 50.0/50.0 kB 10.5 MB/s eta 0:00:00 04:43:04 Collecting ipaddr (from -r requirements.txt (line 2)) 04:43:04 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/ipaddr/2.2.0/ipaddr-2.2.0.tar.gz (26 kB) 04:43:04 Preparing metadata (setup.py): started 04:43:04 Preparing metadata (setup.py): finished with status 'done' 04:43:04 Collecting netaddr (from -r requirements.txt (line 3)) 04:43:04 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/netaddr/0.10.1/netaddr-0.10.1-py2.py3-none-any.whl (2.2 MB) 04:43:04 Collecting netifaces (from -r requirements.txt (line 4)) 04:43:04 Using cached netifaces-0.11.0-cp310-cp310-linux_x86_64.whl 04:43:04 Collecting pyhocon (from -r requirements.txt (line 5)) 04:43:04 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyhocon/0.3.60/pyhocon-0.3.60.tar.gz (158 kB) 04:43:04 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 158.8/158.8 kB 12.6 MB/s eta 0:00:00 04:43:04 Preparing metadata (setup.py): started 04:43:05 Preparing metadata (setup.py): finished with status 'done' 04:43:05 Collecting requests (from -r requirements.txt (line 6)) 04:43:05 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/requests/2.31.0/requests-2.31.0-py3-none-any.whl (62 kB) 04:43:05 Collecting robotframework (from -r requirements.txt (line 7)) 04:43:05 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework/7.0/robotframework-7.0-py3-none-any.whl (726 kB) 04:43:05 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 726.3/726.3 kB 16.2 MB/s eta 0:00:00 04:43:05 Collecting robotframework-httplibrary (from -r requirements.txt (line 8)) 04:43:05 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-httplibrary/0.4.2/robotframework-httplibrary-0.4.2.tar.gz (9.1 kB) 04:43:05 Preparing metadata (setup.py): started 04:43:05 Preparing metadata (setup.py): finished with status 'done' 04:43:05 Collecting robotframework-requests==0.9.3 (from -r requirements.txt (line 9)) 04:43:05 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-requests/0.9.3/robotframework_requests-0.9.3-py3-none-any.whl (21 kB) 04:43:05 Collecting robotframework-selenium2library (from -r requirements.txt (line 10)) 04:43:05 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-selenium2library/3.0.0/robotframework_selenium2library-3.0.0-py2.py3-none-any.whl (6.2 kB) 04:43:05 Collecting robotframework-sshlibrary==3.8.0 (from -r requirements.txt (line 11)) 04:43:05 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-sshlibrary/3.8.0/robotframework-sshlibrary-3.8.0.tar.gz (51 kB) 04:43:05 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 51.4/51.4 kB 8.7 MB/s eta 0:00:00 04:43:05 Preparing metadata (setup.py): started 04:43:06 Preparing metadata (setup.py): finished with status 'done' 04:43:06 Collecting scapy (from -r requirements.txt (line 12)) 04:43:06 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/scapy/2.5.0/scapy-2.5.0.tar.gz (1.3 MB) 04:43:06 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.3/1.3 MB 16.2 MB/s eta 0:00:00 04:43:06 Preparing metadata (setup.py): started 04:43:06 Preparing metadata (setup.py): finished with status 'done' 04:43:06 Collecting jsonpath-rw (from -r requirements.txt (line 15)) 04:43:06 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpath-rw/1.4.0/jsonpath-rw-1.4.0.tar.gz (13 kB) 04:43:06 Preparing metadata (setup.py): started 04:43:06 Preparing metadata (setup.py): finished with status 'done' 04:43:06 Collecting elasticsearch (from -r requirements.txt (line 18)) 04:43:07 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch/8.12.0/elasticsearch-8.12.0-py3-none-any.whl (431 kB) 04:43:07 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 431.9/431.9 kB 11.3 MB/s eta 0:00:00 04:43:07 Collecting elasticsearch-dsl (from -r requirements.txt (line 19)) 04:43:07 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch-dsl/8.12.0/elasticsearch_dsl-8.12.0-py3-none-any.whl (63 kB) 04:43:07 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 64.0/64.0 kB 13.9 MB/s eta 0:00:00 04:43:07 Collecting pyangbind (from -r requirements.txt (line 22)) 04:43:07 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyangbind/0.8.4.post1/pyangbind-0.8.4.post1-py3-none-any.whl (52 kB) 04:43:07 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 52.8/52.8 kB 3.2 MB/s eta 0:00:00 04:43:07 Collecting isodate (from -r requirements.txt (line 25)) 04:43:07 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/isodate/0.6.1/isodate-0.6.1-py2.py3-none-any.whl (41 kB) 04:43:07 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 41.7/41.7 kB 4.4 MB/s eta 0:00:00 04:43:07 Collecting jmespath (from -r requirements.txt (line 28)) 04:43:07 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jmespath/1.0.1/jmespath-1.0.1-py3-none-any.whl (20 kB) 04:43:07 Collecting jsonpatch (from -r requirements.txt (line 31)) 04:43:07 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpatch/1.33/jsonpatch-1.33-py2.py3-none-any.whl (12 kB) 04:43:07 Collecting paramiko>=1.15.3 (from robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) 04:43:07 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/paramiko/3.4.0/paramiko-3.4.0-py3-none-any.whl (225 kB) 04:43:07 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 225.9/225.9 kB 31.4 MB/s eta 0:00:00 04:43:07 Collecting scp>=0.13.0 (from robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) 04:43:07 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/scp/0.14.5/scp-0.14.5-py2.py3-none-any.whl (8.7 kB) 04:43:07 Collecting docker-pycreds>=0.2.1 (from docker-py->-r requirements.txt (line 1)) 04:43:07 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/docker-pycreds/0.4.0/docker_pycreds-0.4.0-py2.py3-none-any.whl (9.0 kB) 04:43:07 Collecting six>=1.4.0 (from docker-py->-r requirements.txt (line 1)) 04:43:07 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/six/1.16.0/six-1.16.0-py2.py3-none-any.whl (11 kB) 04:43:07 Collecting websocket-client>=0.32.0 (from docker-py->-r requirements.txt (line 1)) 04:43:07 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/websocket-client/1.7.0/websocket_client-1.7.0-py3-none-any.whl (58 kB) 04:43:07 Collecting pyparsing<4,>=2 (from pyhocon->-r requirements.txt (line 5)) 04:43:07 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pyparsing/3.1.1/pyparsing-3.1.1-py3-none-any.whl (103 kB) 04:43:08 Collecting charset-normalizer<4,>=2 (from requests->-r requirements.txt (line 6)) 04:43:08 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/charset-normalizer/3.3.2/charset_normalizer-3.3.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (142 kB) 04:43:08 Collecting idna<4,>=2.5 (from requests->-r requirements.txt (line 6)) 04:43:08 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/idna/3.6/idna-3.6-py3-none-any.whl (61 kB) 04:43:08 Collecting urllib3<3,>=1.21.1 (from requests->-r requirements.txt (line 6)) 04:43:08 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/urllib3/2.2.0/urllib3-2.2.0-py3-none-any.whl (120 kB) 04:43:08 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 120.9/120.9 kB 16.0 MB/s eta 0:00:00 04:43:08 Collecting certifi>=2017.4.17 (from requests->-r requirements.txt (line 6)) 04:43:08 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/certifi/2024.2.2/certifi-2024.2.2-py3-none-any.whl (163 kB) 04:43:08 Collecting webtest>=2.0 (from robotframework-httplibrary->-r requirements.txt (line 8)) 04:43:08 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/webtest/3.0.0/WebTest-3.0.0-py3-none-any.whl (31 kB) 04:43:08 Collecting jsonpointer (from robotframework-httplibrary->-r requirements.txt (line 8)) 04:43:08 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpointer/2.4/jsonpointer-2.4-py2.py3-none-any.whl (7.8 kB) 04:43:08 Collecting robotframework-seleniumlibrary>=3.0.0 (from robotframework-selenium2library->-r requirements.txt (line 10)) 04:43:08 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-seleniumlibrary/6.2.0/robotframework_seleniumlibrary-6.2.0-py2.py3-none-any.whl (95 kB) 04:43:08 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 95.5/95.5 kB 5.2 MB/s eta 0:00:00 04:43:08 Collecting ply (from jsonpath-rw->-r requirements.txt (line 15)) 04:43:08 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/ply/3.11/ply-3.11-py2.py3-none-any.whl (49 kB) 04:43:08 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 49.6/49.6 kB 5.2 MB/s eta 0:00:00 04:43:08 Collecting decorator (from jsonpath-rw->-r requirements.txt (line 15)) 04:43:08 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/decorator/5.1.1/decorator-5.1.1-py3-none-any.whl (9.1 kB) 04:43:08 Collecting elastic-transport<9,>=8 (from elasticsearch->-r requirements.txt (line 18)) 04:43:08 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elastic-transport/8.12.0/elastic_transport-8.12.0-py3-none-any.whl (59 kB) 04:43:08 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 59.9/59.9 kB 13.6 MB/s eta 0:00:00 04:43:08 Collecting python-dateutil (from elasticsearch-dsl->-r requirements.txt (line 19)) 04:43:08 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/python-dateutil/2.8.2/python_dateutil-2.8.2-py2.py3-none-any.whl (247 kB) 04:43:08 Collecting pyang (from pyangbind->-r requirements.txt (line 22)) 04:43:08 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyang/2.6.0/pyang-2.6.0-py2.py3-none-any.whl (594 kB) 04:43:08 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 594.1/594.1 kB 14.1 MB/s eta 0:00:00 04:43:09 Collecting lxml (from pyangbind->-r requirements.txt (line 22)) 04:43:09 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/lxml/5.1.0/lxml-5.1.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (8.0 MB) 04:43:09 Collecting regex (from pyangbind->-r requirements.txt (line 22)) 04:43:10 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/regex/2023.12.25/regex-2023.12.25-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (773 kB) 04:43:11 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 774.0/774.0 kB 1.3 MB/s eta 0:00:00 04:43:11 Collecting enum34 (from pyangbind->-r requirements.txt (line 22)) 04:43:11 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/enum34/1.1.10/enum34-1.1.10-py3-none-any.whl (11 kB) 04:43:11 Collecting bcrypt>=3.2 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) 04:43:11 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/bcrypt/4.1.2/bcrypt-4.1.2-cp39-abi3-manylinux_2_28_x86_64.whl (698 kB) 04:43:11 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 698.9/698.9 kB 17.6 MB/s eta 0:00:00 04:43:12 Collecting cryptography>=3.3 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) 04:43:12 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/cryptography/42.0.2/cryptography-42.0.2-cp39-abi3-manylinux_2_28_x86_64.whl (4.7 MB) 04:43:12 Collecting pynacl>=1.5 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) 04:43:12 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pynacl/1.5.0/PyNaCl-1.5.0-cp36-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.manylinux_2_24_x86_64.whl (856 kB) 04:43:12 Collecting selenium>=4.3.0 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) 04:43:12 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/selenium/4.17.2/selenium-4.17.2-py3-none-any.whl (9.9 MB) 04:43:12 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 9.9/9.9 MB 34.1 MB/s eta 0:00:00 04:43:12 Collecting robotframework-pythonlibcore>=3.0.0 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) 04:43:12 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-pythonlibcore/4.3.0/robotframework_pythonlibcore-4.3.0-py2.py3-none-any.whl (10 kB) 04:43:12 Collecting WebOb>=1.2 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8)) 04:43:12 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/webob/1.8.7/WebOb-1.8.7-py2.py3-none-any.whl (114 kB) 04:43:13 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 115.0/115.0 kB 1.2 MB/s eta 0:00:00 04:43:13 Collecting waitress>=0.8.5 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8)) 04:43:13 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/waitress/3.0.0/waitress-3.0.0-py3-none-any.whl (56 kB) 04:43:13 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 56.7/56.7 kB 7.0 MB/s eta 0:00:00 04:43:13 Collecting beautifulsoup4 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8)) 04:43:13 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/beautifulsoup4/4.12.3/beautifulsoup4-4.12.3-py3-none-any.whl (147 kB) 04:43:13 Collecting cffi>=1.12 (from cryptography>=3.3->paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) 04:43:13 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/cffi/1.16.0/cffi-1.16.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (443 kB) 04:43:13 Collecting trio~=0.17 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) 04:43:13 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/trio/0.24.0/trio-0.24.0-py3-none-any.whl (460 kB) 04:43:13 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 460.2/460.2 kB 10.5 MB/s eta 0:00:00 04:43:13 Collecting trio-websocket~=0.9 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) 04:43:13 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/trio-websocket/0.11.1/trio_websocket-0.11.1-py3-none-any.whl (17 kB) 04:43:13 Collecting typing_extensions>=4.9.0 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) 04:43:13 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/typing-extensions/4.9.0/typing_extensions-4.9.0-py3-none-any.whl (32 kB) 04:43:13 Collecting soupsieve>1.2 (from beautifulsoup4->webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8)) 04:43:13 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/soupsieve/2.5/soupsieve-2.5-py3-none-any.whl (36 kB) 04:43:13 Collecting pycparser (from cffi>=1.12->cryptography>=3.3->paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) 04:43:13 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pycparser/2.21/pycparser-2.21-py2.py3-none-any.whl (118 kB) 04:43:14 Collecting attrs>=20.1.0 (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) 04:43:14 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/attrs/23.2.0/attrs-23.2.0-py3-none-any.whl (60 kB) 04:43:14 Collecting sortedcontainers (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) 04:43:14 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/sortedcontainers/2.4.0/sortedcontainers-2.4.0-py2.py3-none-any.whl (29 kB) 04:43:14 Collecting outcome (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) 04:43:14 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/outcome/1.3.0.post0/outcome-1.3.0.post0-py2.py3-none-any.whl (10 kB) 04:43:14 Collecting sniffio>=1.3.0 (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) 04:43:14 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/sniffio/1.3.0/sniffio-1.3.0-py3-none-any.whl (10 kB) 04:43:14 Collecting exceptiongroup (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) 04:43:14 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/exceptiongroup/1.2.0/exceptiongroup-1.2.0-py3-none-any.whl (16 kB) 04:43:14 Collecting wsproto>=0.14 (from trio-websocket~=0.9->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) 04:43:14 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/wsproto/1.2.0/wsproto-1.2.0-py3-none-any.whl (24 kB) 04:43:14 Collecting pysocks!=1.5.7,<2.0,>=1.5.6 (from urllib3[socks]<3,>=1.26->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) 04:43:14 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pysocks/1.7.1/PySocks-1.7.1-py3-none-any.whl (16 kB) 04:43:14 Collecting h11<1,>=0.9.0 (from wsproto>=0.14->trio-websocket~=0.9->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) 04:43:14 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/h11/0.14.0/h11-0.14.0-py3-none-any.whl (58 kB) 04:43:14 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 58.3/58.3 kB 13.2 MB/s eta 0:00:00 04:43:14 Building wheels for collected packages: robotframework-sshlibrary, ipaddr, pyhocon, robotframework-httplibrary, scapy, jsonpath-rw 04:43:14 Building wheel for robotframework-sshlibrary (setup.py): started 04:43:14 Building wheel for robotframework-sshlibrary (setup.py): finished with status 'done' 04:43:14 Created wheel for robotframework-sshlibrary: filename=robotframework_sshlibrary-3.8.0-py3-none-any.whl size=55116 sha256=a3a5d06c2057635b31ef98afa8d0782f28c2560b469cd020f9146f99be20026e 04:43:14 Stored in directory: /home/jenkins/.cache/pip/wheels/4f/7c/b3/1dfc58277260e643335754e93ea5854bc7ba3d181575a9cea9 04:43:14 Building wheel for ipaddr (setup.py): started 04:43:15 Building wheel for ipaddr (setup.py): finished with status 'done' 04:43:15 Created wheel for ipaddr: filename=ipaddr-2.2.0-py3-none-any.whl size=18282 sha256=8f8050511d305a82c35a889dc9ab0681b51f0fc545677ff322087b34e565e7cb 04:43:15 Stored in directory: /home/jenkins/.cache/pip/wheels/b5/7c/08/e4a91c0b38d5ae5fea76fbb9b60ce1b5f5f8d6e69cbe801870 04:43:15 Building wheel for pyhocon (setup.py): started 04:43:15 Building wheel for pyhocon (setup.py): finished with status 'done' 04:43:15 Created wheel for pyhocon: filename=pyhocon-0.3.60-py3-none-any.whl size=20864 sha256=3ed8c75b273f9f0c265d6a0ea8ea69372f476d65f5ba8a48539567477e1a4e4e 04:43:15 Stored in directory: /home/jenkins/.cache/pip/wheels/7e/3f/4f/66e113a4b8eca7d8ff120a7fcfb53be15fc5078eb353482440 04:43:15 Building wheel for robotframework-httplibrary (setup.py): started 04:43:15 Building wheel for robotframework-httplibrary (setup.py): finished with status 'done' 04:43:15 Created wheel for robotframework-httplibrary: filename=robotframework_httplibrary-0.4.2-py3-none-any.whl size=9954 sha256=dc1d1db849d09565fe905e8ae09a7789719d861a840174d3a4718ccb0843b6a9 04:43:15 Stored in directory: /home/jenkins/.cache/pip/wheels/2e/b8/87/b9b31f375281dd80f51ca94affc6e39f3e45d192e1e1f95553 04:43:15 Building wheel for scapy (setup.py): started 04:43:16 Building wheel for scapy (setup.py): finished with status 'done' 04:43:16 Created wheel for scapy: filename=scapy-2.5.0-py2.py3-none-any.whl size=1444328 sha256=b4deef2754608b680dc1a5d2ea61c19ed5bd655142156293c9f159fdff2ab045 04:43:16 Stored in directory: /home/jenkins/.cache/pip/wheels/8e/0a/14/42ef36f95fd1fbf75090db30f0cbb4ad4186b84b7a3d10dfcb 04:43:16 Building wheel for jsonpath-rw (setup.py): started 04:43:16 Building wheel for jsonpath-rw (setup.py): finished with status 'done' 04:43:16 Created wheel for jsonpath-rw: filename=jsonpath_rw-1.4.0-py3-none-any.whl size=15127 sha256=4683cd1ac3b7920a28f65f281a9a5e97460b7a0eb793ef893a235240689ca1a3 04:43:16 Stored in directory: /home/jenkins/.cache/pip/wheels/22/71/20/0f098fcfc9905114ba8ed62f4b7f9b66ef9a017f99d918fc12 04:43:16 Successfully built robotframework-sshlibrary ipaddr pyhocon robotframework-httplibrary scapy jsonpath-rw 04:43:17 Installing collected packages: sortedcontainers, ply, netifaces, netaddr, ipaddr, enum34, websocket-client, WebOb, waitress, urllib3, typing_extensions, soupsieve, sniffio, six, scapy, robotframework-pythonlibcore, robotframework, regex, pysocks, pyparsing, pycparser, lxml, jsonpointer, jmespath, idna, h11, exceptiongroup, decorator, charset-normalizer, certifi, bcrypt, attrs, wsproto, requests, python-dateutil, pyhocon, pyang, outcome, jsonpath-rw, jsonpatch, isodate, elastic-transport, docker-pycreds, cffi, beautifulsoup4, webtest, trio, robotframework-requests, pynacl, pyangbind, elasticsearch, docker-py, cryptography, trio-websocket, robotframework-httplibrary, paramiko, elasticsearch-dsl, selenium, scp, robotframework-sshlibrary, robotframework-seleniumlibrary, robotframework-selenium2library 04:43:26 Successfully installed WebOb-1.8.7 attrs-23.2.0 bcrypt-4.1.2 beautifulsoup4-4.12.3 certifi-2024.2.2 cffi-1.16.0 charset-normalizer-3.3.2 cryptography-42.0.2 decorator-5.1.1 docker-py-1.10.6 docker-pycreds-0.4.0 elastic-transport-8.12.0 elasticsearch-8.12.0 elasticsearch-dsl-8.12.0 enum34-1.1.10 exceptiongroup-1.2.0 h11-0.14.0 idna-3.6 ipaddr-2.2.0 isodate-0.6.1 jmespath-1.0.1 jsonpatch-1.33 jsonpath-rw-1.4.0 jsonpointer-2.4 lxml-5.1.0 netaddr-0.10.1 netifaces-0.11.0 outcome-1.3.0.post0 paramiko-3.4.0 ply-3.11 pyang-2.6.0 pyangbind-0.8.4.post1 pycparser-2.21 pyhocon-0.3.60 pynacl-1.5.0 pyparsing-3.1.1 pysocks-1.7.1 python-dateutil-2.8.2 regex-2023.12.25 requests-2.31.0 robotframework-7.0 robotframework-httplibrary-0.4.2 robotframework-pythonlibcore-4.3.0 robotframework-requests-0.9.3 robotframework-selenium2library-3.0.0 robotframework-seleniumlibrary-6.2.0 robotframework-sshlibrary-3.8.0 scapy-2.5.0 scp-0.14.5 selenium-4.17.2 six-1.16.0 sniffio-1.3.0 sortedcontainers-2.4.0 soupsieve-2.5 trio-0.24.0 trio-websocket-0.11.1 typing_extensions-4.9.0 urllib3-2.2.0 waitress-3.0.0 websocket-client-1.7.0 webtest-3.0.0 wsproto-1.2.0 04:43:26 + pip freeze 04:43:26 attrs==23.2.0 04:43:26 bcrypt==4.1.2 04:43:26 beautifulsoup4==4.12.3 04:43:26 certifi==2024.2.2 04:43:26 cffi==1.16.0 04:43:26 charset-normalizer==3.3.2 04:43:26 cryptography==42.0.2 04:43:26 decorator==5.1.1 04:43:26 distlib==0.3.8 04:43:26 docker-py==1.10.6 04:43:26 docker-pycreds==0.4.0 04:43:26 elastic-transport==8.12.0 04:43:26 elasticsearch==8.12.0 04:43:26 elasticsearch-dsl==8.12.0 04:43:26 enum34==1.1.10 04:43:26 exceptiongroup==1.2.0 04:43:26 filelock==3.13.1 04:43:26 h11==0.14.0 04:43:26 idna==3.6 04:43:26 ipaddr==2.2.0 04:43:26 isodate==0.6.1 04:43:26 jmespath==1.0.1 04:43:26 jsonpatch==1.33 04:43:26 jsonpath-rw==1.4.0 04:43:26 jsonpointer==2.4 04:43:26 lxml==5.1.0 04:43:26 netaddr==0.10.1 04:43:26 netifaces==0.11.0 04:43:26 outcome==1.3.0.post0 04:43:26 paramiko==3.4.0 04:43:26 platformdirs==4.2.0 04:43:26 ply==3.11 04:43:26 pyang==2.6.0 04:43:26 pyangbind==0.8.4.post1 04:43:26 pycparser==2.21 04:43:26 pyhocon==0.3.60 04:43:26 PyNaCl==1.5.0 04:43:26 pyparsing==3.1.1 04:43:26 PySocks==1.7.1 04:43:26 python-dateutil==2.8.2 04:43:26 regex==2023.12.25 04:43:26 requests==2.31.0 04:43:26 robotframework==7.0 04:43:26 robotframework-httplibrary==0.4.2 04:43:26 robotframework-pythonlibcore==4.3.0 04:43:26 robotframework-requests==0.9.3 04:43:26 robotframework-selenium2library==3.0.0 04:43:26 robotframework-seleniumlibrary==6.2.0 04:43:26 robotframework-sshlibrary==3.8.0 04:43:26 scapy==2.5.0 04:43:26 scp==0.14.5 04:43:26 selenium==4.17.2 04:43:26 six==1.16.0 04:43:26 sniffio==1.3.0 04:43:26 sortedcontainers==2.4.0 04:43:26 soupsieve==2.5 04:43:26 trio==0.24.0 04:43:26 trio-websocket==0.11.1 04:43:26 typing_extensions==4.9.0 04:43:26 urllib3==2.2.0 04:43:26 virtualenv==20.25.0 04:43:26 waitress==3.0.0 04:43:26 WebOb==1.8.7 04:43:26 websocket-client==1.7.0 04:43:26 WebTest==3.0.0 04:43:26 wsproto==1.2.0 04:43:27 [EnvInject] - Injecting environment variables from a build step. 04:43:27 [EnvInject] - Injecting as environment variables the properties file path 'env.properties' 04:43:27 [EnvInject] - Variables injected successfully. 04:43:27 [openflowplugin-csit-3node-clustering-bulkomatic-only-calcium] $ /bin/bash -l /tmp/jenkins14174609420068799354.sh 04:43:27 Setup pyenv: 04:43:27 system 04:43:27 3.8.13 04:43:27 3.9.13 04:43:27 * 3.10.6 (set by /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-calcium/.python-version) 04:43:27 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-Azlr from file:/tmp/.os_lf_venv 04:43:28 lf-activate-venv(): INFO: Installing: python-heatclient python-openstackclient yq 04:43:38 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. 04:43:38 botocore 1.34.37 requires urllib3<2.1,>=1.25.4; python_version >= "3.10", but you have urllib3 2.2.0 which is incompatible. 04:43:38 lftools 0.37.8 requires openstacksdk<1.5.0, but you have openstacksdk 2.1.0 which is incompatible. 04:43:38 lftools 0.37.8 requires urllib3<2.0.0, but you have urllib3 2.2.0 which is incompatible. 04:43:38 lf-activate-venv(): INFO: Adding /tmp/venv-Azlr/bin to PATH 04:43:38 + ODL_SYSTEM=() 04:43:38 + TOOLS_SYSTEM=() 04:43:38 + OPENSTACK_SYSTEM=() 04:43:38 + OPENSTACK_CONTROLLERS=() 04:43:38 + mapfile -t ADDR 04:43:38 ++ jq -r '.outputs[] | select(.output_key | match("^vm_[0-9]+_ips$")) | .output_value | .[]' 04:43:38 ++ openstack stack show -f json -c outputs releng-openflowplugin-csit-3node-clustering-bulkomatic-only-calcium-132 04:43:39 + for i in "${ADDR[@]}" 04:43:39 ++ ssh 10.30.171.163 hostname -s 04:43:39 Warning: Permanently added '10.30.171.163' (ECDSA) to the list of known hosts. 04:43:40 + REMHOST=releng-30393-132-1-mininet-ovs-28-0 04:43:40 + case ${REMHOST} in 04:43:40 + TOOLS_SYSTEM=("${TOOLS_SYSTEM[@]}" "${i}") 04:43:40 + for i in "${ADDR[@]}" 04:43:40 ++ ssh 10.30.170.215 hostname -s 04:43:40 Warning: Permanently added '10.30.170.215' (ECDSA) to the list of known hosts. 04:43:40 + REMHOST=releng-30393-132-0-builder-0 04:43:40 + case ${REMHOST} in 04:43:40 + ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}") 04:43:40 + for i in "${ADDR[@]}" 04:43:40 ++ ssh 10.30.171.16 hostname -s 04:43:40 Warning: Permanently added '10.30.171.16' (ECDSA) to the list of known hosts. 04:43:41 + REMHOST=releng-30393-132-0-builder-1 04:43:41 + case ${REMHOST} in 04:43:41 + ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}") 04:43:41 + for i in "${ADDR[@]}" 04:43:41 ++ ssh 10.30.170.254 hostname -s 04:43:41 Warning: Permanently added '10.30.170.254' (ECDSA) to the list of known hosts. 04:43:41 + REMHOST=releng-30393-132-0-builder-2 04:43:41 + case ${REMHOST} in 04:43:41 + ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}") 04:43:41 + echo NUM_ODL_SYSTEM=3 04:43:41 + echo NUM_TOOLS_SYSTEM=1 04:43:41 + '[' '' == yes ']' 04:43:41 + NUM_OPENSTACK_SYSTEM=0 04:43:41 + echo NUM_OPENSTACK_SYSTEM=0 04:43:41 + '[' 0 -eq 2 ']' 04:43:41 + echo ODL_SYSTEM_IP=10.30.170.215 04:43:41 ++ seq 0 2 04:43:41 + for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 ))) 04:43:41 + echo ODL_SYSTEM_1_IP=10.30.170.215 04:43:41 + for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 ))) 04:43:41 + echo ODL_SYSTEM_2_IP=10.30.171.16 04:43:41 + for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 ))) 04:43:41 + echo ODL_SYSTEM_3_IP=10.30.170.254 04:43:41 + echo TOOLS_SYSTEM_IP=10.30.171.163 04:43:41 ++ seq 0 0 04:43:41 + for i in $(seq 0 $(( ${#TOOLS_SYSTEM[@]} - 1 ))) 04:43:41 + echo TOOLS_SYSTEM_1_IP=10.30.171.163 04:43:41 + openstack_index=0 04:43:41 + NUM_OPENSTACK_CONTROL_NODES=1 04:43:41 + echo NUM_OPENSTACK_CONTROL_NODES=1 04:43:41 ++ seq 0 0 04:43:41 + for i in $(seq 0 $((NUM_OPENSTACK_CONTROL_NODES - 1))) 04:43:41 + echo OPENSTACK_CONTROL_NODE_1_IP= 04:43:41 + NUM_OPENSTACK_COMPUTE_NODES=-1 04:43:41 + echo NUM_OPENSTACK_COMPUTE_NODES=-1 04:43:41 + '[' -1 -ge 2 ']' 04:43:41 ++ seq 0 -2 04:43:41 + NUM_OPENSTACK_HAPROXY_NODES=0 04:43:41 + echo NUM_OPENSTACK_HAPROXY_NODES=0 04:43:41 ++ seq 0 -1 04:43:41 + echo 'Contents of slave_addresses.txt:' 04:43:41 Contents of slave_addresses.txt: 04:43:41 + cat slave_addresses.txt 04:43:41 NUM_ODL_SYSTEM=3 04:43:41 NUM_TOOLS_SYSTEM=1 04:43:41 NUM_OPENSTACK_SYSTEM=0 04:43:41 ODL_SYSTEM_IP=10.30.170.215 04:43:41 ODL_SYSTEM_1_IP=10.30.170.215 04:43:41 ODL_SYSTEM_2_IP=10.30.171.16 04:43:41 ODL_SYSTEM_3_IP=10.30.170.254 04:43:41 TOOLS_SYSTEM_IP=10.30.171.163 04:43:41 TOOLS_SYSTEM_1_IP=10.30.171.163 04:43:41 NUM_OPENSTACK_CONTROL_NODES=1 04:43:41 OPENSTACK_CONTROL_NODE_1_IP= 04:43:41 NUM_OPENSTACK_COMPUTE_NODES=-1 04:43:41 NUM_OPENSTACK_HAPROXY_NODES=0 04:43:41 [EnvInject] - Injecting environment variables from a build step. 04:43:41 [EnvInject] - Injecting as environment variables the properties file path 'slave_addresses.txt' 04:43:41 [EnvInject] - Variables injected successfully. 04:43:41 [openflowplugin-csit-3node-clustering-bulkomatic-only-calcium] $ /bin/sh /tmp/jenkins1124149650050400951.sh 04:43:41 Preparing for JRE Version 17 04:43:41 Karaf artifact is karaf 04:43:41 Karaf project is integration 04:43:41 Java home is /usr/lib/jvm/java-17-openjdk 04:43:41 [EnvInject] - Injecting environment variables from a build step. 04:43:41 [EnvInject] - Injecting as environment variables the properties file path 'set_variables.env' 04:43:41 [EnvInject] - Variables injected successfully. 04:43:41 [openflowplugin-csit-3node-clustering-bulkomatic-only-calcium] $ /bin/bash /tmp/jenkins10865047983633748386.sh 04:43:41 Distribution bundle URL is https://nexus.opendaylight.org/content/repositories//autorelease-7523/org/opendaylight/integration/karaf/0.20.0/karaf-0.20.0.zip 04:43:41 Distribution bundle is karaf-0.20.0.zip 04:43:41 Distribution bundle version is 0.20.0 04:43:41 Distribution folder is karaf-0.20.0 04:43:41 Nexus prefix is https://nexus.opendaylight.org 04:43:41 [EnvInject] - Injecting environment variables from a build step. 04:43:41 [EnvInject] - Injecting as environment variables the properties file path 'detect_variables.env' 04:43:41 [EnvInject] - Variables injected successfully. 04:43:41 [openflowplugin-csit-3node-clustering-bulkomatic-only-calcium] $ /bin/bash -l /tmp/jenkins5843460705391631039.sh 04:43:41 Setup pyenv: 04:43:41 system 04:43:41 3.8.13 04:43:41 3.9.13 04:43:41 * 3.10.6 (set by /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-calcium/.python-version) 04:43:41 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-Azlr from file:/tmp/.os_lf_venv 04:43:43 lf-activate-venv(): INFO: Installing: python-heatclient python-openstackclient 04:43:48 lf-activate-venv(): INFO: Adding /tmp/venv-Azlr/bin to PATH 04:43:48 Copying common-functions.sh to /tmp 04:43:50 Copying common-functions.sh to 10.30.171.163:/tmp 04:43:50 Warning: Permanently added '10.30.171.163' (ECDSA) to the list of known hosts. 04:43:50 Copying common-functions.sh to 10.30.170.215:/tmp 04:43:50 Warning: Permanently added '10.30.170.215' (ECDSA) to the list of known hosts. 04:43:51 Copying common-functions.sh to 10.30.171.16:/tmp 04:43:51 Warning: Permanently added '10.30.171.16' (ECDSA) to the list of known hosts. 04:43:51 Copying common-functions.sh to 10.30.170.254:/tmp 04:43:51 Warning: Permanently added '10.30.170.254' (ECDSA) to the list of known hosts. 04:43:51 [openflowplugin-csit-3node-clustering-bulkomatic-only-calcium] $ /bin/bash /tmp/jenkins5756642234084125537.sh 04:43:51 common-functions.sh is being sourced 04:43:51 common-functions environment: 04:43:51 MAVENCONF: /tmp/karaf-0.20.0/etc/org.ops4j.pax.url.mvn.cfg 04:43:51 ACTUALFEATURES: 04:43:51 FEATURESCONF: /tmp/karaf-0.20.0/etc/org.apache.karaf.features.cfg 04:43:51 CUSTOMPROP: /tmp/karaf-0.20.0/etc/custom.properties 04:43:51 LOGCONF: /tmp/karaf-0.20.0/etc/org.ops4j.pax.logging.cfg 04:43:51 MEMCONF: /tmp/karaf-0.20.0/bin/setenv 04:43:51 CONTROLLERMEM: 2048m 04:43:51 AKKACONF: /tmp/karaf-0.20.0/configuration/initial/akka.conf 04:43:51 MODULESCONF: /tmp/karaf-0.20.0/configuration/initial/modules.conf 04:43:51 MODULESHARDSCONF: /tmp/karaf-0.20.0/configuration/initial/module-shards.conf 04:43:51 SUITES: 04:43:51 04:43:51 ################################################# 04:43:51 ## Configure Cluster and Start ## 04:43:51 ################################################# 04:43:51 ACTUALFEATURES: odl-infrautils-ready,odl-jolokia,odl-openflowplugin-flow-services-rest,odl-openflowplugin-app-bulk-o-matic 04:43:51 SPACE_SEPARATED_FEATURES: odl-infrautils-ready odl-jolokia odl-openflowplugin-flow-services-rest odl-openflowplugin-app-bulk-o-matic 04:43:51 Locating script plan to use... 04:43:51 Finished running script plans 04:43:51 Configuring member-1 with IP address 10.30.170.215 04:43:51 Warning: Permanently added '10.30.170.215' (ECDSA) to the list of known hosts. 04:43:51 Warning: Permanently added '10.30.170.215' (ECDSA) to the list of known hosts. 04:43:52 + source /tmp/common-functions.sh karaf-0.20.0 04:43:52 ++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]] 04:43:52 common-functions.sh is being sourced 04:43:52 ++ echo 'common-functions.sh is being sourced' 04:43:52 ++ BUNDLEFOLDER=karaf-0.20.0 04:43:52 ++ export MAVENCONF=/tmp/karaf-0.20.0/etc/org.ops4j.pax.url.mvn.cfg 04:43:52 ++ MAVENCONF=/tmp/karaf-0.20.0/etc/org.ops4j.pax.url.mvn.cfg 04:43:52 ++ export FEATURESCONF=/tmp/karaf-0.20.0/etc/org.apache.karaf.features.cfg 04:43:52 ++ FEATURESCONF=/tmp/karaf-0.20.0/etc/org.apache.karaf.features.cfg 04:43:52 ++ export CUSTOMPROP=/tmp/karaf-0.20.0/etc/custom.properties 04:43:52 ++ CUSTOMPROP=/tmp/karaf-0.20.0/etc/custom.properties 04:43:52 ++ export LOGCONF=/tmp/karaf-0.20.0/etc/org.ops4j.pax.logging.cfg 04:43:52 ++ LOGCONF=/tmp/karaf-0.20.0/etc/org.ops4j.pax.logging.cfg 04:43:52 ++ export MEMCONF=/tmp/karaf-0.20.0/bin/setenv 04:43:52 ++ MEMCONF=/tmp/karaf-0.20.0/bin/setenv 04:43:52 ++ export CONTROLLERMEM= 04:43:52 ++ CONTROLLERMEM= 04:43:52 common-functions environment: 04:43:52 MAVENCONF: /tmp/karaf-0.20.0/etc/org.ops4j.pax.url.mvn.cfg 04:43:52 ACTUALFEATURES: 04:43:52 FEATURESCONF: /tmp/karaf-0.20.0/etc/org.apache.karaf.features.cfg 04:43:52 CUSTOMPROP: /tmp/karaf-0.20.0/etc/custom.properties 04:43:52 LOGCONF: /tmp/karaf-0.20.0/etc/org.ops4j.pax.logging.cfg 04:43:52 MEMCONF: /tmp/karaf-0.20.0/bin/setenv 04:43:52 CONTROLLERMEM: 04:43:52 AKKACONF: /tmp/karaf-0.20.0/configuration/initial/akka.conf 04:43:52 MODULESCONF: /tmp/karaf-0.20.0/configuration/initial/modules.conf 04:43:52 MODULESHARDSCONF: /tmp/karaf-0.20.0/configuration/initial/module-shards.conf 04:43:52 SUITES: 04:43:52 04:43:52 ++ export AKKACONF=/tmp/karaf-0.20.0/configuration/initial/akka.conf 04:43:52 ++ AKKACONF=/tmp/karaf-0.20.0/configuration/initial/akka.conf 04:43:52 ++ export MODULESCONF=/tmp/karaf-0.20.0/configuration/initial/modules.conf 04:43:52 ++ MODULESCONF=/tmp/karaf-0.20.0/configuration/initial/modules.conf 04:43:52 ++ export MODULESHARDSCONF=/tmp/karaf-0.20.0/configuration/initial/module-shards.conf 04:43:52 ++ MODULESHARDSCONF=/tmp/karaf-0.20.0/configuration/initial/module-shards.conf 04:43:52 ++ print_common_env 04:43:52 ++ cat 04:43:52 ++ SSH='ssh -t -t' 04:43:52 ++ extra_services_cntl=' dnsmasq.service httpd.service libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service rabbitmq-server.service ' 04:43:52 ++ extra_services_cmp=' libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service ' 04:43:52 Changing to /tmp 04:43:52 Downloading the distribution from https://nexus.opendaylight.org/content/repositories//autorelease-7523/org/opendaylight/integration/karaf/0.20.0/karaf-0.20.0.zip 04:43:52 + echo 'Changing to /tmp' 04:43:52 + cd /tmp 04:43:52 + echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories//autorelease-7523/org/opendaylight/integration/karaf/0.20.0/karaf-0.20.0.zip' 04:43:52 + wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories//autorelease-7523/org/opendaylight/integration/karaf/0.20.0/karaf-0.20.0.zip 04:43:52 --2024-02-08 04:43:52-- https://nexus.opendaylight.org/content/repositories//autorelease-7523/org/opendaylight/integration/karaf/0.20.0/karaf-0.20.0.zip 04:43:52 Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6 04:43:52 Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected. 04:43:52 HTTP request sent, awaiting response... 200 OK 04:43:52 Length: 231881313 (221M) [application/zip] 04:43:52 Saving to: ‘karaf-0.20.0.zip’ 04:43:52 04:43:52 0K ........ ........ ........ ........ ........ ........ 1% 43.5M 5s 04:43:52 3072K ........ ........ ........ ........ ........ ........ 2% 64.4M 4s 04:43:52 6144K ........ ........ ........ ........ ........ ........ 4% 80.3M 4s 04:43:52 9216K ........ ........ ........ ........ ........ ........ 5% 49.4M 4s 04:43:52 12288K ........ ........ ........ ........ ........ ........ 6% 47.9M 4s 04:43:52 15360K ........ ........ ........ ........ ........ ........ 8% 53.6M 4s 04:43:52 18432K ........ ........ ........ ........ ........ ........ 9% 92.5M 3s 04:43:52 21504K ........ ........ ........ ........ ........ ........ 10% 130M 3s 04:43:52 24576K ........ ........ ........ ........ ........ ........ 12% 128M 3s 04:43:52 27648K ........ ........ ........ ........ ........ ........ 13% 133M 3s 04:43:52 30720K ........ ........ ........ ........ ........ ........ 14% 167M 3s 04:43:52 33792K ........ ........ ........ ........ ........ ........ 16% 86.6M 3s 04:43:52 36864K ........ ........ ........ ........ ........ ........ 17% 99.3M 2s 04:43:52 39936K ........ ........ ........ ........ ........ ........ 18% 130M 2s 04:43:52 43008K ........ ........ ........ ........ ........ ........ 20% 127M 2s 04:43:52 46080K ........ ........ ........ ........ ........ ........ 21% 83.4M 2s 04:43:52 49152K ........ ........ ........ ........ ........ ........ 23% 180M 2s 04:43:52 52224K ........ ........ ........ ........ ........ ........ 24% 175M 2s 04:43:53 55296K ........ ........ ........ ........ ........ ........ 25% 176M 2s 04:43:53 58368K ........ ........ ........ ........ ........ ........ 27% 175M 2s 04:43:53 61440K ........ ........ ........ ........ ........ ........ 28% 156M 2s 04:43:53 64512K ........ ........ ........ ........ ........ ........ 29% 34.0M 2s 04:43:53 67584K ........ ........ ........ ........ ........ ........ 31% 130M 2s 04:43:53 70656K ........ ........ ........ ........ ........ ........ 32% 191M 2s 04:43:53 73728K ........ ........ ........ ........ ........ ........ 33% 145M 2s 04:43:53 76800K ........ ........ ........ ........ ........ ........ 35% 171M 2s 04:43:53 79872K ........ ........ ........ ........ ........ ........ 36% 209M 1s 04:43:53 82944K ........ ........ ........ ........ ........ ........ 37% 177M 1s 04:43:53 86016K ........ ........ ........ ........ ........ ........ 39% 148M 1s 04:43:53 89088K ........ ........ ........ ........ ........ ........ 40% 175M 1s 04:43:53 92160K ........ ........ ........ ........ ........ ........ 42% 144M 1s 04:43:53 95232K ........ ........ ........ ........ ........ ........ 43% 180M 1s 04:43:53 98304K ........ ........ ........ ........ ........ ........ 44% 198M 1s 04:43:53 101376K ........ ........ ........ ........ ........ ........ 46% 157M 1s 04:43:53 104448K ........ ........ ........ ........ ........ ........ 47% 320M 1s 04:43:53 107520K ........ ........ ........ ........ ........ ........ 48% 292M 1s 04:43:53 110592K ........ ........ ........ ........ ........ ........ 50% 158M 1s 04:43:53 113664K ........ ........ ........ ........ ........ ........ 51% 200M 1s 04:43:53 116736K ........ ........ ........ ........ ........ ........ 52% 238M 1s 04:43:53 119808K ........ ........ ........ ........ ........ ........ 54% 285M 1s 04:43:53 122880K ........ ........ ........ ........ ........ ........ 55% 295M 1s 04:43:53 125952K ........ ........ ........ ........ ........ ........ 56% 77.8M 1s 04:43:53 129024K ........ ........ ........ ........ ........ ........ 58% 214M 1s 04:43:53 132096K ........ ........ ........ ........ ........ ........ 59% 294M 1s 04:43:53 135168K ........ ........ ........ ........ ........ ........ 61% 391M 1s 04:43:53 138240K ........ ........ ........ ........ ........ ........ 62% 310M 1s 04:43:53 141312K ........ ........ ........ ........ ........ ........ 63% 273M 1s 04:43:53 144384K ........ ........ ........ ........ ........ ........ 65% 263M 1s 04:43:53 147456K ........ ........ ........ ........ ........ ........ 66% 240M 1s 04:43:53 150528K ........ ........ ........ ........ ........ ........ 67% 271M 1s 04:43:53 153600K ........ ........ ........ ........ ........ ........ 69% 277M 1s 04:43:53 156672K ........ ........ ........ ........ ........ ........ 70% 273M 1s 04:43:53 159744K ........ ........ ........ ........ ........ ........ 71% 286M 0s 04:43:53 162816K ........ ........ ........ ........ ........ ........ 73% 266M 0s 04:43:53 165888K ........ ........ ........ ........ ........ ........ 74% 271M 0s 04:43:53 168960K ........ ........ ........ ........ ........ ........ 75% 254M 0s 04:43:53 172032K ........ ........ ........ ........ ........ ........ 77% 258M 0s 04:43:53 175104K ........ ........ ........ ........ ........ ........ 78% 302M 0s 04:43:53 178176K ........ ........ ........ ........ ........ ........ 80% 265M 0s 04:43:53 181248K ........ ........ ........ ........ ........ ........ 81% 303M 0s 04:43:53 184320K ........ ........ ........ ........ ........ ........ 82% 96.0M 0s 04:43:53 187392K ........ ........ ........ ........ ........ ........ 84% 284M 0s 04:43:53 190464K ........ ........ ........ ........ ........ ........ 85% 268M 0s 04:43:53 193536K ........ ........ ........ ........ ........ ........ 86% 240M 0s 04:43:53 196608K ........ ........ ........ ........ ........ ........ 88% 250M 0s 04:43:53 199680K ........ ........ ........ ........ ........ ........ 89% 245M 0s 04:43:53 202752K ........ ........ ........ ........ ........ ........ 90% 266M 0s 04:43:53 205824K ........ ........ ........ ........ ........ ........ 92% 289M 0s 04:43:53 208896K ........ ........ ........ ........ ........ ........ 93% 307M 0s 04:43:53 211968K ........ ........ ........ ........ ........ ........ 94% 269M 0s 04:43:53 215040K ........ ........ ........ ........ ........ ........ 96% 279M 0s 04:43:53 218112K ........ ........ ........ ........ ........ ........ 97% 297M 0s 04:43:53 221184K ........ ........ ........ ........ ........ ........ 99% 303M 0s 04:43:53 224256K ........ ........ ........ ........ .. 100% 296M=1.5s 04:43:53 04:43:53 2024-02-08 04:43:53 (149 MB/s) - ‘karaf-0.20.0.zip’ saved [231881313/231881313] 04:43:53 04:43:53 Extracting the new controller... 04:43:53 + echo 'Extracting the new controller...' 04:43:53 + unzip -q karaf-0.20.0.zip 04:43:56 Adding external repositories... 04:43:56 + echo 'Adding external repositories...' 04:43:56 + sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.20.0/etc/org.ops4j.pax.url.mvn.cfg 04:43:56 + cat /tmp/karaf-0.20.0/etc/org.ops4j.pax.url.mvn.cfg 04:43:56 ################################################################################ 04:43:56 # 04:43:56 # Licensed to the Apache Software Foundation (ASF) under one or more 04:43:56 # contributor license agreements. See the NOTICE file distributed with 04:43:56 # this work for additional information regarding copyright ownership. 04:43:56 # The ASF licenses this file to You under the Apache License, Version 2.0 04:43:56 # (the "License"); you may not use this file except in compliance with 04:43:56 # the License. You may obtain a copy of the License at 04:43:56 # 04:43:56 # http://www.apache.org/licenses/LICENSE-2.0 04:43:56 # 04:43:56 # Unless required by applicable law or agreed to in writing, software 04:43:56 # distributed under the License is distributed on an "AS IS" BASIS, 04:43:56 # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. 04:43:56 # See the License for the specific language governing permissions and 04:43:56 # limitations under the License. 04:43:56 # 04:43:56 ################################################################################ 04:43:56 04:43:56 # 04:43:56 # If set to true, the following property will not allow any certificate to be used 04:43:56 # when accessing Maven repositories through SSL 04:43:56 # 04:43:56 #org.ops4j.pax.url.mvn.certificateCheck= 04:43:56 04:43:56 # 04:43:56 # Path to the local Maven settings file. 04:43:56 # The repositories defined in this file will be automatically added to the list 04:43:56 # of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property 04:43:56 # below is not set. 04:43:56 # The following locations are checked for the existence of the settings.xml file 04:43:56 # * 1. looks for the specified url 04:43:56 # * 2. if not found looks for ${user.home}/.m2/settings.xml 04:43:56 # * 3. if not found looks for ${maven.home}/conf/settings.xml 04:43:56 # * 4. if not found looks for ${M2_HOME}/conf/settings.xml 04:43:56 # 04:43:56 #org.ops4j.pax.url.mvn.settings= 04:43:56 04:43:56 # 04:43:56 # Path to the local Maven repository which is used to avoid downloading 04:43:56 # artifacts when they already exist locally. 04:43:56 # The value of this property will be extracted from the settings.xml file 04:43:56 # above, or defaulted to: 04:43:56 # System.getProperty( "user.home" ) + "/.m2/repository" 04:43:56 # 04:43:56 org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository} 04:43:56 04:43:56 # 04:43:56 # Default this to false. It's just weird to use undocumented repos 04:43:56 # 04:43:56 org.ops4j.pax.url.mvn.useFallbackRepositories=false 04:43:56 04:43:56 # 04:43:56 # Uncomment if you don't wanna use the proxy settings 04:43:56 # from the Maven conf/settings.xml file 04:43:56 # 04:43:56 # org.ops4j.pax.url.mvn.proxySupport=false 04:43:56 04:43:56 # 04:43:56 # Comma separated list of repositories scanned when resolving an artifact. 04:43:56 # Those repositories will be checked before iterating through the 04:43:56 # below list of repositories and even before the local repository 04:43:56 # A repository url can be appended with zero or more of the following flags: 04:43:56 # @snapshots : the repository contains snaphots 04:43:56 # @noreleases : the repository does not contain any released artifacts 04:43:56 # 04:43:56 # The following property value will add the system folder as a repo. 04:43:56 # 04:43:56 org.ops4j.pax.url.mvn.defaultRepositories=\ 04:43:56 file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\ 04:43:56 file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\ 04:43:56 file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots 04:43:56 04:43:56 # Use the default local repo (e.g.~/.m2/repository) as a "remote" repo 04:43:56 #org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false 04:43:56 04:43:56 # 04:43:56 # Comma separated list of repositories scanned when resolving an artifact. 04:43:56 # The default list includes the following repositories: 04:43:56 # http://repo1.maven.org/maven2@id=central 04:43:56 # http://repository.springsource.com/maven/bundles/release@id=spring.ebr 04:43:56 # http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external 04:43:56 # http://zodiac.springsource.com/maven/bundles/release@id=gemini 04:43:56 # http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases 04:43:56 # https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases 04:43:56 # https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases 04:43:56 # To add repositories to the default ones, prepend '+' to the list of repositories 04:43:56 # to add. 04:43:56 # A repository url can be appended with zero or more of the following flags: 04:43:56 # @snapshots : the repository contains snapshots 04:43:56 # @noreleases : the repository does not contain any released artifacts 04:43:56 # @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended 04:43:56 # 04:43:56 org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases 04:43:56 04:43:56 ### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.+ [[ True == \T\r\u\e ]] 04:43:56 + echo 'Configuring the startup features...' 04:43:56 Configuring the startup features... 04:43:56 + sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-infrautils-ready,odl-jolokia,odl-openflowplugin-flow-services-rest,odl-openflowplugin-app-bulk-o-matic,/g' /tmp/karaf-0.20.0/etc/org.apache.karaf.features.cfg 04:43:56 + FEATURE_TEST_STRING=features-test 04:43:56 + FEATURE_TEST_VERSION=0.20.0 04:43:56 + KARAF_VERSION=karaf4 04:43:56 + [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]] 04:43:56 + sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.20.0/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.20.0/etc/org.apache.karaf.features.cfg 04:43:56 + [[ ! -z '' ]] 04:43:56 + cat /tmp/karaf-0.20.0/etc/org.apache.karaf.features.cfg 04:43:56 ################################################################################ 04:43:56 # 04:43:56 # Licensed to the Apache Software Foundation (ASF) under one or more 04:43:56 # contributor license agreements. See the NOTICE file distributed with 04:43:56 # this work for additional information regarding copyright ownership. 04:43:56 # The ASF licenses this file to You under the Apache License, Version 2.0 04:43:56 # (the "License"); you may not use this file except in compliance with 04:43:56 # the License. You may obtain a copy of the License at 04:43:56 # 04:43:56 # http://www.apache.org/licenses/LICENSE-2.0 04:43:56 # 04:43:56 # Unless required by applicable law or agreed to in writing, software 04:43:56 # distributed under the License is distributed on an "AS IS" BASIS, 04:43:56 # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. 04:43:56 # See the License for the specific language governing permissions and 04:43:56 # limitations under the License. 04:43:56 # 04:43:56 ################################################################################ 04:43:56 04:43:56 # 04:43:56 # Comma separated list of features repositories to register by default 04:43:56 # 04:43:56 featuresRepositories = mvn:org.opendaylight.integration/features-test/0.20.0/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/6f998722-40c8-4c0d-90c2-67a89cfdff36.xml 04:43:56 04:43:56 # 04:43:56 # Comma separated list of features to install at startup 04:43:56 # 04:43:56 featuresBoot = odl-infrautils-ready,odl-jolokia,odl-openflowplugin-flow-services-rest,odl-openflowplugin-app-bulk-o-matic, 737bc17c-9f81-469b-8a78-921ab894418d 04:43:56 04:43:56 # 04:43:56 # Resource repositories (OBR) that the features resolver can use 04:43:56 # to resolve requirements/capabilities 04:43:56 # 04:43:56 # The format of the resourceRepositories is 04:43:56 # resourceRepositories=[xml:url|json:url],... 04:43:56 # for Instance: 04:43:56 # 04:43:56 #resourceRepositories=xml:http://host/path/to/index.xml 04:43:56 # or 04:43:56 #resourceRepositories=json:http://host/path/to/index.json 04:43:56 # 04:43:56 04:43:56 # 04:43:56 # Defines if the boot features are started in asynchronous mode (in a dedicated thread) 04:43:56 # 04:43:56 featuresBootAsynchronous=false 04:43:56 04:43:56 # 04:43:56 # Service requirements enforcement 04:43:56 # 04:43:56 # By default, the feature resolver checks the service requirements/capabilities of 04:43:56 # bundles for new features (xml schema >= 1.3.0) in order to automatically installs 04:43:56 # the required bundles. 04:43:56 # The following flag can have those values: 04:43:56 # - disable: service requirements are completely ignored 04:43:56 # - default: service requirements are ignored for old features 04:43:56 # - enforce: service requirements are always verified 04:43:56 # 04:43:56 #serviceRequirements=default 04:43:56 04:43:56 # 04:43:56 # Store cfg file for config element in feature 04:43:56 # 04:43:56 #configCfgStore=true 04:43:56 04:43:56 # 04:43:56 # Define if the feature service automatically refresh bundles 04:43:56 # 04:43:56 autoRefresh=true 04:43:56 04:43:56 # 04:43:56 # Configuration of features processing mechanism (overrides, blacklisting, modification of features) 04:43:56 # XML file defines instructions related to features processing 04:43:56 # versions.properties may declare properties to resolve placeholders in XML file 04:43:56 # both files are relative to ${karaf.etc} 04:43:56 # 04:43:56 #featureProcessing=org.apache.karaf.features.xml 04:43:56 #featureProcessingVersions=versions.properties 04:43:56 + configure_karaf_log karaf4 '' 04:43:56 + local -r karaf_version=karaf4 04:43:56 + local -r controllerdebugmap= 04:43:56 + local logapi=log4j 04:43:56 + grep log4j2 /tmp/karaf-0.20.0/etc/org.ops4j.pax.logging.cfg 04:43:56 log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n 04:43:56 log4j2.rootLogger.level = INFO 04:43:56 #log4j2.rootLogger.type = asyncRoot 04:43:56 #log4j2.rootLogger.includeLocation = false 04:43:56 log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile 04:43:56 log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi 04:43:56 log4j2.rootLogger.appenderRef.Console.ref = Console 04:43:56 log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter 04:43:56 log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} 04:43:56 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter 04:43:56 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair 04:43:56 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker 04:43:56 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL 04:43:56 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or 04:43:56 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY 04:43:56 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL 04:43:56 log4j2.logger.spifly.name = org.apache.aries.spifly 04:43:56 log4j2.logger.spifly.level = WARN 04:43:56 log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit 04:43:56 log4j2.logger.audit.level = INFO 04:43:56 log4j2.logger.audit.additivity = false 04:43:56 log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile 04:43:56 # Console appender not used by default (see log4j2.rootLogger.appenderRefs) 04:43:56 log4j2.appender.console.type = Console 04:43:56 log4j2.appender.console.name = Console 04:43:56 log4j2.appender.console.layout.type = PatternLayout 04:43:56 log4j2.appender.console.layout.pattern = ${log4j2.pattern} 04:43:56 log4j2.appender.rolling.type = RollingRandomAccessFile 04:43:56 log4j2.appender.rolling.name = RollingFile 04:43:56 log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log 04:43:56 log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i 04:43:56 #log4j2.appender.rolling.immediateFlush = false 04:43:56 log4j2.appender.rolling.append = true 04:43:56 log4j2.appender.rolling.layout.type = PatternLayout 04:43:56 log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} 04:43:56 log4j2.appender.rolling.policies.type = Policies 04:43:56 log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy 04:43:56 log4j2.appender.rolling.policies.size.size = 64MB 04:43:56 log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy 04:43:56 log4j2.appender.rolling.strategy.max = 7 04:43:56 log4j2.appender.audit.type = RollingRandomAccessFile 04:43:56 log4j2.appender.audit.name = AuditRollingFile 04:43:56 log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log 04:43:56 log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i 04:43:56 log4j2.appender.audit.append = true 04:43:56 log4j2.appender.audit.layout.type = PatternLayout 04:43:56 log4j2.appender.audit.layout.pattern = ${log4j2.pattern} 04:43:56 log4j2.appender.audit.policies.type = Policies 04:43:56 log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy 04:43:56 log4j2.appender.audit.policies.size.size = 8MB 04:43:56 log4j2.appender.audit.strategy.type = DefaultRolloverStrategy 04:43:56 log4j2.appender.audit.strategy.max = 7 04:43:56 log4j2.appender.osgi.type = PaxOsgi 04:43:56 log4j2.appender.osgi.name = PaxOsgi 04:43:56 log4j2.appender.osgi.filter = * 04:43:56 #log4j2.logger.aether.name = shaded.org.eclipse.aether 04:43:56 #log4j2.logger.aether.level = TRACE 04:43:56 #log4j2.logger.http-headers.name = shaded.org.apache.http.headers 04:43:56 #log4j2.logger.http-headers.level = DEBUG 04:43:56 #log4j2.logger.maven.name = org.ops4j.pax.url.mvn 04:43:56 #log4j2.logger.maven.level = TRACE 04:43:56 Configuring the karaf log... karaf_version: karaf4, logapi: log4j2 04:43:56 + logapi=log4j2 04:43:56 + echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2' 04:43:56 + '[' log4j2 == log4j2 ']' 04:43:56 + sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.20.0/etc/org.ops4j.pax.logging.cfg 04:43:56 controllerdebugmap: 04:43:56 cat /tmp/karaf-0.20.0/etc/org.ops4j.pax.logging.cfg 04:43:56 + orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver 04:43:56 + orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver 04:43:56 + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN' 04:43:56 + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN' 04:43:56 + unset IFS 04:43:56 + echo 'controllerdebugmap: ' 04:43:56 + '[' -n '' ']' 04:43:56 + echo 'cat /tmp/karaf-0.20.0/etc/org.ops4j.pax.logging.cfg' 04:43:56 + cat /tmp/karaf-0.20.0/etc/org.ops4j.pax.logging.cfg 04:43:56 ################################################################################ 04:43:56 # 04:43:56 # Licensed to the Apache Software Foundation (ASF) under one or more 04:43:56 # contributor license agreements. See the NOTICE file distributed with 04:43:56 # this work for additional information regarding copyright ownership. 04:43:56 # The ASF licenses this file to You under the Apache License, Version 2.0 04:43:56 # (the "License"); you may not use this file except in compliance with 04:43:56 # the License. You may obtain a copy of the License at 04:43:56 # 04:43:56 # http://www.apache.org/licenses/LICENSE-2.0 04:43:56 # 04:43:56 # Unless required by applicable law or agreed to in writing, software 04:43:56 # distributed under the License is distributed on an "AS IS" BASIS, 04:43:56 # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. 04:43:56 # See the License for the specific language governing permissions and 04:43:56 # limitations under the License. 04:43:56 # 04:43:56 ################################################################################ 04:43:56 04:43:56 # Common pattern layout for appenders 04:43:56 log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n 04:43:56 04:43:56 # Root logger 04:43:56 log4j2.rootLogger.level = INFO 04:43:56 # uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library 04:43:56 #log4j2.rootLogger.type = asyncRoot 04:43:56 #log4j2.rootLogger.includeLocation = false 04:43:56 log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile 04:43:56 log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi 04:43:56 log4j2.rootLogger.appenderRef.Console.ref = Console 04:43:56 log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter 04:43:56 log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} 04:43:56 04:43:56 # Filters for logs marked by org.opendaylight.odlparent.Markers 04:43:56 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter 04:43:56 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair 04:43:56 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker 04:43:56 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL 04:43:56 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or 04:43:56 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY 04:43:56 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL 04:43:56 04:43:56 # Loggers configuration 04:43:56 04:43:56 # Spifly logger 04:43:56 log4j2.logger.spifly.name = org.apache.aries.spifly 04:43:56 log4j2.logger.spifly.level = WARN 04:43:56 04:43:56 # Security audit logger 04:43:56 log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit 04:43:56 log4j2.logger.audit.level = INFO 04:43:56 log4j2.logger.audit.additivity = false 04:43:56 log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile 04:43:56 04:43:56 # Appenders configuration 04:43:56 04:43:56 # Console appender not used by default (see log4j2.rootLogger.appenderRefs) 04:43:56 log4j2.appender.console.type = Console 04:43:56 log4j2.appender.console.name = Console 04:43:56 log4j2.appender.console.layout.type = PatternLayout 04:43:56 log4j2.appender.console.layout.pattern = ${log4j2.pattern} 04:43:56 04:43:56 # Rolling file appender 04:43:56 log4j2.appender.rolling.type = RollingRandomAccessFile 04:43:56 log4j2.appender.rolling.name = RollingFile 04:43:56 log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log 04:43:56 log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i 04:43:56 # uncomment to not force a disk flush 04:43:56 #log4j2.appender.rolling.immediateFlush = false 04:43:56 log4j2.appender.rolling.append = true 04:43:56 log4j2.appender.rolling.layout.type = PatternLayout 04:43:56 log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} 04:43:56 log4j2.appender.rolling.policies.type = Policies 04:43:56 log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy 04:43:56 log4j2.appender.rolling.policies.size.size = 1GB 04:43:56 log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy 04:43:56 log4j2.appender.rolling.strategy.max = 7 04:43:56 04:43:56 # Audit file appender 04:43:56 log4j2.appender.audit.type = RollingRandomAccessFile 04:43:56 log4j2.appender.audit.name = AuditRollingFile 04:43:56 log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log 04:43:56 log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i 04:43:56 log4j2.appender.audit.append = true 04:43:56 log4j2.appender.audit.layout.type = PatternLayout 04:43:56 log4j2.appender.audit.layout.pattern = ${log4j2.pattern} 04:43:56 log4j2.appender.audit.policies.type = Policies 04:43:56 log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy 04:43:56 log4j2.appender.audit.policies.size.size = 8MB 04:43:56 log4j2.appender.audit.strategy.type = DefaultRolloverStrategy 04:43:56 log4j2.appender.audit.strategy.max = 7 04:43:56 04:43:56 # OSGi appender 04:43:56 log4j2.appender.osgi.type = PaxOsgi 04:43:56 log4j2.appender.osgi.name = PaxOsgi 04:43:56 log4j2.appender.osgi.filter = * 04:43:56 04:43:56 # help with identification of maven-related problems with pax-url-aether 04:43:56 #log4j2.logger.aether.name = shaded.org.eclipse.aether 04:43:56 #log4j2.logger.aether.level = TRACE 04:43:56 #log4j2.logger.http-headers.name = shaded.org.apache.http.headers 04:43:56 #log4j2.logger.http-headers.level = DEBUG 04:43:56 #log4j2.logger.maven.name = org.ops4j.pax.url.mvn 04:43:56 #log4j2.logger.maven.level = TRACE 04:43:56 log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN 04:43:56 log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN 04:43:56 + set_java_vars /usr/lib/jvm/java-17-openjdk 2048m /tmp/karaf-0.20.0/bin/setenv 04:43:56 + local -r java_home=/usr/lib/jvm/java-17-openjdk 04:43:56 + local -r controllermem=2048m 04:43:56 + local -r memconf=/tmp/karaf-0.20.0/bin/setenv 04:43:56 Configure 04:43:56 java home: /usr/lib/jvm/java-17-openjdk 04:43:56 max memory: 2048m 04:43:56 memconf: /tmp/karaf-0.20.0/bin/setenv 04:43:56 + echo Configure 04:43:56 + echo ' java home: /usr/lib/jvm/java-17-openjdk' 04:43:56 + echo ' max memory: 2048m' 04:43:56 + echo ' memconf: /tmp/karaf-0.20.0/bin/setenv' 04:43:56 + sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk}%g' /tmp/karaf-0.20.0/bin/setenv 04:43:56 + sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=2048m/g' /tmp/karaf-0.20.0/bin/setenv 04:43:56 cat /tmp/karaf-0.20.0/bin/setenv 04:43:56 + echo 'cat /tmp/karaf-0.20.0/bin/setenv' 04:43:56 + cat /tmp/karaf-0.20.0/bin/setenv 04:43:56 #!/bin/sh 04:43:56 # 04:43:56 # Licensed to the Apache Software Foundation (ASF) under one or more 04:43:56 # contributor license agreements. See the NOTICE file distributed with 04:43:56 # this work for additional information regarding copyright ownership. 04:43:56 # The ASF licenses this file to You under the Apache License, Version 2.0 04:43:56 # (the "License"); you may not use this file except in compliance with 04:43:56 # the License. You may obtain a copy of the License at 04:43:56 # 04:43:56 # http://www.apache.org/licenses/LICENSE-2.0 04:43:56 # 04:43:56 # Unless required by applicable law or agreed to in writing, software 04:43:56 # distributed under the License is distributed on an "AS IS" BASIS, 04:43:56 # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. 04:43:56 # See the License for the specific language governing permissions and 04:43:56 # limitations under the License. 04:43:56 # 04:43:56 04:43:56 # 04:43:56 # handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf 04:43:56 # script: client, instance, shell, start, status, stop, karaf 04:43:56 # 04:43:56 # if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then 04:43:56 # Actions go here... 04:43:56 # fi 04:43:56 04:43:56 # 04:43:56 # general settings which should be applied for all scripts go here; please keep 04:43:56 # in mind that it is possible that scripts might be executed more than once, e.g. 04:43:56 # in example of the start script where the start script is executed first and the 04:43:56 # karaf script afterwards. 04:43:56 # 04:43:56 04:43:56 # 04:43:56 # The following section shows the possible configuration options for the default 04:43:56 # karaf scripts 04:43:56 # 04:43:56 export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk} # Location of Java installation 04:43:56 # export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration 04:43:56 # export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options 04:43:56 # export EXTRA_JAVA_OPTS # Additional JVM options 04:43:56 # export KARAF_HOME # Karaf home folder 04:43:56 # export KARAF_DATA # Karaf data folder 04:43:56 # export KARAF_BASE # Karaf base folder 04:43:56 # export KARAF_ETC # Karaf etc folder 04:43:56 # export KARAF_LOG # Karaf log folder 04:43:56 # export KARAF_SYSTEM_OPTS # First citizen Karaf options 04:43:56 # export KARAF_OPTS # Additional available Karaf options 04:43:56 # export KARAF_DEBUG # Enable debug mode 04:43:56 # export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start 04:43:56 # export KARAF_NOROOT # Prevent execution as root if set to true 04:43:56 Set Java version 04:43:56 + echo 'Set Java version' 04:43:56 + sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-17-openjdk/bin/java 1 04:43:56 + sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-17-openjdk/bin/java 04:43:56 JDK default version ... 04:43:56 + echo 'JDK default version ...' 04:43:56 + java -version 04:43:56 openjdk version "17.0.6-ea" 2023-01-17 LTS 04:43:56 OpenJDK Runtime Environment (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS) 04:43:56 OpenJDK 64-Bit Server VM (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS, mixed mode, sharing) 04:43:56 Set JAVA_HOME 04:43:56 + echo 'Set JAVA_HOME' 04:43:56 + export JAVA_HOME=/usr/lib/jvm/java-17-openjdk 04:43:56 + JAVA_HOME=/usr/lib/jvm/java-17-openjdk 04:43:56 ++ readlink -e /usr/lib/jvm/java-17-openjdk/bin/java 04:43:56 Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java 04:43:56 Listing all open ports on controller system... 04:43:56 + JAVA_RESOLVED=/usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java 04:43:56 + echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java' 04:43:56 + echo 'Listing all open ports on controller system...' 04:43:56 + netstat -pnatu 04:43:56 (Not all processes could be identified, non-owned process info 04:43:56 will not be shown, you would have to be root to see it all.) 04:43:56 Active Internet connections (servers and established) 04:43:56 Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name 04:43:56 tcp 0 0 0.0.0.0:111 0.0.0.0:* LISTEN - 04:43:56 tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN - 04:43:56 tcp 0 164 10.30.170.215:22 10.30.171.66:36840 ESTABLISHED - 04:43:56 tcp 0 0 10.30.170.215:45884 199.204.45.87:443 TIME_WAIT - 04:43:56 tcp6 0 0 :::111 :::* LISTEN - 04:43:56 tcp6 0 0 :::5555 :::* LISTEN - 04:43:56 tcp6 0 0 :::22 :::* LISTEN - 04:43:56 udp 0 0 10.30.170.215:68 10.30.170.4:67 ESTABLISHED - 04:43:56 udp 0 0 0.0.0.0:111 0.0.0.0:* - 04:43:56 udp 0 0 127.0.0.1:323 0.0.0.0:* - 04:43:56 udp6 0 0 :::111 :::* - 04:43:56 udp6 0 0 ::1:323 :::* - 04:43:56 Configuring cluster 04:43:56 + '[' -f /tmp/custom_shard_config.txt ']' 04:43:56 + echo 'Configuring cluster' 04:43:56 + /tmp/karaf-0.20.0/bin/configure_cluster.sh 1 10.30.170.215 10.30.171.16 10.30.170.254 04:43:56 ################################################ 04:43:56 ## Configure Cluster ## 04:43:56 ################################################ 04:43:56 NOTE: Cluster configuration files not found. Copying from 04:43:56 /tmp/karaf-0.20.0/system/org/opendaylight/controller/sal-clustering-config/8.0.4 04:43:56 Configuring unique name in akka.conf 04:43:56 Configuring hostname in akka.conf 04:43:56 Configuring data and rpc seed nodes in akka.conf 04:43:56 modules = [ 04:43:56 04:43:56 { 04:43:56 name = "inventory" 04:43:56 namespace = "urn:opendaylight:inventory" 04:43:56 shard-strategy = "module" 04:43:56 }, 04:43:56 { 04:43:56 name = "topology" 04:43:56 namespace = "urn:TBD:params:xml:ns:yang:network-topology" 04:43:56 shard-strategy = "module" 04:43:56 }, 04:43:56 { 04:43:56 name = "toaster" 04:43:56 namespace = "http://netconfcentral.org/ns/toaster" 04:43:56 shard-strategy = "module" 04:43:56 } 04:43:56 ] 04:43:56 Configuring replication type in module-shards.conf 04:43:56 ################################################ 04:43:56 ## NOTE: Manually restart controller to ## 04:43:56 ## apply configuration. ## 04:43:56 ################################################ 04:43:56 Dump akka.conf 04:43:56 + echo 'Dump akka.conf' 04:43:56 + cat /tmp/karaf-0.20.0/configuration/initial/akka.conf 04:43:56 04:43:56 odl-cluster-data { 04:43:56 akka { 04:43:56 remote { 04:43:56 artery { 04:43:56 enabled = on 04:43:56 transport = tcp 04:43:56 canonical.hostname = "10.30.170.215" 04:43:56 canonical.port = 2550 04:43:56 } 04:43:56 } 04:43:56 04:43:56 cluster { 04:43:56 # Using artery. 04:43:56 seed-nodes = ["akka://opendaylight-cluster-data@10.30.170.215:2550", 04:43:56 "akka://opendaylight-cluster-data@10.30.171.16:2550", 04:43:56 "akka://opendaylight-cluster-data@10.30.170.254:2550"] 04:43:56 04:43:56 roles = ["member-1"] 04:43:56 04:43:56 # when under load we might trip a false positive on the failure detector 04:43:56 # failure-detector { 04:43:56 # heartbeat-interval = 4 s 04:43:56 # acceptable-heartbeat-pause = 16s 04:43:56 # } 04:43:56 } 04:43:56 04:43:56 persistence { 04:43:56 # By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by 04:43:56 # modifying the following two properties. The directory location specified may be a relative or absolute path. 04:43:56 # The relative path is always relative to KARAF_HOME. 04:43:56 04:43:56 # snapshot-store.local.dir = "target/snapshots" 04:43:56 04:43:56 # Use lz4 compression for LocalSnapshotStore snapshots 04:43:56 snapshot-store.local.use-lz4-compression = false 04:43:56 # Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB 04:43:56 snapshot-store.local.lz4-blocksize = 256KB 04:43:56 } 04:43:56 disable-default-actor-system-quarantined-event-handling = "false" 04:43:56 } 04:43:56 } 04:43:56 Dump modules.conf 04:43:56 + echo 'Dump modules.conf' 04:43:56 + cat /tmp/karaf-0.20.0/configuration/initial/modules.conf 04:43:56 modules = [ 04:43:56 04:43:56 { 04:43:56 name = "inventory" 04:43:56 namespace = "urn:opendaylight:inventory" 04:43:56 shard-strategy = "module" 04:43:56 }, 04:43:56 { 04:43:56 name = "topology" 04:43:56 namespace = "urn:TBD:params:xml:ns:yang:network-topology" 04:43:56 shard-strategy = "module" 04:43:56 }, 04:43:56 { 04:43:56 name = "toaster" 04:43:56 namespace = "http://netconfcentral.org/ns/toaster" 04:43:56 shard-strategy = "module" 04:43:56 } 04:43:56 ] 04:43:56 Dump module-shards.conf 04:43:56 + echo 'Dump module-shards.conf' 04:43:56 + cat /tmp/karaf-0.20.0/configuration/initial/module-shards.conf 04:43:56 module-shards = [ 04:43:56 { 04:43:56 name = "default" 04:43:56 shards = [ 04:43:56 { 04:43:56 name = "default" 04:43:56 replicas = ["member-1", 04:43:56 "member-2", 04:43:56 "member-3"] 04:43:56 } 04:43:56 ] 04:43:56 }, 04:43:56 { 04:43:56 name = "inventory" 04:43:56 shards = [ 04:43:56 { 04:43:56 name="inventory" 04:43:56 replicas = ["member-1", 04:43:56 "member-2", 04:43:56 "member-3"] 04:43:56 } 04:43:56 ] 04:43:56 }, 04:43:56 { 04:43:56 name = "topology" 04:43:56 shards = [ 04:43:56 { 04:43:56 name="topology" 04:43:56 replicas = ["member-1", 04:43:56 "member-2", 04:43:56 "member-3"] 04:43:56 } 04:43:56 ] 04:43:56 }, 04:43:56 { 04:43:56 name = "toaster" 04:43:56 shards = [ 04:43:56 { 04:43:56 name="toaster" 04:43:56 replicas = ["member-1", 04:43:56 "member-2", 04:43:56 "member-3"] 04:43:56 } 04:43:56 ] 04:43:56 } 04:43:56 ] 04:43:56 Configuring member-2 with IP address 10.30.171.16 04:43:56 Warning: Permanently added '10.30.171.16' (ECDSA) to the list of known hosts. 04:43:56 Warning: Permanently added '10.30.171.16' (ECDSA) to the list of known hosts. 04:43:57 common-functions.sh is being sourced 04:43:57 + source /tmp/common-functions.sh karaf-0.20.0 04:43:57 ++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]] 04:43:57 ++ echo 'common-functions.sh is being sourced' 04:43:57 ++ BUNDLEFOLDER=karaf-0.20.0 04:43:57 ++ export MAVENCONF=/tmp/karaf-0.20.0/etc/org.ops4j.pax.url.mvn.cfg 04:43:57 ++ MAVENCONF=/tmp/karaf-0.20.0/etc/org.ops4j.pax.url.mvn.cfg 04:43:57 ++ export FEATURESCONF=/tmp/karaf-0.20.0/etc/org.apache.karaf.features.cfg 04:43:57 ++ FEATURESCONF=/tmp/karaf-0.20.0/etc/org.apache.karaf.features.cfg 04:43:57 ++ export CUSTOMPROP=/tmp/karaf-0.20.0/etc/custom.properties 04:43:57 ++ CUSTOMPROP=/tmp/karaf-0.20.0/etc/custom.properties 04:43:57 ++ export LOGCONF=/tmp/karaf-0.20.0/etc/org.ops4j.pax.logging.cfg 04:43:57 ++ LOGCONF=/tmp/karaf-0.20.0/etc/org.ops4j.pax.logging.cfg 04:43:57 ++ export MEMCONF=/tmp/karaf-0.20.0/bin/setenv 04:43:57 ++ MEMCONF=/tmp/karaf-0.20.0/bin/setenv 04:43:57 ++ export CONTROLLERMEM= 04:43:57 ++ CONTROLLERMEM= 04:43:57 ++ export AKKACONF=/tmp/karaf-0.20.0/configuration/initial/akka.conf 04:43:57 ++ AKKACONF=/tmp/karaf-0.20.0/configuration/initial/akka.conf 04:43:57 ++ export MODULESCONF=/tmp/karaf-0.20.0/configuration/initial/modules.conf 04:43:57 ++ MODULESCONF=/tmp/karaf-0.20.0/configuration/initial/modules.conf 04:43:57 ++ export MODULESHARDSCONF=/tmp/karaf-0.20.0/configuration/initial/module-shards.conf 04:43:57 ++ MODULESHARDSCONF=/tmp/karaf-0.20.0/configuration/initial/module-shards.conf 04:43:57 ++ print_common_env 04:43:57 ++ cat 04:43:57 common-functions environment: 04:43:57 MAVENCONF: /tmp/karaf-0.20.0/etc/org.ops4j.pax.url.mvn.cfg 04:43:57 ACTUALFEATURES: 04:43:57 FEATURESCONF: /tmp/karaf-0.20.0/etc/org.apache.karaf.features.cfg 04:43:57 CUSTOMPROP: /tmp/karaf-0.20.0/etc/custom.properties 04:43:57 LOGCONF: /tmp/karaf-0.20.0/etc/org.ops4j.pax.logging.cfg 04:43:57 MEMCONF: /tmp/karaf-0.20.0/bin/setenv 04:43:57 CONTROLLERMEM: 04:43:57 AKKACONF: /tmp/karaf-0.20.0/configuration/initial/akka.conf 04:43:57 MODULESCONF: /tmp/karaf-0.20.0/configuration/initial/modules.conf 04:43:57 MODULESHARDSCONF: /tmp/karaf-0.20.0/configuration/initial/module-shards.conf 04:43:57 SUITES: 04:43:57 04:43:57 ++ SSH='ssh -t -t' 04:43:57 ++ extra_services_cntl=' dnsmasq.service httpd.service libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service rabbitmq-server.service ' 04:43:57 ++ extra_services_cmp=' libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service ' 04:43:57 Changing to /tmp 04:43:57 Downloading the distribution from https://nexus.opendaylight.org/content/repositories//autorelease-7523/org/opendaylight/integration/karaf/0.20.0/karaf-0.20.0.zip 04:43:57 + echo 'Changing to /tmp' 04:43:57 + cd /tmp 04:43:57 + echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories//autorelease-7523/org/opendaylight/integration/karaf/0.20.0/karaf-0.20.0.zip' 04:43:57 + wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories//autorelease-7523/org/opendaylight/integration/karaf/0.20.0/karaf-0.20.0.zip 04:43:57 --2024-02-08 04:43:57-- https://nexus.opendaylight.org/content/repositories//autorelease-7523/org/opendaylight/integration/karaf/0.20.0/karaf-0.20.0.zip 04:43:57 Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6 04:43:57 Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected. 04:43:57 HTTP request sent, awaiting response... 200 OK 04:43:57 Length: 231881313 (221M) [application/zip] 04:43:57 Saving to: ‘karaf-0.20.0.zip’ 04:43:57 04:43:57 0K ........ ........ ........ ........ ........ ........ 1% 68.0M 3s 04:43:57 3072K ........ ........ ........ ........ ........ ........ 2% 98.3M 3s 04:43:57 6144K ........ ........ ........ ........ ........ ........ 4% 101M 2s 04:43:57 9216K ........ ........ ........ ........ ........ ........ 5% 99.1M 2s 04:43:57 12288K ........ ........ ........ ........ ........ ........ 6% 110M 2s 04:43:57 15360K ........ ........ ........ ........ ........ ........ 8% 131M 2s 04:43:57 18432K ........ ........ ........ ........ ........ ........ 9% 130M 2s 04:43:57 21504K ........ ........ ........ ........ ........ ........ 10% 139M 2s 04:43:57 24576K ........ ........ ........ ........ ........ ........ 12% 110M 2s 04:43:57 27648K ........ ........ ........ ........ ........ ........ 13% 93.1M 2s 04:43:57 30720K ........ ........ ........ ........ ........ ........ 14% 124M 2s 04:43:57 33792K ........ ........ ........ ........ ........ ........ 16% 110M 2s 04:43:57 36864K ........ ........ ........ ........ ........ ........ 17% 127M 2s 04:43:57 39936K ........ ........ ........ ........ ........ ........ 18% 136M 2s 04:43:57 43008K ........ ........ ........ ........ ........ ........ 20% 131M 2s 04:43:57 46080K ........ ........ ........ ........ ........ ........ 21% 140M 2s 04:43:57 49152K ........ ........ ........ ........ ........ ........ 23% 121M 2s 04:43:57 52224K ........ ........ ........ ........ ........ ........ 24% 144M 1s 04:43:57 55296K ........ ........ ........ ........ ........ ........ 25% 188M 1s 04:43:57 58368K ........ ........ ........ ........ ........ ........ 27% 236M 1s 04:43:57 61440K ........ ........ ........ ........ ........ ........ 28% 268M 1s 04:43:57 64512K ........ ........ ........ ........ ........ ........ 29% 222M 1s 04:43:57 67584K ........ ........ ........ ........ ........ ........ 31% 186M 1s 04:43:57 70656K ........ ........ ........ ........ ........ ........ 32% 218M 1s 04:43:57 73728K ........ ........ ........ ........ ........ ........ 33% 216M 1s 04:43:57 76800K ........ ........ ........ ........ ........ ........ 35% 203M 1s 04:43:57 79872K ........ ........ ........ ........ ........ ........ 36% 189M 1s 04:43:57 82944K ........ ........ ........ ........ ........ ........ 37% 155M 1s 04:43:57 86016K ........ ........ ........ ........ ........ ........ 39% 159M 1s 04:43:57 89088K ........ ........ ........ ........ ........ ........ 40% 299M 1s 04:43:57 92160K ........ ........ ........ ........ ........ ........ 42% 175M 1s 04:43:57 95232K ........ ........ ........ ........ ........ ........ 43% 162M 1s 04:43:57 98304K ........ ........ ........ ........ ........ ........ 44% 151M 1s 04:43:57 101376K ........ ........ ........ ........ ........ ........ 46% 142M 1s 04:43:57 104448K ........ ........ ........ ........ ........ ........ 47% 161M 1s 04:43:57 107520K ........ ........ ........ ........ ........ ........ 48% 148M 1s 04:43:58 110592K ........ ........ ........ ........ ........ ........ 50% 73.3M 1s 04:43:58 113664K ........ ........ ........ ........ ........ ........ 51% 162M 1s 04:43:58 116736K ........ ........ ........ ........ ........ ........ 52% 213M 1s 04:43:58 119808K ........ ........ ........ ........ ........ ........ 54% 358M 1s 04:43:58 122880K ........ ........ ........ ........ ........ ........ 55% 285M 1s 04:43:58 125952K ........ ........ ........ ........ ........ ........ 56% 174M 1s 04:43:58 129024K ........ ........ ........ ........ ........ ........ 58% 203M 1s 04:43:58 132096K ........ ........ ........ ........ ........ ........ 59% 134M 1s 04:43:58 135168K ........ ........ ........ ........ ........ ........ 61% 108M 1s 04:43:58 138240K ........ ........ ........ ........ ........ ........ 62% 49.9M 1s 04:43:58 141312K ........ ........ ........ ........ ........ ........ 63% 234M 1s 04:43:58 144384K ........ ........ ........ ........ ........ ........ 65% 290M 1s 04:43:58 147456K ........ ........ ........ ........ ........ ........ 66% 207M 1s 04:43:58 150528K ........ ........ ........ ........ ........ ........ 67% 172M 1s 04:43:58 153600K ........ ........ ........ ........ ........ ........ 69% 236M 0s 04:43:58 156672K ........ ........ ........ ........ ........ ........ 70% 265M 0s 04:43:58 159744K ........ ........ ........ ........ ........ ........ 71% 294M 0s 04:43:58 162816K ........ ........ ........ ........ ........ ........ 73% 262M 0s 04:43:58 165888K ........ ........ ........ ........ ........ ........ 74% 284M 0s 04:43:58 168960K ........ ........ ........ ........ ........ ........ 75% 308M 0s 04:43:58 172032K ........ ........ ........ ........ ........ ........ 77% 321M 0s 04:43:58 175104K ........ ........ ........ ........ ........ ........ 78% 292M 0s 04:43:58 178176K ........ ........ ........ ........ ........ ........ 80% 299M 0s 04:43:58 181248K ........ ........ ........ ........ ........ ........ 81% 340M 0s 04:43:58 184320K ........ ........ ........ ........ ........ ........ 82% 312M 0s 04:43:58 187392K ........ ........ ........ ........ ........ ........ 84% 338M 0s 04:43:58 190464K ........ ........ ........ ........ ........ ........ 85% 332M 0s 04:43:58 193536K ........ ........ ........ ........ ........ ........ 86% 306M 0s 04:43:58 196608K ........ ........ ........ ........ ........ ........ 88% 344M 0s 04:43:58 199680K ........ ........ ........ ........ ........ ........ 89% 334M 0s 04:43:58 202752K ........ ........ ........ ........ ........ ........ 90% 331M 0s 04:43:58 205824K ........ ........ ........ ........ ........ ........ 92% 332M 0s 04:43:58 208896K ........ ........ ........ ........ ........ ........ 93% 330M 0s 04:43:58 211968K ........ ........ ........ ........ ........ ........ 94% 341M 0s 04:43:58 215040K ........ ........ ........ ........ ........ ........ 96% 339M 0s 04:43:58 218112K ........ ........ ........ ........ ........ ........ 97% 330M 0s 04:43:58 221184K ........ ........ ........ ........ ........ ........ 99% 344M 0s 04:43:58 224256K ........ ........ ........ ........ .. 100% 294M=1.3s 04:43:58 04:43:58 2024-02-08 04:43:58 (172 MB/s) - ‘karaf-0.20.0.zip’ saved [231881313/231881313] 04:43:58 04:43:58 Extracting the new controller... 04:43:58 + echo 'Extracting the new controller...' 04:43:58 + unzip -q karaf-0.20.0.zip 04:44:00 Adding external repositories... 04:44:00 + echo 'Adding external repositories...' 04:44:00 + sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.20.0/etc/org.ops4j.pax.url.mvn.cfg 04:44:00 + cat /tmp/karaf-0.20.0/etc/org.ops4j.pax.url.mvn.cfg 04:44:00 ################################################################################ 04:44:00 # 04:44:00 # Licensed to the Apache Software Foundation (ASF) under one or more 04:44:00 # contributor license agreements. See the NOTICE file distributed with 04:44:00 # this work for additional information regarding copyright ownership. 04:44:00 # The ASF licenses this file to You under the Apache License, Version 2.0 04:44:00 # (the "License"); you may not use this file except in compliance with 04:44:00 # the License. You may obtain a copy of the License at 04:44:00 # 04:44:00 # http://www.apache.org/licenses/LICENSE-2.0 04:44:00 # 04:44:00 # Unless required by applicable law or agreed to in writing, software 04:44:00 # distributed under the License is distributed on an "AS IS" BASIS, 04:44:00 # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. 04:44:00 # See the License for the specific language governing permissions and 04:44:00 # limitations under the License. 04:44:00 # 04:44:00 ################################################################################ 04:44:00 04:44:00 # 04:44:00 # If set to true, the following property will not allow any certificate to be used 04:44:00 # when accessing Maven repositories through SSL 04:44:00 # 04:44:00 #org.ops4j.pax.url.mvn.certificateCheck= 04:44:00 04:44:00 # 04:44:00 # Path to the local Maven settings file. 04:44:00 # The repositories defined in this file will be automatically added to the list 04:44:00 # of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property 04:44:00 # below is not set. 04:44:00 # The following locations are checked for the existence of the settings.xml file 04:44:00 # * 1. looks for the specified url 04:44:00 # * 2. if not found looks for ${user.home}/.m2/settings.xml 04:44:00 # * 3. if not found looks for ${maven.home}/conf/settings.xml 04:44:00 # * 4. if not found looks for ${M2_HOME}/conf/settings.xml 04:44:00 # 04:44:00 #org.ops4j.pax.url.mvn.settings= 04:44:00 04:44:00 # 04:44:00 # Path to the local Maven repository which is used to avoid downloading 04:44:00 # artifacts when they already exist locally. 04:44:00 # The value of this property will be extracted from the settings.xml file 04:44:00 # above, or defaulted to: 04:44:00 # System.getProperty( "user.home" ) + "/.m2/repository" 04:44:00 # 04:44:00 org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository} 04:44:00 04:44:00 # 04:44:00 # Default this to false. It's just weird to use undocumented repos 04:44:00 # 04:44:00 org.ops4j.pax.url.mvn.useFallbackRepositories=false 04:44:00 04:44:00 # 04:44:00 # Uncomment if you don't wanna use the proxy settings 04:44:00 # from the Maven conf/settings.xml file 04:44:00 # 04:44:00 # org.ops4j.pax.url.mvn.proxySupport=false 04:44:00 04:44:00 # 04:44:00 # Comma separated list of repositories scanned when resolving an artifact. 04:44:00 # Those repositories will be checked before iterating through the 04:44:00 # below list of repositories and even before the local repository 04:44:00 # A repository url can be appended with zero or more of the following flags: 04:44:00 # @snapshots : the repository contains snaphots 04:44:00 # @noreleases : the repository does not contain any released artifacts 04:44:00 # 04:44:00 # The following property value will add the system folder as a repo. 04:44:00 # 04:44:00 org.ops4j.pax.url.mvn.defaultRepositories=\ 04:44:00 file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\ 04:44:00 file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\ 04:44:00 file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots 04:44:00 04:44:00 # Use the default local repo (e.g.~/.m2/repository) as a "remote" repo 04:44:00 #org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false 04:44:00 04:44:00 # 04:44:00 # Comma separated list of repositories scanned when resolving an artifact. 04:44:00 # The default list includes the following repositories: 04:44:00 # http://repo1.maven.org/maven2@id=central 04:44:00 # http://repository.springsource.com/maven/bundles/release@id=spring.ebr 04:44:00 # http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external 04:44:00 # http://zodiac.springsource.com/maven/bundles/release@id=gemini 04:44:00 # http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases 04:44:00 # https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases 04:44:00 # https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases 04:44:00 # To add repositories to the default ones, prepend '+' to the list of repositories 04:44:00 # to add. 04:44:00 # A repository url can be appended with zero or more of the following flags: 04:44:00 # @snapshots : the repository contains snapshots 04:44:00 # @noreleases : the repository does not contain any released artifacts 04:44:00 # @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended 04:44:00 # 04:44:00 org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases 04:44:00 04:44:00 ### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.Configuring the startup features... 04:44:00 + [[ True == \T\r\u\e ]] 04:44:00 + echo 'Configuring the startup features...' 04:44:00 + sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-infrautils-ready,odl-jolokia,odl-openflowplugin-flow-services-rest,odl-openflowplugin-app-bulk-o-matic,/g' /tmp/karaf-0.20.0/etc/org.apache.karaf.features.cfg 04:44:00 + FEATURE_TEST_STRING=features-test 04:44:00 + FEATURE_TEST_VERSION=0.20.0 04:44:00 + KARAF_VERSION=karaf4 04:44:00 + [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]] 04:44:00 + sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.20.0/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.20.0/etc/org.apache.karaf.features.cfg 04:44:00 + [[ ! -z '' ]] 04:44:00 + cat /tmp/karaf-0.20.0/etc/org.apache.karaf.features.cfg 04:44:00 ################################################################################ 04:44:00 # 04:44:00 # Licensed to the Apache Software Foundation (ASF) under one or more 04:44:00 # contributor license agreements. See the NOTICE file distributed with 04:44:00 # this work for additional information regarding copyright ownership. 04:44:00 # The ASF licenses this file to You under the Apache License, Version 2.0 04:44:00 # (the "License"); you may not use this file except in compliance with 04:44:00 # the License. You may obtain a copy of the License at 04:44:00 # 04:44:00 # http://www.apache.org/licenses/LICENSE-2.0 04:44:00 # 04:44:00 # Unless required by applicable law or agreed to in writing, software 04:44:00 # distributed under the License is distributed on an "AS IS" BASIS, 04:44:00 # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. 04:44:00 # See the License for the specific language governing permissions and 04:44:00 # limitations under the License. 04:44:00 # 04:44:00 ################################################################################ 04:44:00 04:44:00 # 04:44:00 # Comma separated list of features repositories to register by default 04:44:00 # 04:44:00 featuresRepositories = mvn:org.opendaylight.integration/features-test/0.20.0/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/6f998722-40c8-4c0d-90c2-67a89cfdff36.xml 04:44:00 04:44:00 # 04:44:00 # Comma separated list of features to install at startup 04:44:00 # 04:44:00 featuresBoot = odl-infrautils-ready,odl-jolokia,odl-openflowplugin-flow-services-rest,odl-openflowplugin-app-bulk-o-matic, 737bc17c-9f81-469b-8a78-921ab894418d 04:44:00 04:44:00 # 04:44:00 # Resource repositories (OBR) that the features resolver can use 04:44:00 # to resolve requirements/capabilities 04:44:00 # 04:44:00 # The format of the resourceRepositories is 04:44:00 # resourceRepositories=[xml:url|json:url],... 04:44:00 # for Instance: 04:44:00 # 04:44:00 #resourceRepositories=xml:http://host/path/to/index.xml 04:44:00 # or 04:44:00 #resourceRepositories=json:http://host/path/to/index.json 04:44:00 # 04:44:00 04:44:00 # 04:44:00 # Defines if the boot features are started in asynchronous mode (in a dedicated thread) 04:44:00 # 04:44:00 featuresBootAsynchronous=false 04:44:00 04:44:00 # 04:44:00 # Service requirements enforcement 04:44:00 # 04:44:00 # By default, the feature resolver checks the service requirements/capabilities of 04:44:00 # bundles for new features (xml schema >= 1.3.0) in order to automatically installs 04:44:00 # the required bundles. 04:44:00 # The following flag can have those values: 04:44:00 # - disable: service requirements are completely ignored 04:44:00 # - default: service requirements are ignored for old features 04:44:00 # - enforce: service requirements are always verified 04:44:00 # 04:44:00 #serviceRequirements=default 04:44:00 04:44:00 # 04:44:00 # Store cfg file for config element in feature 04:44:00 # 04:44:00 #configCfgStore=true 04:44:00 04:44:00 # 04:44:00 # Define if the feature service automatically refresh bundles 04:44:00 # 04:44:00 autoRefresh=true 04:44:00 04:44:00 # 04:44:00 # Configuration of features processing mechanism (overrides, blacklisting, modification of features) 04:44:00 # XML file defines instructions related to features processing 04:44:00 # versions.properties may declare properties to resolve placeholders in XML file 04:44:00 # both files are relative to ${karaf.etc} 04:44:00 # 04:44:00 #featureProcessing=org.apache.karaf.features.xml 04:44:00 #featureProcessingVersions=versions.properties 04:44:00 + configure_karaf_log karaf4 '' 04:44:00 + local -r karaf_version=karaf4 04:44:00 + local -r controllerdebugmap= 04:44:00 + local logapi=log4j 04:44:00 + grep log4j2 /tmp/karaf-0.20.0/etc/org.ops4j.pax.logging.cfg 04:44:00 log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n 04:44:00 log4j2.rootLogger.level = INFO 04:44:00 #log4j2.rootLogger.type = asyncRoot 04:44:00 #log4j2.rootLogger.includeLocation = false 04:44:00 log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile 04:44:00 log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi 04:44:00 log4j2.rootLogger.appenderRef.Console.ref = Console 04:44:00 log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter 04:44:00 log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} 04:44:00 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter 04:44:00 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair 04:44:00 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker 04:44:00 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL 04:44:00 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or 04:44:00 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY 04:44:00 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL 04:44:00 log4j2.logger.spifly.name = org.apache.aries.spifly 04:44:00 log4j2.logger.spifly.level = WARN 04:44:00 log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit 04:44:00 log4j2.logger.audit.level = INFO 04:44:00 log4j2.logger.audit.additivity = false 04:44:00 log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile 04:44:00 # Console appender not used by default (see log4j2.rootLogger.appenderRefs) 04:44:00 log4j2.appender.console.type = Console 04:44:00 log4j2.appender.console.name = Console 04:44:00 log4j2.appender.console.layout.type = PatternLayout 04:44:00 log4j2.appender.console.layout.pattern = ${log4j2.pattern} 04:44:00 log4j2.appender.rolling.type = RollingRandomAccessFile 04:44:00 log4j2.appender.rolling.name = RollingFile 04:44:00 log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log 04:44:00 log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i 04:44:00 #log4j2.appender.rolling.immediateFlush = false 04:44:00 log4j2.appender.rolling.append = true 04:44:00 log4j2.appender.rolling.layout.type = PatternLayout 04:44:00 log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} 04:44:00 log4j2.appender.rolling.policies.type = Policies 04:44:00 log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy 04:44:00 log4j2.appender.rolling.policies.size.size = 64MB 04:44:00 log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy 04:44:00 log4j2.appender.rolling.strategy.max = 7 04:44:00 log4j2.appender.audit.type = RollingRandomAccessFile 04:44:00 log4j2.appender.audit.name = AuditRollingFile 04:44:00 log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log 04:44:00 log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i 04:44:00 log4j2.appender.audit.append = true 04:44:00 log4j2.appender.audit.layout.type = PatternLayout 04:44:00 log4j2.appender.audit.layout.pattern = ${log4j2.pattern} 04:44:00 log4j2.appender.audit.policies.type = Policies 04:44:00 log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy 04:44:00 log4j2.appender.audit.policies.size.size = 8MB 04:44:00 log4j2.appender.audit.strategy.type = DefaultRolloverStrategy 04:44:00 log4j2.appender.audit.strategy.max = 7 04:44:00 log4j2.appender.osgi.type = PaxOsgi 04:44:00 log4j2.appender.osgi.name = PaxOsgi 04:44:00 log4j2.appender.osgi.filter = * 04:44:00 #log4j2.logger.aether.name = shaded.org.eclipse.aether 04:44:00 #log4j2.logger.aether.level = TRACE 04:44:00 #log4j2.logger.http-headers.name = shaded.org.apache.http.headers 04:44:00 #log4j2.logger.http-headers.level = DEBUG 04:44:00 #log4j2.logger.maven.name = org.ops4j.pax.url.mvn 04:44:00 #log4j2.logger.maven.level = TRACE 04:44:00 + logapi=log4j2 04:44:00 Configuring the karaf log... karaf_version: karaf4, logapi: log4j2 04:44:00 + echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2' 04:44:00 + '[' log4j2 == log4j2 ']' 04:44:00 + sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.20.0/etc/org.ops4j.pax.logging.cfg 04:44:00 + orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver 04:44:00 + orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver 04:44:00 + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN' 04:44:00 + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN' 04:44:00 controllerdebugmap: 04:44:00 + unset IFS 04:44:00 + echo 'controllerdebugmap: ' 04:44:00 cat /tmp/karaf-0.20.0/etc/org.ops4j.pax.logging.cfg 04:44:00 + '[' -n '' ']' 04:44:00 + echo 'cat /tmp/karaf-0.20.0/etc/org.ops4j.pax.logging.cfg' 04:44:00 + cat /tmp/karaf-0.20.0/etc/org.ops4j.pax.logging.cfg 04:44:00 ################################################################################ 04:44:00 # 04:44:00 # Licensed to the Apache Software Foundation (ASF) under one or more 04:44:00 # contributor license agreements. See the NOTICE file distributed with 04:44:00 # this work for additional information regarding copyright ownership. 04:44:00 # The ASF licenses this file to You under the Apache License, Version 2.0 04:44:00 # (the "License"); you may not use this file except in compliance with 04:44:00 # the License. You may obtain a copy of the License at 04:44:00 # 04:44:00 # http://www.apache.org/licenses/LICENSE-2.0 04:44:00 # 04:44:00 # Unless required by applicable law or agreed to in writing, software 04:44:00 # distributed under the License is distributed on an "AS IS" BASIS, 04:44:00 # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. 04:44:00 # See the License for the specific language governing permissions and 04:44:00 # limitations under the License. 04:44:00 # 04:44:00 ################################################################################ 04:44:00 04:44:00 # Common pattern layout for appenders 04:44:00 log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n 04:44:00 04:44:00 # Root logger 04:44:00 log4j2.rootLogger.level = INFO 04:44:00 # uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library 04:44:00 #log4j2.rootLogger.type = asyncRoot 04:44:00 #log4j2.rootLogger.includeLocation = false 04:44:00 log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile 04:44:00 log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi 04:44:00 log4j2.rootLogger.appenderRef.Console.ref = Console 04:44:00 log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter 04:44:00 log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} 04:44:00 04:44:00 # Filters for logs marked by org.opendaylight.odlparent.Markers 04:44:00 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter 04:44:00 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair 04:44:00 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker 04:44:00 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL 04:44:00 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or 04:44:00 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY 04:44:00 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL 04:44:00 04:44:00 # Loggers configuration 04:44:00 04:44:00 # Spifly logger 04:44:00 log4j2.logger.spifly.name = org.apache.aries.spifly 04:44:00 log4j2.logger.spifly.level = WARN 04:44:00 04:44:00 # Security audit logger 04:44:00 log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit 04:44:00 log4j2.logger.audit.level = INFO 04:44:00 log4j2.logger.audit.additivity = false 04:44:00 log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile 04:44:00 04:44:00 # Appenders configuration 04:44:00 04:44:00 # Console appender not used by default (see log4j2.rootLogger.appenderRefs) 04:44:00 log4j2.appender.console.type = Console 04:44:00 log4j2.appender.console.name = Console 04:44:00 log4j2.appender.console.layout.type = PatternLayout 04:44:00 log4j2.appender.console.layout.pattern = ${log4j2.pattern} 04:44:00 04:44:00 # Rolling file appender 04:44:00 log4j2.appender.rolling.type = RollingRandomAccessFile 04:44:00 log4j2.appender.rolling.name = RollingFile 04:44:00 log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log 04:44:00 log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i 04:44:00 # uncomment to not force a disk flush 04:44:00 #log4j2.appender.rolling.immediateFlush = false 04:44:00 log4j2.appender.rolling.append = true 04:44:00 log4j2.appender.rolling.layout.type = PatternLayout 04:44:00 log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} 04:44:00 log4j2.appender.rolling.policies.type = Policies 04:44:00 log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy 04:44:00 log4j2.appender.rolling.policies.size.size = 1GB 04:44:00 log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy 04:44:00 log4j2.appender.rolling.strategy.max = 7 04:44:00 04:44:00 # Audit file appender 04:44:00 log4j2.appender.audit.type = RollingRandomAccessFile 04:44:00 log4j2.appender.audit.name = AuditRollingFile 04:44:00 log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log 04:44:00 log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i 04:44:00 log4j2.appender.audit.append = true 04:44:00 log4j2.appender.audit.layout.type = PatternLayout 04:44:00 log4j2.appender.audit.layout.pattern = ${log4j2.pattern} 04:44:00 log4j2.appender.audit.policies.type = Policies 04:44:00 log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy 04:44:00 log4j2.appender.audit.policies.size.size = 8MB 04:44:00 log4j2.appender.audit.strategy.type = DefaultRolloverStrategy 04:44:00 log4j2.appender.audit.strategy.max = 7 04:44:00 04:44:00 # OSGi appender 04:44:00 log4j2.appender.osgi.type = PaxOsgi 04:44:00 log4j2.appender.osgi.name = PaxOsgi 04:44:00 log4j2.appender.osgi.filter = * 04:44:00 04:44:00 # help with identification of maven-related problems with pax-url-aether 04:44:00 #log4j2.logger.aether.name = shaded.org.eclipse.aether 04:44:00 #log4j2.logger.aether.level = TRACE 04:44:00 #log4j2.logger.http-headers.name = shaded.org.apache.http.headers 04:44:00 #log4j2.logger.http-headers.level = DEBUG 04:44:00 #log4j2.logger.maven.name = org.ops4j.pax.url.mvn 04:44:00 #log4j2.logger.maven.level = TRACE 04:44:00 log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN 04:44:00 log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN 04:44:00 + set_java_vars /usr/lib/jvm/java-17-openjdk 2048m /tmp/karaf-0.20.0/bin/setenv 04:44:00 + local -r java_home=/usr/lib/jvm/java-17-openjdk 04:44:00 Configure 04:44:00 java home: /usr/lib/jvm/java-17-openjdk 04:44:00 max memory: 2048m 04:44:00 memconf: /tmp/karaf-0.20.0/bin/setenv 04:44:00 + local -r controllermem=2048m 04:44:00 + local -r memconf=/tmp/karaf-0.20.0/bin/setenv 04:44:00 + echo Configure 04:44:00 + echo ' java home: /usr/lib/jvm/java-17-openjdk' 04:44:00 + echo ' max memory: 2048m' 04:44:00 + echo ' memconf: /tmp/karaf-0.20.0/bin/setenv' 04:44:00 + sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk}%g' /tmp/karaf-0.20.0/bin/setenv 04:44:00 + sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=2048m/g' /tmp/karaf-0.20.0/bin/setenv 04:44:00 cat /tmp/karaf-0.20.0/bin/setenv 04:44:00 + echo 'cat /tmp/karaf-0.20.0/bin/setenv' 04:44:00 + cat /tmp/karaf-0.20.0/bin/setenv 04:44:00 #!/bin/sh 04:44:00 # 04:44:00 # Licensed to the Apache Software Foundation (ASF) under one or more 04:44:00 # contributor license agreements. See the NOTICE file distributed with 04:44:00 # this work for additional information regarding copyright ownership. 04:44:00 # The ASF licenses this file to You under the Apache License, Version 2.0 04:44:00 # (the "License"); you may not use this file except in compliance with 04:44:00 # the License. You may obtain a copy of the License at 04:44:00 # 04:44:00 # http://www.apache.org/licenses/LICENSE-2.0 04:44:00 # 04:44:00 # Unless required by applicable law or agreed to in writing, software 04:44:00 # distributed under the License is distributed on an "AS IS" BASIS, 04:44:00 # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. 04:44:00 # See the License for the specific language governing permissions and 04:44:00 # limitations under the License. 04:44:00 # 04:44:00 04:44:00 # 04:44:00 # handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf 04:44:00 # script: client, instance, shell, start, status, stop, karaf 04:44:00 # 04:44:00 # if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then 04:44:00 # Actions go here... 04:44:00 # fi 04:44:00 04:44:00 # 04:44:00 # general settings which should be applied for all scripts go here; please keep 04:44:00 # in mind that it is possible that scripts might be executed more than once, e.g. 04:44:00 # in example of the start script where the start script is executed first and the 04:44:00 # karaf script afterwards. 04:44:00 # 04:44:00 04:44:00 # 04:44:00 # The following section shows the possible configuration options for the default 04:44:00 # karaf scripts 04:44:00 # 04:44:00 export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk} # Location of Java installation 04:44:00 # export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration 04:44:00 # export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options 04:44:00 # export EXTRA_JAVA_OPTS # Additional JVM options 04:44:00 # export KARAF_HOME # Karaf home folder 04:44:00 # export KARAF_DATA # Karaf data folder 04:44:00 # export KARAF_BASE # Karaf base folder 04:44:00 # export KARAF_ETC # Karaf etc folder 04:44:00 # export KARAF_LOG # Karaf log folder 04:44:00 # export KARAF_SYSTEM_OPTS # First citizen Karaf options 04:44:00 # export KARAF_OPTS # Additional available Karaf options 04:44:00 # export KARAF_DEBUG # Enable debug mode 04:44:00 # export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start 04:44:00 # export KARAF_NOROOT # Prevent execution as root if set to true 04:44:00 Set Java version 04:44:00 + echo 'Set Java version' 04:44:00 + sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-17-openjdk/bin/java 1 04:44:00 + sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-17-openjdk/bin/java 04:44:00 JDK default version ... 04:44:00 + echo 'JDK default version ...' 04:44:00 + java -version 04:44:01 openjdk version "17.0.6-ea" 2023-01-17 LTS 04:44:01 OpenJDK Runtime Environment (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS) 04:44:01 OpenJDK 64-Bit Server VM (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS, mixed mode, sharing) 04:44:01 Set JAVA_HOME 04:44:01 + echo 'Set JAVA_HOME' 04:44:01 + export JAVA_HOME=/usr/lib/jvm/java-17-openjdk 04:44:01 + JAVA_HOME=/usr/lib/jvm/java-17-openjdk 04:44:01 ++ readlink -e /usr/lib/jvm/java-17-openjdk/bin/java 04:44:01 Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java 04:44:01 + JAVA_RESOLVED=/usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java 04:44:01 + echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java' 04:44:01 Listing all open ports on controller system... 04:44:01 + echo 'Listing all open ports on controller system...' 04:44:01 + netstat -pnatu 04:44:01 Active Internet connections (servers and established) 04:44:01 Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name 04:44:01 tcp 0 0 0.0.0.0:111 0.0.0.0:* LISTEN - 04:44:01 tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN - 04:44:01 tcp 0 0 10.30.171.16:60770 199.204.45.87:443 TIME_WAIT - 04:44:01 tcp 0 200 10.30.171.16:22 10.30.171.66:59916 ESTABLISHED - 04:44:01 tcp6 0 0 :::111 :::* LISTEN - 04:44:01 tcp6 0 0 :::5555 :::* LISTEN - 04:44:01 tcp6 0 0 :::22 :::* LISTEN - 04:44:01 udp 0 0 10.30.171.16:68 10.30.170.2:67 ESTABLISHED - 04:44:01 udp 0 0 0.0.0.0:111 0.0.0.0:* - 04:44:01 udp 0 0 127.0.0.1:323 0.0.0.0:* - 04:44:01 udp6 0 0 :::111 :::* - 04:44:01 udp6 0 0 ::1:323 :::* - 04:44:01 (Not all processes could be identified, non-owned process info 04:44:01 will not be shown, you would have to be root to see it all.) 04:44:01 Configuring cluster 04:44:01 + '[' -f /tmp/custom_shard_config.txt ']' 04:44:01 + echo 'Configuring cluster' 04:44:01 + /tmp/karaf-0.20.0/bin/configure_cluster.sh 2 10.30.170.215 10.30.171.16 10.30.170.254 04:44:01 ################################################ 04:44:01 ## Configure Cluster ## 04:44:01 ################################################ 04:44:01 NOTE: Cluster configuration files not found. Copying from 04:44:01 /tmp/karaf-0.20.0/system/org/opendaylight/controller/sal-clustering-config/8.0.4 04:44:01 Configuring unique name in akka.conf 04:44:01 Configuring hostname in akka.conf 04:44:01 Configuring data and rpc seed nodes in akka.conf 04:44:01 modules = [ 04:44:01 04:44:01 { 04:44:01 name = "inventory" 04:44:01 namespace = "urn:opendaylight:inventory" 04:44:01 shard-strategy = "module" 04:44:01 }, 04:44:01 { 04:44:01 name = "topology" 04:44:01 namespace = "urn:TBD:params:xml:ns:yang:network-topology" 04:44:01 shard-strategy = "module" 04:44:01 }, 04:44:01 { 04:44:01 name = "toaster" 04:44:01 namespace = "http://netconfcentral.org/ns/toaster" 04:44:01 shard-strategy = "module" 04:44:01 } 04:44:01 ] 04:44:01 Configuring replication type in module-shards.conf 04:44:01 ################################################ 04:44:01 ## NOTE: Manually restart controller to ## 04:44:01 ## apply configuration. ## 04:44:01 ################################################ 04:44:01 Dump akka.conf 04:44:01 + echo 'Dump akka.conf' 04:44:01 + cat /tmp/karaf-0.20.0/configuration/initial/akka.conf 04:44:01 04:44:01 odl-cluster-data { 04:44:01 akka { 04:44:01 remote { 04:44:01 artery { 04:44:01 enabled = on 04:44:01 transport = tcp 04:44:01 canonical.hostname = "10.30.171.16" 04:44:01 canonical.port = 2550 04:44:01 } 04:44:01 } 04:44:01 04:44:01 cluster { 04:44:01 # Using artery. 04:44:01 seed-nodes = ["akka://opendaylight-cluster-data@10.30.170.215:2550", 04:44:01 "akka://opendaylight-cluster-data@10.30.171.16:2550", 04:44:01 "akka://opendaylight-cluster-data@10.30.170.254:2550"] 04:44:01 04:44:01 roles = ["member-2"] 04:44:01 04:44:01 # when under load we might trip a false positive on the failure detector 04:44:01 # failure-detector { 04:44:01 # heartbeat-interval = 4 s 04:44:01 # acceptable-heartbeat-pause = 16s 04:44:01 # } 04:44:01 } 04:44:01 04:44:01 persistence { 04:44:01 # By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by 04:44:01 # modifying the following two properties. The directory location specified may be a relative or absolute path. 04:44:01 # The relative path is always relative to KARAF_HOME. 04:44:01 04:44:01 # snapshot-store.local.dir = "target/snapshots" 04:44:01 04:44:01 # Use lz4 compression for LocalSnapshotStore snapshots 04:44:01 snapshot-store.local.use-lz4-compression = false 04:44:01 # Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB 04:44:01 snapshot-store.local.lz4-blocksize = 256KB 04:44:01 } 04:44:01 disable-default-actor-system-quarantined-event-handling = "false" 04:44:01 } 04:44:01 } 04:44:01 Dump modules.conf 04:44:01 + echo 'Dump modules.conf' 04:44:01 + cat /tmp/karaf-0.20.0/configuration/initial/modules.conf 04:44:01 modules = [ 04:44:01 04:44:01 { 04:44:01 name = "inventory" 04:44:01 namespace = "urn:opendaylight:inventory" 04:44:01 shard-strategy = "module" 04:44:01 }, 04:44:01 { 04:44:01 name = "topology" 04:44:01 namespace = "urn:TBD:params:xml:ns:yang:network-topology" 04:44:01 shard-strategy = "module" 04:44:01 }, 04:44:01 { 04:44:01 name = "toaster" 04:44:01 namespace = "http://netconfcentral.org/ns/toaster" 04:44:01 shard-strategy = "module" 04:44:01 } 04:44:01 ] 04:44:01 Dump module-shards.conf 04:44:01 + echo 'Dump module-shards.conf' 04:44:01 + cat /tmp/karaf-0.20.0/configuration/initial/module-shards.conf 04:44:01 module-shards = [ 04:44:01 { 04:44:01 name = "default" 04:44:01 shards = [ 04:44:01 { 04:44:01 name = "default" 04:44:01 replicas = ["member-1", 04:44:01 "member-2", 04:44:01 "member-3"] 04:44:01 } 04:44:01 ] 04:44:01 }, 04:44:01 { 04:44:01 name = "inventory" 04:44:01 shards = [ 04:44:01 { 04:44:01 name="inventory" 04:44:01 replicas = ["member-1", 04:44:01 "member-2", 04:44:01 "member-3"] 04:44:01 } 04:44:01 ] 04:44:01 }, 04:44:01 { 04:44:01 name = "topology" 04:44:01 shards = [ 04:44:01 { 04:44:01 name="topology" 04:44:01 replicas = ["member-1", 04:44:01 "member-2", 04:44:01 "member-3"] 04:44:01 } 04:44:01 ] 04:44:01 }, 04:44:01 { 04:44:01 name = "toaster" 04:44:01 shards = [ 04:44:01 { 04:44:01 name="toaster" 04:44:01 replicas = ["member-1", 04:44:01 "member-2", 04:44:01 "member-3"] 04:44:01 } 04:44:01 ] 04:44:01 } 04:44:01 ] 04:44:01 Configuring member-3 with IP address 10.30.170.254 04:44:01 Warning: Permanently added '10.30.170.254' (ECDSA) to the list of known hosts. 04:44:01 Warning: Permanently added '10.30.170.254' (ECDSA) to the list of known hosts. 04:44:01 + source /tmp/common-functions.sh karaf-0.20.0 04:44:01 ++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]] 04:44:01 common-functions.sh is being sourced 04:44:01 ++ echo 'common-functions.sh is being sourced' 04:44:01 ++ BUNDLEFOLDER=karaf-0.20.0 04:44:01 ++ export MAVENCONF=/tmp/karaf-0.20.0/etc/org.ops4j.pax.url.mvn.cfg 04:44:01 ++ MAVENCONF=/tmp/karaf-0.20.0/etc/org.ops4j.pax.url.mvn.cfg 04:44:01 ++ export FEATURESCONF=/tmp/karaf-0.20.0/etc/org.apache.karaf.features.cfg 04:44:01 ++ FEATURESCONF=/tmp/karaf-0.20.0/etc/org.apache.karaf.features.cfg 04:44:01 ++ export CUSTOMPROP=/tmp/karaf-0.20.0/etc/custom.properties 04:44:01 ++ CUSTOMPROP=/tmp/karaf-0.20.0/etc/custom.properties 04:44:01 ++ export LOGCONF=/tmp/karaf-0.20.0/etc/org.ops4j.pax.logging.cfg 04:44:01 ++ LOGCONF=/tmp/karaf-0.20.0/etc/org.ops4j.pax.logging.cfg 04:44:01 ++ export MEMCONF=/tmp/karaf-0.20.0/bin/setenv 04:44:01 ++ MEMCONF=/tmp/karaf-0.20.0/bin/setenv 04:44:01 ++ export CONTROLLERMEM= 04:44:01 ++ CONTROLLERMEM= 04:44:01 ++ export AKKACONF=/tmp/karaf-0.20.0/configuration/initial/akka.conf 04:44:01 ++ AKKACONF=/tmp/karaf-0.20.0/configuration/initial/akka.conf 04:44:01 ++ export MODULESCONF=/tmp/karaf-0.20.0/configuration/initial/modules.conf 04:44:01 ++ MODULESCONF=/tmp/karaf-0.20.0/configuration/initial/modules.conf 04:44:01 ++ export MODULESHARDSCONF=/tmp/karaf-0.20.0/configuration/initial/module-shards.conf 04:44:01 ++ MODULESHARDSCONF=/tmp/karaf-0.20.0/configuration/initial/module-shards.conf 04:44:01 ++ print_common_env 04:44:01 ++ cat 04:44:01 common-functions environment: 04:44:01 MAVENCONF: /tmp/karaf-0.20.0/etc/org.ops4j.pax.url.mvn.cfg 04:44:01 ACTUALFEATURES: 04:44:01 FEATURESCONF: /tmp/karaf-0.20.0/etc/org.apache.karaf.features.cfg 04:44:01 CUSTOMPROP: /tmp/karaf-0.20.0/etc/custom.properties 04:44:01 LOGCONF: /tmp/karaf-0.20.0/etc/org.ops4j.pax.logging.cfg 04:44:01 MEMCONF: /tmp/karaf-0.20.0/bin/setenv 04:44:01 CONTROLLERMEM: 04:44:01 AKKACONF: /tmp/karaf-0.20.0/configuration/initial/akka.conf 04:44:01 MODULESCONF: /tmp/karaf-0.20.0/configuration/initial/modules.conf 04:44:01 MODULESHARDSCONF: /tmp/karaf-0.20.0/configuration/initial/module-shards.conf 04:44:01 SUITES: 04:44:01 04:44:01 ++ SSH='ssh -t -t' 04:44:01 ++ extra_services_cntl=' dnsmasq.service httpd.service libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service rabbitmq-server.service ' 04:44:01 ++ extra_services_cmp=' libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service ' 04:44:01 Changing to /tmp 04:44:01 Downloading the distribution from https://nexus.opendaylight.org/content/repositories//autorelease-7523/org/opendaylight/integration/karaf/0.20.0/karaf-0.20.0.zip 04:44:01 + echo 'Changing to /tmp' 04:44:01 + cd /tmp 04:44:01 + echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories//autorelease-7523/org/opendaylight/integration/karaf/0.20.0/karaf-0.20.0.zip' 04:44:01 + wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories//autorelease-7523/org/opendaylight/integration/karaf/0.20.0/karaf-0.20.0.zip 04:44:01 --2024-02-08 04:44:01-- https://nexus.opendaylight.org/content/repositories//autorelease-7523/org/opendaylight/integration/karaf/0.20.0/karaf-0.20.0.zip 04:44:01 Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6 04:44:01 Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected. 04:44:01 HTTP request sent, awaiting response... 200 OK 04:44:01 Length: 231881313 (221M) [application/zip] 04:44:01 Saving to: ‘karaf-0.20.0.zip’ 04:44:01 04:44:01 0K ........ ........ ........ ........ ........ ........ 1% 16.5M 13s 04:44:02 3072K ........ ........ ........ ........ ........ ........ 2% 100M 8s 04:44:02 6144K ........ ........ ........ ........ ........ ........ 4% 112M 6s 04:44:02 9216K ........ ........ ........ ........ ........ ........ 5% 119M 5s 04:44:02 12288K ........ ........ ........ ........ ........ ........ 6% 112M 4s 04:44:02 15360K ........ ........ ........ ........ ........ ........ 8% 123M 4s 04:44:02 18432K ........ ........ ........ ........ ........ ........ 9% 114M 3s 04:44:02 21504K ........ ........ ........ ........ ........ ........ 10% 136M 3s 04:44:02 24576K ........ ........ ........ ........ ........ ........ 12% 166M 3s 04:44:02 27648K ........ ........ ........ ........ ........ ........ 13% 255M 3s 04:44:02 30720K ........ ........ ........ ........ ........ ........ 14% 363M 2s 04:44:02 33792K ........ ........ ........ ........ ........ ........ 16% 322M 2s 04:44:02 36864K ........ ........ ........ ........ ........ ........ 17% 149M 2s 04:44:02 39936K ........ ........ ........ ........ ........ ........ 18% 164M 2s 04:44:02 43008K ........ ........ ........ ........ ........ ........ 20% 132M 2s 04:44:02 46080K ........ ........ ........ ........ ........ ........ 21% 165M 2s 04:44:02 49152K ........ ........ ........ ........ ........ ........ 23% 156M 2s 04:44:02 52224K ........ ........ ........ ........ ........ ........ 24% 160M 2s 04:44:02 55296K ........ ........ ........ ........ ........ ........ 25% 154M 2s 04:44:02 58368K ........ ........ ........ ........ ........ ........ 27% 163M 2s 04:44:02 61440K ........ ........ ........ ........ ........ ........ 28% 133M 1s 04:44:02 64512K ........ ........ ........ ........ ........ ........ 29% 143M 1s 04:44:02 67584K ........ ........ ........ ........ ........ ........ 31% 146M 1s 04:44:02 70656K ........ ........ ........ ........ ........ ........ 32% 148M 1s 04:44:02 73728K ........ ........ ........ ........ ........ ........ 33% 142M 1s 04:44:02 76800K ........ ........ ........ ........ ........ ........ 35% 173M 1s 04:44:02 79872K ........ ........ ........ ........ ........ ........ 36% 156M 1s 04:44:02 82944K ........ ........ ........ ........ ........ ........ 37% 139M 1s 04:44:02 86016K ........ ........ ........ ........ ........ ........ 39% 174M 1s 04:44:02 89088K ........ ........ ........ ........ ........ ........ 40% 178M 1s 04:44:02 92160K ........ ........ ........ ........ ........ ........ 42% 157M 1s 04:44:02 95232K ........ ........ ........ ........ ........ ........ 43% 165M 1s 04:44:02 98304K ........ ........ ........ ........ ........ ........ 44% 143M 1s 04:44:02 101376K ........ ........ ........ ........ ........ ........ 46% 157M 1s 04:44:02 104448K ........ ........ ........ ........ ........ ........ 47% 201M 1s 04:44:02 107520K ........ ........ ........ ........ ........ ........ 48% 186M 1s 04:44:02 110592K ........ ........ ........ ........ ........ ........ 50% 134M 1s 04:44:02 113664K ........ ........ ........ ........ ........ ........ 51% 165M 1s 04:44:02 116736K ........ ........ ........ ........ ........ ........ 52% 130M 1s 04:44:02 119808K ........ ........ ........ ........ ........ ........ 54% 113M 1s 04:44:02 122880K ........ ........ ........ ........ ........ ........ 55% 267M 1s 04:44:02 125952K ........ ........ ........ ........ ........ ........ 56% 141M 1s 04:44:02 129024K ........ ........ ........ ........ ........ ........ 58% 164M 1s 04:44:02 132096K ........ ........ ........ ........ ........ ........ 59% 158M 1s 04:44:02 135168K ........ ........ ........ ........ ........ ........ 61% 175M 1s 04:44:03 138240K ........ ........ ........ ........ ........ ........ 62% 182M 1s 04:44:03 141312K ........ ........ ........ ........ ........ ........ 63% 179M 1s 04:44:03 144384K ........ ........ ........ ........ ........ ........ 65% 156M 1s 04:44:03 147456K ........ ........ ........ ........ ........ ........ 66% 153M 1s 04:44:03 150528K ........ ........ ........ ........ ........ ........ 67% 157M 1s 04:44:03 153600K ........ ........ ........ ........ ........ ........ 69% 153M 1s 04:44:03 156672K ........ ........ ........ ........ ........ ........ 70% 219M 0s 04:44:03 159744K ........ ........ ........ ........ ........ ........ 71% 312M 0s 04:44:03 162816K ........ ........ ........ ........ ........ ........ 73% 283M 0s 04:44:03 165888K ........ ........ ........ ........ ........ ........ 74% 313M 0s 04:44:03 168960K ........ ........ ........ ........ ........ ........ 75% 242M 0s 04:44:03 172032K ........ ........ ........ ........ ........ ........ 77% 288M 0s 04:44:03 175104K ........ ........ ........ ........ ........ ........ 78% 362M 0s 04:44:03 178176K ........ ........ ........ ........ ........ ........ 80% 352M 0s 04:44:03 181248K ........ ........ ........ ........ ........ ........ 81% 359M 0s 04:44:03 184320K ........ ........ ........ ........ ........ ........ 82% 356M 0s 04:44:03 187392K ........ ........ ........ ........ ........ ........ 84% 358M 0s 04:44:03 190464K ........ ........ ........ ........ ........ ........ 85% 363M 0s 04:44:03 193536K ........ ........ ........ ........ ........ ........ 86% 348M 0s 04:44:03 196608K ........ ........ ........ ........ ........ ........ 88% 345M 0s 04:44:03 199680K ........ ........ ........ ........ ........ ........ 89% 361M 0s 04:44:03 202752K ........ ........ ........ ........ ........ ........ 90% 347M 0s 04:44:03 205824K ........ ........ ........ ........ ........ ........ 92% 350M 0s 04:44:03 208896K ........ ........ ........ ........ ........ ........ 93% 332M 0s 04:44:03 211968K ........ ........ ........ ........ ........ ........ 94% 358M 0s 04:44:03 215040K ........ ........ ........ ........ ........ ........ 96% 344M 0s 04:44:03 218112K ........ ........ ........ ........ ........ ........ 97% 294M 0s 04:44:03 221184K ........ ........ ........ ........ ........ ........ 99% 331M 0s 04:44:03 224256K ........ ........ ........ ........ .. 100% 294M=1.4s 04:44:03 04:44:03 2024-02-08 04:44:03 (161 MB/s) - ‘karaf-0.20.0.zip’ saved [231881313/231881313] 04:44:03 04:44:03 Extracting the new controller... 04:44:03 + echo 'Extracting the new controller...' 04:44:03 + unzip -q karaf-0.20.0.zip 04:44:05 Adding external repositories... 04:44:05 + echo 'Adding external repositories...' 04:44:05 + sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.20.0/etc/org.ops4j.pax.url.mvn.cfg 04:44:05 + cat /tmp/karaf-0.20.0/etc/org.ops4j.pax.url.mvn.cfg 04:44:05 ################################################################################ 04:44:05 # 04:44:05 # Licensed to the Apache Software Foundation (ASF) under one or more 04:44:05 # contributor license agreements. See the NOTICE file distributed with 04:44:05 # this work for additional information regarding copyright ownership. 04:44:05 # The ASF licenses this file to You under the Apache License, Version 2.0 04:44:05 # (the "License"); you may not use this file except in compliance with 04:44:05 # the License. You may obtain a copy of the License at 04:44:05 # 04:44:05 # http://www.apache.org/licenses/LICENSE-2.0 04:44:05 # 04:44:05 # Unless required by applicable law or agreed to in writing, software 04:44:05 # distributed under the License is distributed on an "AS IS" BASIS, 04:44:05 # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. 04:44:05 # See the License for the specific language governing permissions and 04:44:05 # limitations under the License. 04:44:05 # 04:44:05 ################################################################################ 04:44:05 04:44:05 # 04:44:05 # If set to true, the following property will not allow any certificate to be used 04:44:05 # when accessing Maven repositories through SSL 04:44:05 # 04:44:05 #org.ops4j.pax.url.mvn.certificateCheck= 04:44:05 04:44:05 # 04:44:05 # Path to the local Maven settings file. 04:44:05 # The repositories defined in this file will be automatically added to the list 04:44:05 # of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property 04:44:05 # below is not set. 04:44:05 # The following locations are checked for the existence of the settings.xml file 04:44:05 # * 1. looks for the specified url 04:44:05 # * 2. if not found looks for ${user.home}/.m2/settings.xml 04:44:05 # * 3. if not found looks for ${maven.home}/conf/settings.xml 04:44:05 # * 4. if not found looks for ${M2_HOME}/conf/settings.xml 04:44:05 # 04:44:05 #org.ops4j.pax.url.mvn.settings= 04:44:05 04:44:05 # 04:44:05 # Path to the local Maven repository which is used to avoid downloading 04:44:05 # artifacts when they already exist locally. 04:44:05 # The value of this property will be extracted from the settings.xml file 04:44:05 # above, or defaulted to: 04:44:05 # System.getProperty( "user.home" ) + "/.m2/repository" 04:44:05 # 04:44:05 org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository} 04:44:05 04:44:05 # 04:44:05 # Default this to false. It's just weird to use undocumented repos 04:44:05 # 04:44:05 org.ops4j.pax.url.mvn.useFallbackRepositories=false 04:44:05 04:44:05 # 04:44:05 # Uncomment if you don't wanna use the proxy settings 04:44:05 # from the Maven conf/settings.xml file 04:44:05 # 04:44:05 # org.ops4j.pax.url.mvn.proxySupport=false 04:44:05 04:44:05 # 04:44:05 # Comma separated list of repositories scanned when resolving an artifact. 04:44:05 # Those repositories will be checked before iterating through the 04:44:05 # below list of repositories and even before the local repository 04:44:05 # A repository url can be appended with zero or more of the following flags: 04:44:05 # @snapshots : the repository contains snaphots 04:44:05 # @noreleases : the repository does not contain any released artifacts 04:44:05 # 04:44:05 # The following property value will add the system folder as a repo. 04:44:05 # 04:44:05 org.ops4j.pax.url.mvn.defaultRepositories=\ 04:44:05 file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\ 04:44:05 file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\ 04:44:05 file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots 04:44:05 04:44:05 # Use the default local repo (e.g.~/.m2/repository) as a "remote" repo 04:44:05 #org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false 04:44:05 04:44:05 # 04:44:05 # Comma separated list of repositories scanned when resolving an artifact. 04:44:05 # The default list includes the following repositories: 04:44:05 # http://repo1.maven.org/maven2@id=central 04:44:05 # http://repository.springsource.com/maven/bundles/release@id=spring.ebr 04:44:05 # http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external 04:44:05 # http://zodiac.springsource.com/maven/bundles/release@id=gemini 04:44:05 # http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases 04:44:05 # https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases 04:44:05 # https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases 04:44:05 # To add repositories to the default ones, prepend '+' to the list of repositories 04:44:05 # to add. 04:44:05 # A repository url can be appended with zero or more of the following flags: 04:44:05 # @snapshots : the repository contains snapshots 04:44:05 # @noreleases : the repository does not contain any released artifacts 04:44:05 # @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended 04:44:05 # 04:44:05 org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases 04:44:05 04:44:05 ### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.+ [[ True == \T\r\u\e ]] 04:44:05 Configuring the startup features... 04:44:05 + echo 'Configuring the startup features...' 04:44:05 + sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-infrautils-ready,odl-jolokia,odl-openflowplugin-flow-services-rest,odl-openflowplugin-app-bulk-o-matic,/g' /tmp/karaf-0.20.0/etc/org.apache.karaf.features.cfg 04:44:05 + FEATURE_TEST_STRING=features-test 04:44:05 + FEATURE_TEST_VERSION=0.20.0 04:44:05 + KARAF_VERSION=karaf4 04:44:05 + [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]] 04:44:05 + sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.20.0/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.20.0/etc/org.apache.karaf.features.cfg 04:44:05 + [[ ! -z '' ]] 04:44:05 + cat /tmp/karaf-0.20.0/etc/org.apache.karaf.features.cfg 04:44:05 ################################################################################ 04:44:05 # 04:44:05 # Licensed to the Apache Software Foundation (ASF) under one or more 04:44:05 # contributor license agreements. See the NOTICE file distributed with 04:44:05 # this work for additional information regarding copyright ownership. 04:44:05 # The ASF licenses this file to You under the Apache License, Version 2.0 04:44:05 # (the "License"); you may not use this file except in compliance with 04:44:05 # the License. You may obtain a copy of the License at 04:44:05 # 04:44:05 # http://www.apache.org/licenses/LICENSE-2.0 04:44:05 # 04:44:05 # Unless required by applicable law or agreed to in writing, software 04:44:05 # distributed under the License is distributed on an "AS IS" BASIS, 04:44:05 # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. 04:44:05 # See the License for the specific language governing permissions and 04:44:05 # limitations under the License. 04:44:05 # 04:44:05 ################################################################################ 04:44:05 04:44:05 # 04:44:05 # Comma separated list of features repositories to register by default 04:44:05 # 04:44:05 featuresRepositories = mvn:org.opendaylight.integration/features-test/0.20.0/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/6f998722-40c8-4c0d-90c2-67a89cfdff36.xml 04:44:05 04:44:05 # 04:44:05 # Comma separated list of features to install at startup 04:44:05 # 04:44:05 featuresBoot = odl-infrautils-ready,odl-jolokia,odl-openflowplugin-flow-services-rest,odl-openflowplugin-app-bulk-o-matic, 737bc17c-9f81-469b-8a78-921ab894418d 04:44:05 04:44:05 # 04:44:05 # Resource repositories (OBR) that the features resolver can use 04:44:05 # to resolve requirements/capabilities 04:44:05 # 04:44:05 # The format of the resourceRepositories is 04:44:05 # resourceRepositories=[xml:url|json:url],... 04:44:05 # for Instance: 04:44:05 # 04:44:05 #resourceRepositories=xml:http://host/path/to/index.xml 04:44:05 # or 04:44:05 #resourceRepositories=json:http://host/path/to/index.json 04:44:05 # 04:44:05 04:44:05 # 04:44:05 # Defines if the boot features are started in asynchronous mode (in a dedicated thread) 04:44:05 # 04:44:05 featuresBootAsynchronous=false 04:44:05 04:44:05 # 04:44:05 # Service requirements enforcement 04:44:05 # 04:44:05 # By default, the feature resolver checks the service requirements/capabilities of 04:44:05 # bundles for new features (xml schema >= 1.3.0) in order to automatically installs 04:44:05 # the required bundles. 04:44:05 # The following flag can have those values: 04:44:05 # - disable: service requirements are completely ignored 04:44:05 # - default: service requirements are ignored for old features 04:44:05 # - enforce: service requirements are always verified 04:44:05 # 04:44:05 #serviceRequirements=default 04:44:05 04:44:05 # 04:44:05 # Store cfg file for config element in feature 04:44:05 # 04:44:05 #configCfgStore=true 04:44:05 04:44:05 # 04:44:05 # Define if the feature service automatically refresh bundles 04:44:05 # 04:44:05 autoRefresh=true 04:44:05 04:44:05 # 04:44:05 # Configuration of features processing mechanism (overrides, blacklisting, modification of features) 04:44:05 # XML file defines instructions related to features processing 04:44:05 # versions.properties may declare properties to resolve placeholders in XML file 04:44:05 # both files are relative to ${karaf.etc} 04:44:05 # 04:44:05 #featureProcessing=org.apache.karaf.features.xml 04:44:05 #featureProcessingVersions=versions.properties 04:44:05 + configure_karaf_log karaf4 '' 04:44:05 + local -r karaf_version=karaf4 04:44:05 + local -r controllerdebugmap= 04:44:05 + local logapi=log4j 04:44:05 + grep log4j2 /tmp/karaf-0.20.0/etc/org.ops4j.pax.logging.cfg 04:44:05 log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n 04:44:05 log4j2.rootLogger.level = INFO 04:44:05 #log4j2.rootLogger.type = asyncRoot 04:44:05 #log4j2.rootLogger.includeLocation = false 04:44:05 log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile 04:44:05 log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi 04:44:05 log4j2.rootLogger.appenderRef.Console.ref = Console 04:44:05 log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter 04:44:05 log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} 04:44:05 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter 04:44:05 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair 04:44:05 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker 04:44:05 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL 04:44:05 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or 04:44:05 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY 04:44:05 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL 04:44:05 log4j2.logger.spifly.name = org.apache.aries.spifly 04:44:05 log4j2.logger.spifly.level = WARN 04:44:05 log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit 04:44:05 log4j2.logger.audit.level = INFO 04:44:05 log4j2.logger.audit.additivity = false 04:44:05 log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile 04:44:05 # Console appender not used by default (see log4j2.rootLogger.appenderRefs) 04:44:05 log4j2.appender.console.type = Console 04:44:05 log4j2.appender.console.name = Console 04:44:05 log4j2.appender.console.layout.type = PatternLayout 04:44:05 log4j2.appender.console.layout.pattern = ${log4j2.pattern} 04:44:05 log4j2.appender.rolling.type = RollingRandomAccessFile 04:44:05 log4j2.appender.rolling.name = RollingFile 04:44:05 log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log 04:44:05 log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i 04:44:05 #log4j2.appender.rolling.immediateFlush = false 04:44:05 log4j2.appender.rolling.append = true 04:44:05 log4j2.appender.rolling.layout.type = PatternLayout 04:44:05 log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} 04:44:05 log4j2.appender.rolling.policies.type = Policies 04:44:05 log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy 04:44:05 log4j2.appender.rolling.policies.size.size = 64MB 04:44:05 log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy 04:44:05 log4j2.appender.rolling.strategy.max = 7 04:44:05 log4j2.appender.audit.type = RollingRandomAccessFile 04:44:05 log4j2.appender.audit.name = AuditRollingFile 04:44:05 log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log 04:44:05 log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i 04:44:05 log4j2.appender.audit.append = true 04:44:05 log4j2.appender.audit.layout.type = PatternLayout 04:44:05 log4j2.appender.audit.layout.pattern = ${log4j2.pattern} 04:44:05 log4j2.appender.audit.policies.type = Policies 04:44:05 log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy 04:44:05 log4j2.appender.audit.policies.size.size = 8MB 04:44:05 log4j2.appender.audit.strategy.type = DefaultRolloverStrategy 04:44:05 log4j2.appender.audit.strategy.max = 7 04:44:05 log4j2.appender.osgi.type = PaxOsgi 04:44:05 log4j2.appender.osgi.name = PaxOsgi 04:44:05 log4j2.appender.osgi.filter = * 04:44:05 #log4j2.logger.aether.name = shaded.org.eclipse.aether 04:44:05 #log4j2.logger.aether.level = TRACE 04:44:05 #log4j2.logger.http-headers.name = shaded.org.apache.http.headers 04:44:05 #log4j2.logger.http-headers.level = DEBUG 04:44:05 #log4j2.logger.maven.name = org.ops4j.pax.url.mvn 04:44:05 #log4j2.logger.maven.level = TRACE 04:44:05 + logapi=log4j2 04:44:05 + echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2' 04:44:05 Configuring the karaf log... karaf_version: karaf4, logapi: log4j2 04:44:05 + '[' log4j2 == log4j2 ']' 04:44:05 + sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.20.0/etc/org.ops4j.pax.logging.cfg 04:44:05 + orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver 04:44:05 + orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver 04:44:05 + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN' 04:44:05 + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN' 04:44:05 + unset IFS 04:44:05 controllerdebugmap: 04:44:05 cat /tmp/karaf-0.20.0/etc/org.ops4j.pax.logging.cfg 04:44:05 + echo 'controllerdebugmap: ' 04:44:05 + '[' -n '' ']' 04:44:05 + echo 'cat /tmp/karaf-0.20.0/etc/org.ops4j.pax.logging.cfg' 04:44:05 + cat /tmp/karaf-0.20.0/etc/org.ops4j.pax.logging.cfg 04:44:05 ################################################################################ 04:44:05 # 04:44:05 # Licensed to the Apache Software Foundation (ASF) under one or more 04:44:05 # contributor license agreements. See the NOTICE file distributed with 04:44:05 # this work for additional information regarding copyright ownership. 04:44:05 # The ASF licenses this file to You under the Apache License, Version 2.0 04:44:05 # (the "License"); you may not use this file except in compliance with 04:44:05 # the License. You may obtain a copy of the License at 04:44:05 # 04:44:05 # http://www.apache.org/licenses/LICENSE-2.0 04:44:05 # 04:44:05 # Unless required by applicable law or agreed to in writing, software 04:44:05 # distributed under the License is distributed on an "AS IS" BASIS, 04:44:05 # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. 04:44:05 # See the License for the specific language governing permissions and 04:44:05 # limitations under the License. 04:44:05 # 04:44:05 ################################################################################ 04:44:05 04:44:05 # Common pattern layout for appenders 04:44:05 log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n 04:44:05 04:44:05 # Root logger 04:44:05 log4j2.rootLogger.level = INFO 04:44:05 # uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library 04:44:05 #log4j2.rootLogger.type = asyncRoot 04:44:05 #log4j2.rootLogger.includeLocation = false 04:44:05 log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile 04:44:05 log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi 04:44:05 log4j2.rootLogger.appenderRef.Console.ref = Console 04:44:05 log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter 04:44:05 log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} 04:44:05 04:44:05 # Filters for logs marked by org.opendaylight.odlparent.Markers 04:44:05 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter 04:44:05 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair 04:44:05 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker 04:44:05 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL 04:44:05 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or 04:44:05 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY 04:44:05 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL 04:44:05 04:44:05 # Loggers configuration 04:44:05 04:44:05 # Spifly logger 04:44:05 log4j2.logger.spifly.name = org.apache.aries.spifly 04:44:05 log4j2.logger.spifly.level = WARN 04:44:05 04:44:05 # Security audit logger 04:44:05 log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit 04:44:05 log4j2.logger.audit.level = INFO 04:44:05 log4j2.logger.audit.additivity = false 04:44:05 log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile 04:44:05 04:44:05 # Appenders configuration 04:44:05 04:44:05 # Console appender not used by default (see log4j2.rootLogger.appenderRefs) 04:44:05 log4j2.appender.console.type = Console 04:44:05 log4j2.appender.console.name = Console 04:44:05 log4j2.appender.console.layout.type = PatternLayout 04:44:05 log4j2.appender.console.layout.pattern = ${log4j2.pattern} 04:44:05 04:44:05 # Rolling file appender 04:44:05 log4j2.appender.rolling.type = RollingRandomAccessFile 04:44:05 log4j2.appender.rolling.name = RollingFile 04:44:05 log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log 04:44:05 log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i 04:44:05 # uncomment to not force a disk flush 04:44:05 #log4j2.appender.rolling.immediateFlush = false 04:44:05 log4j2.appender.rolling.append = true 04:44:05 log4j2.appender.rolling.layout.type = PatternLayout 04:44:05 log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} 04:44:05 log4j2.appender.rolling.policies.type = Policies 04:44:05 log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy 04:44:05 log4j2.appender.rolling.policies.size.size = 1GB 04:44:05 log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy 04:44:05 log4j2.appender.rolling.strategy.max = 7 04:44:05 04:44:05 # Audit file appender 04:44:05 log4j2.appender.audit.type = RollingRandomAccessFile 04:44:05 log4j2.appender.audit.name = AuditRollingFile 04:44:05 log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log 04:44:05 log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i 04:44:05 log4j2.appender.audit.append = true 04:44:05 log4j2.appender.audit.layout.type = PatternLayout 04:44:05 log4j2.appender.audit.layout.pattern = ${log4j2.pattern} 04:44:05 log4j2.appender.audit.policies.type = Policies 04:44:05 log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy 04:44:05 log4j2.appender.audit.policies.size.size = 8MB 04:44:05 log4j2.appender.audit.strategy.type = DefaultRolloverStrategy 04:44:05 log4j2.appender.audit.strategy.max = 7 04:44:05 04:44:05 # OSGi appender 04:44:05 log4j2.appender.osgi.type = PaxOsgi 04:44:05 log4j2.appender.osgi.name = PaxOsgi 04:44:05 log4j2.appender.osgi.filter = * 04:44:05 04:44:05 # help with identification of maven-related problems with pax-url-aether 04:44:05 #log4j2.logger.aether.name = shaded.org.eclipse.aether 04:44:05 #log4j2.logger.aether.level = TRACE 04:44:05 #log4j2.logger.http-headers.name = shaded.org.apache.http.headers 04:44:05 #log4j2.logger.http-headers.level = DEBUG 04:44:05 #log4j2.logger.maven.name = org.ops4j.pax.url.mvn 04:44:05 #log4j2.logger.maven.level = TRACE 04:44:05 log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN 04:44:05 log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN 04:44:05 + set_java_vars /usr/lib/jvm/java-17-openjdk 2048m /tmp/karaf-0.20.0/bin/setenv 04:44:05 + local -r java_home=/usr/lib/jvm/java-17-openjdk 04:44:05 + local -r controllermem=2048m 04:44:05 Configure 04:44:05 java home: /usr/lib/jvm/java-17-openjdk 04:44:05 + local -r memconf=/tmp/karaf-0.20.0/bin/setenv 04:44:05 + echo Configure 04:44:05 + echo ' java home: /usr/lib/jvm/java-17-openjdk' 04:44:05 max memory: 2048m 04:44:05 memconf: /tmp/karaf-0.20.0/bin/setenv 04:44:05 + echo ' max memory: 2048m' 04:44:05 + echo ' memconf: /tmp/karaf-0.20.0/bin/setenv' 04:44:05 + sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk}%g' /tmp/karaf-0.20.0/bin/setenv 04:44:05 + sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=2048m/g' /tmp/karaf-0.20.0/bin/setenv 04:44:05 cat /tmp/karaf-0.20.0/bin/setenv 04:44:05 + echo 'cat /tmp/karaf-0.20.0/bin/setenv' 04:44:05 + cat /tmp/karaf-0.20.0/bin/setenv 04:44:05 #!/bin/sh 04:44:05 # 04:44:05 # Licensed to the Apache Software Foundation (ASF) under one or more 04:44:05 # contributor license agreements. See the NOTICE file distributed with 04:44:05 # this work for additional information regarding copyright ownership. 04:44:05 # The ASF licenses this file to You under the Apache License, Version 2.0 04:44:05 # (the "License"); you may not use this file except in compliance with 04:44:05 # the License. You may obtain a copy of the License at 04:44:05 # 04:44:05 # http://www.apache.org/licenses/LICENSE-2.0 04:44:05 # 04:44:05 # Unless required by applicable law or agreed to in writing, software 04:44:05 # distributed under the License is distributed on an "AS IS" BASIS, 04:44:05 # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. 04:44:05 # See the License for the specific language governing permissions and 04:44:05 # limitations under the License. 04:44:05 # 04:44:05 04:44:05 # 04:44:05 # handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf 04:44:05 # script: client, instance, shell, start, status, stop, karaf 04:44:05 # 04:44:05 # if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then 04:44:05 # Actions go here... 04:44:05 # fi 04:44:05 04:44:05 # 04:44:05 # general settings which should be applied for all scripts go here; please keep 04:44:05 # in mind that it is possible that scripts might be executed more than once, e.g. 04:44:05 # in example of the start script where the start script is executed first and the 04:44:05 # karaf script afterwards. 04:44:05 # 04:44:05 04:44:05 # 04:44:05 # The following section shows the possible configuration options for the default 04:44:05 # karaf scripts 04:44:05 # 04:44:05 export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk} # Location of Java installation 04:44:05 # export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration 04:44:05 # export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options 04:44:05 # export EXTRA_JAVA_OPTS # Additional JVM options 04:44:05 # export KARAF_HOME # Karaf home folder 04:44:05 # export KARAF_DATA # Karaf data folder 04:44:05 # export KARAF_BASE # Karaf base folder 04:44:05 # export KARAF_ETC # Karaf etc folder 04:44:05 # export KARAF_LOG # Karaf log folder 04:44:05 # export KARAF_SYSTEM_OPTS # First citizen Karaf options 04:44:05 # export KARAF_OPTS # Additional available Karaf options 04:44:05 # export KARAF_DEBUG # Enable debug mode 04:44:05 # export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start 04:44:05 # export KARAF_NOROOT # Prevent execution as root if set to true 04:44:05 Set Java version 04:44:05 + echo 'Set Java version' 04:44:05 + sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-17-openjdk/bin/java 1 04:44:05 + sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-17-openjdk/bin/java 04:44:05 JDK default version ... 04:44:05 + echo 'JDK default version ...' 04:44:05 + java -version 04:44:06 openjdk version "17.0.6-ea" 2023-01-17 LTS 04:44:06 OpenJDK Runtime Environment (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS) 04:44:06 OpenJDK 64-Bit Server VM (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS, mixed mode, sharing) 04:44:06 Set JAVA_HOME 04:44:06 + echo 'Set JAVA_HOME' 04:44:06 + export JAVA_HOME=/usr/lib/jvm/java-17-openjdk 04:44:06 + JAVA_HOME=/usr/lib/jvm/java-17-openjdk 04:44:06 ++ readlink -e /usr/lib/jvm/java-17-openjdk/bin/java 04:44:06 Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java 04:44:06 + JAVA_RESOLVED=/usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java 04:44:06 + echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java' 04:44:06 Listing all open ports on controller system... 04:44:06 + echo 'Listing all open ports on controller system...' 04:44:06 + netstat -pnatu 04:44:06 (Not all processes could be identified, non-owned process info 04:44:06 will not be shown, you would have to be root to see it all.) 04:44:06 Active Internet connections (servers and established) 04:44:06 Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name 04:44:06 tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN - 04:44:06 tcp 0 0 0.0.0.0:111 0.0.0.0:* LISTEN - 04:44:06 tcp 0 0 10.30.170.254:22 10.30.171.66:57404 ESTABLISHED - 04:44:06 tcp 0 0 10.30.170.254:37090 199.204.45.87:443 TIME_WAIT - 04:44:06 tcp6 0 0 :::5555 :::* LISTEN - 04:44:06 tcp6 0 0 :::22 :::* LISTEN - 04:44:06 tcp6 0 0 :::111 :::* LISTEN - 04:44:06 udp 0 0 10.30.170.254:68 10.30.170.2:67 ESTABLISHED - 04:44:06 udp 0 0 0.0.0.0:111 0.0.0.0:* - 04:44:06 udp 0 0 127.0.0.1:323 0.0.0.0:* - 04:44:06 udp6 0 0 :::111 :::* - 04:44:06 udp6 0 0 ::1:323 :::* - 04:44:06 + '[' -f /tmp/custom_shard_config.txt ']' 04:44:06 + echo 'Configuring cluster' 04:44:06 Configuring cluster 04:44:06 + /tmp/karaf-0.20.0/bin/configure_cluster.sh 3 10.30.170.215 10.30.171.16 10.30.170.254 04:44:06 ################################################ 04:44:06 ## Configure Cluster ## 04:44:06 ################################################ 04:44:06 NOTE: Cluster configuration files not found. Copying from 04:44:06 /tmp/karaf-0.20.0/system/org/opendaylight/controller/sal-clustering-config/8.0.4 04:44:06 Configuring unique name in akka.conf 04:44:06 Configuring hostname in akka.conf 04:44:06 Configuring data and rpc seed nodes in akka.conf 04:44:06 modules = [ 04:44:06 04:44:06 { 04:44:06 name = "inventory" 04:44:06 namespace = "urn:opendaylight:inventory" 04:44:06 shard-strategy = "module" 04:44:06 }, 04:44:06 { 04:44:06 name = "topology" 04:44:06 namespace = "urn:TBD:params:xml:ns:yang:network-topology" 04:44:06 shard-strategy = "module" 04:44:06 }, 04:44:06 { 04:44:06 name = "toaster" 04:44:06 namespace = "http://netconfcentral.org/ns/toaster" 04:44:06 shard-strategy = "module" 04:44:06 } 04:44:06 ] 04:44:06 Configuring replication type in module-shards.conf 04:44:06 ################################################ 04:44:06 ## NOTE: Manually restart controller to ## 04:44:06 ## apply configuration. ## 04:44:06 ################################################ 04:44:06 Dump akka.conf 04:44:06 + echo 'Dump akka.conf' 04:44:06 + cat /tmp/karaf-0.20.0/configuration/initial/akka.conf 04:44:06 04:44:06 odl-cluster-data { 04:44:06 akka { 04:44:06 remote { 04:44:06 artery { 04:44:06 enabled = on 04:44:06 transport = tcp 04:44:06 canonical.hostname = "10.30.170.254" 04:44:06 canonical.port = 2550 04:44:06 } 04:44:06 } 04:44:06 04:44:06 cluster { 04:44:06 # Using artery. 04:44:06 seed-nodes = ["akka://opendaylight-cluster-data@10.30.170.215:2550", 04:44:06 "akka://opendaylight-cluster-data@10.30.171.16:2550", 04:44:06 "akka://opendaylight-cluster-data@10.30.170.254:2550"] 04:44:06 04:44:06 roles = ["member-3"] 04:44:06 04:44:06 # when under load we might trip a false positive on the failure detector 04:44:06 # failure-detector { 04:44:06 # heartbeat-interval = 4 s 04:44:06 # acceptable-heartbeat-pause = 16s 04:44:06 # } 04:44:06 } 04:44:06 04:44:06 persistence { 04:44:06 # By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by 04:44:06 # modifying the following two properties. The directory location specified may be a relative or absolute path. 04:44:06 # The relative path is always relative to KARAF_HOME. 04:44:06 04:44:06 # snapshot-store.local.dir = "target/snapshots" 04:44:06 04:44:06 # Use lz4 compression for LocalSnapshotStore snapshots 04:44:06 snapshot-store.local.use-lz4-compression = false 04:44:06 # Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB 04:44:06 snapshot-store.local.lz4-blocksize = 256KB 04:44:06 } 04:44:06 disable-default-actor-system-quarantined-event-handling = "false" 04:44:06 } 04:44:06 } 04:44:06 Dump modules.conf 04:44:06 + echo 'Dump modules.conf' 04:44:06 + cat /tmp/karaf-0.20.0/configuration/initial/modules.conf 04:44:06 modules = [ 04:44:06 04:44:06 { 04:44:06 name = "inventory" 04:44:06 namespace = "urn:opendaylight:inventory" 04:44:06 shard-strategy = "module" 04:44:06 }, 04:44:06 { 04:44:06 name = "topology" 04:44:06 namespace = "urn:TBD:params:xml:ns:yang:network-topology" 04:44:06 shard-strategy = "module" 04:44:06 }, 04:44:06 { 04:44:06 name = "toaster" 04:44:06 namespace = "http://netconfcentral.org/ns/toaster" 04:44:06 shard-strategy = "module" 04:44:06 } 04:44:06 ] 04:44:06 Dump module-shards.conf 04:44:06 + echo 'Dump module-shards.conf' 04:44:06 + cat /tmp/karaf-0.20.0/configuration/initial/module-shards.conf 04:44:06 module-shards = [ 04:44:06 { 04:44:06 name = "default" 04:44:06 shards = [ 04:44:06 { 04:44:06 name = "default" 04:44:06 replicas = ["member-1", 04:44:06 "member-2", 04:44:06 "member-3"] 04:44:06 } 04:44:06 ] 04:44:06 }, 04:44:06 { 04:44:06 name = "inventory" 04:44:06 shards = [ 04:44:06 { 04:44:06 name="inventory" 04:44:06 replicas = ["member-1", 04:44:06 "member-2", 04:44:06 "member-3"] 04:44:06 } 04:44:06 ] 04:44:06 }, 04:44:06 { 04:44:06 name = "topology" 04:44:06 shards = [ 04:44:06 { 04:44:06 name="topology" 04:44:06 replicas = ["member-1", 04:44:06 "member-2", 04:44:06 "member-3"] 04:44:06 } 04:44:06 ] 04:44:06 }, 04:44:06 { 04:44:06 name = "toaster" 04:44:06 shards = [ 04:44:06 { 04:44:06 name="toaster" 04:44:06 replicas = ["member-1", 04:44:06 "member-2", 04:44:06 "member-3"] 04:44:06 } 04:44:06 ] 04:44:06 } 04:44:06 ] 04:44:06 Locating config plan to use... 04:44:06 Finished running config plans 04:44:06 Starting member-1 with IP address 10.30.170.215 04:44:06 Warning: Permanently added '10.30.170.215' (ECDSA) to the list of known hosts. 04:44:06 Warning: Permanently added '10.30.170.215' (ECDSA) to the list of known hosts. 04:44:06 Redirecting karaf console output to karaf_console.log 04:44:06 Starting controller... 04:44:06 start: Redirecting Karaf output to /tmp/karaf-0.20.0/data/log/karaf_console.log 04:44:06 Starting member-2 with IP address 10.30.171.16 04:44:06 Warning: Permanently added '10.30.171.16' (ECDSA) to the list of known hosts. 04:44:06 Warning: Permanently added '10.30.171.16' (ECDSA) to the list of known hosts. 04:44:07 Redirecting karaf console output to karaf_console.log 04:44:07 Starting controller... 04:44:07 start: Redirecting Karaf output to /tmp/karaf-0.20.0/data/log/karaf_console.log 04:44:07 Starting member-3 with IP address 10.30.170.254 04:44:07 Warning: Permanently added '10.30.170.254' (ECDSA) to the list of known hosts. 04:44:07 Warning: Permanently added '10.30.170.254' (ECDSA) to the list of known hosts. 04:44:07 Redirecting karaf console output to karaf_console.log 04:44:07 Starting controller... 04:44:07 start: Redirecting Karaf output to /tmp/karaf-0.20.0/data/log/karaf_console.log 04:44:07 [openflowplugin-csit-3node-clustering-bulkomatic-only-calcium] $ /bin/bash /tmp/jenkins5471075832325896055.sh 04:44:07 common-functions.sh is being sourced 04:44:07 common-functions environment: 04:44:07 MAVENCONF: /tmp/karaf-0.20.0/etc/org.ops4j.pax.url.mvn.cfg 04:44:07 ACTUALFEATURES: 04:44:07 FEATURESCONF: /tmp/karaf-0.20.0/etc/org.apache.karaf.features.cfg 04:44:07 CUSTOMPROP: /tmp/karaf-0.20.0/etc/custom.properties 04:44:07 LOGCONF: /tmp/karaf-0.20.0/etc/org.ops4j.pax.logging.cfg 04:44:07 MEMCONF: /tmp/karaf-0.20.0/bin/setenv 04:44:07 CONTROLLERMEM: 2048m 04:44:07 AKKACONF: /tmp/karaf-0.20.0/configuration/initial/akka.conf 04:44:07 MODULESCONF: /tmp/karaf-0.20.0/configuration/initial/modules.conf 04:44:07 MODULESHARDSCONF: /tmp/karaf-0.20.0/configuration/initial/module-shards.conf 04:44:07 SUITES: 04:44:07 04:44:07 + echo '#################################################' 04:44:07 ################################################# 04:44:07 + echo '## Verify Cluster is UP ##' 04:44:07 ## Verify Cluster is UP ## 04:44:07 + echo '#################################################' 04:44:07 ################################################# 04:44:07 + create_post_startup_script 04:44:07 + cat 04:44:07 + copy_and_run_post_startup_script 04:44:07 + seed_index=1 04:44:07 ++ seq 1 3 04:44:07 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") 04:44:07 + CONTROLLERIP=ODL_SYSTEM_1_IP 04:44:07 + echo 'Execute the post startup script on controller 10.30.170.215' 04:44:07 Execute the post startup script on controller 10.30.170.215 04:44:07 + scp /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-calcium/post-startup-script.sh 10.30.170.215:/tmp/ 04:44:07 Warning: Permanently added '10.30.170.215' (ECDSA) to the list of known hosts. 04:44:08 + ssh 10.30.170.215 'bash /tmp/post-startup-script.sh 1' 04:44:08 Warning: Permanently added '10.30.170.215' (ECDSA) to the list of known hosts. 04:44:23 tcp6 0 0 :::8101 :::* LISTEN 04:44:23 Waiting up to 3 minutes for controller to come up, checking every 5 seconds... 04:44:53 2024-02-08T04:44:49,123 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 208 - org.opendaylight.infrautils.ready-api - 6.0.5 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] 04:44:53 Controller is UP 04:44:53 2024-02-08T04:44:49,123 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 208 - org.opendaylight.infrautils.ready-api - 6.0.5 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] 04:44:53 Listing all open ports on controller system... 04:44:53 (Not all processes could be identified, non-owned process info 04:44:53 will not be shown, you would have to be root to see it all.) 04:44:53 Active Internet connections (servers and established) 04:44:53 Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name 04:44:53 tcp 0 0 0.0.0.0:111 0.0.0.0:* LISTEN - 04:44:53 tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN - 04:44:53 tcp 0 164 10.30.170.215:22 10.30.171.66:45320 ESTABLISHED - 04:44:53 tcp 0 0 10.30.170.215:45884 199.204.45.87:443 TIME_WAIT - 04:44:53 tcp6 0 0 :::8101 :::* LISTEN 5754/java 04:44:53 tcp6 0 0 :::6633 :::* LISTEN 5754/java 04:44:53 tcp6 0 0 127.0.0.1:1099 :::* LISTEN 5754/java 04:44:53 tcp6 0 0 :::111 :::* LISTEN - 04:44:53 tcp6 0 0 :::5555 :::* LISTEN - 04:44:53 tcp6 0 0 :::8181 :::* LISTEN 5754/java 04:44:53 tcp6 0 0 127.0.0.1:41013 :::* LISTEN 5754/java 04:44:53 tcp6 0 0 10.30.170.215:2550 :::* LISTEN 5754/java 04:44:53 tcp6 0 0 :::22 :::* LISTEN - 04:44:53 tcp6 0 0 127.0.0.1:44444 :::* LISTEN 5754/java 04:44:53 tcp6 0 0 :::6653 :::* LISTEN 5754/java 04:44:53 tcp6 0 0 10.30.170.215:2550 10.30.170.254:59798 ESTABLISHED 5754/java 04:44:53 tcp6 0 0 127.0.0.1:50218 127.0.0.1:44444 TIME_WAIT - 04:44:53 tcp6 0 0 10.30.170.215:2550 10.30.170.254:59788 ESTABLISHED 5754/java 04:44:53 tcp6 0 0 10.30.170.215:54032 10.30.170.254:2550 ESTABLISHED 5754/java 04:44:53 tcp6 0 0 10.30.170.215:2550 10.30.171.16:44022 ESTABLISHED 5754/java 04:44:53 tcp6 0 0 10.30.170.215:49990 10.30.171.16:2550 ESTABLISHED 5754/java 04:44:53 tcp6 32 0 10.30.170.215:42066 199.204.45.87:443 CLOSE_WAIT 5754/java 04:44:53 tcp6 0 0 127.0.0.1:57256 127.0.0.1:1099 TIME_WAIT - 04:44:53 tcp6 0 0 10.30.170.215:54034 10.30.170.254:2550 ESTABLISHED 5754/java 04:44:53 tcp6 0 0 10.30.170.215:2550 10.30.171.16:44014 ESTABLISHED 5754/java 04:44:53 tcp6 0 0 127.0.0.1:50220 127.0.0.1:44444 TIME_WAIT - 04:44:53 tcp6 0 0 10.30.170.215:49992 10.30.171.16:2550 ESTABLISHED 5754/java 04:44:53 udp 0 0 10.30.170.215:68 10.30.170.4:67 ESTABLISHED - 04:44:53 udp 0 0 0.0.0.0:111 0.0.0.0:* - 04:44:53 udp 0 0 127.0.0.1:323 0.0.0.0:* - 04:44:53 udp6 0 0 :::111 :::* - 04:44:53 udp6 0 0 ::1:323 :::* - 04:44:53 looking for "BindException: Address already in use" in log file 04:44:53 looking for "server is unhealthy" in log file 04:44:53 + '[' 1 == 0 ']' 04:44:53 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") 04:44:53 + CONTROLLERIP=ODL_SYSTEM_2_IP 04:44:53 + echo 'Execute the post startup script on controller 10.30.171.16' 04:44:53 Execute the post startup script on controller 10.30.171.16 04:44:53 + scp /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-calcium/post-startup-script.sh 10.30.171.16:/tmp/ 04:44:53 Warning: Permanently added '10.30.171.16' (ECDSA) to the list of known hosts. 04:44:53 + ssh 10.30.171.16 'bash /tmp/post-startup-script.sh 2' 04:44:53 Warning: Permanently added '10.30.171.16' (ECDSA) to the list of known hosts. 04:44:53 tcp6 0 0 :::8101 :::* LISTEN 04:44:53 Waiting up to 3 minutes for controller to come up, checking every 5 seconds... 04:44:58 2024-02-08T04:44:48,583 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 208 - org.opendaylight.infrautils.ready-api - 6.0.5 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] 04:44:58 Controller is UP 04:44:58 2024-02-08T04:44:48,583 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 208 - org.opendaylight.infrautils.ready-api - 6.0.5 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] 04:44:58 Listing all open ports on controller system... 04:44:58 (Not all processes could be identified, non-owned process info 04:44:58 will not be shown, you would have to be root to see it all.) 04:44:58 Active Internet connections (servers and established) 04:44:58 Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name 04:44:58 tcp 0 0 0.0.0.0:111 0.0.0.0:* LISTEN - 04:44:58 tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN - 04:44:58 tcp 0 164 10.30.171.16:22 10.30.171.66:53090 ESTABLISHED - 04:44:58 tcp 0 0 10.30.171.16:60770 199.204.45.87:443 TIME_WAIT - 04:44:58 tcp6 0 0 :::8101 :::* LISTEN 5749/java 04:44:58 tcp6 0 0 :::6633 :::* LISTEN 5749/java 04:44:58 tcp6 0 0 127.0.0.1:1099 :::* LISTEN 5749/java 04:44:58 tcp6 0 0 :::111 :::* LISTEN - 04:44:58 tcp6 0 0 :::5555 :::* LISTEN - 04:44:58 tcp6 0 0 :::8181 :::* LISTEN 5749/java 04:44:58 tcp6 0 0 10.30.171.16:2550 :::* LISTEN 5749/java 04:44:58 tcp6 0 0 :::22 :::* LISTEN - 04:44:58 tcp6 0 0 127.0.0.1:44444 :::* LISTEN 5749/java 04:44:58 tcp6 0 0 :::6653 :::* LISTEN 5749/java 04:44:58 tcp6 0 0 127.0.0.1:38303 :::* LISTEN 5749/java 04:44:58 tcp6 0 0 10.30.171.16:2550 10.30.170.254:55458 ESTABLISHED 5749/java 04:44:58 tcp6 0 0 127.0.0.1:48216 127.0.0.1:44444 TIME_WAIT - 04:44:58 tcp6 0 0 10.30.171.16:2550 10.30.170.215:49992 ESTABLISHED 5749/java 04:44:58 tcp6 0 0 10.30.171.16:2550 10.30.170.215:49990 ESTABLISHED 5749/java 04:44:58 tcp6 0 0 10.30.171.16:44022 10.30.170.215:2550 ESTABLISHED 5749/java 04:44:58 tcp6 0 0 127.0.0.1:43506 127.0.0.1:1099 TIME_WAIT - 04:44:58 tcp6 0 0 127.0.0.1:48212 127.0.0.1:44444 TIME_WAIT - 04:44:58 tcp6 0 0 10.30.171.16:2550 10.30.170.254:55470 ESTABLISHED 5749/java 04:44:58 tcp6 32 0 10.30.171.16:45906 199.204.45.87:443 CLOSE_WAIT 5749/java 04:44:58 tcp6 0 0 10.30.171.16:45108 10.30.170.254:2550 ESTABLISHED 5749/java 04:44:58 tcp6 0 0 10.30.171.16:45094 10.30.170.254:2550 ESTABLISHED 5749/java 04:44:58 tcp6 0 0 10.30.171.16:44014 10.30.170.215:2550 ESTABLISHED 5749/java 04:44:58 udp 0 0 10.30.171.16:68 10.30.170.2:67 ESTABLISHED - 04:44:58 udp 0 0 0.0.0.0:111 0.0.0.0:* - 04:44:58 udp 0 0 127.0.0.1:323 0.0.0.0:* - 04:44:58 udp6 0 0 :::111 :::* - 04:44:58 udp6 0 0 ::1:323 :::* - 04:44:58 looking for "BindException: Address already in use" in log file 04:44:58 looking for "server is unhealthy" in log file 04:44:58 + '[' 2 == 0 ']' 04:44:58 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") 04:44:58 + CONTROLLERIP=ODL_SYSTEM_3_IP 04:44:58 + echo 'Execute the post startup script on controller 10.30.170.254' 04:44:58 Execute the post startup script on controller 10.30.170.254 04:44:58 + scp /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-calcium/post-startup-script.sh 10.30.170.254:/tmp/ 04:44:58 Warning: Permanently added '10.30.170.254' (ECDSA) to the list of known hosts. 04:44:59 + ssh 10.30.170.254 'bash /tmp/post-startup-script.sh 3' 04:44:59 Warning: Permanently added '10.30.170.254' (ECDSA) to the list of known hosts. 04:44:59 tcp6 0 0 :::8101 :::* LISTEN 04:44:59 Waiting up to 3 minutes for controller to come up, checking every 5 seconds... 04:45:04 2024-02-08T04:44:49,969 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 208 - org.opendaylight.infrautils.ready-api - 6.0.5 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] 04:45:04 Controller is UP 04:45:04 2024-02-08T04:44:49,969 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 208 - org.opendaylight.infrautils.ready-api - 6.0.5 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] 04:45:04 Listing all open ports on controller system... 04:45:04 (Not all processes could be identified, non-owned process info 04:45:04 will not be shown, you would have to be root to see it all.) 04:45:04 Active Internet connections (servers and established) 04:45:04 Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name 04:45:04 tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN - 04:45:04 tcp 0 0 0.0.0.0:111 0.0.0.0:* LISTEN - 04:45:04 tcp 0 164 10.30.170.254:22 10.30.171.66:39078 ESTABLISHED - 04:45:04 tcp 0 0 10.30.170.254:37090 199.204.45.87:443 TIME_WAIT - 04:45:04 tcp6 0 0 :::5555 :::* LISTEN - 04:45:04 tcp6 0 0 :::8181 :::* LISTEN 5757/java 04:45:04 tcp6 0 0 10.30.170.254:2550 :::* LISTEN 5757/java 04:45:04 tcp6 0 0 :::22 :::* LISTEN - 04:45:04 tcp6 0 0 127.0.0.1:44444 :::* LISTEN 5757/java 04:45:04 tcp6 0 0 :::6653 :::* LISTEN 5757/java 04:45:04 tcp6 0 0 :::8101 :::* LISTEN 5757/java 04:45:04 tcp6 0 0 127.0.0.1:42247 :::* LISTEN 5757/java 04:45:04 tcp6 0 0 :::6633 :::* LISTEN 5757/java 04:45:04 tcp6 0 0 127.0.0.1:1099 :::* LISTEN 5757/java 04:45:04 tcp6 0 0 :::111 :::* LISTEN - 04:45:04 tcp6 0 0 10.30.170.254:59798 10.30.170.215:2550 ESTABLISHED 5757/java 04:45:04 tcp6 0 0 10.30.170.254:2550 10.30.171.16:45108 ESTABLISHED 5757/java 04:45:04 tcp6 32 0 10.30.170.254:53424 199.204.45.87:443 CLOSE_WAIT 5757/java 04:45:04 tcp6 0 0 127.0.0.1:35430 127.0.0.1:44444 TIME_WAIT - 04:45:04 tcp6 0 0 127.0.0.1:50354 127.0.0.1:1099 TIME_WAIT - 04:45:04 tcp6 0 0 10.30.170.254:59788 10.30.170.215:2550 ESTABLISHED 5757/java 04:45:04 tcp6 0 0 10.30.170.254:55458 10.30.171.16:2550 ESTABLISHED 5757/java 04:45:04 tcp6 0 0 10.30.170.254:2550 10.30.170.215:54032 ESTABLISHED 5757/java 04:45:04 tcp6 0 0 127.0.0.1:35426 127.0.0.1:44444 TIME_WAIT - 04:45:04 tcp6 0 0 10.30.170.254:2550 10.30.171.16:45094 ESTABLISHED 5757/java 04:45:04 tcp6 0 0 10.30.170.254:55470 10.30.171.16:2550 ESTABLISHED 5757/java 04:45:04 tcp6 0 0 10.30.170.254:2550 10.30.170.215:54034 ESTABLISHED 5757/java 04:45:04 udp 0 0 10.30.170.254:68 10.30.170.2:67 ESTABLISHED - 04:45:04 udp 0 0 0.0.0.0:111 0.0.0.0:* - 04:45:04 udp 0 0 127.0.0.1:323 0.0.0.0:* - 04:45:04 udp6 0 0 :::111 :::* - 04:45:04 udp6 0 0 ::1:323 :::* - 04:45:04 looking for "BindException: Address already in use" in log file 04:45:04 looking for "server is unhealthy" in log file 04:45:04 + '[' 0 == 0 ']' 04:45:04 + seed_index=1 04:45:04 + dump_controller_threads 04:45:04 ++ seq 1 3 04:45:04 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") 04:45:04 + CONTROLLERIP=ODL_SYSTEM_1_IP 04:45:04 + echo 'Let'\''s take the karaf thread dump' 04:45:04 Let's take the karaf thread dump 04:45:04 + ssh 10.30.170.215 'sudo ps aux' 04:45:04 Warning: Permanently added '10.30.170.215' (ECDSA) to the list of known hosts. 04:45:04 ++ grep org.apache.karaf.main.Main /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-calcium/ps_before.log 04:45:04 ++ grep -v grep 04:45:04 ++ tr -s ' ' 04:45:04 ++ cut -f2 '-d ' 04:45:04 + pid=5754 04:45:04 + echo 'karaf main: org.apache.karaf.main.Main, pid:5754' 04:45:04 karaf main: org.apache.karaf.main.Main, pid:5754 04:45:04 + ssh 10.30.170.215 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 5754' 04:45:04 Warning: Permanently added '10.30.170.215' (ECDSA) to the list of known hosts. 04:45:05 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") 04:45:05 + CONTROLLERIP=ODL_SYSTEM_2_IP 04:45:05 + echo 'Let'\''s take the karaf thread dump' 04:45:05 Let's take the karaf thread dump 04:45:05 + ssh 10.30.171.16 'sudo ps aux' 04:45:05 Warning: Permanently added '10.30.171.16' (ECDSA) to the list of known hosts. 04:45:05 ++ grep org.apache.karaf.main.Main /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-calcium/ps_before.log 04:45:05 ++ grep -v grep 04:45:05 ++ tr -s ' ' 04:45:05 ++ cut -f2 '-d ' 04:45:05 + pid=5749 04:45:05 + echo 'karaf main: org.apache.karaf.main.Main, pid:5749' 04:45:05 karaf main: org.apache.karaf.main.Main, pid:5749 04:45:05 + ssh 10.30.171.16 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 5749' 04:45:05 Warning: Permanently added '10.30.171.16' (ECDSA) to the list of known hosts. 04:45:06 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") 04:45:06 + CONTROLLERIP=ODL_SYSTEM_3_IP 04:45:06 + echo 'Let'\''s take the karaf thread dump' 04:45:06 Let's take the karaf thread dump 04:45:06 + ssh 10.30.170.254 'sudo ps aux' 04:45:06 Warning: Permanently added '10.30.170.254' (ECDSA) to the list of known hosts. 04:45:06 ++ tr -s ' ' 04:45:06 ++ grep org.apache.karaf.main.Main /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-calcium/ps_before.log 04:45:06 ++ cut -f2 '-d ' 04:45:06 ++ grep -v grep 04:45:06 + pid=5757 04:45:06 + echo 'karaf main: org.apache.karaf.main.Main, pid:5757' 04:45:06 karaf main: org.apache.karaf.main.Main, pid:5757 04:45:06 + ssh 10.30.170.254 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 5757' 04:45:06 Warning: Permanently added '10.30.170.254' (ECDSA) to the list of known hosts. 04:45:06 + '[' 0 -gt 0 ']' 04:45:06 + echo 'Generating controller variables...' 04:45:06 Generating controller variables... 04:45:06 ++ seq 1 3 04:45:06 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") 04:45:06 + CONTROLLERIP=ODL_SYSTEM_1_IP 04:45:06 + odl_variables=' -v ODL_SYSTEM_1_IP:10.30.170.215' 04:45:06 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") 04:45:06 + CONTROLLERIP=ODL_SYSTEM_2_IP 04:45:06 + odl_variables=' -v ODL_SYSTEM_1_IP:10.30.170.215 -v ODL_SYSTEM_2_IP:10.30.171.16' 04:45:06 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") 04:45:06 + CONTROLLERIP=ODL_SYSTEM_3_IP 04:45:06 + odl_variables=' -v ODL_SYSTEM_1_IP:10.30.170.215 -v ODL_SYSTEM_2_IP:10.30.171.16 -v ODL_SYSTEM_3_IP:10.30.170.254' 04:45:06 + echo 'Generating mininet variables...' 04:45:06 Generating mininet variables... 04:45:06 ++ seq 1 1 04:45:06 + for i in $(seq 1 "${NUM_TOOLS_SYSTEM}") 04:45:06 + MININETIP=TOOLS_SYSTEM_1_IP 04:45:06 + tools_variables=' -v TOOLS_SYSTEM_1_IP:10.30.171.163' 04:45:06 + get_test_suites SUITES 04:45:06 + local __suite_list=SUITES 04:45:06 + echo 'Locating test plan to use...' 04:45:06 Locating test plan to use... 04:45:06 + testplan_filepath=/w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-calcium/test/csit/testplans/openflowplugin-clustering-bulkomatic-calcium.txt 04:45:06 + '[' '!' -f /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-calcium/test/csit/testplans/openflowplugin-clustering-bulkomatic-calcium.txt ']' 04:45:06 + testplan_filepath=/w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-calcium/test/csit/testplans/openflowplugin-clustering-bulkomatic.txt 04:45:06 + '[' disabled '!=' disabled ']' 04:45:06 + echo 'Changing the testplan path...' 04:45:06 Changing the testplan path... 04:45:06 + sed s:integration:/w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-calcium: /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-calcium/test/csit/testplans/openflowplugin-clustering-bulkomatic.txt 04:45:06 + cat testplan.txt 04:45:06 # Place the suites in run order: 04:45:06 /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-calcium/test/csit/suites/openflowplugin/Clustering_Bulkomatic/ 04:45:06 + '[' -z '' ']' 04:45:06 ++ grep -E -v '(^[[:space:]]*#|^[[:space:]]*$)' testplan.txt 04:45:06 ++ tr '\012' ' ' 04:45:06 + suite_list='/w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-calcium/test/csit/suites/openflowplugin/Clustering_Bulkomatic/ ' 04:45:06 + eval 'SUITES='\''/w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-calcium/test/csit/suites/openflowplugin/Clustering_Bulkomatic/ '\''' 04:45:06 ++ SUITES='/w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-calcium/test/csit/suites/openflowplugin/Clustering_Bulkomatic/ ' 04:45:06 + echo 'Starting Robot test suites /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-calcium/test/csit/suites/openflowplugin/Clustering_Bulkomatic/ ...' 04:45:06 Starting Robot test suites /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-calcium/test/csit/suites/openflowplugin/Clustering_Bulkomatic/ ... 04:45:06 + robot -N openflowplugin-clustering-bulkomatic.txt --removekeywords wuks -e exclude -e skip_if_calcium -v BUNDLEFOLDER:karaf-0.20.0 -v BUNDLE_URL:https://nexus.opendaylight.org/content/repositories//autorelease-7523/org/opendaylight/integration/karaf/0.20.0/karaf-0.20.0.zip -v CONTROLLER:10.30.170.215 -v CONTROLLER1:10.30.171.16 -v CONTROLLER2:10.30.170.254 -v CONTROLLER_USER:jenkins -v JAVA_HOME:/usr/lib/jvm/java-17-openjdk -v JDKVERSION:openjdk17 -v JENKINS_WORKSPACE:/w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-calcium -v MININET:10.30.171.163 -v MININET1: -v MININET2: -v MININET_USER:jenkins -v NEXUSURL_PREFIX:https://nexus.opendaylight.org -v NUM_ODL_SYSTEM:3 -v NUM_TOOLS_SYSTEM:1 -v ODL_STREAM:calcium -v ODL_SYSTEM_IP:10.30.170.215 -v ODL_SYSTEM_1_IP:10.30.170.215 -v ODL_SYSTEM_2_IP:10.30.171.16 -v ODL_SYSTEM_3_IP:10.30.170.254 -v ODL_SYSTEM_USER:jenkins -v TOOLS_SYSTEM_IP:10.30.171.163 -v TOOLS_SYSTEM_1_IP:10.30.171.163 -v TOOLS_SYSTEM_USER:jenkins -v USER_HOME:/home/jenkins -v IS_KARAF_APPL:True -v WORKSPACE:/tmp -v ODL_OF_PLUGIN:lithium /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-calcium/test/csit/suites/openflowplugin/Clustering_Bulkomatic/ 04:45:07 ============================================================================== 04:45:07 openflowplugin-clustering-bulkomatic.txt 04:45:07 ============================================================================== 04:45:07 openflowplugin-clustering-bulkomatic.txt.Cluster Reconcilliation Multi DPN ... 04:45:07 ============================================================================== 04:45:13 Check Shards Status And Initialize Variables :: Check Status for a... | FAIL | 04:45:13 Dictionary '${Stream_dict}' has no key 'calcium'. 04:45:13 ------------------------------------------------------------------------------ 04:45:13 Get Inventory Follower and Leader Before Cluster Restart :: Find a... [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. 04:45:18 [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. 04:45:20 [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. 04:45:20 | PASS | 04:45:20 ------------------------------------------------------------------------------ 04:45:20 Start Mininet Connect To Follower Node1 :: Start mininet with conn... | PASS | 04:45:24 ------------------------------------------------------------------------------ 04:45:24 Add Bulk Flow From Follower :: 10000 Flows ( 10000 per DPN) in 1 D... :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 04:45:24 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 04:45:24 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 04:45:24 | FAIL | 04:45:24 Variable '${temp_json_config_add}' not found. 04:45:24 ------------------------------------------------------------------------------ 04:45:24 Get Bulk Flows and Verify In Inventory Leader :: Initiate get oper... :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 04:45:24 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 04:45:24 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 04:45:25 | FAIL | 04:45:25 Variable '${temp_json_config_get}' not found. 04:45:25 ------------------------------------------------------------------------------ 04:45:25 Verify Flows In Switch Before Cluster Restart :: Verify flows are ... :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 04:45:25 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 04:45:25 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 04:47:05 | FAIL | 04:47:05 Keyword 'MininetKeywords.Check Flows In Mininet' failed after retrying for 1 minute 40 seconds. The last error was: 0.0 != 10000.0 04:47:05 ------------------------------------------------------------------------------ 04:47:05 Stop Mininet Connected To Follower Node1 and Exit :: Stop mininet ... :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 04:47:06 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 04:47:06 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 04:47:09 | PASS | 04:47:09 ------------------------------------------------------------------------------ 04:47:09 Start Mininet Reconnect To Follower Node1 :: Start mininet with re... | PASS | 04:47:13 ------------------------------------------------------------------------------ 04:47:13 Verify Flows In Switch Reconnected To Follower Node1 :: Verify 100... :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 04:47:13 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 04:47:13 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 04:48:55 | FAIL | 04:48:55 Keyword 'MininetKeywords.Check Flows In Mininet' failed after retrying for 1 minute 40 seconds. The last error was: 0.0 != 10000.0 04:48:55 ------------------------------------------------------------------------------ 04:48:55 Stop Mininet Connected To Follower Node1 :: Stop mininet and exit ... :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 04:48:55 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 04:48:55 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 04:48:57 | PASS | 04:48:57 ------------------------------------------------------------------------------ 04:48:57 Start Mininet Connect To Follower Node2 :: Start mininet with conn... | PASS | 04:49:01 ------------------------------------------------------------------------------ 04:49:01 Verify Flows In Switch Connected To Follower Node2 :: Verify 10000... :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 04:49:01 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 04:49:01 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 04:50:42 | FAIL | 04:50:42 Keyword 'MininetKeywords.Check Flows In Mininet' failed after retrying for 1 minute 40 seconds. The last error was: 0.0 != 10000.0 04:50:42 ------------------------------------------------------------------------------ 04:50:42 Stop Mininet Connected To Follower Node2 :: Stop mininet and exit ... :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 04:50:43 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 04:50:43 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 04:50:46 | PASS | 04:50:46 ------------------------------------------------------------------------------ 04:50:46 Start Mininet Connect To Inventory Leader :: Start mininet with co... | PASS | 04:50:49 ------------------------------------------------------------------------------ 04:50:49 Verify Flows In Switch Connected To Leader :: Verify 10000 flows p... :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 04:50:50 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 04:50:50 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 04:52:31 | FAIL | 04:52:31 Keyword 'MininetKeywords.Check Flows In Mininet' failed after retrying for 1 minute 40 seconds. The last error was: 0.0 != 10000.0 04:52:31 ------------------------------------------------------------------------------ 04:52:31 Stop Mininet Connected To Inventory Leader :: Stop mininet and exi... :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 04:52:31 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 04:52:31 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 04:52:34 | PASS | 04:52:34 ------------------------------------------------------------------------------ 04:52:34 Delete All Flows From Follower Node1 :: 10000 Flows deleted via Fo... | FAIL | 04:52:34 Variable '${temp_json_config_del}' not found. 04:52:34 ------------------------------------------------------------------------------ 04:52:34 Verify No Flows In Inventory Leader :: Verify flow count is 0 acro... | FAIL | 04:52:35 Variable '${temp_json_config_get}' not found. 04:52:35 ------------------------------------------------------------------------------ 04:52:35 openflowplugin-clustering-bulkomatic.txt.Cluster Reconcilliation M... | FAIL | 04:52:35 18 tests, 9 passed, 9 failed 04:52:35 ============================================================================== 04:52:35 openflowplugin-clustering-bulkomatic.txt.Cluster HA Data Recovery BulkFlow ... 04:52:35 ============================================================================== 04:52:38 Check Shards Status and Initialize Variables :: Check Status for a... | FAIL | 04:52:38 Dictionary '${Stream_dict}' has no key 'calcium'. 04:52:38 ------------------------------------------------------------------------------ 04:52:38 Get Inventory Follower Before Leader Restart :: Find a follower in... [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. 04:52:39 [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. 04:52:39 [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. 04:52:39 | PASS | 04:52:39 ------------------------------------------------------------------------------ 04:52:39 Shutdown Leader From Cluster Node :: Shutdown Leader Node and Star... | PASS | 04:52:43 ------------------------------------------------------------------------------ 04:52:43 Check Shards Status After Leader Shutdown :: Wait for node converg... | FAIL | 04:54:34 Keyword 'ClusterOpenFlow.Check OpenFlow Shards Status' failed after retrying for 1 minute 40 seconds. The last error was: Dictionary '${Stream_dict}' has no key 'calcium'. 04:54:34 ------------------------------------------------------------------------------ 04:54:34 Check Shard Status For Leader After PreLeader Shutdown :: Find a L... [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. 04:54:35 [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. 04:54:35 | PASS | 04:54:35 ------------------------------------------------------------------------------ 04:54:35 Start Mininet Connect To Follower Node1 :: Start mininet with conn... | PASS | 04:54:39 ------------------------------------------------------------------------------ 04:54:39 Add Bulk Flow From Follower :: 10000 Flows added via Follower Node... :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 04:54:39 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 04:54:39 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 04:54:39 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 04:54:39 | FAIL | 04:54:39 Variable '${temp_json_config_add}' not found. 04:54:39 ------------------------------------------------------------------------------ 04:54:39 Get Bulk Flows And Verify In Leader :: Initiate get operation and ... :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 04:54:39 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 04:54:39 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 04:54:39 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 04:54:39 | FAIL | 04:54:39 Variable '${temp_json_config_get}' not found. 04:54:39 ------------------------------------------------------------------------------ 04:54:39 Verify Flows In Switch Before Cluster Restart :: Verify flows are ... :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 04:54:39 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 04:54:39 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 04:54:40 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 04:56:20 | FAIL | 04:56:20 Keyword 'MininetKeywords.Check Flows In Mininet' failed after retrying for 1 minute 40 seconds. The last error was: 0.0 != 10000.0 04:56:20 ------------------------------------------------------------------------------ 04:56:20 Restart Pre Leader From Cluster Node :: Restart Leader Node. :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 04:56:20 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 04:56:21 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 04:56:21 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 04:56:21 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 04:56:21 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 04:56:21 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 04:56:21 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 04:56:22 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 04:56:22 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 04:56:43 [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. 04:56:43 [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. 04:56:44 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 04:56:44 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 04:56:45 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 04:56:45 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 04:56:45 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 04:56:45 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 04:56:45 | PASS | 04:56:45 ------------------------------------------------------------------------------ 04:56:45 Check Shards Status After Leader Restart :: Wait for node converge... :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 04:56:46 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 04:56:46 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 04:56:47 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 04:56:47 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:02:38 | FAIL | 05:02:38 Keyword 'ClusterOpenFlow.Check OpenFlow Shards Status' failed after retrying for 5 minutes 50 seconds. The last error was: Dictionary '${Stream_dict}' has no key 'calcium'. 05:02:38 ------------------------------------------------------------------------------ 05:02:38 Verify Data Recovery After Leader Restart :: 10000 Flows preserved... :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:02:39 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:02:39 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:04:20 | FAIL | 05:04:20 Keyword 'BulkomaticKeywords.Get Bulk Flow And Verify Count In Cluster' failed after retrying for 1 minute 40 seconds. The last error was: Variable '${temp_json_config_get}' not found. 05:04:20 ------------------------------------------------------------------------------ 05:04:20 Verify Flows In Switch After Leader Restart :: Verify flows are in... :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:04:20 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:04:21 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:06:01 | FAIL | 05:06:01 Keyword 'MininetKeywords.Check Flows In Mininet' failed after retrying for 1 minute 40 seconds. The last error was: 0.0 != 10000.0 05:06:01 ------------------------------------------------------------------------------ 05:06:01 Stop Mininet Connected To Follower Node1 :: Stop mininet and exit ... :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:06:02 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:06:02 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:06:05 | PASS | 05:06:05 ------------------------------------------------------------------------------ 05:06:05 Delete All Flows From Follower Node1 :: 10000 Flows deleted via Fo... | FAIL | 05:06:05 Variable '${temp_json_config_del}' not found. 05:06:05 ------------------------------------------------------------------------------ 05:06:05 Verify No Flows In Leader Node :: Verify flow count is 0 across cl... | FAIL | 05:06:05 Variable '${temp_json_config_get}' not found. 05:06:05 ------------------------------------------------------------------------------ 05:06:05 Get Inventory Follower And Leader Before Cluster Restart :: Find a... [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. 05:06:06 [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. 05:06:07 [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. 05:06:07 | PASS | 05:06:07 ------------------------------------------------------------------------------ 05:06:07 Shutdown Follower From Cluster Node :: Shutdown Follower Node2 and... | PASS | 05:06:11 ------------------------------------------------------------------------------ 05:06:11 Check Shards Status After Follower Shutdown :: Wait for node conve... | FAIL | 05:08:01 Keyword 'ClusterOpenFlow.Check OpenFlow Shards Status' failed after retrying for 1 minute 40 seconds. The last error was: Dictionary '${Stream_dict}' has no key 'calcium'. 05:08:01 ------------------------------------------------------------------------------ 05:08:01 Start Mininet Connect To Follower Node :: Start mininet with conne... | PASS | 05:08:05 ------------------------------------------------------------------------------ 05:08:05 Add Bulk Flow From Follower Node1 :: 10000 Flows added via Followe... :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:08:05 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:08:05 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:08:05 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:08:05 | FAIL | 05:08:05 Variable '${temp_json_config_add}' not found. 05:08:05 ------------------------------------------------------------------------------ 05:08:05 Get Bulk Flows And Verify In Leader Before Follower Restart :: Ini... :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:08:05 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:08:05 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:08:05 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:08:05 | FAIL | 05:08:05 Variable '${temp_json_config_get}' not found. 05:08:05 ------------------------------------------------------------------------------ 05:08:05 Verify Flows In Switch Before Follower Restart :: Verify flows are... :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:08:06 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:08:06 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:08:06 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:09:47 | FAIL | 05:09:47 Keyword 'MininetKeywords.Check Flows In Mininet' failed after retrying for 1 minute 40 seconds. The last error was: 0.0 != 10000.0 05:09:47 ------------------------------------------------------------------------------ 05:09:47 Restart Follower From Cluster Node :: Restart Follower Node2. :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:09:47 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:09:47 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:09:47 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:09:47 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:09:47 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:09:47 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:09:47 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:09:48 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:09:48 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:10:09 [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. 05:10:09 [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. 05:10:11 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:10:11 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:10:11 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:10:11 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:10:12 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:10:12 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:10:12 | PASS | 05:10:12 ------------------------------------------------------------------------------ 05:10:12 Check Shards Status After Follower Restart :: Wait for node conver... :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:10:12 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:10:12 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:10:13 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:10:13 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:16:04 | FAIL | 05:16:04 Keyword 'ClusterOpenFlow.Check OpenFlow Shards Status' failed after retrying for 5 minutes 50 seconds. The last error was: Dictionary '${Stream_dict}' has no key 'calcium'. 05:16:04 ------------------------------------------------------------------------------ 05:16:04 Verify Data Recovery After Follower Restart :: 10000 Flows preserv... :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:16:05 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:16:05 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:17:46 | FAIL | 05:17:46 Keyword 'BulkomaticKeywords.Get Bulk Flow And Verify Count In Cluster' failed after retrying for 1 minute 40 seconds. The last error was: Variable '${temp_json_config_get}' not found. 05:17:46 ------------------------------------------------------------------------------ 05:17:46 Verify Flows In Switch After Follower Restart :: Verify flows are ... :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:17:47 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:17:47 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:19:28 | FAIL | 05:19:28 Keyword 'MininetKeywords.Check Flows In Mininet' failed after retrying for 1 minute 40 seconds. The last error was: 0.0 != 10000.0 05:19:28 ------------------------------------------------------------------------------ 05:19:28 Stop Mininet Connected To Follower Node :: Stop mininet and exit c... :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:19:28 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:19:28 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:19:31 | PASS | 05:19:31 ------------------------------------------------------------------------------ 05:19:31 Delete All Flows From Follower Node :: 10000 Flows deleted via Fol... | FAIL | 05:19:31 Variable '${temp_json_config_del}' not found. 05:19:31 ------------------------------------------------------------------------------ 05:19:31 Verify No Flows In Leader Node After Follower Restart :: Verify fl... | FAIL | 05:19:32 Variable '${temp_json_config_get}' not found. 05:19:32 ------------------------------------------------------------------------------ 05:19:32 openflowplugin-clustering-bulkomatic.txt.Cluster HA Data Recovery ... | FAIL | 05:19:32 30 tests, 11 passed, 19 failed 05:19:32 ============================================================================== 05:19:32 openflowplugin-clustering-bulkomatic.txt.Cluster HA Data Recovery BulkFlow ... 05:19:32 ============================================================================== 05:19:34 Check Shards Status And Initialize Variables :: Check Status for a... | FAIL | 05:19:35 Dictionary '${Stream_dict}' has no key 'calcium'. 05:19:35 ------------------------------------------------------------------------------ 05:19:35 Get Inventory Follower Before Cluster Restart :: Find a follower i... [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. 05:19:36 [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. 05:19:36 [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. 05:19:36 | PASS | 05:19:36 ------------------------------------------------------------------------------ 05:19:36 Start Mininet Connect To Follower Node1 :: Start mininet with conn... | PASS | 05:19:40 ------------------------------------------------------------------------------ 05:19:40 Add Bulk Flow From Follower :: 1000 Flows added via Follower Node1... :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:19:40 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:19:40 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:19:40 | FAIL | 05:19:40 Variable '${temp_json_config_add}' not found. 05:19:40 ------------------------------------------------------------------------------ 05:19:40 Get Bulk Flows and Verify In Cluster :: Initiate get operation and... :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:19:41 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:19:41 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:19:41 | FAIL | 05:19:41 Variable '${temp_json_config_get}' not found. 05:19:41 ------------------------------------------------------------------------------ 05:19:41 Verify Flows In Switch Before Cluster Restart :: Verify flows are ... :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:19:41 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:19:41 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:21:22 | FAIL | 05:21:22 Keyword 'MininetKeywords.Check Flows In Mininet' failed after retrying for 1 minute 40 seconds. The last error was: 0.0 != 1000.0 05:21:22 ------------------------------------------------------------------------------ 05:21:22 Kill All Cluster Nodes :: Kill All Nodes. :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:21:22 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:21:22 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:21:23 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:21:23 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:21:23 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:21:23 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:21:24 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:21:24 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:21:25 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:21:25 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:21:26 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:21:26 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:21:26 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:21:26 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:21:27 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:21:27 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:21:27 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:21:27 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:21:27 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:21:27 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:21:27 | PASS | 05:21:27 ------------------------------------------------------------------------------ 05:21:27 Stop Mininet Connected To Follower Node1 and Exit :: Stop mininet ... :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:21:38 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:21:48 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:21:48 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:21:58 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:21:58 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:22:01 | PASS | 05:22:01 ------------------------------------------------------------------------------ 05:22:01 Restart All Cluster Nodes :: Restart all cluster nodes. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. 05:22:34 [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. 05:22:35 [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. 05:22:35 [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. 05:22:37 [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. 05:22:37 [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. 05:22:40 | PASS | 05:22:40 ------------------------------------------------------------------------------ 05:22:40 Verify Data Recovery After Cluster Restart :: 1000 Flows preserved... | FAIL | 05:28:34 Keyword 'BulkomaticKeywords.Get Bulk Flow And Verify Count In Cluster' failed after retrying for 5 minutes 50 seconds. The last error was: Variable '${temp_json_config_get}' not found. 05:28:34 ------------------------------------------------------------------------------ 05:28:34 Start Mininet Again Connect To Follower Node1 :: Start mininet wit... | PASS | 05:28:38 ------------------------------------------------------------------------------ 05:28:38 Verify Flows In Switch After Cluster Restart :: Verify flows are i... :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:28:39 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:28:39 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:30:20 | FAIL | 05:30:20 Keyword 'MininetKeywords.Check Flows In Mininet' failed after retrying for 1 minute 40 seconds. The last error was: 0.0 != 1000.0 05:30:20 ------------------------------------------------------------------------------ 05:30:20 Stop Mininet Connected To Follower Node1 :: Stop mininet and exit ... :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:30:20 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:30:20 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:30:23 | PASS | 05:30:23 ------------------------------------------------------------------------------ 05:30:23 Delete All Flows From Follower Node1 :: 1000 Flows deleted via Fol... | FAIL | 05:30:24 Variable '${temp_json_config_del}' not found. 05:30:24 ------------------------------------------------------------------------------ 05:30:24 Verify No Flows In Cluster :: Verify flow count is 0 across cluste... | FAIL | 05:30:24 Variable '${temp_json_config_get}' not found. 05:30:24 ------------------------------------------------------------------------------ 05:30:24 Get Inventory Leader Before Leader Restart :: Find leader in the i... [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. 05:30:25 [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. 05:30:26 [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. 05:30:26 | PASS | 05:30:26 ------------------------------------------------------------------------------ 05:30:26 Start Mininet Connect To Leader :: Start mininet with connection t... | PASS | 05:30:29 ------------------------------------------------------------------------------ 05:30:29 Add Bulk Flow From Leader :: 1000 Flows added via Follower Node1 a... :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:30:30 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:30:30 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:30:30 | FAIL | 05:30:30 Variable '${temp_json_config_add}' not found. 05:30:30 ------------------------------------------------------------------------------ 05:30:30 Get Bulk Flows and Verify In Cluster Before Leader Restart :: Init... :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:30:30 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:30:30 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:30:30 | FAIL | 05:30:30 Variable '${temp_json_config_get}' not found. 05:30:30 ------------------------------------------------------------------------------ 05:30:30 Verify Flows In Switch Before Leader Restart :: Verify flows are i... :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:30:31 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:30:31 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:32:12 | FAIL | 05:32:12 Keyword 'MininetKeywords.Check Flows In Mininet' failed after retrying for 1 minute 40 seconds. The last error was: 0.0 != 1000.0 05:32:12 ------------------------------------------------------------------------------ 05:32:12 Kill Leader From Cluster Node :: Kill Leader Node. :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:32:12 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:32:12 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:32:12 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:32:12 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:32:12 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:32:13 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:32:13 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:32:14 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:32:14 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:32:15 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:32:15 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:32:15 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:32:15 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:32:16 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:32:16 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:32:16 | PASS | 05:32:16 ------------------------------------------------------------------------------ 05:32:16 Stop Mininet Connected To Leader Node :: Stop mininet and exit con... :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:32:26 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:32:26 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:32:26 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:32:29 | PASS | 05:32:29 ------------------------------------------------------------------------------ 05:32:29 Restart Leader from Cluster Node :: Start Leader Node Up. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. 05:32:51 [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. 05:32:54 | PASS | 05:32:54 ------------------------------------------------------------------------------ 05:32:54 Verify Data Recovery After Leader Restart :: 1000 Flows preserved ... | FAIL | 05:38:45 Keyword 'BulkomaticKeywords.Get Bulk Flow And Verify Count In Cluster' failed after retrying for 5 minutes 50 seconds. The last error was: Variable '${temp_json_config_get}' not found. 05:38:45 ------------------------------------------------------------------------------ 05:38:45 Start Mininet Again Connect To Leader :: Start mininet with connec... | PASS | 05:38:49 ------------------------------------------------------------------------------ 05:38:49 Verify Flows In Switch After Leader Restart :: Verify flows are in... :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:38:50 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:38:50 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:40:31 | FAIL | 05:40:31 Keyword 'MininetKeywords.Check Flows In Mininet' failed after retrying for 1 minute 40 seconds. The last error was: 0.0 != 1000.0 05:40:31 ------------------------------------------------------------------------------ 05:40:31 Stop Mininet Connected To Leader Node After Leader Restart :: Stop... :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:40:31 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:40:31 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:40:34 | PASS | 05:40:34 ------------------------------------------------------------------------------ 05:40:34 Delete All Flows From Leader Node :: 1000 Flows deleted via Leader... | FAIL | 05:40:35 Variable '${temp_json_config_del}' not found. 05:40:35 ------------------------------------------------------------------------------ 05:40:35 Verify No Flows In Cluster After Leader Restart :: Verify flow cou... | FAIL | 05:40:35 Variable '${temp_json_config_get}' not found. 05:40:35 ------------------------------------------------------------------------------ 05:40:35 Get Inventory Follower Before follower Restart :: Find follower in... [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. 05:40:36 [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. 05:40:36 [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. 05:40:36 | PASS | 05:40:36 ------------------------------------------------------------------------------ 05:40:36 Start Mininet Connect To Follower Node2 :: Start mininet with conn... | PASS | 05:40:40 ------------------------------------------------------------------------------ 05:40:40 Add Bulk Flow From Follower Node2 :: 1000 Flows added via Follower... :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:40:40 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:40:41 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:40:41 | FAIL | 05:40:41 Variable '${temp_json_config_add}' not found. 05:40:41 ------------------------------------------------------------------------------ 05:40:41 Get Bulk Flows and Verify In Cluster Before Follower Restart :: In... :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:40:41 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:40:41 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:40:41 | FAIL | 05:40:41 Variable '${temp_json_config_get}' not found. 05:40:41 ------------------------------------------------------------------------------ 05:40:41 Verify Flows In Switch Before Follower Restart :: Verify flows are... :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:40:41 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:40:42 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:42:22 | FAIL | 05:42:22 Keyword 'MininetKeywords.Check Flows In Mininet' failed after retrying for 1 minute 40 seconds. The last error was: 0.0 != 1000.0 05:42:22 ------------------------------------------------------------------------------ 05:42:22 Kill Follower Node2 :: Kill Follower Node2. :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:42:23 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:42:23 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:42:23 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:42:23 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:42:23 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:42:23 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:42:23 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:42:25 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:42:25 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:42:25 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:42:25 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:42:26 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:42:26 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:42:26 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:42:26 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:42:26 | PASS | 05:42:26 ------------------------------------------------------------------------------ 05:42:26 Stop Mininet Connected To Follower Node2 and Exit :: Stop mininet ... :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:42:27 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:42:37 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:42:37 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:42:40 | PASS | 05:42:40 ------------------------------------------------------------------------------ 05:42:40 Restart Follower Node2 :: Start Follower Node2 Up. [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. 05:43:03 [ WARN ] Keyword 'RequestsLibrary.To Json' is deprecated. Please use ${resp.json()} instead. Have a look at the improved HTML output as pretty printing replacement. 05:43:05 | PASS | 05:43:05 ------------------------------------------------------------------------------ 05:43:05 Verify Data Recovery After Follower Node2 Restart :: 1000 Flows pr... | FAIL | 05:48:57 Keyword 'BulkomaticKeywords.Get Bulk Flow And Verify Count In Cluster' failed after retrying for 5 minutes 50 seconds. The last error was: Variable '${temp_json_config_get}' not found. 05:48:57 ------------------------------------------------------------------------------ 05:48:57 Start Mininet Again Connect To Follower Node2 :: Start mininet wit... | PASS | 05:49:01 ------------------------------------------------------------------------------ 05:49:01 Verify Flows In Switch After Follower Node2 Restart :: Verify flow... :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:49:02 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:49:02 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:50:42 | FAIL | 05:50:42 Keyword 'MininetKeywords.Check Flows In Mininet' failed after retrying for 1 minute 40 seconds. The last error was: 0.0 != 1000.0 05:50:42 ------------------------------------------------------------------------------ 05:50:42 Stop Mininet Connected To Follower Node2 :: Stop mininet and exit ... :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:50:42 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:50:43 :1: SyntaxWarning: "is not" with a literal. Did you mean "!="? 05:50:46 | PASS | 05:50:46 ------------------------------------------------------------------------------ 05:50:46 Delete All Flows From Follower Node 2 :: 1000 Flows deleted via Le... | FAIL | 05:50:46 Variable '${temp_json_config_del}' not found. 05:50:46 ------------------------------------------------------------------------------ 05:50:46 Verify No Flows In Cluster After Follower Node2 Restart | FAIL | 05:50:46 Variable '${temp_json_config_get}' not found. 05:50:46 ------------------------------------------------------------------------------ 05:50:46 openflowplugin-clustering-bulkomatic.txt.Cluster HA Data Recovery ... | FAIL | 05:50:46 43 tests, 21 passed, 22 failed 05:50:46 ============================================================================== 05:50:47 openflowplugin-clustering-bulkomatic.txt.Cluster Current Term Verification ... 05:50:47 ============================================================================== 05:50:49 Check Shard And Get Inventory :: Check Status for all shards and F... | FAIL | 05:50:50 Dictionary '${Stream_dict}' has no key 'calcium'. 05:50:50 ------------------------------------------------------------------------------ 05:50:50 Initial Current Term Verification :: Verifying current term for Le... | FAIL | 05:50:50 Variable '${Inventory_Leader}' not found. 05:50:50 ------------------------------------------------------------------------------ 05:50:50 Add Bulk Flow From Follower :: 10000 Flows added via Follower Node... | FAIL | 05:50:50 Variable '${temp_json_config_add}' not found. 05:50:50 ------------------------------------------------------------------------------ 05:50:50 Get Bulk Flows And Verify In Cluster :: Initiate get operation and... | FAIL | 05:50:51 Variable '${temp_json_config_get}' not found. 05:50:51 ------------------------------------------------------------------------------ 05:50:51 Current Term Verification After Adding Bulk Flow :: Verifying curr... | FAIL | 05:50:51 Variable '${Inventory_Leader}' not found. 05:50:51 ------------------------------------------------------------------------------ 05:50:51 Current Term Comparison Before And After Addition Of Flow :: Compa... | FAIL | 05:50:52 Variable '${current_term_value_after}' not found. 05:50:52 ------------------------------------------------------------------------------ 05:50:52 Delete and Add ten percent of the flows for 5 iterations :: Perfor... | FAIL | 05:50:52 Variable '${temp_json_config_del_ten_percent}' not found. 05:50:52 ------------------------------------------------------------------------------ 05:50:52 Current Term Verification After Continuous Deletion and Addition O... | FAIL | 05:50:53 Variable '${Inventory_Leader}' not found. 05:50:53 ------------------------------------------------------------------------------ 05:50:53 Current Term Comparison Before and After Continuous Deletion and A... | FAIL | 05:50:53 Variable '${current_term_value_after}' not found. 05:50:53 ------------------------------------------------------------------------------ 05:50:53 Delete All Flows From Follower Node :: 10000 Flows deleted via Lea... | FAIL | 05:50:53 Variable '${temp_json_config_del}' not found. 05:50:53 ------------------------------------------------------------------------------ 05:50:53 Verify No Flows In Cluster After Flow Deletion :: Verifying No FLo... | FAIL | 05:50:54 Variable '${temp_json_config_get}' not found. 05:50:54 ------------------------------------------------------------------------------ 05:50:54 PreLeader Verification :: Verifying LastIndex and LastApplied and ... | FAIL | 05:50:54 Variable '${Inventory_Leader}' not found. 05:50:54 ------------------------------------------------------------------------------ 05:50:54 openflowplugin-clustering-bulkomatic.txt.Cluster Current Term Veri... | FAIL | 05:50:54 12 tests, 0 passed, 12 failed 05:50:54 ============================================================================== 05:50:54 openflowplugin-clustering-bulkomatic.txt | FAIL | 05:50:54 103 tests, 41 passed, 62 failed 05:50:54 ============================================================================== 05:50:54 Output: /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-calcium/output.xml 05:50:57 Log: /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-calcium/log.html 05:50:58 Report: /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-calcium/report.html 05:50:58 + true 05:50:58 + echo 'Examining the files in data/log and checking filesize' 05:50:58 Examining the files in data/log and checking filesize 05:50:58 + ssh 10.30.170.215 'ls -altr /tmp/karaf-0.20.0/data/log/' 05:50:58 Warning: Permanently added '10.30.170.215' (ECDSA) to the list of known hosts. 05:50:58 total 2436 05:50:58 drwxrwxr-x. 2 jenkins jenkins 48 Feb 8 04:44 . 05:50:58 drwxrwxr-x. 9 jenkins jenkins 149 Feb 8 04:44 .. 05:50:58 -rw-rw-r--. 1 jenkins jenkins 3516 Feb 8 04:52 karaf_console.log 05:50:58 -rw-rw-r--. 1 jenkins jenkins 1490664 Feb 8 05:50 karaf.log 05:50:58 + ssh 10.30.170.215 'du -hs /tmp/karaf-0.20.0/data/log/*' 05:50:58 Warning: Permanently added '10.30.170.215' (ECDSA) to the list of known hosts. 05:50:58 4.0K /tmp/karaf-0.20.0/data/log/karaf_console.log 05:50:58 2.4M /tmp/karaf-0.20.0/data/log/karaf.log 05:50:58 + ssh 10.30.171.16 'ls -altr /tmp/karaf-0.20.0/data/log/' 05:50:58 Warning: Permanently added '10.30.171.16' (ECDSA) to the list of known hosts. 05:50:58 total 1540 05:50:58 drwxrwxr-x. 2 jenkins jenkins 48 Feb 8 04:44 . 05:50:58 drwxrwxr-x. 9 jenkins jenkins 149 Feb 8 04:44 .. 05:50:58 -rw-rw-r--. 1 jenkins jenkins 3516 Feb 8 05:06 karaf_console.log 05:50:58 -rw-rw-r--. 1 jenkins jenkins 1329526 Feb 8 05:50 karaf.log 05:50:58 + ssh 10.30.171.16 'du -hs /tmp/karaf-0.20.0/data/log/*' 05:50:58 Warning: Permanently added '10.30.171.16' (ECDSA) to the list of known hosts. 05:50:59 4.0K /tmp/karaf-0.20.0/data/log/karaf_console.log 05:50:59 1.5M /tmp/karaf-0.20.0/data/log/karaf.log 05:50:59 + ssh 10.30.170.254 'ls -altr /tmp/karaf-0.20.0/data/log/' 05:50:59 Warning: Permanently added '10.30.170.254' (ECDSA) to the list of known hosts. 05:50:59 total 2308 05:50:59 drwxrwxr-x. 2 jenkins jenkins 48 Feb 8 04:44 . 05:50:59 drwxrwxr-x. 9 jenkins jenkins 149 Feb 8 04:44 .. 05:50:59 -rw-rw-r--. 1 jenkins jenkins 3516 Feb 8 05:21 karaf_console.log 05:50:59 -rw-rw-r--. 1 jenkins jenkins 1342815 Feb 8 05:50 karaf.log 05:50:59 + ssh 10.30.170.254 'du -hs /tmp/karaf-0.20.0/data/log/*' 05:50:59 Warning: Permanently added '10.30.170.254' (ECDSA) to the list of known hosts. 05:50:59 4.0K /tmp/karaf-0.20.0/data/log/karaf_console.log 05:50:59 2.3M /tmp/karaf-0.20.0/data/log/karaf.log 05:50:59 + set +e 05:50:59 ++ seq 1 3 05:50:59 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") 05:50:59 + CONTROLLERIP=ODL_SYSTEM_1_IP 05:50:59 + echo 'Let'\''s take the karaf thread dump again' 05:50:59 Let's take the karaf thread dump again 05:50:59 + ssh 10.30.170.215 'sudo ps aux' 05:50:59 Warning: Permanently added '10.30.170.215' (ECDSA) to the list of known hosts. 05:50:59 ++ grep org.apache.karaf.main.Main /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-calcium/ps_after.log 05:50:59 ++ cut -f2 '-d ' 05:50:59 ++ grep -v grep 05:50:59 ++ tr -s ' ' 05:50:59 + pid=9272 05:50:59 + echo 'karaf main: org.apache.karaf.main.Main, pid:9272' 05:50:59 karaf main: org.apache.karaf.main.Main, pid:9272 05:50:59 + ssh 10.30.170.215 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 9272' 05:50:59 Warning: Permanently added '10.30.170.215' (ECDSA) to the list of known hosts. 05:51:00 + echo 'killing karaf process...' 05:51:00 killing karaf process... 05:51:00 + ssh 10.30.170.215 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh' 05:51:00 Warning: Permanently added '10.30.170.215' (ECDSA) to the list of known hosts. 05:51:00 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") 05:51:00 + CONTROLLERIP=ODL_SYSTEM_2_IP 05:51:00 + echo 'Let'\''s take the karaf thread dump again' 05:51:00 Let's take the karaf thread dump again 05:51:00 + ssh 10.30.171.16 'sudo ps aux' 05:51:00 Warning: Permanently added '10.30.171.16' (ECDSA) to the list of known hosts. 05:51:00 ++ grep org.apache.karaf.main.Main /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-calcium/ps_after.log 05:51:00 ++ grep -v grep 05:51:00 ++ tr -s ' ' 05:51:00 ++ cut -f2 '-d ' 05:51:00 + pid=8257 05:51:00 + echo 'karaf main: org.apache.karaf.main.Main, pid:8257' 05:51:00 karaf main: org.apache.karaf.main.Main, pid:8257 05:51:00 + ssh 10.30.171.16 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 8257' 05:51:00 Warning: Permanently added '10.30.171.16' (ECDSA) to the list of known hosts. 05:51:01 + echo 'killing karaf process...' 05:51:01 killing karaf process... 05:51:01 + ssh 10.30.171.16 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh' 05:51:01 Warning: Permanently added '10.30.171.16' (ECDSA) to the list of known hosts. 05:51:01 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") 05:51:01 + CONTROLLERIP=ODL_SYSTEM_3_IP 05:51:01 + echo 'Let'\''s take the karaf thread dump again' 05:51:01 Let's take the karaf thread dump again 05:51:01 + ssh 10.30.170.254 'sudo ps aux' 05:51:01 Warning: Permanently added '10.30.170.254' (ECDSA) to the list of known hosts. 05:51:01 ++ grep org.apache.karaf.main.Main /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-calcium/ps_after.log 05:51:01 ++ tr -s ' ' 05:51:01 ++ cut -f2 '-d ' 05:51:01 ++ grep -v grep 05:51:01 + pid=8683 05:51:01 + echo 'karaf main: org.apache.karaf.main.Main, pid:8683' 05:51:01 karaf main: org.apache.karaf.main.Main, pid:8683 05:51:01 + ssh 10.30.170.254 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 8683' 05:51:01 Warning: Permanently added '10.30.170.254' (ECDSA) to the list of known hosts. 05:51:02 + echo 'killing karaf process...' 05:51:02 killing karaf process... 05:51:02 + ssh 10.30.170.254 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh' 05:51:02 Warning: Permanently added '10.30.170.254' (ECDSA) to the list of known hosts. 05:51:02 + sleep 5 05:51:07 ++ seq 1 3 05:51:07 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") 05:51:07 + CONTROLLERIP=ODL_SYSTEM_1_IP 05:51:07 + echo 'Compressing karaf.log 1' 05:51:07 Compressing karaf.log 1 05:51:07 + ssh 10.30.170.215 gzip --best /tmp/karaf-0.20.0/data/log/karaf.log 05:51:07 Warning: Permanently added '10.30.170.215' (ECDSA) to the list of known hosts. 05:51:08 + echo 'Fetching compressed karaf.log 1' 05:51:08 Fetching compressed karaf.log 1 05:51:08 + scp 10.30.170.215:/tmp/karaf-0.20.0/data/log/karaf.log.gz odl1_karaf.log.gz 05:51:08 Warning: Permanently added '10.30.170.215' (ECDSA) to the list of known hosts. 05:51:08 + ssh 10.30.170.215 rm -f /tmp/karaf-0.20.0/data/log/karaf.log.gz 05:51:08 Warning: Permanently added '10.30.170.215' (ECDSA) to the list of known hosts. 05:51:08 + scp 10.30.170.215:/tmp/karaf-0.20.0/data/log/karaf_console.log odl1_karaf_console.log 05:51:08 Warning: Permanently added '10.30.170.215' (ECDSA) to the list of known hosts. 05:51:08 + ssh 10.30.170.215 rm -f /tmp/karaf-0.20.0/data/log/karaf_console.log 05:51:08 Warning: Permanently added '10.30.170.215' (ECDSA) to the list of known hosts. 05:51:09 + echo 'Fetch GC logs' 05:51:09 Fetch GC logs 05:51:09 + mkdir -p gclogs-1 05:51:09 + scp '10.30.170.215:/tmp/karaf-0.20.0/data/log/*.log' gclogs-1/ 05:51:09 Warning: Permanently added '10.30.170.215' (ECDSA) to the list of known hosts. 05:51:09 scp: /tmp/karaf-0.20.0/data/log/*.log: No such file or directory 05:51:09 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") 05:51:09 + CONTROLLERIP=ODL_SYSTEM_2_IP 05:51:09 + echo 'Compressing karaf.log 2' 05:51:09 Compressing karaf.log 2 05:51:09 + ssh 10.30.171.16 gzip --best /tmp/karaf-0.20.0/data/log/karaf.log 05:51:09 Warning: Permanently added '10.30.171.16' (ECDSA) to the list of known hosts. 05:51:09 + echo 'Fetching compressed karaf.log 2' 05:51:09 Fetching compressed karaf.log 2 05:51:09 + scp 10.30.171.16:/tmp/karaf-0.20.0/data/log/karaf.log.gz odl2_karaf.log.gz 05:51:09 Warning: Permanently added '10.30.171.16' (ECDSA) to the list of known hosts. 05:51:09 + ssh 10.30.171.16 rm -f /tmp/karaf-0.20.0/data/log/karaf.log.gz 05:51:09 Warning: Permanently added '10.30.171.16' (ECDSA) to the list of known hosts. 05:51:09 + scp 10.30.171.16:/tmp/karaf-0.20.0/data/log/karaf_console.log odl2_karaf_console.log 05:51:09 Warning: Permanently added '10.30.171.16' (ECDSA) to the list of known hosts. 05:51:10 + ssh 10.30.171.16 rm -f /tmp/karaf-0.20.0/data/log/karaf_console.log 05:51:10 Warning: Permanently added '10.30.171.16' (ECDSA) to the list of known hosts. 05:51:10 + echo 'Fetch GC logs' 05:51:10 Fetch GC logs 05:51:10 + mkdir -p gclogs-2 05:51:10 + scp '10.30.171.16:/tmp/karaf-0.20.0/data/log/*.log' gclogs-2/ 05:51:10 Warning: Permanently added '10.30.171.16' (ECDSA) to the list of known hosts. 05:51:10 scp: /tmp/karaf-0.20.0/data/log/*.log: No such file or directory 05:51:10 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") 05:51:10 + CONTROLLERIP=ODL_SYSTEM_3_IP 05:51:10 + echo 'Compressing karaf.log 3' 05:51:10 Compressing karaf.log 3 05:51:10 + ssh 10.30.170.254 gzip --best /tmp/karaf-0.20.0/data/log/karaf.log 05:51:10 Warning: Permanently added '10.30.170.254' (ECDSA) to the list of known hosts. 05:51:10 + echo 'Fetching compressed karaf.log 3' 05:51:10 Fetching compressed karaf.log 3 05:51:10 + scp 10.30.170.254:/tmp/karaf-0.20.0/data/log/karaf.log.gz odl3_karaf.log.gz 05:51:10 Warning: Permanently added '10.30.170.254' (ECDSA) to the list of known hosts. 05:51:10 + ssh 10.30.170.254 rm -f /tmp/karaf-0.20.0/data/log/karaf.log.gz 05:51:11 Warning: Permanently added '10.30.170.254' (ECDSA) to the list of known hosts. 05:51:11 + scp 10.30.170.254:/tmp/karaf-0.20.0/data/log/karaf_console.log odl3_karaf_console.log 05:51:11 Warning: Permanently added '10.30.170.254' (ECDSA) to the list of known hosts. 05:51:11 + ssh 10.30.170.254 rm -f /tmp/karaf-0.20.0/data/log/karaf_console.log 05:51:11 Warning: Permanently added '10.30.170.254' (ECDSA) to the list of known hosts. 05:51:11 + echo 'Fetch GC logs' 05:51:11 Fetch GC logs 05:51:11 + mkdir -p gclogs-3 05:51:11 + scp '10.30.170.254:/tmp/karaf-0.20.0/data/log/*.log' gclogs-3/ 05:51:11 Warning: Permanently added '10.30.170.254' (ECDSA) to the list of known hosts. 05:51:11 scp: /tmp/karaf-0.20.0/data/log/*.log: No such file or directory 05:51:11 + echo 'Examine copied files' 05:51:11 Examine copied files 05:51:11 + ls -lt 05:51:11 total 17392 05:51:11 drwxrwxr-x. 2 jenkins jenkins 6 Feb 8 05:51 gclogs-3 05:51:11 -rw-rw-r--. 1 jenkins jenkins 3516 Feb 8 05:51 odl3_karaf_console.log 05:51:11 -rw-rw-r--. 1 jenkins jenkins 109965 Feb 8 05:51 odl3_karaf.log.gz 05:51:11 drwxrwxr-x. 2 jenkins jenkins 6 Feb 8 05:51 gclogs-2 05:51:11 -rw-rw-r--. 1 jenkins jenkins 3516 Feb 8 05:51 odl2_karaf_console.log 05:51:11 -rw-rw-r--. 1 jenkins jenkins 107616 Feb 8 05:51 odl2_karaf.log.gz 05:51:11 drwxrwxr-x. 2 jenkins jenkins 6 Feb 8 05:51 gclogs-1 05:51:11 -rw-rw-r--. 1 jenkins jenkins 3516 Feb 8 05:51 odl1_karaf_console.log 05:51:11 -rw-rw-r--. 1 jenkins jenkins 123820 Feb 8 05:51 odl1_karaf.log.gz 05:51:11 -rw-rw-r--. 1 jenkins jenkins 132892 Feb 8 05:51 karaf_3_8683_threads_after.log 05:51:11 -rw-rw-r--. 1 jenkins jenkins 15915 Feb 8 05:51 ps_after.log 05:51:11 -rw-rw-r--. 1 jenkins jenkins 113121 Feb 8 05:51 karaf_2_8257_threads_after.log 05:51:11 -rw-rw-r--. 1 jenkins jenkins 115235 Feb 8 05:51 karaf_1_9272_threads_after.log 05:51:11 -rw-rw-r--. 1 jenkins jenkins 260587 Feb 8 05:50 report.html 05:51:11 -rw-rw-r--. 1 jenkins jenkins 1830698 Feb 8 05:50 log.html 05:51:11 -rw-rw-r--. 1 jenkins jenkins 14520475 Feb 8 05:50 output.xml 05:51:11 -rw-rw-r--. 1 jenkins jenkins 162 Feb 8 04:45 testplan.txt 05:51:11 -rw-rw-r--. 1 jenkins jenkins 120910 Feb 8 04:45 karaf_3_5757_threads_before.log 05:51:11 -rw-rw-r--. 1 jenkins jenkins 16795 Feb 8 04:45 ps_before.log 05:51:11 -rw-rw-r--. 1 jenkins jenkins 125768 Feb 8 04:45 karaf_2_5749_threads_before.log 05:51:11 -rw-rw-r--. 1 jenkins jenkins 128947 Feb 8 04:45 karaf_1_5754_threads_before.log 05:51:11 -rw-rw-r--. 1 jenkins jenkins 3043 Feb 8 04:44 post-startup-script.sh 05:51:11 -rw-rw-r--. 1 jenkins jenkins 225 Feb 8 04:43 startup-script.sh 05:51:11 -rw-rw-r--. 1 jenkins jenkins 3264 Feb 8 04:43 configuration-script.sh 05:51:11 -rw-rw-r--. 1 jenkins jenkins 266 Feb 8 04:43 detect_variables.env 05:51:11 -rw-rw-r--. 1 jenkins jenkins 86 Feb 8 04:43 set_variables.env 05:51:11 -rw-rw-r--. 1 jenkins jenkins 358 Feb 8 04:43 slave_addresses.txt 05:51:11 -rw-rw-r--. 1 jenkins jenkins 570 Feb 8 04:43 requirements.txt 05:51:11 -rw-rw-r--. 1 jenkins jenkins 26 Feb 8 04:43 env.properties 05:51:11 -rw-rw-r--. 1 jenkins jenkins 336 Feb 8 04:41 stack-parameters.yaml 05:51:11 drwxrwxr-x. 7 jenkins jenkins 4096 Feb 8 04:39 test 05:51:11 drwxrwxr-x. 2 jenkins jenkins 6 Feb 8 04:39 test@tmp 05:51:11 + true 05:51:11 [openflowplugin-csit-3node-clustering-bulkomatic-only-calcium] $ /bin/sh /tmp/jenkins13596317315377158076.sh 05:51:11 Cleaning up Robot installation... 05:51:12 $ ssh-agent -k 05:51:12 unset SSH_AUTH_SOCK; 05:51:12 unset SSH_AGENT_PID; 05:51:12 echo Agent pid 5352 killed; 05:51:12 [ssh-agent] Stopped. 05:51:12 Recording plot data 05:51:12 Robot results publisher started... 05:51:12 INFO: Checking test criticality is deprecated and will be dropped in a future release! 05:51:12 -Parsing output xml: 05:51:13 Done! 05:51:13 -Copying log files to build dir: 05:51:14 Done! 05:51:14 -Assigning results to build: 05:51:14 Done! 05:51:14 -Checking thresholds: 05:51:14 Done! 05:51:14 Done publishing Robot results. 05:51:14 Build step 'Publish Robot Framework test results' changed build result to UNSTABLE 05:51:14 [PostBuildScript] - [INFO] Executing post build scripts. 05:51:14 [openflowplugin-csit-3node-clustering-bulkomatic-only-calcium] $ /bin/bash /tmp/jenkins5311862664980700894.sh 05:51:14 Archiving csit artifacts 05:51:14 mv: cannot stat '*_1.png': No such file or directory 05:51:14 mv: cannot stat '/tmp/odl1_*': No such file or directory 05:51:14 mv: cannot stat '*_2.png': No such file or directory 05:51:14 mv: cannot stat '/tmp/odl2_*': No such file or directory 05:51:14 mv: cannot stat '*_3.png': No such file or directory 05:51:14 mv: cannot stat '/tmp/odl3_*': No such file or directory 05:51:14 % Total % Received % Xferd Average Speed Time Time Time Current 05:51:14 Dload Upload Total Spent Left Speed 05:51:14 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 1853k 0 1853k 0 0 3976k 0 --:--:-- --:--:-- --:--:-- 3976k 05:51:14 Archive: robot-plugin.zip 05:51:14 inflating: ./archives/robot-plugin/log.html 05:51:14 inflating: ./archives/robot-plugin/output.xml 05:51:14 inflating: ./archives/robot-plugin/report.html 05:51:14 mv: cannot stat '*.log.gz': No such file or directory 05:51:14 mv: cannot stat '*.csv': No such file or directory 05:51:14 mv: cannot stat '*.png': No such file or directory 05:51:14 [PostBuildScript] - [INFO] Executing post build scripts. 05:51:14 [openflowplugin-csit-3node-clustering-bulkomatic-only-calcium] $ /bin/bash /tmp/jenkins680533677704138176.sh 05:51:14 [PostBuildScript] - [INFO] Executing post build scripts. 05:51:14 [EnvInject] - Injecting environment variables from a build step. 05:51:14 [EnvInject] - Injecting as environment variables the properties content 05:51:14 OS_CLOUD=vex 05:51:14 OS_STACK_NAME=releng-openflowplugin-csit-3node-clustering-bulkomatic-only-calcium-132 05:51:14 05:51:14 [EnvInject] - Variables injected successfully. 05:51:14 provisioning config files... 05:51:15 copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml 05:51:15 [openflowplugin-csit-3node-clustering-bulkomatic-only-calcium] $ /bin/bash /tmp/jenkins6789010152999603236.sh 05:51:15 ---> openstack-stack-delete.sh 05:51:15 Setup pyenv: 05:51:15 system 05:51:15 3.8.13 05:51:15 3.9.13 05:51:15 * 3.10.6 (set by /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-calcium/.python-version) 05:51:15 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-Azlr from file:/tmp/.os_lf_venv 05:51:16 lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes python-heatclient python-openstackclient 05:51:32 lf-activate-venv(): INFO: Adding /tmp/venv-Azlr/bin to PATH 05:51:32 INFO: Retrieving stack cost for: releng-openflowplugin-csit-3node-clustering-bulkomatic-only-calcium-132 05:51:38 DEBUG: Successfully retrieved stack cost: total: 0.77 05:52:00 INFO: Deleting stack releng-openflowplugin-csit-3node-clustering-bulkomatic-only-calcium-132 05:52:00 Waiting for stack to delete... 05:52:00 Successfully deleted stack releng-openflowplugin-csit-3node-clustering-bulkomatic-only-calcium-132 05:52:00 [PostBuildScript] - [INFO] Executing post build scripts. 05:52:00 [openflowplugin-csit-3node-clustering-bulkomatic-only-calcium] $ /bin/bash /tmp/jenkins4300939613319995473.sh 05:52:00 ---> sysstat.sh 05:52:00 [openflowplugin-csit-3node-clustering-bulkomatic-only-calcium] $ /bin/bash /tmp/jenkins3361624965951066284.sh 05:52:00 ---> package-listing.sh 05:52:00 ++ facter osfamily 05:52:00 ++ tr '[:upper:]' '[:lower:]' 05:52:00 + OS_FAMILY=redhat 05:52:00 + workspace=/w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-calcium 05:52:00 + START_PACKAGES=/tmp/packages_start.txt 05:52:00 + END_PACKAGES=/tmp/packages_end.txt 05:52:00 + DIFF_PACKAGES=/tmp/packages_diff.txt 05:52:00 + PACKAGES=/tmp/packages_start.txt 05:52:00 + '[' /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-calcium ']' 05:52:00 + PACKAGES=/tmp/packages_end.txt 05:52:00 + case "${OS_FAMILY}" in 05:52:00 + rpm -qa 05:52:00 + sort 05:52:01 + '[' -f /tmp/packages_start.txt ']' 05:52:01 + '[' -f /tmp/packages_end.txt ']' 05:52:01 + diff /tmp/packages_start.txt /tmp/packages_end.txt 05:52:01 + '[' /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-calcium ']' 05:52:01 + mkdir -p /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-calcium/archives/ 05:52:01 + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-calcium/archives/ 05:52:01 [openflowplugin-csit-3node-clustering-bulkomatic-only-calcium] $ /bin/bash /tmp/jenkins4086142615666921724.sh 05:52:01 ---> capture-instance-metadata.sh 05:52:01 Setup pyenv: 05:52:01 system 05:52:01 3.8.13 05:52:01 3.9.13 05:52:01 * 3.10.6 (set by /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-calcium/.python-version) 05:52:01 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-Azlr from file:/tmp/.os_lf_venv 05:52:02 lf-activate-venv(): INFO: Installing: lftools 05:52:12 lf-activate-venv(): INFO: Adding /tmp/venv-Azlr/bin to PATH 05:52:12 INFO: Running in OpenStack, capturing instance metadata 05:52:13 [openflowplugin-csit-3node-clustering-bulkomatic-only-calcium] $ /bin/bash /tmp/jenkins17839519192270074660.sh 05:52:13 provisioning config files... 05:52:13 Could not find credentials [logs] for openflowplugin-csit-3node-clustering-bulkomatic-only-calcium #132 05:52:13 copy managed file [jenkins-log-archives-settings] to file:/w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-calcium@tmp/config2359785999695389144tmp 05:52:13 Regular expression run condition: Expression=[^.*logs-s3.*], Label=[odl-logs-s3-cloudfront-index] 05:52:13 Run condition [Regular expression match] enabling perform for step [Provide Configuration files] 05:52:13 provisioning config files... 05:52:13 copy managed file [jenkins-s3-log-ship] to file:/home/jenkins/.aws/credentials 05:52:13 [EnvInject] - Injecting environment variables from a build step. 05:52:13 [EnvInject] - Injecting as environment variables the properties content 05:52:13 SERVER_ID=logs 05:52:13 05:52:13 [EnvInject] - Variables injected successfully. 05:52:13 [openflowplugin-csit-3node-clustering-bulkomatic-only-calcium] $ /bin/bash /tmp/jenkins5321701349206454338.sh 05:52:13 ---> create-netrc.sh 05:52:13 WARN: Log server credential not found. 05:52:13 [openflowplugin-csit-3node-clustering-bulkomatic-only-calcium] $ /bin/bash /tmp/jenkins8598197203043008538.sh 05:52:13 ---> python-tools-install.sh 05:52:13 Setup pyenv: 05:52:13 system 05:52:13 3.8.13 05:52:13 3.9.13 05:52:13 * 3.10.6 (set by /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-calcium/.python-version) 05:52:14 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-Azlr from file:/tmp/.os_lf_venv 05:52:15 lf-activate-venv(): INFO: Installing: lftools 05:52:26 lf-activate-venv(): INFO: Adding /tmp/venv-Azlr/bin to PATH 05:52:26 [openflowplugin-csit-3node-clustering-bulkomatic-only-calcium] $ /bin/bash /tmp/jenkins17497148927349514589.sh 05:52:26 ---> sudo-logs.sh 05:52:26 Archiving 'sudo' log.. 05:52:27 [openflowplugin-csit-3node-clustering-bulkomatic-only-calcium] $ /bin/bash /tmp/jenkins9388847053674420996.sh 05:52:27 ---> job-cost.sh 05:52:27 Setup pyenv: 05:52:27 system 05:52:27 3.8.13 05:52:27 3.9.13 05:52:27 * 3.10.6 (set by /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-calcium/.python-version) 05:52:27 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-Azlr from file:/tmp/.os_lf_venv 05:52:28 lf-activate-venv(): INFO: Installing: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 05:52:37 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. 05:52:37 lftools 0.37.8 requires openstacksdk<1.5.0, but you have openstacksdk 2.1.0 which is incompatible. 05:52:37 lf-activate-venv(): INFO: Adding /tmp/venv-Azlr/bin to PATH 05:52:37 DEBUG: total: 0.77 05:52:37 INFO: Retrieving Stack Cost... 05:52:37 INFO: Retrieving Pricing Info for: v3-standard-2 05:52:37 INFO: Archiving Costs 05:52:37 [openflowplugin-csit-3node-clustering-bulkomatic-only-calcium] $ /bin/bash -l /tmp/jenkins11665387605907484687.sh 05:52:37 ---> logs-deploy.sh 05:52:37 Setup pyenv: 05:52:38 system 05:52:38 3.8.13 05:52:38 3.9.13 05:52:38 * 3.10.6 (set by /w/workspace/openflowplugin-csit-3node-clustering-bulkomatic-only-calcium/.python-version) 05:52:38 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-Azlr from file:/tmp/.os_lf_venv 05:52:39 lf-activate-venv(): INFO: Installing: lftools 05:52:49 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. 05:52:49 python-openstackclient 6.5.0 requires openstacksdk>=2.0.0, but you have openstacksdk 1.4.0 which is incompatible. 05:52:50 lf-activate-venv(): INFO: Adding /tmp/venv-Azlr/bin to PATH 05:52:50 WARNING: Nexus logging server not set 05:52:50 INFO: S3 path logs/releng/vex-yul-odl-jenkins-1/openflowplugin-csit-3node-clustering-bulkomatic-only-calcium/132/ 05:52:50 INFO: archiving logs to S3 05:52:51 ---> uname -a: 05:52:51 Linux prd-centos8-robot-2c-8g-4565.novalocal 4.18.0-532.el8.x86_64 #1 SMP Thu Dec 21 12:11:59 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux 05:52:51 05:52:51 05:52:51 ---> lscpu: 05:52:51 Architecture: x86_64 05:52:51 CPU op-mode(s): 32-bit, 64-bit 05:52:51 Byte Order: Little Endian 05:52:51 CPU(s): 2 05:52:51 On-line CPU(s) list: 0,1 05:52:51 Thread(s) per core: 1 05:52:51 Core(s) per socket: 1 05:52:51 Socket(s): 2 05:52:51 NUMA node(s): 1 05:52:51 Vendor ID: AuthenticAMD 05:52:51 CPU family: 23 05:52:51 Model: 49 05:52:51 Model name: AMD EPYC-Rome Processor 05:52:51 Stepping: 0 05:52:51 CPU MHz: 2800.000 05:52:51 BogoMIPS: 5600.00 05:52:51 Virtualization: AMD-V 05:52:51 Hypervisor vendor: KVM 05:52:51 Virtualization type: full 05:52:51 L1d cache: 32K 05:52:51 L1i cache: 32K 05:52:51 L2 cache: 512K 05:52:51 L3 cache: 16384K 05:52:51 NUMA node0 CPU(s): 0,1 05:52:51 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities 05:52:51 05:52:51 05:52:51 ---> nproc: 05:52:51 2 05:52:51 05:52:51 05:52:51 ---> df -h: 05:52:51 Filesystem Size Used Avail Use% Mounted on 05:52:51 devtmpfs 3.8G 0 3.8G 0% /dev 05:52:51 tmpfs 3.8G 0 3.8G 0% /dev/shm 05:52:51 tmpfs 3.8G 17M 3.8G 1% /run 05:52:51 tmpfs 3.8G 0 3.8G 0% /sys/fs/cgroup 05:52:51 /dev/vda1 40G 9.3G 31G 24% / 05:52:51 tmpfs 770M 0 770M 0% /run/user/1001 05:52:51 05:52:51 05:52:51 ---> free -m: 05:52:51 total used free shared buff/cache available 05:52:51 Mem: 7697 604 4767 19 2325 6795 05:52:51 Swap: 1023 0 1023 05:52:51 05:52:51 05:52:51 ---> ip addr: 05:52:51 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 05:52:51 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 05:52:51 inet 127.0.0.1/8 scope host lo 05:52:51 valid_lft forever preferred_lft forever 05:52:51 inet6 ::1/128 scope host 05:52:51 valid_lft forever preferred_lft forever 05:52:51 2: eth0: mtu 1458 qdisc mq state UP group default qlen 1000 05:52:51 link/ether fa:16:3e:f0:d7:af brd ff:ff:ff:ff:ff:ff 05:52:51 altname enp0s3 05:52:51 altname ens3 05:52:51 inet 10.30.171.66/23 brd 10.30.171.255 scope global dynamic noprefixroute eth0 05:52:51 valid_lft 81917sec preferred_lft 81917sec 05:52:51 inet6 fe80::f816:3eff:fef0:d7af/64 scope link 05:52:51 valid_lft forever preferred_lft forever 05:52:51 05:52:51 05:52:51 ---> sar -b -r -n DEV: 05:52:51 Linux 4.18.0-532.el8.x86_64 (centos-stream-8-robot-f84d986f-3f43-4447-86d7-70e5891bac13.noval) 02/08/2024 _x86_64_ (2 CPU) 05:52:51 05:52:51 04:38:04 LINUX RESTART (2 CPU) 05:52:51 05:52:51 04:39:01 AM tps rtps wtps bread/s bwrtn/s 05:52:51 04:40:01 AM 60.73 17.88 42.85 3778.07 28146.05 05:52:51 04:41:01 AM 104.67 6.53 98.13 1267.84 9984.66 05:52:51 04:42:01 AM 56.86 0.60 56.26 27.06 4573.49 05:52:51 04:43:01 AM 28.51 0.87 27.64 125.69 2528.31 05:52:51 04:44:01 AM 60.96 0.20 60.76 9.33 7007.48 05:52:51 04:45:01 AM 17.63 0.00 17.63 0.00 1379.32 05:52:51 04:46:01 AM 5.92 0.02 5.90 0.13 260.31 05:52:51 04:47:01 AM 0.43 0.00 0.43 0.00 11.85 05:52:51 04:48:01 AM 0.15 0.00 0.15 0.00 9.10 05:52:51 04:49:01 AM 0.17 0.00 0.17 0.00 6.28 05:52:51 04:50:01 AM 0.55 0.00 0.55 0.00 17.24 05:52:51 04:51:01 AM 0.62 0.00 0.62 0.00 15.68 05:52:51 04:52:01 AM 0.47 0.00 0.47 0.00 8.91 05:52:51 04:53:02 AM 0.48 0.00 0.48 0.00 33.12 05:52:51 04:54:01 AM 1.69 0.07 1.63 1.36 41.10 05:52:51 04:55:01 AM 0.42 0.00 0.42 0.00 16.43 05:52:51 04:56:01 AM 0.15 0.00 0.15 0.00 11.48 05:52:51 04:57:01 AM 0.22 0.03 0.18 1.87 15.91 05:52:51 04:58:01 AM 0.17 0.00 0.17 0.00 3.63 05:52:51 04:59:01 AM 0.47 0.00 0.47 0.00 9.48 05:52:51 05:00:01 AM 0.37 0.00 0.37 0.00 5.37 05:52:51 05:01:01 AM 0.28 0.02 0.27 0.13 6.70 05:52:51 05:02:01 AM 0.42 0.07 0.35 1.73 9.40 05:52:51 05:03:01 AM 0.18 0.00 0.18 0.00 6.01 05:52:51 05:04:01 AM 0.13 0.02 0.12 0.13 1.48 05:52:51 05:05:01 AM 30.29 22.69 7.60 784.94 5520.36 05:52:51 05:06:01 AM 2.35 0.00 2.35 0.00 532.23 05:52:51 05:07:01 AM 0.12 0.00 0.12 0.00 23.61 05:52:51 05:08:01 AM 0.17 0.00 0.17 0.00 4.95 05:52:51 05:09:01 AM 0.15 0.00 0.15 0.00 13.10 05:52:51 05:10:01 AM 0.20 0.00 0.20 0.00 10.46 05:52:51 05:11:01 AM 0.68 0.00 0.68 0.00 17.21 05:52:51 05:12:01 AM 0.47 0.00 0.47 0.00 7.31 05:52:51 05:13:01 AM 0.50 0.00 0.50 0.00 8.01 05:52:51 05:14:01 AM 0.53 0.00 0.53 0.00 8.15 05:52:51 05:15:01 AM 0.48 0.00 0.48 0.00 7.50 05:52:51 05:16:01 AM 0.48 0.00 0.48 0.00 7.98 05:52:51 05:17:01 AM 0.40 0.00 0.40 0.00 6.20 05:52:51 05:18:01 AM 0.45 0.00 0.45 0.00 7.73 05:52:51 05:19:01 AM 0.48 0.00 0.48 0.00 8.65 05:52:51 05:20:01 AM 0.40 0.00 0.40 0.00 12.20 05:52:51 05:21:01 AM 0.60 0.00 0.60 0.00 33.69 05:52:51 05:22:01 AM 0.47 0.00 0.47 0.00 13.50 05:52:51 05:23:01 AM 0.30 0.00 0.30 0.00 23.19 05:52:51 05:24:01 AM 0.28 0.00 0.28 0.00 3.98 05:52:51 05:25:01 AM 0.40 0.00 0.40 0.00 4.58 05:52:51 05:26:01 AM 0.33 0.00 0.33 0.00 3.85 05:52:51 05:27:01 AM 0.33 0.00 0.33 0.00 3.85 05:52:51 05:28:01 AM 0.48 0.00 0.48 0.00 6.12 05:52:51 05:29:01 AM 0.28 0.00 0.28 0.00 6.92 05:52:51 05:30:01 AM 0.13 0.00 0.13 0.00 6.13 05:52:51 05:31:01 AM 0.18 0.00 0.18 0.00 26.71 05:52:51 05:32:01 AM 0.18 0.00 0.18 0.00 4.82 05:52:51 05:33:01 AM 0.13 0.00 0.13 0.00 16.28 05:52:51 05:34:01 AM 0.18 0.00 0.18 0.00 8.96 05:52:51 05:35:01 AM 0.25 0.00 0.25 0.00 3.47 05:52:51 05:36:01 AM 0.43 0.00 0.43 0.00 5.23 05:52:51 05:37:01 AM 0.32 0.00 0.32 0.00 3.72 05:52:51 05:38:01 AM 0.33 0.00 0.33 0.00 3.85 05:52:51 05:39:01 AM 0.37 0.00 0.37 0.00 7.90 05:52:51 05:40:01 AM 0.17 0.00 0.17 0.00 6.10 05:52:51 05:41:01 AM 0.27 0.00 0.27 0.00 26.94 05:52:51 05:42:01 AM 0.25 0.00 0.25 0.00 9.02 05:52:51 05:43:01 AM 0.28 0.00 0.28 0.00 12.16 05:52:51 05:44:01 AM 0.23 0.00 0.23 0.00 14.93 05:52:51 05:45:01 AM 0.73 0.30 0.43 6.40 5.23 05:52:51 05:46:01 AM 0.97 0.00 0.97 0.00 20.56 05:52:51 05:47:01 AM 0.32 0.00 0.32 0.00 2.97 05:52:51 05:48:01 AM 0.43 0.00 0.43 0.00 5.33 05:52:51 05:49:01 AM 0.40 0.00 0.40 0.00 6.27 05:52:51 05:50:01 AM 0.20 0.00 0.20 0.00 7.48 05:52:51 05:51:01 AM 0.52 0.00 0.52 0.00 16.41 05:52:51 05:52:01 AM 20.24 0.32 19.93 44.12 1489.30 05:52:51 Average: 5.64 0.68 4.96 82.88 851.09 05:52:51 05:52:51 04:39:01 AM kbmemfree kbavail kbmemused %memused kbbuffers kbcached kbcommit %commit kbactive kbinact kbdirty 05:52:51 04:40:01 AM 5574916 7099456 2307532 29.27 2688 1717856 694316 7.77 161196 1866668 91864 05:52:51 04:41:01 AM 5270676 7042856 2611772 33.13 2688 1954124 701400 7.85 188384 2095040 52512 05:52:51 04:42:01 AM 5222468 7038520 2659980 33.75 2688 1993152 681588 7.63 194568 2121404 47344 05:52:51 04:43:01 AM 5161772 7018556 2720676 34.52 2688 2032572 705560 7.90 224864 2146016 34072 05:52:51 04:44:01 AM 5031816 7042972 2850632 36.16 2688 2180212 660840 7.40 233716 2239992 28704 05:52:51 04:45:01 AM 5030144 7040712 2852304 36.19 2688 2180220 660840 7.40 233732 2244172 4 05:52:51 04:46:01 AM 4990976 7002744 2891472 36.68 2688 2181420 747988 8.38 233772 2282892 52 05:52:51 04:47:01 AM 4990664 7002572 2891784 36.69 2688 2181560 747988 8.38 233772 2283096 32 05:52:51 04:48:01 AM 4988016 7000196 2894432 36.72 2688 2181848 747988 8.38 233772 2286036 80 05:52:51 04:49:01 AM 4986276 6998696 2896172 36.74 2688 2182104 747988 8.38 233772 2287748 184 05:52:51 04:50:01 AM 4985148 6997760 2897300 36.76 2688 2182272 748660 8.38 233772 2288684 0 05:52:51 04:51:01 AM 4984632 6997520 2897816 36.76 2688 2182560 748660 8.38 233772 2289360 16 05:52:51 04:52:01 AM 4984512 6997536 2897936 36.76 2688 2182696 748660 8.38 233772 2289476 16 05:52:51 04:53:02 AM 5014088 7028004 2868360 36.39 2688 2183584 737408 8.26 234252 2259424 68 05:52:51 04:54:01 AM 5014216 7028220 2868232 36.39 2688 2183680 737408 8.26 234252 2259568 20 05:52:51 04:55:01 AM 5013652 7028204 2868796 36.39 2688 2184228 737408 8.26 234252 2260008 212 05:52:51 04:56:01 AM 5012236 7026928 2870212 36.41 2688 2184368 737408 8.26 234252 2261532 44 05:52:51 04:57:01 AM 5011404 7026580 2871044 36.42 2688 2184844 737408 8.26 234512 2262144 24 05:52:51 04:58:01 AM 5011412 7026680 2871036 36.42 2688 2184936 737408 8.26 234512 2262120 60 05:52:51 04:59:01 AM 5011472 7026848 2870976 36.42 2688 2185036 737408 8.26 234512 2262228 4 05:52:51 05:00:01 AM 5010644 7026108 2871804 36.43 2688 2185132 756424 8.47 234512 2262744 52 05:52:51 05:01:01 AM 5010200 7025748 2872248 36.44 2688 2185240 737080 8.25 234512 2263108 48 05:52:51 05:02:01 AM 5010380 7026100 2872068 36.44 2688 2185404 737080 8.25 234532 2262908 32 05:52:51 05:03:01 AM 5010204 7026044 2872244 36.44 2688 2185508 737080 8.25 234532 2263176 4 05:52:51 05:04:01 AM 5010028 7025888 2872420 36.44 2688 2185528 741288 8.30 234532 2263196 4 05:52:51 05:05:01 AM 4820652 7025152 3061796 38.84 2688 2373988 730540 8.18 347904 2338280 15316 05:52:51 05:06:01 AM 4820744 7025376 3061704 38.84 2688 2374120 730540 8.18 347904 2338344 24 05:52:51 05:07:01 AM 4820240 7025588 3062208 38.85 2688 2374836 730540 8.18 347904 2339332 56 05:52:51 05:08:01 AM 4819984 7025420 3062464 38.85 2688 2374932 730540 8.18 347904 2339560 40 05:52:51 05:09:01 AM 4819536 7025312 3062912 38.86 2688 2375272 730540 8.18 347904 2340028 16 05:52:51 05:10:01 AM 4819076 7025108 3063372 38.86 2688 2375528 730720 8.18 347904 2340372 4 05:52:51 05:11:01 AM 4818996 7025332 3063452 38.86 2688 2375820 730720 8.18 347904 2340548 16 05:52:51 05:12:01 AM 4818632 7025064 3063816 38.87 2688 2375916 730720 8.18 347904 2340832 16 05:52:51 05:13:01 AM 4818640 7025176 3063808 38.87 2688 2376012 730720 8.18 347904 2340936 4 05:52:51 05:14:01 AM 4818640 7025272 3063808 38.87 2688 2376108 730720 8.18 347904 2341032 4 05:52:51 05:15:01 AM 4818508 7025228 3063940 38.87 2688 2376204 730720 8.18 347904 2341192 16 05:52:51 05:16:01 AM 4818444 7025260 3064004 38.87 2688 2376300 730720 8.18 347904 2341336 4 05:52:51 05:17:01 AM 4818448 7025340 3064000 38.87 2688 2376368 730720 8.18 347904 2341412 4 05:52:51 05:18:01 AM 4817992 7024956 3064456 38.88 2688 2376456 730720 8.18 347904 2341512 4 05:52:51 05:19:01 AM 4817860 7024960 3064588 38.88 2688 2376592 730720 8.18 347904 2341720 24 05:52:51 05:20:01 AM 4814260 7022276 3068188 38.92 2688 2377492 748800 8.38 347904 2344840 680 05:52:51 05:21:01 AM 4814644 7022792 3067804 38.92 2688 2377624 748800 8.38 347904 2344792 4 05:52:51 05:22:01 AM 4814144 7022680 3068304 38.93 2688 2378012 714464 8.00 347904 2345660 120 05:52:51 05:23:01 AM 4813600 7022644 3068848 38.93 2688 2378520 714464 8.00 347904 2346180 24 05:52:51 05:24:01 AM 4813576 7022636 3068872 38.93 2688 2378536 714464 8.00 347904 2346196 4 05:52:51 05:25:01 AM 4813336 7022416 3069112 38.94 2688 2378556 714464 8.00 347904 2346424 4 05:52:51 05:26:01 AM 4813476 7022572 3068972 38.93 2688 2378572 714464 8.00 347904 2346272 4 05:52:51 05:27:01 AM 4813564 7022676 3068884 38.93 2688 2378588 714464 8.00 347904 2346288 4 05:52:51 05:28:01 AM 4813532 7022664 3068916 38.93 2688 2378608 714464 8.00 347904 2346308 4 05:52:51 05:29:01 AM 4813040 7022332 3069408 38.94 2688 2378776 732068 8.20 347904 2346524 56 05:52:51 05:30:01 AM 4812788 7022184 3069660 38.94 2688 2378904 722820 8.09 347904 2346832 40 05:52:51 05:31:01 AM 4812216 7022356 3070232 38.95 2688 2379648 722820 8.09 347904 2347512 24 05:52:51 05:32:01 AM 4812112 7022392 3070336 38.95 2688 2379772 722820 8.09 347904 2347652 68 05:52:51 05:33:01 AM 4810568 7021464 3071880 38.97 2688 2380380 722820 8.09 347904 2349212 228 05:52:51 05:34:01 AM 4811008 7021912 3071440 38.97 2688 2380396 722820 8.09 347904 2348880 16 05:52:51 05:35:01 AM 4810876 7021796 3071572 38.97 2688 2380404 722820 8.09 347904 2348948 4 05:52:51 05:36:01 AM 4811068 7022008 3071380 38.96 2688 2380424 722820 8.09 347904 2348916 4 05:52:51 05:37:01 AM 4811052 7022008 3071396 38.97 2688 2380440 722820 8.09 347904 2348936 4 05:52:51 05:38:01 AM 4810844 7021816 3071604 38.97 2688 2380456 722820 8.09 347904 2349068 4 05:52:51 05:39:01 AM 4810664 7021776 3071784 38.97 2688 2380604 722820 8.09 347904 2349096 24 05:52:51 05:40:01 AM 4809804 7021048 3072644 38.98 2688 2380736 742716 8.32 347904 2349564 32 05:52:51 05:41:01 AM 4809624 7021620 3072824 38.98 2688 2381480 742716 8.32 347904 2349996 52 05:52:51 05:42:01 AM 4809512 7021644 3072936 38.98 2688 2381616 742716 8.32 347904 2350132 24 05:52:51 05:43:01 AM 4809396 7021948 3073052 38.99 2688 2382028 742716 8.32 347904 2350552 192 05:52:51 05:44:01 AM 4808944 7021712 3073504 38.99 2688 2382244 742716 8.32 347904 2350900 4 05:52:51 05:45:01 AM 4808508 7021488 3073940 39.00 2688 2382456 742716 8.32 348000 2351096 12 05:52:51 05:46:01 AM 4808644 7021640 3073804 39.00 2688 2382472 742716 8.32 348000 2350928 4 05:52:51 05:47:01 AM 4808792 7021804 3073656 38.99 2688 2382488 742716 8.32 348000 2350948 4 05:52:51 05:48:01 AM 4808668 7021700 3073780 39.00 2688 2382508 742716 8.32 348000 2351084 4 05:52:51 05:49:01 AM 4808556 7021668 3073892 39.00 2688 2382596 742716 8.32 348000 2351164 40 05:52:51 05:50:01 AM 4808072 7021356 3074376 39.00 2688 2382760 742716 8.32 348000 2351404 48 05:52:51 05:51:01 AM 4824000 7040436 3058448 38.80 2688 2385912 666576 7.46 348860 2334620 2892 05:52:51 05:52:01 AM 4933048 7005744 2949400 37.42 2688 2247040 695648 7.79 551336 2046636 25564 05:52:51 Average: 4897730 7023414 2984718 37.87 2688 2295967 728279 8.15 309457 2303462 4126 05:52:51 05:52:51 04:39:01 AM IFACE rxpck/s txpck/s rxkB/s txkB/s rxcmp/s txcmp/s rxmcst/s %ifutil 05:52:51 04:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 04:40:01 AM eth0 297.30 186.05 1144.07 57.44 0.00 0.00 0.00 0.00 05:52:51 04:41:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 04:41:01 AM eth0 60.50 50.97 735.06 6.13 0.00 0.00 0.00 0.00 05:52:51 04:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 04:42:01 AM eth0 28.78 19.90 159.96 4.99 0.00 0.00 0.00 0.00 05:52:51 04:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 04:43:01 AM eth0 22.83 18.01 7.68 5.56 0.00 0.00 0.00 0.00 05:52:51 04:44:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 04:44:01 AM eth0 342.83 298.20 380.97 68.54 0.00 0.00 0.00 0.00 05:52:51 04:45:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 04:45:01 AM eth0 173.13 147.32 39.74 27.38 0.00 0.00 0.00 0.00 05:52:51 04:46:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 04:46:01 AM eth0 57.31 50.77 19.01 4.69 0.00 0.00 0.00 0.00 05:52:51 04:47:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 04:47:01 AM eth0 2.98 2.07 0.39 0.18 0.00 0.00 0.00 0.00 05:52:51 04:48:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 04:48:01 AM eth0 26.09 25.09 4.51 1.99 0.00 0.00 0.00 0.00 05:52:51 04:49:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 04:49:01 AM eth0 26.21 25.87 4.46 2.10 0.00 0.00 0.00 0.00 05:52:51 04:50:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 04:50:01 AM eth0 1.75 2.05 0.39 0.24 0.00 0.00 0.00 0.00 05:52:51 04:51:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 04:51:01 AM eth0 26.13 25.41 4.41 2.01 0.00 0.00 0.00 0.00 05:52:51 04:52:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 04:52:01 AM eth0 3.80 2.38 0.55 0.20 0.00 0.00 0.00 0.00 05:52:51 04:53:02 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 04:53:02 AM eth0 70.48 68.94 13.41 5.91 0.00 0.00 0.00 0.00 05:52:51 04:54:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 04:54:01 AM eth0 0.95 0.36 0.52 0.39 0.00 0.00 0.00 0.00 05:52:51 04:55:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 04:55:01 AM eth0 30.92 27.96 5.93 2.22 0.00 0.00 0.00 0.00 05:52:51 04:56:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 04:56:01 AM eth0 3.48 1.78 0.50 0.16 0.00 0.00 0.00 0.00 05:52:51 04:57:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 04:57:01 AM eth0 16.00 15.73 3.30 1.47 0.00 0.00 0.00 0.00 05:52:51 04:58:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 04:58:01 AM eth0 0.50 0.07 0.03 0.00 0.00 0.00 0.00 0.00 05:52:51 04:59:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 04:59:01 AM eth0 0.45 0.07 0.02 0.00 0.00 0.00 0.00 0.00 05:52:51 05:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 05:00:01 AM eth0 0.65 0.25 0.10 0.07 0.00 0.00 0.00 0.00 05:52:51 05:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 05:01:01 AM eth0 0.30 0.07 0.02 0.00 0.00 0.00 0.00 0.00 05:52:51 05:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 05:02:01 AM eth0 0.47 0.10 0.03 0.01 0.00 0.00 0.00 0.00 05:52:51 05:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 05:03:01 AM eth0 7.16 6.61 1.22 0.46 0.00 0.00 0.00 0.00 05:52:51 05:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 05:04:01 AM eth0 0.33 0.00 0.02 0.00 0.00 0.00 0.00 0.00 05:52:51 05:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 05:05:01 AM eth0 186.22 128.97 1327.54 8.68 0.00 0.00 0.00 0.00 05:52:51 05:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 05:06:01 AM eth0 1.68 2.07 0.29 0.18 0.00 0.00 0.00 0.00 05:52:51 05:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 05:07:01 AM eth0 42.89 42.70 8.89 3.30 0.00 0.00 0.00 0.00 05:52:51 05:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 05:08:01 AM eth0 0.08 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 05:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 05:09:01 AM eth0 17.16 16.89 3.67 1.43 0.00 0.00 0.00 0.00 05:52:51 05:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 05:10:01 AM eth0 8.36 8.61 1.49 0.79 0.00 0.00 0.00 0.00 05:52:51 05:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 05:11:01 AM eth0 8.08 7.90 1.98 0.81 0.00 0.00 0.00 0.00 05:52:51 05:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 05:12:01 AM eth0 0.35 0.12 0.02 0.01 0.00 0.00 0.00 0.00 05:52:51 05:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 05:13:01 AM eth0 0.27 0.07 0.01 0.00 0.00 0.00 0.00 0.00 05:52:51 05:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 05:14:01 AM eth0 0.17 0.07 0.01 0.00 0.00 0.00 0.00 0.00 05:52:51 05:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 05:15:01 AM eth0 0.43 0.13 0.09 0.07 0.00 0.00 0.00 0.00 05:52:51 05:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 05:16:01 AM eth0 0.32 0.07 0.02 0.00 0.00 0.00 0.00 0.00 05:52:51 05:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 05:17:01 AM eth0 7.31 7.01 1.59 0.49 0.00 0.00 0.00 0.00 05:52:51 05:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 05:18:01 AM eth0 9.00 8.17 1.74 0.82 0.00 0.00 0.00 0.00 05:52:51 05:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 05:19:01 AM eth0 2.27 2.13 0.58 0.36 0.00 0.00 0.00 0.00 05:52:51 05:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 05:20:01 AM eth0 87.60 86.97 15.77 6.72 0.00 0.00 0.00 0.00 05:52:51 05:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 05:21:01 AM eth0 1.58 1.15 0.29 0.12 0.00 0.00 0.00 0.00 05:52:51 05:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 05:22:01 AM eth0 12.88 12.98 2.49 1.62 0.00 0.00 0.00 0.00 05:52:51 05:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 05:23:01 AM eth0 6.83 6.58 2.87 0.91 0.00 0.00 0.00 0.00 05:52:51 05:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 05:24:01 AM eth0 7.45 0.05 0.49 0.00 0.00 0.00 0.00 0.00 05:52:51 05:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 05:25:01 AM eth0 0.23 0.12 0.08 0.06 0.00 0.00 0.00 0.00 05:52:51 05:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 05:26:01 AM eth0 0.15 0.05 0.01 0.00 0.00 0.00 0.00 0.00 05:52:51 05:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 05:27:01 AM eth0 0.12 0.00 0.01 0.00 0.00 0.00 0.00 0.00 05:52:51 05:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 05:28:01 AM eth0 0.25 0.20 0.01 0.01 0.00 0.00 0.00 0.00 05:52:51 05:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 05:29:01 AM eth0 13.43 12.95 2.76 1.06 0.00 0.00 0.00 0.00 05:52:51 05:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 05:30:01 AM eth0 1.70 2.02 0.35 0.23 0.00 0.00 0.00 0.00 05:52:51 05:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 05:31:01 AM eth0 58.83 58.41 11.52 4.33 0.00 0.00 0.00 0.00 05:52:51 05:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 05:32:01 AM eth0 1.75 1.65 0.30 0.15 0.00 0.00 0.00 0.00 05:52:51 05:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 05:33:01 AM eth0 33.46 33.21 6.58 3.17 0.00 0.00 0.00 0.00 05:52:51 05:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 05:34:01 AM eth0 0.13 0.00 0.01 0.00 0.00 0.00 0.00 0.00 05:52:51 05:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 05:35:01 AM eth0 0.25 0.10 0.08 0.06 0.00 0.00 0.00 0.00 05:52:51 05:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 05:36:01 AM eth0 0.18 0.10 0.01 0.00 0.00 0.00 0.00 0.00 05:52:51 05:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 05:37:01 AM eth0 0.08 0.05 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 05:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 05:38:01 AM eth0 0.17 0.05 0.01 0.00 0.00 0.00 0.00 0.00 05:52:51 05:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 05:39:01 AM eth0 15.98 14.88 2.89 1.17 0.00 0.00 0.00 0.00 05:52:51 05:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 05:40:01 AM eth0 2.50 2.07 0.74 0.48 0.00 0.00 0.00 0.00 05:52:51 05:41:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 05:41:01 AM eth0 65.18 65.06 12.20 4.78 0.00 0.00 0.00 0.00 05:52:51 05:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 05:42:01 AM eth0 1.77 2.18 0.31 0.19 0.00 0.00 0.00 0.00 05:52:51 05:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 05:43:01 AM eth0 24.73 24.96 4.33 2.20 0.00 0.00 0.00 0.00 05:52:51 05:44:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 05:44:01 AM eth0 9.17 9.18 2.04 0.82 0.00 0.00 0.00 0.00 05:52:51 05:45:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 05:45:01 AM eth0 0.30 0.13 0.08 0.07 0.00 0.00 0.00 0.00 05:52:51 05:46:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 05:46:01 AM eth0 0.20 0.10 0.01 0.00 0.00 0.00 0.00 0.00 05:52:51 05:47:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 05:47:01 AM eth0 0.12 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 05:48:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 05:48:01 AM eth0 0.17 0.05 0.01 0.00 0.00 0.00 0.00 0.00 05:52:51 05:49:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 05:49:01 AM eth0 17.26 16.66 2.97 1.29 0.00 0.00 0.00 0.00 05:52:51 05:50:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 05:50:01 AM eth0 1.93 2.25 0.42 0.28 0.00 0.00 0.00 0.00 05:52:51 05:51:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 05:51:01 AM eth0 148.45 147.58 28.41 11.24 0.00 0.00 0.00 0.00 05:52:51 05:52:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 05:52:01 AM eth0 69.11 52.35 108.56 76.65 0.00 0.00 0.00 0.00 05:52:51 Average: lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:51 Average: eth0 28.36 24.05 55.92 4.48 0.00 0.00 0.00 0.00 05:52:51 05:52:51 05:52:51 ---> sar -P ALL: 05:52:51 Linux 4.18.0-532.el8.x86_64 (centos-stream-8-robot-f84d986f-3f43-4447-86d7-70e5891bac13.noval) 02/08/2024 _x86_64_ (2 CPU) 05:52:51 05:52:51 04:38:04 LINUX RESTART (2 CPU) 05:52:51 05:52:51 04:39:01 AM CPU %user %nice %system %iowait %steal %idle 05:52:51 04:40:01 AM all 22.16 0.00 4.63 27.72 0.07 45.43 05:52:51 04:40:01 AM 0 20.62 0.00 4.56 25.43 0.07 49.33 05:52:51 04:40:01 AM 1 23.69 0.00 4.71 30.01 0.07 41.53 05:52:51 04:41:01 AM all 29.53 0.00 4.47 6.37 0.13 59.51 05:52:51 04:41:01 AM 0 24.42 0.00 4.03 6.97 0.12 64.47 05:52:51 04:41:01 AM 1 34.63 0.00 4.92 5.77 0.13 54.55 05:52:51 04:42:01 AM all 23.75 0.00 3.02 1.67 0.10 71.46 05:52:51 04:42:01 AM 0 19.20 0.00 2.72 2.00 0.10 75.98 05:52:51 04:42:01 AM 1 28.30 0.00 3.33 1.34 0.10 66.94 05:52:51 04:43:01 AM all 16.89 0.00 2.62 0.74 0.08 79.67 05:52:51 04:43:01 AM 0 20.80 0.00 2.88 0.62 0.08 75.63 05:52:51 04:43:01 AM 1 12.99 0.00 2.37 0.87 0.07 83.70 05:52:51 04:44:01 AM all 27.57 0.00 4.22 2.67 0.11 65.44 05:52:51 04:44:01 AM 0 16.30 0.00 3.58 2.37 0.10 77.64 05:52:51 04:44:01 AM 1 38.91 0.00 4.87 2.96 0.12 53.14 05:52:51 04:45:01 AM all 0.77 0.00 0.62 3.55 0.07 94.99 05:52:51 04:45:01 AM 0 0.90 0.00 0.55 4.58 0.05 93.92 05:52:51 04:45:01 AM 1 0.64 0.00 0.69 2.53 0.08 96.07 05:52:51 04:46:01 AM all 4.79 0.00 0.49 0.18 0.07 94.47 05:52:51 04:46:01 AM 0 5.07 0.00 0.50 0.05 0.07 94.30 05:52:51 04:46:01 AM 1 4.50 0.00 0.47 0.32 0.07 94.64 05:52:51 04:47:01 AM all 0.80 0.00 0.14 0.00 0.08 98.97 05:52:51 04:47:01 AM 0 0.79 0.00 0.17 0.00 0.08 98.96 05:52:51 04:47:01 AM 1 0.82 0.00 0.12 0.00 0.08 98.98 05:52:51 04:48:01 AM all 2.19 0.00 0.24 0.00 0.08 97.49 05:52:51 04:48:01 AM 0 2.51 0.00 0.25 0.00 0.08 97.15 05:52:51 04:48:01 AM 1 1.86 0.00 0.23 0.00 0.08 97.82 05:52:51 04:49:01 AM all 2.20 0.00 0.20 0.00 0.08 97.52 05:52:51 04:49:01 AM 0 1.98 0.00 0.17 0.00 0.08 97.77 05:52:51 04:49:01 AM 1 2.42 0.00 0.23 0.00 0.07 97.28 05:52:51 04:50:01 AM all 0.89 0.00 0.14 0.00 0.06 98.91 05:52:51 04:50:01 AM 0 0.87 0.00 0.17 0.00 0.05 98.91 05:52:51 04:50:01 AM 1 0.92 0.00 0.12 0.00 0.07 98.90 05:52:51 05:52:51 04:50:01 AM CPU %user %nice %system %iowait %steal %idle 05:52:51 04:51:01 AM all 2.23 0.00 0.24 0.00 0.08 97.44 05:52:51 04:51:01 AM 0 2.11 0.00 0.22 0.00 0.07 97.61 05:52:51 04:51:01 AM 1 2.36 0.00 0.27 0.00 0.10 97.27 05:52:51 04:52:01 AM all 0.75 0.00 0.17 0.00 0.06 99.02 05:52:51 04:52:01 AM 0 0.65 0.00 0.20 0.00 0.07 99.08 05:52:51 04:52:01 AM 1 0.85 0.00 0.13 0.00 0.05 98.96 05:52:51 04:53:02 AM all 5.90 0.00 0.55 0.00 0.07 93.48 05:52:51 04:53:02 AM 0 6.27 0.00 0.63 0.00 0.07 93.03 05:52:51 04:53:02 AM 1 5.53 0.00 0.47 0.00 0.07 93.93 05:52:51 04:54:01 AM all 1.59 0.00 0.28 0.01 0.08 98.05 05:52:51 04:54:01 AM 0 1.19 0.00 0.20 0.00 0.08 98.52 05:52:51 04:54:01 AM 1 1.99 0.00 0.36 0.02 0.07 97.57 05:52:51 04:55:01 AM all 2.92 0.00 0.23 0.00 0.09 96.76 05:52:51 04:55:01 AM 0 1.24 0.00 0.23 0.00 0.10 98.43 05:52:51 04:55:01 AM 1 4.61 0.00 0.22 0.00 0.08 95.09 05:52:51 04:56:01 AM all 0.74 0.00 0.15 0.00 0.08 99.03 05:52:51 04:56:01 AM 0 0.62 0.00 0.13 0.00 0.07 99.18 05:52:51 04:56:01 AM 1 0.87 0.00 0.17 0.00 0.08 98.88 05:52:51 04:57:01 AM all 2.33 0.00 0.19 0.00 0.08 97.40 05:52:51 04:57:01 AM 0 1.20 0.00 0.18 0.00 0.08 98.53 05:52:51 04:57:01 AM 1 3.45 0.00 0.20 0.00 0.08 96.26 05:52:51 04:58:01 AM all 1.53 0.00 0.13 0.00 0.08 98.27 05:52:51 04:58:01 AM 0 1.69 0.00 0.12 0.00 0.08 98.11 05:52:51 04:58:01 AM 1 1.37 0.00 0.13 0.00 0.07 98.43 05:52:51 04:59:01 AM all 1.46 0.00 0.13 0.00 0.07 98.35 05:52:51 04:59:01 AM 0 1.62 0.00 0.13 0.00 0.07 98.18 05:52:51 04:59:01 AM 1 1.30 0.00 0.12 0.00 0.07 98.51 05:52:51 05:00:01 AM all 1.47 0.00 0.15 0.00 0.08 98.30 05:52:51 05:00:01 AM 0 1.64 0.00 0.13 0.00 0.08 98.14 05:52:51 05:00:01 AM 1 1.30 0.00 0.17 0.00 0.08 98.45 05:52:51 05:01:01 AM all 1.42 0.00 0.15 0.00 0.08 98.34 05:52:51 05:01:01 AM 0 1.82 0.00 0.15 0.00 0.08 97.94 05:52:51 05:01:01 AM 1 1.02 0.00 0.15 0.00 0.08 98.75 05:52:51 05:52:51 05:01:01 AM CPU %user %nice %system %iowait %steal %idle 05:52:51 05:02:01 AM all 1.47 0.00 0.13 0.00 0.08 98.32 05:52:51 05:02:01 AM 0 1.39 0.00 0.13 0.00 0.08 98.40 05:52:51 05:02:01 AM 1 1.55 0.00 0.13 0.00 0.07 98.25 05:52:51 05:03:01 AM all 1.55 0.00 0.15 0.00 0.08 98.21 05:52:51 05:03:01 AM 0 1.79 0.00 0.17 0.00 0.08 97.96 05:52:51 05:03:01 AM 1 1.32 0.00 0.13 0.00 0.08 98.46 05:52:51 05:04:01 AM all 1.11 0.00 0.13 0.00 0.08 98.69 05:52:51 05:04:01 AM 0 1.34 0.00 0.15 0.00 0.08 98.43 05:52:51 05:04:01 AM 1 0.89 0.00 0.10 0.00 0.07 98.95 05:52:51 05:05:01 AM all 1.03 16.22 1.17 1.71 0.09 79.78 05:52:51 05:05:01 AM 0 1.14 20.25 1.17 2.01 0.08 75.34 05:52:51 05:05:01 AM 1 0.92 12.19 1.17 1.40 0.10 84.21 05:52:51 05:06:01 AM all 0.81 0.00 0.13 0.06 0.08 98.92 05:52:51 05:06:01 AM 0 0.85 0.00 0.13 0.03 0.08 98.90 05:52:51 05:06:01 AM 1 0.77 0.00 0.13 0.08 0.07 98.95 05:52:51 05:07:01 AM all 4.81 0.00 0.41 0.00 0.08 94.70 05:52:51 05:07:01 AM 0 2.37 0.00 0.33 0.00 0.07 97.22 05:52:51 05:07:01 AM 1 7.31 0.00 0.49 0.00 0.09 92.11 05:52:51 05:08:01 AM all 1.48 0.00 0.13 0.00 0.08 98.32 05:52:51 05:08:01 AM 0 1.96 0.00 0.13 0.00 0.08 97.83 05:52:51 05:08:01 AM 1 1.00 0.00 0.12 0.00 0.07 98.81 05:52:51 05:09:01 AM all 1.97 0.00 0.21 0.00 0.07 97.76 05:52:51 05:09:01 AM 0 2.01 0.00 0.22 0.00 0.07 97.71 05:52:51 05:09:01 AM 1 1.92 0.00 0.20 0.00 0.07 97.81 05:52:51 05:10:01 AM all 1.24 0.00 0.19 0.00 0.07 98.50 05:52:51 05:10:01 AM 0 0.87 0.00 0.18 0.00 0.05 98.90 05:52:51 05:10:01 AM 1 1.61 0.00 0.20 0.00 0.08 98.11 05:52:51 05:11:01 AM all 2.33 0.00 0.18 0.00 0.09 97.39 05:52:51 05:11:01 AM 0 2.59 0.00 0.18 0.00 0.08 97.14 05:52:51 05:11:01 AM 1 2.07 0.00 0.18 0.00 0.10 97.64 05:52:51 05:12:01 AM all 1.49 0.00 0.12 0.00 0.08 98.31 05:52:51 05:12:01 AM 0 1.12 0.00 0.13 0.00 0.07 98.68 05:52:51 05:12:01 AM 1 1.87 0.00 0.10 0.00 0.08 97.95 05:52:51 05:52:51 05:12:01 AM CPU %user %nice %system %iowait %steal %idle 05:52:51 05:13:01 AM all 1.44 0.00 0.12 0.00 0.08 98.37 05:52:51 05:13:01 AM 0 1.14 0.00 0.12 0.00 0.07 98.68 05:52:51 05:13:01 AM 1 1.74 0.00 0.12 0.00 0.08 98.06 05:52:51 05:14:01 AM all 1.38 0.00 0.13 0.00 0.08 98.41 05:52:51 05:14:01 AM 0 1.70 0.00 0.15 0.00 0.10 98.05 05:52:51 05:14:01 AM 1 1.05 0.00 0.10 0.00 0.07 98.78 05:52:51 05:15:01 AM all 1.43 0.00 0.13 0.00 0.09 98.35 05:52:51 05:15:01 AM 0 1.07 0.00 0.17 0.00 0.08 98.68 05:52:51 05:15:01 AM 1 1.79 0.00 0.10 0.00 0.10 98.01 05:52:51 05:16:01 AM all 1.47 0.00 0.12 0.00 0.09 98.32 05:52:51 05:16:01 AM 0 2.06 0.00 0.12 0.00 0.10 97.73 05:52:51 05:16:01 AM 1 0.89 0.00 0.12 0.00 0.08 98.91 05:52:51 05:17:01 AM all 1.35 0.00 0.14 0.00 0.07 98.45 05:52:51 05:17:01 AM 0 1.52 0.00 0.12 0.00 0.07 98.29 05:52:51 05:17:01 AM 1 1.17 0.00 0.17 0.00 0.07 98.60 05:52:51 05:18:01 AM all 1.26 0.00 0.13 0.00 0.08 98.53 05:52:51 05:18:01 AM 0 1.39 0.00 0.13 0.00 0.08 98.40 05:52:51 05:18:01 AM 1 1.14 0.00 0.13 0.00 0.07 98.66 05:52:51 05:19:01 AM all 0.79 0.00 0.11 0.00 0.08 99.02 05:52:51 05:19:01 AM 0 0.80 0.00 0.10 0.00 0.07 99.03 05:52:51 05:19:01 AM 1 0.77 0.00 0.12 0.00 0.10 99.01 05:52:51 05:20:01 AM all 4.73 0.00 0.40 0.00 0.10 94.77 05:52:51 05:20:01 AM 0 5.19 0.00 0.34 0.00 0.12 94.35 05:52:51 05:20:01 AM 1 4.27 0.00 0.47 0.00 0.08 95.18 05:52:51 05:21:01 AM all 0.81 0.00 0.13 0.01 0.10 98.96 05:52:51 05:21:01 AM 0 0.87 0.00 0.13 0.02 0.12 98.86 05:52:51 05:21:01 AM 1 0.75 0.00 0.12 0.00 0.08 99.05 05:52:51 05:22:01 AM all 5.41 0.00 0.55 0.00 0.07 93.98 05:52:51 05:22:01 AM 0 2.82 0.00 0.44 0.00 0.07 96.67 05:52:51 05:22:01 AM 1 8.02 0.00 0.66 0.00 0.07 91.25 05:52:51 05:23:01 AM all 2.74 0.00 0.18 0.00 0.08 97.01 05:52:51 05:23:01 AM 0 1.14 0.00 0.13 0.00 0.08 98.65 05:52:51 05:23:01 AM 1 4.34 0.00 0.22 0.00 0.08 95.36 05:52:51 05:52:51 05:23:01 AM CPU %user %nice %system %iowait %steal %idle 05:52:51 05:24:01 AM all 1.13 0.00 0.12 0.00 0.07 98.69 05:52:51 05:24:01 AM 0 1.12 0.00 0.12 0.00 0.07 98.70 05:52:51 05:24:01 AM 1 1.14 0.00 0.12 0.00 0.07 98.68 05:52:51 05:25:01 AM all 1.12 0.00 0.13 0.00 0.08 98.67 05:52:51 05:25:01 AM 0 1.29 0.00 0.15 0.00 0.08 98.48 05:52:51 05:25:01 AM 1 0.95 0.00 0.10 0.00 0.08 98.86 05:52:51 05:26:01 AM all 1.14 0.00 0.10 0.00 0.08 98.67 05:52:51 05:26:01 AM 0 1.10 0.00 0.12 0.00 0.08 98.70 05:52:51 05:26:01 AM 1 1.19 0.00 0.08 0.00 0.08 98.65 05:52:51 05:27:01 AM all 1.14 0.00 0.11 0.00 0.09 98.66 05:52:51 05:27:01 AM 0 0.80 0.00 0.10 0.00 0.08 99.01 05:52:51 05:27:01 AM 1 1.49 0.00 0.12 0.00 0.10 98.30 05:52:51 05:28:01 AM all 1.11 0.00 0.11 0.00 0.07 98.71 05:52:51 05:28:01 AM 0 0.82 0.00 0.12 0.00 0.05 99.01 05:52:51 05:28:01 AM 1 1.40 0.00 0.10 0.00 0.08 98.41 05:52:51 05:29:01 AM all 1.79 0.00 0.18 0.00 0.08 97.94 05:52:51 05:29:01 AM 0 1.74 0.00 0.17 0.00 0.07 98.03 05:52:51 05:29:01 AM 1 1.84 0.00 0.20 0.00 0.10 97.86 05:52:51 05:30:01 AM all 0.76 0.00 0.13 0.00 0.08 99.03 05:52:51 05:30:01 AM 0 0.67 0.00 0.12 0.00 0.07 99.15 05:52:51 05:30:01 AM 1 0.85 0.00 0.13 0.00 0.10 98.91 05:52:51 05:31:01 AM all 3.58 0.00 0.34 0.00 0.08 95.99 05:52:51 05:31:01 AM 0 4.51 0.00 0.29 0.00 0.07 95.13 05:52:51 05:31:01 AM 1 2.65 0.00 0.40 0.00 0.10 96.85 05:52:51 05:32:01 AM all 0.78 0.00 0.12 0.00 0.08 99.01 05:52:51 05:32:01 AM 0 0.68 0.00 0.08 0.00 0.07 99.17 05:52:51 05:32:01 AM 1 0.89 0.00 0.15 0.00 0.10 98.86 05:52:51 05:33:01 AM all 4.39 0.00 0.36 0.00 0.08 95.17 05:52:51 05:33:01 AM 0 1.50 0.00 0.27 0.00 0.07 98.16 05:52:51 05:33:01 AM 1 7.34 0.00 0.46 0.00 0.09 92.11 05:52:51 05:34:01 AM all 1.06 0.00 0.12 0.00 0.08 98.74 05:52:51 05:34:01 AM 0 0.70 0.00 0.10 0.00 0.05 99.15 05:52:51 05:34:01 AM 1 1.42 0.00 0.13 0.00 0.12 98.33 05:52:51 05:52:51 05:34:01 AM CPU %user %nice %system %iowait %steal %idle 05:52:51 05:35:01 AM all 1.08 0.00 0.09 0.00 0.08 98.75 05:52:51 05:35:01 AM 0 0.82 0.00 0.08 0.00 0.07 99.03 05:52:51 05:35:01 AM 1 1.34 0.00 0.10 0.00 0.10 98.46 05:52:51 05:36:01 AM all 1.07 0.00 0.12 0.00 0.08 98.74 05:52:51 05:36:01 AM 0 0.77 0.00 0.12 0.00 0.07 99.05 05:52:51 05:36:01 AM 1 1.37 0.00 0.12 0.00 0.08 98.43 05:52:51 05:37:01 AM all 1.06 0.00 0.11 0.00 0.08 98.75 05:52:51 05:37:01 AM 0 0.67 0.00 0.10 0.00 0.05 99.18 05:52:51 05:37:01 AM 1 1.45 0.00 0.12 0.00 0.12 98.31 05:52:51 05:38:01 AM all 1.06 0.00 0.12 0.00 0.09 98.73 05:52:51 05:38:01 AM 0 0.60 0.00 0.10 0.00 0.07 99.23 05:52:51 05:38:01 AM 1 1.52 0.00 0.13 0.00 0.12 98.23 05:52:51 05:39:01 AM all 1.80 0.00 0.17 0.00 0.07 97.97 05:52:51 05:39:01 AM 0 1.34 0.00 0.15 0.00 0.05 98.46 05:52:51 05:39:01 AM 1 2.26 0.00 0.18 0.00 0.08 97.48 05:52:51 05:40:01 AM all 0.79 0.00 0.13 0.00 0.09 99.00 05:52:51 05:40:01 AM 0 0.79 0.00 0.12 0.00 0.08 99.01 05:52:51 05:40:01 AM 1 0.79 0.00 0.13 0.00 0.10 98.98 05:52:51 05:41:01 AM all 3.62 0.00 0.34 0.00 0.09 95.94 05:52:51 05:41:01 AM 0 3.68 0.00 0.33 0.00 0.07 95.92 05:52:51 05:41:01 AM 1 3.56 0.00 0.35 0.00 0.12 95.97 05:52:51 05:42:01 AM all 0.75 0.00 0.12 0.00 0.10 99.03 05:52:51 05:42:01 AM 0 0.68 0.00 0.10 0.00 0.08 99.13 05:52:51 05:42:01 AM 1 0.82 0.00 0.13 0.00 0.12 98.93 05:52:51 05:43:01 AM all 3.29 0.00 0.26 0.00 0.08 96.36 05:52:51 05:43:01 AM 0 3.78 0.00 0.32 0.00 0.07 95.82 05:52:51 05:43:01 AM 1 2.81 0.00 0.20 0.00 0.10 96.89 05:52:51 05:44:01 AM all 2.05 0.00 0.13 0.00 0.10 97.72 05:52:51 05:44:01 AM 0 0.94 0.00 0.10 0.00 0.07 98.90 05:52:51 05:44:01 AM 1 3.16 0.00 0.17 0.00 0.13 96.54 05:52:51 05:45:01 AM all 1.10 0.01 0.13 0.01 0.08 98.66 05:52:51 05:45:01 AM 0 1.12 0.00 0.12 0.00 0.08 98.68 05:52:51 05:45:01 AM 1 1.09 0.02 0.15 0.02 0.08 98.65 05:52:51 05:52:51 05:45:01 AM CPU %user %nice %system %iowait %steal %idle 05:52:51 05:46:01 AM all 1.12 0.00 0.12 0.00 0.08 98.68 05:52:51 05:46:01 AM 0 0.95 0.00 0.10 0.00 0.08 98.86 05:52:51 05:46:01 AM 1 1.29 0.00 0.13 0.00 0.08 98.50 05:52:51 05:47:01 AM all 1.08 0.00 0.11 0.00 0.08 98.73 05:52:51 05:47:01 AM 0 1.05 0.00 0.12 0.00 0.08 98.75 05:52:51 05:47:01 AM 1 1.10 0.00 0.10 0.00 0.08 98.71 05:52:51 05:48:01 AM all 1.13 0.00 0.11 0.00 0.12 98.65 05:52:51 05:48:01 AM 0 0.88 0.00 0.12 0.00 0.10 98.90 05:52:51 05:48:01 AM 1 1.37 0.00 0.10 0.00 0.13 98.40 05:52:51 05:49:01 AM all 1.94 0.00 0.18 0.00 0.09 97.79 05:52:51 05:49:01 AM 0 1.05 0.00 0.18 0.00 0.08 98.68 05:52:51 05:49:01 AM 1 2.83 0.00 0.17 0.00 0.10 96.91 05:52:51 05:50:01 AM all 0.78 0.00 0.13 0.00 0.09 99.01 05:52:51 05:50:01 AM 0 0.80 0.00 0.12 0.00 0.08 99.00 05:52:51 05:50:01 AM 1 0.75 0.00 0.13 0.00 0.10 99.01 05:52:51 05:51:01 AM all 7.75 0.00 0.71 0.01 0.10 91.42 05:52:51 05:51:01 AM 0 9.29 0.00 0.84 0.02 0.10 89.76 05:52:51 05:51:01 AM 1 6.20 0.00 0.59 0.00 0.10 93.10 05:52:51 05:52:01 AM all 17.99 0.00 2.45 0.48 0.08 79.00 05:52:51 05:52:01 AM 0 10.68 0.00 2.08 0.60 0.07 86.57 05:52:51 05:52:01 AM 1 25.32 0.00 2.82 0.37 0.08 71.41 05:52:51 Average: all 3.61 0.22 0.49 0.62 0.08 94.98 05:52:51 Average: 0 3.09 0.28 0.46 0.61 0.08 95.49 05:52:51 Average: 1 4.13 0.17 0.51 0.63 0.09 94.48 05:52:51 05:52:51 05:52:51