05:33:55 Started by upstream project "integration-distribution-mri-test-potassium" build number 38 05:33:55 originally caused by: 05:33:55 Started by timer 05:33:55 Running as SYSTEM 05:33:55 [EnvInject] - Loading node environment variables. 05:33:55 Building remotely on prd-centos8-robot-2c-8g-5619 (centos8-robot-2c-8g) in workspace /w/workspace/controller-csit-3node-clustering-ask-all-potassium 05:33:56 [ssh-agent] Looking for ssh-agent implementation... 05:33:57 [ssh-agent] Exec ssh-agent (binary ssh-agent on a remote machine) 05:33:57 $ ssh-agent 05:33:57 SSH_AUTH_SOCK=/tmp/ssh-NEaLZu68Qc5b/agent.5271 05:33:57 SSH_AGENT_PID=5272 05:33:57 [ssh-agent] Started. 05:33:57 Running ssh-add (command line suppressed) 05:33:57 Identity added: /w/workspace/controller-csit-3node-clustering-ask-all-potassium@tmp/private_key_2342803213587986016.key (/w/workspace/controller-csit-3node-clustering-ask-all-potassium@tmp/private_key_2342803213587986016.key) 05:33:57 [ssh-agent] Using credentials jenkins (Release Engineering Jenkins Key) 05:33:57 The recommended git tool is: NONE 05:33:59 using credential opendaylight-jenkins-ssh 05:33:59 Wiping out workspace first. 05:33:59 Cloning the remote Git repository 05:33:59 Cloning repository git://devvexx.opendaylight.org/mirror/integration/test 05:34:00 > git init /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test # timeout=10 05:34:00 Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test 05:34:00 > git --version # timeout=10 05:34:00 > git --version # 'git version 2.43.0' 05:34:00 using GIT_SSH to set credentials Release Engineering Jenkins Key 05:34:00 [INFO] Currently running in a labeled security context 05:34:00 [INFO] Currently SELinux is 'enforcing' on the host 05:34:00 > /usr/bin/chcon --type=ssh_home_t /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test@tmp/jenkins-gitclient-ssh7521000369261621285.key 05:34:00 Verifying host key using known hosts file 05:34:00 You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification. 05:34:00 > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test +refs/heads/*:refs/remotes/origin/* # timeout=10 05:34:02 > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10 05:34:02 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 05:34:02 > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10 05:34:03 Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test 05:34:03 using GIT_SSH to set credentials Release Engineering Jenkins Key 05:34:03 [INFO] Currently running in a labeled security context 05:34:03 [INFO] Currently SELinux is 'enforcing' on the host 05:34:03 > /usr/bin/chcon --type=ssh_home_t /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test@tmp/jenkins-gitclient-ssh16120543766445157662.key 05:34:03 Verifying host key using known hosts file 05:34:03 You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification. 05:34:03 > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test master # timeout=10 05:34:03 > git rev-parse FETCH_HEAD^{commit} # timeout=10 05:34:03 Checking out Revision c88ead2b4a65ba004398ad07cfe033ae1e467b17 (origin/master) 05:34:03 > git config core.sparsecheckout # timeout=10 05:34:03 > git checkout -f c88ead2b4a65ba004398ad07cfe033ae1e467b17 # timeout=10 05:34:03 Commit message: "Reformat '* On Session' keywords (aaa)" 05:34:03 > git rev-parse FETCH_HEAD^{commit} # timeout=10 05:34:03 > git rev-list --no-walk 7df40c8c0ac70da634e98ef506471a9aa0c475be # timeout=10 05:34:04 No emails were triggered. 05:34:04 provisioning config files... 05:34:04 copy managed file [npmrc] to file:/home/jenkins/.npmrc 05:34:04 copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf 05:34:04 copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml 05:34:04 [controller-csit-3node-clustering-ask-all-potassium] $ /bin/bash /tmp/jenkins14036255891149696613.sh 05:34:04 ---> python-tools-install.sh 05:34:04 Setup pyenv: 05:34:04 system 05:34:04 * 3.8.13 (set by /opt/pyenv/version) 05:34:04 * 3.9.13 (set by /opt/pyenv/version) 05:34:04 * 3.10.13 (set by /opt/pyenv/version) 05:34:04 * 3.11.7 (set by /opt/pyenv/version) 05:34:09 lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-A0mX 05:34:09 lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv 05:34:12 lf-activate-venv(): INFO: Installing: lftools 05:34:46 lf-activate-venv(): INFO: Adding /tmp/venv-A0mX/bin to PATH 05:34:46 Generating Requirements File 05:35:16 Python 3.11.7 05:35:17 pip 24.0 from /tmp/venv-A0mX/lib/python3.11/site-packages/pip (python 3.11) 05:35:17 appdirs==1.4.4 05:35:17 argcomplete==3.2.3 05:35:17 aspy.yaml==1.3.0 05:35:17 attrs==23.2.0 05:35:17 autopage==0.5.2 05:35:17 beautifulsoup4==4.12.3 05:35:17 boto3==1.34.79 05:35:17 botocore==1.34.79 05:35:17 bs4==0.0.2 05:35:17 cachetools==5.3.3 05:35:17 certifi==2024.2.2 05:35:17 cffi==1.16.0 05:35:17 cfgv==3.4.0 05:35:17 chardet==5.2.0 05:35:17 charset-normalizer==3.3.2 05:35:17 click==8.1.7 05:35:17 cliff==4.6.0 05:35:17 cmd2==2.4.3 05:35:17 cryptography==3.3.2 05:35:17 debtcollector==3.0.0 05:35:17 decorator==5.1.1 05:35:17 defusedxml==0.7.1 05:35:17 Deprecated==1.2.14 05:35:17 distlib==0.3.8 05:35:17 dnspython==2.6.1 05:35:17 docker==4.2.2 05:35:17 dogpile.cache==1.3.2 05:35:17 email_validator==2.1.1 05:35:17 filelock==3.13.3 05:35:17 future==1.0.0 05:35:17 gitdb==4.0.11 05:35:17 GitPython==3.1.43 05:35:17 google-auth==2.29.0 05:35:17 httplib2==0.22.0 05:35:17 identify==2.5.35 05:35:17 idna==3.6 05:35:17 importlib-resources==1.5.0 05:35:17 iso8601==2.1.0 05:35:17 Jinja2==3.1.3 05:35:17 jmespath==1.0.1 05:35:17 jsonpatch==1.33 05:35:17 jsonpointer==2.4 05:35:17 jsonschema==4.21.1 05:35:17 jsonschema-specifications==2023.12.1 05:35:17 keystoneauth1==5.6.0 05:35:17 kubernetes==29.0.0 05:35:17 lftools==0.37.10 05:35:17 lxml==5.2.1 05:35:17 MarkupSafe==2.1.5 05:35:17 msgpack==1.0.8 05:35:17 multi_key_dict==2.0.3 05:35:17 munch==4.0.0 05:35:17 netaddr==1.2.1 05:35:17 netifaces==0.11.0 05:35:17 niet==1.4.2 05:35:17 nodeenv==1.8.0 05:35:17 oauth2client==4.1.3 05:35:17 oauthlib==3.2.2 05:35:17 openstacksdk==3.0.0 05:35:17 os-client-config==2.1.0 05:35:17 os-service-types==1.7.0 05:35:17 osc-lib==3.0.1 05:35:17 oslo.config==9.4.0 05:35:17 oslo.context==5.5.0 05:35:17 oslo.i18n==6.3.0 05:35:17 oslo.log==5.5.1 05:35:17 oslo.serialization==5.4.0 05:35:17 oslo.utils==7.1.0 05:35:17 packaging==24.0 05:35:17 pbr==6.0.0 05:35:17 platformdirs==4.2.0 05:35:17 prettytable==3.10.0 05:35:17 pyasn1==0.6.0 05:35:17 pyasn1_modules==0.4.0 05:35:17 pycparser==2.22 05:35:17 pygerrit2==2.0.15 05:35:17 PyGithub==2.3.0 05:35:17 pyinotify==0.9.6 05:35:17 PyJWT==2.8.0 05:35:17 PyNaCl==1.5.0 05:35:17 pyparsing==2.4.7 05:35:17 pyperclip==1.8.2 05:35:17 pyrsistent==0.20.0 05:35:17 python-cinderclient==9.5.0 05:35:17 python-dateutil==2.9.0.post0 05:35:17 python-heatclient==3.5.0 05:35:17 python-jenkins==1.8.2 05:35:17 python-keystoneclient==5.4.0 05:35:17 python-magnumclient==4.4.0 05:35:17 python-novaclient==18.6.0 05:35:17 python-openstackclient==6.6.0 05:35:17 python-swiftclient==4.5.0 05:35:17 PyYAML==6.0.1 05:35:17 referencing==0.34.0 05:35:17 requests==2.31.0 05:35:17 requests-oauthlib==2.0.0 05:35:17 requestsexceptions==1.4.0 05:35:17 rfc3986==2.0.0 05:35:17 rpds-py==0.18.0 05:35:17 rsa==4.9 05:35:17 ruamel.yaml==0.18.6 05:35:17 ruamel.yaml.clib==0.2.8 05:35:17 s3transfer==0.10.1 05:35:17 simplejson==3.19.2 05:35:17 six==1.16.0 05:35:17 smmap==5.0.1 05:35:17 soupsieve==2.5 05:35:17 stevedore==5.2.0 05:35:17 tabulate==0.9.0 05:35:17 toml==0.10.2 05:35:17 tomlkit==0.12.4 05:35:17 tqdm==4.66.2 05:35:17 typing_extensions==4.11.0 05:35:17 tzdata==2024.1 05:35:17 urllib3==1.26.18 05:35:17 virtualenv==20.25.1 05:35:17 wcwidth==0.2.13 05:35:17 websocket-client==1.7.0 05:35:17 wrapt==1.16.0 05:35:17 xdg==6.0.0 05:35:17 xmltodict==0.13.0 05:35:17 yq==3.2.3 05:35:17 [EnvInject] - Injecting environment variables from a build step. 05:35:17 [EnvInject] - Injecting as environment variables the properties content 05:35:17 OS_STACK_TEMPLATE=csit-2-instance-type.yaml 05:35:17 OS_CLOUD=vex 05:35:17 OS_STACK_NAME=releng-controller-csit-3node-clustering-ask-all-potassium-38 05:35:17 OS_STACK_TEMPLATE_DIR=openstack-hot 05:35:17 05:35:17 [EnvInject] - Variables injected successfully. 05:35:17 provisioning config files... 05:35:17 copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml 05:35:17 [controller-csit-3node-clustering-ask-all-potassium] $ /bin/bash /tmp/jenkins2621985339026861008.sh 05:35:17 ---> Create parameters file for OpenStack HOT 05:35:17 OpenStack Heat parameters generated 05:35:17 ----------------------------------- 05:35:17 parameters: 05:35:17 vm_0_count: '3' 05:35:17 vm_0_flavor: 'v3-standard-4' 05:35:17 vm_0_image: 'ZZCI - CentOS Stream 8 - builder - x86_64 - 20240401-160147.446' 05:35:17 vm_1_count: '0' 05:35:17 vm_1_flavor: 'v3-standard-2' 05:35:17 vm_1_image: 'ZZCI - Ubuntu 18.04 - mininet-ovs-28 - x86_64 - 20230601-180106.003' 05:35:17 05:35:17 job_name: '29108-38' 05:35:17 silo: 'releng' 05:35:17 [controller-csit-3node-clustering-ask-all-potassium] $ /bin/bash -l /tmp/jenkins13906822548422219139.sh 05:35:18 ---> Create HEAT stack 05:35:18 + source /home/jenkins/lf-env.sh 05:35:18 + lf-activate-venv --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 05:35:18 ++ mktemp -d /tmp/venv-XXXX 05:35:18 + lf_venv=/tmp/venv-aOIv 05:35:18 + local venv_file=/tmp/.os_lf_venv 05:35:18 + local python=python3 05:35:18 + local options 05:35:18 + local set_path=true 05:35:18 + local install_args= 05:35:18 ++ getopt -o np:v: -l no-path,system-site-packages,python:,venv-file: -n lf-activate-venv -- --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 05:35:18 + options=' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\''' 05:35:18 + eval set -- ' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\''' 05:35:18 ++ set -- --python python3 -- 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 05:35:18 + true 05:35:18 + case $1 in 05:35:18 + python=python3 05:35:18 + shift 2 05:35:18 + true 05:35:18 + case $1 in 05:35:18 + shift 05:35:18 + break 05:35:18 + case $python in 05:35:18 + local pkg_list= 05:35:18 + [[ -d /opt/pyenv ]] 05:35:18 + echo 'Setup pyenv:' 05:35:18 Setup pyenv: 05:35:18 + export PYENV_ROOT=/opt/pyenv 05:35:18 + PYENV_ROOT=/opt/pyenv 05:35:18 + export PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin 05:35:18 + PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin 05:35:18 + pyenv versions 05:35:18 system 05:35:18 3.8.13 05:35:18 3.9.13 05:35:18 3.10.13 05:35:18 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-ask-all-potassium/.python-version) 05:35:18 + command -v pyenv 05:35:18 ++ pyenv init - --no-rehash 05:35:18 + eval 'PATH="$(bash --norc -ec '\''IFS=:; paths=($PATH); 05:35:18 for i in ${!paths[@]}; do 05:35:18 if [[ ${paths[i]} == "'\'''\''/opt/pyenv/shims'\'''\''" ]]; then unset '\''\'\'''\''paths[i]'\''\'\'''\''; 05:35:18 fi; done; 05:35:18 echo "${paths[*]}"'\'')" 05:35:18 export PATH="/opt/pyenv/shims:${PATH}" 05:35:18 export PYENV_SHELL=bash 05:35:18 source '\''/opt/pyenv/libexec/../completions/pyenv.bash'\'' 05:35:18 pyenv() { 05:35:18 local command 05:35:18 command="${1:-}" 05:35:18 if [ "$#" -gt 0 ]; then 05:35:18 shift 05:35:18 fi 05:35:18 05:35:18 case "$command" in 05:35:18 rehash|shell) 05:35:18 eval "$(pyenv "sh-$command" "$@")" 05:35:18 ;; 05:35:18 *) 05:35:18 command pyenv "$command" "$@" 05:35:18 ;; 05:35:18 esac 05:35:18 }' 05:35:18 +++ bash --norc -ec 'IFS=:; paths=($PATH); 05:35:18 for i in ${!paths[@]}; do 05:35:18 if [[ ${paths[i]} == "/opt/pyenv/shims" ]]; then unset '\''paths[i]'\''; 05:35:18 fi; done; 05:35:18 echo "${paths[*]}"' 05:35:18 ++ PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin 05:35:18 ++ export PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin 05:35:18 ++ PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin 05:35:18 ++ export PYENV_SHELL=bash 05:35:18 ++ PYENV_SHELL=bash 05:35:18 ++ source /opt/pyenv/libexec/../completions/pyenv.bash 05:35:18 +++ complete -F _pyenv pyenv 05:35:18 ++ lf-pyver python3 05:35:18 ++ local py_version_xy=python3 05:35:18 ++ local py_version_xyz= 05:35:18 ++ awk '{ print $1 }' 05:35:18 ++ pyenv versions 05:35:18 ++ local command 05:35:18 ++ command=versions 05:35:18 ++ '[' 1 -gt 0 ']' 05:35:18 ++ shift 05:35:18 ++ case "$command" in 05:35:18 ++ command pyenv versions 05:35:18 ++ pyenv versions 05:35:18 ++ sed 's/^[ *]* //' 05:35:18 ++ grep -E '^[0-9.]*[0-9]$' 05:35:18 ++ [[ ! -s /tmp/.pyenv_versions ]] 05:35:18 +++ tail -n 1 05:35:18 +++ grep '^3' /tmp/.pyenv_versions 05:35:18 +++ sort -V 05:35:18 ++ py_version_xyz=3.11.7 05:35:18 ++ [[ -z 3.11.7 ]] 05:35:18 ++ echo 3.11.7 05:35:18 ++ return 0 05:35:18 + pyenv local 3.11.7 05:35:18 + local command 05:35:18 + command=local 05:35:18 + '[' 2 -gt 0 ']' 05:35:18 + shift 05:35:18 + case "$command" in 05:35:18 + command pyenv local 3.11.7 05:35:18 + pyenv local 3.11.7 05:35:18 + for arg in "$@" 05:35:18 + case $arg in 05:35:18 + pkg_list+='lftools[openstack] ' 05:35:18 + for arg in "$@" 05:35:18 + case $arg in 05:35:18 + pkg_list+='kubernetes ' 05:35:18 + for arg in "$@" 05:35:18 + case $arg in 05:35:18 + pkg_list+='niet ' 05:35:18 + for arg in "$@" 05:35:18 + case $arg in 05:35:18 + pkg_list+='python-heatclient ' 05:35:18 + for arg in "$@" 05:35:18 + case $arg in 05:35:18 + pkg_list+='python-openstackclient ' 05:35:18 + for arg in "$@" 05:35:18 + case $arg in 05:35:18 + pkg_list+='python-magnumclient ' 05:35:18 + for arg in "$@" 05:35:18 + case $arg in 05:35:18 + pkg_list+='yq ' 05:35:18 + [[ -f /tmp/.os_lf_venv ]] 05:35:18 ++ cat /tmp/.os_lf_venv 05:35:18 + lf_venv=/tmp/venv-A0mX 05:35:18 + echo 'lf-activate-venv(): INFO: Reuse venv:/tmp/venv-A0mX from' file:/tmp/.os_lf_venv 05:35:18 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-A0mX from file:/tmp/.os_lf_venv 05:35:18 + /tmp/venv-A0mX/bin/python3 -m pip install --upgrade --quiet pip virtualenv 05:35:19 + [[ -z lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq ]] 05:35:19 + echo 'lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq ' 05:35:19 lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 05:35:19 + /tmp/venv-A0mX/bin/python3 -m pip install --upgrade --quiet --upgrade-strategy eager 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 05:35:39 + type python3 05:35:39 + true 05:35:39 + echo 'lf-activate-venv(): INFO: Adding /tmp/venv-A0mX/bin to PATH' 05:35:39 lf-activate-venv(): INFO: Adding /tmp/venv-A0mX/bin to PATH 05:35:39 + PATH=/tmp/venv-A0mX/bin:/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin 05:35:39 + return 0 05:35:39 + openstack --os-cloud vex limits show --absolute 05:35:40 +--------------------------+---------+ 05:35:40 | Name | Value | 05:35:40 +--------------------------+---------+ 05:35:40 | maxTotalInstances | -1 | 05:35:40 | maxTotalCores | 450 | 05:35:40 | maxTotalRAMSize | 1000000 | 05:35:40 | maxServerMeta | 128 | 05:35:40 | maxImageMeta | 128 | 05:35:40 | maxPersonality | 5 | 05:35:40 | maxPersonalitySize | 10240 | 05:35:40 | maxTotalKeypairs | 100 | 05:35:40 | maxServerGroups | 10 | 05:35:40 | maxServerGroupMembers | 10 | 05:35:40 | maxTotalFloatingIps | -1 | 05:35:40 | maxSecurityGroups | -1 | 05:35:40 | maxSecurityGroupRules | -1 | 05:35:40 | totalRAMUsed | 425984 | 05:35:40 | totalCoresUsed | 104 | 05:35:40 | totalInstancesUsed | 37 | 05:35:40 | totalFloatingIpsUsed | 0 | 05:35:40 | totalSecurityGroupsUsed | 0 | 05:35:40 | totalServerGroupsUsed | 0 | 05:35:40 | maxTotalVolumes | -1 | 05:35:40 | maxTotalSnapshots | 10 | 05:35:40 | maxTotalVolumeGigabytes | 4096 | 05:35:40 | maxTotalBackups | 10 | 05:35:40 | maxTotalBackupGigabytes | 1000 | 05:35:40 | totalVolumesUsed | 0 | 05:35:40 | totalGigabytesUsed | 0 | 05:35:40 | totalSnapshotsUsed | 0 | 05:35:40 | totalBackupsUsed | 0 | 05:35:40 | totalBackupGigabytesUsed | 0 | 05:35:40 +--------------------------+---------+ 05:35:41 + pushd /opt/ciman/openstack-hot 05:35:41 /opt/ciman/openstack-hot /w/workspace/controller-csit-3node-clustering-ask-all-potassium 05:35:41 + lftools openstack --os-cloud vex stack create releng-controller-csit-3node-clustering-ask-all-potassium-38 csit-2-instance-type.yaml /w/workspace/controller-csit-3node-clustering-ask-all-potassium/stack-parameters.yaml 05:36:07 Creating stack releng-controller-csit-3node-clustering-ask-all-potassium-38 05:36:07 Waiting to initialize infrastructure... 05:36:07 Stack initialization successful. 05:36:07 ------------------------------------ 05:36:07 Stack Details 05:36:07 ------------------------------------ 05:36:07 {'added': None, 05:36:07 'capabilities': [], 05:36:07 'created_at': '2024-04-07T05:35:43Z', 05:36:07 'deleted': None, 05:36:07 'deleted_at': None, 05:36:07 'description': 'No description', 05:36:07 'environment': None, 05:36:07 'environment_files': None, 05:36:07 'files': None, 05:36:07 'files_container': None, 05:36:07 'id': 'bad0d1be-0831-4f2c-b25a-f9809a81c7c4', 05:36:07 'is_rollback_disabled': True, 05:36:07 'links': [{'href': 'https://orchestration.public.mtl1.vexxhost.net/v1/12c36e260d8e4bb2913965203b1b491f/stacks/releng-controller-csit-3node-clustering-ask-all-potassium-38/bad0d1be-0831-4f2c-b25a-f9809a81c7c4', 05:36:07 'rel': 'self'}], 05:36:07 'location': Munch({'cloud': 'vex', 'region_name': 'ca-ymq-1', 'zone': None, 'project': Munch({'id': '12c36e260d8e4bb2913965203b1b491f', 'name': '61975f2c-7c17-4d69-82fa-c3ae420ad6fd', 'domain_id': None, 'domain_name': 'Default'})}), 05:36:07 'name': 'releng-controller-csit-3node-clustering-ask-all-potassium-38', 05:36:07 'notification_topics': [], 05:36:07 'outputs': [{'description': 'IP addresses of the 2nd vm types', 05:36:07 'output_key': 'vm_1_ips', 05:36:07 'output_value': []}, 05:36:07 {'description': 'IP addresses of the 1st vm types', 05:36:07 'output_key': 'vm_0_ips', 05:36:07 'output_value': ['10.30.171.124', 05:36:07 '10.30.171.236', 05:36:07 '10.30.170.187']}], 05:36:07 'owner_id': ****, 05:36:07 'parameters': {'OS::project_id': '12c36e260d8e4bb2913965203b1b491f', 05:36:07 'OS::stack_id': 'bad0d1be-0831-4f2c-b25a-f9809a81c7c4', 05:36:07 'OS::stack_name': 'releng-controller-csit-3node-clustering-ask-all-potassium-38', 05:36:07 'job_name': '29108-38', 05:36:07 'silo': 'releng', 05:36:07 'vm_0_count': '3', 05:36:07 'vm_0_flavor': 'v3-standard-4', 05:36:07 'vm_0_image': 'ZZCI - CentOS Stream 8 - builder - x86_64 - ' 05:36:07 '20240401-160147.446', 05:36:07 'vm_1_count': '0', 05:36:07 'vm_1_flavor': 'v3-standard-2', 05:36:07 'vm_1_image': 'ZZCI - Ubuntu 18.04 - mininet-ovs-28 - x86_64 - ' 05:36:07 '20230601-180106.003'}, 05:36:07 'parent_id': None, 05:36:07 'replaced': None, 05:36:07 'status': 'CREATE_COMPLETE', 05:36:07 'status_reason': 'Stack CREATE completed successfully', 05:36:07 'tags': [], 05:36:07 'template': None, 05:36:07 'template_description': 'No description', 05:36:07 'template_url': None, 05:36:07 'timeout_mins': 15, 05:36:07 'unchanged': None, 05:36:07 'updated': None, 05:36:07 'updated_at': None, 05:36:07 'user_project_id': 'c66fc70c639d45939b16f9df57cbb3f0'} 05:36:07 ------------------------------------ 05:36:07 + popd 05:36:07 /w/workspace/controller-csit-3node-clustering-ask-all-potassium 05:36:08 [controller-csit-3node-clustering-ask-all-potassium] $ /bin/bash -l /tmp/jenkins8393608009333498260.sh 05:36:08 ---> Copy SSH public keys to CSIT lab 05:36:08 Setup pyenv: 05:36:08 system 05:36:08 3.8.13 05:36:08 3.9.13 05:36:08 3.10.13 05:36:08 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-ask-all-potassium/.python-version) 05:36:08 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-A0mX from file:/tmp/.os_lf_venv 05:36:10 lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes python-heatclient python-openstackclient 05:36:24 lf-activate-venv(): INFO: Adding /tmp/venv-A0mX/bin to PATH 05:36:27 SSH not responding on 10.30.171.236. Retrying in 10 seconds... 05:36:27 SSH not responding on 10.30.170.187. Retrying in 10 seconds... 05:36:27 SSH not responding on 10.30.171.124. Retrying in 10 seconds... 05:36:37 Ping to 10.30.171.236 successful. 05:36:37 Ping to 10.30.170.187 successful. 05:36:37 Ping to 10.30.171.124 successful. 05:36:37 SSH not responding on 10.30.171.236. Retrying in 10 seconds... 05:36:37 SSH not responding on 10.30.171.124. Retrying in 10 seconds... 05:36:37 SSH not responding on 10.30.170.187. Retrying in 10 seconds... 05:36:47 Ping to 10.30.171.236 successful. 05:36:47 Ping to 10.30.171.124 successful. 05:36:47 Ping to 10.30.170.187 successful. 05:36:47 SSH not responding on 10.30.171.236. Retrying in 10 seconds... 05:36:47 SSH not responding on 10.30.170.187. Retrying in 10 seconds... 05:36:47 SSH not responding on 10.30.171.124. Retrying in 10 seconds... 05:36:57 Ping to 10.30.171.236 successful. 05:36:57 Ping to 10.30.170.187 successful. 05:36:57 Ping to 10.30.171.124 successful. 05:36:58 SSH not responding on 10.30.171.124. Retrying in 10 seconds... 05:36:58 SSH not responding on 10.30.170.187. Retrying in 10 seconds... 05:36:58 Warning: Permanently added '10.30.171.236' (ECDSA) to the list of known hosts. 05:36:59 10.30.171.236 releng-29108-38-0-builder-1.novalocal 05:36:59 Successfully copied public keys to slave 10.30.171.236 05:37:08 Ping to 10.30.171.124 successful. 05:37:08 Ping to 10.30.170.187 successful. 05:37:08 SSH not responding on 10.30.171.124. Retrying in 10 seconds... 05:37:08 Warning: Permanently added '10.30.170.187' (ECDSA) to the list of known hosts. 05:37:09 10.30.170.187 releng-29108-38-0-builder-2.novalocal 05:37:09 Successfully copied public keys to slave 10.30.170.187 05:37:18 Ping to 10.30.171.124 successful. 05:37:19 SSH not responding on 10.30.171.124. Retrying in 10 seconds... 05:37:29 Ping to 10.30.171.124 successful. 05:37:30 Warning: Permanently added '10.30.171.124' (ECDSA) to the list of known hosts. 05:37:31 10.30.171.124 releng-29108-38-0-builder-0.novalocal 05:37:31 Successfully copied public keys to slave 10.30.171.124 05:37:31 Process 6684 ready. 05:37:31 Process 6685 ready. 05:37:31 Process 6686 ready. 05:37:31 SSH ready on all stack servers. 05:37:31 [controller-csit-3node-clustering-ask-all-potassium] $ /bin/bash -l /tmp/jenkins3106683132391487488.sh 05:37:31 Setup pyenv: 05:37:31 system 05:37:31 3.8.13 05:37:31 3.9.13 05:37:31 3.10.13 05:37:31 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-ask-all-potassium/.python-version) 05:37:35 lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-NAUV 05:37:35 lf-activate-venv(): INFO: Save venv in file: /w/workspace/controller-csit-3node-clustering-ask-all-potassium/.robot_venv 05:37:38 lf-activate-venv(): INFO: Installing: setuptools wheel 05:37:40 lf-activate-venv(): INFO: Adding /tmp/venv-NAUV/bin to PATH 05:37:40 + echo 'Installing Python Requirements' 05:37:40 Installing Python Requirements 05:37:40 + cat 05:37:40 + python -m pip install -r requirements.txt 05:37:40 Looking in indexes: https://nexus3.opendaylight.org/repository/PyPi/simple 05:37:40 Collecting docker-py (from -r requirements.txt (line 1)) 05:37:40 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/docker-py/1.10.6/docker_py-1.10.6-py2.py3-none-any.whl (50 kB) 05:37:40 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 50.0/50.0 kB 1.1 MB/s eta 0:00:00 05:37:40 Collecting ipaddr (from -r requirements.txt (line 2)) 05:37:40 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/ipaddr/2.2.0/ipaddr-2.2.0.tar.gz (26 kB) 05:37:40 Preparing metadata (setup.py): started 05:37:40 Preparing metadata (setup.py): finished with status 'done' 05:37:40 Collecting netaddr (from -r requirements.txt (line 3)) 05:37:40 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/netaddr/1.2.1/netaddr-1.2.1-py3-none-any.whl (2.3 MB) 05:37:41 Collecting netifaces (from -r requirements.txt (line 4)) 05:37:41 Using cached netifaces-0.11.0-cp311-cp311-linux_x86_64.whl 05:37:41 Collecting pyhocon (from -r requirements.txt (line 5)) 05:37:41 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyhocon/0.3.60/pyhocon-0.3.60.tar.gz (158 kB) 05:37:41 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 158.8/158.8 kB 31.2 MB/s eta 0:00:00 05:37:41 Preparing metadata (setup.py): started 05:37:41 Preparing metadata (setup.py): finished with status 'done' 05:37:41 Collecting requests (from -r requirements.txt (line 6)) 05:37:41 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/requests/2.31.0/requests-2.31.0-py3-none-any.whl (62 kB) 05:37:41 Collecting robotframework (from -r requirements.txt (line 7)) 05:37:41 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework/7.0/robotframework-7.0-py3-none-any.whl (726 kB) 05:37:41 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 726.3/726.3 kB 24.4 MB/s eta 0:00:00 05:37:41 Collecting robotframework-httplibrary (from -r requirements.txt (line 8)) 05:37:41 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-httplibrary/0.4.2/robotframework-httplibrary-0.4.2.tar.gz (9.1 kB) 05:37:41 Preparing metadata (setup.py): started 05:37:41 Preparing metadata (setup.py): finished with status 'done' 05:37:41 Collecting robotframework-requests==0.9.3 (from -r requirements.txt (line 9)) 05:37:41 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-requests/0.9.3/robotframework_requests-0.9.3-py3-none-any.whl (21 kB) 05:37:41 Collecting robotframework-selenium2library (from -r requirements.txt (line 10)) 05:37:41 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-selenium2library/3.0.0/robotframework_selenium2library-3.0.0-py2.py3-none-any.whl (6.2 kB) 05:37:41 Collecting robotframework-sshlibrary==3.8.0 (from -r requirements.txt (line 11)) 05:37:41 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-sshlibrary/3.8.0/robotframework-sshlibrary-3.8.0.tar.gz (51 kB) 05:37:41 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 51.4/51.4 kB 9.1 MB/s eta 0:00:00 05:37:41 Preparing metadata (setup.py): started 05:37:41 Preparing metadata (setup.py): finished with status 'done' 05:37:42 Collecting scapy (from -r requirements.txt (line 12)) 05:37:42 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/scapy/2.5.0/scapy-2.5.0.tar.gz (1.3 MB) 05:37:42 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.3/1.3 MB 22.9 MB/s eta 0:00:00 05:37:42 Preparing metadata (setup.py): started 05:37:42 Preparing metadata (setup.py): finished with status 'done' 05:37:42 Collecting jsonpath-rw (from -r requirements.txt (line 15)) 05:37:42 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpath-rw/1.4.0/jsonpath-rw-1.4.0.tar.gz (13 kB) 05:37:42 Preparing metadata (setup.py): started 05:37:42 Preparing metadata (setup.py): finished with status 'done' 05:37:42 Collecting elasticsearch (from -r requirements.txt (line 18)) 05:37:42 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch/8.13.0/elasticsearch-8.13.0-py3-none-any.whl (451 kB) 05:37:42 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 451.0/451.0 kB 30.7 MB/s eta 0:00:00 05:37:42 Collecting elasticsearch-dsl (from -r requirements.txt (line 19)) 05:37:42 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch-dsl/8.13.0/elasticsearch_dsl-8.13.0-py3-none-any.whl (88 kB) 05:37:42 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 88.6/88.6 kB 17.5 MB/s eta 0:00:00 05:37:42 Collecting pyangbind (from -r requirements.txt (line 22)) 05:37:42 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyangbind/0.8.5/pyangbind-0.8.5-py3-none-any.whl (52 kB) 05:37:42 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 52.9/52.9 kB 10.1 MB/s eta 0:00:00 05:37:42 Collecting isodate (from -r requirements.txt (line 25)) 05:37:42 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/isodate/0.6.1/isodate-0.6.1-py2.py3-none-any.whl (41 kB) 05:37:42 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 41.7/41.7 kB 10.2 MB/s eta 0:00:00 05:37:42 Collecting jmespath (from -r requirements.txt (line 28)) 05:37:42 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jmespath/1.0.1/jmespath-1.0.1-py3-none-any.whl (20 kB) 05:37:42 Collecting jsonpatch (from -r requirements.txt (line 31)) 05:37:42 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpatch/1.33/jsonpatch-1.33-py2.py3-none-any.whl (12 kB) 05:37:43 Collecting paramiko>=1.15.3 (from robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) 05:37:43 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/paramiko/3.4.0/paramiko-3.4.0-py3-none-any.whl (225 kB) 05:37:43 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 225.9/225.9 kB 26.2 MB/s eta 0:00:00 05:37:43 Collecting scp>=0.13.0 (from robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) 05:37:43 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/scp/0.14.5/scp-0.14.5-py2.py3-none-any.whl (8.7 kB) 05:37:43 Collecting docker-pycreds>=0.2.1 (from docker-py->-r requirements.txt (line 1)) 05:37:43 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/docker-pycreds/0.4.0/docker_pycreds-0.4.0-py2.py3-none-any.whl (9.0 kB) 05:37:43 Collecting six>=1.4.0 (from docker-py->-r requirements.txt (line 1)) 05:37:43 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/six/1.16.0/six-1.16.0-py2.py3-none-any.whl (11 kB) 05:37:43 Collecting websocket-client>=0.32.0 (from docker-py->-r requirements.txt (line 1)) 05:37:43 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/websocket-client/1.7.0/websocket_client-1.7.0-py3-none-any.whl (58 kB) 05:37:43 Collecting pyparsing<4,>=2 (from pyhocon->-r requirements.txt (line 5)) 05:37:43 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pyparsing/3.1.2/pyparsing-3.1.2-py3-none-any.whl (103 kB) 05:37:43 Collecting charset-normalizer<4,>=2 (from requests->-r requirements.txt (line 6)) 05:37:43 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/charset-normalizer/3.3.2/charset_normalizer-3.3.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (140 kB) 05:37:43 Collecting idna<4,>=2.5 (from requests->-r requirements.txt (line 6)) 05:37:43 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/idna/3.6/idna-3.6-py3-none-any.whl (61 kB) 05:37:43 Collecting urllib3<3,>=1.21.1 (from requests->-r requirements.txt (line 6)) 05:37:43 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/urllib3/2.2.1/urllib3-2.2.1-py3-none-any.whl (121 kB) 05:37:43 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 121.1/121.1 kB 21.0 MB/s eta 0:00:00 05:37:43 Collecting certifi>=2017.4.17 (from requests->-r requirements.txt (line 6)) 05:37:43 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/certifi/2024.2.2/certifi-2024.2.2-py3-none-any.whl (163 kB) 05:37:43 Collecting webtest>=2.0 (from robotframework-httplibrary->-r requirements.txt (line 8)) 05:37:43 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/webtest/3.0.0/WebTest-3.0.0-py3-none-any.whl (31 kB) 05:37:43 Collecting jsonpointer (from robotframework-httplibrary->-r requirements.txt (line 8)) 05:37:43 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpointer/2.4/jsonpointer-2.4-py2.py3-none-any.whl (7.8 kB) 05:37:43 Collecting robotframework-seleniumlibrary>=3.0.0 (from robotframework-selenium2library->-r requirements.txt (line 10)) 05:37:43 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-seleniumlibrary/6.2.0/robotframework_seleniumlibrary-6.2.0-py2.py3-none-any.whl (95 kB) 05:37:43 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 95.5/95.5 kB 19.1 MB/s eta 0:00:00 05:37:43 Collecting ply (from jsonpath-rw->-r requirements.txt (line 15)) 05:37:44 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/ply/3.11/ply-3.11-py2.py3-none-any.whl (49 kB) 05:37:44 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 49.6/49.6 kB 11.4 MB/s eta 0:00:00 05:37:44 Collecting decorator (from jsonpath-rw->-r requirements.txt (line 15)) 05:37:44 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/decorator/5.1.1/decorator-5.1.1-py3-none-any.whl (9.1 kB) 05:37:44 Collecting elastic-transport<9,>=8.13 (from elasticsearch->-r requirements.txt (line 18)) 05:37:44 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elastic-transport/8.13.0/elastic_transport-8.13.0-py3-none-any.whl (64 kB) 05:37:44 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 64.3/64.3 kB 12.5 MB/s eta 0:00:00 05:37:44 Collecting python-dateutil (from elasticsearch-dsl->-r requirements.txt (line 19)) 05:37:44 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/python-dateutil/2.9.0.post0/python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 05:37:44 Collecting pyang (from pyangbind->-r requirements.txt (line 22)) 05:37:44 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyang/2.6.0/pyang-2.6.0-py2.py3-none-any.whl (594 kB) 05:37:44 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 594.1/594.1 kB 21.6 MB/s eta 0:00:00 05:37:44 Collecting lxml (from pyangbind->-r requirements.txt (line 22)) 05:37:44 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/lxml/5.2.1/lxml-5.2.1-cp311-cp311-manylinux_2_28_x86_64.whl (5.0 MB) 05:37:45 Collecting regex (from pyangbind->-r requirements.txt (line 22)) 05:37:45 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/regex/2023.12.25/regex-2023.12.25-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (785 kB) 05:37:45 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 785.1/785.1 kB 20.8 MB/s eta 0:00:00 05:37:45 Collecting enum34 (from pyangbind->-r requirements.txt (line 22)) 05:37:45 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/enum34/1.1.10/enum34-1.1.10-py3-none-any.whl (11 kB) 05:37:45 Collecting bcrypt>=3.2 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) 05:37:45 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/bcrypt/4.1.2/bcrypt-4.1.2-cp39-abi3-manylinux_2_28_x86_64.whl (698 kB) 05:37:45 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 698.9/698.9 kB 39.6 MB/s eta 0:00:00 05:37:46 Collecting cryptography>=3.3 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) 05:37:46 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/cryptography/42.0.5/cryptography-42.0.5-cp39-abi3-manylinux_2_28_x86_64.whl (4.6 MB) 05:37:46 Collecting pynacl>=1.5 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) 05:37:46 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pynacl/1.5.0/PyNaCl-1.5.0-cp36-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.manylinux_2_24_x86_64.whl (856 kB) 05:37:46 Collecting selenium>=4.3.0 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) 05:37:46 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/selenium/4.19.0/selenium-4.19.0-py3-none-any.whl (10.5 MB) 05:37:46 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 10.5/10.5 MB 82.6 MB/s eta 0:00:00 05:37:46 Collecting robotframework-pythonlibcore>=3.0.0 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) 05:37:46 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-pythonlibcore/4.4.1/robotframework_pythonlibcore-4.4.1-py2.py3-none-any.whl (12 kB) 05:37:46 Collecting WebOb>=1.2 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8)) 05:37:46 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/webob/1.8.7/WebOb-1.8.7-py2.py3-none-any.whl (114 kB) 05:37:46 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 115.0/115.0 kB 17.3 MB/s eta 0:00:00 05:37:46 Collecting waitress>=0.8.5 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8)) 05:37:46 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/waitress/3.0.0/waitress-3.0.0-py3-none-any.whl (56 kB) 05:37:46 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 56.7/56.7 kB 7.1 MB/s eta 0:00:00 05:37:46 Collecting beautifulsoup4 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8)) 05:37:46 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/beautifulsoup4/4.12.3/beautifulsoup4-4.12.3-py3-none-any.whl (147 kB) 05:37:46 Collecting cffi>=1.12 (from cryptography>=3.3->paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) 05:37:46 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/cffi/1.16.0/cffi-1.16.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (464 kB) 05:37:47 Collecting trio~=0.17 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) 05:37:47 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/trio/0.25.0/trio-0.25.0-py3-none-any.whl (467 kB) 05:37:47 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 467.2/467.2 kB 15.4 MB/s eta 0:00:00 05:37:47 Collecting trio-websocket~=0.9 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) 05:37:47 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/trio-websocket/0.11.1/trio_websocket-0.11.1-py3-none-any.whl (17 kB) 05:37:47 Collecting typing_extensions>=4.9.0 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) 05:37:47 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/typing-extensions/4.11.0/typing_extensions-4.11.0-py3-none-any.whl (34 kB) 05:37:47 Collecting soupsieve>1.2 (from beautifulsoup4->webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8)) 05:37:47 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/soupsieve/2.5/soupsieve-2.5-py3-none-any.whl (36 kB) 05:37:47 Collecting pycparser (from cffi>=1.12->cryptography>=3.3->paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) 05:37:47 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pycparser/2.22/pycparser-2.22-py3-none-any.whl (117 kB) 05:37:47 Collecting attrs>=23.2.0 (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) 05:37:47 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/attrs/23.2.0/attrs-23.2.0-py3-none-any.whl (60 kB) 05:37:47 Collecting sortedcontainers (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) 05:37:47 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/sortedcontainers/2.4.0/sortedcontainers-2.4.0-py2.py3-none-any.whl (29 kB) 05:37:47 Collecting outcome (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) 05:37:47 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/outcome/1.3.0.post0/outcome-1.3.0.post0-py2.py3-none-any.whl (10 kB) 05:37:47 Collecting sniffio>=1.3.0 (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) 05:37:47 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/sniffio/1.3.1/sniffio-1.3.1-py3-none-any.whl (10 kB) 05:37:47 Collecting wsproto>=0.14 (from trio-websocket~=0.9->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) 05:37:47 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/wsproto/1.2.0/wsproto-1.2.0-py3-none-any.whl (24 kB) 05:37:47 Collecting pysocks!=1.5.7,<2.0,>=1.5.6 (from urllib3[socks]<3,>=1.26->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) 05:37:47 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pysocks/1.7.1/PySocks-1.7.1-py3-none-any.whl (16 kB) 05:37:47 Collecting h11<1,>=0.9.0 (from wsproto>=0.14->trio-websocket~=0.9->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) 05:37:47 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/h11/0.14.0/h11-0.14.0-py3-none-any.whl (58 kB) 05:37:47 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 58.3/58.3 kB 11.9 MB/s eta 0:00:00 05:37:47 Building wheels for collected packages: robotframework-sshlibrary, ipaddr, pyhocon, robotframework-httplibrary, scapy, jsonpath-rw 05:37:47 Building wheel for robotframework-sshlibrary (setup.py): started 05:37:48 Building wheel for robotframework-sshlibrary (setup.py): finished with status 'done' 05:37:48 Created wheel for robotframework-sshlibrary: filename=robotframework_sshlibrary-3.8.0-py3-none-any.whl size=55119 sha256=10bf159eb118e35097f55e157c0ba92f8bd8b9e290fea38b5d5450fe6b53abc9 05:37:48 Stored in directory: /home/jenkins/.cache/pip/wheels/f7/c9/b3/a977b7bcc410d45ae27d240df3d00a12585509180e373ecccc 05:37:48 Building wheel for ipaddr (setup.py): started 05:37:48 Building wheel for ipaddr (setup.py): finished with status 'done' 05:37:48 Created wheel for ipaddr: filename=ipaddr-2.2.0-py3-none-any.whl size=18280 sha256=657f4a130a1340f6d00ee35ff4bea7ba977f0049d7fa9f2e40fa5613df509ba5 05:37:48 Stored in directory: /home/jenkins/.cache/pip/wheels/dc/6c/04/da2d847fa8d45c59af3e1d83e2acc29cb8adcbaf04c0898dbf 05:37:48 Building wheel for pyhocon (setup.py): started 05:37:48 Building wheel for pyhocon (setup.py): finished with status 'done' 05:37:48 Created wheel for pyhocon: filename=pyhocon-0.3.60-py3-none-any.whl size=20865 sha256=0497aea54bc6c38096311747aabc66c0a1b4ea8e2442db891aaa4f7a6f202e45 05:37:48 Stored in directory: /home/jenkins/.cache/pip/wheels/02/09/4e/04a983205b51f96912ae6fc13f56f3050a586c98200fe36725 05:37:48 Building wheel for robotframework-httplibrary (setup.py): started 05:37:48 Building wheel for robotframework-httplibrary (setup.py): finished with status 'done' 05:37:48 Created wheel for robotframework-httplibrary: filename=robotframework_httplibrary-0.4.2-py3-none-any.whl size=9953 sha256=9a39d7bf1c732c8bf994a268b9083d232821acd24c521e23a265a0ecdc451619 05:37:48 Stored in directory: /home/jenkins/.cache/pip/wheels/aa/bc/0d/9a20dd51effef392aae2733cb4c7b66c6fa29fca33d88b57ed 05:37:48 Building wheel for scapy (setup.py): started 05:37:49 Building wheel for scapy (setup.py): finished with status 'done' 05:37:49 Created wheel for scapy: filename=scapy-2.5.0-py2.py3-none-any.whl size=1444327 sha256=34b08070959ce3e3378dd4b3e7d04465e96215429ddc816402c4209c4244e285 05:37:49 Stored in directory: /home/jenkins/.cache/pip/wheels/3b/a7/d6/87eeec31fbfcb2bd8ace7dad8172b6d6ebbe1ec6827dbb389a 05:37:49 Building wheel for jsonpath-rw (setup.py): started 05:37:49 Building wheel for jsonpath-rw (setup.py): finished with status 'done' 05:37:49 Created wheel for jsonpath-rw: filename=jsonpath_rw-1.4.0-py3-none-any.whl size=15130 sha256=88cdab552c1721f125d15d9486356dd7f143d07032f1028e4b5092de6c8e13ac 05:37:49 Stored in directory: /home/jenkins/.cache/pip/wheels/f1/54/63/9a8da38cefae13755097b36cc852decc25d8ef69c37d58d4eb 05:37:49 Successfully built robotframework-sshlibrary ipaddr pyhocon robotframework-httplibrary scapy jsonpath-rw 05:37:50 Installing collected packages: sortedcontainers, ply, netifaces, ipaddr, enum34, websocket-client, WebOb, waitress, urllib3, typing_extensions, soupsieve, sniffio, six, scapy, robotframework-pythonlibcore, robotframework, regex, pysocks, pyparsing, pycparser, netaddr, lxml, jsonpointer, jmespath, idna, h11, decorator, charset-normalizer, certifi, bcrypt, attrs, wsproto, requests, python-dateutil, pyhocon, pyang, outcome, jsonpath-rw, jsonpatch, isodate, elastic-transport, docker-pycreds, cffi, beautifulsoup4, webtest, trio, robotframework-requests, pynacl, pyangbind, elasticsearch, docker-py, cryptography, trio-websocket, robotframework-httplibrary, paramiko, elasticsearch-dsl, selenium, scp, robotframework-sshlibrary, robotframework-seleniumlibrary, robotframework-selenium2library 05:37:57 Successfully installed WebOb-1.8.7 attrs-23.2.0 bcrypt-4.1.2 beautifulsoup4-4.12.3 certifi-2024.2.2 cffi-1.16.0 charset-normalizer-3.3.2 cryptography-42.0.5 decorator-5.1.1 docker-py-1.10.6 docker-pycreds-0.4.0 elastic-transport-8.13.0 elasticsearch-8.13.0 elasticsearch-dsl-8.13.0 enum34-1.1.10 h11-0.14.0 idna-3.6 ipaddr-2.2.0 isodate-0.6.1 jmespath-1.0.1 jsonpatch-1.33 jsonpath-rw-1.4.0 jsonpointer-2.4 lxml-5.2.1 netaddr-1.2.1 netifaces-0.11.0 outcome-1.3.0.post0 paramiko-3.4.0 ply-3.11 pyang-2.6.0 pyangbind-0.8.5 pycparser-2.22 pyhocon-0.3.60 pynacl-1.5.0 pyparsing-3.1.2 pysocks-1.7.1 python-dateutil-2.9.0.post0 regex-2023.12.25 requests-2.31.0 robotframework-7.0 robotframework-httplibrary-0.4.2 robotframework-pythonlibcore-4.4.1 robotframework-requests-0.9.3 robotframework-selenium2library-3.0.0 robotframework-seleniumlibrary-6.2.0 robotframework-sshlibrary-3.8.0 scapy-2.5.0 scp-0.14.5 selenium-4.19.0 six-1.16.0 sniffio-1.3.1 sortedcontainers-2.4.0 soupsieve-2.5 trio-0.25.0 trio-websocket-0.11.1 typing_extensions-4.11.0 urllib3-2.2.1 waitress-3.0.0 websocket-client-1.7.0 webtest-3.0.0 wsproto-1.2.0 05:37:57 + pip freeze 05:37:57 attrs==23.2.0 05:37:57 bcrypt==4.1.2 05:37:57 beautifulsoup4==4.12.3 05:37:57 certifi==2024.2.2 05:37:57 cffi==1.16.0 05:37:57 charset-normalizer==3.3.2 05:37:57 cryptography==42.0.5 05:37:57 decorator==5.1.1 05:37:57 distlib==0.3.8 05:37:57 docker-py==1.10.6 05:37:57 docker-pycreds==0.4.0 05:37:57 elastic-transport==8.13.0 05:37:57 elasticsearch==8.13.0 05:37:57 elasticsearch-dsl==8.13.0 05:37:57 enum34==1.1.10 05:37:57 filelock==3.13.3 05:37:57 h11==0.14.0 05:37:57 idna==3.6 05:37:57 ipaddr==2.2.0 05:37:57 isodate==0.6.1 05:37:57 jmespath==1.0.1 05:37:57 jsonpatch==1.33 05:37:57 jsonpath-rw==1.4.0 05:37:57 jsonpointer==2.4 05:37:57 lxml==5.2.1 05:37:57 netaddr==1.2.1 05:37:57 netifaces==0.11.0 05:37:57 outcome==1.3.0.post0 05:37:57 paramiko==3.4.0 05:37:57 platformdirs==4.2.0 05:37:57 ply==3.11 05:37:57 pyang==2.6.0 05:37:57 pyangbind==0.8.5 05:37:57 pycparser==2.22 05:37:57 pyhocon==0.3.60 05:37:57 PyNaCl==1.5.0 05:37:57 pyparsing==3.1.2 05:37:57 PySocks==1.7.1 05:37:57 python-dateutil==2.9.0.post0 05:37:57 regex==2023.12.25 05:37:57 requests==2.31.0 05:37:57 robotframework==7.0 05:37:57 robotframework-httplibrary==0.4.2 05:37:57 robotframework-pythonlibcore==4.4.1 05:37:57 robotframework-requests==0.9.3 05:37:57 robotframework-selenium2library==3.0.0 05:37:57 robotframework-seleniumlibrary==6.2.0 05:37:57 robotframework-sshlibrary==3.8.0 05:37:57 scapy==2.5.0 05:37:57 scp==0.14.5 05:37:57 selenium==4.19.0 05:37:57 six==1.16.0 05:37:57 sniffio==1.3.1 05:37:57 sortedcontainers==2.4.0 05:37:57 soupsieve==2.5 05:37:57 trio==0.25.0 05:37:57 trio-websocket==0.11.1 05:37:57 typing_extensions==4.11.0 05:37:57 urllib3==2.2.1 05:37:57 virtualenv==20.25.1 05:37:57 waitress==3.0.0 05:37:57 WebOb==1.8.7 05:37:57 websocket-client==1.7.0 05:37:57 WebTest==3.0.0 05:37:57 wsproto==1.2.0 05:37:57 [EnvInject] - Injecting environment variables from a build step. 05:37:57 [EnvInject] - Injecting as environment variables the properties file path 'env.properties' 05:37:58 [EnvInject] - Variables injected successfully. 05:37:58 [controller-csit-3node-clustering-ask-all-potassium] $ /bin/bash -l /tmp/jenkins16506350574342492042.sh 05:37:58 Setup pyenv: 05:37:58 system 05:37:58 3.8.13 05:37:58 3.9.13 05:37:58 3.10.13 05:37:58 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-ask-all-potassium/.python-version) 05:37:58 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-A0mX from file:/tmp/.os_lf_venv 05:38:00 lf-activate-venv(): INFO: Installing: python-heatclient python-openstackclient yq 05:38:06 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. 05:38:06 lftools 0.37.10 requires urllib3<2.1.0, but you have urllib3 2.2.1 which is incompatible. 05:38:06 lf-activate-venv(): INFO: Adding /tmp/venv-A0mX/bin to PATH 05:38:06 + ODL_SYSTEM=() 05:38:06 + TOOLS_SYSTEM=() 05:38:06 + OPENSTACK_SYSTEM=() 05:38:06 + OPENSTACK_CONTROLLERS=() 05:38:06 + mapfile -t ADDR 05:38:06 ++ jq -r '.outputs[] | select(.output_key | match("^vm_[0-9]+_ips$")) | .output_value | .[]' 05:38:06 ++ openstack stack show -f json -c outputs releng-controller-csit-3node-clustering-ask-all-potassium-38 05:38:08 + for i in "${ADDR[@]}" 05:38:08 ++ ssh 10.30.171.124 hostname -s 05:38:08 Warning: Permanently added '10.30.171.124' (ECDSA) to the list of known hosts. 05:38:08 + REMHOST=releng-29108-38-0-builder-0 05:38:08 + case ${REMHOST} in 05:38:08 + ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}") 05:38:08 + for i in "${ADDR[@]}" 05:38:08 ++ ssh 10.30.171.236 hostname -s 05:38:08 Warning: Permanently added '10.30.171.236' (ECDSA) to the list of known hosts. 05:38:09 + REMHOST=releng-29108-38-0-builder-1 05:38:09 + case ${REMHOST} in 05:38:09 + ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}") 05:38:09 + for i in "${ADDR[@]}" 05:38:09 ++ ssh 10.30.170.187 hostname -s 05:38:09 Warning: Permanently added '10.30.170.187' (ECDSA) to the list of known hosts. 05:38:09 + REMHOST=releng-29108-38-0-builder-2 05:38:09 + case ${REMHOST} in 05:38:09 + ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}") 05:38:09 + echo NUM_ODL_SYSTEM=3 05:38:09 + echo NUM_TOOLS_SYSTEM=0 05:38:09 + '[' '' == yes ']' 05:38:09 + NUM_OPENSTACK_SYSTEM=0 05:38:09 + echo NUM_OPENSTACK_SYSTEM=0 05:38:09 + '[' 0 -eq 2 ']' 05:38:09 + echo ODL_SYSTEM_IP=10.30.171.124 05:38:09 ++ seq 0 2 05:38:09 + for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 ))) 05:38:09 + echo ODL_SYSTEM_1_IP=10.30.171.124 05:38:09 + for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 ))) 05:38:09 + echo ODL_SYSTEM_2_IP=10.30.171.236 05:38:09 + for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 ))) 05:38:09 + echo ODL_SYSTEM_3_IP=10.30.170.187 05:38:09 + echo TOOLS_SYSTEM_IP= 05:38:09 ++ seq 0 -1 05:38:09 + openstack_index=0 05:38:09 + NUM_OPENSTACK_CONTROL_NODES=1 05:38:09 + echo NUM_OPENSTACK_CONTROL_NODES=1 05:38:09 ++ seq 0 0 05:38:09 + for i in $(seq 0 $((NUM_OPENSTACK_CONTROL_NODES - 1))) 05:38:09 + echo OPENSTACK_CONTROL_NODE_1_IP= 05:38:09 + NUM_OPENSTACK_COMPUTE_NODES=-1 05:38:09 + echo NUM_OPENSTACK_COMPUTE_NODES=-1 05:38:09 + '[' -1 -ge 2 ']' 05:38:09 ++ seq 0 -2 05:38:09 + NUM_OPENSTACK_HAPROXY_NODES=0 05:38:09 + echo NUM_OPENSTACK_HAPROXY_NODES=0 05:38:09 ++ seq 0 -1 05:38:09 + echo 'Contents of slave_addresses.txt:' 05:38:09 Contents of slave_addresses.txt: 05:38:09 + cat slave_addresses.txt 05:38:09 NUM_ODL_SYSTEM=3 05:38:09 NUM_TOOLS_SYSTEM=0 05:38:09 NUM_OPENSTACK_SYSTEM=0 05:38:09 ODL_SYSTEM_IP=10.30.171.124 05:38:09 ODL_SYSTEM_1_IP=10.30.171.124 05:38:09 ODL_SYSTEM_2_IP=10.30.171.236 05:38:09 ODL_SYSTEM_3_IP=10.30.170.187 05:38:09 TOOLS_SYSTEM_IP= 05:38:09 NUM_OPENSTACK_CONTROL_NODES=1 05:38:09 OPENSTACK_CONTROL_NODE_1_IP= 05:38:09 NUM_OPENSTACK_COMPUTE_NODES=-1 05:38:09 NUM_OPENSTACK_HAPROXY_NODES=0 05:38:09 [EnvInject] - Injecting environment variables from a build step. 05:38:09 [EnvInject] - Injecting as environment variables the properties file path 'slave_addresses.txt' 05:38:09 [EnvInject] - Variables injected successfully. 05:38:09 [controller-csit-3node-clustering-ask-all-potassium] $ /bin/sh /tmp/jenkins5462904115543578523.sh 05:38:09 Preparing for JRE Version 17 05:38:09 Karaf artifact is karaf 05:38:09 Karaf project is integration 05:38:09 Java home is /usr/lib/jvm/java-17-openjdk 05:38:09 [EnvInject] - Injecting environment variables from a build step. 05:38:09 [EnvInject] - Injecting as environment variables the properties file path 'set_variables.env' 05:38:09 [EnvInject] - Variables injected successfully. 05:38:09 [controller-csit-3node-clustering-ask-all-potassium] $ /bin/bash /tmp/jenkins5283482169666689817.sh 05:38:09 --2024-04-07 05:38:09-- http://git.opendaylight.org/gerrit/gitweb?p=integration/distribution.git;a=blob_plain;f=pom.xml;hb=refs/heads/stable/potassium 05:38:09 Resolving git.opendaylight.org (git.opendaylight.org)... 13.39.230.180, 35.181.223.58, 52.47.161.242, ... 05:38:09 Connecting to git.opendaylight.org (git.opendaylight.org)|13.39.230.180|:80... connected. 05:38:09 HTTP request sent, awaiting response... 200 OK 05:38:09 Length: 2620 (2.6K) [text/plain] 05:38:09 Saving to: ‘pom.xml’ 05:38:09 05:38:09 0K .. 100% 263M=0s 05:38:09 05:38:09 2024-04-07 05:38:09 (263 MB/s) - ‘pom.xml’ saved [2620/2620] 05:38:09 05:38:09 Bundle version is 0.19.3-SNAPSHOT 05:38:09 --2024-04-07 05:38:09-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.19.3-SNAPSHOT/maven-metadata.xml 05:38:09 Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6 05:38:09 Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected. 05:38:09 HTTP request sent, awaiting response... 200 OK 05:38:09 Length: 1404 (1.4K) [application/xml] 05:38:09 Saving to: ‘maven-metadata.xml’ 05:38:09 05:38:09 0K . 100% 41.8M=0s 05:38:09 05:38:09 2024-04-07 05:38:09 (41.8 MB/s) - ‘maven-metadata.xml’ saved [1404/1404] 05:38:09 05:38:10 05:38:10 05:38:10 org.opendaylight.integration 05:38:10 karaf 05:38:10 0.19.3-SNAPSHOT 05:38:10 05:38:10 05:38:10 20240406.185403 05:38:10 93 05:38:10 05:38:10 20240406185403 05:38:10 05:38:10 05:38:10 pom 05:38:10 0.19.3-20240406.185403-93 05:38:10 20240406185403 05:38:10 05:38:10 05:38:10 tar.gz 05:38:10 0.19.3-20240406.185403-93 05:38:10 20240406185403 05:38:10 05:38:10 05:38:10 zip 05:38:10 0.19.3-20240406.185403-93 05:38:10 20240406185403 05:38:10 05:38:10 05:38:10 cyclonedx 05:38:10 xml 05:38:10 0.19.3-20240406.185403-93 05:38:10 20240406185403 05:38:10 05:38:10 05:38:10 cyclonedx 05:38:10 json 05:38:10 0.19.3-20240406.185403-93 05:38:10 20240406185403 05:38:10 05:38:10 05:38:10 05:38:10 05:38:10 Nexus timestamp is 0.19.3-20240406.185403-93 05:38:10 Distribution bundle URL is https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.19.3-SNAPSHOT/karaf-0.19.3-20240406.185403-93.zip 05:38:10 Distribution bundle is karaf-0.19.3-20240406.185403-93.zip 05:38:10 Distribution bundle version is 0.19.3-SNAPSHOT 05:38:10 Distribution folder is karaf-0.19.3-SNAPSHOT 05:38:10 Nexus prefix is https://nexus.opendaylight.org 05:38:10 [EnvInject] - Injecting environment variables from a build step. 05:38:10 [EnvInject] - Injecting as environment variables the properties file path 'detect_variables.env' 05:38:10 [EnvInject] - Variables injected successfully. 05:38:10 [controller-csit-3node-clustering-ask-all-potassium] $ /bin/bash -l /tmp/jenkins7622714540693184252.sh 05:38:10 Setup pyenv: 05:38:10 system 05:38:10 3.8.13 05:38:10 3.9.13 05:38:10 3.10.13 05:38:10 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-ask-all-potassium/.python-version) 05:38:10 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-A0mX from file:/tmp/.os_lf_venv 05:38:12 lf-activate-venv(): INFO: Installing: python-heatclient python-openstackclient 05:38:17 lf-activate-venv(): INFO: Adding /tmp/venv-A0mX/bin to PATH 05:38:17 Copying common-functions.sh to /tmp 05:38:19 Copying common-functions.sh to 10.30.171.124:/tmp 05:38:19 Warning: Permanently added '10.30.171.124' (ECDSA) to the list of known hosts. 05:38:19 Copying common-functions.sh to 10.30.171.236:/tmp 05:38:19 Warning: Permanently added '10.30.171.236' (ECDSA) to the list of known hosts. 05:38:19 Copying common-functions.sh to 10.30.170.187:/tmp 05:38:19 Warning: Permanently added '10.30.170.187' (ECDSA) to the list of known hosts. 05:38:20 [controller-csit-3node-clustering-ask-all-potassium] $ /bin/bash /tmp/jenkins12806934851854141385.sh 05:38:20 common-functions.sh is being sourced 05:38:20 common-functions environment: 05:38:20 MAVENCONF: /tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg 05:38:20 ACTUALFEATURES: 05:38:20 FEATURESCONF: /tmp/karaf-0.19.3-SNAPSHOT/etc/org.apache.karaf.features.cfg 05:38:20 CUSTOMPROP: /tmp/karaf-0.19.3-SNAPSHOT/etc/custom.properties 05:38:20 LOGCONF: /tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg 05:38:20 MEMCONF: /tmp/karaf-0.19.3-SNAPSHOT/bin/setenv 05:38:20 CONTROLLERMEM: 2048m 05:38:20 AKKACONF: /tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/akka.conf 05:38:20 MODULESCONF: /tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/modules.conf 05:38:20 MODULESHARDSCONF: /tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/module-shards.conf 05:38:20 SUITES: 05:38:20 05:38:20 ################################################# 05:38:20 ## Configure Cluster and Start ## 05:38:20 ################################################# 05:38:20 ACTUALFEATURES: odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app 05:38:20 SPACE_SEPARATED_FEATURES: odl-integration-compatible-with-all odl-jolokia odl-restconf odl-clustering-test-app 05:38:20 Locating script plan to use... 05:38:20 script plan exists!!! 05:38:20 Changing the script plan path... 05:38:20 # Place the scripts in run order: 05:38:20 /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/scripts/car_people_shard.sh 05:38:20 Executing /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/scripts/car_people_shard.sh... 05:38:20 Add car-people shards file 05:38:20 Copy shard config to member-1 with IP address 10.30.171.124 05:38:20 Warning: Permanently added '10.30.171.124' (ECDSA) to the list of known hosts. 05:38:20 Copy shard config to member-2 with IP address 10.30.171.236 05:38:20 Warning: Permanently added '10.30.171.236' (ECDSA) to the list of known hosts. 05:38:20 Copy shard config to member-3 with IP address 10.30.170.187 05:38:20 Warning: Permanently added '10.30.170.187' (ECDSA) to the list of known hosts. 05:38:20 Finished running script plans 05:38:20 Configuring member-1 with IP address 10.30.171.124 05:38:20 Warning: Permanently added '10.30.171.124' (ECDSA) to the list of known hosts. 05:38:21 Warning: Permanently added '10.30.171.124' (ECDSA) to the list of known hosts. 05:38:21 + source /tmp/common-functions.sh karaf-0.19.3-SNAPSHOT 05:38:21 ++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]] 05:38:21 common-functions.sh is being sourced 05:38:21 ++ echo 'common-functions.sh is being sourced' 05:38:21 ++ BUNDLEFOLDER=karaf-0.19.3-SNAPSHOT 05:38:21 ++ export MAVENCONF=/tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg 05:38:21 ++ MAVENCONF=/tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg 05:38:21 ++ export FEATURESCONF=/tmp/karaf-0.19.3-SNAPSHOT/etc/org.apache.karaf.features.cfg 05:38:21 ++ FEATURESCONF=/tmp/karaf-0.19.3-SNAPSHOT/etc/org.apache.karaf.features.cfg 05:38:21 ++ export CUSTOMPROP=/tmp/karaf-0.19.3-SNAPSHOT/etc/custom.properties 05:38:21 ++ CUSTOMPROP=/tmp/karaf-0.19.3-SNAPSHOT/etc/custom.properties 05:38:21 ++ export LOGCONF=/tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg 05:38:21 ++ LOGCONF=/tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg 05:38:21 ++ export MEMCONF=/tmp/karaf-0.19.3-SNAPSHOT/bin/setenv 05:38:21 ++ MEMCONF=/tmp/karaf-0.19.3-SNAPSHOT/bin/setenv 05:38:21 ++ export CONTROLLERMEM= 05:38:21 ++ CONTROLLERMEM= 05:38:21 ++ export AKKACONF=/tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/akka.conf 05:38:21 ++ AKKACONF=/tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/akka.conf 05:38:21 ++ export MODULESCONF=/tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/modules.conf 05:38:21 ++ MODULESCONF=/tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/modules.conf 05:38:21 ++ export MODULESHARDSCONF=/tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/module-shards.conf 05:38:21 ++ MODULESHARDSCONF=/tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/module-shards.conf 05:38:21 ++ print_common_env 05:38:21 ++ cat 05:38:21 common-functions environment: 05:38:21 MAVENCONF: /tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg 05:38:21 ACTUALFEATURES: 05:38:21 FEATURESCONF: /tmp/karaf-0.19.3-SNAPSHOT/etc/org.apache.karaf.features.cfg 05:38:21 CUSTOMPROP: /tmp/karaf-0.19.3-SNAPSHOT/etc/custom.properties 05:38:21 LOGCONF: /tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg 05:38:21 MEMCONF: /tmp/karaf-0.19.3-SNAPSHOT/bin/setenv 05:38:21 CONTROLLERMEM: 05:38:21 AKKACONF: /tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/akka.conf 05:38:21 MODULESCONF: /tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/modules.conf 05:38:21 MODULESHARDSCONF: /tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/module-shards.conf 05:38:21 SUITES: 05:38:21 05:38:21 ++ SSH='ssh -t -t' 05:38:21 ++ extra_services_cntl=' dnsmasq.service httpd.service libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service rabbitmq-server.service ' 05:38:21 ++ extra_services_cmp=' libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service ' 05:38:21 Changing to /tmp 05:38:21 Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.19.3-SNAPSHOT/karaf-0.19.3-20240406.185403-93.zip 05:38:21 + echo 'Changing to /tmp' 05:38:21 + cd /tmp 05:38:21 + echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.19.3-SNAPSHOT/karaf-0.19.3-20240406.185403-93.zip' 05:38:21 + wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.19.3-SNAPSHOT/karaf-0.19.3-20240406.185403-93.zip 05:38:21 --2024-04-07 05:38:21-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.19.3-SNAPSHOT/karaf-0.19.3-20240406.185403-93.zip 05:38:21 Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6 05:38:21 Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected. 05:38:21 HTTP request sent, awaiting response... 200 OK 05:38:21 Length: 234135853 (223M) [application/zip] 05:38:21 Saving to: ‘karaf-0.19.3-20240406.185403-93.zip’ 05:38:21 05:38:21 0K ........ ........ ........ ........ ........ ........ 1% 60.6M 4s 05:38:21 3072K ........ ........ ........ ........ ........ ........ 2% 62.8M 4s 05:38:21 6144K ........ ........ ........ ........ ........ ........ 4% 86.5M 3s 05:38:21 9216K ........ ........ ........ ........ ........ ........ 5% 114M 3s 05:38:21 12288K ........ ........ ........ ........ ........ ........ 6% 84.8M 3s 05:38:21 15360K ........ ........ ........ ........ ........ ........ 8% 130M 2s 05:38:21 18432K ........ ........ ........ ........ ........ ........ 9% 93.3M 2s 05:38:21 21504K ........ ........ ........ ........ ........ ........ 10% 68.9M 2s 05:38:21 24576K ........ ........ ........ ........ ........ ........ 12% 119M 2s 05:38:21 27648K ........ ........ ........ ........ ........ ........ 13% 88.9M 2s 05:38:21 30720K ........ ........ ........ ........ ........ ........ 14% 141M 2s 05:38:21 33792K ........ ........ ........ ........ ........ ........ 16% 123M 2s 05:38:21 36864K ........ ........ ........ ........ ........ ........ 17% 183M 2s 05:38:22 39936K ........ ........ ........ ........ ........ ........ 18% 203M 2s 05:38:22 43008K ........ ........ ........ ........ ........ ........ 20% 144M 2s 05:38:22 46080K ........ ........ ........ ........ ........ ........ 21% 202M 2s 05:38:22 49152K ........ ........ ........ ........ ........ ........ 22% 274M 2s 05:38:22 52224K ........ ........ ........ ........ ........ ........ 24% 300M 2s 05:38:22 55296K ........ ........ ........ ........ ........ ........ 25% 290M 1s 05:38:22 58368K ........ ........ ........ ........ ........ ........ 26% 308M 1s 05:38:22 61440K ........ ........ ........ ........ ........ ........ 28% 299M 1s 05:38:22 64512K ........ ........ ........ ........ ........ ........ 29% 282M 1s 05:38:22 67584K ........ ........ ........ ........ ........ ........ 30% 263M 1s 05:38:22 70656K ........ ........ ........ ........ ........ ........ 32% 269M 1s 05:38:22 73728K ........ ........ ........ ........ ........ ........ 33% 280M 1s 05:38:22 76800K ........ ........ ........ ........ ........ ........ 34% 252M 1s 05:38:22 79872K ........ ........ ........ ........ ........ ........ 36% 275M 1s 05:38:22 82944K ........ ........ ........ ........ ........ ........ 37% 266M 1s 05:38:22 86016K ........ ........ ........ ........ ........ ........ 38% 288M 1s 05:38:22 89088K ........ ........ ........ ........ ........ ........ 40% 272M 1s 05:38:22 92160K ........ ........ ........ ........ ........ ........ 41% 263M 1s 05:38:22 95232K ........ ........ ........ ........ ........ ........ 42% 199M 1s 05:38:22 98304K ........ ........ ........ ........ ........ ........ 44% 278M 1s 05:38:22 101376K ........ ........ ........ ........ ........ ........ 45% 290M 1s 05:38:22 104448K ........ ........ ........ ........ ........ ........ 47% 287M 1s 05:38:22 107520K ........ ........ ........ ........ ........ ........ 48% 303M 1s 05:38:22 110592K ........ ........ ........ ........ ........ ........ 49% 289M 1s 05:38:22 113664K ........ ........ ........ ........ ........ ........ 51% 288M 1s 05:38:22 116736K ........ ........ ........ ........ ........ ........ 52% 286M 1s 05:38:22 119808K ........ ........ ........ ........ ........ ........ 53% 303M 1s 05:38:22 122880K ........ ........ ........ ........ ........ ........ 55% 289M 1s 05:38:22 125952K ........ ........ ........ ........ ........ ........ 56% 118M 1s 05:38:22 129024K ........ ........ ........ ........ ........ ........ 57% 225M 1s 05:38:22 132096K ........ ........ ........ ........ ........ ........ 59% 292M 1s 05:38:22 135168K ........ ........ ........ ........ ........ ........ 60% 319M 1s 05:38:22 138240K ........ ........ ........ ........ ........ ........ 61% 286M 0s 05:38:22 141312K ........ ........ ........ ........ ........ ........ 63% 279M 0s 05:38:22 144384K ........ ........ ........ ........ ........ ........ 64% 301M 0s 05:38:22 147456K ........ ........ ........ ........ ........ ........ 65% 281M 0s 05:38:22 150528K ........ ........ ........ ........ ........ ........ 67% 276M 0s 05:38:22 153600K ........ ........ ........ ........ ........ ........ 68% 274M 0s 05:38:22 156672K ........ ........ ........ ........ ........ ........ 69% 291M 0s 05:38:22 159744K ........ ........ ........ ........ ........ ........ 71% 291M 0s 05:38:22 162816K ........ ........ ........ ........ ........ ........ 72% 294M 0s 05:38:22 165888K ........ ........ ........ ........ ........ ........ 73% 277M 0s 05:38:22 168960K ........ ........ ........ ........ ........ ........ 75% 245M 0s 05:38:22 172032K ........ ........ ........ ........ ........ ........ 76% 183M 0s 05:38:22 175104K ........ ........ ........ ........ ........ ........ 77% 343M 0s 05:38:22 178176K ........ ........ ........ ........ ........ ........ 79% 339M 0s 05:38:22 181248K ........ ........ ........ ........ ........ ........ 80% 361M 0s 05:38:22 184320K ........ ........ ........ ........ ........ ........ 81% 340M 0s 05:38:22 187392K ........ ........ ........ ........ ........ ........ 83% 283M 0s 05:38:22 190464K ........ ........ ........ ........ ........ ........ 84% 286M 0s 05:38:22 193536K ........ ........ ........ ........ ........ ........ 85% 283M 0s 05:38:22 196608K ........ ........ ........ ........ ........ ........ 87% 290M 0s 05:38:22 199680K ........ ........ ........ ........ ........ ........ 88% 288M 0s 05:38:22 202752K ........ ........ ........ ........ ........ ........ 90% 284M 0s 05:38:22 205824K ........ ........ ........ ........ ........ ........ 91% 277M 0s 05:38:22 208896K ........ ........ ........ ........ ........ ........ 92% 275M 0s 05:38:22 211968K ........ ........ ........ ........ ........ ........ 94% 273M 0s 05:38:22 215040K ........ ........ ........ ........ ........ ........ 95% 283M 0s 05:38:22 218112K ........ ........ ........ ........ ........ ........ 96% 279M 0s 05:38:22 221184K ........ ........ ........ ........ ........ ........ 98% 283M 0s 05:38:22 224256K ........ ........ ........ ........ ........ ........ 99% 261M 0s 05:38:22 227328K ........ ........ .... 100% 329M=1.1s 05:38:22 05:38:22 2024-04-07 05:38:22 (202 MB/s) - ‘karaf-0.19.3-20240406.185403-93.zip’ saved [234135853/234135853] 05:38:22 05:38:22 Extracting the new controller... 05:38:22 + echo 'Extracting the new controller...' 05:38:22 + unzip -q karaf-0.19.3-20240406.185403-93.zip 05:38:25 Adding external repositories... 05:38:25 + echo 'Adding external repositories...' 05:38:25 + sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg 05:38:25 + cat /tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg 05:38:25 ################################################################################ 05:38:25 # 05:38:25 # Licensed to the Apache Software Foundation (ASF) under one or more 05:38:25 # contributor license agreements. See the NOTICE file distributed with 05:38:25 # this work for additional information regarding copyright ownership. 05:38:25 # The ASF licenses this file to You under the Apache License, Version 2.0 05:38:25 # (the "License"); you may not use this file except in compliance with 05:38:25 # the License. You may obtain a copy of the License at 05:38:25 # 05:38:25 # http://www.apache.org/licenses/LICENSE-2.0 05:38:25 # 05:38:25 # Unless required by applicable law or agreed to in writing, software 05:38:25 # distributed under the License is distributed on an "AS IS" BASIS, 05:38:25 # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. 05:38:25 # See the License for the specific language governing permissions and 05:38:25 # limitations under the License. 05:38:25 # 05:38:25 ################################################################################ 05:38:25 05:38:25 # 05:38:25 # If set to true, the following property will not allow any certificate to be used 05:38:25 # when accessing Maven repositories through SSL 05:38:25 # 05:38:25 #org.ops4j.pax.url.mvn.certificateCheck= 05:38:25 05:38:25 # 05:38:25 # Path to the local Maven settings file. 05:38:25 # The repositories defined in this file will be automatically added to the list 05:38:25 # of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property 05:38:25 # below is not set. 05:38:25 # The following locations are checked for the existence of the settings.xml file 05:38:25 # * 1. looks for the specified url 05:38:25 # * 2. if not found looks for ${user.home}/.m2/settings.xml 05:38:25 # * 3. if not found looks for ${maven.home}/conf/settings.xml 05:38:25 # * 4. if not found looks for ${M2_HOME}/conf/settings.xml 05:38:25 # 05:38:25 #org.ops4j.pax.url.mvn.settings= 05:38:25 05:38:25 # 05:38:25 # Path to the local Maven repository which is used to avoid downloading 05:38:25 # artifacts when they already exist locally. 05:38:25 # The value of this property will be extracted from the settings.xml file 05:38:25 # above, or defaulted to: 05:38:25 # System.getProperty( "user.home" ) + "/.m2/repository" 05:38:25 # 05:38:25 org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository} 05:38:25 05:38:25 # 05:38:25 # Default this to false. It's just weird to use undocumented repos 05:38:25 # 05:38:25 org.ops4j.pax.url.mvn.useFallbackRepositories=false 05:38:25 05:38:25 # 05:38:25 # Uncomment if you don't wanna use the proxy settings 05:38:25 # from the Maven conf/settings.xml file 05:38:25 # 05:38:25 # org.ops4j.pax.url.mvn.proxySupport=false 05:38:25 05:38:25 # 05:38:25 # Comma separated list of repositories scanned when resolving an artifact. 05:38:25 # Those repositories will be checked before iterating through the 05:38:25 # below list of repositories and even before the local repository 05:38:25 # A repository url can be appended with zero or more of the following flags: 05:38:25 # @snapshots : the repository contains snaphots 05:38:25 # @noreleases : the repository does not contain any released artifacts 05:38:25 # 05:38:25 # The following property value will add the system folder as a repo. 05:38:25 # 05:38:25 org.ops4j.pax.url.mvn.defaultRepositories=\ 05:38:25 file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\ 05:38:25 file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\ 05:38:25 file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots 05:38:25 05:38:25 # Use the default local repo (e.g.~/.m2/repository) as a "remote" repo 05:38:25 #org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false 05:38:25 05:38:25 # 05:38:25 # Comma separated list of repositories scanned when resolving an artifact. 05:38:25 # The default list includes the following repositories: 05:38:25 # http://repo1.maven.org/maven2@id=central 05:38:25 # http://repository.springsource.com/maven/bundles/release@id=spring.ebr 05:38:25 # http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external 05:38:25 # http://zodiac.springsource.com/maven/bundles/release@id=gemini 05:38:25 # http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases 05:38:25 # https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases 05:38:25 # https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases 05:38:25 # To add repositories to the default ones, prepend '+' to the list of repositories 05:38:25 # to add. 05:38:25 # A repository url can be appended with zero or more of the following flags: 05:38:25 # @snapshots : the repository contains snapshots 05:38:25 # @noreleases : the repository does not contain any released artifacts 05:38:25 # @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended 05:38:25 # 05:38:25 org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases 05:38:25 05:38:25 ### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.Configuring the startup features... 05:38:25 + [[ True == \T\r\u\e ]] 05:38:25 + echo 'Configuring the startup features...' 05:38:25 + sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.19.3-SNAPSHOT/etc/org.apache.karaf.features.cfg 05:38:25 + FEATURE_TEST_STRING=features-test 05:38:25 + FEATURE_TEST_VERSION=0.19.3-SNAPSHOT 05:38:25 + KARAF_VERSION=karaf4 05:38:25 + [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]] 05:38:25 + sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.19.3-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.19.3-SNAPSHOT/etc/org.apache.karaf.features.cfg 05:38:25 + [[ ! -z '' ]] 05:38:25 + cat /tmp/karaf-0.19.3-SNAPSHOT/etc/org.apache.karaf.features.cfg 05:38:25 ################################################################################ 05:38:25 # 05:38:25 # Licensed to the Apache Software Foundation (ASF) under one or more 05:38:25 # contributor license agreements. See the NOTICE file distributed with 05:38:25 # this work for additional information regarding copyright ownership. 05:38:25 # The ASF licenses this file to You under the Apache License, Version 2.0 05:38:25 # (the "License"); you may not use this file except in compliance with 05:38:25 # the License. You may obtain a copy of the License at 05:38:25 # 05:38:25 # http://www.apache.org/licenses/LICENSE-2.0 05:38:25 # 05:38:25 # Unless required by applicable law or agreed to in writing, software 05:38:25 # distributed under the License is distributed on an "AS IS" BASIS, 05:38:25 # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. 05:38:25 # See the License for the specific language governing permissions and 05:38:25 # limitations under the License. 05:38:25 # 05:38:25 ################################################################################ 05:38:25 05:38:25 # 05:38:25 # Comma separated list of features repositories to register by default 05:38:25 # 05:38:25 featuresRepositories = mvn:org.opendaylight.integration/features-test/0.19.3-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/feb5a77f-e23f-49fb-8948-bd9f7aeae636.xml 05:38:25 05:38:25 # 05:38:25 # Comma separated list of features to install at startup 05:38:25 # 05:38:25 featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, 7a78e861-931c-47ca-a06c-fb7663e98e08 05:38:25 05:38:25 # 05:38:25 # Resource repositories (OBR) that the features resolver can use 05:38:25 # to resolve requirements/capabilities 05:38:25 # 05:38:25 # The format of the resourceRepositories is 05:38:25 # resourceRepositories=[xml:url|json:url],... 05:38:25 # for Instance: 05:38:25 # 05:38:25 #resourceRepositories=xml:http://host/path/to/index.xml 05:38:25 # or 05:38:25 #resourceRepositories=json:http://host/path/to/index.json 05:38:25 # 05:38:25 05:38:25 # 05:38:25 # Defines if the boot features are started in asynchronous mode (in a dedicated thread) 05:38:25 # 05:38:25 featuresBootAsynchronous=false 05:38:25 05:38:25 # 05:38:25 # Service requirements enforcement 05:38:25 # 05:38:25 # By default, the feature resolver checks the service requirements/capabilities of 05:38:25 # bundles for new features (xml schema >= 1.3.0) in order to automatically installs 05:38:25 # the required bundles. 05:38:25 # The following flag can have those values: 05:38:25 # - disable: service requirements are completely ignored 05:38:25 # - default: service requirements are ignored for old features 05:38:25 # - enforce: service requirements are always verified 05:38:25 # 05:38:25 #serviceRequirements=default 05:38:25 05:38:25 # 05:38:25 # Store cfg file for config element in feature 05:38:25 # 05:38:25 #configCfgStore=true 05:38:25 05:38:25 # 05:38:25 # Define if the feature service automatically refresh bundles 05:38:25 # 05:38:25 autoRefresh=true 05:38:25 05:38:25 # 05:38:25 # Configuration of features processing mechanism (overrides, blacklisting, modification of features) 05:38:25 # XML file defines instructions related to features processing 05:38:25 # versions.properties may declare properties to resolve placeholders in XML file 05:38:25 # both files are relative to ${karaf.etc} 05:38:25 # 05:38:25 #featureProcessing=org.apache.karaf.features.xml 05:38:25 #featureProcessingVersions=versions.properties 05:38:25 + configure_karaf_log karaf4 '' 05:38:25 + local -r karaf_version=karaf4 05:38:25 + local -r controllerdebugmap= 05:38:25 + local logapi=log4j 05:38:25 + grep log4j2 /tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg 05:38:25 log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n 05:38:25 log4j2.rootLogger.level = INFO 05:38:25 #log4j2.rootLogger.type = asyncRoot 05:38:25 #log4j2.rootLogger.includeLocation = false 05:38:25 log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile 05:38:25 log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi 05:38:25 log4j2.rootLogger.appenderRef.Console.ref = Console 05:38:25 log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter 05:38:25 log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} 05:38:25 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter 05:38:25 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair 05:38:25 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker 05:38:25 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL 05:38:25 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or 05:38:25 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY 05:38:25 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL 05:38:25 log4j2.logger.spifly.name = org.apache.aries.spifly 05:38:25 log4j2.logger.spifly.level = WARN 05:38:25 log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit 05:38:25 log4j2.logger.audit.level = INFO 05:38:25 log4j2.logger.audit.additivity = false 05:38:25 log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile 05:38:25 # Console appender not used by default (see log4j2.rootLogger.appenderRefs) 05:38:25 log4j2.appender.console.type = Console 05:38:25 log4j2.appender.console.name = Console 05:38:25 log4j2.appender.console.layout.type = PatternLayout 05:38:25 log4j2.appender.console.layout.pattern = ${log4j2.pattern} 05:38:25 log4j2.appender.rolling.type = RollingRandomAccessFile 05:38:25 log4j2.appender.rolling.name = RollingFile 05:38:25 log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log 05:38:25 log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i 05:38:25 #log4j2.appender.rolling.immediateFlush = false 05:38:25 log4j2.appender.rolling.append = true 05:38:25 log4j2.appender.rolling.layout.type = PatternLayout 05:38:25 log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} 05:38:25 log4j2.appender.rolling.policies.type = Policies 05:38:25 log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy 05:38:25 log4j2.appender.rolling.policies.size.size = 64MB 05:38:25 log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy 05:38:25 log4j2.appender.rolling.strategy.max = 7 05:38:25 log4j2.appender.audit.type = RollingRandomAccessFile 05:38:25 log4j2.appender.audit.name = AuditRollingFile 05:38:25 log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log 05:38:25 log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i 05:38:25 log4j2.appender.audit.append = true 05:38:25 log4j2.appender.audit.layout.type = PatternLayout 05:38:25 log4j2.appender.audit.layout.pattern = ${log4j2.pattern} 05:38:25 log4j2.appender.audit.policies.type = Policies 05:38:25 log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy 05:38:25 log4j2.appender.audit.policies.size.size = 8MB 05:38:25 log4j2.appender.audit.strategy.type = DefaultRolloverStrategy 05:38:25 log4j2.appender.audit.strategy.max = 7 05:38:25 log4j2.appender.osgi.type = PaxOsgi 05:38:25 log4j2.appender.osgi.name = PaxOsgi 05:38:25 log4j2.appender.osgi.filter = * 05:38:25 #log4j2.logger.aether.name = shaded.org.eclipse.aether 05:38:25 #log4j2.logger.aether.level = TRACE 05:38:25 #log4j2.logger.http-headers.name = shaded.org.apache.http.headers 05:38:25 #log4j2.logger.http-headers.level = DEBUG 05:38:25 #log4j2.logger.maven.name = org.ops4j.pax.url.mvn 05:38:25 #log4j2.logger.maven.level = TRACE 05:38:25 Configuring the karaf log... karaf_version: karaf4, logapi: log4j2 05:38:25 + logapi=log4j2 05:38:25 + echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2' 05:38:25 + '[' log4j2 == log4j2 ']' 05:38:25 + sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg 05:38:25 + orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver 05:38:25 + orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver 05:38:25 + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN' 05:38:25 controllerdebugmap: 05:38:25 cat /tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg 05:38:25 + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN' 05:38:25 + unset IFS 05:38:25 + echo 'controllerdebugmap: ' 05:38:25 + '[' -n '' ']' 05:38:25 + echo 'cat /tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg' 05:38:25 + cat /tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg 05:38:25 ################################################################################ 05:38:25 # 05:38:25 # Licensed to the Apache Software Foundation (ASF) under one or more 05:38:25 # contributor license agreements. See the NOTICE file distributed with 05:38:25 # this work for additional information regarding copyright ownership. 05:38:25 # The ASF licenses this file to You under the Apache License, Version 2.0 05:38:25 # (the "License"); you may not use this file except in compliance with 05:38:25 # the License. You may obtain a copy of the License at 05:38:25 # 05:38:25 # http://www.apache.org/licenses/LICENSE-2.0 05:38:25 # 05:38:25 # Unless required by applicable law or agreed to in writing, software 05:38:25 # distributed under the License is distributed on an "AS IS" BASIS, 05:38:25 # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. 05:38:25 # See the License for the specific language governing permissions and 05:38:25 # limitations under the License. 05:38:25 # 05:38:25 ################################################################################ 05:38:25 05:38:25 # Common pattern layout for appenders 05:38:25 log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n 05:38:25 05:38:25 # Root logger 05:38:25 log4j2.rootLogger.level = INFO 05:38:25 # uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library 05:38:25 #log4j2.rootLogger.type = asyncRoot 05:38:25 #log4j2.rootLogger.includeLocation = false 05:38:25 log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile 05:38:25 log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi 05:38:25 log4j2.rootLogger.appenderRef.Console.ref = Console 05:38:25 log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter 05:38:25 log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} 05:38:25 05:38:25 # Filters for logs marked by org.opendaylight.odlparent.Markers 05:38:25 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter 05:38:25 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair 05:38:25 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker 05:38:25 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL 05:38:25 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or 05:38:25 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY 05:38:25 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL 05:38:25 05:38:25 # Loggers configuration 05:38:25 05:38:25 # Spifly logger 05:38:25 log4j2.logger.spifly.name = org.apache.aries.spifly 05:38:25 log4j2.logger.spifly.level = WARN 05:38:25 05:38:25 # Security audit logger 05:38:25 log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit 05:38:25 log4j2.logger.audit.level = INFO 05:38:25 log4j2.logger.audit.additivity = false 05:38:25 log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile 05:38:25 05:38:25 # Appenders configuration 05:38:25 05:38:25 # Console appender not used by default (see log4j2.rootLogger.appenderRefs) 05:38:25 log4j2.appender.console.type = Console 05:38:25 log4j2.appender.console.name = Console 05:38:25 log4j2.appender.console.layout.type = PatternLayout 05:38:25 log4j2.appender.console.layout.pattern = ${log4j2.pattern} 05:38:25 05:38:25 # Rolling file appender 05:38:25 log4j2.appender.rolling.type = RollingRandomAccessFile 05:38:25 log4j2.appender.rolling.name = RollingFile 05:38:25 log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log 05:38:25 log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i 05:38:25 # uncomment to not force a disk flush 05:38:25 #log4j2.appender.rolling.immediateFlush = false 05:38:25 log4j2.appender.rolling.append = true 05:38:25 log4j2.appender.rolling.layout.type = PatternLayout 05:38:25 log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} 05:38:25 log4j2.appender.rolling.policies.type = Policies 05:38:25 log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy 05:38:25 log4j2.appender.rolling.policies.size.size = 1GB 05:38:25 log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy 05:38:25 log4j2.appender.rolling.strategy.max = 7 05:38:25 05:38:25 # Audit file appender 05:38:25 log4j2.appender.audit.type = RollingRandomAccessFile 05:38:25 log4j2.appender.audit.name = AuditRollingFile 05:38:25 log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log 05:38:25 log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i 05:38:25 log4j2.appender.audit.append = true 05:38:25 log4j2.appender.audit.layout.type = PatternLayout 05:38:25 log4j2.appender.audit.layout.pattern = ${log4j2.pattern} 05:38:25 log4j2.appender.audit.policies.type = Policies 05:38:25 log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy 05:38:25 log4j2.appender.audit.policies.size.size = 8MB 05:38:25 log4j2.appender.audit.strategy.type = DefaultRolloverStrategy 05:38:25 log4j2.appender.audit.strategy.max = 7 05:38:25 05:38:25 # OSGi appender 05:38:25 log4j2.appender.osgi.type = PaxOsgi 05:38:25 log4j2.appender.osgi.name = PaxOsgi 05:38:25 log4j2.appender.osgi.filter = * 05:38:25 05:38:25 # help with identification of maven-related problems with pax-url-aether 05:38:25 #log4j2.logger.aether.name = shaded.org.eclipse.aether 05:38:25 #log4j2.logger.aether.level = TRACE 05:38:25 #log4j2.logger.http-headers.name = shaded.org.apache.http.headers 05:38:25 #log4j2.logger.http-headers.level = DEBUG 05:38:25 #log4j2.logger.maven.name = org.ops4j.pax.url.mvn 05:38:25 #log4j2.logger.maven.level = TRACE 05:38:25 log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN 05:38:25 log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN 05:38:25 + set_java_vars /usr/lib/jvm/java-17-openjdk 3072m /tmp/karaf-0.19.3-SNAPSHOT/bin/setenv 05:38:25 + local -r java_home=/usr/lib/jvm/java-17-openjdk 05:38:25 + local -r controllermem=3072m 05:38:25 Configure 05:38:25 java home: /usr/lib/jvm/java-17-openjdk 05:38:25 max memory: 3072m 05:38:25 memconf: /tmp/karaf-0.19.3-SNAPSHOT/bin/setenv 05:38:25 + local -r memconf=/tmp/karaf-0.19.3-SNAPSHOT/bin/setenv 05:38:25 + echo Configure 05:38:25 + echo ' java home: /usr/lib/jvm/java-17-openjdk' 05:38:25 + echo ' max memory: 3072m' 05:38:25 + echo ' memconf: /tmp/karaf-0.19.3-SNAPSHOT/bin/setenv' 05:38:25 + sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk}%g' /tmp/karaf-0.19.3-SNAPSHOT/bin/setenv 05:38:25 + sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.19.3-SNAPSHOT/bin/setenv 05:38:25 cat /tmp/karaf-0.19.3-SNAPSHOT/bin/setenv 05:38:25 + echo 'cat /tmp/karaf-0.19.3-SNAPSHOT/bin/setenv' 05:38:25 + cat /tmp/karaf-0.19.3-SNAPSHOT/bin/setenv 05:38:25 #!/bin/sh 05:38:25 # 05:38:25 # Licensed to the Apache Software Foundation (ASF) under one or more 05:38:25 # contributor license agreements. See the NOTICE file distributed with 05:38:25 # this work for additional information regarding copyright ownership. 05:38:25 # The ASF licenses this file to You under the Apache License, Version 2.0 05:38:25 # (the "License"); you may not use this file except in compliance with 05:38:25 # the License. You may obtain a copy of the License at 05:38:25 # 05:38:25 # http://www.apache.org/licenses/LICENSE-2.0 05:38:25 # 05:38:25 # Unless required by applicable law or agreed to in writing, software 05:38:25 # distributed under the License is distributed on an "AS IS" BASIS, 05:38:25 # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. 05:38:25 # See the License for the specific language governing permissions and 05:38:25 # limitations under the License. 05:38:25 # 05:38:25 05:38:25 # 05:38:25 # handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf 05:38:25 # script: client, instance, shell, start, status, stop, karaf 05:38:25 # 05:38:25 # if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then 05:38:25 # Actions go here... 05:38:25 # fi 05:38:25 05:38:25 # 05:38:25 # general settings which should be applied for all scripts go here; please keep 05:38:25 # in mind that it is possible that scripts might be executed more than once, e.g. 05:38:25 # in example of the start script where the start script is executed first and the 05:38:25 # karaf script afterwards. 05:38:25 # 05:38:25 05:38:25 # 05:38:25 # The following section shows the possible configuration options for the default 05:38:25 # karaf scripts 05:38:25 # 05:38:25 export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk} # Location of Java installation 05:38:25 # export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration 05:38:25 # export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options 05:38:25 # export EXTRA_JAVA_OPTS # Additional JVM options 05:38:25 # export KARAF_HOME # Karaf home folder 05:38:25 # export KARAF_DATA # Karaf data folder 05:38:25 # export KARAF_BASE # Karaf base folder 05:38:25 # export KARAF_ETC # Karaf etc folder 05:38:25 # export KARAF_LOG # Karaf log folder 05:38:25 # export KARAF_SYSTEM_OPTS # First citizen Karaf options 05:38:25 # export KARAF_OPTS # Additional available Karaf options 05:38:25 # export KARAF_DEBUG # Enable debug mode 05:38:25 # export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start 05:38:25 # export KARAF_NOROOT # Prevent execution as root if set to true 05:38:25 Set Java version 05:38:25 + echo 'Set Java version' 05:38:25 + sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-17-openjdk/bin/java 1 05:38:25 + sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-17-openjdk/bin/java 05:38:25 JDK default version ... 05:38:25 + echo 'JDK default version ...' 05:38:25 + java -version 05:38:26 openjdk version "17.0.6-ea" 2023-01-17 LTS 05:38:26 OpenJDK Runtime Environment (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS) 05:38:26 OpenJDK 64-Bit Server VM (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS, mixed mode, sharing) 05:38:26 Set JAVA_HOME 05:38:26 + echo 'Set JAVA_HOME' 05:38:26 + export JAVA_HOME=/usr/lib/jvm/java-17-openjdk 05:38:26 + JAVA_HOME=/usr/lib/jvm/java-17-openjdk 05:38:26 ++ readlink -e /usr/lib/jvm/java-17-openjdk/bin/java 05:38:26 + JAVA_RESOLVED=/usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java 05:38:26 + echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java' 05:38:26 Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java 05:38:26 Listing all open ports on controller system... 05:38:26 + echo 'Listing all open ports on controller system...' 05:38:26 + netstat -pnatu 05:38:26 (Not all processes could be identified, non-owned process info 05:38:26 will not be shown, you would have to be root to see it all.) 05:38:26 Active Internet connections (servers and established) 05:38:26 Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name 05:38:26 tcp 0 0 0.0.0.0:111 0.0.0.0:* LISTEN - 05:38:26 tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN - 05:38:26 tcp 0 164 10.30.171.124:22 10.30.170.160:47694 ESTABLISHED - 05:38:26 tcp 0 0 10.30.171.124:46330 199.204.45.87:443 TIME_WAIT - 05:38:26 tcp6 0 0 :::111 :::* LISTEN - 05:38:26 tcp6 0 0 :::5555 :::* LISTEN - 05:38:26 tcp6 0 0 :::22 :::* LISTEN - 05:38:26 udp 0 0 10.30.171.124:68 10.30.170.3:67 ESTABLISHED - 05:38:26 udp 0 0 0.0.0.0:111 0.0.0.0:* - 05:38:26 udp 0 0 127.0.0.1:323 0.0.0.0:* - 05:38:26 udp6 0 0 :::111 :::* - 05:38:26 udp6 0 0 ::1:323 :::* - 05:38:26 Custom shard config exists!!! 05:38:26 Copying the shard config... 05:38:26 + '[' -f /tmp/custom_shard_config.txt ']' 05:38:26 + echo 'Custom shard config exists!!!' 05:38:26 + echo 'Copying the shard config...' 05:38:26 + cp /tmp/custom_shard_config.txt /tmp/karaf-0.19.3-SNAPSHOT/bin/ 05:38:26 Configuring cluster 05:38:26 + echo 'Configuring cluster' 05:38:26 + /tmp/karaf-0.19.3-SNAPSHOT/bin/configure_cluster.sh 1 10.30.171.124 10.30.171.236 10.30.170.187 05:38:26 ################################################ 05:38:26 ## Configure Cluster ## 05:38:26 ################################################ 05:38:26 NOTE: Cluster configuration files not found. Copying from 05:38:26 /tmp/karaf-0.19.3-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/8.0.5 05:38:26 Configuring unique name in akka.conf 05:38:26 Configuring hostname in akka.conf 05:38:26 Configuring data and rpc seed nodes in akka.conf 05:38:26 modules = [ 05:38:26 05:38:26 { 05:38:26 name = "inventory" 05:38:26 namespace = "urn:opendaylight:inventory" 05:38:26 shard-strategy = "module" 05:38:26 }, 05:38:26 { 05:38:26 name = "topology" 05:38:26 namespace = "urn:TBD:params:xml:ns:yang:network-topology" 05:38:26 shard-strategy = "module" 05:38:26 }, 05:38:26 { 05:38:26 name = "toaster" 05:38:26 namespace = "http://netconfcentral.org/ns/toaster" 05:38:26 shard-strategy = "module" 05:38:26 }, 05:38:26 { 05:38:26 name = "car" 05:38:26 namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" 05:38:26 shard-strategy = "module" 05:38:26 }, 05:38:26 { 05:38:26 name = "people" 05:38:26 namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" 05:38:26 shard-strategy = "module" 05:38:26 }, 05:38:26 { 05:38:26 name = "car-people" 05:38:26 namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" 05:38:26 shard-strategy = "module" 05:38:26 } 05:38:26 ] 05:38:26 Configuring replication type in module-shards.conf 05:38:26 ################################################ 05:38:26 ## NOTE: Manually restart controller to ## 05:38:26 ## apply configuration. ## 05:38:26 ################################################ 05:38:26 Dump akka.conf 05:38:26 + echo 'Dump akka.conf' 05:38:26 + cat /tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/akka.conf 05:38:26 05:38:26 odl-cluster-data { 05:38:26 akka { 05:38:26 remote { 05:38:26 artery { 05:38:26 enabled = on 05:38:26 transport = tcp 05:38:26 canonical.hostname = "10.30.171.124" 05:38:26 canonical.port = 2550 05:38:26 } 05:38:26 } 05:38:26 05:38:26 cluster { 05:38:26 # Using artery. 05:38:26 seed-nodes = ["akka://opendaylight-cluster-data@10.30.171.124:2550", 05:38:26 "akka://opendaylight-cluster-data@10.30.171.236:2550", 05:38:26 "akka://opendaylight-cluster-data@10.30.170.187:2550"] 05:38:26 05:38:26 roles = ["member-1"] 05:38:26 05:38:26 # when under load we might trip a false positive on the failure detector 05:38:26 # failure-detector { 05:38:26 # heartbeat-interval = 4 s 05:38:26 # acceptable-heartbeat-pause = 16s 05:38:26 # } 05:38:26 } 05:38:26 05:38:26 persistence { 05:38:26 # By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by 05:38:26 # modifying the following two properties. The directory location specified may be a relative or absolute path. 05:38:26 # The relative path is always relative to KARAF_HOME. 05:38:26 05:38:26 # snapshot-store.local.dir = "target/snapshots" 05:38:26 05:38:26 # Use lz4 compression for LocalSnapshotStore snapshots 05:38:26 snapshot-store.local.use-lz4-compression = false 05:38:26 # Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB 05:38:26 snapshot-store.local.lz4-blocksize = 256KB 05:38:26 } 05:38:26 disable-default-actor-system-quarantined-event-handling = "false" 05:38:26 } 05:38:26 } 05:38:26 Dump modules.conf 05:38:26 + echo 'Dump modules.conf' 05:38:26 + cat /tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/modules.conf 05:38:26 modules = [ 05:38:26 05:38:26 { 05:38:26 name = "inventory" 05:38:26 namespace = "urn:opendaylight:inventory" 05:38:26 shard-strategy = "module" 05:38:26 }, 05:38:26 { 05:38:26 name = "topology" 05:38:26 namespace = "urn:TBD:params:xml:ns:yang:network-topology" 05:38:26 shard-strategy = "module" 05:38:26 }, 05:38:26 { 05:38:26 name = "toaster" 05:38:26 namespace = "http://netconfcentral.org/ns/toaster" 05:38:26 shard-strategy = "module" 05:38:26 }, 05:38:26 { 05:38:26 name = "car" 05:38:26 namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" 05:38:26 shard-strategy = "module" 05:38:26 }, 05:38:26 { 05:38:26 name = "people" 05:38:26 namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" 05:38:26 shard-strategy = "module" 05:38:26 }, 05:38:26 { 05:38:26 name = "car-people" 05:38:26 namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" 05:38:26 shard-strategy = "module" 05:38:26 } 05:38:26 ] 05:38:26 Dump module-shards.conf 05:38:26 + echo 'Dump module-shards.conf' 05:38:26 + cat /tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/module-shards.conf 05:38:26 module-shards = [ 05:38:26 { 05:38:26 name = "default" 05:38:26 shards = [ 05:38:26 { 05:38:26 name = "default" 05:38:26 replicas = ["member-1", 05:38:26 "member-2", 05:38:26 "member-3"] 05:38:26 } 05:38:26 ] 05:38:26 }, 05:38:26 { 05:38:26 name = "inventory" 05:38:26 shards = [ 05:38:26 { 05:38:26 name="inventory" 05:38:26 replicas = ["member-1", 05:38:26 "member-2", 05:38:26 "member-3"] 05:38:26 } 05:38:26 ] 05:38:26 }, 05:38:26 { 05:38:26 name = "topology" 05:38:26 shards = [ 05:38:26 { 05:38:26 name="topology" 05:38:26 replicas = ["member-1", 05:38:26 "member-2", 05:38:26 "member-3"] 05:38:26 } 05:38:26 ] 05:38:26 }, 05:38:26 { 05:38:26 name = "toaster" 05:38:26 shards = [ 05:38:26 { 05:38:26 name="toaster" 05:38:26 replicas = ["member-1", 05:38:26 "member-2", 05:38:26 "member-3"] 05:38:26 } 05:38:26 ] 05:38:26 }, 05:38:26 { 05:38:26 name = "car" 05:38:26 shards = [ 05:38:26 { 05:38:26 name="car" 05:38:26 replicas = ["member-1", 05:38:26 "member-2", 05:38:26 "member-3"] 05:38:26 } 05:38:26 ] 05:38:26 }, 05:38:26 { 05:38:26 name = "people" 05:38:26 shards = [ 05:38:26 { 05:38:26 name="people" 05:38:26 replicas = ["member-1", 05:38:26 "member-2", 05:38:26 "member-3"] 05:38:26 } 05:38:26 ] 05:38:26 }, 05:38:26 { 05:38:26 name = "car-people" 05:38:26 shards = [ 05:38:26 { 05:38:26 name="car-people" 05:38:26 replicas = ["member-1", 05:38:26 "member-2", 05:38:26 "member-3"] 05:38:26 } 05:38:26 ] 05:38:26 } 05:38:26 ] 05:38:26 Configuring member-2 with IP address 10.30.171.236 05:38:26 Warning: Permanently added '10.30.171.236' (ECDSA) to the list of known hosts. 05:38:26 Warning: Permanently added '10.30.171.236' (ECDSA) to the list of known hosts. 05:38:26 + source /tmp/common-functions.sh karaf-0.19.3-SNAPSHOT 05:38:26 ++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]] 05:38:26 common-functions.sh is being sourced 05:38:26 ++ echo 'common-functions.sh is being sourced' 05:38:26 ++ BUNDLEFOLDER=karaf-0.19.3-SNAPSHOT 05:38:26 ++ export MAVENCONF=/tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg 05:38:26 ++ MAVENCONF=/tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg 05:38:26 ++ export FEATURESCONF=/tmp/karaf-0.19.3-SNAPSHOT/etc/org.apache.karaf.features.cfg 05:38:26 ++ FEATURESCONF=/tmp/karaf-0.19.3-SNAPSHOT/etc/org.apache.karaf.features.cfg 05:38:26 ++ export CUSTOMPROP=/tmp/karaf-0.19.3-SNAPSHOT/etc/custom.properties 05:38:26 ++ CUSTOMPROP=/tmp/karaf-0.19.3-SNAPSHOT/etc/custom.properties 05:38:26 ++ export LOGCONF=/tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg 05:38:26 ++ LOGCONF=/tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg 05:38:26 ++ export MEMCONF=/tmp/karaf-0.19.3-SNAPSHOT/bin/setenv 05:38:26 ++ MEMCONF=/tmp/karaf-0.19.3-SNAPSHOT/bin/setenv 05:38:26 ++ export CONTROLLERMEM= 05:38:26 ++ CONTROLLERMEM= 05:38:26 ++ export AKKACONF=/tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/akka.conf 05:38:26 ++ AKKACONF=/tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/akka.conf 05:38:26 ++ export MODULESCONF=/tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/modules.conf 05:38:26 ++ MODULESCONF=/tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/modules.conf 05:38:26 ++ export MODULESHARDSCONF=/tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/module-shards.conf 05:38:26 ++ MODULESHARDSCONF=/tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/module-shards.conf 05:38:26 ++ print_common_env 05:38:26 ++ cat 05:38:26 common-functions environment: 05:38:26 MAVENCONF: /tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg 05:38:26 ACTUALFEATURES: 05:38:26 FEATURESCONF: /tmp/karaf-0.19.3-SNAPSHOT/etc/org.apache.karaf.features.cfg 05:38:26 CUSTOMPROP: /tmp/karaf-0.19.3-SNAPSHOT/etc/custom.properties 05:38:26 LOGCONF: /tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg 05:38:26 MEMCONF: /tmp/karaf-0.19.3-SNAPSHOT/bin/setenv 05:38:26 CONTROLLERMEM: 05:38:26 AKKACONF: /tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/akka.conf 05:38:26 MODULESCONF: /tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/modules.conf 05:38:26 MODULESHARDSCONF: /tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/module-shards.conf 05:38:26 SUITES: 05:38:26 05:38:26 ++ SSH='ssh -t -t' 05:38:26 ++ extra_services_cntl=' dnsmasq.service httpd.service libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service rabbitmq-server.service ' 05:38:26 ++ extra_services_cmp=' libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service ' 05:38:26 Changing to /tmp 05:38:26 Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.19.3-SNAPSHOT/karaf-0.19.3-20240406.185403-93.zip 05:38:26 + echo 'Changing to /tmp' 05:38:26 + cd /tmp 05:38:26 + echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.19.3-SNAPSHOT/karaf-0.19.3-20240406.185403-93.zip' 05:38:26 + wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.19.3-SNAPSHOT/karaf-0.19.3-20240406.185403-93.zip 05:38:26 --2024-04-07 05:38:26-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.19.3-SNAPSHOT/karaf-0.19.3-20240406.185403-93.zip 05:38:26 Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6 05:38:26 Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected. 05:38:26 HTTP request sent, awaiting response... 200 OK 05:38:26 Length: 234135853 (223M) [application/zip] 05:38:26 Saving to: ‘karaf-0.19.3-20240406.185403-93.zip’ 05:38:26 05:38:26 0K ........ ........ ........ ........ ........ ........ 1% 89.6M 2s 05:38:26 3072K ........ ........ ........ ........ ........ ........ 2% 140M 2s 05:38:26 6144K ........ ........ ........ ........ ........ ........ 4% 139M 2s 05:38:27 9216K ........ ........ ........ ........ ........ ........ 5% 172M 2s 05:38:27 12288K ........ ........ ........ ........ ........ ........ 6% 209M 2s 05:38:27 15360K ........ ........ ........ ........ ........ ........ 8% 201M 1s 05:38:27 18432K ........ ........ ........ ........ ........ ........ 9% 247M 1s 05:38:27 21504K ........ ........ ........ ........ ........ ........ 10% 232M 1s 05:38:27 24576K ........ ........ ........ ........ ........ ........ 12% 275M 1s 05:38:27 27648K ........ ........ ........ ........ ........ ........ 13% 293M 1s 05:38:27 30720K ........ ........ ........ ........ ........ ........ 14% 306M 1s 05:38:27 33792K ........ ........ ........ ........ ........ ........ 16% 321M 1s 05:38:27 36864K ........ ........ ........ ........ ........ ........ 17% 315M 1s 05:38:27 39936K ........ ........ ........ ........ ........ ........ 18% 361M 1s 05:38:27 43008K ........ ........ ........ ........ ........ ........ 20% 239M 1s 05:38:27 46080K ........ ........ ........ ........ ........ ........ 21% 290M 1s 05:38:27 49152K ........ ........ ........ ........ ........ ........ 22% 393M 1s 05:38:27 52224K ........ ........ ........ ........ ........ ........ 24% 132M 1s 05:38:27 55296K ........ ........ ........ ........ ........ ........ 25% 281M 1s 05:38:27 58368K ........ ........ ........ ........ ........ ........ 26% 88.4M 1s 05:38:27 61440K ........ ........ ........ ........ ........ ........ 28% 139M 1s 05:38:27 64512K ........ ........ ........ ........ ........ ........ 29% 284M 1s 05:38:27 67584K ........ ........ ........ ........ ........ ........ 30% 96.3M 1s 05:38:27 70656K ........ ........ ........ ........ ........ ........ 32% 235M 1s 05:38:27 73728K ........ ........ ........ ........ ........ ........ 33% 334M 1s 05:38:27 76800K ........ ........ ........ ........ ........ ........ 34% 216M 1s 05:38:27 79872K ........ ........ ........ ........ ........ ........ 36% 127M 1s 05:38:27 82944K ........ ........ ........ ........ ........ ........ 37% 386M 1s 05:38:27 86016K ........ ........ ........ ........ ........ ........ 38% 313M 1s 05:38:27 89088K ........ ........ ........ ........ ........ ........ 40% 292M 1s 05:38:27 92160K ........ ........ ........ ........ ........ ........ 41% 338M 1s 05:38:27 95232K ........ ........ ........ ........ ........ ........ 42% 346M 1s 05:38:27 98304K ........ ........ ........ ........ ........ ........ 44% 344M 1s 05:38:27 101376K ........ ........ ........ ........ ........ ........ 45% 346M 1s 05:38:27 104448K ........ ........ ........ ........ ........ ........ 47% 321M 1s 05:38:27 107520K ........ ........ ........ ........ ........ ........ 48% 379M 1s 05:38:27 110592K ........ ........ ........ ........ ........ ........ 49% 373M 1s 05:38:27 113664K ........ ........ ........ ........ ........ ........ 51% 365M 1s 05:38:27 116736K ........ ........ ........ ........ ........ ........ 52% 356M 0s 05:38:27 119808K ........ ........ ........ ........ ........ ........ 53% 361M 0s 05:38:27 122880K ........ ........ ........ ........ ........ ........ 55% 260M 0s 05:38:27 125952K ........ ........ ........ ........ ........ ........ 56% 326M 0s 05:38:27 129024K ........ ........ ........ ........ ........ ........ 57% 331M 0s 05:38:27 132096K ........ ........ ........ ........ ........ ........ 59% 370M 0s 05:38:27 135168K ........ ........ ........ ........ ........ ........ 60% 344M 0s 05:38:27 138240K ........ ........ ........ ........ ........ ........ 61% 369M 0s 05:38:27 141312K ........ ........ ........ ........ ........ ........ 63% 344M 0s 05:38:27 144384K ........ ........ ........ ........ ........ ........ 64% 375M 0s 05:38:27 147456K ........ ........ ........ ........ ........ ........ 65% 363M 0s 05:38:27 150528K ........ ........ ........ ........ ........ ........ 67% 343M 0s 05:38:27 153600K ........ ........ ........ ........ ........ ........ 68% 384M 0s 05:38:27 156672K ........ ........ ........ ........ ........ ........ 69% 364M 0s 05:38:27 159744K ........ ........ ........ ........ ........ ........ 71% 366M 0s 05:38:27 162816K ........ ........ ........ ........ ........ ........ 72% 345M 0s 05:38:27 165888K ........ ........ ........ ........ ........ ........ 73% 356M 0s 05:38:27 168960K ........ ........ ........ ........ ........ ........ 75% 359M 0s 05:38:27 172032K ........ ........ ........ ........ ........ ........ 76% 347M 0s 05:38:27 175104K ........ ........ ........ ........ ........ ........ 77% 321M 0s 05:38:27 178176K ........ ........ ........ ........ ........ ........ 79% 115M 0s 05:38:27 181248K ........ ........ ........ ........ ........ ........ 80% 316M 0s 05:38:27 184320K ........ ........ ........ ........ ........ ........ 81% 315M 0s 05:38:27 187392K ........ ........ ........ ........ ........ ........ 83% 327M 0s 05:38:27 190464K ........ ........ ........ ........ ........ ........ 84% 335M 0s 05:38:27 193536K ........ ........ ........ ........ ........ ........ 85% 360M 0s 05:38:27 196608K ........ ........ ........ ........ ........ ........ 87% 357M 0s 05:38:27 199680K ........ ........ ........ ........ ........ ........ 88% 377M 0s 05:38:27 202752K ........ ........ ........ ........ ........ ........ 90% 398M 0s 05:38:27 205824K ........ ........ ........ ........ ........ ........ 91% 341M 0s 05:38:27 208896K ........ ........ ........ ........ ........ ........ 92% 318M 0s 05:38:27 211968K ........ ........ ........ ........ ........ ........ 94% 346M 0s 05:38:27 215040K ........ ........ ........ ........ ........ ........ 95% 333M 0s 05:38:27 218112K ........ ........ ........ ........ ........ ........ 96% 349M 0s 05:38:27 221184K ........ ........ ........ ........ ........ ........ 98% 316M 0s 05:38:27 224256K ........ ........ ........ ........ ........ ........ 99% 348M 0s 05:38:27 227328K ........ ........ .... 100% 334M=0.9s 05:38:27 05:38:27 2024-04-07 05:38:27 (260 MB/s) - ‘karaf-0.19.3-20240406.185403-93.zip’ saved [234135853/234135853] 05:38:27 05:38:27 + echo 'Extracting the new controller...' 05:38:27 Extracting the new controller... 05:38:27 + unzip -q karaf-0.19.3-20240406.185403-93.zip 05:38:30 Adding external repositories... 05:38:30 + echo 'Adding external repositories...' 05:38:30 + sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg 05:38:30 + cat /tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg 05:38:30 ################################################################################ 05:38:30 # 05:38:30 # Licensed to the Apache Software Foundation (ASF) under one or more 05:38:30 # contributor license agreements. See the NOTICE file distributed with 05:38:30 # this work for additional information regarding copyright ownership. 05:38:30 # The ASF licenses this file to You under the Apache License, Version 2.0 05:38:30 # (the "License"); you may not use this file except in compliance with 05:38:30 # the License. You may obtain a copy of the License at 05:38:30 # 05:38:30 # http://www.apache.org/licenses/LICENSE-2.0 05:38:30 # 05:38:30 # Unless required by applicable law or agreed to in writing, software 05:38:30 # distributed under the License is distributed on an "AS IS" BASIS, 05:38:30 # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. 05:38:30 # See the License for the specific language governing permissions and 05:38:30 # limitations under the License. 05:38:30 # 05:38:30 ################################################################################ 05:38:30 05:38:30 # 05:38:30 # If set to true, the following property will not allow any certificate to be used 05:38:30 # when accessing Maven repositories through SSL 05:38:30 # 05:38:30 #org.ops4j.pax.url.mvn.certificateCheck= 05:38:30 05:38:30 # 05:38:30 # Path to the local Maven settings file. 05:38:30 # The repositories defined in this file will be automatically added to the list 05:38:30 # of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property 05:38:30 # below is not set. 05:38:30 # The following locations are checked for the existence of the settings.xml file 05:38:30 # * 1. looks for the specified url 05:38:30 # * 2. if not found looks for ${user.home}/.m2/settings.xml 05:38:30 # * 3. if not found looks for ${maven.home}/conf/settings.xml 05:38:30 # * 4. if not found looks for ${M2_HOME}/conf/settings.xml 05:38:30 # 05:38:30 #org.ops4j.pax.url.mvn.settings= 05:38:30 05:38:30 # 05:38:30 # Path to the local Maven repository which is used to avoid downloading 05:38:30 # artifacts when they already exist locally. 05:38:30 # The value of this property will be extracted from the settings.xml file 05:38:30 # above, or defaulted to: 05:38:30 # System.getProperty( "user.home" ) + "/.m2/repository" 05:38:30 # 05:38:30 org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository} 05:38:30 05:38:30 # 05:38:30 # Default this to false. It's just weird to use undocumented repos 05:38:30 # 05:38:30 org.ops4j.pax.url.mvn.useFallbackRepositories=false 05:38:30 05:38:30 # 05:38:30 # Uncomment if you don't wanna use the proxy settings 05:38:30 # from the Maven conf/settings.xml file 05:38:30 # 05:38:30 # org.ops4j.pax.url.mvn.proxySupport=false 05:38:30 05:38:30 # 05:38:30 # Comma separated list of repositories scanned when resolving an artifact. 05:38:30 # Those repositories will be checked before iterating through the 05:38:30 # below list of repositories and even before the local repository 05:38:30 # A repository url can be appended with zero or more of the following flags: 05:38:30 # @snapshots : the repository contains snaphots 05:38:30 # @noreleases : the repository does not contain any released artifacts 05:38:30 # 05:38:30 # The following property value will add the system folder as a repo. 05:38:30 # 05:38:30 org.ops4j.pax.url.mvn.defaultRepositories=\ 05:38:30 file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\ 05:38:30 file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\ 05:38:30 file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots 05:38:30 05:38:30 # Use the default local repo (e.g.~/.m2/repository) as a "remote" repo 05:38:30 #org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false 05:38:30 05:38:30 # 05:38:30 # Comma separated list of repositories scanned when resolving an artifact. 05:38:30 # The default list includes the following repositories: 05:38:30 # http://repo1.maven.org/maven2@id=central 05:38:30 # http://repository.springsource.com/maven/bundles/release@id=spring.ebr 05:38:30 # http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external 05:38:30 # http://zodiac.springsource.com/maven/bundles/release@id=gemini 05:38:30 # http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases 05:38:30 # https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases 05:38:30 # https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases 05:38:30 # To add repositories to the default ones, prepend '+' to the list of repositories 05:38:30 # to add. 05:38:30 # A repository url can be appended with zero or more of the following flags: 05:38:30 # @snapshots : the repository contains snapshots 05:38:30 # @noreleases : the repository does not contain any released artifacts 05:38:30 # @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended 05:38:30 # 05:38:30 org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases 05:38:30 05:38:30 ### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.Configuring the startup features... 05:38:30 + [[ True == \T\r\u\e ]] 05:38:30 + echo 'Configuring the startup features...' 05:38:30 + sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.19.3-SNAPSHOT/etc/org.apache.karaf.features.cfg 05:38:30 + FEATURE_TEST_STRING=features-test 05:38:30 + FEATURE_TEST_VERSION=0.19.3-SNAPSHOT 05:38:30 + KARAF_VERSION=karaf4 05:38:30 + [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]] 05:38:30 + sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.19.3-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.19.3-SNAPSHOT/etc/org.apache.karaf.features.cfg 05:38:30 + [[ ! -z '' ]] 05:38:30 + cat /tmp/karaf-0.19.3-SNAPSHOT/etc/org.apache.karaf.features.cfg 05:38:30 ################################################################################ 05:38:30 # 05:38:30 # Licensed to the Apache Software Foundation (ASF) under one or more 05:38:30 # contributor license agreements. See the NOTICE file distributed with 05:38:30 # this work for additional information regarding copyright ownership. 05:38:30 # The ASF licenses this file to You under the Apache License, Version 2.0 05:38:30 # (the "License"); you may not use this file except in compliance with 05:38:30 # the License. You may obtain a copy of the License at 05:38:30 # 05:38:30 # http://www.apache.org/licenses/LICENSE-2.0 05:38:30 # 05:38:30 # Unless required by applicable law or agreed to in writing, software 05:38:30 # distributed under the License is distributed on an "AS IS" BASIS, 05:38:30 # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. 05:38:30 # See the License for the specific language governing permissions and 05:38:30 # limitations under the License. 05:38:30 # 05:38:30 ################################################################################ 05:38:30 05:38:30 # 05:38:30 # Comma separated list of features repositories to register by default 05:38:30 # 05:38:30 featuresRepositories = mvn:org.opendaylight.integration/features-test/0.19.3-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/feb5a77f-e23f-49fb-8948-bd9f7aeae636.xml 05:38:30 05:38:30 # 05:38:30 # Comma separated list of features to install at startup 05:38:30 # 05:38:30 featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, 7a78e861-931c-47ca-a06c-fb7663e98e08 05:38:30 05:38:30 # 05:38:30 # Resource repositories (OBR) that the features resolver can use 05:38:30 # to resolve requirements/capabilities 05:38:30 # 05:38:30 # The format of the resourceRepositories is 05:38:30 # resourceRepositories=[xml:url|json:url],... 05:38:30 # for Instance: 05:38:30 # 05:38:30 #resourceRepositories=xml:http://host/path/to/index.xml 05:38:30 # or 05:38:30 #resourceRepositories=json:http://host/path/to/index.json 05:38:30 # 05:38:30 05:38:30 # 05:38:30 # Defines if the boot features are started in asynchronous mode (in a dedicated thread) 05:38:30 # 05:38:30 featuresBootAsynchronous=false 05:38:30 05:38:30 # 05:38:30 # Service requirements enforcement 05:38:30 # 05:38:30 # By default, the feature resolver checks the service requirements/capabilities of 05:38:30 # bundles for new features (xml schema >= 1.3.0) in order to automatically installs 05:38:30 # the required bundles. 05:38:30 # The following flag can have those values: 05:38:30 # - disable: service requirements are completely ignored 05:38:30 # - default: service requirements are ignored for old features 05:38:30 # - enforce: service requirements are always verified 05:38:30 # 05:38:30 #serviceRequirements=default 05:38:30 05:38:30 # 05:38:30 # Store cfg file for config element in feature 05:38:30 # 05:38:30 #configCfgStore=true 05:38:30 05:38:30 # 05:38:30 # Define if the feature service automatically refresh bundles 05:38:30 # 05:38:30 autoRefresh=true 05:38:30 05:38:30 # 05:38:30 # Configuration of features processing mechanism (overrides, blacklisting, modification of features) 05:38:30 # XML file defines instructions related to features processing 05:38:30 # versions.properties may declare properties to resolve placeholders in XML file 05:38:30 # both files are relative to ${karaf.etc} 05:38:30 # 05:38:30 #featureProcessing=org.apache.karaf.features.xml 05:38:30 #featureProcessingVersions=versions.properties 05:38:30 + configure_karaf_log karaf4 '' 05:38:30 + local -r karaf_version=karaf4 05:38:30 + local -r controllerdebugmap= 05:38:30 + local logapi=log4j 05:38:30 + grep log4j2 /tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg 05:38:30 log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n 05:38:30 log4j2.rootLogger.level = INFO 05:38:30 #log4j2.rootLogger.type = asyncRoot 05:38:30 #log4j2.rootLogger.includeLocation = false 05:38:30 log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile 05:38:30 log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi 05:38:30 log4j2.rootLogger.appenderRef.Console.ref = Console 05:38:30 log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter 05:38:30 log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} 05:38:30 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter 05:38:30 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair 05:38:30 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker 05:38:30 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL 05:38:30 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or 05:38:30 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY 05:38:30 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL 05:38:30 log4j2.logger.spifly.name = org.apache.aries.spifly 05:38:30 log4j2.logger.spifly.level = WARN 05:38:30 log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit 05:38:30 log4j2.logger.audit.level = INFO 05:38:30 log4j2.logger.audit.additivity = false 05:38:30 log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile 05:38:30 # Console appender not used by default (see log4j2.rootLogger.appenderRefs) 05:38:30 log4j2.appender.console.type = Console 05:38:30 log4j2.appender.console.name = Console 05:38:30 log4j2.appender.console.layout.type = PatternLayout 05:38:30 log4j2.appender.console.layout.pattern = ${log4j2.pattern} 05:38:30 log4j2.appender.rolling.type = RollingRandomAccessFile 05:38:30 log4j2.appender.rolling.name = RollingFile 05:38:30 log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log 05:38:30 log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i 05:38:30 #log4j2.appender.rolling.immediateFlush = false 05:38:30 log4j2.appender.rolling.append = true 05:38:30 log4j2.appender.rolling.layout.type = PatternLayout 05:38:30 log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} 05:38:30 log4j2.appender.rolling.policies.type = Policies 05:38:30 log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy 05:38:30 log4j2.appender.rolling.policies.size.size = 64MB 05:38:30 log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy 05:38:30 log4j2.appender.rolling.strategy.max = 7 05:38:30 log4j2.appender.audit.type = RollingRandomAccessFile 05:38:30 log4j2.appender.audit.name = AuditRollingFile 05:38:30 log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log 05:38:30 log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i 05:38:30 log4j2.appender.audit.append = true 05:38:30 log4j2.appender.audit.layout.type = PatternLayout 05:38:30 log4j2.appender.audit.layout.pattern = ${log4j2.pattern} 05:38:30 log4j2.appender.audit.policies.type = Policies 05:38:30 log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy 05:38:30 log4j2.appender.audit.policies.size.size = 8MB 05:38:30 log4j2.appender.audit.strategy.type = DefaultRolloverStrategy 05:38:30 log4j2.appender.audit.strategy.max = 7 05:38:30 log4j2.appender.osgi.type = PaxOsgi 05:38:30 log4j2.appender.osgi.name = PaxOsgi 05:38:30 log4j2.appender.osgi.filter = * 05:38:30 #log4j2.logger.aether.name = shaded.org.eclipse.aether 05:38:30 #log4j2.logger.aether.level = TRACE 05:38:30 #log4j2.logger.http-headers.name = shaded.org.apache.http.headers 05:38:30 #log4j2.logger.http-headers.level = DEBUG 05:38:30 #log4j2.logger.maven.name = org.ops4j.pax.url.mvn 05:38:30 #log4j2.logger.maven.level = TRACE 05:38:30 Configuring the karaf log... karaf_version: karaf4, logapi: log4j2 05:38:30 + logapi=log4j2 05:38:30 + echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2' 05:38:30 + '[' log4j2 == log4j2 ']' 05:38:30 + sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg 05:38:30 + orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver 05:38:30 + orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver 05:38:30 + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN' 05:38:30 + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN' 05:38:30 controllerdebugmap: 05:38:30 + unset IFS 05:38:30 + echo 'controllerdebugmap: ' 05:38:30 cat /tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg 05:38:30 + '[' -n '' ']' 05:38:30 + echo 'cat /tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg' 05:38:30 + cat /tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg 05:38:30 ################################################################################ 05:38:30 # 05:38:30 # Licensed to the Apache Software Foundation (ASF) under one or more 05:38:30 # contributor license agreements. See the NOTICE file distributed with 05:38:30 # this work for additional information regarding copyright ownership. 05:38:30 # The ASF licenses this file to You under the Apache License, Version 2.0 05:38:30 # (the "License"); you may not use this file except in compliance with 05:38:30 # the License. You may obtain a copy of the License at 05:38:30 # 05:38:30 # http://www.apache.org/licenses/LICENSE-2.0 05:38:30 # 05:38:30 # Unless required by applicable law or agreed to in writing, software 05:38:30 # distributed under the License is distributed on an "AS IS" BASIS, 05:38:30 # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. 05:38:30 # See the License for the specific language governing permissions and 05:38:30 # limitations under the License. 05:38:30 # 05:38:30 ################################################################################ 05:38:30 05:38:30 # Common pattern layout for appenders 05:38:30 log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n 05:38:30 05:38:30 # Root logger 05:38:30 log4j2.rootLogger.level = INFO 05:38:30 # uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library 05:38:30 #log4j2.rootLogger.type = asyncRoot 05:38:30 #log4j2.rootLogger.includeLocation = false 05:38:30 log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile 05:38:30 log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi 05:38:30 log4j2.rootLogger.appenderRef.Console.ref = Console 05:38:30 log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter 05:38:30 log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} 05:38:30 05:38:30 # Filters for logs marked by org.opendaylight.odlparent.Markers 05:38:30 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter 05:38:30 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair 05:38:30 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker 05:38:30 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL 05:38:30 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or 05:38:30 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY 05:38:30 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL 05:38:30 05:38:30 # Loggers configuration 05:38:30 05:38:30 # Spifly logger 05:38:30 log4j2.logger.spifly.name = org.apache.aries.spifly 05:38:30 log4j2.logger.spifly.level = WARN 05:38:30 05:38:30 # Security audit logger 05:38:30 log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit 05:38:30 log4j2.logger.audit.level = INFO 05:38:30 log4j2.logger.audit.additivity = false 05:38:30 log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile 05:38:30 05:38:30 # Appenders configuration 05:38:30 05:38:30 # Console appender not used by default (see log4j2.rootLogger.appenderRefs) 05:38:30 log4j2.appender.console.type = Console 05:38:30 log4j2.appender.console.name = Console 05:38:30 log4j2.appender.console.layout.type = PatternLayout 05:38:30 log4j2.appender.console.layout.pattern = ${log4j2.pattern} 05:38:30 05:38:30 # Rolling file appender 05:38:30 log4j2.appender.rolling.type = RollingRandomAccessFile 05:38:30 log4j2.appender.rolling.name = RollingFile 05:38:30 log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log 05:38:30 log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i 05:38:30 # uncomment to not force a disk flush 05:38:30 #log4j2.appender.rolling.immediateFlush = false 05:38:30 log4j2.appender.rolling.append = true 05:38:30 log4j2.appender.rolling.layout.type = PatternLayout 05:38:30 log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} 05:38:30 log4j2.appender.rolling.policies.type = Policies 05:38:30 log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy 05:38:30 log4j2.appender.rolling.policies.size.size = 1GB 05:38:30 log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy 05:38:30 log4j2.appender.rolling.strategy.max = 7 05:38:30 05:38:30 # Audit file appender 05:38:30 log4j2.appender.audit.type = RollingRandomAccessFile 05:38:30 log4j2.appender.audit.name = AuditRollingFile 05:38:30 log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log 05:38:30 log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i 05:38:30 log4j2.appender.audit.append = true 05:38:30 log4j2.appender.audit.layout.type = PatternLayout 05:38:30 log4j2.appender.audit.layout.pattern = ${log4j2.pattern} 05:38:30 log4j2.appender.audit.policies.type = Policies 05:38:30 log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy 05:38:30 log4j2.appender.audit.policies.size.size = 8MB 05:38:30 log4j2.appender.audit.strategy.type = DefaultRolloverStrategy 05:38:30 log4j2.appender.audit.strategy.max = 7 05:38:30 05:38:30 # OSGi appender 05:38:30 log4j2.appender.osgi.type = PaxOsgi 05:38:30 log4j2.appender.osgi.name = PaxOsgi 05:38:30 log4j2.appender.osgi.filter = * 05:38:30 05:38:30 # help with identification of maven-related problems with pax-url-aether 05:38:30 #log4j2.logger.aether.name = shaded.org.eclipse.aether 05:38:30 #log4j2.logger.aether.level = TRACE 05:38:30 #log4j2.logger.http-headers.name = shaded.org.apache.http.headers 05:38:30 #log4j2.logger.http-headers.level = DEBUG 05:38:30 #log4j2.logger.maven.name = org.ops4j.pax.url.mvn 05:38:30 #log4j2.logger.maven.level = TRACE 05:38:30 log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN 05:38:30 log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN 05:38:30 + set_java_vars /usr/lib/jvm/java-17-openjdk 3072m /tmp/karaf-0.19.3-SNAPSHOT/bin/setenv 05:38:30 + local -r java_home=/usr/lib/jvm/java-17-openjdk 05:38:30 + local -r controllermem=3072m 05:38:30 Configure 05:38:30 + local -r memconf=/tmp/karaf-0.19.3-SNAPSHOT/bin/setenv 05:38:30 + echo Configure 05:38:30 java home: /usr/lib/jvm/java-17-openjdk 05:38:30 max memory: 3072m 05:38:30 memconf: /tmp/karaf-0.19.3-SNAPSHOT/bin/setenv 05:38:30 + echo ' java home: /usr/lib/jvm/java-17-openjdk' 05:38:30 + echo ' max memory: 3072m' 05:38:30 + echo ' memconf: /tmp/karaf-0.19.3-SNAPSHOT/bin/setenv' 05:38:30 + sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk}%g' /tmp/karaf-0.19.3-SNAPSHOT/bin/setenv 05:38:30 + sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.19.3-SNAPSHOT/bin/setenv 05:38:30 cat /tmp/karaf-0.19.3-SNAPSHOT/bin/setenv 05:38:30 + echo 'cat /tmp/karaf-0.19.3-SNAPSHOT/bin/setenv' 05:38:30 + cat /tmp/karaf-0.19.3-SNAPSHOT/bin/setenv 05:38:30 #!/bin/sh 05:38:30 # 05:38:30 # Licensed to the Apache Software Foundation (ASF) under one or more 05:38:30 # contributor license agreements. See the NOTICE file distributed with 05:38:30 # this work for additional information regarding copyright ownership. 05:38:30 # The ASF licenses this file to You under the Apache License, Version 2.0 05:38:30 # (the "License"); you may not use this file except in compliance with 05:38:30 # the License. You may obtain a copy of the License at 05:38:30 # 05:38:30 # http://www.apache.org/licenses/LICENSE-2.0 05:38:30 # 05:38:30 # Unless required by applicable law or agreed to in writing, software 05:38:30 # distributed under the License is distributed on an "AS IS" BASIS, 05:38:30 # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. 05:38:30 # See the License for the specific language governing permissions and 05:38:30 # limitations under the License. 05:38:30 # 05:38:30 05:38:30 # 05:38:30 # handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf 05:38:30 # script: client, instance, shell, start, status, stop, karaf 05:38:30 # 05:38:30 # if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then 05:38:30 # Actions go here... 05:38:30 # fi 05:38:30 05:38:30 # 05:38:30 # general settings which should be applied for all scripts go here; please keep 05:38:30 # in mind that it is possible that scripts might be executed more than once, e.g. 05:38:30 # in example of the start script where the start script is executed first and the 05:38:30 # karaf script afterwards. 05:38:30 # 05:38:30 05:38:30 # 05:38:30 # The following section shows the possible configuration options for the default 05:38:30 # karaf scripts 05:38:30 # 05:38:30 export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk} # Location of Java installation 05:38:30 # export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration 05:38:30 # export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options 05:38:30 # export EXTRA_JAVA_OPTS # Additional JVM options 05:38:30 # export KARAF_HOME # Karaf home folder 05:38:30 # export KARAF_DATA # Karaf data folder 05:38:30 # export KARAF_BASE # Karaf base folder 05:38:30 # export KARAF_ETC # Karaf etc folder 05:38:30 # export KARAF_LOG # Karaf log folder 05:38:30 # export KARAF_SYSTEM_OPTS # First citizen Karaf options 05:38:30 # export KARAF_OPTS # Additional available Karaf options 05:38:30 # export KARAF_DEBUG # Enable debug mode 05:38:30 # export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start 05:38:30 # export KARAF_NOROOT # Prevent execution as root if set to true 05:38:30 Set Java version 05:38:30 + echo 'Set Java version' 05:38:30 + sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-17-openjdk/bin/java 1 05:38:30 + sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-17-openjdk/bin/java 05:38:30 JDK default version ... 05:38:30 + echo 'JDK default version ...' 05:38:30 + java -version 05:38:30 openjdk version "17.0.6-ea" 2023-01-17 LTS 05:38:30 OpenJDK Runtime Environment (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS) 05:38:30 OpenJDK 64-Bit Server VM (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS, mixed mode, sharing) 05:38:30 Set JAVA_HOME 05:38:30 + echo 'Set JAVA_HOME' 05:38:30 + export JAVA_HOME=/usr/lib/jvm/java-17-openjdk 05:38:30 + JAVA_HOME=/usr/lib/jvm/java-17-openjdk 05:38:30 ++ readlink -e /usr/lib/jvm/java-17-openjdk/bin/java 05:38:30 + JAVA_RESOLVED=/usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java 05:38:30 + echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java' 05:38:30 Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java 05:38:30 Listing all open ports on controller system... 05:38:30 + echo 'Listing all open ports on controller system...' 05:38:30 + netstat -pnatu 05:38:30 (Not all processes could be identified, non-owned process info 05:38:30 will not be shown, you would have to be root to see it all.) 05:38:30 Active Internet connections (servers and established) 05:38:30 Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name 05:38:30 tcp 0 0 0.0.0.0:111 0.0.0.0:* LISTEN - 05:38:30 tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN - 05:38:30 tcp 0 0 10.30.171.236:36400 199.204.45.87:443 TIME_WAIT - 05:38:30 tcp 0 164 10.30.171.236:22 10.30.170.160:40924 ESTABLISHED - 05:38:30 tcp6 0 0 :::111 :::* LISTEN - 05:38:30 tcp6 0 0 :::5555 :::* LISTEN - 05:38:30 tcp6 0 0 :::22 :::* LISTEN - 05:38:30 udp 0 0 10.30.171.236:68 10.30.170.3:67 ESTABLISHED - 05:38:30 udp 0 0 0.0.0.0:111 0.0.0.0:* - 05:38:30 udp 0 0 127.0.0.1:323 0.0.0.0:* - 05:38:30 udp6 0 0 :::111 :::* - 05:38:30 udp6 0 0 ::1:323 :::* - 05:38:30 Custom shard config exists!!! 05:38:30 Copying the shard config... 05:38:30 + '[' -f /tmp/custom_shard_config.txt ']' 05:38:30 + echo 'Custom shard config exists!!!' 05:38:30 + echo 'Copying the shard config...' 05:38:30 + cp /tmp/custom_shard_config.txt /tmp/karaf-0.19.3-SNAPSHOT/bin/ 05:38:30 Configuring cluster 05:38:30 + echo 'Configuring cluster' 05:38:30 + /tmp/karaf-0.19.3-SNAPSHOT/bin/configure_cluster.sh 2 10.30.171.124 10.30.171.236 10.30.170.187 05:38:30 ################################################ 05:38:30 ## Configure Cluster ## 05:38:30 ################################################ 05:38:30 NOTE: Cluster configuration files not found. Copying from 05:38:30 /tmp/karaf-0.19.3-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/8.0.5 05:38:30 Configuring unique name in akka.conf 05:38:30 Configuring hostname in akka.conf 05:38:30 Configuring data and rpc seed nodes in akka.conf 05:38:30 modules = [ 05:38:30 05:38:30 { 05:38:30 name = "inventory" 05:38:30 namespace = "urn:opendaylight:inventory" 05:38:30 shard-strategy = "module" 05:38:30 }, 05:38:30 { 05:38:30 name = "topology" 05:38:30 namespace = "urn:TBD:params:xml:ns:yang:network-topology" 05:38:30 shard-strategy = "module" 05:38:30 }, 05:38:30 { 05:38:30 name = "toaster" 05:38:30 namespace = "http://netconfcentral.org/ns/toaster" 05:38:30 shard-strategy = "module" 05:38:30 }, 05:38:30 { 05:38:30 name = "car" 05:38:30 namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" 05:38:30 shard-strategy = "module" 05:38:30 }, 05:38:30 { 05:38:30 name = "people" 05:38:30 namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" 05:38:30 shard-strategy = "module" 05:38:30 }, 05:38:30 { 05:38:30 name = "car-people" 05:38:30 namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" 05:38:30 shard-strategy = "module" 05:38:30 } 05:38:30 ] 05:38:30 Configuring replication type in module-shards.conf 05:38:30 ################################################ 05:38:30 ## NOTE: Manually restart controller to ## 05:38:30 ## apply configuration. ## 05:38:30 ################################################ 05:38:30 Dump akka.conf 05:38:30 + echo 'Dump akka.conf' 05:38:30 + cat /tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/akka.conf 05:38:30 05:38:30 odl-cluster-data { 05:38:30 akka { 05:38:30 remote { 05:38:30 artery { 05:38:30 enabled = on 05:38:30 transport = tcp 05:38:30 canonical.hostname = "10.30.171.236" 05:38:30 canonical.port = 2550 05:38:30 } 05:38:30 } 05:38:30 05:38:30 cluster { 05:38:30 # Using artery. 05:38:30 seed-nodes = ["akka://opendaylight-cluster-data@10.30.171.124:2550", 05:38:30 "akka://opendaylight-cluster-data@10.30.171.236:2550", 05:38:30 "akka://opendaylight-cluster-data@10.30.170.187:2550"] 05:38:30 05:38:30 roles = ["member-2"] 05:38:30 05:38:30 # when under load we might trip a false positive on the failure detector 05:38:30 # failure-detector { 05:38:30 # heartbeat-interval = 4 s 05:38:30 # acceptable-heartbeat-pause = 16s 05:38:30 # } 05:38:30 } 05:38:30 05:38:30 persistence { 05:38:30 # By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by 05:38:30 # modifying the following two properties. The directory location specified may be a relative or absolute path. 05:38:30 # The relative path is always relative to KARAF_HOME. 05:38:30 05:38:30 # snapshot-store.local.dir = "target/snapshots" 05:38:30 05:38:30 # Use lz4 compression for LocalSnapshotStore snapshots 05:38:30 snapshot-store.local.use-lz4-compression = false 05:38:30 # Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB 05:38:30 snapshot-store.local.lz4-blocksize = 256KB 05:38:30 } 05:38:30 disable-default-actor-system-quarantined-event-handling = "false" 05:38:30 } 05:38:30 } 05:38:30 Dump modules.conf 05:38:30 + echo 'Dump modules.conf' 05:38:30 + cat /tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/modules.conf 05:38:30 modules = [ 05:38:30 05:38:30 { 05:38:30 name = "inventory" 05:38:30 namespace = "urn:opendaylight:inventory" 05:38:30 shard-strategy = "module" 05:38:30 }, 05:38:30 { 05:38:30 name = "topology" 05:38:30 namespace = "urn:TBD:params:xml:ns:yang:network-topology" 05:38:30 shard-strategy = "module" 05:38:30 }, 05:38:30 { 05:38:30 name = "toaster" 05:38:30 namespace = "http://netconfcentral.org/ns/toaster" 05:38:30 shard-strategy = "module" 05:38:30 }, 05:38:30 { 05:38:30 name = "car" 05:38:30 namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" 05:38:30 shard-strategy = "module" 05:38:30 }, 05:38:30 { 05:38:30 name = "people" 05:38:30 namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" 05:38:30 shard-strategy = "module" 05:38:30 }, 05:38:30 { 05:38:30 name = "car-people" 05:38:30 namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" 05:38:30 shard-strategy = "module" 05:38:30 } 05:38:30 ] 05:38:30 Dump module-shards.conf 05:38:30 + echo 'Dump module-shards.conf' 05:38:30 + cat /tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/module-shards.conf 05:38:30 module-shards = [ 05:38:30 { 05:38:30 name = "default" 05:38:30 shards = [ 05:38:30 { 05:38:30 name = "default" 05:38:30 replicas = ["member-1", 05:38:30 "member-2", 05:38:30 "member-3"] 05:38:30 } 05:38:30 ] 05:38:30 }, 05:38:30 { 05:38:30 name = "inventory" 05:38:30 shards = [ 05:38:30 { 05:38:30 name="inventory" 05:38:30 replicas = ["member-1", 05:38:30 "member-2", 05:38:30 "member-3"] 05:38:30 } 05:38:30 ] 05:38:30 }, 05:38:30 { 05:38:30 name = "topology" 05:38:30 shards = [ 05:38:30 { 05:38:30 name="topology" 05:38:30 replicas = ["member-1", 05:38:30 "member-2", 05:38:30 "member-3"] 05:38:30 } 05:38:30 ] 05:38:30 }, 05:38:30 { 05:38:30 name = "toaster" 05:38:30 shards = [ 05:38:30 { 05:38:30 name="toaster" 05:38:30 replicas = ["member-1", 05:38:30 "member-2", 05:38:30 "member-3"] 05:38:30 } 05:38:30 ] 05:38:30 }, 05:38:30 { 05:38:30 name = "car" 05:38:30 shards = [ 05:38:30 { 05:38:30 name="car" 05:38:30 replicas = ["member-1", 05:38:30 "member-2", 05:38:30 "member-3"] 05:38:30 } 05:38:30 ] 05:38:30 }, 05:38:30 { 05:38:30 name = "people" 05:38:30 shards = [ 05:38:30 { 05:38:30 name="people" 05:38:30 replicas = ["member-1", 05:38:30 "member-2", 05:38:30 "member-3"] 05:38:30 } 05:38:30 ] 05:38:30 }, 05:38:30 { 05:38:30 name = "car-people" 05:38:30 shards = [ 05:38:30 { 05:38:30 name="car-people" 05:38:30 replicas = ["member-1", 05:38:30 "member-2", 05:38:30 "member-3"] 05:38:30 } 05:38:30 ] 05:38:30 } 05:38:30 ] 05:38:30 Configuring member-3 with IP address 10.30.170.187 05:38:30 Warning: Permanently added '10.30.170.187' (ECDSA) to the list of known hosts. 05:38:31 Warning: Permanently added '10.30.170.187' (ECDSA) to the list of known hosts. 05:38:31 + source /tmp/common-functions.sh karaf-0.19.3-SNAPSHOT 05:38:31 ++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]] 05:38:31 common-functions.sh is being sourced 05:38:31 ++ echo 'common-functions.sh is being sourced' 05:38:31 ++ BUNDLEFOLDER=karaf-0.19.3-SNAPSHOT 05:38:31 ++ export MAVENCONF=/tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg 05:38:31 ++ MAVENCONF=/tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg 05:38:31 ++ export FEATURESCONF=/tmp/karaf-0.19.3-SNAPSHOT/etc/org.apache.karaf.features.cfg 05:38:31 ++ FEATURESCONF=/tmp/karaf-0.19.3-SNAPSHOT/etc/org.apache.karaf.features.cfg 05:38:31 ++ export CUSTOMPROP=/tmp/karaf-0.19.3-SNAPSHOT/etc/custom.properties 05:38:31 ++ CUSTOMPROP=/tmp/karaf-0.19.3-SNAPSHOT/etc/custom.properties 05:38:31 ++ export LOGCONF=/tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg 05:38:31 ++ LOGCONF=/tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg 05:38:31 ++ export MEMCONF=/tmp/karaf-0.19.3-SNAPSHOT/bin/setenv 05:38:31 ++ MEMCONF=/tmp/karaf-0.19.3-SNAPSHOT/bin/setenv 05:38:31 ++ export CONTROLLERMEM= 05:38:31 ++ CONTROLLERMEM= 05:38:31 ++ export AKKACONF=/tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/akka.conf 05:38:31 ++ AKKACONF=/tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/akka.conf 05:38:31 ++ export MODULESCONF=/tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/modules.conf 05:38:31 ++ MODULESCONF=/tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/modules.conf 05:38:31 ++ export MODULESHARDSCONF=/tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/module-shards.conf 05:38:31 ++ MODULESHARDSCONF=/tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/module-shards.conf 05:38:31 ++ print_common_env 05:38:31 ++ cat 05:38:31 common-functions environment: 05:38:31 MAVENCONF: /tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg 05:38:31 ACTUALFEATURES: 05:38:31 FEATURESCONF: /tmp/karaf-0.19.3-SNAPSHOT/etc/org.apache.karaf.features.cfg 05:38:31 CUSTOMPROP: /tmp/karaf-0.19.3-SNAPSHOT/etc/custom.properties 05:38:31 LOGCONF: /tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg 05:38:31 MEMCONF: /tmp/karaf-0.19.3-SNAPSHOT/bin/setenv 05:38:31 CONTROLLERMEM: 05:38:31 AKKACONF: /tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/akka.conf 05:38:31 MODULESCONF: /tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/modules.conf 05:38:31 MODULESHARDSCONF: /tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/module-shards.conf 05:38:31 SUITES: 05:38:31 05:38:31 ++ SSH='ssh -t -t' 05:38:31 ++ extra_services_cntl=' dnsmasq.service httpd.service libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service rabbitmq-server.service ' 05:38:31 ++ extra_services_cmp=' libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service ' 05:38:31 Changing to /tmp 05:38:31 + echo 'Changing to /tmp' 05:38:31 + cd /tmp 05:38:31 Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.19.3-SNAPSHOT/karaf-0.19.3-20240406.185403-93.zip 05:38:31 + echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.19.3-SNAPSHOT/karaf-0.19.3-20240406.185403-93.zip' 05:38:31 + wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.19.3-SNAPSHOT/karaf-0.19.3-20240406.185403-93.zip 05:38:31 --2024-04-07 05:38:31-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.19.3-SNAPSHOT/karaf-0.19.3-20240406.185403-93.zip 05:38:31 Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6 05:38:31 Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected. 05:38:31 HTTP request sent, awaiting response... 200 OK 05:38:31 Length: 234135853 (223M) [application/zip] 05:38:31 Saving to: ‘karaf-0.19.3-20240406.185403-93.zip’ 05:38:31 05:38:31 0K ........ ........ ........ ........ ........ ........ 1% 97.5M 2s 05:38:31 3072K ........ ........ ........ ........ ........ ........ 2% 81.0M 2s 05:38:31 6144K ........ ........ ........ ........ ........ ........ 4% 62.5M 3s 05:38:31 9216K ........ ........ ........ ........ ........ ........ 5% 114M 3s 05:38:31 12288K ........ ........ ........ ........ ........ ........ 6% 102M 2s 05:38:31 15360K ........ ........ ........ ........ ........ ........ 8% 123M 2s 05:38:31 18432K ........ ........ ........ ........ ........ ........ 9% 157M 2s 05:38:31 21504K ........ ........ ........ ........ ........ ........ 10% 95.6M 2s 05:38:31 24576K ........ ........ ........ ........ ........ ........ 12% 149M 2s 05:38:31 27648K ........ ........ ........ ........ ........ ........ 13% 178M 2s 05:38:31 30720K ........ ........ ........ ........ ........ ........ 14% 102M 2s 05:38:31 33792K ........ ........ ........ ........ ........ ........ 16% 75.3M 2s 05:38:31 36864K ........ ........ ........ ........ ........ ........ 17% 91.3M 2s 05:38:31 39936K ........ ........ ........ ........ ........ ........ 18% 89.0M 2s 05:38:31 43008K ........ ........ ........ ........ ........ ........ 20% 92.3M 2s 05:38:31 46080K ........ ........ ........ ........ ........ ........ 21% 93.9M 2s 05:38:31 49152K ........ ........ ........ ........ ........ ........ 22% 127M 2s 05:38:31 52224K ........ ........ ........ ........ ........ ........ 24% 94.3M 2s 05:38:31 55296K ........ ........ ........ ........ ........ ........ 25% 92.6M 2s 05:38:31 58368K ........ ........ ........ ........ ........ ........ 26% 74.1M 2s 05:38:31 61440K ........ ........ ........ ........ ........ ........ 28% 85.4M 2s 05:38:32 64512K ........ ........ ........ ........ ........ ........ 29% 86.8M 2s 05:38:32 67584K ........ ........ ........ ........ ........ ........ 30% 84.2M 2s 05:38:32 70656K ........ ........ ........ ........ ........ ........ 32% 97.4M 2s 05:38:32 73728K ........ ........ ........ ........ ........ ........ 33% 121M 2s 05:38:32 76800K ........ ........ ........ ........ ........ ........ 34% 244M 1s 05:38:32 79872K ........ ........ ........ ........ ........ ........ 36% 237M 1s 05:38:32 82944K ........ ........ ........ ........ ........ ........ 37% 233M 1s 05:38:32 86016K ........ ........ ........ ........ ........ ........ 38% 243M 1s 05:38:32 89088K ........ ........ ........ ........ ........ ........ 40% 234M 1s 05:38:32 92160K ........ ........ ........ ........ ........ ........ 41% 256M 1s 05:38:32 95232K ........ ........ ........ ........ ........ ........ 42% 235M 1s 05:38:32 98304K ........ ........ ........ ........ ........ ........ 44% 256M 1s 05:38:32 101376K ........ ........ ........ ........ ........ ........ 45% 263M 1s 05:38:32 104448K ........ ........ ........ ........ ........ ........ 47% 257M 1s 05:38:32 107520K ........ ........ ........ ........ ........ ........ 48% 268M 1s 05:38:32 110592K ........ ........ ........ ........ ........ ........ 49% 291M 1s 05:38:32 113664K ........ ........ ........ ........ ........ ........ 51% 277M 1s 05:38:32 116736K ........ ........ ........ ........ ........ ........ 52% 268M 1s 05:38:32 119808K ........ ........ ........ ........ ........ ........ 53% 244M 1s 05:38:32 122880K ........ ........ ........ ........ ........ ........ 55% 218M 1s 05:38:32 125952K ........ ........ ........ ........ ........ ........ 56% 291M 1s 05:38:32 129024K ........ ........ ........ ........ ........ ........ 57% 259M 1s 05:38:32 132096K ........ ........ ........ ........ ........ ........ 59% 225M 1s 05:38:32 135168K ........ ........ ........ ........ ........ ........ 60% 380M 1s 05:38:32 138240K ........ ........ ........ ........ ........ ........ 61% 292M 1s 05:38:32 141312K ........ ........ ........ ........ ........ ........ 63% 374M 1s 05:38:32 144384K ........ ........ ........ ........ ........ ........ 64% 248M 1s 05:38:32 147456K ........ ........ ........ ........ ........ ........ 65% 267M 1s 05:38:32 150528K ........ ........ ........ ........ ........ ........ 67% 392M 1s 05:38:32 153600K ........ ........ ........ ........ ........ ........ 68% 311M 0s 05:38:32 156672K ........ ........ ........ ........ ........ ........ 69% 332M 0s 05:38:32 159744K ........ ........ ........ ........ ........ ........ 71% 310M 0s 05:38:32 162816K ........ ........ ........ ........ ........ ........ 72% 289M 0s 05:38:32 165888K ........ ........ ........ ........ ........ ........ 73% 326M 0s 05:38:32 168960K ........ ........ ........ ........ ........ ........ 75% 330M 0s 05:38:32 172032K ........ ........ ........ ........ ........ ........ 76% 332M 0s 05:38:32 175104K ........ ........ ........ ........ ........ ........ 77% 287M 0s 05:38:32 178176K ........ ........ ........ ........ ........ ........ 79% 321M 0s 05:38:32 181248K ........ ........ ........ ........ ........ ........ 80% 351M 0s 05:38:32 184320K ........ ........ ........ ........ ........ ........ 81% 335M 0s 05:38:32 187392K ........ ........ ........ ........ ........ ........ 83% 358M 0s 05:38:32 190464K ........ ........ ........ ........ ........ ........ 84% 311M 0s 05:38:32 193536K ........ ........ ........ ........ ........ ........ 85% 340M 0s 05:38:32 196608K ........ ........ ........ ........ ........ ........ 87% 300M 0s 05:38:32 199680K ........ ........ ........ ........ ........ ........ 88% 307M 0s 05:38:32 202752K ........ ........ ........ ........ ........ ........ 90% 316M 0s 05:38:32 205824K ........ ........ ........ ........ ........ ........ 91% 344M 0s 05:38:32 208896K ........ ........ ........ ........ ........ ........ 92% 324M 0s 05:38:32 211968K ........ ........ ........ ........ ........ ........ 94% 339M 0s 05:38:32 215040K ........ ........ ........ ........ ........ ........ 95% 237M 0s 05:38:32 218112K ........ ........ ........ ........ ........ ........ 96% 272M 0s 05:38:32 221184K ........ ........ ........ ........ ........ ........ 98% 317M 0s 05:38:32 224256K ........ ........ ........ ........ ........ ........ 99% 339M 0s 05:38:32 227328K ........ ........ .... 100% 317M=1.3s 05:38:32 05:38:32 2024-04-07 05:38:32 (173 MB/s) - ‘karaf-0.19.3-20240406.185403-93.zip’ saved [234135853/234135853] 05:38:32 05:38:32 Extracting the new controller... 05:38:32 + echo 'Extracting the new controller...' 05:38:32 + unzip -q karaf-0.19.3-20240406.185403-93.zip 05:38:34 Adding external repositories... 05:38:34 + echo 'Adding external repositories...' 05:38:34 + sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg 05:38:34 + cat /tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg 05:38:34 ################################################################################ 05:38:34 # 05:38:34 # Licensed to the Apache Software Foundation (ASF) under one or more 05:38:34 # contributor license agreements. See the NOTICE file distributed with 05:38:34 # this work for additional information regarding copyright ownership. 05:38:34 # The ASF licenses this file to You under the Apache License, Version 2.0 05:38:34 # (the "License"); you may not use this file except in compliance with 05:38:34 # the License. You may obtain a copy of the License at 05:38:34 # 05:38:34 # http://www.apache.org/licenses/LICENSE-2.0 05:38:34 # 05:38:34 # Unless required by applicable law or agreed to in writing, software 05:38:34 # distributed under the License is distributed on an "AS IS" BASIS, 05:38:34 # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. 05:38:34 # See the License for the specific language governing permissions and 05:38:34 # limitations under the License. 05:38:34 # 05:38:34 ################################################################################ 05:38:34 05:38:34 # 05:38:34 # If set to true, the following property will not allow any certificate to be used 05:38:34 # when accessing Maven repositories through SSL 05:38:34 # 05:38:34 #org.ops4j.pax.url.mvn.certificateCheck= 05:38:34 05:38:34 # 05:38:34 # Path to the local Maven settings file. 05:38:34 # The repositories defined in this file will be automatically added to the list 05:38:34 # of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property 05:38:34 # below is not set. 05:38:34 # The following locations are checked for the existence of the settings.xml file 05:38:34 # * 1. looks for the specified url 05:38:34 # * 2. if not found looks for ${user.home}/.m2/settings.xml 05:38:34 # * 3. if not found looks for ${maven.home}/conf/settings.xml 05:38:34 # * 4. if not found looks for ${M2_HOME}/conf/settings.xml 05:38:34 # 05:38:34 #org.ops4j.pax.url.mvn.settings= 05:38:34 05:38:34 # 05:38:34 # Path to the local Maven repository which is used to avoid downloading 05:38:34 # artifacts when they already exist locally. 05:38:34 # The value of this property will be extracted from the settings.xml file 05:38:34 # above, or defaulted to: 05:38:34 # System.getProperty( "user.home" ) + "/.m2/repository" 05:38:34 # 05:38:34 org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository} 05:38:34 05:38:34 # 05:38:34 # Default this to false. It's just weird to use undocumented repos 05:38:34 # 05:38:34 org.ops4j.pax.url.mvn.useFallbackRepositories=false 05:38:34 05:38:34 # 05:38:34 # Uncomment if you don't wanna use the proxy settings 05:38:34 # from the Maven conf/settings.xml file 05:38:34 # 05:38:34 # org.ops4j.pax.url.mvn.proxySupport=false 05:38:34 05:38:34 # 05:38:34 # Comma separated list of repositories scanned when resolving an artifact. 05:38:34 # Those repositories will be checked before iterating through the 05:38:34 # below list of repositories and even before the local repository 05:38:34 # A repository url can be appended with zero or more of the following flags: 05:38:34 # @snapshots : the repository contains snaphots 05:38:34 # @noreleases : the repository does not contain any released artifacts 05:38:34 # 05:38:34 # The following property value will add the system folder as a repo. 05:38:34 # 05:38:34 org.ops4j.pax.url.mvn.defaultRepositories=\ 05:38:34 file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\ 05:38:34 file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\ 05:38:34 file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots 05:38:34 05:38:34 # Use the default local repo (e.g.~/.m2/repository) as a "remote" repo 05:38:34 #org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false 05:38:34 05:38:34 # 05:38:34 # Comma separated list of repositories scanned when resolving an artifact. 05:38:34 # The default list includes the following repositories: 05:38:34 # http://repo1.maven.org/maven2@id=central 05:38:34 # http://repository.springsource.com/maven/bundles/release@id=spring.ebr 05:38:34 # http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external 05:38:34 # http://zodiac.springsource.com/maven/bundles/release@id=gemini 05:38:34 # http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases 05:38:34 # https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases 05:38:34 # https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases 05:38:34 # To add repositories to the default ones, prepend '+' to the list of repositories 05:38:34 # to add. 05:38:34 # A repository url can be appended with zero or more of the following flags: 05:38:34 # @snapshots : the repository contains snapshots 05:38:34 # @noreleases : the repository does not contain any released artifacts 05:38:34 # @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended 05:38:34 # 05:38:34 org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases 05:38:34 05:38:34 ### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.Configuring the startup features... 05:38:34 + [[ True == \T\r\u\e ]] 05:38:34 + echo 'Configuring the startup features...' 05:38:34 + sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.19.3-SNAPSHOT/etc/org.apache.karaf.features.cfg 05:38:34 + FEATURE_TEST_STRING=features-test 05:38:34 + FEATURE_TEST_VERSION=0.19.3-SNAPSHOT 05:38:34 + KARAF_VERSION=karaf4 05:38:34 + [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]] 05:38:34 + sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.19.3-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.19.3-SNAPSHOT/etc/org.apache.karaf.features.cfg 05:38:34 + [[ ! -z '' ]] 05:38:34 + cat /tmp/karaf-0.19.3-SNAPSHOT/etc/org.apache.karaf.features.cfg 05:38:34 ################################################################################ 05:38:34 # 05:38:34 # Licensed to the Apache Software Foundation (ASF) under one or more 05:38:34 # contributor license agreements. See the NOTICE file distributed with 05:38:34 # this work for additional information regarding copyright ownership. 05:38:34 # The ASF licenses this file to You under the Apache License, Version 2.0 05:38:34 # (the "License"); you may not use this file except in compliance with 05:38:34 # the License. You may obtain a copy of the License at 05:38:34 # 05:38:34 # http://www.apache.org/licenses/LICENSE-2.0 05:38:34 # 05:38:34 # Unless required by applicable law or agreed to in writing, software 05:38:34 # distributed under the License is distributed on an "AS IS" BASIS, 05:38:34 # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. 05:38:34 # See the License for the specific language governing permissions and 05:38:34 # limitations under the License. 05:38:34 # 05:38:34 ################################################################################ 05:38:34 05:38:34 # 05:38:34 # Comma separated list of features repositories to register by default 05:38:34 # 05:38:34 featuresRepositories = mvn:org.opendaylight.integration/features-test/0.19.3-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/feb5a77f-e23f-49fb-8948-bd9f7aeae636.xml 05:38:34 05:38:34 # 05:38:34 # Comma separated list of features to install at startup 05:38:34 # 05:38:34 featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, 7a78e861-931c-47ca-a06c-fb7663e98e08 05:38:34 05:38:34 # 05:38:34 # Resource repositories (OBR) that the features resolver can use 05:38:34 # to resolve requirements/capabilities 05:38:34 # 05:38:34 # The format of the resourceRepositories is 05:38:34 # resourceRepositories=[xml:url|json:url],... 05:38:34 # for Instance: 05:38:34 # 05:38:34 #resourceRepositories=xml:http://host/path/to/index.xml 05:38:34 # or 05:38:34 #resourceRepositories=json:http://host/path/to/index.json 05:38:34 # 05:38:34 05:38:34 # 05:38:34 # Defines if the boot features are started in asynchronous mode (in a dedicated thread) 05:38:34 # 05:38:34 featuresBootAsynchronous=false 05:38:34 05:38:34 # 05:38:34 # Service requirements enforcement 05:38:34 # 05:38:34 # By default, the feature resolver checks the service requirements/capabilities of 05:38:34 # bundles for new features (xml schema >= 1.3.0) in order to automatically installs 05:38:34 # the required bundles. 05:38:34 # The following flag can have those values: 05:38:34 # - disable: service requirements are completely ignored 05:38:34 # - default: service requirements are ignored for old features 05:38:34 # - enforce: service requirements are always verified 05:38:34 # 05:38:34 #serviceRequirements=default 05:38:34 05:38:34 # 05:38:34 # Store cfg file for config element in feature 05:38:34 # 05:38:34 #configCfgStore=true 05:38:34 05:38:34 # 05:38:34 # Define if the feature service automatically refresh bundles 05:38:34 # 05:38:34 autoRefresh=true 05:38:34 05:38:34 # 05:38:34 # Configuration of features processing mechanism (overrides, blacklisting, modification of features) 05:38:34 # XML file defines instructions related to features processing 05:38:34 # versions.properties may declare properties to resolve placeholders in XML file 05:38:34 # both files are relative to ${karaf.etc} 05:38:34 # 05:38:34 #featureProcessing=org.apache.karaf.features.xml 05:38:34 #featureProcessingVersions=versions.properties 05:38:34 + configure_karaf_log karaf4 '' 05:38:34 + local -r karaf_version=karaf4 05:38:34 + local -r controllerdebugmap= 05:38:34 + local logapi=log4j 05:38:34 + grep log4j2 /tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg 05:38:34 log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n 05:38:34 log4j2.rootLogger.level = INFO 05:38:34 #log4j2.rootLogger.type = asyncRoot 05:38:34 #log4j2.rootLogger.includeLocation = false 05:38:34 log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile 05:38:34 log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi 05:38:34 log4j2.rootLogger.appenderRef.Console.ref = Console 05:38:34 log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter 05:38:34 log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} 05:38:34 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter 05:38:34 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair 05:38:34 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker 05:38:34 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL 05:38:34 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or 05:38:34 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY 05:38:34 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL 05:38:34 log4j2.logger.spifly.name = org.apache.aries.spifly 05:38:34 log4j2.logger.spifly.level = WARN 05:38:34 log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit 05:38:34 log4j2.logger.audit.level = INFO 05:38:34 log4j2.logger.audit.additivity = false 05:38:34 log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile 05:38:34 # Console appender not used by default (see log4j2.rootLogger.appenderRefs) 05:38:34 log4j2.appender.console.type = Console 05:38:34 log4j2.appender.console.name = Console 05:38:34 log4j2.appender.console.layout.type = PatternLayout 05:38:34 log4j2.appender.console.layout.pattern = ${log4j2.pattern} 05:38:34 log4j2.appender.rolling.type = RollingRandomAccessFile 05:38:34 log4j2.appender.rolling.name = RollingFile 05:38:34 log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log 05:38:34 log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i 05:38:34 #log4j2.appender.rolling.immediateFlush = false 05:38:34 log4j2.appender.rolling.append = true 05:38:34 log4j2.appender.rolling.layout.type = PatternLayout 05:38:34 log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} 05:38:34 log4j2.appender.rolling.policies.type = Policies 05:38:34 log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy 05:38:34 log4j2.appender.rolling.policies.size.size = 64MB 05:38:34 log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy 05:38:34 log4j2.appender.rolling.strategy.max = 7 05:38:34 log4j2.appender.audit.type = RollingRandomAccessFile 05:38:34 log4j2.appender.audit.name = AuditRollingFile 05:38:34 log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log 05:38:34 log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i 05:38:34 log4j2.appender.audit.append = true 05:38:34 log4j2.appender.audit.layout.type = PatternLayout 05:38:34 log4j2.appender.audit.layout.pattern = ${log4j2.pattern} 05:38:34 log4j2.appender.audit.policies.type = Policies 05:38:34 log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy 05:38:34 log4j2.appender.audit.policies.size.size = 8MB 05:38:34 log4j2.appender.audit.strategy.type = DefaultRolloverStrategy 05:38:34 log4j2.appender.audit.strategy.max = 7 05:38:34 log4j2.appender.osgi.type = PaxOsgi 05:38:34 log4j2.appender.osgi.name = PaxOsgi 05:38:34 log4j2.appender.osgi.filter = * 05:38:34 #log4j2.logger.aether.name = shaded.org.eclipse.aether 05:38:34 #log4j2.logger.aether.level = TRACE 05:38:34 #log4j2.logger.http-headers.name = shaded.org.apache.http.headers 05:38:34 #log4j2.logger.http-headers.level = DEBUG 05:38:34 #log4j2.logger.maven.name = org.ops4j.pax.url.mvn 05:38:34 #log4j2.logger.maven.level = TRACE 05:38:34 + logapi=log4j2 05:38:34 Configuring the karaf log... karaf_version: karaf4, logapi: log4j2 05:38:34 + echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2' 05:38:34 + '[' log4j2 == log4j2 ']' 05:38:34 + sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg 05:38:34 + orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver 05:38:34 + orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver 05:38:34 + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN' 05:38:34 controllerdebugmap: 05:38:34 + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN' 05:38:34 + unset IFS 05:38:34 + echo 'controllerdebugmap: ' 05:38:34 cat /tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg 05:38:34 + '[' -n '' ']' 05:38:34 + echo 'cat /tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg' 05:38:34 + cat /tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg 05:38:34 ################################################################################ 05:38:34 # 05:38:34 # Licensed to the Apache Software Foundation (ASF) under one or more 05:38:34 # contributor license agreements. See the NOTICE file distributed with 05:38:34 # this work for additional information regarding copyright ownership. 05:38:34 # The ASF licenses this file to You under the Apache License, Version 2.0 05:38:34 # (the "License"); you may not use this file except in compliance with 05:38:34 # the License. You may obtain a copy of the License at 05:38:34 # 05:38:34 # http://www.apache.org/licenses/LICENSE-2.0 05:38:34 # 05:38:34 # Unless required by applicable law or agreed to in writing, software 05:38:34 # distributed under the License is distributed on an "AS IS" BASIS, 05:38:34 # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. 05:38:34 # See the License for the specific language governing permissions and 05:38:34 # limitations under the License. 05:38:34 # 05:38:34 ################################################################################ 05:38:34 05:38:34 # Common pattern layout for appenders 05:38:34 log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n 05:38:34 05:38:34 # Root logger 05:38:34 log4j2.rootLogger.level = INFO 05:38:34 # uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library 05:38:34 #log4j2.rootLogger.type = asyncRoot 05:38:34 #log4j2.rootLogger.includeLocation = false 05:38:34 log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile 05:38:34 log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi 05:38:34 log4j2.rootLogger.appenderRef.Console.ref = Console 05:38:34 log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter 05:38:34 log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} 05:38:34 05:38:34 # Filters for logs marked by org.opendaylight.odlparent.Markers 05:38:34 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter 05:38:34 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair 05:38:34 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker 05:38:34 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL 05:38:34 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or 05:38:34 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY 05:38:34 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL 05:38:34 05:38:34 # Loggers configuration 05:38:34 05:38:34 # Spifly logger 05:38:34 log4j2.logger.spifly.name = org.apache.aries.spifly 05:38:34 log4j2.logger.spifly.level = WARN 05:38:34 05:38:34 # Security audit logger 05:38:34 log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit 05:38:34 log4j2.logger.audit.level = INFO 05:38:34 log4j2.logger.audit.additivity = false 05:38:34 log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile 05:38:34 05:38:34 # Appenders configuration 05:38:34 05:38:34 # Console appender not used by default (see log4j2.rootLogger.appenderRefs) 05:38:34 log4j2.appender.console.type = Console 05:38:34 log4j2.appender.console.name = Console 05:38:34 log4j2.appender.console.layout.type = PatternLayout 05:38:34 log4j2.appender.console.layout.pattern = ${log4j2.pattern} 05:38:34 05:38:34 # Rolling file appender 05:38:34 log4j2.appender.rolling.type = RollingRandomAccessFile 05:38:34 log4j2.appender.rolling.name = RollingFile 05:38:34 log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log 05:38:34 log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i 05:38:34 # uncomment to not force a disk flush 05:38:34 #log4j2.appender.rolling.immediateFlush = false 05:38:34 log4j2.appender.rolling.append = true 05:38:34 log4j2.appender.rolling.layout.type = PatternLayout 05:38:34 log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} 05:38:34 log4j2.appender.rolling.policies.type = Policies 05:38:34 log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy 05:38:34 log4j2.appender.rolling.policies.size.size = 1GB 05:38:34 log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy 05:38:34 log4j2.appender.rolling.strategy.max = 7 05:38:34 05:38:34 # Audit file appender 05:38:34 log4j2.appender.audit.type = RollingRandomAccessFile 05:38:34 log4j2.appender.audit.name = AuditRollingFile 05:38:34 log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log 05:38:34 log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i 05:38:34 log4j2.appender.audit.append = true 05:38:34 log4j2.appender.audit.layout.type = PatternLayout 05:38:34 log4j2.appender.audit.layout.pattern = ${log4j2.pattern} 05:38:34 log4j2.appender.audit.policies.type = Policies 05:38:34 log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy 05:38:34 log4j2.appender.audit.policies.size.size = 8MB 05:38:34 log4j2.appender.audit.strategy.type = DefaultRolloverStrategy 05:38:34 log4j2.appender.audit.strategy.max = 7 05:38:34 05:38:34 # OSGi appender 05:38:34 log4j2.appender.osgi.type = PaxOsgi 05:38:34 log4j2.appender.osgi.name = PaxOsgi 05:38:34 log4j2.appender.osgi.filter = * 05:38:34 05:38:34 # help with identification of maven-related problems with pax-url-aether 05:38:34 #log4j2.logger.aether.name = shaded.org.eclipse.aether 05:38:34 #log4j2.logger.aether.level = TRACE 05:38:34 #log4j2.logger.http-headers.name = shaded.org.apache.http.headers 05:38:34 #log4j2.logger.http-headers.level = DEBUG 05:38:34 #log4j2.logger.maven.name = org.ops4j.pax.url.mvn 05:38:34 #log4j2.logger.maven.level = TRACE 05:38:34 log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN 05:38:34 log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN 05:38:34 + set_java_vars /usr/lib/jvm/java-17-openjdk 3072m /tmp/karaf-0.19.3-SNAPSHOT/bin/setenv 05:38:34 + local -r java_home=/usr/lib/jvm/java-17-openjdk 05:38:34 + local -r controllermem=3072m 05:38:34 + local -r memconf=/tmp/karaf-0.19.3-SNAPSHOT/bin/setenv 05:38:34 Configure 05:38:34 java home: /usr/lib/jvm/java-17-openjdk 05:38:34 max memory: 3072m 05:38:34 memconf: /tmp/karaf-0.19.3-SNAPSHOT/bin/setenv 05:38:34 + echo Configure 05:38:34 + echo ' java home: /usr/lib/jvm/java-17-openjdk' 05:38:34 + echo ' max memory: 3072m' 05:38:34 + echo ' memconf: /tmp/karaf-0.19.3-SNAPSHOT/bin/setenv' 05:38:34 + sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk}%g' /tmp/karaf-0.19.3-SNAPSHOT/bin/setenv 05:38:34 + sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.19.3-SNAPSHOT/bin/setenv 05:38:34 cat /tmp/karaf-0.19.3-SNAPSHOT/bin/setenv 05:38:34 + echo 'cat /tmp/karaf-0.19.3-SNAPSHOT/bin/setenv' 05:38:34 + cat /tmp/karaf-0.19.3-SNAPSHOT/bin/setenv 05:38:34 #!/bin/sh 05:38:34 # 05:38:34 # Licensed to the Apache Software Foundation (ASF) under one or more 05:38:34 # contributor license agreements. See the NOTICE file distributed with 05:38:34 # this work for additional information regarding copyright ownership. 05:38:34 # The ASF licenses this file to You under the Apache License, Version 2.0 05:38:34 # (the "License"); you may not use this file except in compliance with 05:38:34 # the License. You may obtain a copy of the License at 05:38:34 # 05:38:34 # http://www.apache.org/licenses/LICENSE-2.0 05:38:34 # 05:38:34 # Unless required by applicable law or agreed to in writing, software 05:38:34 # distributed under the License is distributed on an "AS IS" BASIS, 05:38:34 # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. 05:38:34 # See the License for the specific language governing permissions and 05:38:34 # limitations under the License. 05:38:34 # 05:38:34 05:38:34 # 05:38:34 # handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf 05:38:34 # script: client, instance, shell, start, status, stop, karaf 05:38:34 # 05:38:34 # if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then 05:38:34 # Actions go here... 05:38:34 # fi 05:38:34 05:38:34 # 05:38:34 # general settings which should be applied for all scripts go here; please keep 05:38:34 # in mind that it is possible that scripts might be executed more than once, e.g. 05:38:34 # in example of the start script where the start script is executed first and the 05:38:34 # karaf script afterwards. 05:38:34 # 05:38:34 05:38:34 # 05:38:34 # The following section shows the possible configuration options for the default 05:38:34 # karaf scripts 05:38:34 # 05:38:34 export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk} # Location of Java installation 05:38:34 # export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration 05:38:34 # export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options 05:38:34 # export EXTRA_JAVA_OPTS # Additional JVM options 05:38:34 # export KARAF_HOME # Karaf home folder 05:38:34 # export KARAF_DATA # Karaf data folder 05:38:34 # export KARAF_BASE # Karaf base folder 05:38:34 # export KARAF_ETC # Karaf etc folder 05:38:34 # export KARAF_LOG # Karaf log folder 05:38:34 # export KARAF_SYSTEM_OPTS # First citizen Karaf options 05:38:34 # export KARAF_OPTS # Additional available Karaf options 05:38:34 # export KARAF_DEBUG # Enable debug mode 05:38:34 # export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start 05:38:34 # export KARAF_NOROOT # Prevent execution as root if set to true 05:38:34 Set Java version 05:38:34 + echo 'Set Java version' 05:38:34 + sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-17-openjdk/bin/java 1 05:38:34 + sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-17-openjdk/bin/java 05:38:34 JDK default version ... 05:38:34 + echo 'JDK default version ...' 05:38:34 + java -version 05:38:35 openjdk version "17.0.6-ea" 2023-01-17 LTS 05:38:35 OpenJDK Runtime Environment (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS) 05:38:35 OpenJDK 64-Bit Server VM (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS, mixed mode, sharing) 05:38:35 Set JAVA_HOME 05:38:35 + echo 'Set JAVA_HOME' 05:38:35 + export JAVA_HOME=/usr/lib/jvm/java-17-openjdk 05:38:35 + JAVA_HOME=/usr/lib/jvm/java-17-openjdk 05:38:35 ++ readlink -e /usr/lib/jvm/java-17-openjdk/bin/java 05:38:35 Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java 05:38:35 Listing all open ports on controller system... 05:38:35 + JAVA_RESOLVED=/usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java 05:38:35 + echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java' 05:38:35 + echo 'Listing all open ports on controller system...' 05:38:35 + netstat -pnatu 05:38:35 (Not all processes could be identified, non-owned process info 05:38:35 will not be shown, you would have to be root to see it all.) 05:38:35 Active Internet connections (servers and established) 05:38:35 Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name 05:38:35 tcp 0 0 0.0.0.0:111 0.0.0.0:* LISTEN - 05:38:35 tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN - 05:38:35 tcp 0 0 10.30.170.187:38894 199.204.45.87:443 TIME_WAIT - 05:38:35 tcp 0 164 10.30.170.187:22 10.30.170.160:59672 ESTABLISHED - 05:38:35 tcp6 0 0 :::111 :::* LISTEN - 05:38:35 tcp6 0 0 :::5555 :::* LISTEN - 05:38:35 tcp6 0 0 :::22 :::* LISTEN - 05:38:35 udp 0 0 10.30.170.187:68 10.30.170.3:67 ESTABLISHED - 05:38:35 udp 0 0 0.0.0.0:111 0.0.0.0:* - 05:38:35 udp 0 0 127.0.0.1:323 0.0.0.0:* - 05:38:35 udp6 0 0 :::111 :::* - 05:38:35 udp6 0 0 ::1:323 :::* - 05:38:35 Custom shard config exists!!! 05:38:35 + '[' -f /tmp/custom_shard_config.txt ']' 05:38:35 + echo 'Custom shard config exists!!!' 05:38:35 + echo 'Copying the shard config...' 05:38:35 Copying the shard config... 05:38:35 + cp /tmp/custom_shard_config.txt /tmp/karaf-0.19.3-SNAPSHOT/bin/ 05:38:35 Configuring cluster 05:38:35 + echo 'Configuring cluster' 05:38:35 + /tmp/karaf-0.19.3-SNAPSHOT/bin/configure_cluster.sh 3 10.30.171.124 10.30.171.236 10.30.170.187 05:38:35 ################################################ 05:38:35 ## Configure Cluster ## 05:38:35 ################################################ 05:38:35 NOTE: Cluster configuration files not found. Copying from 05:38:35 /tmp/karaf-0.19.3-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/8.0.5 05:38:35 Configuring unique name in akka.conf 05:38:35 Configuring hostname in akka.conf 05:38:35 Configuring data and rpc seed nodes in akka.conf 05:38:35 modules = [ 05:38:35 05:38:35 { 05:38:35 name = "inventory" 05:38:35 namespace = "urn:opendaylight:inventory" 05:38:35 shard-strategy = "module" 05:38:35 }, 05:38:35 { 05:38:35 name = "topology" 05:38:35 namespace = "urn:TBD:params:xml:ns:yang:network-topology" 05:38:35 shard-strategy = "module" 05:38:35 }, 05:38:35 { 05:38:35 name = "toaster" 05:38:35 namespace = "http://netconfcentral.org/ns/toaster" 05:38:35 shard-strategy = "module" 05:38:35 }, 05:38:35 { 05:38:35 name = "car" 05:38:35 namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" 05:38:35 shard-strategy = "module" 05:38:35 }, 05:38:35 { 05:38:35 name = "people" 05:38:35 namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" 05:38:35 shard-strategy = "module" 05:38:35 }, 05:38:35 { 05:38:35 name = "car-people" 05:38:35 namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" 05:38:35 shard-strategy = "module" 05:38:35 } 05:38:35 ] 05:38:35 Configuring replication type in module-shards.conf 05:38:35 ################################################ 05:38:35 ## NOTE: Manually restart controller to ## 05:38:35 ## apply configuration. ## 05:38:35 ################################################ 05:38:35 Dump akka.conf 05:38:35 + echo 'Dump akka.conf' 05:38:35 + cat /tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/akka.conf 05:38:35 05:38:35 odl-cluster-data { 05:38:35 akka { 05:38:35 remote { 05:38:35 artery { 05:38:35 enabled = on 05:38:35 transport = tcp 05:38:35 canonical.hostname = "10.30.170.187" 05:38:35 canonical.port = 2550 05:38:35 } 05:38:35 } 05:38:35 05:38:35 cluster { 05:38:35 # Using artery. 05:38:35 seed-nodes = ["akka://opendaylight-cluster-data@10.30.171.124:2550", 05:38:35 "akka://opendaylight-cluster-data@10.30.171.236:2550", 05:38:35 "akka://opendaylight-cluster-data@10.30.170.187:2550"] 05:38:35 05:38:35 roles = ["member-3"] 05:38:35 05:38:35 # when under load we might trip a false positive on the failure detector 05:38:35 # failure-detector { 05:38:35 # heartbeat-interval = 4 s 05:38:35 # acceptable-heartbeat-pause = 16s 05:38:35 # } 05:38:35 } 05:38:35 05:38:35 persistence { 05:38:35 # By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by 05:38:35 # modifying the following two properties. The directory location specified may be a relative or absolute path. 05:38:35 # The relative path is always relative to KARAF_HOME. 05:38:35 05:38:35 # snapshot-store.local.dir = "target/snapshots" 05:38:35 05:38:35 # Use lz4 compression for LocalSnapshotStore snapshots 05:38:35 snapshot-store.local.use-lz4-compression = false 05:38:35 # Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB 05:38:35 snapshot-store.local.lz4-blocksize = 256KB 05:38:35 } 05:38:35 disable-default-actor-system-quarantined-event-handling = "false" 05:38:35 } 05:38:35 } 05:38:35 Dump modules.conf 05:38:35 + echo 'Dump modules.conf' 05:38:35 + cat /tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/modules.conf 05:38:35 modules = [ 05:38:35 05:38:35 { 05:38:35 name = "inventory" 05:38:35 namespace = "urn:opendaylight:inventory" 05:38:35 shard-strategy = "module" 05:38:35 }, 05:38:35 { 05:38:35 name = "topology" 05:38:35 namespace = "urn:TBD:params:xml:ns:yang:network-topology" 05:38:35 shard-strategy = "module" 05:38:35 }, 05:38:35 { 05:38:35 name = "toaster" 05:38:35 namespace = "http://netconfcentral.org/ns/toaster" 05:38:35 shard-strategy = "module" 05:38:35 }, 05:38:35 { 05:38:35 name = "car" 05:38:35 namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" 05:38:35 shard-strategy = "module" 05:38:35 }, 05:38:35 { 05:38:35 name = "people" 05:38:35 namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" 05:38:35 shard-strategy = "module" 05:38:35 }, 05:38:35 { 05:38:35 name = "car-people" 05:38:35 namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" 05:38:35 shard-strategy = "module" 05:38:35 } 05:38:35 ] 05:38:35 Dump module-shards.conf 05:38:35 + echo 'Dump module-shards.conf' 05:38:35 + cat /tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/module-shards.conf 05:38:35 module-shards = [ 05:38:35 { 05:38:35 name = "default" 05:38:35 shards = [ 05:38:35 { 05:38:35 name = "default" 05:38:35 replicas = ["member-1", 05:38:35 "member-2", 05:38:35 "member-3"] 05:38:35 } 05:38:35 ] 05:38:35 }, 05:38:35 { 05:38:35 name = "inventory" 05:38:35 shards = [ 05:38:35 { 05:38:35 name="inventory" 05:38:35 replicas = ["member-1", 05:38:35 "member-2", 05:38:35 "member-3"] 05:38:35 } 05:38:35 ] 05:38:35 }, 05:38:35 { 05:38:35 name = "topology" 05:38:35 shards = [ 05:38:35 { 05:38:35 name="topology" 05:38:35 replicas = ["member-1", 05:38:35 "member-2", 05:38:35 "member-3"] 05:38:35 } 05:38:35 ] 05:38:35 }, 05:38:35 { 05:38:35 name = "toaster" 05:38:35 shards = [ 05:38:35 { 05:38:35 name="toaster" 05:38:35 replicas = ["member-1", 05:38:35 "member-2", 05:38:35 "member-3"] 05:38:35 } 05:38:35 ] 05:38:35 }, 05:38:35 { 05:38:35 name = "car" 05:38:35 shards = [ 05:38:35 { 05:38:35 name="car" 05:38:35 replicas = ["member-1", 05:38:35 "member-2", 05:38:35 "member-3"] 05:38:35 } 05:38:35 ] 05:38:35 }, 05:38:35 { 05:38:35 name = "people" 05:38:35 shards = [ 05:38:35 { 05:38:35 name="people" 05:38:35 replicas = ["member-1", 05:38:35 "member-2", 05:38:35 "member-3"] 05:38:35 } 05:38:35 ] 05:38:35 }, 05:38:35 { 05:38:35 name = "car-people" 05:38:35 shards = [ 05:38:35 { 05:38:35 name="car-people" 05:38:35 replicas = ["member-1", 05:38:35 "member-2", 05:38:35 "member-3"] 05:38:35 } 05:38:35 ] 05:38:35 } 05:38:35 ] 05:38:35 Locating config plan to use... 05:38:35 Finished running config plans 05:38:35 Starting member-1 with IP address 10.30.171.124 05:38:35 Warning: Permanently added '10.30.171.124' (ECDSA) to the list of known hosts. 05:38:35 Warning: Permanently added '10.30.171.124' (ECDSA) to the list of known hosts. 05:38:36 Redirecting karaf console output to karaf_console.log 05:38:36 Starting controller... 05:38:36 start: Redirecting Karaf output to /tmp/karaf-0.19.3-SNAPSHOT/data/log/karaf_console.log 05:38:36 Starting member-2 with IP address 10.30.171.236 05:38:36 Warning: Permanently added '10.30.171.236' (ECDSA) to the list of known hosts. 05:38:36 Warning: Permanently added '10.30.171.236' (ECDSA) to the list of known hosts. 05:38:36 Redirecting karaf console output to karaf_console.log 05:38:36 Starting controller... 05:38:36 start: Redirecting Karaf output to /tmp/karaf-0.19.3-SNAPSHOT/data/log/karaf_console.log 05:38:36 Starting member-3 with IP address 10.30.170.187 05:38:36 Warning: Permanently added '10.30.170.187' (ECDSA) to the list of known hosts. 05:38:36 Warning: Permanently added '10.30.170.187' (ECDSA) to the list of known hosts. 05:38:36 Redirecting karaf console output to karaf_console.log 05:38:36 Starting controller... 05:38:37 start: Redirecting Karaf output to /tmp/karaf-0.19.3-SNAPSHOT/data/log/karaf_console.log 05:38:37 [controller-csit-3node-clustering-ask-all-potassium] $ /bin/bash /tmp/jenkins13072549285107618164.sh 05:38:37 common-functions.sh is being sourced 05:38:37 common-functions environment: 05:38:37 MAVENCONF: /tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg 05:38:37 ACTUALFEATURES: 05:38:37 FEATURESCONF: /tmp/karaf-0.19.3-SNAPSHOT/etc/org.apache.karaf.features.cfg 05:38:37 CUSTOMPROP: /tmp/karaf-0.19.3-SNAPSHOT/etc/custom.properties 05:38:37 LOGCONF: /tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg 05:38:37 MEMCONF: /tmp/karaf-0.19.3-SNAPSHOT/bin/setenv 05:38:37 CONTROLLERMEM: 2048m 05:38:37 AKKACONF: /tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/akka.conf 05:38:37 MODULESCONF: /tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/modules.conf 05:38:37 MODULESHARDSCONF: /tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/module-shards.conf 05:38:37 SUITES: 05:38:37 05:38:37 + echo '#################################################' 05:38:37 ################################################# 05:38:37 + echo '## Verify Cluster is UP ##' 05:38:37 ## Verify Cluster is UP ## 05:38:37 + echo '#################################################' 05:38:37 ################################################# 05:38:37 + create_post_startup_script 05:38:37 + cat 05:38:37 + copy_and_run_post_startup_script 05:38:37 + seed_index=1 05:38:37 ++ seq 1 3 05:38:37 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") 05:38:37 + CONTROLLERIP=ODL_SYSTEM_1_IP 05:38:37 + echo 'Execute the post startup script on controller 10.30.171.124' 05:38:37 Execute the post startup script on controller 10.30.171.124 05:38:37 + scp /w/workspace/controller-csit-3node-clustering-ask-all-potassium/post-startup-script.sh 10.30.171.124:/tmp/ 05:38:37 Warning: Permanently added '10.30.171.124' (ECDSA) to the list of known hosts. 05:38:37 + ssh 10.30.171.124 'bash /tmp/post-startup-script.sh 1' 05:38:37 Warning: Permanently added '10.30.171.124' (ECDSA) to the list of known hosts. 05:38:52 tcp6 0 0 :::8101 :::* LISTEN 05:38:52 Waiting up to 3 minutes for controller to come up, checking every 5 seconds... 05:39:17 2024-04-07T05:39:13,798 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 292 - org.opendaylight.infrautils.ready-api - 6.0.6 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] 05:39:17 Controller is UP 05:39:17 2024-04-07T05:39:13,798 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 292 - org.opendaylight.infrautils.ready-api - 6.0.6 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] 05:39:17 Listing all open ports on controller system... 05:39:17 (Not all processes could be identified, non-owned process info 05:39:17 will not be shown, you would have to be root to see it all.) 05:39:17 Active Internet connections (servers and established) 05:39:17 Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name 05:39:17 tcp 0 0 0.0.0.0:111 0.0.0.0:* LISTEN - 05:39:17 tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN - 05:39:17 tcp 0 164 10.30.171.124:22 10.30.170.160:38990 ESTABLISHED - 05:39:17 tcp 0 0 10.30.171.124:46330 199.204.45.87:443 TIME_WAIT - 05:39:17 tcp6 0 0 :::111 :::* LISTEN - 05:39:17 tcp6 0 0 :::6640 :::* LISTEN 5795/java 05:39:17 tcp6 0 0 :::5555 :::* LISTEN - 05:39:17 tcp6 0 0 :::8181 :::* LISTEN 5795/java 05:39:17 tcp6 0 0 10.30.171.124:2550 :::* LISTEN 5795/java 05:39:17 tcp6 0 0 :::22 :::* LISTEN - 05:39:17 tcp6 0 0 127.0.0.1:34329 :::* LISTEN 5795/java 05:39:17 tcp6 0 0 127.0.0.1:44444 :::* LISTEN 5795/java 05:39:17 tcp6 0 0 :::6653 :::* LISTEN 5795/java 05:39:17 tcp6 0 0 :::4189 :::* LISTEN 5795/java 05:39:17 tcp6 0 0 :::1790 :::* LISTEN 5795/java 05:39:17 tcp6 0 0 :::8101 :::* LISTEN 5795/java 05:39:17 tcp6 0 0 :::6633 :::* LISTEN 5795/java 05:39:17 tcp6 0 0 127.0.0.1:1099 :::* LISTEN 5795/java 05:39:17 tcp6 32 0 10.30.171.124:46368 199.204.45.87:443 CLOSE_WAIT 5795/java 05:39:17 tcp6 0 0 10.30.171.124:42466 10.30.170.187:2550 ESTABLISHED 5795/java 05:39:17 tcp6 0 0 10.30.171.124:2550 10.30.171.236:34424 ESTABLISHED 5795/java 05:39:17 tcp6 0 0 127.0.0.1:44444 127.0.0.1:54086 ESTABLISHED 5795/java 05:39:17 tcp6 0 0 127.0.0.1:54086 127.0.0.1:44444 ESTABLISHED 5795/java 05:39:17 tcp6 0 0 10.30.171.124:56346 10.30.171.236:2550 ESTABLISHED 5795/java 05:39:17 tcp6 0 0 10.30.171.124:56338 10.30.171.236:2550 ESTABLISHED 5795/java 05:39:17 tcp6 0 0 10.30.171.124:2550 10.30.170.187:34506 ESTABLISHED 5795/java 05:39:17 tcp6 0 0 10.30.171.124:2550 10.30.171.236:34440 ESTABLISHED 5795/java 05:39:17 tcp6 0 0 127.0.0.1:38338 127.0.0.1:1099 TIME_WAIT - 05:39:17 tcp6 0 0 10.30.171.124:2550 10.30.170.187:34492 ESTABLISHED 5795/java 05:39:17 tcp6 0 0 10.30.171.124:42454 10.30.170.187:2550 ESTABLISHED 5795/java 05:39:17 tcp6 0 0 127.0.0.1:51002 127.0.0.1:44444 TIME_WAIT - 05:39:17 udp 0 0 10.30.171.124:68 10.30.170.3:67 ESTABLISHED - 05:39:17 udp 0 0 0.0.0.0:111 0.0.0.0:* - 05:39:17 udp 0 0 127.0.0.1:323 0.0.0.0:* - 05:39:17 udp6 0 0 :::4342 :::* 5795/java 05:39:17 udp6 0 0 :::111 :::* - 05:39:17 udp6 0 0 ::1:323 :::* - 05:39:17 looking for "BindException: Address already in use" in log file 05:39:17 looking for "server is unhealthy" in log file 05:39:17 + '[' 1 == 0 ']' 05:39:17 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") 05:39:17 + CONTROLLERIP=ODL_SYSTEM_2_IP 05:39:17 + echo 'Execute the post startup script on controller 10.30.171.236' 05:39:17 Execute the post startup script on controller 10.30.171.236 05:39:17 + scp /w/workspace/controller-csit-3node-clustering-ask-all-potassium/post-startup-script.sh 10.30.171.236:/tmp/ 05:39:17 Warning: Permanently added '10.30.171.236' (ECDSA) to the list of known hosts. 05:39:18 + ssh 10.30.171.236 'bash /tmp/post-startup-script.sh 2' 05:39:18 Warning: Permanently added '10.30.171.236' (ECDSA) to the list of known hosts. 05:39:18 tcp6 0 0 :::8101 :::* LISTEN 05:39:18 Waiting up to 3 minutes for controller to come up, checking every 5 seconds... 05:39:23 2024-04-07T05:39:14,042 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 292 - org.opendaylight.infrautils.ready-api - 6.0.6 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] 05:39:23 Controller is UP 05:39:23 2024-04-07T05:39:14,042 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 292 - org.opendaylight.infrautils.ready-api - 6.0.6 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] 05:39:23 Listing all open ports on controller system... 05:39:23 (Not all processes could be identified, non-owned process info 05:39:23 will not be shown, you would have to be root to see it all.) 05:39:23 Active Internet connections (servers and established) 05:39:23 Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name 05:39:23 tcp 0 0 0.0.0.0:111 0.0.0.0:* LISTEN - 05:39:23 tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN - 05:39:23 tcp 0 0 10.30.171.236:36400 199.204.45.87:443 TIME_WAIT - 05:39:23 tcp 0 164 10.30.171.236:22 10.30.170.160:36222 ESTABLISHED - 05:39:23 tcp6 0 0 :::8101 :::* LISTEN 5762/java 05:39:23 tcp6 0 0 :::6633 :::* LISTEN 5762/java 05:39:23 tcp6 0 0 127.0.0.1:1099 :::* LISTEN 5762/java 05:39:23 tcp6 0 0 :::111 :::* LISTEN - 05:39:23 tcp6 0 0 :::6640 :::* LISTEN 5762/java 05:39:23 tcp6 0 0 :::5555 :::* LISTEN - 05:39:23 tcp6 0 0 :::8181 :::* LISTEN 5762/java 05:39:23 tcp6 0 0 10.30.171.236:2550 :::* LISTEN 5762/java 05:39:23 tcp6 0 0 :::22 :::* LISTEN - 05:39:23 tcp6 0 0 :::12345 :::* LISTEN 5762/java 05:39:23 tcp6 0 0 127.0.0.1:44444 :::* LISTEN 5762/java 05:39:23 tcp6 0 0 :::6653 :::* LISTEN 5762/java 05:39:23 tcp6 0 0 127.0.0.1:42525 :::* LISTEN 5762/java 05:39:23 tcp6 0 0 :::1790 :::* LISTEN 5762/java 05:39:23 tcp6 0 0 127.0.0.1:40580 127.0.0.1:44444 TIME_WAIT - 05:39:23 tcp6 0 0 10.30.171.236:36856 10.30.170.187:2550 ESTABLISHED 5762/java 05:39:23 tcp6 0 0 10.30.171.236:34424 10.30.171.124:2550 ESTABLISHED 5762/java 05:39:23 tcp6 0 0 10.30.171.236:2550 10.30.171.124:56346 ESTABLISHED 5762/java 05:39:23 tcp6 32 0 10.30.171.236:38756 199.204.45.87:443 CLOSE_WAIT 5762/java 05:39:23 tcp6 0 0 10.30.171.236:34440 10.30.171.124:2550 ESTABLISHED 5762/java 05:39:23 tcp6 0 0 127.0.0.1:40582 127.0.0.1:44444 TIME_WAIT - 05:39:23 tcp6 0 0 10.30.171.236:2550 10.30.171.124:56338 ESTABLISHED 5762/java 05:39:23 tcp6 0 0 10.30.171.236:2550 10.30.170.187:35670 ESTABLISHED 5762/java 05:39:23 tcp6 0 0 127.0.0.1:45950 127.0.0.1:1099 TIME_WAIT - 05:39:23 tcp6 0 0 10.30.171.236:2550 10.30.170.187:35666 ESTABLISHED 5762/java 05:39:23 tcp6 0 0 10.30.171.236:36860 10.30.170.187:2550 ESTABLISHED 5762/java 05:39:23 udp 0 0 10.30.171.236:68 10.30.170.3:67 ESTABLISHED - 05:39:23 udp 0 0 0.0.0.0:111 0.0.0.0:* - 05:39:23 udp 0 0 127.0.0.1:323 0.0.0.0:* - 05:39:23 udp6 0 0 :::111 :::* - 05:39:23 udp6 0 0 ::1:323 :::* - 05:39:23 udp6 0 0 :::4342 :::* 5762/java 05:39:23 looking for "BindException: Address already in use" in log file 05:39:23 looking for "server is unhealthy" in log file 05:39:23 + '[' 2 == 0 ']' 05:39:23 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") 05:39:23 + CONTROLLERIP=ODL_SYSTEM_3_IP 05:39:23 + echo 'Execute the post startup script on controller 10.30.170.187' 05:39:23 Execute the post startup script on controller 10.30.170.187 05:39:23 + scp /w/workspace/controller-csit-3node-clustering-ask-all-potassium/post-startup-script.sh 10.30.170.187:/tmp/ 05:39:23 Warning: Permanently added '10.30.170.187' (ECDSA) to the list of known hosts. 05:39:23 + ssh 10.30.170.187 'bash /tmp/post-startup-script.sh 3' 05:39:23 Warning: Permanently added '10.30.170.187' (ECDSA) to the list of known hosts. 05:39:23 tcp6 0 0 :::8101 :::* LISTEN 05:39:23 Waiting up to 3 minutes for controller to come up, checking every 5 seconds... 05:39:33 2024-04-07T05:39:33,249 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 292 - org.opendaylight.infrautils.ready-api - 6.0.6 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] 05:39:33 Controller is UP 05:39:33 2024-04-07T05:39:33,249 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 292 - org.opendaylight.infrautils.ready-api - 6.0.6 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] 05:39:33 Listing all open ports on controller system... 05:39:33 (Not all processes could be identified, non-owned process info 05:39:33 will not be shown, you would have to be root to see it all.) 05:39:33 Active Internet connections (servers and established) 05:39:33 Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name 05:39:33 tcp 0 0 0.0.0.0:111 0.0.0.0:* LISTEN - 05:39:33 tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN - 05:39:33 tcp 0 164 10.30.170.187:22 10.30.170.160:52752 ESTABLISHED - 05:39:33 tcp6 0 0 :::12345 :::* LISTEN 5753/java 05:39:33 tcp6 0 0 127.0.0.1:44444 :::* LISTEN 5753/java 05:39:33 tcp6 0 0 :::6653 :::* LISTEN 5753/java 05:39:33 tcp6 0 0 :::1790 :::* LISTEN 5753/java 05:39:33 tcp6 0 0 :::8101 :::* LISTEN 5753/java 05:39:33 tcp6 0 0 :::6633 :::* LISTEN 5753/java 05:39:33 tcp6 0 0 127.0.0.1:1099 :::* LISTEN 5753/java 05:39:33 tcp6 0 0 127.0.0.1:42157 :::* LISTEN 5753/java 05:39:33 tcp6 0 0 :::111 :::* LISTEN - 05:39:33 tcp6 0 0 :::6640 :::* LISTEN 5753/java 05:39:33 tcp6 0 0 :::5555 :::* LISTEN - 05:39:33 tcp6 0 0 :::8181 :::* LISTEN 5753/java 05:39:33 tcp6 0 0 10.30.170.187:2550 :::* LISTEN 5753/java 05:39:33 tcp6 0 0 :::22 :::* LISTEN - 05:39:33 tcp6 0 0 10.30.170.187:2550 10.30.171.124:42466 ESTABLISHED 5753/java 05:39:33 tcp6 0 0 10.30.170.187:2550 10.30.171.236:36856 ESTABLISHED 5753/java 05:39:33 tcp6 0 0 10.30.170.187:35670 10.30.171.236:2550 ESTABLISHED 5753/java 05:39:33 tcp6 0 0 127.0.0.1:59500 127.0.0.1:44444 TIME_WAIT - 05:39:33 tcp6 0 0 10.30.170.187:34492 10.30.171.124:2550 ESTABLISHED 5753/java 05:39:33 tcp6 32 0 10.30.170.187:33330 199.204.45.87:443 CLOSE_WAIT 5753/java 05:39:33 tcp6 0 0 127.0.0.1:52458 127.0.0.1:1099 TIME_WAIT - 05:39:33 tcp6 0 0 127.0.0.1:59492 127.0.0.1:44444 TIME_WAIT - 05:39:33 tcp6 0 0 10.30.170.187:2550 10.30.171.236:36860 ESTABLISHED 5753/java 05:39:33 tcp6 0 0 10.30.170.187:34506 10.30.171.124:2550 ESTABLISHED 5753/java 05:39:33 tcp6 0 0 10.30.170.187:35666 10.30.171.236:2550 ESTABLISHED 5753/java 05:39:33 tcp6 0 0 10.30.170.187:2550 10.30.171.124:42454 ESTABLISHED 5753/java 05:39:33 udp 0 0 10.30.170.187:68 10.30.170.3:67 ESTABLISHED - 05:39:33 udp 0 0 0.0.0.0:111 0.0.0.0:* - 05:39:33 udp 0 0 127.0.0.1:323 0.0.0.0:* - 05:39:33 udp6 0 0 :::4342 :::* 5753/java 05:39:33 udp6 0 0 :::111 :::* - 05:39:33 udp6 0 0 ::1:323 :::* - 05:39:33 looking for "BindException: Address already in use" in log file 05:39:33 looking for "server is unhealthy" in log file 05:39:33 + '[' 0 == 0 ']' 05:39:33 + seed_index=1 05:39:33 + dump_controller_threads 05:39:33 ++ seq 1 3 05:39:33 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") 05:39:33 + CONTROLLERIP=ODL_SYSTEM_1_IP 05:39:33 + echo 'Let'\''s take the karaf thread dump' 05:39:33 Let's take the karaf thread dump 05:39:33 + ssh 10.30.171.124 'sudo ps aux' 05:39:33 Warning: Permanently added '10.30.171.124' (ECDSA) to the list of known hosts. 05:39:34 ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-ask-all-potassium/ps_before.log 05:39:34 ++ tr -s ' ' 05:39:34 ++ grep -v grep 05:39:34 ++ cut -f2 '-d ' 05:39:34 + pid=5795 05:39:34 + echo 'karaf main: org.apache.karaf.main.Main, pid:5795' 05:39:34 karaf main: org.apache.karaf.main.Main, pid:5795 05:39:34 + ssh 10.30.171.124 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 5795' 05:39:34 Warning: Permanently added '10.30.171.124' (ECDSA) to the list of known hosts. 05:39:34 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") 05:39:34 + CONTROLLERIP=ODL_SYSTEM_2_IP 05:39:34 + echo 'Let'\''s take the karaf thread dump' 05:39:34 Let's take the karaf thread dump 05:39:34 + ssh 10.30.171.236 'sudo ps aux' 05:39:34 Warning: Permanently added '10.30.171.236' (ECDSA) to the list of known hosts. 05:39:35 ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-ask-all-potassium/ps_before.log 05:39:35 ++ grep -v grep 05:39:35 ++ tr -s ' ' 05:39:35 ++ cut -f2 '-d ' 05:39:35 + pid=5762 05:39:35 + echo 'karaf main: org.apache.karaf.main.Main, pid:5762' 05:39:35 karaf main: org.apache.karaf.main.Main, pid:5762 05:39:35 + ssh 10.30.171.236 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 5762' 05:39:35 Warning: Permanently added '10.30.171.236' (ECDSA) to the list of known hosts. 05:39:35 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") 05:39:35 + CONTROLLERIP=ODL_SYSTEM_3_IP 05:39:35 + echo 'Let'\''s take the karaf thread dump' 05:39:35 Let's take the karaf thread dump 05:39:35 + ssh 10.30.170.187 'sudo ps aux' 05:39:35 Warning: Permanently added '10.30.170.187' (ECDSA) to the list of known hosts. 05:39:36 ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-ask-all-potassium/ps_before.log 05:39:36 ++ grep -v grep 05:39:36 ++ cut -f2 '-d ' 05:39:36 ++ tr -s ' ' 05:39:36 + pid=5753 05:39:36 + echo 'karaf main: org.apache.karaf.main.Main, pid:5753' 05:39:36 karaf main: org.apache.karaf.main.Main, pid:5753 05:39:36 + ssh 10.30.170.187 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 5753' 05:39:36 Warning: Permanently added '10.30.170.187' (ECDSA) to the list of known hosts. 05:39:36 + '[' 0 -gt 0 ']' 05:39:36 + echo 'Generating controller variables...' 05:39:36 Generating controller variables... 05:39:36 ++ seq 1 3 05:39:36 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") 05:39:36 + CONTROLLERIP=ODL_SYSTEM_1_IP 05:39:36 + odl_variables=' -v ODL_SYSTEM_1_IP:10.30.171.124' 05:39:36 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") 05:39:36 + CONTROLLERIP=ODL_SYSTEM_2_IP 05:39:36 + odl_variables=' -v ODL_SYSTEM_1_IP:10.30.171.124 -v ODL_SYSTEM_2_IP:10.30.171.236' 05:39:36 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") 05:39:36 + CONTROLLERIP=ODL_SYSTEM_3_IP 05:39:36 + odl_variables=' -v ODL_SYSTEM_1_IP:10.30.171.124 -v ODL_SYSTEM_2_IP:10.30.171.236 -v ODL_SYSTEM_3_IP:10.30.170.187' 05:39:36 + echo 'Generating mininet variables...' 05:39:36 Generating mininet variables... 05:39:36 ++ seq 1 0 05:39:36 + get_test_suites SUITES 05:39:36 + local __suite_list=SUITES 05:39:36 + echo 'Locating test plan to use...' 05:39:36 Locating test plan to use... 05:39:36 + testplan_filepath=/w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/testplans/controller-clustering-ask-potassium.txt 05:39:36 + '[' '!' -f /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/testplans/controller-clustering-ask-potassium.txt ']' 05:39:36 + testplan_filepath=/w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/testplans/controller-clustering-ask.txt 05:39:36 + '[' disabled '!=' disabled ']' 05:39:36 + echo 'Changing the testplan path...' 05:39:36 Changing the testplan path... 05:39:36 + sed s:integration:/w/workspace/controller-csit-3node-clustering-ask-all-potassium: /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/testplans/controller-clustering-ask.txt 05:39:36 + cat testplan.txt 05:39:36 # Place the suites in run order: 05:39:36 /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot 05:39:36 /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence.robot 05:39:36 /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot 05:39:36 /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_partition_and_heal.robot 05:39:36 /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot 05:39:36 /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_rpc_broker/action_provider_precedence.robot 05:39:36 /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot 05:39:36 /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_rpc_broker/action_provider_partition_and_heal.robot 05:39:36 /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot 05:39:36 /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/cluster_singleton/master_stability.robot 05:39:36 /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot 05:39:36 /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot 05:39:36 /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot 05:39:36 /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot 05:39:36 /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot 05:39:36 /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/singleton_service/global_rpc_kill.robot 05:39:36 /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot 05:39:36 /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/singleton_service/global_rpc_freeze.robot 05:39:36 /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot 05:39:36 /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/singleton_service/global_rpc_isolate.robot 05:39:36 /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot 05:39:36 /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot 05:39:36 /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot 05:39:36 /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot 05:39:36 /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot 05:39:36 /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot 05:39:36 /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot 05:39:36 /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot 05:39:36 /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot 05:39:36 + '[' -z '' ']' 05:39:36 ++ grep -E -v '(^[[:space:]]*#|^[[:space:]]*$)' testplan.txt 05:39:36 ++ tr '\012' ' ' 05:39:36 + suite_list='/w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_rpc_broker/action_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_rpc_broker/action_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/singleton_service/global_rpc_kill.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/singleton_service/global_rpc_freeze.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/singleton_service/global_rpc_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot ' 05:39:36 + eval 'SUITES='\''/w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_rpc_broker/action_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_rpc_broker/action_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/singleton_service/global_rpc_kill.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/singleton_service/global_rpc_freeze.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/singleton_service/global_rpc_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot '\''' 05:39:36 ++ SUITES='/w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_rpc_broker/action_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_rpc_broker/action_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/singleton_service/global_rpc_kill.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/singleton_service/global_rpc_freeze.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/singleton_service/global_rpc_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot ' 05:39:36 + echo 'Starting Robot test suites /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_rpc_broker/action_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_rpc_broker/action_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/singleton_service/global_rpc_kill.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/singleton_service/global_rpc_freeze.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/singleton_service/global_rpc_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot ...' 05:39:36 Starting Robot test suites /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_rpc_broker/action_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_rpc_broker/action_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/singleton_service/global_rpc_kill.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/singleton_service/global_rpc_freeze.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/singleton_service/global_rpc_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot ... 05:39:36 + robot -N controller-clustering-ask.txt --removekeywords wuks -e exclude -e skip_if_potassium -v BUNDLEFOLDER:karaf-0.19.3-SNAPSHOT -v BUNDLE_URL:https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.19.3-SNAPSHOT/karaf-0.19.3-20240406.185403-93.zip -v CONTROLLER:10.30.171.124 -v CONTROLLER1:10.30.171.236 -v CONTROLLER2:10.30.170.187 -v CONTROLLER_USER:jenkins -v JAVA_HOME:/usr/lib/jvm/java-17-openjdk -v JDKVERSION:openjdk17 -v JENKINS_WORKSPACE:/w/workspace/controller-csit-3node-clustering-ask-all-potassium -v MININET: -v MININET1: -v MININET2: -v MININET_USER:jenkins -v NEXUSURL_PREFIX:https://nexus.opendaylight.org -v NUM_ODL_SYSTEM:3 -v NUM_TOOLS_SYSTEM:0 -v ODL_STREAM:potassium -v ODL_SYSTEM_IP:10.30.171.124 -v ODL_SYSTEM_1_IP:10.30.171.124 -v ODL_SYSTEM_2_IP:10.30.171.236 -v ODL_SYSTEM_3_IP:10.30.170.187 -v ODL_SYSTEM_USER:jenkins -v TOOLS_SYSTEM_IP: -v TOOLS_SYSTEM_USER:jenkins -v USER_HOME:/home/jenkins -v IS_KARAF_APPL:True -v WORKSPACE:/tmp /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_rpc_broker/action_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_rpc_broker/action_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/singleton_service/global_rpc_kill.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/singleton_service/global_rpc_freeze.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/singleton_service/global_rpc_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot 05:39:37 ============================================================================== 05:39:37 controller-clustering-ask.txt 05:39:37 ============================================================================== 05:39:37 controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te... 05:39:37 ============================================================================== 05:39:46 Stop_All_Members :: Stop every odl node. | FAIL | 05:45:55 Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 05:45:55 ------------------------------------------------------------------------------ 05:45:55 Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS | 05:46:06 ------------------------------------------------------------------------------ 05:46:06 Start_All_And_Sync :: Start each member and wait for sync. | FAIL | 05:52:15 Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ConnectionError: HTTPConnectionPool(host='10.30.170.187', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) 05:52:15 ------------------------------------------------------------------------------ 05:52:15 controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL | 05:52:15 3 tests, 1 passed, 2 failed 05:52:15 ============================================================================== 05:52:15 controller-clustering-ask.txt.Rpc Provider Precedence :: DOMRpcBroker testi... 05:52:15 ============================================================================== 05:52:22 Register_Rpc_On_Each_Node :: Register global rpc on each node of t... | FAIL | 05:52:25 ... click for list of related bugs or create a new one if needed (with the 05:52:25 "controller_clustering_ask_txt_rpc_provider_precedence_register_rpc_on_each_node" 05:52:25 reference somewhere inside) 05:52:25 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_precedence_register_rpc_on_each_node&order=bug_status" 05:52:25 05:52:25 ConnectionError: HTTPConnectionPool(host='10.30.170.187', port=8181): Max retries exceeded with url: /rests/operations/odl-mdsal-lowlevel-control:register-constant (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) 05:52:25 ------------------------------------------------------------------------------ 05:52:25 Invoke_Rpc_On_Each_Node :: Verify that the rpc response comes from... | FAIL | 05:52:26 ... click for list of related bugs or create a new one if needed (with the 05:52:26 "controller_clustering_ask_txt_rpc_provider_precedence_invoke_rpc_on_each_node" 05:52:26 reference somewhere inside) 05:52:26 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_precedence_invoke_rpc_on_each_node&order=bug_status" 05:52:26 05:52:26 ConnectionError: HTTPConnectionPool(host='10.30.170.187', port=8181): Max retries exceeded with url: /rests/operations/odl-mdsal-lowlevel-target:get-constant (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) 05:52:26 ------------------------------------------------------------------------------ 05:52:26 Unregister_Rpc_On_Node :: Unregister the rpc on one of the cluster... | PASS | 05:52:26 ------------------------------------------------------------------------------ 05:52:26 Invoke_Rpc_On_Node_With_Unregistered_Rpc :: Invoke rcp on the node... | PASS | 05:52:27 ------------------------------------------------------------------------------ 05:52:27 Invoke_Rpc_On_Remaining_Nodes :: Verify that the rpc response come... | PASS | 05:52:27 ------------------------------------------------------------------------------ 05:52:27 Reregister_Rpc_On_Node :: Reregister the rpc. | PASS | 05:52:28 ------------------------------------------------------------------------------ 05:52:28 Invoke_Rpc_On_Each_Node_Again :: Verify that the rpc response come... | FAIL | 05:52:28 ... click for list of related bugs or create a new one if needed (with the 05:52:28 "controller_clustering_ask_txt_rpc_provider_precedence_invoke_rpc_on_each_node_again" 05:52:28 reference somewhere inside) 05:52:28 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_precedence_invoke_rpc_on_each_node_again&order=bug_status" 05:52:28 05:52:28 ConnectionError: HTTPConnectionPool(host='10.30.170.187', port=8181): Max retries exceeded with url: /rests/operations/odl-mdsal-lowlevel-target:get-constant (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) 05:52:28 ------------------------------------------------------------------------------ 05:52:28 Unregister_Rpc_On_Each_Node :: Unregister rpc on every node. | FAIL | 05:52:29 ... click for list of related bugs or create a new one if needed (with the 05:52:29 "controller_clustering_ask_txt_rpc_provider_precedence_unregister_rpc_on_each_node" 05:52:29 reference somewhere inside) 05:52:29 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_precedence_unregister_rpc_on_each_node&order=bug_status" 05:52:29 05:52:29 ConnectionError: HTTPConnectionPool(host='10.30.170.187', port=8181): Max retries exceeded with url: /rests/operations/odl-mdsal-lowlevel-control:unregister-constant (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) 05:52:29 ------------------------------------------------------------------------------ 05:52:29 controller-clustering-ask.txt.Rpc Provider Precedence :: DOMRpcBro... | FAIL | 05:52:29 8 tests, 4 passed, 4 failed 05:52:29 ============================================================================== 05:52:29 controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te... 05:52:29 ============================================================================== 05:52:35 Stop_All_Members :: Stop every odl node. | FAIL | 05:58:47 Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 05:58:47 ------------------------------------------------------------------------------ 05:58:47 Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS | 05:58:59 ------------------------------------------------------------------------------ 05:58:59 Start_All_And_Sync :: Start each member and wait for sync. | FAIL | 06:05:17 Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.236:8181/jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore 06:05:17 ------------------------------------------------------------------------------ 06:05:17 controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL | 06:05:17 3 tests, 1 passed, 2 failed 06:05:17 ============================================================================== 06:05:17 controller-clustering-ask.txt.Rpc Provider Partition And Heal :: DOMRpcBrok... 06:05:17 ============================================================================== 06:05:53 Register_Rpc_On_Two_Nodes :: Register rpc on two nodes of the odl ... | FAIL | 06:06:15 ... click for list of related bugs or create a new one if needed (with the 06:06:15 "controller_clustering_ask_txt_rpc_provider_partition_and_heal_register_rpc_on_two_nodes" 06:06:15 reference somewhere inside) 06:06:15 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_partition_and_heal_register_rpc_on_two_nodes&order=bug_status" 06:06:15 06:06:15 HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.236:8181/rests/operations/odl-mdsal-lowlevel-control:register-constant 06:06:15 ------------------------------------------------------------------------------ 06:06:15 Invoke_Rpc_On_Each_Node :: Invoke get-constant rpc on every node o... | FAIL | 06:06:57 ... click for list of related bugs or create a new one if needed (with the 06:06:57 "controller_clustering_ask_txt_rpc_provider_partition_and_heal_invoke_rpc_on_each_node" 06:06:57 reference somewhere inside) 06:06:57 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_partition_and_heal_invoke_rpc_on_each_node&order=bug_status" 06:06:57 06:06:57 Keyword 'Verify_Constant_On_Active_Nodes' failed after retrying for 10 seconds. The last error was: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.236:8181/rests/operations/odl-mdsal-lowlevel-target:get-constant 06:06:57 ------------------------------------------------------------------------------ 06:06:57 Isolate_One_Node :: Isolate one node with registered rpc. From the... | PASS | 06:07:40 ------------------------------------------------------------------------------ 06:07:40 Invoke_Rpc_On_Nonisolated_Nodes :: Invoke rpc on non-islolated nodes. | FAIL | 06:10:05 ... click for list of related bugs or create a new one if needed (with the 06:10:05 "controller_clustering_ask_txt_rpc_provider_partition_and_heal_invoke_rpc_on_nonisolated_nodes" 06:10:05 reference somewhere inside) 06:10:05 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_partition_and_heal_invoke_rpc_on_nonisolated_nodes&order=bug_status" 06:10:05 06:10:05 Keyword 'DrbCommons.Verify_Constant_On_Active_Nodes' failed after retrying for 1 minute. The last error was: Keyword 'Verify_Constant_On_Active_Nodes' failed after retrying for 10 seconds. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=125.0) 06:10:05 ------------------------------------------------------------------------------ 06:10:05 Rejoin_Isolated_Member :: Rejoin isolated node | FAIL | 06:12:55 ... click for list of related bugs or create a new one if needed (with the 06:12:55 "controller_clustering_ask_txt_rpc_provider_partition_and_heal_rejoin_isolated_member" 06:12:55 reference somewhere inside) 06:12:55 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_partition_and_heal_rejoin_isolated_member&order=bug_status" 06:12:55 06:12:55 Keyword 'Check_Cluster_Is_In_Sync' failed after retrying for 1 minute. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=125.0) 06:12:55 ------------------------------------------------------------------------------ 06:12:55 Invoke_Rpc_On_Each_Node_Again :: Invoke rpc get-constant on every ... | FAIL | 06:15:10 ... click for list of related bugs or create a new one if needed (with the 06:15:10 "controller_clustering_ask_txt_rpc_provider_partition_and_heal_invoke_rpc_on_each_node_again" 06:15:10 reference somewhere inside) 06:15:10 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_partition_and_heal_invoke_rpc_on_each_node_again&order=bug_status" 06:15:10 06:15:10 Keyword 'Verify_Constant_On_Active_Nodes' failed after retrying for 10 seconds. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=125.0) 06:15:10 ------------------------------------------------------------------------------ 06:15:10 Unregister_Rpc_On_Each_Node :: Inregister rpc on both nodes. | FAIL | 06:15:21 ... click for list of related bugs or create a new one if needed (with the 06:15:21 "controller_clustering_ask_txt_rpc_provider_partition_and_heal_unregister_rpc_on_each_node" 06:15:21 reference somewhere inside) 06:15:21 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_partition_and_heal_unregister_rpc_on_each_node&order=bug_status" 06:15:21 06:15:21 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.124:8181/rests/operations/odl-mdsal-lowlevel-control:unregister-constant 06:15:21 ------------------------------------------------------------------------------ 06:15:21 controller-clustering-ask.txt.Rpc Provider Partition And Heal :: D... | FAIL | 06:15:21 7 tests, 1 passed, 6 failed 06:15:21 ============================================================================== 06:15:22 controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te... 06:15:22 ============================================================================== 06:16:20 Stop_All_Members :: Stop every odl node. | FAIL | 06:22:29 Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 06:22:29 ------------------------------------------------------------------------------ 06:22:29 Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS | 06:22:47 ------------------------------------------------------------------------------ 06:22:47 Start_All_And_Sync :: Start each member and wait for sync. | FAIL | 06:30:18 Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=125.0) 06:30:18 ------------------------------------------------------------------------------ 06:30:18 controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL | 06:30:18 3 tests, 1 passed, 2 failed 06:30:18 ============================================================================== 06:30:18 controller-clustering-ask.txt.Action Provider Precedence :: DOMRpcBroker te... 06:30:18 ============================================================================== 06:31:16 Register_Rpc_On_Each_Node :: Register routed rpc on each node of t... | FAIL | 06:34:07 ... click for list of related bugs or create a new one if needed (with the 06:34:07 "controller_clustering_ask_txt_action_provider_precedence_register_rpc_on_each_node" 06:34:07 reference somewhere inside) 06:34:07 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_precedence_register_rpc_on_each_node&order=bug_status" 06:34:07 06:34:07 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=125.0) 06:34:07 ------------------------------------------------------------------------------ 06:34:07 Invoke_Rpc_On_Each_Node :: Verify that the rpc response comes from... | FAIL | 06:36:23 ... click for list of related bugs or create a new one if needed (with the 06:36:23 "controller_clustering_ask_txt_action_provider_precedence_invoke_rpc_on_each_node" 06:36:23 reference somewhere inside) 06:36:23 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_precedence_invoke_rpc_on_each_node&order=bug_status" 06:36:23 06:36:23 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=125.0) 06:36:23 ------------------------------------------------------------------------------ 06:36:23 Unregister_Rpc_On_Node :: Unregister the rpc on one of the cluster... | PASS | 06:36:33 ------------------------------------------------------------------------------ 06:36:33 Invoke_Rpc_On_Node_With_Unregistered_Rpc :: Invoke rcp on the node... | FAIL | 06:37:18 ... click for list of related bugs or create a new one if needed (with the 06:37:18 "controller_clustering_ask_txt_action_provider_precedence_invoke_rpc_on_node_with_unregistered_rpc" 06:37:18 reference somewhere inside) 06:37:18 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_precedence_invoke_rpc_on_node_with_unregistered_rpc&order=bug_status" 06:37:18 06:37:18 HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.124:8181/rests/operations/odl-mdsal-lowlevel-target:get-contexted-constant 06:37:18 ------------------------------------------------------------------------------ 06:37:18 Invoke_Rpc_On_Remaining_Nodes :: Verify that the rpc response come... | PASS | 06:38:03 ------------------------------------------------------------------------------ 06:38:03 Reregister_Rpc_On_Node :: Reregister the rpc. | PASS | 06:38:48 ------------------------------------------------------------------------------ 06:38:48 Invoke_Rpc_On_Each_Node_Again :: Verify that the rpc response come... | FAIL | 06:41:39 ... click for list of related bugs or create a new one if needed (with the 06:41:39 "controller_clustering_ask_txt_action_provider_precedence_invoke_rpc_on_each_node_again" 06:41:39 reference somewhere inside) 06:41:39 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_precedence_invoke_rpc_on_each_node_again&order=bug_status" 06:41:39 06:41:39 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=125.0) 06:41:39 ------------------------------------------------------------------------------ 06:41:39 Unregister_Rpc_On_Each_Node :: Unregister rpc on every node. | FAIL | 06:43:55 ... click for list of related bugs or create a new one if needed (with the 06:43:55 "controller_clustering_ask_txt_action_provider_precedence_unregister_rpc_on_each_node" 06:43:55 reference somewhere inside) 06:43:55 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_precedence_unregister_rpc_on_each_node&order=bug_status" 06:43:55 06:43:55 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=125.0) 06:43:55 ------------------------------------------------------------------------------ 06:43:55 controller-clustering-ask.txt.Action Provider Precedence :: DOMRpc... | FAIL | 06:43:55 8 tests, 3 passed, 5 failed 06:43:55 ============================================================================== 06:43:55 controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te... 06:43:55 ============================================================================== 06:44:52 Stop_All_Members :: Stop every odl node. | FAIL | 06:51:00 Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 06:51:00 ------------------------------------------------------------------------------ 06:51:00 Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS | 06:51:11 ------------------------------------------------------------------------------ 06:51:11 Start_All_And_Sync :: Start each member and wait for sync. | FAIL | 06:57:16 Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore 06:57:16 ------------------------------------------------------------------------------ 06:57:16 controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL | 06:57:16 3 tests, 1 passed, 2 failed 06:57:16 ============================================================================== 06:57:16 controller-clustering-ask.txt.Action Provider Partition And Heal :: DOMRpcB... 06:57:16 ============================================================================== 06:58:49 Register_Rpc_On_Two_Nodes :: Register rpc on two nodes of the odl ... | FAIL | 06:59:20 ... click for list of related bugs or create a new one if needed (with the 06:59:20 "controller_clustering_ask_txt_action_provider_partition_and_heal_register_rpc_on_two_nodes" 06:59:20 reference somewhere inside) 06:59:20 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_partition_and_heal_register_rpc_on_two_nodes&order=bug_status" 06:59:20 06:59:20 HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/operations/odl-mdsal-lowlevel-control:register-bound-constant 06:59:20 ------------------------------------------------------------------------------ 06:59:20 Invoke_Rpc_On_Each_Node :: Invoke get-contexted-constant rpc on ev... | FAIL | 07:00:06 ... click for list of related bugs or create a new one if needed (with the 07:00:06 "controller_clustering_ask_txt_action_provider_partition_and_heal_invoke_rpc_on_each_node" 07:00:06 reference somewhere inside) 07:00:06 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_partition_and_heal_invoke_rpc_on_each_node&order=bug_status" 07:00:06 07:00:06 Keyword 'Verify_Contexted_Constant_On_Active_Nodes' failed after retrying for 10 seconds. The last error was: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/operations/odl-mdsal-lowlevel-target:get-contexted-constant 07:00:06 ------------------------------------------------------------------------------ 07:00:06 Isolate_One_Node :: Isolate one node with registered rpc. | FAIL | 07:02:46 ... click for list of related bugs or create a new one if needed (with the 07:02:46 "controller_clustering_ask_txt_action_provider_partition_and_heal_isolate_one_node" 07:02:46 reference somewhere inside) 07:02:46 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_partition_and_heal_isolate_one_node&order=bug_status" 07:02:46 07:02:46 ReadTimeout: HTTPConnectionPool(host='10.30.170.187', port=8181): Read timed out. (read timeout=125.0) 07:02:46 ------------------------------------------------------------------------------ 07:02:46 Invoke_Rpc_On_Remaining_Nodes :: Invoke rpc on non-islolated nodes... | FAIL | 07:04:22 ... click for list of related bugs or create a new one if needed (with the 07:04:22 "controller_clustering_ask_txt_action_provider_partition_and_heal_invoke_rpc_on_remaining_nodes" 07:04:22 reference somewhere inside) 07:04:22 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_partition_and_heal_invoke_rpc_on_remaining_nodes&order=bug_status" 07:04:22 07:04:22 Keyword 'DrbCommons.Verify_Contexted_Constant_On_Active_Nodes' failed after retrying for 1 minute. The last error was: Keyword 'Verify_Contexted_Constant_On_Active_Nodes' failed after retrying for 10 seconds. The last error was: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/operations/odl-mdsal-lowlevel-target:get-contexted-constant 07:04:22 ------------------------------------------------------------------------------ 07:04:22 Rejoin_Isolated_Member :: Rejoin isolated node | FAIL | 07:04:42 ... click for list of related bugs or create a new one if needed (with the 07:04:42 "controller_clustering_ask_txt_action_provider_partition_and_heal_rejoin_isolated_member" 07:04:42 reference somewhere inside) 07:04:42 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_partition_and_heal_rejoin_isolated_member&order=bug_status" 07:04:42 07:04:42 Variable '${isolated_idx}' not found. 07:04:42 ------------------------------------------------------------------------------ 07:04:42 Invoke_Rpc_On_Each_Node_Again :: Invoke rpc get-contexted-constant... | FAIL | 07:05:38 ... click for list of related bugs or create a new one if needed (with the 07:05:38 "controller_clustering_ask_txt_action_provider_partition_and_heal_invoke_rpc_on_each_node_again" 07:05:38 reference somewhere inside) 07:05:38 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_partition_and_heal_invoke_rpc_on_each_node_again&order=bug_status" 07:05:38 07:05:38 Keyword 'Verify_Contexted_Constant_On_Active_Nodes' failed after retrying for 10 seconds. The last error was: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/operations/odl-mdsal-lowlevel-target:get-contexted-constant 07:05:38 ------------------------------------------------------------------------------ 07:05:38 Unregister_Rpc_On_Each_Node :: Inregister rpc on both nodes. | FAIL | 07:06:13 ... click for list of related bugs or create a new one if needed (with the 07:06:13 "controller_clustering_ask_txt_action_provider_partition_and_heal_unregister_rpc_on_each_node" 07:06:13 reference somewhere inside) 07:06:13 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_partition_and_heal_unregister_rpc_on_each_node&order=bug_status" 07:06:13 07:06:13 HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.124:8181/rests/operations/odl-mdsal-lowlevel-control:unregister-bound-constant 07:06:13 ------------------------------------------------------------------------------ 07:06:13 controller-clustering-ask.txt.Action Provider Partition And Heal :... | FAIL | 07:06:13 7 tests, 0 passed, 7 failed 07:06:13 ============================================================================== 07:06:13 controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te... 07:06:13 ============================================================================== 07:07:21 Stop_All_Members :: Stop every odl node. | FAIL | 07:13:29 Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 07:13:29 ------------------------------------------------------------------------------ 07:13:29 Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS | 07:13:39 ------------------------------------------------------------------------------ 07:13:39 Start_All_And_Sync :: Start each member and wait for sync. | FAIL | 07:21:09 Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=125.0) 07:21:09 ------------------------------------------------------------------------------ 07:21:09 controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL | 07:21:09 3 tests, 1 passed, 2 failed 07:21:09 ============================================================================== 07:21:09 controller-clustering-ask.txt.Master Stability :: Cluster Singleton testing... 07:21:09 ============================================================================== 07:22:07 Register_Singleton_Constant_On_Each_Node_And_Verify :: Register a ... | FAIL | 07:24:58 ... click for list of related bugs or create a new one if needed (with the 07:24:58 "controller_clustering_ask_txt_master_stability_register_singleton_constant_on_each_node_and_verify" 07:24:58 reference somewhere inside) 07:24:58 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_master_stability_register_singleton_constant_on_each_node_and_verify&order=bug_status" 07:24:58 07:24:58 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=125.0) 07:24:58 ------------------------------------------------------------------------------ 07:24:58 Unregister_Singleton_Constant_On_Non_Master_Node :: Unregister the... | FAIL | 07:25:09 ... click for list of related bugs or create a new one if needed (with the 07:25:09 "controller_clustering_ask_txt_master_stability_unregister_singleton_constant_on_non_master_node" 07:25:09 reference somewhere inside) 07:25:09 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_master_stability_unregister_singleton_constant_on_non_master_node&order=bug_status" 07:25:09 07:25:09 Variable '@{cs_candidates}' not found. Did you mean: 07:25:09 @{cs_exp_candidates} 07:25:09 ------------------------------------------------------------------------------ 07:25:09 Monitor_Stability_While_Unregistered :: Verify that the owner rema... | FAIL | 07:25:54 ... click for list of related bugs or create a new one if needed (with the 07:25:54 "controller_clustering_ask_txt_master_stability_monitor_stability_while_unregistered" 07:25:54 reference somewhere inside) 07:25:54 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_master_stability_monitor_stability_while_unregistered&order=bug_status" 07:25:54 07:25:54 Variable '${cs_owner}' not found. 07:25:54 ------------------------------------------------------------------------------ 07:25:54 Reregister_Singleton_Constant :: Re-register the unregistered cand... | FAIL | 07:26:39 ... click for list of related bugs or create a new one if needed (with the 07:26:39 "controller_clustering_ask_txt_master_stability_reregister_singleton_constant" 07:26:39 reference somewhere inside) 07:26:39 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_master_stability_reregister_singleton_constant&order=bug_status" 07:26:39 07:26:39 Variable '${unregistered_node}' not found. 07:26:39 ------------------------------------------------------------------------------ 07:26:39 Verify_Stability_After_Reregistration :: Verify that the owner rem... | FAIL | 07:27:24 ... click for list of related bugs or create a new one if needed (with the 07:27:24 "controller_clustering_ask_txt_master_stability_verify_stability_after_reregistration" 07:27:24 reference somewhere inside) 07:27:24 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_master_stability_verify_stability_after_reregistration&order=bug_status" 07:27:24 07:27:24 Variable '${cs_owner}' not found. 07:27:24 ------------------------------------------------------------------------------ 07:27:24 Unregister_Singleton_Constant_On_Each_Node :: Unregister the appli... | FAIL | 07:30:15 ... click for list of related bugs or create a new one if needed (with the 07:30:15 "controller_clustering_ask_txt_master_stability_unregister_singleton_constant_on_each_node" 07:30:15 reference somewhere inside) 07:30:15 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_master_stability_unregister_singleton_constant_on_each_node&order=bug_status" 07:30:15 07:30:15 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=125.0) 07:30:15 ------------------------------------------------------------------------------ 07:30:15 controller-clustering-ask.txt.Master Stability :: Cluster Singleto... | FAIL | 07:30:15 6 tests, 0 passed, 6 failed 07:30:15 ============================================================================== 07:30:15 controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te... 07:30:15 ============================================================================== 07:31:12 Stop_All_Members :: Stop every odl node. | FAIL | 07:37:20 Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 07:37:20 ------------------------------------------------------------------------------ 07:37:20 Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS | 07:37:30 ------------------------------------------------------------------------------ 07:37:30 Start_All_And_Sync :: Start each member and wait for sync. | FAIL | 07:43:38 Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: Index 1 has incorrect status: False 07:43:38 ------------------------------------------------------------------------------ 07:43:38 controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL | 07:43:38 3 tests, 1 passed, 2 failed 07:43:38 ============================================================================== 07:43:38 controller-clustering-ask.txt.Partition And Heal :: Cluster Singleton testi... 07:43:38 ============================================================================== 07:44:35 Register_Singleton_Constant_On_Each_Node :: Register a candidate a... | FAIL | 07:47:26 ... click for list of related bugs or create a new one if needed (with the 07:47:26 "controller_clustering_ask_txt_partition_and_heal_register_singleton_constant_on_each_node" 07:47:26 reference somewhere inside) 07:47:26 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_partition_and_heal_register_singleton_constant_on_each_node&order=bug_status" 07:47:26 07:47:26 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=125.0) 07:47:26 ------------------------------------------------------------------------------ 07:47:26 Verify_Singleton_Constant_On_Each_Node :: Store the owner and cand... | FAIL | 07:47:37 ... click for list of related bugs or create a new one if needed (with the 07:47:37 "controller_clustering_ask_txt_partition_and_heal_verify_singleton_constant_on_each_node" 07:47:37 reference somewhere inside) 07:47:37 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_partition_and_heal_verify_singleton_constant_on_each_node&order=bug_status" 07:47:37 07:47:37 Could not parse owner and candidates for device get-singleton-constant-service'] 07:47:37 ------------------------------------------------------------------------------ 07:47:37 Isolate_Owner_Node :: Isolate the cluster node which is the owner.... | FAIL | 07:48:22 ... click for list of related bugs or create a new one if needed (with the 07:48:22 "controller_clustering_ask_txt_partition_and_heal_isolate_owner_node" 07:48:22 reference somewhere inside) 07:48:22 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_partition_and_heal_isolate_owner_node&order=bug_status" 07:48:22 07:48:22 Variable '${cs_owner}' not found. 07:48:22 ------------------------------------------------------------------------------ 07:48:22 Monitor_Stability_While_Isolated :: Monitor the stability of the s... | FAIL | 07:49:07 ... click for list of related bugs or create a new one if needed (with the 07:49:07 "controller_clustering_ask_txt_partition_and_heal_monitor_stability_while_isolated" 07:49:07 reference somewhere inside) 07:49:07 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_partition_and_heal_monitor_stability_while_isolated&order=bug_status" 07:49:07 07:49:07 Invalid IF condition: Evaluating expression '"${index}" == "${cs_isolated_index}"' failed: Variable '${cs_isolated_index}' not found. 07:49:07 ------------------------------------------------------------------------------ 07:49:07 Rejoin_Isolated_node :: Rejoin isolated node. | FAIL | 07:49:52 ... click for list of related bugs or create a new one if needed (with the 07:49:52 "controller_clustering_ask_txt_partition_and_heal_rejoin_isolated_node" 07:49:52 reference somewhere inside) 07:49:52 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_partition_and_heal_rejoin_isolated_node&order=bug_status" 07:49:52 07:49:52 Variable '${cs_isolated_index}' not found. 07:49:52 ------------------------------------------------------------------------------ 07:49:52 Unregister_Singleton_Constant_On_Each_Node :: Unregister the appli... | FAIL | 07:52:43 ... click for list of related bugs or create a new one if needed (with the 07:52:43 "controller_clustering_ask_txt_partition_and_heal_unregister_singleton_constant_on_each_node" 07:52:43 reference somewhere inside) 07:52:43 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_partition_and_heal_unregister_singleton_constant_on_each_node&order=bug_status" 07:52:43 07:52:43 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=125.0) 07:52:43 ------------------------------------------------------------------------------ 07:52:43 controller-clustering-ask.txt.Partition And Heal :: Cluster Single... | FAIL | 07:52:43 6 tests, 0 passed, 6 failed 07:52:43 ============================================================================== 07:52:43 controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te... 07:52:43 ============================================================================== 07:53:40 Stop_All_Members :: Stop every odl node. | FAIL | 08:00:08 Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 08:00:08 ------------------------------------------------------------------------------ 08:00:08 Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS | 08:00:19 ------------------------------------------------------------------------------ 08:00:19 Start_All_And_Sync :: Start each member and wait for sync. | FAIL | 08:07:50 Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=125.0) 08:07:50 ------------------------------------------------------------------------------ 08:07:50 controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL | 08:07:50 3 tests, 1 passed, 2 failed 08:07:50 ============================================================================== 08:07:50 controller-clustering-ask.txt.Chasing The Leader :: Cluster Singleton testi... 08:07:50 ============================================================================== 08:08:48 Register_Candidates :: Register a candidate application on each no... | FAIL | 08:11:39 ... click for list of related bugs or create a new one if needed (with the 08:11:39 "controller_clustering_ask_txt_chasing_the_leader_register_candidates" 08:11:39 reference somewhere inside) 08:11:39 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_chasing_the_leader_register_candidates&order=bug_status" 08:11:39 08:11:39 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=125.0) 08:11:39 ------------------------------------------------------------------------------ 08:11:39 Do_Nothing :: Do nothing for the time of the test duration, becaus... | PASS | 08:12:50 ------------------------------------------------------------------------------ 08:12:50 Unregister_Candidates_And_Validate_Criteria :: Unregister the test... | FAIL | 08:15:05 ... click for list of related bugs or create a new one if needed (with the 08:15:05 "controller_clustering_ask_txt_chasing_the_leader_unregister_candidates_and_validate_criteria" 08:15:05 reference somewhere inside) 08:15:05 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_chasing_the_leader_unregister_candidates_and_validate_criteria&order=bug_status" 08:15:05 08:15:05 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=125.0) 08:15:05 ------------------------------------------------------------------------------ 08:15:05 controller-clustering-ask.txt.Chasing The Leader :: Cluster Single... | FAIL | 08:15:05 3 tests, 1 passed, 2 failed 08:15:05 ============================================================================== 08:15:06 controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te... 08:15:06 ============================================================================== 08:15:28 Stop_All_Members :: Stop every odl node. | FAIL | 08:21:36 Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 08:21:36 ------------------------------------------------------------------------------ 08:21:36 Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS | 08:21:47 ------------------------------------------------------------------------------ 08:21:47 Start_All_And_Sync :: Start each member and wait for sync. | FAIL | 08:28:56 Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=125.0) 08:28:56 ------------------------------------------------------------------------------ 08:28:56 controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL | 08:28:56 3 tests, 1 passed, 2 failed 08:28:56 ============================================================================== 08:28:56 controller-clustering-ask.txt.Global Rpc Kill :: Controller functional HA t... 08:28:56 ============================================================================== 08:29:30 Get_Basic_Rpc_Test_Owner :: Find a service owner and successors. | FAIL | 08:29:30 Parent suite setup failed: 08:29:30 TimeoutError: timed out 08:29:30 ------------------------------------------------------------------------------ 08:29:30 Rpc_Before_Stopping_On_Owner :: Run rpc on the service owner. | FAIL | 08:29:30 Parent suite setup failed: 08:29:30 TimeoutError: timed out 08:29:30 ------------------------------------------------------------------------------ 08:29:30 Rpc_Before_Stop_On_Successors :: Run rpc on non owher cluster nodes. | FAIL | 08:29:30 Parent suite setup failed: 08:29:30 TimeoutError: timed out 08:29:30 ------------------------------------------------------------------------------ 08:29:30 Stop_Current_Owner_Member :: Stop cluster node which is the owner. | FAIL | 08:29:30 Parent suite setup failed: 08:29:30 TimeoutError: timed out 08:29:30 ------------------------------------------------------------------------------ 08:29:30 Verify_New_Basic_Rpc_Test_Owner_Elected :: Verify new owner of the... | FAIL | 08:29:30 Parent suite setup failed: 08:29:30 TimeoutError: timed out 08:29:30 ------------------------------------------------------------------------------ 08:29:30 Rpc_On_Remained_Cluster_Nodes :: Run rpc on remained cluster nodes. | FAIL | 08:29:30 Parent suite setup failed: 08:29:30 TimeoutError: timed out 08:29:30 ------------------------------------------------------------------------------ 08:29:30 Restart_Stopped_Member :: Restart stopped node | FAIL | 08:29:30 Parent suite setup failed: 08:29:30 TimeoutError: timed out 08:29:30 ------------------------------------------------------------------------------ 08:29:30 Verify_New_Owner_Remained_After_Rejoin :: Verify no owner change h... | FAIL | 08:29:30 Parent suite setup failed: 08:29:30 TimeoutError: timed out 08:29:30 ------------------------------------------------------------------------------ 08:29:30 Rpc_After_Rejoin_On_New_Owner :: Run rpc on the new service owner ... | FAIL | 08:29:30 Parent suite setup failed: 08:29:30 TimeoutError: timed out 08:29:30 ------------------------------------------------------------------------------ 08:29:30 Rpc_After_Rejoin_On_Old_Owner :: Run rpc on rejoined cluster node. | FAIL | 08:29:30 Parent suite setup failed: 08:29:30 TimeoutError: timed out 08:29:30 ------------------------------------------------------------------------------ 08:29:30 Rpc_After_Rejoin_On_All :: Run rpc again on all nodes. | FAIL | 08:29:30 Parent suite setup failed: 08:29:30 TimeoutError: timed out 08:29:30 ------------------------------------------------------------------------------ 08:29:30 controller-clustering-ask.txt.Global Rpc Kill :: Controller functi... | FAIL | 08:29:30 Suite setup failed: 08:29:30 TimeoutError: timed out 08:29:30 08:29:30 11 tests, 0 passed, 11 failed 08:29:30 ============================================================================== 08:29:30 controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te... 08:29:30 ============================================================================== 08:29:52 Stop_All_Members :: Stop every odl node. | FAIL | 08:36:02 Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 08:36:02 ------------------------------------------------------------------------------ 08:36:02 Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS | 08:36:12 ------------------------------------------------------------------------------ 08:36:12 Start_All_And_Sync :: Start each member and wait for sync. | FAIL | 08:43:23 Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=125.0) 08:43:23 ------------------------------------------------------------------------------ 08:43:23 controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL | 08:43:23 3 tests, 1 passed, 2 failed 08:43:23 ============================================================================== 08:43:23 controller-clustering-ask.txt.Global Rpc Freeze :: Controller functional HA... 08:43:23 ============================================================================== 08:43:56 Get_Basic_Rpc_Test_Owner :: Find a service owner and successors. | FAIL | 08:43:56 Parent suite setup failed: 08:43:56 TimeoutError: timed out 08:43:56 ------------------------------------------------------------------------------ 08:43:56 Rpc_Before_Freezing_On_Owner :: Run rpc on the service owner. | FAIL | 08:43:56 Parent suite setup failed: 08:43:56 TimeoutError: timed out 08:43:56 ------------------------------------------------------------------------------ 08:43:56 Rpc_Before_Freeze_On_Successors :: Run rpc on non owher cluster no... | FAIL | 08:43:56 Parent suite setup failed: 08:43:56 TimeoutError: timed out 08:43:56 ------------------------------------------------------------------------------ 08:43:56 Freeze_Current_Owner_Member :: Stop cluster node which is the owner. | FAIL | 08:43:56 Parent suite setup failed: 08:43:56 TimeoutError: timed out 08:43:56 ------------------------------------------------------------------------------ 08:43:56 Verify_New_Basic_Rpc_Test_Owner_Elected :: Verify new owner of the... | FAIL | 08:43:56 Parent suite setup failed: 08:43:56 TimeoutError: timed out 08:43:56 ------------------------------------------------------------------------------ 08:43:56 Rpc_On_Remained_Cluster_Nodes :: Run rpc on remained cluster nodes. | FAIL | 08:43:56 Parent suite setup failed: 08:43:56 TimeoutError: timed out 08:43:56 ------------------------------------------------------------------------------ 08:43:56 Unfreeze_Frozen_Member :: Restart frozen node | FAIL | 08:43:56 Parent suite setup failed: 08:43:56 TimeoutError: timed out 08:43:56 ------------------------------------------------------------------------------ 08:43:56 Rpc_After_Rejoin_On_New_Owner :: Run rpc on the new service owner ... | FAIL | 08:43:56 Parent suite setup failed: 08:43:56 TimeoutError: timed out 08:43:56 ------------------------------------------------------------------------------ 08:43:56 Rpc_After_Rejoin_On_Old_Owner :: Run rpc on rejoined cluster node. | FAIL | 08:43:56 Parent suite setup failed: 08:43:56 TimeoutError: timed out 08:43:56 ------------------------------------------------------------------------------ 08:43:56 Rpc_After_Rejoin_On_All :: Run rpc again on all nodes. | FAIL | 08:43:56 Parent suite setup failed: 08:43:56 TimeoutError: timed out 08:43:56 ------------------------------------------------------------------------------ 08:43:56 controller-clustering-ask.txt.Global Rpc Freeze :: Controller func... | FAIL | 08:43:56 Suite setup failed: 08:43:56 TimeoutError: timed out 08:43:56 08:43:56 10 tests, 0 passed, 10 failed 08:43:56 ============================================================================== 08:43:56 controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te... 08:43:56 ============================================================================== 08:44:18 Stop_All_Members :: Stop every odl node. | FAIL | 08:50:28 Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 08:50:28 ------------------------------------------------------------------------------ 08:50:28 Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS | 08:50:38 ------------------------------------------------------------------------------ 08:50:38 Start_All_And_Sync :: Start each member and wait for sync. | FAIL | 08:57:48 Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=125.0) 08:57:48 ------------------------------------------------------------------------------ 08:57:48 controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL | 08:57:48 3 tests, 1 passed, 2 failed 08:57:48 ============================================================================== 08:57:48 controller-clustering-ask.txt.Global Rpc Isolate :: Controller functional H... 08:57:48 ============================================================================== 08:58:21 Get_Basic_Rpc_Test_Owner :: Find a service owner and successors. | FAIL | 08:58:21 Parent suite setup failed: 08:58:21 TimeoutError: timed out 08:58:21 ------------------------------------------------------------------------------ 08:58:21 Rpc_Before_Isolation_On_Owner :: Run rpc on the service owner. | FAIL | 08:58:21 Parent suite setup failed: 08:58:21 TimeoutError: timed out 08:58:21 ------------------------------------------------------------------------------ 08:58:21 Rpc_Before_Isolation_On_Successors :: Run rpc on non owher cluster... | FAIL | 08:58:21 Parent suite setup failed: 08:58:21 TimeoutError: timed out 08:58:21 ------------------------------------------------------------------------------ 08:58:21 Isolate_Current_Owner_Member :: Isolating cluster node which is th... | FAIL | 08:58:21 Parent suite setup failed: 08:58:21 TimeoutError: timed out 08:58:21 ------------------------------------------------------------------------------ 08:58:21 Verify_New_Basic_Rpc_Test_Owner_Elected :: Verify new owner of the... | FAIL | 08:58:21 Parent suite setup failed: 08:58:21 TimeoutError: timed out 08:58:21 ------------------------------------------------------------------------------ 08:58:21 Rpc_On_Isolated_Node :: Run rpc on isolated cluster node. | FAIL | 08:58:21 Parent suite setup failed: 08:58:21 TimeoutError: timed out 08:58:21 ------------------------------------------------------------------------------ 08:58:21 Rpc_On_Non_Isolated_Cluster_Nodes :: Run rpc on remained cluster n... | FAIL | 08:58:21 Parent suite setup failed: 08:58:21 TimeoutError: timed out 08:58:21 ------------------------------------------------------------------------------ 08:58:21 Rejoin_Isolated_Member :: Rejoin isolated node | FAIL | 08:58:21 Parent suite setup failed: 08:58:21 TimeoutError: timed out 08:58:21 ------------------------------------------------------------------------------ 08:58:21 Rpc_After_Rejoin_On_New_Owner :: Run rpc on the new service owner ... | FAIL | 08:58:21 Parent suite setup failed: 08:58:21 TimeoutError: timed out 08:58:21 ------------------------------------------------------------------------------ 08:58:21 Rpc_After_Rejoin_On_Old_Owner :: Run rpc on rejoined cluster node. | FAIL | 08:58:21 Parent suite setup failed: 08:58:21 TimeoutError: timed out 08:58:21 ------------------------------------------------------------------------------ 08:58:21 Rpc_After_Rejoin_On_All :: Run rpc again on all nodes. | FAIL | 08:58:21 Parent suite setup failed: 08:58:21 TimeoutError: timed out 08:58:21 ------------------------------------------------------------------------------ 08:58:21 controller-clustering-ask.txt.Global Rpc Isolate :: Controller fun... | FAIL | 08:58:21 Suite setup failed: 08:58:21 TimeoutError: timed out 08:58:21 08:58:21 11 tests, 0 passed, 11 failed 08:58:21 ============================================================================== 08:58:21 controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te... 08:58:21 ============================================================================== 08:58:43 Stop_All_Members :: Stop every odl node. | FAIL | 09:04:52 Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 09:04:52 ------------------------------------------------------------------------------ 09:04:52 Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS | 09:05:02 ------------------------------------------------------------------------------ 09:05:02 Start_All_And_Sync :: Start each member and wait for sync. | FAIL | 09:12:12 Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=125.0) 09:12:12 ------------------------------------------------------------------------------ 09:12:12 controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL | 09:12:12 3 tests, 1 passed, 2 failed 09:12:12 ============================================================================== 09:12:12 controller-clustering-ask.txt.Carpeople Crud :: Suite for performing basic ... 09:12:12 ============================================================================== 09:12:41 Add_Cars_To_Leader :: Add 30 cars to car Leader by one big PUT. | FAIL | 09:12:41 Parent suite setup failed: 09:12:41 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:12:41 ------------------------------------------------------------------------------ 09:12:41 See_Added_Cars_On_Leader :: GET response from Leader should match ... | FAIL | 09:12:41 Parent suite setup failed: 09:12:41 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:12:41 ------------------------------------------------------------------------------ 09:12:41 See_Added_Cars_On_Followers :: The same check on other members. | FAIL | 09:12:41 Parent suite setup failed: 09:12:41 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:12:41 ------------------------------------------------------------------------------ 09:12:41 Add_People_To_First_Follower :: Add 30 people to people first Foll... | FAIL | 09:12:41 Parent suite setup failed: 09:12:41 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:12:41 ------------------------------------------------------------------------------ 09:12:41 See_Added_People_On_Leader :: GET response from Leader should matc... | FAIL | 09:12:41 Parent suite setup failed: 09:12:41 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:12:41 ------------------------------------------------------------------------------ 09:12:41 See_Added_People_On_Followers :: The same check on other members. | FAIL | 09:12:41 Parent suite setup failed: 09:12:41 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:12:41 ------------------------------------------------------------------------------ 09:12:41 Buy_Cars_On_Leader :: Buy some cars on car-people Leader, loop of ... | FAIL | 09:12:41 Parent suite setup failed: 09:12:41 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:12:41 ------------------------------------------------------------------------------ 09:12:41 Buy_Cars_On_Followers :: On each Follower buy corresponding ID seg... | FAIL | 09:12:41 Parent suite setup failed: 09:12:41 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:12:41 ------------------------------------------------------------------------------ 09:12:41 See_Added_CarPeople_On_Leader :: GET car-person mappings from Lead... | FAIL | 09:12:41 Parent suite setup failed: 09:12:41 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:12:41 ------------------------------------------------------------------------------ 09:12:41 See_Added_CarPeople_On_Followers :: The same check on other members. | FAIL | 09:12:41 Parent suite setup failed: 09:12:41 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:12:41 ------------------------------------------------------------------------------ 09:12:41 Delete_All_CarPeople_On_Leader :: DELETE car-people container. No ... | FAIL | 09:12:41 Parent suite setup failed: 09:12:41 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:12:41 ------------------------------------------------------------------------------ 09:12:41 Delete_All_People_On_Leader :: DELETE people container. No verific... | FAIL | 09:12:41 Parent suite setup failed: 09:12:41 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:12:41 ------------------------------------------------------------------------------ 09:12:41 Delete_All_Cars_On_Leader :: DELETE cars container. No verificatio... | FAIL | 09:12:41 Parent suite setup failed: 09:12:41 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:12:41 ------------------------------------------------------------------------------ 09:12:41 controller-clustering-ask.txt.Carpeople Crud :: Suite for performi... | FAIL | 09:12:41 Suite setup failed: 09:12:41 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:12:41 09:12:41 13 tests, 0 passed, 13 failed 09:12:41 ============================================================================== 09:12:41 controller-clustering-ask.txt.Car Failover Crud :: Suite mixing basic opera... 09:12:41 ============================================================================== 09:13:09 Add_Original_Cars_On_Old_Leader_And_Verify :: Add initial cars on ... | FAIL | 09:13:09 Parent suite setup failed: 09:13:09 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:13:09 ------------------------------------------------------------------------------ 09:13:09 Stop_Original_Car_Leader :: Stop the car Leader to cause a new lea... | FAIL | 09:13:09 Parent suite setup failed: 09:13:09 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:13:09 ------------------------------------------------------------------------------ 09:13:09 Wait_For_New_Leader :: Wait until new car Leader is elected. | FAIL | 09:13:09 Parent suite setup failed: 09:13:09 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:13:09 ------------------------------------------------------------------------------ 09:13:09 See_Original_Cars_On_New_Leader :: GET cars from new Leader, shoul... | FAIL | 09:13:09 Parent suite setup failed: 09:13:09 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:13:09 ------------------------------------------------------------------------------ 09:13:09 See_Original_Cars_On_New_Followers :: The same check on other exis... | FAIL | 09:13:09 Parent suite setup failed: 09:13:09 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:13:09 ------------------------------------------------------------------------------ 09:13:09 Delete_Original_Cars_On_New_Leader :: Delete cars on the new Leader. | FAIL | 09:13:09 Parent suite setup failed: 09:13:09 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:13:09 ------------------------------------------------------------------------------ 09:13:09 Add_Leader_Cars_On_New_Leader :: Add cars on the new Leader. | FAIL | 09:13:09 Parent suite setup failed: 09:13:09 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:13:09 ------------------------------------------------------------------------------ 09:13:09 See_Leader_Cars_On_New_Leader :: GET cars from new Leader, should ... | FAIL | 09:13:09 Parent suite setup failed: 09:13:09 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:13:09 ------------------------------------------------------------------------------ 09:13:09 See_Leader_Cars_On_New_Followers :: The same check on other existi... | FAIL | 09:13:09 Parent suite setup failed: 09:13:09 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:13:09 ------------------------------------------------------------------------------ 09:13:09 Delete_Leader_Cars_On_New_First_Follower :: Delete cars in new fir... | FAIL | 09:13:09 Parent suite setup failed: 09:13:09 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:13:09 ------------------------------------------------------------------------------ 09:13:09 Add_Follower_Cars_On_New_First_Follower :: Add cars on the new fir... | FAIL | 09:13:09 Parent suite setup failed: 09:13:09 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:13:09 ------------------------------------------------------------------------------ 09:13:09 See_Folower_Cars_On_New_Leader :: Get cars from the new Leader, sh... | FAIL | 09:13:09 Parent suite setup failed: 09:13:09 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:13:09 ------------------------------------------------------------------------------ 09:13:09 See_Follower_Cars_On_New_Followers :: The same check on other exis... | FAIL | 09:13:09 Parent suite setup failed: 09:13:09 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:13:09 ------------------------------------------------------------------------------ 09:13:09 Start_Old_Car_Leader :: Start the stopped member without deleting ... | FAIL | 09:13:09 Parent suite setup failed: 09:13:09 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:13:09 ------------------------------------------------------------------------------ 09:13:09 See_Folower_Cars_On_Old_Leader :: GET cars from the restarted memb... | FAIL | 09:13:09 Parent suite setup failed: 09:13:09 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:13:09 ------------------------------------------------------------------------------ 09:13:09 Delete_Follower_Cars_On_New_Leader :: Delete cars on the last Leader. | FAIL | 09:13:09 Parent suite setup failed: 09:13:09 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:13:09 ------------------------------------------------------------------------------ 09:13:09 controller-clustering-ask.txt.Car Failover Crud :: Suite mixing ba... | FAIL | 09:13:09 Suite setup failed: 09:13:09 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:13:09 09:13:09 16 tests, 0 passed, 16 failed 09:13:09 ============================================================================== 09:13:09 controller-clustering-ask.txt.Car Persistence Recovery :: This test restart... 09:13:09 ============================================================================== 09:13:37 Add_Cars_On_Leader_And_Verify :: Single big PUT to datastore to ad... | FAIL | 09:13:37 Parent suite setup failed: 09:13:37 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:13:37 ------------------------------------------------------------------------------ 09:13:37 Stop_All_Members :: Stop all controllers. | FAIL | 09:13:37 Parent suite setup failed: 09:13:37 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:13:37 ------------------------------------------------------------------------------ 09:13:37 Start_All_Members :: Start all controllers (should restore the per... | FAIL | 09:13:37 Parent suite setup failed: 09:13:37 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:13:37 ------------------------------------------------------------------------------ 09:13:37 Memorize_Leader_And_Followers :: Locate current Leader of car Shard. | FAIL | 09:13:37 Parent suite setup failed: 09:13:37 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:13:37 ------------------------------------------------------------------------------ 09:13:37 See_Cars_On_Leader :: GET cars from Leader, should match the PUT d... | FAIL | 09:13:37 Parent suite setup failed: 09:13:37 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:13:37 ------------------------------------------------------------------------------ 09:13:37 See_Cars_On_Followers :: The same check on other members. | FAIL | 09:13:37 Parent suite setup failed: 09:13:37 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:13:37 ------------------------------------------------------------------------------ 09:13:37 Delete_Cars_On_Leader :: Delete cars on the new Leader. | FAIL | 09:13:37 Parent suite setup failed: 09:13:37 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:13:37 ------------------------------------------------------------------------------ 09:13:37 controller-clustering-ask.txt.Car Persistence Recovery :: This tes... | FAIL | 09:13:37 Suite setup failed: 09:13:37 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:13:37 09:13:37 7 tests, 0 passed, 7 failed 09:13:37 ============================================================================== 09:13:37 controller-clustering-ask.txt.Buycar Failover :: This test focuses on testi... 09:13:37 ============================================================================== 09:14:05 Add_Cars_To_Leader_And_Verify :: Add all needed cars to car Leader... | FAIL | 09:14:05 Parent suite setup failed: 09:14:05 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:14:05 ------------------------------------------------------------------------------ 09:14:05 Add_People_To_First_Follower_And_Verify :: Add all needed people t... | FAIL | 09:14:05 Parent suite setup failed: 09:14:05 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:14:05 ------------------------------------------------------------------------------ 09:14:05 Buy_Cars_On_Leader_And_Verify :: Buy some cars on the leader member. | FAIL | 09:14:05 Parent suite setup failed: 09:14:05 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:14:05 ------------------------------------------------------------------------------ 09:14:05 Buy_Cars_On_Follower_And_Verify :: Buy some cars on the first foll... | FAIL | 09:14:05 Parent suite setup failed: 09:14:05 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:14:05 ------------------------------------------------------------------------------ 09:14:05 Reboot_People_Leader :: Previous people Leader is rebooted. We sho... | FAIL | 09:14:05 Parent suite setup failed: 09:14:05 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:14:05 ------------------------------------------------------------------------------ 09:14:05 Buy_Cars_On_Leader_After_Reboot_And_Verify :: Buy some cars on the... | FAIL | 09:14:05 Parent suite setup failed: 09:14:05 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:14:05 ------------------------------------------------------------------------------ 09:14:05 Buy_Cars_On_Follower_After_Reboot_And_Verify :: Buy some cars on t... | FAIL | 09:14:05 Parent suite setup failed: 09:14:05 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:14:05 ------------------------------------------------------------------------------ 09:14:05 Delete_All_CarPeople :: DELETE car-people container. No verificati... | FAIL | 09:14:05 Parent suite setup failed: 09:14:05 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:14:05 ------------------------------------------------------------------------------ 09:14:05 Delete_All_People :: DELETE people container. No verification beyo... | FAIL | 09:14:05 Parent suite setup failed: 09:14:05 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:14:05 ------------------------------------------------------------------------------ 09:14:05 Delete_All_Cars :: DELETE cars container. No verification beyond h... | FAIL | 09:14:05 Parent suite setup failed: 09:14:05 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:14:05 ------------------------------------------------------------------------------ 09:14:05 controller-clustering-ask.txt.Buycar Failover :: This test focuses... | FAIL | 09:14:05 Suite setup failed: 09:14:05 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:14:05 09:14:05 10 tests, 0 passed, 10 failed 09:14:05 ============================================================================== 09:14:05 controller-clustering-ask.txt.Entity Isolate :: Suite for performing member... 09:14:05 ============================================================================== 09:14:27 Check All Shards Before Isolate :: Check all shards in controller. | FAIL | 09:14:27 Parent suite setup failed: 09:14:27 Evaluating expression 'json.loads(\'\'\'{\n "error": "javax.management.InstanceNotFoundException : org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "error_type": "javax.management.InstanceNotFoundException",\n "request": {\n "mbean": "org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "type": "read"\n },\n "stacktrace": "javax.management.InstanceNotFoundException: org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1088)\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1358)\\n\\tat java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:921)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:46)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:41)\\n\\tat org.jolokia.backend.executor.AbstractMBeanServerExecutor.call(AbstractMBeanServerExecutor.java:90)\\n\\tat org.jolokia.handler.ReadHandler.getMBeanInfo(ReadHandler.java:233)\\n\\tat org.jolokia.handler.ReadHandler.getAllAttributesNames(ReadHandler.java:245)\\n\\tat org.jolokia.handler.ReadHandler.resolveAttributes(ReadHandler.java:221)\\n\\tat org.jolokia.handler.ReadHandler.f... 09:14:27 [ Message content over the limit has been removed. ] 09:14:27 ...clipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\\n\\tat org.eclipse.jetty.server.Server.handle(Server.java:516)\\n\\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)\\n\\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)\\n\\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)\\n\\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\\n\\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\\n\\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\\n\\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)\\n\\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\\n\\tat java.base/java.lang.Thread.run(Thread.java:833)\\n",\n "status": 404\n}\n\'\'\')' failed: JSONDecodeError: Invalid control character at: line 8 column 190 (char 619) 09:14:27 ------------------------------------------------------------------------------ 09:14:27 Isolate Entity Leader :: Isolate the entity-ownership Leader to ca... | FAIL | 09:14:27 Parent suite setup failed: 09:14:27 Evaluating expression 'json.loads(\'\'\'{\n "error": "javax.management.InstanceNotFoundException : org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "error_type": "javax.management.InstanceNotFoundException",\n "request": {\n "mbean": "org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "type": "read"\n },\n "stacktrace": "javax.management.InstanceNotFoundException: org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1088)\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1358)\\n\\tat java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:921)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:46)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:41)\\n\\tat org.jolokia.backend.executor.AbstractMBeanServerExecutor.call(AbstractMBeanServerExecutor.java:90)\\n\\tat org.jolokia.handler.ReadHandler.getMBeanInfo(ReadHandler.java:233)\\n\\tat org.jolokia.handler.ReadHandler.getAllAttributesNames(ReadHandler.java:245)\\n\\tat org.jolokia.handler.ReadHandler.resolveAttributes(ReadHandler.java:221)\\n\\tat org.jolokia.handler.ReadHandler.f... 09:14:27 [ Message content over the limit has been removed. ] 09:14:27 ...clipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\\n\\tat org.eclipse.jetty.server.Server.handle(Server.java:516)\\n\\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)\\n\\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)\\n\\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)\\n\\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\\n\\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\\n\\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\\n\\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)\\n\\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\\n\\tat java.base/java.lang.Thread.run(Thread.java:833)\\n",\n "status": 404\n}\n\'\'\')' failed: JSONDecodeError: Invalid control character at: line 8 column 190 (char 619) 09:14:27 ------------------------------------------------------------------------------ 09:14:27 Check All Shards After Isolate :: Check all shards in controller. | FAIL | 09:14:27 Parent suite setup failed: 09:14:27 Evaluating expression 'json.loads(\'\'\'{\n "error": "javax.management.InstanceNotFoundException : org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "error_type": "javax.management.InstanceNotFoundException",\n "request": {\n "mbean": "org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "type": "read"\n },\n "stacktrace": "javax.management.InstanceNotFoundException: org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1088)\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1358)\\n\\tat java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:921)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:46)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:41)\\n\\tat org.jolokia.backend.executor.AbstractMBeanServerExecutor.call(AbstractMBeanServerExecutor.java:90)\\n\\tat org.jolokia.handler.ReadHandler.getMBeanInfo(ReadHandler.java:233)\\n\\tat org.jolokia.handler.ReadHandler.getAllAttributesNames(ReadHandler.java:245)\\n\\tat org.jolokia.handler.ReadHandler.resolveAttributes(ReadHandler.java:221)\\n\\tat org.jolokia.handler.ReadHandler.f... 09:14:27 [ Message content over the limit has been removed. ] 09:14:27 ...clipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\\n\\tat org.eclipse.jetty.server.Server.handle(Server.java:516)\\n\\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)\\n\\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)\\n\\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)\\n\\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\\n\\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\\n\\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\\n\\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)\\n\\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\\n\\tat java.base/java.lang.Thread.run(Thread.java:833)\\n",\n "status": 404\n}\n\'\'\')' failed: JSONDecodeError: Invalid control character at: line 8 column 190 (char 619) 09:14:27 ------------------------------------------------------------------------------ 09:14:27 Rejoin Entity Leader :: Rejoin the entity-ownership Leader. | FAIL | 09:14:27 Parent suite setup failed: 09:14:27 Evaluating expression 'json.loads(\'\'\'{\n "error": "javax.management.InstanceNotFoundException : org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "error_type": "javax.management.InstanceNotFoundException",\n "request": {\n "mbean": "org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "type": "read"\n },\n "stacktrace": "javax.management.InstanceNotFoundException: org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1088)\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1358)\\n\\tat java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:921)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:46)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:41)\\n\\tat org.jolokia.backend.executor.AbstractMBeanServerExecutor.call(AbstractMBeanServerExecutor.java:90)\\n\\tat org.jolokia.handler.ReadHandler.getMBeanInfo(ReadHandler.java:233)\\n\\tat org.jolokia.handler.ReadHandler.getAllAttributesNames(ReadHandler.java:245)\\n\\tat org.jolokia.handler.ReadHandler.resolveAttributes(ReadHandler.java:221)\\n\\tat org.jolokia.handler.ReadHandler.f... 09:14:27 [ Message content over the limit has been removed. ] 09:14:27 ...clipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\\n\\tat org.eclipse.jetty.server.Server.handle(Server.java:516)\\n\\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)\\n\\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)\\n\\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)\\n\\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\\n\\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\\n\\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\\n\\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)\\n\\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\\n\\tat java.base/java.lang.Thread.run(Thread.java:833)\\n",\n "status": 404\n}\n\'\'\')' failed: JSONDecodeError: Invalid control character at: line 8 column 190 (char 619) 09:14:27 ------------------------------------------------------------------------------ 09:14:27 Check All Shards After Rejoin :: Check all shards in controller. | FAIL | 09:14:27 Parent suite setup failed: 09:14:27 Evaluating expression 'json.loads(\'\'\'{\n "error": "javax.management.InstanceNotFoundException : org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "error_type": "javax.management.InstanceNotFoundException",\n "request": {\n "mbean": "org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "type": "read"\n },\n "stacktrace": "javax.management.InstanceNotFoundException: org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1088)\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1358)\\n\\tat java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:921)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:46)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:41)\\n\\tat org.jolokia.backend.executor.AbstractMBeanServerExecutor.call(AbstractMBeanServerExecutor.java:90)\\n\\tat org.jolokia.handler.ReadHandler.getMBeanInfo(ReadHandler.java:233)\\n\\tat org.jolokia.handler.ReadHandler.getAllAttributesNames(ReadHandler.java:245)\\n\\tat org.jolokia.handler.ReadHandler.resolveAttributes(ReadHandler.java:221)\\n\\tat org.jolokia.handler.ReadHandler.f... 09:14:27 [ Message content over the limit has been removed. ] 09:14:27 ...clipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\\n\\tat org.eclipse.jetty.server.Server.handle(Server.java:516)\\n\\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)\\n\\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)\\n\\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)\\n\\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\\n\\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\\n\\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\\n\\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)\\n\\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\\n\\tat java.base/java.lang.Thread.run(Thread.java:833)\\n",\n "status": 404\n}\n\'\'\')' failed: JSONDecodeError: Invalid control character at: line 8 column 190 (char 619) 09:14:27 ------------------------------------------------------------------------------ 09:14:28 controller-clustering-ask.txt.Entity Isolate :: Suite for performi... | FAIL | 09:14:28 Suite setup failed: 09:14:28 Evaluating expression 'json.loads(\'\'\'{\n "error": "javax.management.InstanceNotFoundException : org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "error_type": "javax.management.InstanceNotFoundException",\n "request": {\n "mbean": "org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "type": "read"\n },\n "stacktrace": "javax.management.InstanceNotFoundException: org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1088)\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1358)\\n\\tat java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:921)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:46)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:41)\\n\\tat org.jolokia.backend.executor.AbstractMBeanServerExecutor.call(AbstractMBeanServerExecutor.java:90)\\n\\tat org.jolokia.handler.ReadHandler.getMBeanInfo(ReadHandler.java:233)\\n\\tat org.jolokia.handler.ReadHandler.getAllAttributesNames(ReadHandler.java:245)\\n\\tat org.jolokia.handler.ReadHandler.resolveAttributes(ReadHandler.java:221)\\n\\tat org.jolokia.handler.ReadHandler.f... 09:14:28 [ Message content over the limit has been removed. ] 09:14:28 ...clipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\\n\\tat org.eclipse.jetty.server.Server.handle(Server.java:516)\\n\\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)\\n\\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)\\n\\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)\\n\\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\\n\\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\\n\\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\\n\\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)\\n\\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\\n\\tat java.base/java.lang.Thread.run(Thread.java:833)\\n",\n "status": 404\n}\n\'\'\')' failed: JSONDecodeError: Invalid control character at: line 8 column 190 (char 619) 09:14:28 09:14:28 5 tests, 0 passed, 5 failed 09:14:28 ============================================================================== 09:14:28 controller-clustering-ask.txt.Buycar Failover Isolation :: This test focuse... 09:14:28 ============================================================================== 09:14:56 Add_Cars_To_Leader_And_Verify :: Add all needed cars to car Leader... | FAIL | 09:14:56 Parent suite setup failed: 09:14:56 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:14:56 ------------------------------------------------------------------------------ 09:14:56 Add_People_To_First_Follower_And_Verify :: Add all needed people t... | FAIL | 09:14:56 Parent suite setup failed: 09:14:56 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:14:56 ------------------------------------------------------------------------------ 09:14:56 Buy_Cars_On_Leader_And_Verify :: Buy some cars on the leader member. | FAIL | 09:14:56 Parent suite setup failed: 09:14:56 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:14:56 ------------------------------------------------------------------------------ 09:14:56 Buy_Cars_On_Follower_And_Verify :: Buy some cars on the first foll... | FAIL | 09:14:56 Parent suite setup failed: 09:14:56 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:14:56 ------------------------------------------------------------------------------ 09:14:56 Isolate_and_Rejoin_People_Leader :: Previous people Leader is isol... | FAIL | 09:14:56 Parent suite setup failed: 09:14:56 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:14:56 ------------------------------------------------------------------------------ 09:14:56 Buy_Cars_On_Leader_After_Rejoin_And_Verify :: Buy some cars on the... | FAIL | 09:14:56 Parent suite setup failed: 09:14:56 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:14:56 ------------------------------------------------------------------------------ 09:14:56 Buy_Cars_On_Follower_After_Rejoin_And_Verify :: Buy some cars on t... | FAIL | 09:14:56 Parent suite setup failed: 09:14:56 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:14:56 ------------------------------------------------------------------------------ 09:14:56 Delete_All_CarPeople :: DELETE car-people container. No verificati... | FAIL | 09:14:56 Parent suite setup failed: 09:14:56 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:14:56 ------------------------------------------------------------------------------ 09:14:56 Delete_All_People :: DELETE people container. No verification beyo... | FAIL | 09:14:56 Parent suite setup failed: 09:14:56 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:14:56 ------------------------------------------------------------------------------ 09:14:56 Delete_All_Cars :: DELETE cars container. No verification beyond h... | FAIL | 09:14:56 Parent suite setup failed: 09:14:56 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:14:56 ------------------------------------------------------------------------------ 09:14:56 controller-clustering-ask.txt.Buycar Failover Isolation :: This te... | FAIL | 09:14:56 Suite setup failed: 09:14:56 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:14:56 09:14:56 10 tests, 0 passed, 10 failed 09:14:56 ============================================================================== 09:14:56 controller-clustering-ask.txt.Car Failover Crud Isolation :: Suite mixing b... 09:14:56 ============================================================================== 09:15:23 Add_Original_Cars_On_Old_Leader_And_Verify :: Add initial cars on ... | FAIL | 09:15:23 Parent suite setup failed: 09:15:23 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:15:23 ------------------------------------------------------------------------------ 09:15:23 Isolate_Original_Car_Leader :: Isolate the car Leader to cause a n... | FAIL | 09:15:23 Parent suite setup failed: 09:15:23 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:15:23 ------------------------------------------------------------------------------ 09:15:23 Wait_For_New_Leader :: Wait until new car Leader is elected. | FAIL | 09:15:23 Parent suite setup failed: 09:15:23 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:15:23 ------------------------------------------------------------------------------ 09:15:23 See_Original_Cars_On_New_Leader :: GET cars from new Leader, shoul... | FAIL | 09:15:23 Parent suite setup failed: 09:15:23 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:15:23 ------------------------------------------------------------------------------ 09:15:23 See_Original_Cars_On_New_Followers :: The same check on other exis... | FAIL | 09:15:23 Parent suite setup failed: 09:15:23 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:15:23 ------------------------------------------------------------------------------ 09:15:23 Delete_Original_Cars_On_New_Leader :: Delete cars on the new Leader. | FAIL | 09:15:23 Parent suite setup failed: 09:15:23 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:15:23 ------------------------------------------------------------------------------ 09:15:23 Add_Leader_Cars_On_New_Leader :: Add cars on the new Leader. | FAIL | 09:15:23 Parent suite setup failed: 09:15:23 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:15:23 ------------------------------------------------------------------------------ 09:15:23 See_Leader_Cars_On_New_Leader :: GET cars from new Leader, should ... | FAIL | 09:15:23 Parent suite setup failed: 09:15:23 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:15:23 ------------------------------------------------------------------------------ 09:15:23 See_Leader_Cars_On_New_Followers :: The same check on other existi... | FAIL | 09:15:23 Parent suite setup failed: 09:15:23 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:15:23 ------------------------------------------------------------------------------ 09:15:23 Delete_Leader_Cars_On_New_First_Follower :: Delete cars in new fir... | FAIL | 09:15:23 Parent suite setup failed: 09:15:23 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:15:23 ------------------------------------------------------------------------------ 09:15:23 Add_Follower_Cars_On_New_First_Follower :: Add cars on the new fir... | FAIL | 09:15:23 Parent suite setup failed: 09:15:23 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:15:23 ------------------------------------------------------------------------------ 09:15:23 See_Folower_Cars_On_New_Leader :: Get cars from the new Leader, sh... | FAIL | 09:15:23 Parent suite setup failed: 09:15:23 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:15:23 ------------------------------------------------------------------------------ 09:15:23 See_Follower_Cars_On_New_Followers :: The same check on other exis... | FAIL | 09:15:23 Parent suite setup failed: 09:15:23 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:15:23 ------------------------------------------------------------------------------ 09:15:23 Rejoin_Old_Car_Leader :: Rejoin the isolated member without deleti... | FAIL | 09:15:23 Parent suite setup failed: 09:15:23 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:15:23 ------------------------------------------------------------------------------ 09:15:23 See_Folower_Cars_On_Old_Leader :: GET cars from the restarted memb... | FAIL | 09:15:23 Parent suite setup failed: 09:15:23 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:15:23 ------------------------------------------------------------------------------ 09:15:23 Delete_Follower_Cars_On_New_Leader :: Delete cars on the last Leader. | FAIL | 09:15:23 Parent suite setup failed: 09:15:23 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:15:23 ------------------------------------------------------------------------------ 09:15:23 controller-clustering-ask.txt.Car Failover Crud Isolation :: Suite... | FAIL | 09:15:23 Suite setup failed: 09:15:23 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:15:23 09:15:23 16 tests, 0 passed, 16 failed 09:15:23 ============================================================================== 09:15:24 controller-clustering-ask.txt.Car Outage Corners :: Cluster suite for testi... 09:15:24 ============================================================================== 09:15:51 Stop_Majority_Of_The_Followers :: Stop half plus one car Follower ... | FAIL | 09:15:51 Parent suite setup failed: 09:15:51 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:15:51 ------------------------------------------------------------------------------ 09:15:51 Attempt_To_Add_Cars_To_Leader :: Adding cars should fail, as major... | FAIL | 09:15:51 Parent suite setup failed: 09:15:51 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:15:51 ------------------------------------------------------------------------------ 09:15:51 Start_Tipping_Follower :: Start one Follower member without persis... | FAIL | 09:15:51 Parent suite setup failed: 09:15:51 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:15:51 ------------------------------------------------------------------------------ 09:15:51 Add_Cars_On_Tipping_Follower :: Add cars on the tipping Follower. | FAIL | 09:15:51 Parent suite setup failed: 09:15:51 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:15:51 ------------------------------------------------------------------------------ 09:15:51 See_Cars_On_Existing_Members :: On each up member: GET cars, shoul... | FAIL | 09:15:51 Parent suite setup failed: 09:15:51 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:15:51 ------------------------------------------------------------------------------ 09:15:51 Start_Other_Followers :: Start other followers without persisted d... | FAIL | 09:15:51 Parent suite setup failed: 09:15:51 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:15:51 ------------------------------------------------------------------------------ 09:15:51 See_Cars_On_New_Follower_Leader :: GET cars from a new follower to... | FAIL | 09:15:51 Parent suite setup failed: 09:15:51 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:15:51 ------------------------------------------------------------------------------ 09:15:51 Delete_Cars_On_Leader :: Delete cars on Leader. | FAIL | 09:15:51 Parent suite setup failed: 09:15:51 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:15:51 ------------------------------------------------------------------------------ 09:15:51 controller-clustering-ask.txt.Car Outage Corners :: Cluster suite ... | FAIL | 09:15:51 Suite setup failed: 09:15:51 ReadTimeout: HTTPConnectionPool(host='10.30.171.236', port=8181): Read timed out. (read timeout=5.0) 09:15:51 09:15:51 8 tests, 0 passed, 8 failed 09:15:51 ============================================================================== 09:15:51 controller-clustering-ask.txt | FAIL | 09:15:51 195 tests, 20 passed, 175 failed 09:15:51 ============================================================================== 09:15:51 Output: /w/workspace/controller-csit-3node-clustering-ask-all-potassium/output.xml 09:16:01 Log: /w/workspace/controller-csit-3node-clustering-ask-all-potassium/log.html 09:16:01 Report: /w/workspace/controller-csit-3node-clustering-ask-all-potassium/report.html 09:16:03 + true 09:16:03 + echo 'Examining the files in data/log and checking filesize' 09:16:03 Examining the files in data/log and checking filesize 09:16:03 + ssh 10.30.171.124 'ls -altr /tmp/karaf-0.19.3-SNAPSHOT/data/log/' 09:16:03 Warning: Permanently added '10.30.171.124' (ECDSA) to the list of known hosts. 09:16:03 total 20228 09:16:03 drwxrwxr-x. 2 jenkins jenkins 48 Apr 7 05:38 . 09:16:03 -rw-rw-r--. 1 jenkins jenkins 1720 Apr 7 05:38 karaf_console.log 09:16:03 drwxrwxr-x. 9 jenkins jenkins 149 Apr 7 09:05 .. 09:16:03 -rw-rw-r--. 1 jenkins jenkins 16548383 Apr 7 09:15 karaf.log 09:16:03 + ssh 10.30.171.124 'du -hs /tmp/karaf-0.19.3-SNAPSHOT/data/log/*' 09:16:03 Warning: Permanently added '10.30.171.124' (ECDSA) to the list of known hosts. 09:16:03 4.0K /tmp/karaf-0.19.3-SNAPSHOT/data/log/karaf_console.log 09:16:03 20M /tmp/karaf-0.19.3-SNAPSHOT/data/log/karaf.log 09:16:03 + ssh 10.30.171.236 'ls -altr /tmp/karaf-0.19.3-SNAPSHOT/data/log/' 09:16:03 Warning: Permanently added '10.30.171.236' (ECDSA) to the list of known hosts. 09:16:04 total 593200 09:16:04 drwxrwxr-x. 2 jenkins jenkins 48 Apr 7 05:38 . 09:16:04 -rw-rw-r--. 1 jenkins jenkins 1720 Apr 7 05:38 karaf_console.log 09:16:04 -rw-rw-r--. 1 jenkins jenkins 607431817 Apr 7 06:09 karaf.log 09:16:04 drwxrwxr-x. 4 jenkins jenkins 28 Apr 7 09:05 .. 09:16:04 + ssh 10.30.171.236 'du -hs /tmp/karaf-0.19.3-SNAPSHOT/data/log/*' 09:16:04 Warning: Permanently added '10.30.171.236' (ECDSA) to the list of known hosts. 09:16:05 4.0K /tmp/karaf-0.19.3-SNAPSHOT/data/log/karaf_console.log 09:16:05 580M /tmp/karaf-0.19.3-SNAPSHOT/data/log/karaf.log 09:16:05 + ssh 10.30.170.187 'ls -altr /tmp/karaf-0.19.3-SNAPSHOT/data/log/' 09:16:05 Warning: Permanently added '10.30.170.187' (ECDSA) to the list of known hosts. 09:16:05 total 1643020 09:16:05 drwxrwxr-x. 2 jenkins jenkins 48 Apr 7 05:38 . 09:16:05 -rw-rw-r--. 1 jenkins jenkins 11017 Apr 7 05:46 karaf_console.log 09:16:05 drwxrwxr-x. 4 jenkins jenkins 28 Apr 7 09:05 .. 09:16:05 -rw-rw-r--. 1 jenkins jenkins 608728580 Apr 7 09:15 karaf.log 09:16:05 + ssh 10.30.170.187 'du -hs /tmp/karaf-0.19.3-SNAPSHOT/data/log/*' 09:16:05 Warning: Permanently added '10.30.170.187' (ECDSA) to the list of known hosts. 09:16:05 12K /tmp/karaf-0.19.3-SNAPSHOT/data/log/karaf_console.log 09:16:05 1.6G /tmp/karaf-0.19.3-SNAPSHOT/data/log/karaf.log 09:16:05 + set +e 09:16:05 ++ seq 1 3 09:16:05 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") 09:16:05 + CONTROLLERIP=ODL_SYSTEM_1_IP 09:16:05 + echo 'Let'\''s take the karaf thread dump again' 09:16:05 Let's take the karaf thread dump again 09:16:05 + ssh 10.30.171.124 'sudo ps aux' 09:16:05 Warning: Permanently added '10.30.171.124' (ECDSA) to the list of known hosts. 09:16:06 ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-ask-all-potassium/ps_after.log 09:16:06 ++ cut -f2 '-d ' 09:16:06 ++ grep -v grep 09:16:06 ++ tr -s ' ' 09:16:06 + pid=31279 09:16:06 + echo 'karaf main: org.apache.karaf.main.Main, pid:31279' 09:16:06 karaf main: org.apache.karaf.main.Main, pid:31279 09:16:06 + ssh 10.30.171.124 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 31279' 09:16:06 Warning: Permanently added '10.30.171.124' (ECDSA) to the list of known hosts. 09:16:06 + echo 'killing karaf process...' 09:16:06 killing karaf process... 09:16:06 + ssh 10.30.171.124 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh' 09:16:06 Warning: Permanently added '10.30.171.124' (ECDSA) to the list of known hosts. 09:16:06 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") 09:16:06 + CONTROLLERIP=ODL_SYSTEM_2_IP 09:16:06 + echo 'Let'\''s take the karaf thread dump again' 09:16:06 Let's take the karaf thread dump again 09:16:06 + ssh 10.30.171.236 'sudo ps aux' 09:16:07 Warning: Permanently added '10.30.171.236' (ECDSA) to the list of known hosts. 09:16:07 ++ tr -s ' ' 09:16:07 ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-ask-all-potassium/ps_after.log 09:16:07 ++ cut -f2 '-d ' 09:16:07 ++ grep -v grep 09:16:07 + pid=7715 09:16:07 + echo 'karaf main: org.apache.karaf.main.Main, pid:7715' 09:16:07 karaf main: org.apache.karaf.main.Main, pid:7715 09:16:07 + ssh 10.30.171.236 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 7715' 09:16:07 Warning: Permanently added '10.30.171.236' (ECDSA) to the list of known hosts. 09:16:19 7715: Unable to open socket file /proc/7715/root/tmp/.java_pid7715: target process 7715 doesn't respond within 10500ms or HotSpot VM not loaded 09:16:19 + true 09:16:19 + echo 'killing karaf process...' 09:16:19 killing karaf process... 09:16:19 + ssh 10.30.171.236 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh' 09:16:19 Warning: Permanently added '10.30.171.236' (ECDSA) to the list of known hosts. 09:16:20 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") 09:16:20 + CONTROLLERIP=ODL_SYSTEM_3_IP 09:16:20 + echo 'Let'\''s take the karaf thread dump again' 09:16:20 Let's take the karaf thread dump again 09:16:20 + ssh 10.30.170.187 'sudo ps aux' 09:16:20 Warning: Permanently added '10.30.170.187' (ECDSA) to the list of known hosts. 09:16:20 ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-ask-all-potassium/ps_after.log 09:16:20 ++ grep -v grep 09:16:20 ++ tr -s ' ' 09:16:20 ++ cut -f2 '-d ' 09:16:20 + pid=26591 09:16:20 + echo 'karaf main: org.apache.karaf.main.Main, pid:26591' 09:16:20 karaf main: org.apache.karaf.main.Main, pid:26591 09:16:20 + ssh 10.30.170.187 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 26591' 09:16:20 Warning: Permanently added '10.30.170.187' (ECDSA) to the list of known hosts. 09:16:21 + echo 'killing karaf process...' 09:16:21 killing karaf process... 09:16:21 + ssh 10.30.170.187 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh' 09:16:21 Warning: Permanently added '10.30.170.187' (ECDSA) to the list of known hosts. 09:16:21 + sleep 5 09:16:26 ++ seq 1 3 09:16:26 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") 09:16:26 + CONTROLLERIP=ODL_SYSTEM_1_IP 09:16:26 + echo 'Compressing karaf.log 1' 09:16:26 Compressing karaf.log 1 09:16:26 + ssh 10.30.171.124 gzip --best /tmp/karaf-0.19.3-SNAPSHOT/data/log/karaf.log 09:16:26 Warning: Permanently added '10.30.171.124' (ECDSA) to the list of known hosts. 09:16:26 + echo 'Fetching compressed karaf.log 1' 09:16:26 Fetching compressed karaf.log 1 09:16:26 + scp 10.30.171.124:/tmp/karaf-0.19.3-SNAPSHOT/data/log/karaf.log.gz odl1_karaf.log.gz 09:16:26 Warning: Permanently added '10.30.171.124' (ECDSA) to the list of known hosts. 09:16:27 + ssh 10.30.171.124 rm -f /tmp/karaf-0.19.3-SNAPSHOT/data/log/karaf.log.gz 09:16:27 Warning: Permanently added '10.30.171.124' (ECDSA) to the list of known hosts. 09:16:27 + scp 10.30.171.124:/tmp/karaf-0.19.3-SNAPSHOT/data/log/karaf_console.log odl1_karaf_console.log 09:16:27 Warning: Permanently added '10.30.171.124' (ECDSA) to the list of known hosts. 09:16:27 + ssh 10.30.171.124 rm -f /tmp/karaf-0.19.3-SNAPSHOT/data/log/karaf_console.log 09:16:27 Warning: Permanently added '10.30.171.124' (ECDSA) to the list of known hosts. 09:16:27 + echo 'Fetch GC logs' 09:16:27 Fetch GC logs 09:16:27 + mkdir -p gclogs-1 09:16:27 + scp '10.30.171.124:/tmp/karaf-0.19.3-SNAPSHOT/data/log/*.log' gclogs-1/ 09:16:27 Warning: Permanently added '10.30.171.124' (ECDSA) to the list of known hosts. 09:16:27 scp: /tmp/karaf-0.19.3-SNAPSHOT/data/log/*.log: No such file or directory 09:16:27 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") 09:16:27 + CONTROLLERIP=ODL_SYSTEM_2_IP 09:16:27 + echo 'Compressing karaf.log 2' 09:16:27 Compressing karaf.log 2 09:16:27 + ssh 10.30.171.236 gzip --best /tmp/karaf-0.19.3-SNAPSHOT/data/log/karaf.log 09:16:28 Warning: Permanently added '10.30.171.236' (ECDSA) to the list of known hosts. 09:16:35 + echo 'Fetching compressed karaf.log 2' 09:16:35 Fetching compressed karaf.log 2 09:16:35 + scp 10.30.171.236:/tmp/karaf-0.19.3-SNAPSHOT/data/log/karaf.log.gz odl2_karaf.log.gz 09:16:35 Warning: Permanently added '10.30.171.236' (ECDSA) to the list of known hosts. 09:16:35 + ssh 10.30.171.236 rm -f /tmp/karaf-0.19.3-SNAPSHOT/data/log/karaf.log.gz 09:16:35 Warning: Permanently added '10.30.171.236' (ECDSA) to the list of known hosts. 09:16:36 + scp 10.30.171.236:/tmp/karaf-0.19.3-SNAPSHOT/data/log/karaf_console.log odl2_karaf_console.log 09:16:36 Warning: Permanently added '10.30.171.236' (ECDSA) to the list of known hosts. 09:16:38 + ssh 10.30.171.236 rm -f /tmp/karaf-0.19.3-SNAPSHOT/data/log/karaf_console.log 09:16:38 Warning: Permanently added '10.30.171.236' (ECDSA) to the list of known hosts. 09:16:38 + echo 'Fetch GC logs' 09:16:38 Fetch GC logs 09:16:38 + mkdir -p gclogs-2 09:16:38 + scp '10.30.171.236:/tmp/karaf-0.19.3-SNAPSHOT/data/log/*.log' gclogs-2/ 09:16:38 Warning: Permanently added '10.30.171.236' (ECDSA) to the list of known hosts. 09:16:39 scp: /tmp/karaf-0.19.3-SNAPSHOT/data/log/*.log: No such file or directory 09:16:39 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") 09:16:39 + CONTROLLERIP=ODL_SYSTEM_3_IP 09:16:39 + echo 'Compressing karaf.log 3' 09:16:39 Compressing karaf.log 3 09:16:39 + ssh 10.30.170.187 gzip --best /tmp/karaf-0.19.3-SNAPSHOT/data/log/karaf.log 09:16:39 Warning: Permanently added '10.30.170.187' (ECDSA) to the list of known hosts. 09:16:45 + echo 'Fetching compressed karaf.log 3' 09:16:45 Fetching compressed karaf.log 3 09:16:45 + scp 10.30.170.187:/tmp/karaf-0.19.3-SNAPSHOT/data/log/karaf.log.gz odl3_karaf.log.gz 09:16:45 Warning: Permanently added '10.30.170.187' (ECDSA) to the list of known hosts. 09:16:45 + ssh 10.30.170.187 rm -f /tmp/karaf-0.19.3-SNAPSHOT/data/log/karaf.log.gz 09:16:45 Warning: Permanently added '10.30.170.187' (ECDSA) to the list of known hosts. 09:16:45 + scp 10.30.170.187:/tmp/karaf-0.19.3-SNAPSHOT/data/log/karaf_console.log odl3_karaf_console.log 09:16:45 Warning: Permanently added '10.30.170.187' (ECDSA) to the list of known hosts. 09:16:45 + ssh 10.30.170.187 rm -f /tmp/karaf-0.19.3-SNAPSHOT/data/log/karaf_console.log 09:16:45 Warning: Permanently added '10.30.170.187' (ECDSA) to the list of known hosts. 09:16:46 + echo 'Fetch GC logs' 09:16:46 Fetch GC logs 09:16:46 + mkdir -p gclogs-3 09:16:46 + scp '10.30.170.187:/tmp/karaf-0.19.3-SNAPSHOT/data/log/*.log' gclogs-3/ 09:16:46 Warning: Permanently added '10.30.170.187' (ECDSA) to the list of known hosts. 09:16:46 scp: /tmp/karaf-0.19.3-SNAPSHOT/data/log/*.log: No such file or directory 09:16:46 + echo 'Examine copied files' 09:16:46 Examine copied files 09:16:46 + ls -lt 09:16:46 total 63432 09:16:46 drwxrwxr-x. 2 jenkins jenkins 6 Apr 7 09:16 gclogs-3 09:16:46 -rw-rw-r--. 1 jenkins jenkins 11017 Apr 7 09:16 odl3_karaf_console.log 09:16:46 -rw-rw-r--. 1 jenkins jenkins 4514331 Apr 7 09:16 odl3_karaf.log.gz 09:16:46 drwxrwxr-x. 2 jenkins jenkins 6 Apr 7 09:16 gclogs-2 09:16:46 -rw-rw-r--. 1 jenkins jenkins 1720 Apr 7 09:16 odl2_karaf_console.log 09:16:46 -rw-rw-r--. 1 jenkins jenkins 4319900 Apr 7 09:16 odl2_karaf.log.gz 09:16:46 drwxrwxr-x. 2 jenkins jenkins 6 Apr 7 09:16 gclogs-1 09:16:46 -rw-rw-r--. 1 jenkins jenkins 1720 Apr 7 09:16 odl1_karaf_console.log 09:16:46 -rw-rw-r--. 1 jenkins jenkins 996193 Apr 7 09:16 odl1_karaf.log.gz 09:16:46 -rw-rw-r--. 1 jenkins jenkins 124260 Apr 7 09:16 karaf_3_26591_threads_after.log 09:16:46 -rw-rw-r--. 1 jenkins jenkins 16084 Apr 7 09:16 ps_after.log 09:16:46 -rw-rw-r--. 1 jenkins jenkins 0 Apr 7 09:16 karaf_2_7715_threads_after.log 09:16:46 -rw-rw-r--. 1 jenkins jenkins 130455 Apr 7 09:16 karaf_1_31279_threads_after.log 09:16:46 -rw-rw-r--. 1 jenkins jenkins 305145 Apr 7 09:16 report.html 09:16:46 -rw-rw-r--. 1 jenkins jenkins 3097896 Apr 7 09:16 log.html 09:16:46 -rw-rw-r--. 1 jenkins jenkins 50885731 Apr 7 09:15 output.xml 09:16:46 -rw-rw-r--. 1 jenkins jenkins 4149 Apr 7 05:39 testplan.txt 09:16:46 -rw-rw-r--. 1 jenkins jenkins 144917 Apr 7 05:39 karaf_3_5753_threads_before.log 09:16:46 -rw-rw-r--. 1 jenkins jenkins 16354 Apr 7 05:39 ps_before.log 09:16:46 -rw-rw-r--. 1 jenkins jenkins 149609 Apr 7 05:39 karaf_2_5762_threads_before.log 09:16:46 -rw-rw-r--. 1 jenkins jenkins 142368 Apr 7 05:39 karaf_1_5795_threads_before.log 09:16:46 -rw-rw-r--. 1 jenkins jenkins 3106 Apr 7 05:38 post-startup-script.sh 09:16:46 -rw-rw-r--. 1 jenkins jenkins 252 Apr 7 05:38 startup-script.sh 09:16:46 -rw-rw-r--. 1 jenkins jenkins 3452 Apr 7 05:38 configuration-script.sh 09:16:46 -rw-rw-r--. 1 jenkins jenkins 695 Apr 7 05:38 custom_shard_config.txt 09:16:46 -rw-rw-r--. 1 jenkins jenkins 136 Apr 7 05:38 scriptplan.txt 09:16:46 -rw-rw-r--. 1 jenkins jenkins 335 Apr 7 05:38 detect_variables.env 09:16:46 -rw-rw-r--. 1 jenkins jenkins 2620 Apr 7 05:38 pom.xml 09:16:46 -rw-rw-r--. 1 jenkins jenkins 86 Apr 7 05:38 set_variables.env 09:16:46 -rw-rw-r--. 1 jenkins jenkins 314 Apr 7 05:38 slave_addresses.txt 09:16:46 -rw-rw-r--. 1 jenkins jenkins 570 Apr 7 05:37 requirements.txt 09:16:46 -rw-rw-r--. 1 jenkins jenkins 26 Apr 7 05:37 env.properties 09:16:46 -rw-rw-r--. 1 jenkins jenkins 335 Apr 7 05:35 stack-parameters.yaml 09:16:46 drwxrwxr-x. 7 jenkins jenkins 4096 Apr 7 05:34 test 09:16:46 drwxrwxr-x. 2 jenkins jenkins 6 Apr 7 05:34 test@tmp 09:16:46 -rw-rw-r--. 1 jenkins jenkins 1404 Apr 6 18:54 maven-metadata.xml 09:16:46 + true 09:16:46 [controller-csit-3node-clustering-ask-all-potassium] $ /bin/sh /tmp/jenkins13121701303250666008.sh 09:16:46 Cleaning up Robot installation... 09:16:46 $ ssh-agent -k 09:16:46 unset SSH_AUTH_SOCK; 09:16:46 unset SSH_AGENT_PID; 09:16:46 echo Agent pid 5272 killed; 09:16:46 [ssh-agent] Stopped. 09:16:46 Recording plot data 09:16:46 Robot results publisher started... 09:16:46 INFO: Checking test criticality is deprecated and will be dropped in a future release! 09:16:46 -Parsing output xml: 09:16:49 Done! 09:16:49 -Copying log files to build dir: 09:16:50 Done! 09:16:50 -Assigning results to build: 09:16:51 Done! 09:16:51 -Checking thresholds: 09:16:51 Done! 09:16:51 Done publishing Robot results. 09:16:51 Build step 'Publish Robot Framework test results' changed build result to UNSTABLE 09:16:51 [PostBuildScript] - [INFO] Executing post build scripts. 09:16:51 [controller-csit-3node-clustering-ask-all-potassium] $ /bin/bash /tmp/jenkins536388226708291838.sh 09:16:51 Archiving csit artifacts 09:16:51 mv: cannot stat '*_1.png': No such file or directory 09:16:51 mv: cannot stat '/tmp/odl1_*': No such file or directory 09:16:51 mv: cannot stat '*_2.png': No such file or directory 09:16:51 mv: cannot stat '/tmp/odl2_*': No such file or directory 09:16:51 mv: cannot stat '*_3.png': No such file or directory 09:16:51 mv: cannot stat '/tmp/odl3_*': No such file or directory 09:16:51 % Total % Received % Xferd Average Speed Time Time Time Current 09:16:51 Dload Upload Total Spent Left Speed 09:16:51 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 360k 0 360k 0 0 1348k 0 --:--:-- --:--:-- --:--:-- 1343k 100 4597k 0 4597k 0 0 4374k 0 --:--:-- 0:00:01 --:--:-- 4374k 09:16:52 Archive: robot-plugin.zip 09:16:52 inflating: ./archives/robot-plugin/log.html 09:16:52 inflating: ./archives/robot-plugin/output.xml 09:16:52 inflating: ./archives/robot-plugin/report.html 09:16:52 mv: cannot stat '*.log.gz': No such file or directory 09:16:52 mv: cannot stat '*.csv': No such file or directory 09:16:52 mv: cannot stat '*.png': No such file or directory 09:16:52 [PostBuildScript] - [INFO] Executing post build scripts. 09:16:52 [controller-csit-3node-clustering-ask-all-potassium] $ /bin/bash /tmp/jenkins1623016217913357851.sh 09:16:52 [PostBuildScript] - [INFO] Executing post build scripts. 09:16:52 [EnvInject] - Injecting environment variables from a build step. 09:16:52 [EnvInject] - Injecting as environment variables the properties content 09:16:52 OS_CLOUD=vex 09:16:52 OS_STACK_NAME=releng-controller-csit-3node-clustering-ask-all-potassium-38 09:16:52 09:16:52 [EnvInject] - Variables injected successfully. 09:16:52 provisioning config files... 09:16:53 copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml 09:16:53 [controller-csit-3node-clustering-ask-all-potassium] $ /bin/bash /tmp/jenkins14343945862083009306.sh 09:16:53 ---> openstack-stack-delete.sh 09:16:53 Setup pyenv: 09:16:53 system 09:16:53 3.8.13 09:16:53 3.9.13 09:16:53 3.10.13 09:16:53 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-ask-all-potassium/.python-version) 09:16:53 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-A0mX from file:/tmp/.os_lf_venv 09:16:55 lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes python-heatclient python-openstackclient 09:17:14 lf-activate-venv(): INFO: Adding /tmp/venv-A0mX/bin to PATH 09:17:14 INFO: Retrieving stack cost for: releng-controller-csit-3node-clustering-ask-all-potassium-38 09:17:18 DEBUG: Successfully retrieved stack cost: total: 1.32 09:17:30 INFO: Deleting stack releng-controller-csit-3node-clustering-ask-all-potassium-38 09:17:30 Successfully deleted stack releng-controller-csit-3node-clustering-ask-all-potassium-38 09:17:30 [PostBuildScript] - [INFO] Executing post build scripts. 09:17:30 [controller-csit-3node-clustering-ask-all-potassium] $ /bin/bash /tmp/jenkins1105958187555471495.sh 09:17:30 ---> sysstat.sh 09:17:31 [controller-csit-3node-clustering-ask-all-potassium] $ /bin/bash /tmp/jenkins1076799298448832474.sh 09:17:31 ---> package-listing.sh 09:17:31 ++ facter osfamily 09:17:31 ++ tr '[:upper:]' '[:lower:]' 09:17:31 + OS_FAMILY=redhat 09:17:31 + workspace=/w/workspace/controller-csit-3node-clustering-ask-all-potassium 09:17:31 + START_PACKAGES=/tmp/packages_start.txt 09:17:31 + END_PACKAGES=/tmp/packages_end.txt 09:17:31 + DIFF_PACKAGES=/tmp/packages_diff.txt 09:17:31 + PACKAGES=/tmp/packages_start.txt 09:17:31 + '[' /w/workspace/controller-csit-3node-clustering-ask-all-potassium ']' 09:17:31 + PACKAGES=/tmp/packages_end.txt 09:17:31 + case "${OS_FAMILY}" in 09:17:31 + rpm -qa 09:17:31 + sort 09:17:31 + '[' -f /tmp/packages_start.txt ']' 09:17:31 + '[' -f /tmp/packages_end.txt ']' 09:17:31 + diff /tmp/packages_start.txt /tmp/packages_end.txt 09:17:31 + '[' /w/workspace/controller-csit-3node-clustering-ask-all-potassium ']' 09:17:31 + mkdir -p /w/workspace/controller-csit-3node-clustering-ask-all-potassium/archives/ 09:17:31 + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/controller-csit-3node-clustering-ask-all-potassium/archives/ 09:17:31 [controller-csit-3node-clustering-ask-all-potassium] $ /bin/bash /tmp/jenkins10260341502916924871.sh 09:17:31 ---> capture-instance-metadata.sh 09:17:32 Setup pyenv: 09:17:32 system 09:17:32 3.8.13 09:17:32 3.9.13 09:17:32 3.10.13 09:17:32 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-ask-all-potassium/.python-version) 09:17:32 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-A0mX from file:/tmp/.os_lf_venv 09:17:33 lf-activate-venv(): INFO: Installing: lftools 09:17:43 lf-activate-venv(): INFO: Adding /tmp/venv-A0mX/bin to PATH 09:17:43 INFO: Running in OpenStack, capturing instance metadata 09:17:44 [controller-csit-3node-clustering-ask-all-potassium] $ /bin/bash /tmp/jenkins11074689110508388298.sh 09:17:44 provisioning config files... 09:17:45 Could not find credentials [logs] for controller-csit-3node-clustering-ask-all-potassium #38 09:17:45 copy managed file [jenkins-log-archives-settings] to file:/w/workspace/controller-csit-3node-clustering-ask-all-potassium@tmp/config17322734498772103705tmp 09:17:45 Regular expression run condition: Expression=[^.*logs-s3.*], Label=[odl-logs-s3-cloudfront-index] 09:17:45 Run condition [Regular expression match] enabling perform for step [Provide Configuration files] 09:17:45 provisioning config files... 09:17:45 copy managed file [jenkins-s3-log-ship] to file:/home/jenkins/.aws/credentials 09:17:45 [EnvInject] - Injecting environment variables from a build step. 09:17:45 [EnvInject] - Injecting as environment variables the properties content 09:17:45 SERVER_ID=logs 09:17:45 09:17:45 [EnvInject] - Variables injected successfully. 09:17:45 [controller-csit-3node-clustering-ask-all-potassium] $ /bin/bash /tmp/jenkins11917901988900609833.sh 09:17:45 ---> create-netrc.sh 09:17:45 WARN: Log server credential not found. 09:17:45 [controller-csit-3node-clustering-ask-all-potassium] $ /bin/bash /tmp/jenkins16260950018336857965.sh 09:17:45 ---> python-tools-install.sh 09:17:45 Setup pyenv: 09:17:45 system 09:17:45 3.8.13 09:17:45 3.9.13 09:17:45 3.10.13 09:17:45 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-ask-all-potassium/.python-version) 09:17:45 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-A0mX from file:/tmp/.os_lf_venv 09:17:47 lf-activate-venv(): INFO: Installing: lftools 09:17:57 lf-activate-venv(): INFO: Adding /tmp/venv-A0mX/bin to PATH 09:17:57 [controller-csit-3node-clustering-ask-all-potassium] $ /bin/bash /tmp/jenkins7138073181858953902.sh 09:17:57 ---> sudo-logs.sh 09:17:57 Archiving 'sudo' log.. 09:17:57 [controller-csit-3node-clustering-ask-all-potassium] $ /bin/bash /tmp/jenkins8108172046872696092.sh 09:17:57 ---> job-cost.sh 09:17:57 Setup pyenv: 09:17:57 system 09:17:57 3.8.13 09:17:57 3.9.13 09:17:57 3.10.13 09:17:57 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-ask-all-potassium/.python-version) 09:17:57 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-A0mX from file:/tmp/.os_lf_venv 09:17:59 lf-activate-venv(): INFO: Installing: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 09:18:06 lf-activate-venv(): INFO: Adding /tmp/venv-A0mX/bin to PATH 09:18:06 DEBUG: total: 1.32 09:18:06 INFO: Retrieving Stack Cost... 09:18:07 INFO: Retrieving Pricing Info for: v3-standard-2 09:18:07 INFO: Archiving Costs 09:18:07 [controller-csit-3node-clustering-ask-all-potassium] $ /bin/bash -l /tmp/jenkins13004337420922411683.sh 09:18:07 ---> logs-deploy.sh 09:18:07 Setup pyenv: 09:18:07 system 09:18:08 3.8.13 09:18:08 3.9.13 09:18:08 3.10.13 09:18:08 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-ask-all-potassium/.python-version) 09:18:08 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-A0mX from file:/tmp/.os_lf_venv 09:18:09 lf-activate-venv(): INFO: Installing: lftools 09:19:05 lf-activate-venv(): INFO: Adding /tmp/venv-A0mX/bin to PATH 09:19:05 WARNING: Nexus logging server not set 09:19:05 INFO: S3 path logs/releng/vex-yul-odl-jenkins-1/controller-csit-3node-clustering-ask-all-potassium/38/ 09:19:05 INFO: archiving logs to S3 09:19:07 ---> uname -a: 09:19:07 Linux prd-centos8-robot-2c-8g-5619.novalocal 4.18.0-547.el8.x86_64 #1 SMP Wed Mar 20 00:35:01 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux 09:19:07 09:19:07 09:19:07 ---> lscpu: 09:19:07 Architecture: x86_64 09:19:07 CPU op-mode(s): 32-bit, 64-bit 09:19:07 Byte Order: Little Endian 09:19:07 CPU(s): 2 09:19:07 On-line CPU(s) list: 0,1 09:19:07 Thread(s) per core: 1 09:19:07 Core(s) per socket: 1 09:19:07 Socket(s): 2 09:19:07 NUMA node(s): 1 09:19:07 Vendor ID: AuthenticAMD 09:19:07 CPU family: 23 09:19:07 Model: 49 09:19:07 Model name: AMD EPYC-Rome Processor 09:19:07 Stepping: 0 09:19:07 CPU MHz: 2799.998 09:19:07 BogoMIPS: 5599.99 09:19:07 Virtualization: AMD-V 09:19:07 Hypervisor vendor: KVM 09:19:07 Virtualization type: full 09:19:07 L1d cache: 32K 09:19:07 L1i cache: 32K 09:19:07 L2 cache: 512K 09:19:07 L3 cache: 16384K 09:19:07 NUMA node0 CPU(s): 0,1 09:19:07 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities 09:19:07 09:19:07 09:19:07 ---> nproc: 09:19:07 2 09:19:07 09:19:07 09:19:07 ---> df -h: 09:19:07 Filesystem Size Used Avail Use% Mounted on 09:19:07 devtmpfs 3.8G 0 3.8G 0% /dev 09:19:07 tmpfs 3.8G 0 3.8G 0% /dev/shm 09:19:07 tmpfs 3.8G 17M 3.8G 1% /run 09:19:07 tmpfs 3.8G 0 3.8G 0% /sys/fs/cgroup 09:19:07 /dev/vda1 40G 9.6G 31G 24% / 09:19:07 tmpfs 770M 0 770M 0% /run/user/1001 09:19:07 09:19:07 09:19:07 ---> free -m: 09:19:07 total used free shared buff/cache available 09:19:07 Mem: 7697 609 4683 19 2405 6791 09:19:07 Swap: 1023 0 1023 09:19:07 09:19:07 09:19:07 ---> ip addr: 09:19:07 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 09:19:07 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 09:19:07 inet 127.0.0.1/8 scope host lo 09:19:07 valid_lft forever preferred_lft forever 09:19:07 inet6 ::1/128 scope host 09:19:07 valid_lft forever preferred_lft forever 09:19:07 2: eth0: mtu 1458 qdisc mq state UP group default qlen 1000 09:19:07 link/ether fa:16:3e:ba:6d:99 brd ff:ff:ff:ff:ff:ff 09:19:07 altname enp0s3 09:19:07 altname ens3 09:19:07 inet 10.30.170.160/23 brd 10.30.171.255 scope global dynamic noprefixroute eth0 09:19:07 valid_lft 72842sec preferred_lft 72842sec 09:19:07 inet6 fe80::f816:3eff:feba:6d99/64 scope link 09:19:07 valid_lft forever preferred_lft forever 09:19:07 09:19:07 09:19:07 ---> sar -b -r -n DEV: 09:19:07 Linux 4.18.0-547.el8.x86_64 (centos-stream-8-robot-8eca76b2-cb40-4fba-ac9e-845c8a03a7a7.noval) 04/07/2024 _x86_64_ (2 CPU) 09:19:07 09:19:07 05:33:04 LINUX RESTART (2 CPU) 09:19:07 09:19:07 05:34:02 AM tps rtps wtps bread/s bwrtn/s 09:19:07 05:35:01 AM 93.21 13.01 80.19 2426.16 6429.40 09:19:07 05:36:01 AM 76.19 0.75 75.44 52.52 8496.87 09:19:07 05:37:01 AM 19.58 0.85 18.73 123.96 1656.46 09:19:07 05:38:01 AM 24.44 0.17 24.28 9.46 1815.34 09:19:07 05:39:01 AM 47.57 2.55 45.02 397.07 6885.47 09:19:07 05:40:01 AM 2.78 0.00 2.78 0.00 85.74 09:19:07 05:41:01 AM 2.03 0.00 2.03 0.00 100.28 09:19:07 05:42:01 AM 0.52 0.00 0.52 0.00 19.10 09:19:07 05:43:01 AM 0.20 0.00 0.20 0.00 7.63 09:19:07 05:44:01 AM 0.33 0.00 0.33 0.00 20.73 09:19:07 05:45:01 AM 0.15 0.00 0.15 0.00 13.75 09:19:07 05:46:01 AM 0.35 0.00 0.35 0.00 21.25 09:19:07 05:47:01 AM 0.22 0.03 0.18 1.87 11.35 09:19:07 05:48:01 AM 0.17 0.00 0.17 0.00 12.30 09:19:07 05:49:01 AM 0.57 0.03 0.53 0.27 18.66 09:19:07 05:50:01 AM 0.27 0.00 0.27 0.00 25.24 09:19:07 05:51:01 AM 0.18 0.00 0.18 0.00 13.30 09:19:07 05:52:01 AM 0.28 0.00 0.28 0.00 25.00 09:19:07 05:53:01 AM 0.22 0.02 0.20 0.13 67.64 09:19:07 05:54:01 AM 0.73 0.00 0.73 0.00 22.90 09:19:07 05:55:01 AM 0.22 0.00 0.22 0.00 11.71 09:19:07 05:56:01 AM 0.22 0.00 0.22 0.00 12.18 09:19:07 05:57:01 AM 0.52 0.00 0.52 0.00 20.40 09:19:07 05:58:01 AM 0.47 0.00 0.47 0.00 15.58 09:19:07 05:59:01 AM 0.63 0.00 0.63 0.00 24.63 09:19:07 06:00:01 AM 0.15 0.00 0.15 0.00 8.93 09:19:07 06:01:01 AM 0.28 0.02 0.27 0.13 15.89 09:19:07 06:02:01 AM 0.40 0.07 0.33 1.73 12.49 09:19:07 06:03:01 AM 0.23 0.00 0.23 0.00 8.52 09:19:07 06:04:01 AM 0.33 0.00 0.33 0.00 6.21 09:19:07 06:05:01 AM 0.18 0.00 0.18 0.00 11.75 09:19:07 06:06:01 AM 0.33 0.00 0.33 0.00 8.75 09:19:07 06:07:01 AM 0.13 0.00 0.13 0.00 9.33 09:19:07 06:08:01 AM 0.13 0.00 0.13 0.00 15.08 09:19:07 06:09:01 AM 0.37 0.00 0.37 0.00 12.21 09:19:07 06:10:01 AM 0.12 0.00 0.12 0.00 0.77 09:19:07 06:11:01 AM 34.76 27.36 7.40 1133.49 4721.09 09:19:07 06:12:01 AM 0.87 0.00 0.87 0.00 17.05 09:19:07 06:13:01 AM 0.15 0.00 0.15 0.00 1.28 09:19:07 06:14:01 AM 0.38 0.00 0.38 0.00 9.03 09:19:07 06:15:01 AM 0.25 0.00 0.25 0.00 3.43 09:19:07 06:16:01 AM 0.18 0.00 0.18 0.00 9.50 09:19:07 06:17:01 AM 0.15 0.00 0.15 0.00 6.68 09:19:07 06:18:01 AM 0.13 0.00 0.13 0.00 11.06 09:19:07 06:19:01 AM 0.27 0.00 0.27 0.00 10.25 09:19:07 06:20:01 AM 0.28 0.00 0.28 0.00 13.61 09:19:07 06:21:01 AM 0.22 0.00 0.22 0.00 10.40 09:19:07 06:22:01 AM 0.23 0.00 0.23 0.00 15.83 09:19:07 06:23:01 AM 0.20 0.00 0.20 0.00 23.91 09:19:07 06:24:01 AM 0.30 0.00 0.30 0.00 8.10 09:19:07 06:25:01 AM 0.13 0.00 0.13 0.00 2.92 09:19:07 06:26:01 AM 0.12 0.00 0.12 0.00 0.78 09:19:07 06:27:01 AM 0.13 0.00 0.13 0.00 2.78 09:19:07 06:28:01 AM 0.10 0.00 0.10 0.00 0.63 09:19:07 06:29:02 AM 0.25 0.00 0.25 0.00 5.45 09:19:07 06:30:01 AM 0.12 0.00 0.12 0.00 1.22 09:19:07 06:31:01 AM 0.42 0.00 0.42 0.00 12.11 09:19:07 06:32:01 AM 0.28 0.00 0.28 0.00 6.20 09:19:07 06:33:01 AM 0.15 0.00 0.15 0.00 5.87 09:19:07 06:34:01 AM 0.15 0.00 0.15 0.00 1.50 09:19:07 06:35:01 AM 0.23 0.00 0.23 0.00 8.73 09:19:07 06:36:01 AM 0.17 0.00 0.17 0.00 2.93 09:19:07 06:37:01 AM 0.17 0.00 0.17 0.00 6.02 09:19:07 06:38:01 AM 0.27 0.00 0.27 0.00 6.83 09:19:07 06:39:01 AM 0.30 0.00 0.30 0.00 5.65 09:19:07 06:40:01 AM 0.38 0.00 0.38 0.00 11.56 09:19:07 06:41:01 AM 0.45 0.00 0.45 0.00 5.78 09:19:07 06:42:01 AM 0.32 0.00 0.32 0.00 8.21 09:19:07 06:43:01 AM 0.12 0.00 0.12 0.00 1.32 09:19:07 06:44:01 AM 0.13 0.00 0.13 0.00 1.50 09:19:07 06:45:01 AM 0.30 0.00 0.30 0.00 9.27 09:19:07 06:46:01 AM 0.35 0.00 0.35 0.00 13.58 09:19:07 06:47:01 AM 0.13 0.00 0.13 0.00 14.81 09:19:07 06:48:01 AM 1.15 0.30 0.85 6.40 31.81 09:19:07 06:49:01 AM 0.32 0.00 0.32 0.00 13.01 09:19:07 06:50:01 AM 0.13 0.00 0.13 0.00 15.33 09:19:07 06:51:01 AM 0.28 0.00 0.28 0.00 16.14 09:19:07 06:52:01 AM 0.20 0.00 0.20 0.00 19.48 09:19:07 06:53:01 AM 0.13 0.00 0.13 0.00 3.18 09:19:07 06:54:01 AM 0.28 0.00 0.28 0.00 4.50 09:19:07 06:55:01 AM 0.17 0.00 0.17 0.00 2.97 09:19:07 06:56:01 AM 0.17 0.00 0.17 0.00 2.12 09:19:07 06:57:01 AM 0.13 0.00 0.13 0.00 2.82 09:19:07 06:58:01 AM 0.17 0.00 0.17 0.00 7.77 09:19:07 06:59:01 AM 0.43 0.00 0.43 0.00 8.88 09:19:07 07:00:01 AM 0.17 0.00 0.17 0.00 6.55 09:19:07 07:01:01 AM 0.18 0.00 0.18 0.00 20.43 09:19:07 07:02:01 AM 0.17 0.00 0.17 0.00 2.78 09:19:07 07:03:01 AM 0.20 0.00 0.20 0.00 2.37 09:19:07 07:04:01 AM 0.37 0.00 0.37 0.00 57.44 09:19:07 07:05:01 AM 0.15 0.00 0.15 0.00 32.79 09:19:07 07:06:01 AM 0.13 0.00 0.13 0.00 18.26 09:19:07 07:07:01 AM 0.15 0.00 0.15 0.00 10.00 09:19:07 07:08:01 AM 0.30 0.00 0.30 0.00 14.40 09:19:07 07:09:01 AM 0.25 0.00 0.25 0.00 10.48 09:19:07 07:10:01 AM 0.15 0.00 0.15 0.00 15.19 09:19:07 07:11:01 AM 0.32 0.00 0.32 0.00 17.38 09:19:07 07:12:01 AM 0.23 0.00 0.23 0.00 10.95 09:19:07 07:13:01 AM 0.13 0.00 0.13 0.00 13.60 09:19:07 07:14:01 AM 0.35 0.00 0.35 0.00 28.66 09:19:07 07:15:01 AM 0.42 0.00 0.42 0.00 8.03 09:19:07 07:16:01 AM 0.37 0.00 0.37 0.00 4.43 09:19:07 07:17:01 AM 1.12 0.00 1.12 0.00 18.76 09:19:07 07:18:01 AM 0.15 0.00 0.15 0.00 1.45 09:19:07 07:19:01 AM 0.23 0.00 0.23 0.00 3.65 09:19:07 07:20:01 AM 0.15 0.00 0.15 0.00 3.10 09:19:07 07:21:01 AM 0.27 0.00 0.27 0.00 3.32 09:19:07 07:22:01 AM 0.22 0.00 0.22 0.00 8.56 09:19:07 07:23:01 AM 0.17 0.00 0.17 0.00 2.98 09:19:07 07:24:01 AM 0.35 0.00 0.35 0.00 9.87 09:19:07 07:25:01 AM 0.18 0.00 0.18 0.00 1.33 09:19:07 07:26:01 AM 0.12 0.00 0.12 0.00 3.75 09:19:07 07:27:01 AM 0.15 0.00 0.15 0.00 2.95 09:19:07 07:28:01 AM 0.37 0.00 0.37 0.00 9.08 09:19:07 07:29:01 AM 0.37 0.00 0.37 0.00 9.86 09:19:07 07:30:01 AM 0.13 0.00 0.13 0.00 1.43 09:19:07 07:31:01 AM 0.17 0.00 0.17 0.00 5.10 09:19:07 07:32:02 AM 0.17 0.00 0.17 0.00 14.13 09:19:07 07:33:01 AM 0.14 0.00 0.14 0.00 8.54 09:19:07 07:34:01 AM 0.28 0.00 0.28 0.00 18.36 09:19:07 07:35:01 AM 0.23 0.00 0.23 0.00 15.04 09:19:07 07:36:01 AM 0.20 0.00 0.20 0.00 10.70 09:19:07 07:37:01 AM 0.17 0.00 0.17 0.00 15.76 09:19:07 07:38:01 AM 0.27 0.00 0.27 0.00 24.88 09:19:07 07:39:01 AM 0.40 0.00 0.40 0.00 12.91 09:19:07 07:40:01 AM 0.35 0.00 0.35 0.00 10.20 09:19:07 07:41:01 AM 0.48 0.00 0.48 0.00 12.18 09:19:07 07:42:01 AM 0.52 0.00 0.52 0.00 12.95 09:19:07 07:43:01 AM 0.45 0.00 0.45 0.00 11.23 09:19:07 07:44:01 AM 0.35 0.00 0.35 0.00 12.46 09:19:07 07:45:01 AM 0.25 0.00 0.25 0.00 6.88 09:19:07 07:46:01 AM 0.20 0.00 0.20 0.00 6.26 09:19:07 07:47:01 AM 0.15 0.00 0.15 0.00 2.77 09:19:07 07:48:01 AM 0.15 0.00 0.15 0.00 5.05 09:19:07 07:49:01 AM 0.38 0.00 0.38 0.00 6.98 09:19:07 07:50:01 AM 0.43 0.00 0.43 0.00 9.25 09:19:07 07:51:01 AM 0.55 0.00 0.55 0.00 11.05 09:19:07 07:52:01 AM 0.32 0.00 0.32 0.00 3.57 09:19:07 07:53:01 AM 0.33 0.00 0.33 0.00 8.22 09:19:07 07:54:01 AM 0.25 0.00 0.25 0.00 5.38 09:19:07 07:55:01 AM 0.27 0.00 0.27 0.00 18.08 09:19:07 07:56:01 AM 0.20 0.00 0.20 0.00 10.70 09:19:07 07:57:01 AM 0.17 0.00 0.17 0.00 15.76 09:19:07 07:58:01 AM 0.23 0.00 0.23 0.00 12.68 09:19:07 07:59:01 AM 0.77 0.00 0.77 0.00 21.63 09:19:07 08:00:01 AM 0.52 0.00 0.52 0.00 17.18 09:19:07 08:01:01 AM 0.33 0.00 0.33 0.00 20.33 09:19:07 08:02:01 AM 0.17 0.00 0.17 0.00 4.83 09:19:07 08:03:01 AM 0.22 0.00 0.22 0.00 2.77 09:19:07 08:04:01 AM 0.32 0.00 0.32 0.00 6.90 09:19:07 08:05:01 AM 0.13 0.00 0.13 0.00 1.45 09:19:07 08:06:01 AM 0.08 0.00 0.08 0.00 0.53 09:19:07 08:07:01 AM 0.17 0.00 0.17 0.00 3.22 09:19:07 08:08:01 AM 0.10 0.00 0.10 0.00 0.77 09:19:07 08:09:01 AM 0.28 0.00 0.28 0.00 10.21 09:19:07 08:10:01 AM 0.15 0.00 0.15 0.00 6.41 09:19:07 08:11:01 AM 0.28 0.00 0.28 0.00 3.87 09:19:07 08:12:01 AM 0.22 0.00 0.22 0.00 2.85 09:19:07 08:13:01 AM 0.17 0.00 0.17 0.00 3.65 09:19:07 08:14:01 AM 0.32 0.00 0.32 0.00 9.72 09:19:07 08:15:01 AM 0.13 0.00 0.13 0.00 1.43 09:19:07 08:16:01 AM 0.17 0.00 0.17 0.00 9.61 09:19:07 08:17:01 AM 0.15 0.00 0.15 0.00 14.13 09:19:07 08:18:01 AM 0.13 0.00 0.13 0.00 15.20 09:19:07 08:19:01 AM 0.28 0.00 0.28 0.00 17.43 09:19:07 08:20:01 AM 0.57 0.00 0.57 0.00 17.41 09:19:07 08:21:01 AM 0.25 0.00 0.25 0.00 11.51 09:19:07 08:22:01 AM 0.13 0.00 0.13 0.00 22.40 09:19:07 08:23:01 AM 0.13 0.00 0.13 0.00 7.46 09:19:07 08:24:01 AM 0.30 0.00 0.30 0.00 5.18 09:19:07 08:25:01 AM 0.17 0.00 0.17 0.00 2.67 09:19:07 08:26:01 AM 0.13 0.00 0.13 0.00 1.45 09:19:07 08:27:01 AM 0.22 0.00 0.22 0.00 2.77 09:19:07 08:28:01 AM 0.18 0.00 0.18 0.00 3.37 09:19:07 08:29:01 AM 0.28 0.00 0.28 0.00 4.47 09:19:07 08:30:01 AM 0.23 0.00 0.23 0.00 15.75 09:19:07 08:31:01 AM 0.18 0.00 0.18 0.00 7.91 09:19:07 08:32:01 AM 0.18 0.00 0.18 0.00 15.60 09:19:07 08:33:01 AM 0.18 0.00 0.18 0.00 14.53 09:19:07 08:34:01 AM 0.40 0.00 0.40 0.00 19.85 09:19:07 08:35:01 AM 0.23 0.00 0.23 0.00 14.03 09:19:07 08:36:01 AM 0.28 0.00 0.28 0.00 14.41 09:19:07 08:37:01 AM 0.20 0.00 0.20 0.00 18.40 09:19:07 08:38:01 AM 0.13 0.00 0.13 0.00 2.65 09:19:07 08:39:02 AM 0.25 0.00 0.25 0.00 4.33 09:19:07 08:40:01 AM 0.14 0.00 0.14 0.00 2.32 09:19:07 08:41:01 AM 0.28 0.00 0.28 0.00 3.75 09:19:07 08:42:01 AM 0.20 0.00 0.20 0.00 4.43 09:19:07 08:43:01 AM 0.15 0.00 0.15 0.00 1.45 09:19:07 08:44:01 AM 0.25 0.00 0.25 0.00 10.48 09:19:07 08:45:01 AM 0.13 0.00 0.13 0.00 9.62 09:19:07 08:46:01 AM 0.22 0.00 0.22 0.00 16.46 09:19:07 08:47:01 AM 0.27 0.00 0.27 0.00 16.18 09:19:07 08:48:01 AM 0.18 0.00 0.18 0.00 8.56 09:19:07 08:49:01 AM 0.32 0.00 0.32 0.00 17.45 09:19:07 08:50:01 AM 0.20 0.00 0.20 0.00 17.59 09:19:07 08:51:01 AM 0.28 0.00 0.28 0.00 25.11 09:19:07 08:52:01 AM 0.20 0.00 0.20 0.00 3.90 09:19:07 08:53:01 AM 0.13 0.00 0.13 0.00 1.53 09:19:07 08:54:01 AM 0.78 0.00 0.78 0.00 12.06 09:19:07 08:55:01 AM 0.63 0.00 0.63 0.00 10.56 09:19:07 08:56:01 AM 0.37 0.00 0.37 0.00 5.35 09:19:07 08:57:01 AM 0.28 0.00 0.28 0.00 2.92 09:19:07 08:58:01 AM 0.27 0.00 0.27 0.00 6.10 09:19:07 08:59:01 AM 0.20 0.00 0.20 0.00 12.65 09:19:07 09:00:01 AM 0.60 0.00 0.60 0.00 20.29 09:19:07 09:01:01 AM 0.42 0.00 0.42 0.00 12.75 09:19:07 09:02:01 AM 0.18 0.00 0.18 0.00 14.91 09:19:07 09:03:01 AM 0.17 0.00 0.17 0.00 16.00 09:19:07 09:04:01 AM 0.53 0.00 0.53 0.00 17.14 09:19:07 09:05:01 AM 0.62 0.00 0.62 0.00 26.83 09:19:07 09:06:01 AM 0.28 0.00 0.28 0.00 8.45 09:19:07 09:07:01 AM 0.35 0.00 0.35 0.00 3.98 09:19:07 09:08:01 AM 0.45 0.00 0.45 0.00 6.32 09:19:07 09:09:01 AM 0.37 0.00 0.37 0.00 4.15 09:19:07 09:10:01 AM 0.38 0.00 0.38 0.00 5.22 09:19:07 09:11:01 AM 0.48 0.00 0.48 0.00 7.55 09:19:07 09:12:01 AM 0.30 0.00 0.30 0.00 2.78 09:19:07 09:13:01 AM 0.27 0.00 0.27 0.00 18.41 09:19:07 09:14:01 AM 0.32 0.00 0.32 0.00 21.46 09:19:07 09:15:01 AM 0.25 0.00 0.25 0.00 27.16 09:19:07 09:16:01 AM 0.22 0.00 0.22 0.00 27.11 09:19:07 09:17:01 AM 4.98 0.23 4.75 34.12 428.91 09:19:07 09:18:01 AM 26.22 0.47 25.76 53.72 3167.18 09:19:07 09:19:01 AM 16.66 0.00 16.66 0.00 860.79 09:19:07 Average: 1.80 0.20 1.60 18.68 164.00 09:19:07 09:19:07 05:34:02 AM kbmemfree kbavail kbmemused %memused kbbuffers kbcached kbcommit %commit kbactive kbinact kbdirty 09:19:07 05:35:01 AM 5324564 7062744 2557864 32.45 2688 1920544 668836 7.49 212244 2023096 164224 09:19:07 05:36:01 AM 5200012 7024200 2682416 34.03 2688 2001640 689960 7.73 222396 2112884 36444 09:19:07 05:37:01 AM 5266008 7095228 2616420 33.19 2688 2006628 636432 7.13 241708 2028784 4 09:19:07 05:38:01 AM 5011520 7037476 2870908 36.42 2688 2195932 669632 7.50 261836 2240436 170248 09:19:07 05:39:01 AM 5030500 7070192 2851928 36.18 2688 2209424 632612 7.08 267388 2209100 24 09:19:07 05:40:01 AM 4988968 7029464 2893460 36.71 2688 2210216 720716 8.07 267572 2249848 784 09:19:07 05:41:01 AM 4986676 7027564 2895752 36.74 2688 2210576 720716 8.07 267572 2252632 24 09:19:07 05:42:01 AM 4985284 7026528 2897144 36.75 2688 2210940 720716 8.07 267572 2253804 24 09:19:07 05:43:01 AM 4983612 7025212 2898816 36.78 2688 2211288 720716 8.07 267572 2255676 192 09:19:07 05:44:01 AM 4982484 7024436 2899944 36.79 2688 2211640 720716 8.07 267572 2256916 72 09:19:07 05:45:01 AM 4980776 7023076 2901652 36.81 2688 2211996 720716 8.07 267572 2258500 56 09:19:07 05:46:01 AM 4978856 7021736 2903572 36.84 2688 2212568 720716 8.07 267572 2260416 72 09:19:07 05:47:01 AM 4980116 7023296 2902312 36.82 2688 2212880 701572 7.86 268276 2259180 56 09:19:07 05:48:01 AM 4979100 7022688 2903328 36.83 2688 2213288 723536 8.10 268276 2259880 172 09:19:07 05:49:01 AM 4978932 7023008 2903496 36.84 2688 2213784 723536 8.10 268328 2260364 344 09:19:07 05:50:01 AM 4977856 7022352 2904572 36.85 2688 2214188 711528 7.97 268328 2261040 100 09:19:07 05:51:01 AM 4978016 7023008 2904412 36.85 2688 2214680 711528 7.97 268328 2261024 248 09:19:07 05:52:01 AM 4976908 7022392 2905520 36.86 2688 2215172 711528 7.97 268328 2262304 92 09:19:07 05:53:01 AM 4969436 7016836 2912992 36.96 2688 2217096 711528 7.97 268552 2269360 32 09:19:07 05:54:01 AM 4969012 7016776 2913416 36.96 2688 2217452 711528 7.97 268552 2269812 4 09:19:07 05:55:01 AM 4968636 7016752 2913792 36.97 2688 2217804 711528 7.97 268556 2270184 88 09:19:07 05:56:01 AM 4968384 7016816 2914044 36.97 2688 2218128 711528 7.97 268552 2270416 124 09:19:07 05:57:01 AM 4968056 7016844 2914372 36.97 2688 2218476 711528 7.97 268552 2270804 16 09:19:07 05:58:01 AM 4967808 7016948 2914620 36.98 2688 2218836 711528 7.97 268552 2271088 40 09:19:07 05:59:01 AM 4966884 7016728 2915544 36.99 2688 2219540 711528 7.97 268552 2272040 216 09:19:07 06:00:01 AM 4966312 7016336 2916116 37.00 2688 2219712 730804 8.18 268552 2272500 152 09:19:07 06:01:01 AM 4965000 7015312 2917428 37.01 2688 2219996 730804 8.18 268552 2273544 56 09:19:07 06:02:01 AM 4965164 7015772 2917264 37.01 2688 2220292 730804 8.18 268616 2273492 48 09:19:07 06:03:01 AM 4965124 7015872 2917304 37.01 2688 2220432 730804 8.18 268616 2273432 4 09:19:07 06:04:01 AM 4964980 7015824 2917448 37.01 2688 2220536 730804 8.18 268616 2273728 72 09:19:07 06:05:01 AM 4964584 7015668 2917844 37.02 2688 2220776 730804 8.18 268616 2274036 56 09:19:07 06:06:01 AM 4966564 7017920 2915864 36.99 2688 2221040 714400 8.00 268772 2271912 108 09:19:07 06:07:01 AM 4965816 7017736 2916612 37.00 2688 2221604 714400 8.00 268824 2272436 424 09:19:07 06:08:01 AM 4963680 7015816 2918748 37.03 2688 2221820 714400 8.00 268824 2274700 212 09:19:07 06:09:01 AM 4963744 7015880 2918684 37.03 2688 2221820 714400 8.00 268824 2274772 4 09:19:07 06:10:01 AM 4962820 7014956 2919608 37.04 2688 2221820 755612 8.46 268824 2275168 4 09:19:07 06:11:01 AM 4796952 7014140 3085476 39.14 2688 2386624 725272 8.12 355276 2353388 48 09:19:07 06:12:01 AM 4797468 7014656 3084960 39.14 2688 2386624 725272 8.12 355276 2353092 8 09:19:07 06:13:01 AM 4797936 7015176 3084492 39.13 2688 2386676 725272 8.12 355276 2353148 56 09:19:07 06:14:01 AM 4797848 7015136 3084580 39.13 2688 2386724 740684 8.29 355276 2353532 16 09:19:07 06:15:01 AM 4798000 7015288 3084428 39.13 2688 2386724 740684 8.29 355276 2353420 4 09:19:07 06:16:01 AM 4800016 7017536 3082412 39.10 2688 2386956 722828 8.09 355276 2351388 4 09:19:07 06:17:01 AM 4797760 7015528 3084668 39.13 2688 2387204 722828 8.09 355276 2353724 88 09:19:07 06:18:01 AM 4797312 7015328 3085116 39.14 2688 2387460 722828 8.09 355276 2353980 40 09:19:07 06:19:01 AM 4796920 7015192 3085508 39.14 2688 2387716 722828 8.09 355276 2354564 124 09:19:07 06:20:01 AM 4796100 7014628 3086328 39.15 2688 2387972 739092 8.28 355276 2354996 32 09:19:07 06:21:01 AM 4795880 7014756 3086548 39.16 2688 2388320 719624 8.06 355276 2355348 168 09:19:07 06:22:01 AM 4795556 7014788 3086872 39.16 2688 2388668 719624 8.06 355276 2355820 116 09:19:07 06:23:01 AM 4794944 7014788 3087484 39.17 2688 2389288 719624 8.06 355276 2356444 72 09:19:07 06:24:01 AM 4795064 7015004 3087364 39.17 2688 2389376 719624 8.06 355276 2356396 56 09:19:07 06:25:01 AM 4795064 7015004 3087364 39.17 2688 2389376 719624 8.06 355276 2356340 8 09:19:07 06:26:01 AM 4795244 7015224 3087184 39.17 2688 2389416 719624 8.06 355276 2356376 48 09:19:07 06:27:01 AM 4795156 7015140 3087272 39.17 2688 2389420 719624 8.06 355276 2356384 4 09:19:07 06:28:01 AM 4795188 7015172 3087240 39.17 2688 2389420 719624 8.06 355276 2356384 4 09:19:07 06:29:02 AM 4794888 7014920 3087540 39.17 2688 2389468 719624 8.06 355276 2356500 12 09:19:07 06:30:01 AM 4794456 7014492 3087972 39.18 2688 2389472 708680 7.94 355276 2356852 12 09:19:07 06:31:01 AM 4794248 7014448 3088180 39.18 2688 2389632 708680 7.94 355276 2356976 4 09:19:07 06:32:01 AM 4794420 7014688 3088008 39.18 2688 2389700 708680 7.94 355276 2356904 16 09:19:07 06:33:01 AM 4794636 7015016 3087792 39.17 2688 2389812 708680 7.94 355284 2356776 4 09:19:07 06:34:01 AM 4794492 7014872 3087936 39.17 2688 2389812 708680 7.94 355284 2356844 12 09:19:07 06:35:01 AM 4794096 7014620 3088332 39.18 2688 2389956 708680 7.94 355292 2357128 4 09:19:07 06:36:01 AM 4794320 7014844 3088108 39.18 2688 2389956 708680 7.94 355292 2357040 8 09:19:07 06:37:01 AM 4794168 7014820 3088260 39.18 2688 2390084 708680 7.94 355292 2357064 8 09:19:07 06:38:01 AM 4794044 7014820 3088384 39.18 2688 2390208 708680 7.94 355292 2357304 28 09:19:07 06:39:01 AM 4793704 7014616 3088724 39.18 2688 2390344 708680 7.94 355292 2357652 112 09:19:07 06:40:01 AM 4793308 7014332 3089120 39.19 2688 2390456 708696 7.94 355292 2357792 4 09:19:07 06:41:01 AM 4793700 7014732 3088728 39.18 2688 2390464 708696 7.94 355292 2357564 4 09:19:07 06:42:01 AM 4793704 7014888 3088724 39.18 2688 2390616 708696 7.94 355300 2357596 4 09:19:07 06:43:01 AM 4793548 7014732 3088880 39.19 2688 2390616 708696 7.94 355300 2357596 4 09:19:07 06:44:01 AM 4793156 7014428 3089272 39.19 2688 2390704 708696 7.94 355300 2357984 92 09:19:07 06:45:01 AM 4793232 7014664 3089196 39.19 2688 2390864 726936 8.14 355300 2357840 84 09:19:07 06:46:01 AM 4792972 7014732 3089456 39.19 2688 2391192 726936 8.14 355300 2358308 136 09:19:07 06:47:01 AM 4792104 7014216 3090324 39.21 2688 2391552 726936 8.14 355300 2359104 92 09:19:07 06:48:01 AM 4791872 7014544 3090556 39.21 2688 2392112 726936 8.14 355400 2359220 72 09:19:07 06:49:01 AM 4789944 7012960 3092484 39.23 2688 2392448 726936 8.14 355400 2361236 172 09:19:07 06:50:01 AM 4789228 7012604 3093200 39.24 2688 2392808 748776 8.38 355400 2361908 104 09:19:07 06:51:01 AM 4788904 7012652 3093524 39.25 2688 2393176 748776 8.38 355400 2362144 72 09:19:07 06:52:01 AM 4788640 7012884 3093788 39.25 2688 2393672 748776 8.38 355400 2362640 64 09:19:07 06:53:01 AM 4788332 7012576 3094096 39.25 2688 2393672 748776 8.38 355400 2362756 4 09:19:07 06:54:01 AM 4788592 7012872 3093836 39.25 2688 2393708 732996 8.21 355400 2362528 52 09:19:07 06:55:01 AM 4788456 7012740 3093972 39.25 2688 2393712 732996 8.21 355400 2362612 12 09:19:07 06:56:01 AM 4788492 7012776 3093936 39.25 2688 2393712 732996 8.21 355400 2362680 4 09:19:07 06:57:01 AM 4788664 7013036 3093764 39.25 2688 2393800 732996 8.21 355400 2362560 40 09:19:07 06:58:01 AM 4788424 7012984 3094004 39.25 2688 2393988 732996 8.21 355400 2362740 32 09:19:07 06:59:01 AM 4788300 7012940 3094128 39.25 2688 2394068 732996 8.21 355400 2363000 68 09:19:07 07:00:01 AM 4787328 7012276 3095100 39.27 2688 2394384 730032 8.17 355400 2363476 240 09:19:07 07:01:01 AM 4786300 7011604 3096128 39.28 2688 2394728 730032 8.17 355400 2364488 4 09:19:07 07:02:01 AM 4787328 7012632 3095100 39.27 2688 2394728 730032 8.17 355408 2363776 4 09:19:07 07:03:01 AM 4787464 7012828 3094964 39.26 2688 2394796 730032 8.17 355408 2363528 72 09:19:07 07:04:01 AM 4785848 7012936 3096580 39.28 2688 2396512 730032 8.17 355408 2365456 244 09:19:07 07:05:01 AM 4784972 7012820 3097456 39.30 2688 2397272 730032 8.17 355408 2366140 56 09:19:07 07:06:01 AM 4784456 7012872 3097972 39.30 2688 2397840 730032 8.17 355408 2366712 104 09:19:07 07:07:01 AM 4784344 7012948 3098084 39.30 2688 2398028 730032 8.17 355408 2366780 24 09:19:07 07:08:01 AM 4784276 7013176 3098152 39.30 2688 2398324 730152 8.18 355436 2367040 16 09:19:07 07:09:01 AM 4783480 7012728 3098948 39.31 2688 2398672 730152 8.18 355436 2367572 184 09:19:07 07:10:01 AM 4782980 7012576 3099448 39.32 2688 2399028 752324 8.42 355436 2368084 116 09:19:07 07:11:01 AM 4783028 7012992 3099400 39.32 2688 2399396 732856 8.21 355436 2368104 52 09:19:07 07:12:01 AM 4782628 7012936 3099800 39.33 2688 2399732 732856 8.21 355436 2368448 144 09:19:07 07:13:01 AM 4782024 7012672 3100404 39.33 2688 2400072 732856 8.21 355436 2369068 112 09:19:07 07:14:01 AM 4781564 7012836 3100864 39.34 2688 2400696 732856 8.21 355436 2369480 36 09:19:07 07:15:01 AM 4781196 7012552 3101232 39.34 2688 2400780 732856 8.21 355436 2369820 4 09:19:07 07:16:01 AM 4780932 7012288 3101496 39.35 2688 2400780 748800 8.38 355436 2370012 8 09:19:07 07:17:01 AM 4781316 7012716 3101112 39.34 2688 2400824 716568 8.02 364916 2360320 4 09:19:07 07:18:01 AM 4781184 7012584 3101244 39.34 2688 2400824 716568 8.02 364916 2360436 4 09:19:07 07:19:01 AM 4781424 7012832 3101004 39.34 2688 2400832 716568 8.02 364916 2360196 28 09:19:07 07:20:01 AM 4780880 7012328 3101548 39.35 2688 2400872 716924 8.03 364916 2360656 4 09:19:07 07:21:01 AM 4781244 7012700 3101184 39.34 2688 2400876 716924 8.03 364916 2360384 4 09:19:07 07:22:01 AM 4781092 7012724 3101336 39.34 2688 2401052 716924 8.03 364916 2360564 24 09:19:07 07:23:01 AM 4780756 7012536 3101672 39.35 2688 2401200 716924 8.03 364924 2360824 120 09:19:07 07:24:01 AM 4780984 7012768 3101444 39.35 2688 2401204 716924 8.03 364924 2360568 4 09:19:07 07:25:01 AM 4780908 7012728 3101520 39.35 2688 2401248 716924 8.03 364924 2360652 52 09:19:07 07:26:01 AM 4780852 7012780 3101576 39.35 2688 2401348 716924 8.03 364924 2360648 64 09:19:07 07:27:01 AM 4781292 7013268 3101136 39.34 2688 2401396 716924 8.03 364924 2360464 56 09:19:07 07:28:01 AM 4781056 7013104 3101372 39.35 2688 2401468 716924 8.03 364920 2360488 24 09:19:07 07:29:01 AM 4781252 7013404 3101176 39.34 2688 2401572 716924 8.03 364924 2360644 12 09:19:07 07:30:01 AM 4780788 7012940 3101640 39.35 2688 2401572 733448 8.21 364924 2360932 8 09:19:07 07:31:01 AM 4780624 7012904 3101804 39.35 2688 2401696 733448 8.21 364924 2360936 16 09:19:07 07:32:02 AM 4780368 7013012 3102060 39.35 2688 2402060 733448 8.21 364924 2361248 24 09:19:07 07:33:01 AM 4780128 7013116 3102300 39.36 2688 2402404 733448 8.21 364924 2361660 152 09:19:07 07:34:01 AM 4779684 7013028 3102744 39.36 2688 2402768 733448 8.21 364924 2361880 100 09:19:07 07:35:01 AM 4779584 7013284 3102844 39.36 2688 2403116 733448 8.21 364924 2362168 76 09:19:07 07:36:01 AM 4779204 7013264 3103224 39.37 2688 2403476 733448 8.21 364924 2362644 168 09:19:07 07:37:01 AM 4778712 7013112 3103716 39.38 2688 2403824 733448 8.21 364924 2362980 80 09:19:07 07:38:01 AM 4778416 7013412 3104012 39.38 2688 2404412 733448 8.21 364924 2363492 4 09:19:07 07:39:01 AM 4778072 7013288 3104356 39.38 2688 2404632 733448 8.21 364924 2363784 4 09:19:07 07:40:01 AM 4777344 7012784 3105084 39.39 2688 2404856 706184 7.91 364924 2364288 4 09:19:07 07:41:01 AM 4777544 7013204 3104884 39.39 2688 2405076 706184 7.91 364924 2364280 4 09:19:07 07:42:01 AM 4777476 7013360 3104952 39.39 2688 2405300 706184 7.91 364924 2364388 4 09:19:07 07:43:01 AM 4777144 7013240 3105284 39.40 2688 2405520 706184 7.91 364924 2364600 48 09:19:07 07:44:01 AM 4776840 7013268 3105588 39.40 2688 2405844 706184 7.91 364924 2365000 68 09:19:07 07:45:01 AM 4776500 7012988 3105928 39.40 2688 2405904 706184 7.91 364924 2365116 8 09:19:07 07:46:01 AM 4776676 7013284 3105752 39.40 2688 2406024 706184 7.91 364924 2365116 4 09:19:07 07:47:01 AM 4776240 7012848 3106188 39.41 2688 2406024 706184 7.91 364924 2365396 8 09:19:07 07:48:01 AM 4775980 7012704 3106448 39.41 2688 2406140 706184 7.91 364932 2365504 4 09:19:07 07:49:01 AM 4776224 7013028 3106204 39.41 2688 2406220 706184 7.91 364936 2365500 4 09:19:07 07:50:01 AM 4775632 7012556 3106796 39.41 2688 2406340 708348 7.93 364932 2365868 4 09:19:07 07:51:01 AM 4775768 7012824 3106660 39.41 2688 2406464 708348 7.93 364932 2365920 4 09:19:07 07:52:01 AM 4776012 7013068 3106416 39.41 2688 2406464 708348 7.93 364932 2365836 4 09:19:07 07:53:01 AM 4775888 7013096 3106540 39.41 2688 2406612 708348 7.93 364936 2365832 4 09:19:07 07:54:01 AM 4775444 7012844 3106984 39.42 2688 2406812 729560 8.17 364932 2366060 116 09:19:07 07:55:01 AM 4775208 7012984 3107220 39.42 2688 2407180 729560 8.17 364932 2366468 32 09:19:07 07:56:01 AM 4775068 7013168 3107360 39.42 2688 2407504 729560 8.17 364932 2366792 80 09:19:07 07:57:01 AM 4774684 7013148 3107744 39.43 2688 2407868 729560 8.17 364932 2367040 4 09:19:07 07:58:01 AM 4774420 7013236 3108008 39.43 2688 2408228 729560 8.17 364932 2367396 40 09:19:07 07:59:01 AM 4774044 7013216 3108384 39.43 2688 2408576 729560 8.17 364932 2367820 32 09:19:07 08:00:01 AM 4772960 7012488 3109468 39.45 2688 2408940 728820 8.16 364932 2368456 24 09:19:07 08:01:01 AM 4771876 7011936 3110552 39.46 2688 2409472 728820 8.16 364932 2369548 68 09:19:07 08:02:01 AM 4773052 7013168 3109376 39.45 2688 2409520 728820 8.16 364940 2368700 4 09:19:07 08:03:01 AM 4772996 7013112 3109432 39.45 2688 2409520 728820 8.16 364940 2368700 4 09:19:07 08:04:01 AM 4772876 7013032 3109552 39.45 2688 2409560 728820 8.16 364940 2368924 4 09:19:07 08:05:01 AM 4773060 7013220 3109368 39.45 2688 2409564 728820 8.16 364940 2368744 4 09:19:07 08:06:01 AM 4772968 7013176 3109460 39.45 2688 2409612 728820 8.16 364940 2368792 56 09:19:07 08:07:01 AM 4773088 7013296 3109340 39.45 2688 2409612 728820 8.16 364940 2368792 4 09:19:07 08:08:01 AM 4772644 7012984 3109784 39.45 2688 2409744 728820 8.16 364940 2368928 136 09:19:07 08:09:01 AM 4772476 7012892 3109952 39.45 2688 2409820 728820 8.16 364940 2369076 60 09:19:07 08:10:01 AM 4772156 7012688 3110272 39.46 2688 2409936 728820 8.16 364944 2369584 8 09:19:07 08:11:01 AM 4772504 7013036 3109924 39.45 2688 2409940 728820 8.16 364944 2369340 4 09:19:07 08:12:01 AM 4772236 7012824 3110192 39.46 2688 2409996 728820 8.16 364944 2369396 64 09:19:07 08:13:01 AM 4772008 7012716 3110420 39.46 2688 2410140 728820 8.16 364948 2369512 144 09:19:07 08:14:01 AM 4772160 7012892 3110268 39.46 2688 2410140 728820 8.16 364948 2369384 12 09:19:07 08:15:01 AM 4772256 7012988 3110172 39.46 2688 2410140 712684 7.98 364948 2369316 8 09:19:07 08:16:01 AM 4772048 7013176 3110380 39.46 2688 2410536 712684 7.98 364948 2369716 164 09:19:07 08:17:01 AM 4771708 7013188 3110720 39.46 2688 2410892 712684 7.98 364948 2370064 124 09:19:07 08:18:01 AM 4771380 7013220 3111048 39.47 2688 2411244 712684 7.98 364948 2370420 48 09:19:07 08:19:01 AM 4770752 7012940 3111676 39.48 2688 2411592 712684 7.98 364948 2370948 12 09:19:07 08:20:01 AM 4769992 7012528 3112436 39.49 2688 2411948 729896 8.17 364948 2371460 32 09:19:07 08:21:01 AM 4769844 7012744 3112584 39.49 2688 2412312 729896 8.17 364948 2371700 152 09:19:07 08:22:01 AM 4769332 7012872 3113096 39.49 2688 2412952 729896 8.17 364948 2372344 148 09:19:07 08:23:01 AM 4769588 7013192 3112840 39.49 2688 2413008 729896 8.17 364948 2372188 4 09:19:07 08:24:01 AM 4769568 7013176 3112860 39.49 2688 2413012 729896 8.17 364948 2372376 12 09:19:07 08:25:01 AM 4769536 7013184 3112892 39.49 2688 2413052 729896 8.17 364948 2372348 12 09:19:07 08:26:01 AM 4769156 7012804 3113272 39.50 2688 2413052 729896 8.17 364948 2372352 12 09:19:07 08:27:01 AM 4769168 7012868 3113260 39.50 2688 2413104 729896 8.17 364948 2372544 56 09:19:07 08:28:01 AM 4769192 7012892 3113236 39.50 2688 2413104 729896 8.17 364948 2372408 4 09:19:07 08:29:01 AM 4769208 7013028 3113220 39.50 2688 2413232 712296 7.98 364948 2372476 148 09:19:07 08:30:01 AM 4768236 7012376 3114192 39.51 2688 2413552 735396 8.23 364948 2373196 48 09:19:07 08:31:01 AM 4767928 7012392 3114500 39.51 2688 2413864 735396 8.23 364948 2373456 176 09:19:07 08:32:01 AM 4768208 7013024 3114220 39.51 2688 2414224 735396 8.23 364948 2373536 140 09:19:07 08:33:01 AM 4767608 7012784 3114820 39.52 2688 2414584 735396 8.23 364948 2374032 112 09:19:07 08:34:01 AM 4767384 7012904 3115044 39.52 2688 2414920 735396 8.23 364948 2374324 40 09:19:07 08:35:01 AM 4767140 7013004 3115288 39.52 2688 2415264 735396 8.23 364948 2374640 28 09:19:07 08:36:01 AM 4766736 7012952 3115692 39.53 2688 2415624 735396 8.23 364948 2374908 16 09:19:07 08:37:01 AM 4766300 7013040 3116128 39.53 2688 2416140 735396 8.23 364948 2375436 48 09:19:07 08:38:01 AM 4766408 7013148 3116020 39.53 2688 2416140 735396 8.23 364948 2375436 4 09:19:07 08:39:02 AM 4766312 7013092 3116116 39.53 2688 2416180 735396 8.23 364948 2375660 52 09:19:07 08:40:01 AM 4765716 7012496 3116712 39.54 2688 2416180 715920 8.02 364948 2375828 16 09:19:07 08:41:01 AM 4765856 7012640 3116572 39.54 2688 2416180 715920 8.02 364948 2375708 4 09:19:07 08:42:01 AM 4765820 7012656 3116608 39.54 2688 2416232 715920 8.02 364948 2375760 4 09:19:07 08:43:01 AM 4765892 7012728 3116536 39.54 2688 2416232 715920 8.02 364948 2375760 4 09:19:07 08:44:01 AM 4764876 7012000 3117552 39.55 2688 2416520 715920 8.02 364948 2376728 104 09:19:07 08:45:01 AM 4764008 7011492 3118420 39.56 2688 2416888 715920 8.02 364948 2377576 212 09:19:07 08:46:01 AM 4763928 7011752 3118500 39.56 2688 2417228 731560 8.19 364948 2377804 100 09:19:07 08:47:01 AM 4762908 7011092 3119520 39.58 2688 2417580 731560 8.19 364948 2378588 64 09:19:07 08:48:01 AM 4763056 7011588 3119372 39.57 2688 2417928 731560 8.19 364948 2378648 208 09:19:07 08:49:01 AM 4762700 7011580 3119728 39.58 2688 2418284 731560 8.19 364948 2379068 180 09:19:07 08:50:01 AM 4761740 7010964 3120688 39.59 2688 2418628 732264 8.20 364948 2379588 40 09:19:07 08:51:01 AM 4761408 7011276 3121020 39.59 2688 2419264 732264 8.20 364948 2380112 4 09:19:07 08:52:01 AM 4761348 7011252 3121080 39.60 2688 2419300 732264 8.20 364948 2380152 4 09:19:07 08:53:01 AM 4761624 7011532 3120804 39.59 2688 2419304 732264 8.20 364948 2379932 4 09:19:07 08:54:01 AM 4761208 7011160 3121220 39.60 2688 2419344 737032 8.25 365948 2379364 4 09:19:07 08:55:01 AM 4761260 7011212 3121168 39.60 2688 2419344 737032 8.25 365940 2379204 4 09:19:07 08:56:01 AM 4761148 7011152 3121280 39.60 2688 2419396 737032 8.25 365940 2379508 4 09:19:07 08:57:01 AM 4761108 7011112 3121320 39.60 2688 2419396 737032 8.25 365940 2379424 4 09:19:07 08:58:01 AM 4761300 7011480 3121128 39.60 2688 2419572 716372 8.02 365940 2379212 64 09:19:07 08:59:01 AM 4760980 7011476 3121448 39.60 2688 2419888 716372 8.02 365940 2379720 68 09:19:07 09:00:01 AM 4759800 7010652 3122628 39.62 2688 2420244 718620 8.05 365940 2380516 24 09:19:07 09:01:01 AM 4759388 7010560 3123040 39.62 2688 2420564 718620 8.05 365940 2380796 148 09:19:07 09:02:01 AM 4759948 7011476 3122480 39.61 2688 2420920 718620 8.05 365940 2380688 116 09:19:07 09:03:01 AM 4759396 7011284 3123032 39.62 2688 2421280 718620 8.05 365940 2381052 32 09:19:07 09:04:01 AM 4759244 7011488 3123184 39.62 2688 2421636 718620 8.05 365940 2381476 16 09:19:07 09:05:01 AM 4758528 7011368 3123900 39.63 2688 2422232 718620 8.05 365940 2381892 4 09:19:07 09:06:01 AM 4758492 7011524 3123936 39.63 2688 2422424 718620 8.05 365940 2382084 4 09:19:07 09:07:01 AM 4758520 7011556 3123908 39.63 2688 2422428 718620 8.05 365940 2382088 4 09:19:07 09:08:01 AM 4758556 7011628 3123872 39.63 2688 2422464 718620 8.05 365940 2382124 4 09:19:07 09:09:01 AM 4758388 7011460 3124040 39.63 2688 2422464 718620 8.05 365940 2382200 4 09:19:07 09:10:01 AM 4758128 7011204 3124300 39.64 2688 2422476 718556 8.05 365940 2382480 4 09:19:07 09:11:01 AM 4758056 7011184 3124372 39.64 2688 2422520 718556 8.05 365940 2382548 4 09:19:07 09:12:01 AM 4758012 7011140 3124416 39.64 2688 2422520 718556 8.05 365940 2382732 4 09:19:07 09:13:01 AM 4757552 7011148 3124876 39.64 2688 2422988 718556 8.05 365944 2382888 4 09:19:07 09:14:01 AM 4756408 7010716 3126020 39.66 2688 2423700 752176 8.42 365944 2383860 248 09:19:07 09:15:01 AM 4752912 7007948 3129516 39.70 2688 2424440 801440 8.97 365944 2386904 252 09:19:07 09:16:01 AM 4556488 6815312 3325940 42.19 2688 2428212 909156 10.18 366060 2583688 3264 09:19:07 09:17:01 AM 4801916 6960084 3080512 39.08 2688 2330992 699744 7.84 407284 2312456 64996 09:19:07 09:18:01 AM 4830204 6987032 3052224 38.72 2688 2331976 703536 7.88 592124 2107744 2244 09:19:07 09:19:01 AM 4791708 6950160 3090720 39.21 2688 2333620 724904 8.12 591564 2146216 16 09:19:07 Average: 4812690 7013419 3069738 38.94 2688 2370381 723257 8.10 348369 2346395 2021 09:19:07 09:19:07 05:34:02 AM IFACE rxpck/s txpck/s rxkB/s txkB/s rxcmp/s txcmp/s rxmcst/s %ifutil 09:19:07 05:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 05:35:01 AM eth0 136.67 93.99 1029.27 21.37 0.00 0.00 0.00 0.00 09:19:07 05:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 05:36:01 AM eth0 30.01 25.03 294.66 5.74 0.00 0.00 0.00 0.00 09:19:07 05:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 05:37:01 AM eth0 22.04 14.16 6.60 4.48 0.00 0.00 0.00 0.00 09:19:07 05:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 05:38:01 AM eth0 36.35 30.66 294.16 6.65 0.00 0.00 0.00 0.00 09:19:07 05:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 05:39:01 AM eth0 537.90 465.08 110.93 94.63 0.00 0.00 0.00 0.00 09:19:07 05:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 05:40:01 AM eth0 38.71 27.73 14.43 4.41 0.00 0.00 0.00 0.00 09:19:07 05:41:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 05:41:01 AM eth0 10.06 9.85 2.31 2.00 0.00 0.00 0.00 0.00 09:19:07 05:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 05:42:01 AM eth0 9.72 9.77 2.04 1.81 0.00 0.00 0.00 0.00 09:19:07 05:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 05:43:01 AM eth0 10.90 10.30 3.52 1.85 0.00 0.00 0.00 0.00 09:19:07 05:44:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 05:44:01 AM eth0 12.98 10.00 2.74 2.12 0.00 0.00 0.00 0.00 09:19:07 05:45:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 05:45:01 AM eth0 10.08 9.91 2.51 2.15 0.00 0.00 0.00 0.00 09:19:07 05:46:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 05:46:01 AM eth0 14.45 14.56 3.41 2.74 0.00 0.00 0.00 0.00 09:19:07 05:47:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 05:47:01 AM eth0 8.73 5.95 1.70 1.15 0.00 0.00 0.00 0.00 09:19:07 05:48:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 05:48:01 AM eth0 2.68 1.17 0.48 0.20 0.00 0.00 0.00 0.00 09:19:07 05:49:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 05:49:01 AM eth0 3.85 1.17 0.74 0.25 0.00 0.00 0.00 0.00 09:19:07 05:50:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 05:50:01 AM eth0 2.08 1.12 0.63 0.36 0.00 0.00 0.00 0.00 09:19:07 05:51:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 05:51:01 AM eth0 2.13 1.08 0.54 0.19 0.00 0.00 0.00 0.00 09:19:07 05:52:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 05:52:01 AM eth0 1.65 1.27 0.63 0.38 0.00 0.00 0.00 0.00 09:19:07 05:53:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 05:53:01 AM eth0 47.48 46.32 8.87 4.82 0.00 0.00 0.00 0.00 09:19:07 05:54:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 05:54:01 AM eth0 12.61 10.18 2.92 2.26 0.00 0.00 0.00 0.00 09:19:07 05:55:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 05:55:01 AM eth0 10.01 9.95 2.29 2.01 0.00 0.00 0.00 0.00 09:19:07 05:56:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 05:56:01 AM eth0 9.28 8.97 1.93 1.67 0.00 0.00 0.00 0.00 09:19:07 05:57:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 05:57:01 AM eth0 12.76 9.38 2.35 1.75 0.00 0.00 0.00 0.00 09:19:07 05:58:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 05:58:01 AM eth0 10.90 9.81 2.14 1.82 0.00 0.00 0.00 0.00 09:19:07 05:59:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 05:59:01 AM eth0 20.13 18.85 4.29 3.50 0.00 0.00 0.00 0.00 09:19:07 06:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 06:00:01 AM eth0 2.35 0.57 0.39 0.09 0.00 0.00 0.00 0.00 09:19:07 06:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 06:01:01 AM eth0 1.37 1.05 0.48 0.36 0.00 0.00 0.00 0.00 09:19:07 06:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 06:02:01 AM eth0 0.85 0.55 0.17 0.11 0.00 0.00 0.00 0.00 09:19:07 06:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 06:03:01 AM eth0 1.97 0.43 0.24 0.07 0.00 0.00 0.00 0.00 09:19:07 06:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 06:04:01 AM eth0 1.90 0.58 0.52 0.31 0.00 0.00 0.00 0.00 09:19:07 06:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 06:05:01 AM eth0 1.42 1.02 0.69 0.50 0.00 0.00 0.00 0.00 09:19:07 06:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 06:06:01 AM eth0 11.01 10.13 2.00 1.12 0.00 0.00 0.00 0.00 09:19:07 06:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 06:07:01 AM eth0 9.41 6.86 1.55 0.62 0.00 0.00 0.00 0.00 09:19:07 06:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 06:08:01 AM eth0 5.62 5.08 1.13 0.54 0.00 0.00 0.00 0.00 09:19:07 06:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 06:09:01 AM eth0 0.68 0.23 0.16 0.07 0.00 0.00 0.00 0.00 09:19:07 06:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 06:10:01 AM eth0 2.20 0.08 0.19 0.00 0.00 0.00 0.00 0.00 09:19:07 06:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 06:11:01 AM eth0 115.89 85.24 1030.79 5.95 0.00 0.00 0.00 0.00 09:19:07 06:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 06:12:01 AM eth0 0.30 0.07 0.02 0.00 0.00 0.00 0.00 0.00 09:19:07 06:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 06:13:01 AM eth0 3.55 1.52 0.52 0.11 0.00 0.00 0.00 0.00 09:19:07 06:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 06:14:01 AM eth0 4.13 2.22 1.02 0.45 0.00 0.00 0.00 0.00 09:19:07 06:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 06:15:01 AM eth0 0.58 0.18 0.32 0.19 0.00 0.00 0.00 0.00 09:19:07 06:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 06:16:01 AM eth0 7.85 7.00 1.47 0.74 0.00 0.00 0.00 0.00 09:19:07 06:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 06:17:01 AM eth0 20.49 9.40 32.85 1.37 0.00 0.00 0.00 0.00 09:19:07 06:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 06:18:01 AM eth0 9.77 7.02 1.66 1.26 0.00 0.00 0.00 0.00 09:19:07 06:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 06:19:01 AM eth0 9.48 7.50 1.92 1.58 0.00 0.00 0.00 0.00 09:19:07 06:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 06:20:01 AM eth0 8.58 7.28 1.56 1.32 0.00 0.00 0.00 0.00 09:19:07 06:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 06:21:01 AM eth0 9.61 9.46 2.00 1.78 0.00 0.00 0.00 0.00 09:19:07 06:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 06:22:01 AM eth0 9.31 9.55 1.99 1.76 0.00 0.00 0.00 0.00 09:19:07 06:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 06:23:01 AM eth0 16.60 16.20 3.64 2.91 0.00 0.00 0.00 0.00 09:19:07 06:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 06:24:01 AM eth0 0.67 0.42 0.16 0.11 0.00 0.00 0.00 0.00 09:19:07 06:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 06:25:01 AM eth0 0.23 0.00 0.01 0.00 0.00 0.00 0.00 0.00 09:19:07 06:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 06:26:01 AM eth0 0.33 0.25 0.04 0.03 0.00 0.00 0.00 0.00 09:19:07 06:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 06:27:01 AM eth0 0.28 0.08 0.01 0.00 0.00 0.00 0.00 0.00 09:19:07 06:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 06:28:01 AM eth0 0.08 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 06:29:02 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 06:29:02 AM eth0 3.57 0.38 6.07 0.10 0.00 0.00 0.00 0.00 09:19:07 06:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 06:30:01 AM eth0 0.88 0.12 0.17 0.07 0.00 0.00 0.00 0.00 09:19:07 06:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 06:31:01 AM eth0 5.33 5.26 1.32 0.92 0.00 0.00 0.00 0.00 09:19:07 06:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 06:32:01 AM eth0 4.12 4.00 0.68 0.27 0.00 0.00 0.00 0.00 09:19:07 06:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 06:33:01 AM eth0 1.45 1.28 0.26 0.11 0.00 0.00 0.00 0.00 09:19:07 06:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 06:34:01 AM eth0 1.00 0.30 0.24 0.14 0.00 0.00 0.00 0.00 09:19:07 06:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 06:35:01 AM eth0 2.48 2.37 0.74 0.38 0.00 0.00 0.00 0.00 09:19:07 06:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 06:36:01 AM eth0 0.20 0.00 0.01 0.00 0.00 0.00 0.00 0.00 09:19:07 06:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 06:37:01 AM eth0 4.15 3.90 0.80 0.30 0.00 0.00 0.00 0.00 09:19:07 06:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 06:38:01 AM eth0 3.57 3.55 0.61 0.26 0.00 0.00 0.00 0.00 09:19:07 06:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 06:39:01 AM eth0 9.42 8.73 1.63 0.84 0.00 0.00 0.00 0.00 09:19:07 06:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 06:40:01 AM eth0 2.10 2.05 0.31 0.15 0.00 0.00 0.00 0.00 09:19:07 06:41:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 06:41:01 AM eth0 0.22 0.05 0.01 0.00 0.00 0.00 0.00 0.00 09:19:07 06:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 06:42:01 AM eth0 3.95 3.75 0.82 0.29 0.00 0.00 0.00 0.00 09:19:07 06:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 06:43:01 AM eth0 0.70 0.10 0.07 0.01 0.00 0.00 0.00 0.00 09:19:07 06:44:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 06:44:01 AM eth0 2.38 2.03 0.71 0.59 0.00 0.00 0.00 0.00 09:19:07 06:45:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 06:45:01 AM eth0 8.15 8.27 1.48 0.92 0.00 0.00 0.00 0.00 09:19:07 06:46:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 06:46:01 AM eth0 9.06 9.10 1.94 1.68 0.00 0.00 0.00 0.00 09:19:07 06:47:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 06:47:01 AM eth0 9.61 9.81 2.26 1.99 0.00 0.00 0.00 0.00 09:19:07 06:48:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 06:48:01 AM eth0 9.38 9.70 2.02 1.81 0.00 0.00 0.00 0.00 09:19:07 06:49:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 06:49:01 AM eth0 9.32 9.43 2.03 1.80 0.00 0.00 0.00 0.00 09:19:07 06:50:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 06:50:01 AM eth0 9.41 9.71 2.02 1.81 0.00 0.00 0.00 0.00 09:19:07 06:51:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 06:51:01 AM eth0 9.80 10.10 2.10 1.90 0.00 0.00 0.00 0.00 09:19:07 06:52:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 06:52:01 AM eth0 11.05 10.76 2.53 1.95 0.00 0.00 0.00 0.00 09:19:07 06:53:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 06:53:01 AM eth0 0.18 0.03 0.01 0.00 0.00 0.00 0.00 0.00 09:19:07 06:54:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 06:54:01 AM eth0 0.40 0.32 0.11 0.09 0.00 0.00 0.00 0.00 09:19:07 06:55:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 06:55:01 AM eth0 0.85 0.17 0.16 0.07 0.00 0.00 0.00 0.00 09:19:07 06:56:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 06:56:01 AM eth0 0.35 0.15 0.25 0.19 0.00 0.00 0.00 0.00 09:19:07 06:57:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 06:57:01 AM eth0 0.30 0.30 0.07 0.04 0.00 0.00 0.00 0.00 09:19:07 06:58:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 06:58:01 AM eth0 5.40 5.37 1.10 0.75 0.00 0.00 0.00 0.00 09:19:07 06:59:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 06:59:01 AM eth0 1.95 1.82 0.41 0.22 0.00 0.00 0.00 0.00 09:19:07 07:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 07:00:01 AM eth0 1.73 1.82 0.31 0.21 0.00 0.00 0.00 0.00 09:19:07 07:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 07:01:01 AM eth0 1.80 1.87 0.30 0.20 0.00 0.00 0.00 0.00 09:19:07 07:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 07:02:01 AM eth0 0.27 0.17 0.03 0.01 0.00 0.00 0.00 0.00 09:19:07 07:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 07:03:01 AM eth0 2.97 2.55 0.40 0.18 0.00 0.00 0.00 0.00 09:19:07 07:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 07:04:01 AM eth0 2.07 2.23 0.50 0.76 0.00 0.00 0.00 0.00 09:19:07 07:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 07:05:01 AM eth0 4.70 4.90 0.71 0.50 0.00 0.00 0.00 0.00 09:19:07 07:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 07:06:01 AM eth0 2.80 2.90 0.39 0.31 0.00 0.00 0.00 0.00 09:19:07 07:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 07:07:01 AM eth0 4.25 4.35 0.78 0.51 0.00 0.00 0.00 0.00 09:19:07 07:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 07:08:01 AM eth0 7.48 7.67 1.56 1.40 0.00 0.00 0.00 0.00 09:19:07 07:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 07:09:01 AM eth0 9.57 9.67 2.08 1.85 0.00 0.00 0.00 0.00 09:19:07 07:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 07:10:01 AM eth0 9.20 9.50 1.96 1.76 0.00 0.00 0.00 0.00 09:19:07 07:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 07:11:01 AM eth0 9.50 9.73 2.02 1.81 0.00 0.00 0.00 0.00 09:19:07 07:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 07:12:01 AM eth0 9.98 9.45 2.02 1.75 0.00 0.00 0.00 0.00 09:19:07 07:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 07:13:01 AM eth0 9.35 9.53 2.19 1.93 0.00 0.00 0.00 0.00 09:19:07 07:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 07:14:01 AM eth0 16.31 16.09 3.68 2.97 0.00 0.00 0.00 0.00 09:19:07 07:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 07:15:01 AM eth0 0.53 0.42 0.31 0.23 0.00 0.00 0.00 0.00 09:19:07 07:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 07:16:01 AM eth0 0.40 0.17 0.34 0.01 0.00 0.00 0.00 0.00 09:19:07 07:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 07:17:01 AM eth0 0.35 0.25 0.04 0.03 0.00 0.00 0.00 0.00 09:19:07 07:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 07:18:01 AM eth0 0.10 0.05 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 07:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 07:19:01 AM eth0 0.83 0.15 0.15 0.07 0.00 0.00 0.00 0.00 09:19:07 07:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 07:20:01 AM eth0 0.67 0.37 0.30 0.22 0.00 0.00 0.00 0.00 09:19:07 07:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 07:21:01 AM eth0 0.10 0.05 0.01 0.00 0.00 0.00 0.00 0.00 09:19:07 07:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 07:22:01 AM eth0 5.30 5.26 1.07 0.73 0.00 0.00 0.00 0.00 09:19:07 07:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 07:23:01 AM eth0 5.23 5.20 0.96 0.36 0.00 0.00 0.00 0.00 09:19:07 07:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 07:24:01 AM eth0 0.22 0.12 0.08 0.06 0.00 0.00 0.00 0.00 09:19:07 07:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 07:25:01 AM eth0 0.97 0.92 0.25 0.08 0.00 0.00 0.00 0.00 09:19:07 07:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 07:26:01 AM eth0 5.11 5.13 1.03 0.38 0.00 0.00 0.00 0.00 09:19:07 07:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 07:27:01 AM eth0 2.62 2.57 0.50 0.18 0.00 0.00 0.00 0.00 09:19:07 07:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 07:28:01 AM eth0 3.20 3.18 0.56 0.23 0.00 0.00 0.00 0.00 09:19:07 07:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 07:29:01 AM eth0 2.32 2.17 0.39 0.21 0.00 0.00 0.00 0.00 09:19:07 07:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 07:30:01 AM eth0 0.08 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 07:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 07:31:01 AM eth0 4.15 4.30 0.82 0.53 0.00 0.00 0.00 0.00 09:19:07 07:32:02 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 07:32:02 AM eth0 11.31 11.21 2.45 1.93 0.00 0.00 0.00 0.00 09:19:07 07:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 07:33:01 AM eth0 9.52 9.62 2.23 1.96 0.00 0.00 0.00 0.00 09:19:07 07:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 07:34:01 AM eth0 9.48 9.75 2.09 1.87 0.00 0.00 0.00 0.00 09:19:07 07:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 07:35:01 AM eth0 9.45 9.80 2.02 1.82 0.00 0.00 0.00 0.00 09:19:07 07:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 07:36:01 AM eth0 9.33 9.67 2.01 1.81 0.00 0.00 0.00 0.00 09:19:07 07:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 07:37:01 AM eth0 9.42 9.67 2.02 1.81 0.00 0.00 0.00 0.00 09:19:07 07:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 07:38:01 AM eth0 14.08 14.00 3.21 2.57 0.00 0.00 0.00 0.00 09:19:07 07:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 07:39:01 AM eth0 0.82 0.58 0.26 0.16 0.00 0.00 0.00 0.00 09:19:07 07:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 07:40:01 AM eth0 0.75 0.60 0.46 0.10 0.00 0.00 0.00 0.00 09:19:07 07:41:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 07:41:01 AM eth0 0.47 0.40 0.17 0.09 0.00 0.00 0.00 0.00 09:19:07 07:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 07:42:01 AM eth0 0.45 0.40 0.17 0.09 0.00 0.00 0.00 0.00 09:19:07 07:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 07:43:01 AM eth0 0.48 0.40 0.17 0.09 0.00 0.00 0.00 0.00 09:19:07 07:44:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 07:44:01 AM eth0 4.93 4.88 1.15 0.77 0.00 0.00 0.00 0.00 09:19:07 07:45:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 07:45:01 AM eth0 1.47 1.40 0.27 0.10 0.00 0.00 0.00 0.00 09:19:07 07:46:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 07:46:01 AM eth0 0.37 0.35 0.02 0.04 0.00 0.00 0.00 0.00 09:19:07 07:47:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 07:47:01 AM eth0 1.03 0.32 0.41 0.26 0.00 0.00 0.00 0.00 09:19:07 07:48:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 07:48:01 AM eth0 3.43 3.32 0.80 0.44 0.00 0.00 0.00 0.00 09:19:07 07:49:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 07:49:01 AM eth0 2.17 2.05 0.38 0.22 0.00 0.00 0.00 0.00 09:19:07 07:50:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 07:50:01 AM eth0 3.92 3.90 0.60 0.29 0.00 0.00 0.00 0.00 09:19:07 07:51:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 07:51:01 AM eth0 0.38 0.32 0.02 0.03 0.00 0.00 0.00 0.00 09:19:07 07:52:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 07:52:01 AM eth0 0.13 0.10 0.01 0.01 0.00 0.00 0.00 0.00 09:19:07 07:53:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 07:53:01 AM eth0 4.57 4.48 0.90 0.51 0.00 0.00 0.00 0.00 09:19:07 07:54:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 07:54:01 AM eth0 4.35 4.52 0.98 0.88 0.00 0.00 0.00 0.00 09:19:07 07:55:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 07:55:01 AM eth0 10.00 10.15 2.11 1.89 0.00 0.00 0.00 0.00 09:19:07 07:56:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 07:56:01 AM eth0 8.83 8.88 1.87 1.66 0.00 0.00 0.00 0.00 09:19:07 07:57:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 07:57:01 AM eth0 9.36 9.71 2.02 1.81 0.00 0.00 0.00 0.00 09:19:07 07:58:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 07:58:01 AM eth0 9.35 9.70 2.02 1.81 0.00 0.00 0.00 0.00 09:19:07 07:59:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 07:59:01 AM eth0 9.48 9.83 2.09 1.87 0.00 0.00 0.00 0.00 09:19:07 08:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 08:00:01 AM eth0 9.37 9.73 2.02 1.81 0.00 0.00 0.00 0.00 09:19:07 08:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 08:01:01 AM eth0 12.38 12.63 2.85 2.27 0.00 0.00 0.00 0.00 09:19:07 08:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 08:02:01 AM eth0 0.27 0.18 0.04 0.03 0.00 0.00 0.00 0.00 09:19:07 08:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 08:03:01 AM eth0 0.10 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 08:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 08:04:01 AM eth0 0.45 0.32 0.12 0.09 0.00 0.00 0.00 0.00 09:19:07 08:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 08:05:01 AM eth0 0.05 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 08:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 08:06:01 AM eth0 0.28 0.25 0.04 0.03 0.00 0.00 0.00 0.00 09:19:07 08:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 08:07:01 AM eth0 0.10 0.00 0.01 0.00 0.00 0.00 0.00 0.00 09:19:07 08:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 08:08:01 AM eth0 2.97 2.92 0.64 0.54 0.00 0.00 0.00 0.00 09:19:07 08:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 08:09:01 AM eth0 5.20 5.18 1.08 0.45 0.00 0.00 0.00 0.00 09:19:07 08:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 08:10:01 AM eth0 1.73 1.73 0.27 0.12 0.00 0.00 0.00 0.00 09:19:07 08:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 08:11:01 AM eth0 0.17 0.10 0.01 0.00 0.00 0.00 0.00 0.00 09:19:07 08:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 08:12:01 AM eth0 2.63 2.63 0.45 0.19 0.00 0.00 0.00 0.00 09:19:07 08:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 08:13:01 AM eth0 2.72 2.77 0.55 0.20 0.00 0.00 0.00 0.00 09:19:07 08:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 08:14:01 AM eth0 0.28 0.18 0.08 0.07 0.00 0.00 0.00 0.00 09:19:07 08:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 08:15:01 AM eth0 0.08 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 08:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 08:16:01 AM eth0 14.01 14.66 2.68 2.05 0.00 0.00 0.00 0.00 09:19:07 08:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 08:17:01 AM eth0 9.37 9.65 2.02 1.81 0.00 0.00 0.00 0.00 09:19:07 08:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 08:18:01 AM eth0 9.33 9.70 2.01 1.81 0.00 0.00 0.00 0.00 09:19:07 08:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 08:19:01 AM eth0 9.30 9.53 2.05 1.83 0.00 0.00 0.00 0.00 09:19:07 08:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 08:20:01 AM eth0 9.23 9.58 1.98 1.78 0.00 0.00 0.00 0.00 09:19:07 08:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 08:21:01 AM eth0 9.40 9.72 2.02 1.81 0.00 0.00 0.00 0.00 09:19:07 08:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 08:22:01 AM eth0 16.50 16.30 3.70 3.01 0.00 0.00 0.00 0.00 09:19:07 08:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 08:23:01 AM eth0 0.23 0.17 0.05 0.03 0.00 0.00 0.00 0.00 09:19:07 08:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 08:24:01 AM eth0 0.23 0.10 0.08 0.06 0.00 0.00 0.00 0.00 09:19:07 08:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 08:25:01 AM eth0 0.23 0.18 0.04 0.03 0.00 0.00 0.00 0.00 09:19:07 08:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 08:26:01 AM eth0 0.73 0.13 0.15 0.07 0.00 0.00 0.00 0.00 09:19:07 08:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 08:27:01 AM eth0 0.73 0.47 0.30 0.23 0.00 0.00 0.00 0.00 09:19:07 08:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 08:28:01 AM eth0 0.03 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 08:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 08:29:01 AM eth0 3.00 3.07 0.70 0.60 0.00 0.00 0.00 0.00 09:19:07 08:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 08:30:01 AM eth0 14.05 14.18 2.79 1.66 0.00 0.00 0.00 0.00 09:19:07 08:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 08:31:01 AM eth0 8.66 8.78 2.04 1.79 0.00 0.00 0.00 0.00 09:19:07 08:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 08:32:01 AM eth0 10.33 9.92 2.61 1.89 0.00 0.00 0.00 0.00 09:19:07 08:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 08:33:01 AM eth0 9.73 9.81 2.27 2.00 0.00 0.00 0.00 0.00 09:19:07 08:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 08:34:01 AM eth0 9.18 9.43 2.02 1.80 0.00 0.00 0.00 0.00 09:19:07 08:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 08:35:01 AM eth0 9.47 9.73 2.03 1.81 0.00 0.00 0.00 0.00 09:19:07 08:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 08:36:01 AM eth0 9.03 9.33 1.94 1.74 0.00 0.00 0.00 0.00 09:19:07 08:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 08:37:01 AM eth0 11.83 11.45 2.69 2.10 0.00 0.00 0.00 0.00 09:19:07 08:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 08:38:01 AM eth0 0.13 0.00 0.01 0.00 0.00 0.00 0.00 0.00 09:19:07 08:39:02 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 08:39:02 AM eth0 0.42 0.30 0.11 0.09 0.00 0.00 0.00 0.00 09:19:07 08:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 08:40:01 AM eth0 0.07 0.03 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 08:41:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 08:41:01 AM eth0 0.07 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 08:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 08:42:01 AM eth0 0.28 0.20 0.04 0.03 0.00 0.00 0.00 0.00 09:19:07 08:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 08:43:01 AM eth0 0.07 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 08:44:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 08:44:01 AM eth0 8.95 9.10 2.02 1.36 0.00 0.00 0.00 0.00 09:19:07 08:45:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 08:45:01 AM eth0 12.18 12.65 2.54 1.86 0.00 0.00 0.00 0.00 09:19:07 08:46:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 08:46:01 AM eth0 9.35 9.68 2.02 1.81 0.00 0.00 0.00 0.00 09:19:07 08:47:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 08:47:01 AM eth0 9.38 9.58 2.19 1.93 0.00 0.00 0.00 0.00 09:19:07 08:48:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 08:48:01 AM eth0 9.25 9.33 1.95 1.74 0.00 0.00 0.00 0.00 09:19:07 08:49:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 08:49:01 AM eth0 9.52 9.80 2.09 1.87 0.00 0.00 0.00 0.00 09:19:07 08:50:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 08:50:01 AM eth0 9.05 9.43 1.96 1.77 0.00 0.00 0.00 0.00 09:19:07 08:51:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 08:51:01 AM eth0 15.44 15.39 3.50 2.84 0.00 0.00 0.00 0.00 09:19:07 08:52:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 08:52:01 AM eth0 0.17 0.15 0.03 0.02 0.00 0.00 0.00 0.00 09:19:07 08:53:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 08:53:01 AM eth0 0.07 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 08:54:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 08:54:01 AM eth0 0.43 0.33 0.11 0.09 0.00 0.00 0.00 0.00 09:19:07 08:55:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 08:55:01 AM eth0 0.15 0.02 0.01 0.00 0.00 0.00 0.00 0.00 09:19:07 08:56:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 08:56:01 AM eth0 1.50 0.40 0.27 0.10 0.00 0.00 0.00 0.00 09:19:07 08:57:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 08:57:01 AM eth0 0.38 0.15 0.26 0.19 0.00 0.00 0.00 0.00 09:19:07 08:58:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 08:58:01 AM eth0 5.43 5.45 1.35 0.74 0.00 0.00 0.00 0.00 09:19:07 08:59:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 08:59:01 AM eth0 12.48 12.41 2.68 1.72 0.00 0.00 0.00 0.00 09:19:07 09:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 09:00:01 AM eth0 9.68 9.86 2.27 2.00 0.00 0.00 0.00 0.00 09:19:07 09:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 09:01:01 AM eth0 8.50 8.70 1.79 1.61 0.00 0.00 0.00 0.00 09:19:07 09:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 09:02:01 AM eth0 9.35 9.63 2.01 1.80 0.00 0.00 0.00 0.00 09:19:07 09:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 09:03:01 AM eth0 9.32 9.68 2.01 1.81 0.00 0.00 0.00 0.00 09:19:07 09:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 09:04:01 AM eth0 9.66 9.90 2.10 1.88 0.00 0.00 0.00 0.00 09:19:07 09:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 09:05:01 AM eth0 16.35 16.01 3.65 2.95 0.00 0.00 0.00 0.00 09:19:07 09:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 09:06:01 AM eth0 2.83 2.93 0.59 0.53 0.00 0.00 0.00 0.00 09:19:07 09:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 09:07:01 AM eth0 0.07 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 09:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 09:08:01 AM eth0 0.32 0.22 0.04 0.03 0.00 0.00 0.00 0.00 09:19:07 09:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 09:09:01 AM eth0 0.25 0.10 0.08 0.06 0.00 0.00 0.00 0.00 09:19:07 09:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 09:10:01 AM eth0 0.08 0.05 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 09:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 09:11:01 AM eth0 0.95 0.30 0.20 0.10 0.00 0.00 0.00 0.00 09:19:07 09:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 09:12:01 AM eth0 0.45 0.15 0.26 0.19 0.00 0.00 0.00 0.00 09:19:07 09:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 09:13:01 AM eth0 10.60 11.06 3.00 1.49 0.00 0.00 0.00 0.00 09:19:07 09:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 09:14:01 AM eth0 12.78 12.96 5.01 1.62 0.00 0.00 0.00 0.00 09:19:07 09:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 09:15:01 AM eth0 15.16 15.61 4.59 2.34 0.00 0.00 0.00 0.00 09:19:07 09:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 09:16:01 AM eth0 10.33 10.80 3.64 1.28 0.00 0.00 0.00 0.00 09:19:07 09:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 09:17:01 AM eth0 107.75 79.21 317.85 247.55 0.00 0.00 0.00 0.00 09:19:07 09:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 09:18:01 AM eth0 16.03 16.16 13.83 7.63 0.00 0.00 0.00 0.00 09:19:07 09:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 09:19:01 AM eth0 3.97 4.45 2.73 2.10 0.00 0.00 0.00 0.00 09:19:07 Average: lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:07 Average: eth0 9.89 8.70 15.08 2.62 0.00 0.00 0.00 0.00 09:19:07 09:19:07 09:19:07 ---> sar -P ALL: 09:19:07 Linux 4.18.0-547.el8.x86_64 (centos-stream-8-robot-8eca76b2-cb40-4fba-ac9e-845c8a03a7a7.noval) 04/07/2024 _x86_64_ (2 CPU) 09:19:07 09:19:07 05:33:04 LINUX RESTART (2 CPU) 09:19:07 09:19:07 05:34:02 AM CPU %user %nice %system %iowait %steal %idle 09:19:07 05:35:01 AM all 39.88 0.00 6.00 2.89 0.11 51.12 09:19:07 05:35:01 AM 0 30.57 0.00 5.06 2.62 0.10 61.65 09:19:07 05:35:01 AM 1 49.22 0.00 6.94 3.15 0.12 40.57 09:19:07 05:36:01 AM all 26.78 0.00 3.16 2.25 0.09 67.72 09:19:07 05:36:01 AM 0 23.29 0.00 2.57 1.93 0.10 72.10 09:19:07 05:36:01 AM 1 30.26 0.00 3.75 2.57 0.08 63.34 09:19:07 05:37:01 AM all 12.84 0.00 1.83 0.41 0.09 84.83 09:19:07 05:37:01 AM 0 14.65 0.00 1.90 0.63 0.08 82.73 09:19:07 05:37:01 AM 1 11.03 0.00 1.75 0.18 0.10 86.93 09:19:07 05:38:01 AM all 21.49 0.00 3.51 0.37 0.07 74.57 09:19:07 05:38:01 AM 0 11.67 0.00 2.70 0.28 0.07 85.28 09:19:07 05:38:01 AM 1 31.34 0.00 4.32 0.45 0.07 63.82 09:19:07 05:39:01 AM all 12.18 0.00 2.48 1.76 0.08 83.51 09:19:07 05:39:01 AM 0 10.97 0.00 2.61 1.74 0.08 84.59 09:19:07 05:39:01 AM 1 13.38 0.00 2.34 1.77 0.07 82.44 09:19:07 05:40:01 AM all 3.74 0.00 0.42 0.01 0.05 95.78 09:19:07 05:40:01 AM 0 2.82 0.00 0.45 0.00 0.03 96.69 09:19:07 05:40:01 AM 1 4.66 0.00 0.39 0.02 0.07 94.87 09:19:07 05:41:01 AM all 4.45 0.00 0.33 0.00 0.07 95.16 09:19:07 05:41:01 AM 0 1.69 0.00 0.20 0.00 0.07 98.04 09:19:07 05:41:01 AM 1 7.22 0.00 0.45 0.00 0.07 92.26 09:19:07 05:42:01 AM all 4.31 0.00 0.31 0.01 0.07 95.31 09:19:07 05:42:01 AM 0 1.81 0.00 0.15 0.02 0.03 97.99 09:19:07 05:42:01 AM 1 6.81 0.00 0.47 0.00 0.10 92.62 09:19:07 05:43:01 AM all 4.26 0.00 0.29 0.00 0.07 95.38 09:19:07 05:43:01 AM 0 1.84 0.00 0.13 0.00 0.05 97.98 09:19:07 05:43:01 AM 1 6.68 0.00 0.45 0.00 0.08 92.79 09:19:07 05:44:01 AM all 4.28 0.00 0.30 0.00 0.08 95.34 09:19:07 05:44:01 AM 0 1.79 0.00 0.17 0.00 0.08 97.96 09:19:07 05:44:01 AM 1 6.78 0.00 0.44 0.00 0.07 92.72 09:19:07 05:45:01 AM all 4.23 0.00 0.32 0.00 0.08 95.37 09:19:07 05:45:01 AM 0 3.61 0.00 0.32 0.00 0.08 95.99 09:19:07 05:45:01 AM 1 4.85 0.00 0.32 0.00 0.08 94.75 09:19:07 09:19:07 05:45:01 AM CPU %user %nice %system %iowait %steal %idle 09:19:07 05:46:01 AM all 6.25 0.00 0.36 0.00 0.08 93.32 09:19:07 05:46:01 AM 0 4.41 0.00 0.28 0.00 0.07 95.24 09:19:07 05:46:01 AM 1 8.09 0.00 0.44 0.00 0.08 91.39 09:19:07 05:47:01 AM all 2.11 0.00 0.15 0.00 0.08 97.67 09:19:07 05:47:01 AM 0 1.92 0.00 0.17 0.00 0.05 97.86 09:19:07 05:47:01 AM 1 2.29 0.00 0.13 0.00 0.10 97.48 09:19:07 05:48:01 AM all 1.14 0.00 0.12 0.00 0.06 98.69 09:19:07 05:48:01 AM 0 0.53 0.00 0.07 0.00 0.03 99.37 09:19:07 05:48:01 AM 1 1.74 0.00 0.17 0.00 0.08 98.01 09:19:07 05:49:01 AM all 1.44 0.00 0.25 0.00 0.05 98.26 09:19:07 05:49:01 AM 0 1.09 0.00 0.28 0.00 0.05 98.58 09:19:07 05:49:01 AM 1 1.80 0.00 0.22 0.00 0.05 97.93 09:19:07 05:50:01 AM all 1.17 0.00 0.13 0.00 0.06 98.65 09:19:07 05:50:01 AM 0 1.17 0.00 0.13 0.00 0.05 98.65 09:19:07 05:50:01 AM 1 1.17 0.00 0.12 0.00 0.07 98.65 09:19:07 05:51:01 AM all 1.30 0.00 0.13 0.00 0.07 98.50 09:19:07 05:51:01 AM 0 0.52 0.00 0.10 0.00 0.05 99.33 09:19:07 05:51:01 AM 1 2.09 0.00 0.17 0.00 0.08 97.66 09:19:07 05:52:01 AM all 1.40 0.00 0.13 0.00 0.05 98.41 09:19:07 05:52:01 AM 0 1.55 0.00 0.13 0.00 0.05 98.26 09:19:07 05:52:01 AM 1 1.25 0.00 0.13 0.00 0.05 98.56 09:19:07 05:53:01 AM all 8.48 0.00 0.54 0.00 0.07 90.91 09:19:07 05:53:01 AM 0 10.91 0.00 0.57 0.00 0.07 88.45 09:19:07 05:53:01 AM 1 6.06 0.00 0.50 0.00 0.07 93.37 09:19:07 05:54:01 AM all 4.32 0.00 0.32 0.00 0.06 95.30 09:19:07 05:54:01 AM 0 3.36 0.00 0.30 0.00 0.05 96.29 09:19:07 05:54:01 AM 1 5.29 0.00 0.33 0.00 0.07 94.31 09:19:07 05:55:01 AM all 4.31 0.00 0.32 0.00 0.07 95.30 09:19:07 05:55:01 AM 0 1.77 0.00 0.18 0.00 0.07 97.98 09:19:07 05:55:01 AM 1 6.87 0.00 0.45 0.00 0.07 92.61 09:19:07 05:56:01 AM all 3.96 0.00 0.27 0.00 0.07 95.70 09:19:07 05:56:01 AM 0 1.22 0.00 0.13 0.00 0.07 98.58 09:19:07 05:56:01 AM 1 6.71 0.00 0.40 0.00 0.07 92.82 09:19:07 09:19:07 05:56:01 AM CPU %user %nice %system %iowait %steal %idle 09:19:07 05:57:01 AM all 4.12 0.00 0.29 0.00 0.08 95.51 09:19:07 05:57:01 AM 0 2.31 0.00 0.18 0.00 0.07 97.44 09:19:07 05:57:01 AM 1 5.94 0.00 0.40 0.00 0.08 93.57 09:19:07 05:58:01 AM all 4.29 0.00 0.28 0.00 0.08 95.35 09:19:07 05:58:01 AM 0 1.57 0.00 0.18 0.00 0.07 98.18 09:19:07 05:58:01 AM 1 7.01 0.00 0.39 0.00 0.08 92.52 09:19:07 05:59:01 AM all 7.14 0.00 0.39 0.00 0.08 92.39 09:19:07 05:59:01 AM 0 5.81 0.00 0.39 0.00 0.10 93.70 09:19:07 05:59:01 AM 1 8.46 0.00 0.39 0.00 0.07 91.08 09:19:07 06:00:01 AM all 0.72 0.00 0.10 0.00 0.06 99.12 09:19:07 06:00:01 AM 0 0.57 0.00 0.07 0.00 0.03 99.33 09:19:07 06:00:01 AM 1 0.87 0.00 0.13 0.00 0.08 98.91 09:19:07 06:01:01 AM all 0.98 0.00 0.13 0.01 0.07 98.81 09:19:07 06:01:01 AM 0 0.85 0.00 0.10 0.00 0.07 98.98 09:19:07 06:01:01 AM 1 1.12 0.00 0.15 0.02 0.07 98.65 09:19:07 06:02:01 AM all 0.93 0.00 0.11 0.00 0.05 98.92 09:19:07 06:02:01 AM 0 0.65 0.00 0.08 0.00 0.05 99.22 09:19:07 06:02:01 AM 1 1.20 0.00 0.13 0.00 0.05 98.62 09:19:07 06:03:01 AM all 0.64 0.00 0.08 0.00 0.05 99.23 09:19:07 06:03:01 AM 0 0.78 0.00 0.08 0.00 0.03 99.10 09:19:07 06:03:01 AM 1 0.50 0.00 0.07 0.00 0.07 99.37 09:19:07 06:04:01 AM all 0.55 0.00 0.07 0.00 0.06 99.32 09:19:07 06:04:01 AM 0 0.57 0.00 0.05 0.00 0.05 99.33 09:19:07 06:04:01 AM 1 0.53 0.00 0.08 0.00 0.07 99.32 09:19:07 06:05:01 AM all 0.87 0.00 0.12 0.00 0.06 98.96 09:19:07 06:05:01 AM 0 0.65 0.00 0.10 0.00 0.05 99.20 09:19:07 06:05:01 AM 1 1.08 0.00 0.13 0.00 0.07 98.71 09:19:07 06:06:01 AM all 2.10 0.00 0.25 0.00 0.04 97.61 09:19:07 06:06:01 AM 0 1.98 0.00 0.18 0.00 0.05 97.79 09:19:07 06:06:01 AM 1 2.22 0.00 0.32 0.00 0.03 97.43 09:19:07 06:07:01 AM all 3.11 0.00 0.52 0.00 0.05 96.32 09:19:07 06:07:01 AM 0 0.44 0.00 0.18 0.00 0.05 99.33 09:19:07 06:07:01 AM 1 5.80 0.00 0.86 0.00 0.05 93.29 09:19:07 09:19:07 06:07:01 AM CPU %user %nice %system %iowait %steal %idle 09:19:07 06:08:01 AM all 3.92 0.00 0.32 0.00 0.06 95.69 09:19:07 06:08:01 AM 0 0.82 0.00 0.17 0.00 0.07 98.95 09:19:07 06:08:01 AM 1 7.16 0.00 0.49 0.00 0.05 92.31 09:19:07 06:09:01 AM all 0.37 0.00 0.08 0.00 0.04 99.52 09:19:07 06:09:01 AM 0 0.12 0.00 0.08 0.00 0.05 99.75 09:19:07 06:09:01 AM 1 0.62 0.00 0.07 0.00 0.03 99.28 09:19:07 06:10:01 AM all 0.36 0.00 0.08 0.00 0.03 99.52 09:19:07 06:10:01 AM 0 0.18 0.00 0.12 0.00 0.05 99.65 09:19:07 06:10:01 AM 1 0.53 0.00 0.05 0.00 0.02 99.40 09:19:07 06:11:01 AM all 2.27 13.87 1.02 1.76 0.08 81.01 09:19:07 06:11:01 AM 0 2.22 17.18 1.18 2.22 0.07 77.13 09:19:07 06:11:01 AM 1 2.31 10.56 0.86 1.30 0.08 84.89 09:19:07 06:12:01 AM all 0.33 0.00 0.07 0.01 0.03 99.57 09:19:07 06:12:01 AM 0 0.55 0.00 0.05 0.00 0.03 99.37 09:19:07 06:12:01 AM 1 0.10 0.00 0.08 0.02 0.03 99.77 09:19:07 06:13:01 AM all 0.45 0.00 0.07 0.00 0.04 99.44 09:19:07 06:13:01 AM 0 0.70 0.00 0.07 0.00 0.03 99.20 09:19:07 06:13:01 AM 1 0.20 0.00 0.07 0.00 0.05 99.68 09:19:07 06:14:01 AM all 0.53 0.00 0.09 0.00 0.06 99.32 09:19:07 06:14:01 AM 0 0.62 0.00 0.10 0.00 0.07 99.22 09:19:07 06:14:01 AM 1 0.45 0.00 0.08 0.00 0.05 99.42 09:19:07 06:15:01 AM all 0.33 0.00 0.07 0.00 0.04 99.56 09:19:07 06:15:01 AM 0 0.53 0.00 0.03 0.00 0.03 99.40 09:19:07 06:15:01 AM 1 0.13 0.00 0.10 0.00 0.05 99.72 09:19:07 06:16:01 AM all 1.41 0.00 0.13 0.00 0.06 98.40 09:19:07 06:16:01 AM 0 0.72 0.00 0.13 0.00 0.05 99.10 09:19:07 06:16:01 AM 1 2.11 0.00 0.12 0.00 0.07 97.71 09:19:07 06:17:01 AM all 3.50 0.00 0.25 0.00 0.08 96.17 09:19:07 06:17:01 AM 0 2.49 0.00 0.22 0.00 0.07 97.22 09:19:07 06:17:01 AM 1 4.52 0.00 0.29 0.00 0.08 95.11 09:19:07 06:18:01 AM all 3.98 0.00 0.31 0.00 0.05 95.66 09:19:07 06:18:01 AM 0 3.12 0.00 0.27 0.00 0.05 96.56 09:19:07 06:18:01 AM 1 4.85 0.00 0.35 0.00 0.05 94.75 09:19:07 09:19:07 06:18:01 AM CPU %user %nice %system %iowait %steal %idle 09:19:07 06:19:01 AM all 4.10 0.00 0.29 0.00 0.06 95.55 09:19:07 06:19:01 AM 0 2.72 0.00 0.22 0.00 0.05 97.02 09:19:07 06:19:01 AM 1 5.49 0.00 0.37 0.00 0.07 94.08 09:19:07 06:20:01 AM all 4.29 0.00 0.29 0.00 0.05 95.38 09:19:07 06:20:01 AM 0 3.13 0.00 0.22 0.00 0.05 96.60 09:19:07 06:20:01 AM 1 5.45 0.00 0.35 0.00 0.05 94.15 09:19:07 06:21:01 AM all 4.49 0.00 0.30 0.00 0.06 95.15 09:19:07 06:21:01 AM 0 2.76 0.00 0.22 0.00 0.05 96.97 09:19:07 06:21:01 AM 1 6.22 0.00 0.39 0.00 0.07 93.33 09:19:07 06:22:01 AM all 4.18 0.00 0.32 0.00 0.06 95.45 09:19:07 06:22:01 AM 0 3.86 0.00 0.33 0.00 0.07 95.73 09:19:07 06:22:01 AM 1 4.49 0.00 0.30 0.00 0.05 95.16 09:19:07 06:23:01 AM all 6.47 0.00 0.34 0.00 0.08 93.11 09:19:07 06:23:01 AM 0 4.94 0.00 0.25 0.00 0.08 94.73 09:19:07 06:23:01 AM 1 8.00 0.00 0.42 0.00 0.08 91.49 09:19:07 06:24:01 AM all 0.56 0.00 0.08 0.03 0.06 99.28 09:19:07 06:24:01 AM 0 0.53 0.00 0.08 0.05 0.07 99.27 09:19:07 06:24:01 AM 1 0.58 0.00 0.07 0.00 0.05 99.30 09:19:07 06:25:01 AM all 0.33 0.00 0.04 0.00 0.03 99.59 09:19:07 06:25:01 AM 0 0.55 0.00 0.02 0.00 0.03 99.40 09:19:07 06:25:01 AM 1 0.12 0.00 0.07 0.00 0.03 99.78 09:19:07 06:26:01 AM all 0.43 0.00 0.07 0.00 0.04 99.47 09:19:07 06:26:01 AM 0 0.55 0.00 0.05 0.00 0.03 99.37 09:19:07 06:26:01 AM 1 0.30 0.00 0.08 0.00 0.05 99.57 09:19:07 06:27:01 AM all 0.29 0.00 0.04 0.00 0.03 99.63 09:19:07 06:27:01 AM 0 0.53 0.00 0.05 0.00 0.02 99.40 09:19:07 06:27:01 AM 1 0.05 0.00 0.03 0.00 0.05 99.87 09:19:07 06:28:01 AM all 0.31 0.00 0.05 0.00 0.03 99.61 09:19:07 06:28:01 AM 0 0.53 0.00 0.03 0.00 0.03 99.40 09:19:07 06:28:01 AM 1 0.08 0.00 0.07 0.00 0.03 99.82 09:19:07 06:29:02 AM all 0.41 0.00 0.06 0.01 0.04 99.48 09:19:07 06:29:02 AM 0 0.57 0.00 0.07 0.00 0.03 99.33 09:19:07 06:29:02 AM 1 0.25 0.00 0.05 0.02 0.05 99.63 09:19:07 09:19:07 06:29:02 AM CPU %user %nice %system %iowait %steal %idle 09:19:07 06:30:01 AM all 0.31 0.00 0.06 0.00 0.03 99.60 09:19:07 06:30:01 AM 0 0.53 0.00 0.05 0.00 0.02 99.41 09:19:07 06:30:01 AM 1 0.08 0.00 0.07 0.00 0.05 99.80 09:19:07 06:31:01 AM all 1.60 0.00 0.13 0.00 0.06 98.20 09:19:07 06:31:01 AM 0 1.82 0.00 0.17 0.00 0.03 97.98 09:19:07 06:31:01 AM 1 1.39 0.00 0.10 0.00 0.08 98.43 09:19:07 06:32:01 AM all 0.53 0.00 0.15 0.00 0.04 99.28 09:19:07 06:32:01 AM 0 0.38 0.00 0.20 0.00 0.03 99.38 09:19:07 06:32:01 AM 1 0.67 0.00 0.10 0.00 0.05 99.18 09:19:07 06:33:01 AM all 0.68 0.00 0.08 0.00 0.04 99.20 09:19:07 06:33:01 AM 0 0.62 0.00 0.10 0.00 0.03 99.25 09:19:07 06:33:01 AM 1 0.75 0.00 0.05 0.00 0.05 99.15 09:19:07 06:34:01 AM all 0.33 0.00 0.06 0.00 0.05 99.56 09:19:07 06:34:01 AM 0 0.55 0.00 0.05 0.00 0.03 99.37 09:19:07 06:34:01 AM 1 0.12 0.00 0.07 0.00 0.07 99.75 09:19:07 06:35:01 AM all 0.86 0.00 0.08 0.00 0.03 99.03 09:19:07 06:35:01 AM 0 0.74 0.00 0.08 0.00 0.03 99.15 09:19:07 06:35:01 AM 1 0.98 0.00 0.08 0.00 0.02 98.92 09:19:07 06:36:01 AM all 0.43 0.00 0.07 0.00 0.03 99.48 09:19:07 06:36:01 AM 0 0.57 0.00 0.02 0.00 0.02 99.40 09:19:07 06:36:01 AM 1 0.28 0.00 0.12 0.00 0.03 99.57 09:19:07 06:37:01 AM all 0.81 0.00 0.12 0.00 0.04 99.03 09:19:07 06:37:01 AM 0 0.74 0.00 0.08 0.00 0.03 99.15 09:19:07 06:37:01 AM 1 0.88 0.00 0.15 0.00 0.05 98.91 09:19:07 06:38:01 AM all 0.66 0.00 0.10 0.00 0.04 99.20 09:19:07 06:38:01 AM 0 0.65 0.00 0.08 0.00 0.05 99.21 09:19:07 06:38:01 AM 1 0.67 0.00 0.12 0.00 0.03 99.18 09:19:07 06:39:01 AM all 0.76 0.00 0.13 0.00 0.05 99.07 09:19:07 06:39:01 AM 0 0.70 0.00 0.10 0.00 0.05 99.15 09:19:07 06:39:01 AM 1 0.82 0.00 0.15 0.00 0.05 98.98 09:19:07 06:40:01 AM all 0.72 0.00 0.11 0.00 0.05 99.12 09:19:07 06:40:01 AM 0 0.52 0.00 0.15 0.00 0.07 99.27 09:19:07 06:40:01 AM 1 0.92 0.00 0.07 0.00 0.03 98.98 09:19:07 09:19:07 06:40:01 AM CPU %user %nice %system %iowait %steal %idle 09:19:07 06:41:01 AM all 0.33 0.00 0.07 0.00 0.03 99.57 09:19:07 06:41:01 AM 0 0.15 0.00 0.10 0.00 0.05 99.70 09:19:07 06:41:01 AM 1 0.52 0.00 0.03 0.00 0.02 99.43 09:19:07 06:42:01 AM all 0.79 0.00 0.08 0.00 0.04 99.08 09:19:07 06:42:01 AM 0 0.27 0.00 0.12 0.00 0.07 99.55 09:19:07 06:42:01 AM 1 1.32 0.00 0.05 0.00 0.02 98.62 09:19:07 06:43:01 AM all 0.37 0.00 0.09 0.00 0.04 99.50 09:19:07 06:43:01 AM 0 0.55 0.00 0.05 0.00 0.03 99.37 09:19:07 06:43:01 AM 1 0.18 0.00 0.13 0.00 0.05 99.63 09:19:07 06:44:01 AM all 1.16 0.00 0.09 0.00 0.05 98.70 09:19:07 06:44:01 AM 0 0.63 0.00 0.03 0.00 0.05 99.28 09:19:07 06:44:01 AM 1 1.69 0.00 0.15 0.00 0.05 98.11 09:19:07 06:45:01 AM all 1.69 0.00 0.14 0.00 0.04 98.13 09:19:07 06:45:01 AM 0 1.60 0.00 0.12 0.00 0.05 98.23 09:19:07 06:45:01 AM 1 1.77 0.00 0.17 0.00 0.03 98.03 09:19:07 06:46:01 AM all 4.19 0.00 0.29 0.00 0.06 95.45 09:19:07 06:46:01 AM 0 1.71 0.00 0.13 0.00 0.05 98.11 09:19:07 06:46:01 AM 1 6.69 0.00 0.45 0.00 0.07 92.79 09:19:07 06:47:01 AM all 4.48 0.00 0.33 0.00 0.08 95.11 09:19:07 06:47:01 AM 0 2.17 0.00 0.23 0.00 0.05 97.54 09:19:07 06:47:01 AM 1 6.80 0.00 0.44 0.00 0.10 92.66 09:19:07 06:48:01 AM all 4.42 0.00 0.34 0.01 0.08 95.15 09:19:07 06:48:01 AM 0 2.63 0.00 0.23 0.00 0.07 97.07 09:19:07 06:48:01 AM 1 6.21 0.00 0.45 0.02 0.10 93.22 09:19:07 06:49:01 AM all 4.29 0.00 0.34 0.00 0.05 95.31 09:19:07 06:49:01 AM 0 3.48 0.00 0.33 0.00 0.05 96.13 09:19:07 06:49:01 AM 1 5.10 0.00 0.35 0.00 0.05 94.49 09:19:07 06:50:01 AM all 4.58 0.00 0.32 0.00 0.06 95.05 09:19:07 06:50:01 AM 0 5.12 0.00 0.33 0.00 0.07 94.47 09:19:07 06:50:01 AM 1 4.03 0.00 0.30 0.00 0.05 95.62 09:19:07 06:51:01 AM all 4.52 0.00 0.33 0.00 0.06 95.10 09:19:07 06:51:01 AM 0 4.35 0.00 0.33 0.00 0.07 95.25 09:19:07 06:51:01 AM 1 4.68 0.00 0.32 0.00 0.05 94.95 09:19:07 09:19:07 06:51:01 AM CPU %user %nice %system %iowait %steal %idle 09:19:07 06:52:01 AM all 4.13 0.00 0.21 0.00 0.04 95.62 09:19:07 06:52:01 AM 0 2.04 0.00 0.13 0.00 0.03 97.79 09:19:07 06:52:01 AM 1 6.23 0.00 0.28 0.00 0.05 93.43 09:19:07 06:53:01 AM all 0.33 0.00 0.04 0.00 0.02 99.62 09:19:07 06:53:01 AM 0 0.52 0.00 0.02 0.00 0.00 99.47 09:19:07 06:53:01 AM 1 0.13 0.00 0.07 0.00 0.03 99.77 09:19:07 06:54:01 AM all 0.48 0.00 0.08 0.00 0.03 99.42 09:19:07 06:54:01 AM 0 0.57 0.00 0.05 0.00 0.03 99.35 09:19:07 06:54:01 AM 1 0.38 0.00 0.10 0.00 0.03 99.48 09:19:07 06:55:01 AM all 0.33 0.00 0.06 0.00 0.02 99.59 09:19:07 06:55:01 AM 0 0.53 0.00 0.03 0.00 0.00 99.43 09:19:07 06:55:01 AM 1 0.13 0.00 0.08 0.00 0.03 99.75 09:19:07 06:56:01 AM all 0.36 0.00 0.07 0.00 0.03 99.55 09:19:07 06:56:01 AM 0 0.55 0.00 0.03 0.00 0.02 99.40 09:19:07 06:56:01 AM 1 0.17 0.00 0.10 0.00 0.03 99.70 09:19:07 06:57:01 AM all 0.61 0.00 0.10 0.00 0.04 99.25 09:19:07 06:57:01 AM 0 0.53 0.00 0.05 0.00 0.03 99.38 09:19:07 06:57:01 AM 1 0.69 0.00 0.15 0.00 0.05 99.11 09:19:07 06:58:01 AM all 2.59 0.00 0.23 0.00 0.04 97.15 09:19:07 06:58:01 AM 0 1.27 0.00 0.15 0.00 0.03 98.55 09:19:07 06:58:01 AM 1 3.91 0.00 0.30 0.00 0.05 95.73 09:19:07 06:59:01 AM all 2.07 0.00 1.72 0.00 0.03 96.18 09:19:07 06:59:01 AM 0 3.16 0.00 3.42 0.00 0.03 93.38 09:19:07 06:59:01 AM 1 1.02 0.00 0.07 0.00 0.03 98.88 09:19:07 07:00:01 AM all 2.27 0.00 0.32 0.00 0.04 97.37 09:19:07 07:00:01 AM 0 0.68 0.00 0.13 0.00 0.05 99.13 09:19:07 07:00:01 AM 1 3.88 0.00 0.51 0.00 0.03 95.58 09:19:07 07:01:01 AM all 1.45 0.00 0.28 0.00 0.03 98.25 09:19:07 07:01:01 AM 0 1.74 0.00 0.32 0.00 0.02 97.93 09:19:07 07:01:01 AM 1 1.15 0.00 0.23 0.00 0.03 98.58 09:19:07 07:02:01 AM all 0.18 0.00 0.08 0.00 0.02 99.72 09:19:07 07:02:01 AM 0 0.27 0.00 0.08 0.00 0.02 99.63 09:19:07 07:02:01 AM 1 0.10 0.00 0.08 0.00 0.02 99.80 09:19:07 09:19:07 07:02:01 AM CPU %user %nice %system %iowait %steal %idle 09:19:07 07:03:01 AM all 0.35 0.00 0.08 0.00 0.04 99.52 09:19:07 07:03:01 AM 0 0.44 0.00 0.08 0.00 0.05 99.43 09:19:07 07:03:01 AM 1 0.27 0.00 0.08 0.00 0.03 99.62 09:19:07 07:04:01 AM all 6.09 0.00 0.31 0.00 0.03 93.57 09:19:07 07:04:01 AM 0 6.73 0.00 0.33 0.00 0.03 92.90 09:19:07 07:04:01 AM 1 5.45 0.00 0.28 0.00 0.03 94.24 09:19:07 07:05:01 AM all 2.81 0.00 0.16 0.00 0.04 96.98 09:19:07 07:05:01 AM 0 1.07 0.00 0.12 0.00 0.05 98.76 09:19:07 07:05:01 AM 1 4.56 0.00 0.20 0.00 0.03 95.21 09:19:07 07:06:01 AM all 2.11 0.00 0.14 0.00 0.03 97.71 09:19:07 07:06:01 AM 0 1.69 0.00 0.15 0.00 0.03 98.13 09:19:07 07:06:01 AM 1 2.54 0.00 0.13 0.00 0.03 97.30 09:19:07 07:07:01 AM all 1.40 0.00 0.10 0.00 0.03 98.47 09:19:07 07:07:01 AM 0 0.70 0.00 0.10 0.00 0.05 99.15 09:19:07 07:07:01 AM 1 2.09 0.00 0.10 0.00 0.02 97.79 09:19:07 07:08:01 AM all 3.45 0.00 0.25 0.00 0.05 96.25 09:19:07 07:08:01 AM 0 5.03 0.00 0.34 0.00 0.05 94.59 09:19:07 07:08:01 AM 1 1.87 0.00 0.17 0.00 0.05 97.91 09:19:07 07:09:01 AM all 4.34 0.00 0.30 0.00 0.04 95.31 09:19:07 07:09:01 AM 0 2.06 0.00 0.20 0.00 0.03 97.71 09:19:07 07:09:01 AM 1 6.63 0.00 0.40 0.00 0.05 92.92 09:19:07 07:10:01 AM all 4.27 0.00 0.29 0.00 0.05 95.39 09:19:07 07:10:01 AM 0 4.33 0.00 0.28 0.00 0.05 95.33 09:19:07 07:10:01 AM 1 4.20 0.00 0.30 0.00 0.05 95.45 09:19:07 07:11:01 AM all 4.33 0.00 0.34 0.00 0.06 95.27 09:19:07 07:11:01 AM 0 4.70 0.00 0.35 0.00 0.07 94.88 09:19:07 07:11:01 AM 1 3.96 0.00 0.33 0.00 0.05 95.65 09:19:07 07:12:01 AM all 4.25 0.00 0.31 0.00 0.05 95.39 09:19:07 07:12:01 AM 0 2.39 0.00 0.22 0.00 0.03 97.36 09:19:07 07:12:01 AM 1 6.12 0.00 0.40 0.00 0.07 93.41 09:19:07 07:13:01 AM all 4.19 0.00 0.31 0.00 0.04 95.46 09:19:07 07:13:01 AM 0 2.16 0.00 0.20 0.00 0.03 97.61 09:19:07 07:13:01 AM 1 6.24 0.00 0.42 0.00 0.05 93.30 09:19:07 09:19:07 07:13:01 AM CPU %user %nice %system %iowait %steal %idle 09:19:07 07:14:01 AM all 6.20 0.00 0.31 0.01 0.06 93.42 09:19:07 07:14:01 AM 0 3.24 0.00 0.20 0.02 0.05 96.49 09:19:07 07:14:01 AM 1 9.17 0.00 0.42 0.00 0.07 90.35 09:19:07 07:15:01 AM all 0.54 0.00 0.07 0.00 0.03 99.36 09:19:07 07:15:01 AM 0 0.50 0.00 0.07 0.00 0.02 99.42 09:19:07 07:15:01 AM 1 0.58 0.00 0.07 0.00 0.05 99.30 09:19:07 07:16:01 AM all 0.33 0.00 0.07 0.00 0.03 99.58 09:19:07 07:16:01 AM 0 0.08 0.00 0.07 0.00 0.03 99.82 09:19:07 07:16:01 AM 1 0.57 0.00 0.07 0.00 0.02 99.35 09:19:07 07:17:01 AM all 0.42 0.20 0.11 0.01 0.03 99.24 09:19:07 07:17:01 AM 0 0.25 0.32 0.12 0.00 0.02 99.30 09:19:07 07:17:01 AM 1 0.58 0.08 0.10 0.02 0.03 99.18 09:19:07 07:18:01 AM all 0.32 0.00 0.07 0.00 0.03 99.59 09:19:07 07:18:01 AM 0 0.05 0.00 0.05 0.00 0.02 99.88 09:19:07 07:18:01 AM 1 0.58 0.00 0.08 0.00 0.03 99.30 09:19:07 07:19:01 AM all 0.33 0.00 0.07 0.00 0.03 99.58 09:19:07 07:19:01 AM 0 0.08 0.00 0.05 0.00 0.02 99.85 09:19:07 07:19:01 AM 1 0.57 0.00 0.08 0.00 0.03 99.32 09:19:07 07:20:01 AM all 0.23 0.00 0.07 0.00 0.02 99.68 09:19:07 07:20:01 AM 0 0.10 0.00 0.05 0.00 0.02 99.83 09:19:07 07:20:01 AM 1 0.37 0.00 0.08 0.00 0.02 99.53 09:19:07 07:21:01 AM all 0.31 0.00 0.07 0.00 0.03 99.60 09:19:07 07:21:01 AM 0 0.10 0.00 0.10 0.00 0.03 99.77 09:19:07 07:21:01 AM 1 0.52 0.00 0.03 0.00 0.02 99.43 09:19:07 07:22:01 AM all 1.73 0.00 0.17 0.00 0.03 98.07 09:19:07 07:22:01 AM 0 0.72 0.00 0.12 0.00 0.03 99.13 09:19:07 07:22:01 AM 1 2.74 0.00 0.22 0.00 0.03 97.01 09:19:07 07:23:01 AM all 0.85 0.00 0.18 0.00 0.03 98.94 09:19:07 07:23:01 AM 0 1.20 0.00 0.10 0.00 0.02 98.68 09:19:07 07:23:01 AM 1 0.50 0.00 0.27 0.00 0.03 99.20 09:19:07 07:24:01 AM all 0.36 0.00 0.07 0.00 0.03 99.55 09:19:07 07:24:01 AM 0 0.38 0.00 0.03 0.00 0.02 99.57 09:19:07 07:24:01 AM 1 0.33 0.00 0.10 0.00 0.03 99.53 09:19:07 09:19:07 07:24:01 AM CPU %user %nice %system %iowait %steal %idle 09:19:07 07:25:01 AM all 0.27 0.00 0.11 0.00 0.03 99.59 09:19:07 07:25:01 AM 0 0.35 0.00 0.12 0.00 0.02 99.51 09:19:07 07:25:01 AM 1 0.18 0.00 0.10 0.00 0.05 99.67 09:19:07 07:26:01 AM all 0.51 0.00 0.17 0.00 0.03 99.30 09:19:07 07:26:01 AM 0 0.52 0.00 0.18 0.00 0.02 99.28 09:19:07 07:26:01 AM 1 0.50 0.00 0.15 0.00 0.03 99.31 09:19:07 07:27:01 AM all 0.58 0.00 0.14 0.00 0.04 99.24 09:19:07 07:27:01 AM 0 0.37 0.00 0.17 0.00 0.03 99.43 09:19:07 07:27:01 AM 1 0.78 0.00 0.12 0.00 0.05 99.05 09:19:07 07:28:01 AM all 0.54 0.00 0.11 0.00 0.03 99.32 09:19:07 07:28:01 AM 0 0.33 0.00 0.15 0.00 0.03 99.48 09:19:07 07:28:01 AM 1 0.75 0.00 0.07 0.00 0.02 99.17 09:19:07 07:29:01 AM all 0.71 0.00 0.08 0.00 0.04 99.17 09:19:07 07:29:01 AM 0 0.77 0.00 0.07 0.00 0.02 99.15 09:19:07 07:29:01 AM 1 0.65 0.00 0.10 0.00 0.07 99.18 09:19:07 07:30:01 AM all 0.34 0.00 0.07 0.00 0.03 99.56 09:19:07 07:30:01 AM 0 0.10 0.00 0.07 0.00 0.02 99.82 09:19:07 07:30:01 AM 1 0.58 0.00 0.07 0.00 0.05 99.30 09:19:07 07:31:01 AM all 1.19 0.00 0.12 0.00 0.03 98.67 09:19:07 07:31:01 AM 0 0.43 0.00 0.10 0.00 0.02 99.45 09:19:07 07:31:01 AM 1 1.94 0.00 0.13 0.00 0.03 97.90 09:19:07 07:32:02 AM all 4.25 0.00 0.32 0.00 0.05 95.38 09:19:07 07:32:02 AM 0 5.47 0.00 0.40 0.00 0.07 94.06 09:19:07 07:32:02 AM 1 3.03 0.00 0.23 0.00 0.03 96.71 09:19:07 07:33:01 AM all 4.30 0.00 0.29 0.00 0.05 95.36 09:19:07 07:33:01 AM 0 4.34 0.00 0.29 0.00 0.03 95.34 09:19:07 07:33:01 AM 1 4.25 0.00 0.29 0.00 0.07 95.39 09:19:07 07:34:01 AM all 4.39 0.00 0.31 0.00 0.05 95.25 09:19:07 07:34:01 AM 0 4.47 0.00 0.30 0.00 0.05 95.18 09:19:07 07:34:01 AM 1 4.32 0.00 0.32 0.00 0.05 95.31 09:19:07 07:35:01 AM all 4.34 0.00 0.30 0.00 0.04 95.31 09:19:07 07:35:01 AM 0 3.80 0.00 0.28 0.00 0.03 95.88 09:19:07 07:35:01 AM 1 4.89 0.00 0.32 0.00 0.05 94.74 09:19:07 09:19:07 07:35:01 AM CPU %user %nice %system %iowait %steal %idle 09:19:07 07:36:01 AM all 4.30 0.00 0.31 0.00 0.05 95.34 09:19:07 07:36:01 AM 0 5.87 0.00 0.40 0.00 0.07 93.67 09:19:07 07:36:01 AM 1 2.74 0.00 0.22 0.00 0.03 97.01 09:19:07 07:37:01 AM all 4.28 0.00 0.32 0.00 0.06 95.34 09:19:07 07:37:01 AM 0 4.57 0.00 0.39 0.00 0.07 94.97 09:19:07 07:37:01 AM 1 3.98 0.00 0.25 0.00 0.05 95.71 09:19:07 07:38:01 AM all 5.54 0.00 0.28 0.00 0.04 94.13 09:19:07 07:38:01 AM 0 1.87 0.00 0.18 0.00 0.03 97.91 09:19:07 07:38:01 AM 1 9.22 0.00 0.39 0.00 0.05 90.34 09:19:07 07:39:01 AM all 0.89 0.00 0.09 0.00 0.05 98.96 09:19:07 07:39:01 AM 0 0.69 0.00 0.08 0.00 0.05 99.18 09:19:07 07:39:01 AM 1 1.10 0.00 0.10 0.00 0.05 98.75 09:19:07 07:40:01 AM all 0.88 0.00 0.10 0.00 0.04 98.98 09:19:07 07:40:01 AM 0 1.00 0.00 0.12 0.00 0.05 98.83 09:19:07 07:40:01 AM 1 0.75 0.00 0.08 0.00 0.03 99.13 09:19:07 07:41:01 AM all 0.74 0.00 0.10 0.00 0.04 99.11 09:19:07 07:41:01 AM 0 0.47 0.00 0.08 0.00 0.03 99.41 09:19:07 07:41:01 AM 1 1.02 0.00 0.12 0.00 0.05 98.81 09:19:07 07:42:01 AM all 0.86 0.00 0.09 0.00 0.05 99.00 09:19:07 07:42:01 AM 0 0.73 0.00 0.05 0.00 0.05 99.16 09:19:07 07:42:01 AM 1 0.99 0.00 0.13 0.00 0.05 98.83 09:19:07 07:43:01 AM all 0.85 0.00 0.10 0.00 0.04 99.01 09:19:07 07:43:01 AM 0 0.62 0.00 0.07 0.00 0.03 99.28 09:19:07 07:43:01 AM 1 1.09 0.00 0.13 0.00 0.05 98.73 09:19:07 07:44:01 AM all 2.05 0.00 0.18 0.01 0.03 97.73 09:19:07 07:44:01 AM 0 0.99 0.00 0.13 0.00 0.03 98.85 09:19:07 07:44:01 AM 1 3.11 0.00 0.23 0.02 0.03 96.61 09:19:07 07:45:01 AM all 0.48 0.00 0.08 0.00 0.03 99.41 09:19:07 07:45:01 AM 0 0.62 0.00 0.07 0.00 0.03 99.28 09:19:07 07:45:01 AM 1 0.35 0.00 0.08 0.00 0.03 99.53 09:19:07 07:46:01 AM all 0.74 0.00 0.08 0.00 0.02 99.17 09:19:07 07:46:01 AM 0 0.63 0.00 0.08 0.00 0.02 99.27 09:19:07 07:46:01 AM 1 0.85 0.00 0.07 0.00 0.02 99.07 09:19:07 09:19:07 07:46:01 AM CPU %user %nice %system %iowait %steal %idle 09:19:07 07:47:01 AM all 0.34 0.00 0.08 0.00 0.03 99.56 09:19:07 07:47:01 AM 0 0.55 0.00 0.07 0.00 0.02 99.37 09:19:07 07:47:01 AM 1 0.13 0.00 0.08 0.00 0.03 99.75 09:19:07 07:48:01 AM all 0.37 0.00 0.11 0.00 0.03 99.50 09:19:07 07:48:01 AM 0 0.23 0.00 0.13 0.00 0.03 99.60 09:19:07 07:48:01 AM 1 0.50 0.00 0.08 0.00 0.02 99.40 09:19:07 07:49:01 AM all 0.53 0.00 0.13 0.00 0.03 99.31 09:19:07 07:49:01 AM 0 0.55 0.00 0.12 0.00 0.03 99.30 09:19:07 07:49:01 AM 1 0.52 0.00 0.13 0.00 0.03 99.32 09:19:07 07:50:01 AM all 0.61 0.00 0.16 0.00 0.03 99.21 09:19:07 07:50:01 AM 0 0.57 0.00 0.20 0.00 0.02 99.22 09:19:07 07:50:01 AM 1 0.65 0.00 0.12 0.00 0.03 99.20 09:19:07 07:51:01 AM all 0.77 0.00 0.11 0.01 0.03 99.09 09:19:07 07:51:01 AM 0 0.88 0.00 0.10 0.02 0.02 98.98 09:19:07 07:51:01 AM 1 0.65 0.00 0.12 0.00 0.03 99.20 09:19:07 07:52:01 AM all 0.33 0.00 0.06 0.00 0.03 99.58 09:19:07 07:52:01 AM 0 0.10 0.00 0.08 0.00 0.03 99.78 09:19:07 07:52:01 AM 1 0.57 0.00 0.03 0.00 0.02 99.38 09:19:07 07:53:01 AM all 1.29 0.00 0.09 0.00 0.04 98.57 09:19:07 07:53:01 AM 0 1.35 0.00 0.10 0.00 0.05 98.50 09:19:07 07:53:01 AM 1 1.23 0.00 0.08 0.00 0.03 98.65 09:19:07 07:54:01 AM all 2.17 0.00 0.18 0.00 0.03 97.61 09:19:07 07:54:01 AM 0 1.34 0.00 0.13 0.00 0.03 98.50 09:19:07 07:54:01 AM 1 3.01 0.00 0.23 0.00 0.03 96.73 09:19:07 07:55:01 AM all 4.49 0.00 0.31 0.00 0.05 95.15 09:19:07 07:55:01 AM 0 2.01 0.00 0.15 0.00 0.03 97.81 09:19:07 07:55:01 AM 1 6.97 0.00 0.47 0.00 0.07 92.50 09:19:07 07:56:01 AM all 4.10 0.00 0.32 0.00 0.06 95.52 09:19:07 07:56:01 AM 0 5.95 0.00 0.40 0.00 0.07 93.58 09:19:07 07:56:01 AM 1 2.26 0.00 0.23 0.00 0.05 97.46 09:19:07 07:57:01 AM all 4.27 0.00 0.32 0.00 0.05 95.36 09:19:07 07:57:01 AM 0 4.13 0.00 0.32 0.00 0.05 95.50 09:19:07 07:57:01 AM 1 4.40 0.00 0.32 0.00 0.05 95.23 09:19:07 09:19:07 07:57:01 AM CPU %user %nice %system %iowait %steal %idle 09:19:07 07:58:01 AM all 4.33 0.00 0.30 0.00 0.05 95.31 09:19:07 07:58:01 AM 0 5.91 0.00 0.37 0.00 0.05 93.67 09:19:07 07:58:01 AM 1 2.76 0.00 0.23 0.00 0.05 96.96 09:19:07 07:59:01 AM all 4.27 0.00 0.30 0.00 0.06 95.37 09:19:07 07:59:01 AM 0 1.99 0.00 0.20 0.00 0.07 97.74 09:19:07 07:59:01 AM 1 6.55 0.00 0.40 0.00 0.05 93.00 09:19:07 08:00:01 AM all 4.11 0.00 0.32 0.00 0.05 95.52 09:19:07 08:00:01 AM 0 0.99 0.00 0.18 0.00 0.03 98.79 09:19:07 08:00:01 AM 1 7.22 0.00 0.45 0.00 0.07 92.26 09:19:07 08:01:01 AM all 4.76 0.00 0.26 0.00 0.05 94.93 09:19:07 08:01:01 AM 0 2.93 0.00 0.22 0.00 0.03 96.82 09:19:07 08:01:01 AM 1 6.60 0.00 0.30 0.00 0.07 93.03 09:19:07 08:02:01 AM all 0.46 0.00 0.05 0.00 0.03 99.47 09:19:07 08:02:01 AM 0 0.82 0.00 0.02 0.00 0.02 99.15 09:19:07 08:02:01 AM 1 0.10 0.00 0.08 0.00 0.03 99.78 09:19:07 08:03:01 AM all 0.31 0.00 0.04 0.00 0.02 99.63 09:19:07 08:03:01 AM 0 0.52 0.00 0.02 0.00 0.00 99.47 09:19:07 08:03:01 AM 1 0.10 0.00 0.07 0.00 0.03 99.80 09:19:07 08:04:01 AM all 0.43 0.00 0.08 0.00 0.03 99.47 09:19:07 08:04:01 AM 0 0.55 0.00 0.07 0.00 0.02 99.37 09:19:07 08:04:01 AM 1 0.30 0.00 0.08 0.00 0.03 99.58 09:19:07 08:05:01 AM all 0.33 0.00 0.04 0.00 0.03 99.61 09:19:07 08:05:01 AM 0 0.53 0.00 0.02 0.00 0.02 99.43 09:19:07 08:05:01 AM 1 0.12 0.00 0.07 0.00 0.03 99.78 09:19:07 08:06:01 AM all 0.42 0.00 0.06 0.00 0.03 99.49 09:19:07 08:06:01 AM 0 0.72 0.00 0.05 0.00 0.02 99.22 09:19:07 08:06:01 AM 1 0.12 0.00 0.07 0.00 0.05 99.77 09:19:07 08:07:01 AM all 0.32 0.00 0.04 0.00 0.03 99.62 09:19:07 08:07:01 AM 0 0.57 0.00 0.05 0.00 0.02 99.37 09:19:07 08:07:01 AM 1 0.07 0.00 0.03 0.00 0.03 99.87 09:19:07 08:08:01 AM all 1.47 0.00 0.09 0.00 0.03 98.41 09:19:07 08:08:01 AM 0 1.87 0.00 0.10 0.00 0.02 98.01 09:19:07 08:08:01 AM 1 1.07 0.00 0.08 0.00 0.03 98.81 09:19:07 09:19:07 08:08:01 AM CPU %user %nice %system %iowait %steal %idle 09:19:07 08:09:01 AM all 0.59 0.00 0.27 0.00 0.03 99.11 09:19:07 08:09:01 AM 0 0.67 0.00 0.28 0.00 0.03 99.01 09:19:07 08:09:01 AM 1 0.50 0.00 0.25 0.00 0.03 99.21 09:19:07 08:10:01 AM all 0.54 0.00 0.09 0.00 0.03 99.35 09:19:07 08:10:01 AM 0 0.40 0.00 0.12 0.00 0.03 99.45 09:19:07 08:10:01 AM 1 0.67 0.00 0.07 0.00 0.02 99.25 09:19:07 08:11:01 AM all 0.35 0.00 0.08 0.00 0.03 99.55 09:19:07 08:11:01 AM 0 0.58 0.00 0.07 0.00 0.02 99.33 09:19:07 08:11:01 AM 1 0.12 0.00 0.08 0.00 0.03 99.77 09:19:07 08:12:01 AM all 0.48 0.00 0.08 0.00 0.03 99.41 09:19:07 08:12:01 AM 0 0.38 0.00 0.07 0.00 0.02 99.53 09:19:07 08:12:01 AM 1 0.58 0.00 0.10 0.00 0.03 99.28 09:19:07 08:13:01 AM all 0.83 0.00 0.12 0.00 0.04 99.01 09:19:07 08:13:01 AM 0 0.35 0.00 0.15 0.00 0.05 99.45 09:19:07 08:13:01 AM 1 1.30 0.00 0.08 0.00 0.03 98.58 09:19:07 08:14:01 AM all 0.35 0.00 0.06 0.00 0.03 99.57 09:19:07 08:14:01 AM 0 0.57 0.00 0.03 0.00 0.02 99.38 09:19:07 08:14:01 AM 1 0.13 0.00 0.08 0.00 0.03 99.75 09:19:07 08:15:01 AM all 0.34 0.00 0.07 0.00 0.03 99.57 09:19:07 08:15:01 AM 0 0.55 0.00 0.05 0.00 0.02 99.38 09:19:07 08:15:01 AM 1 0.13 0.00 0.08 0.00 0.03 99.75 09:19:07 08:16:01 AM all 3.88 0.00 0.26 0.00 0.04 95.82 09:19:07 08:16:01 AM 0 2.56 0.00 0.25 0.00 0.03 97.16 09:19:07 08:16:01 AM 1 5.21 0.00 0.27 0.00 0.05 94.47 09:19:07 08:17:01 AM all 4.37 0.00 0.30 0.00 0.06 95.27 09:19:07 08:17:01 AM 0 3.85 0.00 0.28 0.00 0.07 95.80 09:19:07 08:17:01 AM 1 4.90 0.00 0.32 0.00 0.05 94.73 09:19:07 08:18:01 AM all 4.29 0.00 0.34 0.00 0.06 95.30 09:19:07 08:18:01 AM 0 4.07 0.00 0.32 0.00 0.07 95.55 09:19:07 08:18:01 AM 1 4.52 0.00 0.37 0.00 0.05 95.06 09:19:07 08:19:01 AM all 4.30 0.00 0.32 0.00 0.05 95.33 09:19:07 08:19:01 AM 0 1.97 0.00 0.17 0.00 0.05 97.81 09:19:07 08:19:01 AM 1 6.64 0.00 0.47 0.00 0.05 92.84 09:19:07 09:19:07 08:19:01 AM CPU %user %nice %system %iowait %steal %idle 09:19:07 08:20:01 AM all 4.23 0.00 0.29 0.00 0.07 95.41 09:19:07 08:20:01 AM 0 1.40 0.00 0.17 0.00 0.05 98.38 09:19:07 08:20:01 AM 1 7.05 0.00 0.42 0.00 0.08 92.45 09:19:07 08:21:01 AM all 4.32 0.00 0.33 0.00 0.05 95.30 09:19:07 08:21:01 AM 0 6.15 0.00 0.40 0.00 0.07 93.38 09:19:07 08:21:01 AM 1 2.49 0.00 0.27 0.00 0.03 97.21 09:19:07 08:22:01 AM all 6.42 0.00 0.32 0.00 0.05 93.21 09:19:07 08:22:01 AM 0 6.54 0.00 0.30 0.00 0.05 93.11 09:19:07 08:22:01 AM 1 6.30 0.00 0.34 0.00 0.05 93.31 09:19:07 08:23:01 AM all 0.48 0.00 0.08 0.00 0.03 99.41 09:19:07 08:23:01 AM 0 0.35 0.00 0.08 0.00 0.03 99.53 09:19:07 08:23:01 AM 1 0.62 0.00 0.07 0.00 0.03 99.28 09:19:07 08:24:01 AM all 0.36 0.00 0.05 0.00 0.03 99.57 09:19:07 08:24:01 AM 0 0.13 0.00 0.07 0.00 0.02 99.78 09:19:07 08:24:01 AM 1 0.58 0.00 0.03 0.00 0.03 99.35 09:19:07 08:25:01 AM all 0.45 0.00 0.08 0.00 0.02 99.46 09:19:07 08:25:01 AM 0 0.32 0.00 0.07 0.00 0.02 99.60 09:19:07 08:25:01 AM 1 0.58 0.00 0.08 0.00 0.02 99.32 09:19:07 08:26:01 AM all 0.33 0.00 0.05 0.00 0.03 99.58 09:19:07 08:26:01 AM 0 0.12 0.00 0.08 0.00 0.03 99.77 09:19:07 08:26:01 AM 1 0.55 0.00 0.02 0.00 0.03 99.40 09:19:07 08:27:01 AM all 0.44 0.00 0.08 0.00 0.03 99.46 09:19:07 08:27:01 AM 0 0.33 0.00 0.08 0.00 0.03 99.55 09:19:07 08:27:01 AM 1 0.55 0.00 0.07 0.00 0.02 99.37 09:19:07 08:28:01 AM all 0.34 0.00 0.06 0.00 0.03 99.57 09:19:07 08:28:01 AM 0 0.13 0.00 0.08 0.00 0.03 99.75 09:19:07 08:28:01 AM 1 0.55 0.00 0.03 0.00 0.02 99.40 09:19:07 08:29:01 AM all 1.47 0.00 0.09 0.01 0.04 98.39 09:19:07 08:29:01 AM 0 2.29 0.00 0.13 0.02 0.05 97.51 09:19:07 08:29:01 AM 1 0.65 0.00 0.05 0.00 0.03 99.27 09:19:07 08:30:01 AM all 2.64 0.00 0.26 0.00 0.04 97.05 09:19:07 08:30:01 AM 0 3.18 0.00 0.34 0.00 0.05 96.43 09:19:07 08:30:01 AM 1 2.10 0.00 0.18 0.00 0.03 97.68 09:19:07 09:19:07 08:30:01 AM CPU %user %nice %system %iowait %steal %idle 09:19:07 08:31:01 AM all 3.89 0.00 0.31 0.00 0.05 95.75 09:19:07 08:31:01 AM 0 3.38 0.00 0.28 0.00 0.05 96.28 09:19:07 08:31:01 AM 1 4.40 0.00 0.33 0.00 0.05 95.21 09:19:07 08:32:01 AM all 4.31 0.00 0.35 0.00 0.07 95.27 09:19:07 08:32:01 AM 0 3.63 0.00 0.32 0.00 0.07 95.98 09:19:07 08:32:01 AM 1 4.99 0.00 0.38 0.00 0.07 94.56 09:19:07 08:33:01 AM all 4.43 0.00 0.32 0.00 0.05 95.20 09:19:07 08:33:01 AM 0 3.43 0.00 0.23 0.00 0.05 96.29 09:19:07 08:33:01 AM 1 5.44 0.00 0.40 0.00 0.05 94.11 09:19:07 08:34:01 AM all 4.18 0.00 0.31 0.00 0.05 95.46 09:19:07 08:34:01 AM 0 2.36 0.00 0.23 0.00 0.03 97.37 09:19:07 08:34:01 AM 1 5.99 0.00 0.39 0.00 0.07 93.56 09:19:07 08:35:01 AM all 4.36 0.00 0.33 0.00 0.05 95.26 09:19:07 08:35:01 AM 0 3.30 0.00 0.27 0.00 0.05 96.39 09:19:07 08:35:01 AM 1 5.42 0.00 0.38 0.00 0.05 94.14 09:19:07 08:36:01 AM all 4.23 0.00 0.30 0.00 0.06 95.41 09:19:07 08:36:01 AM 0 3.52 0.00 0.30 0.00 0.07 96.12 09:19:07 08:36:01 AM 1 4.95 0.00 0.30 0.00 0.05 94.70 09:19:07 08:37:01 AM all 4.47 0.00 0.27 0.00 0.04 95.22 09:19:07 08:37:01 AM 0 3.81 0.00 0.27 0.00 0.05 95.87 09:19:07 08:37:01 AM 1 5.14 0.00 0.27 0.00 0.03 94.56 09:19:07 08:38:01 AM all 0.34 0.00 0.07 0.00 0.03 99.57 09:19:07 08:38:01 AM 0 0.52 0.00 0.02 0.00 0.00 99.47 09:19:07 08:38:01 AM 1 0.17 0.00 0.12 0.00 0.05 99.67 09:19:07 08:39:02 AM all 0.47 0.00 0.08 0.00 0.03 99.42 09:19:07 08:39:02 AM 0 0.72 0.00 0.03 0.00 0.03 99.22 09:19:07 08:39:02 AM 1 0.22 0.00 0.12 0.00 0.03 99.63 09:19:07 08:40:01 AM all 0.34 0.00 0.07 0.00 0.02 99.58 09:19:07 08:40:01 AM 0 0.12 0.00 0.03 0.00 0.00 99.85 09:19:07 08:40:01 AM 1 0.56 0.00 0.10 0.00 0.03 99.30 09:19:07 08:41:01 AM all 0.37 0.00 0.08 0.00 0.03 99.53 09:19:07 08:41:01 AM 0 0.57 0.00 0.05 0.00 0.02 99.37 09:19:07 08:41:01 AM 1 0.17 0.00 0.10 0.00 0.03 99.70 09:19:07 09:19:07 08:41:01 AM CPU %user %nice %system %iowait %steal %idle 09:19:07 08:42:01 AM all 0.46 0.00 0.07 0.00 0.04 99.43 09:19:07 08:42:01 AM 0 0.63 0.00 0.07 0.00 0.05 99.25 09:19:07 08:42:01 AM 1 0.28 0.00 0.07 0.00 0.03 99.62 09:19:07 08:43:01 AM all 0.35 0.00 0.06 0.00 0.02 99.57 09:19:07 08:43:01 AM 0 0.58 0.00 0.05 0.00 0.00 99.37 09:19:07 08:43:01 AM 1 0.12 0.00 0.07 0.00 0.03 99.78 09:19:07 08:44:01 AM all 2.37 0.00 0.20 0.00 0.03 97.39 09:19:07 08:44:01 AM 0 0.89 0.00 0.12 0.00 0.03 98.96 09:19:07 08:44:01 AM 1 3.86 0.00 0.28 0.00 0.03 95.82 09:19:07 08:45:01 AM all 3.90 0.00 0.32 0.00 0.05 95.74 09:19:07 08:45:01 AM 0 3.63 0.00 0.33 0.00 0.05 95.99 09:19:07 08:45:01 AM 1 4.16 0.00 0.30 0.00 0.05 95.48 09:19:07 08:46:01 AM all 4.36 0.00 0.29 0.00 0.05 95.30 09:19:07 08:46:01 AM 0 4.27 0.00 0.33 0.00 0.05 95.35 09:19:07 08:46:01 AM 1 4.45 0.00 0.25 0.00 0.05 95.25 09:19:07 08:47:01 AM all 4.23 0.00 0.33 0.00 0.06 95.38 09:19:07 08:47:01 AM 0 3.36 0.00 0.30 0.00 0.07 96.27 09:19:07 08:47:01 AM 1 5.09 0.00 0.37 0.00 0.05 94.49 09:19:07 08:48:01 AM all 4.28 0.00 0.29 0.00 0.04 95.39 09:19:07 08:48:01 AM 0 2.04 0.00 0.18 0.00 0.03 97.74 09:19:07 08:48:01 AM 1 6.52 0.00 0.40 0.00 0.05 93.02 09:19:07 08:49:01 AM all 4.29 0.00 0.33 0.00 0.05 95.33 09:19:07 08:49:01 AM 0 3.09 0.00 0.28 0.00 0.05 96.57 09:19:07 08:49:01 AM 1 5.48 0.00 0.39 0.00 0.05 94.09 09:19:07 08:50:01 AM all 4.39 0.00 0.32 0.00 0.05 95.24 09:19:07 08:50:01 AM 0 3.66 0.00 0.27 0.00 0.03 96.03 09:19:07 08:50:01 AM 1 5.12 0.00 0.37 0.00 0.07 94.44 09:19:07 08:51:01 AM all 6.11 0.00 0.34 0.01 0.07 93.47 09:19:07 08:51:01 AM 0 6.37 0.00 0.34 0.00 0.07 93.23 09:19:07 08:51:01 AM 1 5.86 0.00 0.35 0.02 0.07 93.71 09:19:07 08:52:01 AM all 0.41 0.00 0.08 0.00 0.02 99.49 09:19:07 08:52:01 AM 0 0.13 0.00 0.13 0.00 0.03 99.70 09:19:07 08:52:01 AM 1 0.68 0.00 0.03 0.00 0.00 99.28 09:19:07 09:19:07 08:52:01 AM CPU %user %nice %system %iowait %steal %idle 09:19:07 08:53:01 AM all 0.33 0.00 0.05 0.00 0.03 99.59 09:19:07 08:53:01 AM 0 0.15 0.00 0.08 0.00 0.03 99.73 09:19:07 08:53:01 AM 1 0.52 0.00 0.02 0.00 0.02 99.45 09:19:07 08:54:01 AM all 0.48 0.15 0.13 0.00 0.03 99.22 09:19:07 08:54:01 AM 0 0.32 0.30 0.17 0.00 0.03 99.18 09:19:07 08:54:01 AM 1 0.63 0.00 0.08 0.00 0.02 99.27 09:19:07 08:55:01 AM all 0.32 0.00 0.08 0.00 0.02 99.58 09:19:07 08:55:01 AM 0 0.07 0.00 0.07 0.00 0.02 99.85 09:19:07 08:55:01 AM 1 0.57 0.00 0.10 0.00 0.02 99.32 09:19:07 08:56:01 AM all 0.23 0.00 0.06 0.00 0.03 99.67 09:19:07 08:56:01 AM 0 0.08 0.00 0.03 0.00 0.03 99.85 09:19:07 08:56:01 AM 1 0.39 0.00 0.08 0.00 0.03 99.50 09:19:07 08:57:01 AM all 0.34 0.00 0.08 0.00 0.03 99.56 09:19:07 08:57:01 AM 0 0.15 0.00 0.12 0.00 0.03 99.70 09:19:07 08:57:01 AM 1 0.53 0.00 0.03 0.00 0.02 99.42 09:19:07 08:58:01 AM all 1.57 0.00 0.16 0.00 0.03 98.24 09:19:07 08:58:01 AM 0 0.42 0.00 0.17 0.00 0.03 99.38 09:19:07 08:58:01 AM 1 2.72 0.00 0.15 0.00 0.03 97.09 09:19:07 08:59:01 AM all 2.96 0.00 0.23 0.00 0.03 96.77 09:19:07 08:59:01 AM 0 1.71 0.00 0.20 0.00 0.03 98.06 09:19:07 08:59:01 AM 1 4.22 0.00 0.27 0.00 0.03 95.48 09:19:07 09:00:01 AM all 4.43 0.00 0.30 0.00 0.06 95.21 09:19:07 09:00:01 AM 0 3.51 0.00 0.23 0.00 0.05 96.20 09:19:07 09:00:01 AM 1 5.34 0.00 0.37 0.00 0.07 94.23 09:19:07 09:01:01 AM all 3.98 0.00 0.29 0.00 0.05 95.67 09:19:07 09:01:01 AM 0 3.22 0.00 0.30 0.00 0.05 96.43 09:19:07 09:01:01 AM 1 4.75 0.00 0.28 0.00 0.05 94.92 09:19:07 09:02:01 AM all 4.34 0.00 0.32 0.00 0.05 95.30 09:19:07 09:02:01 AM 0 3.56 0.00 0.25 0.00 0.05 96.14 09:19:07 09:02:01 AM 1 5.11 0.00 0.39 0.00 0.05 94.45 09:19:07 09:03:01 AM all 4.39 0.00 0.29 0.00 0.06 95.26 09:19:07 09:03:01 AM 0 4.54 0.00 0.28 0.00 0.07 95.11 09:19:07 09:03:01 AM 1 4.25 0.00 0.30 0.00 0.05 95.40 09:19:07 09:19:07 09:03:01 AM CPU %user %nice %system %iowait %steal %idle 09:19:07 09:04:01 AM all 4.35 0.00 0.33 0.00 0.06 95.26 09:19:07 09:04:01 AM 0 5.29 0.00 0.39 0.00 0.07 94.26 09:19:07 09:04:01 AM 1 3.41 0.00 0.28 0.00 0.05 96.25 09:19:07 09:05:01 AM all 6.54 0.00 0.37 0.00 0.07 93.02 09:19:07 09:05:01 AM 0 5.59 0.00 0.30 0.00 0.05 94.05 09:19:07 09:05:01 AM 1 7.49 0.00 0.44 0.00 0.08 91.99 09:19:07 09:06:01 AM all 1.54 0.00 0.13 0.00 0.03 98.30 09:19:07 09:06:01 AM 0 0.92 0.00 0.10 0.00 0.03 98.95 09:19:07 09:06:01 AM 1 2.16 0.00 0.15 0.00 0.03 97.66 09:19:07 09:07:01 AM all 0.34 0.00 0.05 0.00 0.04 99.57 09:19:07 09:07:01 AM 0 0.55 0.00 0.03 0.00 0.03 99.38 09:19:07 09:07:01 AM 1 0.13 0.00 0.07 0.00 0.05 99.75 09:19:07 09:08:01 AM all 0.46 0.00 0.07 0.00 0.03 99.45 09:19:07 09:08:01 AM 0 0.77 0.00 0.05 0.00 0.02 99.17 09:19:07 09:08:01 AM 1 0.15 0.00 0.08 0.00 0.03 99.73 09:19:07 09:09:01 AM all 0.34 0.00 0.06 0.00 0.02 99.58 09:19:07 09:09:01 AM 0 0.55 0.00 0.05 0.00 0.02 99.38 09:19:07 09:09:01 AM 1 0.13 0.00 0.07 0.00 0.02 99.78 09:19:07 09:10:01 AM all 0.36 0.00 0.05 0.00 0.04 99.55 09:19:07 09:10:01 AM 0 0.57 0.00 0.02 0.00 0.03 99.38 09:19:07 09:10:01 AM 1 0.15 0.00 0.08 0.00 0.05 99.72 09:19:07 09:11:01 AM all 0.44 0.00 0.08 0.00 0.03 99.44 09:19:07 09:11:01 AM 0 0.62 0.00 0.10 0.00 0.03 99.25 09:19:07 09:11:01 AM 1 0.27 0.00 0.07 0.00 0.03 99.63 09:19:07 09:12:01 AM all 0.35 0.00 0.06 0.00 0.02 99.57 09:19:07 09:12:01 AM 0 0.57 0.00 0.05 0.00 0.02 99.37 09:19:07 09:12:01 AM 1 0.13 0.00 0.07 0.00 0.02 99.78 09:19:07 09:13:01 AM all 2.60 0.00 0.42 0.00 0.04 96.94 09:19:07 09:13:01 AM 0 0.82 0.00 0.18 0.00 0.05 98.95 09:19:07 09:13:01 AM 1 4.38 0.00 0.65 0.00 0.03 94.93 09:19:07 09:14:01 AM all 2.85 0.00 0.75 0.00 0.03 96.37 09:19:07 09:14:01 AM 0 3.20 0.00 0.70 0.00 0.02 96.08 09:19:07 09:14:01 AM 1 2.51 0.00 0.80 0.00 0.03 96.66 09:19:07 09:19:07 09:14:01 AM CPU %user %nice %system %iowait %steal %idle 09:19:07 09:15:01 AM all 3.45 0.00 0.59 0.00 0.05 95.92 09:19:07 09:15:01 AM 0 4.85 0.00 0.70 0.00 0.03 94.41 09:19:07 09:15:01 AM 1 2.04 0.00 0.47 0.00 0.07 97.43 09:19:07 09:16:01 AM all 10.11 0.00 0.79 0.00 0.05 89.05 09:19:07 09:16:01 AM 0 0.90 0.00 0.37 0.00 0.07 98.66 09:19:07 09:16:01 AM 1 19.30 0.00 1.22 0.00 0.03 79.45 09:19:07 09:17:01 AM all 12.32 0.00 1.81 0.13 0.06 85.69 09:19:07 09:17:01 AM 0 11.01 0.00 1.67 0.05 0.05 87.22 09:19:07 09:17:01 AM 1 13.63 0.00 1.94 0.20 0.07 84.16 09:19:07 09:18:01 AM all 31.62 0.00 2.93 0.58 0.09 64.78 09:19:07 09:18:01 AM 0 22.96 0.00 2.29 0.78 0.10 73.87 09:19:07 09:18:01 AM 1 40.26 0.00 3.57 0.38 0.08 55.70 09:19:07 09:19:01 AM all 9.84 0.00 0.94 0.23 0.04 88.95 09:19:07 09:19:01 AM 0 2.27 0.00 0.67 0.38 0.03 96.64 09:19:07 09:19:01 AM 1 17.41 0.00 1.20 0.07 0.05 81.27 09:19:07 Average: all 2.88 0.06 0.29 0.05 0.04 96.67 09:19:07 Average: 0 2.25 0.08 0.26 0.05 0.04 97.32 09:19:07 Average: 1 3.51 0.05 0.32 0.05 0.05 96.03 09:19:07 09:19:07 09:19:07