00:57:38 Started by upstream project "integration-distribution-mri-test-titanium" build number 73 00:57:38 originally caused by: 00:57:38 Started by timer 00:57:38 Running as SYSTEM 00:57:38 [EnvInject] - Loading node environment variables. 00:57:38 Building remotely on prd-centos8-robot-2c-8g-8613 (centos8-robot-2c-8g) in workspace /w/workspace/controller-csit-3node-clustering-tell-all-titanium 00:57:38 [ssh-agent] Looking for ssh-agent implementation... 00:57:39 [ssh-agent] Exec ssh-agent (binary ssh-agent on a remote machine) 00:57:39 $ ssh-agent 00:57:39 SSH_AUTH_SOCK=/tmp/ssh-Y6uIXjITAQ8z/agent.5292 00:57:39 SSH_AGENT_PID=5293 00:57:39 [ssh-agent] Started. 00:57:39 Running ssh-add (command line suppressed) 00:57:39 Identity added: /w/workspace/controller-csit-3node-clustering-tell-all-titanium@tmp/private_key_11946633281186362711.key (/w/workspace/controller-csit-3node-clustering-tell-all-titanium@tmp/private_key_11946633281186362711.key) 00:57:39 [ssh-agent] Using credentials jenkins (Release Engineering Jenkins Key) 00:57:39 The recommended git tool is: NONE 00:57:41 using credential opendaylight-jenkins-ssh 00:57:41 Wiping out workspace first. 00:57:41 Cloning the remote Git repository 00:57:41 Cloning repository git://devvexx.opendaylight.org/mirror/integration/test 00:57:41 > git init /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test # timeout=10 00:57:41 Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test 00:57:41 > git --version # timeout=10 00:57:41 > git --version # 'git version 2.43.0' 00:57:41 using GIT_SSH to set credentials Release Engineering Jenkins Key 00:57:41 [INFO] Currently running in a labeled security context 00:57:41 [INFO] Currently SELinux is 'enforcing' on the host 00:57:41 > /usr/bin/chcon --type=ssh_home_t /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test@tmp/jenkins-gitclient-ssh4755142414143250763.key 00:57:41 Verifying host key using known hosts file 00:57:41 You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification. 00:57:41 > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test +refs/heads/*:refs/remotes/origin/* # timeout=10 00:57:44 > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10 00:57:44 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 00:57:44 > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10 00:57:44 Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test 00:57:44 using GIT_SSH to set credentials Release Engineering Jenkins Key 00:57:44 [INFO] Currently running in a labeled security context 00:57:44 [INFO] Currently SELinux is 'enforcing' on the host 00:57:44 > /usr/bin/chcon --type=ssh_home_t /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test@tmp/jenkins-gitclient-ssh55588406894472057.key 00:57:44 Verifying host key using known hosts file 00:57:44 You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification. 00:57:44 > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test master # timeout=10 00:57:45 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:57:45 Checking out Revision f65244a2a093016c71f9a7a564be7d086941e15c (origin/master) 00:57:45 > git config core.sparsecheckout # timeout=10 00:57:45 > git checkout -f f65244a2a093016c71f9a7a564be7d086941e15c # timeout=10 00:57:45 Commit message: "Fix netconf cluster test with RESTCONF_ROOT" 00:57:45 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:57:45 > git rev-list --no-walk cc140aba40d20c279ad305eb08204917e9a97348 # timeout=10 00:57:46 No emails were triggered. 00:57:46 provisioning config files... 00:57:46 copy managed file [npmrc] to file:/home/jenkins/.npmrc 00:57:46 copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf 00:57:46 copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml 00:57:46 [controller-csit-3node-clustering-tell-all-titanium] $ /bin/bash /tmp/jenkins4278293761780495120.sh 00:57:46 ---> python-tools-install.sh 00:57:46 Setup pyenv: 00:57:46 system 00:57:46 * 3.8.13 (set by /opt/pyenv/version) 00:57:46 * 3.9.13 (set by /opt/pyenv/version) 00:57:46 * 3.10.13 (set by /opt/pyenv/version) 00:57:46 * 3.11.7 (set by /opt/pyenv/version) 00:57:51 lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-RqOx 00:57:51 lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv 00:57:51 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 00:57:51 lf-activate-venv(): INFO: Attempting to install with network-safe options... 00:57:55 lf-activate-venv(): INFO: Base packages installed successfully 00:57:55 lf-activate-venv(): INFO: Installing additional packages: lftools 00:58:18 lf-activate-venv(): INFO: Adding /tmp/venv-RqOx/bin to PATH 00:58:18 Generating Requirements File 00:58:35 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. 00:58:35 httplib2 0.30.2 requires pyparsing<4,>=3.0.4, but you have pyparsing 2.4.7 which is incompatible. 00:58:35 Python 3.11.7 00:58:35 pip 26.0.1 from /tmp/venv-RqOx/lib/python3.11/site-packages/pip (python 3.11) 00:58:36 appdirs==1.4.4 00:58:36 argcomplete==3.6.3 00:58:36 aspy.yaml==1.3.0 00:58:36 attrs==25.4.0 00:58:36 autopage==0.6.0 00:58:36 beautifulsoup4==4.14.3 00:58:36 boto3==1.42.44 00:58:36 botocore==1.42.44 00:58:36 bs4==0.0.2 00:58:36 certifi==2026.1.4 00:58:36 cffi==2.0.0 00:58:36 cfgv==3.5.0 00:58:36 chardet==5.2.0 00:58:36 charset-normalizer==3.4.4 00:58:36 click==8.3.1 00:58:36 cliff==4.13.1 00:58:36 cmd2==3.2.0 00:58:36 cryptography==3.3.2 00:58:36 debtcollector==3.0.0 00:58:36 decorator==5.2.1 00:58:36 defusedxml==0.7.1 00:58:36 Deprecated==1.3.1 00:58:36 distlib==0.4.0 00:58:36 dnspython==2.8.0 00:58:36 docker==7.1.0 00:58:36 dogpile.cache==1.5.0 00:58:36 durationpy==0.10 00:58:36 email-validator==2.3.0 00:58:36 filelock==3.20.3 00:58:36 future==1.0.0 00:58:36 gitdb==4.0.12 00:58:36 GitPython==3.1.46 00:58:36 httplib2==0.30.2 00:58:36 identify==2.6.16 00:58:36 idna==3.11 00:58:36 importlib-resources==1.5.0 00:58:36 iso8601==2.1.0 00:58:36 Jinja2==3.1.6 00:58:36 jmespath==1.1.0 00:58:36 jsonpatch==1.33 00:58:36 jsonpointer==3.0.0 00:58:36 jsonschema==4.26.0 00:58:36 jsonschema-specifications==2025.9.1 00:58:36 keystoneauth1==5.13.0 00:58:36 kubernetes==35.0.0 00:58:36 lftools==0.37.21 00:58:36 lxml==6.0.2 00:58:36 markdown-it-py==4.0.0 00:58:36 MarkupSafe==3.0.3 00:58:36 mdurl==0.1.2 00:58:36 msgpack==1.1.2 00:58:36 multi_key_dict==2.0.3 00:58:36 munch==4.0.0 00:58:36 netaddr==1.3.0 00:58:36 niet==1.4.2 00:58:36 nodeenv==1.10.0 00:58:36 oauth2client==4.1.3 00:58:36 oauthlib==3.3.1 00:58:36 openstacksdk==4.9.0 00:58:36 os-service-types==1.8.2 00:58:36 osc-lib==4.3.0 00:58:36 oslo.config==10.2.0 00:58:36 oslo.context==6.2.0 00:58:36 oslo.i18n==6.7.1 00:58:36 oslo.log==8.0.0 00:58:36 oslo.serialization==5.9.0 00:58:36 oslo.utils==9.2.0 00:58:36 packaging==26.0 00:58:36 pbr==7.0.3 00:58:36 platformdirs==4.5.1 00:58:36 prettytable==3.17.0 00:58:36 psutil==7.2.2 00:58:36 pyasn1==0.6.2 00:58:36 pyasn1_modules==0.4.2 00:58:36 pycparser==3.0 00:58:36 pygerrit2==2.0.15 00:58:36 PyGithub==2.8.1 00:58:36 Pygments==2.19.2 00:58:36 PyJWT==2.11.0 00:58:36 PyNaCl==1.6.2 00:58:36 pyparsing==2.4.7 00:58:36 pyperclip==1.11.0 00:58:36 pyrsistent==0.20.0 00:58:36 python-cinderclient==9.8.0 00:58:36 python-dateutil==2.9.0.post0 00:58:36 python-heatclient==5.0.0 00:58:36 python-jenkins==1.8.3 00:58:36 python-keystoneclient==5.7.0 00:58:36 python-magnumclient==4.9.0 00:58:36 python-openstackclient==8.3.0 00:58:36 python-swiftclient==4.9.0 00:58:36 PyYAML==6.0.3 00:58:36 referencing==0.37.0 00:58:36 requests==2.32.5 00:58:36 requests-oauthlib==2.0.0 00:58:36 requestsexceptions==1.4.0 00:58:36 rfc3986==2.0.0 00:58:36 rich==14.3.2 00:58:36 rich-argparse==1.7.2 00:58:36 rpds-py==0.30.0 00:58:36 rsa==4.9.1 00:58:36 ruamel.yaml==0.19.1 00:58:36 ruamel.yaml.clib==0.2.15 00:58:36 s3transfer==0.16.0 00:58:36 simplejson==3.20.2 00:58:36 six==1.17.0 00:58:36 smmap==5.0.2 00:58:36 soupsieve==2.8.3 00:58:36 stevedore==5.6.0 00:58:36 tabulate==0.9.0 00:58:36 toml==0.10.2 00:58:36 tomlkit==0.14.0 00:58:36 tqdm==4.67.3 00:58:36 typing_extensions==4.15.0 00:58:36 tzdata==2025.3 00:58:36 urllib3==1.26.20 00:58:36 virtualenv==20.36.1 00:58:36 wcwidth==0.6.0 00:58:36 websocket-client==1.9.0 00:58:36 wrapt==2.1.1 00:58:36 xdg==6.0.0 00:58:36 xmltodict==1.0.2 00:58:36 yq==3.4.3 00:58:36 [EnvInject] - Injecting environment variables from a build step. 00:58:36 [EnvInject] - Injecting as environment variables the properties content 00:58:36 OS_STACK_TEMPLATE=csit-2-instance-type.yaml 00:58:36 OS_CLOUD=vex 00:58:36 OS_STACK_NAME=releng-controller-csit-3node-clustering-tell-all-titanium-73 00:58:36 OS_STACK_TEMPLATE_DIR=openstack-hot 00:58:36 00:58:36 [EnvInject] - Variables injected successfully. 00:58:36 provisioning config files... 00:58:36 copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml 00:58:36 [controller-csit-3node-clustering-tell-all-titanium] $ /bin/bash /tmp/jenkins38452291348063052.sh 00:58:36 ---> Create parameters file for OpenStack HOT 00:58:36 OpenStack Heat parameters generated 00:58:36 ----------------------------------- 00:58:36 parameters: 00:58:36 vm_0_count: '3' 00:58:36 vm_0_flavor: 'v3-standard-4' 00:58:36 vm_0_image: 'ZZCI - Ubuntu 22.04 - builder - x86_64 - 20260201-010217.481' 00:58:36 vm_1_count: '0' 00:58:36 vm_1_flavor: 'v3-standard-2' 00:58:36 vm_1_image: 'ZZCI - Ubuntu 22.04 - mininet-ovs-217 - x86_64 - 20250917-133034.654' 00:58:36 00:58:36 job_name: '14749-73' 00:58:36 silo: 'releng' 00:58:36 [controller-csit-3node-clustering-tell-all-titanium] $ /bin/bash -l /tmp/jenkins2472019215291112861.sh 00:58:37 ---> Create HEAT stack 00:58:37 + source /home/jenkins/lf-env.sh 00:58:37 + lf-activate-venv --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq 00:58:37 ++ mktemp -d /tmp/venv-XXXX 00:58:37 + lf_venv=/tmp/venv-uoo4 00:58:37 + local venv_file=/tmp/.os_lf_venv 00:58:37 + local python=python3 00:58:37 + local options 00:58:37 + local set_path=true 00:58:37 + local install_args= 00:58:37 ++ getopt -o np:v: -l no-path,system-site-packages,python:,venv-file: -n lf-activate-venv -- --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq 00:58:37 + options=' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''urllib3~=1.26.15'\'' '\''yq'\''' 00:58:37 + eval set -- ' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''urllib3~=1.26.15'\'' '\''yq'\''' 00:58:37 ++ set -- --python python3 -- 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq 00:58:37 + true 00:58:37 + case $1 in 00:58:37 + python=python3 00:58:37 + shift 2 00:58:37 + true 00:58:37 + case $1 in 00:58:37 + shift 00:58:37 + break 00:58:37 + case $python in 00:58:37 + local pkg_list= 00:58:37 + [[ -d /opt/pyenv ]] 00:58:37 + echo 'Setup pyenv:' 00:58:37 Setup pyenv: 00:58:37 + export PYENV_ROOT=/opt/pyenv 00:58:37 + PYENV_ROOT=/opt/pyenv 00:58:37 + export PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin 00:58:37 + PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin 00:58:37 + pyenv versions 00:58:37 system 00:58:37 3.8.13 00:58:37 3.9.13 00:58:37 3.10.13 00:58:37 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-titanium/.python-version) 00:58:37 + command -v pyenv 00:58:37 ++ pyenv init - --no-rehash 00:58:37 + eval 'PATH="$(bash --norc -ec '\''IFS=:; paths=($PATH); 00:58:37 for i in ${!paths[@]}; do 00:58:37 if [[ ${paths[i]} == "'\'''\''/opt/pyenv/shims'\'''\''" ]]; then unset '\''\'\'''\''paths[i]'\''\'\'''\''; 00:58:37 fi; done; 00:58:37 echo "${paths[*]}"'\'')" 00:58:37 export PATH="/opt/pyenv/shims:${PATH}" 00:58:37 export PYENV_SHELL=bash 00:58:37 source '\''/opt/pyenv/libexec/../completions/pyenv.bash'\'' 00:58:37 pyenv() { 00:58:37 local command 00:58:37 command="${1:-}" 00:58:37 if [ "$#" -gt 0 ]; then 00:58:37 shift 00:58:37 fi 00:58:37 00:58:37 case "$command" in 00:58:37 rehash|shell) 00:58:37 eval "$(pyenv "sh-$command" "$@")" 00:58:37 ;; 00:58:37 *) 00:58:37 command pyenv "$command" "$@" 00:58:37 ;; 00:58:37 esac 00:58:37 }' 00:58:37 +++ bash --norc -ec 'IFS=:; paths=($PATH); 00:58:37 for i in ${!paths[@]}; do 00:58:37 if [[ ${paths[i]} == "/opt/pyenv/shims" ]]; then unset '\''paths[i]'\''; 00:58:37 fi; done; 00:58:37 echo "${paths[*]}"' 00:58:37 ++ PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin 00:58:37 ++ export PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin 00:58:37 ++ PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin 00:58:37 ++ export PYENV_SHELL=bash 00:58:37 ++ PYENV_SHELL=bash 00:58:37 ++ source /opt/pyenv/libexec/../completions/pyenv.bash 00:58:37 +++ complete -F _pyenv pyenv 00:58:37 ++ lf-pyver python3 00:58:37 ++ local py_version_xy=python3 00:58:37 ++ local py_version_xyz= 00:58:37 ++ awk '{ print $1 }' 00:58:37 ++ pyenv versions 00:58:37 ++ local command 00:58:37 ++ command=versions 00:58:37 ++ '[' 1 -gt 0 ']' 00:58:37 ++ shift 00:58:37 ++ case "$command" in 00:58:37 ++ command pyenv versions 00:58:37 ++ pyenv versions 00:58:37 ++ sed 's/^[ *]* //' 00:58:37 ++ grep -E '^[0-9.]*[0-9]$' 00:58:37 ++ [[ ! -s /tmp/.pyenv_versions ]] 00:58:37 +++ tail -n 1 00:58:37 +++ grep '^3' /tmp/.pyenv_versions 00:58:37 +++ sort -V 00:58:37 ++ py_version_xyz=3.11.7 00:58:37 ++ [[ -z 3.11.7 ]] 00:58:37 ++ echo 3.11.7 00:58:37 ++ return 0 00:58:37 + pyenv local 3.11.7 00:58:37 + local command 00:58:37 + command=local 00:58:37 + '[' 2 -gt 0 ']' 00:58:37 + shift 00:58:37 + case "$command" in 00:58:37 + command pyenv local 3.11.7 00:58:37 + pyenv local 3.11.7 00:58:37 + for arg in "$@" 00:58:37 + case $arg in 00:58:37 + pkg_list+='lftools[openstack] ' 00:58:37 + for arg in "$@" 00:58:37 + case $arg in 00:58:37 + pkg_list+='kubernetes ' 00:58:37 + for arg in "$@" 00:58:37 + case $arg in 00:58:37 + pkg_list+='niet ' 00:58:37 + for arg in "$@" 00:58:37 + case $arg in 00:58:37 + pkg_list+='python-heatclient ' 00:58:37 + for arg in "$@" 00:58:37 + case $arg in 00:58:37 + pkg_list+='python-openstackclient ' 00:58:37 + for arg in "$@" 00:58:37 + case $arg in 00:58:37 + pkg_list+='python-magnumclient ' 00:58:37 + for arg in "$@" 00:58:37 + case $arg in 00:58:37 + pkg_list+='urllib3~=1.26.15 ' 00:58:37 + for arg in "$@" 00:58:37 + case $arg in 00:58:37 + pkg_list+='yq ' 00:58:37 + [[ -f /tmp/.os_lf_venv ]] 00:58:37 ++ cat /tmp/.os_lf_venv 00:58:37 + lf_venv=/tmp/venv-RqOx 00:58:37 + echo 'lf-activate-venv(): INFO: Reuse venv:/tmp/venv-RqOx from' file:/tmp/.os_lf_venv 00:58:37 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-RqOx from file:/tmp/.os_lf_venv 00:58:37 + echo 'lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)' 00:58:37 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 00:58:37 + local 'pip_opts=--upgrade --quiet' 00:58:37 + pip_opts='--upgrade --quiet --trusted-host pypi.org' 00:58:37 + pip_opts='--upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org' 00:58:37 + pip_opts='--upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org' 00:58:37 + [[ -n '' ]] 00:58:37 + [[ -n '' ]] 00:58:37 + echo 'lf-activate-venv(): INFO: Attempting to install with network-safe options...' 00:58:37 lf-activate-venv(): INFO: Attempting to install with network-safe options... 00:58:37 + /tmp/venv-RqOx/bin/python3 -m pip install --upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org pip 'setuptools<66' virtualenv 00:58:39 + echo 'lf-activate-venv(): INFO: Base packages installed successfully' 00:58:39 lf-activate-venv(): INFO: Base packages installed successfully 00:58:39 + [[ -z lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq ]] 00:58:39 + echo 'lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq ' 00:58:39 lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq 00:58:39 + /tmp/venv-RqOx/bin/python3 -m pip install --upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org --upgrade-strategy eager 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq 00:58:54 + type python3 00:58:54 + true 00:58:54 + echo 'lf-activate-venv(): INFO: Adding /tmp/venv-RqOx/bin to PATH' 00:58:54 lf-activate-venv(): INFO: Adding /tmp/venv-RqOx/bin to PATH 00:58:54 + PATH=/tmp/venv-RqOx/bin:/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin 00:58:54 + return 0 00:58:54 + openstack --os-cloud vex limits show --absolute 00:58:55 +--------------------------+---------+ 00:58:55 | Name | Value | 00:58:55 +--------------------------+---------+ 00:58:55 | maxTotalInstances | -1 | 00:58:55 | maxTotalCores | 450 | 00:58:55 | maxTotalRAMSize | 1000000 | 00:58:55 | maxServerMeta | 128 | 00:58:55 | maxImageMeta | 128 | 00:58:55 | maxPersonality | 5 | 00:58:55 | maxPersonalitySize | 10240 | 00:58:55 | maxTotalKeypairs | 100 | 00:58:55 | maxServerGroups | 10 | 00:58:55 | maxServerGroupMembers | 10 | 00:58:55 | maxTotalFloatingIps | -1 | 00:58:55 | maxSecurityGroups | -1 | 00:58:55 | maxSecurityGroupRules | -1 | 00:58:55 | totalRAMUsed | 647168 | 00:58:55 | totalCoresUsed | 158 | 00:58:55 | totalInstancesUsed | 50 | 00:58:55 | totalFloatingIpsUsed | 0 | 00:58:55 | totalSecurityGroupsUsed | 0 | 00:58:55 | totalServerGroupsUsed | 0 | 00:58:55 | maxTotalVolumes | -1 | 00:58:55 | maxTotalSnapshots | 10 | 00:58:55 | maxTotalVolumeGigabytes | 4096 | 00:58:55 | maxTotalBackups | 10 | 00:58:55 | maxTotalBackupGigabytes | 1000 | 00:58:55 | totalVolumesUsed | 0 | 00:58:55 | totalGigabytesUsed | 0 | 00:58:55 | totalSnapshotsUsed | 0 | 00:58:55 | totalBackupsUsed | 0 | 00:58:55 | totalBackupGigabytesUsed | 0 | 00:58:55 +--------------------------+---------+ 00:58:56 + pushd /opt/ciman/openstack-hot 00:58:56 /opt/ciman/openstack-hot /w/workspace/controller-csit-3node-clustering-tell-all-titanium 00:58:56 + lftools openstack --os-cloud vex stack create releng-controller-csit-3node-clustering-tell-all-titanium-73 csit-2-instance-type.yaml /w/workspace/controller-csit-3node-clustering-tell-all-titanium/stack-parameters.yaml 00:59:22 Creating stack releng-controller-csit-3node-clustering-tell-all-titanium-73 00:59:22 Waiting to initialize infrastructure... 00:59:22 Stack initialization successful. 00:59:22 ------------------------------------ 00:59:22 Stack Details 00:59:22 ------------------------------------ 00:59:22 {'added': None, 00:59:22 'capabilities': [], 00:59:22 'created_at': '2026-02-08T00:58:59Z', 00:59:22 'deleted': None, 00:59:22 'deleted_at': None, 00:59:22 'description': 'No description', 00:59:22 'environment': None, 00:59:22 'environment_files': None, 00:59:22 'files': None, 00:59:22 'files_container': None, 00:59:22 'id': 'f29b994a-f950-46f3-8e1d-d52a7b75dfeb', 00:59:22 'is_rollback_disabled': True, 00:59:22 'links': [{'href': 'https://orchestration.public.mtl1.vexxhost.net/v1/12c36e260d8e4bb2913965203b1b491f/stacks/releng-controller-csit-3node-clustering-tell-all-titanium-73/f29b994a-f950-46f3-8e1d-d52a7b75dfeb', 00:59:22 'rel': 'self'}], 00:59:22 'location': Munch({'cloud': 'vex', 'region_name': 'ca-ymq-1', 'zone': None, 'project': Munch({'id': '12c36e260d8e4bb2913965203b1b491f', 'name': '61975f2c-7c17-4d69-82fa-c3ae420ad6fd', 'domain_id': None, 'domain_name': 'Default'})}), 00:59:22 'name': 'releng-controller-csit-3node-clustering-tell-all-titanium-73', 00:59:22 'notification_topics': [], 00:59:22 'outputs': [{'description': 'IP addresses of the 1st vm types', 00:59:22 'output_key': 'vm_0_ips', 00:59:22 'output_value': ['10.30.171.250', 00:59:22 '10.30.171.198', 00:59:22 '10.30.171.173']}, 00:59:22 {'description': 'IP addresses of the 2nd vm types', 00:59:22 'output_key': 'vm_1_ips', 00:59:22 'output_value': []}], 00:59:22 'owner_id': ****, 00:59:22 'parameters': {'OS::project_id': '12c36e260d8e4bb2913965203b1b491f', 00:59:22 'OS::stack_id': 'f29b994a-f950-46f3-8e1d-d52a7b75dfeb', 00:59:22 'OS::stack_name': 'releng-controller-csit-3node-clustering-tell-all-titanium-73', 00:59:22 'job_name': '14749-73', 00:59:22 'silo': 'releng', 00:59:22 'vm_0_count': '3', 00:59:22 'vm_0_flavor': 'v3-standard-4', 00:59:22 'vm_0_image': 'ZZCI - Ubuntu 22.04 - builder - x86_64 - ' 00:59:22 '20260201-010217.481', 00:59:22 'vm_1_count': '0', 00:59:22 'vm_1_flavor': 'v3-standard-2', 00:59:22 'vm_1_image': 'ZZCI - Ubuntu 22.04 - mininet-ovs-217 - x86_64 ' 00:59:22 '- 20250917-133034.654'}, 00:59:22 'parent_id': None, 00:59:22 'replaced': None, 00:59:22 'status': 'CREATE_COMPLETE', 00:59:22 'status_reason': 'Stack CREATE completed successfully', 00:59:22 'tags': [], 00:59:22 'template': None, 00:59:22 'template_description': 'No description', 00:59:22 'template_url': None, 00:59:22 'timeout_mins': 15, 00:59:22 'unchanged': None, 00:59:22 'updated': None, 00:59:22 'updated_at': None, 00:59:22 'user_project_id': 'a66a534882ce442fa9e56ed24f942164'} 00:59:22 ------------------------------------ 00:59:22 + popd 00:59:22 /w/workspace/controller-csit-3node-clustering-tell-all-titanium 00:59:22 [controller-csit-3node-clustering-tell-all-titanium] $ /bin/bash -l /tmp/jenkins2652470754631640471.sh 00:59:22 ---> Copy SSH public keys to CSIT lab 00:59:22 Setup pyenv: 00:59:22 system 00:59:22 3.8.13 00:59:22 3.9.13 00:59:22 3.10.13 00:59:22 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-titanium/.python-version) 00:59:23 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-RqOx from file:/tmp/.os_lf_venv 00:59:23 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 00:59:23 lf-activate-venv(): INFO: Attempting to install with network-safe options... 00:59:25 lf-activate-venv(): INFO: Base packages installed successfully 00:59:25 lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes python-heatclient python-openstackclient urllib3~=1.26.15 00:59:36 lf-activate-venv(): INFO: Adding /tmp/venv-RqOx/bin to PATH 00:59:38 SSH not responding on 10.30.171.250. Retrying in 10 seconds... 00:59:38 SSH not responding on 10.30.171.173. Retrying in 10 seconds... 00:59:38 SSH not responding on 10.30.171.198. Retrying in 10 seconds... 00:59:48 Ping to 10.30.171.250 successful. 00:59:48 Ping to 10.30.171.173 successful. 00:59:48 Ping to 10.30.171.198 successful. 00:59:49 SSH not responding on 10.30.171.173. Retrying in 10 seconds... 00:59:49 SSH not responding on 10.30.171.198. Retrying in 10 seconds... 00:59:50 Warning: Permanently added '10.30.171.250' (ECDSA) to the list of known hosts. 00:59:50 releng-14749-73-0-builder-0 00:59:50 Successfully copied public keys to slave 10.30.171.250 00:59:50 Process 6509 ready. 00:59:59 Ping to 10.30.171.173 successful. 00:59:59 Ping to 10.30.171.198 successful. 01:00:00 Warning: Permanently added '10.30.171.173' (ECDSA) to the list of known hosts. 01:00:00 Warning: Permanently added '10.30.171.198' (ECDSA) to the list of known hosts. 01:00:00 releng-14749-73-0-builder-2 01:00:00 Successfully copied public keys to slave 10.30.171.173 01:00:00 releng-14749-73-0-builder-1 01:00:01 Successfully copied public keys to slave 10.30.171.198 01:00:01 Process 6510 ready. 01:00:01 Process 6511 ready. 01:00:01 SSH ready on all stack servers. 01:00:01 [controller-csit-3node-clustering-tell-all-titanium] $ /bin/bash -l /tmp/jenkins16473602762392774779.sh 01:00:01 Setup pyenv: 01:00:01 system 01:00:01 3.8.13 01:00:01 3.9.13 01:00:01 3.10.13 01:00:01 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-titanium/.python-version) 01:00:06 lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-KufZ 01:00:06 lf-activate-venv(): INFO: Save venv in file: /w/workspace/controller-csit-3node-clustering-tell-all-titanium/.robot_venv 01:00:06 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 01:00:06 lf-activate-venv(): INFO: Attempting to install with network-safe options... 01:00:11 lf-activate-venv(): INFO: Base packages installed successfully 01:00:11 lf-activate-venv(): INFO: Installing additional packages: setuptools wheel 01:00:13 lf-activate-venv(): INFO: Adding /tmp/venv-KufZ/bin to PATH 01:00:13 + echo 'Installing Python Requirements' 01:00:13 Installing Python Requirements 01:00:13 + cat 01:00:13 + python -m pip install -r requirements.txt 01:00:13 Looking in indexes: https://nexus3.opendaylight.org/repository/PyPi/simple 01:00:13 Collecting docker-py (from -r requirements.txt (line 1)) 01:00:13 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/docker-py/1.10.6/docker_py-1.10.6-py2.py3-none-any.whl (50 kB) 01:00:13 Collecting ipaddr (from -r requirements.txt (line 2)) 01:00:13 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/ipaddr/2.2.0/ipaddr-2.2.0.tar.gz (26 kB) 01:00:13 Installing build dependencies: started 01:00:14 Installing build dependencies: finished with status 'done' 01:00:14 Getting requirements to build wheel: started 01:00:14 Getting requirements to build wheel: finished with status 'done' 01:00:14 Preparing metadata (pyproject.toml): started 01:00:14 Preparing metadata (pyproject.toml): finished with status 'done' 01:00:14 Collecting netaddr (from -r requirements.txt (line 3)) 01:00:14 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/netaddr/1.3.0/netaddr-1.3.0-py3-none-any.whl (2.3 MB) 01:00:14 Collecting netifaces (from -r requirements.txt (line 4)) 01:00:14 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/netifaces/0.11.0/netifaces-0.11.0.tar.gz (30 kB) 01:00:14 Installing build dependencies: started 01:00:15 Installing build dependencies: finished with status 'done' 01:00:15 Getting requirements to build wheel: started 01:00:16 Getting requirements to build wheel: finished with status 'done' 01:00:16 Preparing metadata (pyproject.toml): started 01:00:16 Preparing metadata (pyproject.toml): finished with status 'done' 01:00:16 Collecting pyhocon (from -r requirements.txt (line 5)) 01:00:16 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyhocon/0.3.61/pyhocon-0.3.61-py3-none-any.whl (25 kB) 01:00:16 Collecting requests (from -r requirements.txt (line 6)) 01:00:16 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/requests/2.32.5/requests-2.32.5-py3-none-any.whl (64 kB) 01:00:16 Collecting robotframework (from -r requirements.txt (line 7)) 01:00:16 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework/7.4.1/robotframework-7.4.1-py3-none-any.whl (806 kB) 01:00:16 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 806.9/806.9 kB 23.7 MB/s 0:00:00 01:00:16 Collecting robotframework-httplibrary (from -r requirements.txt (line 8)) 01:00:16 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-httplibrary/0.4.2/robotframework-httplibrary-0.4.2.tar.gz (9.1 kB) 01:00:16 Installing build dependencies: started 01:00:17 Installing build dependencies: finished with status 'done' 01:00:17 Getting requirements to build wheel: started 01:00:17 Getting requirements to build wheel: finished with status 'done' 01:00:17 Preparing metadata (pyproject.toml): started 01:00:17 Preparing metadata (pyproject.toml): finished with status 'done' 01:00:17 Collecting robotframework-requests==0.9.7 (from -r requirements.txt (line 9)) 01:00:17 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-requests/0.9.7/robotframework_requests-0.9.7-py3-none-any.whl (21 kB) 01:00:17 Collecting robotframework-selenium2library (from -r requirements.txt (line 10)) 01:00:17 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-selenium2library/3.0.0/robotframework_selenium2library-3.0.0-py2.py3-none-any.whl (6.2 kB) 01:00:17 Collecting robotframework-sshlibrary==3.8.0 (from -r requirements.txt (line 11)) 01:00:17 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-sshlibrary/3.8.0/robotframework-sshlibrary-3.8.0.tar.gz (51 kB) 01:00:17 Installing build dependencies: started 01:00:18 Installing build dependencies: finished with status 'done' 01:00:18 Getting requirements to build wheel: started 01:00:19 Getting requirements to build wheel: finished with status 'done' 01:00:19 Preparing metadata (pyproject.toml): started 01:00:19 Preparing metadata (pyproject.toml): finished with status 'done' 01:00:19 Collecting scapy (from -r requirements.txt (line 12)) 01:00:19 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/scapy/2.7.0/scapy-2.7.0-py3-none-any.whl (2.6 MB) 01:00:19 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.6/2.6 MB 44.4 MB/s 0:00:00 01:00:19 Collecting jsonpath-rw (from -r requirements.txt (line 15)) 01:00:19 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpath-rw/1.4.0/jsonpath-rw-1.4.0.tar.gz (13 kB) 01:00:19 Installing build dependencies: started 01:00:20 Installing build dependencies: finished with status 'done' 01:00:20 Getting requirements to build wheel: started 01:00:20 Getting requirements to build wheel: finished with status 'done' 01:00:20 Preparing metadata (pyproject.toml): started 01:00:20 Preparing metadata (pyproject.toml): finished with status 'done' 01:00:20 Collecting elasticsearch (from -r requirements.txt (line 18)) 01:00:20 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch/9.3.0/elasticsearch-9.3.0-py3-none-any.whl (979 kB) 01:00:20 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 979.4/979.4 kB 26.8 MB/s 0:00:00 01:00:20 Collecting elasticsearch-dsl (from -r requirements.txt (line 19)) 01:00:20 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch-dsl/8.18.0/elasticsearch_dsl-8.18.0-py3-none-any.whl (10 kB) 01:00:20 Collecting pyangbind (from -r requirements.txt (line 22)) 01:00:20 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyangbind/0.8.7/pyangbind-0.8.7-py3-none-any.whl (52 kB) 01:00:20 Collecting isodate (from -r requirements.txt (line 25)) 01:00:20 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/isodate/0.7.2/isodate-0.7.2-py3-none-any.whl (22 kB) 01:00:21 Collecting jmespath (from -r requirements.txt (line 28)) 01:00:21 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jmespath/1.1.0/jmespath-1.1.0-py3-none-any.whl (20 kB) 01:00:21 Collecting jsonpatch (from -r requirements.txt (line 31)) 01:00:21 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpatch/1.33/jsonpatch-1.33-py2.py3-none-any.whl (12 kB) 01:00:21 Collecting paramiko>=1.15.3 (from robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) 01:00:21 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/paramiko/4.0.0/paramiko-4.0.0-py3-none-any.whl (223 kB) 01:00:21 Collecting scp>=0.13.0 (from robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) 01:00:21 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/scp/0.15.0/scp-0.15.0-py2.py3-none-any.whl (8.8 kB) 01:00:21 Collecting docker-pycreds>=0.2.1 (from docker-py->-r requirements.txt (line 1)) 01:00:21 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/docker-pycreds/0.4.0/docker_pycreds-0.4.0-py2.py3-none-any.whl (9.0 kB) 01:00:21 Collecting six>=1.4.0 (from docker-py->-r requirements.txt (line 1)) 01:00:21 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/six/1.17.0/six-1.17.0-py2.py3-none-any.whl (11 kB) 01:00:21 Collecting websocket-client>=0.32.0 (from docker-py->-r requirements.txt (line 1)) 01:00:21 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/websocket-client/1.9.0/websocket_client-1.9.0-py3-none-any.whl (82 kB) 01:00:21 Collecting pyparsing<4,>=2 (from pyhocon->-r requirements.txt (line 5)) 01:00:21 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pyparsing/3.3.2/pyparsing-3.3.2-py3-none-any.whl (122 kB) 01:00:21 Collecting charset_normalizer<4,>=2 (from requests->-r requirements.txt (line 6)) 01:00:21 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/charset-normalizer/3.4.4/charset_normalizer-3.4.4-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl (151 kB) 01:00:21 Collecting idna<4,>=2.5 (from requests->-r requirements.txt (line 6)) 01:00:21 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/idna/3.11/idna-3.11-py3-none-any.whl (71 kB) 01:00:21 Collecting urllib3<3,>=1.21.1 (from requests->-r requirements.txt (line 6)) 01:00:21 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/urllib3/2.6.3/urllib3-2.6.3-py3-none-any.whl (131 kB) 01:00:21 Collecting certifi>=2017.4.17 (from requests->-r requirements.txt (line 6)) 01:00:21 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/certifi/2026.1.4/certifi-2026.1.4-py3-none-any.whl (152 kB) 01:00:21 Collecting webtest>=2.0 (from robotframework-httplibrary->-r requirements.txt (line 8)) 01:00:21 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/webtest/3.0.7/webtest-3.0.7-py3-none-any.whl (32 kB) 01:00:21 Collecting jsonpointer (from robotframework-httplibrary->-r requirements.txt (line 8)) 01:00:21 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpointer/3.0.0/jsonpointer-3.0.0-py2.py3-none-any.whl (7.6 kB) 01:00:21 Collecting robotframework-seleniumlibrary>=3.0.0 (from robotframework-selenium2library->-r requirements.txt (line 10)) 01:00:21 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-seleniumlibrary/6.8.0/robotframework_seleniumlibrary-6.8.0-py3-none-any.whl (104 kB) 01:00:22 Collecting ply (from jsonpath-rw->-r requirements.txt (line 15)) 01:00:22 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/ply/3.11/ply-3.11-py2.py3-none-any.whl (49 kB) 01:00:22 Collecting decorator (from jsonpath-rw->-r requirements.txt (line 15)) 01:00:22 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/decorator/5.2.1/decorator-5.2.1-py3-none-any.whl (9.2 kB) 01:00:22 Collecting anyio (from elasticsearch->-r requirements.txt (line 18)) 01:00:22 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/anyio/4.12.1/anyio-4.12.1-py3-none-any.whl (113 kB) 01:00:22 Collecting elastic-transport<10,>=9.2.0 (from elasticsearch->-r requirements.txt (line 18)) 01:00:22 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elastic-transport/9.2.1/elastic_transport-9.2.1-py3-none-any.whl (65 kB) 01:00:22 Collecting python-dateutil (from elasticsearch->-r requirements.txt (line 18)) 01:00:22 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/python-dateutil/2.9.0.post0/python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 01:00:22 Collecting sniffio (from elasticsearch->-r requirements.txt (line 18)) 01:00:22 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/sniffio/1.3.1/sniffio-1.3.1-py3-none-any.whl (10 kB) 01:00:22 Collecting typing-extensions (from elasticsearch->-r requirements.txt (line 18)) 01:00:22 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/typing-extensions/4.15.0/typing_extensions-4.15.0-py3-none-any.whl (44 kB) 01:00:22 Collecting elasticsearch (from -r requirements.txt (line 18)) 01:00:22 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch/8.19.3/elasticsearch-8.19.3-py3-none-any.whl (952 kB) 01:00:22 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 952.8/952.8 kB 30.8 MB/s 0:00:00 01:00:22 INFO: pip is looking at multiple versions of elasticsearch-dsl to determine which version is compatible with other requirements. This could take a while. 01:00:22 Collecting elasticsearch-dsl (from -r requirements.txt (line 19)) 01:00:22 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch-dsl/8.17.1/elasticsearch_dsl-8.17.1-py3-none-any.whl (158 kB) 01:00:22 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch-dsl/8.17.0/elasticsearch_dsl-8.17.0-py3-none-any.whl (158 kB) 01:00:22 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch-dsl/8.16.0/elasticsearch_dsl-8.16.0-py3-none-any.whl (158 kB) 01:00:22 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch-dsl/8.15.4/elasticsearch_dsl-8.15.4-py3-none-any.whl (104 kB) 01:00:22 Collecting elastic-transport<9,>=8.15.1 (from elasticsearch->-r requirements.txt (line 18)) 01:00:22 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elastic-transport/8.17.1/elastic_transport-8.17.1-py3-none-any.whl (64 kB) 01:00:22 Collecting pyang (from pyangbind->-r requirements.txt (line 22)) 01:00:22 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyang/2.7.1/pyang-2.7.1-py2.py3-none-any.whl (598 kB) 01:00:22 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 598.5/598.5 kB 19.5 MB/s 0:00:00 01:00:23 Collecting lxml (from pyangbind->-r requirements.txt (line 22)) 01:00:23 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/lxml/6.0.2/lxml-6.0.2-cp311-cp311-manylinux_2_26_x86_64.manylinux_2_28_x86_64.whl (5.2 MB) 01:00:23 Collecting regex (from pyangbind->-r requirements.txt (line 22)) 01:00:23 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/regex/2026.1.15/regex-2026.1.15-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl (800 kB) 01:00:23 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 800.5/800.5 kB 34.8 MB/s 0:00:00 01:00:23 Collecting enum34 (from pyangbind->-r requirements.txt (line 22)) 01:00:23 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/enum34/1.1.10/enum34-1.1.10-py3-none-any.whl (11 kB) 01:00:24 Collecting bcrypt>=3.2 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) 01:00:24 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/bcrypt/5.0.0/bcrypt-5.0.0-cp39-abi3-manylinux_2_28_x86_64.whl (278 kB) 01:00:24 Collecting cryptography>=3.3 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) 01:00:24 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/cryptography/46.0.4/cryptography-46.0.4-cp311-abi3-manylinux_2_28_x86_64.whl (4.5 MB) 01:00:24 Collecting invoke>=2.0 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) 01:00:24 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/invoke/2.2.1/invoke-2.2.1-py3-none-any.whl (160 kB) 01:00:24 Collecting pynacl>=1.5 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) 01:00:24 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pynacl/1.6.2/pynacl-1.6.2-cp38-abi3-manylinux_2_26_x86_64.manylinux_2_28_x86_64.whl (1.4 MB) 01:00:25 Collecting cffi>=2.0.0 (from cryptography>=3.3->paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) 01:00:25 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/cffi/2.0.0/cffi-2.0.0-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (215 kB) 01:00:25 Collecting pycparser (from cffi>=2.0.0->cryptography>=3.3->paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) 01:00:25 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pycparser/3.0/pycparser-3.0-py3-none-any.whl (48 kB) 01:00:25 Collecting selenium>=4.3.0 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) 01:00:25 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/selenium/4.40.0/selenium-4.40.0-py3-none-any.whl (9.6 MB) 01:00:25 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 9.6/9.6 MB 66.0 MB/s 0:00:00 01:00:25 Collecting robotframework-pythonlibcore>=4.4.1 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) 01:00:25 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-pythonlibcore/4.5.0/robotframework_pythonlibcore-4.5.0-py3-none-any.whl (19 kB) 01:00:25 Collecting click>=8.0 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) 01:00:25 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/click/8.3.1/click-8.3.1-py3-none-any.whl (108 kB) 01:00:25 Collecting trio<1.0,>=0.31.0 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) 01:00:25 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/trio/0.32.0/trio-0.32.0-py3-none-any.whl (512 kB) 01:00:25 Collecting trio-websocket<1.0,>=0.12.2 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) 01:00:25 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/trio-websocket/0.12.2/trio_websocket-0.12.2-py3-none-any.whl (21 kB) 01:00:25 Collecting trio-typing>=0.10.0 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) 01:00:25 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/trio-typing/0.10.0/trio_typing-0.10.0-py3-none-any.whl (42 kB) 01:00:25 Collecting types-certifi>=2021.10.8.3 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) 01:00:25 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/types-certifi/2021.10.8.3/types_certifi-2021.10.8.3-py3-none-any.whl (2.1 kB) 01:00:25 Collecting types-urllib3>=1.26.25.14 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) 01:00:25 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/types-urllib3/1.26.25.14/types_urllib3-1.26.25.14-py3-none-any.whl (15 kB) 01:00:25 Collecting attrs>=23.2.0 (from trio<1.0,>=0.31.0->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) 01:00:25 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/attrs/25.4.0/attrs-25.4.0-py3-none-any.whl (67 kB) 01:00:25 Collecting sortedcontainers (from trio<1.0,>=0.31.0->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) 01:00:25 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/sortedcontainers/2.4.0/sortedcontainers-2.4.0-py2.py3-none-any.whl (29 kB) 01:00:25 Collecting outcome (from trio<1.0,>=0.31.0->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) 01:00:25 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/outcome/1.3.0.post0/outcome-1.3.0.post0-py2.py3-none-any.whl (10 kB) 01:00:25 Collecting wsproto>=0.14 (from trio-websocket<1.0,>=0.12.2->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) 01:00:25 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/wsproto/1.3.2/wsproto-1.3.2-py3-none-any.whl (24 kB) 01:00:25 Collecting pysocks!=1.5.7,<2.0,>=1.5.6 (from urllib3[socks]<3.0,>=2.6.3->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) 01:00:25 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pysocks/1.7.1/PySocks-1.7.1-py3-none-any.whl (16 kB) 01:00:25 Collecting mypy-extensions>=0.4.2 (from trio-typing>=0.10.0->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) 01:00:25 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/mypy-extensions/1.1.0/mypy_extensions-1.1.0-py3-none-any.whl (5.0 kB) 01:00:25 Collecting async-generator (from trio-typing>=0.10.0->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) 01:00:25 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/async-generator/1.10/async_generator-1.10-py3-none-any.whl (18 kB) 01:00:25 Requirement already satisfied: packaging in /tmp/venv-KufZ/lib/python3.11/site-packages (from trio-typing>=0.10.0->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) (26.0) 01:00:25 Collecting importlib-metadata (from trio-typing>=0.10.0->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) 01:00:26 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/importlib-metadata/8.7.1/importlib_metadata-8.7.1-py3-none-any.whl (27 kB) 01:00:26 Collecting WebOb>=1.2 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8)) 01:00:26 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/webob/1.8.9/WebOb-1.8.9-py2.py3-none-any.whl (115 kB) 01:00:26 Collecting waitress>=3.0.2 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8)) 01:00:26 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/waitress/3.0.2/waitress-3.0.2-py3-none-any.whl (56 kB) 01:00:26 Collecting beautifulsoup4 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8)) 01:00:26 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/beautifulsoup4/4.14.3/beautifulsoup4-4.14.3-py3-none-any.whl (107 kB) 01:00:26 Collecting h11<1,>=0.16.0 (from wsproto>=0.14->trio-websocket<1.0,>=0.12.2->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) 01:00:26 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/h11/0.16.0/h11-0.16.0-py3-none-any.whl (37 kB) 01:00:26 Collecting soupsieve>=1.6.1 (from beautifulsoup4->webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8)) 01:00:26 Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/soupsieve/2.8.3/soupsieve-2.8.3-py3-none-any.whl (37 kB) 01:00:26 Collecting zipp>=3.20 (from importlib-metadata->trio-typing>=0.10.0->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) 01:00:26 Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/zipp/3.23.0/zipp-3.23.0-py3-none-any.whl (10 kB) 01:00:26 Building wheels for collected packages: robotframework-sshlibrary, ipaddr, netifaces, robotframework-httplibrary, jsonpath-rw 01:00:26 Building wheel for robotframework-sshlibrary (pyproject.toml): started 01:00:26 Building wheel for robotframework-sshlibrary (pyproject.toml): finished with status 'done' 01:00:26 Created wheel for robotframework-sshlibrary: filename=robotframework_sshlibrary-3.8.0-py3-none-any.whl size=55205 sha256=bea5e84656d9ae24680fd3df030ed0ff9e25b69089f7c1f847dcd2a98281ec8b 01:00:26 Stored in directory: /home/jenkins/.cache/pip/wheels/f7/c9/b3/a977b7bcc410d45ae27d240df3d00a12585509180e373ecccc 01:00:26 Building wheel for ipaddr (pyproject.toml): started 01:00:26 Building wheel for ipaddr (pyproject.toml): finished with status 'done' 01:00:26 Created wheel for ipaddr: filename=ipaddr-2.2.0-py3-none-any.whl size=18351 sha256=177fcf8799fbb2872676293076d91318ba6555d0b7a1ee8a5223d87a59052b03 01:00:26 Stored in directory: /home/jenkins/.cache/pip/wheels/dc/6c/04/da2d847fa8d45c59af3e1d83e2acc29cb8adcbaf04c0898dbf 01:00:26 Building wheel for netifaces (pyproject.toml): started 01:00:29 Building wheel for netifaces (pyproject.toml): finished with status 'done' 01:00:29 Created wheel for netifaces: filename=netifaces-0.11.0-cp311-cp311-linux_x86_64.whl size=41075 sha256=d547d713dd60d49c889b5849a6a6f87da31f78b7e17ab59d9a673c2414e632eb 01:00:29 Stored in directory: /home/jenkins/.cache/pip/wheels/f8/18/88/e61d54b995bea304bdb1d040a92b72228a1bf72ca2a3eba7c9 01:00:29 Building wheel for robotframework-httplibrary (pyproject.toml): started 01:00:29 Building wheel for robotframework-httplibrary (pyproject.toml): finished with status 'done' 01:00:29 Created wheel for robotframework-httplibrary: filename=robotframework_httplibrary-0.4.2-py3-none-any.whl size=10012 sha256=c8d4be36d7dcbae840ee7275b5f745ef7c351865554aef21e856e4b408d97c24 01:00:29 Stored in directory: /home/jenkins/.cache/pip/wheels/aa/bc/0d/9a20dd51effef392aae2733cb4c7b66c6fa29fca33d88b57ed 01:00:29 Building wheel for jsonpath-rw (pyproject.toml): started 01:00:29 Building wheel for jsonpath-rw (pyproject.toml): finished with status 'done' 01:00:29 Created wheel for jsonpath-rw: filename=jsonpath_rw-1.4.0-py3-none-any.whl size=15175 sha256=56b333f588429b6accb6536e6a138004b719250ceb1f89bb802021c79a06b167 01:00:29 Stored in directory: /home/jenkins/.cache/pip/wheels/f1/54/63/9a8da38cefae13755097b36cc852decc25d8ef69c37d58d4eb 01:00:29 Successfully built robotframework-sshlibrary ipaddr netifaces robotframework-httplibrary jsonpath-rw 01:00:29 Installing collected packages: types-urllib3, types-certifi, sortedcontainers, ply, netifaces, ipaddr, enum34, zipp, websocket-client, WebOb, waitress, urllib3, typing-extensions, soupsieve, sniffio, six, scapy, robotframework-pythonlibcore, robotframework, regex, pysocks, pyparsing, pycparser, netaddr, mypy-extensions, lxml, jsonpointer, jmespath, isodate, invoke, idna, h11, decorator, click, charset_normalizer, certifi, bcrypt, attrs, async-generator, wsproto, requests, python-dateutil, pyhocon, pyang, outcome, jsonpath-rw, jsonpatch, importlib-metadata, elastic-transport, docker-pycreds, cffi, beautifulsoup4, webtest, trio, robotframework-requests, pynacl, pyangbind, elasticsearch, docker-py, cryptography, trio-websocket, trio-typing, robotframework-httplibrary, paramiko, elasticsearch-dsl, selenium, scp, robotframework-sshlibrary, robotframework-seleniumlibrary, robotframework-selenium2library 01:00:37 01:00:37 Successfully installed WebOb-1.8.9 async-generator-1.10 attrs-25.4.0 bcrypt-5.0.0 beautifulsoup4-4.14.3 certifi-2026.1.4 cffi-2.0.0 charset_normalizer-3.4.4 click-8.3.1 cryptography-46.0.4 decorator-5.2.1 docker-py-1.10.6 docker-pycreds-0.4.0 elastic-transport-8.17.1 elasticsearch-8.19.3 elasticsearch-dsl-8.15.4 enum34-1.1.10 h11-0.16.0 idna-3.11 importlib-metadata-8.7.1 invoke-2.2.1 ipaddr-2.2.0 isodate-0.7.2 jmespath-1.1.0 jsonpatch-1.33 jsonpath-rw-1.4.0 jsonpointer-3.0.0 lxml-6.0.2 mypy-extensions-1.1.0 netaddr-1.3.0 netifaces-0.11.0 outcome-1.3.0.post0 paramiko-4.0.0 ply-3.11 pyang-2.7.1 pyangbind-0.8.7 pycparser-3.0 pyhocon-0.3.61 pynacl-1.6.2 pyparsing-3.3.2 pysocks-1.7.1 python-dateutil-2.9.0.post0 regex-2026.1.15 requests-2.32.5 robotframework-7.4.1 robotframework-httplibrary-0.4.2 robotframework-pythonlibcore-4.5.0 robotframework-requests-0.9.7 robotframework-selenium2library-3.0.0 robotframework-seleniumlibrary-6.8.0 robotframework-sshlibrary-3.8.0 scapy-2.7.0 scp-0.15.0 selenium-4.40.0 six-1.17.0 sniffio-1.3.1 sortedcontainers-2.4.0 soupsieve-2.8.3 trio-0.32.0 trio-typing-0.10.0 trio-websocket-0.12.2 types-certifi-2021.10.8.3 types-urllib3-1.26.25.14 typing-extensions-4.15.0 urllib3-2.6.3 waitress-3.0.2 websocket-client-1.9.0 webtest-3.0.7 wsproto-1.3.2 zipp-3.23.0 01:00:37 + pip freeze 01:00:37 async-generator==1.10 01:00:37 attrs==25.4.0 01:00:37 bcrypt==5.0.0 01:00:37 beautifulsoup4==4.14.3 01:00:37 certifi==2026.1.4 01:00:37 cffi==2.0.0 01:00:37 charset-normalizer==3.4.4 01:00:37 click==8.3.1 01:00:37 cryptography==46.0.4 01:00:37 decorator==5.2.1 01:00:37 distlib==0.4.0 01:00:37 docker-py==1.10.6 01:00:37 docker-pycreds==0.4.0 01:00:37 elastic-transport==8.17.1 01:00:37 elasticsearch==8.19.3 01:00:37 elasticsearch-dsl==8.15.4 01:00:37 enum34==1.1.10 01:00:37 filelock==3.20.3 01:00:37 h11==0.16.0 01:00:37 idna==3.11 01:00:37 importlib_metadata==8.7.1 01:00:37 invoke==2.2.1 01:00:37 ipaddr==2.2.0 01:00:37 isodate==0.7.2 01:00:37 jmespath==1.1.0 01:00:37 jsonpatch==1.33 01:00:37 jsonpath-rw==1.4.0 01:00:37 jsonpointer==3.0.0 01:00:37 lxml==6.0.2 01:00:37 mypy_extensions==1.1.0 01:00:37 netaddr==1.3.0 01:00:37 netifaces==0.11.0 01:00:37 outcome==1.3.0.post0 01:00:37 packaging==26.0 01:00:37 paramiko==4.0.0 01:00:37 platformdirs==4.5.1 01:00:37 ply==3.11 01:00:37 pyang==2.7.1 01:00:37 pyangbind==0.8.7 01:00:37 pycparser==3.0 01:00:37 pyhocon==0.3.61 01:00:37 PyNaCl==1.6.2 01:00:37 pyparsing==3.3.2 01:00:37 PySocks==1.7.1 01:00:37 python-dateutil==2.9.0.post0 01:00:37 regex==2026.1.15 01:00:37 requests==2.32.5 01:00:37 robotframework==7.4.1 01:00:37 robotframework-httplibrary==0.4.2 01:00:37 robotframework-pythonlibcore==4.5.0 01:00:37 robotframework-requests==0.9.7 01:00:37 robotframework-selenium2library==3.0.0 01:00:37 robotframework-seleniumlibrary==6.8.0 01:00:37 robotframework-sshlibrary==3.8.0 01:00:37 scapy==2.7.0 01:00:37 scp==0.15.0 01:00:37 selenium==4.40.0 01:00:37 six==1.17.0 01:00:37 sniffio==1.3.1 01:00:37 sortedcontainers==2.4.0 01:00:37 soupsieve==2.8.3 01:00:37 trio==0.32.0 01:00:37 trio-typing==0.10.0 01:00:37 trio-websocket==0.12.2 01:00:37 types-certifi==2021.10.8.3 01:00:37 types-urllib3==1.26.25.14 01:00:37 typing_extensions==4.15.0 01:00:37 urllib3==2.6.3 01:00:37 virtualenv==20.36.1 01:00:37 waitress==3.0.2 01:00:37 WebOb==1.8.9 01:00:37 websocket-client==1.9.0 01:00:37 WebTest==3.0.7 01:00:37 wsproto==1.3.2 01:00:37 zipp==3.23.0 01:00:37 [EnvInject] - Injecting environment variables from a build step. 01:00:37 [EnvInject] - Injecting as environment variables the properties file path 'env.properties' 01:00:37 [EnvInject] - Variables injected successfully. 01:00:37 [controller-csit-3node-clustering-tell-all-titanium] $ /bin/bash -l /tmp/jenkins6745654663688585735.sh 01:00:37 Setup pyenv: 01:00:38 system 01:00:38 3.8.13 01:00:38 3.9.13 01:00:38 3.10.13 01:00:38 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-titanium/.python-version) 01:00:38 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-RqOx from file:/tmp/.os_lf_venv 01:00:38 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 01:00:38 lf-activate-venv(): INFO: Attempting to install with network-safe options... 01:00:40 lf-activate-venv(): INFO: Base packages installed successfully 01:00:40 lf-activate-venv(): INFO: Installing additional packages: python-heatclient python-openstackclient yq 01:00:46 lf-activate-venv(): INFO: Adding /tmp/venv-RqOx/bin to PATH 01:00:46 + ODL_SYSTEM=() 01:00:46 + TOOLS_SYSTEM=() 01:00:46 + OPENSTACK_SYSTEM=() 01:00:46 + OPENSTACK_CONTROLLERS=() 01:00:46 + mapfile -t ADDR 01:00:46 ++ openstack stack show -f json -c outputs releng-controller-csit-3node-clustering-tell-all-titanium-73 01:00:46 ++ jq -r '.outputs[] | select(.output_key | match("^vm_[0-9]+_ips$")) | .output_value | .[]' 01:00:48 + for i in "${ADDR[@]}" 01:00:48 ++ ssh 10.30.171.250 hostname -s 01:00:48 Warning: Permanently added '10.30.171.250' (ECDSA) to the list of known hosts. 01:00:48 + REMHOST=releng-14749-73-0-builder-0 01:00:48 + case ${REMHOST} in 01:00:48 + ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}") 01:00:48 + for i in "${ADDR[@]}" 01:00:48 ++ ssh 10.30.171.198 hostname -s 01:00:48 Warning: Permanently added '10.30.171.198' (ECDSA) to the list of known hosts. 01:00:49 + REMHOST=releng-14749-73-0-builder-1 01:00:49 + case ${REMHOST} in 01:00:49 + ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}") 01:00:49 + for i in "${ADDR[@]}" 01:00:49 ++ ssh 10.30.171.173 hostname -s 01:00:49 Warning: Permanently added '10.30.171.173' (ECDSA) to the list of known hosts. 01:00:49 + REMHOST=releng-14749-73-0-builder-2 01:00:49 + case ${REMHOST} in 01:00:49 + ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}") 01:00:49 + echo NUM_ODL_SYSTEM=3 01:00:49 + echo NUM_TOOLS_SYSTEM=0 01:00:49 + '[' '' == yes ']' 01:00:49 + NUM_OPENSTACK_SYSTEM=0 01:00:49 + echo NUM_OPENSTACK_SYSTEM=0 01:00:49 + '[' 0 -eq 2 ']' 01:00:49 + echo ODL_SYSTEM_IP=10.30.171.250 01:00:49 ++ seq 0 2 01:00:49 + for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 ))) 01:00:49 + echo ODL_SYSTEM_1_IP=10.30.171.250 01:00:49 + for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 ))) 01:00:49 + echo ODL_SYSTEM_2_IP=10.30.171.198 01:00:49 + for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 ))) 01:00:49 + echo ODL_SYSTEM_3_IP=10.30.171.173 01:00:49 + echo TOOLS_SYSTEM_IP= 01:00:49 ++ seq 0 -1 01:00:49 + openstack_index=0 01:00:49 + NUM_OPENSTACK_CONTROL_NODES=1 01:00:49 + echo NUM_OPENSTACK_CONTROL_NODES=1 01:00:49 ++ seq 0 0 01:00:49 + for i in $(seq 0 $((NUM_OPENSTACK_CONTROL_NODES - 1))) 01:00:49 + echo OPENSTACK_CONTROL_NODE_1_IP= 01:00:49 + NUM_OPENSTACK_COMPUTE_NODES=-1 01:00:49 + echo NUM_OPENSTACK_COMPUTE_NODES=-1 01:00:49 + '[' -1 -ge 2 ']' 01:00:49 ++ seq 0 -2 01:00:49 + NUM_OPENSTACK_HAPROXY_NODES=0 01:00:49 + echo NUM_OPENSTACK_HAPROXY_NODES=0 01:00:49 ++ seq 0 -1 01:00:49 + echo 'Contents of slave_addresses.txt:' 01:00:49 Contents of slave_addresses.txt: 01:00:49 + cat slave_addresses.txt 01:00:49 NUM_ODL_SYSTEM=3 01:00:49 NUM_TOOLS_SYSTEM=0 01:00:49 NUM_OPENSTACK_SYSTEM=0 01:00:49 ODL_SYSTEM_IP=10.30.171.250 01:00:49 ODL_SYSTEM_1_IP=10.30.171.250 01:00:49 ODL_SYSTEM_2_IP=10.30.171.198 01:00:49 ODL_SYSTEM_3_IP=10.30.171.173 01:00:49 TOOLS_SYSTEM_IP= 01:00:49 NUM_OPENSTACK_CONTROL_NODES=1 01:00:49 OPENSTACK_CONTROL_NODE_1_IP= 01:00:49 NUM_OPENSTACK_COMPUTE_NODES=-1 01:00:49 NUM_OPENSTACK_HAPROXY_NODES=0 01:00:49 [EnvInject] - Injecting environment variables from a build step. 01:00:49 [EnvInject] - Injecting as environment variables the properties file path 'slave_addresses.txt' 01:00:49 [EnvInject] - Variables injected successfully. 01:00:49 [controller-csit-3node-clustering-tell-all-titanium] $ /bin/sh /tmp/jenkins4096411424119179626.sh 01:00:49 Preparing for JRE Version 21 01:00:49 Karaf artifact is karaf 01:00:49 Karaf project is integration 01:00:49 Java home is /usr/lib/jvm/java-21-openjdk-amd64 01:00:49 [EnvInject] - Injecting environment variables from a build step. 01:00:49 [EnvInject] - Injecting as environment variables the properties file path 'set_variables.env' 01:00:49 [EnvInject] - Variables injected successfully. 01:00:49 [controller-csit-3node-clustering-tell-all-titanium] $ /bin/bash /tmp/jenkins14083765537363258667.sh 01:00:49 2026-02-08 01:00:49 URL:https://raw.githubusercontent.com/opendaylight/integration-distribution/stable/titanium/pom.xml [2619/2619] -> "pom.xml" [1] 01:00:49 Bundle version is 0.22.2-SNAPSHOT 01:00:49 --2026-02-08 01:00:49-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.22.2-SNAPSHOT/maven-metadata.xml 01:00:49 Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6 01:00:49 Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected. 01:00:49 HTTP request sent, awaiting response... 200 OK 01:00:49 Length: 1410 (1.4K) [application/xml] 01:00:49 Saving to: ‘maven-metadata.xml’ 01:00:49 01:00:49 0K . 100% 63.4M=0s 01:00:49 01:00:49 2026-02-08 01:00:49 (63.4 MB/s) - ‘maven-metadata.xml’ saved [1410/1410] 01:00:49 01:00:49 01:00:49 01:00:49 org.opendaylight.integration 01:00:49 karaf 01:00:49 0.22.2-SNAPSHOT 01:00:49 01:00:49 01:00:49 20260207.175700 01:00:49 491 01:00:49 01:00:49 20260207175700 01:00:49 01:00:49 01:00:49 pom 01:00:49 0.22.2-20260207.175700-491 01:00:49 20260207175700 01:00:49 01:00:49 01:00:49 tar.gz 01:00:49 0.22.2-20260207.175700-491 01:00:49 20260207175700 01:00:49 01:00:49 01:00:49 zip 01:00:49 0.22.2-20260207.175700-491 01:00:49 20260207175700 01:00:49 01:00:49 01:00:49 cyclonedx 01:00:49 xml 01:00:49 0.22.2-20260207.175700-491 01:00:49 20260207175700 01:00:49 01:00:49 01:00:49 cyclonedx 01:00:49 json 01:00:49 0.22.2-20260207.175700-491 01:00:49 20260207175700 01:00:49 01:00:49 01:00:49 01:00:49 01:00:49 Nexus timestamp is 0.22.2-20260207.175700-491 01:00:49 Distribution bundle URL is https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.22.2-SNAPSHOT/karaf-0.22.2-20260207.175700-491.zip 01:00:49 Distribution bundle is karaf-0.22.2-20260207.175700-491.zip 01:00:49 Distribution bundle version is 0.22.2-SNAPSHOT 01:00:49 Distribution folder is karaf-0.22.2-SNAPSHOT 01:00:49 Nexus prefix is https://nexus.opendaylight.org 01:00:49 [EnvInject] - Injecting environment variables from a build step. 01:00:49 [EnvInject] - Injecting as environment variables the properties file path 'detect_variables.env' 01:00:49 [EnvInject] - Variables injected successfully. 01:00:49 [controller-csit-3node-clustering-tell-all-titanium] $ /bin/bash -l /tmp/jenkins14264380450043694992.sh 01:00:50 Setup pyenv: 01:00:50 system 01:00:50 3.8.13 01:00:50 3.9.13 01:00:50 3.10.13 01:00:50 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-titanium/.python-version) 01:00:50 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-RqOx from file:/tmp/.os_lf_venv 01:00:50 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 01:00:50 lf-activate-venv(): INFO: Attempting to install with network-safe options... 01:00:52 lf-activate-venv(): INFO: Base packages installed successfully 01:00:52 lf-activate-venv(): INFO: Installing additional packages: python-heatclient python-openstackclient 01:00:57 lf-activate-venv(): INFO: Adding /tmp/venv-RqOx/bin to PATH 01:00:57 Copying common-functions.sh to /tmp 01:00:58 Copying common-functions.sh to 10.30.171.250:/tmp 01:00:58 Warning: Permanently added '10.30.171.250' (ECDSA) to the list of known hosts. 01:00:59 Copying common-functions.sh to 10.30.171.198:/tmp 01:00:59 Warning: Permanently added '10.30.171.198' (ECDSA) to the list of known hosts. 01:00:59 Copying common-functions.sh to 10.30.171.173:/tmp 01:00:59 Warning: Permanently added '10.30.171.173' (ECDSA) to the list of known hosts. 01:01:00 [controller-csit-3node-clustering-tell-all-titanium] $ /bin/bash /tmp/jenkins3659554284426462460.sh 01:01:00 common-functions.sh is being sourced 01:01:00 common-functions environment: 01:01:00 MAVENCONF: /tmp/karaf-0.22.2-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg 01:01:00 ACTUALFEATURES: 01:01:00 FEATURESCONF: /tmp/karaf-0.22.2-SNAPSHOT/etc/org.apache.karaf.features.cfg 01:01:00 CUSTOMPROP: /tmp/karaf-0.22.2-SNAPSHOT/etc/custom.properties 01:01:00 LOGCONF: /tmp/karaf-0.22.2-SNAPSHOT/etc/org.ops4j.pax.logging.cfg 01:01:00 MEMCONF: /tmp/karaf-0.22.2-SNAPSHOT/bin/setenv 01:01:00 CONTROLLERMEM: 2048m 01:01:00 AKKACONF: /tmp/karaf-0.22.2-SNAPSHOT/configuration/initial/pekko.conf 01:01:00 MODULESCONF: /tmp/karaf-0.22.2-SNAPSHOT/configuration/initial/modules.conf 01:01:00 MODULESHARDSCONF: /tmp/karaf-0.22.2-SNAPSHOT/configuration/initial/module-shards.conf 01:01:00 SUITES: 01:01:00 01:01:00 ################################################# 01:01:00 ## Configure Cluster and Start ## 01:01:00 ################################################# 01:01:00 ACTUALFEATURES: odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app 01:01:00 SPACE_SEPARATED_FEATURES: odl-integration-compatible-with-all odl-jolokia odl-restconf odl-clustering-test-app 01:01:00 Locating script plan to use... 01:01:00 script plan exists!!! 01:01:00 Changing the script plan path... 01:01:00 # Place the scripts in run order: 01:01:00 /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/scripts/car_people_shard.sh 01:01:00 Executing /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/scripts/car_people_shard.sh... 01:01:00 Add car-people shards file 01:01:00 Copy shard config to member-1 with IP address 10.30.171.250 01:01:00 Warning: Permanently added '10.30.171.250' (ECDSA) to the list of known hosts. 01:01:00 Copy shard config to member-2 with IP address 10.30.171.198 01:01:00 Warning: Permanently added '10.30.171.198' (ECDSA) to the list of known hosts. 01:01:00 Copy shard config to member-3 with IP address 10.30.171.173 01:01:01 Warning: Permanently added '10.30.171.173' (ECDSA) to the list of known hosts. 01:01:01 Finished running script plans 01:01:01 Configuring member-1 with IP address 10.30.171.250 01:01:01 Warning: Permanently added '10.30.171.250' (ECDSA) to the list of known hosts. 01:01:01 Warning: Permanently added '10.30.171.250' (ECDSA) to the list of known hosts. 01:01:01 common-functions.sh is being sourced 01:01:01 + source /tmp/common-functions.sh karaf-0.22.2-SNAPSHOT titanium 01:01:01 ++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]] 01:01:01 ++ echo 'common-functions.sh is being sourced' 01:01:01 ++ BUNDLEFOLDER=karaf-0.22.2-SNAPSHOT 01:01:01 ++ DISTROSTREAM=titanium 01:01:01 ++ export MAVENCONF=/tmp/karaf-0.22.2-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg 01:01:01 ++ MAVENCONF=/tmp/karaf-0.22.2-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg 01:01:01 ++ export FEATURESCONF=/tmp/karaf-0.22.2-SNAPSHOT/etc/org.apache.karaf.features.cfg 01:01:01 ++ FEATURESCONF=/tmp/karaf-0.22.2-SNAPSHOT/etc/org.apache.karaf.features.cfg 01:01:01 ++ export CUSTOMPROP=/tmp/karaf-0.22.2-SNAPSHOT/etc/custom.properties 01:01:01 ++ CUSTOMPROP=/tmp/karaf-0.22.2-SNAPSHOT/etc/custom.properties 01:01:01 ++ export LOGCONF=/tmp/karaf-0.22.2-SNAPSHOT/etc/org.ops4j.pax.logging.cfg 01:01:01 ++ LOGCONF=/tmp/karaf-0.22.2-SNAPSHOT/etc/org.ops4j.pax.logging.cfg 01:01:01 ++ export MEMCONF=/tmp/karaf-0.22.2-SNAPSHOT/bin/setenv 01:01:01 ++ MEMCONF=/tmp/karaf-0.22.2-SNAPSHOT/bin/setenv 01:01:01 ++ export CONTROLLERMEM= 01:01:01 ++ CONTROLLERMEM= 01:01:01 ++ case "${DISTROSTREAM}" in 01:01:01 ++ CLUSTER_SYSTEM=pekko 01:01:01 ++ export AKKACONF=/tmp/karaf-0.22.2-SNAPSHOT/configuration/initial/pekko.conf 01:01:01 ++ AKKACONF=/tmp/karaf-0.22.2-SNAPSHOT/configuration/initial/pekko.conf 01:01:01 ++ export MODULESCONF=/tmp/karaf-0.22.2-SNAPSHOT/configuration/initial/modules.conf 01:01:01 ++ MODULESCONF=/tmp/karaf-0.22.2-SNAPSHOT/configuration/initial/modules.conf 01:01:01 ++ export MODULESHARDSCONF=/tmp/karaf-0.22.2-SNAPSHOT/configuration/initial/module-shards.conf 01:01:01 ++ MODULESHARDSCONF=/tmp/karaf-0.22.2-SNAPSHOT/configuration/initial/module-shards.conf 01:01:01 ++ print_common_env 01:01:01 ++ cat 01:01:01 common-functions environment: 01:01:01 MAVENCONF: /tmp/karaf-0.22.2-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg 01:01:01 ACTUALFEATURES: 01:01:01 FEATURESCONF: /tmp/karaf-0.22.2-SNAPSHOT/etc/org.apache.karaf.features.cfg 01:01:01 CUSTOMPROP: /tmp/karaf-0.22.2-SNAPSHOT/etc/custom.properties 01:01:01 LOGCONF: /tmp/karaf-0.22.2-SNAPSHOT/etc/org.ops4j.pax.logging.cfg 01:01:01 MEMCONF: /tmp/karaf-0.22.2-SNAPSHOT/bin/setenv 01:01:01 CONTROLLERMEM: 01:01:01 AKKACONF: /tmp/karaf-0.22.2-SNAPSHOT/configuration/initial/pekko.conf 01:01:01 MODULESCONF: /tmp/karaf-0.22.2-SNAPSHOT/configuration/initial/modules.conf 01:01:01 MODULESHARDSCONF: /tmp/karaf-0.22.2-SNAPSHOT/configuration/initial/module-shards.conf 01:01:01 SUITES: 01:01:01 01:01:01 ++ SSH='ssh -t -t' 01:01:01 ++ extra_services_cntl=' dnsmasq.service httpd.service libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service rabbitmq-server.service ' 01:01:01 ++ extra_services_cmp=' libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service ' 01:01:01 Changing to /tmp 01:01:01 Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.22.2-SNAPSHOT/karaf-0.22.2-20260207.175700-491.zip 01:01:01 + echo 'Changing to /tmp' 01:01:01 + cd /tmp 01:01:01 + echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.22.2-SNAPSHOT/karaf-0.22.2-20260207.175700-491.zip' 01:01:01 + wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.22.2-SNAPSHOT/karaf-0.22.2-20260207.175700-491.zip 01:01:01 --2026-02-08 01:01:01-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.22.2-SNAPSHOT/karaf-0.22.2-20260207.175700-491.zip 01:01:01 Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6 01:01:01 Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected. 01:01:01 HTTP request sent, awaiting response... 200 OK 01:01:01 Length: 234981974 (224M) [application/zip] 01:01:01 Saving to: ‘karaf-0.22.2-20260207.175700-491.zip’ 01:01:01 01:01:01 0K ........ ........ ........ ........ ........ ........ 1% 76.7M 3s 01:01:01 3072K ........ ........ ........ ........ ........ ........ 2% 115M 2s 01:01:01 6144K ........ ........ ........ ........ ........ ........ 4% 138M 2s 01:01:02 9216K ........ ........ ........ ........ ........ ........ 5% 163M 2s 01:01:02 12288K ........ ........ ........ ........ ........ ........ 6% 165M 2s 01:01:02 15360K ........ ........ ........ ........ ........ ........ 8% 193M 2s 01:01:02 18432K ........ ........ ........ ........ ........ ........ 9% 196M 1s 01:01:02 21504K ........ ........ ........ ........ ........ ........ 10% 231M 1s 01:01:02 24576K ........ ........ ........ ........ ........ ........ 12% 256M 1s 01:01:02 27648K ........ ........ ........ ........ ........ ........ 13% 273M 1s 01:01:02 30720K ........ ........ ........ ........ ........ ........ 14% 288M 1s 01:01:02 33792K ........ ........ ........ ........ ........ ........ 16% 278M 1s 01:01:02 36864K ........ ........ ........ ........ ........ ........ 17% 320M 1s 01:01:02 39936K ........ ........ ........ ........ ........ ........ 18% 325M 1s 01:01:02 43008K ........ ........ ........ ........ ........ ........ 20% 319M 1s 01:01:02 46080K ........ ........ ........ ........ ........ ........ 21% 257M 1s 01:01:02 49152K ........ ........ ........ ........ ........ ........ 22% 187M 1s 01:01:02 52224K ........ ........ ........ ........ ........ ........ 24% 331M 1s 01:01:02 55296K ........ ........ ........ ........ ........ ........ 25% 319M 1s 01:01:02 58368K ........ ........ ........ ........ ........ ........ 26% 323M 1s 01:01:02 61440K ........ ........ ........ ........ ........ ........ 28% 306M 1s 01:01:02 64512K ........ ........ ........ ........ ........ ........ 29% 321M 1s 01:01:02 67584K ........ ........ ........ ........ ........ ........ 30% 314M 1s 01:01:02 70656K ........ ........ ........ ........ ........ ........ 32% 278M 1s 01:01:02 73728K ........ ........ ........ ........ ........ ........ 33% 342M 1s 01:01:02 76800K ........ ........ ........ ........ ........ ........ 34% 395M 1s 01:01:02 79872K ........ ........ ........ ........ ........ ........ 36% 335M 1s 01:01:02 82944K ........ ........ ........ ........ ........ ........ 37% 189M 1s 01:01:02 86016K ........ ........ ........ ........ ........ ........ 38% 281M 1s 01:01:02 89088K ........ ........ ........ ........ ........ ........ 40% 322M 1s 01:01:02 92160K ........ ........ ........ ........ ........ ........ 41% 305M 1s 01:01:02 95232K ........ ........ ........ ........ ........ ........ 42% 327M 1s 01:01:02 98304K ........ ........ ........ ........ ........ ........ 44% 303M 1s 01:01:02 101376K ........ ........ ........ ........ ........ ........ 45% 309M 1s 01:01:02 104448K ........ ........ ........ ........ ........ ........ 46% 244M 1s 01:01:02 107520K ........ ........ ........ ........ ........ ........ 48% 411M 0s 01:01:02 110592K ........ ........ ........ ........ ........ ........ 49% 292M 0s 01:01:02 113664K ........ ........ ........ ........ ........ ........ 50% 278M 0s 01:01:02 116736K ........ ........ ........ ........ ........ ........ 52% 282M 0s 01:01:02 119808K ........ ........ ........ ........ ........ ........ 53% 266M 0s 01:01:02 122880K ........ ........ ........ ........ ........ ........ 54% 275M 0s 01:01:02 125952K ........ ........ ........ ........ ........ ........ 56% 194M 0s 01:01:02 129024K ........ ........ ........ ........ ........ ........ 57% 200M 0s 01:01:02 132096K ........ ........ ........ ........ ........ ........ 58% 274M 0s 01:01:02 135168K ........ ........ ........ ........ ........ ........ 60% 273M 0s 01:01:02 138240K ........ ........ ........ ........ ........ ........ 61% 272M 0s 01:01:02 141312K ........ ........ ........ ........ ........ ........ 62% 276M 0s 01:01:02 144384K ........ ........ ........ ........ ........ ........ 64% 269M 0s 01:01:02 147456K ........ ........ ........ ........ ........ ........ 65% 277M 0s 01:01:02 150528K ........ ........ ........ ........ ........ ........ 66% 279M 0s 01:01:02 153600K ........ ........ ........ ........ ........ ........ 68% 275M 0s 01:01:02 156672K ........ ........ ........ ........ ........ ........ 69% 273M 0s 01:01:02 159744K ........ ........ ........ ........ ........ ........ 70% 280M 0s 01:01:02 162816K ........ ........ ........ ........ ........ ........ 72% 278M 0s 01:01:02 165888K ........ ........ ........ ........ ........ ........ 73% 129M 0s 01:01:02 168960K ........ ........ ........ ........ ........ ........ 74% 252M 0s 01:01:02 172032K ........ ........ ........ ........ ........ ........ 76% 22.0M 0s 01:01:02 175104K ........ ........ ........ ........ ........ ........ 77% 315M 0s 01:01:02 178176K ........ ........ ........ ........ ........ ........ 78% 282M 0s 01:01:02 181248K ........ ........ ........ ........ ........ ........ 80% 283M 0s 01:01:02 184320K ........ ........ ........ ........ ........ ........ 81% 277M 0s 01:01:02 187392K ........ ........ ........ ........ ........ ........ 83% 275M 0s 01:01:02 190464K ........ ........ ........ ........ ........ ........ 84% 280M 0s 01:01:02 193536K ........ ........ ........ ........ ........ ........ 85% 271M 0s 01:01:02 196608K ........ ........ ........ ........ ........ ........ 87% 279M 0s 01:01:02 199680K ........ ........ ........ ........ ........ ........ 88% 282M 0s 01:01:02 202752K ........ ........ ........ ........ ........ ........ 89% 285M 0s 01:01:02 205824K ........ ........ ........ ........ ........ ........ 91% 276M 0s 01:01:02 208896K ........ ........ ........ ........ ........ ........ 92% 288M 0s 01:01:02 211968K ........ ........ ........ ........ ........ ........ 93% 281M 0s 01:01:02 215040K ........ ........ ........ ........ ........ ........ 95% 281M 0s 01:01:02 218112K ........ ........ ........ ........ ........ ........ 96% 251M 0s 01:01:02 221184K ........ ........ ........ ........ ........ ........ 97% 366M 0s 01:01:02 224256K ........ ........ ........ ........ ........ ........ 99% 298M 0s 01:01:02 227328K ........ ........ ........ ........ . 100% 325M=1.0s 01:01:02 01:01:02 2026-02-08 01:01:02 (221 MB/s) - ‘karaf-0.22.2-20260207.175700-491.zip’ saved [234981974/234981974] 01:01:02 01:01:02 Extracting the new controller... 01:01:02 + echo 'Extracting the new controller...' 01:01:02 + unzip -q karaf-0.22.2-20260207.175700-491.zip 01:01:04 Adding external repositories... 01:01:04 + echo 'Adding external repositories...' 01:01:04 + sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.22.2-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg 01:01:04 ################################################################################ 01:01:04 # 01:01:04 # Licensed to the Apache Software Foundation (ASF) under one or more 01:01:04 # contributor license agreements. See the NOTICE file distributed with 01:01:04 # this work for additional information regarding copyright ownership. 01:01:04 # The ASF licenses this file to You under the Apache License, Version 2.0 01:01:04 # (the "License"); you may not use this file except in compliance with 01:01:04 # the License. You may obtain a copy of the License at 01:01:04 # 01:01:04 # http://www.apache.org/licenses/LICENSE-2.0 01:01:04 # 01:01:04 # Unless required by applicable law or agreed to in writing, software 01:01:04 # distributed under the License is distributed on an "AS IS" BASIS, 01:01:04 # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. 01:01:04 # See the License for the specific language governing permissions and 01:01:04 # limitations under the License. 01:01:04 # 01:01:04 ################################################################################ 01:01:04 01:01:04 # 01:01:04 # If set to true, the following property will not allow any certificate to be used 01:01:04 # when accessing Maven repositories through SSL 01:01:04 # 01:01:04 #org.ops4j.pax.url.mvn.certificateCheck= 01:01:04 01:01:04 # 01:01:04 # Path to the local Maven settings file. 01:01:04 # The repositories defined in this file will be automatically added to the list 01:01:04 # of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property 01:01:04 # below is not set. 01:01:04 # The following locations are checked for the existence of the settings.xml file 01:01:04 # * 1. looks for the specified url 01:01:04 # * 2. if not found looks for ${user.home}/.m2/settings.xml 01:01:04 # * 3. if not found looks for ${maven.home}/conf/settings.xml 01:01:04 # * 4. if not found looks for ${M2_HOME}/conf/settings.xml 01:01:04 # 01:01:04 #org.ops4j.pax.url.mvn.settings= 01:01:04 01:01:04 # 01:01:04 # Path to the local Maven repository which is used to avoid downloading 01:01:04 # artifacts when they already exist locally. 01:01:04 # The value of this property will be extracted from the settings.xml file 01:01:04 # above, or defaulted to: 01:01:04 # System.getProperty( "user.home" ) + "/.m2/repository" 01:01:04 # 01:01:04 org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository} 01:01:04 01:01:04 # 01:01:04 # Default this to false. It's just weird to use undocumented repos 01:01:04 # 01:01:04 org.ops4j.pax.url.mvn.useFallbackRepositories=false 01:01:04 01:01:04 # 01:01:04 # Uncomment if you don't wanna use the proxy settings 01:01:04 # from the Maven conf/settings.xml file 01:01:04 # 01:01:04 # org.ops4j.pax.url.mvn.proxySupport=false 01:01:04 01:01:04 # 01:01:04 # Comma separated list of repositories scanned when resolving an artifact. 01:01:04 # Those repositories will be checked before iterating through the 01:01:04 # below list of repositories and even before the local repository 01:01:04 # A repository url can be appended with zero or more of the following flags: 01:01:04 # @snapshots : the repository contains snaphots 01:01:04 # @noreleases : the repository does not contain any released artifacts 01:01:04 # 01:01:04 # The following property value will add the system folder as a repo. 01:01:04 # 01:01:04 org.ops4j.pax.url.mvn.defaultRepositories=\ 01:01:04 file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\ 01:01:04 file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\ 01:01:04 file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots 01:01:04 01:01:04 # Use the default local repo (e.g.~/.m2/repository) as a "remote" repo 01:01:04 #org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false 01:01:04 01:01:04 # 01:01:04 # Comma separated list of repositories scanned when resolving an artifact. 01:01:04 # The default list includes the following repositories: 01:01:04 # http://repo1.maven.org/maven2@id=central 01:01:04 # http://repository.springsource.com/maven/bundles/release@id=spring.ebr 01:01:04 # http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external 01:01:04 # http://zodiac.springsource.com/maven/bundles/release@id=gemini 01:01:04 # http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases 01:01:04 # https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases 01:01:04 # https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases 01:01:04 # To add repositories to the default ones, prepend '+' to the list of repositories 01:01:04 # to add. 01:01:04 # A repository url can be appended with zero or more of the following flags: 01:01:04 # @snapshots : the repository contains snapshots 01:01:04 # @noreleases : the repository does not contain any released artifacts 01:01:04 # @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended 01:01:04 # 01:01:04 org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases 01:01:04 01:01:04 ### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.Configuring the startup features... 01:01:04 + cat /tmp/karaf-0.22.2-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg 01:01:04 + [[ True == \T\r\u\e ]] 01:01:04 + echo 'Configuring the startup features...' 01:01:04 + sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.22.2-SNAPSHOT/etc/org.apache.karaf.features.cfg 01:01:04 + FEATURE_TEST_STRING=features-test 01:01:04 + FEATURE_TEST_VERSION=0.22.2-SNAPSHOT 01:01:04 + KARAF_VERSION=karaf4 01:01:04 + [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]] 01:01:04 + sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.22.2-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.22.2-SNAPSHOT/etc/org.apache.karaf.features.cfg 01:01:04 + [[ ! -z '' ]] 01:01:04 + cat /tmp/karaf-0.22.2-SNAPSHOT/etc/org.apache.karaf.features.cfg 01:01:04 ################################################################################ 01:01:04 # 01:01:04 # Licensed to the Apache Software Foundation (ASF) under one or more 01:01:04 # contributor license agreements. See the NOTICE file distributed with 01:01:04 # this work for additional information regarding copyright ownership. 01:01:04 # The ASF licenses this file to You under the Apache License, Version 2.0 01:01:04 # (the "License"); you may not use this file except in compliance with 01:01:04 # the License. You may obtain a copy of the License at 01:01:04 # 01:01:04 # http://www.apache.org/licenses/LICENSE-2.0 01:01:04 # 01:01:04 # Unless required by applicable law or agreed to in writing, software 01:01:04 # distributed under the License is distributed on an "AS IS" BASIS, 01:01:04 # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. 01:01:04 # See the License for the specific language governing permissions and 01:01:04 # limitations under the License. 01:01:04 # 01:01:04 ################################################################################ 01:01:04 01:01:04 # 01:01:04 # Comma separated list of features repositories to register by default 01:01:04 # 01:01:04 featuresRepositories = mvn:org.opendaylight.integration/features-test/0.22.2-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/4fcf3549-2afc-4ad5-89c2-131fdba22663.xml 01:01:04 01:01:04 # 01:01:04 # Comma separated list of features to install at startup 01:01:04 # 01:01:04 featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, e5e243c7-6090-4d26-9145-e5c40716ec59 01:01:04 01:01:04 # 01:01:04 # Resource repositories (OBR) that the features resolver can use 01:01:04 # to resolve requirements/capabilities 01:01:04 # 01:01:04 # The format of the resourceRepositories is 01:01:04 # resourceRepositories=[xml:url|json:url],... 01:01:04 # for Instance: 01:01:04 # 01:01:04 #resourceRepositories=xml:http://host/path/to/index.xml 01:01:04 # or 01:01:04 #resourceRepositories=json:http://host/path/to/index.json 01:01:04 # 01:01:04 01:01:04 # 01:01:04 # Defines if the boot features are started in asynchronous mode (in a dedicated thread) 01:01:04 # 01:01:04 featuresBootAsynchronous=false 01:01:04 01:01:04 # 01:01:04 # Service requirements enforcement 01:01:04 # 01:01:04 # By default, the feature resolver checks the service requirements/capabilities of 01:01:04 # bundles for new features (xml schema >= 1.3.0) in order to automatically installs 01:01:04 # the required bundles. 01:01:04 # The following flag can have those values: 01:01:04 # - disable: service requirements are completely ignored 01:01:04 # - default: service requirements are ignored for old features 01:01:04 # - enforce: service requirements are always verified 01:01:04 # 01:01:04 #serviceRequirements=default 01:01:04 01:01:04 # 01:01:04 # Store cfg file for config element in feature 01:01:04 # 01:01:04 #configCfgStore=true 01:01:04 01:01:04 # 01:01:04 # Define if the feature service automatically refresh bundles 01:01:04 # 01:01:04 autoRefresh=true 01:01:04 01:01:04 # 01:01:04 # Configuration of features processing mechanism (overrides, blacklisting, modification of features) 01:01:04 # XML file defines instructions related to features processing 01:01:04 # versions.properties may declare properties to resolve placeholders in XML file 01:01:04 # both files are relative to ${karaf.etc} 01:01:04 # 01:01:04 #featureProcessing=org.apache.karaf.features.xml 01:01:04 #featureProcessingVersions=versions.properties 01:01:04 + configure_karaf_log karaf4 '' 01:01:04 + local -r karaf_version=karaf4 01:01:04 + local -r controllerdebugmap= 01:01:04 + local logapi=log4j 01:01:04 + grep log4j2 /tmp/karaf-0.22.2-SNAPSHOT/etc/org.ops4j.pax.logging.cfg 01:01:04 log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n 01:01:04 log4j2.rootLogger.level = INFO 01:01:04 #log4j2.rootLogger.type = asyncRoot 01:01:04 #log4j2.rootLogger.includeLocation = false 01:01:04 log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile 01:01:04 log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi 01:01:04 log4j2.rootLogger.appenderRef.Console.ref = Console 01:01:04 log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter 01:01:04 log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} 01:01:04 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter 01:01:04 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair 01:01:04 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker 01:01:04 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL 01:01:04 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or 01:01:04 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY 01:01:04 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL 01:01:04 log4j2.logger.spifly.name = org.apache.aries.spifly 01:01:04 log4j2.logger.spifly.level = WARN 01:01:04 log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit 01:01:04 log4j2.logger.audit.level = INFO 01:01:04 log4j2.logger.audit.additivity = false 01:01:04 log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile 01:01:04 # Console appender not used by default (see log4j2.rootLogger.appenderRefs) 01:01:04 log4j2.appender.console.type = Console 01:01:04 log4j2.appender.console.name = Console 01:01:04 log4j2.appender.console.layout.type = PatternLayout 01:01:04 log4j2.appender.console.layout.pattern = ${log4j2.pattern} 01:01:04 log4j2.appender.rolling.type = RollingRandomAccessFile 01:01:04 log4j2.appender.rolling.name = RollingFile 01:01:04 log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log 01:01:04 log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i 01:01:04 #log4j2.appender.rolling.immediateFlush = false 01:01:04 log4j2.appender.rolling.append = true 01:01:04 log4j2.appender.rolling.layout.type = PatternLayout 01:01:04 log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} 01:01:04 log4j2.appender.rolling.policies.type = Policies 01:01:04 log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy 01:01:04 log4j2.appender.rolling.policies.size.size = 64MB 01:01:04 log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy 01:01:04 log4j2.appender.rolling.strategy.max = 7 01:01:04 log4j2.appender.audit.type = RollingRandomAccessFile 01:01:04 log4j2.appender.audit.name = AuditRollingFile 01:01:04 log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log 01:01:04 log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i 01:01:04 log4j2.appender.audit.append = true 01:01:04 log4j2.appender.audit.layout.type = PatternLayout 01:01:04 log4j2.appender.audit.layout.pattern = ${log4j2.pattern} 01:01:04 log4j2.appender.audit.policies.type = Policies 01:01:04 log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy 01:01:04 log4j2.appender.audit.policies.size.size = 8MB 01:01:04 log4j2.appender.audit.strategy.type = DefaultRolloverStrategy 01:01:04 log4j2.appender.audit.strategy.max = 7 01:01:04 log4j2.appender.osgi.type = PaxOsgi 01:01:04 log4j2.appender.osgi.name = PaxOsgi 01:01:04 log4j2.appender.osgi.filter = * 01:01:04 #log4j2.logger.aether.name = shaded.org.eclipse.aether 01:01:04 #log4j2.logger.aether.level = TRACE 01:01:04 #log4j2.logger.http-headers.name = shaded.org.apache.http.headers 01:01:04 #log4j2.logger.http-headers.level = DEBUG 01:01:04 #log4j2.logger.maven.name = org.ops4j.pax.url.mvn 01:01:04 #log4j2.logger.maven.level = TRACE 01:01:04 Configuring the karaf log... karaf_version: karaf4, logapi: log4j2 01:01:04 + logapi=log4j2 01:01:04 + echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2' 01:01:04 + '[' log4j2 == log4j2 ']' 01:01:04 + sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.22.2-SNAPSHOT/etc/org.ops4j.pax.logging.cfg 01:01:04 + orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver 01:01:04 + orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver 01:01:04 + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN' 01:01:04 controllerdebugmap: 01:01:04 cat /tmp/karaf-0.22.2-SNAPSHOT/etc/org.ops4j.pax.logging.cfg 01:01:04 + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN' 01:01:04 + unset IFS 01:01:04 + echo 'controllerdebugmap: ' 01:01:04 + '[' -n '' ']' 01:01:04 + echo 'cat /tmp/karaf-0.22.2-SNAPSHOT/etc/org.ops4j.pax.logging.cfg' 01:01:04 + cat /tmp/karaf-0.22.2-SNAPSHOT/etc/org.ops4j.pax.logging.cfg 01:01:04 ################################################################################ 01:01:04 # 01:01:04 # Licensed to the Apache Software Foundation (ASF) under one or more 01:01:04 # contributor license agreements. See the NOTICE file distributed with 01:01:04 # this work for additional information regarding copyright ownership. 01:01:04 # The ASF licenses this file to You under the Apache License, Version 2.0 01:01:04 # (the "License"); you may not use this file except in compliance with 01:01:04 # the License. You may obtain a copy of the License at 01:01:04 # 01:01:04 # http://www.apache.org/licenses/LICENSE-2.0 01:01:04 # 01:01:04 # Unless required by applicable law or agreed to in writing, software 01:01:04 # distributed under the License is distributed on an "AS IS" BASIS, 01:01:04 # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. 01:01:04 # See the License for the specific language governing permissions and 01:01:04 # limitations under the License. 01:01:04 # 01:01:04 ################################################################################ 01:01:04 01:01:04 # Common pattern layout for appenders 01:01:04 log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n 01:01:04 01:01:04 # Root logger 01:01:04 log4j2.rootLogger.level = INFO 01:01:04 # uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library 01:01:04 #log4j2.rootLogger.type = asyncRoot 01:01:04 #log4j2.rootLogger.includeLocation = false 01:01:04 log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile 01:01:04 log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi 01:01:04 log4j2.rootLogger.appenderRef.Console.ref = Console 01:01:04 log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter 01:01:04 log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} 01:01:04 01:01:04 # Filters for logs marked by org.opendaylight.odlparent.Markers 01:01:04 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter 01:01:04 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair 01:01:04 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker 01:01:04 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL 01:01:04 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or 01:01:04 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY 01:01:04 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL 01:01:04 01:01:04 # Loggers configuration 01:01:04 01:01:04 # Spifly logger 01:01:04 log4j2.logger.spifly.name = org.apache.aries.spifly 01:01:04 log4j2.logger.spifly.level = WARN 01:01:04 01:01:04 # Security audit logger 01:01:04 log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit 01:01:04 log4j2.logger.audit.level = INFO 01:01:04 log4j2.logger.audit.additivity = false 01:01:04 log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile 01:01:04 01:01:04 # Appenders configuration 01:01:04 01:01:04 # Console appender not used by default (see log4j2.rootLogger.appenderRefs) 01:01:04 log4j2.appender.console.type = Console 01:01:04 log4j2.appender.console.name = Console 01:01:04 log4j2.appender.console.layout.type = PatternLayout 01:01:04 log4j2.appender.console.layout.pattern = ${log4j2.pattern} 01:01:04 01:01:04 # Rolling file appender 01:01:04 log4j2.appender.rolling.type = RollingRandomAccessFile 01:01:04 log4j2.appender.rolling.name = RollingFile 01:01:04 log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log 01:01:04 log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i 01:01:04 # uncomment to not force a disk flush 01:01:04 #log4j2.appender.rolling.immediateFlush = false 01:01:04 log4j2.appender.rolling.append = true 01:01:04 log4j2.appender.rolling.layout.type = PatternLayout 01:01:04 log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} 01:01:04 log4j2.appender.rolling.policies.type = Policies 01:01:04 log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy 01:01:04 log4j2.appender.rolling.policies.size.size = 1GB 01:01:04 log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy 01:01:04 log4j2.appender.rolling.strategy.max = 7 01:01:04 01:01:04 # Audit file appender 01:01:04 log4j2.appender.audit.type = RollingRandomAccessFile 01:01:04 log4j2.appender.audit.name = AuditRollingFile 01:01:04 log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log 01:01:04 log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i 01:01:04 log4j2.appender.audit.append = true 01:01:04 log4j2.appender.audit.layout.type = PatternLayout 01:01:04 log4j2.appender.audit.layout.pattern = ${log4j2.pattern} 01:01:04 log4j2.appender.audit.policies.type = Policies 01:01:04 log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy 01:01:04 log4j2.appender.audit.policies.size.size = 8MB 01:01:04 log4j2.appender.audit.strategy.type = DefaultRolloverStrategy 01:01:04 log4j2.appender.audit.strategy.max = 7 01:01:04 01:01:04 # OSGi appender 01:01:04 log4j2.appender.osgi.type = PaxOsgi 01:01:04 log4j2.appender.osgi.name = PaxOsgi 01:01:04 log4j2.appender.osgi.filter = * 01:01:04 01:01:04 # help with identification of maven-related problems with pax-url-aether 01:01:04 #log4j2.logger.aether.name = shaded.org.eclipse.aether 01:01:04 #log4j2.logger.aether.level = TRACE 01:01:04 #log4j2.logger.http-headers.name = shaded.org.apache.http.headers 01:01:04 #log4j2.logger.http-headers.level = DEBUG 01:01:04 #log4j2.logger.maven.name = org.ops4j.pax.url.mvn 01:01:04 #log4j2.logger.maven.level = TRACE 01:01:04 log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN 01:01:04 log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN 01:01:04 + set_java_vars /usr/lib/jvm/java-21-openjdk-amd64 3072m /tmp/karaf-0.22.2-SNAPSHOT/bin/setenv 01:01:04 + local -r java_home=/usr/lib/jvm/java-21-openjdk-amd64 01:01:04 + local -r controllermem=3072m 01:01:04 Configure 01:01:04 java home: /usr/lib/jvm/java-21-openjdk-amd64 01:01:04 max memory: 3072m 01:01:04 memconf: /tmp/karaf-0.22.2-SNAPSHOT/bin/setenv 01:01:04 + local -r memconf=/tmp/karaf-0.22.2-SNAPSHOT/bin/setenv 01:01:04 + echo Configure 01:01:04 + echo ' java home: /usr/lib/jvm/java-21-openjdk-amd64' 01:01:04 + echo ' max memory: 3072m' 01:01:04 + echo ' memconf: /tmp/karaf-0.22.2-SNAPSHOT/bin/setenv' 01:01:04 + sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64}%g' /tmp/karaf-0.22.2-SNAPSHOT/bin/setenv 01:01:04 + sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.22.2-SNAPSHOT/bin/setenv 01:01:04 cat /tmp/karaf-0.22.2-SNAPSHOT/bin/setenv 01:01:04 + echo 'cat /tmp/karaf-0.22.2-SNAPSHOT/bin/setenv' 01:01:04 + cat /tmp/karaf-0.22.2-SNAPSHOT/bin/setenv 01:01:04 #!/bin/sh 01:01:04 # 01:01:04 # Licensed to the Apache Software Foundation (ASF) under one or more 01:01:04 # contributor license agreements. See the NOTICE file distributed with 01:01:04 # this work for additional information regarding copyright ownership. 01:01:04 # The ASF licenses this file to You under the Apache License, Version 2.0 01:01:04 # (the "License"); you may not use this file except in compliance with 01:01:04 # the License. You may obtain a copy of the License at 01:01:04 # 01:01:04 # http://www.apache.org/licenses/LICENSE-2.0 01:01:04 # 01:01:04 # Unless required by applicable law or agreed to in writing, software 01:01:04 # distributed under the License is distributed on an "AS IS" BASIS, 01:01:04 # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. 01:01:04 # See the License for the specific language governing permissions and 01:01:04 # limitations under the License. 01:01:04 # 01:01:04 01:01:04 # 01:01:04 # handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf 01:01:04 # script: client, instance, shell, start, status, stop, karaf 01:01:04 # 01:01:04 # if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then 01:01:04 # Actions go here... 01:01:04 # fi 01:01:04 01:01:04 # 01:01:04 # general settings which should be applied for all scripts go here; please keep 01:01:04 # in mind that it is possible that scripts might be executed more than once, e.g. 01:01:04 # in example of the start script where the start script is executed first and the 01:01:04 # karaf script afterwards. 01:01:04 # 01:01:04 01:01:04 # 01:01:04 # The following section shows the possible configuration options for the default 01:01:04 # karaf scripts 01:01:04 # 01:01:04 export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64} # Location of Java installation 01:01:04 # export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration 01:01:04 # export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options 01:01:04 # export EXTRA_JAVA_OPTS # Additional JVM options 01:01:04 # export KARAF_HOME # Karaf home folder 01:01:04 # export KARAF_DATA # Karaf data folder 01:01:04 # export KARAF_BASE # Karaf base folder 01:01:04 # export KARAF_ETC # Karaf etc folder 01:01:04 # export KARAF_LOG # Karaf log folder 01:01:04 # export KARAF_SYSTEM_OPTS # First citizen Karaf options 01:01:04 # export KARAF_OPTS # Additional available Karaf options 01:01:04 # export KARAF_DEBUG # Enable debug mode 01:01:04 # export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start 01:01:04 # export KARAF_NOROOT # Prevent execution as root if set to true 01:01:04 Set Java version 01:01:04 + echo 'Set Java version' 01:01:04 + sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-21-openjdk-amd64/bin/java 1 01:01:04 sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper 01:01:04 sudo: a password is required 01:01:04 + sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-21-openjdk-amd64/bin/java 01:01:05 JDK default version ... 01:01:05 sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper 01:01:05 sudo: a password is required 01:01:05 + echo 'JDK default version ...' 01:01:05 + java -version 01:01:05 openjdk version "21.0.9" 2025-10-21 01:01:05 OpenJDK Runtime Environment (build 21.0.9+10-Ubuntu-122.04) 01:01:05 OpenJDK 64-Bit Server VM (build 21.0.9+10-Ubuntu-122.04, mixed mode, sharing) 01:01:05 Set JAVA_HOME 01:01:05 + echo 'Set JAVA_HOME' 01:01:05 + export JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64 01:01:05 + JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64 01:01:05 ++ readlink -e /usr/lib/jvm/java-21-openjdk-amd64/bin/java 01:01:05 Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java 01:01:05 + JAVA_RESOLVED=/usr/lib/jvm/java-21-openjdk-amd64/bin/java 01:01:05 + echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java' 01:01:05 Listing all open ports on controller system... 01:01:05 + echo 'Listing all open ports on controller system...' 01:01:05 + netstat -pnatu 01:01:05 /tmp/configuration-script.sh: line 40: netstat: command not found 01:01:05 Custom shard config exists!!! 01:01:05 Copying the shard config... 01:01:05 + '[' -f /tmp/custom_shard_config.txt ']' 01:01:05 + echo 'Custom shard config exists!!!' 01:01:05 + echo 'Copying the shard config...' 01:01:05 + cp /tmp/custom_shard_config.txt /tmp/karaf-0.22.2-SNAPSHOT/bin/ 01:01:05 Configuring cluster 01:01:05 + echo 'Configuring cluster' 01:01:05 + /tmp/karaf-0.22.2-SNAPSHOT/bin/configure_cluster.sh 1 10.30.171.250 10.30.171.198 10.30.171.173 01:01:05 ################################################ 01:01:05 ## Configure Cluster ## 01:01:05 ################################################ 01:01:05 NOTE: Cluster configuration files not found. Copying from 01:01:05 /tmp/karaf-0.22.2-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/11.0.2 01:01:05 Configuring unique name in pekko.conf 01:01:05 Configuring hostname in pekko.conf 01:01:05 Configuring data and rpc seed nodes in pekko.conf 01:01:05 modules = [ 01:01:05 01:01:05 { 01:01:05 name = "inventory" 01:01:05 namespace = "urn:opendaylight:inventory" 01:01:05 shard-strategy = "module" 01:01:05 }, 01:01:05 { 01:01:05 name = "topology" 01:01:05 namespace = "urn:TBD:params:xml:ns:yang:network-topology" 01:01:05 shard-strategy = "module" 01:01:05 }, 01:01:05 { 01:01:05 name = "toaster" 01:01:05 namespace = "http://netconfcentral.org/ns/toaster" 01:01:05 shard-strategy = "module" 01:01:05 }, 01:01:05 { 01:01:05 name = "car" 01:01:05 namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" 01:01:05 shard-strategy = "module" 01:01:05 }, 01:01:05 { 01:01:05 name = "people" 01:01:05 namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" 01:01:05 shard-strategy = "module" 01:01:05 }, 01:01:05 { 01:01:05 name = "car-people" 01:01:05 namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" 01:01:05 shard-strategy = "module" 01:01:05 } 01:01:05 ] 01:01:05 Configuring replication type in module-shards.conf 01:01:05 ################################################ 01:01:05 ## NOTE: Manually restart controller to ## 01:01:05 ## apply configuration. ## 01:01:05 ################################################ 01:01:05 Dump pekko.conf 01:01:05 + echo 'Dump pekko.conf' 01:01:05 + cat /tmp/karaf-0.22.2-SNAPSHOT/configuration/initial/pekko.conf 01:01:05 01:01:05 odl-cluster-data { 01:01:05 pekko { 01:01:05 remote { 01:01:05 artery { 01:01:05 enabled = on 01:01:05 transport = tcp 01:01:05 canonical.hostname = "10.30.171.250" 01:01:05 canonical.port = 2550 01:01:05 } 01:01:05 } 01:01:05 01:01:05 cluster { 01:01:05 # Using artery. 01:01:05 seed-nodes = ["pekko://opendaylight-cluster-data@10.30.171.250:2550", 01:01:05 "pekko://opendaylight-cluster-data@10.30.171.198:2550", 01:01:05 "pekko://opendaylight-cluster-data@10.30.171.173:2550"] 01:01:05 01:01:05 roles = ["member-1"] 01:01:05 01:01:05 # when under load we might trip a false positive on the failure detector 01:01:05 # failure-detector { 01:01:05 # heartbeat-interval = 4 s 01:01:05 # acceptable-heartbeat-pause = 16s 01:01:05 # } 01:01:05 } 01:01:05 01:01:05 persistence { 01:01:05 # By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by 01:01:05 # modifying the following two properties. The directory location specified may be a relative or absolute path. 01:01:05 # The relative path is always relative to KARAF_HOME. 01:01:05 01:01:05 # snapshot-store.local.dir = "target/snapshots" 01:01:05 01:01:05 # Use lz4 compression for LocalSnapshotStore snapshots 01:01:05 snapshot-store.local.use-lz4-compression = false 01:01:05 # Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB 01:01:05 snapshot-store.local.lz4-blocksize = 256KB 01:01:05 } 01:01:05 disable-default-actor-system-quarantined-event-handling = "false" 01:01:05 } 01:01:05 } 01:01:05 Dump modules.conf 01:01:05 + echo 'Dump modules.conf' 01:01:05 + cat /tmp/karaf-0.22.2-SNAPSHOT/configuration/initial/modules.conf 01:01:05 modules = [ 01:01:05 01:01:05 { 01:01:05 name = "inventory" 01:01:05 namespace = "urn:opendaylight:inventory" 01:01:05 shard-strategy = "module" 01:01:05 }, 01:01:05 { 01:01:05 name = "topology" 01:01:05 namespace = "urn:TBD:params:xml:ns:yang:network-topology" 01:01:05 shard-strategy = "module" 01:01:05 }, 01:01:05 { 01:01:05 name = "toaster" 01:01:05 namespace = "http://netconfcentral.org/ns/toaster" 01:01:05 shard-strategy = "module" 01:01:05 }, 01:01:05 { 01:01:05 name = "car" 01:01:05 namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" 01:01:05 shard-strategy = "module" 01:01:05 }, 01:01:05 { 01:01:05 name = "people" 01:01:05 namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" 01:01:05 shard-strategy = "module" 01:01:05 }, 01:01:05 { 01:01:05 name = "car-people" 01:01:05 namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" 01:01:05 shard-strategy = "module" 01:01:05 } 01:01:05 ] 01:01:05 Dump module-shards.conf 01:01:05 + echo 'Dump module-shards.conf' 01:01:05 + cat /tmp/karaf-0.22.2-SNAPSHOT/configuration/initial/module-shards.conf 01:01:05 module-shards = [ 01:01:05 { 01:01:05 name = "default" 01:01:05 shards = [ 01:01:05 { 01:01:05 name = "default" 01:01:05 replicas = ["member-1", 01:01:05 "member-2", 01:01:05 "member-3"] 01:01:05 } 01:01:05 ] 01:01:05 }, 01:01:05 { 01:01:05 name = "inventory" 01:01:05 shards = [ 01:01:05 { 01:01:05 name="inventory" 01:01:05 replicas = ["member-1", 01:01:05 "member-2", 01:01:05 "member-3"] 01:01:05 } 01:01:05 ] 01:01:05 }, 01:01:05 { 01:01:05 name = "topology" 01:01:05 shards = [ 01:01:05 { 01:01:05 name="topology" 01:01:05 replicas = ["member-1", 01:01:05 "member-2", 01:01:05 "member-3"] 01:01:05 } 01:01:05 ] 01:01:05 }, 01:01:05 { 01:01:05 name = "toaster" 01:01:05 shards = [ 01:01:05 { 01:01:05 name="toaster" 01:01:05 replicas = ["member-1", 01:01:05 "member-2", 01:01:05 "member-3"] 01:01:05 } 01:01:05 ] 01:01:05 }, 01:01:05 { 01:01:05 name = "car" 01:01:05 shards = [ 01:01:05 { 01:01:05 name="car" 01:01:05 replicas = ["member-1", 01:01:05 "member-2", 01:01:05 "member-3"] 01:01:05 } 01:01:05 ] 01:01:05 }, 01:01:05 { 01:01:05 name = "people" 01:01:05 shards = [ 01:01:05 { 01:01:05 name="people" 01:01:05 replicas = ["member-1", 01:01:05 "member-2", 01:01:05 "member-3"] 01:01:05 } 01:01:05 ] 01:01:05 }, 01:01:05 { 01:01:05 name = "car-people" 01:01:05 shards = [ 01:01:05 { 01:01:05 name="car-people" 01:01:05 replicas = ["member-1", 01:01:05 "member-2", 01:01:05 "member-3"] 01:01:05 } 01:01:05 ] 01:01:05 } 01:01:05 ] 01:01:05 Configuring member-2 with IP address 10.30.171.198 01:01:05 Warning: Permanently added '10.30.171.198' (ECDSA) to the list of known hosts. 01:01:05 Warning: Permanently added '10.30.171.198' (ECDSA) to the list of known hosts. 01:01:05 + source /tmp/common-functions.sh karaf-0.22.2-SNAPSHOT titanium 01:01:05 ++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]] 01:01:05 common-functions.sh is being sourced 01:01:05 ++ echo 'common-functions.sh is being sourced' 01:01:05 ++ BUNDLEFOLDER=karaf-0.22.2-SNAPSHOT 01:01:05 ++ DISTROSTREAM=titanium 01:01:05 ++ export MAVENCONF=/tmp/karaf-0.22.2-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg 01:01:05 ++ MAVENCONF=/tmp/karaf-0.22.2-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg 01:01:05 ++ export FEATURESCONF=/tmp/karaf-0.22.2-SNAPSHOT/etc/org.apache.karaf.features.cfg 01:01:05 ++ FEATURESCONF=/tmp/karaf-0.22.2-SNAPSHOT/etc/org.apache.karaf.features.cfg 01:01:05 ++ export CUSTOMPROP=/tmp/karaf-0.22.2-SNAPSHOT/etc/custom.properties 01:01:05 ++ CUSTOMPROP=/tmp/karaf-0.22.2-SNAPSHOT/etc/custom.properties 01:01:05 ++ export LOGCONF=/tmp/karaf-0.22.2-SNAPSHOT/etc/org.ops4j.pax.logging.cfg 01:01:05 ++ LOGCONF=/tmp/karaf-0.22.2-SNAPSHOT/etc/org.ops4j.pax.logging.cfg 01:01:05 ++ export MEMCONF=/tmp/karaf-0.22.2-SNAPSHOT/bin/setenv 01:01:05 ++ MEMCONF=/tmp/karaf-0.22.2-SNAPSHOT/bin/setenv 01:01:05 ++ export CONTROLLERMEM= 01:01:05 ++ CONTROLLERMEM= 01:01:05 ++ case "${DISTROSTREAM}" in 01:01:05 ++ CLUSTER_SYSTEM=pekko 01:01:05 ++ export AKKACONF=/tmp/karaf-0.22.2-SNAPSHOT/configuration/initial/pekko.conf 01:01:05 ++ AKKACONF=/tmp/karaf-0.22.2-SNAPSHOT/configuration/initial/pekko.conf 01:01:05 ++ export MODULESCONF=/tmp/karaf-0.22.2-SNAPSHOT/configuration/initial/modules.conf 01:01:05 ++ MODULESCONF=/tmp/karaf-0.22.2-SNAPSHOT/configuration/initial/modules.conf 01:01:05 ++ export MODULESHARDSCONF=/tmp/karaf-0.22.2-SNAPSHOT/configuration/initial/module-shards.conf 01:01:05 ++ MODULESHARDSCONF=/tmp/karaf-0.22.2-SNAPSHOT/configuration/initial/module-shards.conf 01:01:05 ++ print_common_env 01:01:05 ++ cat 01:01:05 common-functions environment: 01:01:05 MAVENCONF: /tmp/karaf-0.22.2-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg 01:01:05 ACTUALFEATURES: 01:01:05 FEATURESCONF: /tmp/karaf-0.22.2-SNAPSHOT/etc/org.apache.karaf.features.cfg 01:01:05 CUSTOMPROP: /tmp/karaf-0.22.2-SNAPSHOT/etc/custom.properties 01:01:05 LOGCONF: /tmp/karaf-0.22.2-SNAPSHOT/etc/org.ops4j.pax.logging.cfg 01:01:05 MEMCONF: /tmp/karaf-0.22.2-SNAPSHOT/bin/setenv 01:01:05 CONTROLLERMEM: 01:01:05 AKKACONF: /tmp/karaf-0.22.2-SNAPSHOT/configuration/initial/pekko.conf 01:01:05 MODULESCONF: /tmp/karaf-0.22.2-SNAPSHOT/configuration/initial/modules.conf 01:01:05 MODULESHARDSCONF: /tmp/karaf-0.22.2-SNAPSHOT/configuration/initial/module-shards.conf 01:01:05 SUITES: 01:01:05 01:01:05 ++ SSH='ssh -t -t' 01:01:05 ++ extra_services_cntl=' dnsmasq.service httpd.service libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service rabbitmq-server.service ' 01:01:05 ++ extra_services_cmp=' libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service ' 01:01:05 Changing to /tmp 01:01:05 + echo 'Changing to /tmp' 01:01:05 + cd /tmp 01:01:05 Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.22.2-SNAPSHOT/karaf-0.22.2-20260207.175700-491.zip 01:01:05 + echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.22.2-SNAPSHOT/karaf-0.22.2-20260207.175700-491.zip' 01:01:05 + wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.22.2-SNAPSHOT/karaf-0.22.2-20260207.175700-491.zip 01:01:05 --2026-02-08 01:01:05-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.22.2-SNAPSHOT/karaf-0.22.2-20260207.175700-491.zip 01:01:05 Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6 01:01:05 Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected. 01:01:05 HTTP request sent, awaiting response... 200 OK 01:01:05 Length: 234981974 (224M) [application/zip] 01:01:05 Saving to: ‘karaf-0.22.2-20260207.175700-491.zip’ 01:01:05 01:01:05 0K ........ ........ ........ ........ ........ ........ 1% 55.4M 4s 01:01:05 3072K ........ ........ ........ ........ ........ ........ 2% 52.9M 4s 01:01:05 6144K ........ ........ ........ ........ ........ ........ 4% 73.5M 4s 01:01:05 9216K ........ ........ ........ ........ ........ ........ 5% 76.7M 3s 01:01:05 12288K ........ ........ ........ ........ ........ ........ 6% 77.8M 3s 01:01:06 15360K ........ ........ ........ ........ ........ ........ 8% 70.0M 3s 01:01:06 18432K ........ ........ ........ ........ ........ ........ 9% 51.4M 3s 01:01:06 21504K ........ ........ ........ ........ ........ ........ 10% 155M 3s 01:01:06 24576K ........ ........ ........ ........ ........ ........ 12% 187M 3s 01:01:06 27648K ........ ........ ........ ........ ........ ........ 13% 198M 2s 01:01:06 30720K ........ ........ ........ ........ ........ ........ 14% 186M 2s 01:01:06 33792K ........ ........ ........ ........ ........ ........ 16% 250M 2s 01:01:06 36864K ........ ........ ........ ........ ........ ........ 17% 259M 2s 01:01:06 39936K ........ ........ ........ ........ ........ ........ 18% 214M 2s 01:01:06 43008K ........ ........ ........ ........ ........ ........ 20% 245M 2s 01:01:06 46080K ........ ........ ........ ........ ........ ........ 21% 257M 2s 01:01:06 49152K ........ ........ ........ ........ ........ ........ 22% 255M 2s 01:01:06 52224K ........ ........ ........ ........ ........ ........ 24% 272M 2s 01:01:06 55296K ........ ........ ........ ........ ........ ........ 25% 311M 1s 01:01:06 58368K ........ ........ ........ ........ ........ ........ 26% 306M 1s 01:01:06 61440K ........ ........ ........ ........ ........ ........ 28% 264M 1s 01:01:06 64512K ........ ........ ........ ........ ........ ........ 29% 320M 1s 01:01:06 67584K ........ ........ ........ ........ ........ ........ 30% 307M 1s 01:01:06 70656K ........ ........ ........ ........ ........ ........ 32% 300M 1s 01:01:06 73728K ........ ........ ........ ........ ........ ........ 33% 309M 1s 01:01:06 76800K ........ ........ ........ ........ ........ ........ 34% 301M 1s 01:01:06 79872K ........ ........ ........ ........ ........ ........ 36% 238M 1s 01:01:06 82944K ........ ........ ........ ........ ........ ........ 37% 321M 1s 01:01:06 86016K ........ ........ ........ ........ ........ ........ 38% 407M 1s 01:01:06 89088K ........ ........ ........ ........ ........ ........ 40% 303M 1s 01:01:06 92160K ........ ........ ........ ........ ........ ........ 41% 281M 1s 01:01:06 95232K ........ ........ ........ ........ ........ ........ 42% 294M 1s 01:01:06 98304K ........ ........ ........ ........ ........ ........ 44% 300M 1s 01:01:06 101376K ........ ........ ........ ........ ........ ........ 45% 298M 1s 01:01:06 104448K ........ ........ ........ ........ ........ ........ 46% 288M 1s 01:01:06 107520K ........ ........ ........ ........ ........ ........ 48% 289M 1s 01:01:06 110592K ........ ........ ........ ........ ........ ........ 49% 292M 1s 01:01:06 113664K ........ ........ ........ ........ ........ ........ 50% 302M 1s 01:01:06 116736K ........ ........ ........ ........ ........ ........ 52% 293M 1s 01:01:06 119808K ........ ........ ........ ........ ........ ........ 53% 291M 1s 01:01:06 122880K ........ ........ ........ ........ ........ ........ 54% 302M 1s 01:01:06 125952K ........ ........ ........ ........ ........ ........ 56% 305M 1s 01:01:06 129024K ........ ........ ........ ........ ........ ........ 57% 292M 1s 01:01:06 132096K ........ ........ ........ ........ ........ ........ 58% 299M 1s 01:01:06 135168K ........ ........ ........ ........ ........ ........ 60% 296M 0s 01:01:06 138240K ........ ........ ........ ........ ........ ........ 61% 297M 0s 01:01:06 141312K ........ ........ ........ ........ ........ ........ 62% 271M 0s 01:01:06 144384K ........ ........ ........ ........ ........ ........ 64% 292M 0s 01:01:06 147456K ........ ........ ........ ........ ........ ........ 65% 310M 0s 01:01:06 150528K ........ ........ ........ ........ ........ ........ 66% 268M 0s 01:01:06 153600K ........ ........ ........ ........ ........ ........ 68% 354M 0s 01:01:06 156672K ........ ........ ........ ........ ........ ........ 69% 362M 0s 01:01:06 159744K ........ ........ ........ ........ ........ ........ 70% 359M 0s 01:01:06 162816K ........ ........ ........ ........ ........ ........ 72% 364M 0s 01:01:06 165888K ........ ........ ........ ........ ........ ........ 73% 346M 0s 01:01:06 168960K ........ ........ ........ ........ ........ ........ 74% 368M 0s 01:01:06 172032K ........ ........ ........ ........ ........ ........ 76% 355M 0s 01:01:06 175104K ........ ........ ........ ........ ........ ........ 77% 357M 0s 01:01:06 178176K ........ ........ ........ ........ ........ ........ 78% 352M 0s 01:01:06 181248K ........ ........ ........ ........ ........ ........ 80% 347M 0s 01:01:06 184320K ........ ........ ........ ........ ........ ........ 81% 350M 0s 01:01:06 187392K ........ ........ ........ ........ ........ ........ 83% 306M 0s 01:01:06 190464K ........ ........ ........ ........ ........ ........ 84% 228M 0s 01:01:06 193536K ........ ........ ........ ........ ........ ........ 85% 302M 0s 01:01:06 196608K ........ ........ ........ ........ ........ ........ 87% 354M 0s 01:01:06 199680K ........ ........ ........ ........ ........ ........ 88% 362M 0s 01:01:06 202752K ........ ........ ........ ........ ........ ........ 89% 351M 0s 01:01:06 205824K ........ ........ ........ ........ ........ ........ 91% 357M 0s 01:01:06 208896K ........ ........ ........ ........ ........ ........ 92% 353M 0s 01:01:06 211968K ........ ........ ........ ........ ........ ........ 93% 354M 0s 01:01:06 215040K ........ ........ ........ ........ ........ ........ 95% 287M 0s 01:01:06 218112K ........ ........ ........ ........ ........ ........ 96% 345M 0s 01:01:06 221184K ........ ........ ........ ........ ........ ........ 97% 348M 0s 01:01:06 224256K ........ ........ ........ ........ ........ ........ 99% 362M 0s 01:01:06 227328K ........ ........ ........ ........ . 100% 359M=1.0s 01:01:06 01:01:06 2026-02-08 01:01:06 (219 MB/s) - ‘karaf-0.22.2-20260207.175700-491.zip’ saved [234981974/234981974] 01:01:06 01:01:06 Extracting the new controller... 01:01:06 + echo 'Extracting the new controller...' 01:01:06 + unzip -q karaf-0.22.2-20260207.175700-491.zip 01:01:09 Adding external repositories... 01:01:09 + echo 'Adding external repositories...' 01:01:09 ################################################################################ 01:01:09 # 01:01:09 # Licensed to the Apache Software Foundation (ASF) under one or more 01:01:09 # contributor license agreements. See the NOTICE file distributed with 01:01:09 # this work for additional information regarding copyright ownership. 01:01:09 # The ASF licenses this file to You under the Apache License, Version 2.0 01:01:09 # (the "License"); you may not use this file except in compliance with 01:01:09 # the License. You may obtain a copy of the License at 01:01:09 # 01:01:09 # http://www.apache.org/licenses/LICENSE-2.0 01:01:09 # 01:01:09 # Unless required by applicable law or agreed to in writing, software 01:01:09 # distributed under the License is distributed on an "AS IS" BASIS, 01:01:09 # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. 01:01:09 # See the License for the specific language governing permissions and 01:01:09 # limitations under the License. 01:01:09 # 01:01:09 ################################################################################ 01:01:09 01:01:09 # 01:01:09 # If set to true, the following property will not allow any certificate to be used 01:01:09 # when accessing Maven repositories through SSL 01:01:09 # 01:01:09 #org.ops4j.pax.url.mvn.certificateCheck= 01:01:09 01:01:09 # 01:01:09 # Path to the local Maven settings file. 01:01:09 # The repositories defined in this file will be automatically added to the list 01:01:09 # of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property 01:01:09 # below is not set. 01:01:09 # The following locations are checked for the existence of the settings.xml file 01:01:09 # * 1. looks for the specified url 01:01:09 # * 2. if not found looks for ${user.home}/.m2/settings.xml 01:01:09 # * 3. if not found looks for ${maven.home}/conf/settings.xml 01:01:09 # * 4. if not found looks for ${M2_HOME}/conf/settings.xml 01:01:09 # 01:01:09 #org.ops4j.pax.url.mvn.settings= 01:01:09 01:01:09 # 01:01:09 # Path to the local Maven repository which is used to avoid downloading 01:01:09 # artifacts when they already exist locally. 01:01:09 # The value of this property will be extracted from the settings.xml file 01:01:09 # above, or defaulted to: 01:01:09 # System.getProperty( "user.home" ) + "/.m2/repository" 01:01:09 # 01:01:09 org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository} 01:01:09 01:01:09 # 01:01:09 # Default this to false. It's just weird to use undocumented repos 01:01:09 # 01:01:09 org.ops4j.pax.url.mvn.useFallbackRepositories=false 01:01:09 01:01:09 # 01:01:09 # Uncomment if you don't wanna use the proxy settings 01:01:09 # from the Maven conf/settings.xml file 01:01:09 # 01:01:09 # org.ops4j.pax.url.mvn.proxySupport=false 01:01:09 01:01:09 # 01:01:09 # Comma separated list of repositories scanned when resolving an artifact. 01:01:09 # Those repositories will be checked before iterating through the 01:01:09 # below list of repositories and even before the local repository 01:01:09 # A repository url can be appended with zero or more of the following flags: 01:01:09 # @snapshots : the repository contains snaphots 01:01:09 # @noreleases : the repository does not contain any released artifacts 01:01:09 # 01:01:09 # The following property value will add the system folder as a repo. 01:01:09 # 01:01:09 org.ops4j.pax.url.mvn.defaultRepositories=\ 01:01:09 file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\ 01:01:09 file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\ 01:01:09 file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots 01:01:09 01:01:09 # Use the default local repo (e.g.~/.m2/repository) as a "remote" repo 01:01:09 #org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false 01:01:09 01:01:09 # 01:01:09 # Comma separated list of repositories scanned when resolving an artifact. 01:01:09 # The default list includes the following repositories: 01:01:09 # http://repo1.maven.org/maven2@id=central 01:01:09 # http://repository.springsource.com/maven/bundles/release@id=spring.ebr 01:01:09 # http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external 01:01:09 # http://zodiac.springsource.com/maven/bundles/release@id=gemini 01:01:09 # http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases 01:01:09 # https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases 01:01:09 # https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases 01:01:09 # To add repositories to the default ones, prepend '+' to the list of repositories 01:01:09 # to add. 01:01:09 # A repository url can be appended with zero or more of the following flags: 01:01:09 # @snapshots : the repository contains snapshots 01:01:09 # @noreleases : the repository does not contain any released artifacts 01:01:09 # @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended 01:01:09 # 01:01:09 org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases 01:01:09 01:01:09 ### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.Configuring the startup features... 01:01:09 + sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.22.2-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg 01:01:09 + cat /tmp/karaf-0.22.2-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg 01:01:09 + [[ True == \T\r\u\e ]] 01:01:09 + echo 'Configuring the startup features...' 01:01:09 + sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.22.2-SNAPSHOT/etc/org.apache.karaf.features.cfg 01:01:09 + FEATURE_TEST_STRING=features-test 01:01:09 + FEATURE_TEST_VERSION=0.22.2-SNAPSHOT 01:01:09 + KARAF_VERSION=karaf4 01:01:09 + [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]] 01:01:09 + sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.22.2-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.22.2-SNAPSHOT/etc/org.apache.karaf.features.cfg 01:01:09 + [[ ! -z '' ]] 01:01:09 + cat /tmp/karaf-0.22.2-SNAPSHOT/etc/org.apache.karaf.features.cfg 01:01:09 ################################################################################ 01:01:09 # 01:01:09 # Licensed to the Apache Software Foundation (ASF) under one or more 01:01:09 # contributor license agreements. See the NOTICE file distributed with 01:01:09 # this work for additional information regarding copyright ownership. 01:01:09 # The ASF licenses this file to You under the Apache License, Version 2.0 01:01:09 # (the "License"); you may not use this file except in compliance with 01:01:09 # the License. You may obtain a copy of the License at 01:01:09 # 01:01:09 # http://www.apache.org/licenses/LICENSE-2.0 01:01:09 # 01:01:09 # Unless required by applicable law or agreed to in writing, software 01:01:09 # distributed under the License is distributed on an "AS IS" BASIS, 01:01:09 # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. 01:01:09 # See the License for the specific language governing permissions and 01:01:09 # limitations under the License. 01:01:09 # 01:01:09 ################################################################################ 01:01:09 01:01:09 # 01:01:09 # Comma separated list of features repositories to register by default 01:01:09 # 01:01:09 featuresRepositories = mvn:org.opendaylight.integration/features-test/0.22.2-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/4fcf3549-2afc-4ad5-89c2-131fdba22663.xml 01:01:09 01:01:09 # 01:01:09 # Comma separated list of features to install at startup 01:01:09 # 01:01:09 featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, e5e243c7-6090-4d26-9145-e5c40716ec59 01:01:09 01:01:09 # 01:01:09 # Resource repositories (OBR) that the features resolver can use 01:01:09 # to resolve requirements/capabilities 01:01:09 # 01:01:09 # The format of the resourceRepositories is 01:01:09 # resourceRepositories=[xml:url|json:url],... 01:01:09 # for Instance: 01:01:09 # 01:01:09 #resourceRepositories=xml:http://host/path/to/index.xml 01:01:09 # or 01:01:09 #resourceRepositories=json:http://host/path/to/index.json 01:01:09 # 01:01:09 01:01:09 # 01:01:09 # Defines if the boot features are started in asynchronous mode (in a dedicated thread) 01:01:09 # 01:01:09 featuresBootAsynchronous=false 01:01:09 01:01:09 # 01:01:09 # Service requirements enforcement 01:01:09 # 01:01:09 # By default, the feature resolver checks the service requirements/capabilities of 01:01:09 # bundles for new features (xml schema >= 1.3.0) in order to automatically installs 01:01:09 # the required bundles. 01:01:09 # The following flag can have those values: 01:01:09 # - disable: service requirements are completely ignored 01:01:09 # - default: service requirements are ignored for old features 01:01:09 # - enforce: service requirements are always verified 01:01:09 # 01:01:09 #serviceRequirements=default 01:01:09 01:01:09 # 01:01:09 # Store cfg file for config element in feature 01:01:09 # 01:01:09 #configCfgStore=true 01:01:09 01:01:09 # 01:01:09 # Define if the feature service automatically refresh bundles 01:01:09 # 01:01:09 autoRefresh=true 01:01:09 01:01:09 # 01:01:09 # Configuration of features processing mechanism (overrides, blacklisting, modification of features) 01:01:09 # XML file defines instructions related to features processing 01:01:09 # versions.properties may declare properties to resolve placeholders in XML file 01:01:09 # both files are relative to ${karaf.etc} 01:01:09 # 01:01:09 #featureProcessing=org.apache.karaf.features.xml 01:01:09 #featureProcessingVersions=versions.properties 01:01:09 log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n 01:01:09 log4j2.rootLogger.level = INFO 01:01:09 #log4j2.rootLogger.type = asyncRoot 01:01:09 #log4j2.rootLogger.includeLocation = false 01:01:09 log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile 01:01:09 log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi 01:01:09 log4j2.rootLogger.appenderRef.Console.ref = Console 01:01:09 log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter 01:01:09 log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} 01:01:09 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter 01:01:09 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair 01:01:09 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker 01:01:09 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL 01:01:09 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or 01:01:09 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY 01:01:09 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL 01:01:09 log4j2.logger.spifly.name = org.apache.aries.spifly 01:01:09 log4j2.logger.spifly.level = WARN 01:01:09 log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit 01:01:09 log4j2.logger.audit.level = INFO 01:01:09 log4j2.logger.audit.additivity = false 01:01:09 log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile 01:01:09 # Console appender not used by default (see log4j2.rootLogger.appenderRefs) 01:01:09 log4j2.appender.console.type = Console 01:01:09 log4j2.appender.console.name = Console 01:01:09 log4j2.appender.console.layout.type = PatternLayout 01:01:09 log4j2.appender.console.layout.pattern = ${log4j2.pattern} 01:01:09 log4j2.appender.rolling.type = RollingRandomAccessFile 01:01:09 log4j2.appender.rolling.name = RollingFile 01:01:09 log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log 01:01:09 log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i 01:01:09 #log4j2.appender.rolling.immediateFlush = false 01:01:09 log4j2.appender.rolling.append = true 01:01:09 log4j2.appender.rolling.layout.type = PatternLayout 01:01:09 log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} 01:01:09 log4j2.appender.rolling.policies.type = Policies 01:01:09 log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy 01:01:09 log4j2.appender.rolling.policies.size.size = 64MB 01:01:09 log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy 01:01:09 log4j2.appender.rolling.strategy.max = 7 01:01:09 log4j2.appender.audit.type = RollingRandomAccessFile 01:01:09 log4j2.appender.audit.name = AuditRollingFile 01:01:09 log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log 01:01:09 log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i 01:01:09 log4j2.appender.audit.append = true 01:01:09 log4j2.appender.audit.layout.type = PatternLayout 01:01:09 log4j2.appender.audit.layout.pattern = ${log4j2.pattern} 01:01:09 log4j2.appender.audit.policies.type = Policies 01:01:09 log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy 01:01:09 log4j2.appender.audit.policies.size.size = 8MB 01:01:09 log4j2.appender.audit.strategy.type = DefaultRolloverStrategy 01:01:09 log4j2.appender.audit.strategy.max = 7 01:01:09 log4j2.appender.osgi.type = PaxOsgi 01:01:09 log4j2.appender.osgi.name = PaxOsgi 01:01:09 log4j2.appender.osgi.filter = * 01:01:09 #log4j2.logger.aether.name = shaded.org.eclipse.aether 01:01:09 #log4j2.logger.aether.level = TRACE 01:01:09 #log4j2.logger.http-headers.name = shaded.org.apache.http.headers 01:01:09 #log4j2.logger.http-headers.level = DEBUG 01:01:09 #log4j2.logger.maven.name = org.ops4j.pax.url.mvn 01:01:09 #log4j2.logger.maven.level = TRACE 01:01:09 Configuring the karaf log... karaf_version: karaf4, logapi: log4j2 01:01:09 + configure_karaf_log karaf4 '' 01:01:09 + local -r karaf_version=karaf4 01:01:09 + local -r controllerdebugmap= 01:01:09 + local logapi=log4j 01:01:09 + grep log4j2 /tmp/karaf-0.22.2-SNAPSHOT/etc/org.ops4j.pax.logging.cfg 01:01:09 + logapi=log4j2 01:01:09 + echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2' 01:01:09 + '[' log4j2 == log4j2 ']' 01:01:09 + sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.22.2-SNAPSHOT/etc/org.ops4j.pax.logging.cfg 01:01:09 + orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver 01:01:09 + orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver 01:01:09 + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN' 01:01:09 + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN' 01:01:09 + unset IFS 01:01:09 controllerdebugmap: 01:01:09 cat /tmp/karaf-0.22.2-SNAPSHOT/etc/org.ops4j.pax.logging.cfg 01:01:09 ################################################################################ 01:01:09 # 01:01:09 # Licensed to the Apache Software Foundation (ASF) under one or more 01:01:09 # contributor license agreements. See the NOTICE file distributed with 01:01:09 # this work for additional information regarding copyright ownership. 01:01:09 # The ASF licenses this file to You under the Apache License, Version 2.0 01:01:09 # (the "License"); you may not use this file except in compliance with 01:01:09 # the License. You may obtain a copy of the License at 01:01:09 # 01:01:09 # http://www.apache.org/licenses/LICENSE-2.0 01:01:09 # 01:01:09 # Unless required by applicable law or agreed to in writing, software 01:01:09 # distributed under the License is distributed on an "AS IS" BASIS, 01:01:09 # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. 01:01:09 # See the License for the specific language governing permissions and 01:01:09 # limitations under the License. 01:01:09 # 01:01:09 ################################################################################ 01:01:09 01:01:09 # Common pattern layout for appenders 01:01:09 log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n 01:01:09 01:01:09 # Root logger 01:01:09 log4j2.rootLogger.level = INFO 01:01:09 # uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library 01:01:09 #log4j2.rootLogger.type = asyncRoot 01:01:09 #log4j2.rootLogger.includeLocation = false 01:01:09 log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile 01:01:09 log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi 01:01:09 log4j2.rootLogger.appenderRef.Console.ref = Console 01:01:09 log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter 01:01:09 log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} 01:01:09 01:01:09 # Filters for logs marked by org.opendaylight.odlparent.Markers 01:01:09 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter 01:01:09 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair 01:01:09 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker 01:01:09 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL 01:01:09 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or 01:01:09 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY 01:01:09 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL 01:01:09 01:01:09 # Loggers configuration 01:01:09 01:01:09 # Spifly logger 01:01:09 log4j2.logger.spifly.name = org.apache.aries.spifly 01:01:09 log4j2.logger.spifly.level = WARN 01:01:09 01:01:09 # Security audit logger 01:01:09 log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit 01:01:09 log4j2.logger.audit.level = INFO 01:01:09 log4j2.logger.audit.additivity = false 01:01:09 log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile 01:01:09 01:01:09 # Appenders configuration 01:01:09 01:01:09 # Console appender not used by default (see log4j2.rootLogger.appenderRefs) 01:01:09 log4j2.appender.console.type = Console 01:01:09 log4j2.appender.console.name = Console 01:01:09 log4j2.appender.console.layout.type = PatternLayout 01:01:09 log4j2.appender.console.layout.pattern = ${log4j2.pattern} 01:01:09 01:01:09 # Rolling file appender 01:01:09 log4j2.appender.rolling.type = RollingRandomAccessFile 01:01:09 log4j2.appender.rolling.name = RollingFile 01:01:09 log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log 01:01:09 log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i 01:01:09 # uncomment to not force a disk flush 01:01:09 #log4j2.appender.rolling.immediateFlush = false 01:01:09 log4j2.appender.rolling.append = true 01:01:09 log4j2.appender.rolling.layout.type = PatternLayout 01:01:09 log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} 01:01:09 log4j2.appender.rolling.policies.type = Policies 01:01:09 log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy 01:01:09 log4j2.appender.rolling.policies.size.size = 1GB 01:01:09 log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy 01:01:09 log4j2.appender.rolling.strategy.max = 7 01:01:09 01:01:09 # Audit file appender 01:01:09 log4j2.appender.audit.type = RollingRandomAccessFile 01:01:09 log4j2.appender.audit.name = AuditRollingFile 01:01:09 log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log 01:01:09 log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i 01:01:09 log4j2.appender.audit.append = true 01:01:09 log4j2.appender.audit.layout.type = PatternLayout 01:01:09 log4j2.appender.audit.layout.pattern = ${log4j2.pattern} 01:01:09 log4j2.appender.audit.policies.type = Policies 01:01:09 log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy 01:01:09 log4j2.appender.audit.policies.size.size = 8MB 01:01:09 log4j2.appender.audit.strategy.type = DefaultRolloverStrategy 01:01:09 log4j2.appender.audit.strategy.max = 7 01:01:09 01:01:09 # OSGi appender 01:01:09 log4j2.appender.osgi.type = PaxOsgi 01:01:09 log4j2.appender.osgi.name = PaxOsgi 01:01:09 log4j2.appender.osgi.filter = * 01:01:09 01:01:09 # help with identification of maven-related problems with pax-url-aether 01:01:09 #log4j2.logger.aether.name = shaded.org.eclipse.aether 01:01:09 #log4j2.logger.aether.level = TRACE 01:01:09 #log4j2.logger.http-headers.name = shaded.org.apache.http.headers 01:01:09 #log4j2.logger.http-headers.level = DEBUG 01:01:09 #log4j2.logger.maven.name = org.ops4j.pax.url.mvn 01:01:09 #log4j2.logger.maven.level = TRACE 01:01:09 log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN 01:01:09 log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN 01:01:09 Configure 01:01:09 java home: /usr/lib/jvm/java-21-openjdk-amd64 01:01:09 max memory: 3072m 01:01:09 memconf: /tmp/karaf-0.22.2-SNAPSHOT/bin/setenv 01:01:09 cat /tmp/karaf-0.22.2-SNAPSHOT/bin/setenv 01:01:09 + echo 'controllerdebugmap: ' 01:01:09 + '[' -n '' ']' 01:01:09 + echo 'cat /tmp/karaf-0.22.2-SNAPSHOT/etc/org.ops4j.pax.logging.cfg' 01:01:09 + cat /tmp/karaf-0.22.2-SNAPSHOT/etc/org.ops4j.pax.logging.cfg 01:01:09 + set_java_vars /usr/lib/jvm/java-21-openjdk-amd64 3072m /tmp/karaf-0.22.2-SNAPSHOT/bin/setenv 01:01:09 + local -r java_home=/usr/lib/jvm/java-21-openjdk-amd64 01:01:09 + local -r controllermem=3072m 01:01:09 + local -r memconf=/tmp/karaf-0.22.2-SNAPSHOT/bin/setenv 01:01:09 + echo Configure 01:01:09 + echo ' java home: /usr/lib/jvm/java-21-openjdk-amd64' 01:01:09 + echo ' max memory: 3072m' 01:01:09 + echo ' memconf: /tmp/karaf-0.22.2-SNAPSHOT/bin/setenv' 01:01:09 + sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64}%g' /tmp/karaf-0.22.2-SNAPSHOT/bin/setenv 01:01:09 + sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.22.2-SNAPSHOT/bin/setenv 01:01:09 + echo 'cat /tmp/karaf-0.22.2-SNAPSHOT/bin/setenv' 01:01:09 + cat /tmp/karaf-0.22.2-SNAPSHOT/bin/setenv 01:01:09 #!/bin/sh 01:01:09 # 01:01:09 # Licensed to the Apache Software Foundation (ASF) under one or more 01:01:09 # contributor license agreements. See the NOTICE file distributed with 01:01:09 # this work for additional information regarding copyright ownership. 01:01:09 # The ASF licenses this file to You under the Apache License, Version 2.0 01:01:09 # (the "License"); you may not use this file except in compliance with 01:01:09 # the License. You may obtain a copy of the License at 01:01:09 # 01:01:09 # http://www.apache.org/licenses/LICENSE-2.0 01:01:09 # 01:01:09 # Unless required by applicable law or agreed to in writing, software 01:01:09 # distributed under the License is distributed on an "AS IS" BASIS, 01:01:09 # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. 01:01:09 # See the License for the specific language governing permissions and 01:01:09 # limitations under the License. 01:01:09 # 01:01:09 01:01:09 # 01:01:09 # handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf 01:01:09 # script: client, instance, shell, start, status, stop, karaf 01:01:09 # 01:01:09 # if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then 01:01:09 # Actions go here... 01:01:09 # fi 01:01:09 01:01:09 # 01:01:09 # general settings which should be applied for all scripts go here; please keep 01:01:09 # in mind that it is possible that scripts might be executed more than once, e.g. 01:01:09 # in example of the start script where the start script is executed first and the 01:01:09 # karaf script afterwards. 01:01:09 # 01:01:09 01:01:09 # 01:01:09 # The following section shows the possible configuration options for the default 01:01:09 # karaf scripts 01:01:09 # 01:01:09 export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64} # Location of Java installation 01:01:09 # export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration 01:01:09 # export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options 01:01:09 # export EXTRA_JAVA_OPTS # Additional JVM options 01:01:09 # export KARAF_HOME # Karaf home folder 01:01:09 # export KARAF_DATA # Karaf data folder 01:01:09 # export KARAF_BASE # Karaf base folder 01:01:09 # export KARAF_ETC # Karaf etc folder 01:01:09 # export KARAF_LOG # Karaf log folder 01:01:09 # export KARAF_SYSTEM_OPTS # First citizen Karaf options 01:01:09 # export KARAF_OPTS # Additional available Karaf options 01:01:09 # export KARAF_DEBUG # Enable debug mode 01:01:09 # export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start 01:01:09 # export KARAF_NOROOT # Prevent execution as root if set to true 01:01:09 Set Java version 01:01:09 + echo 'Set Java version' 01:01:09 + sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-21-openjdk-amd64/bin/java 1 01:01:09 sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper 01:01:09 sudo: a password is required 01:01:09 + sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-21-openjdk-amd64/bin/java 01:01:09 sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper 01:01:09 sudo: a password is required 01:01:09 JDK default version ... 01:01:09 + echo 'JDK default version ...' 01:01:09 + java -version 01:01:10 openjdk version "21.0.9" 2025-10-21 01:01:10 OpenJDK Runtime Environment (build 21.0.9+10-Ubuntu-122.04) 01:01:10 OpenJDK 64-Bit Server VM (build 21.0.9+10-Ubuntu-122.04, mixed mode, sharing) 01:01:10 Set JAVA_HOME 01:01:10 + echo 'Set JAVA_HOME' 01:01:10 + export JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64 01:01:10 + JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64 01:01:10 ++ readlink -e /usr/lib/jvm/java-21-openjdk-amd64/bin/java 01:01:10 Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java 01:01:10 + JAVA_RESOLVED=/usr/lib/jvm/java-21-openjdk-amd64/bin/java 01:01:10 + echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java' 01:01:10 Listing all open ports on controller system... 01:01:10 + echo 'Listing all open ports on controller system...' 01:01:10 + netstat -pnatu 01:01:10 /tmp/configuration-script.sh: line 40: netstat: command not found 01:01:10 Custom shard config exists!!! 01:01:10 Copying the shard config... 01:01:10 + '[' -f /tmp/custom_shard_config.txt ']' 01:01:10 + echo 'Custom shard config exists!!!' 01:01:10 + echo 'Copying the shard config...' 01:01:10 + cp /tmp/custom_shard_config.txt /tmp/karaf-0.22.2-SNAPSHOT/bin/ 01:01:10 Configuring cluster 01:01:10 + echo 'Configuring cluster' 01:01:10 + /tmp/karaf-0.22.2-SNAPSHOT/bin/configure_cluster.sh 2 10.30.171.250 10.30.171.198 10.30.171.173 01:01:10 ################################################ 01:01:10 ## Configure Cluster ## 01:01:10 ################################################ 01:01:10 NOTE: Cluster configuration files not found. Copying from 01:01:10 /tmp/karaf-0.22.2-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/11.0.2 01:01:10 Configuring unique name in pekko.conf 01:01:10 Configuring hostname in pekko.conf 01:01:10 Configuring data and rpc seed nodes in pekko.conf 01:01:10 modules = [ 01:01:10 01:01:10 { 01:01:10 name = "inventory" 01:01:10 namespace = "urn:opendaylight:inventory" 01:01:10 shard-strategy = "module" 01:01:10 }, 01:01:10 { 01:01:10 name = "topology" 01:01:10 namespace = "urn:TBD:params:xml:ns:yang:network-topology" 01:01:10 shard-strategy = "module" 01:01:10 }, 01:01:10 { 01:01:10 name = "toaster" 01:01:10 namespace = "http://netconfcentral.org/ns/toaster" 01:01:10 shard-strategy = "module" 01:01:10 }, 01:01:10 { 01:01:10 name = "car" 01:01:10 namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" 01:01:10 shard-strategy = "module" 01:01:10 }, 01:01:10 { 01:01:10 name = "people" 01:01:10 namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" 01:01:10 shard-strategy = "module" 01:01:10 }, 01:01:10 { 01:01:10 name = "car-people" 01:01:10 namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" 01:01:10 shard-strategy = "module" 01:01:10 } 01:01:10 ] 01:01:10 Configuring replication type in module-shards.conf 01:01:10 ################################################ 01:01:10 ## NOTE: Manually restart controller to ## 01:01:10 ## apply configuration. ## 01:01:10 ################################################ 01:01:10 Dump pekko.conf 01:01:10 + echo 'Dump pekko.conf' 01:01:10 + cat /tmp/karaf-0.22.2-SNAPSHOT/configuration/initial/pekko.conf 01:01:10 01:01:10 odl-cluster-data { 01:01:10 pekko { 01:01:10 remote { 01:01:10 artery { 01:01:10 enabled = on 01:01:10 transport = tcp 01:01:10 canonical.hostname = "10.30.171.198" 01:01:10 canonical.port = 2550 01:01:10 } 01:01:10 } 01:01:10 01:01:10 cluster { 01:01:10 # Using artery. 01:01:10 seed-nodes = ["pekko://opendaylight-cluster-data@10.30.171.250:2550", 01:01:10 "pekko://opendaylight-cluster-data@10.30.171.198:2550", 01:01:10 "pekko://opendaylight-cluster-data@10.30.171.173:2550"] 01:01:10 01:01:10 roles = ["member-2"] 01:01:10 01:01:10 # when under load we might trip a false positive on the failure detector 01:01:10 # failure-detector { 01:01:10 # heartbeat-interval = 4 s 01:01:10 # acceptable-heartbeat-pause = 16s 01:01:10 # } 01:01:10 } 01:01:10 01:01:10 persistence { 01:01:10 # By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by 01:01:10 # modifying the following two properties. The directory location specified may be a relative or absolute path. 01:01:10 # The relative path is always relative to KARAF_HOME. 01:01:10 01:01:10 # snapshot-store.local.dir = "target/snapshots" 01:01:10 01:01:10 # Use lz4 compression for LocalSnapshotStore snapshots 01:01:10 snapshot-store.local.use-lz4-compression = false 01:01:10 # Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB 01:01:10 snapshot-store.local.lz4-blocksize = 256KB 01:01:10 } 01:01:10 disable-default-actor-system-quarantined-event-handling = "false" 01:01:10 } 01:01:10 } 01:01:10 Dump modules.conf 01:01:10 + echo 'Dump modules.conf' 01:01:10 + cat /tmp/karaf-0.22.2-SNAPSHOT/configuration/initial/modules.conf 01:01:10 modules = [ 01:01:10 01:01:10 { 01:01:10 name = "inventory" 01:01:10 namespace = "urn:opendaylight:inventory" 01:01:10 shard-strategy = "module" 01:01:10 }, 01:01:10 { 01:01:10 name = "topology" 01:01:10 namespace = "urn:TBD:params:xml:ns:yang:network-topology" 01:01:10 shard-strategy = "module" 01:01:10 }, 01:01:10 { 01:01:10 name = "toaster" 01:01:10 namespace = "http://netconfcentral.org/ns/toaster" 01:01:10 shard-strategy = "module" 01:01:10 }, 01:01:10 { 01:01:10 name = "car" 01:01:10 namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" 01:01:10 shard-strategy = "module" 01:01:10 }, 01:01:10 { 01:01:10 name = "people" 01:01:10 namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" 01:01:10 shard-strategy = "module" 01:01:10 }, 01:01:10 { 01:01:10 name = "car-people" 01:01:10 namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" 01:01:10 shard-strategy = "module" 01:01:10 } 01:01:10 ] 01:01:10 Dump module-shards.conf 01:01:10 + echo 'Dump module-shards.conf' 01:01:10 + cat /tmp/karaf-0.22.2-SNAPSHOT/configuration/initial/module-shards.conf 01:01:10 module-shards = [ 01:01:10 { 01:01:10 name = "default" 01:01:10 shards = [ 01:01:10 { 01:01:10 name = "default" 01:01:10 replicas = ["member-1", 01:01:10 "member-2", 01:01:10 "member-3"] 01:01:10 } 01:01:10 ] 01:01:10 }, 01:01:10 { 01:01:10 name = "inventory" 01:01:10 shards = [ 01:01:10 { 01:01:10 name="inventory" 01:01:10 replicas = ["member-1", 01:01:10 "member-2", 01:01:10 "member-3"] 01:01:10 } 01:01:10 ] 01:01:10 }, 01:01:10 { 01:01:10 name = "topology" 01:01:10 shards = [ 01:01:10 { 01:01:10 name="topology" 01:01:10 replicas = ["member-1", 01:01:10 "member-2", 01:01:10 "member-3"] 01:01:10 } 01:01:10 ] 01:01:10 }, 01:01:10 { 01:01:10 name = "toaster" 01:01:10 shards = [ 01:01:10 { 01:01:10 name="toaster" 01:01:10 replicas = ["member-1", 01:01:10 "member-2", 01:01:10 "member-3"] 01:01:10 } 01:01:10 ] 01:01:10 }, 01:01:10 { 01:01:10 name = "car" 01:01:10 shards = [ 01:01:10 { 01:01:10 name="car" 01:01:10 replicas = ["member-1", 01:01:10 "member-2", 01:01:10 "member-3"] 01:01:10 } 01:01:10 ] 01:01:10 }, 01:01:10 { 01:01:10 name = "people" 01:01:10 shards = [ 01:01:10 { 01:01:10 name="people" 01:01:10 replicas = ["member-1", 01:01:10 "member-2", 01:01:10 "member-3"] 01:01:10 } 01:01:10 ] 01:01:10 }, 01:01:10 { 01:01:10 name = "car-people" 01:01:10 shards = [ 01:01:10 { 01:01:10 name="car-people" 01:01:10 replicas = ["member-1", 01:01:10 "member-2", 01:01:10 "member-3"] 01:01:10 } 01:01:10 ] 01:01:10 } 01:01:10 ] 01:01:10 Configuring member-3 with IP address 10.30.171.173 01:01:10 Warning: Permanently added '10.30.171.173' (ECDSA) to the list of known hosts. 01:01:10 Warning: Permanently added '10.30.171.173' (ECDSA) to the list of known hosts. 01:01:10 + source /tmp/common-functions.sh karaf-0.22.2-SNAPSHOT titanium 01:01:10 ++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]] 01:01:10 common-functions.sh is being sourced 01:01:10 ++ echo 'common-functions.sh is being sourced' 01:01:10 ++ BUNDLEFOLDER=karaf-0.22.2-SNAPSHOT 01:01:10 ++ DISTROSTREAM=titanium 01:01:10 ++ export MAVENCONF=/tmp/karaf-0.22.2-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg 01:01:10 ++ MAVENCONF=/tmp/karaf-0.22.2-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg 01:01:10 ++ export FEATURESCONF=/tmp/karaf-0.22.2-SNAPSHOT/etc/org.apache.karaf.features.cfg 01:01:10 ++ FEATURESCONF=/tmp/karaf-0.22.2-SNAPSHOT/etc/org.apache.karaf.features.cfg 01:01:10 ++ export CUSTOMPROP=/tmp/karaf-0.22.2-SNAPSHOT/etc/custom.properties 01:01:10 ++ CUSTOMPROP=/tmp/karaf-0.22.2-SNAPSHOT/etc/custom.properties 01:01:10 ++ export LOGCONF=/tmp/karaf-0.22.2-SNAPSHOT/etc/org.ops4j.pax.logging.cfg 01:01:10 ++ LOGCONF=/tmp/karaf-0.22.2-SNAPSHOT/etc/org.ops4j.pax.logging.cfg 01:01:10 ++ export MEMCONF=/tmp/karaf-0.22.2-SNAPSHOT/bin/setenv 01:01:10 ++ MEMCONF=/tmp/karaf-0.22.2-SNAPSHOT/bin/setenv 01:01:10 ++ export CONTROLLERMEM= 01:01:10 ++ CONTROLLERMEM= 01:01:10 ++ case "${DISTROSTREAM}" in 01:01:10 ++ CLUSTER_SYSTEM=pekko 01:01:10 ++ export AKKACONF=/tmp/karaf-0.22.2-SNAPSHOT/configuration/initial/pekko.conf 01:01:10 ++ AKKACONF=/tmp/karaf-0.22.2-SNAPSHOT/configuration/initial/pekko.conf 01:01:10 ++ export MODULESCONF=/tmp/karaf-0.22.2-SNAPSHOT/configuration/initial/modules.conf 01:01:10 ++ MODULESCONF=/tmp/karaf-0.22.2-SNAPSHOT/configuration/initial/modules.conf 01:01:10 ++ export MODULESHARDSCONF=/tmp/karaf-0.22.2-SNAPSHOT/configuration/initial/module-shards.conf 01:01:10 ++ MODULESHARDSCONF=/tmp/karaf-0.22.2-SNAPSHOT/configuration/initial/module-shards.conf 01:01:10 ++ print_common_env 01:01:10 ++ cat 01:01:10 common-functions environment: 01:01:10 MAVENCONF: /tmp/karaf-0.22.2-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg 01:01:10 ACTUALFEATURES: 01:01:10 FEATURESCONF: /tmp/karaf-0.22.2-SNAPSHOT/etc/org.apache.karaf.features.cfg 01:01:10 CUSTOMPROP: /tmp/karaf-0.22.2-SNAPSHOT/etc/custom.properties 01:01:10 LOGCONF: /tmp/karaf-0.22.2-SNAPSHOT/etc/org.ops4j.pax.logging.cfg 01:01:10 MEMCONF: /tmp/karaf-0.22.2-SNAPSHOT/bin/setenv 01:01:10 CONTROLLERMEM: 01:01:10 AKKACONF: /tmp/karaf-0.22.2-SNAPSHOT/configuration/initial/pekko.conf 01:01:10 MODULESCONF: /tmp/karaf-0.22.2-SNAPSHOT/configuration/initial/modules.conf 01:01:10 MODULESHARDSCONF: /tmp/karaf-0.22.2-SNAPSHOT/configuration/initial/module-shards.conf 01:01:10 SUITES: 01:01:10 01:01:10 ++ SSH='ssh -t -t' 01:01:10 ++ extra_services_cntl=' dnsmasq.service httpd.service libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service rabbitmq-server.service ' 01:01:10 ++ extra_services_cmp=' libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service ' 01:01:10 Changing to /tmp 01:01:10 Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.22.2-SNAPSHOT/karaf-0.22.2-20260207.175700-491.zip 01:01:10 + echo 'Changing to /tmp' 01:01:10 + cd /tmp 01:01:10 + echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.22.2-SNAPSHOT/karaf-0.22.2-20260207.175700-491.zip' 01:01:10 + wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.22.2-SNAPSHOT/karaf-0.22.2-20260207.175700-491.zip 01:01:10 --2026-02-08 01:01:10-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.22.2-SNAPSHOT/karaf-0.22.2-20260207.175700-491.zip 01:01:10 Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6 01:01:10 Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected. 01:01:10 HTTP request sent, awaiting response... 200 OK 01:01:10 Length: 234981974 (224M) [application/zip] 01:01:10 Saving to: ‘karaf-0.22.2-20260207.175700-491.zip’ 01:01:10 01:01:10 0K ........ ........ ........ ........ ........ ........ 1% 63.0M 4s 01:01:10 3072K ........ ........ ........ ........ ........ ........ 2% 124M 3s 01:01:10 6144K ........ ........ ........ ........ ........ ........ 4% 140M 2s 01:01:10 9216K ........ ........ ........ ........ ........ ........ 5% 128M 2s 01:01:10 12288K ........ ........ ........ ........ ........ ........ 6% 191M 2s 01:01:10 15360K ........ ........ ........ ........ ........ ........ 8% 200M 2s 01:01:10 18432K ........ ........ ........ ........ ........ ........ 9% 238M 2s 01:01:10 21504K ........ ........ ........ ........ ........ ........ 10% 183M 1s 01:01:10 24576K ........ ........ ........ ........ ........ ........ 12% 237M 1s 01:01:10 27648K ........ ........ ........ ........ ........ ........ 13% 260M 1s 01:01:10 30720K ........ ........ ........ ........ ........ ........ 14% 242M 1s 01:01:10 33792K ........ ........ ........ ........ ........ ........ 16% 284M 1s 01:01:10 36864K ........ ........ ........ ........ ........ ........ 17% 296M 1s 01:01:10 39936K ........ ........ ........ ........ ........ ........ 18% 311M 1s 01:01:10 43008K ........ ........ ........ ........ ........ ........ 20% 319M 1s 01:01:10 46080K ........ ........ ........ ........ ........ ........ 21% 319M 1s 01:01:10 49152K ........ ........ ........ ........ ........ ........ 22% 350M 1s 01:01:10 52224K ........ ........ ........ ........ ........ ........ 24% 331M 1s 01:01:10 55296K ........ ........ ........ ........ ........ ........ 25% 310M 1s 01:01:11 58368K ........ ........ ........ ........ ........ ........ 26% 362M 1s 01:01:11 61440K ........ ........ ........ ........ ........ ........ 28% 363M 1s 01:01:11 64512K ........ ........ ........ ........ ........ ........ 29% 317M 1s 01:01:11 67584K ........ ........ ........ ........ ........ ........ 30% 324M 1s 01:01:11 70656K ........ ........ ........ ........ ........ ........ 32% 367M 1s 01:01:11 73728K ........ ........ ........ ........ ........ ........ 33% 340M 1s 01:01:11 76800K ........ ........ ........ ........ ........ ........ 34% 242M 1s 01:01:11 79872K ........ ........ ........ ........ ........ ........ 36% 501M 1s 01:01:11 82944K ........ ........ ........ ........ ........ ........ 37% 345M 1s 01:01:11 86016K ........ ........ ........ ........ ........ ........ 38% 262M 1s 01:01:11 89088K ........ ........ ........ ........ ........ ........ 40% 369M 1s 01:01:11 92160K ........ ........ ........ ........ ........ ........ 41% 380M 1s 01:01:11 95232K ........ ........ ........ ........ ........ ........ 42% 237M 1s 01:01:11 98304K ........ ........ ........ ........ ........ ........ 44% 495M 1s 01:01:11 101376K ........ ........ ........ ........ ........ ........ 45% 359M 1s 01:01:11 104448K ........ ........ ........ ........ ........ ........ 46% 321M 0s 01:01:11 107520K ........ ........ ........ ........ ........ ........ 48% 326M 0s 01:01:11 110592K ........ ........ ........ ........ ........ ........ 49% 313M 0s 01:01:11 113664K ........ ........ ........ ........ ........ ........ 50% 322M 0s 01:01:11 116736K ........ ........ ........ ........ ........ ........ 52% 321M 0s 01:01:11 119808K ........ ........ ........ ........ ........ ........ 53% 310M 0s 01:01:11 122880K ........ ........ ........ ........ ........ ........ 54% 307M 0s 01:01:11 125952K ........ ........ ........ ........ ........ ........ 56% 315M 0s 01:01:11 129024K ........ ........ ........ ........ ........ ........ 57% 324M 0s 01:01:11 132096K ........ ........ ........ ........ ........ ........ 58% 317M 0s 01:01:11 135168K ........ ........ ........ ........ ........ ........ 60% 315M 0s 01:01:11 138240K ........ ........ ........ ........ ........ ........ 61% 323M 0s 01:01:11 141312K ........ ........ ........ ........ ........ ........ 62% 308M 0s 01:01:11 144384K ........ ........ ........ ........ ........ ........ 64% 316M 0s 01:01:11 147456K ........ ........ ........ ........ ........ ........ 65% 317M 0s 01:01:11 150528K ........ ........ ........ ........ ........ ........ 66% 312M 0s 01:01:11 153600K ........ ........ ........ ........ ........ ........ 68% 324M 0s 01:01:11 156672K ........ ........ ........ ........ ........ ........ 69% 322M 0s 01:01:11 159744K ........ ........ ........ ........ ........ ........ 70% 315M 0s 01:01:11 162816K ........ ........ ........ ........ ........ ........ 72% 310M 0s 01:01:11 165888K ........ ........ ........ ........ ........ ........ 73% 317M 0s 01:01:11 168960K ........ ........ ........ ........ ........ ........ 74% 318M 0s 01:01:11 172032K ........ ........ ........ ........ ........ ........ 76% 319M 0s 01:01:11 175104K ........ ........ ........ ........ ........ ........ 77% 316M 0s 01:01:11 178176K ........ ........ ........ ........ ........ ........ 78% 318M 0s 01:01:11 181248K ........ ........ ........ ........ ........ ........ 80% 317M 0s 01:01:11 184320K ........ ........ ........ ........ ........ ........ 81% 325M 0s 01:01:11 187392K ........ ........ ........ ........ ........ ........ 83% 316M 0s 01:01:11 190464K ........ ........ ........ ........ ........ ........ 84% 302M 0s 01:01:11 193536K ........ ........ ........ ........ ........ ........ 85% 266M 0s 01:01:11 196608K ........ ........ ........ ........ ........ ........ 87% 233M 0s 01:01:11 199680K ........ ........ ........ ........ ........ ........ 88% 260M 0s 01:01:11 202752K ........ ........ ........ ........ ........ ........ 89% 309M 0s 01:01:11 205824K ........ ........ ........ ........ ........ ........ 91% 316M 0s 01:01:11 208896K ........ ........ ........ ........ ........ ........ 92% 252M 0s 01:01:11 211968K ........ ........ ........ ........ ........ ........ 93% 155M 0s 01:01:11 215040K ........ ........ ........ ........ ........ ........ 95% 257M 0s 01:01:11 218112K ........ ........ ........ ........ ........ ........ 96% 300M 0s 01:01:11 221184K ........ ........ ........ ........ ........ ........ 97% 322M 0s 01:01:11 224256K ........ ........ ........ ........ ........ ........ 99% 316M 0s 01:01:11 227328K ........ ........ ........ ........ . 100% 309M=0.8s 01:01:11 01:01:11 2026-02-08 01:01:11 (269 MB/s) - ‘karaf-0.22.2-20260207.175700-491.zip’ saved [234981974/234981974] 01:01:11 01:01:11 Extracting the new controller... 01:01:11 + echo 'Extracting the new controller...' 01:01:11 + unzip -q karaf-0.22.2-20260207.175700-491.zip 01:01:13 Adding external repositories... 01:01:13 + echo 'Adding external repositories...' 01:01:13 + sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.22.2-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg 01:01:13 + cat /tmp/karaf-0.22.2-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg 01:01:13 ################################################################################ 01:01:13 # 01:01:13 # Licensed to the Apache Software Foundation (ASF) under one or more 01:01:13 # contributor license agreements. See the NOTICE file distributed with 01:01:13 # this work for additional information regarding copyright ownership. 01:01:13 # The ASF licenses this file to You under the Apache License, Version 2.0 01:01:13 # (the "License"); you may not use this file except in compliance with 01:01:13 # the License. You may obtain a copy of the License at 01:01:13 # 01:01:13 # http://www.apache.org/licenses/LICENSE-2.0 01:01:13 # 01:01:13 # Unless required by applicable law or agreed to in writing, software 01:01:13 # distributed under the License is distributed on an "AS IS" BASIS, 01:01:13 # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. 01:01:13 # See the License for the specific language governing permissions and 01:01:13 # limitations under the License. 01:01:13 # 01:01:13 ################################################################################ 01:01:13 01:01:13 # 01:01:13 # If set to true, the following property will not allow any certificate to be used 01:01:13 # when accessing Maven repositories through SSL 01:01:13 # 01:01:13 #org.ops4j.pax.url.mvn.certificateCheck= 01:01:13 01:01:13 # 01:01:13 # Path to the local Maven settings file. 01:01:13 # The repositories defined in this file will be automatically added to the list 01:01:13 # of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property 01:01:13 # below is not set. 01:01:13 # The following locations are checked for the existence of the settings.xml file 01:01:13 # * 1. looks for the specified url 01:01:13 # * 2. if not found looks for ${user.home}/.m2/settings.xml 01:01:13 # * 3. if not found looks for ${maven.home}/conf/settings.xml 01:01:13 # * 4. if not found looks for ${M2_HOME}/conf/settings.xml 01:01:13 # 01:01:13 #org.ops4j.pax.url.mvn.settings= 01:01:13 01:01:13 # 01:01:13 # Path to the local Maven repository which is used to avoid downloading 01:01:13 # artifacts when they already exist locally. 01:01:13 # The value of this property will be extracted from the settings.xml file 01:01:13 # above, or defaulted to: 01:01:13 # System.getProperty( "user.home" ) + "/.m2/repository" 01:01:13 # 01:01:13 org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository} 01:01:13 01:01:13 # 01:01:13 # Default this to false. It's just weird to use undocumented repos 01:01:13 # 01:01:13 org.ops4j.pax.url.mvn.useFallbackRepositories=false 01:01:13 01:01:13 # 01:01:13 # Uncomment if you don't wanna use the proxy settings 01:01:13 # from the Maven conf/settings.xml file 01:01:13 # 01:01:13 # org.ops4j.pax.url.mvn.proxySupport=false 01:01:13 01:01:13 # 01:01:13 # Comma separated list of repositories scanned when resolving an artifact. 01:01:13 # Those repositories will be checked before iterating through the 01:01:13 # below list of repositories and even before the local repository 01:01:13 # A repository url can be appended with zero or more of the following flags: 01:01:13 # @snapshots : the repository contains snaphots 01:01:13 # @noreleases : the repository does not contain any released artifacts 01:01:13 # 01:01:13 # The following property value will add the system folder as a repo. 01:01:13 # 01:01:13 org.ops4j.pax.url.mvn.defaultRepositories=\ 01:01:13 file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\ 01:01:13 file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\ 01:01:13 file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots 01:01:13 01:01:13 # Use the default local repo (e.g.~/.m2/repository) as a "remote" repo 01:01:13 #org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false 01:01:13 01:01:13 # 01:01:13 # Comma separated list of repositories scanned when resolving an artifact. 01:01:13 # The default list includes the following repositories: 01:01:13 # http://repo1.maven.org/maven2@id=central 01:01:13 # http://repository.springsource.com/maven/bundles/release@id=spring.ebr 01:01:13 # http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external 01:01:13 # http://zodiac.springsource.com/maven/bundles/release@id=gemini 01:01:13 # http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases 01:01:13 # https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases 01:01:13 # https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases 01:01:13 # To add repositories to the default ones, prepend '+' to the list of repositories 01:01:13 # to add. 01:01:13 # A repository url can be appended with zero or more of the following flags: 01:01:13 # @snapshots : the repository contains snapshots 01:01:13 # @noreleases : the repository does not contain any released artifacts 01:01:13 # @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended 01:01:13 # 01:01:13 org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases 01:01:13 01:01:13 ### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.Configuring the startup features... 01:01:13 + [[ True == \T\r\u\e ]] 01:01:13 + echo 'Configuring the startup features...' 01:01:13 + sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.22.2-SNAPSHOT/etc/org.apache.karaf.features.cfg 01:01:13 + FEATURE_TEST_STRING=features-test 01:01:13 + FEATURE_TEST_VERSION=0.22.2-SNAPSHOT 01:01:13 + KARAF_VERSION=karaf4 01:01:13 + [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]] 01:01:13 + sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.22.2-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.22.2-SNAPSHOT/etc/org.apache.karaf.features.cfg 01:01:13 + [[ ! -z '' ]] 01:01:13 + cat /tmp/karaf-0.22.2-SNAPSHOT/etc/org.apache.karaf.features.cfg 01:01:13 ################################################################################ 01:01:13 # 01:01:13 # Licensed to the Apache Software Foundation (ASF) under one or more 01:01:13 # contributor license agreements. See the NOTICE file distributed with 01:01:13 # this work for additional information regarding copyright ownership. 01:01:13 # The ASF licenses this file to You under the Apache License, Version 2.0 01:01:13 # (the "License"); you may not use this file except in compliance with 01:01:13 # the License. You may obtain a copy of the License at 01:01:13 # 01:01:13 # http://www.apache.org/licenses/LICENSE-2.0 01:01:13 # 01:01:13 # Unless required by applicable law or agreed to in writing, software 01:01:13 # distributed under the License is distributed on an "AS IS" BASIS, 01:01:13 # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. 01:01:13 # See the License for the specific language governing permissions and 01:01:13 # limitations under the License. 01:01:13 # 01:01:13 ################################################################################ 01:01:13 01:01:13 # 01:01:13 # Comma separated list of features repositories to register by default 01:01:13 # 01:01:13 featuresRepositories = mvn:org.opendaylight.integration/features-test/0.22.2-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/4fcf3549-2afc-4ad5-89c2-131fdba22663.xml 01:01:13 01:01:13 # 01:01:13 # Comma separated list of features to install at startup 01:01:13 # 01:01:13 featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, e5e243c7-6090-4d26-9145-e5c40716ec59 01:01:13 01:01:13 # 01:01:13 # Resource repositories (OBR) that the features resolver can use 01:01:13 # to resolve requirements/capabilities 01:01:13 # 01:01:13 # The format of the resourceRepositories is 01:01:13 # resourceRepositories=[xml:url|json:url],... 01:01:13 # for Instance: 01:01:13 # 01:01:13 #resourceRepositories=xml:http://host/path/to/index.xml 01:01:13 # or 01:01:13 #resourceRepositories=json:http://host/path/to/index.json 01:01:13 # 01:01:13 01:01:13 # 01:01:13 # Defines if the boot features are started in asynchronous mode (in a dedicated thread) 01:01:13 # 01:01:13 featuresBootAsynchronous=false 01:01:13 01:01:13 # 01:01:13 # Service requirements enforcement 01:01:13 # 01:01:13 # By default, the feature resolver checks the service requirements/capabilities of 01:01:13 # bundles for new features (xml schema >= 1.3.0) in order to automatically installs 01:01:13 # the required bundles. 01:01:13 # The following flag can have those values: 01:01:13 # - disable: service requirements are completely ignored 01:01:13 # - default: service requirements are ignored for old features 01:01:13 # - enforce: service requirements are always verified 01:01:13 # 01:01:13 #serviceRequirements=default 01:01:13 01:01:13 # 01:01:13 # Store cfg file for config element in feature 01:01:13 # 01:01:13 #configCfgStore=true 01:01:13 01:01:13 # 01:01:13 # Define if the feature service automatically refresh bundles 01:01:13 # 01:01:13 autoRefresh=true 01:01:13 01:01:13 # 01:01:13 # Configuration of features processing mechanism (overrides, blacklisting, modification of features) 01:01:13 # XML file defines instructions related to features processing 01:01:13 # versions.properties may declare properties to resolve placeholders in XML file 01:01:13 # both files are relative to ${karaf.etc} 01:01:13 # 01:01:13 #featureProcessing=org.apache.karaf.features.xml 01:01:13 #featureProcessingVersions=versions.properties 01:01:13 + configure_karaf_log karaf4 '' 01:01:13 + local -r karaf_version=karaf4 01:01:13 + local -r controllerdebugmap= 01:01:13 + local logapi=log4j 01:01:13 + grep log4j2 /tmp/karaf-0.22.2-SNAPSHOT/etc/org.ops4j.pax.logging.cfg 01:01:13 log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n 01:01:13 log4j2.rootLogger.level = INFO 01:01:13 #log4j2.rootLogger.type = asyncRoot 01:01:13 #log4j2.rootLogger.includeLocation = false 01:01:13 log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile 01:01:13 log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi 01:01:13 log4j2.rootLogger.appenderRef.Console.ref = Console 01:01:13 log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter 01:01:13 log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} 01:01:13 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter 01:01:13 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair 01:01:13 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker 01:01:13 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL 01:01:13 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or 01:01:13 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY 01:01:13 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL 01:01:13 log4j2.logger.spifly.name = org.apache.aries.spifly 01:01:13 log4j2.logger.spifly.level = WARN 01:01:13 log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit 01:01:13 log4j2.logger.audit.level = INFO 01:01:13 log4j2.logger.audit.additivity = false 01:01:13 log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile 01:01:13 # Console appender not used by default (see log4j2.rootLogger.appenderRefs) 01:01:13 log4j2.appender.console.type = Console 01:01:13 log4j2.appender.console.name = Console 01:01:13 log4j2.appender.console.layout.type = PatternLayout 01:01:13 log4j2.appender.console.layout.pattern = ${log4j2.pattern} 01:01:13 log4j2.appender.rolling.type = RollingRandomAccessFile 01:01:13 log4j2.appender.rolling.name = RollingFile 01:01:13 log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log 01:01:13 log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i 01:01:13 #log4j2.appender.rolling.immediateFlush = false 01:01:13 log4j2.appender.rolling.append = true 01:01:13 log4j2.appender.rolling.layout.type = PatternLayout 01:01:13 log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} 01:01:13 log4j2.appender.rolling.policies.type = Policies 01:01:13 log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy 01:01:13 log4j2.appender.rolling.policies.size.size = 64MB 01:01:13 log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy 01:01:13 log4j2.appender.rolling.strategy.max = 7 01:01:13 log4j2.appender.audit.type = RollingRandomAccessFile 01:01:13 log4j2.appender.audit.name = AuditRollingFile 01:01:13 log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log 01:01:13 log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i 01:01:13 log4j2.appender.audit.append = true 01:01:13 log4j2.appender.audit.layout.type = PatternLayout 01:01:13 log4j2.appender.audit.layout.pattern = ${log4j2.pattern} 01:01:13 log4j2.appender.audit.policies.type = Policies 01:01:13 log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy 01:01:13 log4j2.appender.audit.policies.size.size = 8MB 01:01:13 log4j2.appender.audit.strategy.type = DefaultRolloverStrategy 01:01:13 log4j2.appender.audit.strategy.max = 7 01:01:13 log4j2.appender.osgi.type = PaxOsgi 01:01:13 log4j2.appender.osgi.name = PaxOsgi 01:01:13 log4j2.appender.osgi.filter = * 01:01:13 #log4j2.logger.aether.name = shaded.org.eclipse.aether 01:01:13 #log4j2.logger.aether.level = TRACE 01:01:13 #log4j2.logger.http-headers.name = shaded.org.apache.http.headers 01:01:13 #log4j2.logger.http-headers.level = DEBUG 01:01:13 #log4j2.logger.maven.name = org.ops4j.pax.url.mvn 01:01:13 #log4j2.logger.maven.level = TRACE 01:01:13 + logapi=log4j2 01:01:13 Configuring the karaf log... karaf_version: karaf4, logapi: log4j2 01:01:13 + echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2' 01:01:13 + '[' log4j2 == log4j2 ']' 01:01:13 + sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.22.2-SNAPSHOT/etc/org.ops4j.pax.logging.cfg 01:01:13 + orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver 01:01:13 + orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver 01:01:13 + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN' 01:01:13 + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN' 01:01:13 controllerdebugmap: 01:01:13 cat /tmp/karaf-0.22.2-SNAPSHOT/etc/org.ops4j.pax.logging.cfg 01:01:13 + unset IFS 01:01:13 + echo 'controllerdebugmap: ' 01:01:13 + '[' -n '' ']' 01:01:13 + echo 'cat /tmp/karaf-0.22.2-SNAPSHOT/etc/org.ops4j.pax.logging.cfg' 01:01:13 + cat /tmp/karaf-0.22.2-SNAPSHOT/etc/org.ops4j.pax.logging.cfg 01:01:13 ################################################################################ 01:01:13 # 01:01:13 # Licensed to the Apache Software Foundation (ASF) under one or more 01:01:13 # contributor license agreements. See the NOTICE file distributed with 01:01:13 # this work for additional information regarding copyright ownership. 01:01:13 # The ASF licenses this file to You under the Apache License, Version 2.0 01:01:13 # (the "License"); you may not use this file except in compliance with 01:01:13 # the License. You may obtain a copy of the License at 01:01:13 # 01:01:13 # http://www.apache.org/licenses/LICENSE-2.0 01:01:13 # 01:01:13 # Unless required by applicable law or agreed to in writing, software 01:01:13 # distributed under the License is distributed on an "AS IS" BASIS, 01:01:13 # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. 01:01:13 # See the License for the specific language governing permissions and 01:01:13 # limitations under the License. 01:01:13 # 01:01:13 ################################################################################ 01:01:13 01:01:13 # Common pattern layout for appenders 01:01:13 log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n 01:01:13 01:01:13 # Root logger 01:01:13 log4j2.rootLogger.level = INFO 01:01:13 # uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library 01:01:13 #log4j2.rootLogger.type = asyncRoot 01:01:13 #log4j2.rootLogger.includeLocation = false 01:01:13 log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile 01:01:13 log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi 01:01:13 log4j2.rootLogger.appenderRef.Console.ref = Console 01:01:13 log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter 01:01:13 log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} 01:01:13 01:01:13 # Filters for logs marked by org.opendaylight.odlparent.Markers 01:01:13 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter 01:01:13 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair 01:01:13 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker 01:01:13 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL 01:01:13 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or 01:01:13 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY 01:01:13 log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL 01:01:13 01:01:13 # Loggers configuration 01:01:13 01:01:13 # Spifly logger 01:01:13 log4j2.logger.spifly.name = org.apache.aries.spifly 01:01:13 log4j2.logger.spifly.level = WARN 01:01:13 01:01:13 # Security audit logger 01:01:13 log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit 01:01:13 log4j2.logger.audit.level = INFO 01:01:13 log4j2.logger.audit.additivity = false 01:01:13 log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile 01:01:13 01:01:13 # Appenders configuration 01:01:13 01:01:13 # Console appender not used by default (see log4j2.rootLogger.appenderRefs) 01:01:13 log4j2.appender.console.type = Console 01:01:13 log4j2.appender.console.name = Console 01:01:13 log4j2.appender.console.layout.type = PatternLayout 01:01:13 log4j2.appender.console.layout.pattern = ${log4j2.pattern} 01:01:13 01:01:13 # Rolling file appender 01:01:13 log4j2.appender.rolling.type = RollingRandomAccessFile 01:01:13 log4j2.appender.rolling.name = RollingFile 01:01:13 log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log 01:01:13 log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i 01:01:13 # uncomment to not force a disk flush 01:01:13 #log4j2.appender.rolling.immediateFlush = false 01:01:13 log4j2.appender.rolling.append = true 01:01:13 log4j2.appender.rolling.layout.type = PatternLayout 01:01:13 log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} 01:01:13 log4j2.appender.rolling.policies.type = Policies 01:01:13 log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy 01:01:13 log4j2.appender.rolling.policies.size.size = 1GB 01:01:13 log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy 01:01:13 log4j2.appender.rolling.strategy.max = 7 01:01:13 01:01:13 # Audit file appender 01:01:13 log4j2.appender.audit.type = RollingRandomAccessFile 01:01:13 log4j2.appender.audit.name = AuditRollingFile 01:01:13 log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log 01:01:13 log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i 01:01:13 log4j2.appender.audit.append = true 01:01:13 log4j2.appender.audit.layout.type = PatternLayout 01:01:13 log4j2.appender.audit.layout.pattern = ${log4j2.pattern} 01:01:13 log4j2.appender.audit.policies.type = Policies 01:01:13 log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy 01:01:13 log4j2.appender.audit.policies.size.size = 8MB 01:01:13 log4j2.appender.audit.strategy.type = DefaultRolloverStrategy 01:01:13 log4j2.appender.audit.strategy.max = 7 01:01:13 01:01:13 # OSGi appender 01:01:13 log4j2.appender.osgi.type = PaxOsgi 01:01:13 log4j2.appender.osgi.name = PaxOsgi 01:01:13 log4j2.appender.osgi.filter = * 01:01:13 01:01:13 # help with identification of maven-related problems with pax-url-aether 01:01:13 #log4j2.logger.aether.name = shaded.org.eclipse.aether 01:01:13 #log4j2.logger.aether.level = TRACE 01:01:13 #log4j2.logger.http-headers.name = shaded.org.apache.http.headers 01:01:13 #log4j2.logger.http-headers.level = DEBUG 01:01:13 #log4j2.logger.maven.name = org.ops4j.pax.url.mvn 01:01:13 #log4j2.logger.maven.level = TRACE 01:01:13 log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN 01:01:13 log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN 01:01:13 + set_java_vars /usr/lib/jvm/java-21-openjdk-amd64 3072m /tmp/karaf-0.22.2-SNAPSHOT/bin/setenv 01:01:13 Configure 01:01:13 java home: /usr/lib/jvm/java-21-openjdk-amd64 01:01:13 max memory: 3072m 01:01:13 memconf: /tmp/karaf-0.22.2-SNAPSHOT/bin/setenv 01:01:13 + local -r java_home=/usr/lib/jvm/java-21-openjdk-amd64 01:01:13 + local -r controllermem=3072m 01:01:13 + local -r memconf=/tmp/karaf-0.22.2-SNAPSHOT/bin/setenv 01:01:13 + echo Configure 01:01:13 + echo ' java home: /usr/lib/jvm/java-21-openjdk-amd64' 01:01:13 + echo ' max memory: 3072m' 01:01:13 + echo ' memconf: /tmp/karaf-0.22.2-SNAPSHOT/bin/setenv' 01:01:13 + sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64}%g' /tmp/karaf-0.22.2-SNAPSHOT/bin/setenv 01:01:13 + sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.22.2-SNAPSHOT/bin/setenv 01:01:13 cat /tmp/karaf-0.22.2-SNAPSHOT/bin/setenv 01:01:13 + echo 'cat /tmp/karaf-0.22.2-SNAPSHOT/bin/setenv' 01:01:13 + cat /tmp/karaf-0.22.2-SNAPSHOT/bin/setenv 01:01:13 #!/bin/sh 01:01:13 # 01:01:13 # Licensed to the Apache Software Foundation (ASF) under one or more 01:01:13 # contributor license agreements. See the NOTICE file distributed with 01:01:13 # this work for additional information regarding copyright ownership. 01:01:13 # The ASF licenses this file to You under the Apache License, Version 2.0 01:01:13 # (the "License"); you may not use this file except in compliance with 01:01:13 # the License. You may obtain a copy of the License at 01:01:13 # 01:01:13 # http://www.apache.org/licenses/LICENSE-2.0 01:01:13 # 01:01:13 # Unless required by applicable law or agreed to in writing, software 01:01:13 # distributed under the License is distributed on an "AS IS" BASIS, 01:01:13 # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. 01:01:13 # See the License for the specific language governing permissions and 01:01:13 # limitations under the License. 01:01:13 # 01:01:13 01:01:13 # 01:01:13 # handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf 01:01:13 # script: client, instance, shell, start, status, stop, karaf 01:01:13 # 01:01:13 # if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then 01:01:13 # Actions go here... 01:01:13 # fi 01:01:13 01:01:13 # 01:01:13 # general settings which should be applied for all scripts go here; please keep 01:01:13 # in mind that it is possible that scripts might be executed more than once, e.g. 01:01:13 # in example of the start script where the start script is executed first and the 01:01:13 # karaf script afterwards. 01:01:13 # 01:01:13 01:01:13 # 01:01:13 # The following section shows the possible configuration options for the default 01:01:13 # karaf scripts 01:01:13 # 01:01:13 export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64} # Location of Java installation 01:01:13 # export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration 01:01:13 # export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options 01:01:13 # export EXTRA_JAVA_OPTS # Additional JVM options 01:01:13 # export KARAF_HOME # Karaf home folder 01:01:13 # export KARAF_DATA # Karaf data folder 01:01:13 # export KARAF_BASE # Karaf base folder 01:01:13 # export KARAF_ETC # Karaf etc folder 01:01:13 # export KARAF_LOG # Karaf log folder 01:01:13 # export KARAF_SYSTEM_OPTS # First citizen Karaf options 01:01:13 # export KARAF_OPTS # Additional available Karaf options 01:01:13 # export KARAF_DEBUG # Enable debug mode 01:01:13 # export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start 01:01:13 # export KARAF_NOROOT # Prevent execution as root if set to true 01:01:13 Set Java version 01:01:13 + echo 'Set Java version' 01:01:13 + sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-21-openjdk-amd64/bin/java 1 01:01:13 sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper 01:01:13 sudo: a password is required 01:01:13 + sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-21-openjdk-amd64/bin/java 01:01:13 sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper 01:01:13 sudo: a password is required 01:01:13 JDK default version ... 01:01:13 + echo 'JDK default version ...' 01:01:13 + java -version 01:01:13 openjdk version "21.0.9" 2025-10-21 01:01:13 OpenJDK Runtime Environment (build 21.0.9+10-Ubuntu-122.04) 01:01:13 OpenJDK 64-Bit Server VM (build 21.0.9+10-Ubuntu-122.04, mixed mode, sharing) 01:01:13 Set JAVA_HOME 01:01:13 + echo 'Set JAVA_HOME' 01:01:13 + export JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64 01:01:13 + JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64 01:01:13 ++ readlink -e /usr/lib/jvm/java-21-openjdk-amd64/bin/java 01:01:13 Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java 01:01:13 + JAVA_RESOLVED=/usr/lib/jvm/java-21-openjdk-amd64/bin/java 01:01:13 + echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java' 01:01:13 Listing all open ports on controller system... 01:01:13 + echo 'Listing all open ports on controller system...' 01:01:13 + netstat -pnatu 01:01:13 /tmp/configuration-script.sh: line 40: netstat: command not found 01:01:13 + '[' -f /tmp/custom_shard_config.txt ']' 01:01:13 Custom shard config exists!!! 01:01:13 Copying the shard config... 01:01:13 + echo 'Custom shard config exists!!!' 01:01:13 + echo 'Copying the shard config...' 01:01:13 + cp /tmp/custom_shard_config.txt /tmp/karaf-0.22.2-SNAPSHOT/bin/ 01:01:13 Configuring cluster 01:01:13 + echo 'Configuring cluster' 01:01:13 + /tmp/karaf-0.22.2-SNAPSHOT/bin/configure_cluster.sh 3 10.30.171.250 10.30.171.198 10.30.171.173 01:01:13 ################################################ 01:01:13 ## Configure Cluster ## 01:01:13 ################################################ 01:01:13 NOTE: Cluster configuration files not found. Copying from 01:01:13 /tmp/karaf-0.22.2-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/11.0.2 01:01:13 Configuring unique name in pekko.conf 01:01:13 Configuring hostname in pekko.conf 01:01:13 Configuring data and rpc seed nodes in pekko.conf 01:01:13 modules = [ 01:01:13 01:01:13 { 01:01:13 name = "inventory" 01:01:13 namespace = "urn:opendaylight:inventory" 01:01:13 shard-strategy = "module" 01:01:13 }, 01:01:13 { 01:01:13 name = "topology" 01:01:13 namespace = "urn:TBD:params:xml:ns:yang:network-topology" 01:01:13 shard-strategy = "module" 01:01:13 }, 01:01:13 { 01:01:13 name = "toaster" 01:01:13 namespace = "http://netconfcentral.org/ns/toaster" 01:01:13 shard-strategy = "module" 01:01:13 }, 01:01:13 { 01:01:13 name = "car" 01:01:13 namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" 01:01:13 shard-strategy = "module" 01:01:13 }, 01:01:13 { 01:01:13 name = "people" 01:01:13 namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" 01:01:13 shard-strategy = "module" 01:01:13 }, 01:01:13 { 01:01:13 name = "car-people" 01:01:13 namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" 01:01:13 shard-strategy = "module" 01:01:13 } 01:01:13 ] 01:01:13 Configuring replication type in module-shards.conf 01:01:13 ################################################ 01:01:13 ## NOTE: Manually restart controller to ## 01:01:13 ## apply configuration. ## 01:01:13 ################################################ 01:01:13 Dump pekko.conf 01:01:13 + echo 'Dump pekko.conf' 01:01:13 + cat /tmp/karaf-0.22.2-SNAPSHOT/configuration/initial/pekko.conf 01:01:13 01:01:13 odl-cluster-data { 01:01:13 pekko { 01:01:13 remote { 01:01:13 artery { 01:01:13 enabled = on 01:01:13 transport = tcp 01:01:13 canonical.hostname = "10.30.171.173" 01:01:13 canonical.port = 2550 01:01:13 } 01:01:13 } 01:01:13 01:01:13 cluster { 01:01:13 # Using artery. 01:01:13 seed-nodes = ["pekko://opendaylight-cluster-data@10.30.171.250:2550", 01:01:13 "pekko://opendaylight-cluster-data@10.30.171.198:2550", 01:01:13 "pekko://opendaylight-cluster-data@10.30.171.173:2550"] 01:01:13 01:01:13 roles = ["member-3"] 01:01:13 01:01:13 # when under load we might trip a false positive on the failure detector 01:01:13 # failure-detector { 01:01:13 # heartbeat-interval = 4 s 01:01:13 # acceptable-heartbeat-pause = 16s 01:01:13 # } 01:01:13 } 01:01:13 01:01:13 persistence { 01:01:13 # By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by 01:01:13 # modifying the following two properties. The directory location specified may be a relative or absolute path. 01:01:13 # The relative path is always relative to KARAF_HOME. 01:01:13 01:01:13 # snapshot-store.local.dir = "target/snapshots" 01:01:13 01:01:13 # Use lz4 compression for LocalSnapshotStore snapshots 01:01:13 snapshot-store.local.use-lz4-compression = false 01:01:13 # Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB 01:01:13 snapshot-store.local.lz4-blocksize = 256KB 01:01:13 } 01:01:13 disable-default-actor-system-quarantined-event-handling = "false" 01:01:13 } 01:01:13 } 01:01:13 Dump modules.conf 01:01:13 + echo 'Dump modules.conf' 01:01:13 + cat /tmp/karaf-0.22.2-SNAPSHOT/configuration/initial/modules.conf 01:01:13 modules = [ 01:01:13 01:01:13 { 01:01:13 name = "inventory" 01:01:13 namespace = "urn:opendaylight:inventory" 01:01:13 shard-strategy = "module" 01:01:13 }, 01:01:13 { 01:01:13 name = "topology" 01:01:13 namespace = "urn:TBD:params:xml:ns:yang:network-topology" 01:01:13 shard-strategy = "module" 01:01:13 }, 01:01:13 { 01:01:13 name = "toaster" 01:01:13 namespace = "http://netconfcentral.org/ns/toaster" 01:01:13 shard-strategy = "module" 01:01:13 }, 01:01:13 { 01:01:13 name = "car" 01:01:13 namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" 01:01:13 shard-strategy = "module" 01:01:13 }, 01:01:13 { 01:01:13 name = "people" 01:01:13 namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" 01:01:13 shard-strategy = "module" 01:01:13 }, 01:01:13 { 01:01:13 name = "car-people" 01:01:13 namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" 01:01:13 shard-strategy = "module" 01:01:13 } 01:01:13 ] 01:01:13 Dump module-shards.conf 01:01:13 + echo 'Dump module-shards.conf' 01:01:13 + cat /tmp/karaf-0.22.2-SNAPSHOT/configuration/initial/module-shards.conf 01:01:13 module-shards = [ 01:01:13 { 01:01:13 name = "default" 01:01:13 shards = [ 01:01:13 { 01:01:13 name = "default" 01:01:13 replicas = ["member-1", 01:01:13 "member-2", 01:01:13 "member-3"] 01:01:13 } 01:01:13 ] 01:01:13 }, 01:01:13 { 01:01:13 name = "inventory" 01:01:13 shards = [ 01:01:13 { 01:01:13 name="inventory" 01:01:13 replicas = ["member-1", 01:01:13 "member-2", 01:01:13 "member-3"] 01:01:13 } 01:01:13 ] 01:01:13 }, 01:01:13 { 01:01:13 name = "topology" 01:01:13 shards = [ 01:01:13 { 01:01:13 name="topology" 01:01:13 replicas = ["member-1", 01:01:13 "member-2", 01:01:13 "member-3"] 01:01:13 } 01:01:13 ] 01:01:13 }, 01:01:13 { 01:01:13 name = "toaster" 01:01:13 shards = [ 01:01:13 { 01:01:13 name="toaster" 01:01:13 replicas = ["member-1", 01:01:13 "member-2", 01:01:13 "member-3"] 01:01:13 } 01:01:13 ] 01:01:13 }, 01:01:13 { 01:01:13 name = "car" 01:01:13 shards = [ 01:01:13 { 01:01:13 name="car" 01:01:13 replicas = ["member-1", 01:01:13 "member-2", 01:01:13 "member-3"] 01:01:13 } 01:01:13 ] 01:01:13 }, 01:01:13 { 01:01:13 name = "people" 01:01:13 shards = [ 01:01:13 { 01:01:13 name="people" 01:01:13 replicas = ["member-1", 01:01:13 "member-2", 01:01:13 "member-3"] 01:01:13 } 01:01:13 ] 01:01:13 }, 01:01:13 { 01:01:13 name = "car-people" 01:01:13 shards = [ 01:01:13 { 01:01:13 name="car-people" 01:01:13 replicas = ["member-1", 01:01:13 "member-2", 01:01:13 "member-3"] 01:01:13 } 01:01:13 ] 01:01:13 } 01:01:13 ] 01:01:13 Locating config plan to use... 01:01:13 Finished running config plans 01:01:13 Starting member-1 with IP address 10.30.171.250 01:01:13 Warning: Permanently added '10.30.171.250' (ECDSA) to the list of known hosts. 01:01:14 Warning: Permanently added '10.30.171.250' (ECDSA) to the list of known hosts. 01:01:14 Redirecting karaf console output to karaf_console.log 01:01:14 Starting controller... 01:01:14 start: Redirecting Karaf output to /tmp/karaf-0.22.2-SNAPSHOT/data/log/karaf_console.log 01:01:14 Starting member-2 with IP address 10.30.171.198 01:01:14 Warning: Permanently added '10.30.171.198' (ECDSA) to the list of known hosts. 01:01:14 Warning: Permanently added '10.30.171.198' (ECDSA) to the list of known hosts. 01:01:14 Redirecting karaf console output to karaf_console.log 01:01:14 Starting controller... 01:01:14 start: Redirecting Karaf output to /tmp/karaf-0.22.2-SNAPSHOT/data/log/karaf_console.log 01:01:14 Starting member-3 with IP address 10.30.171.173 01:01:14 Warning: Permanently added '10.30.171.173' (ECDSA) to the list of known hosts. 01:01:15 Warning: Permanently added '10.30.171.173' (ECDSA) to the list of known hosts. 01:01:15 Redirecting karaf console output to karaf_console.log 01:01:15 Starting controller... 01:01:15 start: Redirecting Karaf output to /tmp/karaf-0.22.2-SNAPSHOT/data/log/karaf_console.log 01:01:15 [controller-csit-3node-clustering-tell-all-titanium] $ /bin/bash /tmp/jenkins9049411562569419904.sh 01:01:15 common-functions.sh is being sourced 01:01:15 common-functions environment: 01:01:15 MAVENCONF: /tmp/karaf-0.22.2-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg 01:01:15 ACTUALFEATURES: 01:01:15 FEATURESCONF: /tmp/karaf-0.22.2-SNAPSHOT/etc/org.apache.karaf.features.cfg 01:01:15 CUSTOMPROP: /tmp/karaf-0.22.2-SNAPSHOT/etc/custom.properties 01:01:15 LOGCONF: /tmp/karaf-0.22.2-SNAPSHOT/etc/org.ops4j.pax.logging.cfg 01:01:15 MEMCONF: /tmp/karaf-0.22.2-SNAPSHOT/bin/setenv 01:01:15 CONTROLLERMEM: 2048m 01:01:15 AKKACONF: /tmp/karaf-0.22.2-SNAPSHOT/configuration/initial/pekko.conf 01:01:15 MODULESCONF: /tmp/karaf-0.22.2-SNAPSHOT/configuration/initial/modules.conf 01:01:15 MODULESHARDSCONF: /tmp/karaf-0.22.2-SNAPSHOT/configuration/initial/module-shards.conf 01:01:15 SUITES: 01:01:15 01:01:15 + echo '#################################################' 01:01:15 ################################################# 01:01:15 + echo '## Verify Cluster is UP ##' 01:01:15 ## Verify Cluster is UP ## 01:01:15 + echo '#################################################' 01:01:15 ################################################# 01:01:15 + create_post_startup_script 01:01:15 + cat 01:01:15 + copy_and_run_post_startup_script 01:01:15 + seed_index=1 01:01:15 ++ seq 1 3 01:01:15 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") 01:01:15 + CONTROLLERIP=ODL_SYSTEM_1_IP 01:01:15 + echo 'Execute the post startup script on controller 10.30.171.250' 01:01:15 Execute the post startup script on controller 10.30.171.250 01:01:15 + scp /w/workspace/controller-csit-3node-clustering-tell-all-titanium/post-startup-script.sh 10.30.171.250:/tmp/ 01:01:15 Warning: Permanently added '10.30.171.250' (ECDSA) to the list of known hosts. 01:01:15 + ssh 10.30.171.250 'bash /tmp/post-startup-script.sh 1' 01:01:15 Warning: Permanently added '10.30.171.250' (ECDSA) to the list of known hosts. 01:01:15 /tmp/post-startup-script.sh: line 4: netstat: command not found 01:01:20 /tmp/post-startup-script.sh: line 4: netstat: command not found 01:01:25 /tmp/post-startup-script.sh: line 4: netstat: command not found 01:01:30 /tmp/post-startup-script.sh: line 4: netstat: command not found 01:01:35 /tmp/post-startup-script.sh: line 4: netstat: command not found 01:01:40 /tmp/post-startup-script.sh: line 4: netstat: command not found 01:01:45 /tmp/post-startup-script.sh: line 4: netstat: command not found 01:01:50 /tmp/post-startup-script.sh: line 4: netstat: command not found 01:01:55 /tmp/post-startup-script.sh: line 4: netstat: command not found 01:02:00 /tmp/post-startup-script.sh: line 4: netstat: command not found 01:02:05 /tmp/post-startup-script.sh: line 4: netstat: command not found 01:02:10 /tmp/post-startup-script.sh: line 4: netstat: command not found 01:02:15 Waiting up to 3 minutes for controller to come up, checking every 5 seconds... 01:02:20 2026-02-08T01:01:57,815 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 284 - org.opendaylight.infrautils.ready-api - 7.1.7 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] 01:02:20 Controller is UP 01:02:20 2026-02-08T01:01:57,815 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 284 - org.opendaylight.infrautils.ready-api - 7.1.7 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] 01:02:20 Listing all open ports on controller system... 01:02:20 looking for "BindException: Address already in use" in log file 01:02:20 looking for "server is unhealthy" in log file 01:02:20 /tmp/post-startup-script.sh: line 51: netstat: command not found 01:02:20 + '[' 1 == 0 ']' 01:02:20 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") 01:02:20 + CONTROLLERIP=ODL_SYSTEM_2_IP 01:02:20 + echo 'Execute the post startup script on controller 10.30.171.198' 01:02:20 Execute the post startup script on controller 10.30.171.198 01:02:20 + scp /w/workspace/controller-csit-3node-clustering-tell-all-titanium/post-startup-script.sh 10.30.171.198:/tmp/ 01:02:20 Warning: Permanently added '10.30.171.198' (ECDSA) to the list of known hosts. 01:02:21 + ssh 10.30.171.198 'bash /tmp/post-startup-script.sh 2' 01:02:21 Warning: Permanently added '10.30.171.198' (ECDSA) to the list of known hosts. 01:02:21 /tmp/post-startup-script.sh: line 4: netstat: command not found 01:02:26 /tmp/post-startup-script.sh: line 4: netstat: command not found 01:02:31 /tmp/post-startup-script.sh: line 4: netstat: command not found 01:02:36 /tmp/post-startup-script.sh: line 4: netstat: command not found 01:02:41 /tmp/post-startup-script.sh: line 4: netstat: command not found 01:02:46 /tmp/post-startup-script.sh: line 4: netstat: command not found 01:02:51 /tmp/post-startup-script.sh: line 4: netstat: command not found 01:02:56 /tmp/post-startup-script.sh: line 4: netstat: command not found 01:03:01 /tmp/post-startup-script.sh: line 4: netstat: command not found 01:03:06 /tmp/post-startup-script.sh: line 4: netstat: command not found 01:03:11 /tmp/post-startup-script.sh: line 4: netstat: command not found 01:03:16 /tmp/post-startup-script.sh: line 4: netstat: command not found 01:03:21 Waiting up to 3 minutes for controller to come up, checking every 5 seconds... 01:03:26 2026-02-08T01:01:58,366 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 284 - org.opendaylight.infrautils.ready-api - 7.1.7 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] 01:03:26 Controller is UP 01:03:26 2026-02-08T01:01:58,366 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 284 - org.opendaylight.infrautils.ready-api - 7.1.7 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] 01:03:26 Listing all open ports on controller system... 01:03:26 /tmp/post-startup-script.sh: line 51: netstat: command not found 01:03:26 looking for "BindException: Address already in use" in log file 01:03:26 looking for "server is unhealthy" in log file 01:03:26 + '[' 2 == 0 ']' 01:03:26 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") 01:03:26 + CONTROLLERIP=ODL_SYSTEM_3_IP 01:03:26 + echo 'Execute the post startup script on controller 10.30.171.173' 01:03:26 Execute the post startup script on controller 10.30.171.173 01:03:26 + scp /w/workspace/controller-csit-3node-clustering-tell-all-titanium/post-startup-script.sh 10.30.171.173:/tmp/ 01:03:26 Warning: Permanently added '10.30.171.173' (ECDSA) to the list of known hosts. 01:03:27 + ssh 10.30.171.173 'bash /tmp/post-startup-script.sh 3' 01:03:27 Warning: Permanently added '10.30.171.173' (ECDSA) to the list of known hosts. 01:03:27 /tmp/post-startup-script.sh: line 4: netstat: command not found 01:03:32 /tmp/post-startup-script.sh: line 4: netstat: command not found 01:03:37 /tmp/post-startup-script.sh: line 4: netstat: command not found 01:03:42 /tmp/post-startup-script.sh: line 4: netstat: command not found 01:03:47 /tmp/post-startup-script.sh: line 4: netstat: command not found 01:03:52 /tmp/post-startup-script.sh: line 4: netstat: command not found 01:03:57 /tmp/post-startup-script.sh: line 4: netstat: command not found 01:04:02 /tmp/post-startup-script.sh: line 4: netstat: command not found 01:04:07 /tmp/post-startup-script.sh: line 4: netstat: command not found 01:04:12 /tmp/post-startup-script.sh: line 4: netstat: command not found 01:04:17 /tmp/post-startup-script.sh: line 4: netstat: command not found 01:04:22 /tmp/post-startup-script.sh: line 4: netstat: command not found 01:04:27 Waiting up to 3 minutes for controller to come up, checking every 5 seconds... 01:04:32 2026-02-08T01:01:58,263 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 284 - org.opendaylight.infrautils.ready-api - 7.1.7 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] 01:04:32 Controller is UP 01:04:32 2026-02-08T01:01:58,263 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 284 - org.opendaylight.infrautils.ready-api - 7.1.7 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] 01:04:32 Listing all open ports on controller system... 01:04:32 looking for "BindException: Address already in use" in log file 01:04:32 /tmp/post-startup-script.sh: line 51: netstat: command not found 01:04:32 looking for "server is unhealthy" in log file 01:04:32 + '[' 0 == 0 ']' 01:04:32 + seed_index=1 01:04:32 + dump_controller_threads 01:04:32 ++ seq 1 3 01:04:32 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") 01:04:32 + CONTROLLERIP=ODL_SYSTEM_1_IP 01:04:32 + echo 'Let'\''s take the karaf thread dump' 01:04:32 Let's take the karaf thread dump 01:04:32 + ssh 10.30.171.250 'sudo ps aux' 01:04:32 Warning: Permanently added '10.30.171.250' (ECDSA) to the list of known hosts. 01:04:32 ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-titanium/ps_before.log 01:04:32 ++ grep -v grep 01:04:32 ++ tr -s ' ' 01:04:32 ++ cut -f2 '-d ' 01:04:32 + pid=2069 01:04:32 + echo 'karaf main: org.apache.karaf.main.Main, pid:2069' 01:04:32 karaf main: org.apache.karaf.main.Main, pid:2069 01:04:32 + ssh 10.30.171.250 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 2069' 01:04:32 Warning: Permanently added '10.30.171.250' (ECDSA) to the list of known hosts. 01:04:33 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") 01:04:33 + CONTROLLERIP=ODL_SYSTEM_2_IP 01:04:33 + echo 'Let'\''s take the karaf thread dump' 01:04:33 Let's take the karaf thread dump 01:04:33 + ssh 10.30.171.198 'sudo ps aux' 01:04:33 Warning: Permanently added '10.30.171.198' (ECDSA) to the list of known hosts. 01:04:33 ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-titanium/ps_before.log 01:04:33 ++ grep -v grep 01:04:33 ++ tr -s ' ' 01:04:33 ++ cut -f2 '-d ' 01:04:33 + pid=2072 01:04:33 + echo 'karaf main: org.apache.karaf.main.Main, pid:2072' 01:04:33 karaf main: org.apache.karaf.main.Main, pid:2072 01:04:33 + ssh 10.30.171.198 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 2072' 01:04:33 Warning: Permanently added '10.30.171.198' (ECDSA) to the list of known hosts. 01:04:34 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") 01:04:34 + CONTROLLERIP=ODL_SYSTEM_3_IP 01:04:34 + echo 'Let'\''s take the karaf thread dump' 01:04:34 Let's take the karaf thread dump 01:04:34 + ssh 10.30.171.173 'sudo ps aux' 01:04:34 Warning: Permanently added '10.30.171.173' (ECDSA) to the list of known hosts. 01:04:35 ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-titanium/ps_before.log 01:04:35 ++ grep -v grep 01:04:35 ++ tr -s ' ' 01:04:35 ++ cut -f2 '-d ' 01:04:35 + pid=2068 01:04:35 + echo 'karaf main: org.apache.karaf.main.Main, pid:2068' 01:04:35 karaf main: org.apache.karaf.main.Main, pid:2068 01:04:35 + ssh 10.30.171.173 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 2068' 01:04:35 Warning: Permanently added '10.30.171.173' (ECDSA) to the list of known hosts. 01:04:35 + '[' 0 -gt 0 ']' 01:04:35 + echo 'Generating controller variables...' 01:04:35 Generating controller variables... 01:04:35 ++ seq 1 3 01:04:35 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") 01:04:35 + CONTROLLERIP=ODL_SYSTEM_1_IP 01:04:35 + odl_variables=' -v ODL_SYSTEM_1_IP:10.30.171.250' 01:04:35 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") 01:04:35 + CONTROLLERIP=ODL_SYSTEM_2_IP 01:04:35 + odl_variables=' -v ODL_SYSTEM_1_IP:10.30.171.250 -v ODL_SYSTEM_2_IP:10.30.171.198' 01:04:35 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") 01:04:35 + CONTROLLERIP=ODL_SYSTEM_3_IP 01:04:35 + odl_variables=' -v ODL_SYSTEM_1_IP:10.30.171.250 -v ODL_SYSTEM_2_IP:10.30.171.198 -v ODL_SYSTEM_3_IP:10.30.171.173' 01:04:35 + echo 'Generating mininet variables...' 01:04:35 Generating mininet variables... 01:04:35 ++ seq 1 0 01:04:35 + get_test_suites SUITES 01:04:35 + local __suite_list=SUITES 01:04:35 + echo 'Locating test plan to use...' 01:04:35 Locating test plan to use... 01:04:35 + testplan_filepath=/w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/testplans/controller-clustering-tell-titanium.txt 01:04:35 + '[' '!' -f /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/testplans/controller-clustering-tell-titanium.txt ']' 01:04:35 + testplan_filepath=/w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/testplans/controller-clustering-tell.txt 01:04:35 + '[' disabled '!=' disabled ']' 01:04:35 + echo 'Changing the testplan path...' 01:04:35 Changing the testplan path... 01:04:35 + sed s:integration:/w/workspace/controller-csit-3node-clustering-tell-all-titanium: /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/testplans/controller-clustering-tell.txt 01:04:35 + cat testplan.txt 01:04:35 # Place the suites in run order: 01:04:35 01:04:35 # disabling all "prefix based" suites. This functionality was newly 01:04:35 # introduced with these tests in 2017. The assumption is that 01:04:35 # development stopped in that area, but may continue at a later 01:04:35 # time. Still, the tests are failing and no resources to solve the 01:04:35 # failures at this time. If/When this changes, we can uncomment 01:04:35 # those suites. Note that every suite is commented out with it's 01:04:35 # accompanying "restart_with_tell_based_true" setup suite. 01:04:35 01:04:35 01:04:35 # /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot 01:04:35 # /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/ddb-sanity-prefix-based.robot 01:04:35 /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot 01:04:35 /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot 01:04:35 /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot 01:04:35 /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot 01:04:35 # /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot 01:04:35 # /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown_prefbasedshard.robot 01:04:35 /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot 01:04:35 /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot 01:04:35 # /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot 01:04:35 # /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement_prefbasedshard.robot 01:04:35 /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot 01:04:35 /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot 01:04:35 # /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot 01:04:35 # /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/leader_isolation_prefbasedshard.robot 01:04:35 /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot 01:04:35 /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/client_isolation.robot 01:04:35 # /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot 01:04:35 # /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/client_isolation_prefbasedshard.robot 01:04:35 /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot 01:04:35 /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/listener_stability.robot 01:04:35 # /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot 01:04:35 # /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/listener_stability_prefbasedshard.robot 01:04:35 /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot 01:04:35 /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/cluster_singleton/master_stability.robot 01:04:35 /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot 01:04:35 /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot 01:04:35 /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot 01:04:35 /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot 01:04:35 /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot 01:04:35 /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot 01:04:35 /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot 01:04:35 /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot 01:04:35 /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot 01:04:35 /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot 01:04:35 /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot 01:04:35 /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot 01:04:35 /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot 01:04:35 + '[' -z '' ']' 01:04:35 ++ grep -E -v '(^[[:space:]]*#|^[[:space:]]*$)' testplan.txt 01:04:35 ++ tr '\012' ' ' 01:04:35 + suite_list='/w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot ' 01:04:35 + eval 'SUITES='\''/w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot '\''' 01:04:35 ++ SUITES='/w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot ' 01:04:35 + echo 'Starting Robot test suites /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot ...' 01:04:35 Starting Robot test suites /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot ... 01:04:35 + robot -N controller-clustering-tell.txt --removekeywords wuks -e exclude -e skip_if_titanium -v BUNDLEFOLDER:karaf-0.22.2-SNAPSHOT -v BUNDLE_URL:https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.22.2-SNAPSHOT/karaf-0.22.2-20260207.175700-491.zip -v CONTROLLER:10.30.171.250 -v CONTROLLER1:10.30.171.198 -v CONTROLLER2:10.30.171.173 -v CONTROLLER_USER:jenkins -v JAVA_HOME:/usr/lib/jvm/java-21-openjdk-amd64 -v JDKVERSION:openjdk21 -v JENKINS_WORKSPACE:/w/workspace/controller-csit-3node-clustering-tell-all-titanium -v MININET: -v MININET1: -v MININET2: -v MININET_USER:jenkins -v NEXUSURL_PREFIX:https://nexus.opendaylight.org -v NUM_ODL_SYSTEM:3 -v NUM_TOOLS_SYSTEM:0 -v ODL_STREAM:titanium -v ODL_SYSTEM_IP:10.30.171.250 -v ODL_SYSTEM_1_IP:10.30.171.250 -v ODL_SYSTEM_2_IP:10.30.171.198 -v ODL_SYSTEM_3_IP:10.30.171.173 -v ODL_SYSTEM_USER:jenkins -v TOOLS_SYSTEM_IP: -v TOOLS_SYSTEM_USER:jenkins -v USER_HOME:/home/jenkins -v IS_KARAF_APPL:True -v WORKSPACE:/tmp /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot 01:04:35 ============================================================================== 01:04:35 controller-clustering-tell.txt 01:04:35 ============================================================================== 01:04:36 controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... 01:04:36 ============================================================================== 01:04:40 Stop_All_Members :: Stop every odl node. | PASS | 01:08:52 ------------------------------------------------------------------------------ 01:08:52 Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | 01:09:01 ------------------------------------------------------------------------------ 01:09:01 Start_All_And_Sync :: Start each member and wait for sync. | PASS | 01:10:14 ------------------------------------------------------------------------------ 01:10:14 controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | PASS | 01:10:14 3 tests, 3 passed, 0 failed 01:10:14 ============================================================================== 01:10:14 controller-clustering-tell.txt.Ddb-Sanity-Module-Based :: DOMDataBroker tes... 01:10:14 ============================================================================== 01:10:18 Get_Shard_Role :: Get shard role. | FAIL | 01:10:19 ... click for list of related bugs or create a new one if needed (with the 01:10:19 "controller_clustering_tell_txt_ddb_sanity_module_based_get_shard_role" 01:10:19 reference somewhere inside) 01:10:19 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_get_shard_role&order=bug_status" 01:10:19 01:10:19 HTTPError: 404 Client Error: Not Found for url: http://10.30.171.250:8181/restconf/operations/cluster-admin:get-shard-role 01:10:19 ------------------------------------------------------------------------------ 01:10:19 Subscribe_Listener_To_Leader :: Subscribe listener to leader. | FAIL | 01:10:25 ... click for list of related bugs or create a new one if needed (with the 01:10:25 "controller_clustering_tell_txt_ddb_sanity_module_based_subscribe_listener_to_leader" 01:10:25 reference somewhere inside) 01:10:25 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_subscribe_listener_to_leader&order=bug_status" 01:10:25 01:10:25 HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.173:8181/rests/operations/odl-mdsal-lowlevel-control:unsubscribe-dtcl 01:10:25 ------------------------------------------------------------------------------ 01:10:25 Subscribe_Listener_To_Follower :: Subscribe listener to follower. | FAIL | 01:10:31 ... click for list of related bugs or create a new one if needed (with the 01:10:31 "controller_clustering_tell_txt_ddb_sanity_module_based_subscribe_listener_to_follower" 01:10:31 reference somewhere inside) 01:10:31 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_subscribe_listener_to_follower&order=bug_status" 01:10:31 01:10:31 HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.250:8181/rests/operations/odl-mdsal-lowlevel-control:unsubscribe-dtcl 01:10:31 ------------------------------------------------------------------------------ 01:10:31 Make_Leader_Local :: Make the loeader local and verify. | FAIL | 01:10:31 ... click for list of related bugs or create a new one if needed (with the 01:10:31 "controller_clustering_tell_txt_ddb_sanity_module_based_make_leader_local" 01:10:31 reference somewhere inside) 01:10:31 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_make_leader_local&order=bug_status" 01:10:31 01:10:31 HTTPError: 404 Client Error: Not Found for url: http://10.30.171.250:8181/restconf/operations/cluster-admin:make-leader-local 01:10:31 ------------------------------------------------------------------------------ 01:10:31 Remove_Leader_Shard_Replica_And_Add_It_Back :: Remove and add shar... | FAIL | 01:10:32 ... click for list of related bugs or create a new one if needed (with the 01:10:32 "controller_clustering_tell_txt_ddb_sanity_module_based_remove_leader_shard_replica_and_add_it_back" 01:10:32 reference somewhere inside) 01:10:32 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_remove_leader_shard_replica_and_add_it_back&order=bug_status" 01:10:32 01:10:32 HTTPError: 404 Client Error: Not Found for url: http://10.30.171.173:8181/restconf/operations/cluster-admin:remove-shard-replica 01:10:32 ------------------------------------------------------------------------------ 01:10:32 Remove_Follower_Shard_Replica_And_Add_It_Back :: Remove and add sh... | FAIL | 01:10:33 ... click for list of related bugs or create a new one if needed (with the 01:10:33 "controller_clustering_tell_txt_ddb_sanity_module_based_remove_follower_shard_replica_and_add_it_back" 01:10:33 reference somewhere inside) 01:10:33 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_remove_follower_shard_replica_and_add_it_back&order=bug_status" 01:10:33 01:10:33 HTTPError: 404 Client Error: Not Found for url: http://10.30.171.250:8181/restconf/operations/cluster-admin:remove-shard-replica 01:10:33 ------------------------------------------------------------------------------ 01:10:33 Write_Transactions_One_Node_Leader :: Write transactions. | PASS | 01:11:35 ------------------------------------------------------------------------------ 01:11:35 Write_Transactions_One_Node_Follower :: Write transactions. | PASS | 01:12:38 ------------------------------------------------------------------------------ 01:12:38 Write_Transactions_All_Nodes :: Write transactions. | PASS | 01:13:45 ------------------------------------------------------------------------------ 01:13:45 controller-clustering-tell.txt.Ddb-Sanity-Module-Based :: DOMDataB... | FAIL | 01:13:45 9 tests, 3 passed, 6 failed 01:13:45 ============================================================================== 01:13:45 controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... 01:13:45 ============================================================================== 01:13:49 Stop_All_Members :: Stop every odl node. | FAIL | 01:19:58 Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 01:19:58 ------------------------------------------------------------------------------ 01:19:58 Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | 01:20:08 ------------------------------------------------------------------------------ 01:20:08 Start_All_And_Sync :: Start each member and wait for sync. | FAIL | 01:26:16 Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.198:8181/jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore 01:26:16 ------------------------------------------------------------------------------ 01:26:16 controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL | 01:26:16 3 tests, 1 passed, 2 failed 01:26:16 ============================================================================== 01:26:16 controller-clustering-tell.txt.Clean Leader Shutdown :: DOMDataBroker testi... 01:26:16 ============================================================================== 01:26:49 Local_Leader_Shutdown :: Shutdown the leader on the same node as t... | FAIL | 01:29:10 ... click for list of related bugs or create a new one if needed (with the 01:29:10 "controller_clustering_tell_txt_clean_leader_shutdown_local_leader_shutdown" 01:29:10 reference somewhere inside) 01:29:10 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_clean_leader_shutdown_local_leader_shutdown&order=bug_status" 01:29:10 01:29:10 HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.198:8181/jolokia/read/org.opendaylight.controller:Category=Shards,name=member-2-shard-default-config,type=DistributedConfigDatastore 01:29:10 ------------------------------------------------------------------------------ 01:29:10 Restart :: Restart odl | FAIL | 01:35:39 ... click for list of related bugs or create a new one if needed (with the 01:35:39 "controller_clustering_tell_txt_clean_leader_shutdown_restart" 01:35:39 reference somewhere inside) 01:35:39 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_clean_leader_shutdown_restart&order=bug_status" 01:35:39 01:35:39 Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 01:35:39 ------------------------------------------------------------------------------ 01:35:39 Remote_Leader_Shutdown :: Shutdown the leader on different node as... | FAIL | 01:38:09 ... click for list of related bugs or create a new one if needed (with the 01:38:09 "controller_clustering_tell_txt_clean_leader_shutdown_remote_leader_shutdown" 01:38:09 reference somewhere inside) 01:38:09 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_clean_leader_shutdown_remote_leader_shutdown&order=bug_status" 01:38:09 01:38:09 ConnectionError: HTTPConnectionPool(host='10.30.171.250', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError("HTTPConnection(host='10.30.171.250', port=8181): Failed to establish a new connection: [Errno 111] Connection refused")) 01:38:09 ------------------------------------------------------------------------------ 01:38:09 controller-clustering-tell.txt.Clean Leader Shutdown :: DOMDataBro... | FAIL | 01:38:09 3 tests, 0 passed, 3 failed 01:38:09 ============================================================================== 01:38:09 controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... 01:38:09 ============================================================================== 01:38:45 Stop_All_Members :: Stop every odl node. | FAIL | 01:44:48 Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 01:44:48 ------------------------------------------------------------------------------ 01:44:48 Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | 01:44:58 ------------------------------------------------------------------------------ 01:44:58 Start_All_And_Sync :: Start each member and wait for sync. | FAIL | 01:51:08 Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.198:8181/jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore 01:51:08 ------------------------------------------------------------------------------ 01:51:08 controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL | 01:51:08 3 tests, 1 passed, 2 failed 01:51:08 ============================================================================== 01:51:08 controller-clustering-tell.txt.Explicit Leader Movement :: DOMDataBroker te... 01:51:08 ============================================================================== 01:51:41 Local_To_Remote_Movement :: Leader moves from local to remote node... | FAIL | 01:52:01 ... click for list of related bugs or create a new one if needed (with the 01:52:01 "controller_clustering_tell_txt_explicit_leader_movement_local_to_remote_movement" 01:52:01 reference somewhere inside) 01:52:01 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_local_to_remote_movement&order=bug_status" 01:52:01 01:52:01 HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.198:8181/jolokia/read/org.opendaylight.controller:Category=Shards,name=member-2-shard-default-config,type=DistributedConfigDatastore 01:52:01 ------------------------------------------------------------------------------ 01:52:01 Restart1 :: Restart odl | FAIL | 01:58:31 ... click for list of related bugs or create a new one if needed (with the 01:58:31 "controller_clustering_tell_txt_explicit_leader_movement_restart1" 01:58:31 reference somewhere inside) 01:58:31 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_restart1&order=bug_status" 01:58:31 01:58:31 Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 01:58:31 ------------------------------------------------------------------------------ 01:58:31 Remote_To_Remote_Movement :: Leader moves from one remote to other... | FAIL | 01:59:01 ... click for list of related bugs or create a new one if needed (with the 01:59:01 "controller_clustering_tell_txt_explicit_leader_movement_remote_to_remote_movement" 01:59:01 reference somewhere inside) 01:59:01 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_remote_to_remote_movement&order=bug_status" 01:59:01 01:59:01 ConnectionError: HTTPConnectionPool(host='10.30.171.250', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError("HTTPConnection(host='10.30.171.250', port=8181): Failed to establish a new connection: [Errno 111] Connection refused")) 01:59:01 ------------------------------------------------------------------------------ 01:59:01 Restart2 :: Restart odl | FAIL | 02:05:27 ... click for list of related bugs or create a new one if needed (with the 02:05:27 "controller_clustering_tell_txt_explicit_leader_movement_restart2" 02:05:27 reference somewhere inside) 02:05:27 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_restart2&order=bug_status" 02:05:27 02:05:27 Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 02:05:27 ------------------------------------------------------------------------------ 02:05:27 Remote_To_Local_Movement :: Leader moves from remote to local node... | FAIL | 02:05:47 ... click for list of related bugs or create a new one if needed (with the 02:05:47 "controller_clustering_tell_txt_explicit_leader_movement_remote_to_local_movement" 02:05:47 reference somewhere inside) 02:05:47 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_remote_to_local_movement&order=bug_status" 02:05:47 02:05:47 ConnectionError: HTTPConnectionPool(host='10.30.171.250', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError("HTTPConnection(host='10.30.171.250', port=8181): Failed to establish a new connection: [Errno 111] Connection refused")) 02:05:47 ------------------------------------------------------------------------------ 02:05:47 controller-clustering-tell.txt.Explicit Leader Movement :: DOMData... | FAIL | 02:05:47 5 tests, 0 passed, 5 failed 02:05:47 ============================================================================== 02:05:47 controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... 02:05:47 ============================================================================== 02:06:23 Stop_All_Members :: Stop every odl node. | FAIL | 02:12:27 Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 02:12:27 ------------------------------------------------------------------------------ 02:12:27 Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | 02:12:36 ------------------------------------------------------------------------------ 02:12:36 Start_All_And_Sync :: Start each member and wait for sync. | FAIL | 02:18:40 Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: Index 1 has incorrect status: False 02:18:40 ------------------------------------------------------------------------------ 02:18:40 controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL | 02:18:40 3 tests, 1 passed, 2 failed 02:18:40 ============================================================================== 02:18:40 controller-clustering-tell.txt.Leader Isolation :: DOMDataBroker testing: L... 02:18:40 ============================================================================== 02:19:13 Healing_Within_Request_Timeout :: The isolated node (leader) is re... | FAIL | 02:19:34 ... click for list of related bugs or create a new one if needed (with the 02:19:34 "controller_clustering_tell_txt_leader_isolation_healing_within_request_timeout" 02:19:34 reference somewhere inside) 02:19:34 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_leader_isolation_healing_within_request_timeout&order=bug_status" 02:19:34 02:19:34 HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.198:8181/jolokia/read/org.opendaylight.controller:Category=Shards,name=member-2-shard-default-config,type=DistributedConfigDatastore 02:19:34 ------------------------------------------------------------------------------ 02:19:34 Restart :: Restart odl | FAIL | 02:26:07 ... click for list of related bugs or create a new one if needed (with the 02:26:07 "controller_clustering_tell_txt_leader_isolation_restart" 02:26:07 reference somewhere inside) 02:26:07 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_leader_isolation_restart&order=bug_status" 02:26:07 02:26:07 Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 02:26:07 ------------------------------------------------------------------------------ 02:26:07 Healing_After_Request_Timeout :: The isolated node (leader) is rej... | FAIL | 02:26:38 ... click for list of related bugs or create a new one if needed (with the 02:26:38 "controller_clustering_tell_txt_leader_isolation_healing_after_request_timeout" 02:26:38 reference somewhere inside) 02:26:38 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_leader_isolation_healing_after_request_timeout&order=bug_status" 02:26:38 02:26:38 ConnectionError: HTTPConnectionPool(host='10.30.171.250', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError("HTTPConnection(host='10.30.171.250', port=8181): Failed to establish a new connection: [Errno 111] Connection refused")) 02:26:38 ------------------------------------------------------------------------------ 02:26:38 controller-clustering-tell.txt.Leader Isolation :: DOMDataBroker t... | FAIL | 02:26:38 3 tests, 0 passed, 3 failed 02:26:38 ============================================================================== 02:26:38 controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... 02:26:38 ============================================================================== 02:27:13 Stop_All_Members :: Stop every odl node. | FAIL | 02:33:18 Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 02:33:18 ------------------------------------------------------------------------------ 02:33:18 Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | 02:33:27 ------------------------------------------------------------------------------ 02:33:27 Start_All_And_Sync :: Start each member and wait for sync. | FAIL | 02:39:35 Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: Index 1 has incorrect status: False 02:39:35 ------------------------------------------------------------------------------ 02:39:35 controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL | 02:39:35 3 tests, 1 passed, 2 failed 02:39:35 ============================================================================== 02:39:35 controller-clustering-tell.txt.Client Isolation :: DOMDataBroker testing: C... 02:39:35 ============================================================================== 02:40:08 Producer_On_Shard_Leader_Node_ChainedTx :: Client isolation with p... | FAIL | 02:41:48 ... click for list of related bugs or create a new one if needed (with the 02:41:48 "controller_clustering_tell_txt_client_isolation_producer_on_shard_leader_node_chainedtx" 02:41:48 reference somewhere inside) 02:41:48 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_producer_on_shard_leader_node_chainedtx&order=bug_status" 02:41:48 02:41:48 HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.198:8181/jolokia/read/org.opendaylight.controller:Category=Shards,name=member-2-shard-default-config,type=DistributedConfigDatastore 02:41:48 02:41:48 Also keyword teardown failed: 02:41:48 Several failures occurred: 02:41:48 02:41:48 1) Variable '${client_node_dst}' not found. 02:41:48 02:41:48 2) Variable '${client_node_dst}' not found. 02:41:48 02:41:48 3) Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 1 minute 10 seconds. The last error was: Several failures occurred: 02:41:48 02:41:48 1) HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.198:8181/jolokia/read/org.opendaylight.controller:Category=Shards,name=member-2-shard-default-config,type=DistributedConfigDatastore 02:41:48 02:41:48 2) Resolving variable '${response.text}' failed: AttributeError: 'NoneType' object has no attribute 'text' 02:41:48 [ Message content over the limit has been removed. ] 02:41:48 ...se.text}' failed: AttributeError: 'NoneType' object has no attribute 'text' 02:41:48 02:41:48 120) Evaluating expression "json.loads('''None''')" failed: JSONDecodeError: Expecting value: line 1 column 1 (char 0) 02:41:48 02:41:48 121) ValueError: Argument 'dictionary' got value 'None' (None) that cannot be converted to Mapping. 02:41:48 02:41:48 122) ValueError: Argument 'dictionary' got value 'None' (None) that cannot be converted to Mapping. 02:41:48 02:41:48 123) Unrecognized Raft state: None 02:41:48 02:41:48 124) No leader found. 02:41:48 02:41:48 125) Too many Leaders. 02:41:48 02:41:48 126) IndexError: Given index 0 is out of the range 0--1. 02:41:48 02:41:48 4) KeyError: 'threads' 02:41:48 ------------------------------------------------------------------------------ 02:41:48 Restart1 :: Restart odl | FAIL | 02:48:18 ... click for list of related bugs or create a new one if needed (with the 02:48:18 "controller_clustering_tell_txt_client_isolation_restart1" 02:48:18 reference somewhere inside) 02:48:18 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_restart1&order=bug_status" 02:48:18 02:48:18 Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 02:48:18 ------------------------------------------------------------------------------ 02:48:18 Producer_On_Shard_Leader_Node_SimpleTx :: Client isolation with pr... | FAIL | 02:50:08 ... click for list of related bugs or create a new one if needed (with the 02:50:08 "controller_clustering_tell_txt_client_isolation_producer_on_shard_leader_node_simpletx" 02:50:08 reference somewhere inside) 02:50:08 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_producer_on_shard_leader_node_simpletx&order=bug_status" 02:50:08 02:50:08 ConnectionError: HTTPConnectionPool(host='10.30.171.250', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError("HTTPConnection(host='10.30.171.250', port=8181): Failed to establish a new connection: [Errno 111] Connection refused")) 02:50:08 02:50:08 Also keyword teardown failed: 02:50:08 Several failures occurred: 02:50:08 02:50:08 1) Variable '${client_node_dst}' not found. 02:50:08 02:50:08 2) Variable '${client_node_dst}' not found. 02:50:08 02:50:08 3) Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 1 minute 10 seconds. The last error was: Several failures occurred: 02:50:08 02:50:08 1) ConnectionError: HTTPConnectionPool(host='10.30.171.250', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError("HTTPConnection(host='10.30.171.250', port=8181): ... 02:50:08 [ Message content over the limit has been removed. ] 02:50:08 ...se.text}' failed: AttributeError: 'NoneType' object has no attribute 'text' 02:50:08 02:50:08 174) Evaluating expression "json.loads('''None''')" failed: JSONDecodeError: Expecting value: line 1 column 1 (char 0) 02:50:08 02:50:08 175) ValueError: Argument 'dictionary' got value 'None' (None) that cannot be converted to Mapping. 02:50:08 02:50:08 176) ValueError: Argument 'dictionary' got value 'None' (None) that cannot be converted to Mapping. 02:50:08 02:50:08 177) Unrecognized Raft state: None 02:50:08 02:50:08 178) No leader found. 02:50:08 02:50:08 179) Too many Leaders. 02:50:08 02:50:08 180) IndexError: Given index 0 is out of the range 0--1. 02:50:08 02:50:08 4) KeyError: 'threads' 02:50:08 ------------------------------------------------------------------------------ 02:50:08 Restart2 :: Restart odl | FAIL | 02:56:34 ... click for list of related bugs or create a new one if needed (with the 02:56:34 "controller_clustering_tell_txt_client_isolation_restart2" 02:56:34 reference somewhere inside) 02:56:34 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_restart2&order=bug_status" 02:56:34 02:56:34 Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 02:56:34 ------------------------------------------------------------------------------ 02:56:34 Producer_On_Shard_Non_Leader_Node_ChainedTx :: Client isolation wi... | FAIL | 02:58:13 ... click for list of related bugs or create a new one if needed (with the 02:58:13 "controller_clustering_tell_txt_client_isolation_producer_on_shard_non_leader_node_chainedtx" 02:58:13 reference somewhere inside) 02:58:13 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_producer_on_shard_non_leader_node_chainedtx&order=bug_status" 02:58:13 02:58:13 ConnectionError: HTTPConnectionPool(host='10.30.171.250', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError("HTTPConnection(host='10.30.171.250', port=8181): Failed to establish a new connection: [Errno 111] Connection refused")) 02:58:13 02:58:13 Also keyword teardown failed: 02:58:13 Several failures occurred: 02:58:13 02:58:13 1) Variable '${client_node_dst}' not found. 02:58:13 02:58:13 2) Variable '${client_node_dst}' not found. 02:58:13 02:58:13 3) Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 1 minute 10 seconds. The last error was: Several failures occurred: 02:58:13 02:58:13 1) ConnectionError: HTTPConnectionPool(host='10.30.171.250', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError("HTTPConnection(host='10.30.171.250', port=8181): ... 02:58:13 [ Message content over the limit has been removed. ] 02:58:13 ...se.text}' failed: AttributeError: 'NoneType' object has no attribute 'text' 02:58:13 02:58:13 174) Evaluating expression "json.loads('''None''')" failed: JSONDecodeError: Expecting value: line 1 column 1 (char 0) 02:58:13 02:58:13 175) ValueError: Argument 'dictionary' got value 'None' (None) that cannot be converted to Mapping. 02:58:13 02:58:13 176) ValueError: Argument 'dictionary' got value 'None' (None) that cannot be converted to Mapping. 02:58:13 02:58:13 177) Unrecognized Raft state: None 02:58:13 02:58:13 178) No leader found. 02:58:13 02:58:13 179) Too many Leaders. 02:58:13 02:58:13 180) IndexError: Given index 0 is out of the range 0--1. 02:58:13 02:58:13 4) KeyError: 'threads' 02:58:13 ------------------------------------------------------------------------------ 02:58:13 Restart3 :: Restart odl | FAIL | 03:04:38 ... click for list of related bugs or create a new one if needed (with the 03:04:38 "controller_clustering_tell_txt_client_isolation_restart3" 03:04:38 reference somewhere inside) 03:04:38 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_restart3&order=bug_status" 03:04:38 03:04:38 Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 03:04:38 ------------------------------------------------------------------------------ 03:04:38 Producer_On_Shard_Non_Leader_Node_SimpleTx :: Client isolation wit... | FAIL | 03:06:18 ... click for list of related bugs or create a new one if needed (with the 03:06:18 "controller_clustering_tell_txt_client_isolation_producer_on_shard_non_leader_node_simpletx" 03:06:18 reference somewhere inside) 03:06:18 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_producer_on_shard_non_leader_node_simpletx&order=bug_status" 03:06:18 03:06:18 ConnectionError: HTTPConnectionPool(host='10.30.171.250', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError("HTTPConnection(host='10.30.171.250', port=8181): Failed to establish a new connection: [Errno 111] Connection refused")) 03:06:18 03:06:18 Also keyword teardown failed: 03:06:18 Several failures occurred: 03:06:18 03:06:18 1) Variable '${client_node_dst}' not found. 03:06:18 03:06:18 2) Variable '${client_node_dst}' not found. 03:06:18 03:06:18 3) Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 1 minute 10 seconds. The last error was: Several failures occurred: 03:06:18 03:06:18 1) ConnectionError: HTTPConnectionPool(host='10.30.171.250', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError("HTTPConnection(host='10.30.171.250', port=8181): ... 03:06:18 [ Message content over the limit has been removed. ] 03:06:18 ...se.text}' failed: AttributeError: 'NoneType' object has no attribute 'text' 03:06:18 03:06:18 174) Evaluating expression "json.loads('''None''')" failed: JSONDecodeError: Expecting value: line 1 column 1 (char 0) 03:06:18 03:06:18 175) ValueError: Argument 'dictionary' got value 'None' (None) that cannot be converted to Mapping. 03:06:18 03:06:18 176) ValueError: Argument 'dictionary' got value 'None' (None) that cannot be converted to Mapping. 03:06:18 03:06:18 177) Unrecognized Raft state: None 03:06:18 03:06:18 178) No leader found. 03:06:18 03:06:18 179) Too many Leaders. 03:06:18 03:06:18 180) IndexError: Given index 0 is out of the range 0--1. 03:06:18 03:06:18 4) KeyError: 'threads' 03:06:18 ------------------------------------------------------------------------------ 03:06:18 controller-clustering-tell.txt.Client Isolation :: DOMDataBroker t... | FAIL | 03:06:18 7 tests, 0 passed, 7 failed 03:06:18 ============================================================================== 03:06:18 controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... 03:06:18 ============================================================================== 03:06:54 Stop_All_Members :: Stop every odl node. | FAIL | 03:13:00 Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 03:13:00 ------------------------------------------------------------------------------ 03:13:00 Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | 03:13:09 ------------------------------------------------------------------------------ 03:13:09 Start_All_And_Sync :: Start each member and wait for sync. | FAIL | 03:19:17 Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: Index 1 has incorrect status: False 03:19:17 ------------------------------------------------------------------------------ 03:19:17 controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL | 03:19:17 3 tests, 1 passed, 2 failed 03:19:17 ============================================================================== 03:19:17 controller-clustering-tell.txt.Listener Stability :: DOMDataBroker testing:... 03:19:17 ============================================================================== 03:19:49 Move_Leader_From_Listener_Local_To_Remote :: Listener runs on lead... | FAIL | 03:20:10 ... click for list of related bugs or create a new one if needed (with the 03:20:10 "controller_clustering_tell_txt_listener_stability_move_leader_from_listener_local_to_remote" 03:20:10 reference somewhere inside) 03:20:10 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_listener_stability_move_leader_from_listener_local_to_remote&order=bug_status" 03:20:10 03:20:10 HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.198:8181/jolokia/read/org.opendaylight.controller:Category=Shards,name=member-2-shard-default-config,type=DistributedConfigDatastore 03:20:10 ------------------------------------------------------------------------------ 03:20:10 Restart_1 :: Restart odl. | FAIL | 03:26:40 ... click for list of related bugs or create a new one if needed (with the 03:26:40 "controller_clustering_tell_txt_listener_stability_restart_1" 03:26:40 reference somewhere inside) 03:26:40 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_listener_stability_restart_1&order=bug_status" 03:26:40 03:26:40 Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 03:26:40 ------------------------------------------------------------------------------ 03:26:40 Move_Leader_From_Listener_Remote_To_Other_Remote :: Listener runs ... | FAIL | 03:27:10 ... click for list of related bugs or create a new one if needed (with the 03:27:10 "controller_clustering_tell_txt_listener_stability_move_leader_from_listener_remote_to_other_remote" 03:27:10 reference somewhere inside) 03:27:10 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_listener_stability_move_leader_from_listener_remote_to_other_remote&order=bug_status" 03:27:10 03:27:10 ConnectionError: HTTPConnectionPool(host='10.30.171.250', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError("HTTPConnection(host='10.30.171.250', port=8181): Failed to establish a new connection: [Errno 111] Connection refused")) 03:27:10 ------------------------------------------------------------------------------ 03:27:10 Restart_2 :: Restart odl. | FAIL | 03:33:41 ... click for list of related bugs or create a new one if needed (with the 03:33:41 "controller_clustering_tell_txt_listener_stability_restart_2" 03:33:41 reference somewhere inside) 03:33:41 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_listener_stability_restart_2&order=bug_status" 03:33:41 03:33:41 Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 03:33:41 ------------------------------------------------------------------------------ 03:33:41 Move_Leader_From_Listener_Remote_To_Local :: Listener runs on foll... | FAIL | 03:34:01 ... click for list of related bugs or create a new one if needed (with the 03:34:01 "controller_clustering_tell_txt_listener_stability_move_leader_from_listener_remote_to_local" 03:34:01 reference somewhere inside) 03:34:01 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_listener_stability_move_leader_from_listener_remote_to_local&order=bug_status" 03:34:01 03:34:01 ConnectionError: HTTPConnectionPool(host='10.30.171.250', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError("HTTPConnection(host='10.30.171.250', port=8181): Failed to establish a new connection: [Errno 111] Connection refused")) 03:34:01 ------------------------------------------------------------------------------ 03:34:01 controller-clustering-tell.txt.Listener Stability :: DOMDataBroker... | FAIL | 03:34:01 5 tests, 0 passed, 5 failed 03:34:01 ============================================================================== 03:34:01 controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... 03:34:01 ============================================================================== 03:34:37 Stop_All_Members :: Stop every odl node. | FAIL | 03:40:42 Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 03:40:42 ------------------------------------------------------------------------------ 03:40:42 Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | 03:40:51 ------------------------------------------------------------------------------ 03:40:51 Start_All_And_Sync :: Start each member and wait for sync. | FAIL | 03:46:59 Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: Index 1 has incorrect status: False 03:46:59 ------------------------------------------------------------------------------ 03:46:59 controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL | 03:46:59 3 tests, 1 passed, 2 failed 03:46:59 ============================================================================== 03:46:59 controller-clustering-tell.txt.Master Stability :: Cluster Singleton testin... 03:46:59 ============================================================================== 03:47:31 Register_Singleton_Constant_On_Each_Node_And_Verify :: Register a ... | FAIL | 03:47:53 ... click for list of related bugs or create a new one if needed (with the 03:47:53 "controller_clustering_tell_txt_master_stability_register_singleton_constant_on_each_node_and_verify" 03:47:53 reference somewhere inside) 03:47:53 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_register_singleton_constant_on_each_node_and_verify&order=bug_status" 03:47:53 03:47:53 HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.198:8181/rests/operations/odl-mdsal-lowlevel-control:register-singleton-constant 03:47:53 ------------------------------------------------------------------------------ 03:47:53 Unregister_Singleton_Constant_On_Non_Master_Node :: Unregister the... | FAIL | 03:48:13 ... click for list of related bugs or create a new one if needed (with the 03:48:13 "controller_clustering_tell_txt_master_stability_unregister_singleton_constant_on_non_master_node" 03:48:13 reference somewhere inside) 03:48:13 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_unregister_singleton_constant_on_non_master_node&order=bug_status" 03:48:13 03:48:13 Variable '@{cs_candidates}' not found. Did you mean: 03:48:13 @{cs_exp_candidates} 03:48:13 ------------------------------------------------------------------------------ 03:48:13 Monitor_Stability_While_Unregistered :: Verify that the owner rema... | FAIL | 03:48:33 ... click for list of related bugs or create a new one if needed (with the 03:48:33 "controller_clustering_tell_txt_master_stability_monitor_stability_while_unregistered" 03:48:33 reference somewhere inside) 03:48:33 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_monitor_stability_while_unregistered&order=bug_status" 03:48:33 03:48:33 Variable '${cs_owner}' not found. 03:48:33 ------------------------------------------------------------------------------ 03:48:33 Reregister_Singleton_Constant :: Re-register the unregistered cand... | FAIL | 03:48:54 ... click for list of related bugs or create a new one if needed (with the 03:48:54 "controller_clustering_tell_txt_master_stability_reregister_singleton_constant" 03:48:54 reference somewhere inside) 03:48:54 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_reregister_singleton_constant&order=bug_status" 03:48:54 03:48:54 Variable '${unregistered_node}' not found. 03:48:54 ------------------------------------------------------------------------------ 03:48:54 Verify_Stability_After_Reregistration :: Verify that the owner rem... | FAIL | 03:49:14 ... click for list of related bugs or create a new one if needed (with the 03:49:14 "controller_clustering_tell_txt_master_stability_verify_stability_after_reregistration" 03:49:14 reference somewhere inside) 03:49:14 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_verify_stability_after_reregistration&order=bug_status" 03:49:14 03:49:14 Variable '${cs_owner}' not found. 03:49:14 ------------------------------------------------------------------------------ 03:49:14 Unregister_Singleton_Constant_On_Each_Node :: Unregister the appli... | FAIL | 03:49:35 ... click for list of related bugs or create a new one if needed (with the 03:49:35 "controller_clustering_tell_txt_master_stability_unregister_singleton_constant_on_each_node" 03:49:35 reference somewhere inside) 03:49:35 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_unregister_singleton_constant_on_each_node&order=bug_status" 03:49:35 03:49:35 HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.198:8181/rests/operations/odl-mdsal-lowlevel-control:unregister-singleton-constant 03:49:35 ------------------------------------------------------------------------------ 03:49:35 controller-clustering-tell.txt.Master Stability :: Cluster Singlet... | FAIL | 03:49:35 6 tests, 0 passed, 6 failed 03:49:35 ============================================================================== 03:49:35 controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... 03:49:35 ============================================================================== 03:50:08 Stop_All_Members :: Stop every odl node. | FAIL | 03:56:16 Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 03:56:16 ------------------------------------------------------------------------------ 03:56:16 Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | 03:56:28 ------------------------------------------------------------------------------ 03:56:28 Start_All_And_Sync :: Start each member and wait for sync. | FAIL | 04:02:35 Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: Index 1 has incorrect status: False 04:02:35 ------------------------------------------------------------------------------ 04:02:35 controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL | 04:02:35 3 tests, 1 passed, 2 failed 04:02:35 ============================================================================== 04:02:35 controller-clustering-tell.txt.Partition And Heal :: Cluster Singleton test... 04:02:35 ============================================================================== 04:03:08 Register_Singleton_Constant_On_Each_Node :: Register a candidate a... | FAIL | 04:03:29 ... click for list of related bugs or create a new one if needed (with the 04:03:29 "controller_clustering_tell_txt_partition_and_heal_register_singleton_constant_on_each_node" 04:03:29 reference somewhere inside) 04:03:29 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_register_singleton_constant_on_each_node&order=bug_status" 04:03:29 04:03:29 HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.198:8181/rests/operations/odl-mdsal-lowlevel-control:register-singleton-constant 04:03:29 ------------------------------------------------------------------------------ 04:03:29 Verify_Singleton_Constant_On_Each_Node :: Store the owner and cand... | FAIL | 04:03:49 ... click for list of related bugs or create a new one if needed (with the 04:03:49 "controller_clustering_tell_txt_partition_and_heal_verify_singleton_constant_on_each_node" 04:03:49 reference somewhere inside) 04:03:49 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_verify_singleton_constant_on_each_node&order=bug_status" 04:03:49 04:03:49 Could not parse owner and candidates for device get-singleton-constant-service'] 04:03:49 ------------------------------------------------------------------------------ 04:03:49 Isolate_Owner_Node :: Isolate the cluster node which is the owner.... | FAIL | 04:04:10 ... click for list of related bugs or create a new one if needed (with the 04:04:10 "controller_clustering_tell_txt_partition_and_heal_isolate_owner_node" 04:04:10 reference somewhere inside) 04:04:10 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_isolate_owner_node&order=bug_status" 04:04:10 04:04:10 Variable '${cs_owner}' not found. 04:04:10 ------------------------------------------------------------------------------ 04:04:10 Monitor_Stability_While_Isolated :: Monitor the stability of the s... | FAIL | 04:04:30 ... click for list of related bugs or create a new one if needed (with the 04:04:30 "controller_clustering_tell_txt_partition_and_heal_monitor_stability_while_isolated" 04:04:30 reference somewhere inside) 04:04:30 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_monitor_stability_while_isolated&order=bug_status" 04:04:30 04:04:30 Invalid IF condition: Evaluating expression '"${index}" == "${cs_isolated_index}"' failed: Variable '${cs_isolated_index}' not found. 04:04:30 ------------------------------------------------------------------------------ 04:04:30 Rejoin_Isolated_node :: Rejoin isolated node. | FAIL | 04:04:50 ... click for list of related bugs or create a new one if needed (with the 04:04:50 "controller_clustering_tell_txt_partition_and_heal_rejoin_isolated_node" 04:04:50 reference somewhere inside) 04:04:50 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_rejoin_isolated_node&order=bug_status" 04:04:50 04:04:50 Variable '${cs_isolated_index}' not found. 04:04:50 ------------------------------------------------------------------------------ 04:04:50 Unregister_Singleton_Constant_On_Each_Node :: Unregister the appli... | FAIL | 04:05:11 ... click for list of related bugs or create a new one if needed (with the 04:05:11 "controller_clustering_tell_txt_partition_and_heal_unregister_singleton_constant_on_each_node" 04:05:11 reference somewhere inside) 04:05:11 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_unregister_singleton_constant_on_each_node&order=bug_status" 04:05:11 04:05:11 HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.198:8181/rests/operations/odl-mdsal-lowlevel-control:unregister-singleton-constant 04:05:11 ------------------------------------------------------------------------------ 04:05:11 controller-clustering-tell.txt.Partition And Heal :: Cluster Singl... | FAIL | 04:05:11 6 tests, 0 passed, 6 failed 04:05:11 ============================================================================== 04:05:11 controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... 04:05:11 ============================================================================== 04:05:44 Stop_All_Members :: Stop every odl node. | FAIL | 04:11:53 Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 04:11:53 ------------------------------------------------------------------------------ 04:11:53 Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | 04:12:02 ------------------------------------------------------------------------------ 04:12:02 Start_All_And_Sync :: Start each member and wait for sync. | FAIL | 04:18:09 Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: Index 1 has incorrect status: False 04:18:09 ------------------------------------------------------------------------------ 04:18:09 controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL | 04:18:09 3 tests, 1 passed, 2 failed 04:18:09 ============================================================================== 04:18:09 controller-clustering-tell.txt.Chasing The Leader :: Cluster Singleton test... 04:18:09 ============================================================================== 04:18:45 Register_Candidates :: Register a candidate application on each no... | FAIL | 04:19:06 ... click for list of related bugs or create a new one if needed (with the 04:19:06 "controller_clustering_tell_txt_chasing_the_leader_register_candidates" 04:19:06 reference somewhere inside) 04:19:06 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_chasing_the_leader_register_candidates&order=bug_status" 04:19:06 04:19:06 HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.198:8181/rests/operations/odl-mdsal-lowlevel-control:register-flapping-singleton 04:19:06 ------------------------------------------------------------------------------ 04:19:06 Do_Nothing :: Do nothing for the time of the test duration, becaus... | PASS | 04:20:27 ------------------------------------------------------------------------------ 04:20:27 Unregister_Candidates_And_Validate_Criteria :: Unregister the test... | FAIL | 04:20:48 ... click for list of related bugs or create a new one if needed (with the 04:20:48 "controller_clustering_tell_txt_chasing_the_leader_unregister_candidates_and_validate_criteria" 04:20:48 reference somewhere inside) 04:20:48 "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_chasing_the_leader_unregister_candidates_and_validate_criteria&order=bug_status" 04:20:48 04:20:48 HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.198:8181/rests/operations/odl-mdsal-lowlevel-control:unregister-flapping-singleton 04:20:48 ------------------------------------------------------------------------------ 04:20:48 controller-clustering-tell.txt.Chasing The Leader :: Cluster Singl... | FAIL | 04:20:48 3 tests, 1 passed, 2 failed 04:20:48 ============================================================================== 04:20:48 controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... 04:20:48 ============================================================================== 04:21:21 Stop_All_Members :: Stop every odl node. | FAIL | 04:27:29 Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 04:27:29 ------------------------------------------------------------------------------ 04:27:29 Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | 04:27:39 ------------------------------------------------------------------------------ 04:27:39 Start_All_And_Sync :: Start each member and wait for sync. | FAIL | 04:33:47 Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.198:8181/jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore 04:33:47 ------------------------------------------------------------------------------ 04:33:47 controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL | 04:33:47 3 tests, 1 passed, 2 failed 04:33:47 ============================================================================== 04:33:47 controller-clustering-tell.txt.Carpeople Crud :: Suite for performing basic... 04:33:47 ============================================================================== 04:34:20 Add_Cars_To_Leader :: Add 30 cars to car Leader by one big PUT. | FAIL | 04:34:20 Parent suite setup failed: 04:34:20 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:34:20 ------------------------------------------------------------------------------ 04:34:20 See_Added_Cars_On_Leader :: GET response from Leader should match ... | FAIL | 04:34:20 Parent suite setup failed: 04:34:20 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:34:20 ------------------------------------------------------------------------------ 04:34:20 See_Added_Cars_On_Followers :: The same check on other members. | FAIL | 04:34:20 Parent suite setup failed: 04:34:20 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:34:20 ------------------------------------------------------------------------------ 04:34:20 Add_People_To_First_Follower :: Add 30 people to people first Foll... | FAIL | 04:34:20 Parent suite setup failed: 04:34:20 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:34:20 ------------------------------------------------------------------------------ 04:34:20 See_Added_People_On_Leader :: GET response from Leader should matc... | FAIL | 04:34:20 Parent suite setup failed: 04:34:20 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:34:20 ------------------------------------------------------------------------------ 04:34:20 See_Added_People_On_Followers :: The same check on other members. | FAIL | 04:34:20 Parent suite setup failed: 04:34:20 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:34:20 ------------------------------------------------------------------------------ 04:34:20 Buy_Cars_On_Leader :: Buy some cars on car-people Leader, loop of ... | FAIL | 04:34:20 Parent suite setup failed: 04:34:20 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:34:20 ------------------------------------------------------------------------------ 04:34:20 Buy_Cars_On_Followers :: On each Follower buy corresponding ID seg... | FAIL | 04:34:20 Parent suite setup failed: 04:34:20 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:34:20 ------------------------------------------------------------------------------ 04:34:20 See_Added_CarPeople_On_Leader :: GET car-person mappings from Lead... | FAIL | 04:34:20 Parent suite setup failed: 04:34:20 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:34:20 ------------------------------------------------------------------------------ 04:34:20 See_Added_CarPeople_On_Followers :: The same check on other members. | FAIL | 04:34:20 Parent suite setup failed: 04:34:20 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:34:20 ------------------------------------------------------------------------------ 04:34:20 Delete_All_CarPeople_On_Leader :: DELETE car-people container. No ... | FAIL | 04:34:20 Parent suite setup failed: 04:34:20 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:34:20 ------------------------------------------------------------------------------ 04:34:20 Delete_All_People_On_Leader :: DELETE people container. No verific... | FAIL | 04:34:20 Parent suite setup failed: 04:34:20 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:34:20 ------------------------------------------------------------------------------ 04:34:20 Delete_All_Cars_On_Leader :: DELETE cars container. No verificatio... | FAIL | 04:34:20 Parent suite setup failed: 04:34:20 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:34:20 ------------------------------------------------------------------------------ 04:34:20 controller-clustering-tell.txt.Carpeople Crud :: Suite for perform... | FAIL | 04:34:20 Suite setup failed: 04:34:20 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:34:20 04:34:20 13 tests, 0 passed, 13 failed 04:34:20 ============================================================================== 04:34:21 controller-clustering-tell.txt.Car Failover Crud :: Suite mixing basic oper... 04:34:21 ============================================================================== 04:34:53 Add_Original_Cars_On_Old_Leader_And_Verify :: Add initial cars on ... | FAIL | 04:34:53 Parent suite setup failed: 04:34:53 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:34:53 ------------------------------------------------------------------------------ 04:34:53 Stop_Original_Car_Leader :: Stop the car Leader to cause a new lea... | FAIL | 04:34:53 Parent suite setup failed: 04:34:53 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:34:53 ------------------------------------------------------------------------------ 04:34:53 Wait_For_New_Leader :: Wait until new car Leader is elected. | FAIL | 04:34:53 Parent suite setup failed: 04:34:53 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:34:53 ------------------------------------------------------------------------------ 04:34:53 See_Original_Cars_On_New_Leader :: GET cars from new Leader, shoul... | FAIL | 04:34:53 Parent suite setup failed: 04:34:53 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:34:53 ------------------------------------------------------------------------------ 04:34:53 See_Original_Cars_On_New_Followers :: The same check on other exis... | FAIL | 04:34:53 Parent suite setup failed: 04:34:53 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:34:53 ------------------------------------------------------------------------------ 04:34:53 Delete_Original_Cars_On_New_Leader :: Delete cars on the new Leader. | FAIL | 04:34:53 Parent suite setup failed: 04:34:53 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:34:53 ------------------------------------------------------------------------------ 04:34:53 Add_Leader_Cars_On_New_Leader :: Add cars on the new Leader. | FAIL | 04:34:53 Parent suite setup failed: 04:34:53 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:34:53 ------------------------------------------------------------------------------ 04:34:53 See_Leader_Cars_On_New_Leader :: GET cars from new Leader, should ... | FAIL | 04:34:53 Parent suite setup failed: 04:34:53 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:34:53 ------------------------------------------------------------------------------ 04:34:53 See_Leader_Cars_On_New_Followers :: The same check on other existi... | FAIL | 04:34:53 Parent suite setup failed: 04:34:53 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:34:53 ------------------------------------------------------------------------------ 04:34:53 Delete_Leader_Cars_On_New_First_Follower :: Delete cars in new fir... | FAIL | 04:34:53 Parent suite setup failed: 04:34:53 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:34:53 ------------------------------------------------------------------------------ 04:34:53 Add_Follower_Cars_On_New_First_Follower :: Add cars on the new fir... | FAIL | 04:34:53 Parent suite setup failed: 04:34:53 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:34:53 ------------------------------------------------------------------------------ 04:34:53 See_Folower_Cars_On_New_Leader :: Get cars from the new Leader, sh... | FAIL | 04:34:53 Parent suite setup failed: 04:34:53 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:34:53 ------------------------------------------------------------------------------ 04:34:53 See_Follower_Cars_On_New_Followers :: The same check on other exis... | FAIL | 04:34:53 Parent suite setup failed: 04:34:53 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:34:53 ------------------------------------------------------------------------------ 04:34:53 Start_Old_Car_Leader :: Start the stopped member without deleting ... | FAIL | 04:34:53 Parent suite setup failed: 04:34:53 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:34:53 ------------------------------------------------------------------------------ 04:34:53 See_Folower_Cars_On_Old_Leader :: GET cars from the restarted memb... | FAIL | 04:34:53 Parent suite setup failed: 04:34:53 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:34:53 ------------------------------------------------------------------------------ 04:34:53 Delete_Follower_Cars_On_New_Leader :: Delete cars on the last Leader. | FAIL | 04:34:53 Parent suite setup failed: 04:34:53 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:34:53 ------------------------------------------------------------------------------ 04:34:53 controller-clustering-tell.txt.Car Failover Crud :: Suite mixing b... | FAIL | 04:34:53 Suite setup failed: 04:34:53 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:34:53 04:34:53 16 tests, 0 passed, 16 failed 04:34:53 ============================================================================== 04:34:53 controller-clustering-tell.txt.Car Persistence Recovery :: This test restar... 04:34:53 ============================================================================== 04:35:26 Add_Cars_On_Leader_And_Verify :: Single big PUT to datastore to ad... | FAIL | 04:35:26 Parent suite setup failed: 04:35:26 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:35:26 ------------------------------------------------------------------------------ 04:35:26 Stop_All_Members :: Stop all controllers. | FAIL | 04:35:26 Parent suite setup failed: 04:35:26 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:35:26 ------------------------------------------------------------------------------ 04:35:26 Start_All_Members :: Start all controllers (should restore the per... | FAIL | 04:35:26 Parent suite setup failed: 04:35:26 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:35:26 ------------------------------------------------------------------------------ 04:35:26 Memorize_Leader_And_Followers :: Locate current Leader of car Shard. | FAIL | 04:35:26 Parent suite setup failed: 04:35:26 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:35:26 ------------------------------------------------------------------------------ 04:35:26 See_Cars_On_Leader :: GET cars from Leader, should match the PUT d... | FAIL | 04:35:26 Parent suite setup failed: 04:35:26 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:35:26 ------------------------------------------------------------------------------ 04:35:26 See_Cars_On_Followers :: The same check on other members. | FAIL | 04:35:26 Parent suite setup failed: 04:35:26 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:35:26 ------------------------------------------------------------------------------ 04:35:26 Delete_Cars_On_Leader :: Delete cars on the new Leader. | FAIL | 04:35:26 Parent suite setup failed: 04:35:26 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:35:26 ------------------------------------------------------------------------------ 04:35:26 controller-clustering-tell.txt.Car Persistence Recovery :: This te... | FAIL | 04:35:26 Suite setup failed: 04:35:26 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:35:26 04:35:26 7 tests, 0 passed, 7 failed 04:35:26 ============================================================================== 04:35:26 controller-clustering-tell.txt.Buycar Failover :: This test focuses on test... 04:35:26 ============================================================================== 04:35:58 Add_Cars_To_Leader_And_Verify :: Add all needed cars to car Leader... | FAIL | 04:35:58 Parent suite setup failed: 04:35:58 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:35:58 ------------------------------------------------------------------------------ 04:35:58 Add_People_To_First_Follower_And_Verify :: Add all needed people t... | FAIL | 04:35:58 Parent suite setup failed: 04:35:58 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:35:58 ------------------------------------------------------------------------------ 04:35:58 Buy_Cars_On_Leader_And_Verify :: Buy some cars on the leader member. | FAIL | 04:35:58 Parent suite setup failed: 04:35:58 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:35:58 ------------------------------------------------------------------------------ 04:35:58 Buy_Cars_On_Follower_And_Verify :: Buy some cars on the first foll... | FAIL | 04:35:58 Parent suite setup failed: 04:35:58 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:35:58 ------------------------------------------------------------------------------ 04:35:58 Reboot_People_Leader :: Previous people Leader is rebooted. We sho... | FAIL | 04:35:58 Parent suite setup failed: 04:35:58 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:35:58 ------------------------------------------------------------------------------ 04:35:58 Buy_Cars_On_Leader_After_Reboot_And_Verify :: Buy some cars on the... | FAIL | 04:35:58 Parent suite setup failed: 04:35:58 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:35:58 ------------------------------------------------------------------------------ 04:35:58 Buy_Cars_On_Follower_After_Reboot_And_Verify :: Buy some cars on t... | FAIL | 04:35:58 Parent suite setup failed: 04:35:58 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:35:58 ------------------------------------------------------------------------------ 04:35:58 Delete_All_CarPeople :: DELETE car-people container. No verificati... | FAIL | 04:35:58 Parent suite setup failed: 04:35:58 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:35:58 ------------------------------------------------------------------------------ 04:35:58 Delete_All_People :: DELETE people container. No verification beyo... | FAIL | 04:35:58 Parent suite setup failed: 04:35:58 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:35:58 ------------------------------------------------------------------------------ 04:35:58 Delete_All_Cars :: DELETE cars container. No verification beyond h... | FAIL | 04:35:58 Parent suite setup failed: 04:35:58 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:35:58 ------------------------------------------------------------------------------ 04:35:58 controller-clustering-tell.txt.Buycar Failover :: This test focuse... | FAIL | 04:35:58 Suite setup failed: 04:35:58 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:35:58 04:35:58 10 tests, 0 passed, 10 failed 04:35:58 ============================================================================== 04:35:58 controller-clustering-tell.txt.Entity Isolate :: Suite for performing membe... 04:35:58 ============================================================================== 04:36:31 Check All Shards Before Isolate :: Check all shards in controller. | FAIL | 04:36:31 Parent suite setup failed: 04:36:31 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:36:31 ------------------------------------------------------------------------------ 04:36:31 Isolate Entity Leader :: Isolate the entity-ownership Leader to ca... | FAIL | 04:36:31 Parent suite setup failed: 04:36:31 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:36:31 ------------------------------------------------------------------------------ 04:36:31 Check All Shards After Isolate :: Check all shards in controller. | FAIL | 04:36:31 Parent suite setup failed: 04:36:31 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:36:31 ------------------------------------------------------------------------------ 04:36:31 Rejoin Entity Leader :: Rejoin the entity-ownership Leader. | FAIL | 04:36:31 Parent suite setup failed: 04:36:31 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:36:31 ------------------------------------------------------------------------------ 04:36:31 Check All Shards After Rejoin :: Check all shards in controller. | FAIL | 04:36:31 Parent suite setup failed: 04:36:31 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:36:31 ------------------------------------------------------------------------------ 04:36:32 controller-clustering-tell.txt.Entity Isolate :: Suite for perform... | FAIL | 04:36:32 Suite setup failed: 04:36:32 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:36:32 04:36:32 5 tests, 0 passed, 5 failed 04:36:32 ============================================================================== 04:36:32 controller-clustering-tell.txt.Buycar Failover Isolation :: This test focus... 04:36:32 ============================================================================== 04:37:05 Add_Cars_To_Leader_And_Verify :: Add all needed cars to car Leader... | FAIL | 04:37:05 Parent suite setup failed: 04:37:05 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:37:05 ------------------------------------------------------------------------------ 04:37:05 Add_People_To_First_Follower_And_Verify :: Add all needed people t... | FAIL | 04:37:05 Parent suite setup failed: 04:37:05 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:37:05 ------------------------------------------------------------------------------ 04:37:05 Buy_Cars_On_Leader_And_Verify :: Buy some cars on the leader member. | FAIL | 04:37:05 Parent suite setup failed: 04:37:05 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:37:05 ------------------------------------------------------------------------------ 04:37:05 Buy_Cars_On_Follower_And_Verify :: Buy some cars on the first foll... | FAIL | 04:37:05 Parent suite setup failed: 04:37:05 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:37:05 ------------------------------------------------------------------------------ 04:37:05 Isolate_and_Rejoin_People_Leader :: Previous people Leader is isol... | FAIL | 04:37:05 Parent suite setup failed: 04:37:05 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:37:05 ------------------------------------------------------------------------------ 04:37:05 Buy_Cars_On_Leader_After_Rejoin_And_Verify :: Buy some cars on the... | FAIL | 04:37:05 Parent suite setup failed: 04:37:05 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:37:05 ------------------------------------------------------------------------------ 04:37:05 Buy_Cars_On_Follower_After_Rejoin_And_Verify :: Buy some cars on t... | FAIL | 04:37:05 Parent suite setup failed: 04:37:05 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:37:05 ------------------------------------------------------------------------------ 04:37:05 Delete_All_CarPeople :: DELETE car-people container. No verificati... | FAIL | 04:37:05 Parent suite setup failed: 04:37:05 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:37:05 ------------------------------------------------------------------------------ 04:37:05 Delete_All_People :: DELETE people container. No verification beyo... | FAIL | 04:37:05 Parent suite setup failed: 04:37:05 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:37:05 ------------------------------------------------------------------------------ 04:37:05 Delete_All_Cars :: DELETE cars container. No verification beyond h... | FAIL | 04:37:05 Parent suite setup failed: 04:37:05 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:37:05 ------------------------------------------------------------------------------ 04:37:05 controller-clustering-tell.txt.Buycar Failover Isolation :: This t... | FAIL | 04:37:05 Suite setup failed: 04:37:05 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:37:05 04:37:05 10 tests, 0 passed, 10 failed 04:37:05 ============================================================================== 04:37:05 controller-clustering-tell.txt.Car Failover Crud Isolation :: Suite mixing ... 04:37:05 ============================================================================== 04:37:38 Add_Original_Cars_On_Old_Leader_And_Verify :: Add initial cars on ... | FAIL | 04:37:38 Parent suite setup failed: 04:37:38 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:37:38 ------------------------------------------------------------------------------ 04:37:38 Isolate_Original_Car_Leader :: Isolate the car Leader to cause a n... | FAIL | 04:37:38 Parent suite setup failed: 04:37:38 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:37:38 ------------------------------------------------------------------------------ 04:37:38 Wait_For_New_Leader :: Wait until new car Leader is elected. | FAIL | 04:37:38 Parent suite setup failed: 04:37:38 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:37:38 ------------------------------------------------------------------------------ 04:37:38 See_Original_Cars_On_New_Leader :: GET cars from new Leader, shoul... | FAIL | 04:37:38 Parent suite setup failed: 04:37:38 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:37:38 ------------------------------------------------------------------------------ 04:37:38 See_Original_Cars_On_New_Followers :: The same check on other exis... | FAIL | 04:37:38 Parent suite setup failed: 04:37:38 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:37:38 ------------------------------------------------------------------------------ 04:37:38 Delete_Original_Cars_On_New_Leader :: Delete cars on the new Leader. | FAIL | 04:37:38 Parent suite setup failed: 04:37:38 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:37:38 ------------------------------------------------------------------------------ 04:37:38 Add_Leader_Cars_On_New_Leader :: Add cars on the new Leader. | FAIL | 04:37:38 Parent suite setup failed: 04:37:38 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:37:38 ------------------------------------------------------------------------------ 04:37:38 See_Leader_Cars_On_New_Leader :: GET cars from new Leader, should ... | FAIL | 04:37:38 Parent suite setup failed: 04:37:38 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:37:38 ------------------------------------------------------------------------------ 04:37:38 See_Leader_Cars_On_New_Followers :: The same check on other existi... | FAIL | 04:37:38 Parent suite setup failed: 04:37:38 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:37:38 ------------------------------------------------------------------------------ 04:37:38 Delete_Leader_Cars_On_New_First_Follower :: Delete cars in new fir... | FAIL | 04:37:38 Parent suite setup failed: 04:37:38 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:37:38 ------------------------------------------------------------------------------ 04:37:38 Add_Follower_Cars_On_New_First_Follower :: Add cars on the new fir... | FAIL | 04:37:38 Parent suite setup failed: 04:37:38 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:37:38 ------------------------------------------------------------------------------ 04:37:38 See_Folower_Cars_On_New_Leader :: Get cars from the new Leader, sh... | FAIL | 04:37:38 Parent suite setup failed: 04:37:38 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:37:38 ------------------------------------------------------------------------------ 04:37:38 See_Follower_Cars_On_New_Followers :: The same check on other exis... | FAIL | 04:37:38 Parent suite setup failed: 04:37:38 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:37:38 ------------------------------------------------------------------------------ 04:37:38 Rejoin_Old_Car_Leader :: Rejoin the isolated member without deleti... | FAIL | 04:37:38 Parent suite setup failed: 04:37:38 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:37:38 ------------------------------------------------------------------------------ 04:37:38 See_Folower_Cars_On_Old_Leader :: GET cars from the restarted memb... | FAIL | 04:37:38 Parent suite setup failed: 04:37:38 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:37:38 ------------------------------------------------------------------------------ 04:37:38 Delete_Follower_Cars_On_New_Leader :: Delete cars on the last Leader. | FAIL | 04:37:38 Parent suite setup failed: 04:37:38 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:37:38 ------------------------------------------------------------------------------ 04:37:38 controller-clustering-tell.txt.Car Failover Crud Isolation :: Suit... | FAIL | 04:37:38 Suite setup failed: 04:37:38 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:37:38 04:37:38 16 tests, 0 passed, 16 failed 04:37:38 ============================================================================== 04:37:38 controller-clustering-tell.txt.Car Outage Corners :: Cluster suite for test... 04:37:38 ============================================================================== 04:38:10 Stop_Majority_Of_The_Followers :: Stop half plus one car Follower ... | FAIL | 04:38:10 Parent suite setup failed: 04:38:10 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:38:10 ------------------------------------------------------------------------------ 04:38:10 Attempt_To_Add_Cars_To_Leader :: Adding cars should fail, as major... | FAIL | 04:38:10 Parent suite setup failed: 04:38:10 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:38:10 ------------------------------------------------------------------------------ 04:38:10 Start_Tipping_Follower :: Start one Follower member without persis... | FAIL | 04:38:10 Parent suite setup failed: 04:38:10 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:38:10 ------------------------------------------------------------------------------ 04:38:10 Add_Cars_On_Tipping_Follower :: Add cars on the tipping Follower. | FAIL | 04:38:10 Parent suite setup failed: 04:38:10 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:38:10 ------------------------------------------------------------------------------ 04:38:10 See_Cars_On_Existing_Members :: On each up member: GET cars, shoul... | FAIL | 04:38:10 Parent suite setup failed: 04:38:10 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:38:10 ------------------------------------------------------------------------------ 04:38:10 Start_Other_Followers :: Start other followers without persisted d... | FAIL | 04:38:10 Parent suite setup failed: 04:38:10 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:38:10 ------------------------------------------------------------------------------ 04:38:10 See_Cars_On_New_Follower_Leader :: GET cars from a new follower to... | FAIL | 04:38:10 Parent suite setup failed: 04:38:10 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:38:10 ------------------------------------------------------------------------------ 04:38:10 Delete_Cars_On_Leader :: Delete cars on Leader. | FAIL | 04:38:10 Parent suite setup failed: 04:38:10 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:38:10 ------------------------------------------------------------------------------ 04:38:10 controller-clustering-tell.txt.Car Outage Corners :: Cluster suite... | FAIL | 04:38:10 Suite setup failed: 04:38:10 HTTPError: 409 Client Error: Conflict for url: http://10.30.171.250:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 04:38:10 04:38:10 8 tests, 0 passed, 8 failed 04:38:10 ============================================================================== 04:38:10 controller-clustering-tell.txt | FAIL | 04:38:10 162 tests, 16 passed, 146 failed 04:38:10 ============================================================================== 04:38:10 Output: /w/workspace/controller-csit-3node-clustering-tell-all-titanium/output.xml 04:38:23 Log: /w/workspace/controller-csit-3node-clustering-tell-all-titanium/log.html 04:38:23 Report: /w/workspace/controller-csit-3node-clustering-tell-all-titanium/report.html 04:38:24 + true 04:38:24 + echo 'Examining the files in data/log and checking filesize' 04:38:24 Examining the files in data/log and checking filesize 04:38:24 + ssh 10.30.171.250 'ls -altr /tmp/karaf-0.22.2-SNAPSHOT/data/log/' 04:38:24 Warning: Permanently added '10.30.171.250' (ECDSA) to the list of known hosts. 04:38:24 total 7924 04:38:24 drwxrwxr-x 2 jenkins jenkins 4096 Feb 8 01:01 . 04:38:24 -rw-rw-r-- 1 jenkins jenkins 1720 Feb 8 01:01 karaf_console.log 04:38:24 drwxrwxr-x 9 jenkins jenkins 4096 Feb 8 04:28 .. 04:38:24 -rw-rw-r-- 1 jenkins jenkins 8094481 Feb 8 04:37 karaf.log 04:38:24 + ssh 10.30.171.250 'du -hs /tmp/karaf-0.22.2-SNAPSHOT/data/log/*' 04:38:24 Warning: Permanently added '10.30.171.250' (ECDSA) to the list of known hosts. 04:38:25 7.8M /tmp/karaf-0.22.2-SNAPSHOT/data/log/karaf.log 04:38:25 4.0K /tmp/karaf-0.22.2-SNAPSHOT/data/log/karaf_console.log 04:38:25 + ssh 10.30.171.198 'ls -altr /tmp/karaf-0.22.2-SNAPSHOT/data/log/' 04:38:25 Warning: Permanently added '10.30.171.198' (ECDSA) to the list of known hosts. 04:38:25 total 182232 04:38:25 drwxrwxr-x 2 jenkins jenkins 4096 Feb 8 01:01 . 04:38:25 -rw-rw-r-- 1 jenkins jenkins 1720 Feb 8 01:01 karaf_console.log 04:38:25 drwxrwxr-x 4 jenkins jenkins 4096 Feb 8 04:27 .. 04:38:25 -rw-rw-r-- 1 jenkins jenkins 186587529 Feb 8 04:37 karaf.log 04:38:25 + ssh 10.30.171.198 'du -hs /tmp/karaf-0.22.2-SNAPSHOT/data/log/*' 04:38:25 Warning: Permanently added '10.30.171.198' (ECDSA) to the list of known hosts. 04:38:25 178M /tmp/karaf-0.22.2-SNAPSHOT/data/log/karaf.log 04:38:25 4.0K /tmp/karaf-0.22.2-SNAPSHOT/data/log/karaf_console.log 04:38:25 + ssh 10.30.171.173 'ls -altr /tmp/karaf-0.22.2-SNAPSHOT/data/log/' 04:38:25 Warning: Permanently added '10.30.171.173' (ECDSA) to the list of known hosts. 04:38:26 total 106088 04:38:26 drwxrwxr-x 2 jenkins jenkins 4096 Feb 8 01:01 . 04:38:26 -rw-rw-r-- 1 jenkins jenkins 1720 Feb 8 01:01 karaf_console.log 04:38:26 drwxrwxr-x 4 jenkins jenkins 4096 Feb 8 04:27 .. 04:38:26 -rw-rw-r-- 1 jenkins jenkins 108615084 Feb 8 04:38 karaf.log 04:38:26 + ssh 10.30.171.173 'du -hs /tmp/karaf-0.22.2-SNAPSHOT/data/log/*' 04:38:26 Warning: Permanently added '10.30.171.173' (ECDSA) to the list of known hosts. 04:38:26 104M /tmp/karaf-0.22.2-SNAPSHOT/data/log/karaf.log 04:38:26 4.0K /tmp/karaf-0.22.2-SNAPSHOT/data/log/karaf_console.log 04:38:26 + set +e 04:38:26 ++ seq 1 3 04:38:26 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") 04:38:26 + CONTROLLERIP=ODL_SYSTEM_1_IP 04:38:26 + echo 'Let'\''s take the karaf thread dump again' 04:38:26 Let's take the karaf thread dump again 04:38:26 + ssh 10.30.171.250 'sudo ps aux' 04:38:26 Warning: Permanently added '10.30.171.250' (ECDSA) to the list of known hosts. 04:38:26 ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-titanium/ps_after.log 04:38:26 ++ grep -v grep 04:38:26 ++ cut -f2 '-d ' 04:38:26 ++ tr -s ' ' 04:38:26 + pid=27615 04:38:26 + echo 'karaf main: org.apache.karaf.main.Main, pid:27615' 04:38:26 karaf main: org.apache.karaf.main.Main, pid:27615 04:38:26 + ssh 10.30.171.250 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 27615' 04:38:26 Warning: Permanently added '10.30.171.250' (ECDSA) to the list of known hosts. 04:38:27 + echo 'killing karaf process...' 04:38:27 killing karaf process... 04:38:27 + ssh 10.30.171.250 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh' 04:38:27 Warning: Permanently added '10.30.171.250' (ECDSA) to the list of known hosts. 04:38:27 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") 04:38:27 + CONTROLLERIP=ODL_SYSTEM_2_IP 04:38:27 + echo 'Let'\''s take the karaf thread dump again' 04:38:27 Let's take the karaf thread dump again 04:38:27 + ssh 10.30.171.198 'sudo ps aux' 04:38:27 Warning: Permanently added '10.30.171.198' (ECDSA) to the list of known hosts. 04:38:27 ++ tr -s ' ' 04:38:27 ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-titanium/ps_after.log 04:38:27 ++ grep -v grep 04:38:27 ++ cut -f2 '-d ' 04:38:27 + pid=5052 04:38:27 + echo 'karaf main: org.apache.karaf.main.Main, pid:5052' 04:38:27 karaf main: org.apache.karaf.main.Main, pid:5052 04:38:27 + ssh 10.30.171.198 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 5052' 04:38:27 Warning: Permanently added '10.30.171.198' (ECDSA) to the list of known hosts. 04:38:28 + echo 'killing karaf process...' 04:38:28 killing karaf process... 04:38:28 + ssh 10.30.171.198 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh' 04:38:28 Warning: Permanently added '10.30.171.198' (ECDSA) to the list of known hosts. 04:38:28 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") 04:38:28 + CONTROLLERIP=ODL_SYSTEM_3_IP 04:38:28 + echo 'Let'\''s take the karaf thread dump again' 04:38:28 Let's take the karaf thread dump again 04:38:28 + ssh 10.30.171.173 'sudo ps aux' 04:38:28 Warning: Permanently added '10.30.171.173' (ECDSA) to the list of known hosts. 04:38:28 ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-titanium/ps_after.log 04:38:28 ++ grep -v grep 04:38:28 ++ tr -s ' ' 04:38:28 ++ cut -f2 '-d ' 04:38:28 + pid=11395 04:38:28 + echo 'karaf main: org.apache.karaf.main.Main, pid:11395' 04:38:28 karaf main: org.apache.karaf.main.Main, pid:11395 04:38:28 + ssh 10.30.171.173 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 11395' 04:38:28 Warning: Permanently added '10.30.171.173' (ECDSA) to the list of known hosts. 04:38:29 + echo 'killing karaf process...' 04:38:29 killing karaf process... 04:38:29 + ssh 10.30.171.173 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh' 04:38:29 Warning: Permanently added '10.30.171.173' (ECDSA) to the list of known hosts. 04:38:29 + sleep 5 04:38:34 ++ seq 1 3 04:38:34 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") 04:38:34 + CONTROLLERIP=ODL_SYSTEM_1_IP 04:38:34 + echo 'Compressing karaf.log 1' 04:38:34 Compressing karaf.log 1 04:38:34 + ssh 10.30.171.250 gzip --best /tmp/karaf-0.22.2-SNAPSHOT/data/log/karaf.log 04:38:34 Warning: Permanently added '10.30.171.250' (ECDSA) to the list of known hosts. 04:38:35 + echo 'Fetching compressed karaf.log 1' 04:38:35 Fetching compressed karaf.log 1 04:38:35 + scp 10.30.171.250:/tmp/karaf-0.22.2-SNAPSHOT/data/log/karaf.log.gz odl1_karaf.log.gz 04:38:35 Warning: Permanently added '10.30.171.250' (ECDSA) to the list of known hosts. 04:38:35 + ssh 10.30.171.250 rm -f /tmp/karaf-0.22.2-SNAPSHOT/data/log/karaf.log.gz 04:38:35 Warning: Permanently added '10.30.171.250' (ECDSA) to the list of known hosts. 04:38:35 + scp 10.30.171.250:/tmp/karaf-0.22.2-SNAPSHOT/data/log/karaf_console.log odl1_karaf_console.log 04:38:35 Warning: Permanently added '10.30.171.250' (ECDSA) to the list of known hosts. 04:38:35 + ssh 10.30.171.250 rm -f /tmp/karaf-0.22.2-SNAPSHOT/data/log/karaf_console.log 04:38:35 Warning: Permanently added '10.30.171.250' (ECDSA) to the list of known hosts. 04:38:35 + echo 'Fetch GC logs' 04:38:35 Fetch GC logs 04:38:35 + mkdir -p gclogs-1 04:38:35 + scp '10.30.171.250:/tmp/karaf-0.22.2-SNAPSHOT/data/log/*.log' gclogs-1/ 04:38:35 Warning: Permanently added '10.30.171.250' (ECDSA) to the list of known hosts. 04:38:36 scp: /tmp/karaf-0.22.2-SNAPSHOT/data/log/*.log: No such file or directory 04:38:36 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") 04:38:36 + CONTROLLERIP=ODL_SYSTEM_2_IP 04:38:36 + echo 'Compressing karaf.log 2' 04:38:36 Compressing karaf.log 2 04:38:36 + ssh 10.30.171.198 gzip --best /tmp/karaf-0.22.2-SNAPSHOT/data/log/karaf.log 04:38:36 Warning: Permanently added '10.30.171.198' (ECDSA) to the list of known hosts. 04:38:38 + echo 'Fetching compressed karaf.log 2' 04:38:38 Fetching compressed karaf.log 2 04:38:38 + scp 10.30.171.198:/tmp/karaf-0.22.2-SNAPSHOT/data/log/karaf.log.gz odl2_karaf.log.gz 04:38:38 Warning: Permanently added '10.30.171.198' (ECDSA) to the list of known hosts. 04:38:38 + ssh 10.30.171.198 rm -f /tmp/karaf-0.22.2-SNAPSHOT/data/log/karaf.log.gz 04:38:38 Warning: Permanently added '10.30.171.198' (ECDSA) to the list of known hosts. 04:38:38 + scp 10.30.171.198:/tmp/karaf-0.22.2-SNAPSHOT/data/log/karaf_console.log odl2_karaf_console.log 04:38:38 Warning: Permanently added '10.30.171.198' (ECDSA) to the list of known hosts. 04:38:38 + ssh 10.30.171.198 rm -f /tmp/karaf-0.22.2-SNAPSHOT/data/log/karaf_console.log 04:38:38 Warning: Permanently added '10.30.171.198' (ECDSA) to the list of known hosts. 04:38:39 + echo 'Fetch GC logs' 04:38:39 Fetch GC logs 04:38:39 + mkdir -p gclogs-2 04:38:39 + scp '10.30.171.198:/tmp/karaf-0.22.2-SNAPSHOT/data/log/*.log' gclogs-2/ 04:38:39 Warning: Permanently added '10.30.171.198' (ECDSA) to the list of known hosts. 04:38:39 scp: /tmp/karaf-0.22.2-SNAPSHOT/data/log/*.log: No such file or directory 04:38:39 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") 04:38:39 + CONTROLLERIP=ODL_SYSTEM_3_IP 04:38:39 + echo 'Compressing karaf.log 3' 04:38:39 Compressing karaf.log 3 04:38:39 + ssh 10.30.171.173 gzip --best /tmp/karaf-0.22.2-SNAPSHOT/data/log/karaf.log 04:38:39 Warning: Permanently added '10.30.171.173' (ECDSA) to the list of known hosts. 04:38:40 + echo 'Fetching compressed karaf.log 3' 04:38:40 Fetching compressed karaf.log 3 04:38:40 + scp 10.30.171.173:/tmp/karaf-0.22.2-SNAPSHOT/data/log/karaf.log.gz odl3_karaf.log.gz 04:38:40 Warning: Permanently added '10.30.171.173' (ECDSA) to the list of known hosts. 04:38:40 + ssh 10.30.171.173 rm -f /tmp/karaf-0.22.2-SNAPSHOT/data/log/karaf.log.gz 04:38:40 Warning: Permanently added '10.30.171.173' (ECDSA) to the list of known hosts. 04:38:40 + scp 10.30.171.173:/tmp/karaf-0.22.2-SNAPSHOT/data/log/karaf_console.log odl3_karaf_console.log 04:38:41 Warning: Permanently added '10.30.171.173' (ECDSA) to the list of known hosts. 04:38:41 + ssh 10.30.171.173 rm -f /tmp/karaf-0.22.2-SNAPSHOT/data/log/karaf_console.log 04:38:41 Warning: Permanently added '10.30.171.173' (ECDSA) to the list of known hosts. 04:38:41 + echo 'Fetch GC logs' 04:38:41 Fetch GC logs 04:38:41 + mkdir -p gclogs-3 04:38:41 + scp '10.30.171.173:/tmp/karaf-0.22.2-SNAPSHOT/data/log/*.log' gclogs-3/ 04:38:41 Warning: Permanently added '10.30.171.173' (ECDSA) to the list of known hosts. 04:38:41 scp: /tmp/karaf-0.22.2-SNAPSHOT/data/log/*.log: No such file or directory 04:38:41 + echo 'Examine copied files' 04:38:41 Examine copied files 04:38:41 + ls -lt 04:38:41 total 99420 04:38:41 drwxrwxr-x. 2 jenkins jenkins 6 Feb 8 04:38 gclogs-3 04:38:41 -rw-rw-r--. 1 jenkins jenkins 1720 Feb 8 04:38 odl3_karaf_console.log 04:38:41 -rw-rw-r--. 1 jenkins jenkins 1225786 Feb 8 04:38 odl3_karaf.log.gz 04:38:41 drwxrwxr-x. 2 jenkins jenkins 6 Feb 8 04:38 gclogs-2 04:38:41 -rw-rw-r--. 1 jenkins jenkins 1720 Feb 8 04:38 odl2_karaf_console.log 04:38:41 -rw-rw-r--. 1 jenkins jenkins 2143687 Feb 8 04:38 odl2_karaf.log.gz 04:38:41 drwxrwxr-x. 2 jenkins jenkins 6 Feb 8 04:38 gclogs-1 04:38:41 -rw-rw-r--. 1 jenkins jenkins 1720 Feb 8 04:38 odl1_karaf_console.log 04:38:41 -rw-rw-r--. 1 jenkins jenkins 589534 Feb 8 04:38 odl1_karaf.log.gz 04:38:41 -rw-rw-r--. 1 jenkins jenkins 135549 Feb 8 04:38 karaf_3_11395_threads_after.log 04:38:41 -rw-rw-r--. 1 jenkins jenkins 14162 Feb 8 04:38 ps_after.log 04:38:41 -rw-rw-r--. 1 jenkins jenkins 136601 Feb 8 04:38 karaf_2_5052_threads_after.log 04:38:41 -rw-rw-r--. 1 jenkins jenkins 137111 Feb 8 04:38 karaf_1_27615_threads_after.log 04:38:41 -rw-rw-r--. 1 jenkins jenkins 304557 Feb 8 04:38 report.html 04:38:41 -rw-rw-r--. 1 jenkins jenkins 3788699 Feb 8 04:38 log.html 04:38:41 -rw-rw-r--. 1 jenkins jenkins 92864589 Feb 8 04:38 output.xml 04:38:41 -rw-rw-r--. 1 jenkins jenkins 6069 Feb 8 01:04 testplan.txt 04:38:41 -rw-rw-r--. 1 jenkins jenkins 117562 Feb 8 01:04 karaf_3_2068_threads_before.log 04:38:41 -rw-rw-r--. 1 jenkins jenkins 13647 Feb 8 01:04 ps_before.log 04:38:41 -rw-rw-r--. 1 jenkins jenkins 113687 Feb 8 01:04 karaf_2_2072_threads_before.log 04:38:41 -rw-rw-r--. 1 jenkins jenkins 114537 Feb 8 01:04 karaf_1_2069_threads_before.log 04:38:41 -rw-rw-r--. 1 jenkins jenkins 3106 Feb 8 01:01 post-startup-script.sh 04:38:41 -rw-rw-r--. 1 jenkins jenkins 252 Feb 8 01:01 startup-script.sh 04:38:41 -rw-rw-r--. 1 jenkins jenkins 3474 Feb 8 01:01 configuration-script.sh 04:38:41 -rw-rw-r--. 1 jenkins jenkins 695 Feb 8 01:01 custom_shard_config.txt 04:38:41 -rw-rw-r--. 1 jenkins jenkins 136 Feb 8 01:01 scriptplan.txt 04:38:41 -rw-rw-r--. 1 jenkins jenkins 337 Feb 8 01:00 detect_variables.env 04:38:41 -rw-rw-r--. 1 jenkins jenkins 2619 Feb 8 01:00 pom.xml 04:38:41 -rw-rw-r--. 1 jenkins jenkins 92 Feb 8 01:00 set_variables.env 04:38:41 -rw-rw-r--. 1 jenkins jenkins 314 Feb 8 01:00 slave_addresses.txt 04:38:41 -rw-rw-r--. 1 jenkins jenkins 570 Feb 8 01:00 requirements.txt 04:38:41 -rw-rw-r--. 1 jenkins jenkins 26 Feb 8 01:00 env.properties 04:38:41 -rw-rw-r--. 1 jenkins jenkins 333 Feb 8 00:58 stack-parameters.yaml 04:38:41 drwxrwxr-x. 7 jenkins jenkins 4096 Feb 8 00:57 test 04:38:41 drwxrwxr-x. 2 jenkins jenkins 6 Feb 8 00:57 test@tmp 04:38:41 -rw-rw-r--. 1 jenkins jenkins 1410 Feb 7 17:57 maven-metadata.xml 04:38:41 + true 04:38:41 [controller-csit-3node-clustering-tell-all-titanium] $ /bin/sh /tmp/jenkins9099949429380386466.sh 04:38:41 Cleaning up Robot installation... 04:38:42 $ ssh-agent -k 04:38:42 unset SSH_AUTH_SOCK; 04:38:42 unset SSH_AGENT_PID; 04:38:42 echo Agent pid 5293 killed; 04:38:42 [ssh-agent] Stopped. 04:38:42 Recording plot data 04:38:42 Robot results publisher started... 04:38:42 INFO: Checking test criticality is deprecated and will be dropped in a future release! 04:38:42 -Parsing output xml: 04:38:44 Done! 04:38:44 -Copying log files to build dir: 04:38:47 Done! 04:38:47 -Assigning results to build: 04:38:48 Done! 04:38:48 -Checking thresholds: 04:38:48 Done! 04:38:48 Done publishing Robot results. 04:38:48 Build step 'Publish Robot Framework test results' changed build result to UNSTABLE 04:38:48 [PostBuildScript] - [INFO] Executing post build scripts. 04:38:48 [controller-csit-3node-clustering-tell-all-titanium] $ /bin/bash /tmp/jenkins4530028137087530223.sh 04:38:48 Archiving csit artifacts 04:38:48 mv: cannot stat '*_1.png': No such file or directory 04:38:48 mv: cannot stat '/tmp/odl1_*': No such file or directory 04:38:48 mv: cannot stat '*_2.png': No such file or directory 04:38:48 mv: cannot stat '/tmp/odl2_*': No such file or directory 04:38:48 mv: cannot stat '*_3.png': No such file or directory 04:38:48 mv: cannot stat '/tmp/odl3_*': No such file or directory 04:38:48 % Total % Received % Xferd Average Speed Time Time Time Current 04:38:48 Dload Upload Total Spent Left Speed 04:38:48 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 3176k 0 3176k 0 0 4908k 0 --:--:-- --:--:-- --:--:-- 4901k 100 7542k 0 7542k 0 0 4887k 0 --:--:-- 0:00:01 --:--:-- 4887k 04:38:49 Archive: robot-plugin.zip 04:38:49 inflating: ./archives/robot-plugin/log.html 04:38:49 inflating: ./archives/robot-plugin/output.xml 04:38:50 inflating: ./archives/robot-plugin/report.html 04:38:50 mv: cannot stat '*.log.gz': No such file or directory 04:38:50 mv: cannot stat '*.csv': No such file or directory 04:38:50 mv: cannot stat '*.png': No such file or directory 04:38:50 [PostBuildScript] - [INFO] Executing post build scripts. 04:38:50 [controller-csit-3node-clustering-tell-all-titanium] $ /bin/bash /tmp/jenkins637932515488838013.sh 04:38:50 [PostBuildScript] - [INFO] Executing post build scripts. 04:38:50 [EnvInject] - Injecting environment variables from a build step. 04:38:50 [EnvInject] - Injecting as environment variables the properties content 04:38:50 OS_CLOUD=vex 04:38:50 OS_STACK_NAME=releng-controller-csit-3node-clustering-tell-all-titanium-73 04:38:50 04:38:50 [EnvInject] - Variables injected successfully. 04:38:50 provisioning config files... 04:38:50 copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml 04:38:50 [controller-csit-3node-clustering-tell-all-titanium] $ /bin/bash /tmp/jenkins4809304041014989502.sh 04:38:50 ---> openstack-stack-delete.sh 04:38:50 Setup pyenv: 04:38:50 system 04:38:50 3.8.13 04:38:50 3.9.13 04:38:50 3.10.13 04:38:50 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-titanium/.python-version) 04:38:50 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-RqOx from file:/tmp/.os_lf_venv 04:38:50 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 04:38:50 lf-activate-venv(): INFO: Attempting to install with network-safe options... 04:38:52 lf-activate-venv(): INFO: Base packages installed successfully 04:38:52 lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes python-heatclient python-openstackclient urllib3~=1.26.15 04:39:06 lf-activate-venv(): INFO: Adding /tmp/venv-RqOx/bin to PATH 04:39:06 INFO: Stack cost retrieval disabled, setting cost to 0 04:39:28 INFO: Deleting stack releng-controller-csit-3node-clustering-tell-all-titanium-73 04:39:28 Waiting for stack to delete... 04:39:28 Successfully deleted stack releng-controller-csit-3node-clustering-tell-all-titanium-73 04:39:28 [PostBuildScript] - [INFO] Executing post build scripts. 04:39:28 [controller-csit-3node-clustering-tell-all-titanium] $ /bin/bash /tmp/jenkins17061700902007687357.sh 04:39:28 ---> sysstat.sh 04:39:28 [controller-csit-3node-clustering-tell-all-titanium] $ /bin/bash /tmp/jenkins8195720121422695170.sh 04:39:28 ---> package-listing.sh 04:39:28 ++ facter osfamily 04:39:28 ++ tr '[:upper:]' '[:lower:]' 04:39:29 + OS_FAMILY=redhat 04:39:29 + workspace=/w/workspace/controller-csit-3node-clustering-tell-all-titanium 04:39:29 + START_PACKAGES=/tmp/packages_start.txt 04:39:29 + END_PACKAGES=/tmp/packages_end.txt 04:39:29 + DIFF_PACKAGES=/tmp/packages_diff.txt 04:39:29 + PACKAGES=/tmp/packages_start.txt 04:39:29 + '[' /w/workspace/controller-csit-3node-clustering-tell-all-titanium ']' 04:39:29 + PACKAGES=/tmp/packages_end.txt 04:39:29 + case "${OS_FAMILY}" in 04:39:29 + rpm -qa 04:39:29 + sort 04:39:29 + '[' -f /tmp/packages_start.txt ']' 04:39:29 + '[' -f /tmp/packages_end.txt ']' 04:39:29 + diff /tmp/packages_start.txt /tmp/packages_end.txt 04:39:29 + '[' /w/workspace/controller-csit-3node-clustering-tell-all-titanium ']' 04:39:29 + mkdir -p /w/workspace/controller-csit-3node-clustering-tell-all-titanium/archives/ 04:39:29 + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/controller-csit-3node-clustering-tell-all-titanium/archives/ 04:39:29 [controller-csit-3node-clustering-tell-all-titanium] $ /bin/bash /tmp/jenkins8603794333789463772.sh 04:39:29 ---> capture-instance-metadata.sh 04:39:29 Setup pyenv: 04:39:30 system 04:39:30 3.8.13 04:39:30 3.9.13 04:39:30 3.10.13 04:39:30 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-titanium/.python-version) 04:39:30 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-RqOx from file:/tmp/.os_lf_venv 04:39:30 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 04:39:30 lf-activate-venv(): INFO: Attempting to install with network-safe options... 04:39:32 lf-activate-venv(): INFO: Base packages installed successfully 04:39:32 lf-activate-venv(): INFO: Installing additional packages: lftools 04:39:43 lf-activate-venv(): INFO: Adding /tmp/venv-RqOx/bin to PATH 04:39:43 INFO: Running in OpenStack, capturing instance metadata 04:39:44 [controller-csit-3node-clustering-tell-all-titanium] $ /bin/bash /tmp/jenkins14999588321839740761.sh 04:39:44 provisioning config files... 04:39:44 Could not find credentials [logs] for controller-csit-3node-clustering-tell-all-titanium #73 04:39:44 copy managed file [jenkins-log-archives-settings] to file:/w/workspace/controller-csit-3node-clustering-tell-all-titanium@tmp/config8147068528815167560tmp 04:39:44 Regular expression run condition: Expression=[^.*logs-s3.*], Label=[odl-logs-s3-cloudfront-index] 04:39:44 Run condition [Regular expression match] enabling perform for step [Provide Configuration files] 04:39:44 provisioning config files... 04:39:45 copy managed file [jenkins-s3-log-ship] to file:/home/jenkins/.aws/credentials 04:39:45 [EnvInject] - Injecting environment variables from a build step. 04:39:45 [EnvInject] - Injecting as environment variables the properties content 04:39:45 SERVER_ID=logs 04:39:45 04:39:45 [EnvInject] - Variables injected successfully. 04:39:45 [controller-csit-3node-clustering-tell-all-titanium] $ /bin/bash /tmp/jenkins17241899388588273488.sh 04:39:45 ---> create-netrc.sh 04:39:45 WARN: Log server credential not found. 04:39:45 [controller-csit-3node-clustering-tell-all-titanium] $ /bin/bash /tmp/jenkins801636829986700138.sh 04:39:45 ---> python-tools-install.sh 04:39:45 Setup pyenv: 04:39:45 system 04:39:45 3.8.13 04:39:45 3.9.13 04:39:45 3.10.13 04:39:45 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-titanium/.python-version) 04:39:45 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-RqOx from file:/tmp/.os_lf_venv 04:39:45 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 04:39:45 lf-activate-venv(): INFO: Attempting to install with network-safe options... 04:39:47 lf-activate-venv(): INFO: Base packages installed successfully 04:39:47 lf-activate-venv(): INFO: Installing additional packages: lftools 04:39:56 lf-activate-venv(): INFO: Adding /tmp/venv-RqOx/bin to PATH 04:39:56 [controller-csit-3node-clustering-tell-all-titanium] $ /bin/bash /tmp/jenkins16642614312337032897.sh 04:39:56 ---> sudo-logs.sh 04:39:56 Archiving 'sudo' log.. 04:39:56 [controller-csit-3node-clustering-tell-all-titanium] $ /bin/bash /tmp/jenkins17601870294357292740.sh 04:39:56 ---> job-cost.sh 04:39:56 Setup pyenv: 04:39:56 system 04:39:56 3.8.13 04:39:56 3.9.13 04:39:56 3.10.13 04:39:56 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-titanium/.python-version) 04:39:56 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-RqOx from file:/tmp/.os_lf_venv 04:39:56 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 04:39:56 lf-activate-venv(): INFO: Attempting to install with network-safe options... 04:39:58 lf-activate-venv(): INFO: Base packages installed successfully 04:39:58 lf-activate-venv(): INFO: Installing additional packages: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 04:40:05 lf-activate-venv(): INFO: Adding /tmp/venv-RqOx/bin to PATH 04:40:05 DEBUG: total: 0 04:40:05 INFO: Retrieving Stack Cost... 04:40:06 INFO: Retrieving Pricing Info for: v3-standard-2 04:40:06 INFO: Archiving Costs 04:40:06 [controller-csit-3node-clustering-tell-all-titanium] $ /bin/bash -l /tmp/jenkins5338363641704188097.sh 04:40:06 ---> logs-deploy.sh 04:40:06 Setup pyenv: 04:40:06 system 04:40:06 3.8.13 04:40:06 3.9.13 04:40:06 3.10.13 04:40:06 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-titanium/.python-version) 04:40:06 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-RqOx from file:/tmp/.os_lf_venv 04:40:06 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 04:40:06 lf-activate-venv(): INFO: Attempting to install with network-safe options... 04:40:08 lf-activate-venv(): INFO: Base packages installed successfully 04:40:08 lf-activate-venv(): INFO: Installing additional packages: lftools urllib3~=1.26.15 04:40:17 lf-activate-venv(): INFO: Adding /tmp/venv-RqOx/bin to PATH 04:40:17 WARNING: Nexus logging server not set 04:40:17 INFO: S3 path logs/releng/vex-yul-odl-jenkins-1/controller-csit-3node-clustering-tell-all-titanium/73/ 04:40:17 INFO: archiving logs to S3 04:40:18 ---> uname -a: 04:40:18 Linux prd-centos8-robot-2c-8g-8613.novalocal 4.18.0-553.5.1.el8.x86_64 #1 SMP Tue May 21 05:46:01 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux 04:40:18 04:40:18 04:40:18 ---> lscpu: 04:40:18 Architecture: x86_64 04:40:18 CPU op-mode(s): 32-bit, 64-bit 04:40:18 Byte Order: Little Endian 04:40:18 CPU(s): 2 04:40:18 On-line CPU(s) list: 0,1 04:40:18 Thread(s) per core: 1 04:40:18 Core(s) per socket: 1 04:40:18 Socket(s): 2 04:40:18 NUMA node(s): 1 04:40:18 Vendor ID: AuthenticAMD 04:40:18 CPU family: 23 04:40:18 Model: 49 04:40:18 Model name: AMD EPYC-Rome Processor 04:40:18 Stepping: 0 04:40:18 CPU MHz: 2800.000 04:40:18 BogoMIPS: 5600.00 04:40:18 Virtualization: AMD-V 04:40:18 Hypervisor vendor: KVM 04:40:18 Virtualization type: full 04:40:18 L1d cache: 32K 04:40:18 L1i cache: 32K 04:40:18 L2 cache: 512K 04:40:18 L3 cache: 16384K 04:40:18 NUMA node0 CPU(s): 0,1 04:40:18 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities 04:40:18 04:40:18 04:40:18 ---> nproc: 04:40:18 2 04:40:18 04:40:18 04:40:18 ---> df -h: 04:40:18 Filesystem Size Used Avail Use% Mounted on 04:40:18 devtmpfs 3.8G 0 3.8G 0% /dev 04:40:18 tmpfs 3.8G 0 3.8G 0% /dev/shm 04:40:18 tmpfs 3.8G 17M 3.8G 1% /run 04:40:18 tmpfs 3.8G 0 3.8G 0% /sys/fs/cgroup 04:40:18 /dev/vda1 40G 8.5G 32G 22% / 04:40:18 tmpfs 770M 0 770M 0% /run/user/1001 04:40:18 04:40:18 04:40:18 ---> free -m: 04:40:18 total used free shared buff/cache available 04:40:18 Mem: 7697 648 4652 19 2396 6750 04:40:18 Swap: 1023 0 1023 04:40:18 04:40:18 04:40:18 ---> ip addr: 04:40:18 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 04:40:18 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 04:40:18 inet 127.0.0.1/8 scope host lo 04:40:18 valid_lft forever preferred_lft forever 04:40:18 inet6 ::1/128 scope host 04:40:18 valid_lft forever preferred_lft forever 04:40:18 2: eth0: mtu 1458 qdisc mq state UP group default qlen 1000 04:40:18 link/ether fa:16:3e:3d:ee:9b brd ff:ff:ff:ff:ff:ff 04:40:18 altname enp0s3 04:40:18 altname ens3 04:40:18 inet 10.30.170.65/23 brd 10.30.171.255 scope global dynamic noprefixroute eth0 04:40:18 valid_lft 73001sec preferred_lft 73001sec 04:40:18 inet6 fe80::f816:3eff:fe3d:ee9b/64 scope link 04:40:18 valid_lft forever preferred_lft forever 04:40:18 04:40:18 04:40:18 ---> sar -b -r -n DEV: 04:40:18 Linux 4.18.0-553.5.1.el8.x86_64 (centos-stream-8-robot-7d7a37eb-bc14-4dd6-9530-dc22c5eae738.noval) 02/08/2026 _x86_64_ (2 CPU) 04:40:18 04:40:18 00:56:56 LINUX RESTART (2 CPU) 04:40:18 04:40:18 12:58:01 AM tps rtps wtps bread/s bwrtn/s 04:40:18 12:59:01 AM 127.47 1.17 126.31 77.44 12257.68 04:40:18 01:00:01 AM 31.54 0.42 31.13 64.79 3933.78 04:40:18 01:01:01 AM 73.33 9.46 63.87 1681.68 4017.87 04:40:18 01:02:01 AM 29.33 0.07 29.26 1.73 6205.41 04:40:18 01:03:01 AM 0.30 0.00 0.30 0.00 4.92 04:40:18 01:04:01 AM 0.13 0.00 0.13 0.00 1.45 04:40:18 01:05:01 AM 0.27 0.05 0.22 4.80 7.40 04:40:18 01:06:01 AM 1.87 0.00 1.87 0.00 96.82 04:40:18 01:07:01 AM 0.38 0.00 0.38 0.00 19.96 04:40:18 01:08:01 AM 0.35 0.00 0.35 0.00 13.03 04:40:18 01:09:01 AM 0.18 0.00 0.18 0.00 26.51 04:40:18 01:10:01 AM 0.37 0.03 0.33 1.87 13.30 04:40:18 01:11:01 AM 0.38 0.02 0.37 0.13 135.97 04:40:18 01:12:01 AM 0.40 0.03 0.37 0.27 8.85 04:40:18 01:13:01 AM 1.25 0.00 1.25 0.00 33.21 04:40:18 01:14:01 AM 0.27 0.00 0.27 0.00 5.46 04:40:18 01:15:01 AM 0.25 0.00 0.25 0.00 22.33 04:40:18 01:16:01 AM 0.18 0.00 0.18 0.00 10.00 04:40:18 01:17:01 AM 0.20 0.00 0.20 0.00 16.43 04:40:18 01:18:01 AM 0.32 0.00 0.32 0.00 19.60 04:40:18 01:19:01 AM 0.18 0.00 0.18 0.00 8.73 04:40:18 01:20:01 AM 0.13 0.00 0.13 0.00 16.54 04:40:18 01:21:01 AM 0.32 0.00 0.32 0.00 25.77 04:40:18 01:22:01 AM 0.23 0.00 0.23 0.00 9.92 04:40:18 01:23:01 AM 0.35 0.00 0.35 0.00 17.48 04:40:18 01:24:01 AM 0.15 0.00 0.15 0.00 8.93 04:40:18 01:25:01 AM 0.13 0.00 0.13 0.00 8.82 04:40:18 01:26:01 AM 0.18 0.00 0.18 0.00 9.21 04:40:18 01:27:01 AM 0.17 0.00 0.17 0.00 14.65 04:40:18 01:28:01 AM 0.28 0.00 0.28 0.00 7.98 04:40:18 01:29:01 AM 0.17 0.00 0.17 0.00 2.03 04:40:18 01:30:01 AM 0.20 0.00 0.20 0.00 9.63 04:40:18 01:31:01 AM 0.30 0.00 0.30 0.00 14.85 04:40:18 01:32:01 AM 0.28 0.00 0.28 0.00 17.35 04:40:18 01:33:01 AM 0.32 0.00 0.32 0.00 17.31 04:40:18 01:34:02 AM 0.15 0.00 0.15 0.00 8.82 04:40:18 01:35:01 AM 0.19 0.00 0.19 0.00 16.86 04:40:18 01:36:01 AM 0.15 0.00 0.15 0.00 14.40 04:40:18 01:37:01 AM 0.13 0.00 0.13 0.00 3.05 04:40:18 01:38:01 AM 0.40 0.00 0.40 0.00 5.73 04:40:18 01:39:01 AM 0.22 0.00 0.22 0.00 8.32 04:40:18 01:40:01 AM 0.15 0.00 0.15 0.00 16.94 04:40:18 01:41:01 AM 0.37 0.00 0.37 0.00 17.30 04:40:18 01:42:01 AM 0.15 0.00 0.15 0.00 8.13 04:40:18 01:43:01 AM 0.50 0.00 0.50 0.00 23.06 04:40:18 01:44:01 AM 1.28 0.32 0.97 6.93 32.83 04:40:18 01:45:01 AM 0.15 0.00 0.15 0.00 9.63 04:40:18 01:46:01 AM 0.13 0.00 0.13 0.00 24.06 04:40:18 01:47:01 AM 0.38 0.00 0.38 0.00 14.68 04:40:18 01:48:01 AM 0.53 0.00 0.53 0.00 16.63 04:40:18 01:49:01 AM 0.42 0.00 0.42 0.00 13.45 04:40:18 01:50:01 AM 0.40 0.00 0.40 0.00 13.18 04:40:18 01:51:01 AM 0.60 0.00 0.60 0.00 16.16 04:40:18 01:52:01 AM 0.38 0.00 0.38 0.00 11.86 04:40:18 01:53:01 AM 0.42 0.00 0.42 0.00 12.41 04:40:18 01:54:01 AM 0.23 0.00 0.23 0.00 22.11 04:40:18 01:55:01 AM 0.12 0.00 0.12 0.00 8.26 04:40:18 01:56:01 AM 0.15 0.00 0.15 0.00 18.53 04:40:18 01:57:01 AM 0.23 0.00 0.23 0.00 14.63 04:40:18 01:58:01 AM 0.37 0.00 0.37 0.00 12.90 04:40:18 01:59:01 AM 0.20 0.00 0.20 0.00 16.15 04:40:18 02:00:01 AM 0.30 0.00 0.30 0.00 15.46 04:40:18 02:01:01 AM 0.32 0.00 0.32 0.00 15.83 04:40:18 02:02:01 AM 0.42 0.00 0.42 0.00 13.26 04:40:18 02:03:01 AM 0.30 0.00 0.30 0.00 19.46 04:40:18 02:04:01 AM 0.32 0.00 0.32 0.00 19.93 04:40:18 02:05:01 AM 0.18 0.00 0.18 0.00 15.09 04:40:18 02:06:01 AM 6.00 5.75 0.25 555.64 12.03 04:40:18 02:07:01 AM 2.95 0.00 2.95 0.00 83.21 04:40:18 02:08:01 AM 0.28 0.00 0.28 0.00 17.05 04:40:18 02:09:01 AM 0.15 0.00 0.15 0.00 16.26 04:40:18 02:10:01 AM 0.42 0.00 0.42 0.00 15.21 04:40:18 02:11:01 AM 0.73 0.00 0.73 0.00 21.00 04:40:18 02:12:01 AM 0.30 0.00 0.30 0.00 13.41 04:40:18 02:13:01 AM 0.27 0.00 0.27 0.00 27.21 04:40:18 02:14:01 AM 0.13 0.00 0.13 0.00 6.13 04:40:18 02:15:01 AM 0.13 0.00 0.13 0.00 11.86 04:40:18 02:16:01 AM 0.15 0.00 0.15 0.00 12.03 04:40:18 02:17:01 AM 0.28 0.00 0.28 0.00 13.25 04:40:18 02:18:01 AM 0.32 0.00 0.32 0.00 10.50 04:40:18 02:19:01 AM 0.43 0.00 0.43 0.00 17.51 04:40:18 02:20:01 AM 0.45 0.00 0.45 0.00 11.65 04:40:18 02:21:01 AM 0.23 0.00 0.23 0.00 9.80 04:40:18 02:22:01 AM 0.27 0.00 0.27 0.00 18.16 04:40:18 02:23:01 AM 0.32 0.00 0.32 0.00 20.35 04:40:18 02:24:01 AM 0.35 0.00 0.35 0.00 13.43 04:40:18 02:25:01 AM 0.25 0.00 0.25 0.00 17.28 04:40:18 02:26:01 AM 0.23 0.00 0.23 0.00 15.91 04:40:18 02:27:01 AM 0.22 0.00 0.22 0.00 16.10 04:40:18 02:28:01 AM 0.27 0.00 0.27 0.00 11.70 04:40:18 02:29:01 AM 0.18 0.00 0.18 0.00 18.53 04:40:18 02:30:01 AM 0.13 0.00 0.13 0.00 8.43 04:40:18 02:31:01 AM 0.33 0.00 0.33 0.00 17.13 04:40:18 02:32:01 AM 0.25 0.00 0.25 0.00 16.79 04:40:18 02:33:01 AM 0.22 0.00 0.22 0.00 10.25 04:40:18 02:34:01 AM 0.17 0.00 0.17 0.00 27.06 04:40:18 02:35:01 AM 0.13 0.00 0.13 0.00 5.20 04:40:18 02:36:01 AM 0.22 0.00 0.22 0.00 8.93 04:40:18 02:37:01 AM 0.17 0.00 0.17 0.00 10.91 04:40:18 02:38:01 AM 0.28 0.00 0.28 0.00 9.03 04:40:18 02:39:01 AM 0.15 0.00 0.15 0.00 9.73 04:40:18 02:40:01 AM 0.27 0.00 0.27 0.00 10.65 04:40:18 02:41:02 AM 0.23 0.00 0.23 0.00 43.67 04:40:18 02:42:01 AM 0.24 0.00 0.24 0.00 100.71 04:40:18 02:43:01 AM 0.25 0.00 0.25 0.00 30.11 04:40:18 02:44:01 AM 0.15 0.00 0.15 0.00 8.68 04:40:18 02:45:01 AM 0.17 0.00 0.17 0.00 16.28 04:40:18 02:46:01 AM 0.18 0.00 0.18 0.00 15.08 04:40:18 02:47:01 AM 0.28 0.00 0.28 0.00 18.50 04:40:18 02:48:01 AM 0.57 0.00 0.57 0.00 16.41 04:40:18 02:49:01 AM 0.33 0.00 0.33 0.00 31.84 04:40:18 02:50:01 AM 0.17 0.00 0.17 0.00 57.35 04:40:18 02:51:01 AM 0.23 0.00 0.23 0.00 83.54 04:40:18 02:52:01 AM 0.20 0.00 0.20 0.00 17.46 04:40:18 02:53:01 AM 0.28 0.00 0.28 0.00 11.71 04:40:18 02:54:01 AM 0.25 0.00 0.25 0.00 16.25 04:40:18 02:55:01 AM 0.18 0.00 0.18 0.00 15.88 04:40:18 02:56:01 AM 0.12 0.00 0.12 0.00 15.86 04:40:18 02:57:01 AM 0.30 0.00 0.30 0.00 32.94 04:40:18 02:58:01 AM 0.33 0.00 0.33 0.00 71.45 04:40:18 02:59:01 AM 0.22 0.00 0.22 0.00 73.45 04:40:18 03:00:01 AM 0.13 0.00 0.13 0.00 9.46 04:40:18 03:01:01 AM 0.28 0.00 0.28 0.00 16.29 04:40:18 03:02:01 AM 0.35 0.00 0.35 0.00 19.91 04:40:18 03:03:01 AM 0.28 0.00 0.28 0.00 11.88 04:40:18 03:04:01 AM 0.17 0.00 0.17 0.00 15.21 04:40:18 03:05:01 AM 0.15 0.00 0.15 0.00 16.13 04:40:18 03:06:01 AM 0.22 0.00 0.22 0.00 116.83 04:40:18 03:07:01 AM 0.18 0.00 0.18 0.00 44.24 04:40:18 03:08:01 AM 0.47 0.00 0.47 0.00 20.26 04:40:18 03:09:01 AM 0.30 0.00 0.30 0.00 18.53 04:40:18 03:10:01 AM 0.15 0.00 0.15 0.00 10.76 04:40:18 03:11:01 AM 0.28 0.00 0.28 0.00 18.59 04:40:18 03:12:01 AM 0.18 0.00 0.18 0.00 9.18 04:40:18 03:13:01 AM 0.25 0.00 0.25 0.00 17.00 04:40:18 03:14:01 AM 0.22 0.00 0.22 0.00 24.96 04:40:18 03:15:01 AM 0.33 0.00 0.33 0.00 10.66 04:40:18 03:16:01 AM 0.12 0.00 0.12 0.00 5.47 04:40:18 03:17:01 AM 0.17 0.00 0.17 0.00 11.03 04:40:18 03:18:01 AM 0.27 0.00 0.27 0.00 8.38 04:40:18 03:19:01 AM 0.15 0.00 0.15 0.00 10.93 04:40:18 03:20:01 AM 0.13 0.00 0.13 0.00 11.60 04:40:18 03:21:01 AM 0.15 0.00 0.15 0.00 9.38 04:40:18 03:22:01 AM 0.30 0.00 0.30 0.00 19.31 04:40:18 03:23:01 AM 0.27 0.00 0.27 0.00 12.00 04:40:18 03:24:01 AM 0.15 0.00 0.15 0.00 16.26 04:40:18 03:25:01 AM 0.40 0.00 0.40 0.00 19.78 04:40:18 03:26:01 AM 0.92 0.00 0.92 0.00 20.54 04:40:18 03:27:01 AM 0.43 0.00 0.43 0.00 21.20 04:40:18 03:28:01 AM 0.33 0.00 0.33 0.00 9.48 04:40:18 03:29:01 AM 0.18 0.00 0.18 0.00 17.48 04:40:18 03:30:01 AM 0.42 0.00 0.42 0.00 21.18 04:40:18 03:31:01 AM 0.32 0.00 0.32 0.00 15.60 04:40:18 03:32:01 AM 0.13 0.00 0.13 0.00 8.60 04:40:18 03:33:01 AM 0.30 0.00 0.30 0.00 19.68 04:40:18 03:34:01 AM 0.18 0.00 0.18 0.00 13.18 04:40:18 03:35:01 AM 0.28 0.00 0.28 0.00 11.15 04:40:18 03:36:01 AM 0.25 0.00 0.25 0.00 20.98 04:40:18 03:37:01 AM 0.38 0.00 0.38 0.00 14.20 04:40:18 03:38:01 AM 0.38 0.00 0.38 0.00 17.20 04:40:18 03:39:01 AM 0.22 0.00 0.22 0.00 14.15 04:40:18 03:40:01 AM 0.13 0.00 0.13 0.00 8.93 04:40:18 03:41:01 AM 0.40 0.00 0.40 0.00 29.62 04:40:18 03:42:01 AM 0.45 0.00 0.45 0.00 15.43 04:40:18 03:43:01 AM 0.50 0.00 0.50 0.00 12.16 04:40:18 03:44:01 AM 0.18 0.00 0.18 0.00 6.28 04:40:18 03:45:01 AM 0.18 0.00 0.18 0.00 12.26 04:40:18 03:46:01 AM 0.42 0.00 0.42 0.00 11.48 04:40:18 03:47:02 AM 0.45 0.00 0.45 0.00 12.56 04:40:18 03:48:01 AM 0.54 0.00 0.54 0.00 17.45 04:40:18 03:49:01 AM 0.15 0.00 0.15 0.00 5.22 04:40:18 03:50:01 AM 0.13 0.00 0.13 0.00 12.68 04:40:18 03:51:01 AM 0.27 0.00 0.27 0.00 12.01 04:40:18 03:52:01 AM 0.23 0.00 0.23 0.00 17.46 04:40:18 03:53:01 AM 0.23 0.00 0.23 0.00 16.38 04:40:18 03:54:01 AM 0.13 0.00 0.13 0.00 14.00 04:40:18 03:55:01 AM 0.13 0.00 0.13 0.00 8.13 04:40:18 03:56:01 AM 0.13 0.00 0.13 0.00 13.73 04:40:18 03:57:01 AM 0.18 0.00 0.18 0.00 25.21 04:40:18 03:58:01 AM 0.27 0.00 0.27 0.00 9.32 04:40:18 03:59:01 AM 0.25 0.00 0.25 0.00 11.58 04:40:18 04:00:01 AM 0.25 0.00 0.25 0.00 9.75 04:40:18 04:01:01 AM 0.25 0.00 0.25 0.00 7.70 04:40:18 04:02:01 AM 0.33 0.00 0.33 0.00 11.39 04:40:18 04:03:01 AM 0.37 0.00 0.37 0.00 18.38 04:40:18 04:04:01 AM 0.20 0.00 0.20 0.00 5.37 04:40:18 04:05:01 AM 0.17 0.00 0.17 0.00 12.41 04:40:18 04:06:01 AM 0.17 0.00 0.17 0.00 10.51 04:40:18 04:07:01 AM 0.23 0.00 0.23 0.00 15.74 04:40:18 04:08:01 AM 0.32 0.00 0.32 0.00 20.28 04:40:18 04:09:01 AM 0.17 0.00 0.17 0.00 9.11 04:40:18 04:10:01 AM 0.18 0.00 0.18 0.00 15.35 04:40:18 04:11:01 AM 0.27 0.00 0.27 0.00 16.01 04:40:18 04:12:01 AM 0.28 0.00 0.28 0.00 18.96 04:40:18 04:13:01 AM 0.25 0.00 0.25 0.00 19.18 04:40:18 04:14:01 AM 0.22 0.00 0.22 0.00 9.48 04:40:18 04:15:01 AM 0.18 0.00 0.18 0.00 12.28 04:40:18 04:16:01 AM 0.18 0.00 0.18 0.00 8.12 04:40:18 04:17:01 AM 0.22 0.00 0.22 0.00 9.06 04:40:18 04:18:01 AM 0.30 0.00 0.30 0.00 9.45 04:40:18 04:19:01 AM 0.15 0.00 0.15 0.00 11.45 04:40:18 04:20:01 AM 0.40 0.00 0.40 0.00 12.36 04:40:18 04:21:01 AM 0.18 0.00 0.18 0.00 1.80 04:40:18 04:22:01 AM 0.22 0.00 0.22 0.00 18.94 04:40:18 04:23:01 AM 0.52 0.00 0.52 0.00 20.65 04:40:18 04:24:01 AM 0.37 0.00 0.37 0.00 11.05 04:40:18 04:25:01 AM 0.13 0.00 0.13 0.00 16.13 04:40:18 04:26:01 AM 0.12 0.00 0.12 0.00 8.27 04:40:18 04:27:01 AM 0.27 0.00 0.27 0.00 17.85 04:40:18 04:28:01 AM 0.35 0.00 0.35 0.00 30.96 04:40:18 04:29:01 AM 0.17 0.00 0.17 0.00 5.35 04:40:18 04:30:01 AM 0.22 0.00 0.22 0.00 11.05 04:40:18 04:31:01 AM 0.23 0.00 0.23 0.00 10.70 04:40:18 04:32:01 AM 1.03 0.00 1.03 0.00 28.65 04:40:18 04:33:01 AM 0.23 0.00 0.23 0.00 10.50 04:40:18 04:34:01 AM 0.23 0.00 0.23 0.00 11.98 04:40:18 04:35:01 AM 0.15 0.00 0.15 0.00 15.86 04:40:18 04:36:01 AM 0.15 0.00 0.15 0.00 13.76 04:40:18 04:37:01 AM 0.17 0.00 0.17 0.00 7.47 04:40:18 04:38:01 AM 0.27 0.00 0.27 0.00 17.18 04:40:18 04:39:01 AM 14.33 0.32 14.01 36.93 626.73 04:40:18 04:40:01 AM 27.99 0.47 27.52 52.92 4726.41 04:40:18 Average: 1.68 0.08 1.60 11.20 160.56 04:40:18 04:40:18 12:58:01 AM kbmemfree kbavail kbmemused %memused kbbuffers kbcached kbcommit %commit kbactive kbinact kbdirty 04:40:18 12:59:01 AM 5172944 7016696 2709488 34.37 2688 2019288 706940 7.92 198928 2162572 100668 04:40:18 01:00:01 AM 5245380 7090604 2637052 33.45 2688 2021232 638000 7.14 219904 2069188 9564 04:40:18 01:01:01 AM 4957660 7069728 2924772 37.10 2688 2278612 628564 7.04 266912 2279912 176228 04:40:18 01:02:01 AM 4950924 7062968 2931508 37.19 2688 2278696 627560 7.03 267080 2279216 4 04:40:18 01:03:01 AM 4951156 7063204 2931276 37.19 2688 2278700 627560 7.03 267080 2279272 8 04:40:18 01:04:01 AM 4950752 7062800 2931680 37.19 2688 2278700 627560 7.03 267080 2279512 4 04:40:18 01:05:01 AM 4904132 7017068 2978300 37.78 2688 2279588 713780 7.99 267420 2325768 732 04:40:18 01:06:01 AM 4902620 7015936 2979812 37.80 2688 2279968 713780 7.99 267420 2327316 96 04:40:18 01:07:01 AM 4900580 7014272 2981852 37.83 2688 2280344 713780 7.99 267420 2329468 24 04:40:18 01:08:01 AM 4898236 7012300 2984196 37.86 2688 2280716 713780 7.99 267420 2331776 176 04:40:18 01:09:01 AM 4894744 7009544 2987688 37.90 2688 2281452 713780 7.99 267420 2335016 192 04:40:18 01:10:01 AM 4893800 7008804 2988632 37.92 2688 2281656 713780 7.99 267696 2335944 56 04:40:18 01:11:01 AM 4887092 7006024 2995340 38.00 2688 2285584 729156 8.16 267716 2342468 4 04:40:18 01:12:01 AM 4886772 7005828 2995660 38.00 2688 2285716 726184 8.13 267852 2342596 148 04:40:18 01:13:01 AM 4886728 7005828 2995704 38.00 2688 2285760 745448 8.35 267852 2342712 60 04:40:18 01:14:01 AM 4886548 7005924 2995884 38.01 2688 2286044 727928 8.15 267852 2343020 292 04:40:18 01:15:01 AM 4886204 7005952 2996228 38.01 2688 2286416 727928 8.15 267852 2343316 56 04:40:18 01:16:01 AM 4885788 7005912 2996644 38.02 2688 2286784 727928 8.15 267852 2343696 204 04:40:18 01:17:01 AM 4884268 7004772 2998164 38.04 2688 2287164 727928 8.15 267852 2345236 128 04:40:18 01:18:01 AM 4883488 7004364 2998944 38.05 2688 2287536 727928 8.15 267856 2345984 48 04:40:18 01:19:01 AM 4883192 7004444 2999240 38.05 2688 2287912 727928 8.15 267856 2346392 212 04:40:18 01:20:01 AM 4882220 7003928 3000212 38.06 2688 2288368 724284 8.11 267856 2347084 212 04:40:18 01:21:01 AM 4880424 7002640 3002008 38.08 2688 2288892 724284 8.11 267856 2349120 56 04:40:18 01:22:01 AM 4878800 7001300 3003632 38.11 2688 2289176 739700 8.28 267856 2350668 152 04:40:18 01:23:01 AM 4878912 7001656 3003520 38.10 2688 2289412 739700 8.28 267856 2350692 4 04:40:18 01:24:01 AM 4878464 7001492 3003968 38.11 2688 2289696 739700 8.28 267856 2350932 56 04:40:18 01:25:01 AM 4877104 7000416 3005328 38.13 2688 2289980 739700 8.28 267856 2352344 104 04:40:18 01:26:01 AM 4877124 7000708 3005308 38.13 2688 2290260 739700 8.28 267856 2352536 148 04:40:18 01:27:01 AM 4876684 7000576 3005748 38.13 2688 2290560 739700 8.28 268080 2352732 44 04:40:18 01:28:01 AM 4876424 7000388 3006008 38.14 2688 2290632 739700 8.28 268080 2352932 4 04:40:18 01:29:01 AM 4876544 7000524 3005888 38.13 2688 2290648 739700 8.28 268080 2352748 4 04:40:18 01:30:01 AM 4875808 7000080 3006624 38.14 2688 2290948 735916 8.24 268080 2353276 68 04:40:18 01:31:01 AM 4875816 7000472 3006616 38.14 2688 2291328 735916 8.24 268084 2353428 96 04:40:18 01:32:01 AM 4875496 7000524 3006936 38.15 2688 2291692 735916 8.24 268084 2353932 40 04:40:18 01:33:01 AM 4874552 6999956 3007880 38.16 2688 2292068 735916 8.24 268084 2354648 40 04:40:18 01:34:02 AM 4874280 7000068 3008152 38.16 2688 2292460 735916 8.24 268084 2354892 212 04:40:18 01:35:01 AM 4873960 7000112 3008472 38.17 2688 2292824 735916 8.24 268084 2355148 116 04:40:18 01:36:01 AM 4874048 7000512 3008384 38.17 2688 2293128 735916 8.24 268120 2355328 24 04:40:18 01:37:01 AM 4873772 7000284 3008660 38.17 2688 2293176 735916 8.24 268120 2355492 4 04:40:18 01:38:01 AM 4873724 7000244 3008708 38.17 2688 2293184 735916 8.24 268120 2355688 28 04:40:18 01:39:01 AM 4873564 7000416 3008868 38.17 2688 2293524 735916 8.24 268120 2355820 184 04:40:18 01:40:01 AM 4872480 6999680 3009952 38.19 2688 2293872 735916 8.24 268120 2356512 52 04:40:18 01:41:01 AM 4872488 7000072 3009944 38.19 2688 2294256 735916 8.24 268120 2356692 48 04:40:18 01:42:01 AM 4872352 7000288 3010080 38.19 2688 2294608 735916 8.24 268120 2356908 192 04:40:18 01:43:01 AM 4871772 7000084 3010660 38.19 2688 2294984 735916 8.24 268120 2357348 52 04:40:18 01:44:01 AM 4871428 7000312 3011004 38.20 2688 2295556 735916 8.24 268252 2357860 84 04:40:18 01:45:01 AM 4870540 7000172 3011892 38.21 2688 2296304 735916 8.24 268252 2358604 572 04:40:18 01:46:01 AM 4870504 7000320 3011928 38.21 2688 2296480 735916 8.24 268252 2358788 56 04:40:18 01:47:01 AM 4870156 7000252 3012276 38.22 2688 2296760 735916 8.24 268252 2359068 4 04:40:18 01:48:01 AM 4869432 6999812 3013000 38.22 2688 2297044 735916 8.24 268252 2359648 4 04:40:18 01:49:01 AM 4869256 6999920 3013176 38.23 2688 2297328 735916 8.24 268252 2359728 4 04:40:18 01:50:01 AM 4868968 6999912 3013464 38.23 2688 2297608 732200 8.20 268252 2360124 4 04:40:18 01:51:01 AM 4868916 7000144 3013516 38.23 2688 2297892 732200 8.20 268252 2360292 48 04:40:18 01:52:01 AM 4868612 7000096 3013820 38.23 2688 2298148 732200 8.20 268252 2360552 4 04:40:18 01:53:01 AM 4868000 6999888 3014432 38.24 2688 2298560 732200 8.20 268252 2361144 220 04:40:18 01:54:01 AM 4867800 7000072 3014632 38.24 2688 2298952 732200 8.20 268252 2361340 24 04:40:18 01:55:01 AM 4867272 6999912 3015160 38.25 2688 2299312 731736 8.19 268252 2361720 160 04:40:18 01:56:01 AM 4867096 7000116 3015336 38.25 2688 2299692 731736 8.19 268252 2362104 24 04:40:18 01:57:01 AM 4866612 7000024 3015820 38.26 2688 2300084 731736 8.19 268252 2362496 52 04:40:18 01:58:01 AM 4865900 6999688 3016532 38.27 2688 2300460 731736 8.19 268252 2363112 204 04:40:18 01:59:01 AM 4866008 7000052 3016424 38.27 2688 2300708 731736 8.19 268252 2363164 24 04:40:18 02:00:01 AM 4865144 6999572 3017288 38.28 2688 2301100 731052 8.19 268252 2363672 24 04:40:18 02:01:01 AM 4863852 6998660 3018580 38.30 2688 2301480 731052 8.19 268252 2364660 44 04:40:18 02:02:01 AM 4864716 6999916 3017716 38.28 2688 2301872 731052 8.19 268276 2364336 204 04:40:18 02:03:01 AM 4864032 6999608 3018400 38.29 2688 2302248 731052 8.19 268276 2364788 128 04:40:18 02:04:01 AM 4863840 6999788 3018592 38.30 2688 2302612 731052 8.19 268304 2365280 40 04:40:18 02:05:01 AM 4863744 7000080 3018688 38.30 2688 2303008 731052 8.19 268304 2365452 24 04:40:18 02:06:01 AM 4846200 6999608 3036232 38.52 2688 2320028 730984 8.18 270512 2380436 836 04:40:18 02:07:01 AM 4846032 6999792 3036400 38.52 2688 2320388 730984 8.18 270512 2380688 96 04:40:18 02:08:01 AM 4845408 6999548 3037024 38.53 2688 2320768 730984 8.18 270512 2381276 84 04:40:18 02:09:01 AM 4845020 6999532 3037412 38.53 2688 2321132 730984 8.18 270516 2381512 0 04:40:18 02:10:01 AM 4844660 6999552 3037772 38.54 2688 2321520 713112 7.98 270512 2381940 36 04:40:18 02:11:01 AM 4844304 6999588 3038128 38.54 2688 2321900 713112 7.98 270512 2382320 20 04:40:18 02:12:01 AM 4844212 6999872 3038220 38.54 2688 2322276 713112 7.98 270512 2382580 84 04:40:18 02:13:01 AM 4843388 6999704 3039044 38.55 2688 2322924 713112 7.98 270512 2383304 24 04:40:18 02:14:01 AM 4843228 6999824 3039204 38.56 2688 2323204 713112 7.98 270512 2383516 148 04:40:18 02:15:01 AM 4842908 6999780 3039524 38.56 2688 2323488 713112 7.98 270512 2383876 104 04:40:18 02:16:01 AM 4842456 6999612 3039976 38.57 2688 2323772 713112 7.98 270512 2384276 56 04:40:18 02:17:01 AM 4842172 6999572 3040260 38.57 2688 2324008 713112 7.98 270512 2384520 4 04:40:18 02:18:01 AM 4841768 6999448 3040664 38.58 2688 2324288 713112 7.98 270512 2384960 12 04:40:18 02:19:01 AM 4841492 6999492 3040940 38.58 2688 2324608 713112 7.98 270512 2385012 8 04:40:18 02:20:01 AM 4841048 6999300 3041384 38.58 2688 2324868 726364 8.13 270512 2385388 60 04:40:18 02:21:01 AM 4840872 6999484 3041560 38.59 2688 2325220 726364 8.13 270512 2385752 204 04:40:18 02:22:01 AM 4840312 6999300 3042120 38.59 2688 2325596 726364 8.13 270512 2386120 144 04:40:18 02:23:01 AM 4840440 6999804 3041992 38.59 2688 2325972 726364 8.13 270508 2386212 80 04:40:18 02:24:01 AM 4840324 7000072 3042108 38.59 2688 2326364 726364 8.13 270508 2386560 236 04:40:18 02:25:01 AM 4839908 7000032 3042524 38.60 2688 2326740 726364 8.13 270508 2386984 156 04:40:18 02:26:01 AM 4839444 6999916 3042988 38.60 2688 2327088 726364 8.13 270508 2387332 112 04:40:18 02:27:01 AM 4839388 7000164 3043044 38.61 2688 2327384 726364 8.13 270508 2387636 108 04:40:18 02:28:01 AM 4838560 6999708 3043872 38.62 2688 2327764 726364 8.13 270508 2388084 164 04:40:18 02:29:01 AM 4838684 7000220 3043748 38.61 2688 2328140 726364 8.13 270508 2388400 24 04:40:18 02:30:01 AM 4837976 6999892 3044456 38.62 2688 2328520 713048 7.98 270508 2388896 176 04:40:18 02:31:01 AM 4837948 7000132 3044484 38.62 2688 2328788 713048 7.98 270508 2389128 68 04:40:18 02:32:01 AM 4837256 6999812 3045176 38.63 2688 2329168 713048 7.98 270508 2389700 48 04:40:18 02:33:01 AM 4836700 6999640 3045732 38.64 2688 2329544 713048 7.98 270508 2390068 220 04:40:18 02:34:01 AM 4836444 7000000 3045988 38.64 2688 2330168 713048 7.98 270508 2390528 68 04:40:18 02:35:01 AM 4836204 6999984 3046228 38.65 2688 2330392 713048 7.98 270508 2390752 160 04:40:18 02:36:01 AM 4835972 6999976 3046460 38.65 2688 2330608 713048 7.98 270508 2390880 156 04:40:18 02:37:01 AM 4835752 6999968 3046680 38.65 2688 2330828 728560 8.16 270508 2391092 84 04:40:18 02:38:01 AM 4835660 7000072 3046772 38.65 2688 2331016 728560 8.16 270508 2391356 120 04:40:18 02:39:01 AM 4835676 7000304 3046756 38.65 2688 2331232 728560 8.16 270508 2391504 76 04:40:18 02:40:01 AM 4834584 6999520 3047848 38.67 2688 2331540 724632 8.11 270508 2391932 148 04:40:18 02:41:02 AM 4832084 6998760 3050348 38.70 2688 2333272 724632 8.11 270508 2394704 632 04:40:18 02:42:01 AM 4824472 6993868 3057960 38.79 2688 2335992 724632 8.11 270516 2402248 448 04:40:18 02:43:01 AM 4823240 6993032 3059192 38.81 2688 2336392 724632 8.11 270516 2403600 52 04:40:18 02:44:01 AM 4822728 6992904 3059704 38.82 2688 2336776 740008 8.29 270516 2404032 204 04:40:18 02:45:01 AM 4822512 6993064 3059920 38.82 2688 2337152 740008 8.29 270516 2404408 132 04:40:18 02:46:01 AM 4822172 6993084 3060260 38.82 2688 2337512 740008 8.29 270516 2404652 84 04:40:18 02:47:01 AM 4821736 6993036 3060696 38.83 2688 2337892 740008 8.29 270516 2405156 4 04:40:18 02:48:01 AM 4821264 6992932 3061168 38.84 2688 2338268 740008 8.29 270516 2405548 104 04:40:18 02:49:01 AM 4820020 6993020 3062412 38.85 2688 2339608 740008 8.29 270516 2406744 572 04:40:18 02:50:01 AM 4816940 6992768 3065492 38.89 2688 2342440 735120 8.23 270516 2409684 1708 04:40:18 02:51:01 AM 4815776 6992508 3066656 38.90 2688 2343320 735120 8.23 270516 2410736 128 04:40:18 02:52:01 AM 4815456 6992576 3066976 38.91 2688 2343700 735120 8.23 270516 2411480 52 04:40:18 02:53:01 AM 4814712 6992200 3067720 38.92 2688 2344076 735120 8.23 270516 2412264 204 04:40:18 02:54:01 AM 4814280 6992152 3068152 38.92 2688 2344452 735120 8.23 270516 2412584 172 04:40:18 02:55:01 AM 4813816 6992076 3068616 38.93 2688 2344848 735120 8.23 270516 2412972 144 04:40:18 02:56:01 AM 4813492 6992128 3068940 38.93 2688 2345216 735120 8.23 270516 2413364 60 04:40:18 02:57:01 AM 4812504 6992012 3069928 38.95 2688 2346088 735120 8.23 270516 2414372 4 04:40:18 02:58:01 AM 4809680 6992020 3072752 38.98 2688 2348916 735120 8.23 270516 2417268 812 04:40:18 02:59:01 AM 4807944 6991708 3074488 39.00 2688 2350336 735120 8.23 270516 2418772 68 04:40:18 03:00:01 AM 4807368 6991500 3075064 39.01 2688 2350712 729008 8.16 270516 2419164 188 04:40:18 03:01:01 AM 4805768 6990284 3076664 39.03 2688 2351096 729008 8.16 270516 2420616 172 04:40:18 03:02:01 AM 4805800 6990692 3076632 39.03 2688 2351472 744448 8.34 270528 2420980 68 04:40:18 03:03:01 AM 4805304 6990576 3077128 39.04 2688 2351852 744448 8.34 270528 2421428 220 04:40:18 03:04:01 AM 4804016 6989652 3078416 39.05 2688 2352212 744448 8.34 270528 2422648 172 04:40:18 03:05:01 AM 4803396 6989924 3079036 39.06 2688 2353124 744448 8.34 270528 2423336 632 04:40:18 03:06:01 AM 4800508 6989896 3081924 39.10 2688 2355952 744448 8.34 270528 2426192 4 04:40:18 03:07:01 AM 4799196 6990000 3083236 39.12 2688 2357368 744448 8.34 270528 2427608 128 04:40:18 03:08:01 AM 4798752 6989924 3083680 39.12 2688 2357744 744448 8.34 270528 2428044 80 04:40:18 03:09:01 AM 4798492 6990052 3083940 39.12 2688 2358124 744448 8.34 270528 2428364 4 04:40:18 03:10:01 AM 4797856 6989784 3084576 39.13 2688 2358500 722944 8.09 270528 2428852 96 04:40:18 03:11:01 AM 4797812 6990116 3084620 39.13 2688 2358876 722944 8.09 270528 2429120 20 04:40:18 03:12:01 AM 4796940 6989628 3085492 39.14 2688 2359256 722944 8.09 270528 2429624 188 04:40:18 03:13:01 AM 4796712 6989808 3085720 39.15 2688 2359660 722944 8.09 270528 2429996 200 04:40:18 03:14:01 AM 4796236 6989840 3086196 39.15 2688 2360168 722944 8.09 270528 2430548 4 04:40:18 03:15:01 AM 4796156 6989980 3086276 39.15 2688 2360388 722944 8.09 270528 2430652 36 04:40:18 03:16:01 AM 4796076 6990120 3086356 39.15 2688 2360608 722944 8.09 270528 2430872 116 04:40:18 03:17:01 AM 4795624 6989892 3086808 39.16 2688 2360828 722944 8.09 270528 2431188 40 04:40:18 03:18:01 AM 4795284 6989776 3087148 39.16 2688 2361052 722944 8.09 270528 2431384 116 04:40:18 03:19:01 AM 4795092 6989796 3087340 39.17 2688 2361272 722944 8.09 270528 2431528 40 04:40:18 03:20:01 AM 4794756 6989756 3087676 39.17 2688 2361560 726440 8.13 270528 2431948 4 04:40:18 03:21:01 AM 4794572 6989932 3087860 39.17 2688 2361928 726440 8.13 270528 2432312 128 04:40:18 03:22:01 AM 4793928 6989664 3088504 39.18 2688 2362304 726440 8.13 270528 2432860 52 04:40:18 03:23:01 AM 4793188 6989312 3089244 39.19 2688 2362680 741816 8.31 270528 2433412 200 04:40:18 03:24:01 AM 4792872 6989368 3089560 39.20 2688 2363060 741816 8.31 270528 2433920 128 04:40:18 03:25:01 AM 4792764 6989648 3089668 39.20 2688 2363440 741816 8.31 270528 2434176 20 04:40:18 03:26:01 AM 4792212 6989468 3090220 39.20 2688 2363820 747692 8.37 279652 2425348 140 04:40:18 03:27:01 AM 4791776 6989348 3090656 39.21 2688 2364128 747692 8.37 279652 2425664 24 04:40:18 03:28:01 AM 4791476 6989392 3090956 39.21 2688 2364480 747692 8.37 279652 2426076 240 04:40:18 03:29:01 AM 4790704 6989004 3091728 39.22 2688 2364856 747692 8.37 279652 2426628 156 04:40:18 03:30:01 AM 4790248 6988920 3092184 39.23 2688 2365236 729120 8.16 279652 2426996 20 04:40:18 03:31:01 AM 4790264 6989312 3092168 39.23 2688 2365612 729120 8.16 279652 2427140 36 04:40:18 03:32:01 AM 4789960 6989388 3092472 39.23 2688 2365992 729120 8.16 279652 2427520 188 04:40:18 03:33:01 AM 4789312 6989124 3093120 39.24 2688 2366368 744512 8.34 279652 2428080 128 04:40:18 03:34:01 AM 4789296 6989336 3093136 39.24 2688 2366596 744512 8.34 279652 2428172 24 04:40:18 03:35:01 AM 4788940 6989404 3093492 39.25 2688 2367028 744512 8.34 279652 2428596 236 04:40:18 03:36:01 AM 4788504 6989336 3093928 39.25 2688 2367388 744512 8.34 279652 2429092 36 04:40:18 03:37:01 AM 4788484 6989672 3093948 39.25 2688 2367748 744512 8.34 279652 2429432 80 04:40:18 03:38:01 AM 4787560 6989100 3094872 39.26 2688 2368100 744512 8.34 279652 2430068 68 04:40:18 03:39:01 AM 4787676 6989584 3094756 39.26 2688 2368460 744512 8.34 279652 2430056 52 04:40:18 03:40:01 AM 4786548 6988840 3095884 39.28 2688 2368852 730128 8.18 279652 2430940 220 04:40:18 03:41:01 AM 4786224 6989208 3096208 39.28 2688 2369540 730128 8.18 279652 2431412 136 04:40:18 03:42:01 AM 4786136 6989312 3096296 39.28 2688 2369724 730128 8.18 279652 2431332 8 04:40:18 03:43:01 AM 4785976 6989372 3096456 39.28 2688 2369944 730128 8.18 279652 2431620 48 04:40:18 03:44:01 AM 4785788 6989404 3096644 39.29 2688 2370164 730128 8.18 279652 2431772 116 04:40:18 03:45:01 AM 4785564 6989400 3096868 39.29 2688 2370384 730128 8.18 279652 2431992 4 04:40:18 03:46:01 AM 4785432 6989492 3097000 39.29 2688 2370608 730128 8.18 279652 2432332 4 04:40:18 03:47:02 AM 4784960 6989352 3097472 39.30 2688 2370948 730128 8.18 279652 2432664 96 04:40:18 03:48:01 AM 4784748 6989372 3097684 39.30 2688 2371172 730128 8.18 279660 2432844 4 04:40:18 03:49:01 AM 4784364 6989140 3098068 39.30 2688 2371332 730128 8.18 279660 2432928 56 04:40:18 03:50:01 AM 4783944 6989028 3098488 39.31 2688 2371640 745504 8.35 279664 2433348 4 04:40:18 03:51:01 AM 4783876 6989360 3098556 39.31 2688 2372040 745504 8.35 279664 2433752 144 04:40:18 03:52:01 AM 4783372 6989232 3099060 39.32 2688 2372416 745504 8.35 279664 2434128 84 04:40:18 03:53:01 AM 4783008 6989212 3099424 39.32 2688 2372760 745504 8.35 279664 2434424 48 04:40:18 03:54:01 AM 4782640 6989224 3099792 39.33 2688 2373128 745504 8.35 279664 2434840 28 04:40:18 03:55:01 AM 4782408 6989344 3100024 39.33 2688 2373488 745504 8.35 279664 2435076 168 04:40:18 03:56:01 AM 4782120 6989432 3100312 39.33 2688 2373864 745504 8.35 279664 2435452 160 04:40:18 03:57:01 AM 4781348 6989284 3101084 39.34 2688 2374488 745504 8.35 279664 2436076 64 04:40:18 03:58:01 AM 4780856 6989016 3101576 39.35 2688 2374708 745504 8.35 279664 2436608 128 04:40:18 03:59:01 AM 4780996 6989344 3101436 39.35 2688 2374892 745504 8.35 279664 2436644 56 04:40:18 04:00:01 AM 4780500 6989068 3101932 39.35 2688 2375112 729268 8.17 279664 2436864 48 04:40:18 04:01:01 AM 4779452 6988240 3102980 39.37 2688 2375336 745100 8.34 279664 2437660 116 04:40:18 04:02:01 AM 4780280 6989296 3102152 39.36 2688 2375556 745100 8.34 279676 2437180 116 04:40:18 04:03:01 AM 4779952 6989276 3102480 39.36 2688 2375868 745100 8.34 279676 2437564 48 04:40:18 04:04:01 AM 4779332 6988928 3103100 39.37 2688 2376140 745100 8.34 279696 2437888 232 04:40:18 04:05:01 AM 4779436 6989188 3102996 39.37 2688 2376296 745100 8.34 279696 2437908 48 04:40:18 04:06:01 AM 4779168 6989344 3103264 39.37 2688 2376716 745100 8.34 279696 2438332 188 04:40:18 04:07:01 AM 4778916 6989468 3103516 39.37 2688 2377092 745100 8.34 279696 2438700 156 04:40:18 04:08:01 AM 4777900 6988836 3104532 39.39 2688 2377472 745100 8.34 279696 2439420 56 04:40:18 04:09:01 AM 4777648 6988944 3104784 39.39 2688 2377836 745100 8.34 279696 2439716 188 04:40:18 04:10:01 AM 4777168 6988848 3105264 39.39 2688 2378212 738320 8.27 279696 2439944 144 04:40:18 04:11:01 AM 4777300 6989356 3105132 39.39 2688 2378592 738320 8.27 279696 2440320 128 04:40:18 04:12:01 AM 4776564 6989272 3105868 39.40 2688 2379232 738320 8.27 279696 2440856 296 04:40:18 04:13:01 AM 4776272 6989260 3106160 39.41 2688 2379512 738320 8.27 279696 2441200 128 04:40:18 04:14:01 AM 4775924 6989136 3106508 39.41 2688 2379736 738320 8.27 279696 2441356 120 04:40:18 04:15:01 AM 4775756 6989184 3106676 39.41 2688 2379952 738320 8.27 279696 2441688 4 04:40:18 04:16:01 AM 4775744 6989384 3106688 39.41 2688 2380172 738320 8.27 279696 2441784 48 04:40:18 04:17:01 AM 4775400 6989272 3107032 39.42 2688 2380396 738320 8.27 279696 2442016 48 04:40:18 04:18:01 AM 4775124 6989208 3107308 39.42 2688 2380616 738320 8.27 279696 2442428 116 04:40:18 04:19:01 AM 4774608 6988948 3107824 39.43 2688 2380864 738320 8.27 279696 2442620 60 04:40:18 04:20:01 AM 4774552 6989056 3107880 39.43 2688 2381028 730144 8.18 279700 2442780 4 04:40:18 04:21:01 AM 4774376 6989144 3108056 39.43 2688 2381288 730144 8.18 279704 2442920 264 04:40:18 04:22:01 AM 4774292 6989380 3108140 39.43 2688 2381616 730144 8.18 279704 2443244 112 04:40:18 04:23:01 AM 4773592 6989020 3108840 39.44 2688 2381948 730144 8.18 279704 2443644 4 04:40:18 04:24:01 AM 4773544 6989332 3108888 39.44 2688 2382308 730144 8.18 279704 2443900 144 04:40:18 04:25:01 AM 4773228 6989396 3109204 39.44 2688 2382688 730144 8.18 279704 2444280 68 04:40:18 04:26:01 AM 4772524 6989060 3109908 39.45 2688 2383064 730144 8.18 279704 2444800 220 04:40:18 04:27:01 AM 4772308 6989228 3110124 39.46 2688 2383440 730144 8.18 279704 2445032 144 04:40:18 04:28:01 AM 4771612 6989188 3110820 39.47 2688 2384104 730144 8.18 279704 2445792 24 04:40:18 04:29:01 AM 4771532 6989336 3110900 39.47 2688 2384332 730144 8.18 279704 2445952 128 04:40:18 04:30:01 AM 4771204 6989244 3111228 39.47 2688 2384568 730128 8.18 279704 2446304 104 04:40:18 04:31:01 AM 4770908 6989232 3111524 39.47 2688 2384852 761460 8.53 280316 2445864 392 04:40:18 04:32:01 AM 4770704 6989320 3111728 39.48 2688 2385136 761460 8.53 280316 2446156 56 04:40:18 04:33:01 AM 4769656 6988556 3112776 39.49 2688 2385420 761460 8.53 280316 2446896 148 04:40:18 04:34:01 AM 4769544 6988828 3112888 39.49 2688 2385804 741668 8.30 280316 2447128 252 04:40:18 04:35:01 AM 4769100 6988732 3113332 39.50 2688 2386152 758068 8.49 280316 2447500 168 04:40:18 04:36:01 AM 4764088 6984076 3118344 39.56 2688 2386516 775980 8.69 280316 2452196 148 04:40:18 04:37:01 AM 4763476 6983748 3118956 39.57 2688 2386792 795036 8.90 280316 2452736 232 04:40:18 04:38:01 AM 4760264 6980916 3122168 39.61 2688 2387164 837652 9.38 280316 2455512 196 04:40:18 04:39:01 AM 4701836 6886996 3180596 40.35 2688 2355584 768308 8.60 405588 2408000 156628 04:40:18 04:40:01 AM 4802580 6947928 3079852 39.07 2688 2317808 733488 8.21 571916 2148192 11416 04:40:18 Average: 4828097 6996093 3054335 38.75 2688 2334719 731629 8.19 274221 2395488 2170 04:40:18 04:40:18 12:58:01 AM IFACE rxpck/s txpck/s rxkB/s txkB/s rxcmp/s txcmp/s rxmcst/s %ifutil 04:40:18 12:59:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 12:59:01 AM eth0 123.98 97.70 1328.51 12.83 0.00 0.00 0.00 0.00 04:40:18 01:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 01:00:01 AM eth0 17.58 13.13 7.01 4.81 0.00 0.00 0.00 0.00 04:40:18 01:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 01:01:01 AM eth0 51.02 45.29 344.94 13.78 0.00 0.00 0.00 0.00 04:40:18 01:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 01:02:01 AM eth0 576.52 415.44 108.80 89.38 0.00 0.00 0.00 0.00 04:40:18 01:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 01:03:01 AM eth0 2.30 1.83 0.52 0.45 0.00 0.00 0.00 0.00 04:40:18 01:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 01:04:01 AM eth0 3.27 2.10 0.77 0.62 0.00 0.00 0.00 0.00 04:40:18 01:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 01:05:01 AM eth0 48.07 29.94 13.58 4.01 0.00 0.00 0.00 0.00 04:40:18 01:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 01:06:01 AM eth0 11.76 9.33 2.77 1.81 0.00 0.00 0.00 0.00 04:40:18 01:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 01:07:01 AM eth0 12.45 9.23 2.81 1.80 0.00 0.00 0.00 0.00 04:40:18 01:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 01:08:01 AM eth0 12.41 9.65 3.36 2.32 0.00 0.00 0.00 0.00 04:40:18 01:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 01:09:01 AM eth0 22.51 18.45 5.65 3.67 0.00 0.00 0.00 0.00 04:40:18 01:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 01:10:01 AM eth0 4.82 1.62 0.81 0.30 0.00 0.00 0.00 0.00 04:40:18 01:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 01:11:01 AM eth0 64.25 64.41 30.17 5.30 0.00 0.00 0.00 0.00 04:40:18 01:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 01:12:01 AM eth0 7.31 6.83 1.11 0.48 0.00 0.00 0.00 0.00 04:40:18 01:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 01:13:01 AM eth0 7.25 6.90 1.11 0.55 0.00 0.00 0.00 0.00 04:40:18 01:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 01:14:01 AM eth0 16.78 15.41 2.95 1.73 0.00 0.00 0.00 0.00 04:40:18 01:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 01:15:01 AM eth0 11.30 9.00 2.63 1.75 0.00 0.00 0.00 0.00 04:40:18 01:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 01:16:01 AM eth0 11.43 9.16 2.66 1.80 0.00 0.00 0.00 0.00 04:40:18 01:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 01:17:01 AM eth0 12.61 9.08 2.82 1.79 0.00 0.00 0.00 0.00 04:40:18 01:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 01:18:01 AM eth0 12.35 9.55 3.42 2.30 0.00 0.00 0.00 0.00 04:40:18 01:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 01:19:01 AM eth0 12.08 9.27 2.99 1.99 0.00 0.00 0.00 0.00 04:40:18 01:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 01:20:01 AM eth0 15.58 11.20 3.52 2.21 0.00 0.00 0.00 0.00 04:40:18 01:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 01:21:01 AM eth0 10.69 8.70 2.58 1.59 0.00 0.00 0.00 0.00 04:40:18 01:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 01:22:01 AM eth0 1.88 0.93 0.55 0.33 0.00 0.00 0.00 0.00 04:40:18 01:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 01:23:01 AM eth0 0.88 0.65 0.30 0.18 0.00 0.00 0.00 0.00 04:40:18 01:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 01:24:01 AM eth0 1.45 0.65 0.29 0.13 0.00 0.00 0.00 0.00 04:40:18 01:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 01:25:01 AM eth0 0.85 0.67 0.20 0.13 0.00 0.00 0.00 0.00 04:40:18 01:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 01:26:01 AM eth0 3.03 0.65 0.30 0.13 0.00 0.00 0.00 0.00 04:40:18 01:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 01:27:01 AM eth0 16.71 12.06 2.50 1.35 0.00 0.00 0.00 0.00 04:40:18 01:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 01:28:01 AM eth0 5.27 2.73 1.51 0.85 0.00 0.00 0.00 0.00 04:40:18 01:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 01:29:01 AM eth0 0.37 0.07 0.03 0.01 0.00 0.00 0.00 0.00 04:40:18 01:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 01:30:01 AM eth0 16.38 9.81 3.00 1.47 0.00 0.00 0.00 0.00 04:40:18 01:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 01:31:01 AM eth0 11.75 9.07 2.77 1.79 0.00 0.00 0.00 0.00 04:40:18 01:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 01:32:01 AM eth0 11.81 8.92 2.75 1.78 0.00 0.00 0.00 0.00 04:40:18 01:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 01:33:01 AM eth0 11.71 9.56 3.10 2.07 0.00 0.00 0.00 0.00 04:40:18 01:34:02 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 01:34:02 AM eth0 12.53 9.23 3.06 1.98 0.00 0.00 0.00 0.00 04:40:18 01:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 01:35:01 AM eth0 11.01 9.05 2.68 1.78 0.00 0.00 0.00 0.00 04:40:18 01:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 01:36:01 AM eth0 8.32 6.50 1.92 1.28 0.00 0.00 0.00 0.00 04:40:18 01:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 01:37:01 AM eth0 2.52 1.82 0.36 0.12 0.00 0.00 0.00 0.00 04:40:18 01:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 01:38:01 AM eth0 2.33 0.53 0.84 0.52 0.00 0.00 0.00 0.00 04:40:18 01:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 01:39:01 AM eth0 10.63 9.50 2.15 1.41 0.00 0.00 0.00 0.00 04:40:18 01:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 01:40:01 AM eth0 11.38 8.38 2.61 1.66 0.00 0.00 0.00 0.00 04:40:18 01:41:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 01:41:01 AM eth0 12.65 9.37 3.05 1.99 0.00 0.00 0.00 0.00 04:40:18 01:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 01:42:01 AM eth0 10.71 8.52 2.52 1.66 0.00 0.00 0.00 0.00 04:40:18 01:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 01:43:01 AM eth0 11.40 9.05 2.84 1.85 0.00 0.00 0.00 0.00 04:40:18 01:44:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 01:44:01 AM eth0 12.01 9.23 2.85 1.80 0.00 0.00 0.00 0.00 04:40:18 01:45:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 01:45:01 AM eth0 22.28 18.09 5.49 3.44 0.00 0.00 0.00 0.00 04:40:18 01:46:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 01:46:01 AM eth0 1.20 0.62 0.19 0.11 0.00 0.00 0.00 0.00 04:40:18 01:47:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 01:47:01 AM eth0 3.12 0.63 0.41 0.13 0.00 0.00 0.00 0.00 04:40:18 01:48:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 01:48:01 AM eth0 3.20 1.00 0.80 0.45 0.00 0.00 0.00 0.00 04:40:18 01:49:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 01:49:01 AM eth0 0.82 0.60 0.20 0.13 0.00 0.00 0.00 0.00 04:40:18 01:50:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 01:50:01 AM eth0 2.97 0.68 0.47 0.14 0.00 0.00 0.00 0.00 04:40:18 01:51:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 01:51:01 AM eth0 0.88 0.62 0.20 0.13 0.00 0.00 0.00 0.00 04:40:18 01:52:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 01:52:01 AM eth0 13.11 12.28 2.22 1.34 0.00 0.00 0.00 0.00 04:40:18 01:53:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 01:53:01 AM eth0 14.55 13.23 3.19 1.95 0.00 0.00 0.00 0.00 04:40:18 01:54:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 01:54:01 AM eth0 11.45 9.07 2.72 1.79 0.00 0.00 0.00 0.00 04:40:18 01:55:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 01:55:01 AM eth0 11.65 9.06 2.82 1.79 0.00 0.00 0.00 0.00 04:40:18 01:56:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 01:56:01 AM eth0 11.73 9.20 2.74 1.80 0.00 0.00 0.00 0.00 04:40:18 01:57:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 01:57:01 AM eth0 12.05 9.12 2.83 1.79 0.00 0.00 0.00 0.00 04:40:18 01:58:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 01:58:01 AM eth0 14.90 9.43 37.11 2.12 0.00 0.00 0.00 0.00 04:40:18 01:59:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 01:59:01 AM eth0 6.33 5.13 1.47 1.02 0.00 0.00 0.00 0.00 04:40:18 02:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 02:00:01 AM eth0 14.45 11.11 2.96 1.74 0.00 0.00 0.00 0.00 04:40:18 02:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 02:01:01 AM eth0 11.65 9.31 2.81 1.82 0.00 0.00 0.00 0.00 04:40:18 02:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 02:02:01 AM eth0 11.61 9.03 2.71 1.79 0.00 0.00 0.00 0.00 04:40:18 02:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 02:03:01 AM eth0 11.81 9.21 2.88 1.86 0.00 0.00 0.00 0.00 04:40:18 02:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 02:04:01 AM eth0 11.73 9.30 2.93 2.00 0.00 0.00 0.00 0.00 04:40:18 02:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 02:05:01 AM eth0 11.58 9.21 2.87 1.80 0.00 0.00 0.00 0.00 04:40:18 02:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 02:06:01 AM eth0 9.63 8.00 2.00 1.34 0.00 0.00 0.00 0.00 04:40:18 02:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 02:07:01 AM eth0 14.03 10.86 2.88 1.71 0.00 0.00 0.00 0.00 04:40:18 02:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 02:08:01 AM eth0 12.40 9.60 3.45 2.31 0.00 0.00 0.00 0.00 04:40:18 02:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 02:09:01 AM eth0 11.18 9.10 2.71 1.79 0.00 0.00 0.00 0.00 04:40:18 02:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 02:10:01 AM eth0 17.04 9.08 12.75 1.79 0.00 0.00 0.00 0.00 04:40:18 02:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 02:11:01 AM eth0 10.98 9.07 2.69 1.79 0.00 0.00 0.00 0.00 04:40:18 02:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 02:12:01 AM eth0 11.58 9.11 2.75 1.79 0.00 0.00 0.00 0.00 04:40:18 02:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 02:13:01 AM eth0 18.10 14.80 4.55 2.87 0.00 0.00 0.00 0.00 04:40:18 02:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 02:14:01 AM eth0 1.15 0.70 0.22 0.14 0.00 0.00 0.00 0.00 04:40:18 02:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 02:15:01 AM eth0 0.72 0.60 0.19 0.13 0.00 0.00 0.00 0.00 04:40:18 02:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 02:16:01 AM eth0 2.68 0.67 0.28 0.13 0.00 0.00 0.00 0.00 04:40:18 02:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 02:17:01 AM eth0 6.06 0.57 0.58 0.12 0.00 0.00 0.00 0.00 04:40:18 02:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 02:18:01 AM eth0 3.22 1.58 1.24 0.88 0.00 0.00 0.00 0.00 04:40:18 02:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 02:19:01 AM eth0 7.33 6.83 1.48 0.96 0.00 0.00 0.00 0.00 04:40:18 02:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 02:20:01 AM eth0 19.39 13.28 3.03 1.27 0.00 0.00 0.00 0.00 04:40:18 02:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 02:21:01 AM eth0 11.53 8.57 2.63 1.69 0.00 0.00 0.00 0.00 04:40:18 02:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 02:22:01 AM eth0 11.53 9.00 2.69 1.79 0.00 0.00 0.00 0.00 04:40:18 02:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 02:23:01 AM eth0 11.90 9.37 2.96 1.89 0.00 0.00 0.00 0.00 04:40:18 02:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 02:24:01 AM eth0 12.03 9.12 2.75 1.80 0.00 0.00 0.00 0.00 04:40:18 02:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 02:25:01 AM eth0 11.30 9.23 2.69 1.80 0.00 0.00 0.00 0.00 04:40:18 02:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 02:26:01 AM eth0 10.56 8.40 2.46 1.65 0.00 0.00 0.00 0.00 04:40:18 02:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 02:27:01 AM eth0 5.32 4.58 1.12 0.76 0.00 0.00 0.00 0.00 04:40:18 02:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 02:28:01 AM eth0 14.66 11.98 3.25 1.99 0.00 0.00 0.00 0.00 04:40:18 02:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 02:29:01 AM eth0 11.33 8.95 2.71 1.78 0.00 0.00 0.00 0.00 04:40:18 02:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 02:30:01 AM eth0 11.35 9.01 2.68 1.79 0.00 0.00 0.00 0.00 04:40:18 02:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 02:31:01 AM eth0 8.02 6.87 2.00 1.32 0.00 0.00 0.00 0.00 04:40:18 02:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 02:32:01 AM eth0 12.61 9.26 3.05 1.99 0.00 0.00 0.00 0.00 04:40:18 02:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 02:33:01 AM eth0 11.43 9.27 3.03 2.04 0.00 0.00 0.00 0.00 04:40:18 02:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 02:34:01 AM eth0 16.85 13.56 4.16 2.54 0.00 0.00 0.00 0.00 04:40:18 02:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 02:35:01 AM eth0 0.67 0.50 0.20 0.09 0.00 0.00 0.00 0.00 04:40:18 02:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 02:36:01 AM eth0 1.35 0.45 0.30 0.09 0.00 0.00 0.00 0.00 04:40:18 02:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 02:37:01 AM eth0 0.72 0.40 0.19 0.09 0.00 0.00 0.00 0.00 04:40:18 02:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 02:38:01 AM eth0 1.03 0.45 0.30 0.14 0.00 0.00 0.00 0.00 04:40:18 02:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 02:39:01 AM eth0 0.55 0.40 0.18 0.09 0.00 0.00 0.00 0.00 04:40:18 02:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 02:40:01 AM eth0 7.75 6.90 1.50 0.97 0.00 0.00 0.00 0.00 04:40:18 02:41:02 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 02:41:02 AM eth0 9.53 10.01 1.87 0.99 0.00 0.00 0.00 0.00 04:40:18 02:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 02:42:01 AM eth0 5.27 5.81 1.54 0.93 0.00 0.00 0.00 0.00 04:40:18 02:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 02:43:01 AM eth0 12.66 10.90 3.00 1.97 0.00 0.00 0.00 0.00 04:40:18 02:44:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 02:44:01 AM eth0 11.36 9.13 2.70 1.80 0.00 0.00 0.00 0.00 04:40:18 02:45:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 02:45:01 AM eth0 10.70 9.02 2.62 1.79 0.00 0.00 0.00 0.00 04:40:18 02:46:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 02:46:01 AM eth0 11.11 8.73 2.65 1.77 0.00 0.00 0.00 0.00 04:40:18 02:47:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 02:47:01 AM eth0 11.40 9.17 2.72 1.80 0.00 0.00 0.00 0.00 04:40:18 02:48:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 02:48:01 AM eth0 11.73 9.31 3.10 2.11 0.00 0.00 0.00 0.00 04:40:18 02:49:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 02:49:01 AM eth0 7.08 6.78 1.37 1.01 0.00 0.00 0.00 0.00 04:40:18 02:50:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 02:50:01 AM eth0 2.05 2.57 0.17 0.48 0.00 0.00 0.00 0.00 04:40:18 02:51:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 02:51:01 AM eth0 9.75 8.72 2.22 1.53 0.00 0.00 0.00 0.00 04:40:18 02:52:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 02:52:01 AM eth0 11.13 9.08 2.66 1.79 0.00 0.00 0.00 0.00 04:40:18 02:53:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 02:53:01 AM eth0 11.26 9.30 2.84 1.86 0.00 0.00 0.00 0.00 04:40:18 02:54:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 02:54:01 AM eth0 11.86 9.13 2.83 1.80 0.00 0.00 0.00 0.00 04:40:18 02:55:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 02:55:01 AM eth0 11.18 9.07 2.72 1.79 0.00 0.00 0.00 0.00 04:40:18 02:56:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 02:56:01 AM eth0 11.60 9.20 2.73 1.80 0.00 0.00 0.00 0.00 04:40:18 02:57:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 02:57:01 AM eth0 9.36 8.20 1.98 1.33 0.00 0.00 0.00 0.00 04:40:18 02:58:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 02:58:01 AM eth0 2.17 2.68 0.30 0.54 0.00 0.00 0.00 0.00 04:40:18 02:59:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 02:59:01 AM eth0 8.80 8.27 1.89 1.44 0.00 0.00 0.00 0.00 04:40:18 03:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 03:00:01 AM eth0 11.21 9.15 2.70 1.81 0.00 0.00 0.00 0.00 04:40:18 03:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 03:01:01 AM eth0 10.86 8.85 2.61 1.74 0.00 0.00 0.00 0.00 04:40:18 03:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 03:02:01 AM eth0 11.43 9.28 2.76 1.81 0.00 0.00 0.00 0.00 04:40:18 03:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 03:03:01 AM eth0 11.38 9.15 2.82 1.85 0.00 0.00 0.00 0.00 04:40:18 03:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 03:04:01 AM eth0 11.75 9.27 2.95 1.98 0.00 0.00 0.00 0.00 04:40:18 03:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 03:05:01 AM eth0 10.36 9.26 2.15 1.50 0.00 0.00 0.00 0.00 04:40:18 03:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 03:06:01 AM eth0 1.87 2.55 0.16 0.48 0.00 0.00 0.00 0.00 04:40:18 03:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 03:07:01 AM eth0 9.12 8.65 1.80 1.31 0.00 0.00 0.00 0.00 04:40:18 03:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 03:08:01 AM eth0 10.98 9.11 2.76 1.85 0.00 0.00 0.00 0.00 04:40:18 03:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 03:09:01 AM eth0 10.96 9.08 2.68 1.79 0.00 0.00 0.00 0.00 04:40:18 03:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 03:10:01 AM eth0 11.35 9.11 2.71 1.79 0.00 0.00 0.00 0.00 04:40:18 03:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 03:11:01 AM eth0 11.23 9.11 2.74 1.79 0.00 0.00 0.00 0.00 04:40:18 03:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 03:12:01 AM eth0 11.45 9.13 2.71 1.80 0.00 0.00 0.00 0.00 04:40:18 03:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 03:13:01 AM eth0 15.95 9.93 3.24 2.02 0.00 0.00 0.00 0.00 04:40:18 03:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 03:14:01 AM eth0 12.05 10.00 3.01 1.84 0.00 0.00 0.00 0.00 04:40:18 03:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 03:15:01 AM eth0 0.68 0.45 0.19 0.09 0.00 0.00 0.00 0.00 04:40:18 03:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 03:16:01 AM eth0 0.73 0.40 0.19 0.09 0.00 0.00 0.00 0.00 04:40:18 03:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 03:17:01 AM eth0 0.58 0.45 0.18 0.09 0.00 0.00 0.00 0.00 04:40:18 03:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 03:18:01 AM eth0 1.05 0.62 0.34 0.16 0.00 0.00 0.00 0.00 04:40:18 03:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 03:19:01 AM eth0 0.58 0.40 0.18 0.09 0.00 0.00 0.00 0.00 04:40:18 03:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 03:20:01 AM eth0 16.10 12.38 2.52 1.36 0.00 0.00 0.00 0.00 04:40:18 03:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 03:21:01 AM eth0 12.01 11.11 2.57 1.56 0.00 0.00 0.00 0.00 04:40:18 03:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 03:22:01 AM eth0 12.15 9.73 2.78 8.03 0.00 0.00 0.00 0.00 04:40:18 03:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 03:23:01 AM eth0 11.86 9.68 2.85 6.45 0.00 0.00 0.00 0.00 04:40:18 03:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 03:24:01 AM eth0 11.53 9.28 2.95 1.98 0.00 0.00 0.00 0.00 04:40:18 03:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 03:25:01 AM eth0 11.30 9.17 2.71 1.80 0.00 0.00 0.00 0.00 04:40:18 03:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 03:26:01 AM eth0 11.30 9.20 2.71 1.80 0.00 0.00 0.00 0.00 04:40:18 03:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 03:27:01 AM eth0 8.10 6.57 1.91 1.30 0.00 0.00 0.00 0.00 04:40:18 03:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 03:28:01 AM eth0 10.98 9.10 2.53 1.49 0.00 0.00 0.00 0.00 04:40:18 03:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 03:29:01 AM eth0 11.60 9.31 2.98 1.99 0.00 0.00 0.00 0.00 04:40:18 03:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 03:30:01 AM eth0 11.18 9.18 2.73 1.80 0.00 0.00 0.00 0.00 04:40:18 03:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 03:31:01 AM eth0 11.01 8.92 2.67 1.78 0.00 0.00 0.00 0.00 04:40:18 03:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 03:32:01 AM eth0 11.35 9.05 2.72 1.79 0.00 0.00 0.00 0.00 04:40:18 03:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 03:33:01 AM eth0 12.13 9.35 3.16 2.05 0.00 0.00 0.00 0.00 04:40:18 03:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 03:34:01 AM eth0 7.11 6.00 1.65 1.03 0.00 0.00 0.00 0.00 04:40:18 03:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 03:35:01 AM eth0 11.21 10.03 2.39 1.58 0.00 0.00 0.00 0.00 04:40:18 03:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 03:36:01 AM eth0 10.70 8.88 2.59 1.76 0.00 0.00 0.00 0.00 04:40:18 03:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 03:37:01 AM eth0 10.55 8.70 2.57 1.73 0.00 0.00 0.00 0.00 04:40:18 03:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 03:38:01 AM eth0 11.21 8.55 2.90 1.90 0.00 0.00 0.00 0.00 04:40:18 03:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 03:39:01 AM eth0 11.51 9.02 2.72 1.79 0.00 0.00 0.00 0.00 04:40:18 03:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 03:40:01 AM eth0 14.53 9.58 3.60 2.25 0.00 0.00 0.00 0.00 04:40:18 03:41:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 03:41:01 AM eth0 23.79 17.28 6.22 3.98 0.00 0.00 0.00 0.00 04:40:18 03:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 03:42:01 AM eth0 2.53 0.50 0.42 0.08 0.00 0.00 0.00 0.00 04:40:18 03:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 03:43:01 AM eth0 5.80 0.50 0.96 0.15 0.00 0.00 0.00 0.00 04:40:18 03:44:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 03:44:01 AM eth0 1.47 0.48 0.24 0.09 0.00 0.00 0.00 0.00 04:40:18 03:45:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 03:45:01 AM eth0 1.18 0.40 0.26 0.09 0.00 0.00 0.00 0.00 04:40:18 03:46:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 03:46:01 AM eth0 1.08 0.40 0.22 0.09 0.00 0.00 0.00 0.00 04:40:18 03:47:02 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 03:47:02 AM eth0 4.65 3.50 1.06 0.68 0.00 0.00 0.00 0.00 04:40:18 03:48:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 03:48:01 AM eth0 13.15 12.71 2.16 1.06 0.00 0.00 0.00 0.00 04:40:18 03:49:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 03:49:01 AM eth0 14.46 13.18 2.10 1.04 0.00 0.00 0.00 0.00 04:40:18 03:50:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 03:50:01 AM eth0 14.30 12.30 2.20 1.25 0.00 0.00 0.00 0.00 04:40:18 03:51:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 03:51:01 AM eth0 14.55 12.03 3.22 1.99 0.00 0.00 0.00 0.00 04:40:18 03:52:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 03:52:01 AM eth0 11.05 9.15 2.68 1.80 0.00 0.00 0.00 0.00 04:40:18 03:53:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 03:53:01 AM eth0 10.61 8.53 2.61 1.72 0.00 0.00 0.00 0.00 04:40:18 03:54:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 03:54:01 AM eth0 10.75 8.68 2.60 1.72 0.00 0.00 0.00 0.00 04:40:18 03:55:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 03:55:01 AM eth0 11.21 8.93 2.70 1.77 0.00 0.00 0.00 0.00 04:40:18 03:56:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 03:56:01 AM eth0 11.26 8.93 2.69 1.74 0.00 0.00 0.00 0.00 04:40:18 03:57:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 03:57:01 AM eth0 17.66 13.55 4.23 2.54 0.00 0.00 0.00 0.00 04:40:18 03:58:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 03:58:01 AM eth0 3.37 1.07 1.34 0.79 0.00 0.00 0.00 0.00 04:40:18 03:59:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 03:59:01 AM eth0 0.78 0.43 0.19 0.09 0.00 0.00 0.00 0.00 04:40:18 04:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 04:00:01 AM eth0 6.82 0.35 0.95 0.07 0.00 0.00 0.00 0.00 04:40:18 04:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 04:01:01 AM eth0 1.07 0.45 0.21 0.09 0.00 0.00 0.00 0.00 04:40:18 04:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 04:02:01 AM eth0 1.22 0.42 0.22 0.09 0.00 0.00 0.00 0.00 04:40:18 04:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 04:03:01 AM eth0 7.68 7.10 1.57 1.04 0.00 0.00 0.00 0.00 04:40:18 04:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 04:04:01 AM eth0 14.85 13.90 2.46 1.28 0.00 0.00 0.00 0.00 04:40:18 04:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 04:05:01 AM eth0 12.15 11.88 1.89 0.96 0.00 0.00 0.00 0.00 04:40:18 04:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 04:06:01 AM eth0 17.36 14.50 3.07 1.78 0.00 0.00 0.00 0.00 04:40:18 04:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 04:07:01 AM eth0 13.83 9.01 2.86 1.79 0.00 0.00 0.00 0.00 04:40:18 04:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 04:08:01 AM eth0 13.18 9.55 3.33 2.16 0.00 0.00 0.00 0.00 04:40:18 04:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 04:09:01 AM eth0 11.35 8.76 2.89 1.86 0.00 0.00 0.00 0.00 04:40:18 04:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 04:10:01 AM eth0 13.36 9.00 2.97 1.79 0.00 0.00 0.00 0.00 04:40:18 04:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 04:11:01 AM eth0 11.28 9.10 2.73 1.79 0.00 0.00 0.00 0.00 04:40:18 04:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 04:12:01 AM eth0 18.91 15.93 4.77 3.07 0.00 0.00 0.00 0.00 04:40:18 04:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 04:13:01 AM eth0 3.92 3.13 0.97 0.63 0.00 0.00 0.00 0.00 04:40:18 04:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 04:14:01 AM eth0 0.97 0.40 0.20 0.09 0.00 0.00 0.00 0.00 04:40:18 04:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 04:15:01 AM eth0 0.72 0.40 0.19 0.09 0.00 0.00 0.00 0.00 04:40:18 04:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 04:16:01 AM eth0 0.88 0.40 0.20 0.09 0.00 0.00 0.00 0.00 04:40:18 04:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 04:17:01 AM eth0 0.77 0.45 0.19 0.09 0.00 0.00 0.00 0.00 04:40:18 04:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 04:18:01 AM eth0 1.33 0.55 0.35 0.15 0.00 0.00 0.00 0.00 04:40:18 04:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 04:19:01 AM eth0 12.38 11.76 2.19 1.30 0.00 0.00 0.00 0.00 04:40:18 04:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 04:20:01 AM eth0 5.98 5.61 0.86 0.44 0.00 0.00 0.00 0.00 04:40:18 04:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 04:21:01 AM eth0 10.65 10.48 1.74 1.04 0.00 0.00 0.00 0.00 04:40:18 04:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 04:22:01 AM eth0 12.11 10.56 2.56 1.65 0.00 0.00 0.00 0.00 04:40:18 04:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 04:23:01 AM eth0 9.98 8.17 2.49 1.65 0.00 0.00 0.00 0.00 04:40:18 04:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 04:24:01 AM eth0 10.81 8.73 2.63 1.72 0.00 0.00 0.00 0.00 04:40:18 04:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 04:25:01 AM eth0 11.36 9.05 2.73 1.79 0.00 0.00 0.00 0.00 04:40:18 04:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 04:26:01 AM eth0 11.06 9.25 2.66 1.80 0.00 0.00 0.00 0.00 04:40:18 04:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 04:27:01 AM eth0 11.38 8.98 2.73 1.79 0.00 0.00 0.00 0.00 04:40:18 04:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 04:28:01 AM eth0 19.01 15.18 4.76 2.94 0.00 0.00 0.00 0.00 04:40:18 04:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 04:29:01 AM eth0 0.70 0.52 0.19 0.10 0.00 0.00 0.00 0.00 04:40:18 04:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 04:30:01 AM eth0 0.67 0.53 0.16 0.11 0.00 0.00 0.00 0.00 04:40:18 04:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 04:31:01 AM eth0 0.70 0.60 0.19 0.13 0.00 0.00 0.00 0.00 04:40:18 04:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 04:32:01 AM eth0 1.25 0.60 0.25 0.13 0.00 0.00 0.00 0.00 04:40:18 04:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 04:33:01 AM eth0 1.37 0.92 0.60 0.39 0.00 0.00 0.00 0.00 04:40:18 04:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 04:34:01 AM eth0 7.35 6.97 1.46 0.96 0.00 0.00 0.00 0.00 04:40:18 04:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 04:35:01 AM eth0 13.38 13.03 2.43 1.67 0.00 0.00 0.00 0.00 04:40:18 04:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 04:36:01 AM eth0 15.15 14.86 2.81 1.74 0.00 0.00 0.00 0.00 04:40:18 04:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 04:37:01 AM eth0 12.63 12.06 2.31 1.38 0.00 0.00 0.00 0.00 04:40:18 04:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 04:38:01 AM eth0 15.21 14.70 3.00 1.86 0.00 0.00 0.00 0.00 04:40:18 04:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 04:39:01 AM eth0 155.02 96.47 281.42 398.22 0.00 0.00 0.00 0.00 04:40:18 04:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 04:40:01 AM eth0 14.75 13.20 12.94 6.88 0.00 0.00 0.00 0.00 04:40:18 Average: lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:18 Average: eth0 13.70 10.58 11.80 3.74 0.00 0.00 0.00 0.00 04:40:18 04:40:18 04:40:18 ---> sar -P ALL: 04:40:18 Linux 4.18.0-553.5.1.el8.x86_64 (centos-stream-8-robot-7d7a37eb-bc14-4dd6-9530-dc22c5eae738.noval) 02/08/2026 _x86_64_ (2 CPU) 04:40:18 04:40:18 00:56:56 LINUX RESTART (2 CPU) 04:40:18 04:40:18 12:58:01 AM CPU %user %nice %system %iowait %steal %idle 04:40:18 12:59:01 AM all 35.18 0.00 5.26 1.49 0.10 57.96 04:40:18 12:59:01 AM 0 44.72 0.00 6.11 1.42 0.12 47.64 04:40:18 12:59:01 AM 1 25.67 0.00 4.42 1.57 0.08 68.27 04:40:18 01:00:01 AM all 11.10 0.00 2.02 0.43 0.06 86.40 04:40:18 01:00:01 AM 0 12.35 0.00 1.87 0.27 0.07 85.45 04:40:18 01:00:01 AM 1 9.84 0.00 2.17 0.58 0.05 87.35 04:40:18 01:01:01 AM all 35.79 0.00 6.30 0.76 0.12 57.04 04:40:18 01:01:01 AM 0 32.93 0.00 6.39 0.90 0.12 59.66 04:40:18 01:01:01 AM 1 38.64 0.00 6.20 0.62 0.12 54.42 04:40:18 01:02:01 AM all 1.14 0.00 1.22 0.56 0.04 97.04 04:40:18 01:02:01 AM 0 1.05 0.00 1.12 0.60 0.03 97.19 04:40:18 01:02:01 AM 1 1.22 0.00 1.32 0.52 0.05 96.89 04:40:18 01:03:01 AM all 0.28 0.00 0.12 0.00 0.03 99.57 04:40:18 01:03:01 AM 0 0.18 0.00 0.13 0.00 0.02 99.67 04:40:18 01:03:01 AM 1 0.37 0.00 0.10 0.00 0.05 99.48 04:40:18 01:04:01 AM all 0.34 0.00 0.09 0.00 0.03 99.53 04:40:18 01:04:01 AM 0 0.22 0.00 0.10 0.00 0.03 99.65 04:40:18 01:04:01 AM 1 0.47 0.00 0.08 0.00 0.03 99.42 04:40:18 01:05:01 AM all 4.20 0.00 0.42 0.00 0.07 95.32 04:40:18 01:05:01 AM 0 7.06 0.00 0.50 0.00 0.07 92.37 04:40:18 01:05:01 AM 1 1.34 0.00 0.33 0.00 0.07 98.26 04:40:18 01:06:01 AM all 4.36 0.00 0.33 0.01 0.06 95.24 04:40:18 01:06:01 AM 0 3.95 0.00 0.33 0.02 0.05 95.65 04:40:18 01:06:01 AM 1 4.77 0.00 0.33 0.00 0.07 94.83 04:40:18 01:07:01 AM all 4.37 0.00 0.36 0.00 0.07 95.20 04:40:18 01:07:01 AM 0 4.06 0.00 0.32 0.00 0.07 95.56 04:40:18 01:07:01 AM 1 4.68 0.00 0.40 0.00 0.07 94.85 04:40:18 01:08:01 AM all 4.55 0.00 0.33 0.00 0.08 95.04 04:40:18 01:08:01 AM 0 4.48 0.00 0.32 0.00 0.08 95.12 04:40:18 01:08:01 AM 1 4.61 0.00 0.33 0.00 0.08 94.97 04:40:18 01:09:01 AM all 7.76 0.00 0.49 0.00 0.07 91.68 04:40:18 01:09:01 AM 0 9.38 0.00 0.50 0.00 0.07 90.05 04:40:18 01:09:01 AM 1 6.14 0.00 0.49 0.00 0.07 93.31 04:40:18 04:40:18 01:09:01 AM CPU %user %nice %system %iowait %steal %idle 04:40:18 01:10:01 AM all 1.15 0.00 0.13 0.00 0.07 98.65 04:40:18 01:10:01 AM 0 1.65 0.00 0.18 0.00 0.08 98.08 04:40:18 01:10:01 AM 1 0.65 0.00 0.08 0.00 0.05 99.22 04:40:18 01:11:01 AM all 8.46 0.00 0.72 0.00 0.06 90.76 04:40:18 01:11:01 AM 0 15.57 0.00 1.17 0.00 0.07 83.19 04:40:18 01:11:01 AM 1 1.36 0.00 0.27 0.00 0.05 98.33 04:40:18 01:12:01 AM all 0.63 0.00 0.25 0.01 0.05 99.06 04:40:18 01:12:01 AM 0 0.67 0.00 0.30 0.00 0.05 98.98 04:40:18 01:12:01 AM 1 0.60 0.00 0.20 0.02 0.05 99.13 04:40:18 01:13:01 AM all 0.52 0.00 0.09 0.01 0.05 99.33 04:40:18 01:13:01 AM 0 0.22 0.00 0.10 0.02 0.05 99.62 04:40:18 01:13:01 AM 1 0.82 0.00 0.08 0.00 0.05 99.05 04:40:18 01:14:01 AM all 2.69 0.00 0.22 0.00 0.04 97.05 04:40:18 01:14:01 AM 0 1.57 0.00 0.18 0.00 0.03 98.21 04:40:18 01:14:01 AM 1 3.81 0.00 0.25 0.00 0.05 95.88 04:40:18 01:15:01 AM all 4.19 0.00 0.32 0.00 0.08 95.41 04:40:18 01:15:01 AM 0 6.05 0.00 0.40 0.00 0.08 93.47 04:40:18 01:15:01 AM 1 2.32 0.00 0.23 0.00 0.08 97.36 04:40:18 01:16:01 AM all 4.41 0.00 0.34 0.00 0.08 95.17 04:40:18 01:16:01 AM 0 5.78 0.00 0.37 0.00 0.08 93.77 04:40:18 01:16:01 AM 1 3.04 0.00 0.32 0.00 0.07 96.57 04:40:18 01:17:01 AM all 4.38 0.00 0.34 0.00 0.08 95.20 04:40:18 01:17:01 AM 0 6.52 0.00 0.45 0.00 0.08 92.95 04:40:18 01:17:01 AM 1 2.24 0.00 0.23 0.00 0.07 97.46 04:40:18 01:18:01 AM all 4.40 0.00 0.33 0.00 0.08 95.18 04:40:18 01:18:01 AM 0 6.20 0.00 0.42 0.00 0.08 93.30 04:40:18 01:18:01 AM 1 2.61 0.00 0.25 0.00 0.08 97.06 04:40:18 01:19:01 AM all 4.63 0.00 0.37 0.00 0.08 94.93 04:40:18 01:19:01 AM 0 7.85 0.00 0.55 0.00 0.08 91.51 04:40:18 01:19:01 AM 1 1.40 0.00 0.18 0.00 0.07 98.34 04:40:18 01:20:01 AM all 5.36 0.00 0.36 0.00 0.08 94.20 04:40:18 01:20:01 AM 0 7.61 0.00 0.43 0.00 0.08 91.87 04:40:18 01:20:01 AM 1 3.11 0.00 0.28 0.00 0.08 96.52 04:40:18 04:40:18 01:20:01 AM CPU %user %nice %system %iowait %steal %idle 04:40:18 01:21:01 AM all 3.48 0.00 0.26 0.00 0.08 96.18 04:40:18 01:21:01 AM 0 4.95 0.00 0.33 0.00 0.08 94.63 04:40:18 01:21:01 AM 1 2.02 0.00 0.18 0.00 0.07 97.73 04:40:18 01:22:01 AM all 1.02 0.00 0.13 0.00 0.06 98.80 04:40:18 01:22:01 AM 0 1.09 0.00 0.13 0.00 0.07 98.71 04:40:18 01:22:01 AM 1 0.95 0.00 0.12 0.00 0.05 98.88 04:40:18 01:23:01 AM all 0.87 0.00 0.13 0.00 0.08 98.93 04:40:18 01:23:01 AM 0 0.77 0.00 0.15 0.00 0.08 99.00 04:40:18 01:23:01 AM 1 0.97 0.00 0.10 0.00 0.07 98.86 04:40:18 01:24:01 AM all 0.93 0.00 0.13 0.00 0.07 98.88 04:40:18 01:24:01 AM 0 1.04 0.00 0.15 0.00 0.07 98.75 04:40:18 01:24:01 AM 1 0.82 0.00 0.10 0.00 0.07 99.01 04:40:18 01:25:01 AM all 0.96 0.00 0.11 0.00 0.08 98.86 04:40:18 01:25:01 AM 0 0.70 0.00 0.10 0.00 0.08 99.12 04:40:18 01:25:01 AM 1 1.22 0.00 0.12 0.00 0.07 98.60 04:40:18 01:26:01 AM all 0.73 0.00 0.13 0.00 0.06 99.08 04:40:18 01:26:01 AM 0 1.27 0.00 0.15 0.00 0.07 98.51 04:40:18 01:26:01 AM 1 0.18 0.00 0.12 0.00 0.05 99.65 04:40:18 01:27:01 AM all 6.22 0.00 0.42 0.00 0.08 93.28 04:40:18 01:27:01 AM 0 9.22 0.00 0.58 0.00 0.07 90.13 04:40:18 01:27:01 AM 1 3.30 0.00 0.27 0.00 0.09 96.34 04:40:18 01:28:01 AM all 1.35 0.00 0.15 0.00 0.07 98.43 04:40:18 01:28:01 AM 0 0.45 0.00 0.12 0.00 0.08 99.35 04:40:18 01:28:01 AM 1 2.26 0.00 0.19 0.00 0.05 97.50 04:40:18 01:29:01 AM all 0.48 0.00 0.09 0.00 0.07 99.37 04:40:18 01:29:01 AM 0 0.55 0.00 0.07 0.00 0.05 99.33 04:40:18 01:29:01 AM 1 0.40 0.00 0.12 0.00 0.08 99.40 04:40:18 01:30:01 AM all 5.05 0.00 0.31 0.00 0.08 94.57 04:40:18 01:30:01 AM 0 2.79 0.00 0.15 0.00 0.07 96.99 04:40:18 01:30:01 AM 1 7.39 0.00 0.47 0.00 0.09 92.06 04:40:18 01:31:01 AM all 4.45 0.00 0.18 0.00 0.07 95.31 04:40:18 01:31:01 AM 0 5.21 0.00 0.17 0.00 0.07 94.55 04:40:18 01:31:01 AM 1 3.68 0.00 0.18 0.00 0.07 96.07 04:40:18 04:40:18 01:31:01 AM CPU %user %nice %system %iowait %steal %idle 04:40:18 01:32:01 AM all 4.36 0.00 0.15 0.00 0.08 95.41 04:40:18 01:32:01 AM 0 6.17 0.00 0.17 0.00 0.08 93.58 04:40:18 01:32:01 AM 1 2.56 0.00 0.13 0.00 0.07 97.24 04:40:18 01:33:01 AM all 4.39 0.00 0.18 0.00 0.09 95.35 04:40:18 01:33:01 AM 0 6.20 0.00 0.18 0.00 0.10 93.52 04:40:18 01:33:01 AM 1 2.57 0.00 0.17 0.00 0.08 97.18 04:40:18 01:34:02 AM all 4.48 0.00 0.19 0.00 0.07 95.26 04:40:18 01:34:02 AM 0 4.88 0.00 0.18 0.00 0.07 94.87 04:40:18 01:34:02 AM 1 4.08 0.00 0.20 0.00 0.07 95.65 04:40:18 01:35:01 AM all 4.38 0.00 0.20 0.00 0.07 95.35 04:40:18 01:35:01 AM 0 5.37 0.00 0.24 0.00 0.07 94.33 04:40:18 01:35:01 AM 1 3.40 0.00 0.15 0.00 0.07 96.38 04:40:18 01:36:01 AM all 5.42 0.00 0.31 0.00 0.07 94.20 04:40:18 01:36:01 AM 0 8.61 0.00 0.48 0.00 0.07 90.84 04:40:18 01:36:01 AM 1 2.32 0.00 0.13 0.00 0.07 97.48 04:40:18 01:37:01 AM all 1.19 0.00 0.16 0.00 0.07 98.58 04:40:18 01:37:01 AM 0 1.81 0.00 0.25 0.00 0.08 97.85 04:40:18 01:37:01 AM 1 0.58 0.00 0.07 0.00 0.05 99.30 04:40:18 01:38:01 AM all 0.53 0.00 0.10 0.00 0.07 99.31 04:40:18 01:38:01 AM 0 0.38 0.00 0.13 0.00 0.08 99.40 04:40:18 01:38:01 AM 1 0.67 0.00 0.07 0.00 0.05 99.22 04:40:18 01:39:01 AM all 5.77 0.00 0.42 0.00 0.07 93.74 04:40:18 01:39:01 AM 0 1.52 0.00 0.17 0.00 0.07 98.25 04:40:18 01:39:01 AM 1 10.22 0.00 0.68 0.00 0.07 89.02 04:40:18 01:40:01 AM all 4.08 0.00 0.31 0.00 0.07 95.55 04:40:18 01:40:01 AM 0 5.88 0.00 0.43 0.00 0.08 93.60 04:40:18 01:40:01 AM 1 2.27 0.00 0.18 0.00 0.05 97.49 04:40:18 01:41:01 AM all 4.45 0.00 0.36 0.01 0.08 95.11 04:40:18 01:41:01 AM 0 3.73 0.00 0.33 0.02 0.07 95.86 04:40:18 01:41:01 AM 1 5.17 0.00 0.38 0.00 0.08 94.36 04:40:18 01:42:01 AM all 4.14 0.00 0.30 0.00 0.07 95.50 04:40:18 01:42:01 AM 0 4.16 0.00 0.28 0.00 0.07 95.49 04:40:18 01:42:01 AM 1 4.11 0.00 0.32 0.00 0.07 95.50 04:40:18 04:40:18 01:42:01 AM CPU %user %nice %system %iowait %steal %idle 04:40:18 01:43:01 AM all 4.35 0.00 0.33 0.00 0.08 95.25 04:40:18 01:43:01 AM 0 3.64 0.00 0.27 0.00 0.07 96.02 04:40:18 01:43:01 AM 1 5.05 0.00 0.38 0.00 0.08 94.48 04:40:18 01:44:01 AM all 4.42 0.00 0.38 0.02 0.08 95.10 04:40:18 01:44:01 AM 0 4.84 0.00 0.42 0.02 0.08 94.64 04:40:18 01:44:01 AM 1 3.99 0.00 0.35 0.02 0.07 95.57 04:40:18 01:45:01 AM all 7.53 0.00 0.48 0.00 0.08 91.91 04:40:18 01:45:01 AM 0 9.26 0.00 0.50 0.00 0.07 90.17 04:40:18 01:45:01 AM 1 5.80 0.00 0.47 0.00 0.08 93.64 04:40:18 01:46:01 AM all 0.85 0.00 0.10 0.00 0.07 98.98 04:40:18 01:46:01 AM 0 0.60 0.00 0.10 0.00 0.07 99.23 04:40:18 01:46:01 AM 1 1.10 0.00 0.10 0.00 0.07 98.73 04:40:18 01:47:01 AM all 0.85 0.00 0.15 0.00 0.08 98.92 04:40:18 01:47:01 AM 0 0.38 0.00 0.13 0.00 0.07 99.42 04:40:18 01:47:01 AM 1 1.32 0.00 0.17 0.00 0.08 98.43 04:40:18 01:48:01 AM all 1.06 0.00 0.14 0.00 0.08 98.72 04:40:18 01:48:01 AM 0 0.87 0.00 0.12 0.00 0.07 98.95 04:40:18 01:48:01 AM 1 1.25 0.00 0.17 0.00 0.08 98.50 04:40:18 01:49:01 AM all 0.93 0.00 0.13 0.00 0.08 98.86 04:40:18 01:49:01 AM 0 1.08 0.00 0.13 0.00 0.07 98.71 04:40:18 01:49:01 AM 1 0.77 0.00 0.13 0.00 0.08 99.01 04:40:18 01:50:01 AM all 0.94 0.00 0.14 0.00 0.08 98.84 04:40:18 01:50:01 AM 0 0.75 0.00 0.13 0.00 0.07 99.05 04:40:18 01:50:01 AM 1 1.14 0.00 0.15 0.00 0.08 98.63 04:40:18 01:51:01 AM all 0.83 0.00 0.13 0.00 0.08 98.97 04:40:18 01:51:01 AM 0 0.67 0.00 0.12 0.00 0.07 99.15 04:40:18 01:51:01 AM 1 0.99 0.00 0.13 0.00 0.08 98.80 04:40:18 01:52:01 AM all 6.92 0.00 0.46 0.00 0.06 92.56 04:40:18 01:52:01 AM 0 0.53 0.00 0.15 0.00 0.07 99.25 04:40:18 01:52:01 AM 1 13.84 0.00 0.80 0.00 0.05 85.31 04:40:18 01:53:01 AM all 5.76 0.00 0.28 0.00 0.06 93.90 04:40:18 01:53:01 AM 0 7.70 0.00 0.31 0.00 0.07 91.92 04:40:18 01:53:01 AM 1 3.81 0.00 0.26 0.00 0.05 95.89 04:40:18 04:40:18 01:53:01 AM CPU %user %nice %system %iowait %steal %idle 04:40:18 01:54:01 AM all 4.44 0.00 0.25 0.00 0.08 95.22 04:40:18 01:54:01 AM 0 4.36 0.00 0.28 0.00 0.08 95.27 04:40:18 01:54:01 AM 1 4.52 0.00 0.22 0.00 0.08 95.18 04:40:18 01:55:01 AM all 4.60 0.00 0.19 0.00 0.07 95.14 04:40:18 01:55:01 AM 0 2.19 0.00 0.15 0.00 0.07 97.59 04:40:18 01:55:01 AM 1 7.01 0.00 0.23 0.00 0.07 92.69 04:40:18 01:56:01 AM all 4.37 0.00 0.22 0.00 0.07 95.35 04:40:18 01:56:01 AM 0 5.10 0.00 0.22 0.00 0.07 94.62 04:40:18 01:56:01 AM 1 3.64 0.00 0.22 0.00 0.07 96.08 04:40:18 01:57:01 AM all 4.43 0.00 0.18 0.00 0.07 95.32 04:40:18 01:57:01 AM 0 6.86 0.00 0.22 0.00 0.08 92.84 04:40:18 01:57:01 AM 1 2.01 0.00 0.15 0.00 0.05 97.79 04:40:18 01:58:01 AM all 4.39 0.00 0.18 0.00 0.08 95.36 04:40:18 01:58:01 AM 0 6.27 0.00 0.17 0.00 0.08 93.48 04:40:18 01:58:01 AM 1 2.51 0.00 0.18 0.00 0.07 97.24 04:40:18 01:59:01 AM all 5.51 0.00 0.38 0.00 0.07 94.04 04:40:18 01:59:01 AM 0 7.10 0.00 0.58 0.00 0.07 92.25 04:40:18 01:59:01 AM 1 3.99 0.00 0.18 0.00 0.07 95.76 04:40:18 02:00:01 AM all 5.76 0.00 0.30 0.00 0.07 93.87 04:40:18 02:00:01 AM 0 2.64 0.00 0.17 0.00 0.05 97.14 04:40:18 02:00:01 AM 1 8.98 0.00 0.43 0.00 0.09 90.50 04:40:18 02:01:01 AM all 4.47 0.00 0.21 0.01 0.07 95.25 04:40:18 02:01:01 AM 0 3.39 0.00 0.22 0.02 0.07 96.31 04:40:18 02:01:01 AM 1 5.55 0.00 0.20 0.00 0.07 94.18 04:40:18 02:02:01 AM all 4.50 0.00 0.21 0.00 0.08 95.22 04:40:18 02:02:01 AM 0 2.52 0.00 0.22 0.00 0.07 97.19 04:40:18 02:02:01 AM 1 6.47 0.00 0.20 0.00 0.08 93.24 04:40:18 02:03:01 AM all 4.40 0.00 0.19 0.00 0.06 95.35 04:40:18 02:03:01 AM 0 2.60 0.00 0.17 0.00 0.05 97.18 04:40:18 02:03:01 AM 1 6.19 0.00 0.22 0.00 0.07 93.52 04:40:18 02:04:01 AM all 4.44 0.00 0.18 0.00 0.08 95.30 04:40:18 02:04:01 AM 0 5.85 0.00 0.22 0.00 0.08 93.85 04:40:18 02:04:01 AM 1 3.03 0.00 0.15 0.00 0.07 96.76 04:40:18 04:40:18 02:04:01 AM CPU %user %nice %system %iowait %steal %idle 04:40:18 02:05:01 AM all 4.49 0.00 0.18 0.00 0.06 95.27 04:40:18 02:05:01 AM 0 2.05 0.00 0.17 0.00 0.05 97.73 04:40:18 02:05:01 AM 1 6.93 0.00 0.20 0.00 0.07 92.80 04:40:18 02:06:01 AM all 5.83 0.25 0.43 0.11 0.07 93.32 04:40:18 02:06:01 AM 0 5.91 0.02 0.32 0.00 0.07 93.69 04:40:18 02:06:01 AM 1 5.75 0.48 0.53 0.22 0.07 92.95 04:40:18 02:07:01 AM all 5.65 0.00 0.42 0.01 0.07 93.85 04:40:18 02:07:01 AM 0 5.87 0.00 0.46 0.02 0.07 93.58 04:40:18 02:07:01 AM 1 5.44 0.00 0.39 0.00 0.07 94.11 04:40:18 02:08:01 AM all 4.42 0.00 0.36 0.00 0.07 95.15 04:40:18 02:08:01 AM 0 4.13 0.00 0.37 0.00 0.07 95.44 04:40:18 02:08:01 AM 1 4.72 0.00 0.35 0.00 0.07 94.87 04:40:18 02:09:01 AM all 4.34 0.00 0.34 0.00 0.06 95.26 04:40:18 02:09:01 AM 0 4.76 0.00 0.37 0.00 0.07 94.80 04:40:18 02:09:01 AM 1 3.91 0.00 0.32 0.00 0.05 95.72 04:40:18 02:10:01 AM all 4.47 0.00 0.33 0.00 0.08 95.12 04:40:18 02:10:01 AM 0 6.25 0.00 0.42 0.00 0.08 93.25 04:40:18 02:10:01 AM 1 2.69 0.00 0.25 0.00 0.07 96.99 04:40:18 02:11:01 AM all 4.37 0.00 0.37 0.00 0.07 95.19 04:40:18 02:11:01 AM 0 6.90 0.00 0.57 0.00 0.08 92.45 04:40:18 02:11:01 AM 1 1.84 0.00 0.17 0.00 0.05 97.94 04:40:18 02:12:01 AM all 4.40 0.00 0.32 0.00 0.08 95.20 04:40:18 02:12:01 AM 0 4.51 0.00 0.32 0.00 0.07 95.11 04:40:18 02:12:01 AM 1 4.30 0.00 0.32 0.00 0.08 95.30 04:40:18 02:13:01 AM all 6.22 0.00 0.38 0.00 0.06 93.34 04:40:18 02:13:01 AM 0 5.23 0.00 0.37 0.00 0.05 94.35 04:40:18 02:13:01 AM 1 7.21 0.00 0.38 0.00 0.07 92.33 04:40:18 02:14:01 AM all 0.99 0.00 0.11 0.00 0.08 98.81 04:40:18 02:14:01 AM 0 1.09 0.00 0.13 0.00 0.10 98.68 04:40:18 02:14:01 AM 1 0.90 0.00 0.08 0.00 0.07 98.95 04:40:18 02:15:01 AM all 1.04 0.00 0.13 0.00 0.06 98.77 04:40:18 02:15:01 AM 0 0.98 0.00 0.10 0.00 0.03 98.88 04:40:18 02:15:01 AM 1 1.10 0.00 0.15 0.00 0.08 98.66 04:40:18 04:40:18 02:15:01 AM CPU %user %nice %system %iowait %steal %idle 04:40:18 02:16:01 AM all 0.97 0.00 0.16 0.00 0.05 98.82 04:40:18 02:16:01 AM 0 1.40 0.00 0.17 0.00 0.05 98.38 04:40:18 02:16:01 AM 1 0.53 0.00 0.15 0.00 0.05 99.26 04:40:18 02:17:01 AM all 0.87 0.00 0.18 0.01 0.07 98.88 04:40:18 02:17:01 AM 0 0.75 0.00 0.18 0.02 0.07 98.98 04:40:18 02:17:01 AM 1 0.99 0.00 0.17 0.00 0.07 98.78 04:40:18 02:18:01 AM all 0.98 0.00 0.14 0.00 0.11 98.77 04:40:18 02:18:01 AM 0 1.08 0.00 0.12 0.00 0.12 98.68 04:40:18 02:18:01 AM 1 0.87 0.00 0.17 0.00 0.10 98.86 04:40:18 02:19:01 AM all 3.73 0.00 0.26 0.00 0.06 95.95 04:40:18 02:19:01 AM 0 5.96 0.00 0.40 0.00 0.07 93.57 04:40:18 02:19:01 AM 1 1.55 0.00 0.13 0.00 0.05 98.26 04:40:18 02:20:01 AM all 7.10 0.00 0.51 0.00 0.08 92.31 04:40:18 02:20:01 AM 0 5.60 0.00 0.48 0.00 0.09 93.83 04:40:18 02:20:01 AM 1 8.62 0.00 0.54 0.00 0.07 90.77 04:40:18 02:21:01 AM all 4.15 0.00 0.18 0.00 0.07 95.60 04:40:18 02:21:01 AM 0 6.02 0.00 0.20 0.00 0.07 93.72 04:40:18 02:21:01 AM 1 2.27 0.00 0.17 0.00 0.07 97.49 04:40:18 02:22:01 AM all 4.60 0.00 0.19 0.00 0.07 95.14 04:40:18 02:22:01 AM 0 4.61 0.00 0.20 0.00 0.07 95.12 04:40:18 02:22:01 AM 1 4.58 0.00 0.18 0.00 0.07 95.16 04:40:18 02:23:01 AM all 4.54 0.00 0.20 0.00 0.07 95.19 04:40:18 02:23:01 AM 0 6.65 0.00 0.22 0.00 0.07 93.06 04:40:18 02:23:01 AM 1 2.42 0.00 0.18 0.00 0.07 97.32 04:40:18 02:24:01 AM all 4.43 0.00 0.17 0.00 0.07 95.34 04:40:18 02:24:01 AM 0 6.65 0.00 0.18 0.00 0.07 93.10 04:40:18 02:24:01 AM 1 2.21 0.00 0.15 0.00 0.07 97.58 04:40:18 02:25:01 AM all 4.44 0.00 0.18 0.00 0.07 95.32 04:40:18 02:25:01 AM 0 6.69 0.00 0.18 0.00 0.08 93.04 04:40:18 02:25:01 AM 1 2.19 0.00 0.17 0.00 0.05 97.59 04:40:18 02:26:01 AM all 4.06 0.00 0.13 0.00 0.07 95.75 04:40:18 02:26:01 AM 0 4.70 0.00 0.13 0.00 0.07 95.10 04:40:18 02:26:01 AM 1 3.43 0.00 0.12 0.00 0.07 96.39 04:40:18 04:40:18 02:26:01 AM CPU %user %nice %system %iowait %steal %idle 04:40:18 02:27:01 AM all 6.82 0.00 0.42 0.00 0.06 92.70 04:40:18 02:27:01 AM 0 1.00 0.00 0.13 0.00 0.05 98.82 04:40:18 02:27:01 AM 1 13.09 0.00 0.72 0.00 0.07 86.12 04:40:18 02:28:01 AM all 5.25 0.00 0.42 0.00 0.08 94.24 04:40:18 02:28:01 AM 0 3.54 0.00 0.30 0.00 0.08 96.08 04:40:18 02:28:01 AM 1 7.00 0.00 0.54 0.00 0.09 92.37 04:40:18 02:29:01 AM all 4.38 0.00 0.35 0.00 0.07 95.20 04:40:18 02:29:01 AM 0 3.17 0.00 0.27 0.00 0.07 96.49 04:40:18 02:29:01 AM 1 5.59 0.00 0.44 0.00 0.07 93.91 04:40:18 02:30:01 AM all 4.32 0.00 0.34 0.00 0.06 95.28 04:40:18 02:30:01 AM 0 5.17 0.00 0.38 0.00 0.07 94.38 04:40:18 02:30:01 AM 1 3.46 0.00 0.30 0.00 0.05 96.19 04:40:18 02:31:01 AM all 3.22 0.00 0.25 0.00 0.11 96.42 04:40:18 02:31:01 AM 0 3.17 0.00 0.25 0.00 0.08 96.49 04:40:18 02:31:01 AM 1 3.26 0.00 0.25 0.00 0.13 96.36 04:40:18 02:32:01 AM all 4.52 0.00 0.35 0.00 0.07 95.06 04:40:18 02:32:01 AM 0 4.33 0.00 0.35 0.00 0.07 95.25 04:40:18 02:32:01 AM 1 4.72 0.00 0.35 0.00 0.07 94.87 04:40:18 02:33:01 AM all 4.38 0.00 0.33 0.00 0.08 95.22 04:40:18 02:33:01 AM 0 3.53 0.00 0.27 0.00 0.07 96.14 04:40:18 02:33:01 AM 1 5.24 0.00 0.38 0.00 0.08 94.29 04:40:18 02:34:01 AM all 5.49 0.00 0.29 0.00 0.06 94.16 04:40:18 02:34:01 AM 0 4.69 0.00 0.27 0.00 0.05 94.99 04:40:18 02:34:01 AM 1 6.28 0.00 0.32 0.00 0.07 93.33 04:40:18 02:35:01 AM all 0.86 0.00 0.11 0.00 0.05 98.98 04:40:18 02:35:01 AM 0 0.97 0.00 0.12 0.00 0.07 98.85 04:40:18 02:35:01 AM 1 0.75 0.00 0.10 0.00 0.03 99.12 04:40:18 02:36:01 AM all 0.87 0.00 0.14 0.00 0.08 98.91 04:40:18 02:36:01 AM 0 1.15 0.00 0.15 0.00 0.07 98.63 04:40:18 02:36:01 AM 1 0.58 0.00 0.13 0.00 0.08 99.20 04:40:18 02:37:01 AM all 0.72 0.00 0.13 0.14 0.06 98.95 04:40:18 02:37:01 AM 0 0.87 0.00 0.17 0.28 0.07 98.61 04:40:18 02:37:01 AM 1 0.57 0.00 0.10 0.00 0.05 99.28 04:40:18 04:40:18 02:37:01 AM CPU %user %nice %system %iowait %steal %idle 04:40:18 02:38:01 AM all 0.80 0.00 0.10 0.00 0.04 99.06 04:40:18 02:38:01 AM 0 1.10 0.00 0.08 0.00 0.03 98.78 04:40:18 02:38:01 AM 1 0.50 0.00 0.12 0.00 0.05 99.33 04:40:18 02:39:01 AM all 0.87 0.00 0.12 0.00 0.06 98.96 04:40:18 02:39:01 AM 0 0.99 0.00 0.12 0.00 0.07 98.83 04:40:18 02:39:01 AM 1 0.75 0.00 0.12 0.00 0.05 99.08 04:40:18 02:40:01 AM all 4.52 0.00 0.31 0.00 0.06 95.12 04:40:18 02:40:01 AM 0 7.56 0.00 0.49 0.00 0.07 91.88 04:40:18 02:40:01 AM 1 1.59 0.00 0.13 0.00 0.05 98.23 04:40:18 02:41:02 AM all 5.56 0.00 0.47 0.02 0.07 93.89 04:40:18 02:41:02 AM 0 10.69 0.00 0.85 0.00 0.09 88.37 04:40:18 02:41:02 AM 1 0.63 0.00 0.10 0.03 0.05 99.18 04:40:18 02:42:01 AM all 5.93 0.00 0.52 0.00 0.08 93.47 04:40:18 02:42:01 AM 0 11.27 0.00 0.90 0.00 0.10 87.73 04:40:18 02:42:01 AM 1 0.70 0.00 0.14 0.00 0.05 99.12 04:40:18 02:43:01 AM all 5.17 0.00 0.27 0.00 0.05 94.51 04:40:18 02:43:01 AM 0 8.53 0.00 0.34 0.00 0.07 91.06 04:40:18 02:43:01 AM 1 1.86 0.00 0.20 0.00 0.03 97.91 04:40:18 02:44:01 AM all 4.56 0.00 0.21 0.00 0.06 95.17 04:40:18 02:44:01 AM 0 6.60 0.00 0.25 0.00 0.05 93.10 04:40:18 02:44:01 AM 1 2.52 0.00 0.17 0.00 0.07 97.24 04:40:18 02:45:01 AM all 4.37 0.00 0.14 0.00 0.07 95.42 04:40:18 02:45:01 AM 0 6.74 0.00 0.15 0.00 0.08 93.02 04:40:18 02:45:01 AM 1 2.01 0.00 0.13 0.00 0.05 97.81 04:40:18 02:46:01 AM all 4.27 0.00 0.18 0.00 0.08 95.47 04:40:18 02:46:01 AM 0 5.32 0.00 0.22 0.00 0.08 94.38 04:40:18 02:46:01 AM 1 3.23 0.00 0.13 0.00 0.08 96.55 04:40:18 02:47:01 AM all 4.58 0.00 0.19 0.05 0.07 95.11 04:40:18 02:47:01 AM 0 6.01 0.00 0.20 0.00 0.07 93.72 04:40:18 02:47:01 AM 1 3.14 0.00 0.18 0.10 0.07 96.51 04:40:18 02:48:01 AM all 4.65 0.00 0.22 0.00 0.06 95.08 04:40:18 02:48:01 AM 0 3.27 0.00 0.18 0.00 0.05 96.49 04:40:18 02:48:01 AM 1 6.03 0.00 0.25 0.00 0.07 93.66 04:40:18 04:40:18 02:48:01 AM CPU %user %nice %system %iowait %steal %idle 04:40:18 02:49:01 AM all 6.70 0.00 0.50 0.00 0.07 92.73 04:40:18 02:49:01 AM 0 2.80 0.00 0.27 0.00 0.05 96.88 04:40:18 02:49:01 AM 1 10.75 0.00 0.73 0.00 0.09 88.43 04:40:18 02:50:01 AM all 4.54 0.00 0.44 0.01 0.06 94.95 04:40:18 02:50:01 AM 0 6.11 0.00 0.58 0.00 0.07 93.24 04:40:18 02:50:01 AM 1 2.96 0.00 0.30 0.02 0.05 96.67 04:40:18 02:51:01 AM all 6.29 0.00 0.41 0.00 0.07 93.23 04:40:18 02:51:01 AM 0 11.77 0.00 0.64 0.00 0.09 87.51 04:40:18 02:51:01 AM 1 0.99 0.00 0.18 0.00 0.05 98.78 04:40:18 02:52:01 AM all 4.45 0.00 0.17 0.00 0.08 95.31 04:40:18 02:52:01 AM 0 5.90 0.00 0.20 0.00 0.08 93.82 04:40:18 02:52:01 AM 1 2.99 0.00 0.13 0.00 0.07 96.81 04:40:18 02:53:01 AM all 4.65 0.00 0.20 0.00 0.08 95.07 04:40:18 02:53:01 AM 0 4.64 0.00 0.20 0.00 0.07 95.09 04:40:18 02:53:01 AM 1 4.65 0.00 0.20 0.00 0.10 95.05 04:40:18 02:54:01 AM all 4.51 0.00 0.21 0.00 0.08 95.21 04:40:18 02:54:01 AM 0 7.07 0.00 0.25 0.00 0.07 92.61 04:40:18 02:54:01 AM 1 1.94 0.00 0.17 0.00 0.08 97.81 04:40:18 02:55:01 AM all 4.53 0.00 0.19 0.00 0.07 95.21 04:40:18 02:55:01 AM 0 4.81 0.00 0.22 0.00 0.07 94.90 04:40:18 02:55:01 AM 1 4.25 0.00 0.17 0.00 0.07 95.52 04:40:18 02:56:01 AM all 4.52 0.00 0.19 0.00 0.06 95.23 04:40:18 02:56:01 AM 0 3.39 0.00 0.18 0.00 0.05 96.37 04:40:18 02:56:01 AM 1 5.66 0.00 0.20 0.00 0.07 94.08 04:40:18 02:57:01 AM all 5.67 0.00 0.38 0.00 0.07 93.88 04:40:18 02:57:01 AM 0 8.58 0.00 0.59 0.00 0.07 90.77 04:40:18 02:57:01 AM 1 2.86 0.00 0.18 0.00 0.07 96.89 04:40:18 02:58:01 AM all 4.54 0.00 0.39 0.00 0.05 95.02 04:40:18 02:58:01 AM 0 8.35 0.00 0.67 0.00 0.05 90.93 04:40:18 02:58:01 AM 1 0.72 0.00 0.12 0.00 0.05 99.11 04:40:18 02:59:01 AM all 6.46 0.00 0.45 0.00 0.08 93.02 04:40:18 02:59:01 AM 0 10.49 0.00 0.62 0.00 0.09 88.81 04:40:18 02:59:01 AM 1 2.54 0.00 0.28 0.00 0.07 97.11 04:40:18 04:40:18 02:59:01 AM CPU %user %nice %system %iowait %steal %idle 04:40:18 03:00:01 AM all 4.61 0.00 0.20 0.00 0.06 95.14 04:40:18 03:00:01 AM 0 5.36 0.00 0.22 0.00 0.05 94.37 04:40:18 03:00:01 AM 1 3.85 0.00 0.18 0.00 0.07 95.90 04:40:18 03:01:01 AM all 4.37 0.00 0.20 0.00 0.07 95.36 04:40:18 03:01:01 AM 0 6.99 0.00 0.23 0.00 0.08 92.69 04:40:18 03:01:01 AM 1 1.75 0.00 0.17 0.00 0.05 98.03 04:40:18 03:02:01 AM all 4.63 0.00 0.20 0.00 0.06 95.11 04:40:18 03:02:01 AM 0 6.15 0.00 0.18 0.00 0.07 93.60 04:40:18 03:02:01 AM 1 3.11 0.00 0.22 0.00 0.05 96.62 04:40:18 03:03:01 AM all 4.55 0.00 0.21 0.00 0.06 95.18 04:40:18 03:03:01 AM 0 3.31 0.00 0.18 0.00 0.05 96.46 04:40:18 03:03:01 AM 1 5.79 0.00 0.23 0.00 0.07 93.91 04:40:18 03:04:01 AM all 4.61 0.00 0.22 0.00 0.06 95.11 04:40:18 03:04:01 AM 0 6.92 0.00 0.27 0.00 0.07 92.74 04:40:18 03:04:01 AM 1 2.29 0.00 0.17 0.00 0.05 97.49 04:40:18 03:05:01 AM all 6.11 0.00 0.40 0.00 0.08 93.41 04:40:18 03:05:01 AM 0 2.19 0.00 0.23 0.00 0.07 97.51 04:40:18 03:05:01 AM 1 10.18 0.00 0.57 0.00 0.09 89.17 04:40:18 03:06:01 AM all 4.58 0.00 0.43 0.00 0.05 94.94 04:40:18 03:06:01 AM 0 7.77 0.00 0.70 0.00 0.05 91.48 04:40:18 03:06:01 AM 1 1.39 0.00 0.17 0.00 0.05 98.40 04:40:18 03:07:01 AM all 7.19 0.00 0.53 0.00 0.07 92.21 04:40:18 03:07:01 AM 0 3.25 0.00 0.35 0.00 0.05 96.35 04:40:18 03:07:01 AM 1 11.32 0.00 0.72 0.00 0.09 87.88 04:40:18 03:08:01 AM all 4.57 0.00 0.37 0.00 0.05 95.01 04:40:18 03:08:01 AM 0 4.21 0.00 0.32 0.00 0.03 95.44 04:40:18 03:08:01 AM 1 4.94 0.00 0.42 0.00 0.07 94.58 04:40:18 03:09:01 AM all 4.50 0.00 0.36 0.00 0.07 95.08 04:40:18 03:09:01 AM 0 4.09 0.00 0.33 0.00 0.07 95.51 04:40:18 03:09:01 AM 1 4.90 0.00 0.38 0.00 0.07 94.65 04:40:18 03:10:01 AM all 4.62 0.00 0.35 0.00 0.06 94.97 04:40:18 03:10:01 AM 0 5.65 0.00 0.42 0.00 0.07 93.87 04:40:18 03:10:01 AM 1 3.60 0.00 0.28 0.00 0.05 96.07 04:40:18 04:40:18 03:10:01 AM CPU %user %nice %system %iowait %steal %idle 04:40:18 03:11:01 AM all 4.60 0.00 0.36 0.00 0.06 94.98 04:40:18 03:11:01 AM 0 4.73 0.00 0.33 0.00 0.05 94.88 04:40:18 03:11:01 AM 1 4.47 0.00 0.38 0.00 0.07 95.08 04:40:18 03:12:01 AM all 4.50 0.00 0.34 0.00 0.06 95.10 04:40:18 03:12:01 AM 0 6.18 0.00 0.43 0.00 0.07 93.32 04:40:18 03:12:01 AM 1 2.81 0.00 0.25 0.00 0.05 96.89 04:40:18 03:13:01 AM all 4.88 0.00 0.35 0.00 0.07 94.70 04:40:18 03:13:01 AM 0 6.03 0.00 0.42 0.00 0.07 93.48 04:40:18 03:13:01 AM 1 3.72 0.00 0.28 0.00 0.07 95.93 04:40:18 03:14:01 AM all 3.92 0.00 0.31 0.00 0.06 95.71 04:40:18 03:14:01 AM 0 5.08 0.00 0.30 0.00 0.07 94.55 04:40:18 03:14:01 AM 1 2.75 0.00 0.32 0.00 0.05 96.88 04:40:18 03:15:01 AM all 0.92 0.00 0.12 0.00 0.08 98.89 04:40:18 03:15:01 AM 0 0.93 0.00 0.13 0.00 0.08 98.85 04:40:18 03:15:01 AM 1 0.90 0.00 0.10 0.00 0.07 98.93 04:40:18 03:16:01 AM all 0.89 0.00 0.13 0.00 0.06 98.92 04:40:18 03:16:01 AM 0 1.14 0.00 0.17 0.00 0.07 98.63 04:40:18 03:16:01 AM 1 0.65 0.00 0.08 0.00 0.05 99.21 04:40:18 03:17:01 AM all 0.80 0.00 0.13 0.01 0.06 99.00 04:40:18 03:17:01 AM 0 0.72 0.00 0.15 0.02 0.05 99.06 04:40:18 03:17:01 AM 1 0.89 0.00 0.12 0.00 0.07 98.93 04:40:18 03:18:01 AM all 0.87 0.00 0.12 0.00 0.05 98.96 04:40:18 03:18:01 AM 0 0.97 0.00 0.10 0.00 0.03 98.90 04:40:18 03:18:01 AM 1 0.77 0.00 0.13 0.00 0.07 99.03 04:40:18 03:19:01 AM all 0.82 0.00 0.09 0.00 0.07 99.02 04:40:18 03:19:01 AM 0 1.12 0.00 0.12 0.00 0.08 98.68 04:40:18 03:19:01 AM 1 0.52 0.00 0.07 0.00 0.05 99.36 04:40:18 03:20:01 AM all 6.10 0.00 0.41 0.00 0.07 93.42 04:40:18 03:20:01 AM 0 4.49 0.00 0.32 0.00 0.07 95.12 04:40:18 03:20:01 AM 1 7.77 0.00 0.49 0.00 0.07 91.67 04:40:18 03:21:01 AM all 6.24 0.00 0.41 0.00 0.09 93.26 04:40:18 03:21:01 AM 0 7.64 0.00 0.61 0.00 0.09 91.66 04:40:18 03:21:01 AM 1 4.90 0.00 0.22 0.00 0.10 94.78 04:40:18 04:40:18 03:21:01 AM CPU %user %nice %system %iowait %steal %idle 04:40:18 03:22:01 AM all 4.47 0.00 0.20 0.01 0.06 95.26 04:40:18 03:22:01 AM 0 5.43 0.00 0.20 0.00 0.05 94.31 04:40:18 03:22:01 AM 1 3.51 0.00 0.20 0.02 0.07 96.20 04:40:18 03:23:01 AM all 4.39 0.00 0.20 0.00 0.06 95.35 04:40:18 03:23:01 AM 0 3.65 0.00 0.18 0.00 0.05 96.12 04:40:18 03:23:01 AM 1 5.14 0.00 0.22 0.00 0.07 94.58 04:40:18 03:24:01 AM all 4.43 0.00 0.21 0.00 0.07 95.29 04:40:18 03:24:01 AM 0 2.71 0.00 0.18 0.00 0.05 97.06 04:40:18 03:24:01 AM 1 6.16 0.00 0.23 0.00 0.08 93.52 04:40:18 03:25:01 AM all 4.39 0.00 0.19 0.00 0.07 95.35 04:40:18 03:25:01 AM 0 5.50 0.00 0.20 0.00 0.08 94.22 04:40:18 03:25:01 AM 1 3.28 0.00 0.18 0.00 0.05 96.48 04:40:18 03:26:01 AM all 4.38 0.15 0.26 0.00 0.08 95.13 04:40:18 03:26:01 AM 0 2.39 0.27 0.27 0.00 0.05 97.03 04:40:18 03:26:01 AM 1 6.37 0.03 0.25 0.00 0.10 93.24 04:40:18 03:27:01 AM all 5.45 0.00 0.31 0.00 0.08 94.16 04:40:18 03:27:01 AM 0 8.48 0.00 0.43 0.00 0.09 91.00 04:40:18 03:27:01 AM 1 2.51 0.00 0.20 0.00 0.07 97.22 04:40:18 03:28:01 AM all 6.12 0.00 0.41 0.00 0.06 93.41 04:40:18 03:28:01 AM 0 5.17 0.00 0.31 0.00 0.05 94.47 04:40:18 03:28:01 AM 1 7.08 0.00 0.52 0.00 0.07 92.33 04:40:18 03:29:01 AM all 4.46 0.00 0.18 0.00 0.07 95.29 04:40:18 03:29:01 AM 0 5.97 0.00 0.20 0.00 0.07 93.77 04:40:18 03:29:01 AM 1 2.96 0.00 0.17 0.00 0.07 96.81 04:40:18 03:30:01 AM all 4.54 0.00 0.25 0.00 0.06 95.15 04:40:18 03:30:01 AM 0 7.01 0.00 0.27 0.00 0.07 92.66 04:40:18 03:30:01 AM 1 2.07 0.00 0.23 0.00 0.05 97.64 04:40:18 03:31:01 AM all 4.41 0.00 0.18 0.00 0.07 95.34 04:40:18 03:31:01 AM 0 5.43 0.00 0.18 0.00 0.07 94.32 04:40:18 03:31:01 AM 1 3.40 0.00 0.17 0.00 0.07 96.37 04:40:18 03:32:01 AM all 4.38 0.00 0.20 0.00 0.08 95.35 04:40:18 03:32:01 AM 0 6.83 0.00 0.22 0.00 0.08 92.86 04:40:18 03:32:01 AM 1 1.92 0.00 0.18 0.00 0.07 97.83 04:40:18 04:40:18 03:32:01 AM CPU %user %nice %system %iowait %steal %idle 04:40:18 03:33:01 AM all 4.60 0.00 0.16 0.00 0.06 95.18 04:40:18 03:33:01 AM 0 6.59 0.00 0.17 0.00 0.07 93.18 04:40:18 03:33:01 AM 1 2.61 0.00 0.15 0.00 0.05 97.19 04:40:18 03:34:01 AM all 4.40 0.00 0.29 0.00 0.06 95.25 04:40:18 03:34:01 AM 0 6.83 0.00 0.40 0.00 0.05 92.72 04:40:18 03:34:01 AM 1 2.04 0.00 0.18 0.00 0.07 97.71 04:40:18 03:35:01 AM all 6.33 0.00 0.42 0.00 0.09 93.16 04:40:18 03:35:01 AM 0 1.72 0.00 0.15 0.00 0.07 98.06 04:40:18 03:35:01 AM 1 11.16 0.00 0.70 0.00 0.10 88.03 04:40:18 03:36:01 AM all 4.41 0.00 0.32 0.00 0.07 95.20 04:40:18 03:36:01 AM 0 5.13 0.00 0.37 0.00 0.07 94.44 04:40:18 03:36:01 AM 1 3.70 0.00 0.27 0.00 0.07 95.97 04:40:18 03:37:01 AM all 4.12 0.00 0.33 0.00 0.08 95.48 04:40:18 03:37:01 AM 0 3.39 0.00 0.28 0.00 0.07 96.26 04:40:18 03:37:01 AM 1 4.85 0.00 0.37 0.00 0.08 94.69 04:40:18 03:38:01 AM all 4.09 0.00 0.36 0.00 0.08 95.47 04:40:18 03:38:01 AM 0 4.46 0.00 0.38 0.00 0.08 95.07 04:40:18 03:38:01 AM 1 3.71 0.00 0.33 0.00 0.08 95.87 04:40:18 03:39:01 AM all 4.42 0.00 0.32 0.00 0.08 95.18 04:40:18 03:39:01 AM 0 5.38 0.00 0.35 0.00 0.08 94.19 04:40:18 03:39:01 AM 1 3.46 0.00 0.28 0.00 0.08 96.17 04:40:18 03:40:01 AM all 4.48 0.00 0.35 0.00 0.06 95.11 04:40:18 03:40:01 AM 0 5.69 0.00 0.40 0.00 0.07 93.85 04:40:18 03:40:01 AM 1 3.28 0.00 0.30 0.00 0.05 96.37 04:40:18 03:41:01 AM all 6.85 0.00 0.44 0.01 0.07 92.63 04:40:18 03:41:01 AM 0 9.12 0.00 0.50 0.00 0.07 90.31 04:40:18 03:41:01 AM 1 4.59 0.00 0.39 0.02 0.07 94.94 04:40:18 03:42:01 AM all 0.76 0.00 0.13 0.00 0.07 99.05 04:40:18 03:42:01 AM 0 0.70 0.00 0.12 0.00 0.05 99.13 04:40:18 03:42:01 AM 1 0.82 0.00 0.13 0.00 0.08 98.96 04:40:18 03:43:01 AM all 0.88 0.00 0.13 0.00 0.06 98.94 04:40:18 03:43:01 AM 0 1.29 0.00 0.15 0.00 0.08 98.48 04:40:18 03:43:01 AM 1 0.47 0.00 0.10 0.00 0.03 99.40 04:40:18 04:40:18 03:43:01 AM CPU %user %nice %system %iowait %steal %idle 04:40:18 03:44:01 AM all 0.88 0.00 0.11 0.00 0.06 98.96 04:40:18 03:44:01 AM 0 1.12 0.00 0.13 0.00 0.07 98.68 04:40:18 03:44:01 AM 1 0.63 0.00 0.08 0.00 0.05 99.23 04:40:18 03:45:01 AM all 0.85 0.00 0.13 0.00 0.07 98.96 04:40:18 03:45:01 AM 0 0.65 0.00 0.08 0.00 0.05 99.22 04:40:18 03:45:01 AM 1 1.05 0.00 0.17 0.00 0.08 98.70 04:40:18 03:46:01 AM all 0.88 0.00 0.12 0.00 0.05 98.96 04:40:18 03:46:01 AM 0 0.75 0.00 0.07 0.00 0.03 99.15 04:40:18 03:46:01 AM 1 1.00 0.00 0.17 0.00 0.07 98.76 04:40:18 03:47:02 AM all 2.03 0.00 0.14 0.00 0.07 97.76 04:40:18 03:47:02 AM 0 2.69 0.00 0.13 0.00 0.05 97.13 04:40:18 03:47:02 AM 1 1.37 0.00 0.15 0.00 0.08 98.39 04:40:18 03:48:01 AM all 6.99 0.00 3.17 0.00 0.06 89.78 04:40:18 03:48:01 AM 0 7.26 0.00 5.73 0.00 0.07 86.94 04:40:18 03:48:01 AM 1 6.71 0.00 0.55 0.00 0.05 92.69 04:40:18 03:49:01 AM all 6.67 0.00 0.52 0.00 0.06 92.76 04:40:18 03:49:01 AM 0 5.88 0.00 0.49 0.00 0.05 93.58 04:40:18 03:49:01 AM 1 7.47 0.00 0.54 0.00 0.07 91.92 04:40:18 03:50:01 AM all 7.34 0.00 0.50 0.00 0.07 92.09 04:40:18 03:50:01 AM 0 10.91 0.00 0.72 0.00 0.07 88.30 04:40:18 03:50:01 AM 1 3.97 0.00 0.29 0.00 0.07 95.67 04:40:18 03:51:01 AM all 5.20 0.00 0.40 0.00 0.08 94.31 04:40:18 03:51:01 AM 0 6.84 0.00 0.52 0.00 0.08 92.55 04:40:18 03:51:01 AM 1 3.58 0.00 0.28 0.00 0.08 96.06 04:40:18 03:52:01 AM all 4.41 0.00 0.31 0.00 0.07 95.21 04:40:18 03:52:01 AM 0 4.64 0.00 0.32 0.00 0.07 94.97 04:40:18 03:52:01 AM 1 4.18 0.00 0.30 0.00 0.07 95.45 04:40:18 03:53:01 AM all 3.99 0.00 0.30 0.00 0.07 95.65 04:40:18 03:53:01 AM 0 4.26 0.00 0.30 0.00 0.07 95.37 04:40:18 03:53:01 AM 1 3.71 0.00 0.30 0.00 0.07 95.92 04:40:18 03:54:01 AM all 4.22 0.00 0.32 0.00 0.09 95.37 04:40:18 03:54:01 AM 0 3.04 0.00 0.23 0.00 0.08 96.64 04:40:18 03:54:01 AM 1 5.40 0.00 0.40 0.00 0.10 94.10 04:40:18 04:40:18 03:54:01 AM CPU %user %nice %system %iowait %steal %idle 04:40:18 03:55:01 AM all 4.32 0.00 0.28 0.00 0.07 95.33 04:40:18 03:55:01 AM 0 5.55 0.00 0.37 0.00 0.08 94.00 04:40:18 03:55:01 AM 1 3.10 0.00 0.20 0.00 0.05 96.65 04:40:18 03:56:01 AM all 4.23 0.00 0.33 0.00 0.07 95.38 04:40:18 03:56:01 AM 0 4.73 0.00 0.38 0.00 0.05 94.84 04:40:18 03:56:01 AM 1 3.73 0.00 0.27 0.00 0.08 95.92 04:40:18 03:57:01 AM all 5.35 0.00 0.28 0.00 0.08 94.29 04:40:18 03:57:01 AM 0 3.82 0.00 0.25 0.00 0.10 95.83 04:40:18 03:57:01 AM 1 6.88 0.00 0.30 0.00 0.07 92.75 04:40:18 03:58:01 AM all 0.89 0.00 0.11 0.00 0.06 98.94 04:40:18 03:58:01 AM 0 1.14 0.00 0.15 0.00 0.08 98.63 04:40:18 03:58:01 AM 1 0.65 0.00 0.07 0.00 0.03 99.25 04:40:18 03:59:01 AM all 0.87 0.00 0.12 0.00 0.08 98.94 04:40:18 03:59:01 AM 0 0.97 0.00 0.15 0.00 0.10 98.78 04:40:18 03:59:01 AM 1 0.77 0.00 0.08 0.00 0.05 99.10 04:40:18 04:00:01 AM all 0.81 0.00 0.13 0.00 0.07 99.00 04:40:18 04:00:01 AM 0 0.77 0.00 0.13 0.00 0.07 99.03 04:40:18 04:00:01 AM 1 0.85 0.00 0.12 0.00 0.07 98.96 04:40:18 04:01:01 AM all 0.90 0.00 0.13 0.00 0.07 98.90 04:40:18 04:01:01 AM 0 0.80 0.00 0.12 0.00 0.07 99.02 04:40:18 04:01:01 AM 1 1.00 0.00 0.15 0.00 0.07 98.78 04:40:18 04:02:01 AM all 0.89 0.00 0.12 0.00 0.08 98.91 04:40:18 04:02:01 AM 0 0.78 0.00 0.07 0.00 0.08 99.07 04:40:18 04:02:01 AM 1 1.00 0.00 0.17 0.00 0.07 98.76 04:40:18 04:03:01 AM all 4.25 0.00 2.72 0.00 0.07 92.95 04:40:18 04:03:01 AM 0 6.98 0.00 5.31 0.00 0.07 87.64 04:40:18 04:03:01 AM 1 1.56 0.00 0.17 0.00 0.07 98.21 04:40:18 04:04:01 AM all 7.12 0.00 0.53 0.00 0.23 92.12 04:40:18 04:04:01 AM 0 5.78 0.00 0.48 0.00 0.17 93.57 04:40:18 04:04:01 AM 1 8.49 0.00 0.58 0.00 0.28 90.65 04:40:18 04:05:01 AM all 6.68 0.00 0.53 0.00 0.07 92.72 04:40:18 04:05:01 AM 0 2.34 0.00 0.27 0.00 0.07 97.32 04:40:18 04:05:01 AM 1 11.28 0.00 0.81 0.00 0.07 87.84 04:40:18 04:40:18 04:05:01 AM CPU %user %nice %system %iowait %steal %idle 04:40:18 04:06:01 AM all 6.98 0.00 0.47 0.00 0.07 92.48 04:40:18 04:06:01 AM 0 8.83 0.00 0.61 0.00 0.07 90.48 04:40:18 04:06:01 AM 1 5.19 0.00 0.32 0.00 0.07 94.42 04:40:18 04:07:01 AM all 4.34 0.00 0.35 0.01 0.08 95.23 04:40:18 04:07:01 AM 0 4.75 0.00 0.38 0.00 0.08 94.78 04:40:18 04:07:01 AM 1 3.93 0.00 0.32 0.02 0.07 95.67 04:40:18 04:08:01 AM all 4.50 0.00 0.32 0.00 0.08 95.11 04:40:18 04:08:01 AM 0 5.84 0.00 0.33 0.00 0.07 93.76 04:40:18 04:08:01 AM 1 3.16 0.00 0.30 0.00 0.08 96.46 04:40:18 04:09:01 AM all 4.19 0.00 0.35 0.00 0.08 95.39 04:40:18 04:09:01 AM 0 1.87 0.00 0.20 0.00 0.07 97.86 04:40:18 04:09:01 AM 1 6.51 0.00 0.50 0.00 0.08 92.91 04:40:18 04:10:01 AM all 4.41 0.00 0.35 0.00 0.08 95.15 04:40:18 04:10:01 AM 0 2.35 0.00 0.18 0.00 0.07 97.39 04:40:18 04:10:01 AM 1 6.48 0.00 0.52 0.00 0.10 92.90 04:40:18 04:11:01 AM all 4.42 0.00 0.34 0.00 0.08 95.16 04:40:18 04:11:01 AM 0 4.19 0.00 0.35 0.00 0.07 95.39 04:40:18 04:11:01 AM 1 4.65 0.00 0.33 0.00 0.08 94.93 04:40:18 04:12:01 AM all 6.78 0.00 0.38 0.00 0.07 92.77 04:40:18 04:12:01 AM 0 6.33 0.00 0.33 0.00 0.07 93.27 04:40:18 04:12:01 AM 1 7.23 0.00 0.44 0.00 0.07 92.27 04:40:18 04:13:01 AM all 1.70 0.00 0.18 0.00 0.07 98.05 04:40:18 04:13:01 AM 0 1.50 0.00 0.15 0.00 0.05 98.30 04:40:18 04:13:01 AM 1 1.89 0.00 0.22 0.00 0.08 97.81 04:40:18 04:14:01 AM all 0.87 0.00 0.09 0.00 0.07 98.97 04:40:18 04:14:01 AM 0 0.78 0.00 0.08 0.00 0.05 99.08 04:40:18 04:14:01 AM 1 0.95 0.00 0.10 0.00 0.08 98.86 04:40:18 04:15:01 AM all 0.92 0.00 0.13 0.00 0.04 98.91 04:40:18 04:15:01 AM 0 0.63 0.00 0.10 0.00 0.03 99.23 04:40:18 04:15:01 AM 1 1.20 0.00 0.15 0.00 0.05 98.60 04:40:18 04:16:01 AM all 0.84 0.00 0.13 0.00 0.06 98.97 04:40:18 04:16:01 AM 0 0.62 0.00 0.10 0.00 0.05 99.23 04:40:18 04:16:01 AM 1 1.07 0.00 0.15 0.00 0.07 98.71 04:40:18 04:40:18 04:16:01 AM CPU %user %nice %system %iowait %steal %idle 04:40:18 04:17:01 AM all 0.87 0.00 0.12 0.00 0.07 98.95 04:40:18 04:17:01 AM 0 0.65 0.00 0.08 0.00 0.05 99.22 04:40:18 04:17:01 AM 1 1.09 0.00 0.15 0.00 0.08 98.68 04:40:18 04:18:01 AM all 0.84 0.00 0.13 0.00 0.07 98.96 04:40:18 04:18:01 AM 0 0.93 0.00 0.13 0.00 0.07 98.86 04:40:18 04:18:01 AM 1 0.75 0.00 0.12 0.00 0.07 99.06 04:40:18 04:19:01 AM all 6.05 0.00 2.12 0.00 0.07 91.75 04:40:18 04:19:01 AM 0 1.10 0.00 0.20 0.00 0.07 98.63 04:40:18 04:19:01 AM 1 11.39 0.00 4.20 0.00 0.07 84.34 04:40:18 04:20:01 AM all 3.34 0.00 0.28 0.00 0.05 96.33 04:40:18 04:20:01 AM 0 0.23 0.00 0.15 0.00 0.05 99.57 04:40:18 04:20:01 AM 1 6.56 0.00 0.42 0.00 0.05 92.97 04:40:18 04:21:01 AM all 4.71 0.00 0.35 0.00 0.06 94.88 04:40:18 04:21:01 AM 0 6.31 0.00 0.43 0.00 0.09 93.17 04:40:18 04:21:01 AM 1 3.14 0.00 0.27 0.00 0.03 96.56 04:40:18 04:22:01 AM all 5.47 0.00 0.37 0.00 0.07 94.09 04:40:18 04:22:01 AM 0 6.28 0.00 0.45 0.00 0.07 93.20 04:40:18 04:22:01 AM 1 4.68 0.00 0.30 0.00 0.07 94.95 04:40:18 04:23:01 AM all 3.91 0.00 0.30 0.00 0.08 95.71 04:40:18 04:23:01 AM 0 5.72 0.00 0.38 0.00 0.08 93.82 04:40:18 04:23:01 AM 1 2.11 0.00 0.22 0.00 0.07 97.61 04:40:18 04:24:01 AM all 4.31 0.00 0.31 0.00 0.06 95.32 04:40:18 04:24:01 AM 0 5.51 0.00 0.37 0.00 0.07 94.05 04:40:18 04:24:01 AM 1 3.11 0.00 0.25 0.00 0.05 96.59 04:40:18 04:25:01 AM all 4.36 0.00 0.34 0.00 0.08 95.22 04:40:18 04:25:01 AM 0 5.20 0.00 0.38 0.00 0.07 94.35 04:40:18 04:25:01 AM 1 3.51 0.00 0.30 0.00 0.08 96.10 04:40:18 04:26:01 AM all 4.32 0.00 0.32 0.00 0.06 95.31 04:40:18 04:26:01 AM 0 7.09 0.00 0.42 0.00 0.07 92.43 04:40:18 04:26:01 AM 1 1.54 0.00 0.22 0.00 0.05 98.19 04:40:18 04:27:01 AM all 4.37 0.00 0.31 0.00 0.08 95.24 04:40:18 04:27:01 AM 0 5.43 0.00 0.37 0.00 0.08 94.12 04:40:18 04:27:01 AM 1 3.31 0.00 0.25 0.00 0.07 96.37 04:40:18 04:40:18 04:27:01 AM CPU %user %nice %system %iowait %steal %idle 04:40:18 04:28:01 AM all 6.25 0.00 0.36 0.00 0.08 93.31 04:40:18 04:28:01 AM 0 7.25 0.00 0.37 0.00 0.08 92.29 04:40:18 04:28:01 AM 1 5.25 0.00 0.35 0.00 0.07 94.33 04:40:18 04:29:01 AM all 0.79 0.00 0.11 0.00 0.08 99.03 04:40:18 04:29:01 AM 0 1.00 0.00 0.13 0.00 0.08 98.78 04:40:18 04:29:01 AM 1 0.57 0.00 0.08 0.00 0.07 99.28 04:40:18 04:30:01 AM all 0.86 0.00 0.12 0.00 0.07 98.96 04:40:18 04:30:01 AM 0 1.20 0.00 0.15 0.00 0.08 98.56 04:40:18 04:30:01 AM 1 0.52 0.00 0.08 0.00 0.05 99.35 04:40:18 04:31:01 AM all 0.94 0.18 0.20 0.00 0.06 98.63 04:40:18 04:31:01 AM 0 1.02 0.33 0.23 0.00 0.07 98.35 04:40:18 04:31:01 AM 1 0.85 0.02 0.17 0.00 0.05 98.91 04:40:18 04:32:01 AM all 0.97 0.00 0.10 0.01 0.08 98.84 04:40:18 04:32:01 AM 0 1.04 0.00 0.12 0.00 0.10 98.75 04:40:18 04:32:01 AM 1 0.90 0.00 0.08 0.02 0.07 98.93 04:40:18 04:33:01 AM all 1.02 0.00 0.13 0.00 0.08 98.78 04:40:18 04:33:01 AM 0 1.37 0.00 0.18 0.00 0.08 98.37 04:40:18 04:33:01 AM 1 0.67 0.00 0.07 0.00 0.07 99.20 04:40:18 04:34:01 AM all 3.80 0.00 0.66 0.00 0.08 95.47 04:40:18 04:34:01 AM 0 6.54 0.00 1.17 0.00 0.08 92.20 04:40:18 04:34:01 AM 1 1.09 0.00 0.15 0.00 0.07 98.70 04:40:18 04:35:01 AM all 7.95 0.00 5.03 0.00 0.09 86.94 04:40:18 04:35:01 AM 0 7.77 0.00 5.08 0.00 0.07 87.08 04:40:18 04:35:01 AM 1 8.13 0.00 4.98 0.00 0.10 86.79 04:40:18 04:36:01 AM all 7.47 0.00 5.17 0.00 0.09 87.28 04:40:18 04:36:01 AM 0 8.16 0.00 5.67 0.00 0.10 86.07 04:40:18 04:36:01 AM 1 6.77 0.00 4.66 0.00 0.07 88.50 04:40:18 04:37:01 AM all 7.35 0.00 5.37 0.01 0.08 87.19 04:40:18 04:37:01 AM 0 4.74 0.00 5.12 0.02 0.07 90.06 04:40:18 04:37:01 AM 1 10.05 0.00 5.62 0.00 0.09 84.24 04:40:18 04:38:01 AM all 7.53 0.00 5.00 0.00 0.07 87.40 04:40:18 04:38:01 AM 0 11.37 0.00 5.81 0.00 0.07 82.76 04:40:18 04:38:01 AM 1 3.79 0.00 4.22 0.00 0.07 91.92 04:40:18 04:40:18 04:38:01 AM CPU %user %nice %system %iowait %steal %idle 04:40:18 04:39:01 AM all 27.30 0.00 2.45 0.09 0.08 70.08 04:40:18 04:39:01 AM 0 18.79 0.00 2.44 0.12 0.08 78.57 04:40:18 04:39:01 AM 1 35.92 0.00 2.45 0.07 0.08 61.48 04:40:18 04:40:01 AM all 24.04 0.00 3.36 0.23 0.08 72.29 04:40:18 04:40:01 AM 0 29.52 0.00 3.57 0.33 0.08 66.49 04:40:18 04:40:01 AM 1 18.55 0.00 3.15 0.13 0.08 78.09 04:40:18 Average: all 4.39 0.00 0.47 0.02 0.07 95.05 04:40:18 Average: 0 4.83 0.00 0.51 0.02 0.07 94.57 04:40:18 Average: 1 3.96 0.00 0.43 0.02 0.07 95.52 04:40:18 04:40:18 04:40:18