Started by upstream project "integration-distribution-mri-test-scandium" build number 79 originally caused by: Started by timer Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on prd-centos8-robot-2c-8g-4831 (centos8-robot-2c-8g) in workspace /w/workspace/controller-csit-3node-clustering-tell-all-scandium [ssh-agent] Looking for ssh-agent implementation... [ssh-agent] Exec ssh-agent (binary ssh-agent on a remote machine) $ ssh-agent SSH_AUTH_SOCK=/tmp/ssh-GIsFAd1j0JAw/agent.5169 SSH_AGENT_PID=5170 [ssh-agent] Started. Running ssh-add (command line suppressed) Identity added: /w/workspace/controller-csit-3node-clustering-tell-all-scandium@tmp/private_key_6225325857962152037.key (/w/workspace/controller-csit-3node-clustering-tell-all-scandium@tmp/private_key_6225325857962152037.key) [ssh-agent] Using credentials jenkins (Release Engineering Jenkins Key) The recommended git tool is: NONE using credential opendaylight-jenkins-ssh Wiping out workspace first. Cloning the remote Git repository Cloning repository git://devvexx.opendaylight.org/mirror/integration/test > git init /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test # timeout=10 Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test > git --version # timeout=10 > git --version # 'git version 2.43.0' using GIT_SSH to set credentials Release Engineering Jenkins Key [INFO] Currently running in a labeled security context [INFO] Currently SELinux is 'enforcing' on the host > /usr/bin/chcon --type=ssh_home_t /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test@tmp/jenkins-gitclient-ssh16888618779134009910.key Verifying host key using known hosts file You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification. > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10 Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test using GIT_SSH to set credentials Release Engineering Jenkins Key [INFO] Currently running in a labeled security context [INFO] Currently SELinux is 'enforcing' on the host > /usr/bin/chcon --type=ssh_home_t /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test@tmp/jenkins-gitclient-ssh13545063613089140388.key Verifying host key using known hosts file You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification. > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test master # timeout=10 > git rev-parse FETCH_HEAD^{commit} # timeout=10 Checking out Revision 6c60ddfc8acc87c45ab0767b2ba1d2c4e7d34388 (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f 6c60ddfc8acc87c45ab0767b2ba1d2c4e7d34388 # timeout=10 Commit message: "Adapt test for new pce-allocation field" > git rev-parse FETCH_HEAD^{commit} # timeout=10 > git rev-list --no-walk 62cb016f4f4171033927cf2ae7f4ac5095373e88 # timeout=10 No emails were triggered. provisioning config files... copy managed file [npmrc] to file:/home/jenkins/.npmrc copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins1992002703393970764.sh ---> python-tools-install.sh Setup pyenv: system * 3.8.13 (set by /opt/pyenv/version) * 3.9.13 (set by /opt/pyenv/version) * 3.10.13 (set by /opt/pyenv/version) * 3.11.7 (set by /opt/pyenv/version) lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-pnDE lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) lf-activate-venv(): INFO: Attempting to install with network-safe options... lf-activate-venv(): INFO: Base packages installed successfully lf-activate-venv(): INFO: Installing additional packages: lftools lf-activate-venv(): INFO: Adding /tmp/venv-pnDE/bin to PATH Generating Requirements File ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. httplib2 0.31.0 requires pyparsing<4,>=3.0.4, but you have pyparsing 2.4.7 which is incompatible. Python 3.11.7 pip 25.3 from /tmp/venv-pnDE/lib/python3.11/site-packages/pip (python 3.11) appdirs==1.4.4 argcomplete==3.6.3 aspy.yaml==1.3.0 attrs==25.4.0 autopage==0.5.2 beautifulsoup4==4.14.2 boto3==1.40.64 botocore==1.40.64 bs4==0.0.2 cachetools==6.2.1 certifi==2025.10.5 cffi==2.0.0 cfgv==3.4.0 chardet==5.2.0 charset-normalizer==3.4.4 click==8.3.0 cliff==4.11.0 cmd2==2.7.0 cryptography==3.3.2 debtcollector==3.0.0 decorator==5.2.1 defusedxml==0.7.1 Deprecated==1.3.1 distlib==0.4.0 dnspython==2.8.0 docker==7.1.0 dogpile.cache==1.5.0 durationpy==0.10 email-validator==2.3.0 filelock==3.20.0 future==1.0.0 gitdb==4.0.12 GitPython==3.1.45 google-auth==2.42.1 httplib2==0.31.0 identify==2.6.15 idna==3.11 importlib-resources==1.5.0 iso8601==2.1.0 Jinja2==3.1.6 jmespath==1.0.1 jsonpatch==1.33 jsonpointer==3.0.0 jsonschema==4.25.1 jsonschema-specifications==2025.9.1 keystoneauth1==5.12.0 kubernetes==34.1.0 lftools==0.37.15 lxml==6.0.2 markdown-it-py==4.0.0 MarkupSafe==3.0.3 mdurl==0.1.2 msgpack==1.1.2 multi_key_dict==2.0.3 munch==4.0.0 netaddr==1.3.0 niet==1.4.2 nodeenv==1.9.1 oauth2client==4.1.3 oauthlib==3.3.1 openstacksdk==4.7.1 os-service-types==1.8.1 osc-lib==4.2.0 oslo.config==10.0.0 oslo.context==6.1.0 oslo.i18n==6.6.0 oslo.log==7.2.1 oslo.serialization==5.8.0 oslo.utils==9.1.0 packaging==25.0 pbr==7.0.2 platformdirs==4.5.0 prettytable==3.16.0 psutil==7.1.3 pyasn1==0.6.1 pyasn1_modules==0.4.2 pycparser==2.23 pygerrit2==2.0.15 PyGithub==2.8.1 Pygments==2.19.2 PyJWT==2.10.1 PyNaCl==1.6.0 pyparsing==2.4.7 pyperclip==1.11.0 pyrsistent==0.20.0 python-cinderclient==9.8.0 python-dateutil==2.9.0.post0 python-heatclient==4.3.0 python-jenkins==1.8.3 python-keystoneclient==5.7.0 python-magnumclient==4.9.0 python-openstackclient==8.2.0 python-swiftclient==4.8.0 PyYAML==6.0.3 referencing==0.37.0 requests==2.32.5 requests-oauthlib==2.0.0 requestsexceptions==1.4.0 rfc3986==2.0.0 rich==14.2.0 rich-argparse==1.7.2 rpds-py==0.28.0 rsa==4.9.1 ruamel.yaml==0.18.16 ruamel.yaml.clib==0.2.14 s3transfer==0.14.0 simplejson==3.20.2 six==1.17.0 smmap==5.0.2 soupsieve==2.8 stevedore==5.5.0 tabulate==0.9.0 toml==0.10.2 tomlkit==0.13.3 tqdm==4.67.1 typing_extensions==4.15.0 tzdata==2025.2 urllib3==1.26.20 virtualenv==20.35.4 wcwidth==0.2.14 websocket-client==1.9.0 wrapt==2.0.0 xdg==6.0.0 xmltodict==1.0.2 yq==3.4.3 [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content OS_STACK_TEMPLATE=csit-2-instance-type.yaml OS_CLOUD=vex OS_STACK_NAME=releng-controller-csit-3node-clustering-tell-all-scandium-79 OS_STACK_TEMPLATE_DIR=openstack-hot [EnvInject] - Variables injected successfully. provisioning config files... copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins9333926200617846435.sh ---> Create parameters file for OpenStack HOT OpenStack Heat parameters generated ----------------------------------- parameters: vm_0_count: '3' vm_0_flavor: 'v3-standard-4' vm_0_image: 'ZZCI - Ubuntu 22.04 - builder - x86_64 - 20250917-133034.447' vm_1_count: '0' vm_1_flavor: 'v3-standard-2' vm_1_image: 'ZZCI - Ubuntu 22.04 - mininet-ovs-217 - x86_64 - 20250917-133034.654' job_name: '43164-79' silo: 'releng' [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash -l /tmp/jenkins16921574625558301153.sh ---> Create HEAT stack + source /home/jenkins/lf-env.sh + lf-activate-venv --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq ++ mktemp -d /tmp/venv-XXXX + lf_venv=/tmp/venv-mcii + local venv_file=/tmp/.os_lf_venv + local python=python3 + local options + local set_path=true + local install_args= ++ getopt -o np:v: -l no-path,system-site-packages,python:,venv-file: -n lf-activate-venv -- --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq + options=' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''urllib3~=1.26.15'\'' '\''yq'\''' + eval set -- ' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''urllib3~=1.26.15'\'' '\''yq'\''' ++ set -- --python python3 -- 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq + true + case $1 in + python=python3 + shift 2 + true + case $1 in + shift + break + case $python in + local pkg_list= + [[ -d /opt/pyenv ]] + echo 'Setup pyenv:' Setup pyenv: + export PYENV_ROOT=/opt/pyenv + PYENV_ROOT=/opt/pyenv + export PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin + PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin + pyenv versions system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.python-version) + command -v pyenv ++ pyenv init - --no-rehash + eval 'PATH="$(bash --norc -ec '\''IFS=:; paths=($PATH); for i in ${!paths[@]}; do if [[ ${paths[i]} == "'\'''\''/opt/pyenv/shims'\'''\''" ]]; then unset '\''\'\'''\''paths[i]'\''\'\'''\''; fi; done; echo "${paths[*]}"'\'')" export PATH="/opt/pyenv/shims:${PATH}" export PYENV_SHELL=bash source '\''/opt/pyenv/libexec/../completions/pyenv.bash'\'' pyenv() { local command command="${1:-}" if [ "$#" -gt 0 ]; then shift fi case "$command" in rehash|shell) eval "$(pyenv "sh-$command" "$@")" ;; *) command pyenv "$command" "$@" ;; esac }' +++ bash --norc -ec 'IFS=:; paths=($PATH); for i in ${!paths[@]}; do if [[ ${paths[i]} == "/opt/pyenv/shims" ]]; then unset '\''paths[i]'\''; fi; done; echo "${paths[*]}"' ++ PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin ++ export PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin ++ PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin ++ export PYENV_SHELL=bash ++ PYENV_SHELL=bash ++ source /opt/pyenv/libexec/../completions/pyenv.bash +++ complete -F _pyenv pyenv ++ lf-pyver python3 ++ local py_version_xy=python3 ++ local py_version_xyz= ++ awk '{ print $1 }' ++ pyenv versions ++ local command ++ command=versions ++ '[' 1 -gt 0 ']' ++ shift ++ case "$command" in ++ command pyenv versions ++ pyenv versions ++ sed 's/^[ *]* //' ++ grep -E '^[0-9.]*[0-9]$' ++ [[ ! -s /tmp/.pyenv_versions ]] +++ grep '^3' /tmp/.pyenv_versions +++ tail -n 1 +++ sort -V ++ py_version_xyz=3.11.7 ++ [[ -z 3.11.7 ]] ++ echo 3.11.7 ++ return 0 + pyenv local 3.11.7 + local command + command=local + '[' 2 -gt 0 ']' + shift + case "$command" in + command pyenv local 3.11.7 + pyenv local 3.11.7 + for arg in "$@" + case $arg in + pkg_list+='lftools[openstack] ' + for arg in "$@" + case $arg in + pkg_list+='kubernetes ' + for arg in "$@" + case $arg in + pkg_list+='niet ' + for arg in "$@" + case $arg in + pkg_list+='python-heatclient ' + for arg in "$@" + case $arg in + pkg_list+='python-openstackclient ' + for arg in "$@" + case $arg in + pkg_list+='python-magnumclient ' + for arg in "$@" + case $arg in + pkg_list+='urllib3~=1.26.15 ' + for arg in "$@" + case $arg in + pkg_list+='yq ' + [[ -f /tmp/.os_lf_venv ]] ++ cat /tmp/.os_lf_venv + lf_venv=/tmp/venv-pnDE + echo 'lf-activate-venv(): INFO: Reuse venv:/tmp/venv-pnDE from' file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Reuse venv:/tmp/venv-pnDE from file:/tmp/.os_lf_venv + echo 'lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)' lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) + local 'pip_opts=--upgrade --quiet' + pip_opts='--upgrade --quiet --trusted-host pypi.org' + pip_opts='--upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org' + pip_opts='--upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org' + [[ -n '' ]] + [[ -n '' ]] + echo 'lf-activate-venv(): INFO: Attempting to install with network-safe options...' lf-activate-venv(): INFO: Attempting to install with network-safe options... + /tmp/venv-pnDE/bin/python3 -m pip install --upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org pip 'setuptools<66' virtualenv + echo 'lf-activate-venv(): INFO: Base packages installed successfully' lf-activate-venv(): INFO: Base packages installed successfully + [[ -z lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq ]] + echo 'lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq ' lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq + /tmp/venv-pnDE/bin/python3 -m pip install --upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org --upgrade-strategy eager 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq + type python3 + true + echo 'lf-activate-venv(): INFO: Adding /tmp/venv-pnDE/bin to PATH' lf-activate-venv(): INFO: Adding /tmp/venv-pnDE/bin to PATH + PATH=/tmp/venv-pnDE/bin:/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin + return 0 + openstack --os-cloud vex limits show --absolute +--------------------------+---------+ | Name | Value | +--------------------------+---------+ | maxTotalInstances | -1 | | maxTotalCores | 450 | | maxTotalRAMSize | 1000000 | | maxServerMeta | 128 | | maxImageMeta | 128 | | maxPersonality | 5 | | maxPersonalitySize | 10240 | | maxTotalKeypairs | 100 | | maxServerGroups | 10 | | maxServerGroupMembers | 10 | | maxTotalFloatingIps | -1 | | maxSecurityGroups | -1 | | maxSecurityGroupRules | -1 | | totalRAMUsed | 614400 | | totalCoresUsed | 150 | | totalInstancesUsed | 56 | | totalFloatingIpsUsed | 0 | | totalSecurityGroupsUsed | 0 | | totalServerGroupsUsed | 0 | | maxTotalVolumes | -1 | | maxTotalSnapshots | 10 | | maxTotalVolumeGigabytes | 4096 | | maxTotalBackups | 10 | | maxTotalBackupGigabytes | 1000 | | totalVolumesUsed | 3 | | totalGigabytesUsed | 60 | | totalSnapshotsUsed | 0 | | totalBackupsUsed | 0 | | totalBackupGigabytesUsed | 0 | +--------------------------+---------+ + pushd /opt/ciman/openstack-hot /opt/ciman/openstack-hot /w/workspace/controller-csit-3node-clustering-tell-all-scandium + lftools openstack --os-cloud vex stack create releng-controller-csit-3node-clustering-tell-all-scandium-79 csit-2-instance-type.yaml /w/workspace/controller-csit-3node-clustering-tell-all-scandium/stack-parameters.yaml Creating stack releng-controller-csit-3node-clustering-tell-all-scandium-79 Waiting to initialize infrastructure... Stack initialization successful. ------------------------------------ Stack Details ------------------------------------ {'added': None, 'capabilities': [], 'created_at': '2025-11-02T23:35:13Z', 'deleted': None, 'deleted_at': None, 'description': 'No description', 'environment': None, 'environment_files': None, 'files': None, 'files_container': None, 'id': '91acc0da-f17b-44a0-960e-3830d8634def', 'is_rollback_disabled': True, 'links': [{'href': 'https://orchestration.public.mtl1.vexxhost.net/v1/12c36e260d8e4bb2913965203b1b491f/stacks/releng-controller-csit-3node-clustering-tell-all-scandium-79/91acc0da-f17b-44a0-960e-3830d8634def', 'rel': 'self'}], 'location': Munch({'cloud': 'vex', 'region_name': 'ca-ymq-1', 'zone': None, 'project': Munch({'id': '12c36e260d8e4bb2913965203b1b491f', 'name': '61975f2c-7c17-4d69-82fa-c3ae420ad6fd', 'domain_id': None, 'domain_name': 'Default'})}), 'name': 'releng-controller-csit-3node-clustering-tell-all-scandium-79', 'notification_topics': [], 'outputs': [{'description': 'IP addresses of the 2nd vm types', 'output_key': 'vm_1_ips', 'output_value': []}, {'description': 'IP addresses of the 1st vm types', 'output_key': 'vm_0_ips', 'output_value': ['10.30.170.79', '10.30.170.212', '10.30.171.128']}], 'owner_id': ****, 'parameters': {'OS::project_id': '12c36e260d8e4bb2913965203b1b491f', 'OS::stack_id': '91acc0da-f17b-44a0-960e-3830d8634def', 'OS::stack_name': 'releng-controller-csit-3node-clustering-tell-all-scandium-79', 'job_name': '43164-79', 'silo': 'releng', 'vm_0_count': '3', 'vm_0_flavor': 'v3-standard-4', 'vm_0_image': 'ZZCI - Ubuntu 22.04 - builder - x86_64 - ' '20250917-133034.447', 'vm_1_count': '0', 'vm_1_flavor': 'v3-standard-2', 'vm_1_image': 'ZZCI - Ubuntu 22.04 - mininet-ovs-217 - x86_64 ' '- 20250917-133034.654'}, 'parent_id': None, 'replaced': None, 'status': 'CREATE_COMPLETE', 'status_reason': 'Stack CREATE completed successfully', 'tags': [], 'template': None, 'template_description': 'No description', 'template_url': None, 'timeout_mins': 15, 'unchanged': None, 'updated': None, 'updated_at': None, 'user_project_id': 'ac0fc446f951420cb76da671fff4db75'} ------------------------------------ + popd /w/workspace/controller-csit-3node-clustering-tell-all-scandium [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash -l /tmp/jenkins3054197799741456902.sh ---> Copy SSH public keys to CSIT lab Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-pnDE from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) lf-activate-venv(): INFO: Attempting to install with network-safe options... lf-activate-venv(): INFO: Base packages installed successfully lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes python-heatclient python-openstackclient urllib3~=1.26.15 lf-activate-venv(): INFO: Adding /tmp/venv-pnDE/bin to PATH SSH not responding on 10.30.170.212. Retrying in 10 seconds... SSH not responding on 10.30.171.128. Retrying in 10 seconds... SSH not responding on 10.30.170.79. Retrying in 10 seconds... Ping to 10.30.170.212 successful. Ping to 10.30.171.128 successful. Ping to 10.30.170.79 successful. SSH not responding on 10.30.170.212. Retrying in 10 seconds... SSH not responding on 10.30.170.79. Retrying in 10 seconds... SSH not responding on 10.30.171.128. Retrying in 10 seconds... Ping to 10.30.170.212 successful. Ping to 10.30.170.79 successful. Ping to 10.30.171.128 successful. SSH not responding on 10.30.170.79. Retrying in 10 seconds... Warning: Permanently added '10.30.170.212' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.171.128' (ECDSA) to the list of known hosts. releng-43164-79-0-builder-1 Successfully copied public keys to slave 10.30.170.212 releng-43164-79-0-builder-2 Successfully copied public keys to slave 10.30.171.128 Ping to 10.30.170.79 successful. Warning: Permanently added '10.30.170.79' (ECDSA) to the list of known hosts. releng-43164-79-0-builder-0 Successfully copied public keys to slave 10.30.170.79 Process 6495 ready. Process 6496 ready. Process 6497 ready. SSH ready on all stack servers. [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash -l /tmp/jenkins7320883175641920202.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.python-version) lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-FMHL lf-activate-venv(): INFO: Save venv in file: /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.robot_venv lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) lf-activate-venv(): INFO: Attempting to install with network-safe options... lf-activate-venv(): INFO: Base packages installed successfully lf-activate-venv(): INFO: Installing additional packages: setuptools wheel lf-activate-venv(): INFO: Adding /tmp/venv-FMHL/bin to PATH + echo 'Installing Python Requirements' Installing Python Requirements + cat + python -m pip install -r requirements.txt Looking in indexes: https://nexus3.opendaylight.org/repository/PyPi/simple Collecting docker-py (from -r requirements.txt (line 1)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/docker-py/1.10.6/docker_py-1.10.6-py2.py3-none-any.whl (50 kB) Collecting ipaddr (from -r requirements.txt (line 2)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/ipaddr/2.2.0/ipaddr-2.2.0.tar.gz (26 kB) Installing build dependencies: started Installing build dependencies: finished with status 'done' Getting requirements to build wheel: started Getting requirements to build wheel: finished with status 'done' Preparing metadata (pyproject.toml): started Preparing metadata (pyproject.toml): finished with status 'done' Collecting netaddr (from -r requirements.txt (line 3)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/netaddr/1.3.0/netaddr-1.3.0-py3-none-any.whl (2.3 MB) Collecting netifaces (from -r requirements.txt (line 4)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/netifaces/0.11.0/netifaces-0.11.0.tar.gz (30 kB) Installing build dependencies: started Installing build dependencies: finished with status 'done' Getting requirements to build wheel: started Getting requirements to build wheel: finished with status 'done' Preparing metadata (pyproject.toml): started Preparing metadata (pyproject.toml): finished with status 'done' Collecting pyhocon (from -r requirements.txt (line 5)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyhocon/0.3.61/pyhocon-0.3.61-py3-none-any.whl (25 kB) Collecting requests (from -r requirements.txt (line 6)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/requests/2.32.5/requests-2.32.5-py3-none-any.whl (64 kB) Collecting robotframework (from -r requirements.txt (line 7)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework/7.3.2/robotframework-7.3.2-py3-none-any.whl (795 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 795.1/795.1 kB 31.0 MB/s 0:00:00 Collecting robotframework-httplibrary (from -r requirements.txt (line 8)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-httplibrary/0.4.2/robotframework-httplibrary-0.4.2.tar.gz (9.1 kB) Installing build dependencies: started Installing build dependencies: finished with status 'done' Getting requirements to build wheel: started Getting requirements to build wheel: finished with status 'done' Preparing metadata (pyproject.toml): started Preparing metadata (pyproject.toml): finished with status 'done' Collecting robotframework-requests==0.9.7 (from -r requirements.txt (line 9)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-requests/0.9.7/robotframework_requests-0.9.7-py3-none-any.whl (21 kB) Collecting robotframework-selenium2library (from -r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-selenium2library/3.0.0/robotframework_selenium2library-3.0.0-py2.py3-none-any.whl (6.2 kB) Collecting robotframework-sshlibrary==3.8.0 (from -r requirements.txt (line 11)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-sshlibrary/3.8.0/robotframework-sshlibrary-3.8.0.tar.gz (51 kB) Installing build dependencies: started Installing build dependencies: finished with status 'done' Getting requirements to build wheel: started Getting requirements to build wheel: finished with status 'done' Preparing metadata (pyproject.toml): started Preparing metadata (pyproject.toml): finished with status 'done' Collecting scapy (from -r requirements.txt (line 12)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/scapy/2.6.1/scapy-2.6.1-py3-none-any.whl (2.4 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.4/2.4 MB 38.9 MB/s 0:00:00 Collecting jsonpath-rw (from -r requirements.txt (line 15)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpath-rw/1.4.0/jsonpath-rw-1.4.0.tar.gz (13 kB) Installing build dependencies: started Installing build dependencies: finished with status 'done' Getting requirements to build wheel: started Getting requirements to build wheel: finished with status 'done' Preparing metadata (pyproject.toml): started Preparing metadata (pyproject.toml): finished with status 'done' Collecting elasticsearch (from -r requirements.txt (line 18)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch/9.2.0/elasticsearch-9.2.0-py3-none-any.whl (960 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 960.5/960.5 kB 30.4 MB/s 0:00:00 Collecting elasticsearch-dsl (from -r requirements.txt (line 19)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch-dsl/8.18.0/elasticsearch_dsl-8.18.0-py3-none-any.whl (10 kB) Collecting pyangbind (from -r requirements.txt (line 22)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyangbind/0.8.6/pyangbind-0.8.6-py3-none-any.whl (52 kB) Collecting isodate (from -r requirements.txt (line 25)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/isodate/0.7.2/isodate-0.7.2-py3-none-any.whl (22 kB) Collecting jmespath (from -r requirements.txt (line 28)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jmespath/1.0.1/jmespath-1.0.1-py3-none-any.whl (20 kB) Collecting jsonpatch (from -r requirements.txt (line 31)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpatch/1.33/jsonpatch-1.33-py2.py3-none-any.whl (12 kB) Collecting paramiko>=1.15.3 (from robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/paramiko/4.0.0/paramiko-4.0.0-py3-none-any.whl (223 kB) Collecting scp>=0.13.0 (from robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/scp/0.15.0/scp-0.15.0-py2.py3-none-any.whl (8.8 kB) Collecting docker-pycreds>=0.2.1 (from docker-py->-r requirements.txt (line 1)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/docker-pycreds/0.4.0/docker_pycreds-0.4.0-py2.py3-none-any.whl (9.0 kB) Collecting six>=1.4.0 (from docker-py->-r requirements.txt (line 1)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/six/1.17.0/six-1.17.0-py2.py3-none-any.whl (11 kB) Collecting websocket-client>=0.32.0 (from docker-py->-r requirements.txt (line 1)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/websocket-client/1.9.0/websocket_client-1.9.0-py3-none-any.whl (82 kB) Collecting pyparsing<4,>=2 (from pyhocon->-r requirements.txt (line 5)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pyparsing/3.2.5/pyparsing-3.2.5-py3-none-any.whl (113 kB) Collecting charset_normalizer<4,>=2 (from requests->-r requirements.txt (line 6)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/charset-normalizer/3.4.4/charset_normalizer-3.4.4-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl (151 kB) Collecting idna<4,>=2.5 (from requests->-r requirements.txt (line 6)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/idna/3.11/idna-3.11-py3-none-any.whl (71 kB) Collecting urllib3<3,>=1.21.1 (from requests->-r requirements.txt (line 6)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/urllib3/2.5.0/urllib3-2.5.0-py3-none-any.whl (129 kB) Collecting certifi>=2017.4.17 (from requests->-r requirements.txt (line 6)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/certifi/2025.10.5/certifi-2025.10.5-py3-none-any.whl (163 kB) Collecting webtest>=2.0 (from robotframework-httplibrary->-r requirements.txt (line 8)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/webtest/3.0.7/webtest-3.0.7-py3-none-any.whl (32 kB) Collecting jsonpointer (from robotframework-httplibrary->-r requirements.txt (line 8)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpointer/3.0.0/jsonpointer-3.0.0-py2.py3-none-any.whl (7.6 kB) Collecting robotframework-seleniumlibrary>=3.0.0 (from robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-seleniumlibrary/6.8.0/robotframework_seleniumlibrary-6.8.0-py3-none-any.whl (104 kB) Collecting ply (from jsonpath-rw->-r requirements.txt (line 15)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/ply/3.11/ply-3.11-py2.py3-none-any.whl (49 kB) Collecting decorator (from jsonpath-rw->-r requirements.txt (line 15)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/decorator/5.2.1/decorator-5.2.1-py3-none-any.whl (9.2 kB) Collecting anyio (from elasticsearch->-r requirements.txt (line 18)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/anyio/4.11.0/anyio-4.11.0-py3-none-any.whl (109 kB) Collecting elastic-transport<10,>=9.2.0 (from elasticsearch->-r requirements.txt (line 18)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elastic-transport/9.2.0/elastic_transport-9.2.0-py3-none-any.whl (65 kB) Collecting python-dateutil (from elasticsearch->-r requirements.txt (line 18)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/python-dateutil/2.9.0.post0/python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) Collecting sniffio (from elasticsearch->-r requirements.txt (line 18)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/sniffio/1.3.1/sniffio-1.3.1-py3-none-any.whl (10 kB) Collecting typing-extensions (from elasticsearch->-r requirements.txt (line 18)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/typing-extensions/4.15.0/typing_extensions-4.15.0-py3-none-any.whl (44 kB) Collecting elasticsearch (from -r requirements.txt (line 18)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch/8.19.2/elasticsearch-8.19.2-py3-none-any.whl (949 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 949.7/949.7 kB 41.8 MB/s 0:00:00 INFO: pip is looking at multiple versions of elasticsearch-dsl to determine which version is compatible with other requirements. This could take a while. Collecting elasticsearch-dsl (from -r requirements.txt (line 19)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch-dsl/8.17.1/elasticsearch_dsl-8.17.1-py3-none-any.whl (158 kB) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch-dsl/8.17.0/elasticsearch_dsl-8.17.0-py3-none-any.whl (158 kB) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch-dsl/8.16.0/elasticsearch_dsl-8.16.0-py3-none-any.whl (158 kB) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch-dsl/8.15.4/elasticsearch_dsl-8.15.4-py3-none-any.whl (104 kB) Collecting elastic-transport<9,>=8.15.1 (from elasticsearch->-r requirements.txt (line 18)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elastic-transport/8.17.1/elastic_transport-8.17.1-py3-none-any.whl (64 kB) Collecting pyang (from pyangbind->-r requirements.txt (line 22)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyang/2.7.1/pyang-2.7.1-py2.py3-none-any.whl (598 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 598.5/598.5 kB 24.6 MB/s 0:00:00 Collecting lxml (from pyangbind->-r requirements.txt (line 22)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/lxml/6.0.2/lxml-6.0.2-cp311-cp311-manylinux_2_26_x86_64.manylinux_2_28_x86_64.whl (5.2 MB) Collecting regex (from pyangbind->-r requirements.txt (line 22)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/regex/2025.10.23/regex-2025.10.23-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl (800 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 800.3/800.3 kB 25.2 MB/s 0:00:00 Collecting enum34 (from pyangbind->-r requirements.txt (line 22)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/enum34/1.1.10/enum34-1.1.10-py3-none-any.whl (11 kB) Collecting bcrypt>=3.2 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/bcrypt/5.0.0/bcrypt-5.0.0-cp39-abi3-manylinux_2_28_x86_64.whl (278 kB) Collecting cryptography>=3.3 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/cryptography/46.0.3/cryptography-46.0.3-cp311-abi3-manylinux_2_28_x86_64.whl (4.5 MB) Collecting invoke>=2.0 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/invoke/2.2.1/invoke-2.2.1-py3-none-any.whl (160 kB) Collecting pynacl>=1.5 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pynacl/1.6.0/pynacl-1.6.0-cp38-abi3-manylinux_2_26_x86_64.manylinux_2_28_x86_64.whl (1.4 MB) Collecting cffi>=2.0.0 (from cryptography>=3.3->paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/cffi/2.0.0/cffi-2.0.0-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (215 kB) Collecting pycparser (from cffi>=2.0.0->cryptography>=3.3->paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pycparser/2.23/pycparser-2.23-py3-none-any.whl (118 kB) Collecting selenium>=4.3.0 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/selenium/4.38.0/selenium-4.38.0-py3-none-any.whl (9.7 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 9.7/9.7 MB 54.3 MB/s 0:00:00 Collecting robotframework-pythonlibcore>=4.4.1 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-pythonlibcore/4.4.1/robotframework_pythonlibcore-4.4.1-py2.py3-none-any.whl (12 kB) Collecting click>=8.0 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/click/8.3.0/click-8.3.0-py3-none-any.whl (107 kB) Collecting trio<1.0,>=0.31.0 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/trio/0.32.0/trio-0.32.0-py3-none-any.whl (512 kB) Collecting trio-websocket<1.0,>=0.12.2 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/trio-websocket/0.12.2/trio_websocket-0.12.2-py3-none-any.whl (21 kB) Collecting attrs>=23.2.0 (from trio<1.0,>=0.31.0->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/attrs/25.4.0/attrs-25.4.0-py3-none-any.whl (67 kB) Collecting sortedcontainers (from trio<1.0,>=0.31.0->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/sortedcontainers/2.4.0/sortedcontainers-2.4.0-py2.py3-none-any.whl (29 kB) Collecting outcome (from trio<1.0,>=0.31.0->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/outcome/1.3.0.post0/outcome-1.3.0.post0-py2.py3-none-any.whl (10 kB) Collecting wsproto>=0.14 (from trio-websocket<1.0,>=0.12.2->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/wsproto/1.2.0/wsproto-1.2.0-py3-none-any.whl (24 kB) Collecting pysocks!=1.5.7,<2.0,>=1.5.6 (from urllib3[socks]<3.0,>=2.5.0->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pysocks/1.7.1/PySocks-1.7.1-py3-none-any.whl (16 kB) Collecting WebOb>=1.2 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/webob/1.8.9/WebOb-1.8.9-py2.py3-none-any.whl (115 kB) Collecting waitress>=3.0.2 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/waitress/3.0.2/waitress-3.0.2-py3-none-any.whl (56 kB) Collecting beautifulsoup4 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/beautifulsoup4/4.14.2/beautifulsoup4-4.14.2-py3-none-any.whl (106 kB) Collecting h11<1,>=0.9.0 (from wsproto>=0.14->trio-websocket<1.0,>=0.12.2->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/h11/0.16.0/h11-0.16.0-py3-none-any.whl (37 kB) Collecting soupsieve>1.2 (from beautifulsoup4->webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/soupsieve/2.8/soupsieve-2.8-py3-none-any.whl (36 kB) Building wheels for collected packages: robotframework-sshlibrary, ipaddr, netifaces, robotframework-httplibrary, jsonpath-rw Building wheel for robotframework-sshlibrary (pyproject.toml): started Building wheel for robotframework-sshlibrary (pyproject.toml): finished with status 'done' Created wheel for robotframework-sshlibrary: filename=robotframework_sshlibrary-3.8.0-py3-none-any.whl size=55205 sha256=d6c93336855904f015c4e0b7960269a284adb7fb29203554a5206307dc441cf3 Stored in directory: /home/jenkins/.cache/pip/wheels/f7/c9/b3/a977b7bcc410d45ae27d240df3d00a12585509180e373ecccc Building wheel for ipaddr (pyproject.toml): started Building wheel for ipaddr (pyproject.toml): finished with status 'done' Created wheel for ipaddr: filename=ipaddr-2.2.0-py3-none-any.whl size=18353 sha256=eacfebbf1cecc48679afdf5272fc77d31156cd1d271bcfe975f7f7630da2c529 Stored in directory: /home/jenkins/.cache/pip/wheels/dc/6c/04/da2d847fa8d45c59af3e1d83e2acc29cb8adcbaf04c0898dbf Building wheel for netifaces (pyproject.toml): started Building wheel for netifaces (pyproject.toml): finished with status 'done' Created wheel for netifaces: filename=netifaces-0.11.0-cp311-cp311-linux_x86_64.whl size=41072 sha256=8b16b8700de921dac1a26a61cdc807feaee6578de0d8ba376c2cd3540a23ed07 Stored in directory: /home/jenkins/.cache/pip/wheels/f8/18/88/e61d54b995bea304bdb1d040a92b72228a1bf72ca2a3eba7c9 Building wheel for robotframework-httplibrary (pyproject.toml): started Building wheel for robotframework-httplibrary (pyproject.toml): finished with status 'done' Created wheel for robotframework-httplibrary: filename=robotframework_httplibrary-0.4.2-py3-none-any.whl size=10014 sha256=ec10c435d47e7f835a5c95e252c480889469f9251fe70478ec737e64769acc7a Stored in directory: /home/jenkins/.cache/pip/wheels/aa/bc/0d/9a20dd51effef392aae2733cb4c7b66c6fa29fca33d88b57ed Building wheel for jsonpath-rw (pyproject.toml): started Building wheel for jsonpath-rw (pyproject.toml): finished with status 'done' Created wheel for jsonpath-rw: filename=jsonpath_rw-1.4.0-py3-none-any.whl size=15176 sha256=6908537607280edb24e14492ec359cd1aa67c89434059c9db50176326d25b359 Stored in directory: /home/jenkins/.cache/pip/wheels/f1/54/63/9a8da38cefae13755097b36cc852decc25d8ef69c37d58d4eb Successfully built robotframework-sshlibrary ipaddr netifaces robotframework-httplibrary jsonpath-rw Installing collected packages: sortedcontainers, ply, netifaces, ipaddr, enum34, websocket-client, WebOb, waitress, urllib3, typing-extensions, soupsieve, sniffio, six, scapy, robotframework-pythonlibcore, robotframework, regex, pysocks, pyparsing, pycparser, netaddr, lxml, jsonpointer, jmespath, isodate, invoke, idna, h11, decorator, click, charset_normalizer, certifi, bcrypt, attrs, wsproto, requests, python-dateutil, pyhocon, pyang, outcome, jsonpath-rw, jsonpatch, elastic-transport, docker-pycreds, cffi, beautifulsoup4, webtest, trio, robotframework-requests, pynacl, pyangbind, elasticsearch, docker-py, cryptography, trio-websocket, robotframework-httplibrary, paramiko, elasticsearch-dsl, selenium, scp, robotframework-sshlibrary, robotframework-seleniumlibrary, robotframework-selenium2library Successfully installed WebOb-1.8.9 attrs-25.4.0 bcrypt-5.0.0 beautifulsoup4-4.14.2 certifi-2025.10.5 cffi-2.0.0 charset_normalizer-3.4.4 click-8.3.0 cryptography-46.0.3 decorator-5.2.1 docker-py-1.10.6 docker-pycreds-0.4.0 elastic-transport-8.17.1 elasticsearch-8.19.2 elasticsearch-dsl-8.15.4 enum34-1.1.10 h11-0.16.0 idna-3.11 invoke-2.2.1 ipaddr-2.2.0 isodate-0.7.2 jmespath-1.0.1 jsonpatch-1.33 jsonpath-rw-1.4.0 jsonpointer-3.0.0 lxml-6.0.2 netaddr-1.3.0 netifaces-0.11.0 outcome-1.3.0.post0 paramiko-4.0.0 ply-3.11 pyang-2.7.1 pyangbind-0.8.6 pycparser-2.23 pyhocon-0.3.61 pynacl-1.6.0 pyparsing-3.2.5 pysocks-1.7.1 python-dateutil-2.9.0.post0 regex-2025.10.23 requests-2.32.5 robotframework-7.3.2 robotframework-httplibrary-0.4.2 robotframework-pythonlibcore-4.4.1 robotframework-requests-0.9.7 robotframework-selenium2library-3.0.0 robotframework-seleniumlibrary-6.8.0 robotframework-sshlibrary-3.8.0 scapy-2.6.1 scp-0.15.0 selenium-4.38.0 six-1.17.0 sniffio-1.3.1 sortedcontainers-2.4.0 soupsieve-2.8 trio-0.32.0 trio-websocket-0.12.2 typing-extensions-4.15.0 urllib3-2.5.0 waitress-3.0.2 websocket-client-1.9.0 webtest-3.0.7 wsproto-1.2.0 + pip freeze attrs==25.4.0 bcrypt==5.0.0 beautifulsoup4==4.14.2 certifi==2025.10.5 cffi==2.0.0 charset-normalizer==3.4.4 click==8.3.0 cryptography==46.0.3 decorator==5.2.1 distlib==0.4.0 docker-py==1.10.6 docker-pycreds==0.4.0 elastic-transport==8.17.1 elasticsearch==8.19.2 elasticsearch-dsl==8.15.4 enum34==1.1.10 filelock==3.20.0 h11==0.16.0 idna==3.11 invoke==2.2.1 ipaddr==2.2.0 isodate==0.7.2 jmespath==1.0.1 jsonpatch==1.33 jsonpath-rw==1.4.0 jsonpointer==3.0.0 lxml==6.0.2 netaddr==1.3.0 netifaces==0.11.0 outcome==1.3.0.post0 paramiko==4.0.0 platformdirs==4.5.0 ply==3.11 pyang==2.7.1 pyangbind==0.8.6 pycparser==2.23 pyhocon==0.3.61 PyNaCl==1.6.0 pyparsing==3.2.5 PySocks==1.7.1 python-dateutil==2.9.0.post0 regex==2025.10.23 requests==2.32.5 robotframework==7.3.2 robotframework-httplibrary==0.4.2 robotframework-pythonlibcore==4.4.1 robotframework-requests==0.9.7 robotframework-selenium2library==3.0.0 robotframework-seleniumlibrary==6.8.0 robotframework-sshlibrary==3.8.0 scapy==2.6.1 scp==0.15.0 selenium==4.38.0 six==1.17.0 sniffio==1.3.1 sortedcontainers==2.4.0 soupsieve==2.8 trio==0.32.0 trio-websocket==0.12.2 typing_extensions==4.15.0 urllib3==2.5.0 virtualenv==20.35.4 waitress==3.0.2 WebOb==1.8.9 websocket-client==1.9.0 WebTest==3.0.7 wsproto==1.2.0 [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'env.properties' [EnvInject] - Variables injected successfully. [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash -l /tmp/jenkins9959979029402795946.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-pnDE from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) lf-activate-venv(): INFO: Attempting to install with network-safe options... lf-activate-venv(): INFO: Base packages installed successfully lf-activate-venv(): INFO: Installing additional packages: python-heatclient python-openstackclient yq ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. lftools 0.37.15 requires urllib3<2.1.0, but you have urllib3 2.5.0 which is incompatible. kubernetes 34.1.0 requires urllib3<2.4.0,>=1.24.2, but you have urllib3 2.5.0 which is incompatible. lf-activate-venv(): INFO: Adding /tmp/venv-pnDE/bin to PATH + ODL_SYSTEM=() + TOOLS_SYSTEM=() + OPENSTACK_SYSTEM=() + OPENSTACK_CONTROLLERS=() + mapfile -t ADDR ++ jq -r '.outputs[] | select(.output_key | match("^vm_[0-9]+_ips$")) | .output_value | .[]' ++ openstack stack show -f json -c outputs releng-controller-csit-3node-clustering-tell-all-scandium-79 + for i in "${ADDR[@]}" ++ ssh 10.30.170.79 hostname -s Warning: Permanently added '10.30.170.79' (ECDSA) to the list of known hosts. + REMHOST=releng-43164-79-0-builder-0 + case ${REMHOST} in + ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}") + for i in "${ADDR[@]}" ++ ssh 10.30.170.212 hostname -s Warning: Permanently added '10.30.170.212' (ECDSA) to the list of known hosts. + REMHOST=releng-43164-79-0-builder-1 + case ${REMHOST} in + ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}") + for i in "${ADDR[@]}" ++ ssh 10.30.171.128 hostname -s Warning: Permanently added '10.30.171.128' (ECDSA) to the list of known hosts. + REMHOST=releng-43164-79-0-builder-2 + case ${REMHOST} in + ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}") + echo NUM_ODL_SYSTEM=3 + echo NUM_TOOLS_SYSTEM=0 + '[' '' == yes ']' + NUM_OPENSTACK_SYSTEM=0 + echo NUM_OPENSTACK_SYSTEM=0 + '[' 0 -eq 2 ']' + echo ODL_SYSTEM_IP=10.30.170.79 ++ seq 0 2 + for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 ))) + echo ODL_SYSTEM_1_IP=10.30.170.79 + for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 ))) + echo ODL_SYSTEM_2_IP=10.30.170.212 + for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 ))) + echo ODL_SYSTEM_3_IP=10.30.171.128 + echo TOOLS_SYSTEM_IP= ++ seq 0 -1 + openstack_index=0 + NUM_OPENSTACK_CONTROL_NODES=1 + echo NUM_OPENSTACK_CONTROL_NODES=1 ++ seq 0 0 + for i in $(seq 0 $((NUM_OPENSTACK_CONTROL_NODES - 1))) + echo OPENSTACK_CONTROL_NODE_1_IP= + NUM_OPENSTACK_COMPUTE_NODES=-1 + echo NUM_OPENSTACK_COMPUTE_NODES=-1 + '[' -1 -ge 2 ']' ++ seq 0 -2 + NUM_OPENSTACK_HAPROXY_NODES=0 + echo NUM_OPENSTACK_HAPROXY_NODES=0 ++ seq 0 -1 + echo 'Contents of slave_addresses.txt:' Contents of slave_addresses.txt: + cat slave_addresses.txt NUM_ODL_SYSTEM=3 NUM_TOOLS_SYSTEM=0 NUM_OPENSTACK_SYSTEM=0 ODL_SYSTEM_IP=10.30.170.79 ODL_SYSTEM_1_IP=10.30.170.79 ODL_SYSTEM_2_IP=10.30.170.212 ODL_SYSTEM_3_IP=10.30.171.128 TOOLS_SYSTEM_IP= NUM_OPENSTACK_CONTROL_NODES=1 OPENSTACK_CONTROL_NODE_1_IP= NUM_OPENSTACK_COMPUTE_NODES=-1 NUM_OPENSTACK_HAPROXY_NODES=0 [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'slave_addresses.txt' [EnvInject] - Variables injected successfully. [controller-csit-3node-clustering-tell-all-scandium] $ /bin/sh /tmp/jenkins14914774827902799968.sh Preparing for JRE Version 21 Karaf artifact is karaf Karaf project is integration Java home is /usr/lib/jvm/java-21-openjdk-amd64 [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'set_variables.env' [EnvInject] - Variables injected successfully. [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins3091398533414484025.sh 2025-11-02 23:37:14 URL:https://raw.githubusercontent.com/opendaylight/integration-distribution/stable/scandium/pom.xml [2619/2619] -> "pom.xml" [1] Bundle version is 0.21.4-SNAPSHOT --2025-11-02 23:37:14-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.4-SNAPSHOT/maven-metadata.xml Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6 Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 1404 (1.4K) [application/xml] Saving to: ‘maven-metadata.xml’ 0K . 100% 56.9M=0s 2025-11-02 23:37:15 (56.9 MB/s) - ‘maven-metadata.xml’ saved [1404/1404] org.opendaylight.integration karaf 0.21.4-SNAPSHOT 20251102.212815 77 20251102212815 pom 0.21.4-20251102.212815-77 20251102212815 tar.gz 0.21.4-20251102.212815-77 20251102212815 zip 0.21.4-20251102.212815-77 20251102212815 cyclonedx xml 0.21.4-20251102.212815-77 20251102212815 cyclonedx json 0.21.4-20251102.212815-77 20251102212815 Nexus timestamp is 0.21.4-20251102.212815-77 Distribution bundle URL is https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.4-SNAPSHOT/karaf-0.21.4-20251102.212815-77.zip Distribution bundle is karaf-0.21.4-20251102.212815-77.zip Distribution bundle version is 0.21.4-SNAPSHOT Distribution folder is karaf-0.21.4-SNAPSHOT Nexus prefix is https://nexus.opendaylight.org [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'detect_variables.env' [EnvInject] - Variables injected successfully. [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash -l /tmp/jenkins15862322009134457293.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-pnDE from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) lf-activate-venv(): INFO: Attempting to install with network-safe options... ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. lftools 0.37.15 requires urllib3<2.1.0, but you have urllib3 2.5.0 which is incompatible. lf-activate-venv(): INFO: Base packages installed successfully lf-activate-venv(): INFO: Installing additional packages: python-heatclient python-openstackclient ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. lftools 0.37.15 requires urllib3<2.1.0, but you have urllib3 2.5.0 which is incompatible. lf-activate-venv(): INFO: Adding /tmp/venv-pnDE/bin to PATH Copying common-functions.sh to /tmp Copying common-functions.sh to 10.30.170.79:/tmp Warning: Permanently added '10.30.170.79' (ECDSA) to the list of known hosts. Copying common-functions.sh to 10.30.170.212:/tmp Warning: Permanently added '10.30.170.212' (ECDSA) to the list of known hosts. Copying common-functions.sh to 10.30.171.128:/tmp Warning: Permanently added '10.30.171.128' (ECDSA) to the list of known hosts. [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins7766095262226419767.sh common-functions.sh is being sourced common-functions environment: MAVENCONF: /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ACTUALFEATURES: FEATURESCONF: /tmp/karaf-0.21.4-SNAPSHOT/etc/org.apache.karaf.features.cfg CUSTOMPROP: /tmp/karaf-0.21.4-SNAPSHOT/etc/custom.properties LOGCONF: /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg MEMCONF: /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv CONTROLLERMEM: 2048m AKKACONF: /tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/akka.conf MODULESCONF: /tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/modules.conf MODULESHARDSCONF: /tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/module-shards.conf SUITES: ################################################# ## Configure Cluster and Start ## ################################################# ACTUALFEATURES: odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app SPACE_SEPARATED_FEATURES: odl-integration-compatible-with-all odl-jolokia odl-restconf odl-clustering-test-app Locating script plan to use... script plan exists!!! Changing the script plan path... # Place the scripts in run order: /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/scripts/car_people_shard.sh Executing /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/scripts/car_people_shard.sh... Add car-people shards file Copy shard config to member-1 with IP address 10.30.170.79 Warning: Permanently added '10.30.170.79' (ECDSA) to the list of known hosts. Copy shard config to member-2 with IP address 10.30.170.212 Warning: Permanently added '10.30.170.212' (ECDSA) to the list of known hosts. Copy shard config to member-3 with IP address 10.30.171.128 Warning: Permanently added '10.30.171.128' (ECDSA) to the list of known hosts. Finished running script plans Configuring member-1 with IP address 10.30.170.79 Warning: Permanently added '10.30.170.79' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.170.79' (ECDSA) to the list of known hosts. + source /tmp/common-functions.sh karaf-0.21.4-SNAPSHOT scandium ++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]] common-functions.sh is being sourced ++ echo 'common-functions.sh is being sourced' ++ BUNDLEFOLDER=karaf-0.21.4-SNAPSHOT ++ DISTROSTREAM=scandium ++ export MAVENCONF=/tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ++ MAVENCONF=/tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ++ export FEATURESCONF=/tmp/karaf-0.21.4-SNAPSHOT/etc/org.apache.karaf.features.cfg ++ FEATURESCONF=/tmp/karaf-0.21.4-SNAPSHOT/etc/org.apache.karaf.features.cfg ++ export CUSTOMPROP=/tmp/karaf-0.21.4-SNAPSHOT/etc/custom.properties ++ CUSTOMPROP=/tmp/karaf-0.21.4-SNAPSHOT/etc/custom.properties ++ export LOGCONF=/tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ++ LOGCONF=/tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ++ export MEMCONF=/tmp/karaf-0.21.4-SNAPSHOT/bin/setenv ++ MEMCONF=/tmp/karaf-0.21.4-SNAPSHOT/bin/setenv ++ export CONTROLLERMEM= ++ CONTROLLERMEM= ++ case "${DISTROSTREAM}" in ++ CLUSTER_SYSTEM=akka ++ export AKKACONF=/tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/akka.conf ++ AKKACONF=/tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/akka.conf ++ export MODULESCONF=/tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/modules.conf ++ MODULESCONF=/tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/modules.conf ++ export MODULESHARDSCONF=/tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/module-shards.conf ++ MODULESHARDSCONF=/tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/module-shards.conf ++ print_common_env ++ cat common-functions environment: MAVENCONF: /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ACTUALFEATURES: FEATURESCONF: /tmp/karaf-0.21.4-SNAPSHOT/etc/org.apache.karaf.features.cfg CUSTOMPROP: /tmp/karaf-0.21.4-SNAPSHOT/etc/custom.properties LOGCONF: /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg MEMCONF: /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv CONTROLLERMEM: AKKACONF: /tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/akka.conf MODULESCONF: /tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/modules.conf MODULESHARDSCONF: /tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/module-shards.conf SUITES: ++ SSH='ssh -t -t' ++ extra_services_cntl=' dnsmasq.service httpd.service libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service rabbitmq-server.service ' ++ extra_services_cmp=' libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service ' Changing to /tmp Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.4-SNAPSHOT/karaf-0.21.4-20251102.212815-77.zip + echo 'Changing to /tmp' + cd /tmp + echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.4-SNAPSHOT/karaf-0.21.4-20251102.212815-77.zip' + wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.4-SNAPSHOT/karaf-0.21.4-20251102.212815-77.zip --2025-11-02 23:37:27-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.4-SNAPSHOT/karaf-0.21.4-20251102.212815-77.zip Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6 Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 239810410 (229M) [application/zip] Saving to: ‘karaf-0.21.4-20251102.212815-77.zip’ 0K ........ ........ ........ ........ ........ ........ 1% 10.6M 21s 3072K ........ ........ ........ ........ ........ ........ 2% 36.1M 14s 6144K ........ ........ ........ ........ ........ ........ 3% 100M 10s 9216K ........ ........ ........ ........ ........ ........ 5% 148M 8s 12288K ........ ........ ........ ........ ........ ........ 6% 146M 6s 15360K ........ ........ ........ ........ ........ ........ 7% 132M 5s 18432K ........ ........ ........ ........ ........ ........ 9% 140M 5s 21504K ........ ........ ........ ........ ........ ........ 10% 189M 4s 24576K ........ ........ ........ ........ ........ ........ 11% 160M 4s 27648K ........ ........ ........ ........ ........ ........ 13% 153M 4s 30720K ........ ........ ........ ........ ........ ........ 14% 177M 3s 33792K ........ ........ ........ ........ ........ ........ 15% 173M 3s 36864K ........ ........ ........ ........ ........ ........ 17% 175M 3s 39936K ........ ........ ........ ........ ........ ........ 18% 179M 3s 43008K ........ ........ ........ ........ ........ ........ 19% 148M 3s 46080K ........ ........ ........ ........ ........ ........ 20% 145M 2s 49152K ........ ........ ........ ........ ........ ........ 22% 154M 2s 52224K ........ ........ ........ ........ ........ ........ 23% 136M 2s 55296K ........ ........ ........ ........ ........ ........ 24% 142M 2s 58368K ........ ........ ........ ........ ........ ........ 26% 183M 2s 61440K ........ ........ ........ ........ ........ ........ 27% 182M 2s 64512K ........ ........ ........ ........ ........ ........ 28% 152M 2s 67584K ........ ........ ........ ........ ........ ........ 30% 144M 2s 70656K ........ ........ ........ ........ ........ ........ 31% 143M 2s 73728K ........ ........ ........ ........ ........ ........ 32% 147M 2s 76800K ........ ........ ........ ........ ........ ........ 34% 160M 2s 79872K ........ ........ ........ ........ ........ ........ 35% 160M 2s 82944K ........ ........ ........ ........ ........ ........ 36% 156M 2s 86016K ........ ........ ........ ........ ........ ........ 38% 117M 1s 89088K ........ ........ ........ ........ ........ ........ 39% 168M 1s 92160K ........ ........ ........ ........ ........ ........ 40% 170M 1s 95232K ........ ........ ........ ........ ........ ........ 41% 155M 1s 98304K ........ ........ ........ ........ ........ ........ 43% 145M 1s 101376K ........ ........ ........ ........ ........ ........ 44% 175M 1s 104448K ........ ........ ........ ........ ........ ........ 45% 139M 1s 107520K ........ ........ ........ ........ ........ ........ 47% 151M 1s 110592K ........ ........ ........ ........ ........ ........ 48% 164M 1s 113664K ........ ........ ........ ........ ........ ........ 49% 171M 1s 116736K ........ ........ ........ ........ ........ ........ 51% 156M 1s 119808K ........ ........ ........ ........ ........ ........ 52% 89.6M 1s 122880K ........ ........ ........ ........ ........ ........ 53% 155M 1s 125952K ........ ........ ........ ........ ........ ........ 55% 159M 1s 129024K ........ ........ ........ ........ ........ ........ 56% 199M 1s 132096K ........ ........ ........ ........ ........ ........ 57% 141M 1s 135168K ........ ........ ........ ........ ........ ........ 59% 180M 1s 138240K ........ ........ ........ ........ ........ ........ 60% 165M 1s 141312K ........ ........ ........ ........ ........ ........ 61% 158M 1s 144384K ........ ........ ........ ........ ........ ........ 62% 167M 1s 147456K ........ ........ ........ ........ ........ ........ 64% 170M 1s 150528K ........ ........ ........ ........ ........ ........ 65% 156M 1s 153600K ........ ........ ........ ........ ........ ........ 66% 182M 1s 156672K ........ ........ ........ ........ ........ ........ 68% 165M 1s 159744K ........ ........ ........ ........ ........ ........ 69% 147M 1s 162816K ........ ........ ........ ........ ........ ........ 70% 165M 1s 165888K ........ ........ ........ ........ ........ ........ 72% 156M 1s 168960K ........ ........ ........ ........ ........ ........ 73% 159M 1s 172032K ........ ........ ........ ........ ........ ........ 74% 157M 0s 175104K ........ ........ ........ ........ ........ ........ 76% 158M 0s 178176K ........ ........ ........ ........ ........ ........ 77% 135M 0s 181248K ........ ........ ........ ........ ........ ........ 78% 153M 0s 184320K ........ ........ ........ ........ ........ ........ 80% 148M 0s 187392K ........ ........ ........ ........ ........ ........ 81% 160M 0s 190464K ........ ........ ........ ........ ........ ........ 82% 150M 0s 193536K ........ ........ ........ ........ ........ ........ 83% 158M 0s 196608K ........ ........ ........ ........ ........ ........ 85% 166M 0s 199680K ........ ........ ........ ........ ........ ........ 86% 142M 0s 202752K ........ ........ ........ ........ ........ ........ 87% 145M 0s 205824K ........ ........ ........ ........ ........ ........ 89% 174M 0s 208896K ........ ........ ........ ........ ........ ........ 90% 175M 0s 211968K ........ ........ ........ ........ ........ ........ 91% 170M 0s 215040K ........ ........ ........ ........ ........ ........ 93% 263M 0s 218112K ........ ........ ........ ........ ........ ........ 94% 232M 0s 221184K ........ ........ ........ ........ ........ ........ 95% 228M 0s 224256K ........ ........ ........ ........ ........ ........ 97% 236M 0s 227328K ........ ........ ........ ........ ........ ........ 98% 236M 0s 230400K ........ ........ ........ ........ ........ ........ 99% 248M 0s 233472K ........ ... 100% 254M=1.8s 2025-11-02 23:37:29 (129 MB/s) - ‘karaf-0.21.4-20251102.212815-77.zip’ saved [239810410/239810410] Extracting the new controller... + echo 'Extracting the new controller...' + unzip -q karaf-0.21.4-20251102.212815-77.zip Adding external repositories... + echo 'Adding external repositories...' + sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg + cat /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # If set to true, the following property will not allow any certificate to be used # when accessing Maven repositories through SSL # #org.ops4j.pax.url.mvn.certificateCheck= # # Path to the local Maven settings file. # The repositories defined in this file will be automatically added to the list # of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property # below is not set. # The following locations are checked for the existence of the settings.xml file # * 1. looks for the specified url # * 2. if not found looks for ${user.home}/.m2/settings.xml # * 3. if not found looks for ${maven.home}/conf/settings.xml # * 4. if not found looks for ${M2_HOME}/conf/settings.xml # #org.ops4j.pax.url.mvn.settings= # # Path to the local Maven repository which is used to avoid downloading # artifacts when they already exist locally. # The value of this property will be extracted from the settings.xml file # above, or defaulted to: # System.getProperty( "user.home" ) + "/.m2/repository" # org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository} # # Default this to false. It's just weird to use undocumented repos # org.ops4j.pax.url.mvn.useFallbackRepositories=false # # Uncomment if you don't wanna use the proxy settings # from the Maven conf/settings.xml file # # org.ops4j.pax.url.mvn.proxySupport=false # # Comma separated list of repositories scanned when resolving an artifact. # Those repositories will be checked before iterating through the # below list of repositories and even before the local repository # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snaphots # @noreleases : the repository does not contain any released artifacts # # The following property value will add the system folder as a repo. # org.ops4j.pax.url.mvn.defaultRepositories=\ file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\ file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\ file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots # Use the default local repo (e.g.~/.m2/repository) as a "remote" repo #org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false # # Comma separated list of repositories scanned when resolving an artifact. # The default list includes the following repositories: # http://repo1.maven.org/maven2@id=central # http://repository.springsource.com/maven/bundles/release@id=spring.ebr # http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external # http://zodiac.springsource.com/maven/bundles/release@id=gemini # http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases # https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases # https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases # To add repositories to the default ones, prepend '+' to the list of repositories # to add. # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snapshots # @noreleases : the repository does not contain any released artifacts # @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended # org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases ### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.Configuring the startup features... + [[ True == \T\r\u\e ]] + echo 'Configuring the startup features...' + sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.21.4-SNAPSHOT/etc/org.apache.karaf.features.cfg + FEATURE_TEST_STRING=features-test + FEATURE_TEST_VERSION=0.21.4-SNAPSHOT + KARAF_VERSION=karaf4 + [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]] + sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.21.4-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.21.4-SNAPSHOT/etc/org.apache.karaf.features.cfg + [[ ! -z '' ]] + cat /tmp/karaf-0.21.4-SNAPSHOT/etc/org.apache.karaf.features.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # Comma separated list of features repositories to register by default # featuresRepositories = mvn:org.opendaylight.integration/features-test/0.21.4-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/fe1865c8-8927-4eec-9c70-6196d712fd40.xml # # Comma separated list of features to install at startup # featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, ced3a9ed-c818-44c5-b503-263fd8c4049c # # Resource repositories (OBR) that the features resolver can use # to resolve requirements/capabilities # # The format of the resourceRepositories is # resourceRepositories=[xml:url|json:url],... # for Instance: # #resourceRepositories=xml:http://host/path/to/index.xml # or #resourceRepositories=json:http://host/path/to/index.json # # # Defines if the boot features are started in asynchronous mode (in a dedicated thread) # featuresBootAsynchronous=false # # Service requirements enforcement # # By default, the feature resolver checks the service requirements/capabilities of # bundles for new features (xml schema >= 1.3.0) in order to automatically installs # the required bundles. # The following flag can have those values: # - disable: service requirements are completely ignored # - default: service requirements are ignored for old features # - enforce: service requirements are always verified # #serviceRequirements=default # # Store cfg file for config element in feature # #configCfgStore=true # # Define if the feature service automatically refresh bundles # autoRefresh=true # # Configuration of features processing mechanism (overrides, blacklisting, modification of features) # XML file defines instructions related to features processing # versions.properties may declare properties to resolve placeholders in XML file # both files are relative to ${karaf.etc} # #featureProcessing=org.apache.karaf.features.xml #featureProcessingVersions=versions.properties + configure_karaf_log karaf4 '' + local -r karaf_version=karaf4 + local -r controllerdebugmap= + local logapi=log4j + grep log4j2 /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n log4j2.rootLogger.level = INFO #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 64MB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE Configuring the karaf log... karaf_version: karaf4, logapi: log4j2 + logapi=log4j2 + echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2' + '[' log4j2 == log4j2 ']' + sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg + orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver + orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN' controllerdebugmap: cat /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN' + unset IFS + echo 'controllerdebugmap: ' + '[' -n '' ']' + echo 'cat /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg' + cat /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # Common pattern layout for appenders log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n # Root logger log4j2.rootLogger.level = INFO # uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} # Filters for logs marked by org.opendaylight.odlparent.Markers log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL # Loggers configuration # Spifly logger log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN # Security audit logger log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Appenders configuration # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} # Rolling file appender log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i # uncomment to not force a disk flush #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 1GB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 # Audit file appender log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 # OSGi appender log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * # help with identification of maven-related problems with pax-url-aether #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN Configure java home: /usr/lib/jvm/java-21-openjdk-amd64 max memory: 3072m memconf: /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv + set_java_vars /usr/lib/jvm/java-21-openjdk-amd64 3072m /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv + local -r java_home=/usr/lib/jvm/java-21-openjdk-amd64 + local -r controllermem=3072m + local -r memconf=/tmp/karaf-0.21.4-SNAPSHOT/bin/setenv + echo Configure + echo ' java home: /usr/lib/jvm/java-21-openjdk-amd64' + echo ' max memory: 3072m' + echo ' memconf: /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv' + sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64}%g' /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv + sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv cat /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv + echo 'cat /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv' + cat /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv #!/bin/sh # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # # # handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf # script: client, instance, shell, start, status, stop, karaf # # if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then # Actions go here... # fi # # general settings which should be applied for all scripts go here; please keep # in mind that it is possible that scripts might be executed more than once, e.g. # in example of the start script where the start script is executed first and the # karaf script afterwards. # # # The following section shows the possible configuration options for the default # karaf scripts # export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64} # Location of Java installation # export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration # export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options # export EXTRA_JAVA_OPTS # Additional JVM options # export KARAF_HOME # Karaf home folder # export KARAF_DATA # Karaf data folder # export KARAF_BASE # Karaf base folder # export KARAF_ETC # Karaf etc folder # export KARAF_LOG # Karaf log folder # export KARAF_SYSTEM_OPTS # First citizen Karaf options # export KARAF_OPTS # Additional available Karaf options # export KARAF_DEBUG # Enable debug mode # export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start # export KARAF_NOROOT # Prevent execution as root if set to true Set Java version + echo 'Set Java version' + sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-21-openjdk-amd64/bin/java 1 sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper sudo: a password is required + sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-21-openjdk-amd64/bin/java sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper sudo: a password is required JDK default version ... + echo 'JDK default version ...' + java -version openjdk version "21.0.8" 2025-07-15 OpenJDK Runtime Environment (build 21.0.8+9-Ubuntu-0ubuntu122.04.1) OpenJDK 64-Bit Server VM (build 21.0.8+9-Ubuntu-0ubuntu122.04.1, mixed mode, sharing) Set JAVA_HOME + echo 'Set JAVA_HOME' + export JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64 + JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64 ++ readlink -e /usr/lib/jvm/java-21-openjdk-amd64/bin/java Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java Listing all open ports on controller system... + JAVA_RESOLVED=/usr/lib/jvm/java-21-openjdk-amd64/bin/java + echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java' + echo 'Listing all open ports on controller system...' + netstat -pnatu /tmp/configuration-script.sh: line 40: netstat: command not found Custom shard config exists!!! Copying the shard config... + '[' -f /tmp/custom_shard_config.txt ']' + echo 'Custom shard config exists!!!' + echo 'Copying the shard config...' + cp /tmp/custom_shard_config.txt /tmp/karaf-0.21.4-SNAPSHOT/bin/ Configuring cluster + echo 'Configuring cluster' + /tmp/karaf-0.21.4-SNAPSHOT/bin/configure_cluster.sh 1 10.30.170.79 10.30.170.212 10.30.171.128 ################################################ ## Configure Cluster ## ################################################ NOTE: Cluster configuration files not found. Copying from /tmp/karaf-0.21.4-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/10.0.14 Configuring unique name in akka.conf Configuring hostname in akka.conf Configuring data and rpc seed nodes in akka.conf modules = [ { name = "inventory" namespace = "urn:opendaylight:inventory" shard-strategy = "module" }, { name = "topology" namespace = "urn:TBD:params:xml:ns:yang:network-topology" shard-strategy = "module" }, { name = "toaster" namespace = "http://netconfcentral.org/ns/toaster" shard-strategy = "module" }, { name = "car" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" shard-strategy = "module" }, { name = "people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" shard-strategy = "module" }, { name = "car-people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" shard-strategy = "module" } ] Configuring replication type in module-shards.conf ################################################ ## NOTE: Manually restart controller to ## ## apply configuration. ## ################################################ Dump akka.conf + echo 'Dump akka.conf' + cat /tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/akka.conf odl-cluster-data { akka { remote { artery { enabled = on transport = tcp canonical.hostname = "10.30.170.79" canonical.port = 2550 } } cluster { # Using artery. seed-nodes = ["akka://opendaylight-cluster-data@10.30.170.79:2550", "akka://opendaylight-cluster-data@10.30.170.212:2550", "akka://opendaylight-cluster-data@10.30.171.128:2550"] roles = ["member-1"] # when under load we might trip a false positive on the failure detector # failure-detector { # heartbeat-interval = 4 s # acceptable-heartbeat-pause = 16s # } } persistence { # By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by # modifying the following two properties. The directory location specified may be a relative or absolute path. # The relative path is always relative to KARAF_HOME. # snapshot-store.local.dir = "target/snapshots" # Use lz4 compression for LocalSnapshotStore snapshots snapshot-store.local.use-lz4-compression = false # Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB snapshot-store.local.lz4-blocksize = 256KB } disable-default-actor-system-quarantined-event-handling = "false" } } Dump modules.conf + echo 'Dump modules.conf' + cat /tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/modules.conf modules = [ { name = "inventory" namespace = "urn:opendaylight:inventory" shard-strategy = "module" }, { name = "topology" namespace = "urn:TBD:params:xml:ns:yang:network-topology" shard-strategy = "module" }, { name = "toaster" namespace = "http://netconfcentral.org/ns/toaster" shard-strategy = "module" }, { name = "car" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" shard-strategy = "module" }, { name = "people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" shard-strategy = "module" }, { name = "car-people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" shard-strategy = "module" } ] Dump module-shards.conf + echo 'Dump module-shards.conf' + cat /tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/module-shards.conf module-shards = [ { name = "default" shards = [ { name = "default" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "inventory" shards = [ { name="inventory" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "topology" shards = [ { name="topology" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "toaster" shards = [ { name="toaster" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "car" shards = [ { name="car" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "people" shards = [ { name="people" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "car-people" shards = [ { name="car-people" replicas = ["member-1", "member-2", "member-3"] } ] } ] Configuring member-2 with IP address 10.30.170.212 Warning: Permanently added '10.30.170.212' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.170.212' (ECDSA) to the list of known hosts. + source /tmp/common-functions.sh karaf-0.21.4-SNAPSHOT scandium common-functions.sh is being sourced ++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]] ++ echo 'common-functions.sh is being sourced' ++ BUNDLEFOLDER=karaf-0.21.4-SNAPSHOT ++ DISTROSTREAM=scandium ++ export MAVENCONF=/tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ++ MAVENCONF=/tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ++ export FEATURESCONF=/tmp/karaf-0.21.4-SNAPSHOT/etc/org.apache.karaf.features.cfg ++ FEATURESCONF=/tmp/karaf-0.21.4-SNAPSHOT/etc/org.apache.karaf.features.cfg ++ export CUSTOMPROP=/tmp/karaf-0.21.4-SNAPSHOT/etc/custom.properties ++ CUSTOMPROP=/tmp/karaf-0.21.4-SNAPSHOT/etc/custom.properties ++ export LOGCONF=/tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ++ LOGCONF=/tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ++ export MEMCONF=/tmp/karaf-0.21.4-SNAPSHOT/bin/setenv ++ MEMCONF=/tmp/karaf-0.21.4-SNAPSHOT/bin/setenv ++ export CONTROLLERMEM= ++ CONTROLLERMEM= ++ case "${DISTROSTREAM}" in ++ CLUSTER_SYSTEM=akka ++ export AKKACONF=/tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/akka.conf ++ AKKACONF=/tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/akka.conf ++ export MODULESCONF=/tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/modules.conf ++ MODULESCONF=/tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/modules.conf ++ export MODULESHARDSCONF=/tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/module-shards.conf ++ MODULESHARDSCONF=/tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/module-shards.conf ++ print_common_env ++ cat common-functions environment: MAVENCONF: /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ACTUALFEATURES: FEATURESCONF: /tmp/karaf-0.21.4-SNAPSHOT/etc/org.apache.karaf.features.cfg CUSTOMPROP: /tmp/karaf-0.21.4-SNAPSHOT/etc/custom.properties LOGCONF: /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg MEMCONF: /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv CONTROLLERMEM: AKKACONF: /tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/akka.conf MODULESCONF: /tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/modules.conf MODULESHARDSCONF: /tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/module-shards.conf SUITES: ++ SSH='ssh -t -t' ++ extra_services_cntl=' dnsmasq.service httpd.service libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service rabbitmq-server.service ' ++ extra_services_cmp=' libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service ' Changing to /tmp Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.4-SNAPSHOT/karaf-0.21.4-20251102.212815-77.zip + echo 'Changing to /tmp' + cd /tmp + echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.4-SNAPSHOT/karaf-0.21.4-20251102.212815-77.zip' + wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.4-SNAPSHOT/karaf-0.21.4-20251102.212815-77.zip --2025-11-02 23:37:32-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.4-SNAPSHOT/karaf-0.21.4-20251102.212815-77.zip Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6 Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 239810410 (229M) [application/zip] Saving to: ‘karaf-0.21.4-20251102.212815-77.zip’ 0K ........ ........ ........ ........ ........ ........ 1% 15.6M 14s 3072K ........ ........ ........ ........ ........ ........ 2% 33.0M 11s 6144K ........ ........ ........ ........ ........ ........ 3% 36.6M 9s 9216K ........ ........ ........ ........ ........ ........ 5% 45.8M 8s 12288K ........ ........ ........ ........ ........ ........ 6% 52.4M 7s 15360K ........ ........ ........ ........ ........ ........ 7% 128M 6s 18432K ........ ........ ........ ........ ........ ........ 9% 164M 5s 21504K ........ ........ ........ ........ ........ ........ 10% 217M 5s 24576K ........ ........ ........ ........ ........ ........ 11% 209M 4s 27648K ........ ........ ........ ........ ........ ........ 13% 230M 4s 30720K ........ ........ ........ ........ ........ ........ 14% 238M 3s 33792K ........ ........ ........ ........ ........ ........ 15% 254M 3s 36864K ........ ........ ........ ........ ........ ........ 17% 257M 3s 39936K ........ ........ ........ ........ ........ ........ 18% 274M 3s 43008K ........ ........ ........ ........ ........ ........ 19% 273M 3s 46080K ........ ........ ........ ........ ........ ........ 20% 287M 2s 49152K ........ ........ ........ ........ ........ ........ 22% 290M 2s 52224K ........ ........ ........ ........ ........ ........ 23% 311M 2s 55296K ........ ........ ........ ........ ........ ........ 24% 307M 2s 58368K ........ ........ ........ ........ ........ ........ 26% 315M 2s 61440K ........ ........ ........ ........ ........ ........ 27% 297M 2s 64512K ........ ........ ........ ........ ........ ........ 28% 299M 2s 67584K ........ ........ ........ ........ ........ ........ 30% 347M 2s 70656K ........ ........ ........ ........ ........ ........ 31% 357M 2s 73728K ........ ........ ........ ........ ........ ........ 32% 345M 1s 76800K ........ ........ ........ ........ ........ ........ 34% 347M 1s 79872K ........ ........ ........ ........ ........ ........ 35% 352M 1s 82944K ........ ........ ........ ........ ........ ........ 36% 354M 1s 86016K ........ ........ ........ ........ ........ ........ 38% 363M 1s 89088K ........ ........ ........ ........ ........ ........ 39% 296M 1s 92160K ........ ........ ........ ........ ........ ........ 40% 296M 1s 95232K ........ ........ ........ ........ ........ ........ 41% 307M 1s 98304K ........ ........ ........ ........ ........ ........ 43% 341M 1s 101376K ........ ........ ........ ........ ........ ........ 44% 347M 1s 104448K ........ ........ ........ ........ ........ ........ 45% 335M 1s 107520K ........ ........ ........ ........ ........ ........ 47% 362M 1s 110592K ........ ........ ........ ........ ........ ........ 48% 338M 1s 113664K ........ ........ ........ ........ ........ ........ 49% 353M 1s 116736K ........ ........ ........ ........ ........ ........ 51% 348M 1s 119808K ........ ........ ........ ........ ........ ........ 52% 360M 1s 122880K ........ ........ ........ ........ ........ ........ 53% 359M 1s 125952K ........ ........ ........ ........ ........ ........ 55% 361M 1s 129024K ........ ........ ........ ........ ........ ........ 56% 352M 1s 132096K ........ ........ ........ ........ ........ ........ 57% 359M 1s 135168K ........ ........ ........ ........ ........ ........ 59% 339M 1s 138240K ........ ........ ........ ........ ........ ........ 60% 363M 1s 141312K ........ ........ ........ ........ ........ ........ 61% 347M 1s 144384K ........ ........ ........ ........ ........ ........ 62% 366M 1s 147456K ........ ........ ........ ........ ........ ........ 64% 353M 1s 150528K ........ ........ ........ ........ ........ ........ 65% 351M 0s 153600K ........ ........ ........ ........ ........ ........ 66% 345M 0s 156672K ........ ........ ........ ........ ........ ........ 68% 348M 0s 159744K ........ ........ ........ ........ ........ ........ 69% 342M 0s 162816K ........ ........ ........ ........ ........ ........ 70% 214M 0s 165888K ........ ........ ........ ........ ........ ........ 72% 245M 0s 168960K ........ ........ ........ ........ ........ ........ 73% 313M 0s 172032K ........ ........ ........ ........ ........ ........ 74% 349M 0s 175104K ........ ........ ........ ........ ........ ........ 76% 330M 0s 178176K ........ ........ ........ ........ ........ ........ 77% 347M 0s 181248K ........ ........ ........ ........ ........ ........ 78% 364M 0s 184320K ........ ........ ........ ........ ........ ........ 80% 340M 0s 187392K ........ ........ ........ ........ ........ ........ 81% 361M 0s 190464K ........ ........ ........ ........ ........ ........ 82% 327M 0s 193536K ........ ........ ........ ........ ........ ........ 83% 357M 0s 196608K ........ ........ ........ ........ ........ ........ 85% 296M 0s 199680K ........ ........ ........ ........ ........ ........ 86% 338M 0s 202752K ........ ........ ........ ........ ........ ........ 87% 353M 0s 205824K ........ ........ ........ ........ ........ ........ 89% 357M 0s 208896K ........ ........ ........ ........ ........ ........ 90% 334M 0s 211968K ........ ........ ........ ........ ........ ........ 91% 341M 0s 215040K ........ ........ ........ ........ ........ ........ 93% 339M 0s 218112K ........ ........ ........ ........ ........ ........ 94% 350M 0s 221184K ........ ........ ........ ........ ........ ........ 95% 341M 0s 224256K ........ ........ ........ ........ ........ ........ 97% 345M 0s 227328K ........ ........ ........ ........ ........ ........ 98% 323M 0s 230400K ........ ........ ........ ........ ........ ........ 99% 339M 0s 233472K ........ ... 100% 334M=1.2s 2025-11-02 23:37:33 (193 MB/s) - ‘karaf-0.21.4-20251102.212815-77.zip’ saved [239810410/239810410] Extracting the new controller... + echo 'Extracting the new controller...' + unzip -q karaf-0.21.4-20251102.212815-77.zip Adding external repositories... + echo 'Adding external repositories...' + sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg + cat /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # If set to true, the following property will not allow any certificate to be used # when accessing Maven repositories through SSL # #org.ops4j.pax.url.mvn.certificateCheck= # # Path to the local Maven settings file. # The repositories defined in this file will be automatically added to the list # of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property # below is not set. # The following locations are checked for the existence of the settings.xml file # * 1. looks for the specified url # * 2. if not found looks for ${user.home}/.m2/settings.xml # * 3. if not found looks for ${maven.home}/conf/settings.xml # * 4. if not found looks for ${M2_HOME}/conf/settings.xml # #org.ops4j.pax.url.mvn.settings= # # Path to the local Maven repository which is used to avoid downloading # artifacts when they already exist locally. # The value of this property will be extracted from the settings.xml file # above, or defaulted to: # System.getProperty( "user.home" ) + "/.m2/repository" # org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository} # # Default this to false. It's just weird to use undocumented repos # org.ops4j.pax.url.mvn.useFallbackRepositories=false # # Uncomment if you don't wanna use the proxy settings # from the Maven conf/settings.xml file # # org.ops4j.pax.url.mvn.proxySupport=false # # Comma separated list of repositories scanned when resolving an artifact. # Those repositories will be checked before iterating through the # below list of repositories and even before the local repository # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snaphots # @noreleases : the repository does not contain any released artifacts # # The following property value will add the system folder as a repo. # org.ops4j.pax.url.mvn.defaultRepositories=\ file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\ file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\ file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots # Use the default local repo (e.g.~/.m2/repository) as a "remote" repo #org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false # # Comma separated list of repositories scanned when resolving an artifact. # The default list includes the following repositories: # http://repo1.maven.org/maven2@id=central # http://repository.springsource.com/maven/bundles/release@id=spring.ebr # http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external # http://zodiac.springsource.com/maven/bundles/release@id=gemini # http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases # https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases # https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases # To add repositories to the default ones, prepend '+' to the list of repositories # to add. # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snapshots # @noreleases : the repository does not contain any released artifacts # @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended # org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases ### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.Configuring the startup features... + [[ True == \T\r\u\e ]] + echo 'Configuring the startup features...' + sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.21.4-SNAPSHOT/etc/org.apache.karaf.features.cfg + FEATURE_TEST_STRING=features-test + FEATURE_TEST_VERSION=0.21.4-SNAPSHOT + KARAF_VERSION=karaf4 + [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]] + sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.21.4-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.21.4-SNAPSHOT/etc/org.apache.karaf.features.cfg + [[ ! -z '' ]] + cat /tmp/karaf-0.21.4-SNAPSHOT/etc/org.apache.karaf.features.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # Comma separated list of features repositories to register by default # featuresRepositories = mvn:org.opendaylight.integration/features-test/0.21.4-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/fe1865c8-8927-4eec-9c70-6196d712fd40.xml # # Comma separated list of features to install at startup # featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, ced3a9ed-c818-44c5-b503-263fd8c4049c # # Resource repositories (OBR) that the features resolver can use # to resolve requirements/capabilities # # The format of the resourceRepositories is # resourceRepositories=[xml:url|json:url],... # for Instance: # #resourceRepositories=xml:http://host/path/to/index.xml # or #resourceRepositories=json:http://host/path/to/index.json # # # Defines if the boot features are started in asynchronous mode (in a dedicated thread) # featuresBootAsynchronous=false # # Service requirements enforcement # # By default, the feature resolver checks the service requirements/capabilities of # bundles for new features (xml schema >= 1.3.0) in order to automatically installs # the required bundles. # The following flag can have those values: # - disable: service requirements are completely ignored # - default: service requirements are ignored for old features # - enforce: service requirements are always verified # #serviceRequirements=default # # Store cfg file for config element in feature # #configCfgStore=true # # Define if the feature service automatically refresh bundles # autoRefresh=true # # Configuration of features processing mechanism (overrides, blacklisting, modification of features) # XML file defines instructions related to features processing # versions.properties may declare properties to resolve placeholders in XML file # both files are relative to ${karaf.etc} # #featureProcessing=org.apache.karaf.features.xml #featureProcessingVersions=versions.properties + configure_karaf_log karaf4 '' + local -r karaf_version=karaf4 + local -r controllerdebugmap= + local logapi=log4j + grep log4j2 /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n log4j2.rootLogger.level = INFO #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 64MB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE Configuring the karaf log... karaf_version: karaf4, logapi: log4j2 + logapi=log4j2 + echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2' + '[' log4j2 == log4j2 ']' + sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg + orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver + orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN' controllerdebugmap: cat /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN' + unset IFS + echo 'controllerdebugmap: ' + '[' -n '' ']' + echo 'cat /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg' + cat /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # Common pattern layout for appenders log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n # Root logger log4j2.rootLogger.level = INFO # uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} # Filters for logs marked by org.opendaylight.odlparent.Markers log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL # Loggers configuration # Spifly logger log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN # Security audit logger log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Appenders configuration # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} # Rolling file appender log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i # uncomment to not force a disk flush #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 1GB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 # Audit file appender log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 # OSGi appender log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * # help with identification of maven-related problems with pax-url-aether #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN Configure + set_java_vars /usr/lib/jvm/java-21-openjdk-amd64 3072m /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv + local -r java_home=/usr/lib/jvm/java-21-openjdk-amd64 + local -r controllermem=3072m + local -r memconf=/tmp/karaf-0.21.4-SNAPSHOT/bin/setenv + echo Configure + echo ' java home: /usr/lib/jvm/java-21-openjdk-amd64' java home: /usr/lib/jvm/java-21-openjdk-amd64 max memory: 3072m memconf: /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv + echo ' max memory: 3072m' + echo ' memconf: /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv' + sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64}%g' /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv + sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv cat /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv + echo 'cat /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv' + cat /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv #!/bin/sh # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # # # handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf # script: client, instance, shell, start, status, stop, karaf # # if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then # Actions go here... # fi # # general settings which should be applied for all scripts go here; please keep # in mind that it is possible that scripts might be executed more than once, e.g. # in example of the start script where the start script is executed first and the # karaf script afterwards. # # # The following section shows the possible configuration options for the default # karaf scripts # export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64} # Location of Java installation # export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration # export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options # export EXTRA_JAVA_OPTS # Additional JVM options # export KARAF_HOME # Karaf home folder # export KARAF_DATA # Karaf data folder # export KARAF_BASE # Karaf base folder # export KARAF_ETC # Karaf etc folder # export KARAF_LOG # Karaf log folder # export KARAF_SYSTEM_OPTS # First citizen Karaf options # export KARAF_OPTS # Additional available Karaf options # export KARAF_DEBUG # Enable debug mode # export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start # export KARAF_NOROOT # Prevent execution as root if set to true Set Java version + echo 'Set Java version' + sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-21-openjdk-amd64/bin/java 1 sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper sudo: a password is required + sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-21-openjdk-amd64/bin/java sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper sudo: a password is required JDK default version ... + echo 'JDK default version ...' + java -version openjdk version "21.0.8" 2025-07-15 OpenJDK Runtime Environment (build 21.0.8+9-Ubuntu-0ubuntu122.04.1) OpenJDK 64-Bit Server VM (build 21.0.8+9-Ubuntu-0ubuntu122.04.1, mixed mode, sharing) Set JAVA_HOME + echo 'Set JAVA_HOME' + export JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64 + JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64 ++ readlink -e /usr/lib/jvm/java-21-openjdk-amd64/bin/java Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java + JAVA_RESOLVED=/usr/lib/jvm/java-21-openjdk-amd64/bin/java + echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java' Listing all open ports on controller system... + echo 'Listing all open ports on controller system...' + netstat -pnatu /tmp/configuration-script.sh: line 40: netstat: command not found + '[' -f /tmp/custom_shard_config.txt ']' Custom shard config exists!!! Copying the shard config... + echo 'Custom shard config exists!!!' + echo 'Copying the shard config...' + cp /tmp/custom_shard_config.txt /tmp/karaf-0.21.4-SNAPSHOT/bin/ Configuring cluster + echo 'Configuring cluster' + /tmp/karaf-0.21.4-SNAPSHOT/bin/configure_cluster.sh 2 10.30.170.79 10.30.170.212 10.30.171.128 ################################################ ## Configure Cluster ## ################################################ NOTE: Cluster configuration files not found. Copying from /tmp/karaf-0.21.4-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/10.0.14 Configuring unique name in akka.conf Configuring hostname in akka.conf Configuring data and rpc seed nodes in akka.conf modules = [ { name = "inventory" namespace = "urn:opendaylight:inventory" shard-strategy = "module" }, { name = "topology" namespace = "urn:TBD:params:xml:ns:yang:network-topology" shard-strategy = "module" }, { name = "toaster" namespace = "http://netconfcentral.org/ns/toaster" shard-strategy = "module" }, { name = "car" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" shard-strategy = "module" }, { name = "people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" shard-strategy = "module" }, { name = "car-people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" shard-strategy = "module" } ] Configuring replication type in module-shards.conf ################################################ ## NOTE: Manually restart controller to ## ## apply configuration. ## ################################################ Dump akka.conf + echo 'Dump akka.conf' + cat /tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/akka.conf odl-cluster-data { akka { remote { artery { enabled = on transport = tcp canonical.hostname = "10.30.170.212" canonical.port = 2550 } } cluster { # Using artery. seed-nodes = ["akka://opendaylight-cluster-data@10.30.170.79:2550", "akka://opendaylight-cluster-data@10.30.170.212:2550", "akka://opendaylight-cluster-data@10.30.171.128:2550"] roles = ["member-2"] # when under load we might trip a false positive on the failure detector # failure-detector { # heartbeat-interval = 4 s # acceptable-heartbeat-pause = 16s # } } persistence { # By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by # modifying the following two properties. The directory location specified may be a relative or absolute path. # The relative path is always relative to KARAF_HOME. # snapshot-store.local.dir = "target/snapshots" # Use lz4 compression for LocalSnapshotStore snapshots snapshot-store.local.use-lz4-compression = false # Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB snapshot-store.local.lz4-blocksize = 256KB } disable-default-actor-system-quarantined-event-handling = "false" } } Dump modules.conf + echo 'Dump modules.conf' + cat /tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/modules.conf modules = [ { name = "inventory" namespace = "urn:opendaylight:inventory" shard-strategy = "module" }, { name = "topology" namespace = "urn:TBD:params:xml:ns:yang:network-topology" shard-strategy = "module" }, { name = "toaster" namespace = "http://netconfcentral.org/ns/toaster" shard-strategy = "module" }, { name = "car" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" shard-strategy = "module" }, { name = "people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" shard-strategy = "module" }, { name = "car-people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" shard-strategy = "module" } ] Dump module-shards.conf + echo 'Dump module-shards.conf' + cat /tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/module-shards.conf module-shards = [ { name = "default" shards = [ { name = "default" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "inventory" shards = [ { name="inventory" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "topology" shards = [ { name="topology" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "toaster" shards = [ { name="toaster" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "car" shards = [ { name="car" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "people" shards = [ { name="people" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "car-people" shards = [ { name="car-people" replicas = ["member-1", "member-2", "member-3"] } ] } ] Configuring member-3 with IP address 10.30.171.128 Warning: Permanently added '10.30.171.128' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.171.128' (ECDSA) to the list of known hosts. + source /tmp/common-functions.sh karaf-0.21.4-SNAPSHOT scandium common-functions.sh is being sourced ++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]] ++ echo 'common-functions.sh is being sourced' ++ BUNDLEFOLDER=karaf-0.21.4-SNAPSHOT ++ DISTROSTREAM=scandium ++ export MAVENCONF=/tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ++ MAVENCONF=/tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ++ export FEATURESCONF=/tmp/karaf-0.21.4-SNAPSHOT/etc/org.apache.karaf.features.cfg ++ FEATURESCONF=/tmp/karaf-0.21.4-SNAPSHOT/etc/org.apache.karaf.features.cfg ++ export CUSTOMPROP=/tmp/karaf-0.21.4-SNAPSHOT/etc/custom.properties ++ CUSTOMPROP=/tmp/karaf-0.21.4-SNAPSHOT/etc/custom.properties ++ export LOGCONF=/tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ++ LOGCONF=/tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ++ export MEMCONF=/tmp/karaf-0.21.4-SNAPSHOT/bin/setenv ++ MEMCONF=/tmp/karaf-0.21.4-SNAPSHOT/bin/setenv ++ export CONTROLLERMEM= ++ CONTROLLERMEM= ++ case "${DISTROSTREAM}" in ++ CLUSTER_SYSTEM=akka ++ export AKKACONF=/tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/akka.conf ++ AKKACONF=/tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/akka.conf ++ export MODULESCONF=/tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/modules.conf ++ MODULESCONF=/tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/modules.conf ++ export MODULESHARDSCONF=/tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/module-shards.conf ++ MODULESHARDSCONF=/tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/module-shards.conf ++ print_common_env ++ cat common-functions environment: MAVENCONF: /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ACTUALFEATURES: FEATURESCONF: /tmp/karaf-0.21.4-SNAPSHOT/etc/org.apache.karaf.features.cfg CUSTOMPROP: /tmp/karaf-0.21.4-SNAPSHOT/etc/custom.properties LOGCONF: /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg MEMCONF: /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv CONTROLLERMEM: AKKACONF: /tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/akka.conf MODULESCONF: /tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/modules.conf MODULESHARDSCONF: /tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/module-shards.conf SUITES: ++ SSH='ssh -t -t' ++ extra_services_cntl=' dnsmasq.service httpd.service libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service rabbitmq-server.service ' ++ extra_services_cmp=' libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service ' Changing to /tmp Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.4-SNAPSHOT/karaf-0.21.4-20251102.212815-77.zip + echo 'Changing to /tmp' + cd /tmp + echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.4-SNAPSHOT/karaf-0.21.4-20251102.212815-77.zip' + wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.4-SNAPSHOT/karaf-0.21.4-20251102.212815-77.zip --2025-11-02 23:37:36-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.4-SNAPSHOT/karaf-0.21.4-20251102.212815-77.zip Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6 Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 239810410 (229M) [application/zip] Saving to: ‘karaf-0.21.4-20251102.212815-77.zip’ 0K ........ ........ ........ ........ ........ ........ 1% 28.6M 8s 3072K ........ ........ ........ ........ ........ ........ 2% 40.8M 7s 6144K ........ ........ ........ ........ ........ ........ 3% 57.4M 6s 9216K ........ ........ ........ ........ ........ ........ 5% 55.4M 5s 12288K ........ ........ ........ ........ ........ ........ 6% 51.9M 5s 15360K ........ ........ ........ ........ ........ ........ 7% 54.8M 5s 18432K ........ ........ ........ ........ ........ ........ 9% 69.1M 4s 21504K ........ ........ ........ ........ ........ ........ 10% 81.3M 4s 24576K ........ ........ ........ ........ ........ ........ 11% 80.2M 4s 27648K ........ ........ ........ ........ ........ ........ 13% 62.4M 4s 30720K ........ ........ ........ ........ ........ ........ 14% 98.7M 4s 33792K ........ ........ ........ ........ ........ ........ 15% 181M 3s 36864K ........ ........ ........ ........ ........ ........ 17% 163M 3s 39936K ........ ........ ........ ........ ........ ........ 18% 205M 3s 43008K ........ ........ ........ ........ ........ ........ 19% 222M 3s 46080K ........ ........ ........ ........ ........ ........ 20% 253M 3s 49152K ........ ........ ........ ........ ........ ........ 22% 255M 2s 52224K ........ ........ ........ ........ ........ ........ 23% 288M 2s 55296K ........ ........ ........ ........ ........ ........ 24% 293M 2s 58368K ........ ........ ........ ........ ........ ........ 26% 304M 2s 61440K ........ ........ ........ ........ ........ ........ 27% 308M 2s 64512K ........ ........ ........ ........ ........ ........ 28% 320M 2s 67584K ........ ........ ........ ........ ........ ........ 30% 354M 2s 70656K ........ ........ ........ ........ ........ ........ 31% 342M 2s 73728K ........ ........ ........ ........ ........ ........ 32% 261M 2s 76800K ........ ........ ........ ........ ........ ........ 34% 275M 1s 79872K ........ ........ ........ ........ ........ ........ 35% 305M 1s 82944K ........ ........ ........ ........ ........ ........ 36% 292M 1s 86016K ........ ........ ........ ........ ........ ........ 38% 298M 1s 89088K ........ ........ ........ ........ ........ ........ 39% 347M 1s 92160K ........ ........ ........ ........ ........ ........ 40% 359M 1s 95232K ........ ........ ........ ........ ........ ........ 41% 309M 1s 98304K ........ ........ ........ ........ ........ ........ 43% 225M 1s 101376K ........ ........ ........ ........ ........ ........ 44% 339M 1s 104448K ........ ........ ........ ........ ........ ........ 45% 361M 1s 107520K ........ ........ ........ ........ ........ ........ 47% 339M 1s 110592K ........ ........ ........ ........ ........ ........ 48% 349M 1s 113664K ........ ........ ........ ........ ........ ........ 49% 346M 1s 116736K ........ ........ ........ ........ ........ ........ 51% 354M 1s 119808K ........ ........ ........ ........ ........ ........ 52% 344M 1s 122880K ........ ........ ........ ........ ........ ........ 53% 354M 1s 125952K ........ ........ ........ ........ ........ ........ 55% 258M 1s 129024K ........ ........ ........ ........ ........ ........ 56% 236M 1s 132096K ........ ........ ........ ........ ........ ........ 57% 290M 1s 135168K ........ ........ ........ ........ ........ ........ 59% 353M 1s 138240K ........ ........ ........ ........ ........ ........ 60% 222M 1s 141312K ........ ........ ........ ........ ........ ........ 61% 290M 1s 144384K ........ ........ ........ ........ ........ ........ 62% 250M 1s 147456K ........ ........ ........ ........ ........ ........ 64% 456M 1s 150528K ........ ........ ........ ........ ........ ........ 65% 376M 1s 153600K ........ ........ ........ ........ ........ ........ 66% 347M 1s 156672K ........ ........ ........ ........ ........ ........ 68% 341M 0s 159744K ........ ........ ........ ........ ........ ........ 69% 342M 0s 162816K ........ ........ ........ ........ ........ ........ 70% 334M 0s 165888K ........ ........ ........ ........ ........ ........ 72% 342M 0s 168960K ........ ........ ........ ........ ........ ........ 73% 344M 0s 172032K ........ ........ ........ ........ ........ ........ 74% 340M 0s 175104K ........ ........ ........ ........ ........ ........ 76% 333M 0s 178176K ........ ........ ........ ........ ........ ........ 77% 346M 0s 181248K ........ ........ ........ ........ ........ ........ 78% 341M 0s 184320K ........ ........ ........ ........ ........ ........ 80% 349M 0s 187392K ........ ........ ........ ........ ........ ........ 81% 322M 0s 190464K ........ ........ ........ ........ ........ ........ 82% 240M 0s 193536K ........ ........ ........ ........ ........ ........ 83% 326M 0s 196608K ........ ........ ........ ........ ........ ........ 85% 361M 0s 199680K ........ ........ ........ ........ ........ ........ 86% 345M 0s 202752K ........ ........ ........ ........ ........ ........ 87% 357M 0s 205824K ........ ........ ........ ........ ........ ........ 89% 347M 0s 208896K ........ ........ ........ ........ ........ ........ 90% 210M 0s 211968K ........ ........ ........ ........ ........ ........ 91% 143M 0s 215040K ........ ........ ........ ........ ........ ........ 93% 303M 0s 218112K ........ ........ ........ ........ ........ ........ 94% 327M 0s 221184K ........ ........ ........ ........ ........ ........ 95% 298M 0s 224256K ........ ........ ........ ........ ........ ........ 97% 292M 0s 227328K ........ ........ ........ ........ ........ ........ 98% 293M 0s 230400K ........ ........ ........ ........ ........ ........ 99% 278M 0s 233472K ........ ... 100% 315M=1.3s 2025-11-02 23:37:37 (181 MB/s) - ‘karaf-0.21.4-20251102.212815-77.zip’ saved [239810410/239810410] + echo 'Extracting the new controller...' Extracting the new controller... + unzip -q karaf-0.21.4-20251102.212815-77.zip Adding external repositories... + echo 'Adding external repositories...' + sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg + cat /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # If set to true, the following property will not allow any certificate to be used # when accessing Maven repositories through SSL # #org.ops4j.pax.url.mvn.certificateCheck= # # Path to the local Maven settings file. # The repositories defined in this file will be automatically added to the list # of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property # below is not set. # The following locations are checked for the existence of the settings.xml file # * 1. looks for the specified url # * 2. if not found looks for ${user.home}/.m2/settings.xml # * 3. if not found looks for ${maven.home}/conf/settings.xml # * 4. if not found looks for ${M2_HOME}/conf/settings.xml # #org.ops4j.pax.url.mvn.settings= # # Path to the local Maven repository which is used to avoid downloading # artifacts when they already exist locally. # The value of this property will be extracted from the settings.xml file # above, or defaulted to: # System.getProperty( "user.home" ) + "/.m2/repository" # org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository} # # Default this to false. It's just weird to use undocumented repos # org.ops4j.pax.url.mvn.useFallbackRepositories=false # # Uncomment if you don't wanna use the proxy settings # from the Maven conf/settings.xml file # # org.ops4j.pax.url.mvn.proxySupport=false # # Comma separated list of repositories scanned when resolving an artifact. # Those repositories will be checked before iterating through the # below list of repositories and even before the local repository # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snaphots # @noreleases : the repository does not contain any released artifacts # # The following property value will add the system folder as a repo. # org.ops4j.pax.url.mvn.defaultRepositories=\ file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\ file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\ file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots # Use the default local repo (e.g.~/.m2/repository) as a "remote" repo #org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false # # Comma separated list of repositories scanned when resolving an artifact. # The default list includes the following repositories: # http://repo1.maven.org/maven2@id=central # http://repository.springsource.com/maven/bundles/release@id=spring.ebr # http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external # http://zodiac.springsource.com/maven/bundles/release@id=gemini # http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases # https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases # https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases # To add repositories to the default ones, prepend '+' to the list of repositories # to add. # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snapshots # @noreleases : the repository does not contain any released artifacts # @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended # org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases ### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.Configuring the startup features... + [[ True == \T\r\u\e ]] + echo 'Configuring the startup features...' + sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.21.4-SNAPSHOT/etc/org.apache.karaf.features.cfg + FEATURE_TEST_STRING=features-test + FEATURE_TEST_VERSION=0.21.4-SNAPSHOT + KARAF_VERSION=karaf4 + [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]] + sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.21.4-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.21.4-SNAPSHOT/etc/org.apache.karaf.features.cfg + [[ ! -z '' ]] + cat /tmp/karaf-0.21.4-SNAPSHOT/etc/org.apache.karaf.features.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # Comma separated list of features repositories to register by default # featuresRepositories = mvn:org.opendaylight.integration/features-test/0.21.4-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/fe1865c8-8927-4eec-9c70-6196d712fd40.xml # # Comma separated list of features to install at startup # featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, ced3a9ed-c818-44c5-b503-263fd8c4049c # # Resource repositories (OBR) that the features resolver can use # to resolve requirements/capabilities # # The format of the resourceRepositories is # resourceRepositories=[xml:url|json:url],... # for Instance: # #resourceRepositories=xml:http://host/path/to/index.xml # or #resourceRepositories=json:http://host/path/to/index.json # # # Defines if the boot features are started in asynchronous mode (in a dedicated thread) # featuresBootAsynchronous=false # # Service requirements enforcement # # By default, the feature resolver checks the service requirements/capabilities of # bundles for new features (xml schema >= 1.3.0) in order to automatically installs # the required bundles. # The following flag can have those values: # - disable: service requirements are completely ignored # - default: service requirements are ignored for old features # - enforce: service requirements are always verified # #serviceRequirements=default # # Store cfg file for config element in feature # #configCfgStore=true # # Define if the feature service automatically refresh bundles # autoRefresh=true # # Configuration of features processing mechanism (overrides, blacklisting, modification of features) # XML file defines instructions related to features processing # versions.properties may declare properties to resolve placeholders in XML file # both files are relative to ${karaf.etc} # #featureProcessing=org.apache.karaf.features.xml #featureProcessingVersions=versions.properties + configure_karaf_log karaf4 '' + local -r karaf_version=karaf4 + local -r controllerdebugmap= + local logapi=log4j + grep log4j2 /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n log4j2.rootLogger.level = INFO #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 64MB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE Configuring the karaf log... karaf_version: karaf4, logapi: log4j2 + logapi=log4j2 + echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2' + '[' log4j2 == log4j2 ']' + sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg + orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver + orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN' controllerdebugmap: + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN' + unset IFS + echo 'controllerdebugmap: ' cat /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg + '[' -n '' ']' + echo 'cat /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg' + cat /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # Common pattern layout for appenders log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n # Root logger log4j2.rootLogger.level = INFO # uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} # Filters for logs marked by org.opendaylight.odlparent.Markers log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL # Loggers configuration # Spifly logger log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN # Security audit logger log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Appenders configuration # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} # Rolling file appender log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i # uncomment to not force a disk flush #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 1GB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 # Audit file appender log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 # OSGi appender log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * # help with identification of maven-related problems with pax-url-aether #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN + set_java_vars /usr/lib/jvm/java-21-openjdk-amd64 3072m /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv + local -r java_home=/usr/lib/jvm/java-21-openjdk-amd64 + local -r controllermem=3072m Configure java home: /usr/lib/jvm/java-21-openjdk-amd64 + local -r memconf=/tmp/karaf-0.21.4-SNAPSHOT/bin/setenv + echo Configure + echo ' java home: /usr/lib/jvm/java-21-openjdk-amd64' max memory: 3072m memconf: /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv + echo ' max memory: 3072m' + echo ' memconf: /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv' + sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64}%g' /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv + sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv cat /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv + echo 'cat /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv' + cat /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv #!/bin/sh # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # # # handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf # script: client, instance, shell, start, status, stop, karaf # # if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then # Actions go here... # fi # # general settings which should be applied for all scripts go here; please keep # in mind that it is possible that scripts might be executed more than once, e.g. # in example of the start script where the start script is executed first and the # karaf script afterwards. # # # The following section shows the possible configuration options for the default # karaf scripts # export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64} # Location of Java installation # export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration # export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options # export EXTRA_JAVA_OPTS # Additional JVM options # export KARAF_HOME # Karaf home folder # export KARAF_DATA # Karaf data folder # export KARAF_BASE # Karaf base folder # export KARAF_ETC # Karaf etc folder # export KARAF_LOG # Karaf log folder # export KARAF_SYSTEM_OPTS # First citizen Karaf options # export KARAF_OPTS # Additional available Karaf options # export KARAF_DEBUG # Enable debug mode # export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start # export KARAF_NOROOT # Prevent execution as root if set to true Set Java version + echo 'Set Java version' + sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-21-openjdk-amd64/bin/java 1 sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper sudo: a password is required + sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-21-openjdk-amd64/bin/java sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper sudo: a password is required JDK default version ... + echo 'JDK default version ...' + java -version openjdk version "21.0.8" 2025-07-15 OpenJDK Runtime Environment (build 21.0.8+9-Ubuntu-0ubuntu122.04.1) OpenJDK 64-Bit Server VM (build 21.0.8+9-Ubuntu-0ubuntu122.04.1, mixed mode, sharing) Set JAVA_HOME + echo 'Set JAVA_HOME' + export JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64 + JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64 ++ readlink -e /usr/lib/jvm/java-21-openjdk-amd64/bin/java + JAVA_RESOLVED=/usr/lib/jvm/java-21-openjdk-amd64/bin/java + echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java' Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java Listing all open ports on controller system... + echo 'Listing all open ports on controller system...' + netstat -pnatu /tmp/configuration-script.sh: line 40: netstat: command not found + '[' -f /tmp/custom_shard_config.txt ']' Custom shard config exists!!! Copying the shard config... + echo 'Custom shard config exists!!!' + echo 'Copying the shard config...' + cp /tmp/custom_shard_config.txt /tmp/karaf-0.21.4-SNAPSHOT/bin/ Configuring cluster + echo 'Configuring cluster' + /tmp/karaf-0.21.4-SNAPSHOT/bin/configure_cluster.sh 3 10.30.170.79 10.30.170.212 10.30.171.128 ################################################ ## Configure Cluster ## ################################################ NOTE: Cluster configuration files not found. Copying from /tmp/karaf-0.21.4-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/10.0.14 Configuring unique name in akka.conf Configuring hostname in akka.conf Configuring data and rpc seed nodes in akka.conf modules = [ { name = "inventory" namespace = "urn:opendaylight:inventory" shard-strategy = "module" }, { name = "topology" namespace = "urn:TBD:params:xml:ns:yang:network-topology" shard-strategy = "module" }, { name = "toaster" namespace = "http://netconfcentral.org/ns/toaster" shard-strategy = "module" }, { name = "car" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" shard-strategy = "module" }, { name = "people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" shard-strategy = "module" }, { name = "car-people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" shard-strategy = "module" } ] Configuring replication type in module-shards.conf ################################################ ## NOTE: Manually restart controller to ## ## apply configuration. ## ################################################ Dump akka.conf + echo 'Dump akka.conf' + cat /tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/akka.conf odl-cluster-data { akka { remote { artery { enabled = on transport = tcp canonical.hostname = "10.30.171.128" canonical.port = 2550 } } cluster { # Using artery. seed-nodes = ["akka://opendaylight-cluster-data@10.30.170.79:2550", "akka://opendaylight-cluster-data@10.30.170.212:2550", "akka://opendaylight-cluster-data@10.30.171.128:2550"] roles = ["member-3"] # when under load we might trip a false positive on the failure detector # failure-detector { # heartbeat-interval = 4 s # acceptable-heartbeat-pause = 16s # } } persistence { # By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by # modifying the following two properties. The directory location specified may be a relative or absolute path. # The relative path is always relative to KARAF_HOME. # snapshot-store.local.dir = "target/snapshots" # Use lz4 compression for LocalSnapshotStore snapshots snapshot-store.local.use-lz4-compression = false # Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB snapshot-store.local.lz4-blocksize = 256KB } disable-default-actor-system-quarantined-event-handling = "false" } } Dump modules.conf + echo 'Dump modules.conf' + cat /tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/modules.conf modules = [ { name = "inventory" namespace = "urn:opendaylight:inventory" shard-strategy = "module" }, { name = "topology" namespace = "urn:TBD:params:xml:ns:yang:network-topology" shard-strategy = "module" }, { name = "toaster" namespace = "http://netconfcentral.org/ns/toaster" shard-strategy = "module" }, { name = "car" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" shard-strategy = "module" }, { name = "people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" shard-strategy = "module" }, { name = "car-people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" shard-strategy = "module" } ] Dump module-shards.conf + echo 'Dump module-shards.conf' + cat /tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/module-shards.conf module-shards = [ { name = "default" shards = [ { name = "default" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "inventory" shards = [ { name="inventory" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "topology" shards = [ { name="topology" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "toaster" shards = [ { name="toaster" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "car" shards = [ { name="car" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "people" shards = [ { name="people" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "car-people" shards = [ { name="car-people" replicas = ["member-1", "member-2", "member-3"] } ] } ] Locating config plan to use... Finished running config plans Starting member-1 with IP address 10.30.170.79 Warning: Permanently added '10.30.170.79' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.170.79' (ECDSA) to the list of known hosts. Redirecting karaf console output to karaf_console.log Starting controller... start: Redirecting Karaf output to /tmp/karaf-0.21.4-SNAPSHOT/data/log/karaf_console.log Starting member-2 with IP address 10.30.170.212 Warning: Permanently added '10.30.170.212' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.170.212' (ECDSA) to the list of known hosts. Redirecting karaf console output to karaf_console.log Starting controller... start: Redirecting Karaf output to /tmp/karaf-0.21.4-SNAPSHOT/data/log/karaf_console.log Starting member-3 with IP address 10.30.171.128 Warning: Permanently added '10.30.171.128' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.171.128' (ECDSA) to the list of known hosts. Redirecting karaf console output to karaf_console.log Starting controller... start: Redirecting Karaf output to /tmp/karaf-0.21.4-SNAPSHOT/data/log/karaf_console.log [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins7225195307368434361.sh common-functions.sh is being sourced common-functions environment: MAVENCONF: /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ACTUALFEATURES: FEATURESCONF: /tmp/karaf-0.21.4-SNAPSHOT/etc/org.apache.karaf.features.cfg CUSTOMPROP: /tmp/karaf-0.21.4-SNAPSHOT/etc/custom.properties LOGCONF: /tmp/karaf-0.21.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg MEMCONF: /tmp/karaf-0.21.4-SNAPSHOT/bin/setenv CONTROLLERMEM: 2048m AKKACONF: /tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/akka.conf MODULESCONF: /tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/modules.conf MODULESHARDSCONF: /tmp/karaf-0.21.4-SNAPSHOT/configuration/initial/module-shards.conf SUITES: + echo '#################################################' ################################################# + echo '## Verify Cluster is UP ##' ## Verify Cluster is UP ## + echo '#################################################' ################################################# + create_post_startup_script + cat + copy_and_run_post_startup_script + seed_index=1 ++ seq 1 3 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_1_IP + echo 'Execute the post startup script on controller 10.30.170.79' Execute the post startup script on controller 10.30.170.79 + scp /w/workspace/controller-csit-3node-clustering-tell-all-scandium/post-startup-script.sh 10.30.170.79:/tmp/ Warning: Permanently added '10.30.170.79' (ECDSA) to the list of known hosts. + ssh 10.30.170.79 'bash /tmp/post-startup-script.sh 1' Warning: Permanently added '10.30.170.79' (ECDSA) to the list of known hosts. /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found Waiting up to 3 minutes for controller to come up, checking every 5 seconds... 2025-11-02T23:38:23,307 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 282 - org.opendaylight.infrautils.ready-api - 7.1.7 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Controller is UP 2025-11-02T23:38:23,307 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 282 - org.opendaylight.infrautils.ready-api - 7.1.7 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Listing all open ports on controller system... /tmp/post-startup-script.sh: line 51: netstat: command not found looking for "BindException: Address already in use" in log file looking for "server is unhealthy" in log file + '[' 1 == 0 ']' + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_2_IP + echo 'Execute the post startup script on controller 10.30.170.212' Execute the post startup script on controller 10.30.170.212 + scp /w/workspace/controller-csit-3node-clustering-tell-all-scandium/post-startup-script.sh 10.30.170.212:/tmp/ Warning: Permanently added '10.30.170.212' (ECDSA) to the list of known hosts. + ssh 10.30.170.212 'bash /tmp/post-startup-script.sh 2' Warning: Permanently added '10.30.170.212' (ECDSA) to the list of known hosts. /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found Waiting up to 3 minutes for controller to come up, checking every 5 seconds... 2025-11-02T23:38:24,070 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 282 - org.opendaylight.infrautils.ready-api - 7.1.7 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Controller is UP 2025-11-02T23:38:24,070 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 282 - org.opendaylight.infrautils.ready-api - 7.1.7 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Listing all open ports on controller system... /tmp/post-startup-script.sh: line 51: netstat: command not found looking for "BindException: Address already in use" in log file looking for "server is unhealthy" in log file + '[' 2 == 0 ']' + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_3_IP + echo 'Execute the post startup script on controller 10.30.171.128' Execute the post startup script on controller 10.30.171.128 + scp /w/workspace/controller-csit-3node-clustering-tell-all-scandium/post-startup-script.sh 10.30.171.128:/tmp/ Warning: Permanently added '10.30.171.128' (ECDSA) to the list of known hosts. + ssh 10.30.171.128 'bash /tmp/post-startup-script.sh 3' Warning: Permanently added '10.30.171.128' (ECDSA) to the list of known hosts. /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found Waiting up to 3 minutes for controller to come up, checking every 5 seconds... 2025-11-02T23:38:23,332 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 282 - org.opendaylight.infrautils.ready-api - 7.1.7 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Controller is UP 2025-11-02T23:38:23,332 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 282 - org.opendaylight.infrautils.ready-api - 7.1.7 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Listing all open ports on controller system... /tmp/post-startup-script.sh: line 51: netstat: command not found looking for "BindException: Address already in use" in log file looking for "server is unhealthy" in log file + '[' 0 == 0 ']' + seed_index=1 + dump_controller_threads ++ seq 1 3 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_1_IP + echo 'Let'\''s take the karaf thread dump' Let's take the karaf thread dump + ssh 10.30.170.79 'sudo ps aux' Warning: Permanently added '10.30.170.79' (ECDSA) to the list of known hosts. ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-scandium/ps_before.log ++ grep -v grep ++ tr -s ' ' ++ cut -f2 '-d ' + pid=2102 + echo 'karaf main: org.apache.karaf.main.Main, pid:2102' karaf main: org.apache.karaf.main.Main, pid:2102 + ssh 10.30.170.79 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 2102' Warning: Permanently added '10.30.170.79' (ECDSA) to the list of known hosts. + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_2_IP + echo 'Let'\''s take the karaf thread dump' Let's take the karaf thread dump + ssh 10.30.170.212 'sudo ps aux' Warning: Permanently added '10.30.170.212' (ECDSA) to the list of known hosts. ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-scandium/ps_before.log ++ grep -v grep ++ tr -s ' ' ++ cut -f2 '-d ' + pid=2085 + echo 'karaf main: org.apache.karaf.main.Main, pid:2085' karaf main: org.apache.karaf.main.Main, pid:2085 + ssh 10.30.170.212 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 2085' Warning: Permanently added '10.30.170.212' (ECDSA) to the list of known hosts. + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_3_IP + echo 'Let'\''s take the karaf thread dump' Let's take the karaf thread dump + ssh 10.30.171.128 'sudo ps aux' Warning: Permanently added '10.30.171.128' (ECDSA) to the list of known hosts. ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-scandium/ps_before.log ++ cut -f2 '-d ' ++ grep -v grep ++ tr -s ' ' + pid=2096 + echo 'karaf main: org.apache.karaf.main.Main, pid:2096' karaf main: org.apache.karaf.main.Main, pid:2096 + ssh 10.30.171.128 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 2096' Warning: Permanently added '10.30.171.128' (ECDSA) to the list of known hosts. + '[' 0 -gt 0 ']' + echo 'Generating controller variables...' Generating controller variables... ++ seq 1 3 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_1_IP + odl_variables=' -v ODL_SYSTEM_1_IP:10.30.170.79' + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_2_IP + odl_variables=' -v ODL_SYSTEM_1_IP:10.30.170.79 -v ODL_SYSTEM_2_IP:10.30.170.212' + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_3_IP + odl_variables=' -v ODL_SYSTEM_1_IP:10.30.170.79 -v ODL_SYSTEM_2_IP:10.30.170.212 -v ODL_SYSTEM_3_IP:10.30.171.128' + echo 'Generating mininet variables...' Generating mininet variables... ++ seq 1 0 + get_test_suites SUITES + local __suite_list=SUITES + echo 'Locating test plan to use...' Locating test plan to use... + testplan_filepath=/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/testplans/controller-clustering-tell-scandium.txt + '[' '!' -f /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/testplans/controller-clustering-tell-scandium.txt ']' + testplan_filepath=/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/testplans/controller-clustering-tell.txt + '[' disabled '!=' disabled ']' + echo 'Changing the testplan path...' Changing the testplan path... + sed s:integration:/w/workspace/controller-csit-3node-clustering-tell-all-scandium: /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/testplans/controller-clustering-tell.txt + cat testplan.txt # Place the suites in run order: # disabling all "prefix based" suites. This functionality was newly # introduced with these tests in 2017. The assumption is that # development stopped in that area, but may continue at a later # time. Still, the tests are failing and no resources to solve the # failures at this time. If/When this changes, we can uncomment # those suites. Note that every suite is commented out with it's # accompanying "restart_with_tell_based_true" setup suite. # /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot # /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/ddb-sanity-prefix-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot # /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot # /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown_prefbasedshard.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot # /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot # /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement_prefbasedshard.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot # /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot # /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/leader_isolation_prefbasedshard.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/client_isolation.robot # /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot # /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/client_isolation_prefbasedshard.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/listener_stability.robot # /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot # /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/listener_stability_prefbasedshard.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot + '[' -z '' ']' ++ grep -E -v '(^[[:space:]]*#|^[[:space:]]*$)' testplan.txt ++ tr '\012' ' ' + suite_list='/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot ' + eval 'SUITES='\''/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot '\''' ++ SUITES='/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot ' + echo 'Starting Robot test suites /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot ...' Starting Robot test suites /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot ... + robot -N controller-clustering-tell.txt --removekeywords wuks -e exclude -e skip_if_scandium -v BUNDLEFOLDER:karaf-0.21.4-SNAPSHOT -v BUNDLE_URL:https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.4-SNAPSHOT/karaf-0.21.4-20251102.212815-77.zip -v CONTROLLER:10.30.170.79 -v CONTROLLER1:10.30.170.212 -v CONTROLLER2:10.30.171.128 -v CONTROLLER_USER:jenkins -v JAVA_HOME:/usr/lib/jvm/java-21-openjdk-amd64 -v JDKVERSION:openjdk21 -v JENKINS_WORKSPACE:/w/workspace/controller-csit-3node-clustering-tell-all-scandium -v MININET: -v MININET1: -v MININET2: -v MININET_USER:jenkins -v NEXUSURL_PREFIX:https://nexus.opendaylight.org -v NUM_ODL_SYSTEM:3 -v NUM_TOOLS_SYSTEM:0 -v ODL_STREAM:scandium -v ODL_SYSTEM_IP:10.30.170.79 -v ODL_SYSTEM_1_IP:10.30.170.79 -v ODL_SYSTEM_2_IP:10.30.170.212 -v ODL_SYSTEM_3_IP:10.30.171.128 -v ODL_SYSTEM_USER:jenkins -v TOOLS_SYSTEM_IP: -v TOOLS_SYSTEM_USER:jenkins -v USER_HOME:/home/jenkins -v IS_KARAF_APPL:True -v WORKSPACE:/tmp /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot ============================================================================== controller-clustering-tell.txt ============================================================================== controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-tell.txt.Ddb-Sanity-Module-Based :: DOMDataBroker tes... ============================================================================== Get_Shard_Role :: Get shard role. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_ddb_sanity_module_based_get_shard_role" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_get_shard_role&order=bug_status" HTTPError: 404 Client Error: Not Found for url: http://10.30.170.79:8181/restconf/operations/cluster-admin:get-shard-role ------------------------------------------------------------------------------ Subscribe_Listener_To_Leader :: Subscribe listener to leader. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_ddb_sanity_module_based_subscribe_listener_to_leader" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_subscribe_listener_to_leader&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Subscribe_Listener_To_Follower :: Subscribe listener to follower. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_ddb_sanity_module_based_subscribe_listener_to_follower" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_subscribe_listener_to_follower&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Make_Leader_Local :: Make the loeader local and verify. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_ddb_sanity_module_based_make_leader_local" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_make_leader_local&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Remove_Leader_Shard_Replica_And_Add_It_Back :: Remove and add shar... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_ddb_sanity_module_based_remove_leader_shard_replica_and_add_it_back" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_remove_leader_shard_replica_and_add_it_back&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Remove_Follower_Shard_Replica_And_Add_It_Back :: Remove and add sh... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_ddb_sanity_module_based_remove_follower_shard_replica_and_add_it_back" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_remove_follower_shard_replica_and_add_it_back&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Write_Transactions_One_Node_Leader :: Write transactions. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_one_node_leader" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_one_node_leader&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Write_Transactions_One_Node_Follower :: Write transactions. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_one_node_follower" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_one_node_follower&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Write_Transactions_All_Nodes :: Write transactions. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_all_nodes" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_all_nodes&order=bug_status" Resolving variable '${response.text}' failed: AttributeError: 'ReadTimeout' object has no attribute 'text' ------------------------------------------------------------------------------ controller-clustering-tell.txt.Ddb-Sanity-Module-Based :: DOMDataB... | FAIL | 9 tests, 0 passed, 9 failed ============================================================================== controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-tell.txt.Clean Leader Shutdown :: DOMDataBroker testi... ============================================================================== Local_Leader_Shutdown :: Shutdown the leader on the same node as t... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_clean_leader_shutdown_local_leader_shutdown" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_clean_leader_shutdown_local_leader_shutdown&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Restart :: Restart odl | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_clean_leader_shutdown_restart" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_clean_leader_shutdown_restart&order=bug_status" Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Remote_Leader_Shutdown :: Shutdown the leader on different node as... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_clean_leader_shutdown_remote_leader_shutdown" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_clean_leader_shutdown_remote_leader_shutdown&order=bug_status" ConnectionError: HTTPConnectionPool(host='10.30.170.79', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Clean Leader Shutdown :: DOMDataBro... | FAIL | 3 tests, 0 passed, 3 failed ============================================================================== controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-tell.txt.Explicit Leader Movement :: DOMDataBroker te... ============================================================================== Local_To_Remote_Movement :: Leader moves from local to remote node... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_explicit_leader_movement_local_to_remote_movement" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_local_to_remote_movement&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Restart1 :: Restart odl | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_explicit_leader_movement_restart1" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_restart1&order=bug_status" Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Remote_To_Remote_Movement :: Leader moves from one remote to other... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_explicit_leader_movement_remote_to_remote_movement" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_remote_to_remote_movement&order=bug_status" ConnectionError: HTTPConnectionPool(host='10.30.170.79', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) ------------------------------------------------------------------------------ Restart2 :: Restart odl | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_explicit_leader_movement_restart2" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_restart2&order=bug_status" Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Remote_To_Local_Movement :: Leader moves from remote to local node... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_explicit_leader_movement_remote_to_local_movement" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_remote_to_local_movement&order=bug_status" ConnectionError: HTTPConnectionPool(host='10.30.170.79', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Explicit Leader Movement :: DOMData... | FAIL | 5 tests, 0 passed, 5 failed ============================================================================== controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-tell.txt.Leader Isolation :: DOMDataBroker testing: L... ============================================================================== Healing_Within_Request_Timeout :: The isolated node (leader) is re... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_leader_isolation_healing_within_request_timeout" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_leader_isolation_healing_within_request_timeout&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Restart :: Restart odl | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_leader_isolation_restart" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_leader_isolation_restart&order=bug_status" Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Healing_After_Request_Timeout :: The isolated node (leader) is rej... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_leader_isolation_healing_after_request_timeout" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_leader_isolation_healing_after_request_timeout&order=bug_status" ConnectionError: HTTPConnectionPool(host='10.30.170.79', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Leader Isolation :: DOMDataBroker t... | FAIL | 3 tests, 0 passed, 3 failed ============================================================================== controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-tell.txt.Client Isolation :: DOMDataBroker testing: C... ============================================================================== Producer_On_Shard_Leader_Node_ChainedTx :: Client isolation with p... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_client_isolation_producer_on_shard_leader_node_chainedtx" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_producer_on_shard_leader_node_chainedtx&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=125.0) Also keyword teardown failed: Several failures occurred: 1) Variable '${client_node_dst}' not found. 2) Variable '${client_node_dst}' not found. 3) Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 1 minute 10 seconds. The last error was: Several failures occurred: 1) ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=125.0) 2) Resolving variable '${response.text}' failed: AttributeError: 'NoneType' object has no attribute 'text' 3) Resolving variable '${response.status_code}' failed: AttributeError: 'No... [ Message content over the limit has been removed. ] 65) Resolving variable '${response.text}' failed: AttributeError: 'NoneType' object has no attribute 'text' 66) Evaluating expression "json.loads('''None''')" failed: JSONDecodeError: Expecting value: line 1 column 1 (char 0) 67) TypeError: Expected argument 1 to be a dictionary, got None instead. 68) TypeError: Expected argument 1 to be a dictionary, got None instead. 69) Unrecognized Raft state: None 70) No leader found. 71) Too many Leaders. 72) IndexError: Given index 0 is out of the range 0--1. 4) KeyError: 'threads' ------------------------------------------------------------------------------ Restart1 :: Restart odl | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_client_isolation_restart1" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_restart1&order=bug_status" Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Producer_On_Shard_Leader_Node_SimpleTx :: Client isolation with pr... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_client_isolation_producer_on_shard_leader_node_simpletx" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_producer_on_shard_leader_node_simpletx&order=bug_status" ConnectionError: HTTPConnectionPool(host='10.30.170.79', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) Also keyword teardown failed: Several failures occurred: 1) Variable '${client_node_dst}' not found. 2) Variable '${client_node_dst}' not found. 3) Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 1 minute 10 seconds. The last error was: Several failures occurred: 1) ConnectionError: HTTPConnectionPool(host='10.30.170.79', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) Also keyword teardown failed: Several failures occurred: 1) Variable '${client_node_dst}' not found. 2) Variable '${client_node_dst}' not found. 3) Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 1 minute 10 seconds. The last error was: Several failures occurred: 1) ConnectionError: HTTPConnectionPool(host='10.30.170.79', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) Also keyword teardown failed: Several failures occurred: 1) Variable '${client_node_dst}' not found. 2) Variable '${client_node_dst}' not found. 3) Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 1 minute 10 seconds. The last error was: Several failures occurred: 1) ConnectionError: HTTPConnectionPool(host='10.30.170.79', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) ------------------------------------------------------------------------------ Restart_2 :: Restart odl. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_listener_stability_restart_2" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_listener_stability_restart_2&order=bug_status" Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Move_Leader_From_Listener_Remote_To_Local :: Listener runs on foll... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_listener_stability_move_leader_from_listener_remote_to_local" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_listener_stability_move_leader_from_listener_remote_to_local&order=bug_status" ConnectionError: HTTPConnectionPool(host='10.30.170.79', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Listener Stability :: DOMDataBroker... | FAIL | 5 tests, 0 passed, 5 failed ============================================================================== controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-tell.txt.Master Stability :: Cluster Singleton testin... ============================================================================== Register_Singleton_Constant_On_Each_Node_And_Verify :: Register a ... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_master_stability_register_singleton_constant_on_each_node_and_verify" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_register_singleton_constant_on_each_node_and_verify&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Unregister_Singleton_Constant_On_Non_Master_Node :: Unregister the... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_master_stability_unregister_singleton_constant_on_non_master_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_unregister_singleton_constant_on_non_master_node&order=bug_status" Variable '@{cs_candidates}' not found. Did you mean: @{cs_exp_candidates} ------------------------------------------------------------------------------ Monitor_Stability_While_Unregistered :: Verify that the owner rema... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_master_stability_monitor_stability_while_unregistered" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_monitor_stability_while_unregistered&order=bug_status" Variable '${cs_owner}' not found. ------------------------------------------------------------------------------ Reregister_Singleton_Constant :: Re-register the unregistered cand... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_master_stability_reregister_singleton_constant" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_reregister_singleton_constant&order=bug_status" Variable '${unregistered_node}' not found. ------------------------------------------------------------------------------ Verify_Stability_After_Reregistration :: Verify that the owner rem... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_master_stability_verify_stability_after_reregistration" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_verify_stability_after_reregistration&order=bug_status" Variable '${cs_owner}' not found. ------------------------------------------------------------------------------ Unregister_Singleton_Constant_On_Each_Node :: Unregister the appli... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_master_stability_unregister_singleton_constant_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_unregister_singleton_constant_on_each_node&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Master Stability :: Cluster Singlet... | FAIL | 6 tests, 0 passed, 6 failed ============================================================================== controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-tell.txt.Partition And Heal :: Cluster Singleton test... ============================================================================== Register_Singleton_Constant_On_Each_Node :: Register a candidate a... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_partition_and_heal_register_singleton_constant_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_register_singleton_constant_on_each_node&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Verify_Singleton_Constant_On_Each_Node :: Store the owner and cand... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_partition_and_heal_verify_singleton_constant_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_verify_singleton_constant_on_each_node&order=bug_status" Could not parse owner and candidates for device get-singleton-constant-service'] ------------------------------------------------------------------------------ Isolate_Owner_Node :: Isolate the cluster node which is the owner.... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_partition_and_heal_isolate_owner_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_isolate_owner_node&order=bug_status" Variable '${cs_owner}' not found. ------------------------------------------------------------------------------ Monitor_Stability_While_Isolated :: Monitor the stability of the s... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_partition_and_heal_monitor_stability_while_isolated" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_monitor_stability_while_isolated&order=bug_status" Invalid IF condition: Evaluating expression '"${index}" == "${cs_isolated_index}"' failed: Variable '${cs_isolated_index}' not found. ------------------------------------------------------------------------------ Rejoin_Isolated_node :: Rejoin isolated node. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_partition_and_heal_rejoin_isolated_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_rejoin_isolated_node&order=bug_status" Variable '${cs_isolated_index}' not found. ------------------------------------------------------------------------------ Unregister_Singleton_Constant_On_Each_Node :: Unregister the appli... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_partition_and_heal_unregister_singleton_constant_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_unregister_singleton_constant_on_each_node&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Partition And Heal :: Cluster Singl... | FAIL | 6 tests, 0 passed, 6 failed ============================================================================== controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-tell.txt.Chasing The Leader :: Cluster Singleton test... ============================================================================== Register_Candidates :: Register a candidate application on each no... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_chasing_the_leader_register_candidates" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_chasing_the_leader_register_candidates&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Do_Nothing :: Do nothing for the time of the test duration, becaus... | PASS | ------------------------------------------------------------------------------ Unregister_Candidates_And_Validate_Criteria :: Unregister the test... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_chasing_the_leader_unregister_candidates_and_validate_criteria" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_chasing_the_leader_unregister_candidates_and_validate_criteria&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Chasing The Leader :: Cluster Singl... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-tell.txt.Carpeople Crud :: Suite for performing basic... ============================================================================== Add_Cars_To_Leader :: Add 30 cars to car Leader by one big PUT. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Added_Cars_On_Leader :: GET response from Leader should match ... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Added_Cars_On_Followers :: The same check on other members. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Add_People_To_First_Follower :: Add 30 people to people first Foll... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Added_People_On_Leader :: GET response from Leader should matc... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Added_People_On_Followers :: The same check on other members. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Buy_Cars_On_Leader :: Buy some cars on car-people Leader, loop of ... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Buy_Cars_On_Followers :: On each Follower buy corresponding ID seg... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Added_CarPeople_On_Leader :: GET car-person mappings from Lead... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Added_CarPeople_On_Followers :: The same check on other members. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Delete_All_CarPeople_On_Leader :: DELETE car-people container. No ... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Delete_All_People_On_Leader :: DELETE people container. No verific... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Delete_All_Cars_On_Leader :: DELETE cars container. No verificatio... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Carpeople Crud :: Suite for perform... | FAIL | Suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) 13 tests, 0 passed, 13 failed ============================================================================== controller-clustering-tell.txt.Car Failover Crud :: Suite mixing basic oper... ============================================================================== Add_Original_Cars_On_Old_Leader_And_Verify :: Add initial cars on ... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Stop_Original_Car_Leader :: Stop the car Leader to cause a new lea... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Wait_For_New_Leader :: Wait until new car Leader is elected. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Original_Cars_On_New_Leader :: GET cars from new Leader, shoul... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Original_Cars_On_New_Followers :: The same check on other exis... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Delete_Original_Cars_On_New_Leader :: Delete cars on the new Leader. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Add_Leader_Cars_On_New_Leader :: Add cars on the new Leader. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Leader_Cars_On_New_Leader :: GET cars from new Leader, should ... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Leader_Cars_On_New_Followers :: The same check on other existi... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Delete_Leader_Cars_On_New_First_Follower :: Delete cars in new fir... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Add_Follower_Cars_On_New_First_Follower :: Add cars on the new fir... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Folower_Cars_On_New_Leader :: Get cars from the new Leader, sh... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Follower_Cars_On_New_Followers :: The same check on other exis... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Start_Old_Car_Leader :: Start the stopped member without deleting ... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Folower_Cars_On_Old_Leader :: GET cars from the restarted memb... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Delete_Follower_Cars_On_New_Leader :: Delete cars on the last Leader. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Car Failover Crud :: Suite mixing b... | FAIL | Suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) 16 tests, 0 passed, 16 failed ============================================================================== controller-clustering-tell.txt.Car Persistence Recovery :: This test restar... ============================================================================== Add_Cars_On_Leader_And_Verify :: Single big PUT to datastore to ad... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Stop_All_Members :: Stop all controllers. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Start_All_Members :: Start all controllers (should restore the per... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Memorize_Leader_And_Followers :: Locate current Leader of car Shard. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Cars_On_Leader :: GET cars from Leader, should match the PUT d... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Cars_On_Followers :: The same check on other members. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Delete_Cars_On_Leader :: Delete cars on the new Leader. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Car Persistence Recovery :: This te... | FAIL | Suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) 7 tests, 0 passed, 7 failed ============================================================================== controller-clustering-tell.txt.Buycar Failover :: This test focuses on test... ============================================================================== Add_Cars_To_Leader_And_Verify :: Add all needed cars to car Leader... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Add_People_To_First_Follower_And_Verify :: Add all needed people t... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Buy_Cars_On_Leader_And_Verify :: Buy some cars on the leader member. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Buy_Cars_On_Follower_And_Verify :: Buy some cars on the first foll... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Reboot_People_Leader :: Previous people Leader is rebooted. We sho... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Buy_Cars_On_Leader_After_Reboot_And_Verify :: Buy some cars on the... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Buy_Cars_On_Follower_After_Reboot_And_Verify :: Buy some cars on t... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Delete_All_CarPeople :: DELETE car-people container. No verificati... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Delete_All_People :: DELETE people container. No verification beyo... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Delete_All_Cars :: DELETE cars container. No verification beyond h... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Buycar Failover :: This test focuse... | FAIL | Suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) 10 tests, 0 passed, 10 failed ============================================================================== controller-clustering-tell.txt.Entity Isolate :: Suite for performing membe... ============================================================================== Check All Shards Before Isolate :: Check all shards in controller. | FAIL | Parent suite setup failed: Evaluating expression 'json.loads(\'\'\'{\n "error": "javax.management.InstanceNotFoundException : org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "error_type": "javax.management.InstanceNotFoundException",\n "request": {\n "mbean": "org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "type": "read"\n },\n "stacktrace": "javax.management.InstanceNotFoundException: org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1073)\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1343)\\n\\tat java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:921)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:46)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:41)\\n\\tat org.jolokia.backend.executor.AbstractMBeanServerExecutor.call(AbstractMBeanServerExecutor.java:90)\\n\\tat org.jolokia.handler.ReadHandler.getMBeanInfo(ReadHandler.java:233)\\n\\tat org.jolokia.handler.ReadHandler.getAllAttributesNames(ReadHandler.java:245)\\n\\tat org.jolokia.handler.ReadHandler.resolveAttributes(ReadHandler.java:221)\\n\\tat org.jolokia.handler.ReadHandler.f... [ Message content over the limit has been removed. ] ...lipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\\n\\tat org.eclipse.jetty.server.Server.handle(Server.java:516)\\n\\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)\\n\\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)\\n\\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)\\n\\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\\n\\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\\n\\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\\n\\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)\\n\\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\\n\\tat java.base/java.lang.Thread.run(Thread.java:1583)\\n",\n "status": 404\n}\n\'\'\')' failed: JSONDecodeError: Invalid control character at: line 8 column 190 (char 619) ------------------------------------------------------------------------------ Isolate Entity Leader :: Isolate the entity-ownership Leader to ca... | FAIL | Parent suite setup failed: Evaluating expression 'json.loads(\'\'\'{\n "error": "javax.management.InstanceNotFoundException : org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "error_type": "javax.management.InstanceNotFoundException",\n "request": {\n "mbean": "org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "type": "read"\n },\n "stacktrace": "javax.management.InstanceNotFoundException: org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1073)\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1343)\\n\\tat java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:921)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:46)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:41)\\n\\tat org.jolokia.backend.executor.AbstractMBeanServerExecutor.call(AbstractMBeanServerExecutor.java:90)\\n\\tat org.jolokia.handler.ReadHandler.getMBeanInfo(ReadHandler.java:233)\\n\\tat org.jolokia.handler.ReadHandler.getAllAttributesNames(ReadHandler.java:245)\\n\\tat org.jolokia.handler.ReadHandler.resolveAttributes(ReadHandler.java:221)\\n\\tat org.jolokia.handler.ReadHandler.f... [ Message content over the limit has been removed. ] ...lipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\\n\\tat org.eclipse.jetty.server.Server.handle(Server.java:516)\\n\\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)\\n\\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)\\n\\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)\\n\\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\\n\\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\\n\\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\\n\\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)\\n\\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\\n\\tat java.base/java.lang.Thread.run(Thread.java:1583)\\n",\n "status": 404\n}\n\'\'\')' failed: JSONDecodeError: Invalid control character at: line 8 column 190 (char 619) ------------------------------------------------------------------------------ Check All Shards After Isolate :: Check all shards in controller. | FAIL | Parent suite setup failed: Evaluating expression 'json.loads(\'\'\'{\n "error": "javax.management.InstanceNotFoundException : org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "error_type": "javax.management.InstanceNotFoundException",\n "request": {\n "mbean": "org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "type": "read"\n },\n "stacktrace": "javax.management.InstanceNotFoundException: org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1073)\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1343)\\n\\tat java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:921)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:46)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:41)\\n\\tat org.jolokia.backend.executor.AbstractMBeanServerExecutor.call(AbstractMBeanServerExecutor.java:90)\\n\\tat org.jolokia.handler.ReadHandler.getMBeanInfo(ReadHandler.java:233)\\n\\tat org.jolokia.handler.ReadHandler.getAllAttributesNames(ReadHandler.java:245)\\n\\tat org.jolokia.handler.ReadHandler.resolveAttributes(ReadHandler.java:221)\\n\\tat org.jolokia.handler.ReadHandler.f... [ Message content over the limit has been removed. ] ...lipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\\n\\tat org.eclipse.jetty.server.Server.handle(Server.java:516)\\n\\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)\\n\\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)\\n\\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)\\n\\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\\n\\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\\n\\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\\n\\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)\\n\\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\\n\\tat java.base/java.lang.Thread.run(Thread.java:1583)\\n",\n "status": 404\n}\n\'\'\')' failed: JSONDecodeError: Invalid control character at: line 8 column 190 (char 619) ------------------------------------------------------------------------------ Rejoin Entity Leader :: Rejoin the entity-ownership Leader. | FAIL | Parent suite setup failed: Evaluating expression 'json.loads(\'\'\'{\n "error": "javax.management.InstanceNotFoundException : org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "error_type": "javax.management.InstanceNotFoundException",\n "request": {\n "mbean": "org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "type": "read"\n },\n "stacktrace": "javax.management.InstanceNotFoundException: org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1073)\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1343)\\n\\tat java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:921)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:46)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:41)\\n\\tat org.jolokia.backend.executor.AbstractMBeanServerExecutor.call(AbstractMBeanServerExecutor.java:90)\\n\\tat org.jolokia.handler.ReadHandler.getMBeanInfo(ReadHandler.java:233)\\n\\tat org.jolokia.handler.ReadHandler.getAllAttributesNames(ReadHandler.java:245)\\n\\tat org.jolokia.handler.ReadHandler.resolveAttributes(ReadHandler.java:221)\\n\\tat org.jolokia.handler.ReadHandler.f... [ Message content over the limit has been removed. ] ...lipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\\n\\tat org.eclipse.jetty.server.Server.handle(Server.java:516)\\n\\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)\\n\\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)\\n\\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)\\n\\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\\n\\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\\n\\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\\n\\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)\\n\\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\\n\\tat java.base/java.lang.Thread.run(Thread.java:1583)\\n",\n "status": 404\n}\n\'\'\')' failed: JSONDecodeError: Invalid control character at: line 8 column 190 (char 619) ------------------------------------------------------------------------------ Check All Shards After Rejoin :: Check all shards in controller. | FAIL | Parent suite setup failed: Evaluating expression 'json.loads(\'\'\'{\n "error": "javax.management.InstanceNotFoundException : org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "error_type": "javax.management.InstanceNotFoundException",\n "request": {\n "mbean": "org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "type": "read"\n },\n "stacktrace": "javax.management.InstanceNotFoundException: org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1073)\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1343)\\n\\tat java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:921)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:46)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:41)\\n\\tat org.jolokia.backend.executor.AbstractMBeanServerExecutor.call(AbstractMBeanServerExecutor.java:90)\\n\\tat org.jolokia.handler.ReadHandler.getMBeanInfo(ReadHandler.java:233)\\n\\tat org.jolokia.handler.ReadHandler.getAllAttributesNames(ReadHandler.java:245)\\n\\tat org.jolokia.handler.ReadHandler.resolveAttributes(ReadHandler.java:221)\\n\\tat org.jolokia.handler.ReadHandler.f... [ Message content over the limit has been removed. ] ...lipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\\n\\tat org.eclipse.jetty.server.Server.handle(Server.java:516)\\n\\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)\\n\\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)\\n\\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)\\n\\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\\n\\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\\n\\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\\n\\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)\\n\\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\\n\\tat java.base/java.lang.Thread.run(Thread.java:1583)\\n",\n "status": 404\n}\n\'\'\')' failed: JSONDecodeError: Invalid control character at: line 8 column 190 (char 619) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Entity Isolate :: Suite for perform... | FAIL | Suite setup failed: Evaluating expression 'json.loads(\'\'\'{\n "error": "javax.management.InstanceNotFoundException : org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "error_type": "javax.management.InstanceNotFoundException",\n "request": {\n "mbean": "org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "type": "read"\n },\n "stacktrace": "javax.management.InstanceNotFoundException: org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1073)\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1343)\\n\\tat java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:921)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:46)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:41)\\n\\tat org.jolokia.backend.executor.AbstractMBeanServerExecutor.call(AbstractMBeanServerExecutor.java:90)\\n\\tat org.jolokia.handler.ReadHandler.getMBeanInfo(ReadHandler.java:233)\\n\\tat org.jolokia.handler.ReadHandler.getAllAttributesNames(ReadHandler.java:245)\\n\\tat org.jolokia.handler.ReadHandler.resolveAttributes(ReadHandler.java:221)\\n\\tat org.jolokia.handler.ReadHandler.f... [ Message content over the limit has been removed. ] ...lipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\\n\\tat org.eclipse.jetty.server.Server.handle(Server.java:516)\\n\\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)\\n\\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)\\n\\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)\\n\\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\\n\\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\\n\\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\\n\\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)\\n\\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\\n\\tat java.base/java.lang.Thread.run(Thread.java:1583)\\n",\n "status": 404\n}\n\'\'\')' failed: JSONDecodeError: Invalid control character at: line 8 column 190 (char 619) 5 tests, 0 passed, 5 failed ============================================================================== controller-clustering-tell.txt.Buycar Failover Isolation :: This test focus... ============================================================================== Add_Cars_To_Leader_And_Verify :: Add all needed cars to car Leader... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Add_People_To_First_Follower_And_Verify :: Add all needed people t... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Buy_Cars_On_Leader_And_Verify :: Buy some cars on the leader member. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Buy_Cars_On_Follower_And_Verify :: Buy some cars on the first foll... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Isolate_and_Rejoin_People_Leader :: Previous people Leader is isol... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Buy_Cars_On_Leader_After_Rejoin_And_Verify :: Buy some cars on the... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Buy_Cars_On_Follower_After_Rejoin_And_Verify :: Buy some cars on t... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Delete_All_CarPeople :: DELETE car-people container. No verificati... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Delete_All_People :: DELETE people container. No verification beyo... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Delete_All_Cars :: DELETE cars container. No verification beyond h... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Buycar Failover Isolation :: This t... | FAIL | Suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) 10 tests, 0 passed, 10 failed ============================================================================== controller-clustering-tell.txt.Car Failover Crud Isolation :: Suite mixing ... ============================================================================== Add_Original_Cars_On_Old_Leader_And_Verify :: Add initial cars on ... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Isolate_Original_Car_Leader :: Isolate the car Leader to cause a n... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Wait_For_New_Leader :: Wait until new car Leader is elected. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Original_Cars_On_New_Leader :: GET cars from new Leader, shoul... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Original_Cars_On_New_Followers :: The same check on other exis... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Delete_Original_Cars_On_New_Leader :: Delete cars on the new Leader. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Add_Leader_Cars_On_New_Leader :: Add cars on the new Leader. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Leader_Cars_On_New_Leader :: GET cars from new Leader, should ... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Leader_Cars_On_New_Followers :: The same check on other existi... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Delete_Leader_Cars_On_New_First_Follower :: Delete cars in new fir... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Add_Follower_Cars_On_New_First_Follower :: Add cars on the new fir... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Folower_Cars_On_New_Leader :: Get cars from the new Leader, sh... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Follower_Cars_On_New_Followers :: The same check on other exis... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Rejoin_Old_Car_Leader :: Rejoin the isolated member without deleti... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Folower_Cars_On_Old_Leader :: GET cars from the restarted memb... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Delete_Follower_Cars_On_New_Leader :: Delete cars on the last Leader. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Car Failover Crud Isolation :: Suit... | FAIL | Suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) 16 tests, 0 passed, 16 failed ============================================================================== controller-clustering-tell.txt.Car Outage Corners :: Cluster suite for test... ============================================================================== Stop_Majority_Of_The_Followers :: Stop half plus one car Follower ... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Attempt_To_Add_Cars_To_Leader :: Adding cars should fail, as major... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Start_Tipping_Follower :: Start one Follower member without persis... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Add_Cars_On_Tipping_Follower :: Add cars on the tipping Follower. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Cars_On_Existing_Members :: On each up member: GET cars, shoul... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Start_Other_Followers :: Start other followers without persisted d... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Cars_On_New_Follower_Leader :: GET cars from a new follower to... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Delete_Cars_On_Leader :: Delete cars on Leader. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Car Outage Corners :: Cluster suite... | FAIL | Suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.128', port=8181): Read timed out. (read timeout=5.0) 8 tests, 0 passed, 8 failed ============================================================================== controller-clustering-tell.txt | FAIL | 162 tests, 11 passed, 151 failed ============================================================================== Output: /w/workspace/controller-csit-3node-clustering-tell-all-scandium/output.xml Log: /w/workspace/controller-csit-3node-clustering-tell-all-scandium/log.html Report: /w/workspace/controller-csit-3node-clustering-tell-all-scandium/report.html + true + echo 'Examining the files in data/log and checking filesize' Examining the files in data/log and checking filesize + ssh 10.30.170.79 'ls -altr /tmp/karaf-0.21.4-SNAPSHOT/data/log/' Warning: Permanently added '10.30.170.79' (ECDSA) to the list of known hosts. total 14196 drwxrwxr-x 2 jenkins jenkins 4096 Nov 2 23:37 . -rw-rw-r-- 1 jenkins jenkins 1720 Nov 2 23:37 karaf_console.log drwxrwxr-x 9 jenkins jenkins 4096 Nov 3 05:14 .. -rw-rw-r-- 1 jenkins jenkins 14518263 Nov 3 05:28 karaf.log + ssh 10.30.170.79 'du -hs /tmp/karaf-0.21.4-SNAPSHOT/data/log/*' Warning: Permanently added '10.30.170.79' (ECDSA) to the list of known hosts. 14M /tmp/karaf-0.21.4-SNAPSHOT/data/log/karaf.log 4.0K /tmp/karaf-0.21.4-SNAPSHOT/data/log/karaf_console.log + ssh 10.30.170.212 'ls -altr /tmp/karaf-0.21.4-SNAPSHOT/data/log/' Warning: Permanently added '10.30.170.212' (ECDSA) to the list of known hosts. total 8212 drwxrwxr-x 2 jenkins jenkins 4096 Nov 2 23:37 . -rw-rw-r-- 1 jenkins jenkins 1720 Nov 2 23:37 karaf_console.log drwxrwxr-x 9 jenkins jenkins 4096 Nov 3 05:14 .. -rw-rw-r-- 1 jenkins jenkins 8388971 Nov 3 05:28 karaf.log + ssh 10.30.170.212 'du -hs /tmp/karaf-0.21.4-SNAPSHOT/data/log/*' Warning: Permanently added '10.30.170.212' (ECDSA) to the list of known hosts. 8.1M /tmp/karaf-0.21.4-SNAPSHOT/data/log/karaf.log 4.0K /tmp/karaf-0.21.4-SNAPSHOT/data/log/karaf_console.log + ssh 10.30.171.128 'ls -altr /tmp/karaf-0.21.4-SNAPSHOT/data/log/' Warning: Permanently added '10.30.171.128' (ECDSA) to the list of known hosts. total 11348 drwxrwxr-x 2 jenkins jenkins 4096 Nov 2 23:37 . -rw-rw-r-- 1 jenkins jenkins 142564 Nov 2 23:48 karaf_console.log drwxrwxr-x 4 jenkins jenkins 4096 Nov 3 05:14 .. -rw-rw-r-- 1 jenkins jenkins 11461278 Nov 3 05:28 karaf.log + ssh 10.30.171.128 'du -hs /tmp/karaf-0.21.4-SNAPSHOT/data/log/*' Warning: Permanently added '10.30.171.128' (ECDSA) to the list of known hosts. 11M /tmp/karaf-0.21.4-SNAPSHOT/data/log/karaf.log 140K /tmp/karaf-0.21.4-SNAPSHOT/data/log/karaf_console.log + set +e ++ seq 1 3 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_1_IP + echo 'Let'\''s take the karaf thread dump again' Let's take the karaf thread dump again + ssh 10.30.170.79 'sudo ps aux' Warning: Permanently added '10.30.170.79' (ECDSA) to the list of known hosts. ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-scandium/ps_after.log ++ grep -v grep ++ cut -f2 '-d ' ++ tr -s ' ' + pid=30069 + echo 'karaf main: org.apache.karaf.main.Main, pid:30069' karaf main: org.apache.karaf.main.Main, pid:30069 + ssh 10.30.170.79 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 30069' Warning: Permanently added '10.30.170.79' (ECDSA) to the list of known hosts. + echo 'killing karaf process...' killing karaf process... + ssh 10.30.170.79 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh' Warning: Permanently added '10.30.170.79' (ECDSA) to the list of known hosts. + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_2_IP + echo 'Let'\''s take the karaf thread dump again' Let's take the karaf thread dump again + ssh 10.30.170.212 'sudo ps aux' Warning: Permanently added '10.30.170.212' (ECDSA) to the list of known hosts. ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-scandium/ps_after.log ++ grep -v grep ++ tr -s ' ' ++ cut -f2 '-d ' + pid=28599 + echo 'karaf main: org.apache.karaf.main.Main, pid:28599' karaf main: org.apache.karaf.main.Main, pid:28599 + ssh 10.30.170.212 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 28599' Warning: Permanently added '10.30.170.212' (ECDSA) to the list of known hosts. + echo 'killing karaf process...' killing karaf process... + ssh 10.30.170.212 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh' Warning: Permanently added '10.30.170.212' (ECDSA) to the list of known hosts. + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_3_IP + echo 'Let'\''s take the karaf thread dump again' Let's take the karaf thread dump again + ssh 10.30.171.128 'sudo ps aux' Warning: Permanently added '10.30.171.128' (ECDSA) to the list of known hosts. ++ tr -s ' ' ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-scandium/ps_after.log ++ grep -v grep ++ cut -f2 '-d ' + pid=2096 + echo 'karaf main: org.apache.karaf.main.Main, pid:2096' karaf main: org.apache.karaf.main.Main, pid:2096 + ssh 10.30.171.128 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 2096' Warning: Permanently added '10.30.171.128' (ECDSA) to the list of known hosts. + echo 'killing karaf process...' killing karaf process... + ssh 10.30.171.128 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh' Warning: Permanently added '10.30.171.128' (ECDSA) to the list of known hosts. + sleep 5 ++ seq 1 3 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_1_IP + echo 'Compressing karaf.log 1' Compressing karaf.log 1 + ssh 10.30.170.79 gzip --best /tmp/karaf-0.21.4-SNAPSHOT/data/log/karaf.log Warning: Permanently added '10.30.170.79' (ECDSA) to the list of known hosts. + echo 'Fetching compressed karaf.log 1' Fetching compressed karaf.log 1 + scp 10.30.170.79:/tmp/karaf-0.21.4-SNAPSHOT/data/log/karaf.log.gz odl1_karaf.log.gz Warning: Permanently added '10.30.170.79' (ECDSA) to the list of known hosts. + ssh 10.30.170.79 rm -f /tmp/karaf-0.21.4-SNAPSHOT/data/log/karaf.log.gz Warning: Permanently added '10.30.170.79' (ECDSA) to the list of known hosts. + scp 10.30.170.79:/tmp/karaf-0.21.4-SNAPSHOT/data/log/karaf_console.log odl1_karaf_console.log Warning: Permanently added '10.30.170.79' (ECDSA) to the list of known hosts. + ssh 10.30.170.79 rm -f /tmp/karaf-0.21.4-SNAPSHOT/data/log/karaf_console.log Warning: Permanently added '10.30.170.79' (ECDSA) to the list of known hosts. + echo 'Fetch GC logs' Fetch GC logs + mkdir -p gclogs-1 + scp '10.30.170.79:/tmp/karaf-0.21.4-SNAPSHOT/data/log/*.log' gclogs-1/ Warning: Permanently added '10.30.170.79' (ECDSA) to the list of known hosts. scp: /tmp/karaf-0.21.4-SNAPSHOT/data/log/*.log: No such file or directory + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_2_IP + echo 'Compressing karaf.log 2' Compressing karaf.log 2 + ssh 10.30.170.212 gzip --best /tmp/karaf-0.21.4-SNAPSHOT/data/log/karaf.log Warning: Permanently added '10.30.170.212' (ECDSA) to the list of known hosts. + echo 'Fetching compressed karaf.log 2' Fetching compressed karaf.log 2 + scp 10.30.170.212:/tmp/karaf-0.21.4-SNAPSHOT/data/log/karaf.log.gz odl2_karaf.log.gz Warning: Permanently added '10.30.170.212' (ECDSA) to the list of known hosts. + ssh 10.30.170.212 rm -f /tmp/karaf-0.21.4-SNAPSHOT/data/log/karaf.log.gz Warning: Permanently added '10.30.170.212' (ECDSA) to the list of known hosts. + scp 10.30.170.212:/tmp/karaf-0.21.4-SNAPSHOT/data/log/karaf_console.log odl2_karaf_console.log Warning: Permanently added '10.30.170.212' (ECDSA) to the list of known hosts. + ssh 10.30.170.212 rm -f /tmp/karaf-0.21.4-SNAPSHOT/data/log/karaf_console.log Warning: Permanently added '10.30.170.212' (ECDSA) to the list of known hosts. + echo 'Fetch GC logs' Fetch GC logs + mkdir -p gclogs-2 + scp '10.30.170.212:/tmp/karaf-0.21.4-SNAPSHOT/data/log/*.log' gclogs-2/ Warning: Permanently added '10.30.170.212' (ECDSA) to the list of known hosts. scp: /tmp/karaf-0.21.4-SNAPSHOT/data/log/*.log: No such file or directory + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_3_IP + echo 'Compressing karaf.log 3' Compressing karaf.log 3 + ssh 10.30.171.128 gzip --best /tmp/karaf-0.21.4-SNAPSHOT/data/log/karaf.log Warning: Permanently added '10.30.171.128' (ECDSA) to the list of known hosts. + echo 'Fetching compressed karaf.log 3' Fetching compressed karaf.log 3 + scp 10.30.171.128:/tmp/karaf-0.21.4-SNAPSHOT/data/log/karaf.log.gz odl3_karaf.log.gz Warning: Permanently added '10.30.171.128' (ECDSA) to the list of known hosts. + ssh 10.30.171.128 rm -f /tmp/karaf-0.21.4-SNAPSHOT/data/log/karaf.log.gz Warning: Permanently added '10.30.171.128' (ECDSA) to the list of known hosts. + scp 10.30.171.128:/tmp/karaf-0.21.4-SNAPSHOT/data/log/karaf_console.log odl3_karaf_console.log Warning: Permanently added '10.30.171.128' (ECDSA) to the list of known hosts. + ssh 10.30.171.128 rm -f /tmp/karaf-0.21.4-SNAPSHOT/data/log/karaf_console.log Warning: Permanently added '10.30.171.128' (ECDSA) to the list of known hosts. + echo 'Fetch GC logs' Fetch GC logs + mkdir -p gclogs-3 + scp '10.30.171.128:/tmp/karaf-0.21.4-SNAPSHOT/data/log/*.log' gclogs-3/ Warning: Permanently added '10.30.171.128' (ECDSA) to the list of known hosts. scp: /tmp/karaf-0.21.4-SNAPSHOT/data/log/*.log: No such file or directory + echo 'Examine copied files' Examine copied files + ls -lt total 73444 drwxrwxr-x. 2 jenkins jenkins 6 Nov 3 05:29 gclogs-3 -rw-rw-r--. 1 jenkins jenkins 142564 Nov 3 05:29 odl3_karaf_console.log -rw-rw-r--. 1 jenkins jenkins 394057 Nov 3 05:29 odl3_karaf.log.gz drwxrwxr-x. 2 jenkins jenkins 6 Nov 3 05:29 gclogs-2 -rw-rw-r--. 1 jenkins jenkins 1720 Nov 3 05:29 odl2_karaf_console.log -rw-rw-r--. 1 jenkins jenkins 607939 Nov 3 05:29 odl2_karaf.log.gz drwxrwxr-x. 2 jenkins jenkins 6 Nov 3 05:29 gclogs-1 -rw-rw-r--. 1 jenkins jenkins 1720 Nov 3 05:29 odl1_karaf_console.log -rw-rw-r--. 1 jenkins jenkins 854666 Nov 3 05:29 odl1_karaf.log.gz -rw-rw-r--. 1 jenkins jenkins 137316 Nov 3 05:29 karaf_3_2096_threads_after.log -rw-rw-r--. 1 jenkins jenkins 13887 Nov 3 05:29 ps_after.log -rw-rw-r--. 1 jenkins jenkins 124090 Nov 3 05:29 karaf_2_28599_threads_after.log -rw-rw-r--. 1 jenkins jenkins 126497 Nov 3 05:29 karaf_1_30069_threads_after.log -rw-rw-r--. 1 jenkins jenkins 307601 Nov 3 05:29 report.html -rw-rw-r--. 1 jenkins jenkins 4019378 Nov 3 05:29 log.html -rw-rw-r--. 1 jenkins jenkins 68024596 Nov 3 05:29 output.xml -rw-rw-r--. 1 jenkins jenkins 6069 Nov 2 23:41 testplan.txt -rw-rw-r--. 1 jenkins jenkins 107244 Nov 2 23:41 karaf_3_2096_threads_before.log -rw-rw-r--. 1 jenkins jenkins 14039 Nov 2 23:41 ps_before.log -rw-rw-r--. 1 jenkins jenkins 112499 Nov 2 23:41 karaf_2_2085_threads_before.log -rw-rw-r--. 1 jenkins jenkins 112747 Nov 2 23:40 karaf_1_2102_threads_before.log -rw-rw-r--. 1 jenkins jenkins 3106 Nov 2 23:37 post-startup-script.sh -rw-rw-r--. 1 jenkins jenkins 252 Nov 2 23:37 startup-script.sh -rw-rw-r--. 1 jenkins jenkins 3468 Nov 2 23:37 configuration-script.sh -rw-rw-r--. 1 jenkins jenkins 695 Nov 2 23:37 custom_shard_config.txt -rw-rw-r--. 1 jenkins jenkins 136 Nov 2 23:37 scriptplan.txt -rw-rw-r--. 1 jenkins jenkins 335 Nov 2 23:37 detect_variables.env -rw-rw-r--. 1 jenkins jenkins 2619 Nov 2 23:37 pom.xml -rw-rw-r--. 1 jenkins jenkins 92 Nov 2 23:37 set_variables.env -rw-rw-r--. 1 jenkins jenkins 312 Nov 2 23:37 slave_addresses.txt -rw-rw-r--. 1 jenkins jenkins 570 Nov 2 23:36 requirements.txt -rw-rw-r--. 1 jenkins jenkins 26 Nov 2 23:36 env.properties -rw-rw-r--. 1 jenkins jenkins 333 Nov 2 23:34 stack-parameters.yaml drwxrwxr-x. 7 jenkins jenkins 4096 Nov 2 23:33 test drwxrwxr-x. 2 jenkins jenkins 6 Nov 2 23:33 test@tmp -rw-rw-r--. 1 jenkins jenkins 1404 Nov 2 21:28 maven-metadata.xml + true [controller-csit-3node-clustering-tell-all-scandium] $ /bin/sh /tmp/jenkins4385397480173298962.sh Cleaning up Robot installation... $ ssh-agent -k unset SSH_AUTH_SOCK; unset SSH_AGENT_PID; echo Agent pid 5170 killed; [ssh-agent] Stopped. Recording plot data Robot results publisher started... INFO: Checking test criticality is deprecated and will be dropped in a future release! -Parsing output xml: Done! -Copying log files to build dir: Done! -Assigning results to build: Done! -Checking thresholds: Done! Done publishing Robot results. Build step 'Publish Robot Framework test results' changed build result to UNSTABLE [PostBuildScript] - [INFO] Executing post build scripts. [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins13141455991525000072.sh Archiving csit artifacts mv: cannot stat '*_1.png': No such file or directory mv: cannot stat '/tmp/odl1_*': No such file or directory mv: cannot stat '*_2.png': No such file or directory mv: cannot stat '/tmp/odl2_*': No such file or directory mv: cannot stat '*_3.png': No such file or directory mv: cannot stat '/tmp/odl3_*': No such file or directory % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 2600k 0 2600k 0 0 4049k 0 --:--:-- --:--:-- --:--:-- 4043k 100 5476k 0 5476k 0 0 4441k 0 --:--:-- 0:00:01 --:--:-- 4441k Archive: robot-plugin.zip inflating: ./archives/robot-plugin/log.html inflating: ./archives/robot-plugin/output.xml inflating: ./archives/robot-plugin/report.html mv: cannot stat '*.log.gz': No such file or directory mv: cannot stat '*.csv': No such file or directory mv: cannot stat '*.png': No such file or directory [PostBuildScript] - [INFO] Executing post build scripts. [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins1466797267327766448.sh [PostBuildScript] - [INFO] Executing post build scripts. [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content OS_CLOUD=vex OS_STACK_NAME=releng-controller-csit-3node-clustering-tell-all-scandium-79 [EnvInject] - Variables injected successfully. provisioning config files... copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins16771594978602213831.sh ---> openstack-stack-delete.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-pnDE from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) lf-activate-venv(): INFO: Attempting to install with network-safe options... ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. lftools 0.37.15 requires urllib3<2.1.0, but you have urllib3 2.5.0 which is incompatible. lf-activate-venv(): INFO: Base packages installed successfully lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes python-heatclient python-openstackclient urllib3~=1.26.15 lf-activate-venv(): INFO: Adding /tmp/venv-pnDE/bin to PATH INFO: Stack cost retrieval disabled, setting cost to 0 INFO: Deleting stack releng-controller-csit-3node-clustering-tell-all-scandium-79 Waiting for stack to delete... Successfully deleted stack releng-controller-csit-3node-clustering-tell-all-scandium-79 [PostBuildScript] - [INFO] Executing post build scripts. [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins13956551945662937944.sh ---> sysstat.sh [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins10062385815107625958.sh ---> package-listing.sh ++ facter osfamily ++ tr '[:upper:]' '[:lower:]' + OS_FAMILY=redhat + workspace=/w/workspace/controller-csit-3node-clustering-tell-all-scandium + START_PACKAGES=/tmp/packages_start.txt + END_PACKAGES=/tmp/packages_end.txt + DIFF_PACKAGES=/tmp/packages_diff.txt + PACKAGES=/tmp/packages_start.txt + '[' /w/workspace/controller-csit-3node-clustering-tell-all-scandium ']' + PACKAGES=/tmp/packages_end.txt + case "${OS_FAMILY}" in + sort + rpm -qa + '[' -f /tmp/packages_start.txt ']' + '[' -f /tmp/packages_end.txt ']' + diff /tmp/packages_start.txt /tmp/packages_end.txt + '[' /w/workspace/controller-csit-3node-clustering-tell-all-scandium ']' + mkdir -p /w/workspace/controller-csit-3node-clustering-tell-all-scandium/archives/ + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/controller-csit-3node-clustering-tell-all-scandium/archives/ [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins17595491691503364877.sh ---> capture-instance-metadata.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-pnDE from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) lf-activate-venv(): INFO: Attempting to install with network-safe options... lf-activate-venv(): INFO: Base packages installed successfully lf-activate-venv(): INFO: Installing additional packages: lftools lf-activate-venv(): INFO: Adding /tmp/venv-pnDE/bin to PATH INFO: Running in OpenStack, capturing instance metadata [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins5218405817868484392.sh provisioning config files... Could not find credentials [logs] for controller-csit-3node-clustering-tell-all-scandium #79 copy managed file [jenkins-log-archives-settings] to file:/w/workspace/controller-csit-3node-clustering-tell-all-scandium@tmp/config4439088378251969579tmp Regular expression run condition: Expression=[^.*logs-s3.*], Label=[odl-logs-s3-cloudfront-index] Run condition [Regular expression match] enabling perform for step [Provide Configuration files] provisioning config files... copy managed file [jenkins-s3-log-ship] to file:/home/jenkins/.aws/credentials [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content SERVER_ID=logs [EnvInject] - Variables injected successfully. [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins14258374527802054196.sh ---> create-netrc.sh WARN: Log server credential not found. [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins5757096215528663077.sh ---> python-tools-install.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-pnDE from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) lf-activate-venv(): INFO: Attempting to install with network-safe options... lf-activate-venv(): INFO: Base packages installed successfully lf-activate-venv(): INFO: Installing additional packages: lftools lf-activate-venv(): INFO: Adding /tmp/venv-pnDE/bin to PATH [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins14104764763888177160.sh ---> sudo-logs.sh Archiving 'sudo' log.. [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins5226386713460689859.sh ---> job-cost.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-pnDE from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) lf-activate-venv(): INFO: Attempting to install with network-safe options... lf-activate-venv(): INFO: Base packages installed successfully lf-activate-venv(): INFO: Installing additional packages: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 lf-activate-venv(): INFO: Adding /tmp/venv-pnDE/bin to PATH DEBUG: total: 0 INFO: Retrieving Stack Cost... INFO: Retrieving Pricing Info for: v3-standard-2 INFO: Archiving Costs [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash -l /tmp/jenkins10338958761510929872.sh ---> logs-deploy.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-pnDE from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) lf-activate-venv(): INFO: Attempting to install with network-safe options... lf-activate-venv(): INFO: Base packages installed successfully lf-activate-venv(): INFO: Installing additional packages: lftools urllib3~=1.26.15 lf-activate-venv(): INFO: Adding /tmp/venv-pnDE/bin to PATH WARNING: Nexus logging server not set INFO: S3 path logs/releng/vex-yul-odl-jenkins-1/controller-csit-3node-clustering-tell-all-scandium/79/ INFO: archiving logs to S3 ---> uname -a: Linux prd-centos8-robot-2c-8g-4831.novalocal 4.18.0-553.5.1.el8.x86_64 #1 SMP Tue May 21 05:46:01 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux ---> lscpu: Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Byte Order: Little Endian CPU(s): 2 On-line CPU(s) list: 0,1 Thread(s) per core: 1 Core(s) per socket: 1 Socket(s): 2 NUMA node(s): 1 Vendor ID: AuthenticAMD CPU family: 23 Model: 49 Model name: AMD EPYC-Rome Processor Stepping: 0 CPU MHz: 2799.998 BogoMIPS: 5599.99 Virtualization: AMD-V Hypervisor vendor: KVM Virtualization type: full L1d cache: 32K L1i cache: 32K L2 cache: 512K L3 cache: 16384K NUMA node0 CPU(s): 0,1 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities ---> nproc: 2 ---> df -h: Filesystem Size Used Avail Use% Mounted on devtmpfs 3.8G 0 3.8G 0% /dev tmpfs 3.8G 0 3.8G 0% /dev/shm tmpfs 3.8G 17M 3.8G 1% /run tmpfs 3.8G 0 3.8G 0% /sys/fs/cgroup /dev/vda1 40G 8.5G 32G 22% / tmpfs 770M 0 770M 0% /run/user/1001 ---> free -m: total used free shared buff/cache available Mem: 7697 707 4647 19 2342 6691 Swap: 1023 0 1023 ---> ip addr: 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever inet6 ::1/128 scope host valid_lft forever preferred_lft forever 2: eth0: mtu 1458 qdisc mq state UP group default qlen 1000 link/ether fa:16:3e:83:0e:bb brd ff:ff:ff:ff:ff:ff altname enp0s3 altname ens3 inet 10.30.171.70/23 brd 10.30.171.255 scope global dynamic noprefixroute eth0 valid_lft 64912sec preferred_lft 64912sec inet6 fe80::f816:3eff:fe83:ebb/64 scope link valid_lft forever preferred_lft forever ---> sar -b -r -n DEV: Linux 4.18.0-553.5.1.el8.x86_64 (prd-centos8-robot-2c-8g-4831.novalocal) 11/03/2025 _x86_64_ (2 CPU) 12:00:01 AM tps rtps wtps bread/s bwrtn/s 12:01:01 AM 0.85 0.00 0.85 0.00 194.40 12:02:01 AM 0.45 0.08 0.37 1.87 6.10 12:03:01 AM 0.22 0.00 0.22 0.00 3.90 12:04:01 AM 0.33 0.00 0.33 0.00 7.52 12:05:01 AM 0.17 0.00 0.17 0.00 1.55 12:06:01 AM 0.25 0.00 0.25 0.00 6.33 12:07:01 AM 0.13 0.00 0.13 0.00 1.70 12:08:01 AM 0.38 0.00 0.38 0.00 9.36 12:09:01 AM 0.45 0.00 0.45 0.00 10.13 12:10:01 AM 0.13 0.00 0.13 0.00 1.33 12:11:01 AM 0.20 0.00 0.20 0.00 3.58 12:12:01 AM 0.27 0.00 0.27 0.00 5.36 12:13:01 AM 0.10 0.00 0.10 0.00 0.83 12:14:01 AM 0.52 0.00 0.52 0.00 10.50 12:15:01 AM 0.20 0.00 0.20 0.00 4.40 12:16:01 AM 0.18 0.00 0.18 0.00 1.97 12:17:01 AM 0.20 0.00 0.20 0.00 3.92 12:18:01 AM 0.10 0.00 0.10 0.00 1.03 12:19:01 AM 0.28 0.00 0.28 0.00 5.03 12:20:00 AM 0.15 0.00 0.15 0.00 1.21 12:20:01 AM 0.00 0.00 0.00 0.00 0.00 12:21:01 AM 0.25 0.00 0.25 0.00 2.83 12:22:01 AM 0.27 0.00 0.27 0.00 3.65 12:23:01 AM 0.10 0.00 0.10 0.00 0.63 12:24:01 AM 0.33 0.03 0.30 0.27 4.90 12:25:01 AM 8.71 5.73 2.98 555.41 81.04 12:26:01 AM 0.25 0.00 0.25 0.00 17.61 12:27:01 AM 0.12 0.00 0.12 0.00 9.08 12:28:01 AM 0.17 0.00 0.17 0.00 16.41 12:29:01 AM 0.32 0.00 0.32 0.00 18.89 12:30:01 AM 0.15 0.00 0.15 0.00 15.33 12:31:01 AM 0.25 0.00 0.25 0.00 10.86 12:32:01 AM 0.27 0.00 0.27 0.00 25.23 12:33:01 AM 0.12 0.00 0.12 0.00 1.73 12:34:01 AM 0.37 0.00 0.37 0.00 5.15 12:35:01 AM 0.18 0.00 0.18 0.00 4.53 12:36:01 AM 0.25 0.00 0.25 0.00 3.30 12:37:01 AM 0.28 0.00 0.28 0.00 5.23 12:38:01 AM 0.33 0.00 0.33 0.00 3.85 12:39:01 AM 0.54 0.00 0.54 0.00 13.15 12:40:01 AM 0.35 0.00 0.35 0.00 6.68 12:41:01 AM 0.45 0.00 0.45 0.00 6.06 12:42:01 AM 0.37 0.00 0.37 0.00 4.15 12:43:01 AM 0.38 0.00 0.38 0.00 4.18 12:44:01 AM 0.50 0.00 0.50 0.00 7.28 12:45:01 AM 0.37 0.00 0.37 0.00 6.83 12:46:01 AM 1.30 0.32 0.98 6.93 37.48 12:47:01 AM 0.22 0.00 0.22 0.00 16.44 12:48:01 AM 0.20 0.00 0.20 0.00 17.75 12:49:01 AM 0.23 0.00 0.23 0.00 10.95 12:50:01 AM 0.23 0.00 0.23 0.00 18.83 12:51:01 AM 0.28 0.00 0.28 0.00 16.16 12:52:01 AM 0.45 0.00 0.45 0.00 8.00 12:53:01 AM 0.35 0.00 0.35 0.00 3.87 12:54:01 AM 0.40 0.00 0.40 0.00 8.18 12:55:01 AM 0.32 0.00 0.32 0.00 9.82 12:56:01 AM 0.18 0.00 0.18 0.00 15.34 12:57:01 AM 0.13 0.00 0.13 0.00 16.13 12:58:01 AM 0.12 0.00 0.12 0.00 8.53 12:59:01 AM 0.35 0.00 0.35 0.00 20.79 01:00:01 AM 0.27 0.00 0.27 0.00 18.00 01:01:01 AM 0.20 0.00 0.20 0.00 9.65 01:02:01 AM 0.18 0.00 0.18 0.00 24.52 01:03:01 AM 0.12 0.00 0.12 0.00 1.30 01:04:01 AM 0.45 0.00 0.45 0.00 7.68 01:05:01 AM 0.22 0.00 0.22 0.00 5.20 01:06:01 AM 0.28 0.00 0.28 0.00 4.15 01:07:01 AM 0.15 0.00 0.15 0.00 3.75 01:08:01 AM 0.15 0.00 0.15 0.00 1.45 01:09:01 AM 0.28 0.00 0.28 0.00 10.23 01:10:01 AM 0.15 0.00 0.15 0.00 5.07 01:11:01 AM 0.27 0.00 0.27 0.00 3.22 01:12:01 AM 0.20 0.00 0.20 0.00 2.78 01:13:01 AM 0.17 0.00 0.17 0.00 12.01 01:14:01 AM 0.37 0.00 0.37 0.00 18.73 01:15:01 AM 0.12 0.00 0.12 0.00 8.93 01:16:01 AM 0.17 0.00 0.17 0.00 16.39 01:17:01 AM 0.13 0.00 0.13 0.00 16.66 01:18:01 AM 0.13 0.00 0.13 0.00 8.72 01:19:01 AM 0.48 0.00 0.48 0.00 22.53 01:20:01 AM 0.18 0.00 0.18 0.00 3.35 01:21:01 AM 0.17 0.00 0.17 0.00 14.31 01:22:01 AM 0.18 0.00 0.18 0.00 10.15 01:23:01 AM 0.15 0.00 0.15 0.00 16.54 01:24:01 AM 0.40 0.00 0.40 0.00 23.29 01:25:01 AM 0.15 0.00 0.15 0.00 8.67 01:26:01 AM 0.37 0.00 0.37 0.00 20.81 01:27:01 AM 0.22 0.00 0.22 0.00 11.90 01:28:01 AM 0.13 0.00 0.13 0.00 9.76 01:29:01 AM 0.33 0.00 0.33 0.00 15.06 01:30:01 AM 0.18 0.00 0.18 0.00 16.68 01:31:01 AM 0.28 0.00 0.28 0.00 18.29 01:32:01 AM 0.20 0.00 0.20 0.00 10.81 01:33:01 AM 0.18 0.00 0.18 0.00 18.93 01:34:01 AM 0.47 0.00 0.47 0.00 16.93 01:35:01 AM 0.13 0.00 0.13 0.00 23.46 01:36:01 AM 0.13 0.00 0.13 0.00 1.32 01:37:01 AM 0.10 0.00 0.10 0.00 0.83 01:38:01 AM 0.23 0.00 0.23 0.00 5.13 01:39:01 AM 0.28 0.00 0.28 0.00 5.25 01:40:01 AM 0.23 0.00 0.23 0.00 5.33 01:41:01 AM 0.23 0.00 0.23 0.00 3.12 01:42:01 AM 0.20 0.00 0.20 0.00 8.02 01:43:01 AM 0.37 0.00 0.37 0.00 5.48 01:44:01 AM 1.13 0.00 1.13 0.00 20.64 01:45:01 AM 0.27 0.00 0.27 0.00 3.67 01:46:01 AM 0.18 0.00 0.18 0.00 4.32 01:47:02 AM 0.13 0.00 0.13 0.00 17.50 01:48:01 AM 0.17 0.00 0.17 0.00 9.00 01:49:01 AM 0.30 0.00 0.30 0.00 20.11 01:50:01 AM 0.18 0.00 0.18 0.00 16.94 01:51:01 AM 0.40 0.00 0.40 0.00 17.76 01:52:01 AM 0.58 0.00 0.58 0.00 20.40 01:53:01 AM 0.28 0.00 0.28 0.00 3.80 01:54:01 AM 0.38 0.00 0.38 0.00 12.95 01:55:01 AM 0.33 0.00 0.33 0.00 17.78 01:56:01 AM 0.17 0.00 0.17 0.00 10.65 01:57:01 AM 0.15 0.00 0.15 0.00 15.88 01:58:01 AM 0.17 0.00 0.17 0.00 16.41 01:59:01 AM 0.20 0.00 0.20 0.00 9.91 02:00:01 AM 0.40 0.00 0.40 0.00 22.53 02:01:01 AM 0.33 0.00 0.33 0.00 25.71 02:02:01 AM 0.17 0.00 0.17 0.00 2.55 02:03:01 AM 0.13 0.00 0.13 0.00 0.92 02:04:01 AM 0.33 0.00 0.33 0.00 7.75 02:05:01 AM 0.33 0.00 0.33 0.00 4.77 02:06:01 AM 0.12 0.00 0.12 0.00 3.47 02:07:01 AM 0.15 0.00 0.15 0.00 1.48 02:08:01 AM 0.12 0.00 0.12 0.00 6.65 02:09:01 AM 0.32 0.00 0.32 0.00 7.28 02:10:01 AM 0.13 0.00 0.13 0.00 3.33 02:11:01 AM 0.23 0.00 0.23 0.00 3.10 02:12:01 AM 0.23 0.00 0.23 0.00 5.38 02:13:01 AM 0.15 0.00 0.15 0.00 1.65 02:14:01 AM 0.38 0.00 0.38 0.00 8.48 02:15:01 AM 0.15 0.00 0.15 0.00 1.48 02:16:01 AM 0.13 0.00 0.13 0.00 3.72 02:17:01 AM 0.10 0.00 0.10 0.00 0.68 02:18:01 AM 0.17 0.00 0.17 0.00 4.40 02:19:01 AM 0.35 0.00 0.35 0.00 6.27 02:20:01 AM 0.13 0.00 0.13 0.00 3.58 02:21:01 AM 0.25 0.00 0.25 0.00 3.25 02:22:01 AM 0.22 0.00 0.22 0.00 2.95 02:23:01 AM 0.12 0.00 0.12 0.00 3.48 02:24:01 AM 0.40 0.00 0.40 0.00 6.40 02:25:01 AM 0.18 0.00 0.18 0.00 14.05 02:26:01 AM 0.23 0.00 0.23 0.00 17.40 02:27:01 AM 0.13 0.00 0.13 0.00 8.43 02:28:01 AM 0.25 0.00 0.25 0.00 15.86 02:29:01 AM 0.40 0.00 0.40 0.00 20.53 02:30:01 AM 0.17 0.00 0.17 0.00 17.06 02:31:01 AM 0.17 0.00 0.17 0.00 9.37 02:32:01 AM 0.17 0.00 0.17 0.00 7.33 02:33:01 AM 0.32 0.00 0.32 0.00 4.23 02:34:01 AM 0.57 0.00 0.57 0.00 10.86 02:35:01 AM 0.12 0.00 0.12 0.00 1.60 02:36:01 AM 0.17 0.00 0.17 0.00 1.78 02:37:01 AM 0.20 0.00 0.20 0.00 4.97 02:38:01 AM 0.10 0.00 0.10 0.00 0.65 02:39:01 AM 0.32 0.00 0.32 0.00 8.47 02:40:01 AM 0.12 0.00 0.12 0.00 0.92 02:41:01 AM 0.27 0.00 0.27 0.00 6.42 02:42:01 AM 0.23 0.00 0.23 0.00 3.37 02:43:01 AM 0.12 0.00 0.12 0.00 3.88 02:44:01 AM 0.35 0.00 0.35 0.00 5.67 02:45:01 AM 0.13 0.00 0.13 0.00 4.82 02:46:01 AM 0.28 0.00 0.28 0.00 19.70 02:47:01 AM 0.23 0.00 0.23 0.00 17.43 02:48:01 AM 0.15 0.00 0.15 0.00 9.08 02:49:01 AM 0.35 0.00 0.35 0.00 21.06 02:50:01 AM 0.15 0.00 0.15 0.00 16.40 02:51:01 AM 0.60 0.00 0.60 0.00 19.18 02:52:01 AM 0.33 0.00 0.33 0.00 7.23 02:53:01 AM 0.35 0.00 0.35 0.00 3.87 02:54:01 AM 0.48 0.00 0.48 0.00 8.90 02:55:02 AM 0.40 0.00 0.40 0.00 4.42 02:56:01 AM 0.32 0.00 0.32 0.00 6.34 02:57:01 AM 0.30 0.00 0.30 0.00 3.42 02:58:01 AM 0.43 0.00 0.43 0.00 8.48 02:59:01 AM 0.47 0.00 0.47 0.00 6.78 03:00:01 AM 0.37 0.00 0.37 0.00 7.11 03:01:01 AM 0.18 0.00 0.18 0.00 1.92 03:02:01 AM 0.27 0.00 0.27 0.00 3.60 03:03:01 AM 0.18 0.00 0.18 0.00 5.33 03:04:01 AM 0.30 0.00 0.30 0.00 4.87 03:05:01 AM 0.13 0.00 0.13 0.00 4.53 03:06:01 AM 0.17 0.00 0.17 0.00 21.40 03:07:01 AM 0.47 0.00 0.47 0.00 16.53 03:08:01 AM 0.38 0.00 0.38 0.00 12.43 03:09:01 AM 0.23 0.00 0.23 0.00 17.13 03:10:01 AM 0.30 0.00 0.30 0.00 16.16 03:11:01 AM 0.40 0.00 0.40 0.00 16.98 03:12:01 AM 0.30 0.00 0.30 0.00 6.86 03:13:01 AM 0.35 0.00 0.35 0.00 3.83 03:14:01 AM 0.35 0.00 0.35 0.00 6.95 03:15:01 AM 0.40 0.00 0.40 0.00 4.80 03:16:01 AM 0.22 0.00 0.22 0.00 4.90 03:17:01 AM 0.13 0.00 0.13 0.00 1.45 03:18:01 AM 0.15 0.00 0.15 0.00 4.23 03:19:01 AM 0.52 0.00 0.52 0.00 6.57 03:20:01 AM 0.90 0.00 0.90 0.00 16.21 03:21:01 AM 0.47 0.00 0.47 0.00 6.93 03:22:01 AM 0.42 0.00 0.42 0.00 8.37 03:23:01 AM 0.15 0.00 0.15 0.00 1.68 03:24:01 AM 0.37 0.00 0.37 0.00 5.40 03:25:01 AM 0.12 0.00 0.12 0.00 9.61 03:26:01 AM 0.18 0.00 0.18 0.00 16.41 03:27:01 AM 0.15 0.00 0.15 0.00 14.26 03:28:01 AM 0.12 0.00 0.12 0.00 8.40 03:29:01 AM 0.33 0.00 0.33 0.00 21.06 03:30:01 AM 0.15 0.00 0.15 0.00 16.26 03:31:01 AM 0.38 0.00 0.38 0.00 15.36 03:32:01 AM 0.13 0.00 0.13 0.00 23.73 03:33:01 AM 0.15 0.00 0.15 0.00 1.72 03:34:01 AM 0.38 0.00 0.38 0.00 5.88 03:35:01 AM 0.13 0.00 0.13 0.00 3.77 03:36:01 AM 0.20 0.00 0.20 0.00 1.90 03:37:01 AM 0.17 0.00 0.17 0.00 4.28 03:38:01 AM 0.13 0.00 0.13 0.00 1.43 03:39:01 AM 0.53 0.00 0.53 0.00 13.65 03:40:01 AM 0.42 0.00 0.42 0.00 7.53 03:41:01 AM 0.18 0.00 0.18 0.00 2.08 03:42:01 AM 0.20 0.00 0.20 0.00 2.27 03:43:01 AM 0.12 0.00 0.12 0.00 3.07 03:44:01 AM 0.38 0.00 0.38 0.00 22.91 03:45:01 AM 0.17 0.00 0.17 0.00 16.40 03:46:01 AM 0.22 0.00 0.22 0.00 10.95 03:47:01 AM 0.25 0.00 0.25 0.00 15.34 03:48:01 AM 0.13 0.00 0.13 0.00 16.13 03:49:01 AM 0.32 0.00 0.32 0.00 19.70 03:50:01 AM 0.13 0.00 0.13 0.00 2.68 03:51:01 AM 0.32 0.00 0.32 0.00 14.10 03:52:01 AM 0.30 0.00 0.30 0.00 17.08 03:53:01 AM 0.22 0.00 0.22 0.00 10.00 03:54:01 AM 0.40 0.00 0.40 0.00 21.82 03:55:01 AM 0.32 0.00 0.32 0.00 18.50 03:56:01 AM 0.17 0.00 0.17 0.00 8.28 03:57:01 AM 0.13 0.00 0.13 0.00 17.06 03:58:01 AM 0.10 0.00 0.10 0.00 7.33 03:59:01 AM 0.32 0.00 0.32 0.00 16.76 04:00:01 AM 0.18 0.00 0.18 0.00 16.83 04:01:02 AM 0.27 0.00 0.27 0.00 10.43 04:02:01 AM 0.22 0.00 0.22 0.00 18.47 04:03:01 AM 0.17 0.00 0.17 0.00 14.95 04:04:01 AM 0.37 0.00 0.37 0.00 18.15 04:05:01 AM 0.15 0.00 0.15 0.00 22.06 04:06:01 AM 0.38 0.00 0.38 0.00 7.33 04:07:01 AM 0.48 0.00 0.48 0.00 6.25 04:08:01 AM 0.35 0.00 0.35 0.00 6.67 04:09:01 AM 0.47 0.00 0.47 0.00 5.95 04:10:01 AM 0.37 0.00 0.37 0.00 6.17 04:11:01 AM 0.40 0.00 0.40 0.00 4.82 04:12:01 AM 0.35 0.00 0.35 0.00 9.30 04:13:01 AM 0.40 0.00 0.40 0.00 6.02 04:14:01 AM 0.48 0.00 0.48 0.00 12.50 04:15:01 AM 0.18 0.00 0.18 0.00 2.12 04:16:01 AM 0.12 0.00 0.12 0.00 2.67 04:17:01 AM 0.12 0.00 0.12 0.00 2.53 04:18:01 AM 0.13 0.00 0.13 0.00 4.67 04:19:01 AM 0.20 0.00 0.20 0.00 4.32 04:20:01 AM 0.23 0.00 0.23 0.00 9.10 04:21:01 AM 0.35 0.00 0.35 0.00 5.55 04:22:01 AM 0.25 0.00 0.25 0.00 8.50 04:23:01 AM 0.17 0.00 0.17 0.00 18.03 04:24:01 AM 0.23 0.00 0.23 0.00 17.68 04:25:01 AM 0.27 0.00 0.27 0.00 13.10 04:26:01 AM 0.18 0.00 0.18 0.00 15.85 04:27:01 AM 0.12 0.00 0.12 0.00 8.53 04:28:01 AM 0.13 0.00 0.13 0.00 16.26 04:29:01 AM 0.23 0.00 0.23 0.00 22.74 04:30:01 AM 0.22 0.00 0.22 0.00 3.48 04:31:01 AM 0.23 0.00 0.23 0.00 3.07 04:32:01 AM 0.22 0.00 0.22 0.00 5.61 04:33:01 AM 0.12 0.00 0.12 0.00 1.77 04:34:01 AM 0.50 0.00 0.50 0.00 9.56 04:35:01 AM 0.37 0.00 0.37 0.00 4.00 04:36:01 AM 0.37 0.00 0.37 0.00 9.85 04:37:01 AM 0.33 0.00 0.33 0.00 9.60 04:38:01 AM 0.43 0.00 0.43 0.00 5.45 04:39:01 AM 0.52 0.00 0.52 0.00 7.85 04:40:01 AM 0.27 0.00 0.27 0.00 5.18 04:41:01 AM 0.17 0.00 0.17 0.00 3.25 04:42:01 AM 0.20 0.00 0.20 0.00 6.43 04:43:01 AM 0.15 0.00 0.15 0.00 5.73 04:44:01 AM 0.33 0.00 0.33 0.00 5.42 04:45:01 AM 0.25 0.00 0.25 0.00 7.85 04:46:01 AM 0.17 0.00 0.17 0.00 8.81 04:47:01 AM 0.13 0.00 0.13 0.00 16.26 04:48:01 AM 0.13 0.00 0.13 0.00 16.13 04:49:01 AM 0.35 0.00 0.35 0.00 12.18 04:50:01 AM 0.22 0.00 0.22 0.00 16.96 04:51:01 AM 0.17 0.00 0.17 0.00 16.21 04:52:01 AM 0.35 0.00 0.35 0.00 26.46 04:53:01 AM 0.17 0.00 0.17 0.00 4.95 04:54:01 AM 0.32 0.00 0.32 0.00 5.25 04:55:01 AM 0.12 0.00 0.12 0.00 3.87 04:56:01 AM 0.18 0.00 0.18 0.00 2.28 04:57:01 AM 0.12 0.00 0.12 0.00 3.45 04:58:01 AM 0.12 0.00 0.12 0.00 1.18 04:59:01 AM 0.30 0.00 0.30 0.00 4.77 05:00:01 AM 0.17 0.00 0.17 0.00 8.53 05:01:01 AM 0.27 0.00 0.27 0.00 8.21 05:02:01 AM 0.23 0.00 0.23 0.00 3.33 05:03:01 AM 0.12 0.00 0.12 0.00 2.52 05:04:01 AM 0.55 0.00 0.55 0.00 8.88 05:05:01 AM 0.17 0.00 0.17 0.00 2.83 05:06:01 AM 0.33 0.00 0.33 0.00 8.51 05:07:01 AM 1.23 0.00 1.23 0.00 22.06 05:08:01 AM 0.23 0.00 0.23 0.00 9.20 05:09:02 AM 0.35 0.00 0.35 0.00 12.78 05:10:01 AM 0.17 0.00 0.17 0.00 16.84 05:11:01 AM 0.18 0.00 0.18 0.00 18.56 05:12:01 AM 0.15 0.00 0.15 0.00 8.56 05:13:01 AM 0.13 0.00 0.13 0.00 16.13 05:14:01 AM 0.37 0.00 0.37 0.00 20.54 05:15:01 AM 0.27 0.00 0.27 0.00 20.05 05:16:01 AM 0.23 0.00 0.23 0.00 4.95 05:17:01 AM 0.10 0.00 0.10 0.00 0.65 05:18:01 AM 0.13 0.00 0.13 0.00 4.12 05:19:01 AM 0.28 0.00 0.28 0.00 4.90 05:20:00 AM 0.19 0.00 0.19 0.00 3.96 05:20:01 AM 0.00 0.00 0.00 0.00 0.00 05:21:01 AM 0.18 0.00 0.18 0.00 2.05 05:22:01 AM 0.27 0.00 0.27 0.00 9.87 05:23:01 AM 0.18 0.00 0.18 0.00 14.01 05:24:01 AM 0.37 0.00 0.37 0.00 19.28 05:25:01 AM 0.15 0.00 0.15 0.00 14.70 05:26:01 AM 0.22 0.00 0.22 0.00 14.60 05:27:01 AM 0.15 0.00 0.15 0.00 13.61 05:28:01 AM 0.15 0.00 0.15 0.00 13.48 05:29:01 AM 0.33 0.00 0.33 0.00 18.53 05:30:01 AM 18.28 0.28 18.00 33.86 853.79 05:31:01 AM 24.24 0.42 23.83 48.25 3624.93 Average: 0.42 0.02 0.40 1.95 23.84 12:00:01 AM kbmemfree kbavail kbmemused %memused kbbuffers kbcached kbcommit %commit kbactive kbinact kbdirty 12:01:01 AM 4798092 6909928 3084340 39.13 2688 2278868 821196 9.19 268348 2429752 4 12:02:01 AM 4798320 6910276 3084112 39.13 2688 2278988 821196 9.19 268492 2429724 56 12:03:01 AM 4798688 6910716 3083744 39.12 2688 2279060 821196 9.19 268492 2429532 72 12:04:01 AM 4798440 6910468 3083992 39.12 2688 2279060 821196 9.19 268492 2429740 4 12:05:01 AM 4798080 6910164 3084352 39.13 2688 2279124 821196 9.19 268492 2429892 64 12:06:01 AM 4798448 6910596 3083984 39.12 2688 2279188 821196 9.19 268492 2429880 16 12:07:01 AM 4797972 6910120 3084460 39.13 2688 2279188 818400 9.16 268492 2429908 4 12:08:01 AM 4798344 6910664 3084088 39.13 2688 2279376 819804 9.18 268700 2429648 72 12:09:01 AM 4798020 6910356 3084412 39.13 2688 2279376 819804 9.18 268700 2429736 4 12:10:01 AM 4797944 6910280 3084488 39.13 2688 2279376 821024 9.19 268700 2429900 4 12:11:01 AM 4798052 6910512 3084380 39.13 2688 2279500 821024 9.19 268700 2429792 68 12:12:01 AM 4798116 6910576 3084316 39.13 2688 2279500 821024 9.19 268700 2429800 4 12:13:01 AM 4798048 6910560 3084384 39.13 2688 2279552 821024 9.19 268700 2429864 56 12:14:01 AM 4798040 6910624 3084392 39.13 2688 2279624 821024 9.19 268700 2430012 72 12:15:01 AM 4798108 6910692 3084324 39.13 2688 2279624 821024 9.19 268700 2429944 4 12:16:01 AM 4798032 6910676 3084400 39.13 2688 2279684 821024 9.19 268700 2430004 64 12:17:01 AM 4797552 6910212 3084880 39.14 2688 2279700 821024 9.19 268700 2430056 4 12:18:01 AM 4797824 6910484 3084608 39.13 2688 2279700 821024 9.19 268700 2430040 4 12:19:01 AM 4797664 6910328 3084768 39.13 2688 2279704 821024 9.19 268704 2430128 12 12:20:00 AM 4798128 6910792 3084304 39.13 2688 2279704 844428 9.46 268704 2429712 8 12:20:01 AM 4797708 6910372 3084724 39.13 2688 2279704 844428 9.46 268704 2430060 20 12:21:01 AM 4797712 6910380 3084720 39.13 2688 2279708 844428 9.46 268704 2430064 4 12:22:01 AM 4797824 6910492 3084608 39.13 2688 2279708 844428 9.46 268704 2430064 4 12:23:01 AM 4797696 6910364 3084736 39.13 2688 2279708 844428 9.46 268704 2430180 4 12:24:01 AM 4797312 6910132 3085120 39.14 2688 2279860 816712 9.14 268704 2430404 152 12:25:01 AM 4779996 6909776 3102436 39.36 2688 2296768 815140 9.13 270976 2445372 100 12:26:01 AM 4779920 6910064 3102512 39.36 2688 2297148 815140 9.13 270976 2445528 56 12:27:01 AM 4779164 6909692 3103268 39.37 2688 2297532 815140 9.13 270976 2446188 204 12:28:01 AM 4779344 6910256 3103088 39.37 2688 2297916 830556 9.30 270976 2446188 136 12:29:01 AM 4778756 6910048 3103676 39.37 2688 2298296 830556 9.30 270976 2446688 100 12:30:01 AM 4778052 6909724 3104380 39.38 2688 2298676 846584 9.48 270976 2447392 52 12:31:01 AM 4777040 6909472 3105392 39.40 2688 2299424 827120 9.26 270976 2448276 568 12:32:01 AM 4777400 6909928 3105032 39.39 2688 2299520 827120 9.26 270976 2448108 4 12:33:01 AM 4777092 6909624 3105340 39.40 2688 2299524 827120 9.26 270976 2448376 12 12:34:01 AM 4777072 6909684 3105360 39.40 2688 2299604 827120 9.26 270976 2448484 88 12:35:01 AM 4777456 6910068 3104976 39.39 2688 2299604 827120 9.26 270976 2448216 8 12:36:01 AM 4777080 6909776 3105352 39.40 2688 2299688 827120 9.26 270976 2448300 88 12:37:01 AM 4777208 6909904 3105224 39.39 2688 2299688 827120 9.26 270976 2448304 4 12:38:01 AM 4776808 6909504 3105624 39.40 2688 2299688 827120 9.26 270976 2448644 4 12:39:01 AM 4776692 6909604 3105740 39.40 2688 2299904 827120 9.26 270976 2448920 40 12:40:01 AM 4776256 6909240 3106176 39.41 2688 2299976 809748 9.07 270976 2449252 4 12:41:01 AM 4775556 6908548 3106876 39.42 2688 2299980 825140 9.24 270976 2449756 4 12:42:01 AM 4775556 6908564 3106876 39.42 2688 2299996 825140 9.24 270976 2449844 12 12:43:01 AM 4775796 6908812 3106636 39.41 2688 2300004 825140 9.24 270976 2449564 8 12:44:01 AM 4775636 6908700 3106796 39.41 2688 2300052 825140 9.24 270976 2449932 4 12:45:01 AM 4775116 6908476 3107316 39.42 2688 2300348 825140 9.24 270976 2450312 224 12:46:01 AM 4775136 6909072 3107296 39.42 2688 2300928 825140 9.24 271076 2450292 164 12:47:01 AM 4774428 6908748 3108004 39.43 2688 2301312 825140 9.24 271076 2450796 112 12:48:01 AM 4774084 6908800 3108348 39.43 2688 2301708 825140 9.24 271076 2451236 52 12:49:01 AM 4773588 6908688 3108844 39.44 2688 2302092 825140 9.24 271076 2451736 216 12:50:01 AM 4773132 6908616 3109300 39.45 2688 2302476 813036 9.10 271076 2452180 132 12:51:01 AM 4773188 6908984 3109244 39.45 2688 2302776 813036 9.10 271188 2452268 32 12:52:01 AM 4772952 6908800 3109480 39.45 2688 2302828 813036 9.10 271188 2452320 4 12:53:01 AM 4772736 6908584 3109696 39.45 2688 2302836 813036 9.10 271188 2452436 4 12:54:01 AM 4772284 6908340 3110148 39.46 2688 2303036 813036 9.10 271188 2452792 124 12:55:01 AM 4772316 6908608 3110116 39.46 2688 2303280 813036 9.10 271188 2452780 188 12:56:01 AM 4772192 6908848 3110240 39.46 2688 2303644 813036 9.10 271188 2453144 128 12:57:01 AM 4771624 6908680 3110808 39.47 2688 2304044 813036 9.10 271188 2453664 72 12:58:01 AM 4771280 6908720 3111152 39.47 2688 2304428 813036 9.10 271188 2453932 224 12:59:01 AM 4770800 6908624 3111632 39.48 2688 2304808 813036 9.10 271188 2454492 148 01:00:01 AM 4769796 6908008 3112636 39.49 2688 2305188 845200 9.46 271188 2455044 68 01:01:01 AM 4768704 6907636 3113728 39.50 2688 2305924 824204 9.23 271188 2456160 572 01:02:01 AM 4769616 6908660 3112816 39.49 2688 2306020 824204 9.23 271224 2455660 4 01:03:01 AM 4769632 6908680 3112800 39.49 2688 2306024 824204 9.23 271224 2455548 4 01:04:01 AM 4769164 6908292 3113268 39.50 2688 2306104 824204 9.23 271224 2455852 88 01:05:01 AM 4769384 6908512 3113048 39.49 2688 2306104 824204 9.23 271224 2455784 4 01:06:01 AM 4769196 6908400 3113236 39.50 2688 2306180 807772 9.04 271252 2455696 84 01:07:01 AM 4768976 6908184 3113456 39.50 2688 2306184 807772 9.04 271252 2455796 4 01:08:01 AM 4769140 6908348 3113292 39.50 2688 2306184 807772 9.04 271252 2455816 4 01:09:01 AM 4769164 6908584 3113268 39.50 2688 2306396 823212 9.22 271252 2456064 56 01:10:01 AM 4768896 6908392 3113536 39.50 2688 2306472 823000 9.22 271252 2456116 8 01:11:01 AM 4768924 6908416 3113508 39.50 2688 2306472 823000 9.22 271252 2456000 4 01:12:01 AM 4769024 6908568 3113408 39.50 2688 2306524 823000 9.22 271252 2456048 56 01:13:01 AM 4768904 6908756 3113528 39.50 2688 2306840 823000 9.22 271252 2456360 56 01:14:01 AM 4768204 6908436 3114228 39.51 2688 2307220 823000 9.22 271252 2456948 48 01:15:01 AM 4767736 6908356 3114696 39.51 2688 2307608 823000 9.22 271252 2457384 196 01:16:01 AM 4767524 6908532 3114908 39.52 2688 2307988 823000 9.22 271252 2457648 116 01:17:01 AM 4767116 6908496 3115316 39.52 2688 2308368 823000 9.22 271252 2458096 36 01:18:01 AM 4766820 6908592 3115612 39.53 2688 2308752 823000 9.22 271252 2458364 188 01:19:01 AM 4766296 6908356 3116136 39.53 2688 2309040 823000 9.22 271252 2458916 48 01:20:01 AM 4766044 6908204 3116388 39.54 2688 2309140 844972 9.46 271252 2459160 100 01:21:01 AM 4765972 6908500 3116460 39.54 2688 2309500 825508 9.24 271252 2459232 68 01:22:01 AM 4764856 6907768 3117576 39.55 2688 2309880 825508 9.24 271252 2460288 220 01:23:01 AM 4764356 6907652 3118076 39.56 2688 2310272 825508 9.24 271252 2460788 148 01:24:01 AM 4763668 6907344 3118764 39.57 2688 2310652 825508 9.24 271252 2461280 4 01:25:01 AM 4763952 6908016 3118480 39.56 2688 2311032 825508 9.24 271248 2461332 172 01:26:01 AM 4763460 6907916 3118972 39.57 2688 2311432 825508 9.24 271248 2461884 96 01:27:01 AM 4763324 6907992 3119108 39.57 2688 2311636 825508 9.24 271248 2461980 16 01:28:01 AM 4762904 6907816 3119528 39.58 2688 2311880 825508 9.24 271248 2462348 4 01:29:01 AM 4762544 6907908 3119888 39.58 2688 2312340 825508 9.24 271248 2462748 184 01:30:01 AM 4762048 6907796 3120384 39.59 2688 2312720 814132 9.12 271248 2463172 104 01:31:01 AM 4761764 6907908 3120668 39.59 2688 2313104 814132 9.12 271248 2463632 36 01:32:01 AM 4761472 6907992 3120960 39.59 2688 2313488 814132 9.12 271248 2463824 180 01:33:01 AM 4760592 6907492 3121840 39.61 2688 2313868 814132 9.12 271248 2464480 40 01:34:01 AM 4760404 6907688 3122028 39.61 2688 2314252 814132 9.12 271248 2464784 92 01:35:01 AM 4759776 6907648 3122656 39.62 2688 2314832 814132 9.12 271248 2465400 4 01:36:01 AM 4760136 6908008 3122296 39.61 2688 2314832 814132 9.12 271248 2465196 4 01:37:01 AM 4760220 6908104 3122212 39.61 2688 2314844 814132 9.12 271248 2465204 16 01:38:01 AM 4760112 6908068 3122320 39.61 2688 2314916 814132 9.12 271248 2465280 4 01:39:01 AM 4760068 6908024 3122364 39.61 2688 2314916 814132 9.12 271248 2465352 4 01:40:01 AM 4759628 6907668 3122804 39.62 2688 2315000 805956 9.02 271248 2465484 4 01:41:01 AM 4759572 6907628 3122860 39.62 2688 2315004 805956 9.02 271248 2465584 4 01:42:01 AM 4759688 6907924 3122744 39.62 2688 2315184 805956 9.02 271248 2465580 16 01:43:01 AM 4759324 6907668 3123108 39.62 2688 2315292 828980 9.28 271248 2465796 64 01:44:01 AM 4759196 6907544 3123236 39.62 2688 2315296 823136 9.22 280308 2456680 20 01:45:01 AM 4759156 6907504 3123276 39.62 2688 2315296 823136 9.22 280308 2456816 4 01:46:01 AM 4759172 6907748 3123260 39.62 2688 2315532 823136 9.22 280308 2457132 168 01:47:02 AM 4758716 6907688 3123716 39.63 2688 2315928 823136 9.22 280308 2457428 72 01:48:01 AM 4758296 6907632 3124136 39.63 2688 2316292 823136 9.22 280308 2457904 204 01:49:01 AM 4758060 6907792 3124372 39.64 2688 2316680 823136 9.22 280308 2458300 144 01:50:01 AM 4757216 6907320 3125216 39.65 2688 2317060 839444 9.40 280308 2458840 56 01:51:01 AM 4757200 6907684 3125232 39.65 2688 2317444 839444 9.40 280308 2458992 24 01:52:01 AM 4756924 6907816 3125508 39.65 2688 2317844 839444 9.40 280308 2459284 4 01:53:01 AM 4756880 6907904 3125552 39.65 2688 2317976 819880 9.18 280308 2459404 92 01:54:01 AM 4756732 6907984 3125700 39.65 2688 2318204 819880 9.18 280308 2459712 64 01:55:01 AM 4756232 6907884 3126200 39.66 2688 2318612 819880 9.18 280308 2460048 52 01:56:01 AM 4755892 6907936 3126540 39.66 2688 2318996 819880 9.18 280308 2460440 176 01:57:01 AM 4755476 6907900 3126956 39.67 2688 2319380 819880 9.18 280308 2460816 128 01:58:01 AM 4755048 6907852 3127384 39.68 2688 2319760 819880 9.18 280308 2461196 52 01:59:01 AM 4754580 6907768 3127852 39.68 2688 2320144 819880 9.18 280308 2461740 220 02:00:01 AM 4754008 6907580 3128424 39.69 2688 2320528 805940 9.02 280308 2462172 128 02:01:01 AM 4752520 6906664 3129912 39.71 2688 2321092 805940 9.02 280308 2463444 4 02:02:01 AM 4753588 6907740 3128844 39.69 2688 2321100 805940 9.02 280312 2462636 4 02:03:01 AM 4753612 6907844 3128820 39.69 2688 2321180 805940 9.02 280312 2462720 88 02:04:01 AM 4753452 6907684 3128980 39.70 2688 2321180 805940 9.02 280312 2462788 4 02:05:01 AM 4753592 6907828 3128840 39.69 2688 2321184 805940 9.02 280312 2462724 4 02:06:01 AM 4753600 6907916 3128832 39.69 2688 2321264 805940 9.02 280312 2462804 4 02:07:01 AM 4753544 6907860 3128888 39.69 2688 2321264 805940 9.02 280312 2462804 4 02:08:01 AM 4753248 6907744 3129184 39.70 2688 2321448 805940 9.02 280312 2463008 16 02:09:01 AM 4753032 6907632 3129400 39.70 2688 2321552 805940 9.02 280312 2463288 80 02:10:01 AM 4753028 6907628 3129404 39.70 2688 2321552 828296 9.27 280312 2463220 4 02:11:01 AM 4752920 6907524 3129512 39.70 2688 2321556 828296 9.27 280312 2463108 4 02:12:01 AM 4752932 6907608 3129500 39.70 2688 2321628 812760 9.10 280312 2463188 4 02:13:01 AM 4752908 6907588 3129524 39.70 2688 2321632 812760 9.10 280312 2463192 4 02:14:01 AM 4752612 6907372 3129820 39.71 2688 2321712 812760 9.10 280312 2463340 12 02:15:01 AM 4752752 6907512 3129680 39.70 2688 2321712 812760 9.10 280312 2463272 8 02:16:01 AM 4752696 6907540 3129736 39.71 2688 2321796 812760 9.10 280312 2463356 4 02:17:01 AM 4752644 6907488 3129788 39.71 2688 2321796 812760 9.10 280312 2463356 4 02:18:01 AM 4752680 6907608 3129752 39.71 2688 2321880 828156 9.27 280312 2463556 4 02:19:01 AM 4752688 6907620 3129744 39.71 2688 2321884 828156 9.27 280312 2463512 4 02:20:01 AM 4752496 6907508 3129936 39.71 2688 2321964 822372 9.21 280312 2463640 4 02:21:01 AM 4752808 6907824 3129624 39.70 2688 2321968 822372 9.21 280312 2463528 4 02:22:01 AM 4752696 6907792 3129736 39.71 2688 2322048 822372 9.21 280312 2463620 88 02:23:01 AM 4752604 6907700 3129828 39.71 2688 2322048 822372 9.21 280312 2463620 4 02:24:01 AM 4752096 6907280 3130336 39.71 2688 2322136 822372 9.21 280320 2464036 96 02:25:01 AM 4752092 6907652 3130340 39.71 2688 2322516 822372 9.21 280320 2464064 96 02:26:01 AM 4751820 6907764 3130612 39.72 2688 2322900 822372 9.21 280320 2464448 24 02:27:01 AM 4751368 6907700 3131064 39.72 2688 2323280 822372 9.21 280328 2464888 176 02:28:01 AM 4750748 6907464 3131684 39.73 2688 2323664 822372 9.21 280320 2465520 180 02:29:01 AM 4750580 6907692 3131852 39.73 2688 2324060 822372 9.21 280320 2465804 152 02:30:01 AM 4749996 6907484 3132436 39.74 2688 2324444 840592 9.41 280320 2466132 72 02:31:01 AM 4749696 6907404 3132736 39.74 2688 2324656 840592 9.41 280320 2466516 60 02:32:01 AM 4749608 6907424 3132824 39.74 2688 2324764 840592 9.41 280320 2466632 4 02:33:01 AM 4749404 6907224 3133028 39.75 2688 2324768 840592 9.41 280320 2466784 4 02:34:01 AM 4749596 6907512 3132836 39.74 2688 2324864 840592 9.41 280320 2466540 16 02:35:01 AM 4749836 6907752 3132596 39.74 2688 2324864 840592 9.41 280320 2466456 8 02:36:01 AM 4749716 6907728 3132716 39.74 2688 2324960 840592 9.41 280320 2466552 100 02:37:01 AM 4749692 6907704 3132740 39.74 2688 2324960 840592 9.41 280320 2466616 4 02:38:01 AM 4749456 6907560 3132976 39.75 2688 2325052 840592 9.41 280320 2466644 100 02:39:01 AM 4749512 6907620 3132920 39.75 2688 2325056 840592 9.41 280320 2466740 8 02:40:01 AM 4749048 6907248 3133384 39.75 2688 2325148 838320 9.39 280320 2467120 100 02:41:01 AM 4749288 6907496 3133144 39.75 2688 2325152 838320 9.39 280320 2467012 4 02:42:01 AM 4749040 6907340 3133392 39.75 2688 2325244 822000 9.20 280320 2467232 100 02:43:01 AM 4749088 6907388 3133344 39.75 2688 2325244 822000 9.20 280320 2467196 4 02:44:01 AM 4748640 6907036 3133792 39.76 2688 2325340 822000 9.20 280320 2467508 108 02:45:01 AM 4748816 6907444 3133616 39.75 2688 2325580 822000 9.20 280320 2467476 236 02:46:01 AM 4748184 6907196 3134248 39.76 2688 2325964 822000 9.20 280320 2467908 116 02:47:01 AM 4747176 6906572 3135256 39.78 2688 2326348 822000 9.20 280320 2468936 52 02:48:01 AM 4747500 6907280 3134932 39.77 2688 2326728 822000 9.20 280320 2468908 196 02:49:01 AM 4746840 6907004 3135592 39.78 2688 2327112 822000 9.20 280320 2469368 116 02:50:01 AM 4746132 6906680 3136300 39.79 2688 2327496 841124 9.42 280320 2470032 40 02:51:01 AM 4746228 6907112 3136204 39.79 2688 2327824 821660 9.20 280320 2470020 4 02:52:01 AM 4745900 6906900 3136532 39.79 2688 2327940 821660 9.20 280320 2470144 4 02:53:01 AM 4746068 6907068 3136364 39.79 2688 2327940 821660 9.20 280320 2470144 4 02:54:01 AM 4745932 6907024 3136500 39.79 2688 2328032 821660 9.20 280320 2470308 4 02:55:02 AM 4746160 6907256 3136272 39.79 2688 2328036 821660 9.20 280320 2470244 4 02:56:01 AM 4745896 6907084 3136536 39.79 2688 2328128 821660 9.20 280320 2470336 4 02:57:01 AM 4745808 6906996 3136624 39.79 2688 2328128 821660 9.20 280320 2470336 4 02:58:01 AM 4745772 6907052 3136660 39.79 2688 2328220 821660 9.20 280320 2470432 4 02:59:01 AM 4745756 6907040 3136676 39.79 2688 2328224 821660 9.20 280320 2470504 4 03:00:01 AM 4745460 6906836 3136972 39.80 2688 2328316 843996 9.45 280320 2470672 4 03:01:01 AM 4744948 6906332 3137484 39.80 2688 2328320 843996 9.45 280320 2471140 4 03:02:01 AM 4745196 6906672 3137236 39.80 2688 2328412 843996 9.45 280328 2470928 100 03:03:01 AM 4745236 6906712 3137196 39.80 2688 2328412 843996 9.45 280328 2470932 4 03:04:01 AM 4745104 6906676 3137328 39.80 2688 2328508 843996 9.45 280328 2471100 100 03:05:01 AM 4744764 6906568 3137668 39.81 2688 2328748 843996 9.45 280328 2471380 232 03:06:01 AM 4744476 6906668 3137956 39.81 2688 2329128 843996 9.45 280328 2471652 4 03:07:01 AM 4744168 6906752 3138264 39.81 2688 2329520 843996 9.45 280328 2472044 12 03:08:01 AM 4744028 6906996 3138404 39.82 2688 2329912 828612 9.28 280328 2472428 116 03:09:01 AM 4743272 6906620 3139160 39.82 2688 2330292 828612 9.28 280328 2472876 40 03:10:01 AM 4742700 6906432 3139732 39.83 2688 2330676 822656 9.21 280328 2473428 52 03:11:01 AM 4742548 6906604 3139884 39.83 2688 2330992 822656 9.21 280328 2473520 4 03:12:01 AM 4742580 6906748 3139852 39.83 2688 2331104 822656 9.21 280328 2473640 4 03:13:01 AM 4742612 6906780 3139820 39.83 2688 2331104 822656 9.21 280328 2473640 4 03:14:01 AM 4742536 6906796 3139896 39.83 2688 2331196 822656 9.21 280328 2473808 4 03:15:01 AM 4742532 6906796 3139900 39.83 2688 2331200 822656 9.21 280328 2473744 4 03:16:01 AM 4742552 6906908 3139880 39.83 2688 2331292 822656 9.21 280328 2473836 12 03:17:01 AM 4742484 6906840 3139948 39.83 2688 2331292 822656 9.21 280328 2473836 4 03:18:01 AM 4742416 6906868 3140016 39.84 2688 2331388 822656 9.21 280328 2473936 4 03:19:01 AM 4742120 6906572 3140312 39.84 2688 2331388 822656 9.21 280328 2474004 4 03:20:01 AM 4741836 6906384 3140596 39.84 2688 2331480 836628 9.37 281460 2473016 4 03:21:01 AM 4742172 6906724 3140260 39.84 2688 2331484 836628 9.37 281460 2472904 4 03:22:01 AM 4741704 6906348 3140728 39.84 2688 2331576 836628 9.37 281460 2473300 4 03:23:01 AM 4741736 6906384 3140696 39.84 2688 2331580 836628 9.37 281460 2473304 4 03:24:01 AM 4743528 6908288 3138904 39.82 2688 2331748 836628 9.37 281460 2471452 176 03:25:01 AM 4743000 6908032 3139432 39.83 2688 2331964 836628 9.37 281460 2472072 140 03:26:01 AM 4742952 6908356 3139480 39.83 2688 2332344 836628 9.37 281460 2472164 72 03:27:01 AM 4742568 6908360 3139864 39.83 2688 2332724 836628 9.37 281460 2472572 52 03:28:01 AM 4741912 6908088 3140520 39.84 2688 2333108 836628 9.37 281460 2473076 208 03:29:01 AM 4741536 6908088 3140896 39.85 2688 2333492 836628 9.37 281460 2473472 128 03:30:01 AM 4741076 6908024 3141356 39.85 2688 2333888 817796 9.16 281460 2473848 68 03:31:01 AM 4740516 6908048 3141916 39.86 2688 2334464 817796 9.16 281460 2474552 360 03:32:01 AM 4740488 6908352 3141944 39.86 2688 2334796 817796 9.16 281460 2474676 12 03:33:01 AM 4740108 6907972 3142324 39.86 2688 2334796 817796 9.16 281460 2474880 16 03:34:01 AM 4740096 6908040 3142336 39.87 2688 2334876 817796 9.16 281464 2474836 92 03:35:01 AM 4740184 6908132 3142248 39.86 2688 2334880 817796 9.16 281460 2474760 8 03:36:01 AM 4740240 6908196 3142192 39.86 2688 2334888 817796 9.16 281460 2474744 16 03:37:01 AM 4740212 6908240 3142220 39.86 2688 2334960 817796 9.16 281460 2474804 4 03:38:01 AM 4740192 6908224 3142240 39.86 2688 2334964 817796 9.16 281460 2474844 4 03:39:01 AM 4737740 6905952 3144692 39.89 2688 2335144 817796 9.16 281460 2477260 4 03:40:01 AM 4737636 6905952 3144796 39.90 2688 2335248 840892 9.42 281460 2477416 4 03:41:01 AM 4737760 6906084 3144672 39.89 2688 2335256 840892 9.42 281460 2477196 4 03:42:01 AM 4737624 6906004 3144808 39.90 2688 2335312 840892 9.42 281460 2477364 64 03:43:01 AM 4737396 6906012 3145036 39.90 2688 2335548 840892 9.42 281460 2477480 232 03:44:01 AM 4736516 6905516 3145916 39.91 2688 2335932 840892 9.42 281460 2478396 100 03:45:01 AM 4736708 6906092 3145724 39.91 2688 2336312 840892 9.42 281460 2478256 24 03:46:01 AM 4735908 6905676 3146524 39.92 2688 2336696 840892 9.42 281460 2478932 176 03:47:01 AM 4735588 6905748 3146844 39.92 2688 2337096 840892 9.42 281460 2479340 208 03:48:01 AM 4735260 6905792 3147172 39.93 2688 2337460 840892 9.42 281460 2479712 116 03:49:01 AM 4735252 6906140 3147180 39.93 2688 2337816 840892 9.42 281460 2479864 32 03:50:01 AM 4734788 6905804 3147644 39.93 2688 2337944 840892 9.42 281460 2480040 108 03:51:01 AM 4734676 6905968 3147756 39.93 2688 2338224 840892 9.42 281460 2480324 36 03:52:01 AM 4734292 6905968 3148140 39.94 2688 2338608 840892 9.42 281460 2480624 24 03:53:01 AM 4733800 6905856 3148632 39.94 2688 2338988 840892 9.42 281460 2481056 176 03:54:01 AM 4733432 6905872 3149000 39.95 2688 2339372 840892 9.42 281460 2481656 104 03:55:01 AM 4733112 6905936 3149320 39.95 2688 2339756 840892 9.42 281460 2481856 40 03:56:01 AM 4732840 6906044 3149592 39.96 2688 2340136 840892 9.42 281460 2482352 220 03:57:01 AM 4732320 6905812 3150112 39.96 2688 2340416 840892 9.42 281460 2482640 16 03:58:01 AM 4732156 6905896 3150276 39.97 2688 2340664 823664 9.22 281460 2482812 68 03:59:01 AM 4731864 6905976 3150568 39.97 2688 2341044 823664 9.22 281460 2483260 108 04:00:01 AM 4731248 6905744 3151184 39.98 2688 2341428 817636 9.16 281460 2483808 24 04:01:02 AM 4729820 6904704 3152612 40.00 2688 2341812 817636 9.16 281460 2484664 176 04:02:01 AM 4730720 6905988 3151712 39.98 2688 2342196 817636 9.16 281464 2484464 100 04:03:01 AM 4730068 6905704 3152364 39.99 2688 2342564 817636 9.16 281464 2484716 56 04:04:01 AM 4729768 6905792 3152664 40.00 2688 2342944 817636 9.16 281464 2485252 52 04:05:01 AM 4729028 6905660 3153404 40.01 2688 2343552 817636 9.16 281464 2485908 36 04:06:01 AM 4729096 6905800 3153336 40.00 2688 2343624 817636 9.16 281464 2485800 4 04:07:01 AM 4729120 6905824 3153312 40.00 2688 2343624 817636 9.16 281464 2485800 4 04:08:01 AM 4728976 6905764 3153456 40.01 2688 2343708 817636 9.16 281464 2485888 4 04:09:01 AM 4728896 6905684 3153536 40.01 2688 2343708 817636 9.16 281464 2485956 4 04:10:01 AM 4728748 6905612 3153684 40.01 2688 2343784 811764 9.09 281464 2486196 4 04:11:01 AM 4728996 6905868 3153436 40.01 2688 2343788 811764 9.09 281464 2485968 4 04:12:01 AM 4728732 6905780 3153700 40.01 2688 2343964 811764 9.09 281464 2486148 4 04:13:01 AM 4728580 6905684 3153852 40.01 2688 2344020 811764 9.09 281464 2486212 4 04:14:01 AM 4728344 6905592 3154088 40.01 2688 2344164 811764 9.09 281472 2486416 4 04:15:01 AM 4728440 6905688 3153992 40.01 2688 2344164 811764 9.09 281472 2486348 4 04:16:01 AM 4728484 6905828 3153948 40.01 2688 2344260 811764 9.09 281472 2486444 48 04:17:01 AM 4728544 6905948 3153888 40.01 2688 2344320 811764 9.09 281472 2486504 56 04:18:01 AM 4728204 6905672 3154228 40.02 2688 2344384 811764 9.09 281472 2486684 4 04:19:01 AM 4727880 6905536 3154552 40.02 2688 2344572 811764 9.09 281476 2486820 156 04:20:01 AM 4727652 6905312 3154780 40.02 2688 2344576 815584 9.13 281476 2486988 8 04:21:01 AM 4727980 6905776 3154452 40.02 2688 2344712 815584 9.13 281476 2486884 144 04:22:01 AM 4727840 6905832 3154592 40.02 2688 2344916 831000 9.30 281476 2487088 204 04:23:01 AM 4727420 6905796 3155012 40.03 2688 2345300 831000 9.30 281476 2487472 84 04:24:01 AM 4726872 6905644 3155560 40.03 2688 2345696 831000 9.30 281476 2487936 32 04:25:01 AM 4726616 6905768 3155816 40.04 2688 2346064 831000 9.30 281476 2488244 104 04:26:01 AM 4726376 6905872 3156056 40.04 2688 2346416 831000 9.30 281476 2488592 40 04:27:01 AM 4726068 6905944 3156364 40.04 2688 2346796 831000 9.30 281476 2488968 188 04:28:01 AM 4725320 6905872 3157112 40.05 2688 2347464 831000 9.30 281476 2489652 396 04:29:01 AM 4725092 6905852 3157340 40.06 2688 2347672 831000 9.30 281476 2489924 4 04:30:01 AM 4724772 6905532 3157660 40.06 2688 2347672 833404 9.33 281476 2490088 4 04:31:01 AM 4724672 6905516 3157760 40.06 2688 2347756 833404 9.33 281476 2490212 88 04:32:01 AM 4724968 6905812 3157464 40.06 2688 2347756 833404 9.33 281476 2489944 4 04:33:01 AM 4724780 6905628 3157652 40.06 2688 2347768 833404 9.33 281476 2490152 16 04:34:01 AM 4724828 6905752 3157604 40.06 2688 2347836 833404 9.33 281476 2490104 4 04:35:01 AM 4724920 6905844 3157512 40.06 2688 2347836 833404 9.33 281476 2490036 4 04:36:01 AM 4724664 6905776 3157768 40.06 2688 2348024 833404 9.33 281476 2490228 4 04:37:01 AM 4724624 6905924 3157808 40.06 2688 2348212 833404 9.33 281476 2490460 4 04:38:01 AM 4724572 6905872 3157860 40.06 2688 2348212 833404 9.33 281476 2490416 4 04:39:01 AM 4724360 6905704 3158072 40.06 2688 2348256 817648 9.16 281476 2490528 4 04:40:01 AM 4724212 6905636 3158220 40.07 2688 2348336 817176 9.15 281492 2490736 20 04:41:01 AM 4723780 6905312 3158652 40.07 2688 2348444 817176 9.15 281492 2491000 76 04:42:01 AM 4724036 6905632 3158396 40.07 2688 2348508 817176 9.15 281492 2490700 20 04:43:01 AM 4724060 6905788 3158372 40.07 2688 2348640 817176 9.15 281492 2490832 4 04:44:01 AM 4723860 6905592 3158572 40.07 2688 2348644 817176 9.15 281492 2491020 4 04:45:01 AM 4723816 6905692 3158616 40.07 2688 2348788 817176 9.15 281492 2490972 4 04:46:01 AM 4723444 6905700 3158988 40.08 2688 2349172 835088 9.35 281492 2491468 176 04:47:01 AM 4723224 6905872 3159208 40.08 2688 2349556 835088 9.35 281492 2491908 112 04:48:01 AM 4722488 6905508 3159944 40.09 2688 2349936 835088 9.35 281492 2492232 40 04:49:01 AM 4722196 6905604 3160236 40.09 2688 2350324 835088 9.35 281492 2492688 224 04:50:01 AM 4721780 6905568 3160652 40.10 2688 2350704 823808 9.22 281492 2493000 144 04:51:01 AM 4721700 6905860 3160732 40.10 2688 2351076 823808 9.22 281492 2493256 68 04:52:01 AM 4721024 6905824 3161408 40.11 2688 2351708 823808 9.22 281492 2493896 32 04:53:01 AM 4720780 6905656 3161652 40.11 2688 2351784 823808 9.22 281492 2493976 4 04:54:01 AM 4720888 6905764 3161544 40.11 2688 2351784 823808 9.22 281492 2494116 12 04:55:01 AM 4720472 6905428 3161960 40.11 2688 2351864 823808 9.22 281492 2494264 4 04:56:01 AM 4720724 6905684 3161708 40.11 2688 2351868 823808 9.22 281492 2494064 4 04:57:01 AM 4720736 6905776 3161696 40.11 2688 2351948 823808 9.22 281492 2494108 4 04:58:01 AM 4720660 6905700 3161772 40.11 2688 2351948 823808 9.22 281492 2494144 4 04:59:01 AM 4720440 6905656 3161992 40.11 2688 2352124 807424 9.04 281496 2494408 180 05:00:01 AM 4720324 6905596 3162108 40.12 2688 2352180 828652 9.28 281492 2494508 16 05:01:01 AM 4719692 6905116 3162740 40.12 2688 2352324 828652 9.28 281496 2494764 4 05:02:01 AM 4720100 6905524 3162332 40.12 2688 2352324 828652 9.28 281500 2494528 4 05:03:01 AM 4720292 6905764 3162140 40.12 2688 2352372 828652 9.28 281500 2494580 8 05:04:01 AM 4720356 6905840 3162076 40.12 2688 2352384 828652 9.28 281500 2494664 4 05:05:01 AM 4720032 6905700 3162400 40.12 2688 2352568 828652 9.28 281504 2494764 140 05:06:01 AM 4717644 6903312 3164788 40.15 2688 2352568 826988 9.26 281504 2496852 4 05:07:01 AM 4721904 6907692 3160528 40.10 2688 2352688 824580 9.23 282472 2491876 32 05:08:01 AM 4719692 6905692 3162740 40.12 2688 2352908 824580 9.23 282472 2494128 52 05:09:02 AM 4719352 6905740 3163080 40.13 2688 2353288 824580 9.23 282472 2494584 236 05:10:01 AM 4718688 6905448 3163744 40.14 2688 2353676 840292 9.41 282472 2495008 160 05:11:01 AM 4718668 6905808 3163764 40.14 2688 2354040 840292 9.41 282472 2495292 4 05:12:01 AM 4718140 6905672 3164292 40.14 2688 2354440 840292 9.41 282472 2495672 204 05:13:01 AM 4717720 6905644 3164712 40.15 2688 2354824 840292 9.41 282472 2496064 132 05:14:01 AM 4717016 6905416 3165416 40.16 2688 2355300 823864 9.22 282472 2496636 156 05:15:01 AM 4716676 6905524 3165756 40.16 2688 2355744 823864 9.22 282472 2496992 84 05:16:01 AM 4716768 6905616 3165664 40.16 2688 2355744 823864 9.22 282472 2496992 4 05:17:01 AM 4716660 6905588 3165772 40.16 2688 2355824 823864 9.22 282472 2497184 88 05:18:01 AM 4716268 6905200 3166164 40.17 2688 2355828 823864 9.22 282472 2497572 16 05:19:01 AM 4716584 6905516 3165848 40.16 2688 2355836 823864 9.22 282472 2497292 20 05:20:00 AM 4717092 6906100 3165340 40.16 2688 2355904 839288 9.40 282472 2496956 4 05:20:01 AM 4716608 6905620 3165824 40.16 2688 2355912 839288 9.40 282472 2497308 24 05:21:01 AM 4716724 6905740 3165708 40.16 2688 2355912 839288 9.40 282472 2497312 4 05:22:01 AM 4716468 6905668 3165964 40.16 2688 2356096 819784 9.18 282472 2497380 16 05:23:01 AM 4715684 6905272 3166748 40.17 2688 2356484 819784 9.18 282476 2497812 48 05:24:01 AM 4712536 6902520 3169896 40.21 2688 2356880 873892 9.78 282476 2500756 36 05:25:01 AM 4712060 6902432 3170372 40.22 2688 2357260 890340 9.97 282476 2501084 8 05:26:01 AM 4709172 6899928 3173260 40.26 2688 2357644 923124 10.34 282476 2503792 16 05:27:01 AM 4708280 6899636 3174152 40.27 2688 2358244 939180 10.52 282476 2504588 240 05:28:01 AM 4707708 6899452 3174724 40.28 2688 2358632 972372 10.89 282476 2505068 256 05:29:01 AM 4704744 6896880 3177688 40.31 2688 2359024 995624 11.15 282476 2507676 240 05:30:01 AM 4775752 6863060 3106680 39.41 2688 2260032 801388 8.97 387540 2357432 103420 05:31:01 AM 4791860 6894812 3090572 39.21 2688 2275980 788272 8.83 548312 2182280 37020 Average: 4749547 6907076 3132885 39.75 2688 2324515 826743 9.26 278921 2468110 485 12:00:01 AM IFACE rxpck/s txpck/s rxkB/s txkB/s rxcmp/s txcmp/s rxmcst/s %ifutil 12:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:01:01 AM eth0 0.83 0.10 0.10 0.01 0.00 0.00 0.00 0.00 12:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:02:01 AM eth0 5.08 4.33 0.90 0.49 0.00 0.00 0.00 0.00 12:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:03:01 AM eth0 4.30 0.53 0.36 0.09 0.00 0.00 0.00 0.00 12:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:04:01 AM eth0 5.35 0.48 0.80 0.38 0.00 0.00 0.00 0.00 12:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:05:01 AM eth0 5.26 4.68 0.96 0.51 0.00 0.00 0.00 0.00 12:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:06:01 AM eth0 2.17 0.83 0.56 0.32 0.00 0.00 0.00 0.00 12:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:07:01 AM eth0 3.52 0.02 0.47 0.00 0.00 0.00 0.00 0.00 12:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:08:01 AM eth0 6.23 5.35 0.94 0.43 0.00 0.00 0.00 0.00 12:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:09:01 AM eth0 0.87 0.17 0.20 0.07 0.00 0.00 0.00 0.00 12:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:10:01 AM eth0 0.63 0.05 0.04 0.00 0.00 0.00 0.00 0.00 12:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:11:01 AM eth0 5.48 4.98 0.81 0.41 0.00 0.00 0.00 0.00 12:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:12:01 AM eth0 0.58 0.05 0.04 0.00 0.00 0.00 0.00 0.00 12:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:13:01 AM eth0 4.57 4.15 0.65 0.29 0.00 0.00 0.00 0.00 12:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:14:01 AM eth0 1.07 0.62 0.27 0.15 0.00 0.00 0.00 0.00 12:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:15:01 AM eth0 0.70 0.03 0.09 0.00 0.00 0.00 0.00 0.00 12:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:16:01 AM eth0 4.93 4.18 0.72 0.30 0.00 0.00 0.00 0.00 12:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:17:01 AM eth0 0.93 0.67 0.09 0.11 0.00 0.00 0.00 0.00 12:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:18:01 AM eth0 0.55 0.15 0.04 0.01 0.00 0.00 0.00 0.00 12:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:19:01 AM eth0 0.63 0.27 0.16 0.07 0.00 0.00 0.00 0.00 12:20:00 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:20:00 AM eth0 0.43 0.00 0.03 0.00 0.00 0.00 0.00 0.00 12:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:20:01 AM eth0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:21:01 AM eth0 0.75 0.07 0.13 0.00 0.00 0.00 0.00 0.00 12:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:22:01 AM eth0 0.43 0.00 0.03 0.00 0.00 0.00 0.00 0.00 12:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:23:01 AM eth0 0.40 0.10 0.03 0.00 0.00 0.00 0.00 0.00 12:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:24:01 AM eth0 10.68 8.83 1.71 0.94 0.00 0.00 0.00 0.00 12:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:25:01 AM eth0 11.05 7.15 2.29 1.50 0.00 0.00 0.00 0.00 12:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:26:01 AM eth0 12.10 8.93 2.81 1.74 0.00 0.00 0.00 0.00 12:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:27:01 AM eth0 12.38 9.45 3.48 2.21 0.00 0.00 0.00 0.00 12:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:28:01 AM eth0 11.29 9.01 2.81 1.79 0.00 0.00 0.00 0.00 12:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:29:01 AM eth0 10.95 9.05 2.85 1.85 0.00 0.00 0.00 0.00 12:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:30:01 AM eth0 11.01 9.06 2.76 1.79 0.00 0.00 0.00 0.00 12:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:31:01 AM eth0 20.93 17.68 5.52 3.55 0.00 0.00 0.00 0.00 12:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:32:01 AM eth0 1.73 0.43 0.23 0.06 0.00 0.00 0.00 0.00 12:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:33:01 AM eth0 1.95 0.50 0.73 0.43 0.00 0.00 0.00 0.00 12:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:34:01 AM eth0 1.88 0.57 0.60 0.30 0.00 0.00 0.00 0.00 12:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:35:01 AM eth0 0.28 0.05 0.02 0.00 0.00 0.00 0.00 0.00 12:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:36:01 AM eth0 0.70 0.27 0.09 0.04 0.00 0.00 0.00 0.00 12:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:37:01 AM eth0 1.38 0.08 0.15 0.00 0.00 0.00 0.00 0.00 12:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:38:01 AM eth0 1.42 0.35 0.39 0.24 0.00 0.00 0.00 0.00 12:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:39:01 AM eth0 16.69 14.57 3.07 1.73 0.00 0.00 0.00 0.00 12:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:40:01 AM eth0 3.58 0.83 0.72 0.32 0.00 0.00 0.00 0.00 12:41:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:41:01 AM eth0 0.92 0.17 0.31 0.19 0.00 0.00 0.00 0.00 12:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:42:01 AM eth0 4.08 0.30 0.99 0.20 0.00 0.00 0.00 0.00 12:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:43:01 AM eth0 0.97 0.05 0.06 0.00 0.00 0.00 0.00 0.00 12:44:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:44:01 AM eth0 6.67 3.92 1.16 0.54 0.00 0.00 0.00 0.00 12:45:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:45:01 AM eth0 9.93 7.45 2.70 1.81 0.00 0.00 0.00 0.00 12:46:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:46:01 AM eth0 12.05 9.10 2.89 1.82 0.00 0.00 0.00 0.00 12:47:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:47:01 AM eth0 12.55 9.11 2.98 1.80 0.00 0.00 0.00 0.00 12:48:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:48:01 AM eth0 12.33 9.08 2.87 1.79 0.00 0.00 0.00 0.00 12:49:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:49:01 AM eth0 10.93 8.93 2.84 1.84 0.00 0.00 0.00 0.00 12:50:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:50:01 AM eth0 10.95 9.02 2.76 1.79 0.00 0.00 0.00 0.00 12:51:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:51:01 AM eth0 7.76 5.93 1.83 1.18 0.00 0.00 0.00 0.00 12:52:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:52:01 AM eth0 0.97 0.47 0.09 0.07 0.00 0.00 0.00 0.00 12:53:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:53:01 AM eth0 1.48 0.00 0.21 0.00 0.00 0.00 0.00 0.00 12:54:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:54:01 AM eth0 4.93 2.37 1.54 1.00 0.00 0.00 0.00 0.00 12:55:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:55:01 AM eth0 6.87 5.68 1.64 1.09 0.00 0.00 0.00 0.00 12:56:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:56:01 AM eth0 14.35 9.05 3.26 1.79 0.00 0.00 0.00 0.00 12:57:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:57:01 AM eth0 11.35 8.92 2.75 1.78 0.00 0.00 0.00 0.00 12:58:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:58:01 AM eth0 11.55 9.10 2.80 1.79 0.00 0.00 0.00 0.00 12:59:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:59:01 AM eth0 11.31 9.00 2.88 1.84 0.00 0.00 0.00 0.00 01:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:00:01 AM eth0 11.26 9.10 2.79 1.79 0.00 0.00 0.00 0.00 01:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:01:01 AM eth0 20.48 17.16 5.27 3.28 0.00 0.00 0.00 0.00 01:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:02:01 AM eth0 1.33 0.45 0.15 0.06 0.00 0.00 0.00 0.00 01:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:03:01 AM eth0 5.02 0.00 0.27 0.00 0.00 0.00 0.00 0.00 01:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:04:01 AM eth0 5.07 0.93 1.10 0.56 0.00 0.00 0.00 0.00 01:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:05:01 AM eth0 1.37 0.27 0.44 0.23 0.00 0.00 0.00 0.00 01:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:06:01 AM eth0 5.65 0.23 10.46 0.04 0.00 0.00 0.00 0.00 01:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:07:01 AM eth0 0.68 0.05 0.05 0.00 0.00 0.00 0.00 0.00 01:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:08:01 AM eth0 0.75 0.03 0.05 0.00 0.00 0.00 0.00 0.00 01:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:09:01 AM eth0 14.73 13.70 2.85 1.63 0.00 0.00 0.00 0.00 01:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:10:01 AM eth0 1.27 0.68 0.16 0.10 0.00 0.00 0.00 0.00 01:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:11:01 AM eth0 0.35 0.03 0.03 0.00 0.00 0.00 0.00 0.00 01:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:12:01 AM eth0 4.72 4.00 0.66 0.28 0.00 0.00 0.00 0.00 01:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:13:01 AM eth0 9.15 7.40 2.17 1.43 0.00 0.00 0.00 0.00 01:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:14:01 AM eth0 13.75 9.27 3.47 2.07 0.00 0.00 0.00 0.00 01:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:15:01 AM eth0 11.86 9.40 3.16 2.04 0.00 0.00 0.00 0.00 01:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:16:01 AM eth0 15.26 9.08 3.31 1.81 0.00 0.00 0.00 0.00 01:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:17:01 AM eth0 12.21 9.25 4.82 1.99 0.00 0.00 0.00 0.00 01:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:18:01 AM eth0 12.23 8.93 2.84 1.75 0.00 0.00 0.00 0.00 01:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:19:01 AM eth0 7.88 5.93 2.18 1.39 0.00 0.00 0.00 0.00 01:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:20:01 AM eth0 1.40 0.65 0.12 0.10 0.00 0.00 0.00 0.00 01:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:21:01 AM eth0 10.96 8.48 2.60 1.65 0.00 0.00 0.00 0.00 01:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:22:01 AM eth0 11.41 9.22 2.99 1.98 0.00 0.00 0.00 0.00 01:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:23:01 AM eth0 11.18 9.03 2.77 1.79 0.00 0.00 0.00 0.00 01:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:24:01 AM eth0 12.10 9.18 3.04 1.86 0.00 0.00 0.00 0.00 01:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:25:01 AM eth0 11.23 9.18 2.90 1.84 0.00 0.00 0.00 0.00 01:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:26:01 AM eth0 11.51 9.13 2.79 1.80 0.00 0.00 0.00 0.00 01:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:27:01 AM eth0 4.82 3.70 1.10 0.73 0.00 0.00 0.00 0.00 01:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:28:01 AM eth0 3.15 2.32 0.80 0.63 0.00 0.00 0.00 0.00 01:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:29:01 AM eth0 13.15 10.83 3.36 2.16 0.00 0.00 0.00 0.00 01:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:30:01 AM eth0 11.10 9.10 2.76 1.80 0.00 0.00 0.00 0.00 01:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:31:01 AM eth0 11.88 9.33 3.11 1.99 0.00 0.00 0.00 0.00 01:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:32:01 AM eth0 11.75 9.15 2.87 1.80 0.00 0.00 0.00 0.00 01:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:33:01 AM eth0 11.65 9.23 3.10 1.98 0.00 0.00 0.00 0.00 01:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:34:01 AM eth0 12.05 9.13 2.99 1.85 0.00 0.00 0.00 0.00 01:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:35:01 AM eth0 14.50 11.95 3.89 2.40 0.00 0.00 0.00 0.00 01:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:36:01 AM eth0 0.30 0.00 0.02 0.00 0.00 0.00 0.00 0.00 01:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:37:01 AM eth0 0.33 0.10 0.02 0.01 0.00 0.00 0.00 0.00 01:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:38:01 AM eth0 0.57 0.27 0.08 0.04 0.00 0.00 0.00 0.00 01:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:39:01 AM eth0 0.58 0.13 0.16 0.07 0.00 0.00 0.00 0.00 01:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:40:01 AM eth0 0.92 0.30 0.12 0.04 0.00 0.00 0.00 0.00 01:41:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:41:01 AM eth0 0.77 0.22 0.37 0.22 0.00 0.00 0.00 0.00 01:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:42:01 AM eth0 10.08 9.28 1.76 1.04 0.00 0.00 0.00 0.00 01:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:43:01 AM eth0 5.33 5.22 0.79 0.45 0.00 0.00 0.00 0.00 01:44:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:44:01 AM eth0 0.95 0.20 0.20 0.07 0.00 0.00 0.00 0.00 01:45:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:45:01 AM eth0 0.62 0.28 0.27 0.20 0.00 0.00 0.00 0.00 01:46:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:46:01 AM eth0 8.68 7.85 1.73 1.09 0.00 0.00 0.00 0.00 01:47:02 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:47:02 AM eth0 11.38 9.22 2.86 1.81 0.00 0.00 0.00 0.00 01:48:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:48:01 AM eth0 10.71 8.84 2.65 1.75 0.00 0.00 0.00 0.00 01:49:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:49:01 AM eth0 11.48 9.73 2.90 8.19 0.00 0.00 0.00 0.00 01:50:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:50:01 AM eth0 11.26 9.16 2.82 1.82 0.00 0.00 0.00 0.00 01:51:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:51:01 AM eth0 10.93 9.00 2.76 1.79 0.00 0.00 0.00 0.00 01:52:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:52:01 AM eth0 10.86 8.95 2.73 1.78 0.00 0.00 0.00 0.00 01:53:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:53:01 AM eth0 1.83 1.57 0.36 0.31 0.00 0.00 0.00 0.00 01:54:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:54:01 AM eth0 4.55 3.58 0.94 6.79 0.00 0.00 0.00 0.00 01:55:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:55:01 AM eth0 11.18 9.28 2.85 1.81 0.00 0.00 0.00 0.00 01:56:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:56:01 AM eth0 10.96 8.97 2.73 1.79 0.00 0.00 0.00 0.00 01:57:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:57:01 AM eth0 10.68 9.00 2.73 1.79 0.00 0.00 0.00 0.00 01:58:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:58:01 AM eth0 11.00 9.08 2.74 1.79 0.00 0.00 0.00 0.00 01:59:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:59:01 AM eth0 11.36 9.43 2.97 3.61 0.00 0.00 0.00 0.00 02:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:00:01 AM eth0 10.93 9.08 2.75 1.79 0.00 0.00 0.00 0.00 02:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:01:01 AM eth0 13.26 11.50 3.45 2.14 0.00 0.00 0.00 0.00 02:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:02:01 AM eth0 0.37 0.00 0.02 0.00 0.00 0.00 0.00 0.00 02:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:03:01 AM eth0 0.43 0.28 0.09 0.04 0.00 0.00 0.00 0.00 02:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:04:01 AM eth0 0.58 0.17 0.16 0.07 0.00 0.00 0.00 0.00 02:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:05:01 AM eth0 0.18 0.00 0.02 0.00 0.00 0.00 0.00 0.00 02:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:06:01 AM eth0 0.58 0.30 0.08 0.04 0.00 0.00 0.00 0.00 02:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:07:01 AM eth0 0.20 0.00 0.02 0.00 0.00 0.00 0.00 0.00 02:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:08:01 AM eth0 10.05 9.35 1.76 1.05 0.00 0.00 0.00 0.00 02:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:09:01 AM eth0 5.80 5.63 0.97 0.53 0.00 0.00 0.00 0.00 02:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:10:01 AM eth0 0.30 0.00 0.02 0.00 0.00 0.00 0.00 0.00 02:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:11:01 AM eth0 0.47 0.33 0.09 0.03 0.00 0.00 0.00 0.00 02:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:12:01 AM eth0 0.37 0.08 0.02 0.00 0.00 0.00 0.00 0.00 02:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:13:01 AM eth0 0.22 0.05 0.02 0.00 0.00 0.00 0.00 0.00 02:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:14:01 AM eth0 0.72 0.33 0.22 0.09 0.00 0.00 0.00 0.00 02:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:15:01 AM eth0 0.17 0.00 0.02 0.00 0.00 0.00 0.00 0.00 02:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:16:01 AM eth0 0.57 0.30 0.09 0.03 0.00 0.00 0.00 0.00 02:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:17:01 AM eth0 0.13 0.03 0.01 0.00 0.00 0.00 0.00 0.00 02:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:18:01 AM eth0 0.58 0.30 0.10 0.03 0.00 0.00 0.00 0.00 02:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:19:01 AM eth0 0.48 0.20 0.15 0.08 0.00 0.00 0.00 0.00 02:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:20:01 AM eth0 0.53 0.25 0.09 0.03 0.00 0.00 0.00 0.00 02:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:21:01 AM eth0 0.08 0.00 0.01 0.00 0.00 0.00 0.00 0.00 02:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:22:01 AM eth0 0.63 0.32 0.10 0.03 0.00 0.00 0.00 0.00 02:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:23:01 AM eth0 0.38 0.00 0.05 0.00 0.00 0.00 0.00 0.00 02:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:24:01 AM eth0 4.35 3.93 0.91 0.54 0.00 0.00 0.00 0.00 02:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:25:01 AM eth0 10.75 9.20 2.70 1.79 0.00 0.00 0.00 0.00 02:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:26:01 AM eth0 10.90 9.08 2.76 1.79 0.00 0.00 0.00 0.00 02:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:27:01 AM eth0 12.68 9.05 3.01 1.79 0.00 0.00 0.00 0.00 02:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:28:01 AM eth0 11.56 9.33 3.06 2.03 0.00 0.00 0.00 0.00 02:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:29:01 AM eth0 11.16 9.20 2.92 1.87 0.00 0.00 0.00 0.00 02:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:30:01 AM eth0 14.30 9.08 3.11 1.79 0.00 0.00 0.00 0.00 02:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:31:01 AM eth0 8.75 4.53 2.50 1.55 0.00 0.00 0.00 0.00 02:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:32:01 AM eth0 1.58 0.65 0.39 0.28 0.00 0.00 0.00 0.00 02:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:33:01 AM eth0 7.28 0.20 1.15 0.19 0.00 0.00 0.00 0.00 02:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:34:01 AM eth0 2.53 0.35 0.26 0.08 0.00 0.00 0.00 0.00 02:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:35:01 AM eth0 1.08 0.05 0.06 0.00 0.00 0.00 0.00 0.00 02:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:36:01 AM eth0 0.72 0.22 0.04 0.02 0.00 0.00 0.00 0.00 02:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:37:01 AM eth0 0.50 0.00 0.03 0.00 0.00 0.00 0.00 0.00 02:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:38:01 AM eth0 1.42 0.20 0.11 0.02 0.00 0.00 0.00 0.00 02:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:39:01 AM eth0 2.30 0.15 0.26 0.07 0.00 0.00 0.00 0.00 02:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:40:01 AM eth0 3.47 0.17 0.15 0.01 0.00 0.00 0.00 0.00 02:41:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:41:01 AM eth0 1.97 0.00 0.09 0.00 0.00 0.00 0.00 0.00 02:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:42:01 AM eth0 0.62 0.17 0.04 0.01 0.00 0.00 0.00 0.00 02:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:43:01 AM eth0 1.38 0.00 0.10 0.00 0.00 0.00 0.00 0.00 02:44:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:44:01 AM eth0 3.92 0.75 1.26 0.72 0.00 0.00 0.00 0.00 02:45:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:45:01 AM eth0 6.68 5.60 1.61 1.08 0.00 0.00 0.00 0.00 02:46:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:46:01 AM eth0 17.90 9.12 3.70 1.79 0.00 0.00 0.00 0.00 02:47:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:47:01 AM eth0 12.95 9.36 3.17 1.99 0.00 0.00 0.00 0.00 02:48:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:48:01 AM eth0 11.66 9.18 2.79 1.80 0.00 0.00 0.00 0.00 02:49:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:49:01 AM eth0 12.01 9.40 3.00 1.87 0.00 0.00 0.00 0.00 02:50:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:50:01 AM eth0 11.78 9.00 2.82 1.79 0.00 0.00 0.00 0.00 02:51:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:51:01 AM eth0 8.15 6.57 1.98 1.31 0.00 0.00 0.00 0.00 02:52:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:52:01 AM eth0 0.88 0.52 0.08 0.08 0.00 0.00 0.00 0.00 02:53:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:53:01 AM eth0 0.43 0.05 0.03 0.00 0.00 0.00 0.00 0.00 02:54:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:54:01 AM eth0 1.57 0.37 0.22 0.09 0.00 0.00 0.00 0.00 02:55:02 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:55:02 AM eth0 0.50 0.02 0.04 0.00 0.00 0.00 0.00 0.00 02:56:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:56:01 AM eth0 0.78 0.22 0.05 0.02 0.00 0.00 0.00 0.00 02:57:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:57:01 AM eth0 0.28 0.00 0.02 0.00 0.00 0.00 0.00 0.00 02:58:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:58:01 AM eth0 0.70 0.20 0.04 0.02 0.00 0.00 0.00 0.00 02:59:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:59:01 AM eth0 0.78 0.17 0.19 0.07 0.00 0.00 0.00 0.00 03:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:00:01 AM eth0 3.02 0.18 0.20 0.02 0.00 0.00 0.00 0.00 03:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:01:01 AM eth0 0.25 0.00 0.02 0.00 0.00 0.00 0.00 0.00 03:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:02:01 AM eth0 0.50 0.17 0.03 0.01 0.00 0.00 0.00 0.00 03:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:03:01 AM eth0 0.33 0.05 0.02 0.00 0.00 0.00 0.00 0.00 03:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:04:01 AM eth0 0.77 0.35 0.18 0.13 0.00 0.00 0.00 0.00 03:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:05:01 AM eth0 6.83 5.77 1.68 1.11 0.00 0.00 0.00 0.00 03:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:06:01 AM eth0 11.33 9.20 2.84 1.82 0.00 0.00 0.00 0.00 03:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:07:01 AM eth0 10.70 9.00 2.70 1.79 0.00 0.00 0.00 0.00 03:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:08:01 AM eth0 11.00 9.03 2.77 1.79 0.00 0.00 0.00 0.00 03:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:09:01 AM eth0 11.16 9.11 2.89 1.85 0.00 0.00 0.00 0.00 03:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:10:01 AM eth0 10.88 9.07 2.72 1.79 0.00 0.00 0.00 0.00 03:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:11:01 AM eth0 12.31 6.32 11.61 1.24 0.00 0.00 0.00 0.00 03:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:12:01 AM eth0 0.70 0.43 0.08 0.07 0.00 0.00 0.00 0.00 03:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:13:01 AM eth0 0.20 0.00 0.02 0.00 0.00 0.00 0.00 0.00 03:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:14:01 AM eth0 0.73 0.33 0.16 0.08 0.00 0.00 0.00 0.00 03:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:15:01 AM eth0 0.17 0.00 0.01 0.00 0.00 0.00 0.00 0.00 03:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:16:01 AM eth0 0.52 0.20 0.03 0.02 0.00 0.00 0.00 0.00 03:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:17:01 AM eth0 0.15 0.00 0.01 0.00 0.00 0.00 0.00 0.00 03:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:18:01 AM eth0 0.42 0.18 0.03 0.02 0.00 0.00 0.00 0.00 03:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:19:01 AM eth0 0.42 0.15 0.15 0.07 0.00 0.00 0.00 0.00 03:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:20:01 AM eth0 0.43 0.22 0.03 0.02 0.00 0.00 0.00 0.00 03:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:21:01 AM eth0 0.15 0.00 0.01 0.00 0.00 0.00 0.00 0.00 03:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:22:01 AM eth0 0.48 0.25 0.03 0.02 0.00 0.00 0.00 0.00 03:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:23:01 AM eth0 0.25 0.00 0.02 0.00 0.00 0.00 0.00 0.00 03:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:24:01 AM eth0 2.08 1.60 0.52 0.36 0.00 0.00 0.00 0.00 03:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:25:01 AM eth0 4.97 3.93 1.30 0.94 0.00 0.00 0.00 0.00 03:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:26:01 AM eth0 11.10 9.00 2.76 1.77 0.00 0.00 0.00 0.00 03:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:27:01 AM eth0 10.90 9.10 2.75 1.81 0.00 0.00 0.00 0.00 03:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:28:01 AM eth0 11.55 9.13 2.83 1.81 0.00 0.00 0.00 0.00 03:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:29:01 AM eth0 11.68 9.47 3.19 2.09 0.00 0.00 0.00 0.00 03:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:30:01 AM eth0 10.83 8.97 2.73 1.79 0.00 0.00 0.00 0.00 03:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:31:01 AM eth0 14.91 12.86 4.26 2.72 0.00 0.00 0.00 0.00 03:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:32:01 AM eth0 8.55 6.67 1.94 1.18 0.00 0.00 0.00 0.00 03:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:33:01 AM eth0 0.95 0.32 0.37 0.23 0.00 0.00 0.00 0.00 03:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:34:01 AM eth0 0.75 0.50 0.23 0.11 0.00 0.00 0.00 0.00 03:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:35:01 AM eth0 0.23 0.00 0.02 0.00 0.00 0.00 0.00 0.00 03:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:36:01 AM eth0 0.23 0.02 0.02 0.00 0.00 0.00 0.00 0.00 03:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:37:01 AM eth0 0.48 0.32 0.08 0.04 0.00 0.00 0.00 0.00 03:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:38:01 AM eth0 0.23 0.00 0.02 0.00 0.00 0.00 0.00 0.00 03:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:39:01 AM eth0 10.58 9.93 1.97 1.19 0.00 0.00 0.00 0.00 03:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:40:01 AM eth0 5.52 5.32 0.81 0.41 0.00 0.00 0.00 0.00 03:41:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:41:01 AM eth0 0.08 0.00 0.01 0.00 0.00 0.00 0.00 0.00 03:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:42:01 AM eth0 4.02 3.75 0.55 0.27 0.00 0.00 0.00 0.00 03:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:43:01 AM eth0 6.93 5.73 1.70 1.09 0.00 0.00 0.00 0.00 03:44:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:44:01 AM eth0 11.38 9.33 3.11 2.05 0.00 0.00 0.00 0.00 03:45:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:45:01 AM eth0 11.33 9.30 2.85 1.83 0.00 0.00 0.00 0.00 03:46:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:46:01 AM eth0 16.78 9.53 3.97 2.23 0.00 0.00 0.00 0.00 03:47:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:47:01 AM eth0 14.15 9.80 4.29 2.77 0.00 0.00 0.00 0.00 03:48:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:48:01 AM eth0 14.30 9.17 3.49 1.97 0.00 0.00 0.00 0.00 03:49:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:49:01 AM eth0 14.50 7.48 3.07 1.53 0.00 0.00 0.00 0.00 03:50:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:50:01 AM eth0 1.53 0.67 0.13 0.11 0.00 0.00 0.00 0.00 03:51:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:51:01 AM eth0 8.22 6.58 1.95 1.29 0.00 0.00 0.00 0.00 03:52:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:52:01 AM eth0 11.60 9.23 2.83 1.82 0.00 0.00 0.00 0.00 03:53:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:53:01 AM eth0 12.08 9.16 2.87 1.80 0.00 0.00 0.00 0.00 03:54:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:54:01 AM eth0 13.49 9.30 3.09 1.85 0.00 0.00 0.00 0.00 03:55:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:55:01 AM eth0 12.31 9.07 2.88 1.79 0.00 0.00 0.00 0.00 03:56:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:56:01 AM eth0 12.23 8.95 2.73 1.78 0.00 0.00 0.00 0.00 03:57:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:57:01 AM eth0 7.06 5.28 1.55 1.03 0.00 0.00 0.00 0.00 03:58:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:58:01 AM eth0 2.60 2.10 0.49 0.40 0.00 0.00 0.00 0.00 03:59:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:59:01 AM eth0 11.13 9.23 2.82 1.86 0.00 0.00 0.00 0.00 04:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:00:01 AM eth0 11.88 9.05 2.90 1.79 0.00 0.00 0.00 0.00 04:01:02 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:01:02 AM eth0 10.86 8.95 2.73 1.78 0.00 0.00 0.00 0.00 04:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:02:01 AM eth0 10.98 9.10 2.74 1.81 0.00 0.00 0.00 0.00 04:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:03:01 AM eth0 12.25 8.75 2.87 1.72 0.00 0.00 0.00 0.00 04:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:04:01 AM eth0 14.58 9.18 3.51 2.07 0.00 0.00 0.00 0.00 04:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:05:01 AM eth0 16.76 14.00 4.51 2.81 0.00 0.00 0.00 0.00 04:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:06:01 AM eth0 5.50 0.00 0.73 0.00 0.00 0.00 0.00 0.00 04:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:07:01 AM eth0 1.73 0.00 0.18 0.00 0.00 0.00 0.00 0.00 04:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:08:01 AM eth0 1.25 0.30 0.13 0.04 0.00 0.00 0.00 0.00 04:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:09:01 AM eth0 0.62 0.12 0.16 0.07 0.00 0.00 0.00 0.00 04:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:10:01 AM eth0 1.38 0.27 0.14 0.04 0.00 0.00 0.00 0.00 04:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:11:01 AM eth0 0.28 0.00 0.02 0.00 0.00 0.00 0.00 0.00 04:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:12:01 AM eth0 10.31 9.41 1.79 1.05 0.00 0.00 0.00 0.00 04:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:13:01 AM eth0 5.63 5.43 0.79 0.41 0.00 0.00 0.00 0.00 04:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:14:01 AM eth0 1.17 0.75 0.24 0.17 0.00 0.00 0.00 0.00 04:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:15:01 AM eth0 0.33 0.10 0.02 0.00 0.00 0.00 0.00 0.00 04:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:16:01 AM eth0 10.06 9.73 1.42 0.73 0.00 0.00 0.00 0.00 04:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:17:01 AM eth0 4.63 4.48 0.66 0.36 0.00 0.00 0.00 0.00 04:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:18:01 AM eth0 9.55 9.21 1.40 0.73 0.00 0.00 0.00 0.00 04:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:19:01 AM eth0 1.25 0.82 0.32 0.17 0.00 0.00 0.00 0.00 04:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:20:01 AM eth0 0.82 0.00 0.06 0.00 0.00 0.00 0.00 0.00 04:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:21:01 AM eth0 8.73 8.53 1.49 0.86 0.00 0.00 0.00 0.00 04:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:22:01 AM eth0 6.28 5.27 1.48 1.01 0.00 0.00 0.00 0.00 04:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:23:01 AM eth0 11.15 8.91 2.82 1.78 0.00 0.00 0.00 0.00 04:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:24:01 AM eth0 13.78 9.17 3.11 1.86 0.00 0.00 0.00 0.00 04:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:25:01 AM eth0 10.96 9.03 2.78 1.79 0.00 0.00 0.00 0.00 04:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:26:01 AM eth0 9.68 8.02 2.44 1.59 0.00 0.00 0.00 0.00 04:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:27:01 AM eth0 11.23 9.10 2.85 1.79 0.00 0.00 0.00 0.00 04:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:28:01 AM eth0 19.91 16.80 5.10 3.24 0.00 0.00 0.00 0.00 04:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:29:01 AM eth0 2.22 1.77 0.59 0.37 0.00 0.00 0.00 0.00 04:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:30:01 AM eth0 0.35 0.00 0.02 0.00 0.00 0.00 0.00 0.00 04:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:31:01 AM eth0 0.78 0.58 0.34 0.24 0.00 0.00 0.00 0.00 04:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:32:01 AM eth0 0.90 0.00 0.11 0.00 0.00 0.00 0.00 0.00 04:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:33:01 AM eth0 0.60 0.25 0.28 0.19 0.00 0.00 0.00 0.00 04:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:34:01 AM eth0 4.62 0.43 0.47 0.11 0.00 0.00 0.00 0.00 04:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:35:01 AM eth0 0.18 0.05 0.02 0.00 0.00 0.00 0.00 0.00 04:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:36:01 AM eth0 10.43 9.87 1.87 1.12 0.00 0.00 0.00 0.00 04:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:37:01 AM eth0 5.41 5.36 0.76 0.42 0.00 0.00 0.00 0.00 04:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:38:01 AM eth0 0.33 0.00 0.02 0.00 0.00 0.00 0.00 0.00 04:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:39:01 AM eth0 5.08 4.92 0.81 0.40 0.00 0.00 0.00 0.00 04:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:01 AM eth0 4.42 4.23 0.63 0.35 0.00 0.00 0.00 0.00 04:41:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:41:01 AM eth0 9.87 9.45 1.62 0.92 0.00 0.00 0.00 0.00 04:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:42:01 AM eth0 5.18 5.02 0.74 0.39 0.00 0.00 0.00 0.00 04:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:43:01 AM eth0 0.70 0.53 0.08 0.09 0.00 0.00 0.00 0.00 04:44:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:44:01 AM eth0 0.50 0.12 0.15 0.06 0.00 0.00 0.00 0.00 04:45:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:45:01 AM eth0 8.28 8.10 1.46 0.84 0.00 0.00 0.00 0.00 04:46:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:46:01 AM eth0 11.36 9.36 2.80 1.81 0.00 0.00 0.00 0.00 04:47:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:47:01 AM eth0 11.53 9.23 3.04 1.98 0.00 0.00 0.00 0.00 04:48:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:48:01 AM eth0 10.58 8.97 2.76 1.82 0.00 0.00 0.00 0.00 04:49:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:49:01 AM eth0 11.05 9.10 2.91 1.85 0.00 0.00 0.00 0.00 04:50:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:50:01 AM eth0 10.40 8.86 2.67 1.78 0.00 0.00 0.00 0.00 04:51:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:51:01 AM eth0 10.60 8.72 2.71 1.72 0.00 0.00 0.00 0.00 04:52:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:52:01 AM eth0 16.83 14.35 4.34 2.73 0.00 0.00 0.00 0.00 04:53:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:53:01 AM eth0 0.42 0.32 0.08 0.05 0.00 0.00 0.00 0.00 04:54:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:54:01 AM eth0 1.67 0.35 0.54 0.29 0.00 0.00 0.00 0.00 04:55:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:55:01 AM eth0 0.67 0.57 0.33 0.24 0.00 0.00 0.00 0.00 04:56:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:56:01 AM eth0 0.28 0.00 0.02 0.00 0.00 0.00 0.00 0.00 04:57:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:57:01 AM eth0 0.43 0.32 0.08 0.04 0.00 0.00 0.00 0.00 04:58:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:58:01 AM eth0 0.30 0.00 0.02 0.00 0.00 0.00 0.00 0.00 04:59:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:59:01 AM eth0 10.01 9.65 1.88 1.13 0.00 0.00 0.00 0.00 05:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:00:01 AM eth0 4.62 4.45 0.64 0.34 0.00 0.00 0.00 0.00 05:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:01:01 AM eth0 1.03 0.57 0.15 0.09 0.00 0.00 0.00 0.00 05:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:02:01 AM eth0 0.42 0.10 0.03 0.00 0.00 0.00 0.00 0.00 05:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:03:01 AM eth0 4.35 4.17 0.61 0.34 0.00 0.00 0.00 0.00 05:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:04:01 AM eth0 0.43 0.10 0.15 0.06 0.00 0.00 0.00 0.00 05:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:05:01 AM eth0 5.05 4.98 0.74 0.39 0.00 0.00 0.00 0.00 05:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:06:01 AM eth0 0.28 0.07 0.02 0.00 0.00 0.00 0.00 0.00 05:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:07:01 AM eth0 3.33 3.12 0.65 0.51 0.00 0.00 0.00 0.00 05:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:08:01 AM eth0 11.56 10.75 2.22 1.28 0.00 0.00 0.00 0.00 05:09:02 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:09:02 AM eth0 11.21 9.30 2.95 1.86 0.00 0.00 0.00 0.00 05:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:10:01 AM eth0 10.95 9.18 2.77 1.82 0.00 0.00 0.00 0.00 05:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:11:01 AM eth0 11.15 9.18 2.80 1.80 0.00 0.00 0.00 0.00 05:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:12:01 AM eth0 10.83 8.93 2.78 1.78 0.00 0.00 0.00 0.00 05:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:13:01 AM eth0 10.66 8.97 2.74 1.79 0.00 0.00 0.00 0.00 05:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:14:01 AM eth0 13.45 11.18 3.53 2.27 0.00 0.00 0.00 0.00 05:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:15:01 AM eth0 9.80 8.52 2.58 1.56 0.00 0.00 0.00 0.00 05:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:16:01 AM eth0 0.18 0.00 0.01 0.00 0.00 0.00 0.00 0.00 05:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:17:01 AM eth0 0.37 0.32 0.07 0.04 0.00 0.00 0.00 0.00 05:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:18:01 AM eth0 0.87 0.15 0.31 0.18 0.00 0.00 0.00 0.00 05:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:19:01 AM eth0 2.88 0.13 0.31 0.07 0.00 0.00 0.00 0.00 05:20:00 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:20:00 AM eth0 0.69 0.36 0.15 0.05 0.00 0.00 0.00 0.00 05:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:20:01 AM eth0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:21:01 AM eth0 0.08 0.00 0.01 0.00 0.00 0.00 0.00 0.00 05:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:22:01 AM eth0 9.97 9.57 1.77 1.06 0.00 0.00 0.00 0.00 05:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:23:01 AM eth0 10.11 9.60 3.09 1.09 0.00 0.00 0.00 0.00 05:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:24:01 AM eth0 11.65 10.05 3.48 1.41 0.00 0.00 0.00 0.00 05:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:25:01 AM eth0 10.65 9.58 2.99 1.07 0.00 0.00 0.00 0.00 05:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:26:01 AM eth0 9.35 9.15 2.87 1.01 0.00 0.00 0.00 0.00 05:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:27:01 AM eth0 9.16 8.91 3.92 1.42 0.00 0.00 0.00 0.00 05:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:28:01 AM eth0 9.78 9.53 2.97 1.05 0.00 0.00 0.00 0.00 05:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:29:01 AM eth0 9.11 8.65 3.08 1.11 0.00 0.00 0.00 0.00 05:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:30:01 AM eth0 135.56 83.22 212.50 314.28 0.00 0.00 0.00 0.00 05:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:31:01 AM eth0 15.68 14.85 13.78 7.52 0.00 0.00 0.00 0.00 Average: lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 Average: eth0 6.53 4.89 2.16 1.86 0.00 0.00 0.00 0.00 ---> sar -P ALL: Linux 4.18.0-553.5.1.el8.x86_64 (prd-centos8-robot-2c-8g-4831.novalocal) 11/03/2025 _x86_64_ (2 CPU) 12:00:01 AM CPU %user %nice %system %iowait %steal %idle 12:01:01 AM all 0.33 0.03 0.25 0.16 0.03 99.20 12:01:01 AM 0 0.55 0.02 0.15 0.32 0.03 98.93 12:01:01 AM 1 0.10 0.05 0.35 0.00 0.03 99.47 12:02:01 AM all 1.85 0.00 0.19 0.00 0.05 97.91 12:02:01 AM 0 0.30 0.00 0.13 0.00 0.05 99.52 12:02:01 AM 1 3.44 0.00 0.26 0.00 0.05 96.25 12:03:01 AM all 2.86 0.00 1.26 0.00 0.07 95.81 12:03:01 AM 0 5.21 0.00 2.51 0.00 0.09 92.19 12:03:01 AM 1 0.60 0.00 0.07 0.00 0.05 99.28 12:04:01 AM all 0.40 0.00 0.08 0.00 0.04 99.48 12:04:01 AM 0 0.17 0.00 0.07 0.00 0.03 99.73 12:04:01 AM 1 0.63 0.00 0.08 0.00 0.05 99.23 12:05:01 AM all 3.41 0.00 1.59 0.00 0.07 94.93 12:05:01 AM 0 6.23 0.00 2.53 0.00 0.07 91.17 12:05:01 AM 1 0.69 0.00 0.69 0.00 0.07 98.56 12:06:01 AM all 1.50 0.00 0.32 0.00 0.04 98.14 12:06:01 AM 0 0.67 0.00 0.07 0.00 0.03 99.23 12:06:01 AM 1 2.34 0.00 0.58 0.00 0.05 97.03 12:07:01 AM all 0.21 0.00 0.08 0.00 0.04 99.67 12:07:01 AM 0 0.33 0.00 0.10 0.00 0.05 99.51 12:07:01 AM 1 0.08 0.00 0.05 0.00 0.03 99.83 12:08:01 AM all 4.37 0.00 1.42 0.01 0.06 94.13 12:08:01 AM 0 8.88 0.00 2.75 0.02 0.05 88.30 12:08:01 AM 1 0.15 0.00 0.18 0.00 0.07 99.60 12:09:01 AM all 0.32 0.00 0.07 0.00 0.04 99.57 12:09:01 AM 0 0.50 0.00 0.07 0.00 0.03 99.40 12:09:01 AM 1 0.13 0.00 0.07 0.00 0.05 99.75 12:10:01 AM all 0.33 0.00 0.08 0.00 0.03 99.57 12:10:01 AM 0 0.53 0.00 0.05 0.00 0.02 99.40 12:10:01 AM 1 0.13 0.00 0.10 0.00 0.03 99.73 12:11:01 AM all 4.33 0.00 1.88 0.00 0.07 93.73 12:11:01 AM 0 8.33 0.00 3.69 0.00 0.07 87.91 12:11:01 AM 1 0.53 0.00 0.17 0.00 0.07 99.23 12:11:01 AM CPU %user %nice %system %iowait %steal %idle 12:12:01 AM all 0.24 0.00 0.08 0.00 0.04 99.63 12:12:01 AM 0 0.22 0.00 0.08 0.00 0.03 99.67 12:12:01 AM 1 0.27 0.00 0.08 0.00 0.05 99.60 12:13:01 AM all 1.49 0.00 0.17 0.00 0.07 98.27 12:13:01 AM 0 2.70 0.00 0.20 0.00 0.05 97.05 12:13:01 AM 1 0.32 0.00 0.13 0.00 0.08 99.47 12:14:01 AM all 3.04 0.00 1.20 0.01 0.05 95.70 12:14:01 AM 0 5.51 0.00 2.33 0.00 0.03 92.13 12:14:01 AM 1 0.68 0.00 0.13 0.02 0.07 99.10 12:15:01 AM all 0.38 0.00 0.07 0.00 0.06 99.50 12:15:01 AM 0 0.13 0.00 0.08 0.00 0.05 99.73 12:15:01 AM 1 0.62 0.00 0.05 0.00 0.07 99.27 12:16:01 AM all 3.12 0.00 1.27 0.00 0.06 95.55 12:16:01 AM 0 5.76 0.00 2.47 0.00 0.05 91.72 12:16:01 AM 1 0.57 0.00 0.12 0.00 0.07 99.25 12:17:01 AM all 1.65 0.00 0.63 0.00 0.06 97.66 12:17:01 AM 0 2.68 0.00 1.21 0.00 0.05 96.06 12:17:01 AM 1 0.63 0.00 0.07 0.00 0.07 99.23 12:18:01 AM all 0.34 0.00 0.06 0.00 0.04 99.56 12:18:01 AM 0 0.07 0.00 0.03 0.00 0.03 99.87 12:18:01 AM 1 0.62 0.00 0.08 0.00 0.05 99.25 12:19:01 AM all 0.35 0.00 0.08 0.00 0.05 99.52 12:19:01 AM 0 0.13 0.00 0.10 0.00 0.05 99.72 12:19:01 AM 1 0.57 0.00 0.07 0.00 0.05 99.32 12:20:00 AM all 0.38 0.00 0.06 0.00 0.04 99.52 12:20:00 AM 0 0.17 0.00 0.10 0.00 0.05 99.67 12:20:00 AM 1 0.58 0.00 0.02 0.00 0.03 99.37 12:20:01 AM all 0.34 0.00 0.68 0.00 0.00 98.98 12:20:01 AM 0 0.00 0.00 0.68 0.00 0.00 99.32 12:20:01 AM 1 0.68 0.00 0.68 0.00 0.00 98.64 12:21:01 AM all 0.36 0.00 0.08 0.00 0.05 99.51 12:21:01 AM 0 0.12 0.00 0.10 0.00 0.05 99.73 12:21:01 AM 1 0.60 0.00 0.07 0.00 0.05 99.28 12:21:01 AM CPU %user %nice %system %iowait %steal %idle 12:22:01 AM all 0.31 0.00 0.07 0.00 0.06 99.57 12:22:01 AM 0 0.10 0.00 0.05 0.00 0.05 99.80 12:22:01 AM 1 0.52 0.00 0.08 0.00 0.07 99.33 12:23:01 AM all 0.26 0.00 0.08 0.00 0.03 99.62 12:23:01 AM 0 0.13 0.00 0.10 0.00 0.03 99.73 12:23:01 AM 1 0.38 0.00 0.07 0.00 0.03 99.52 12:24:01 AM all 3.41 0.00 0.26 0.00 0.04 96.29 12:24:01 AM 0 6.08 0.00 0.40 0.00 0.05 93.47 12:24:01 AM 1 0.80 0.00 0.13 0.00 0.03 99.03 12:25:01 AM all 6.27 0.24 2.47 0.14 0.07 90.81 12:25:01 AM 0 8.25 0.48 4.53 0.28 0.07 86.38 12:25:01 AM 1 4.31 0.00 0.44 0.00 0.07 95.18 12:26:01 AM all 4.34 0.00 0.37 0.00 0.08 95.22 12:26:01 AM 0 7.19 0.00 0.52 0.00 0.10 92.20 12:26:01 AM 1 1.49 0.00 0.22 0.00 0.05 98.24 12:27:01 AM all 4.52 0.00 0.34 0.00 0.06 95.07 12:27:01 AM 0 4.23 0.00 0.32 0.00 0.05 95.40 12:27:01 AM 1 4.82 0.00 0.37 0.00 0.07 94.75 12:28:01 AM all 4.57 0.00 0.38 0.00 0.07 94.98 12:28:01 AM 0 5.20 0.00 0.40 0.00 0.07 94.33 12:28:01 AM 1 3.95 0.00 0.35 0.00 0.07 95.63 12:29:01 AM all 4.43 0.00 0.37 0.01 0.07 95.12 12:29:01 AM 0 3.46 0.00 0.32 0.02 0.07 96.14 12:29:01 AM 1 5.41 0.00 0.42 0.00 0.07 94.11 12:30:01 AM all 4.53 0.00 0.33 0.00 0.06 95.08 12:30:01 AM 0 4.09 0.00 0.30 0.00 0.05 95.55 12:30:01 AM 1 4.97 0.00 0.35 0.00 0.07 94.61 12:31:01 AM all 7.43 0.00 0.40 0.01 0.07 92.09 12:31:01 AM 0 8.34 0.00 0.38 0.00 0.07 91.21 12:31:01 AM 1 6.53 0.00 0.42 0.02 0.07 92.97 12:32:01 AM all 0.59 0.00 0.08 0.00 0.03 99.29 12:32:01 AM 0 0.68 0.00 0.08 0.00 0.03 99.20 12:32:01 AM 1 0.50 0.00 0.08 0.00 0.03 99.38 12:32:01 AM CPU %user %nice %system %iowait %steal %idle 12:33:01 AM all 0.33 0.00 0.07 0.00 0.03 99.58 12:33:01 AM 0 0.53 0.00 0.05 0.00 0.02 99.40 12:33:01 AM 1 0.12 0.00 0.08 0.00 0.03 99.77 12:34:01 AM all 0.57 0.00 0.08 0.00 0.04 99.31 12:34:01 AM 0 0.67 0.00 0.07 0.00 0.05 99.22 12:34:01 AM 1 0.47 0.00 0.10 0.00 0.03 99.40 12:35:01 AM all 0.22 0.00 0.08 0.00 0.03 99.67 12:35:01 AM 0 0.38 0.00 0.07 0.00 0.03 99.52 12:35:01 AM 1 0.05 0.00 0.08 0.00 0.03 99.83 12:36:01 AM all 0.51 0.00 0.09 0.00 0.03 99.37 12:36:01 AM 0 0.17 0.00 0.08 0.00 0.02 99.73 12:36:01 AM 1 0.85 0.00 0.10 0.00 0.03 99.01 12:37:01 AM all 0.33 0.00 0.05 0.00 0.03 99.59 12:37:01 AM 0 0.53 0.00 0.02 0.00 0.03 99.42 12:37:01 AM 1 0.12 0.00 0.08 0.00 0.03 99.77 12:38:01 AM all 0.35 0.00 0.07 0.00 0.03 99.55 12:38:01 AM 0 0.58 0.00 0.07 0.00 0.03 99.32 12:38:01 AM 1 0.12 0.00 0.07 0.00 0.03 99.78 12:39:01 AM all 7.17 0.00 2.42 0.00 0.06 90.35 12:39:01 AM 0 5.47 0.00 4.19 0.00 0.05 90.29 12:39:01 AM 1 8.88 0.00 0.64 0.00 0.07 90.41 12:40:01 AM all 4.46 0.00 1.85 0.00 0.06 93.63 12:40:01 AM 0 8.47 0.00 3.68 0.00 0.07 87.77 12:40:01 AM 1 0.65 0.00 0.12 0.00 0.05 99.18 12:41:01 AM all 0.38 0.00 0.08 0.00 0.03 99.51 12:41:01 AM 0 0.15 0.00 0.10 0.00 0.03 99.72 12:41:01 AM 1 0.60 0.00 0.07 0.00 0.03 99.30 12:42:01 AM all 0.38 0.00 0.10 0.00 0.03 99.48 12:42:01 AM 0 0.43 0.00 0.12 0.00 0.05 99.40 12:42:01 AM 1 0.33 0.00 0.08 0.00 0.02 99.56 12:43:01 AM all 0.50 0.00 0.08 0.00 0.05 99.37 12:43:01 AM 0 0.35 0.00 0.10 0.00 0.05 99.50 12:43:01 AM 1 0.65 0.00 0.07 0.00 0.05 99.23 12:43:01 AM CPU %user %nice %system %iowait %steal %idle 12:44:01 AM all 2.13 0.00 0.21 0.00 0.05 97.61 12:44:01 AM 0 3.60 0.00 0.34 0.00 0.05 96.01 12:44:01 AM 1 0.68 0.00 0.08 0.00 0.05 99.18 12:45:01 AM all 5.71 0.00 1.32 0.00 0.06 92.91 12:45:01 AM 0 7.84 0.00 2.51 0.00 0.07 89.58 12:45:01 AM 1 3.66 0.00 0.18 0.00 0.05 96.10 12:46:01 AM all 4.58 0.01 0.24 0.01 0.05 95.11 12:46:01 AM 0 5.31 0.02 0.27 0.02 0.05 94.34 12:46:01 AM 1 3.85 0.00 0.22 0.00 0.05 95.89 12:47:01 AM all 4.40 0.00 0.17 0.00 0.07 95.36 12:47:01 AM 0 6.52 0.00 0.18 0.00 0.07 93.23 12:47:01 AM 1 2.29 0.00 0.15 0.00 0.07 97.49 12:48:01 AM all 4.40 0.00 0.21 0.00 0.06 95.34 12:48:01 AM 0 4.23 0.00 0.20 0.00 0.05 95.52 12:48:01 AM 1 4.56 0.00 0.22 0.00 0.07 95.15 12:49:01 AM all 4.45 0.00 0.16 0.00 0.06 95.34 12:49:01 AM 0 5.86 0.00 0.17 0.00 0.07 93.90 12:49:01 AM 1 3.03 0.00 0.15 0.00 0.05 96.77 12:50:01 AM all 4.50 0.00 0.18 0.00 0.05 95.28 12:50:01 AM 0 5.68 0.00 0.18 0.00 0.05 94.08 12:50:01 AM 1 3.31 0.00 0.17 0.00 0.05 96.47 12:51:01 AM all 5.53 0.00 0.33 0.00 0.05 94.09 12:51:01 AM 0 9.47 0.00 0.50 0.00 0.07 89.96 12:51:01 AM 1 1.71 0.00 0.17 0.00 0.03 98.09 12:52:01 AM all 4.20 0.00 1.36 0.00 0.04 94.40 12:52:01 AM 0 8.02 0.00 2.67 0.00 0.05 89.25 12:52:01 AM 1 0.60 0.00 0.12 0.00 0.03 99.25 12:53:01 AM all 0.49 0.00 0.09 0.00 0.05 99.37 12:53:01 AM 0 0.30 0.00 0.12 0.00 0.05 99.53 12:53:01 AM 1 0.68 0.00 0.07 0.00 0.05 99.20 12:54:01 AM all 2.65 0.00 0.20 0.00 0.05 97.10 12:54:01 AM 0 3.53 0.00 0.29 0.00 0.05 96.13 12:54:01 AM 1 1.79 0.00 0.12 0.00 0.05 98.04 12:54:01 AM CPU %user %nice %system %iowait %steal %idle 12:55:01 AM all 6.18 0.00 2.34 0.00 0.06 91.41 12:55:01 AM 0 10.89 0.00 4.62 0.00 0.07 84.41 12:55:01 AM 1 1.75 0.00 0.20 0.00 0.05 97.99 12:56:01 AM all 4.53 0.00 0.29 0.00 0.06 95.12 12:56:01 AM 0 6.14 0.00 0.37 0.00 0.07 93.43 12:56:01 AM 1 2.93 0.00 0.22 0.00 0.05 96.81 12:57:01 AM all 4.40 0.00 0.31 0.00 0.06 95.23 12:57:01 AM 0 4.13 0.00 0.32 0.00 0.05 95.50 12:57:01 AM 1 4.67 0.00 0.30 0.00 0.07 94.96 12:58:01 AM all 4.40 0.00 0.31 0.00 0.06 95.23 12:58:01 AM 0 4.61 0.00 0.28 0.00 0.07 95.04 12:58:01 AM 1 4.20 0.00 0.33 0.00 0.05 95.42 12:59:01 AM all 4.40 0.00 0.30 0.00 0.06 95.24 12:59:01 AM 0 4.83 0.00 0.30 0.00 0.05 94.82 12:59:01 AM 1 3.96 0.00 0.30 0.00 0.07 95.67 01:00:01 AM all 4.40 0.00 0.33 0.00 0.06 95.21 01:00:01 AM 0 4.43 0.00 0.32 0.00 0.07 95.19 01:00:01 AM 1 4.36 0.00 0.35 0.00 0.05 95.23 01:01:01 AM all 7.08 0.00 0.43 0.00 0.06 92.43 01:01:01 AM 0 8.18 0.00 0.45 0.00 0.05 91.32 01:01:01 AM 1 5.97 0.00 0.42 0.00 0.07 93.55 01:02:01 AM all 0.57 0.00 0.09 0.00 0.05 99.29 01:02:01 AM 0 0.53 0.00 0.10 0.00 0.05 99.32 01:02:01 AM 1 0.60 0.00 0.08 0.00 0.05 99.26 01:03:01 AM all 0.20 0.00 0.08 0.00 0.03 99.69 01:03:01 AM 0 0.15 0.00 0.10 0.00 0.02 99.73 01:03:01 AM 1 0.25 0.00 0.07 0.00 0.03 99.65 01:04:01 AM all 0.53 0.00 0.08 0.01 0.05 99.32 01:04:01 AM 0 0.47 0.00 0.10 0.02 0.05 99.37 01:04:01 AM 1 0.60 0.00 0.07 0.00 0.05 99.28 01:05:01 AM all 0.34 0.00 0.08 0.00 0.03 99.54 01:05:01 AM 0 0.13 0.00 0.08 0.00 0.03 99.75 01:05:01 AM 1 0.55 0.00 0.08 0.00 0.03 99.33 01:05:01 AM CPU %user %nice %system %iowait %steal %idle 01:06:01 AM all 0.51 0.00 0.07 0.00 0.03 99.40 01:06:01 AM 0 0.48 0.00 0.10 0.00 0.02 99.40 01:06:01 AM 1 0.53 0.00 0.03 0.00 0.03 99.40 01:07:01 AM all 0.33 0.00 0.06 0.00 0.03 99.57 01:07:01 AM 0 0.10 0.00 0.05 0.00 0.03 99.82 01:07:01 AM 1 0.57 0.00 0.07 0.00 0.03 99.33 01:08:01 AM all 0.33 0.00 0.06 0.00 0.03 99.59 01:08:01 AM 0 0.07 0.00 0.05 0.00 0.02 99.87 01:08:01 AM 1 0.58 0.00 0.07 0.00 0.03 99.32 01:09:01 AM all 7.19 0.00 2.56 0.00 0.05 90.20 01:09:01 AM 0 12.35 0.00 5.01 0.00 0.07 82.57 01:09:01 AM 1 2.40 0.00 0.29 0.00 0.03 97.28 01:10:01 AM all 4.34 0.00 1.81 0.00 0.05 93.79 01:10:01 AM 0 0.28 0.00 0.10 0.00 0.03 99.58 01:10:01 AM 1 8.61 0.00 3.62 0.00 0.07 87.70 01:11:01 AM all 0.33 0.00 0.09 0.00 0.03 99.55 01:11:01 AM 0 0.12 0.00 0.10 0.00 0.03 99.75 01:11:01 AM 1 0.53 0.00 0.08 0.00 0.03 99.35 01:12:01 AM all 2.11 0.00 0.19 0.00 0.03 97.67 01:12:01 AM 0 3.59 0.00 0.26 0.00 0.03 96.12 01:12:01 AM 1 0.67 0.00 0.12 0.00 0.03 99.18 01:13:01 AM all 5.63 0.00 1.26 0.00 0.08 93.03 01:13:01 AM 0 5.47 0.00 2.19 0.00 0.09 92.25 01:13:01 AM 1 5.79 0.00 0.34 0.00 0.07 93.80 01:14:01 AM all 4.41 0.00 0.20 0.00 0.07 95.32 01:14:01 AM 0 5.13 0.00 0.23 0.00 0.07 94.57 01:14:01 AM 1 3.70 0.00 0.17 0.00 0.07 96.07 01:15:01 AM all 4.50 0.00 0.15 0.00 0.06 95.29 01:15:01 AM 0 2.12 0.00 0.13 0.00 0.05 97.70 01:15:01 AM 1 6.88 0.00 0.17 0.00 0.07 92.89 01:16:01 AM all 4.59 0.00 0.18 0.00 0.06 95.17 01:16:01 AM 0 2.66 0.00 0.15 0.00 0.05 97.14 01:16:01 AM 1 6.53 0.00 0.22 0.00 0.07 93.19 01:16:01 AM CPU %user %nice %system %iowait %steal %idle 01:17:01 AM all 4.39 0.00 0.18 0.00 0.06 95.37 01:17:01 AM 0 4.05 0.00 0.17 0.00 0.05 95.73 01:17:01 AM 1 4.73 0.00 0.20 0.00 0.07 95.00 01:18:01 AM all 4.32 0.00 0.18 0.00 0.05 95.45 01:18:01 AM 0 3.97 0.00 0.20 0.00 0.05 95.78 01:18:01 AM 1 4.67 0.00 0.15 0.00 0.05 95.13 01:19:01 AM all 5.62 0.00 0.28 0.00 0.06 94.04 01:19:01 AM 0 8.91 0.00 0.41 0.00 0.07 90.61 01:19:01 AM 1 2.44 0.00 0.15 0.00 0.05 97.36 01:20:01 AM all 6.55 0.00 1.88 0.00 0.07 91.50 01:20:01 AM 0 13.08 0.00 3.83 0.00 0.09 83.00 01:20:01 AM 1 0.63 0.00 0.12 0.00 0.05 99.20 01:21:01 AM all 5.49 0.00 0.96 0.00 0.05 93.51 01:21:01 AM 0 1.79 0.00 0.18 0.00 0.03 98.00 01:21:01 AM 1 9.29 0.00 1.75 0.00 0.07 88.89 01:22:01 AM all 4.39 0.00 0.17 0.00 0.05 95.39 01:22:01 AM 0 3.75 0.00 0.18 0.00 0.05 96.02 01:22:01 AM 1 5.04 0.00 0.15 0.00 0.05 94.76 01:23:01 AM all 4.45 0.00 0.18 0.00 0.05 95.32 01:23:01 AM 0 3.02 0.00 0.13 0.00 0.05 96.79 01:23:01 AM 1 5.87 0.00 0.23 0.00 0.05 93.84 01:24:01 AM all 4.41 0.00 0.19 0.00 0.05 95.35 01:24:01 AM 0 6.20 0.00 0.22 0.00 0.05 93.53 01:24:01 AM 1 2.62 0.00 0.17 0.00 0.05 97.16 01:25:01 AM all 4.47 0.00 0.18 0.00 0.05 95.30 01:25:01 AM 0 4.53 0.00 0.18 0.00 0.05 95.24 01:25:01 AM 1 4.42 0.00 0.17 0.00 0.05 95.37 01:26:01 AM all 4.47 0.00 0.18 0.00 0.05 95.30 01:26:01 AM 0 3.93 0.00 0.17 0.00 0.05 95.86 01:26:01 AM 1 5.00 0.00 0.20 0.00 0.05 94.74 01:27:01 AM all 5.77 0.00 1.37 0.00 0.07 92.79 01:27:01 AM 0 1.57 0.00 0.13 0.00 0.05 98.25 01:27:01 AM 1 10.26 0.00 2.69 0.00 0.09 86.95 01:27:01 AM CPU %user %nice %system %iowait %steal %idle 01:28:01 AM all 6.60 0.00 2.47 0.00 0.06 90.87 01:28:01 AM 0 12.56 0.00 4.98 0.00 0.09 82.37 01:28:01 AM 1 1.09 0.00 0.15 0.00 0.03 98.73 01:29:01 AM all 5.09 0.00 0.37 0.00 0.06 94.48 01:29:01 AM 0 5.62 0.00 0.38 0.00 0.05 93.95 01:29:01 AM 1 4.56 0.00 0.35 0.00 0.07 95.02 01:30:01 AM all 4.34 0.00 0.32 0.00 0.05 95.29 01:30:01 AM 0 3.61 0.00 0.32 0.00 0.05 96.02 01:30:01 AM 1 5.07 0.00 0.32 0.00 0.05 94.56 01:31:01 AM all 4.43 0.00 0.33 0.00 0.06 95.18 01:31:01 AM 0 3.98 0.00 0.30 0.00 0.05 95.67 01:31:01 AM 1 4.88 0.00 0.37 0.00 0.07 94.68 01:32:01 AM all 4.49 0.00 0.33 0.00 0.06 95.12 01:32:01 AM 0 2.36 0.00 0.25 0.00 0.05 97.34 01:32:01 AM 1 6.63 0.00 0.42 0.00 0.07 92.89 01:33:01 AM all 4.35 0.00 0.36 0.00 0.05 95.24 01:33:01 AM 0 4.01 0.00 0.35 0.00 0.05 95.59 01:33:01 AM 1 4.68 0.00 0.37 0.00 0.05 94.90 01:34:01 AM all 4.44 0.00 0.37 0.00 0.05 95.14 01:34:01 AM 0 4.86 0.00 0.38 0.00 0.05 94.71 01:34:01 AM 1 4.03 0.00 0.35 0.00 0.05 95.57 01:35:01 AM all 4.77 0.00 0.27 0.00 0.05 94.91 01:35:01 AM 0 4.89 0.00 0.25 0.00 0.05 94.81 01:35:01 AM 1 4.65 0.00 0.28 0.00 0.05 95.02 01:36:01 AM all 0.33 0.00 0.06 0.00 0.03 99.57 01:36:01 AM 0 0.55 0.00 0.05 0.00 0.03 99.37 01:36:01 AM 1 0.12 0.00 0.07 0.00 0.03 99.78 01:37:01 AM all 0.33 0.00 0.07 0.00 0.03 99.57 01:37:01 AM 0 0.47 0.00 0.05 0.00 0.03 99.45 01:37:01 AM 1 0.18 0.00 0.08 0.00 0.03 99.70 01:38:01 AM all 0.43 0.00 0.06 0.00 0.03 99.49 01:38:01 AM 0 0.35 0.00 0.07 0.00 0.02 99.57 01:38:01 AM 1 0.50 0.00 0.05 0.00 0.03 99.42 01:38:01 AM CPU %user %nice %system %iowait %steal %idle 01:39:01 AM all 0.31 0.00 0.06 0.00 0.03 99.61 01:39:01 AM 0 0.32 0.00 0.07 0.00 0.03 99.58 01:39:01 AM 1 0.30 0.00 0.05 0.00 0.02 99.63 01:40:01 AM all 0.41 0.00 0.08 0.00 0.03 99.48 01:40:01 AM 0 0.45 0.00 0.08 0.00 0.03 99.43 01:40:01 AM 1 0.37 0.00 0.07 0.00 0.03 99.53 01:41:01 AM all 0.31 0.00 0.07 0.00 0.03 99.60 01:41:01 AM 0 0.27 0.00 0.05 0.00 0.02 99.67 01:41:01 AM 1 0.35 0.00 0.08 0.00 0.03 99.53 01:42:01 AM all 6.12 0.00 0.98 0.00 0.05 92.85 01:42:01 AM 0 10.14 0.00 1.81 0.00 0.05 88.00 01:42:01 AM 1 2.17 0.00 0.17 0.00 0.05 97.61 01:43:01 AM all 6.75 0.00 3.63 0.00 0.06 89.56 01:43:01 AM 0 13.31 0.00 7.40 0.00 0.07 79.22 01:43:01 AM 1 0.62 0.00 0.12 0.00 0.05 99.22 01:44:01 AM all 0.37 0.15 0.12 0.01 0.04 99.32 01:44:01 AM 0 0.10 0.30 0.15 0.00 0.05 99.40 01:44:01 AM 1 0.63 0.00 0.08 0.02 0.03 99.23 01:45:01 AM all 0.35 0.00 0.07 0.00 0.03 99.56 01:45:01 AM 0 0.12 0.00 0.08 0.00 0.02 99.78 01:45:01 AM 1 0.58 0.00 0.05 0.00 0.03 99.33 01:46:01 AM all 6.81 0.00 1.71 0.01 0.06 91.41 01:46:01 AM 0 12.64 0.00 3.31 0.00 0.07 83.98 01:46:01 AM 1 1.22 0.00 0.18 0.02 0.05 98.53 01:47:02 AM all 4.42 0.00 0.18 0.00 0.05 95.35 01:47:02 AM 0 4.09 0.00 0.15 0.00 0.05 95.71 01:47:02 AM 1 4.75 0.00 0.20 0.00 0.05 95.00 01:48:01 AM all 4.36 0.00 0.16 0.00 0.06 95.42 01:48:01 AM 0 4.89 0.00 0.15 0.00 0.05 94.90 01:48:01 AM 1 3.83 0.00 0.17 0.00 0.07 95.94 01:49:01 AM all 4.42 0.00 0.18 0.00 0.06 95.34 01:49:01 AM 0 6.52 0.00 0.18 0.00 0.07 93.23 01:49:01 AM 1 2.33 0.00 0.17 0.00 0.05 97.46 01:49:01 AM CPU %user %nice %system %iowait %steal %idle 01:50:01 AM all 4.21 0.00 0.17 0.00 0.05 95.58 01:50:01 AM 0 3.69 0.00 0.15 0.00 0.05 96.11 01:50:01 AM 1 4.72 0.00 0.18 0.00 0.05 95.05 01:51:01 AM all 4.16 0.00 0.18 0.00 0.04 95.62 01:51:01 AM 0 4.44 0.00 0.17 0.00 0.05 95.34 01:51:01 AM 1 3.87 0.00 0.20 0.00 0.03 95.90 01:52:01 AM all 4.52 0.00 0.18 0.00 0.06 95.23 01:52:01 AM 0 4.36 0.00 0.17 0.00 0.05 95.42 01:52:01 AM 1 4.68 0.00 0.20 0.00 0.07 95.05 01:53:01 AM all 6.85 0.00 1.75 0.00 0.07 91.33 01:53:01 AM 0 1.13 0.00 0.18 0.00 0.07 98.62 01:53:01 AM 1 13.13 0.00 3.47 0.00 0.07 83.33 01:54:01 AM all 7.09 0.00 2.55 0.00 0.06 90.29 01:54:01 AM 0 13.55 0.00 5.06 0.00 0.07 81.31 01:54:01 AM 1 0.95 0.00 0.17 0.00 0.05 98.83 01:55:01 AM all 4.21 0.00 0.29 0.00 0.06 95.43 01:55:01 AM 0 4.46 0.00 0.30 0.00 0.05 95.19 01:55:01 AM 1 3.97 0.00 0.28 0.00 0.07 95.68 01:56:01 AM all 4.10 0.00 0.33 0.00 0.06 95.51 01:56:01 AM 0 4.08 0.00 0.35 0.00 0.05 95.52 01:56:01 AM 1 4.13 0.00 0.30 0.00 0.07 95.50 01:57:01 AM all 4.13 0.00 0.32 0.00 0.06 95.50 01:57:01 AM 0 6.60 0.00 0.47 0.00 0.07 92.87 01:57:01 AM 1 1.66 0.00 0.17 0.00 0.05 98.13 01:58:01 AM all 4.18 0.00 0.34 0.00 0.06 95.42 01:58:01 AM 0 5.56 0.00 0.40 0.00 0.07 93.97 01:58:01 AM 1 2.79 0.00 0.28 0.00 0.05 96.87 01:59:01 AM all 4.31 0.00 0.32 0.00 0.06 95.31 01:59:01 AM 0 3.59 0.00 0.25 0.00 0.05 96.11 01:59:01 AM 1 5.03 0.00 0.38 0.00 0.07 94.52 02:00:01 AM all 4.36 0.00 0.33 0.00 0.06 95.25 02:00:01 AM 0 3.49 0.00 0.27 0.00 0.05 96.19 02:00:01 AM 1 5.24 0.00 0.38 0.00 0.07 94.31 02:00:01 AM CPU %user %nice %system %iowait %steal %idle 02:01:01 AM all 4.54 0.00 0.24 0.01 0.06 95.15 02:01:01 AM 0 5.29 0.00 0.28 0.00 0.07 94.36 02:01:01 AM 1 3.78 0.00 0.20 0.02 0.05 95.95 02:02:01 AM all 0.21 0.00 0.08 0.00 0.03 99.68 02:02:01 AM 0 0.07 0.00 0.08 0.00 0.03 99.82 02:02:01 AM 1 0.35 0.00 0.07 0.00 0.03 99.55 02:03:01 AM all 0.48 0.00 0.07 0.00 0.02 99.44 02:03:01 AM 0 0.40 0.00 0.10 0.00 0.02 99.48 02:03:01 AM 1 0.55 0.00 0.03 0.00 0.02 99.40 02:04:01 AM all 0.16 0.00 0.07 0.01 0.03 99.73 02:04:01 AM 0 0.07 0.00 0.03 0.02 0.02 99.87 02:04:01 AM 1 0.25 0.00 0.10 0.00 0.05 99.60 02:05:01 AM all 0.21 0.00 0.06 0.00 0.03 99.70 02:05:01 AM 0 0.10 0.00 0.05 0.00 0.03 99.82 02:05:01 AM 1 0.32 0.00 0.07 0.00 0.03 99.58 02:06:01 AM all 0.48 0.00 0.06 0.00 0.03 99.44 02:06:01 AM 0 0.35 0.00 0.05 0.00 0.02 99.58 02:06:01 AM 1 0.60 0.00 0.07 0.00 0.03 99.30 02:07:01 AM all 0.32 0.00 0.06 0.00 0.03 99.60 02:07:01 AM 0 0.10 0.00 0.08 0.00 0.03 99.78 02:07:01 AM 1 0.53 0.00 0.03 0.00 0.02 99.42 02:08:01 AM all 5.74 0.00 1.83 0.00 0.05 92.38 02:08:01 AM 0 10.95 0.00 3.59 0.00 0.05 85.40 02:08:01 AM 1 0.75 0.00 0.15 0.00 0.05 99.05 02:09:01 AM all 6.46 0.00 2.66 0.00 0.06 90.82 02:09:01 AM 0 12.65 0.00 5.32 0.00 0.07 81.96 02:09:01 AM 1 0.63 0.00 0.15 0.00 0.05 99.16 02:10:01 AM all 0.31 0.00 0.07 0.00 0.03 99.60 02:10:01 AM 0 0.03 0.00 0.02 0.00 0.00 99.95 02:10:01 AM 1 0.59 0.00 0.12 0.00 0.05 99.25 02:11:01 AM all 0.52 0.00 0.07 0.00 0.02 99.40 02:11:01 AM 0 0.27 0.00 0.07 0.00 0.02 99.65 02:11:01 AM 1 0.77 0.00 0.07 0.00 0.02 99.15 02:11:01 AM CPU %user %nice %system %iowait %steal %idle 02:12:01 AM all 0.31 0.00 0.08 0.00 0.04 99.57 02:12:01 AM 0 0.10 0.00 0.08 0.00 0.05 99.77 02:12:01 AM 1 0.52 0.00 0.07 0.00 0.03 99.38 02:13:01 AM all 0.34 0.00 0.08 0.00 0.03 99.56 02:13:01 AM 0 0.13 0.00 0.10 0.00 0.03 99.73 02:13:01 AM 1 0.55 0.00 0.05 0.00 0.02 99.38 02:14:01 AM all 0.49 0.00 0.09 0.00 0.03 99.39 02:14:01 AM 0 0.18 0.00 0.12 0.00 0.03 99.67 02:14:01 AM 1 0.80 0.00 0.07 0.00 0.02 99.12 02:15:01 AM all 0.38 0.00 0.08 0.00 0.03 99.52 02:15:01 AM 0 0.13 0.00 0.10 0.00 0.03 99.73 02:15:01 AM 1 0.62 0.00 0.05 0.00 0.02 99.32 02:16:01 AM all 0.32 0.00 0.10 0.00 0.03 99.56 02:16:01 AM 0 0.25 0.00 0.10 0.00 0.03 99.61 02:16:01 AM 1 0.38 0.00 0.10 0.00 0.02 99.50 02:17:01 AM all 0.36 0.00 0.10 0.00 0.03 99.51 02:17:01 AM 0 0.58 0.00 0.07 0.00 0.03 99.32 02:17:01 AM 1 0.13 0.00 0.13 0.00 0.03 99.70 02:18:01 AM all 0.55 0.00 0.07 0.00 0.03 99.36 02:18:01 AM 0 0.63 0.00 0.05 0.00 0.02 99.30 02:18:01 AM 1 0.47 0.00 0.08 0.00 0.03 99.42 02:19:01 AM all 0.34 0.00 0.08 0.00 0.03 99.55 02:19:01 AM 0 0.62 0.00 0.10 0.00 0.03 99.25 02:19:01 AM 1 0.07 0.00 0.07 0.00 0.02 99.85 02:20:01 AM all 0.38 0.00 0.12 0.00 0.03 99.47 02:20:01 AM 0 0.20 0.00 0.13 0.00 0.03 99.63 02:20:01 AM 1 0.55 0.00 0.10 0.00 0.03 99.31 02:21:01 AM all 0.32 0.00 0.07 0.00 0.03 99.59 02:21:01 AM 0 0.48 0.00 0.07 0.00 0.03 99.42 02:21:01 AM 1 0.15 0.00 0.07 0.00 0.02 99.77 02:22:01 AM all 0.50 0.00 0.09 0.00 0.03 99.37 02:22:01 AM 0 0.63 0.00 0.10 0.00 0.03 99.23 02:22:01 AM 1 0.37 0.00 0.08 0.00 0.03 99.52 02:22:01 AM CPU %user %nice %system %iowait %steal %idle 02:23:01 AM all 0.35 0.00 0.06 0.00 0.03 99.57 02:23:01 AM 0 0.60 0.00 0.07 0.00 0.03 99.30 02:23:01 AM 1 0.10 0.00 0.05 0.00 0.02 99.83 02:24:01 AM all 3.53 0.00 1.60 0.00 0.05 94.82 02:24:01 AM 0 0.68 0.00 0.12 0.00 0.03 99.17 02:24:01 AM 1 6.50 0.00 3.15 0.00 0.07 90.29 02:25:01 AM all 5.49 0.00 0.45 0.00 0.05 94.01 02:25:01 AM 0 1.60 0.00 0.17 0.00 0.03 98.20 02:25:01 AM 1 9.46 0.00 0.73 0.00 0.07 89.74 02:26:01 AM all 4.58 0.00 0.21 0.00 0.05 95.16 02:26:01 AM 0 4.83 0.00 0.22 0.00 0.05 94.90 02:26:01 AM 1 4.33 0.00 0.20 0.00 0.05 95.41 02:27:01 AM all 4.54 0.00 0.18 0.00 0.04 95.23 02:27:01 AM 0 5.08 0.00 0.18 0.00 0.05 94.69 02:27:01 AM 1 4.00 0.00 0.18 0.00 0.03 95.78 02:28:01 AM all 4.57 0.00 0.20 0.00 0.06 95.17 02:28:01 AM 0 4.49 0.00 0.20 0.00 0.05 95.26 02:28:01 AM 1 4.65 0.00 0.20 0.00 0.07 95.08 02:29:01 AM all 4.63 0.00 0.19 0.00 0.04 95.13 02:29:01 AM 0 2.62 0.00 0.18 0.00 0.03 97.16 02:29:01 AM 1 6.65 0.00 0.20 0.00 0.05 93.10 02:30:01 AM all 4.63 0.00 0.19 0.00 0.04 95.13 02:30:01 AM 0 3.99 0.00 0.20 0.00 0.05 95.76 02:30:01 AM 1 5.27 0.00 0.18 0.00 0.03 94.51 02:31:01 AM all 6.40 0.00 0.39 0.00 0.06 93.14 02:31:01 AM 0 4.69 0.00 0.30 0.00 0.05 94.95 02:31:01 AM 1 8.17 0.00 0.49 0.00 0.07 91.28 02:32:01 AM all 2.88 0.00 1.40 0.00 0.41 95.31 02:32:01 AM 0 0.87 0.00 0.13 0.00 0.57 98.44 02:32:01 AM 1 4.99 0.00 2.73 0.00 0.24 92.04 02:33:01 AM all 0.35 0.00 0.07 0.00 0.03 99.56 02:33:01 AM 0 0.27 0.00 0.10 0.00 0.03 99.60 02:33:01 AM 1 0.43 0.00 0.03 0.00 0.02 99.52 02:33:01 AM CPU %user %nice %system %iowait %steal %idle 02:34:01 AM all 0.47 0.00 0.08 0.00 0.02 99.43 02:34:01 AM 0 0.80 0.00 0.05 0.00 0.00 99.15 02:34:01 AM 1 0.13 0.00 0.12 0.00 0.03 99.72 02:35:01 AM all 0.33 0.00 0.07 0.00 0.03 99.57 02:35:01 AM 0 0.52 0.00 0.03 0.00 0.02 99.43 02:35:01 AM 1 0.13 0.00 0.10 0.00 0.05 99.72 02:36:01 AM all 0.47 0.00 0.07 0.00 0.02 99.45 02:36:01 AM 0 0.52 0.00 0.05 0.00 0.02 99.42 02:36:01 AM 1 0.42 0.00 0.08 0.00 0.02 99.48 02:37:01 AM all 0.37 0.00 0.08 0.00 0.02 99.54 02:37:01 AM 0 0.15 0.00 0.10 0.00 0.02 99.73 02:37:01 AM 1 0.58 0.00 0.05 0.00 0.02 99.35 02:38:01 AM all 0.37 0.00 0.10 0.00 0.03 99.51 02:38:01 AM 0 0.38 0.00 0.08 0.00 0.02 99.52 02:38:01 AM 1 0.35 0.00 0.12 0.00 0.03 99.50 02:39:01 AM all 0.29 0.00 0.07 0.00 0.03 99.61 02:39:01 AM 0 0.12 0.00 0.08 0.00 0.03 99.77 02:39:01 AM 1 0.47 0.00 0.05 0.00 0.03 99.45 02:40:01 AM all 0.54 0.00 0.11 0.00 0.03 99.32 02:40:01 AM 0 0.90 0.00 0.12 0.00 0.03 98.95 02:40:01 AM 1 0.18 0.00 0.10 0.00 0.02 99.70 02:41:01 AM all 0.33 0.00 0.08 0.00 0.02 99.57 02:41:01 AM 0 0.57 0.00 0.08 0.00 0.02 99.33 02:41:01 AM 1 0.10 0.00 0.07 0.00 0.02 99.82 02:42:01 AM all 0.45 0.00 0.08 0.00 0.02 99.45 02:42:01 AM 0 0.68 0.00 0.08 0.00 0.02 99.22 02:42:01 AM 1 0.22 0.00 0.08 0.00 0.02 99.68 02:43:01 AM all 0.36 0.00 0.07 0.00 0.03 99.55 02:43:01 AM 0 0.13 0.00 0.07 0.00 0.02 99.78 02:43:01 AM 1 0.58 0.00 0.07 0.00 0.03 99.31 02:44:01 AM all 0.91 0.00 0.13 0.01 0.03 98.92 02:44:01 AM 0 1.53 0.00 0.20 0.00 0.03 98.24 02:44:01 AM 1 0.30 0.00 0.07 0.02 0.02 99.60 02:44:01 AM CPU %user %nice %system %iowait %steal %idle 02:45:01 AM all 6.70 0.00 1.81 0.00 0.05 91.45 02:45:01 AM 0 11.66 0.00 3.47 0.00 0.07 84.80 02:45:01 AM 1 1.91 0.00 0.20 0.00 0.03 97.86 02:46:01 AM all 4.64 0.00 0.18 0.00 0.07 95.11 02:46:01 AM 0 3.24 0.00 0.17 0.00 0.07 96.52 02:46:01 AM 1 6.04 0.00 0.20 0.00 0.07 93.69 02:47:01 AM all 4.62 0.00 0.22 0.00 0.04 95.12 02:47:01 AM 0 7.24 0.00 0.23 0.00 0.03 92.50 02:47:01 AM 1 2.01 0.00 0.20 0.00 0.05 97.74 02:48:01 AM all 4.61 0.00 0.19 0.00 0.05 95.15 02:48:01 AM 0 5.40 0.00 0.22 0.00 0.05 94.33 02:48:01 AM 1 3.81 0.00 0.17 0.00 0.05 95.97 02:49:01 AM all 4.54 0.00 0.19 0.00 0.06 95.21 02:49:01 AM 0 3.68 0.00 0.17 0.00 0.07 96.09 02:49:01 AM 1 5.41 0.00 0.22 0.00 0.05 94.33 02:50:01 AM all 4.61 0.00 0.18 0.00 0.05 95.16 02:50:01 AM 0 5.64 0.00 0.20 0.00 0.05 94.11 02:50:01 AM 1 3.58 0.00 0.17 0.00 0.05 96.20 02:51:01 AM all 5.61 0.00 0.36 0.01 0.05 93.98 02:51:01 AM 0 2.35 0.00 0.22 0.02 0.03 97.38 02:51:01 AM 1 8.95 0.00 0.50 0.00 0.07 90.48 02:52:01 AM all 2.75 0.00 1.36 0.00 0.04 95.85 02:52:01 AM 0 0.18 0.00 0.10 0.00 0.03 99.68 02:52:01 AM 1 5.41 0.00 2.66 0.00 0.05 91.88 02:53:01 AM all 0.33 0.00 0.06 0.00 0.02 99.60 02:53:01 AM 0 0.17 0.00 0.07 0.00 0.02 99.75 02:53:01 AM 1 0.48 0.00 0.05 0.00 0.02 99.45 02:54:01 AM all 0.35 0.00 0.09 0.00 0.03 99.53 02:54:01 AM 0 0.18 0.00 0.10 0.00 0.03 99.68 02:54:01 AM 1 0.52 0.00 0.08 0.00 0.02 99.38 02:55:02 AM all 0.31 0.00 0.08 0.00 0.03 99.59 02:55:02 AM 0 0.50 0.00 0.07 0.00 0.02 99.42 02:55:02 AM 1 0.12 0.00 0.08 0.00 0.03 99.77 02:55:02 AM CPU %user %nice %system %iowait %steal %idle 02:56:01 AM all 0.49 0.00 0.05 0.00 0.02 99.44 02:56:01 AM 0 0.59 0.00 0.03 0.00 0.02 99.36 02:56:01 AM 1 0.39 0.00 0.07 0.00 0.02 99.52 02:57:01 AM all 0.33 0.00 0.08 0.00 0.02 99.58 02:57:01 AM 0 0.55 0.00 0.05 0.00 0.02 99.38 02:57:01 AM 1 0.10 0.00 0.10 0.00 0.02 99.78 02:58:01 AM all 0.43 0.00 0.07 0.00 0.03 99.47 02:58:01 AM 0 0.45 0.00 0.05 0.00 0.03 99.47 02:58:01 AM 1 0.40 0.00 0.08 0.00 0.03 99.48 02:59:01 AM all 0.35 0.00 0.08 0.00 0.02 99.56 02:59:01 AM 0 0.53 0.00 0.03 0.00 0.02 99.42 02:59:01 AM 1 0.17 0.00 0.12 0.00 0.02 99.70 03:00:01 AM all 0.48 0.00 0.08 0.00 0.02 99.42 03:00:01 AM 0 0.57 0.00 0.05 0.00 0.02 99.37 03:00:01 AM 1 0.38 0.00 0.12 0.00 0.02 99.48 03:01:01 AM all 0.35 0.00 0.08 0.00 0.03 99.55 03:01:01 AM 0 0.60 0.00 0.07 0.00 0.03 99.30 03:01:01 AM 1 0.10 0.00 0.08 0.00 0.02 99.80 03:02:01 AM all 0.53 0.00 0.09 0.00 0.03 99.36 03:02:01 AM 0 0.60 0.00 0.08 0.00 0.02 99.30 03:02:01 AM 1 0.45 0.00 0.10 0.00 0.03 99.42 03:03:01 AM all 0.31 0.00 0.07 0.00 0.03 99.60 03:03:01 AM 0 0.50 0.00 0.05 0.00 0.03 99.42 03:03:01 AM 1 0.12 0.00 0.08 0.00 0.02 99.78 03:04:01 AM all 0.99 0.00 0.12 0.00 0.03 98.86 03:04:01 AM 0 0.33 0.00 0.03 0.00 0.02 99.62 03:04:01 AM 1 1.65 0.00 0.20 0.00 0.05 98.10 03:05:01 AM all 6.41 0.00 1.48 0.00 0.05 92.07 03:05:01 AM 0 3.04 0.00 0.17 0.00 0.03 96.76 03:05:01 AM 1 9.96 0.00 2.86 0.00 0.07 87.11 03:06:01 AM all 4.56 0.00 0.19 0.00 0.05 95.19 03:06:01 AM 0 3.67 0.00 0.18 0.00 0.05 96.09 03:06:01 AM 1 5.46 0.00 0.20 0.00 0.05 94.29 03:06:01 AM CPU %user %nice %system %iowait %steal %idle 03:07:01 AM all 4.51 0.00 0.18 0.00 0.06 95.25 03:07:01 AM 0 2.64 0.00 0.15 0.00 0.05 97.16 03:07:01 AM 1 6.38 0.00 0.22 0.00 0.07 93.34 03:08:01 AM all 4.52 0.00 0.19 0.00 0.05 95.23 03:08:01 AM 0 4.35 0.00 0.17 0.00 0.05 95.44 03:08:01 AM 1 4.70 0.00 0.22 0.00 0.05 95.03 03:09:01 AM all 4.51 0.00 0.18 0.00 0.03 95.27 03:09:01 AM 0 6.32 0.00 0.20 0.00 0.03 93.44 03:09:01 AM 1 2.71 0.00 0.17 0.00 0.03 97.09 03:10:01 AM all 4.55 0.00 0.18 0.00 0.05 95.22 03:10:01 AM 0 3.76 0.00 0.18 0.00 0.05 96.00 03:10:01 AM 1 5.34 0.00 0.18 0.00 0.05 94.43 03:11:01 AM all 5.41 0.00 0.28 0.00 0.05 94.26 03:11:01 AM 0 3.38 0.00 0.17 0.00 0.05 96.41 03:11:01 AM 1 7.50 0.00 0.40 0.00 0.05 92.05 03:12:01 AM all 2.54 0.00 1.34 0.00 0.03 96.09 03:12:01 AM 0 0.65 0.00 0.05 0.00 0.02 99.28 03:12:01 AM 1 4.49 0.00 2.68 0.00 0.05 92.78 03:13:01 AM all 0.32 0.00 0.08 0.00 0.03 99.57 03:13:01 AM 0 0.15 0.00 0.05 0.00 0.02 99.78 03:13:01 AM 1 0.48 0.00 0.12 0.00 0.03 99.36 03:14:01 AM all 0.48 0.00 0.07 0.00 0.03 99.42 03:14:01 AM 0 0.35 0.00 0.07 0.00 0.02 99.57 03:14:01 AM 1 0.62 0.00 0.07 0.00 0.03 99.28 03:15:01 AM all 0.35 0.00 0.06 0.00 0.02 99.57 03:15:01 AM 0 0.17 0.00 0.08 0.00 0.02 99.73 03:15:01 AM 1 0.53 0.00 0.03 0.00 0.02 99.42 03:16:01 AM all 0.47 0.00 0.06 0.00 0.03 99.45 03:16:01 AM 0 0.35 0.00 0.08 0.00 0.03 99.53 03:16:01 AM 1 0.58 0.00 0.03 0.00 0.02 99.37 03:17:01 AM all 0.34 0.00 0.07 0.00 0.02 99.57 03:17:01 AM 0 0.12 0.00 0.07 0.00 0.02 99.80 03:17:01 AM 1 0.57 0.00 0.07 0.00 0.02 99.35 03:17:01 AM CPU %user %nice %system %iowait %steal %idle 03:18:01 AM all 0.55 0.00 0.08 0.00 0.03 99.33 03:18:01 AM 0 0.50 0.00 0.12 0.00 0.03 99.35 03:18:01 AM 1 0.60 0.00 0.05 0.00 0.03 99.32 03:19:01 AM all 0.33 0.00 0.08 0.00 0.03 99.57 03:19:01 AM 0 0.12 0.00 0.07 0.00 0.03 99.78 03:19:01 AM 1 0.54 0.00 0.08 0.00 0.03 99.35 03:20:01 AM all 0.38 0.18 0.13 0.00 0.03 99.27 03:20:01 AM 0 0.35 0.33 0.15 0.00 0.02 99.15 03:20:01 AM 1 0.42 0.03 0.12 0.00 0.03 99.40