Started by upstream project "integration-distribution-mri-test-titanium" build number 43 originally caused by: Started by timer Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on prd-centos8-robot-2c-8g-40228 (centos8-robot-2c-8g) in workspace /w/workspace/controller-csit-3node-clustering-tell-all-titanium [ssh-agent] Looking for ssh-agent implementation... [ssh-agent] Exec ssh-agent (binary ssh-agent on a remote machine) $ ssh-agent SSH_AUTH_SOCK=/tmp/ssh-zBNTgHHgPYDn/agent.5298 SSH_AGENT_PID=5299 [ssh-agent] Started. Running ssh-add (command line suppressed) Identity added: /w/workspace/controller-csit-3node-clustering-tell-all-titanium@tmp/private_key_14286726387787444821.key (/w/workspace/controller-csit-3node-clustering-tell-all-titanium@tmp/private_key_14286726387787444821.key) [ssh-agent] Using credentials jenkins (Release Engineering Jenkins Key) The recommended git tool is: NONE using credential opendaylight-jenkins-ssh Wiping out workspace first. Cloning the remote Git repository Cloning repository git://devvexx.opendaylight.org/mirror/integration/test > git init /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test # timeout=10 Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test > git --version # timeout=10 > git --version # 'git version 2.43.0' using GIT_SSH to set credentials Release Engineering Jenkins Key [INFO] Currently running in a labeled security context [INFO] Currently SELinux is 'enforcing' on the host > /usr/bin/chcon --type=ssh_home_t /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test@tmp/jenkins-gitclient-ssh3204094112364711175.key Verifying host key using known hosts file You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification. > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10 Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test using GIT_SSH to set credentials Release Engineering Jenkins Key [INFO] Currently running in a labeled security context [INFO] Currently SELinux is 'enforcing' on the host > /usr/bin/chcon --type=ssh_home_t /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test@tmp/jenkins-gitclient-ssh17777608396510227470.key Verifying host key using known hosts file You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification. > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test master # timeout=10 > git rev-parse FETCH_HEAD^{commit} # timeout=10 Checking out Revision 074069f5d4a1380883ffe1b3642610e77516dcc9 (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f 074069f5d4a1380883ffe1b3642610e77516dcc9 # timeout=10 Commit message: "Update car perf tests for RFC8040 compliance" > git rev-parse FETCH_HEAD^{commit} # timeout=10 > git rev-list --no-walk 7a5ac501dd6c185ea1e99b3d109765d08b47774f # timeout=10 No emails were triggered. provisioning config files... copy managed file [npmrc] to file:/home/jenkins/.npmrc copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml [controller-csit-3node-clustering-tell-all-titanium] $ /bin/bash /tmp/jenkins15420158479393852013.sh ---> python-tools-install.sh Setup pyenv: system * 3.8.13 (set by /opt/pyenv/version) * 3.9.13 (set by /opt/pyenv/version) * 3.10.13 (set by /opt/pyenv/version) * 3.11.7 (set by /opt/pyenv/version) lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-CBnI lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools lf-activate-venv(): INFO: Adding /tmp/venv-CBnI/bin to PATH Generating Requirements File Python 3.11.7 pip 25.1.1 from /tmp/venv-CBnI/lib/python3.11/site-packages/pip (python 3.11) appdirs==1.4.4 argcomplete==3.6.2 aspy.yaml==1.3.0 attrs==25.3.0 autopage==0.5.2 beautifulsoup4==4.13.4 boto3==1.39.3 botocore==1.39.3 bs4==0.0.2 cachetools==5.5.2 certifi==2025.6.15 cffi==1.17.1 cfgv==3.4.0 chardet==5.2.0 charset-normalizer==3.4.2 click==8.2.1 cliff==4.10.0 cmd2==2.7.0 cryptography==3.3.2 debtcollector==3.0.0 decorator==5.2.1 defusedxml==0.7.1 Deprecated==1.2.18 distlib==0.3.9 dnspython==2.7.0 docker==7.1.0 dogpile.cache==1.4.0 durationpy==0.10 email_validator==2.2.0 filelock==3.18.0 future==1.0.0 gitdb==4.0.12 GitPython==3.1.44 google-auth==2.40.3 httplib2==0.22.0 identify==2.6.12 idna==3.10 importlib-resources==1.5.0 iso8601==2.1.0 Jinja2==3.1.6 jmespath==1.0.1 jsonpatch==1.33 jsonpointer==3.0.0 jsonschema==4.24.0 jsonschema-specifications==2025.4.1 keystoneauth1==5.11.1 kubernetes==33.1.0 lftools==0.37.13 lxml==6.0.0 markdown-it-py==3.0.0 MarkupSafe==3.0.2 mdurl==0.1.2 msgpack==1.1.1 multi_key_dict==2.0.3 munch==4.0.0 netaddr==1.3.0 niet==1.4.2 nodeenv==1.9.1 oauth2client==4.1.3 oauthlib==3.3.1 openstacksdk==4.6.0 os-client-config==2.1.0 os-service-types==1.7.0 osc-lib==4.0.2 oslo.config==9.8.0 oslo.context==6.0.0 oslo.i18n==6.5.1 oslo.log==7.1.0 oslo.serialization==5.7.0 oslo.utils==9.0.0 packaging==25.0 pbr==6.1.1 platformdirs==4.3.8 prettytable==3.16.0 psutil==7.0.0 pyasn1==0.6.1 pyasn1_modules==0.4.2 pycparser==2.22 pygerrit2==2.0.15 PyGithub==2.6.1 Pygments==2.19.2 PyJWT==2.10.1 PyNaCl==1.5.0 pyparsing==2.4.7 pyperclip==1.9.0 pyrsistent==0.20.0 python-cinderclient==9.7.0 python-dateutil==2.9.0.post0 python-heatclient==4.2.0 python-jenkins==1.8.2 python-keystoneclient==5.6.0 python-magnumclient==4.8.1 python-openstackclient==8.1.0 python-swiftclient==4.8.0 PyYAML==6.0.2 referencing==0.36.2 requests==2.32.4 requests-oauthlib==2.0.0 requestsexceptions==1.4.0 rfc3986==2.0.0 rich==14.0.0 rich-argparse==1.7.1 rpds-py==0.26.0 rsa==4.9.1 ruamel.yaml==0.18.14 ruamel.yaml.clib==0.2.12 s3transfer==0.13.0 simplejson==3.20.1 six==1.17.0 smmap==5.0.2 soupsieve==2.7 stevedore==5.4.1 tabulate==0.9.0 toml==0.10.2 tomlkit==0.13.3 tqdm==4.67.1 typing_extensions==4.14.1 tzdata==2025.2 urllib3==1.26.20 virtualenv==20.31.2 wcwidth==0.2.13 websocket-client==1.8.0 wrapt==1.17.2 xdg==6.0.0 xmltodict==0.14.2 yq==3.4.3 [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content OS_STACK_TEMPLATE=csit-2-instance-type.yaml OS_CLOUD=vex OS_STACK_NAME=releng-controller-csit-3node-clustering-tell-all-titanium-43 OS_STACK_TEMPLATE_DIR=openstack-hot [EnvInject] - Variables injected successfully. provisioning config files... copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml [controller-csit-3node-clustering-tell-all-titanium] $ /bin/bash /tmp/jenkins10153277750996572497.sh ---> Create parameters file for OpenStack HOT OpenStack Heat parameters generated ----------------------------------- parameters: vm_0_count: '3' vm_0_flavor: 'v3-standard-4' vm_0_image: 'ZZCI - Ubuntu 22.04 - builder - x86_64 - 20250201-010426.857' vm_1_count: '0' vm_1_flavor: 'v3-standard-2' vm_1_image: 'ZZCI - Ubuntu 22.04 - mininet-ovs-217 - x86_64 - 20250201-060151.911' job_name: '14749-43' silo: 'releng' [controller-csit-3node-clustering-tell-all-titanium] $ /bin/bash -l /tmp/jenkins8507395685333101183.sh ---> Create HEAT stack + source /home/jenkins/lf-env.sh + lf-activate-venv --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq ++ mktemp -d /tmp/venv-XXXX + lf_venv=/tmp/venv-vla9 + local venv_file=/tmp/.os_lf_venv + local python=python3 + local options + local set_path=true + local install_args= ++ getopt -o np:v: -l no-path,system-site-packages,python:,venv-file: -n lf-activate-venv -- --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq + options=' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\''' + eval set -- ' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\''' ++ set -- --python python3 -- 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq + true + case $1 in + python=python3 + shift 2 + true + case $1 in + shift + break + case $python in + local pkg_list= + [[ -d /opt/pyenv ]] + echo 'Setup pyenv:' Setup pyenv: + export PYENV_ROOT=/opt/pyenv + PYENV_ROOT=/opt/pyenv + export PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin + PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin + pyenv versions system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-titanium/.python-version) + command -v pyenv ++ pyenv init - --no-rehash + eval 'PATH="$(bash --norc -ec '\''IFS=:; paths=($PATH); for i in ${!paths[@]}; do if [[ ${paths[i]} == "'\'''\''/opt/pyenv/shims'\'''\''" ]]; then unset '\''\'\'''\''paths[i]'\''\'\'''\''; fi; done; echo "${paths[*]}"'\'')" export PATH="/opt/pyenv/shims:${PATH}" export PYENV_SHELL=bash source '\''/opt/pyenv/libexec/../completions/pyenv.bash'\'' pyenv() { local command command="${1:-}" if [ "$#" -gt 0 ]; then shift fi case "$command" in rehash|shell) eval "$(pyenv "sh-$command" "$@")" ;; *) command pyenv "$command" "$@" ;; esac }' +++ bash --norc -ec 'IFS=:; paths=($PATH); for i in ${!paths[@]}; do if [[ ${paths[i]} == "/opt/pyenv/shims" ]]; then unset '\''paths[i]'\''; fi; done; echo "${paths[*]}"' ++ PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin ++ export PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin ++ PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin ++ export PYENV_SHELL=bash ++ PYENV_SHELL=bash ++ source /opt/pyenv/libexec/../completions/pyenv.bash +++ complete -F _pyenv pyenv ++ lf-pyver python3 ++ local py_version_xy=python3 ++ local py_version_xyz= ++ awk '{ print $1 }' ++ pyenv versions ++ local command ++ command=versions ++ '[' 1 -gt 0 ']' ++ shift ++ case "$command" in ++ command pyenv versions ++ pyenv versions ++ sed 's/^[ *]* //' ++ grep -E '^[0-9.]*[0-9]$' ++ [[ ! -s /tmp/.pyenv_versions ]] +++ grep '^3' /tmp/.pyenv_versions +++ tail -n 1 +++ sort -V ++ py_version_xyz=3.11.7 ++ [[ -z 3.11.7 ]] ++ echo 3.11.7 ++ return 0 + pyenv local 3.11.7 + local command + command=local + '[' 2 -gt 0 ']' + shift + case "$command" in + command pyenv local 3.11.7 + pyenv local 3.11.7 + for arg in "$@" + case $arg in + pkg_list+='lftools[openstack] ' + for arg in "$@" + case $arg in + pkg_list+='kubernetes ' + for arg in "$@" + case $arg in + pkg_list+='niet ' + for arg in "$@" + case $arg in + pkg_list+='python-heatclient ' + for arg in "$@" + case $arg in + pkg_list+='python-openstackclient ' + for arg in "$@" + case $arg in + pkg_list+='python-magnumclient ' + for arg in "$@" + case $arg in + pkg_list+='yq ' + [[ -f /tmp/.os_lf_venv ]] ++ cat /tmp/.os_lf_venv + lf_venv=/tmp/venv-CBnI + echo 'lf-activate-venv(): INFO: Reuse venv:/tmp/venv-CBnI from' file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Reuse venv:/tmp/venv-CBnI from file:/tmp/.os_lf_venv + /tmp/venv-CBnI/bin/python3 -m pip install --upgrade --quiet pip 'setuptools<66' virtualenv + [[ -z lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq ]] + echo 'lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq ' lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq + /tmp/venv-CBnI/bin/python3 -m pip install --upgrade --quiet --upgrade-strategy eager 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq + type python3 + true + echo 'lf-activate-venv(): INFO: Adding /tmp/venv-CBnI/bin to PATH' lf-activate-venv(): INFO: Adding /tmp/venv-CBnI/bin to PATH + PATH=/tmp/venv-CBnI/bin:/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin + return 0 + openstack --os-cloud vex limits show --absolute +--------------------------+---------+ | Name | Value | +--------------------------+---------+ | maxTotalInstances | -1 | | maxTotalCores | 450 | | maxTotalRAMSize | 1000000 | | maxServerMeta | 128 | | maxImageMeta | 128 | | maxPersonality | 5 | | maxPersonalitySize | 10240 | | maxTotalKeypairs | 100 | | maxServerGroups | 10 | | maxServerGroupMembers | 10 | | maxTotalFloatingIps | -1 | | maxSecurityGroups | -1 | | maxSecurityGroupRules | -1 | | totalRAMUsed | 630784 | | totalCoresUsed | 154 | | totalInstancesUsed | 54 | | totalFloatingIpsUsed | 0 | | totalSecurityGroupsUsed | 0 | | totalServerGroupsUsed | 0 | | maxTotalVolumes | -1 | | maxTotalSnapshots | 10 | | maxTotalVolumeGigabytes | 4096 | | maxTotalBackups | 10 | | maxTotalBackupGigabytes | 1000 | | totalVolumesUsed | 3 | | totalGigabytesUsed | 60 | | totalSnapshotsUsed | 0 | | totalBackupsUsed | 0 | | totalBackupGigabytesUsed | 0 | +--------------------------+---------+ + pushd /opt/ciman/openstack-hot /opt/ciman/openstack-hot /w/workspace/controller-csit-3node-clustering-tell-all-titanium + lftools openstack --os-cloud vex stack create releng-controller-csit-3node-clustering-tell-all-titanium-43 csit-2-instance-type.yaml /w/workspace/controller-csit-3node-clustering-tell-all-titanium/stack-parameters.yaml Creating stack releng-controller-csit-3node-clustering-tell-all-titanium-43 Waiting to initialize infrastructure... Waiting to initialize infrastructure... Stack initialization successful. ------------------------------------ Stack Details ------------------------------------ {'added': None, 'capabilities': [], 'created_at': '2025-07-06T22:53:53Z', 'deleted': None, 'deleted_at': None, 'description': 'No description', 'environment': None, 'environment_files': None, 'files': None, 'files_container': None, 'id': '4e414267-24b7-4c1e-a7be-34bb098634d2', 'is_rollback_disabled': True, 'links': [{'href': 'https://orchestration.public.mtl1.vexxhost.net/v1/12c36e260d8e4bb2913965203b1b491f/stacks/releng-controller-csit-3node-clustering-tell-all-titanium-43/4e414267-24b7-4c1e-a7be-34bb098634d2', 'rel': 'self'}], 'location': Munch({'cloud': 'vex', 'region_name': 'ca-ymq-1', 'zone': None, 'project': Munch({'id': '12c36e260d8e4bb2913965203b1b491f', 'name': '61975f2c-7c17-4d69-82fa-c3ae420ad6fd', 'domain_id': None, 'domain_name': 'Default'})}), 'name': 'releng-controller-csit-3node-clustering-tell-all-titanium-43', 'notification_topics': [], 'outputs': [{'description': 'IP addresses of the 1st vm types', 'output_key': 'vm_0_ips', 'output_value': ['10.30.170.112', '10.30.171.173', '10.30.171.202']}, {'description': 'IP addresses of the 2nd vm types', 'output_key': 'vm_1_ips', 'output_value': []}], 'owner_id': ****, 'parameters': {'OS::project_id': '12c36e260d8e4bb2913965203b1b491f', 'OS::stack_id': '4e414267-24b7-4c1e-a7be-34bb098634d2', 'OS::stack_name': 'releng-controller-csit-3node-clustering-tell-all-titanium-43', 'job_name': '14749-43', 'silo': 'releng', 'vm_0_count': '3', 'vm_0_flavor': 'v3-standard-4', 'vm_0_image': 'ZZCI - Ubuntu 22.04 - builder - x86_64 - ' '20250201-010426.857', 'vm_1_count': '0', 'vm_1_flavor': 'v3-standard-2', 'vm_1_image': 'ZZCI - Ubuntu 22.04 - mininet-ovs-217 - x86_64 ' '- 20250201-060151.911'}, 'parent_id': None, 'replaced': None, 'status': 'CREATE_COMPLETE', 'status_reason': 'Stack CREATE completed successfully', 'tags': [], 'template': None, 'template_description': 'No description', 'template_url': None, 'timeout_mins': 15, 'unchanged': None, 'updated': None, 'updated_at': None, 'user_project_id': '80c8f35dcf7d4a04a751161eeb88594d'} ------------------------------------ + popd /w/workspace/controller-csit-3node-clustering-tell-all-titanium [controller-csit-3node-clustering-tell-all-titanium] $ /bin/bash -l /tmp/jenkins21048301451619855.sh ---> Copy SSH public keys to CSIT lab Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-titanium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-CBnI from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes python-heatclient python-openstackclient lf-activate-venv(): INFO: Adding /tmp/venv-CBnI/bin to PATH SSH not responding on 10.30.171.173. Retrying in 10 seconds... SSH not responding on 10.30.170.112. Retrying in 10 seconds... SSH not responding on 10.30.171.202. Retrying in 10 seconds... Ping to 10.30.171.173 successful. Ping to 10.30.170.112 successful. Ping to 10.30.171.202 successful. SSH not responding on 10.30.171.202. Retrying in 10 seconds... Warning: Permanently added '10.30.170.112' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.171.173' (ECDSA) to the list of known hosts. releng-14749-43-0-builder-0 Successfully copied public keys to slave 10.30.170.112 Process 6519 ready. releng-14749-43-0-builder-1 Successfully copied public keys to slave 10.30.171.173 Process 6520 ready. Ping to 10.30.171.202 successful. Warning: Permanently added '10.30.171.202' (ECDSA) to the list of known hosts. releng-14749-43-0-builder-2 Successfully copied public keys to slave 10.30.171.202 Process 6521 ready. SSH ready on all stack servers. [controller-csit-3node-clustering-tell-all-titanium] $ /bin/bash -l /tmp/jenkins5795390418108182650.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-titanium/.python-version) lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-buwH lf-activate-venv(): INFO: Save venv in file: /w/workspace/controller-csit-3node-clustering-tell-all-titanium/.robot_venv lf-activate-venv(): INFO: Installing: setuptools wheel lf-activate-venv(): INFO: Adding /tmp/venv-buwH/bin to PATH + echo 'Installing Python Requirements' Installing Python Requirements + cat + python -m pip install -r requirements.txt Looking in indexes: https://nexus3.opendaylight.org/repository/PyPi/simple Collecting docker-py (from -r requirements.txt (line 1)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/docker-py/1.10.6/docker_py-1.10.6-py2.py3-none-any.whl (50 kB) Collecting ipaddr (from -r requirements.txt (line 2)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/ipaddr/2.2.0/ipaddr-2.2.0.tar.gz (26 kB) Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Collecting netaddr (from -r requirements.txt (line 3)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/netaddr/1.3.0/netaddr-1.3.0-py3-none-any.whl (2.3 MB) Collecting netifaces (from -r requirements.txt (line 4)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/netifaces/0.11.0/netifaces-0.11.0.tar.gz (30 kB) Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Collecting pyhocon (from -r requirements.txt (line 5)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyhocon/0.3.61/pyhocon-0.3.61-py3-none-any.whl (25 kB) Collecting requests (from -r requirements.txt (line 6)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/requests/2.32.4/requests-2.32.4-py3-none-any.whl (64 kB) Collecting robotframework (from -r requirements.txt (line 7)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework/7.3.2/robotframework-7.3.2-py3-none-any.whl (795 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 795.1/795.1 kB 14.1 MB/s eta 0:00:00 Collecting robotframework-httplibrary (from -r requirements.txt (line 8)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-httplibrary/0.4.2/robotframework-httplibrary-0.4.2.tar.gz (9.1 kB) Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Collecting robotframework-requests==0.9.7 (from -r requirements.txt (line 9)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-requests/0.9.7/robotframework_requests-0.9.7-py3-none-any.whl (21 kB) Collecting robotframework-selenium2library (from -r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-selenium2library/3.0.0/robotframework_selenium2library-3.0.0-py2.py3-none-any.whl (6.2 kB) Collecting robotframework-sshlibrary==3.8.0 (from -r requirements.txt (line 11)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-sshlibrary/3.8.0/robotframework-sshlibrary-3.8.0.tar.gz (51 kB) Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Collecting scapy (from -r requirements.txt (line 12)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/scapy/2.6.1/scapy-2.6.1-py3-none-any.whl (2.4 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.4/2.4 MB 39.6 MB/s eta 0:00:00 Collecting jsonpath-rw (from -r requirements.txt (line 15)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpath-rw/1.4.0/jsonpath-rw-1.4.0.tar.gz (13 kB) Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Collecting elasticsearch (from -r requirements.txt (line 18)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch/9.0.2/elasticsearch-9.0.2-py3-none-any.whl (914 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 914.3/914.3 kB 44.2 MB/s eta 0:00:00 Collecting elasticsearch-dsl (from -r requirements.txt (line 19)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch-dsl/8.18.0/elasticsearch_dsl-8.18.0-py3-none-any.whl (10 kB) Collecting pyangbind (from -r requirements.txt (line 22)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyangbind/0.8.6/pyangbind-0.8.6-py3-none-any.whl (52 kB) Collecting isodate (from -r requirements.txt (line 25)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/isodate/0.7.2/isodate-0.7.2-py3-none-any.whl (22 kB) Collecting jmespath (from -r requirements.txt (line 28)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jmespath/1.0.1/jmespath-1.0.1-py3-none-any.whl (20 kB) Collecting jsonpatch (from -r requirements.txt (line 31)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpatch/1.33/jsonpatch-1.33-py2.py3-none-any.whl (12 kB) Collecting paramiko>=1.15.3 (from robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/paramiko/3.5.1/paramiko-3.5.1-py3-none-any.whl (227 kB) Collecting scp>=0.13.0 (from robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/scp/0.15.0/scp-0.15.0-py2.py3-none-any.whl (8.8 kB) Collecting docker-pycreds>=0.2.1 (from docker-py->-r requirements.txt (line 1)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/docker-pycreds/0.4.0/docker_pycreds-0.4.0-py2.py3-none-any.whl (9.0 kB) Collecting six>=1.4.0 (from docker-py->-r requirements.txt (line 1)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/six/1.17.0/six-1.17.0-py2.py3-none-any.whl (11 kB) Collecting websocket-client>=0.32.0 (from docker-py->-r requirements.txt (line 1)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/websocket-client/1.8.0/websocket_client-1.8.0-py3-none-any.whl (58 kB) Collecting pyparsing<4,>=2 (from pyhocon->-r requirements.txt (line 5)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pyparsing/3.2.3/pyparsing-3.2.3-py3-none-any.whl (111 kB) Collecting charset_normalizer<4,>=2 (from requests->-r requirements.txt (line 6)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/charset-normalizer/3.4.2/charset_normalizer-3.4.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (147 kB) Collecting idna<4,>=2.5 (from requests->-r requirements.txt (line 6)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/idna/3.10/idna-3.10-py3-none-any.whl (70 kB) Collecting urllib3<3,>=1.21.1 (from requests->-r requirements.txt (line 6)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/urllib3/2.5.0/urllib3-2.5.0-py3-none-any.whl (129 kB) Collecting certifi>=2017.4.17 (from requests->-r requirements.txt (line 6)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/certifi/2025.6.15/certifi-2025.6.15-py3-none-any.whl (157 kB) Collecting webtest>=2.0 (from robotframework-httplibrary->-r requirements.txt (line 8)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/webtest/3.0.6/webtest-3.0.6-py3-none-any.whl (32 kB) Collecting jsonpointer (from robotframework-httplibrary->-r requirements.txt (line 8)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpointer/3.0.0/jsonpointer-3.0.0-py2.py3-none-any.whl (7.6 kB) Collecting robotframework-seleniumlibrary>=3.0.0 (from robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-seleniumlibrary/6.7.1/robotframework_seleniumlibrary-6.7.1-py2.py3-none-any.whl (104 kB) Collecting ply (from jsonpath-rw->-r requirements.txt (line 15)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/ply/3.11/ply-3.11-py2.py3-none-any.whl (49 kB) Collecting decorator (from jsonpath-rw->-r requirements.txt (line 15)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/decorator/5.2.1/decorator-5.2.1-py3-none-any.whl (9.2 kB) Collecting elastic-transport<9,>=8.15.1 (from elasticsearch->-r requirements.txt (line 18)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elastic-transport/8.17.1/elastic_transport-8.17.1-py3-none-any.whl (64 kB) Collecting python-dateutil (from elasticsearch->-r requirements.txt (line 18)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/python-dateutil/2.9.0.post0/python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) Collecting typing-extensions (from elasticsearch->-r requirements.txt (line 18)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/typing-extensions/4.14.1/typing_extensions-4.14.1-py3-none-any.whl (43 kB) Collecting elasticsearch (from -r requirements.txt (line 18)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch/8.18.1/elasticsearch-8.18.1-py3-none-any.whl (906 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 906.3/906.3 kB 17.2 MB/s eta 0:00:00 Collecting pyang (from pyangbind->-r requirements.txt (line 22)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyang/2.6.1/pyang-2.6.1-py2.py3-none-any.whl (594 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 594.7/594.7 kB 34.1 MB/s eta 0:00:00 Collecting lxml (from pyangbind->-r requirements.txt (line 22)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/lxml/6.0.0/lxml-6.0.0-cp311-cp311-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl (5.2 MB) Collecting regex (from pyangbind->-r requirements.txt (line 22)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/regex/2024.11.6/regex-2024.11.6-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (792 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 792.7/792.7 kB 16.7 MB/s eta 0:00:00 Collecting enum34 (from pyangbind->-r requirements.txt (line 22)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/enum34/1.1.10/enum34-1.1.10-py3-none-any.whl (11 kB) Collecting bcrypt>=3.2 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/bcrypt/4.3.0/bcrypt-4.3.0-cp39-abi3-manylinux_2_28_x86_64.whl (284 kB) Collecting cryptography>=3.3 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/cryptography/45.0.5/cryptography-45.0.5-cp311-abi3-manylinux_2_28_x86_64.whl (4.5 MB) Collecting pynacl>=1.5 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pynacl/1.5.0/PyNaCl-1.5.0-cp36-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.manylinux_2_24_x86_64.whl (856 kB) Collecting cffi>=1.14 (from cryptography>=3.3->paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/cffi/1.17.1/cffi-1.17.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (467 kB) Collecting pycparser (from cffi>=1.14->cryptography>=3.3->paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pycparser/2.22/pycparser-2.22-py3-none-any.whl (117 kB) Collecting selenium>=4.3.0 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/selenium/4.34.0/selenium-4.34.0-py3-none-any.whl (9.4 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 9.4/9.4 MB 52.1 MB/s eta 0:00:00 Collecting robotframework-pythonlibcore>=4.4.1 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-pythonlibcore/4.4.1/robotframework_pythonlibcore-4.4.1-py2.py3-none-any.whl (12 kB) Collecting click>=8.0 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/click/8.2.1/click-8.2.1-py3-none-any.whl (102 kB) Collecting urllib3<3,>=1.21.1 (from requests->-r requirements.txt (line 6)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/urllib3/2.4.0/urllib3-2.4.0-py3-none-any.whl (128 kB) Collecting trio~=0.30.0 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/trio/0.30.0/trio-0.30.0-py3-none-any.whl (499 kB) Collecting trio-websocket~=0.12.2 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/trio-websocket/0.12.2/trio_websocket-0.12.2-py3-none-any.whl (21 kB) Collecting attrs>=23.2.0 (from trio~=0.30.0->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/attrs/25.3.0/attrs-25.3.0-py3-none-any.whl (63 kB) Collecting sortedcontainers (from trio~=0.30.0->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/sortedcontainers/2.4.0/sortedcontainers-2.4.0-py2.py3-none-any.whl (29 kB) Collecting outcome (from trio~=0.30.0->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/outcome/1.3.0.post0/outcome-1.3.0.post0-py2.py3-none-any.whl (10 kB) Collecting sniffio>=1.3.0 (from trio~=0.30.0->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/sniffio/1.3.1/sniffio-1.3.1-py3-none-any.whl (10 kB) Collecting wsproto>=0.14 (from trio-websocket~=0.12.2->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/wsproto/1.2.0/wsproto-1.2.0-py3-none-any.whl (24 kB) Collecting pysocks!=1.5.7,<2.0,>=1.5.6 (from urllib3[socks]~=2.4.0->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pysocks/1.7.1/PySocks-1.7.1-py3-none-any.whl (16 kB) Collecting WebOb>=1.2 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/webob/1.8.9/WebOb-1.8.9-py2.py3-none-any.whl (115 kB) Collecting waitress>=3.0.2 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/waitress/3.0.2/waitress-3.0.2-py3-none-any.whl (56 kB) Collecting beautifulsoup4 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/beautifulsoup4/4.13.4/beautifulsoup4-4.13.4-py3-none-any.whl (187 kB) Collecting h11<1,>=0.9.0 (from wsproto>=0.14->trio-websocket~=0.12.2->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/h11/0.16.0/h11-0.16.0-py3-none-any.whl (37 kB) Collecting soupsieve>1.2 (from beautifulsoup4->webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/soupsieve/2.7/soupsieve-2.7-py3-none-any.whl (36 kB) Building wheels for collected packages: robotframework-sshlibrary, ipaddr, netifaces, robotframework-httplibrary, jsonpath-rw DEPRECATION: Building 'robotframework-sshlibrary' using the legacy setup.py bdist_wheel mechanism, which will be removed in a future version. pip 25.3 will enforce this behaviour change. A possible replacement is to use the standardized build interface by setting the `--use-pep517` option, (possibly combined with `--no-build-isolation`), or adding a `pyproject.toml` file to the source tree of 'robotframework-sshlibrary'. Discussion can be found at https://github.com/pypa/pip/issues/6334 Building wheel for robotframework-sshlibrary (setup.py): started Building wheel for robotframework-sshlibrary (setup.py): finished with status 'done' Created wheel for robotframework-sshlibrary: filename=robotframework_sshlibrary-3.8.0-py3-none-any.whl size=55205 sha256=a858d3522bf37f8fba0b45af7d1c6bba7a501f50aede3c164f8ea1fb112436a8 Stored in directory: /home/jenkins/.cache/pip/wheels/f7/c9/b3/a977b7bcc410d45ae27d240df3d00a12585509180e373ecccc DEPRECATION: Building 'ipaddr' using the legacy setup.py bdist_wheel mechanism, which will be removed in a future version. pip 25.3 will enforce this behaviour change. A possible replacement is to use the standardized build interface by setting the `--use-pep517` option, (possibly combined with `--no-build-isolation`), or adding a `pyproject.toml` file to the source tree of 'ipaddr'. Discussion can be found at https://github.com/pypa/pip/issues/6334 Building wheel for ipaddr (setup.py): started Building wheel for ipaddr (setup.py): finished with status 'done' Created wheel for ipaddr: filename=ipaddr-2.2.0-py3-none-any.whl size=18353 sha256=f710f34cc4832f52c95d6ee7c8b8f890bd1da551f743fce9defc3d403762b8b2 Stored in directory: /home/jenkins/.cache/pip/wheels/dc/6c/04/da2d847fa8d45c59af3e1d83e2acc29cb8adcbaf04c0898dbf DEPRECATION: Building 'netifaces' using the legacy setup.py bdist_wheel mechanism, which will be removed in a future version. pip 25.3 will enforce this behaviour change. A possible replacement is to use the standardized build interface by setting the `--use-pep517` option, (possibly combined with `--no-build-isolation`), or adding a `pyproject.toml` file to the source tree of 'netifaces'. Discussion can be found at https://github.com/pypa/pip/issues/6334 Building wheel for netifaces (setup.py): started Building wheel for netifaces (setup.py): finished with status 'done' Created wheel for netifaces: filename=netifaces-0.11.0-cp311-cp311-linux_x86_64.whl size=41080 sha256=6977f15a53510a35061686fb16f2e6a24c29453cfc7c929e9ce9b1debd36885f Stored in directory: /home/jenkins/.cache/pip/wheels/f8/18/88/e61d54b995bea304bdb1d040a92b72228a1bf72ca2a3eba7c9 DEPRECATION: Building 'robotframework-httplibrary' using the legacy setup.py bdist_wheel mechanism, which will be removed in a future version. pip 25.3 will enforce this behaviour change. A possible replacement is to use the standardized build interface by setting the `--use-pep517` option, (possibly combined with `--no-build-isolation`), or adding a `pyproject.toml` file to the source tree of 'robotframework-httplibrary'. Discussion can be found at https://github.com/pypa/pip/issues/6334 Building wheel for robotframework-httplibrary (setup.py): started Building wheel for robotframework-httplibrary (setup.py): finished with status 'done' Created wheel for robotframework-httplibrary: filename=robotframework_httplibrary-0.4.2-py3-none-any.whl size=10014 sha256=04f4da98ef3e8a6ed38424d7135556de00572493cbfcfa57ac7e8036952b6d5c Stored in directory: /home/jenkins/.cache/pip/wheels/aa/bc/0d/9a20dd51effef392aae2733cb4c7b66c6fa29fca33d88b57ed DEPRECATION: Building 'jsonpath-rw' using the legacy setup.py bdist_wheel mechanism, which will be removed in a future version. pip 25.3 will enforce this behaviour change. A possible replacement is to use the standardized build interface by setting the `--use-pep517` option, (possibly combined with `--no-build-isolation`), or adding a `pyproject.toml` file to the source tree of 'jsonpath-rw'. Discussion can be found at https://github.com/pypa/pip/issues/6334 Building wheel for jsonpath-rw (setup.py): started Building wheel for jsonpath-rw (setup.py): finished with status 'done' Created wheel for jsonpath-rw: filename=jsonpath_rw-1.4.0-py3-none-any.whl size=15176 sha256=52f7b6dbda92703922239b3abe89290109a32e50f23924bf69fad312641b250d Stored in directory: /home/jenkins/.cache/pip/wheels/f1/54/63/9a8da38cefae13755097b36cc852decc25d8ef69c37d58d4eb Successfully built robotframework-sshlibrary ipaddr netifaces robotframework-httplibrary jsonpath-rw Installing collected packages: sortedcontainers, ply, netifaces, ipaddr, enum34, websocket-client, WebOb, waitress, urllib3, typing-extensions, soupsieve, sniffio, six, scapy, robotframework-pythonlibcore, robotframework, regex, pysocks, pyparsing, pycparser, netaddr, lxml, jsonpointer, jmespath, isodate, idna, h11, decorator, click, charset_normalizer, certifi, bcrypt, attrs, wsproto, requests, python-dateutil, pyhocon, pyang, outcome, jsonpath-rw, jsonpatch, elastic-transport, docker-pycreds, cffi, beautifulsoup4, webtest, trio, robotframework-requests, pynacl, pyangbind, elasticsearch, docker-py, cryptography, trio-websocket, robotframework-httplibrary, paramiko, elasticsearch-dsl, selenium, scp, robotframework-sshlibrary, robotframework-seleniumlibrary, robotframework-selenium2library Successfully installed WebOb-1.8.9 attrs-25.3.0 bcrypt-4.3.0 beautifulsoup4-4.13.4 certifi-2025.6.15 cffi-1.17.1 charset_normalizer-3.4.2 click-8.2.1 cryptography-45.0.5 decorator-5.2.1 docker-py-1.10.6 docker-pycreds-0.4.0 elastic-transport-8.17.1 elasticsearch-8.18.1 elasticsearch-dsl-8.18.0 enum34-1.1.10 h11-0.16.0 idna-3.10 ipaddr-2.2.0 isodate-0.7.2 jmespath-1.0.1 jsonpatch-1.33 jsonpath-rw-1.4.0 jsonpointer-3.0.0 lxml-6.0.0 netaddr-1.3.0 netifaces-0.11.0 outcome-1.3.0.post0 paramiko-3.5.1 ply-3.11 pyang-2.6.1 pyangbind-0.8.6 pycparser-2.22 pyhocon-0.3.61 pynacl-1.5.0 pyparsing-3.2.3 pysocks-1.7.1 python-dateutil-2.9.0.post0 regex-2024.11.6 requests-2.32.4 robotframework-7.3.2 robotframework-httplibrary-0.4.2 robotframework-pythonlibcore-4.4.1 robotframework-requests-0.9.7 robotframework-selenium2library-3.0.0 robotframework-seleniumlibrary-6.7.1 robotframework-sshlibrary-3.8.0 scapy-2.6.1 scp-0.15.0 selenium-4.34.0 six-1.17.0 sniffio-1.3.1 sortedcontainers-2.4.0 soupsieve-2.7 trio-0.30.0 trio-websocket-0.12.2 typing-extensions-4.14.1 urllib3-2.4.0 waitress-3.0.2 websocket-client-1.8.0 webtest-3.0.6 wsproto-1.2.0 + pip freeze attrs==25.3.0 bcrypt==4.3.0 beautifulsoup4==4.13.4 certifi==2025.6.15 cffi==1.17.1 charset-normalizer==3.4.2 click==8.2.1 cryptography==45.0.5 decorator==5.2.1 distlib==0.3.9 docker-py==1.10.6 docker-pycreds==0.4.0 elastic-transport==8.17.1 elasticsearch==8.18.1 elasticsearch-dsl==8.18.0 enum34==1.1.10 filelock==3.18.0 h11==0.16.0 idna==3.10 ipaddr==2.2.0 isodate==0.7.2 jmespath==1.0.1 jsonpatch==1.33 jsonpath-rw==1.4.0 jsonpointer==3.0.0 lxml==6.0.0 netaddr==1.3.0 netifaces==0.11.0 outcome==1.3.0.post0 paramiko==3.5.1 platformdirs==4.3.8 ply==3.11 pyang==2.6.1 pyangbind==0.8.6 pycparser==2.22 pyhocon==0.3.61 PyNaCl==1.5.0 pyparsing==3.2.3 PySocks==1.7.1 python-dateutil==2.9.0.post0 regex==2024.11.6 requests==2.32.4 robotframework==7.3.2 robotframework-httplibrary==0.4.2 robotframework-pythonlibcore==4.4.1 robotframework-requests==0.9.7 robotframework-selenium2library==3.0.0 robotframework-seleniumlibrary==6.7.1 robotframework-sshlibrary==3.8.0 scapy==2.6.1 scp==0.15.0 selenium==4.34.0 six==1.17.0 sniffio==1.3.1 sortedcontainers==2.4.0 soupsieve==2.7 trio==0.30.0 trio-websocket==0.12.2 typing_extensions==4.14.1 urllib3==2.4.0 virtualenv==20.31.2 waitress==3.0.2 WebOb==1.8.9 websocket-client==1.8.0 WebTest==3.0.6 wsproto==1.2.0 [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'env.properties' [EnvInject] - Variables injected successfully. [controller-csit-3node-clustering-tell-all-titanium] $ /bin/bash -l /tmp/jenkins3354127769775722382.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-titanium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-CBnI from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: python-heatclient python-openstackclient yq ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. lftools 0.37.13 requires urllib3<2.1.0, but you have urllib3 2.5.0 which is incompatible. lf-activate-venv(): INFO: Adding /tmp/venv-CBnI/bin to PATH + ODL_SYSTEM=() + TOOLS_SYSTEM=() + OPENSTACK_SYSTEM=() + OPENSTACK_CONTROLLERS=() + mapfile -t ADDR ++ openstack stack show -f json -c outputs releng-controller-csit-3node-clustering-tell-all-titanium-43 ++ jq -r '.outputs[] | select(.output_key | match("^vm_[0-9]+_ips$")) | .output_value | .[]' + for i in "${ADDR[@]}" ++ ssh 10.30.170.112 hostname -s Warning: Permanently added '10.30.170.112' (ECDSA) to the list of known hosts. + REMHOST=releng-14749-43-0-builder-0 + case ${REMHOST} in + ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}") + for i in "${ADDR[@]}" ++ ssh 10.30.171.173 hostname -s Warning: Permanently added '10.30.171.173' (ECDSA) to the list of known hosts. + REMHOST=releng-14749-43-0-builder-1 + case ${REMHOST} in + ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}") + for i in "${ADDR[@]}" ++ ssh 10.30.171.202 hostname -s Warning: Permanently added '10.30.171.202' (ECDSA) to the list of known hosts. + REMHOST=releng-14749-43-0-builder-2 + case ${REMHOST} in + ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}") + echo NUM_ODL_SYSTEM=3 + echo NUM_TOOLS_SYSTEM=0 + '[' '' == yes ']' + NUM_OPENSTACK_SYSTEM=0 + echo NUM_OPENSTACK_SYSTEM=0 + '[' 0 -eq 2 ']' + echo ODL_SYSTEM_IP=10.30.170.112 ++ seq 0 2 + for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 ))) + echo ODL_SYSTEM_1_IP=10.30.170.112 + for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 ))) + echo ODL_SYSTEM_2_IP=10.30.171.173 + for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 ))) + echo ODL_SYSTEM_3_IP=10.30.171.202 + echo TOOLS_SYSTEM_IP= ++ seq 0 -1 + openstack_index=0 + NUM_OPENSTACK_CONTROL_NODES=1 + echo NUM_OPENSTACK_CONTROL_NODES=1 ++ seq 0 0 + for i in $(seq 0 $((NUM_OPENSTACK_CONTROL_NODES - 1))) + echo OPENSTACK_CONTROL_NODE_1_IP= + NUM_OPENSTACK_COMPUTE_NODES=-1 + echo NUM_OPENSTACK_COMPUTE_NODES=-1 + '[' -1 -ge 2 ']' ++ seq 0 -2 + NUM_OPENSTACK_HAPROXY_NODES=0 + echo NUM_OPENSTACK_HAPROXY_NODES=0 ++ seq 0 -1 + echo 'Contents of slave_addresses.txt:' Contents of slave_addresses.txt: + cat slave_addresses.txt NUM_ODL_SYSTEM=3 NUM_TOOLS_SYSTEM=0 NUM_OPENSTACK_SYSTEM=0 ODL_SYSTEM_IP=10.30.170.112 ODL_SYSTEM_1_IP=10.30.170.112 ODL_SYSTEM_2_IP=10.30.171.173 ODL_SYSTEM_3_IP=10.30.171.202 TOOLS_SYSTEM_IP= NUM_OPENSTACK_CONTROL_NODES=1 OPENSTACK_CONTROL_NODE_1_IP= NUM_OPENSTACK_COMPUTE_NODES=-1 NUM_OPENSTACK_HAPROXY_NODES=0 [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'slave_addresses.txt' [EnvInject] - Variables injected successfully. [controller-csit-3node-clustering-tell-all-titanium] $ /bin/sh /tmp/jenkins7343616760181581783.sh Preparing for JRE Version 21 Karaf artifact is karaf Karaf project is integration Java home is /usr/lib/jvm/java-21-openjdk-amd64 [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'set_variables.env' [EnvInject] - Variables injected successfully. [controller-csit-3node-clustering-tell-all-titanium] $ /bin/bash /tmp/jenkins15030066343236060278.sh 2025-07-06 22:55:51 URL:https://raw.githubusercontent.com/opendaylight/integration-distribution/master/pom.xml [2619/2619] -> "pom.xml" [1] Bundle version is 0.22.0-SNAPSHOT --2025-07-06 22:55:51-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.22.0-SNAPSHOT/maven-metadata.xml Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6 Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 1398 (1.4K) [application/xml] Saving to: ‘maven-metadata.xml’ 0K . 100% 55.9M=0s 2025-07-06 22:55:51 (55.9 MB/s) - ‘maven-metadata.xml’ saved [1398/1398] org.opendaylight.integration karaf 0.22.0-SNAPSHOT 20250706.175225 1 20250706175225 pom 0.22.0-20250706.175225-1 20250706175225 tar.gz 0.22.0-20250706.175225-1 20250706175225 zip 0.22.0-20250706.175225-1 20250706175225 cyclonedx xml 0.22.0-20250706.175225-1 20250706175225 cyclonedx json 0.22.0-20250706.175225-1 20250706175225 Nexus timestamp is 0.22.0-20250706.175225-1 Distribution bundle URL is https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.22.0-SNAPSHOT/karaf-0.22.0-20250706.175225-1.zip Distribution bundle is karaf-0.22.0-20250706.175225-1.zip Distribution bundle version is 0.22.0-SNAPSHOT Distribution folder is karaf-0.22.0-SNAPSHOT Nexus prefix is https://nexus.opendaylight.org [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'detect_variables.env' [EnvInject] - Variables injected successfully. [controller-csit-3node-clustering-tell-all-titanium] $ /bin/bash -l /tmp/jenkins18403591674081151909.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-titanium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-CBnI from file:/tmp/.os_lf_venv ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. lftools 0.37.13 requires urllib3<2.1.0, but you have urllib3 2.5.0 which is incompatible. lf-activate-venv(): INFO: Installing: python-heatclient python-openstackclient ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. lftools 0.37.13 requires urllib3<2.1.0, but you have urllib3 2.5.0 which is incompatible. lf-activate-venv(): INFO: Adding /tmp/venv-CBnI/bin to PATH Copying common-functions.sh to /tmp Copying common-functions.sh to 10.30.170.112:/tmp Warning: Permanently added '10.30.170.112' (ECDSA) to the list of known hosts. Copying common-functions.sh to 10.30.171.173:/tmp Warning: Permanently added '10.30.171.173' (ECDSA) to the list of known hosts. Copying common-functions.sh to 10.30.171.202:/tmp Warning: Permanently added '10.30.171.202' (ECDSA) to the list of known hosts. [controller-csit-3node-clustering-tell-all-titanium] $ /bin/bash /tmp/jenkins6501755933928185357.sh common-functions.sh is being sourced common-functions environment: MAVENCONF: /tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ACTUALFEATURES: FEATURESCONF: /tmp/karaf-0.22.0-SNAPSHOT/etc/org.apache.karaf.features.cfg CUSTOMPROP: /tmp/karaf-0.22.0-SNAPSHOT/etc/custom.properties LOGCONF: /tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg MEMCONF: /tmp/karaf-0.22.0-SNAPSHOT/bin/setenv CONTROLLERMEM: 2048m AKKACONF: /tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/pekko.conf MODULESCONF: /tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/modules.conf MODULESHARDSCONF: /tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/module-shards.conf SUITES: ################################################# ## Configure Cluster and Start ## ################################################# ACTUALFEATURES: odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app SPACE_SEPARATED_FEATURES: odl-integration-compatible-with-all odl-jolokia odl-restconf odl-clustering-test-app Locating script plan to use... script plan exists!!! Changing the script plan path... # Place the scripts in run order: /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/scripts/car_people_shard.sh Executing /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/scripts/car_people_shard.sh... Add car-people shards file Copy shard config to member-1 with IP address 10.30.170.112 Warning: Permanently added '10.30.170.112' (ECDSA) to the list of known hosts. Copy shard config to member-2 with IP address 10.30.171.173 Warning: Permanently added '10.30.171.173' (ECDSA) to the list of known hosts. Copy shard config to member-3 with IP address 10.30.171.202 Warning: Permanently added '10.30.171.202' (ECDSA) to the list of known hosts. Finished running script plans Configuring member-1 with IP address 10.30.170.112 Warning: Permanently added '10.30.170.112' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.170.112' (ECDSA) to the list of known hosts. + source /tmp/common-functions.sh karaf-0.22.0-SNAPSHOT ++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]] common-functions.sh is being sourced ++ echo 'common-functions.sh is being sourced' ++ BUNDLEFOLDER=karaf-0.22.0-SNAPSHOT ++ export MAVENCONF=/tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ++ MAVENCONF=/tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ++ export FEATURESCONF=/tmp/karaf-0.22.0-SNAPSHOT/etc/org.apache.karaf.features.cfg ++ FEATURESCONF=/tmp/karaf-0.22.0-SNAPSHOT/etc/org.apache.karaf.features.cfg ++ export CUSTOMPROP=/tmp/karaf-0.22.0-SNAPSHOT/etc/custom.properties ++ CUSTOMPROP=/tmp/karaf-0.22.0-SNAPSHOT/etc/custom.properties ++ export LOGCONF=/tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ++ LOGCONF=/tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ++ export MEMCONF=/tmp/karaf-0.22.0-SNAPSHOT/bin/setenv ++ MEMCONF=/tmp/karaf-0.22.0-SNAPSHOT/bin/setenv ++ export CONTROLLERMEM= ++ CONTROLLERMEM= ++ '[' '' = calcium ']' ++ CLUSTER_SYSTEM=pekko ++ export AKKACONF=/tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/pekko.conf ++ AKKACONF=/tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/pekko.conf ++ export MODULESCONF=/tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/modules.conf ++ MODULESCONF=/tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/modules.conf ++ export MODULESHARDSCONF=/tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/module-shards.conf ++ MODULESHARDSCONF=/tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/module-shards.conf ++ print_common_env ++ cat common-functions environment: MAVENCONF: /tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ACTUALFEATURES: FEATURESCONF: /tmp/karaf-0.22.0-SNAPSHOT/etc/org.apache.karaf.features.cfg CUSTOMPROP: /tmp/karaf-0.22.0-SNAPSHOT/etc/custom.properties LOGCONF: /tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg MEMCONF: /tmp/karaf-0.22.0-SNAPSHOT/bin/setenv CONTROLLERMEM: AKKACONF: /tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/pekko.conf MODULESCONF: /tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/modules.conf MODULESHARDSCONF: /tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/module-shards.conf SUITES: ++ SSH='ssh -t -t' ++ extra_services_cntl=' dnsmasq.service httpd.service libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service rabbitmq-server.service ' ++ extra_services_cmp=' libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service ' Changing to /tmp Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.22.0-SNAPSHOT/karaf-0.22.0-20250706.175225-1.zip + echo 'Changing to /tmp' + cd /tmp + echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.22.0-SNAPSHOT/karaf-0.22.0-20250706.175225-1.zip' + wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.22.0-SNAPSHOT/karaf-0.22.0-20250706.175225-1.zip --2025-07-06 22:56:04-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.22.0-SNAPSHOT/karaf-0.22.0-20250706.175225-1.zip Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6 Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 236095914 (225M) [application/zip] Saving to: ‘karaf-0.22.0-20250706.175225-1.zip’ 0K ........ ........ ........ ........ ........ ........ 1% 34.8M 6s 3072K ........ ........ ........ ........ ........ ........ 2% 84.9M 4s 6144K ........ ........ ........ ........ ........ ........ 3% 140M 3s 9216K ........ ........ ........ ........ ........ ........ 5% 136M 3s 12288K ........ ........ ........ ........ ........ ........ 6% 125M 3s 15360K ........ ........ ........ ........ ........ ........ 7% 143M 2s 18432K ........ ........ ........ ........ ........ ........ 9% 142M 2s 21504K ........ ........ ........ ........ ........ ........ 10% 192M 2s 24576K ........ ........ ........ ........ ........ ........ 11% 210M 2s 27648K ........ ........ ........ ........ ........ ........ 13% 192M 2s 30720K ........ ........ ........ ........ ........ ........ 14% 177M 2s 33792K ........ ........ ........ ........ ........ ........ 15% 209M 2s 36864K ........ ........ ........ ........ ........ ........ 17% 186M 2s 39936K ........ ........ ........ ........ ........ ........ 18% 206M 1s 43008K ........ ........ ........ ........ ........ ........ 19% 202M 1s 46080K ........ ........ ........ ........ ........ ........ 21% 243M 1s 49152K ........ ........ ........ ........ ........ ........ 22% 138M 1s 52224K ........ ........ ........ ........ ........ ........ 23% 201M 1s 55296K ........ ........ ........ ........ ........ ........ 25% 181M 1s 58368K ........ ........ ........ ........ ........ ........ 26% 129M 1s 61440K ........ ........ ........ ........ ........ ........ 27% 204M 1s 64512K ........ ........ ........ ........ ........ ........ 29% 171M 1s 67584K ........ ........ ........ ........ ........ ........ 30% 210M 1s 70656K ........ ........ ........ ........ ........ ........ 31% 207M 1s 73728K ........ ........ ........ ........ ........ ........ 33% 192M 1s 76800K ........ ........ ........ ........ ........ ........ 34% 208M 1s 79872K ........ ........ ........ ........ ........ ........ 35% 173M 1s 82944K ........ ........ ........ ........ ........ ........ 37% 211M 1s 86016K ........ ........ ........ ........ ........ ........ 38% 185M 1s 89088K ........ ........ ........ ........ ........ ........ 39% 101M 1s 92160K ........ ........ ........ ........ ........ ........ 41% 222M 1s 95232K ........ ........ ........ ........ ........ ........ 42% 192M 1s 98304K ........ ........ ........ ........ ........ ........ 43% 187M 1s 101376K ........ ........ ........ ........ ........ ........ 45% 244M 1s 104448K ........ ........ ........ ........ ........ ........ 46% 290M 1s 107520K ........ ........ ........ ........ ........ ........ 47% 323M 1s 110592K ........ ........ ........ ........ ........ ........ 49% 200M 1s 113664K ........ ........ ........ ........ ........ ........ 50% 225M 1s 116736K ........ ........ ........ ........ ........ ........ 51% 216M 1s 119808K ........ ........ ........ ........ ........ ........ 53% 225M 1s 122880K ........ ........ ........ ........ ........ ........ 54% 225M 1s 125952K ........ ........ ........ ........ ........ ........ 55% 41.8M 1s 129024K ........ ........ ........ ........ ........ ........ 57% 372M 1s 132096K ........ ........ ........ ........ ........ ........ 58% 295M 1s 135168K ........ ........ ........ ........ ........ ........ 59% 210M 1s 138240K ........ ........ ........ ........ ........ ........ 61% 207M 1s 141312K ........ ........ ........ ........ ........ ........ 62% 35.7M 1s 144384K ........ ........ ........ ........ ........ ........ 63% 166M 1s 147456K ........ ........ ........ ........ ........ ........ 65% 212M 1s 150528K ........ ........ ........ ........ ........ ........ 66% 213M 1s 153600K ........ ........ ........ ........ ........ ........ 67% 214M 0s 156672K ........ ........ ........ ........ ........ ........ 69% 222M 0s 159744K ........ ........ ........ ........ ........ ........ 70% 233M 0s 162816K ........ ........ ........ ........ ........ ........ 71% 210M 0s 165888K ........ ........ ........ ........ ........ ........ 73% 259M 0s 168960K ........ ........ ........ ........ ........ ........ 74% 219M 0s 172032K ........ ........ ........ ........ ........ ........ 75% 234M 0s 175104K ........ ........ ........ ........ ........ ........ 77% 210M 0s 178176K ........ ........ ........ ........ ........ ........ 78% 310M 0s 181248K ........ ........ ........ ........ ........ ........ 79% 217M 0s 184320K ........ ........ ........ ........ ........ ........ 81% 235M 0s 187392K ........ ........ ........ ........ ........ ........ 82% 218M 0s 190464K ........ ........ ........ ........ ........ ........ 83% 243M 0s 193536K ........ ........ ........ ........ ........ ........ 85% 239M 0s 196608K ........ ........ ........ ........ ........ ........ 86% 255M 0s 199680K ........ ........ ........ ........ ........ ........ 87% 255M 0s 202752K ........ ........ ........ ........ ........ ........ 89% 228M 0s 205824K ........ ........ ........ ........ ........ ........ 90% 245M 0s 208896K ........ ........ ........ ........ ........ ........ 91% 259M 0s 211968K ........ ........ ........ ........ ........ ........ 93% 295M 0s 215040K ........ ........ ........ ........ ........ ........ 94% 232M 0s 218112K ........ ........ ........ ........ ........ ........ 95% 276M 0s 221184K ........ ........ ........ ........ ........ ........ 97% 259M 0s 224256K ........ ........ ........ ........ ........ ........ 98% 254M 0s 227328K ........ ........ ........ ........ ........ ........ 99% 237M 0s 230400K .. 100% 404M=1.3s 2025-07-06 22:56:05 (171 MB/s) - ‘karaf-0.22.0-20250706.175225-1.zip’ saved [236095914/236095914] Extracting the new controller... + echo 'Extracting the new controller...' + unzip -q karaf-0.22.0-20250706.175225-1.zip Adding external repositories... + echo 'Adding external repositories...' + sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg + cat /tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # If set to true, the following property will not allow any certificate to be used # when accessing Maven repositories through SSL # #org.ops4j.pax.url.mvn.certificateCheck= # # Path to the local Maven settings file. # The repositories defined in this file will be automatically added to the list # of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property # below is not set. # The following locations are checked for the existence of the settings.xml file # * 1. looks for the specified url # * 2. if not found looks for ${user.home}/.m2/settings.xml # * 3. if not found looks for ${maven.home}/conf/settings.xml # * 4. if not found looks for ${M2_HOME}/conf/settings.xml # #org.ops4j.pax.url.mvn.settings= # # Path to the local Maven repository which is used to avoid downloading # artifacts when they already exist locally. # The value of this property will be extracted from the settings.xml file # above, or defaulted to: # System.getProperty( "user.home" ) + "/.m2/repository" # org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository} # # Default this to false. It's just weird to use undocumented repos # org.ops4j.pax.url.mvn.useFallbackRepositories=false # # Uncomment if you don't wanna use the proxy settings # from the Maven conf/settings.xml file # # org.ops4j.pax.url.mvn.proxySupport=false # # Comma separated list of repositories scanned when resolving an artifact. # Those repositories will be checked before iterating through the # below list of repositories and even before the local repository # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snaphots # @noreleases : the repository does not contain any released artifacts # # The following property value will add the system folder as a repo. # org.ops4j.pax.url.mvn.defaultRepositories=\ file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\ file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\ file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots # Use the default local repo (e.g.~/.m2/repository) as a "remote" repo #org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false # # Comma separated list of repositories scanned when resolving an artifact. # The default list includes the following repositories: # http://repo1.maven.org/maven2@id=central # http://repository.springsource.com/maven/bundles/release@id=spring.ebr # http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external # http://zodiac.springsource.com/maven/bundles/release@id=gemini # http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases # https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases # https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases # To add repositories to the default ones, prepend '+' to the list of repositories # to add. # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snapshots # @noreleases : the repository does not contain any released artifacts # @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended # org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases ### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.+ [[ True == \T\r\u\e ]] + echo 'Configuring the startup features...' Configuring the startup features... + sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.22.0-SNAPSHOT/etc/org.apache.karaf.features.cfg + FEATURE_TEST_STRING=features-test + FEATURE_TEST_VERSION=0.22.0-SNAPSHOT + KARAF_VERSION=karaf4 + [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]] + sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.22.0-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.22.0-SNAPSHOT/etc/org.apache.karaf.features.cfg + [[ ! -z '' ]] + cat /tmp/karaf-0.22.0-SNAPSHOT/etc/org.apache.karaf.features.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # Comma separated list of features repositories to register by default # featuresRepositories = mvn:org.opendaylight.integration/features-test/0.22.0-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/c056c0cc-5de5-4ccd-abcf-b0dd849f05a0.xml # # Comma separated list of features to install at startup # featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, 3e26bb56-8d29-423d-969e-201ab79f7500 # # Resource repositories (OBR) that the features resolver can use # to resolve requirements/capabilities # # The format of the resourceRepositories is # resourceRepositories=[xml:url|json:url],... # for Instance: # #resourceRepositories=xml:http://host/path/to/index.xml # or #resourceRepositories=json:http://host/path/to/index.json # # # Defines if the boot features are started in asynchronous mode (in a dedicated thread) # featuresBootAsynchronous=false # # Service requirements enforcement # # By default, the feature resolver checks the service requirements/capabilities of # bundles for new features (xml schema >= 1.3.0) in order to automatically installs # the required bundles. # The following flag can have those values: # - disable: service requirements are completely ignored # - default: service requirements are ignored for old features # - enforce: service requirements are always verified # #serviceRequirements=default # # Store cfg file for config element in feature # #configCfgStore=true # # Define if the feature service automatically refresh bundles # autoRefresh=true # # Configuration of features processing mechanism (overrides, blacklisting, modification of features) # XML file defines instructions related to features processing # versions.properties may declare properties to resolve placeholders in XML file # both files are relative to ${karaf.etc} # #featureProcessing=org.apache.karaf.features.xml #featureProcessingVersions=versions.properties + configure_karaf_log karaf4 '' + local -r karaf_version=karaf4 + local -r controllerdebugmap= + local logapi=log4j + grep log4j2 /tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n log4j2.rootLogger.level = INFO #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 64MB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE Configuring the karaf log... karaf_version: karaf4, logapi: log4j2 + logapi=log4j2 + echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2' + '[' log4j2 == log4j2 ']' + sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg + orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver + orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN' controllerdebugmap: cat /tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN' + unset IFS + echo 'controllerdebugmap: ' + '[' -n '' ']' + echo 'cat /tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg' + cat /tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # Common pattern layout for appenders log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n # Root logger log4j2.rootLogger.level = INFO # uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} # Filters for logs marked by org.opendaylight.odlparent.Markers log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL # Loggers configuration # Spifly logger log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN # Security audit logger log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Appenders configuration # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} # Rolling file appender log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i # uncomment to not force a disk flush #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 1GB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 # Audit file appender log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 # OSGi appender log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * # help with identification of maven-related problems with pax-url-aether #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN + set_java_vars /usr/lib/jvm/java-21-openjdk-amd64 3072m /tmp/karaf-0.22.0-SNAPSHOT/bin/setenv Configure java home: /usr/lib/jvm/java-21-openjdk-amd64 max memory: 3072m memconf: /tmp/karaf-0.22.0-SNAPSHOT/bin/setenv + local -r java_home=/usr/lib/jvm/java-21-openjdk-amd64 + local -r controllermem=3072m + local -r memconf=/tmp/karaf-0.22.0-SNAPSHOT/bin/setenv + echo Configure + echo ' java home: /usr/lib/jvm/java-21-openjdk-amd64' + echo ' max memory: 3072m' + echo ' memconf: /tmp/karaf-0.22.0-SNAPSHOT/bin/setenv' + sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64}%g' /tmp/karaf-0.22.0-SNAPSHOT/bin/setenv + sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.22.0-SNAPSHOT/bin/setenv cat /tmp/karaf-0.22.0-SNAPSHOT/bin/setenv + echo 'cat /tmp/karaf-0.22.0-SNAPSHOT/bin/setenv' + cat /tmp/karaf-0.22.0-SNAPSHOT/bin/setenv #!/bin/sh # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # # # handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf # script: client, instance, shell, start, status, stop, karaf # # if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then # Actions go here... # fi # # general settings which should be applied for all scripts go here; please keep # in mind that it is possible that scripts might be executed more than once, e.g. # in example of the start script where the start script is executed first and the # karaf script afterwards. # # # The following section shows the possible configuration options for the default # karaf scripts # export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64} # Location of Java installation # export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration # export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options # export EXTRA_JAVA_OPTS # Additional JVM options # export KARAF_HOME # Karaf home folder # export KARAF_DATA # Karaf data folder # export KARAF_BASE # Karaf base folder # export KARAF_ETC # Karaf etc folder # export KARAF_LOG # Karaf log folder # export KARAF_SYSTEM_OPTS # First citizen Karaf options # export KARAF_OPTS # Additional available Karaf options # export KARAF_DEBUG # Enable debug mode # export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start # export KARAF_NOROOT # Prevent execution as root if set to true Set Java version + echo 'Set Java version' + sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-21-openjdk-amd64/bin/java 1 sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper sudo: a password is required + sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-21-openjdk-amd64/bin/java sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper sudo: a password is required JDK default version ... + echo 'JDK default version ...' + java -version openjdk version "21.0.5" 2024-10-15 OpenJDK Runtime Environment (build 21.0.5+11-Ubuntu-1ubuntu122.04) OpenJDK 64-Bit Server VM (build 21.0.5+11-Ubuntu-1ubuntu122.04, mixed mode, sharing) Set JAVA_HOME + echo 'Set JAVA_HOME' + export JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64 + JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64 ++ readlink -e /usr/lib/jvm/java-21-openjdk-amd64/bin/java Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java + JAVA_RESOLVED=/usr/lib/jvm/java-21-openjdk-amd64/bin/java + echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java' Listing all open ports on controller system... + echo 'Listing all open ports on controller system...' + netstat -pnatu /tmp/configuration-script.sh: line 40: netstat: command not found Custom shard config exists!!! Copying the shard config... + '[' -f /tmp/custom_shard_config.txt ']' + echo 'Custom shard config exists!!!' + echo 'Copying the shard config...' + cp /tmp/custom_shard_config.txt /tmp/karaf-0.22.0-SNAPSHOT/bin/ Configuring cluster + echo 'Configuring cluster' + /tmp/karaf-0.22.0-SNAPSHOT/bin/configure_cluster.sh 1 10.30.170.112 10.30.171.173 10.30.171.202 ################################################ ## Configure Cluster ## ################################################ NOTE: Cluster configuration files not found. Copying from /tmp/karaf-0.22.0-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/10.0.2 Configuring unique name in akka.conf Configuring hostname in akka.conf Configuring data and rpc seed nodes in akka.conf modules = [ { name = "inventory" namespace = "urn:opendaylight:inventory" shard-strategy = "module" }, { name = "topology" namespace = "urn:TBD:params:xml:ns:yang:network-topology" shard-strategy = "module" }, { name = "toaster" namespace = "http://netconfcentral.org/ns/toaster" shard-strategy = "module" }, { name = "car" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" shard-strategy = "module" }, { name = "people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" shard-strategy = "module" }, { name = "car-people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" shard-strategy = "module" } ] Configuring replication type in module-shards.conf ################################################ ## NOTE: Manually restart controller to ## ## apply configuration. ## ################################################ Dump pekko.conf + echo 'Dump pekko.conf' + cat /tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/pekko.conf cat: /tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/pekko.conf: No such file or directory Dump modules.conf + echo 'Dump modules.conf' + cat /tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/modules.conf modules = [ { name = "inventory" namespace = "urn:opendaylight:inventory" shard-strategy = "module" }, { name = "topology" namespace = "urn:TBD:params:xml:ns:yang:network-topology" shard-strategy = "module" }, { name = "toaster" namespace = "http://netconfcentral.org/ns/toaster" shard-strategy = "module" }, { name = "car" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" shard-strategy = "module" }, { name = "people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" shard-strategy = "module" }, { name = "car-people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" shard-strategy = "module" } ] Dump module-shards.conf + echo 'Dump module-shards.conf' + cat /tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/module-shards.conf module-shards = [ { name = "default" shards = [ { name = "default" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "inventory" shards = [ { name="inventory" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "topology" shards = [ { name="topology" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "toaster" shards = [ { name="toaster" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "car" shards = [ { name="car" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "people" shards = [ { name="people" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "car-people" shards = [ { name="car-people" replicas = ["member-1", "member-2", "member-3"] } ] } ] Configuring member-2 with IP address 10.30.171.173 Warning: Permanently added '10.30.171.173' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.171.173' (ECDSA) to the list of known hosts. + source /tmp/common-functions.sh karaf-0.22.0-SNAPSHOT ++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]] common-functions.sh is being sourced ++ echo 'common-functions.sh is being sourced' ++ BUNDLEFOLDER=karaf-0.22.0-SNAPSHOT ++ export MAVENCONF=/tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ++ MAVENCONF=/tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ++ export FEATURESCONF=/tmp/karaf-0.22.0-SNAPSHOT/etc/org.apache.karaf.features.cfg ++ FEATURESCONF=/tmp/karaf-0.22.0-SNAPSHOT/etc/org.apache.karaf.features.cfg ++ export CUSTOMPROP=/tmp/karaf-0.22.0-SNAPSHOT/etc/custom.properties ++ CUSTOMPROP=/tmp/karaf-0.22.0-SNAPSHOT/etc/custom.properties ++ export LOGCONF=/tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ++ LOGCONF=/tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ++ export MEMCONF=/tmp/karaf-0.22.0-SNAPSHOT/bin/setenv ++ MEMCONF=/tmp/karaf-0.22.0-SNAPSHOT/bin/setenv ++ export CONTROLLERMEM= ++ CONTROLLERMEM= ++ '[' '' = calcium ']' ++ CLUSTER_SYSTEM=pekko ++ export AKKACONF=/tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/pekko.conf ++ AKKACONF=/tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/pekko.conf ++ export MODULESCONF=/tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/modules.conf ++ MODULESCONF=/tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/modules.conf ++ export MODULESHARDSCONF=/tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/module-shards.conf ++ MODULESHARDSCONF=/tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/module-shards.conf ++ print_common_env ++ cat common-functions environment: MAVENCONF: /tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ACTUALFEATURES: FEATURESCONF: /tmp/karaf-0.22.0-SNAPSHOT/etc/org.apache.karaf.features.cfg CUSTOMPROP: /tmp/karaf-0.22.0-SNAPSHOT/etc/custom.properties LOGCONF: /tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg MEMCONF: /tmp/karaf-0.22.0-SNAPSHOT/bin/setenv CONTROLLERMEM: AKKACONF: /tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/pekko.conf MODULESCONF: /tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/modules.conf MODULESHARDSCONF: /tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/module-shards.conf SUITES: ++ SSH='ssh -t -t' ++ extra_services_cntl=' dnsmasq.service httpd.service libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service rabbitmq-server.service ' ++ extra_services_cmp=' libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service ' Changing to /tmp + echo 'Changing to /tmp' + cd /tmp Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.22.0-SNAPSHOT/karaf-0.22.0-20250706.175225-1.zip + echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.22.0-SNAPSHOT/karaf-0.22.0-20250706.175225-1.zip' + wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.22.0-SNAPSHOT/karaf-0.22.0-20250706.175225-1.zip --2025-07-06 22:56:08-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.22.0-SNAPSHOT/karaf-0.22.0-20250706.175225-1.zip Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6 Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 236095914 (225M) [application/zip] Saving to: ‘karaf-0.22.0-20250706.175225-1.zip’ 0K ........ ........ ........ ........ ........ ........ 1% 67.0M 3s 3072K ........ ........ ........ ........ ........ ........ 2% 93.8M 3s 6144K ........ ........ ........ ........ ........ ........ 3% 120M 2s 9216K ........ ........ ........ ........ ........ ........ 5% 156M 2s 12288K ........ ........ ........ ........ ........ ........ 6% 168M 2s 15360K ........ ........ ........ ........ ........ ........ 7% 144M 2s 18432K ........ ........ ........ ........ ........ ........ 9% 216M 2s 21504K ........ ........ ........ ........ ........ ........ 10% 254M 2s 24576K ........ ........ ........ ........ ........ ........ 11% 232M 1s 27648K ........ ........ ........ ........ ........ ........ 13% 288M 1s 30720K ........ ........ ........ ........ ........ ........ 14% 277M 1s 33792K ........ ........ ........ ........ ........ ........ 15% 267M 1s 36864K ........ ........ ........ ........ ........ ........ 17% 281M 1s 39936K ........ ........ ........ ........ ........ ........ 18% 253M 1s 43008K ........ ........ ........ ........ ........ ........ 19% 295M 1s 46080K ........ ........ ........ ........ ........ ........ 21% 275M 1s 49152K ........ ........ ........ ........ ........ ........ 22% 327M 1s 52224K ........ ........ ........ ........ ........ ........ 23% 311M 1s 55296K ........ ........ ........ ........ ........ ........ 25% 288M 1s 58368K ........ ........ ........ ........ ........ ........ 26% 293M 1s 61440K ........ ........ ........ ........ ........ ........ 27% 312M 1s 64512K ........ ........ ........ ........ ........ ........ 29% 287M 1s 67584K ........ ........ ........ ........ ........ ........ 30% 287M 1s 70656K ........ ........ ........ ........ ........ ........ 31% 256M 1s 73728K ........ ........ ........ ........ ........ ........ 33% 198M 1s 76800K ........ ........ ........ ........ ........ ........ 34% 283M 1s 79872K ........ ........ ........ ........ ........ ........ 35% 309M 1s 82944K ........ ........ ........ ........ ........ ........ 37% 316M 1s 86016K ........ ........ ........ ........ ........ ........ 38% 300M 1s 89088K ........ ........ ........ ........ ........ ........ 39% 342M 1s 92160K ........ ........ ........ ........ ........ ........ 41% 321M 1s 95232K ........ ........ ........ ........ ........ ........ 42% 314M 1s 98304K ........ ........ ........ ........ ........ ........ 43% 253M 1s 101376K ........ ........ ........ ........ ........ ........ 45% 315M 1s 104448K ........ ........ ........ ........ ........ ........ 46% 299M 1s 107520K ........ ........ ........ ........ ........ ........ 47% 243M 1s 110592K ........ ........ ........ ........ ........ ........ 49% 271M 1s 113664K ........ ........ ........ ........ ........ ........ 50% 293M 0s 116736K ........ ........ ........ ........ ........ ........ 51% 307M 0s 119808K ........ ........ ........ ........ ........ ........ 53% 326M 0s 122880K ........ ........ ........ ........ ........ ........ 54% 305M 0s 125952K ........ ........ ........ ........ ........ ........ 55% 305M 0s 129024K ........ ........ ........ ........ ........ ........ 57% 288M 0s 132096K ........ ........ ........ ........ ........ ........ 58% 315M 0s 135168K ........ ........ ........ ........ ........ ........ 59% 304M 0s 138240K ........ ........ ........ ........ ........ ........ 61% 318M 0s 141312K ........ ........ ........ ........ ........ ........ 62% 307M 0s 144384K ........ ........ ........ ........ ........ ........ 63% 307M 0s 147456K ........ ........ ........ ........ ........ ........ 65% 297M 0s 150528K ........ ........ ........ ........ ........ ........ 66% 305M 0s 153600K ........ ........ ........ ........ ........ ........ 67% 302M 0s 156672K ........ ........ ........ ........ ........ ........ 69% 323M 0s 159744K ........ ........ ........ ........ ........ ........ 70% 294M 0s 162816K ........ ........ ........ ........ ........ ........ 71% 325M 0s 165888K ........ ........ ........ ........ ........ ........ 73% 308M 0s 168960K ........ ........ ........ ........ ........ ........ 74% 298M 0s 172032K ........ ........ ........ ........ ........ ........ 75% 320M 0s 175104K ........ ........ ........ ........ ........ ........ 77% 324M 0s 178176K ........ ........ ........ ........ ........ ........ 78% 313M 0s 181248K ........ ........ ........ ........ ........ ........ 79% 324M 0s 184320K ........ ........ ........ ........ ........ ........ 81% 337M 0s 187392K ........ ........ ........ ........ ........ ........ 82% 334M 0s 190464K ........ ........ ........ ........ ........ ........ 83% 317M 0s 193536K ........ ........ ........ ........ ........ ........ 85% 322M 0s 196608K ........ ........ ........ ........ ........ ........ 86% 340M 0s 199680K ........ ........ ........ ........ ........ ........ 87% 308M 0s 202752K ........ ........ ........ ........ ........ ........ 89% 333M 0s 205824K ........ ........ ........ ........ ........ ........ 90% 308M 0s 208896K ........ ........ ........ ........ ........ ........ 91% 329M 0s 211968K ........ ........ ........ ........ ........ ........ 93% 322M 0s 215040K ........ ........ ........ ........ ........ ........ 94% 319M 0s 218112K ........ ........ ........ ........ ........ ........ 95% 330M 0s 221184K ........ ........ ........ ........ ........ ........ 97% 339M 0s 224256K ........ ........ ........ ........ ........ ........ 98% 333M 0s 227328K ........ ........ ........ ........ ........ ........ 99% 297M 0s 230400K .. 100% 410M=0.9s 2025-07-06 22:56:09 (263 MB/s) - ‘karaf-0.22.0-20250706.175225-1.zip’ saved [236095914/236095914] Extracting the new controller... + echo 'Extracting the new controller...' + unzip -q karaf-0.22.0-20250706.175225-1.zip Adding external repositories... + echo 'Adding external repositories...' + sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg + cat /tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # If set to true, the following property will not allow any certificate to be used # when accessing Maven repositories through SSL # #org.ops4j.pax.url.mvn.certificateCheck= # # Path to the local Maven settings file. # The repositories defined in this file will be automatically added to the list # of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property # below is not set. # The following locations are checked for the existence of the settings.xml file # * 1. looks for the specified url # * 2. if not found looks for ${user.home}/.m2/settings.xml # * 3. if not found looks for ${maven.home}/conf/settings.xml # * 4. if not found looks for ${M2_HOME}/conf/settings.xml # #org.ops4j.pax.url.mvn.settings= # # Path to the local Maven repository which is used to avoid downloading # artifacts when they already exist locally. # The value of this property will be extracted from the settings.xml file # above, or defaulted to: # System.getProperty( "user.home" ) + "/.m2/repository" # org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository} # # Default this to false. It's just weird to use undocumented repos # org.ops4j.pax.url.mvn.useFallbackRepositories=false # # Uncomment if you don't wanna use the proxy settings # from the Maven conf/settings.xml file # # org.ops4j.pax.url.mvn.proxySupport=false # # Comma separated list of repositories scanned when resolving an artifact. # Those repositories will be checked before iterating through the # below list of repositories and even before the local repository # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snaphots # @noreleases : the repository does not contain any released artifacts # # The following property value will add the system folder as a repo. # org.ops4j.pax.url.mvn.defaultRepositories=\ file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\ file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\ file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots # Use the default local repo (e.g.~/.m2/repository) as a "remote" repo #org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false # # Comma separated list of repositories scanned when resolving an artifact. # The default list includes the following repositories: # http://repo1.maven.org/maven2@id=central # http://repository.springsource.com/maven/bundles/release@id=spring.ebr # http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external # http://zodiac.springsource.com/maven/bundles/release@id=gemini # http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases # https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases # https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases # To add repositories to the default ones, prepend '+' to the list of repositories # to add. # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snapshots # @noreleases : the repository does not contain any released artifacts # @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended # org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases ### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.Configuring the startup features... + [[ True == \T\r\u\e ]] + echo 'Configuring the startup features...' + sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.22.0-SNAPSHOT/etc/org.apache.karaf.features.cfg + FEATURE_TEST_STRING=features-test + FEATURE_TEST_VERSION=0.22.0-SNAPSHOT + KARAF_VERSION=karaf4 + [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]] + sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.22.0-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.22.0-SNAPSHOT/etc/org.apache.karaf.features.cfg + [[ ! -z '' ]] + cat /tmp/karaf-0.22.0-SNAPSHOT/etc/org.apache.karaf.features.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # Comma separated list of features repositories to register by default # featuresRepositories = mvn:org.opendaylight.integration/features-test/0.22.0-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/c056c0cc-5de5-4ccd-abcf-b0dd849f05a0.xml # # Comma separated list of features to install at startup # featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, 3e26bb56-8d29-423d-969e-201ab79f7500 # # Resource repositories (OBR) that the features resolver can use # to resolve requirements/capabilities # # The format of the resourceRepositories is # resourceRepositories=[xml:url|json:url],... # for Instance: # #resourceRepositories=xml:http://host/path/to/index.xml # or #resourceRepositories=json:http://host/path/to/index.json # # # Defines if the boot features are started in asynchronous mode (in a dedicated thread) # featuresBootAsynchronous=false # # Service requirements enforcement # # By default, the feature resolver checks the service requirements/capabilities of # bundles for new features (xml schema >= 1.3.0) in order to automatically installs # the required bundles. # The following flag can have those values: # - disable: service requirements are completely ignored # - default: service requirements are ignored for old features # - enforce: service requirements are always verified # #serviceRequirements=default # # Store cfg file for config element in feature # #configCfgStore=true # # Define if the feature service automatically refresh bundles # autoRefresh=true # # Configuration of features processing mechanism (overrides, blacklisting, modification of features) # XML file defines instructions related to features processing # versions.properties may declare properties to resolve placeholders in XML file # both files are relative to ${karaf.etc} # #featureProcessing=org.apache.karaf.features.xml #featureProcessingVersions=versions.properties + configure_karaf_log karaf4 '' + local -r karaf_version=karaf4 + local -r controllerdebugmap= + local logapi=log4j + grep log4j2 /tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n log4j2.rootLogger.level = INFO #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 64MB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE Configuring the karaf log... karaf_version: karaf4, logapi: log4j2 + logapi=log4j2 + echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2' + '[' log4j2 == log4j2 ']' + sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg controllerdebugmap: cat /tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg + orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver + orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN' + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN' + unset IFS + echo 'controllerdebugmap: ' + '[' -n '' ']' + echo 'cat /tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg' + cat /tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # Common pattern layout for appenders log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n # Root logger log4j2.rootLogger.level = INFO # uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} # Filters for logs marked by org.opendaylight.odlparent.Markers log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL # Loggers configuration # Spifly logger log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN # Security audit logger log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Appenders configuration # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} # Rolling file appender log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i # uncomment to not force a disk flush #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 1GB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 # Audit file appender log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 # OSGi appender log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * # help with identification of maven-related problems with pax-url-aether #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN Configure java home: /usr/lib/jvm/java-21-openjdk-amd64 max memory: 3072m memconf: /tmp/karaf-0.22.0-SNAPSHOT/bin/setenv + set_java_vars /usr/lib/jvm/java-21-openjdk-amd64 3072m /tmp/karaf-0.22.0-SNAPSHOT/bin/setenv + local -r java_home=/usr/lib/jvm/java-21-openjdk-amd64 + local -r controllermem=3072m + local -r memconf=/tmp/karaf-0.22.0-SNAPSHOT/bin/setenv + echo Configure + echo ' java home: /usr/lib/jvm/java-21-openjdk-amd64' + echo ' max memory: 3072m' + echo ' memconf: /tmp/karaf-0.22.0-SNAPSHOT/bin/setenv' + sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64}%g' /tmp/karaf-0.22.0-SNAPSHOT/bin/setenv + sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.22.0-SNAPSHOT/bin/setenv cat /tmp/karaf-0.22.0-SNAPSHOT/bin/setenv + echo 'cat /tmp/karaf-0.22.0-SNAPSHOT/bin/setenv' + cat /tmp/karaf-0.22.0-SNAPSHOT/bin/setenv #!/bin/sh # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # # # handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf # script: client, instance, shell, start, status, stop, karaf # # if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then # Actions go here... # fi # # general settings which should be applied for all scripts go here; please keep # in mind that it is possible that scripts might be executed more than once, e.g. # in example of the start script where the start script is executed first and the # karaf script afterwards. # # # The following section shows the possible configuration options for the default # karaf scripts # export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64} # Location of Java installation # export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration # export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options # export EXTRA_JAVA_OPTS # Additional JVM options # export KARAF_HOME # Karaf home folder # export KARAF_DATA # Karaf data folder # export KARAF_BASE # Karaf base folder # export KARAF_ETC # Karaf etc folder # export KARAF_LOG # Karaf log folder # export KARAF_SYSTEM_OPTS # First citizen Karaf options # export KARAF_OPTS # Additional available Karaf options # export KARAF_DEBUG # Enable debug mode # export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start # export KARAF_NOROOT # Prevent execution as root if set to true Set Java version + echo 'Set Java version' + sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-21-openjdk-amd64/bin/java 1 sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper sudo: a password is required + sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-21-openjdk-amd64/bin/java sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper sudo: a password is required JDK default version ... + echo 'JDK default version ...' + java -version openjdk version "21.0.5" 2024-10-15 OpenJDK Runtime Environment (build 21.0.5+11-Ubuntu-1ubuntu122.04) OpenJDK 64-Bit Server VM (build 21.0.5+11-Ubuntu-1ubuntu122.04, mixed mode, sharing) Set JAVA_HOME + echo 'Set JAVA_HOME' + export JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64 + JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64 ++ readlink -e /usr/lib/jvm/java-21-openjdk-amd64/bin/java Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java + JAVA_RESOLVED=/usr/lib/jvm/java-21-openjdk-amd64/bin/java + echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java' + echo 'Listing all open ports on controller system...' Listing all open ports on controller system... + netstat -pnatu /tmp/configuration-script.sh: line 40: netstat: command not found Custom shard config exists!!! Copying the shard config... + '[' -f /tmp/custom_shard_config.txt ']' + echo 'Custom shard config exists!!!' + echo 'Copying the shard config...' + cp /tmp/custom_shard_config.txt /tmp/karaf-0.22.0-SNAPSHOT/bin/ Configuring cluster + echo 'Configuring cluster' + /tmp/karaf-0.22.0-SNAPSHOT/bin/configure_cluster.sh 2 10.30.170.112 10.30.171.173 10.30.171.202 ################################################ ## Configure Cluster ## ################################################ NOTE: Cluster configuration files not found. Copying from /tmp/karaf-0.22.0-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/10.0.2 Configuring unique name in akka.conf Configuring hostname in akka.conf Configuring data and rpc seed nodes in akka.conf modules = [ { name = "inventory" namespace = "urn:opendaylight:inventory" shard-strategy = "module" }, { name = "topology" namespace = "urn:TBD:params:xml:ns:yang:network-topology" shard-strategy = "module" }, { name = "toaster" namespace = "http://netconfcentral.org/ns/toaster" shard-strategy = "module" }, { name = "car" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" shard-strategy = "module" }, { name = "people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" shard-strategy = "module" }, { name = "car-people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" shard-strategy = "module" } ] Configuring replication type in module-shards.conf ################################################ ## NOTE: Manually restart controller to ## ## apply configuration. ## ################################################ Dump pekko.conf + echo 'Dump pekko.conf' + cat /tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/pekko.conf cat: /tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/pekko.conf: No such file or directory Dump modules.conf + echo 'Dump modules.conf' + cat /tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/modules.conf modules = [ { name = "inventory" namespace = "urn:opendaylight:inventory" shard-strategy = "module" }, { name = "topology" namespace = "urn:TBD:params:xml:ns:yang:network-topology" shard-strategy = "module" }, { name = "toaster" namespace = "http://netconfcentral.org/ns/toaster" shard-strategy = "module" }, { name = "car" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" shard-strategy = "module" }, { name = "people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" shard-strategy = "module" }, { name = "car-people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" shard-strategy = "module" } ] Dump module-shards.conf + echo 'Dump module-shards.conf' + cat /tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/module-shards.conf module-shards = [ { name = "default" shards = [ { name = "default" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "inventory" shards = [ { name="inventory" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "topology" shards = [ { name="topology" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "toaster" shards = [ { name="toaster" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "car" shards = [ { name="car" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "people" shards = [ { name="people" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "car-people" shards = [ { name="car-people" replicas = ["member-1", "member-2", "member-3"] } ] } ] Configuring member-3 with IP address 10.30.171.202 Warning: Permanently added '10.30.171.202' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.171.202' (ECDSA) to the list of known hosts. + source /tmp/common-functions.sh karaf-0.22.0-SNAPSHOT common-functions.sh is being sourced ++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]] ++ echo 'common-functions.sh is being sourced' ++ BUNDLEFOLDER=karaf-0.22.0-SNAPSHOT ++ export MAVENCONF=/tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ++ MAVENCONF=/tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ++ export FEATURESCONF=/tmp/karaf-0.22.0-SNAPSHOT/etc/org.apache.karaf.features.cfg ++ FEATURESCONF=/tmp/karaf-0.22.0-SNAPSHOT/etc/org.apache.karaf.features.cfg ++ export CUSTOMPROP=/tmp/karaf-0.22.0-SNAPSHOT/etc/custom.properties ++ CUSTOMPROP=/tmp/karaf-0.22.0-SNAPSHOT/etc/custom.properties ++ export LOGCONF=/tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ++ LOGCONF=/tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ++ export MEMCONF=/tmp/karaf-0.22.0-SNAPSHOT/bin/setenv ++ MEMCONF=/tmp/karaf-0.22.0-SNAPSHOT/bin/setenv ++ export CONTROLLERMEM= ++ CONTROLLERMEM= ++ '[' '' = calcium ']' ++ CLUSTER_SYSTEM=pekko ++ export AKKACONF=/tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/pekko.conf ++ AKKACONF=/tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/pekko.conf ++ export MODULESCONF=/tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/modules.conf ++ MODULESCONF=/tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/modules.conf ++ export MODULESHARDSCONF=/tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/module-shards.conf ++ MODULESHARDSCONF=/tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/module-shards.conf ++ print_common_env ++ cat common-functions environment: MAVENCONF: /tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ACTUALFEATURES: FEATURESCONF: /tmp/karaf-0.22.0-SNAPSHOT/etc/org.apache.karaf.features.cfg CUSTOMPROP: /tmp/karaf-0.22.0-SNAPSHOT/etc/custom.properties LOGCONF: /tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg MEMCONF: /tmp/karaf-0.22.0-SNAPSHOT/bin/setenv CONTROLLERMEM: AKKACONF: /tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/pekko.conf MODULESCONF: /tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/modules.conf MODULESHARDSCONF: /tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/module-shards.conf SUITES: ++ SSH='ssh -t -t' ++ extra_services_cntl=' dnsmasq.service httpd.service libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service rabbitmq-server.service ' ++ extra_services_cmp=' libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service ' Changing to /tmp Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.22.0-SNAPSHOT/karaf-0.22.0-20250706.175225-1.zip + echo 'Changing to /tmp' + cd /tmp + echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.22.0-SNAPSHOT/karaf-0.22.0-20250706.175225-1.zip' + wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.22.0-SNAPSHOT/karaf-0.22.0-20250706.175225-1.zip --2025-07-06 22:56:12-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.22.0-SNAPSHOT/karaf-0.22.0-20250706.175225-1.zip Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6 Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 236095914 (225M) [application/zip] Saving to: ‘karaf-0.22.0-20250706.175225-1.zip’ 0K ........ ........ ........ ........ ........ ........ 1% 62.6M 4s 3072K ........ ........ ........ ........ ........ ........ 2% 96.4M 3s 6144K ........ ........ ........ ........ ........ ........ 3% 116M 3s 9216K ........ ........ ........ ........ ........ ........ 5% 122M 2s 12288K ........ ........ ........ ........ ........ ........ 6% 137M 2s 15360K ........ ........ ........ ........ ........ ........ 7% 120M 2s 18432K ........ ........ ........ ........ ........ ........ 9% 136M 2s 21504K ........ ........ ........ ........ ........ ........ 10% 133M 2s 24576K ........ ........ ........ ........ ........ ........ 11% 155M 2s 27648K ........ ........ ........ ........ ........ ........ 13% 141M 2s 30720K ........ ........ ........ ........ ........ ........ 14% 147M 2s 33792K ........ ........ ........ ........ ........ ........ 15% 144M 2s 36864K ........ ........ ........ ........ ........ ........ 17% 142M 2s 39936K ........ ........ ........ ........ ........ ........ 18% 148M 2s 43008K ........ ........ ........ ........ ........ ........ 19% 160M 1s 46080K ........ ........ ........ ........ ........ ........ 21% 149M 1s 49152K ........ ........ ........ ........ ........ ........ 22% 172M 1s 52224K ........ ........ ........ ........ ........ ........ 23% 163M 1s 55296K ........ ........ ........ ........ ........ ........ 25% 149M 1s 58368K ........ ........ ........ ........ ........ ........ 26% 163M 1s 61440K ........ ........ ........ ........ ........ ........ 27% 243M 1s 64512K ........ ........ ........ ........ ........ ........ 29% 181M 1s 67584K ........ ........ ........ ........ ........ ........ 30% 161M 1s 70656K ........ ........ ........ ........ ........ ........ 31% 173M 1s 73728K ........ ........ ........ ........ ........ ........ 33% 174M 1s 76800K ........ ........ ........ ........ ........ ........ 34% 161M 1s 79872K ........ ........ ........ ........ ........ ........ 35% 161M 1s 82944K ........ ........ ........ ........ ........ ........ 37% 173M 1s 86016K ........ ........ ........ ........ ........ ........ 38% 166M 1s 89088K ........ ........ ........ ........ ........ ........ 39% 159M 1s 92160K ........ ........ ........ ........ ........ ........ 41% 181M 1s 95232K ........ ........ ........ ........ ........ ........ 42% 170M 1s 98304K ........ ........ ........ ........ ........ ........ 43% 168M 1s 101376K ........ ........ ........ ........ ........ ........ 45% 179M 1s 104448K ........ ........ ........ ........ ........ ........ 46% 161M 1s 107520K ........ ........ ........ ........ ........ ........ 47% 168M 1s 110592K ........ ........ ........ ........ ........ ........ 49% 166M 1s 113664K ........ ........ ........ ........ ........ ........ 50% 159M 1s 116736K ........ ........ ........ ........ ........ ........ 51% 193M 1s 119808K ........ ........ ........ ........ ........ ........ 53% 168M 1s 122880K ........ ........ ........ ........ ........ ........ 54% 169M 1s 125952K ........ ........ ........ ........ ........ ........ 55% 177M 1s 129024K ........ ........ ........ ........ ........ ........ 57% 154M 1s 132096K ........ ........ ........ ........ ........ ........ 58% 162M 1s 135168K ........ ........ ........ ........ ........ ........ 59% 145M 1s 138240K ........ ........ ........ ........ ........ ........ 61% 156M 1s 141312K ........ ........ ........ ........ ........ ........ 62% 155M 1s 144384K ........ ........ ........ ........ ........ ........ 63% 225M 1s 147456K ........ ........ ........ ........ ........ ........ 65% 277M 1s 150528K ........ ........ ........ ........ ........ ........ 66% 328M 0s 153600K ........ ........ ........ ........ ........ ........ 67% 278M 0s 156672K ........ ........ ........ ........ ........ ........ 69% 284M 0s 159744K ........ ........ ........ ........ ........ ........ 70% 291M 0s 162816K ........ ........ ........ ........ ........ ........ 71% 280M 0s 165888K ........ ........ ........ ........ ........ ........ 73% 288M 0s 168960K ........ ........ ........ ........ ........ ........ 74% 286M 0s 172032K ........ ........ ........ ........ ........ ........ 75% 300M 0s 175104K ........ ........ ........ ........ ........ ........ 77% 294M 0s 178176K ........ ........ ........ ........ ........ ........ 78% 296M 0s 181248K ........ ........ ........ ........ ........ ........ 79% 290M 0s 184320K ........ ........ ........ ........ ........ ........ 81% 306M 0s 187392K ........ ........ ........ ........ ........ ........ 82% 305M 0s 190464K ........ ........ ........ ........ ........ ........ 83% 300M 0s 193536K ........ ........ ........ ........ ........ ........ 85% 283M 0s 196608K ........ ........ ........ ........ ........ ........ 86% 295M 0s 199680K ........ ........ ........ ........ ........ ........ 87% 293M 0s 202752K ........ ........ ........ ........ ........ ........ 89% 311M 0s 205824K ........ ........ ........ ........ ........ ........ 90% 307M 0s 208896K ........ ........ ........ ........ ........ ........ 91% 338M 0s 211968K ........ ........ ........ ........ ........ ........ 93% 304M 0s 215040K ........ ........ ........ ........ ........ ........ 94% 311M 0s 218112K ........ ........ ........ ........ ........ ........ 95% 297M 0s 221184K ........ ........ ........ ........ ........ ........ 97% 333M 0s 224256K ........ ........ ........ ........ ........ ........ 98% 278M 0s 227328K ........ ........ ........ ........ ........ ........ 99% 303M 0s 230400K .. 100% 522M=1.2s 2025-07-06 22:56:13 (184 MB/s) - ‘karaf-0.22.0-20250706.175225-1.zip’ saved [236095914/236095914] Extracting the new controller... + echo 'Extracting the new controller...' + unzip -q karaf-0.22.0-20250706.175225-1.zip Adding external repositories... + echo 'Adding external repositories...' + sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg + cat /tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # If set to true, the following property will not allow any certificate to be used # when accessing Maven repositories through SSL # #org.ops4j.pax.url.mvn.certificateCheck= # # Path to the local Maven settings file. # The repositories defined in this file will be automatically added to the list # of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property # below is not set. # The following locations are checked for the existence of the settings.xml file # * 1. looks for the specified url # * 2. if not found looks for ${user.home}/.m2/settings.xml # * 3. if not found looks for ${maven.home}/conf/settings.xml # * 4. if not found looks for ${M2_HOME}/conf/settings.xml # #org.ops4j.pax.url.mvn.settings= # # Path to the local Maven repository which is used to avoid downloading # artifacts when they already exist locally. # The value of this property will be extracted from the settings.xml file # above, or defaulted to: # System.getProperty( "user.home" ) + "/.m2/repository" # org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository} # # Default this to false. It's just weird to use undocumented repos # org.ops4j.pax.url.mvn.useFallbackRepositories=false # # Uncomment if you don't wanna use the proxy settings # from the Maven conf/settings.xml file # # org.ops4j.pax.url.mvn.proxySupport=false # # Comma separated list of repositories scanned when resolving an artifact. # Those repositories will be checked before iterating through the # below list of repositories and even before the local repository # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snaphots # @noreleases : the repository does not contain any released artifacts # # The following property value will add the system folder as a repo. # org.ops4j.pax.url.mvn.defaultRepositories=\ file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\ file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\ file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots # Use the default local repo (e.g.~/.m2/repository) as a "remote" repo #org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false # # Comma separated list of repositories scanned when resolving an artifact. # The default list includes the following repositories: # http://repo1.maven.org/maven2@id=central # http://repository.springsource.com/maven/bundles/release@id=spring.ebr # http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external # http://zodiac.springsource.com/maven/bundles/release@id=gemini # http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases # https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases # https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases # To add repositories to the default ones, prepend '+' to the list of repositories # to add. # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snapshots # @noreleases : the repository does not contain any released artifacts # @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended # org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases ### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.+ [[ True == \T\r\u\e ]] Configuring the startup features... + echo 'Configuring the startup features...' + sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.22.0-SNAPSHOT/etc/org.apache.karaf.features.cfg + FEATURE_TEST_STRING=features-test + FEATURE_TEST_VERSION=0.22.0-SNAPSHOT + KARAF_VERSION=karaf4 + [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]] + sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.22.0-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.22.0-SNAPSHOT/etc/org.apache.karaf.features.cfg + [[ ! -z '' ]] + cat /tmp/karaf-0.22.0-SNAPSHOT/etc/org.apache.karaf.features.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # Comma separated list of features repositories to register by default # featuresRepositories = mvn:org.opendaylight.integration/features-test/0.22.0-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/c056c0cc-5de5-4ccd-abcf-b0dd849f05a0.xml # # Comma separated list of features to install at startup # featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, 3e26bb56-8d29-423d-969e-201ab79f7500 # # Resource repositories (OBR) that the features resolver can use # to resolve requirements/capabilities # # The format of the resourceRepositories is # resourceRepositories=[xml:url|json:url],... # for Instance: # #resourceRepositories=xml:http://host/path/to/index.xml # or #resourceRepositories=json:http://host/path/to/index.json # # # Defines if the boot features are started in asynchronous mode (in a dedicated thread) # featuresBootAsynchronous=false # # Service requirements enforcement # # By default, the feature resolver checks the service requirements/capabilities of # bundles for new features (xml schema >= 1.3.0) in order to automatically installs # the required bundles. # The following flag can have those values: # - disable: service requirements are completely ignored # - default: service requirements are ignored for old features # - enforce: service requirements are always verified # #serviceRequirements=default # # Store cfg file for config element in feature # #configCfgStore=true # # Define if the feature service automatically refresh bundles # autoRefresh=true # # Configuration of features processing mechanism (overrides, blacklisting, modification of features) # XML file defines instructions related to features processing # versions.properties may declare properties to resolve placeholders in XML file # both files are relative to ${karaf.etc} # #featureProcessing=org.apache.karaf.features.xml #featureProcessingVersions=versions.properties + configure_karaf_log karaf4 '' + local -r karaf_version=karaf4 + local -r controllerdebugmap= + local logapi=log4j + grep log4j2 /tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n log4j2.rootLogger.level = INFO #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 64MB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE + logapi=log4j2 Configuring the karaf log... karaf_version: karaf4, logapi: log4j2 + echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2' + '[' log4j2 == log4j2 ']' + sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg + orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver + orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN' controllerdebugmap: cat /tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN' + unset IFS + echo 'controllerdebugmap: ' + '[' -n '' ']' + echo 'cat /tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg' + cat /tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # Common pattern layout for appenders log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n # Root logger log4j2.rootLogger.level = INFO # uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} # Filters for logs marked by org.opendaylight.odlparent.Markers log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL # Loggers configuration # Spifly logger log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN # Security audit logger log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Appenders configuration # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} # Rolling file appender log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i # uncomment to not force a disk flush #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 1GB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 # Audit file appender log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 # OSGi appender log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * # help with identification of maven-related problems with pax-url-aether #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN Configure java home: /usr/lib/jvm/java-21-openjdk-amd64 max memory: 3072m memconf: /tmp/karaf-0.22.0-SNAPSHOT/bin/setenv + set_java_vars /usr/lib/jvm/java-21-openjdk-amd64 3072m /tmp/karaf-0.22.0-SNAPSHOT/bin/setenv + local -r java_home=/usr/lib/jvm/java-21-openjdk-amd64 + local -r controllermem=3072m + local -r memconf=/tmp/karaf-0.22.0-SNAPSHOT/bin/setenv + echo Configure + echo ' java home: /usr/lib/jvm/java-21-openjdk-amd64' + echo ' max memory: 3072m' + echo ' memconf: /tmp/karaf-0.22.0-SNAPSHOT/bin/setenv' + sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64}%g' /tmp/karaf-0.22.0-SNAPSHOT/bin/setenv + sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.22.0-SNAPSHOT/bin/setenv cat /tmp/karaf-0.22.0-SNAPSHOT/bin/setenv + echo 'cat /tmp/karaf-0.22.0-SNAPSHOT/bin/setenv' + cat /tmp/karaf-0.22.0-SNAPSHOT/bin/setenv #!/bin/sh # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # # # handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf # script: client, instance, shell, start, status, stop, karaf # # if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then # Actions go here... # fi # # general settings which should be applied for all scripts go here; please keep # in mind that it is possible that scripts might be executed more than once, e.g. # in example of the start script where the start script is executed first and the # karaf script afterwards. # # # The following section shows the possible configuration options for the default # karaf scripts # export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64} # Location of Java installation # export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration # export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options # export EXTRA_JAVA_OPTS # Additional JVM options # export KARAF_HOME # Karaf home folder # export KARAF_DATA # Karaf data folder # export KARAF_BASE # Karaf base folder # export KARAF_ETC # Karaf etc folder # export KARAF_LOG # Karaf log folder # export KARAF_SYSTEM_OPTS # First citizen Karaf options # export KARAF_OPTS # Additional available Karaf options # export KARAF_DEBUG # Enable debug mode # export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start # export KARAF_NOROOT # Prevent execution as root if set to true Set Java version + echo 'Set Java version' + sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-21-openjdk-amd64/bin/java 1 sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper sudo: a password is required + sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-21-openjdk-amd64/bin/java sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper sudo: a password is required JDK default version ... + echo 'JDK default version ...' + java -version openjdk version "21.0.5" 2024-10-15 OpenJDK Runtime Environment (build 21.0.5+11-Ubuntu-1ubuntu122.04) OpenJDK 64-Bit Server VM (build 21.0.5+11-Ubuntu-1ubuntu122.04, mixed mode, sharing) Set JAVA_HOME + echo 'Set JAVA_HOME' + export JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64 + JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64 ++ readlink -e /usr/lib/jvm/java-21-openjdk-amd64/bin/java Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java + JAVA_RESOLVED=/usr/lib/jvm/java-21-openjdk-amd64/bin/java + echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java' Listing all open ports on controller system... + echo 'Listing all open ports on controller system...' + netstat -pnatu /tmp/configuration-script.sh: line 40: netstat: command not found Custom shard config exists!!! + '[' -f /tmp/custom_shard_config.txt ']' + echo 'Custom shard config exists!!!' Copying the shard config... + echo 'Copying the shard config...' + cp /tmp/custom_shard_config.txt /tmp/karaf-0.22.0-SNAPSHOT/bin/ Configuring cluster + echo 'Configuring cluster' + /tmp/karaf-0.22.0-SNAPSHOT/bin/configure_cluster.sh 3 10.30.170.112 10.30.171.173 10.30.171.202 ################################################ ## Configure Cluster ## ################################################ NOTE: Cluster configuration files not found. Copying from /tmp/karaf-0.22.0-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/10.0.2 Configuring unique name in akka.conf Configuring hostname in akka.conf Configuring data and rpc seed nodes in akka.conf modules = [ { name = "inventory" namespace = "urn:opendaylight:inventory" shard-strategy = "module" }, { name = "topology" namespace = "urn:TBD:params:xml:ns:yang:network-topology" shard-strategy = "module" }, { name = "toaster" namespace = "http://netconfcentral.org/ns/toaster" shard-strategy = "module" }, { name = "car" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" shard-strategy = "module" }, { name = "people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" shard-strategy = "module" }, { name = "car-people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" shard-strategy = "module" } ] Configuring replication type in module-shards.conf ################################################ ## NOTE: Manually restart controller to ## ## apply configuration. ## ################################################ Dump pekko.conf + echo 'Dump pekko.conf' + cat /tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/pekko.conf cat: /tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/pekko.conf: No such file or directoryDump modules.conf + echo 'Dump modules.conf' + cat /tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/modules.conf modules = [ { name = "inventory" namespace = "urn:opendaylight:inventory" shard-strategy = "module" }, { name = "topology" namespace = "urn:TBD:params:xml:ns:yang:network-topology" shard-strategy = "module" }, { name = "toaster" namespace = "http://netconfcentral.org/ns/toaster" shard-strategy = "module" }, { name = "car" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" shard-strategy = "module" }, { name = "people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" shard-strategy = "module" }, { name = "car-people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" shard-strategy = "module" } ] Dump module-shards.conf + echo 'Dump module-shards.conf' + cat /tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/module-shards.conf module-shards = [ { name = "default" shards = [ { name = "default" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "inventory" shards = [ { name="inventory" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "topology" shards = [ { name="topology" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "toaster" shards = [ { name="toaster" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "car" shards = [ { name="car" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "people" shards = [ { name="people" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "car-people" shards = [ { name="car-people" replicas = ["member-1", "member-2", "member-3"] } ] } ] Locating config plan to use... Finished running config plans Starting member-1 with IP address 10.30.170.112 Warning: Permanently added '10.30.170.112' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.170.112' (ECDSA) to the list of known hosts. Redirecting karaf console output to karaf_console.log Starting controller... start: Redirecting Karaf output to /tmp/karaf-0.22.0-SNAPSHOT/data/log/karaf_console.log Starting member-2 with IP address 10.30.171.173 Warning: Permanently added '10.30.171.173' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.171.173' (ECDSA) to the list of known hosts. Redirecting karaf console output to karaf_console.log Starting controller... start: Redirecting Karaf output to /tmp/karaf-0.22.0-SNAPSHOT/data/log/karaf_console.log Starting member-3 with IP address 10.30.171.202 Warning: Permanently added '10.30.171.202' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.171.202' (ECDSA) to the list of known hosts. Redirecting karaf console output to karaf_console.log Starting controller... start: Redirecting Karaf output to /tmp/karaf-0.22.0-SNAPSHOT/data/log/karaf_console.log [controller-csit-3node-clustering-tell-all-titanium] $ /bin/bash /tmp/jenkins13797686060677341951.sh common-functions.sh is being sourced common-functions environment: MAVENCONF: /tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ACTUALFEATURES: FEATURESCONF: /tmp/karaf-0.22.0-SNAPSHOT/etc/org.apache.karaf.features.cfg CUSTOMPROP: /tmp/karaf-0.22.0-SNAPSHOT/etc/custom.properties LOGCONF: /tmp/karaf-0.22.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg MEMCONF: /tmp/karaf-0.22.0-SNAPSHOT/bin/setenv CONTROLLERMEM: 2048m AKKACONF: /tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/pekko.conf MODULESCONF: /tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/modules.conf MODULESHARDSCONF: /tmp/karaf-0.22.0-SNAPSHOT/configuration/initial/module-shards.conf SUITES: + echo '#################################################' ################################################# + echo '## Verify Cluster is UP ##' ## Verify Cluster is UP ## + echo '#################################################' ################################################# + create_post_startup_script + cat + copy_and_run_post_startup_script + seed_index=1 ++ seq 1 3 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_1_IP + echo 'Execute the post startup script on controller 10.30.170.112' Execute the post startup script on controller 10.30.170.112 + scp /w/workspace/controller-csit-3node-clustering-tell-all-titanium/post-startup-script.sh 10.30.170.112:/tmp/ Warning: Permanently added '10.30.170.112' (ECDSA) to the list of known hosts. + ssh 10.30.170.112 'bash /tmp/post-startup-script.sh 1' Warning: Permanently added '10.30.170.112' (ECDSA) to the list of known hosts. /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found Waiting up to 3 minutes for controller to come up, checking every 5 seconds... 2025-07-06T22:57:09,667 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 292 - org.opendaylight.infrautils.ready-api - 7.0.3 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Controller is UP 2025-07-06T22:57:09,667 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 292 - org.opendaylight.infrautils.ready-api - 7.0.3 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Listing all open ports on controller system... /tmp/post-startup-script.sh: line 51: netstat: command not found looking for "BindException: Address already in use" in log file looking for "server is unhealthy" in log file + '[' 1 == 0 ']' + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_2_IP + echo 'Execute the post startup script on controller 10.30.171.173' Execute the post startup script on controller 10.30.171.173 + scp /w/workspace/controller-csit-3node-clustering-tell-all-titanium/post-startup-script.sh 10.30.171.173:/tmp/ Warning: Permanently added '10.30.171.173' (ECDSA) to the list of known hosts. + ssh 10.30.171.173 'bash /tmp/post-startup-script.sh 2' Warning: Permanently added '10.30.171.173' (ECDSA) to the list of known hosts. /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found Waiting up to 3 minutes for controller to come up, checking every 5 seconds... 2025-07-06T22:57:10,638 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 292 - org.opendaylight.infrautils.ready-api - 7.0.3 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Controller is UP 2025-07-06T22:57:10,638 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 292 - org.opendaylight.infrautils.ready-api - 7.0.3 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Listing all open ports on controller system... /tmp/post-startup-script.sh: line 51: netstat: command not found looking for "BindException: Address already in use" in log file looking for "server is unhealthy" in log file + '[' 2 == 0 ']' + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_3_IP + echo 'Execute the post startup script on controller 10.30.171.202' Execute the post startup script on controller 10.30.171.202 + scp /w/workspace/controller-csit-3node-clustering-tell-all-titanium/post-startup-script.sh 10.30.171.202:/tmp/ Warning: Permanently added '10.30.171.202' (ECDSA) to the list of known hosts. + ssh 10.30.171.202 'bash /tmp/post-startup-script.sh 3' Warning: Permanently added '10.30.171.202' (ECDSA) to the list of known hosts. /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found Waiting up to 3 minutes for controller to come up, checking every 5 seconds... 2025-07-06T22:57:09,519 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 292 - org.opendaylight.infrautils.ready-api - 7.0.3 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Controller is UP 2025-07-06T22:57:09,519 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 292 - org.opendaylight.infrautils.ready-api - 7.0.3 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Listing all open ports on controller system... /tmp/post-startup-script.sh: line 51: netstat: command not found looking for "BindException: Address already in use" in log file looking for "server is unhealthy" in log file + '[' 0 == 0 ']' + seed_index=1 + dump_controller_threads ++ seq 1 3 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_1_IP + echo 'Let'\''s take the karaf thread dump' Let's take the karaf thread dump + ssh 10.30.170.112 'sudo ps aux' Warning: Permanently added '10.30.170.112' (ECDSA) to the list of known hosts. ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-titanium/ps_before.log ++ cut -f2 '-d ' ++ grep -v grep ++ tr -s ' ' + pid=2084 + echo 'karaf main: org.apache.karaf.main.Main, pid:2084' karaf main: org.apache.karaf.main.Main, pid:2084 + ssh 10.30.170.112 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 2084' Warning: Permanently added '10.30.170.112' (ECDSA) to the list of known hosts. + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_2_IP + echo 'Let'\''s take the karaf thread dump' Let's take the karaf thread dump + ssh 10.30.171.173 'sudo ps aux' Warning: Permanently added '10.30.171.173' (ECDSA) to the list of known hosts. ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-titanium/ps_before.log ++ grep -v grep ++ cut -f2 '-d ' ++ tr -s ' ' + pid=2076 + echo 'karaf main: org.apache.karaf.main.Main, pid:2076' karaf main: org.apache.karaf.main.Main, pid:2076 + ssh 10.30.171.173 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 2076' Warning: Permanently added '10.30.171.173' (ECDSA) to the list of known hosts. + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_3_IP + echo 'Let'\''s take the karaf thread dump' Let's take the karaf thread dump + ssh 10.30.171.202 'sudo ps aux' Warning: Permanently added '10.30.171.202' (ECDSA) to the list of known hosts. ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-titanium/ps_before.log ++ grep -v grep ++ tr -s ' ' ++ cut -f2 '-d ' + pid=2087 + echo 'karaf main: org.apache.karaf.main.Main, pid:2087' karaf main: org.apache.karaf.main.Main, pid:2087 + ssh 10.30.171.202 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 2087' Warning: Permanently added '10.30.171.202' (ECDSA) to the list of known hosts. + '[' 0 -gt 0 ']' + echo 'Generating controller variables...' Generating controller variables... ++ seq 1 3 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_1_IP + odl_variables=' -v ODL_SYSTEM_1_IP:10.30.170.112' + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_2_IP + odl_variables=' -v ODL_SYSTEM_1_IP:10.30.170.112 -v ODL_SYSTEM_2_IP:10.30.171.173' + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_3_IP + odl_variables=' -v ODL_SYSTEM_1_IP:10.30.170.112 -v ODL_SYSTEM_2_IP:10.30.171.173 -v ODL_SYSTEM_3_IP:10.30.171.202' + echo 'Generating mininet variables...' Generating mininet variables... ++ seq 1 0 + get_test_suites SUITES + local __suite_list=SUITES + echo 'Locating test plan to use...' Locating test plan to use... + testplan_filepath=/w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/testplans/controller-clustering-tell-titanium.txt + '[' '!' -f /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/testplans/controller-clustering-tell-titanium.txt ']' + testplan_filepath=/w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/testplans/controller-clustering-tell.txt + '[' disabled '!=' disabled ']' + echo 'Changing the testplan path...' Changing the testplan path... + sed s:integration:/w/workspace/controller-csit-3node-clustering-tell-all-titanium: /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/testplans/controller-clustering-tell.txt + cat testplan.txt # Place the suites in run order: # disabling all "prefix based" suites. This functionality was newly # introduced with these tests in 2017. The assumption is that # development stopped in that area, but may continue at a later # time. Still, the tests are failing and no resources to solve the # failures at this time. If/When this changes, we can uncomment # those suites. Note that every suite is commented out with it's # accompanying "restart_with_tell_based_true" setup suite. # /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot # /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/ddb-sanity-prefix-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot # /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot # /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown_prefbasedshard.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot # /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot # /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement_prefbasedshard.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot # /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot # /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/leader_isolation_prefbasedshard.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/client_isolation.robot # /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot # /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/client_isolation_prefbasedshard.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/listener_stability.robot # /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot # /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/listener_stability_prefbasedshard.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot + '[' -z '' ']' ++ grep -E -v '(^[[:space:]]*#|^[[:space:]]*$)' testplan.txt ++ tr '\012' ' ' + suite_list='/w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot ' + eval 'SUITES='\''/w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot '\''' ++ SUITES='/w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot ' + echo 'Starting Robot test suites /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot ...' Starting Robot test suites /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot ... + robot -N controller-clustering-tell.txt --removekeywords wuks -e exclude -e skip_if_titanium -v BUNDLEFOLDER:karaf-0.22.0-SNAPSHOT -v BUNDLE_URL:https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.22.0-SNAPSHOT/karaf-0.22.0-20250706.175225-1.zip -v CONTROLLER:10.30.170.112 -v CONTROLLER1:10.30.171.173 -v CONTROLLER2:10.30.171.202 -v CONTROLLER_USER:jenkins -v JAVA_HOME:/usr/lib/jvm/java-21-openjdk-amd64 -v JDKVERSION:openjdk21 -v JENKINS_WORKSPACE:/w/workspace/controller-csit-3node-clustering-tell-all-titanium -v MININET: -v MININET1: -v MININET2: -v MININET_USER:jenkins -v NEXUSURL_PREFIX:https://nexus.opendaylight.org -v NUM_ODL_SYSTEM:3 -v NUM_TOOLS_SYSTEM:0 -v ODL_STREAM:titanium -v ODL_SYSTEM_IP:10.30.170.112 -v ODL_SYSTEM_1_IP:10.30.170.112 -v ODL_SYSTEM_2_IP:10.30.171.173 -v ODL_SYSTEM_3_IP:10.30.171.202 -v ODL_SYSTEM_USER:jenkins -v TOOLS_SYSTEM_IP: -v TOOLS_SYSTEM_USER:jenkins -v USER_HOME:/home/jenkins -v IS_KARAF_APPL:True -v WORKSPACE:/tmp /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-titanium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot ============================================================================== controller-clustering-tell.txt ============================================================================== controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.202', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-tell.txt.Ddb-Sanity-Module-Based :: DOMDataBroker tes... ============================================================================== Get_Shard_Role :: Get shard role. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_ddb_sanity_module_based_get_shard_role" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_get_shard_role&order=bug_status" HTTPError: 404 Client Error: Not Found for url: http://10.30.170.112:8181/restconf/operations/cluster-admin:get-shard-role ------------------------------------------------------------------------------ Subscribe_Listener_To_Leader :: Subscribe listener to leader. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_ddb_sanity_module_based_subscribe_listener_to_leader" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_subscribe_listener_to_leader&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.171.202', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Subscribe_Listener_To_Follower :: Subscribe listener to follower. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_ddb_sanity_module_based_subscribe_listener_to_follower" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_subscribe_listener_to_follower&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.171.202', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Make_Leader_Local :: Make the loeader local and verify. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_ddb_sanity_module_based_make_leader_local" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_make_leader_local&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.171.202', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Remove_Leader_Shard_Replica_And_Add_It_Back :: Remove and add shar... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_ddb_sanity_module_based_remove_leader_shard_replica_and_add_it_back" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_remove_leader_shard_replica_and_add_it_back&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.171.202', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Remove_Follower_Shard_Replica_And_Add_It_Back :: Remove and add sh... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_ddb_sanity_module_based_remove_follower_shard_replica_and_add_it_back" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_remove_follower_shard_replica_and_add_it_back&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.171.202', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Write_Transactions_One_Node_Leader :: Write transactions. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_one_node_leader" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_one_node_leader&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.171.202', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Write_Transactions_One_Node_Follower :: Write transactions. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_one_node_follower" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_one_node_follower&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.171.202', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Write_Transactions_All_Nodes :: Write transactions. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_all_nodes" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_all_nodes&order=bug_status" Resolving variable '${response.text}' failed: AttributeError: 'ReadTimeout' object has no attribute 'text' ------------------------------------------------------------------------------ controller-clustering-tell.txt.Ddb-Sanity-Module-Based :: DOMDataB... | FAIL | 9 tests, 0 passed, 9 failed ============================================================================== controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.202', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-tell.txt.Clean Leader Shutdown :: DOMDataBroker testi... ============================================================================== Local_Leader_Shutdown :: Shutdown the leader on the same node as t... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_clean_leader_shutdown_local_leader_shutdown" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_clean_leader_shutdown_local_leader_shutdown&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.171.202', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Restart :: Restart odl | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_clean_leader_shutdown_restart" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_clean_leader_shutdown_restart&order=bug_status" Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Remote_Leader_Shutdown :: Shutdown the leader on different node as... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_clean_leader_shutdown_remote_leader_shutdown" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_clean_leader_shutdown_remote_leader_shutdown&order=bug_status" ConnectionError: HTTPConnectionPool(host='10.30.170.112', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Clean Leader Shutdown :: DOMDataBro... | FAIL | 3 tests, 0 passed, 3 failed ============================================================================== controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.202', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-tell.txt.Explicit Leader Movement :: DOMDataBroker te... ============================================================================== Local_To_Remote_Movement :: Leader moves from local to remote node... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_explicit_leader_movement_local_to_remote_movement" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_local_to_remote_movement&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.171.202', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Restart1 :: Restart odl | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_explicit_leader_movement_restart1" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_restart1&order=bug_status" Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Remote_To_Remote_Movement :: Leader moves from one remote to other... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_explicit_leader_movement_remote_to_remote_movement" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_remote_to_remote_movement&order=bug_status" ConnectionError: HTTPConnectionPool(host='10.30.170.112', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) ------------------------------------------------------------------------------ Restart2 :: Restart odl | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_explicit_leader_movement_restart2" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_restart2&order=bug_status" Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Remote_To_Local_Movement :: Leader moves from remote to local node... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_explicit_leader_movement_remote_to_local_movement" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_remote_to_local_movement&order=bug_status" ConnectionError: HTTPConnectionPool(host='10.30.170.112', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Explicit Leader Movement :: DOMData... | FAIL | 5 tests, 0 passed, 5 failed ============================================================================== controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.202', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-tell.txt.Leader Isolation :: DOMDataBroker testing: L... ============================================================================== Healing_Within_Request_Timeout :: The isolated node (leader) is re... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_leader_isolation_healing_within_request_timeout" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_leader_isolation_healing_within_request_timeout&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.171.202', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Restart :: Restart odl | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_leader_isolation_restart" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_leader_isolation_restart&order=bug_status" Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Healing_After_Request_Timeout :: The isolated node (leader) is rej... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_leader_isolation_healing_after_request_timeout" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_leader_isolation_healing_after_request_timeout&order=bug_status" ConnectionError: HTTPConnectionPool(host='10.30.170.112', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Leader Isolation :: DOMDataBroker t... | FAIL | 3 tests, 0 passed, 3 failed ============================================================================== controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.202', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-tell.txt.Client Isolation :: DOMDataBroker testing: C... ============================================================================== Producer_On_Shard_Leader_Node_ChainedTx :: Client isolation with p... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_client_isolation_producer_on_shard_leader_node_chainedtx" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_producer_on_shard_leader_node_chainedtx&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.171.202', port=8181): Read timed out. (read timeout=125.0) Also keyword teardown failed: Several failures occurred: 1) Variable '${client_node_dst}' not found. 2) Variable '${client_node_dst}' not found. 3) Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 1 minute 10 seconds. The last error was: Several failures occurred: 1) ReadTimeout: HTTPConnectionPool(host='10.30.171.202', port=8181): Read timed out. (read timeout=125.0) 2) Resolving variable '${response.text}' failed: AttributeError: 'NoneType' object has no attribute 'text' 3) Resolving variable '${response.status_code}' failed: AttributeError: 'No... [ Message content over the limit has been removed. ] 65) Resolving variable '${response.text}' failed: AttributeError: 'NoneType' object has no attribute 'text' 66) Evaluating expression "json.loads('''None''')" failed: JSONDecodeError: Expecting value: line 1 column 1 (char 0) 67) TypeError: Expected argument 1 to be a dictionary, got None instead. 68) TypeError: Expected argument 1 to be a dictionary, got None instead. 69) Unrecognized Raft state: None 70) No leader found. 71) Too many Leaders. 72) IndexError: Given index 0 is out of the range 0--1. 4) KeyError: 'threads' ------------------------------------------------------------------------------ Restart1 :: Restart odl | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_client_isolation_restart1" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_restart1&order=bug_status" Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Producer_On_Shard_Leader_Node_SimpleTx :: Client isolation with pr... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_client_isolation_producer_on_shard_leader_node_simpletx" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_producer_on_shard_leader_node_simpletx&order=bug_status" ConnectionError: HTTPConnectionPool(host='10.30.170.112', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) Also keyword teardown failed: Several failures occurred: 1) Variable '${client_node_dst}' not found. 2) Variable '${client_node_dst}' not found. 3) Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 1 minute 10 seconds. The last error was: Several failures occurred: 1) ConnectionError: HTTPConnectionPool(host='10.30.170.112', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) Also keyword teardown failed: Several failures occurred: 1) Variable '${client_node_dst}' not found. 2) Variable '${client_node_dst}' not found. 3) Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 1 minute 10 seconds. The last error was: Several failures occurred: 1) ConnectionError: HTTPConnectionPool(host='10.30.170.112', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) Also keyword teardown failed: Several failures occurred: 1) Variable '${client_node_dst}' not found. 2) Variable '${client_node_dst}' not found. 3) Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 1 minute 10 seconds. The last error was: Several failures occurred: 1) ConnectionError: HTTPConnectionPool(host='10.30.170.112', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) ------------------------------------------------------------------------------ Restart_2 :: Restart odl. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_listener_stability_restart_2" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_listener_stability_restart_2&order=bug_status" Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Move_Leader_From_Listener_Remote_To_Local :: Listener runs on foll... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_listener_stability_move_leader_from_listener_remote_to_local" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_listener_stability_move_leader_from_listener_remote_to_local&order=bug_status" ConnectionError: HTTPConnectionPool(host='10.30.170.112', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Listener Stability :: DOMDataBroker... | FAIL | 5 tests, 0 passed, 5 failed ============================================================================== controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.202', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-tell.txt.Master Stability :: Cluster Singleton testin... ============================================================================== Register_Singleton_Constant_On_Each_Node_And_Verify :: Register a ... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_master_stability_register_singleton_constant_on_each_node_and_verify" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_register_singleton_constant_on_each_node_and_verify&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.171.202', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Unregister_Singleton_Constant_On_Non_Master_Node :: Unregister the... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_master_stability_unregister_singleton_constant_on_non_master_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_unregister_singleton_constant_on_non_master_node&order=bug_status" Variable '@{cs_candidates}' not found. Did you mean: @{cs_exp_candidates} ------------------------------------------------------------------------------ Monitor_Stability_While_Unregistered :: Verify that the owner rema... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_master_stability_monitor_stability_while_unregistered" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_monitor_stability_while_unregistered&order=bug_status" Variable '${cs_owner}' not found. ------------------------------------------------------------------------------ Reregister_Singleton_Constant :: Re-register the unregistered cand... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_master_stability_reregister_singleton_constant" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_reregister_singleton_constant&order=bug_status" Variable '${unregistered_node}' not found. ------------------------------------------------------------------------------ Verify_Stability_After_Reregistration :: Verify that the owner rem... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_master_stability_verify_stability_after_reregistration" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_verify_stability_after_reregistration&order=bug_status" Variable '${cs_owner}' not found. ------------------------------------------------------------------------------ Unregister_Singleton_Constant_On_Each_Node :: Unregister the appli... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_master_stability_unregister_singleton_constant_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_unregister_singleton_constant_on_each_node&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.171.202', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Master Stability :: Cluster Singlet... | FAIL | 6 tests, 0 passed, 6 failed ============================================================================== controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.173:8181/jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore ------------------------------------------------------------------------------ controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-tell.txt.Partition And Heal :: Cluster Singleton test... ============================================================================== Register_Singleton_Constant_On_Each_Node :: Register a candidate a... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_partition_and_heal_register_singleton_constant_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_register_singleton_constant_on_each_node&order=bug_status" HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.173:8181/rests/operations/odl-mdsal-lowlevel-control:register-singleton-constant ------------------------------------------------------------------------------ Verify_Singleton_Constant_On_Each_Node :: Store the owner and cand... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_partition_and_heal_verify_singleton_constant_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_verify_singleton_constant_on_each_node&order=bug_status" Could not parse owner and candidates for device get-singleton-constant-service'] ------------------------------------------------------------------------------ Isolate_Owner_Node :: Isolate the cluster node which is the owner.... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_partition_and_heal_isolate_owner_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_isolate_owner_node&order=bug_status" Variable '${cs_owner}' not found. ------------------------------------------------------------------------------ Monitor_Stability_While_Isolated :: Monitor the stability of the s... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_partition_and_heal_monitor_stability_while_isolated" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_monitor_stability_while_isolated&order=bug_status" Invalid IF condition: Evaluating expression '"${index}" == "${cs_isolated_index}"' failed: Variable '${cs_isolated_index}' not found. ------------------------------------------------------------------------------ Rejoin_Isolated_node :: Rejoin isolated node. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_partition_and_heal_rejoin_isolated_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_rejoin_isolated_node&order=bug_status" Variable '${cs_isolated_index}' not found. ------------------------------------------------------------------------------ Unregister_Singleton_Constant_On_Each_Node :: Unregister the appli... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_partition_and_heal_unregister_singleton_constant_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_unregister_singleton_constant_on_each_node&order=bug_status" ConnectionError: HTTPConnectionPool(host='10.30.171.173', port=8181): Max retries exceeded with url: /rests/operations/odl-mdsal-lowlevel-control:unregister-singleton-constant (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Partition And Heal :: Cluster Singl... | FAIL | 6 tests, 0 passed, 6 failed ============================================================================== controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.202', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-tell.txt.Chasing The Leader :: Cluster Singleton test... ============================================================================== Register_Candidates :: Register a candidate application on each no... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_chasing_the_leader_register_candidates" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_chasing_the_leader_register_candidates&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.171.202', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Do_Nothing :: Do nothing for the time of the test duration, becaus... | PASS | ------------------------------------------------------------------------------ Unregister_Candidates_And_Validate_Criteria :: Unregister the test... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_chasing_the_leader_unregister_candidates_and_validate_criteria" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_chasing_the_leader_unregister_candidates_and_validate_criteria&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.171.202', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Chasing The Leader :: Cluster Singl... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.202', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-tell.txt.Carpeople Crud :: Suite for performing basic... ============================================================================== Add_Cars_To_Leader :: Add 30 cars to car Leader by one big PUT. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.112:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Added_Cars_On_Leader :: GET response from Leader should match ... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.112:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Added_Cars_On_Followers :: The same check on other members. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.112:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Add_People_To_First_Follower :: Add 30 people to people first Foll... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.112:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Added_People_On_Leader :: GET response from Leader should matc... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.112:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Added_People_On_Followers :: The same check on other members. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.112:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Buy_Cars_On_Leader :: Buy some cars on car-people Leader, loop of ... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.112:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Buy_Cars_On_Followers :: On each Follower buy corresponding ID seg... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.112:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Added_CarPeople_On_Leader :: GET car-person mappings from Lead... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.112:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Added_CarPeople_On_Followers :: The same check on other members. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.112:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_All_CarPeople_On_Leader :: DELETE car-people container. No ... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.112:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_All_People_On_Leader :: DELETE people container. No verific... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.112:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_All_Cars_On_Leader :: DELETE cars container. No verificatio... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.112:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ controller-clustering-tell.txt.Carpeople Crud :: Suite for perform... | FAIL | Suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.112:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 13 tests, 0 passed, 13 failed ============================================================================== controller-clustering-tell.txt.Car Failover Crud :: Suite mixing basic oper... ============================================================================== Add_Original_Cars_On_Old_Leader_And_Verify :: Add initial cars on ... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.173:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Stop_Original_Car_Leader :: Stop the car Leader to cause a new lea... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.173:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Wait_For_New_Leader :: Wait until new car Leader is elected. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.173:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Original_Cars_On_New_Leader :: GET cars from new Leader, shoul... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.173:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Original_Cars_On_New_Followers :: The same check on other exis... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.173:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_Original_Cars_On_New_Leader :: Delete cars on the new Leader. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.173:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Add_Leader_Cars_On_New_Leader :: Add cars on the new Leader. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.173:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Leader_Cars_On_New_Leader :: GET cars from new Leader, should ... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.173:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Leader_Cars_On_New_Followers :: The same check on other existi... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.173:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_Leader_Cars_On_New_First_Follower :: Delete cars in new fir... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.173:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Add_Follower_Cars_On_New_First_Follower :: Add cars on the new fir... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.173:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Folower_Cars_On_New_Leader :: Get cars from the new Leader, sh... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.173:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Follower_Cars_On_New_Followers :: The same check on other exis... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.173:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Start_Old_Car_Leader :: Start the stopped member without deleting ... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.173:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Folower_Cars_On_Old_Leader :: GET cars from the restarted memb... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.173:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_Follower_Cars_On_New_Leader :: Delete cars on the last Leader. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.173:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ controller-clustering-tell.txt.Car Failover Crud :: Suite mixing b... | FAIL | Suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.173:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 16 tests, 0 passed, 16 failed ============================================================================== controller-clustering-tell.txt.Car Persistence Recovery :: This test restar... ============================================================================== Add_Cars_On_Leader_And_Verify :: Single big PUT to datastore to ad... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.112:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Stop_All_Members :: Stop all controllers. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.112:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Start_All_Members :: Start all controllers (should restore the per... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.112:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Memorize_Leader_And_Followers :: Locate current Leader of car Shard. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.112:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Cars_On_Leader :: GET cars from Leader, should match the PUT d... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.112:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Cars_On_Followers :: The same check on other members. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.112:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_Cars_On_Leader :: Delete cars on the new Leader. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.112:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ controller-clustering-tell.txt.Car Persistence Recovery :: This te... | FAIL | Suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.112:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 7 tests, 0 passed, 7 failed ============================================================================== controller-clustering-tell.txt.Buycar Failover :: This test focuses on test... ============================================================================== Add_Cars_To_Leader_And_Verify :: Add all needed cars to car Leader... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.173:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Add_People_To_First_Follower_And_Verify :: Add all needed people t... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.173:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Buy_Cars_On_Leader_And_Verify :: Buy some cars on the leader member. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.173:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Buy_Cars_On_Follower_And_Verify :: Buy some cars on the first foll... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.173:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Reboot_People_Leader :: Previous people Leader is rebooted. We sho... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.173:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Buy_Cars_On_Leader_After_Reboot_And_Verify :: Buy some cars on the... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.173:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Buy_Cars_On_Follower_After_Reboot_And_Verify :: Buy some cars on t... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.173:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_All_CarPeople :: DELETE car-people container. No verificati... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.173:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_All_People :: DELETE people container. No verification beyo... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.173:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_All_Cars :: DELETE cars container. No verification beyond h... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.173:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ controller-clustering-tell.txt.Buycar Failover :: This test focuse... | FAIL | Suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.173:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 10 tests, 0 passed, 10 failed ============================================================================== controller-clustering-tell.txt.Entity Isolate :: Suite for performing membe... ============================================================================== Check All Shards Before Isolate :: Check all shards in controller. | FAIL | Parent suite setup failed: Evaluating expression 'json.loads(\'\'\'{\n "error": "javax.management.InstanceNotFoundException : org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "error_type": "javax.management.InstanceNotFoundException",\n "request": {\n "mbean": "org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "type": "read"\n },\n "stacktrace": "javax.management.InstanceNotFoundException: org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1073)\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1343)\\n\\tat java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:921)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:46)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:41)\\n\\tat org.jolokia.backend.executor.AbstractMBeanServerExecutor.call(AbstractMBeanServerExecutor.java:90)\\n\\tat org.jolokia.handler.ReadHandler.getMBeanInfo(ReadHandler.java:233)\\n\\tat org.jolokia.handler.ReadHandler.getAllAttributesNames(ReadHandler.java:245)\\n\\tat org.jolokia.handler.ReadHandler.resolveAttributes(ReadHandler.java:221)\\n\\tat org.jolokia.handler.ReadHandler.f... [ Message content over the limit has been removed. ] ...lipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\\n\\tat org.eclipse.jetty.server.Server.handle(Server.java:516)\\n\\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)\\n\\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)\\n\\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)\\n\\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\\n\\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\\n\\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\\n\\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)\\n\\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\\n\\tat java.base/java.lang.Thread.run(Thread.java:1583)\\n",\n "status": 404\n}\n\'\'\')' failed: JSONDecodeError: Invalid control character at: line 8 column 190 (char 619) ------------------------------------------------------------------------------ Isolate Entity Leader :: Isolate the entity-ownership Leader to ca... | FAIL | Parent suite setup failed: Evaluating expression 'json.loads(\'\'\'{\n "error": "javax.management.InstanceNotFoundException : org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "error_type": "javax.management.InstanceNotFoundException",\n "request": {\n "mbean": "org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "type": "read"\n },\n "stacktrace": "javax.management.InstanceNotFoundException: org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1073)\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1343)\\n\\tat java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:921)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:46)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:41)\\n\\tat org.jolokia.backend.executor.AbstractMBeanServerExecutor.call(AbstractMBeanServerExecutor.java:90)\\n\\tat org.jolokia.handler.ReadHandler.getMBeanInfo(ReadHandler.java:233)\\n\\tat org.jolokia.handler.ReadHandler.getAllAttributesNames(ReadHandler.java:245)\\n\\tat org.jolokia.handler.ReadHandler.resolveAttributes(ReadHandler.java:221)\\n\\tat org.jolokia.handler.ReadHandler.f... [ Message content over the limit has been removed. ] ...lipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\\n\\tat org.eclipse.jetty.server.Server.handle(Server.java:516)\\n\\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)\\n\\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)\\n\\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)\\n\\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\\n\\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\\n\\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\\n\\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)\\n\\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\\n\\tat java.base/java.lang.Thread.run(Thread.java:1583)\\n",\n "status": 404\n}\n\'\'\')' failed: JSONDecodeError: Invalid control character at: line 8 column 190 (char 619) ------------------------------------------------------------------------------ Check All Shards After Isolate :: Check all shards in controller. | FAIL | Parent suite setup failed: Evaluating expression 'json.loads(\'\'\'{\n "error": "javax.management.InstanceNotFoundException : org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "error_type": "javax.management.InstanceNotFoundException",\n "request": {\n "mbean": "org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "type": "read"\n },\n "stacktrace": "javax.management.InstanceNotFoundException: org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1073)\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1343)\\n\\tat java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:921)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:46)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:41)\\n\\tat org.jolokia.backend.executor.AbstractMBeanServerExecutor.call(AbstractMBeanServerExecutor.java:90)\\n\\tat org.jolokia.handler.ReadHandler.getMBeanInfo(ReadHandler.java:233)\\n\\tat org.jolokia.handler.ReadHandler.getAllAttributesNames(ReadHandler.java:245)\\n\\tat org.jolokia.handler.ReadHandler.resolveAttributes(ReadHandler.java:221)\\n\\tat org.jolokia.handler.ReadHandler.f... [ Message content over the limit has been removed. ] ...lipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\\n\\tat org.eclipse.jetty.server.Server.handle(Server.java:516)\\n\\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)\\n\\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)\\n\\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)\\n\\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\\n\\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\\n\\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\\n\\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)\\n\\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\\n\\tat java.base/java.lang.Thread.run(Thread.java:1583)\\n",\n "status": 404\n}\n\'\'\')' failed: JSONDecodeError: Invalid control character at: line 8 column 190 (char 619) ------------------------------------------------------------------------------ Rejoin Entity Leader :: Rejoin the entity-ownership Leader. | FAIL | Parent suite setup failed: Evaluating expression 'json.loads(\'\'\'{\n "error": "javax.management.InstanceNotFoundException : org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "error_type": "javax.management.InstanceNotFoundException",\n "request": {\n "mbean": "org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "type": "read"\n },\n "stacktrace": "javax.management.InstanceNotFoundException: org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1073)\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1343)\\n\\tat java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:921)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:46)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:41)\\n\\tat org.jolokia.backend.executor.AbstractMBeanServerExecutor.call(AbstractMBeanServerExecutor.java:90)\\n\\tat org.jolokia.handler.ReadHandler.getMBeanInfo(ReadHandler.java:233)\\n\\tat org.jolokia.handler.ReadHandler.getAllAttributesNames(ReadHandler.java:245)\\n\\tat org.jolokia.handler.ReadHandler.resolveAttributes(ReadHandler.java:221)\\n\\tat org.jolokia.handler.ReadHandler.f... [ Message content over the limit has been removed. ] ...lipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\\n\\tat org.eclipse.jetty.server.Server.handle(Server.java:516)\\n\\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)\\n\\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)\\n\\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)\\n\\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\\n\\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\\n\\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\\n\\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)\\n\\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\\n\\tat java.base/java.lang.Thread.run(Thread.java:1583)\\n",\n "status": 404\n}\n\'\'\')' failed: JSONDecodeError: Invalid control character at: line 8 column 190 (char 619) ------------------------------------------------------------------------------ Check All Shards After Rejoin :: Check all shards in controller. | FAIL | Parent suite setup failed: Evaluating expression 'json.loads(\'\'\'{\n "error": "javax.management.InstanceNotFoundException : org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "error_type": "javax.management.InstanceNotFoundException",\n "request": {\n "mbean": "org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "type": "read"\n },\n "stacktrace": "javax.management.InstanceNotFoundException: org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1073)\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1343)\\n\\tat java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:921)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:46)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:41)\\n\\tat org.jolokia.backend.executor.AbstractMBeanServerExecutor.call(AbstractMBeanServerExecutor.java:90)\\n\\tat org.jolokia.handler.ReadHandler.getMBeanInfo(ReadHandler.java:233)\\n\\tat org.jolokia.handler.ReadHandler.getAllAttributesNames(ReadHandler.java:245)\\n\\tat org.jolokia.handler.ReadHandler.resolveAttributes(ReadHandler.java:221)\\n\\tat org.jolokia.handler.ReadHandler.f... [ Message content over the limit has been removed. ] ...lipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\\n\\tat org.eclipse.jetty.server.Server.handle(Server.java:516)\\n\\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)\\n\\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)\\n\\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)\\n\\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\\n\\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\\n\\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\\n\\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)\\n\\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\\n\\tat java.base/java.lang.Thread.run(Thread.java:1583)\\n",\n "status": 404\n}\n\'\'\')' failed: JSONDecodeError: Invalid control character at: line 8 column 190 (char 619) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Entity Isolate :: Suite for perform... | FAIL | Suite setup failed: Evaluating expression 'json.loads(\'\'\'{\n "error": "javax.management.InstanceNotFoundException : org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "error_type": "javax.management.InstanceNotFoundException",\n "request": {\n "mbean": "org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "type": "read"\n },\n "stacktrace": "javax.management.InstanceNotFoundException: org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1073)\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1343)\\n\\tat java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:921)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:46)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:41)\\n\\tat org.jolokia.backend.executor.AbstractMBeanServerExecutor.call(AbstractMBeanServerExecutor.java:90)\\n\\tat org.jolokia.handler.ReadHandler.getMBeanInfo(ReadHandler.java:233)\\n\\tat org.jolokia.handler.ReadHandler.getAllAttributesNames(ReadHandler.java:245)\\n\\tat org.jolokia.handler.ReadHandler.resolveAttributes(ReadHandler.java:221)\\n\\tat org.jolokia.handler.ReadHandler.f... [ Message content over the limit has been removed. ] ...lipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\\n\\tat org.eclipse.jetty.server.Server.handle(Server.java:516)\\n\\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)\\n\\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)\\n\\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)\\n\\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\\n\\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\\n\\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\\n\\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)\\n\\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\\n\\tat java.base/java.lang.Thread.run(Thread.java:1583)\\n",\n "status": 404\n}\n\'\'\')' failed: JSONDecodeError: Invalid control character at: line 8 column 190 (char 619) 5 tests, 0 passed, 5 failed ============================================================================== controller-clustering-tell.txt.Buycar Failover Isolation :: This test focus... ============================================================================== Add_Cars_To_Leader_And_Verify :: Add all needed cars to car Leader... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.173:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Add_People_To_First_Follower_And_Verify :: Add all needed people t... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.173:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Buy_Cars_On_Leader_And_Verify :: Buy some cars on the leader member. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.173:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Buy_Cars_On_Follower_And_Verify :: Buy some cars on the first foll... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.173:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Isolate_and_Rejoin_People_Leader :: Previous people Leader is isol... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.173:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Buy_Cars_On_Leader_After_Rejoin_And_Verify :: Buy some cars on the... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.173:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Buy_Cars_On_Follower_After_Rejoin_And_Verify :: Buy some cars on t... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.173:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_All_CarPeople :: DELETE car-people container. No verificati... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.173:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_All_People :: DELETE people container. No verification beyo... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.173:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_All_Cars :: DELETE cars container. No verification beyond h... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.173:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ controller-clustering-tell.txt.Buycar Failover Isolation :: This t... | FAIL | Suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.173:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 10 tests, 0 passed, 10 failed ============================================================================== controller-clustering-tell.txt.Car Failover Crud Isolation :: Suite mixing ... ============================================================================== Add_Original_Cars_On_Old_Leader_And_Verify :: Add initial cars on ... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.173:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Isolate_Original_Car_Leader :: Isolate the car Leader to cause a n... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.173:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Wait_For_New_Leader :: Wait until new car Leader is elected. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.173:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Original_Cars_On_New_Leader :: GET cars from new Leader, shoul... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.173:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Original_Cars_On_New_Followers :: The same check on other exis... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.173:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_Original_Cars_On_New_Leader :: Delete cars on the new Leader. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.173:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Add_Leader_Cars_On_New_Leader :: Add cars on the new Leader. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.173:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Leader_Cars_On_New_Leader :: GET cars from new Leader, should ... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.173:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Leader_Cars_On_New_Followers :: The same check on other existi... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.173:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_Leader_Cars_On_New_First_Follower :: Delete cars in new fir... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.173:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Add_Follower_Cars_On_New_First_Follower :: Add cars on the new fir... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.173:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Folower_Cars_On_New_Leader :: Get cars from the new Leader, sh... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.173:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Follower_Cars_On_New_Followers :: The same check on other exis... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.173:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Rejoin_Old_Car_Leader :: Rejoin the isolated member without deleti... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.173:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Folower_Cars_On_Old_Leader :: GET cars from the restarted memb... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.173:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_Follower_Cars_On_New_Leader :: Delete cars on the last Leader. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.173:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ controller-clustering-tell.txt.Car Failover Crud Isolation :: Suit... | FAIL | Suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.173:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 16 tests, 0 passed, 16 failed ============================================================================== controller-clustering-tell.txt.Car Outage Corners :: Cluster suite for test... ============================================================================== Stop_Majority_Of_The_Followers :: Stop half plus one car Follower ... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.173:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Attempt_To_Add_Cars_To_Leader :: Adding cars should fail, as major... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.173:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Start_Tipping_Follower :: Start one Follower member without persis... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.173:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Add_Cars_On_Tipping_Follower :: Add cars on the tipping Follower. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.173:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Cars_On_Existing_Members :: On each up member: GET cars, shoul... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.173:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Start_Other_Followers :: Start other followers without persisted d... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.173:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Cars_On_New_Follower_Leader :: GET cars from a new follower to... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.173:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_Cars_On_Leader :: Delete cars on Leader. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.173:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ controller-clustering-tell.txt.Car Outage Corners :: Cluster suite... | FAIL | Suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.173:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 8 tests, 0 passed, 8 failed ============================================================================== controller-clustering-tell.txt | FAIL | 162 tests, 11 passed, 151 failed ============================================================================== Output: /w/workspace/controller-csit-3node-clustering-tell-all-titanium/output.xml Log: /w/workspace/controller-csit-3node-clustering-tell-all-titanium/log.html Report: /w/workspace/controller-csit-3node-clustering-tell-all-titanium/report.html + true + echo 'Examining the files in data/log and checking filesize' Examining the files in data/log and checking filesize + ssh 10.30.170.112 'ls -altr /tmp/karaf-0.22.0-SNAPSHOT/data/log/' Warning: Permanently added '10.30.170.112' (ECDSA) to the list of known hosts. total 25920 drwxrwxr-x 2 jenkins jenkins 4096 Jul 6 22:56 . -rw-rw-r-- 1 jenkins jenkins 1720 Jul 6 22:56 karaf_console.log drwxrwxr-x 9 jenkins jenkins 4096 Jul 7 04:29 .. -rw-rw-r-- 1 jenkins jenkins 26522101 Jul 7 04:42 karaf.log + ssh 10.30.170.112 'du -hs /tmp/karaf-0.22.0-SNAPSHOT/data/log/*' Warning: Permanently added '10.30.170.112' (ECDSA) to the list of known hosts. 26M /tmp/karaf-0.22.0-SNAPSHOT/data/log/karaf.log 4.0K /tmp/karaf-0.22.0-SNAPSHOT/data/log/karaf_console.log + ssh 10.30.171.173 'ls -altr /tmp/karaf-0.22.0-SNAPSHOT/data/log/' Warning: Permanently added '10.30.171.173' (ECDSA) to the list of known hosts. total 36940 drwxrwxr-x 2 jenkins jenkins 4096 Jul 6 22:56 . -rw-rw-r-- 1 jenkins jenkins 1720 Jul 6 22:56 karaf_console.log drwxrwxr-x 9 jenkins jenkins 4096 Jul 7 04:29 .. -rw-rw-r-- 1 jenkins jenkins 37807613 Jul 7 04:42 karaf.log + ssh 10.30.171.173 'du -hs /tmp/karaf-0.22.0-SNAPSHOT/data/log/*' Warning: Permanently added '10.30.171.173' (ECDSA) to the list of known hosts. 37M /tmp/karaf-0.22.0-SNAPSHOT/data/log/karaf.log 4.0K /tmp/karaf-0.22.0-SNAPSHOT/data/log/karaf_console.log + ssh 10.30.171.202 'ls -altr /tmp/karaf-0.22.0-SNAPSHOT/data/log/' Warning: Permanently added '10.30.171.202' (ECDSA) to the list of known hosts. total 17088 drwxrwxr-x 2 jenkins jenkins 4096 Jul 6 22:56 . -rw-rw-r-- 1 jenkins jenkins 196208 Jul 6 23:50 karaf_console.log drwxrwxr-x 4 jenkins jenkins 4096 Jul 7 04:29 .. -rw-rw-r-- 1 jenkins jenkins 17287756 Jul 7 04:43 karaf.log + ssh 10.30.171.202 'du -hs /tmp/karaf-0.22.0-SNAPSHOT/data/log/*' Warning: Permanently added '10.30.171.202' (ECDSA) to the list of known hosts. 17M /tmp/karaf-0.22.0-SNAPSHOT/data/log/karaf.log 192K /tmp/karaf-0.22.0-SNAPSHOT/data/log/karaf_console.log + set +e ++ seq 1 3 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_1_IP + echo 'Let'\''s take the karaf thread dump again' Let's take the karaf thread dump again + ssh 10.30.170.112 'sudo ps aux' Warning: Permanently added '10.30.170.112' (ECDSA) to the list of known hosts. ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-titanium/ps_after.log ++ grep -v grep ++ cut -f2 '-d ' ++ tr -s ' ' + pid=29714 + echo 'karaf main: org.apache.karaf.main.Main, pid:29714' karaf main: org.apache.karaf.main.Main, pid:29714 + ssh 10.30.170.112 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 29714' Warning: Permanently added '10.30.170.112' (ECDSA) to the list of known hosts. + echo 'killing karaf process...' killing karaf process... + ssh 10.30.170.112 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh' Warning: Permanently added '10.30.170.112' (ECDSA) to the list of known hosts. + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_2_IP + echo 'Let'\''s take the karaf thread dump again' Let's take the karaf thread dump again + ssh 10.30.171.173 'sudo ps aux' Warning: Permanently added '10.30.171.173' (ECDSA) to the list of known hosts. ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-titanium/ps_after.log ++ grep -v grep ++ tr -s ' ' ++ cut -f2 '-d ' + pid=38695 + echo 'karaf main: org.apache.karaf.main.Main, pid:38695' karaf main: org.apache.karaf.main.Main, pid:38695 + ssh 10.30.171.173 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 38695' Warning: Permanently added '10.30.171.173' (ECDSA) to the list of known hosts. + echo 'killing karaf process...' killing karaf process... + ssh 10.30.171.173 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh' Warning: Permanently added '10.30.171.173' (ECDSA) to the list of known hosts. + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_3_IP + echo 'Let'\''s take the karaf thread dump again' Let's take the karaf thread dump again + ssh 10.30.171.202 'sudo ps aux' Warning: Permanently added '10.30.171.202' (ECDSA) to the list of known hosts. ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-titanium/ps_after.log ++ grep -v grep ++ cut -f2 '-d ' ++ tr -s ' ' + pid=2087 + echo 'karaf main: org.apache.karaf.main.Main, pid:2087' karaf main: org.apache.karaf.main.Main, pid:2087 + ssh 10.30.171.202 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 2087' Warning: Permanently added '10.30.171.202' (ECDSA) to the list of known hosts. + echo 'killing karaf process...' killing karaf process... + ssh 10.30.171.202 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh' Warning: Permanently added '10.30.171.202' (ECDSA) to the list of known hosts. + sleep 5 ++ seq 1 3 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_1_IP + echo 'Compressing karaf.log 1' Compressing karaf.log 1 + ssh 10.30.170.112 gzip --best /tmp/karaf-0.22.0-SNAPSHOT/data/log/karaf.log Warning: Permanently added '10.30.170.112' (ECDSA) to the list of known hosts. + echo 'Fetching compressed karaf.log 1' Fetching compressed karaf.log 1 + scp 10.30.170.112:/tmp/karaf-0.22.0-SNAPSHOT/data/log/karaf.log.gz odl1_karaf.log.gz Warning: Permanently added '10.30.170.112' (ECDSA) to the list of known hosts. + ssh 10.30.170.112 rm -f /tmp/karaf-0.22.0-SNAPSHOT/data/log/karaf.log.gz Warning: Permanently added '10.30.170.112' (ECDSA) to the list of known hosts. + scp 10.30.170.112:/tmp/karaf-0.22.0-SNAPSHOT/data/log/karaf_console.log odl1_karaf_console.log Warning: Permanently added '10.30.170.112' (ECDSA) to the list of known hosts. + ssh 10.30.170.112 rm -f /tmp/karaf-0.22.0-SNAPSHOT/data/log/karaf_console.log Warning: Permanently added '10.30.170.112' (ECDSA) to the list of known hosts. + echo 'Fetch GC logs' Fetch GC logs + mkdir -p gclogs-1 + scp '10.30.170.112:/tmp/karaf-0.22.0-SNAPSHOT/data/log/*.log' gclogs-1/ Warning: Permanently added '10.30.170.112' (ECDSA) to the list of known hosts. scp: /tmp/karaf-0.22.0-SNAPSHOT/data/log/*.log: No such file or directory + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_2_IP + echo 'Compressing karaf.log 2' Compressing karaf.log 2 + ssh 10.30.171.173 gzip --best /tmp/karaf-0.22.0-SNAPSHOT/data/log/karaf.log Warning: Permanently added '10.30.171.173' (ECDSA) to the list of known hosts. + echo 'Fetching compressed karaf.log 2' Fetching compressed karaf.log 2 + scp 10.30.171.173:/tmp/karaf-0.22.0-SNAPSHOT/data/log/karaf.log.gz odl2_karaf.log.gz Warning: Permanently added '10.30.171.173' (ECDSA) to the list of known hosts. + ssh 10.30.171.173 rm -f /tmp/karaf-0.22.0-SNAPSHOT/data/log/karaf.log.gz Warning: Permanently added '10.30.171.173' (ECDSA) to the list of known hosts. + scp 10.30.171.173:/tmp/karaf-0.22.0-SNAPSHOT/data/log/karaf_console.log odl2_karaf_console.log Warning: Permanently added '10.30.171.173' (ECDSA) to the list of known hosts. + ssh 10.30.171.173 rm -f /tmp/karaf-0.22.0-SNAPSHOT/data/log/karaf_console.log Warning: Permanently added '10.30.171.173' (ECDSA) to the list of known hosts. + echo 'Fetch GC logs' Fetch GC logs + mkdir -p gclogs-2 + scp '10.30.171.173:/tmp/karaf-0.22.0-SNAPSHOT/data/log/*.log' gclogs-2/ Warning: Permanently added '10.30.171.173' (ECDSA) to the list of known hosts. scp: /tmp/karaf-0.22.0-SNAPSHOT/data/log/*.log: No such file or directory + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_3_IP + echo 'Compressing karaf.log 3' Compressing karaf.log 3 + ssh 10.30.171.202 gzip --best /tmp/karaf-0.22.0-SNAPSHOT/data/log/karaf.log Warning: Permanently added '10.30.171.202' (ECDSA) to the list of known hosts. + echo 'Fetching compressed karaf.log 3' Fetching compressed karaf.log 3 + scp 10.30.171.202:/tmp/karaf-0.22.0-SNAPSHOT/data/log/karaf.log.gz odl3_karaf.log.gz Warning: Permanently added '10.30.171.202' (ECDSA) to the list of known hosts. + ssh 10.30.171.202 rm -f /tmp/karaf-0.22.0-SNAPSHOT/data/log/karaf.log.gz Warning: Permanently added '10.30.171.202' (ECDSA) to the list of known hosts. + scp 10.30.171.202:/tmp/karaf-0.22.0-SNAPSHOT/data/log/karaf_console.log odl3_karaf_console.log Warning: Permanently added '10.30.171.202' (ECDSA) to the list of known hosts. + ssh 10.30.171.202 rm -f /tmp/karaf-0.22.0-SNAPSHOT/data/log/karaf_console.log Warning: Permanently added '10.30.171.202' (ECDSA) to the list of known hosts. + echo 'Fetch GC logs' Fetch GC logs + mkdir -p gclogs-3 + scp '10.30.171.202:/tmp/karaf-0.22.0-SNAPSHOT/data/log/*.log' gclogs-3/ Warning: Permanently added '10.30.171.202' (ECDSA) to the list of known hosts. scp: /tmp/karaf-0.22.0-SNAPSHOT/data/log/*.log: No such file or directory + echo 'Examine copied files' Examine copied files + ls -lt total 75020 drwxrwxr-x. 2 jenkins jenkins 6 Jul 7 04:43 gclogs-3 -rw-rw-r--. 1 jenkins jenkins 196208 Jul 7 04:43 odl3_karaf_console.log -rw-rw-r--. 1 jenkins jenkins 542812 Jul 7 04:43 odl3_karaf.log.gz drwxrwxr-x. 2 jenkins jenkins 6 Jul 7 04:43 gclogs-2 -rw-rw-r--. 1 jenkins jenkins 1720 Jul 7 04:43 odl2_karaf_console.log -rw-rw-r--. 1 jenkins jenkins 1526441 Jul 7 04:43 odl2_karaf.log.gz drwxrwxr-x. 2 jenkins jenkins 6 Jul 7 04:43 gclogs-1 -rw-rw-r--. 1 jenkins jenkins 1720 Jul 7 04:43 odl1_karaf_console.log -rw-rw-r--. 1 jenkins jenkins 1269876 Jul 7 04:43 odl1_karaf.log.gz -rw-rw-r--. 1 jenkins jenkins 170909 Jul 7 04:43 karaf_3_2087_threads_after.log -rw-rw-r--. 1 jenkins jenkins 13524 Jul 7 04:43 ps_after.log -rw-rw-r--. 1 jenkins jenkins 146041 Jul 7 04:43 karaf_2_38695_threads_after.log -rw-rw-r--. 1 jenkins jenkins 151867 Jul 7 04:43 karaf_1_29714_threads_after.log -rw-rw-r--. 1 jenkins jenkins 308777 Jul 7 04:43 report.html -rw-rw-r--. 1 jenkins jenkins 3846220 Jul 7 04:43 log.html -rw-rw-r--. 1 jenkins jenkins 68124032 Jul 7 04:43 output.xml -rw-rw-r--. 1 jenkins jenkins 6069 Jul 6 22:59 testplan.txt -rw-rw-r--. 1 jenkins jenkins 134749 Jul 6 22:59 karaf_3_2087_threads_before.log -rw-rw-r--. 1 jenkins jenkins 13979 Jul 6 22:59 ps_before.log -rw-rw-r--. 1 jenkins jenkins 134963 Jul 6 22:59 karaf_2_2076_threads_before.log -rw-rw-r--. 1 jenkins jenkins 137306 Jul 6 22:59 karaf_1_2084_threads_before.log -rw-rw-r--. 1 jenkins jenkins 3106 Jul 6 22:56 post-startup-script.sh -rw-rw-r--. 1 jenkins jenkins 252 Jul 6 22:56 startup-script.sh -rw-rw-r--. 1 jenkins jenkins 3457 Jul 6 22:56 configuration-script.sh -rw-rw-r--. 1 jenkins jenkins 695 Jul 6 22:56 custom_shard_config.txt -rw-rw-r--. 1 jenkins jenkins 136 Jul 6 22:56 scriptplan.txt -rw-rw-r--. 1 jenkins jenkins 333 Jul 6 22:55 detect_variables.env -rw-rw-r--. 1 jenkins jenkins 2619 Jul 6 22:55 pom.xml -rw-rw-r--. 1 jenkins jenkins 92 Jul 6 22:55 set_variables.env -rw-rw-r--. 1 jenkins jenkins 314 Jul 6 22:55 slave_addresses.txt -rw-rw-r--. 1 jenkins jenkins 570 Jul 6 22:55 requirements.txt -rw-rw-r--. 1 jenkins jenkins 26 Jul 6 22:55 env.properties -rw-rw-r--. 1 jenkins jenkins 333 Jul 6 22:53 stack-parameters.yaml drwxrwxr-x. 7 jenkins jenkins 4096 Jul 6 22:52 test drwxrwxr-x. 2 jenkins jenkins 6 Jul 6 22:52 test@tmp -rw-rw-r--. 1 jenkins jenkins 1398 Jul 6 17:52 maven-metadata.xml + true [controller-csit-3node-clustering-tell-all-titanium] $ /bin/sh /tmp/jenkins10516530058138823151.sh Cleaning up Robot installation... $ ssh-agent -k unset SSH_AUTH_SOCK; unset SSH_AGENT_PID; echo Agent pid 5299 killed; [ssh-agent] Stopped. Recording plot data Robot results publisher started... INFO: Checking test criticality is deprecated and will be dropped in a future release! -Parsing output xml: Done! -Copying log files to build dir: Done! -Assigning results to build: Done! -Checking thresholds: Done! Done publishing Robot results. Build step 'Publish Robot Framework test results' changed build result to UNSTABLE [PostBuildScript] - [INFO] Executing post build scripts. [controller-csit-3node-clustering-tell-all-titanium] $ /bin/bash /tmp/jenkins1793849632911409872.sh Archiving csit artifacts mv: cannot stat '*_1.png': No such file or directory mv: cannot stat '/tmp/odl1_*': No such file or directory mv: cannot stat '*_2.png': No such file or directory mv: cannot stat '/tmp/odl2_*': No such file or directory mv: cannot stat '*_3.png': No such file or directory mv: cannot stat '/tmp/odl3_*': No such file or directory % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 3400k 0 3400k 0 0 4197k 0 --:--:-- --:--:-- --:--:-- 4192k 100 5415k 0 5415k 0 0 4512k 0 --:--:-- 0:00:01 --:--:-- 4512k Archive: robot-plugin.zip inflating: ./archives/robot-plugin/log.html inflating: ./archives/robot-plugin/output.xml inflating: ./archives/robot-plugin/report.html mv: cannot stat '*.log.gz': No such file or directory mv: cannot stat '*.csv': No such file or directory mv: cannot stat '*.png': No such file or directory [PostBuildScript] - [INFO] Executing post build scripts. [controller-csit-3node-clustering-tell-all-titanium] $ /bin/bash /tmp/jenkins5787475098194889365.sh [PostBuildScript] - [INFO] Executing post build scripts. [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content OS_CLOUD=vex OS_STACK_NAME=releng-controller-csit-3node-clustering-tell-all-titanium-43 [EnvInject] - Variables injected successfully. provisioning config files... copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml [controller-csit-3node-clustering-tell-all-titanium] $ /bin/bash /tmp/jenkins7076703593250193626.sh ---> openstack-stack-delete.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-titanium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-CBnI from file:/tmp/.os_lf_venv ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. lftools 0.37.13 requires urllib3<2.1.0, but you have urllib3 2.5.0 which is incompatible. lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes python-heatclient python-openstackclient lf-activate-venv(): INFO: Adding /tmp/venv-CBnI/bin to PATH INFO: Retrieving stack cost for: releng-controller-csit-3node-clustering-tell-all-titanium-43 DEBUG: Successfully retrieved stack cost: total: 1.98 INFO: Deleting stack releng-controller-csit-3node-clustering-tell-all-titanium-43 Successfully deleted stack releng-controller-csit-3node-clustering-tell-all-titanium-43 [PostBuildScript] - [INFO] Executing post build scripts. [controller-csit-3node-clustering-tell-all-titanium] $ /bin/bash /tmp/jenkins13763489684159999528.sh ---> sysstat.sh [controller-csit-3node-clustering-tell-all-titanium] $ /bin/bash /tmp/jenkins10443254170593512844.sh ---> package-listing.sh ++ tr '[:upper:]' '[:lower:]' ++ facter osfamily + OS_FAMILY=redhat + workspace=/w/workspace/controller-csit-3node-clustering-tell-all-titanium + START_PACKAGES=/tmp/packages_start.txt + END_PACKAGES=/tmp/packages_end.txt + DIFF_PACKAGES=/tmp/packages_diff.txt + PACKAGES=/tmp/packages_start.txt + '[' /w/workspace/controller-csit-3node-clustering-tell-all-titanium ']' + PACKAGES=/tmp/packages_end.txt + case "${OS_FAMILY}" in + rpm -qa + sort + '[' -f /tmp/packages_start.txt ']' + '[' -f /tmp/packages_end.txt ']' + diff /tmp/packages_start.txt /tmp/packages_end.txt + '[' /w/workspace/controller-csit-3node-clustering-tell-all-titanium ']' + mkdir -p /w/workspace/controller-csit-3node-clustering-tell-all-titanium/archives/ + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/controller-csit-3node-clustering-tell-all-titanium/archives/ [controller-csit-3node-clustering-tell-all-titanium] $ /bin/bash /tmp/jenkins11189783961714475240.sh ---> capture-instance-metadata.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-titanium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-CBnI from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools lf-activate-venv(): INFO: Adding /tmp/venv-CBnI/bin to PATH INFO: Running in OpenStack, capturing instance metadata [controller-csit-3node-clustering-tell-all-titanium] $ /bin/bash /tmp/jenkins1968835372898609308.sh provisioning config files... Could not find credentials [logs] for controller-csit-3node-clustering-tell-all-titanium #43 copy managed file [jenkins-log-archives-settings] to file:/w/workspace/controller-csit-3node-clustering-tell-all-titanium@tmp/config16000230252841357113tmp Regular expression run condition: Expression=[^.*logs-s3.*], Label=[odl-logs-s3-cloudfront-index] Run condition [Regular expression match] enabling perform for step [Provide Configuration files] provisioning config files... copy managed file [jenkins-s3-log-ship] to file:/home/jenkins/.aws/credentials [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content SERVER_ID=logs [EnvInject] - Variables injected successfully. [controller-csit-3node-clustering-tell-all-titanium] $ /bin/bash /tmp/jenkins5452643182771581843.sh ---> create-netrc.sh WARN: Log server credential not found. [controller-csit-3node-clustering-tell-all-titanium] $ /bin/bash /tmp/jenkins16536430806016657546.sh ---> python-tools-install.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-titanium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-CBnI from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools lf-activate-venv(): INFO: Adding /tmp/venv-CBnI/bin to PATH [controller-csit-3node-clustering-tell-all-titanium] $ /bin/bash /tmp/jenkins158969734781515294.sh ---> sudo-logs.sh Archiving 'sudo' log.. [controller-csit-3node-clustering-tell-all-titanium] $ /bin/bash /tmp/jenkins7868120940317984749.sh ---> job-cost.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-titanium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-CBnI from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 lf-activate-venv(): INFO: Adding /tmp/venv-CBnI/bin to PATH DEBUG: total: 1.98 INFO: Retrieving Stack Cost... INFO: Retrieving Pricing Info for: v3-standard-2 INFO: Archiving Costs [controller-csit-3node-clustering-tell-all-titanium] $ /bin/bash -l /tmp/jenkins7874743040169601112.sh ---> logs-deploy.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-titanium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-CBnI from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools lf-activate-venv(): INFO: Adding /tmp/venv-CBnI/bin to PATH WARNING: Nexus logging server not set INFO: S3 path logs/releng/vex-yul-odl-jenkins-1/controller-csit-3node-clustering-tell-all-titanium/43/ INFO: archiving logs to S3 ---> uname -a: Linux prd-centos8-robot-2c-8g-40228.novalocal 4.18.0-553.5.1.el8.x86_64 #1 SMP Tue May 21 05:46:01 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux ---> lscpu: Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Byte Order: Little Endian CPU(s): 2 On-line CPU(s) list: 0,1 Thread(s) per core: 1 Core(s) per socket: 1 Socket(s): 2 NUMA node(s): 1 Vendor ID: AuthenticAMD CPU family: 23 Model: 49 Model name: AMD EPYC-Rome Processor Stepping: 0 CPU MHz: 2799.998 BogoMIPS: 5599.99 Virtualization: AMD-V Hypervisor vendor: KVM Virtualization type: full L1d cache: 32K L1i cache: 32K L2 cache: 512K L3 cache: 16384K NUMA node0 CPU(s): 0,1 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities ---> nproc: 2 ---> df -h: Filesystem Size Used Avail Use% Mounted on devtmpfs 3.8G 0 3.8G 0% /dev tmpfs 3.8G 0 3.8G 0% /dev/shm tmpfs 3.8G 17M 3.8G 1% /run tmpfs 3.8G 0 3.8G 0% /sys/fs/cgroup /dev/vda1 40G 8.4G 32G 22% / tmpfs 770M 0 770M 0% /run/user/1001 ---> free -m: total used free shared buff/cache available Mem: 7697 642 4712 19 2342 6756 Swap: 1023 0 1023 ---> ip addr: 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever inet6 ::1/128 scope host valid_lft forever preferred_lft forever 2: eth0: mtu 1458 qdisc mq state UP group default qlen 1000 link/ether fa:16:3e:d5:61:e0 brd ff:ff:ff:ff:ff:ff altname enp0s3 altname ens3 inet 10.30.170.55/23 brd 10.30.171.255 scope global dynamic noprefixroute eth0 valid_lft 65156sec preferred_lft 65156sec inet6 fe80::f816:3eff:fed5:61e0/64 scope link valid_lft forever preferred_lft forever ---> sar -b -r -n DEV: Linux 4.18.0-553.5.1.el8.x86_64 (prd-centos8-robot-2c-8g-40228.novalocal) 07/07/2025 _x86_64_ (2 CPU) 12:00:01 AM tps rtps wtps bread/s bwrtn/s 12:01:01 AM 0.98 0.00 0.98 0.00 196.62 12:02:01 AM 0.57 0.00 0.57 0.00 8.25 12:03:01 AM 0.22 0.00 0.22 0.00 3.37 12:04:01 AM 0.22 0.00 0.22 0.00 4.00 12:05:01 AM 0.23 0.00 0.23 0.00 21.66 12:06:01 AM 0.28 0.00 0.28 0.00 15.99 12:07:01 AM 0.18 0.00 0.18 0.00 16.33 12:08:01 AM 0.43 0.07 0.37 7.60 18.76 12:09:01 AM 0.27 0.00 0.27 0.00 18.29 12:10:01 AM 0.13 0.00 0.13 0.00 13.46 12:11:01 AM 0.27 0.00 0.27 0.00 3.90 12:12:01 AM 0.45 0.00 0.45 0.00 8.51 12:13:01 AM 0.22 0.00 0.22 0.00 3.57 12:14:01 AM 0.18 0.00 0.18 0.00 13.35 12:15:01 AM 0.10 0.00 0.10 0.00 7.20 12:16:01 AM 0.15 0.00 0.15 0.00 16.28 12:17:01 AM 0.38 0.00 0.38 0.00 21.68 12:18:01 AM 0.25 0.00 0.25 0.00 10.30 12:19:01 AM 0.18 0.00 0.18 0.00 17.41 12:20:01 AM 0.23 0.00 0.23 0.00 26.18 12:21:01 AM 0.28 0.00 0.28 0.00 10.58 12:22:01 AM 0.42 0.00 0.42 0.00 5.25 12:23:01 AM 0.48 0.00 0.48 0.00 8.55 12:24:01 AM 0.17 0.00 0.17 0.00 2.90 12:25:01 AM 0.30 0.00 0.30 0.00 4.50 12:26:01 AM 0.15 0.00 0.15 0.00 4.18 12:27:01 AM 0.22 0.00 0.22 0.00 2.25 12:28:01 AM 0.28 0.00 0.28 0.00 10.60 12:29:01 AM 0.22 0.00 0.22 0.00 4.40 12:30:01 AM 0.13 0.00 0.13 0.00 3.72 12:31:01 AM 0.13 0.00 0.13 0.00 1.08 12:32:01 AM 0.35 0.00 0.35 0.00 6.61 12:33:01 AM 0.35 0.00 0.35 0.00 22.23 12:34:01 AM 0.20 0.00 0.20 0.00 16.54 12:35:01 AM 0.13 0.00 0.13 0.00 9.08 12:36:01 AM 0.18 0.00 0.18 0.00 16.56 12:37:01 AM 0.23 0.00 0.23 0.00 17.28 12:38:01 AM 0.33 0.00 0.33 0.00 15.63 12:39:01 AM 0.40 0.00 0.40 0.00 7.91 12:40:01 AM 0.15 0.00 0.15 0.00 9.47 12:41:01 AM 0.27 0.00 0.27 0.00 10.60 12:42:01 AM 0.35 0.00 0.35 0.00 19.43 12:43:01 AM 0.25 0.00 0.25 0.00 18.56 12:44:01 AM 0.15 0.00 0.15 0.00 8.02 12:45:01 AM 0.17 0.00 0.17 0.00 16.28 12:46:02 AM 0.15 0.00 0.15 0.00 14.83 12:47:01 AM 0.32 0.00 0.32 0.00 12.54 12:48:01 AM 0.22 0.00 0.22 0.00 12.33 12:49:01 AM 0.25 0.00 0.25 0.00 17.73 12:50:01 AM 0.28 0.00 0.28 0.00 14.93 12:51:01 AM 0.18 0.00 0.18 0.00 15.26 12:52:01 AM 0.22 0.00 0.22 0.00 12.60 12:53:01 AM 0.28 0.00 0.28 0.00 17.39 12:54:01 AM 0.18 0.00 0.18 0.00 23.63 12:55:01 AM 0.15 0.00 0.15 0.00 3.90 12:56:01 AM 0.25 0.00 0.25 0.00 3.45 12:57:01 AM 0.40 0.00 0.40 0.00 8.02 12:58:01 AM 0.20 0.00 0.20 0.00 4.27 12:59:01 AM 0.12 0.00 0.12 0.00 0.78 01:00:01 AM 0.13 0.00 0.13 0.00 3.35 01:01:01 AM 0.18 0.00 0.18 0.00 1.90 01:02:01 AM 0.38 0.00 0.38 0.00 12.77 01:03:01 AM 0.30 0.00 0.30 0.00 6.58 01:04:01 AM 0.12 0.00 0.12 0.00 1.17 01:05:01 AM 0.12 0.00 0.12 0.00 3.20 01:06:01 AM 0.17 0.00 0.17 0.00 10.28 01:07:01 AM 0.18 0.00 0.18 0.00 16.08 01:08:01 AM 0.37 0.00 0.37 0.00 20.58 01:09:01 AM 0.28 0.00 0.28 0.00 14.13 01:10:01 AM 0.15 0.00 0.15 0.00 14.13 01:11:01 AM 0.17 0.00 0.17 0.00 16.29 01:12:01 AM 0.20 0.00 0.20 0.00 7.51 01:13:01 AM 0.28 0.00 0.28 0.00 13.13 01:14:01 AM 0.13 0.00 0.13 0.00 6.28 01:15:01 AM 0.23 0.00 0.23 0.00 17.73 01:16:01 AM 0.18 0.00 0.18 0.00 11.75 01:17:01 AM 0.20 0.00 0.20 0.00 17.03 01:18:01 AM 0.28 0.00 0.28 0.00 18.46 01:19:01 AM 0.17 0.00 0.17 0.00 14.28 01:20:01 AM 0.30 0.00 0.30 0.00 25.84 01:21:01 AM 0.17 0.00 0.17 0.00 4.30 01:22:01 AM 0.30 0.00 0.30 0.00 4.70 01:23:01 AM 0.35 0.00 0.35 0.00 7.63 01:24:01 AM 0.83 0.00 0.83 0.00 13.26 01:25:01 AM 0.10 0.00 0.10 0.00 0.65 01:26:01 AM 0.12 0.00 0.12 0.00 3.58 01:27:01 AM 0.28 0.00 0.28 0.00 4.88 01:28:01 AM 0.33 0.00 0.33 0.00 11.20 01:29:01 AM 0.18 0.00 0.18 0.00 4.43 01:30:01 AM 0.15 0.00 0.15 0.00 1.45 01:31:01 AM 0.13 0.00 0.13 0.00 1.08 01:32:01 AM 0.23 0.00 0.23 0.00 6.25 01:33:01 AM 0.23 0.00 0.23 0.00 3.73 01:34:01 AM 0.17 0.00 0.17 0.00 4.65 01:35:01 AM 0.30 0.00 0.30 0.00 5.32 01:36:01 AM 0.22 0.00 0.22 0.00 5.51 01:37:01 AM 0.18 0.00 0.18 0.00 1.92 01:38:01 AM 0.22 0.00 0.22 0.00 6.03 01:39:01 AM 0.20 0.00 0.20 0.00 2.92 01:40:01 AM 0.17 0.00 0.17 0.00 4.78 01:41:01 AM 0.25 0.00 0.25 0.00 3.05 01:42:01 AM 0.35 0.00 0.35 0.00 7.41 01:43:01 AM 0.35 0.00 0.35 0.00 4.83 01:44:01 AM 0.17 0.00 0.17 0.00 4.65 01:45:01 AM 0.17 0.00 0.17 0.00 18.16 01:46:01 AM 0.17 0.00 0.17 0.00 9.27 01:47:01 AM 0.23 0.00 0.23 0.00 17.28 01:48:01 AM 0.22 0.00 0.22 0.00 16.96 01:49:01 AM 0.15 0.00 0.15 0.00 15.33 01:50:01 AM 0.13 0.00 0.13 0.00 8.30 01:51:01 AM 0.27 0.00 0.27 0.00 10.56 01:52:01 AM 0.27 0.00 0.27 0.00 7.17 01:53:01 AM 0.29 0.00 0.29 0.00 4.08 01:54:01 AM 0.13 0.00 0.13 0.00 4.15 01:55:01 AM 0.15 0.00 0.15 0.00 1.45 01:56:01 AM 0.13 0.00 0.13 0.00 4.00 01:57:01 AM 0.45 0.00 0.45 0.00 4.90 01:58:01 AM 0.37 0.00 0.37 0.00 8.42 01:59:01 AM 0.50 0.00 0.50 0.00 6.55 02:00:01 AM 0.22 0.00 0.22 0.00 5.58 02:01:01 AM 0.18 0.00 0.18 0.00 1.90 02:02:01 AM 0.35 0.00 0.35 0.00 9.11 02:03:01 AM 0.30 0.00 0.30 0.00 4.70 02:04:01 AM 0.13 0.00 0.13 0.00 4.52 02:05:01 AM 0.15 0.00 0.15 0.00 12.53 02:06:01 AM 0.22 0.00 0.22 0.00 10.35 02:07:01 AM 0.37 0.00 0.37 0.00 23.16 02:08:01 AM 0.18 0.00 0.18 0.00 9.97 02:09:01 AM 0.17 0.00 0.17 0.00 16.68 02:10:01 AM 0.15 0.00 0.15 0.00 16.13 02:11:01 AM 0.25 0.00 0.25 0.00 8.70 02:12:01 AM 0.28 0.00 0.28 0.00 7.65 02:13:01 AM 0.23 0.00 0.23 0.00 3.50 02:14:01 AM 0.18 0.00 0.18 0.00 4.42 02:15:01 AM 0.12 0.00 0.12 0.00 1.17 02:16:01 AM 0.17 0.00 0.17 0.00 4.42 02:17:01 AM 0.40 0.00 0.40 0.00 4.30 02:18:01 AM 0.40 0.00 0.40 0.00 10.33 02:19:01 AM 0.15 0.00 0.15 0.00 1.22 02:20:01 AM 0.15 0.00 0.15 0.00 4.55 02:21:01 AM 0.17 0.00 0.17 0.00 1.60 02:22:01 AM 0.20 0.00 0.20 0.00 5.52 02:23:01 AM 0.27 0.00 0.27 0.00 4.05 02:24:01 AM 0.13 0.00 0.13 0.00 4.52 02:25:01 AM 0.25 0.00 0.25 0.00 11.10 02:26:01 AM 0.47 0.00 0.47 0.00 22.39 02:27:01 AM 0.45 0.00 0.45 0.00 15.51 02:28:01 AM 0.35 0.00 0.35 0.00 18.41 02:29:01 AM 0.17 0.00 0.17 0.00 12.03 02:30:01 AM 0.22 0.00 0.22 0.00 17.64 02:31:01 AM 0.93 0.00 0.93 0.00 20.73 02:32:01 AM 0.58 0.00 0.58 0.00 9.52 02:33:01 AM 0.47 0.00 0.47 0.00 8.93 02:34:01 AM 0.35 0.00 0.35 0.00 3.85 02:35:01 AM 0.38 0.00 0.38 0.00 4.30 02:36:01 AM 0.37 0.00 0.37 0.00 7.11 02:37:01 AM 0.48 0.00 0.48 0.00 7.15 02:38:01 AM 0.47 0.00 0.47 0.00 9.28 02:39:01 AM 0.35 0.00 0.35 0.00 3.45 02:40:01 AM 0.20 0.00 0.20 0.00 5.83 02:41:01 AM 0.18 0.00 0.18 0.00 1.78 02:42:01 AM 0.37 0.00 0.37 0.00 9.30 02:43:01 AM 0.15 0.00 0.15 0.00 1.85 02:44:01 AM 0.13 0.00 0.13 0.00 9.07 02:45:01 AM 0.12 0.00 0.12 0.00 6.28 02:46:01 AM 0.32 0.00 0.32 0.00 19.28 02:47:01 AM 0.23 0.00 0.23 0.00 18.04 02:48:01 AM 0.23 0.00 0.23 0.00 11.01 02:49:01 AM 0.23 0.00 0.23 0.00 15.51 02:50:01 AM 0.15 0.00 0.15 0.00 17.20 02:51:01 AM 0.22 0.00 0.22 0.00 26.39 02:52:01 AM 0.33 0.00 0.33 0.00 7.95 02:53:01 AM 0.27 0.00 0.27 0.00 4.20 02:54:01 AM 0.23 0.00 0.23 0.00 5.50 02:55:01 AM 0.17 0.00 0.17 0.00 2.02 02:56:01 AM 0.10 0.00 0.10 0.00 0.82 02:57:01 AM 0.23 0.00 0.23 0.00 5.15 02:58:01 AM 0.20 0.00 0.20 0.00 3.07 02:59:01 AM 0.15 0.00 0.15 0.00 6.70 03:00:01 AM 0.13 0.00 0.13 0.00 4.95 03:01:02 AM 0.30 0.00 0.30 0.00 3.52 03:02:01 AM 0.25 0.00 0.25 0.00 3.74 03:03:01 AM 0.37 0.00 0.37 0.00 16.03 03:04:01 AM 0.22 0.00 0.22 0.00 16.98 03:05:01 AM 0.13 0.00 0.13 0.00 8.92 03:06:01 AM 0.13 0.00 0.13 0.00 15.99 03:07:01 AM 0.20 0.00 0.20 0.00 16.46 03:08:01 AM 0.23 0.00 0.23 0.00 13.10 03:09:01 AM 0.15 0.00 0.15 0.00 11.86 03:10:01 AM 0.13 0.00 0.13 0.00 4.40 03:11:01 AM 0.28 0.00 0.28 0.00 15.18 03:12:01 AM 0.30 0.00 0.30 0.00 11.85 03:13:01 AM 0.35 0.00 0.35 0.00 22.18 03:14:01 AM 0.73 0.00 0.73 0.00 23.04 03:15:01 AM 0.33 0.00 0.33 0.00 13.76 03:16:01 AM 0.23 0.00 0.23 0.00 16.70 03:17:01 AM 0.17 0.00 0.17 0.00 9.13 03:18:01 AM 0.23 0.00 0.23 0.00 12.43 03:19:01 AM 0.17 0.00 0.17 0.00 9.90 03:20:01 AM 0.13 0.00 0.13 0.00 16.39 03:21:01 AM 0.18 0.00 0.18 0.00 15.13 03:22:01 AM 0.43 0.00 0.43 0.00 17.96 03:23:01 AM 0.28 0.00 0.28 0.00 13.50 03:24:01 AM 0.13 0.00 0.13 0.00 16.01 03:25:01 AM 0.35 0.00 0.35 0.00 26.01 03:26:01 AM 0.32 0.00 0.32 0.00 3.57 03:27:01 AM 0.40 0.00 0.40 0.00 4.73 03:28:01 AM 0.30 0.00 0.30 0.00 7.63 03:29:01 AM 0.12 0.00 0.12 0.00 0.90 03:30:01 AM 0.13 0.00 0.13 0.00 3.73 03:31:01 AM 0.33 0.00 0.33 0.00 5.55 03:32:01 AM 0.17 0.00 0.17 0.00 6.97 03:33:01 AM 0.25 0.00 0.25 0.00 5.50 03:34:01 AM 0.17 0.00 0.17 0.00 7.10 03:35:01 AM 0.13 0.00 0.13 0.00 0.92 03:36:01 AM 0.12 0.00 0.12 0.00 2.82 03:37:01 AM 0.20 0.00 0.20 0.00 3.67 03:38:01 AM 0.25 0.00 0.25 0.00 6.97 03:39:01 AM 0.23 0.00 0.23 0.00 4.55 03:40:01 AM 0.37 0.00 0.37 0.00 9.05 03:41:01 AM 0.42 0.00 0.42 0.00 9.10 03:42:01 AM 0.48 0.00 0.48 0.00 12.96 03:43:01 AM 0.63 0.00 0.63 0.00 19.75 03:44:01 AM 0.57 0.00 0.57 0.00 18.46 03:45:01 AM 0.27 0.00 0.27 0.00 9.45 03:46:01 AM 0.27 0.00 0.27 0.00 19.99 03:47:01 AM 0.22 0.00 0.22 0.00 9.80 03:48:01 AM 0.22 0.00 0.22 0.00 25.76 03:49:01 AM 0.18 0.00 0.18 0.00 13.21 03:50:01 AM 0.27 0.00 0.27 0.00 15.19 03:51:01 AM 0.27 0.00 0.27 0.00 11.08 03:52:01 AM 0.43 0.00 0.43 0.00 15.68 03:53:01 AM 0.30 0.00 0.30 0.00 12.50 03:54:01 AM 0.13 0.00 0.13 0.00 7.23 03:55:01 AM 0.17 0.00 0.17 0.00 11.90 03:56:01 AM 0.17 0.00 0.17 0.00 7.48 03:57:01 AM 0.32 0.00 0.32 0.00 7.95 03:58:01 AM 0.12 0.00 0.12 0.00 5.93 03:59:01 AM 0.13 0.00 0.13 0.00 3.07 04:00:01 AM 0.30 0.00 0.30 0.00 13.01 04:01:01 AM 0.63 0.00 0.63 0.00 20.11 04:02:01 AM 0.40 0.00 0.40 0.00 17.54 04:03:01 AM 0.57 0.00 0.57 0.00 19.23 04:04:01 AM 0.52 0.00 0.52 0.00 17.98 04:05:01 AM 0.53 0.00 0.53 0.00 17.38 04:06:01 AM 0.47 0.00 0.47 0.00 15.53 04:07:01 AM 0.42 0.00 0.42 0.00 24.71 04:08:01 AM 0.40 0.00 0.40 0.00 8.26 04:09:02 AM 0.35 0.00 0.35 0.00 3.60 04:10:01 AM 0.31 0.00 0.31 0.00 5.74 04:11:01 AM 0.43 0.00 0.43 0.00 5.41 04:12:01 AM 0.38 0.00 0.38 0.00 6.88 04:13:01 AM 0.25 0.00 0.25 0.00 3.60 04:14:01 AM 0.27 0.00 0.27 0.00 7.35 04:15:01 AM 0.17 0.00 0.17 0.00 3.08 04:16:01 AM 0.13 0.00 0.13 0.00 7.15 04:17:01 AM 0.30 0.00 0.30 0.00 4.75 04:18:01 AM 0.27 0.00 0.27 0.00 5.27 04:19:01 AM 0.17 0.00 0.17 0.00 1.50 04:20:01 AM 0.13 0.00 0.13 0.00 3.28 04:21:01 AM 1.22 0.00 1.22 0.00 24.86 04:22:01 AM 0.18 0.00 0.18 0.00 2.15 04:23:01 AM 0.35 0.00 0.35 0.00 14.43 04:24:01 AM 0.23 0.00 0.23 0.00 12.90 04:25:01 AM 0.35 0.00 0.35 0.00 21.36 04:26:01 AM 0.13 0.00 0.13 0.00 10.81 04:27:01 AM 0.25 0.00 0.25 0.00 17.55 04:28:01 AM 0.23 0.00 0.23 0.00 11.26 04:29:01 AM 0.38 0.00 0.38 0.00 25.36 04:30:01 AM 0.12 0.00 0.12 0.00 11.48 04:31:01 AM 0.27 0.00 0.27 0.00 6.05 04:32:01 AM 0.28 0.00 0.28 0.00 3.78 04:33:01 AM 0.25 0.00 0.25 0.00 6.16 04:34:01 AM 0.12 0.00 0.12 0.00 1.47 04:35:01 AM 0.15 0.00 0.15 0.00 3.78 04:36:01 AM 0.15 0.00 0.15 0.00 1.45 04:37:01 AM 0.18 0.00 0.18 0.00 7.65 04:38:01 AM 0.33 0.00 0.33 0.00 11.25 04:39:01 AM 0.25 0.00 0.25 0.00 13.90 04:40:01 AM 0.22 0.00 0.22 0.00 8.30 04:41:01 AM 0.25 0.00 0.25 0.00 13.80 04:42:01 AM 0.20 0.00 0.20 0.00 15.91 04:43:01 AM 0.28 0.00 0.28 0.00 25.23 04:44:01 AM 1.88 0.22 1.67 12.00 97.35 04:45:01 AM 36.15 0.30 35.85 43.45 4423.56 Average: 0.40 0.00 0.39 0.22 26.54 12:00:01 AM kbmemfree kbavail kbmemused %memused kbbuffers kbcached kbcommit %commit kbactive kbinact kbdirty 12:01:01 AM 4849568 6974904 3032856 38.48 2688 2293188 766232 8.58 272132 2377968 4 12:02:01 AM 4850556 6975904 3031868 38.46 2688 2293200 766232 8.58 272184 2377236 4 12:03:01 AM 4850616 6975996 3031808 38.46 2688 2293240 766232 8.58 272184 2377344 48 12:04:01 AM 4850496 6976140 3031928 38.46 2688 2293504 766232 8.58 272184 2377196 264 12:05:01 AM 4849844 6975872 3032580 38.47 2688 2293896 766232 8.58 272184 2377816 96 12:06:01 AM 4849892 6976296 3032532 38.47 2688 2294272 766232 8.58 272184 2378084 80 12:07:01 AM 4848588 6975376 3033836 38.49 2688 2294648 755632 8.46 272184 2378932 4 12:08:01 AM 4848140 6975680 3034284 38.49 2688 2295404 757592 8.48 272288 2379404 156 12:09:01 AM 4848232 6976148 3034192 38.49 2688 2295780 757592 8.48 272288 2379492 80 12:10:01 AM 4847444 6975668 3034980 38.50 2688 2296084 754340 8.45 272400 2380036 4 12:11:01 AM 4847768 6976056 3034656 38.50 2688 2296160 754340 8.45 272400 2380112 48 12:12:01 AM 4847760 6976056 3034664 38.50 2688 2296168 754340 8.45 272400 2380004 16 12:13:01 AM 4847408 6975868 3035016 38.50 2688 2296324 754340 8.45 272400 2380228 160 12:14:01 AM 4847112 6975820 3035312 38.51 2688 2296580 754340 8.45 272400 2380324 56 12:15:01 AM 4847052 6976136 3035372 38.51 2688 2296956 754340 8.45 272400 2380600 240 12:16:01 AM 4846700 6976164 3035724 38.51 2688 2297336 754340 8.45 272400 2380980 160 12:17:01 AM 4846180 6976020 3036244 38.52 2688 2297712 754340 8.45 272400 2381504 56 12:18:01 AM 4845640 6975856 3036784 38.53 2688 2298088 754340 8.45 272400 2381852 204 12:19:01 AM 4845372 6975968 3037052 38.53 2688 2298468 754340 8.45 272400 2382484 128 12:20:01 AM 4844304 6975628 3038120 38.54 2688 2299196 754340 8.45 272400 2383324 136 12:21:01 AM 4844196 6975652 3038228 38.54 2688 2299320 738800 8.27 272400 2383328 4 12:22:01 AM 4844180 6975636 3038244 38.54 2688 2299320 738800 8.27 272400 2383328 4 12:23:01 AM 4844296 6975832 3038128 38.54 2688 2299400 738800 8.27 272400 2383384 4 12:24:01 AM 4844312 6975852 3038112 38.54 2688 2299404 738800 8.27 272400 2383408 4 12:25:01 AM 4844240 6975780 3038184 38.54 2688 2299412 738800 8.27 272400 2383316 20 12:26:01 AM 4843920 6975528 3038504 38.55 2688 2299472 738800 8.27 272400 2383680 4 12:27:01 AM 4844316 6975928 3038108 38.54 2688 2299476 738800 8.27 272400 2383392 4 12:28:01 AM 4843920 6975724 3038504 38.55 2688 2299668 754552 8.45 272400 2383756 24 12:29:01 AM 4843852 6975760 3038572 38.55 2688 2299772 754552 8.45 272400 2383700 80 12:30:01 AM 4843308 6975216 3039116 38.56 2688 2299772 769936 8.62 272400 2383932 4 12:31:01 AM 4844500 6976460 3037924 38.54 2688 2299824 769936 8.62 272400 2383072 56 12:32:01 AM 4844300 6976480 3038124 38.54 2688 2300052 749248 8.39 272400 2383480 228 12:33:01 AM 4843652 6976200 3038772 38.55 2688 2300420 749248 8.39 272400 2383936 84 12:34:01 AM 4843552 6976488 3038872 38.55 2688 2300808 749248 8.39 272400 2384044 20 12:35:01 AM 4842812 6976128 3039612 38.56 2688 2301188 749248 8.39 272400 2384632 172 12:36:01 AM 4842620 6976316 3039804 38.56 2688 2301568 749248 8.39 272400 2384924 96 12:37:01 AM 4842500 6976580 3039924 38.57 2688 2301944 749248 8.39 272400 2385192 20 12:38:01 AM 4841888 6976304 3040536 38.57 2688 2302280 749248 8.39 272400 2385596 4 12:39:01 AM 4842096 6976632 3040328 38.57 2688 2302400 749248 8.39 272400 2385656 4 12:40:01 AM 4840812 6975636 3041612 38.59 2688 2302696 768224 8.60 272400 2386384 68 12:41:01 AM 4841304 6976512 3041120 38.58 2688 2303080 768224 8.60 272400 2386612 220 12:42:01 AM 4840664 6976256 3041760 38.59 2688 2303456 768224 8.60 272400 2386992 144 12:43:01 AM 4840068 6976028 3042356 38.60 2688 2303832 768224 8.60 272400 2387600 68 12:44:01 AM 4840068 6976392 3042356 38.60 2688 2304196 768224 8.60 272400 2387692 220 12:45:01 AM 4839456 6976164 3042968 38.60 2688 2304572 768224 8.60 272400 2388080 144 12:46:02 AM 4839488 6976472 3042936 38.60 2688 2304848 768224 8.60 272400 2388240 0 12:47:01 AM 4839192 6976424 3043232 38.61 2688 2305096 768224 8.60 272400 2388476 4 12:48:01 AM 4838708 6976304 3043716 38.61 2688 2305468 752108 8.42 272400 2389116 112 12:49:01 AM 4838432 6976404 3043992 38.62 2688 2305844 752108 8.42 272400 2389220 36 12:50:01 AM 4837676 6976028 3044748 38.63 2688 2306224 747304 8.37 272400 2389948 68 12:51:01 AM 4837260 6975988 3045164 38.63 2688 2306600 747304 8.37 272400 2390180 24 12:52:01 AM 4837044 6976160 3045380 38.64 2688 2306980 747304 8.37 272400 2390448 112 12:53:01 AM 4836748 6976232 3045676 38.64 2688 2307356 747304 8.37 272400 2390816 68 12:54:01 AM 4836128 6976220 3046296 38.65 2688 2307956 747304 8.37 272400 2391472 4 12:55:01 AM 4835956 6976120 3046468 38.65 2688 2308028 747304 8.37 272400 2391640 4 12:56:01 AM 4835932 6976096 3046492 38.65 2688 2308028 747304 8.37 272400 2391724 8 12:57:01 AM 4835964 6976208 3046460 38.65 2688 2308108 747304 8.37 272404 2391676 4 12:58:01 AM 4835548 6975796 3046876 38.65 2688 2308112 747304 8.37 272400 2391920 4 12:59:01 AM 4835664 6975984 3046760 38.65 2688 2308184 747304 8.37 272404 2392032 80 01:00:01 AM 4835464 6975784 3046960 38.66 2688 2308184 747384 8.37 272400 2392068 4 01:01:01 AM 4835120 6975616 3047304 38.66 2688 2308360 747384 8.37 272400 2392352 180 01:02:01 AM 4835460 6976012 3046964 38.66 2688 2308416 747384 8.37 272404 2391960 16 01:03:01 AM 4835268 6975888 3047156 38.66 2688 2308484 747384 8.37 272404 2392096 4 01:04:01 AM 4835176 6975796 3047248 38.66 2688 2308484 747384 8.37 272404 2392304 16 01:05:01 AM 4835328 6976008 3047096 38.66 2688 2308544 747384 8.37 272404 2392092 8 01:06:01 AM 4835240 6976332 3047184 38.66 2688 2308964 762896 8.54 272404 2392504 160 01:07:01 AM 4834244 6975724 3048180 38.67 2688 2309344 762896 8.54 272404 2393308 124 01:08:01 AM 4834112 6975960 3048312 38.67 2688 2309720 762896 8.54 272404 2393472 36 01:09:01 AM 4833656 6975884 3048768 38.68 2688 2310096 762896 8.54 272404 2393872 96 01:10:01 AM 4833012 6975620 3049412 38.69 2688 2310476 755948 8.46 272404 2394512 84 01:11:01 AM 4833300 6976288 3049124 38.68 2688 2310852 755948 8.46 272404 2394432 116 01:12:01 AM 4833052 6976236 3049372 38.69 2688 2311040 755948 8.46 272404 2394628 40 01:13:01 AM 4832576 6976008 3049848 38.69 2688 2311288 755948 8.46 272404 2395004 16 01:14:01 AM 4832176 6975956 3050248 38.70 2688 2311636 755948 8.46 272404 2395284 204 01:15:01 AM 4831880 6976032 3050544 38.70 2688 2312016 755948 8.46 272404 2395656 128 01:16:01 AM 4831168 6975696 3051256 38.71 2688 2312392 755948 8.46 272404 2396444 216 01:17:01 AM 4830824 6975728 3051600 38.71 2688 2312768 755948 8.46 272404 2396696 144 01:18:01 AM 4830704 6975988 3051720 38.72 2688 2313148 755948 8.46 272404 2396872 92 01:19:01 AM 4830124 6975784 3052300 38.72 2688 2313524 755948 8.46 272404 2397460 80 01:20:01 AM 4829276 6975556 3053148 38.73 2688 2314136 739240 8.28 272404 2398156 8 01:21:01 AM 4829596 6975968 3052828 38.73 2688 2314228 739240 8.28 272404 2397904 4 01:22:01 AM 4829360 6975732 3053064 38.73 2688 2314228 739240 8.28 272404 2398120 4 01:23:01 AM 4829164 6975624 3053260 38.74 2688 2314316 748240 8.38 281968 2388732 248 01:24:01 AM 4829336 6975796 3053088 38.73 2688 2314316 748240 8.38 281968 2388664 4 01:25:01 AM 4829364 6975892 3053060 38.73 2688 2314384 748240 8.38 281968 2388628 76 01:26:01 AM 4829432 6975964 3052992 38.73 2688 2314388 748240 8.38 281968 2388516 4 01:27:01 AM 4829012 6975688 3053412 38.74 2688 2314532 748240 8.38 281968 2388868 164 01:28:01 AM 4829104 6975860 3053320 38.74 2688 2314612 748240 8.38 281968 2388820 8 01:29:01 AM 4829208 6976040 3053216 38.73 2688 2314688 748240 8.38 281968 2388820 4 01:30:01 AM 4828844 6975676 3053580 38.74 2688 2314688 748996 8.39 281968 2389168 4 01:31:01 AM 4828656 6975564 3053768 38.74 2688 2314764 748996 8.39 281968 2389128 80 01:32:01 AM 4828728 6975636 3053696 38.74 2688 2314764 748996 8.39 281968 2389132 4 01:33:01 AM 4828492 6975476 3053932 38.74 2688 2314840 748996 8.39 281968 2389548 84 01:34:01 AM 4828696 6975684 3053728 38.74 2688 2314844 748996 8.39 281968 2389352 4 01:35:01 AM 4828680 6975748 3053744 38.74 2688 2314924 748996 8.39 281968 2389228 88 01:36:01 AM 4828796 6975864 3053628 38.74 2688 2314924 748996 8.39 281968 2389092 4 01:37:01 AM 4828868 6976024 3053556 38.74 2688 2315012 748996 8.39 281968 2389296 92 01:38:01 AM 4828584 6975740 3053840 38.74 2688 2315012 748996 8.39 281968 2389364 4 01:39:01 AM 4828708 6975944 3053716 38.74 2688 2315092 748996 8.39 281968 2389240 92 01:40:01 AM 4828456 6975696 3053968 38.74 2688 2315096 747480 8.37 281968 2389612 4 01:41:01 AM 4828056 6975376 3054368 38.75 2688 2315176 747480 8.37 281968 2389908 96 01:42:01 AM 4828212 6975532 3054212 38.75 2688 2315176 747480 8.37 281968 2389748 8 01:43:01 AM 4828196 6975520 3054228 38.75 2688 2315180 747480 8.37 281968 2389616 4 01:44:01 AM 4828184 6975764 3054240 38.75 2688 2315444 747480 8.37 281976 2389780 184 01:45:01 AM 4828060 6976016 3054364 38.75 2688 2315820 747480 8.37 281976 2390080 52 01:46:01 AM 4827684 6976024 3054740 38.75 2688 2316200 747480 8.37 281976 2390344 204 01:47:01 AM 4827160 6975876 3055264 38.76 2688 2316576 747480 8.37 281976 2390720 128 01:48:01 AM 4826712 6975804 3055712 38.77 2688 2316952 747480 8.37 281976 2391168 100 01:49:01 AM 4826524 6975996 3055900 38.77 2688 2317332 747480 8.37 281976 2391596 52 01:50:01 AM 4825704 6975544 3056720 38.78 2688 2317692 767280 8.59 281976 2392196 188 01:51:01 AM 4825804 6975804 3056620 38.78 2688 2317848 767280 8.59 281976 2392316 112 01:52:01 AM 4825868 6975868 3056556 38.78 2688 2317848 767280 8.59 281976 2392208 4 01:53:01 AM 4825572 6975572 3056852 38.78 2688 2317848 767280 8.59 281976 2392288 4 01:54:01 AM 4825944 6976040 3056480 38.78 2688 2317944 767280 8.59 281976 2392112 4 01:55:01 AM 4825648 6975744 3056776 38.78 2688 2317944 767280 8.59 281976 2392228 4 01:56:01 AM 4825736 6975924 3056688 38.78 2688 2318036 767280 8.59 281976 2392204 4 01:57:01 AM 4825672 6975868 3056752 38.78 2688 2318044 767280 8.59 281976 2392212 4 01:58:01 AM 4825636 6975924 3056788 38.78 2688 2318136 767280 8.59 281976 2392496 4 01:59:01 AM 4825812 6976100 3056612 38.78 2688 2318136 767280 8.59 281976 2392316 4 02:00:01 AM 4825136 6975520 3057288 38.79 2688 2318232 740688 8.29 281976 2392880 4 02:01:01 AM 4824168 6974556 3058256 38.80 2688 2318236 740688 8.29 281976 2393444 4 02:02:01 AM 4825000 6975484 3057424 38.79 2688 2318332 740688 8.29 281984 2393136 4 02:03:01 AM 4825120 6975604 3057304 38.79 2688 2318332 740688 8.29 281984 2392724 4 02:04:01 AM 4825464 6976056 3056960 38.78 2688 2318440 740688 8.29 281984 2392580 4 02:05:01 AM 4824840 6975828 3057584 38.79 2688 2318844 740688 8.29 281984 2393180 72 02:06:01 AM 4824008 6975376 3058416 38.80 2688 2319220 740688 8.29 281984 2393952 220 02:07:01 AM 4824028 6975780 3058396 38.80 2688 2319596 740688 8.29 281984 2394076 24 02:08:01 AM 4823280 6975404 3059144 38.81 2688 2319976 740688 8.29 281984 2394776 216 02:09:01 AM 4823064 6975572 3059360 38.81 2688 2320352 740688 8.29 281984 2394852 132 02:10:01 AM 4822500 6975376 3059924 38.82 2688 2320728 758592 8.49 281984 2395372 52 02:11:01 AM 4822332 6975464 3060092 38.82 2688 2320976 758592 8.49 281984 2395728 120 02:12:01 AM 4822136 6975268 3060288 38.82 2688 2320976 758592 8.49 281984 2395936 16 02:13:01 AM 4822456 6975684 3059968 38.82 2688 2321072 758592 8.49 281984 2395688 104 02:14:01 AM 4822312 6975540 3060112 38.82 2688 2321072 758592 8.49 281984 2395512 4 02:15:01 AM 4822380 6975608 3060044 38.82 2688 2321072 758592 8.49 281984 2395512 4 02:16:01 AM 4822248 6975572 3060176 38.82 2688 2321168 758592 8.49 281984 2395608 4 02:17:01 AM 4822308 6975632 3060116 38.82 2688 2321168 758592 8.49 281984 2395724 4 02:18:01 AM 4822280 6975696 3060144 38.82 2688 2321260 758592 8.49 281984 2395784 4 02:19:01 AM 4821720 6975140 3060704 38.83 2688 2321264 758592 8.49 281984 2396052 16 02:20:01 AM 4821684 6975196 3060740 38.83 2688 2321356 758592 8.49 281984 2396304 8 02:21:01 AM 4821920 6975432 3060504 38.83 2688 2321356 758592 8.49 281984 2396044 4 02:22:01 AM 4821756 6975364 3060668 38.83 2688 2321452 758592 8.49 281984 2396140 4 02:23:01 AM 4822108 6975716 3060316 38.82 2688 2321452 742544 8.31 281984 2396008 4 02:24:01 AM 4822128 6975844 3060296 38.82 2688 2321560 742544 8.31 281984 2396044 4 02:25:01 AM 4821436 6975580 3060988 38.83 2688 2321992 742544 8.31 281984 2396468 188 02:26:01 AM 4821184 6975704 3061240 38.84 2688 2322368 742544 8.31 281984 2397016 36 02:27:01 AM 4819992 6974888 3062432 38.85 2688 2322744 742544 8.31 281984 2397940 96 02:28:01 AM 4820196 6975480 3062228 38.85 2688 2323124 742544 8.31 281984 2397952 80 02:29:01 AM 4819880 6975532 3062544 38.85 2688 2323500 742544 8.31 281984 2398172 144 02:30:01 AM 4818828 6974856 3063596 38.87 2688 2323876 758292 8.49 281984 2398896 36 02:31:01 AM 4818968 6975236 3063456 38.86 2688 2324108 757784 8.48 282416 2398616 4 02:32:01 AM 4818996 6975264 3063428 38.86 2688 2324108 757784 8.48 282416 2398644 4 02:33:01 AM 4818816 6975176 3063608 38.87 2688 2324200 757784 8.48 282416 2398600 4 02:34:01 AM 4819112 6975476 3063312 38.86 2688 2324204 757784 8.48 282416 2398468 4 02:35:01 AM 4818972 6975432 3063452 38.86 2688 2324300 757784 8.48 282416 2398672 100 02:36:01 AM 4819000 6975460 3063424 38.86 2688 2324300 757784 8.48 282416 2398564 4 02:37:01 AM 4818884 6975348 3063540 38.87 2688 2324304 757784 8.48 282416 2398840 4 02:38:01 AM 4818644 6975200 3063780 38.87 2688 2324396 757784 8.48 282416 2398932 4 02:39:01 AM 4819104 6975660 3063320 38.86 2688 2324396 757784 8.48 282416 2398788 4 02:40:01 AM 4817744 6974396 3064680 38.88 2688 2324492 749924 8.40 282416 2399116 4 02:41:01 AM 4817952 6974604 3064472 38.88 2688 2324492 749924 8.40 282416 2398968 4 02:42:01 AM 4818008 6974756 3064416 38.88 2688 2324588 749924 8.40 282416 2399072 16 02:43:01 AM 4818388 6975136 3064036 38.87 2688 2324588 749924 8.40 282416 2398936 8 02:44:01 AM 4818048 6975048 3064376 38.88 2688 2324840 749924 8.40 282416 2399112 16 02:45:01 AM 4818228 6975552 3064196 38.87 2688 2325172 749924 8.40 282420 2399516 188 02:46:01 AM 4817500 6975204 3064924 38.88 2688 2325548 749924 8.40 282416 2399928 112 02:47:01 AM 4817412 6975492 3065012 38.88 2688 2325924 749924 8.40 282416 2400188 36 02:48:01 AM 4816636 6975096 3065788 38.89 2688 2326304 749924 8.40 282416 2400776 204 02:49:01 AM 4816528 6975364 3065896 38.90 2688 2326680 749924 8.40 282416 2400952 188 02:50:01 AM 4815776 6974988 3066648 38.90 2688 2327056 739696 8.28 282416 2401676 80 02:51:01 AM 4815600 6975456 3066824 38.91 2688 2327692 739696 8.28 282416 2401972 4 02:52:01 AM 4815432 6975376 3066992 38.91 2688 2327780 739696 8.28 282416 2402064 4 02:53:01 AM 4815408 6975356 3067016 38.91 2688 2327784 739696 8.28 282416 2402136 4 02:54:01 AM 4815540 6975568 3066884 38.91 2688 2327864 739696 8.28 282416 2402264 4 02:55:01 AM 4815288 6975316 3067136 38.91 2688 2327864 739696 8.28 282416 2402264 4 02:56:01 AM 4815304 6975412 3067120 38.91 2688 2327944 739696 8.28 282416 2402228 84 02:57:01 AM 4815080 6975188 3067344 38.91 2688 2327944 739696 8.28 282416 2402344 4 02:58:01 AM 4814856 6975092 3067568 38.92 2688 2328080 739696 8.28 282416 2402544 144 02:59:01 AM 4815004 6975328 3067420 38.91 2688 2328160 739696 8.28 282416 2402456 56 03:00:01 AM 4814472 6974868 3067952 38.92 2688 2328232 753980 8.44 282416 2402880 8 03:01:02 AM 4814072 6974468 3068352 38.93 2688 2328232 753980 8.44 282416 2403232 4 03:02:01 AM 4814468 6974932 3067956 38.92 2688 2328300 753980 8.44 282420 2402860 72 03:03:01 AM 4814112 6974912 3068312 38.93 2688 2328644 753980 8.44 282420 2403380 84 03:04:01 AM 4813924 6975100 3068500 38.93 2688 2329020 753980 8.44 282420 2403572 116 03:05:01 AM 4813504 6975060 3068920 38.93 2688 2329400 753980 8.44 282420 2404068 160 03:06:01 AM 4813264 6975200 3069160 38.94 2688 2329776 753980 8.44 282420 2404328 84 03:07:01 AM 4812684 6974988 3069740 38.94 2688 2330136 753980 8.44 282420 2404700 4 03:08:01 AM 4812308 6974984 3070116 38.95 2688 2330516 753980 8.44 282420 2405136 96 03:09:01 AM 4812120 6975040 3070304 38.95 2688 2330752 753980 8.44 282420 2405312 4 03:10:01 AM 4811604 6974636 3070820 38.96 2688 2330864 748368 8.38 282420 2405752 16 03:11:01 AM 4811488 6974908 3070936 38.96 2688 2331256 748368 8.38 282420 2405808 40 03:12:01 AM 4811068 6974884 3071356 38.96 2688 2331652 748368 8.38 282420 2406240 204 03:13:01 AM 4810660 6974856 3071764 38.97 2688 2332032 748368 8.38 282420 2406692 40 03:14:01 AM 4810800 6975372 3071624 38.97 2688 2332408 748368 8.38 282504 2406768 56 03:15:01 AM 4810436 6975396 3071988 38.97 2688 2332784 748368 8.38 282504 2407000 144 03:16:01 AM 4810124 6975456 3072300 38.98 2688 2333164 748368 8.38 282504 2407528 100 03:17:01 AM 4809516 6975172 3072908 38.98 2688 2333484 748368 8.38 282504 2408052 196 03:18:01 AM 4809396 6975244 3073028 38.99 2688 2333680 748368 8.38 282504 2407996 120 03:19:01 AM 4808888 6975120 3073536 38.99 2688 2334064 748368 8.38 282504 2408520 248 03:20:01 AM 4808084 6974684 3074340 39.00 2688 2334424 771716 8.64 282504 2409044 148 03:21:01 AM 4807988 6974972 3074436 39.00 2688 2334804 739696 8.28 282504 2409400 112 03:22:01 AM 4807892 6975252 3074532 39.00 2688 2335180 739696 8.28 282504 2409656 144 03:23:01 AM 4806848 6974560 3075576 39.02 2688 2335540 739696 8.28 282504 2410284 216 03:24:01 AM 4806388 6974616 3076036 39.02 2688 2336048 739696 8.28 282504 2410872 284 03:25:01 AM 4806736 6975388 3075688 39.02 2688 2336472 739696 8.28 282504 2410748 4 03:26:01 AM 4806576 6975228 3075848 39.02 2688 2336472 739696 8.28 282504 2410748 4 03:27:01 AM 4806704 6975368 3075720 39.02 2688 2336484 755144 8.46 282504 2410756 4 03:28:01 AM 4806440 6975172 3075984 39.02 2688 2336552 755144 8.46 282504 2410896 4 03:29:01 AM 4806608 6975340 3075816 39.02 2688 2336552 755144 8.46 282504 2410828 4 03:30:01 AM 4806008 6974824 3076416 39.03 2688 2336636 737944 8.26 282504 2411144 4 03:31:01 AM 4806304 6975120 3076120 39.03 2688 2336636 737944 8.26 282504 2411120 4 03:32:01 AM 4806128 6975116 3076296 39.03 2688 2336808 737944 8.26 282504 2411296 4 03:33:01 AM 4805808 6974860 3076616 39.03 2688 2336872 737944 8.26 282504 2411496 24 03:34:01 AM 4805656 6974844 3076768 39.03 2688 2337008 737944 8.26 282512 2411648 4 03:35:01 AM 4805816 6975004 3076608 39.03 2688 2337008 737944 8.26 282512 2411440 4 03:36:01 AM 4805600 6974884 3076824 39.03 2688 2337104 737944 8.26 282512 2411536 44 03:37:01 AM 4805288 6974644 3077136 39.04 2688 2337176 737944 8.26 282512 2411888 64 03:38:01 AM 4805628 6975072 3076796 39.03 2688 2337264 737944 8.26 282512 2411808 48 03:39:01 AM 4805460 6975056 3076964 39.04 2688 2337416 737944 8.26 282516 2411892 136 03:40:01 AM 4804940 6974536 3077484 39.04 2688 2337416 756544 8.47 282516 2412240 4 03:41:01 AM 4804944 6974680 3077480 39.04 2688 2337556 756544 8.47 282516 2412264 4 03:42:01 AM 4804840 6974832 3077584 39.04 2688 2337820 756544 8.47 282516 2412568 20 03:43:01 AM 4804280 6974656 3078144 39.05 2688 2338204 756544 8.47 282516 2413020 24 03:44:01 AM 4803968 6974728 3078456 39.05 2688 2338588 756544 8.47 282516 2413392 0 03:45:01 AM 4803648 6974788 3078776 39.06 2688 2338968 756544 8.47 282516 2413584 188 03:46:01 AM 4803312 6974836 3079112 39.06 2688 2339352 756544 8.47 282516 2413992 56 03:47:01 AM 4802944 6974852 3079480 39.07 2688 2339736 756544 8.47 282516 2414376 208 03:48:01 AM 4802064 6974672 3080360 39.08 2688 2340424 756544 8.47 282516 2415140 228 03:49:01 AM 4801756 6974588 3080668 39.08 2688 2340648 756544 8.47 282516 2415296 104 03:50:01 AM 4800816 6973936 3081608 39.09 2688 2340936 776756 8.70 282516 2415816 4 03:51:01 AM 4800896 6974292 3081528 39.09 2688 2341220 776756 8.70 282516 2416080 56 03:52:01 AM 4800704 6974344 3081720 39.10 2688 2341456 776756 8.70 282516 2416440 4 03:53:01 AM 4799948 6973872 3082476 39.11 2688 2341740 776756 8.70 282516 2416680 56 03:54:01 AM 4800148 6974484 3082276 39.10 2688 2342156 755852 8.46 282516 2416788 284 03:55:01 AM 4800144 6974568 3082280 39.10 2688 2342236 755852 8.46 282516 2416884 44 03:56:01 AM 4800184 6974768 3082240 39.10 2688 2342396 755852 8.46 282516 2417156 16 03:57:01 AM 4800024 6974736 3082400 39.10 2688 2342524 755852 8.46 282524 2417160 72 03:58:01 AM 4799820 6974616 3082604 39.11 2688 2342608 755852 8.46 282524 2417316 16 03:59:01 AM 4799760 6974748 3082664 39.11 2688 2342800 755852 8.46 282524 2417428 144 04:00:01 AM 4799044 6974236 3083380 39.12 2688 2343012 774360 8.67 282524 2417992 32 04:01:01 AM 4798248 6973844 3084176 39.13 2688 2343416 753368 8.44 282524 2418704 4 04:02:01 AM 4798592 6974568 3083832 39.12 2688 2343796 753368 8.44 282528 2418620 40 04:03:01 AM 4798032 6974392 3084392 39.13 2688 2344180 753368 8.44 282528 2419072 20 04:04:01 AM 4798076 6974828 3084348 39.13 2688 2344564 753368 8.44 282528 2419200 4 04:05:01 AM 4797704 6974836 3084720 39.13 2688 2344944 753368 8.44 282528 2419580 4 04:06:01 AM 4797456 6974964 3084968 39.14 2688 2345328 753368 8.44 282528 2419956 36 04:07:01 AM 4796704 6974832 3085720 39.15 2688 2345940 753368 8.44 282528 2420692 72 04:08:01 AM 4796772 6974900 3085652 39.15 2688 2345940 753368 8.44 282528 2420648 4 04:09:02 AM 4796824 6974956 3085600 39.15 2688 2345944 753368 8.44 282528 2420584 4 04:10:01 AM 4796036 6974248 3086388 39.16 2688 2346024 757120 8.48 282528 2421128 4 04:11:01 AM 4796276 6974504 3086148 39.15 2688 2346036 757120 8.48 282528 2420916 4 04:12:01 AM 4796164 6974472 3086260 39.15 2688 2346116 757120 8.48 282528 2421112 4 04:13:01 AM 4796200 6974508 3086224 39.15 2688 2346116 757120 8.48 282528 2421064 4 04:14:01 AM 4796168 6974648 3086256 39.15 2688 2346288 757120 8.48 282528 2420940 40 04:15:01 AM 4796176 6974716 3086248 39.15 2688 2346348 757120 8.48 282528 2421124 56 04:16:01 AM 4795708 6974388 3086716 39.16 2688 2346488 757120 8.48 282532 2421492 4 04:17:01 AM 4796008 6974688 3086416 39.16 2688 2346488 757120 8.48 282532 2421096 4 04:18:01 AM 4795892 6974620 3086532 39.16 2688 2346536 757120 8.48 282532 2421296 4 04:19:01 AM 4795572 6974308 3086852 39.16 2688 2346544 757120 8.48 282532 2421576 16 04:20:01 AM 4795244 6974180 3087180 39.17 2688 2346744 764748 8.56 283420 2420980 408 04:21:01 AM 4795248 6974192 3087176 39.17 2688 2346748 764748 8.56 283420 2420788 4 04:22:01 AM 4795336 6974416 3087088 39.16 2688 2346884 764748 8.56 283420 2421032 144 04:23:01 AM 4795352 6974648 3087072 39.16 2688 2347108 764748 8.56 283420 2420956 88 04:24:01 AM 4795184 6974860 3087240 39.17 2688 2347488 764748 8.56 283420 2421268 160 04:25:01 AM 4794260 6974316 3088164 39.18 2688 2347868 764748 8.56 283420 2422036 24 04:26:01 AM 4794312 6974764 3088112 39.18 2688 2348252 764748 8.56 283420 2422040 116 04:27:01 AM 4793928 6974764 3088496 39.18 2688 2348636 764748 8.56 283420 2422504 40 04:28:01 AM 4793324 6974532 3089100 39.19 2688 2349016 764748 8.56 283420 2422868 192 04:29:01 AM 4792876 6974840 3089548 39.20 2688 2349764 764748 8.56 283420 2423716 264 04:30:01 AM 4792176 6974284 3090248 39.20 2688 2349908 758720 8.50 283420 2423972 88 04:31:01 AM 4792524 6974636 3089900 39.20 2688 2349912 758720 8.50 283420 2423948 4 04:32:01 AM 4792348 6974540 3090076 39.20 2688 2349992 758720 8.50 283420 2424024 88 04:33:01 AM 4791896 6974088 3090528 39.21 2688 2349992 758720 8.50 283420 2424352 4 04:34:01 AM 4792520 6974716 3089904 39.20 2688 2349996 758720 8.50 283420 2423952 4 04:35:01 AM 4792432 6974708 3089992 39.20 2688 2350076 758720 8.50 283420 2423916 4 04:36:01 AM 4792440 6974716 3089984 39.20 2688 2350076 758720 8.50 283420 2424032 4 04:37:01 AM 4792172 6974632 3090252 39.20 2688 2350260 758720 8.50 283420 2424216 16 04:38:01 AM 4789100 6971752 3093324 39.24 2688 2350452 774184 8.67 283420 2427152 4 04:39:01 AM 4787976 6970960 3094448 39.26 2688 2350784 791336 8.86 283424 2427980 4 04:40:01 AM 4783972 6967436 3098452 39.31 2688 2351256 848192 9.50 283424 2431480 304 04:41:01 AM 4783140 6967008 3099284 39.32 2688 2351656 864872 9.68 283424 2432208 364 04:42:01 AM 4779944 6964188 3102480 39.36 2688 2352020 898472 10.06 283424 2435008 328 04:43:01 AM 4779384 6963960 3103040 39.37 2688 2352352 914996 10.25 283424 2435296 4 04:44:01 AM 4965940 6986444 2916484 37.00 2688 2189884 685716 7.68 343704 2191436 14536 04:45:01 AM 4839208 6926112 3043216 38.61 2688 2259920 748276 8.38 544140 2139652 10092 Average: 4820581 6975089 3061843 38.84 2688 2322372 754694 8.45 280665 2398711 152 12:00:01 AM IFACE rxpck/s txpck/s rxkB/s txkB/s rxcmp/s txcmp/s rxmcst/s %ifutil 12:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:01:01 AM eth0 0.93 0.22 0.08 0.02 0.00 0.00 0.00 0.00 12:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:02:01 AM eth0 0.42 0.07 0.03 0.00 0.00 0.00 0.00 0.00 12:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:03:01 AM eth0 4.72 4.00 0.70 0.34 0.00 0.00 0.00 0.00 12:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:04:01 AM eth0 8.33 6.57 1.90 1.29 0.00 0.00 0.00 0.00 12:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:05:01 AM eth0 12.30 9.63 3.10 2.03 0.00 0.00 0.00 0.00 12:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:06:01 AM eth0 10.86 9.01 2.67 1.80 0.00 0.00 0.00 0.00 12:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:07:01 AM eth0 11.06 9.01 2.65 1.80 0.00 0.00 0.00 0.00 12:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:08:01 AM eth0 11.20 9.28 2.83 1.88 0.00 0.00 0.00 0.00 12:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:09:01 AM eth0 11.25 9.06 2.69 1.80 0.00 0.00 0.00 0.00 12:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:10:01 AM eth0 8.58 6.75 2.06 1.33 0.00 0.00 0.00 0.00 12:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:11:01 AM eth0 0.92 0.48 0.08 0.08 0.00 0.00 0.00 0.00 12:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:12:01 AM eth0 0.32 0.05 0.02 0.00 0.00 0.00 0.00 0.00 12:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:13:01 AM eth0 2.68 1.90 0.60 0.40 0.00 0.00 0.00 0.00 12:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:14:01 AM eth0 5.67 4.93 1.32 0.95 0.00 0.00 0.00 0.00 12:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:15:01 AM eth0 11.40 8.95 2.72 1.80 0.00 0.00 0.00 0.00 12:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:16:01 AM eth0 10.60 8.92 2.59 1.80 0.00 0.00 0.00 0.00 12:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:17:01 AM eth0 11.56 9.28 2.75 1.82 0.00 0.00 0.00 0.00 12:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:18:01 AM eth0 11.60 9.28 2.90 1.88 0.00 0.00 0.00 0.00 12:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:19:01 AM eth0 11.71 9.38 2.96 2.01 0.00 0.00 0.00 0.00 12:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:20:01 AM eth0 20.75 17.50 5.17 3.37 0.00 0.00 0.00 0.00 12:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:21:01 AM eth0 0.87 0.43 0.11 0.06 0.00 0.00 0.00 0.00 12:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:22:01 AM eth0 0.28 0.07 0.02 0.00 0.00 0.00 0.00 0.00 12:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:23:01 AM eth0 1.03 0.52 0.22 0.11 0.00 0.00 0.00 0.00 12:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:24:01 AM eth0 0.75 0.25 0.30 0.20 0.00 0.00 0.00 0.00 12:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:25:01 AM eth0 0.85 0.03 0.07 0.00 0.00 0.00 0.00 0.00 12:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:26:01 AM eth0 0.78 0.48 0.32 0.23 0.00 0.00 0.00 0.00 12:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:27:01 AM eth0 0.83 0.00 0.07 0.00 0.00 0.00 0.00 0.00 12:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:28:01 AM eth0 10.73 10.21 2.21 1.42 0.00 0.00 0.00 0.00 12:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:29:01 AM eth0 5.37 4.98 0.76 0.39 0.00 0.00 0.00 0.00 12:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:30:01 AM eth0 0.23 0.05 0.02 0.00 0.00 0.00 0.00 0.00 12:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:31:01 AM eth0 4.42 4.02 0.58 0.29 0.00 0.00 0.00 0.00 12:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:32:01 AM eth0 7.75 5.73 1.70 1.09 0.00 0.00 0.00 0.00 12:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:33:01 AM eth0 12.26 9.80 3.40 2.27 0.00 0.00 0.00 0.00 12:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:34:01 AM eth0 11.70 9.10 2.83 1.81 0.00 0.00 0.00 0.00 12:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:35:01 AM eth0 12.70 9.72 3.38 2.24 0.00 0.00 0.00 0.00 12:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:36:01 AM eth0 10.91 8.98 2.64 1.80 0.00 0.00 0.00 0.00 12:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:37:01 AM eth0 11.38 9.13 2.76 1.81 0.00 0.00 0.00 0.00 12:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:38:01 AM eth0 9.15 7.57 2.28 1.54 0.00 0.00 0.00 0.00 12:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:39:01 AM eth0 1.38 0.73 0.14 0.11 0.00 0.00 0.00 0.00 12:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:40:01 AM eth0 8.75 7.28 2.28 1.60 0.00 0.00 0.00 0.00 12:41:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:41:01 AM eth0 11.38 9.16 2.74 1.81 0.00 0.00 0.00 0.00 12:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:42:01 AM eth0 11.08 9.08 2.65 1.81 0.00 0.00 0.00 0.00 12:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:43:01 AM eth0 12.23 9.75 3.19 2.09 0.00 0.00 0.00 0.00 12:44:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:44:01 AM eth0 11.03 8.95 2.62 1.79 0.00 0.00 0.00 0.00 12:45:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:45:01 AM eth0 12.03 9.41 2.83 1.84 0.00 0.00 0.00 0.00 12:46:02 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:46:02 AM eth0 5.75 4.92 1.38 0.97 0.00 0.00 0.00 0.00 12:47:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:47:01 AM eth0 2.68 2.19 0.49 0.42 0.00 0.00 0.00 0.00 12:48:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:48:01 AM eth0 11.90 9.57 3.10 2.07 0.00 0.00 0.00 0.00 12:49:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:49:01 AM eth0 11.41 9.10 2.73 1.81 0.00 0.00 0.00 0.00 12:50:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:50:01 AM eth0 10.75 9.00 2.63 1.80 0.00 0.00 0.00 0.00 12:51:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:51:01 AM eth0 11.58 9.01 2.72 1.80 0.00 0.00 0.00 0.00 12:52:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:52:01 AM eth0 11.56 9.53 3.01 2.05 0.00 0.00 0.00 0.00 12:53:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:53:01 AM eth0 11.10 9.08 2.70 1.86 0.00 0.00 0.00 0.00 12:54:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:54:01 AM eth0 16.25 13.38 4.08 2.53 0.00 0.00 0.00 0.00 12:55:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:55:01 AM eth0 2.02 0.48 0.46 0.24 0.00 0.00 0.00 0.00 12:56:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:56:01 AM eth0 0.80 0.32 0.32 0.23 0.00 0.00 0.00 0.00 12:57:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:57:01 AM eth0 6.30 0.30 0.73 0.04 0.00 0.00 0.00 0.00 12:58:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:58:01 AM eth0 2.25 0.98 1.49 1.05 0.00 0.00 0.00 0.00 12:59:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:59:01 AM eth0 1.90 0.53 0.51 0.27 0.00 0.00 0.00 0.00 01:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:00:01 AM eth0 4.98 0.05 0.61 0.00 0.00 0.00 0.00 0.00 01:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:01:01 AM eth0 10.60 9.40 1.81 1.07 0.00 0.00 0.00 0.00 01:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:02:01 AM eth0 5.56 4.68 0.78 0.36 0.00 0.00 0.00 0.00 01:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:03:01 AM eth0 1.30 0.85 0.28 0.17 0.00 0.00 0.00 0.00 01:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:04:01 AM eth0 1.83 0.42 0.36 0.20 0.00 0.00 0.00 0.00 01:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:05:01 AM eth0 5.22 3.90 0.65 0.32 0.00 0.00 0.00 0.00 01:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:06:01 AM eth0 15.48 10.10 3.35 1.97 0.00 0.00 0.00 0.00 01:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:07:01 AM eth0 11.86 9.36 3.25 2.22 0.00 0.00 0.00 0.00 01:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:08:01 AM eth0 12.55 9.17 3.00 1.87 0.00 0.00 0.00 0.00 01:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:09:01 AM eth0 13.75 9.30 3.22 2.00 0.00 0.00 0.00 0.00 01:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:10:01 AM eth0 10.98 8.91 2.64 1.79 0.00 0.00 0.00 0.00 01:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:11:01 AM eth0 10.96 8.96 2.61 1.80 0.00 0.00 0.00 0.00 01:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:12:01 AM eth0 4.12 3.25 0.92 0.62 0.00 0.00 0.00 0.00 01:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:13:01 AM eth0 3.23 2.30 0.67 0.48 0.00 0.00 0.00 0.00 01:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:14:01 AM eth0 10.06 8.45 2.41 1.66 0.00 0.00 0.00 0.00 01:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:15:01 AM eth0 11.43 9.13 2.69 1.81 0.00 0.00 0.00 0.00 01:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:16:01 AM eth0 12.10 9.00 2.97 1.98 0.00 0.00 0.00 0.00 01:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:17:01 AM eth0 12.23 9.36 3.24 2.18 0.00 0.00 0.00 0.00 01:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:18:01 AM eth0 12.33 9.23 3.01 1.87 0.00 0.00 0.00 0.00 01:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:19:01 AM eth0 12.76 9.26 3.03 2.00 0.00 0.00 0.00 0.00 01:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:20:01 AM eth0 17.46 14.10 4.27 2.68 0.00 0.00 0.00 0.00 01:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:21:01 AM eth0 1.33 0.38 0.15 0.05 0.00 0.00 0.00 0.00 01:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:22:01 AM eth0 0.78 0.30 0.32 0.23 0.00 0.00 0.00 0.00 01:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:23:01 AM eth0 1.12 0.45 0.24 0.11 0.00 0.00 0.00 0.00 01:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:24:01 AM eth0 0.35 0.00 0.02 0.00 0.00 0.00 0.00 0.00 01:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:25:01 AM eth0 0.67 0.28 0.08 0.04 0.00 0.00 0.00 0.00 01:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:26:01 AM eth0 0.77 0.05 0.12 0.00 0.00 0.00 0.00 0.00 01:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:27:01 AM eth0 4.78 3.75 1.19 0.87 0.00 0.00 0.00 0.00 01:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:28:01 AM eth0 11.38 11.15 1.70 0.84 0.00 0.00 0.00 0.00 01:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:29:01 AM eth0 0.98 0.62 0.14 0.10 0.00 0.00 0.00 0.00 01:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:30:01 AM eth0 0.42 0.10 0.02 0.00 0.00 0.00 0.00 0.00 01:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:31:01 AM eth0 0.73 0.30 0.09 0.03 0.00 0.00 0.00 0.00 01:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:32:01 AM eth0 0.88 0.00 0.10 0.00 0.00 0.00 0.00 0.00 01:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:33:01 AM eth0 1.15 0.58 0.52 0.32 0.00 0.00 0.00 0.00 01:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:34:01 AM eth0 0.57 0.00 0.05 0.00 0.00 0.00 0.00 0.00 01:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:35:01 AM eth0 1.17 0.57 0.39 0.26 0.00 0.00 0.00 0.00 01:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:36:01 AM eth0 0.28 0.00 0.01 0.00 0.00 0.00 0.00 0.00 01:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:37:01 AM eth0 0.72 0.33 0.10 0.04 0.00 0.00 0.00 0.00 01:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:38:01 AM eth0 0.45 0.15 0.14 0.07 0.00 0.00 0.00 0.00 01:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:39:01 AM eth0 0.73 0.30 0.10 0.03 0.00 0.00 0.00 0.00 01:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:40:01 AM eth0 0.13 0.00 0.01 0.00 0.00 0.00 0.00 0.00 01:41:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:41:01 AM eth0 1.67 0.38 0.43 0.22 0.00 0.00 0.00 0.00 01:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:42:01 AM eth0 0.58 0.27 0.31 0.23 0.00 0.00 0.00 0.00 01:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:43:01 AM eth0 0.83 0.25 0.16 0.07 0.00 0.00 0.00 0.00 01:44:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:44:01 AM eth0 9.18 8.15 1.80 1.15 0.00 0.00 0.00 0.00 01:45:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:45:01 AM eth0 11.70 9.06 2.85 1.80 0.00 0.00 0.00 0.00 01:46:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:46:01 AM eth0 11.00 9.05 2.69 1.80 0.00 0.00 0.00 0.00 01:47:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:47:01 AM eth0 10.91 8.96 2.63 1.80 0.00 0.00 0.00 0.00 01:48:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:48:01 AM eth0 11.40 9.15 2.82 1.87 0.00 0.00 0.00 0.00 01:49:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:49:01 AM eth0 11.63 9.22 2.77 1.81 0.00 0.00 0.00 0.00 01:50:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:50:01 AM eth0 10.26 8.38 2.49 1.68 0.00 0.00 0.00 0.00 01:51:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:51:01 AM eth0 0.93 0.60 0.08 0.09 0.00 0.00 0.00 0.00 01:52:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:52:01 AM eth0 0.22 0.00 0.01 0.00 0.00 0.00 0.00 0.00 01:53:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:53:01 AM eth0 0.64 0.19 0.15 0.07 0.00 0.00 0.00 0.00 01:54:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:54:01 AM eth0 0.57 0.23 0.03 0.02 0.00 0.00 0.00 0.00 01:55:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:55:01 AM eth0 0.37 0.05 0.02 0.00 0.00 0.00 0.00 0.00 01:56:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:56:01 AM eth0 0.52 0.18 0.03 0.02 0.00 0.00 0.00 0.00 01:57:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:57:01 AM eth0 0.33 0.00 0.02 0.00 0.00 0.00 0.00 0.00 01:58:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:58:01 AM eth0 0.73 0.35 0.16 0.08 0.00 0.00 0.00 0.00 01:59:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:59:01 AM eth0 0.52 0.00 0.05 0.00 0.00 0.00 0.00 0.00 02:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:00:01 AM eth0 0.38 0.22 0.02 0.02 0.00 0.00 0.00 0.00 02:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:01:01 AM eth0 0.37 0.02 0.02 0.00 0.00 0.00 0.00 0.00 02:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:02:01 AM eth0 1.40 1.00 0.34 6.52 0.00 0.00 0.00 0.00 02:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:03:01 AM eth0 0.83 0.75 0.17 6.45 0.00 0.00 0.00 0.00 02:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:04:01 AM eth0 0.70 0.60 0.08 0.13 0.00 0.00 0.00 0.00 02:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:05:01 AM eth0 11.88 9.65 2.82 1.89 0.00 0.00 0.00 0.00 02:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:06:01 AM eth0 12.25 10.25 3.03 8.26 0.00 0.00 0.00 0.00 02:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:07:01 AM eth0 10.86 8.96 2.64 1.80 0.00 0.00 0.00 0.00 02:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:08:01 AM eth0 12.28 9.45 3.18 2.07 0.00 0.00 0.00 0.00 02:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:09:01 AM eth0 11.40 9.00 2.71 1.80 0.00 0.00 0.00 0.00 02:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:10:01 AM eth0 11.15 9.03 2.74 1.80 0.00 0.00 0.00 0.00 02:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:11:01 AM eth0 8.05 2.53 1.25 0.48 0.00 0.00 0.00 0.00 02:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:12:01 AM eth0 1.83 0.45 0.62 0.42 0.00 0.00 0.00 0.00 02:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:13:01 AM eth0 0.80 0.27 0.16 0.08 0.00 0.00 0.00 0.00 02:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:14:01 AM eth0 6.86 0.10 0.89 0.00 0.00 0.00 0.00 0.00 02:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:15:01 AM eth0 1.08 0.00 0.06 0.00 0.00 0.00 0.00 0.00 02:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:16:01 AM eth0 0.90 0.18 0.05 0.02 0.00 0.00 0.00 0.00 02:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:17:01 AM eth0 0.53 0.00 0.02 0.00 0.00 0.00 0.00 0.00 02:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:18:01 AM eth0 1.20 0.37 0.18 0.09 0.00 0.00 0.00 0.00 02:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:19:01 AM eth0 1.55 0.15 0.34 0.19 0.00 0.00 0.00 0.00 02:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:20:01 AM eth0 1.92 0.18 0.13 0.02 0.00 0.00 0.00 0.00 02:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:21:01 AM eth0 3.25 0.00 0.14 0.00 0.00 0.00 0.00 0.00 02:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:22:01 AM eth0 2.23 0.18 0.09 0.02 0.00 0.00 0.00 0.00 02:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:23:01 AM eth0 0.82 0.22 0.16 0.07 0.00 0.00 0.00 0.00 02:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:24:01 AM eth0 1.32 0.60 0.18 0.13 0.00 0.00 0.00 0.00 02:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:25:01 AM eth0 12.31 10.15 2.96 2.02 0.00 0.00 0.00 0.00 02:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:26:01 AM eth0 13.28 8.98 2.90 1.80 0.00 0.00 0.00 0.00 02:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:27:01 AM eth0 12.56 9.58 3.35 2.20 0.00 0.00 0.00 0.00 02:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:28:01 AM eth0 14.48 9.35 3.32 1.88 0.00 0.00 0.00 0.00 02:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:29:01 AM eth0 14.45 9.11 3.01 1.81 0.00 0.00 0.00 0.00 02:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:30:01 AM eth0 11.53 9.03 2.69 1.80 0.00 0.00 0.00 0.00 02:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:31:01 AM eth0 3.05 2.08 0.55 0.39 0.00 0.00 0.00 0.00 02:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:32:01 AM eth0 1.50 0.13 0.37 0.19 0.00 0.00 0.00 0.00 02:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:33:01 AM eth0 1.62 0.57 0.46 0.28 0.00 0.00 0.00 0.00 02:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:34:01 AM eth0 0.63 0.00 0.04 0.00 0.00 0.00 0.00 0.00 02:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:35:01 AM eth0 0.90 0.15 0.05 0.01 0.00 0.00 0.00 0.00 02:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:36:01 AM eth0 1.53 0.10 0.21 0.00 0.00 0.00 0.00 0.00 02:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:37:01 AM eth0 1.55 0.25 0.39 0.23 0.00 0.00 0.00 0.00 02:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:38:01 AM eth0 1.03 0.52 0.44 0.27 0.00 0.00 0.00 0.00 02:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:39:01 AM eth0 3.17 0.00 0.41 0.00 0.00 0.00 0.00 0.00 02:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:40:01 AM eth0 4.20 0.23 53.62 0.02 0.00 0.00 0.00 0.00 02:41:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:41:01 AM eth0 0.93 0.00 0.05 0.00 0.00 0.00 0.00 0.00 02:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:42:01 AM eth0 1.18 0.47 0.32 0.21 0.00 0.00 0.00 0.00 02:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:43:01 AM eth0 0.87 0.12 0.16 0.07 0.00 0.00 0.00 0.00 02:44:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:44:01 AM eth0 2.38 1.85 0.44 0.38 0.00 0.00 0.00 0.00 02:45:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:45:01 AM eth0 10.00 8.20 2.35 1.60 0.00 0.00 0.00 0.00 02:46:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:46:01 AM eth0 11.30 9.15 2.69 1.81 0.00 0.00 0.00 0.00 02:47:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:47:01 AM eth0 11.65 8.98 2.76 1.80 0.00 0.00 0.00 0.00 02:48:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:48:01 AM eth0 11.68 9.43 3.06 2.07 0.00 0.00 0.00 0.00 02:49:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:49:01 AM eth0 11.40 9.15 2.72 1.81 0.00 0.00 0.00 0.00 02:50:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:50:01 AM eth0 11.43 9.15 2.75 1.81 0.00 0.00 0.00 0.00 02:51:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:51:01 AM eth0 17.16 14.46 4.26 2.75 0.00 0.00 0.00 0.00 02:52:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:52:01 AM eth0 0.68 0.37 0.10 0.05 0.00 0.00 0.00 0.00 02:53:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:53:01 AM eth0 0.75 0.13 0.16 0.07 0.00 0.00 0.00 0.00 02:54:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:54:01 AM eth0 1.05 0.32 0.17 0.04 0.00 0.00 0.00 0.00 02:55:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:55:01 AM eth0 0.80 0.00 0.10 0.00 0.00 0.00 0.00 0.00 02:56:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:56:01 AM eth0 0.60 0.30 0.08 0.04 0.00 0.00 0.00 0.00 02:57:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:57:01 AM eth0 0.58 0.05 0.03 0.00 0.00 0.00 0.00 0.00 02:58:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:58:01 AM eth0 4.15 3.50 1.03 0.72 0.00 0.00 0.00 0.00 02:59:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:59:01 AM eth0 11.46 11.16 1.60 0.79 0.00 0.00 0.00 0.00 03:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:00:01 AM eth0 0.55 0.50 0.12 0.09 0.00 0.00 0.00 0.00 03:01:02 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:01:02 AM eth0 0.55 0.10 0.02 0.00 0.00 0.00 0.00 0.00 03:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:02:01 AM eth0 3.93 3.86 0.54 0.28 0.00 0.00 0.00 0.00 03:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:03:01 AM eth0 11.25 8.66 2.71 1.73 0.00 0.00 0.00 0.00 03:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:04:01 AM eth0 11.11 9.13 2.68 1.81 0.00 0.00 0.00 0.00 03:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:05:01 AM eth0 11.33 9.17 2.70 1.83 0.00 0.00 0.00 0.00 03:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:06:01 AM eth0 11.13 9.00 2.70 1.78 0.00 0.00 0.00 0.00 03:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:07:01 AM eth0 11.08 8.93 2.65 1.79 0.00 0.00 0.00 0.00 03:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:08:01 AM eth0 11.16 9.05 2.78 1.84 0.00 0.00 0.00 0.00 03:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:09:01 AM eth0 5.75 4.50 1.33 0.87 0.00 0.00 0.00 0.00 03:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:10:01 AM eth0 1.05 0.85 0.13 0.17 0.00 0.00 0.00 0.00 03:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:11:01 AM eth0 11.46 9.52 2.77 1.88 0.00 0.00 0.00 0.00 03:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:12:01 AM eth0 10.90 9.08 2.67 1.81 0.00 0.00 0.00 0.00 03:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:13:01 AM eth0 11.46 9.20 2.83 1.87 0.00 0.00 0.00 0.00 03:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:14:01 AM eth0 10.96 9.03 2.69 1.80 0.00 0.00 0.00 0.00 03:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:15:01 AM eth0 10.91 9.02 2.63 1.80 0.00 0.00 0.00 0.00 03:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:16:01 AM eth0 10.85 8.98 2.64 1.80 0.00 0.00 0.00 0.00 03:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:17:01 AM eth0 5.50 4.33 1.36 1.00 0.00 0.00 0.00 0.00 03:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:18:01 AM eth0 4.33 3.73 1.07 0.73 0.00 0.00 0.00 0.00 03:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:19:01 AM eth0 12.28 9.52 3.27 2.20 0.00 0.00 0.00 0.00 03:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:20:01 AM eth0 11.13 8.90 2.67 1.79 0.00 0.00 0.00 0.00 03:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:21:01 AM eth0 10.53 8.82 2.54 1.78 0.00 0.00 0.00 0.00 03:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:22:01 AM eth0 13.91 8.83 2.95 1.75 0.00 0.00 0.00 0.00 03:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:23:01 AM eth0 15.26 9.13 3.48 2.03 0.00 0.00 0.00 0.00 03:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:24:01 AM eth0 14.96 12.43 4.01 2.80 0.00 0.00 0.00 0.00 03:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:25:01 AM eth0 12.33 7.88 2.76 1.43 0.00 0.00 0.00 0.00 03:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:26:01 AM eth0 5.32 0.00 0.69 0.00 0.00 0.00 0.00 0.00 03:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:27:01 AM eth0 1.32 0.07 0.08 0.00 0.00 0.00 0.00 0.00 03:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:28:01 AM eth0 1.02 0.53 0.25 0.12 0.00 0.00 0.00 0.00 03:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:29:01 AM eth0 0.55 0.00 0.03 0.00 0.00 0.00 0.00 0.00 03:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:30:01 AM eth0 1.58 0.28 0.14 0.04 0.00 0.00 0.00 0.00 03:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:31:01 AM eth0 1.97 0.00 0.12 0.00 0.00 0.00 0.00 0.00 03:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:32:01 AM eth0 11.30 9.42 1.86 1.06 0.00 0.00 0.00 0.00 03:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:33:01 AM eth0 8.82 6.10 1.36 0.76 0.00 0.00 0.00 0.00 03:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:34:01 AM eth0 1.78 0.27 0.09 0.04 0.00 0.00 0.00 0.00 03:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:35:01 AM eth0 0.45 0.10 0.02 0.00 0.00 0.00 0.00 0.00 03:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:36:01 AM eth0 12.91 9.65 1.74 0.71 0.00 0.00 0.00 0.00 03:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:37:01 AM eth0 5.98 5.25 1.24 0.83 0.00 0.00 0.00 0.00 03:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:38:01 AM eth0 10.86 9.27 1.68 0.75 0.00 0.00 0.00 0.00 03:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:39:01 AM eth0 6.51 0.70 0.79 0.10 0.00 0.00 0.00 0.00 03:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:40:01 AM eth0 0.73 0.00 0.04 0.00 0.00 0.00 0.00 0.00 03:41:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:41:01 AM eth0 9.11 8.23 1.48 0.84 0.00 0.00 0.00 0.00 03:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:42:01 AM eth0 7.95 6.33 1.84 1.24 0.00 0.00 0.00 0.00 03:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:43:01 AM eth0 12.15 9.22 2.97 1.87 0.00 0.00 0.00 0.00 03:44:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:44:01 AM eth0 10.90 9.08 2.72 1.81 0.00 0.00 0.00 0.00 03:45:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:45:01 AM eth0 11.18 8.96 2.75 1.80 0.00 0.00 0.00 0.00 03:46:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:46:01 AM eth0 11.50 9.13 2.82 1.81 0.00 0.00 0.00 0.00 03:47:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:47:01 AM eth0 11.25 9.02 2.71 1.80 0.00 0.00 0.00 0.00 03:48:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:48:01 AM eth0 19.95 16.31 5.09 3.16 0.00 0.00 0.00 0.00 03:49:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:49:01 AM eth0 6.76 0.67 103.65 0.11 0.00 0.00 0.00 0.00 03:50:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:50:01 AM eth0 0.72 0.60 0.19 0.13 0.00 0.00 0.00 0.00 03:51:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:51:01 AM eth0 1.12 0.63 0.22 0.13 0.00 0.00 0.00 0.00 03:52:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:52:01 AM eth0 0.68 0.60 0.18 0.13 0.00 0.00 0.00 0.00 03:53:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:53:01 AM eth0 1.20 0.63 0.31 0.17 0.00 0.00 0.00 0.00 03:54:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:54:01 AM eth0 4.45 4.03 1.08 0.79 0.00 0.00 0.00 0.00 03:55:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:55:01 AM eth0 11.18 10.78 1.58 0.76 0.00 0.00 0.00 0.00 03:56:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:56:01 AM eth0 5.50 5.31 0.78 0.47 0.00 0.00 0.00 0.00 03:57:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:57:01 AM eth0 4.98 4.73 0.69 0.40 0.00 0.00 0.00 0.00 03:58:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:58:01 AM eth0 2.77 2.53 0.48 0.28 0.00 0.00 0.00 0.00 03:59:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:59:01 AM eth0 3.95 3.58 0.59 0.42 0.00 0.00 0.00 0.00 04:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:00:01 AM eth0 7.43 6.90 1.40 0.91 0.00 0.00 0.00 0.00 04:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:01:01 AM eth0 12.25 9.80 3.03 1.93 0.00 0.00 0.00 0.00 04:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:02:01 AM eth0 11.11 8.98 2.79 1.80 0.00 0.00 0.00 0.00 04:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:03:01 AM eth0 10.73 9.06 2.78 1.86 0.00 0.00 0.00 0.00 04:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:04:01 AM eth0 11.45 9.10 2.87 1.81 0.00 0.00 0.00 0.00 04:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:05:01 AM eth0 10.90 8.68 2.71 1.73 0.00 0.00 0.00 0.00 04:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:06:01 AM eth0 11.28 9.02 2.82 1.80 0.00 0.00 0.00 0.00 04:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:07:01 AM eth0 14.46 12.28 3.65 2.35 0.00 0.00 0.00 0.00 04:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:08:01 AM eth0 0.48 0.17 0.15 0.07 0.00 0.00 0.00 0.00 04:09:02 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:09:02 AM eth0 0.50 0.00 0.06 0.00 0.00 0.00 0.00 0.00 04:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:10:01 AM eth0 0.53 0.36 0.09 0.05 0.00 0.00 0.00 0.00 04:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:11:01 AM eth0 0.30 0.00 0.01 0.00 0.00 0.00 0.00 0.00 04:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:12:01 AM eth0 0.55 0.37 0.07 0.05 0.00 0.00 0.00 0.00 04:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:13:01 AM eth0 0.57 0.12 0.15 0.07 0.00 0.00 0.00 0.00 04:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:14:01 AM eth0 10.06 9.55 1.78 1.07 0.00 0.00 0.00 0.00 04:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:15:01 AM eth0 1.20 0.93 0.42 0.13 0.00 0.00 0.00 0.00 04:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:16:01 AM eth0 1.22 0.73 0.37 0.10 0.00 0.00 0.00 0.00 04:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:17:01 AM eth0 0.53 0.20 0.02 0.19 0.00 0.00 0.00 0.00 04:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:18:01 AM eth0 4.42 4.22 0.72 0.40 0.00 0.00 0.00 0.00 04:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:19:01 AM eth0 0.82 0.33 0.28 0.20 0.00 0.00 0.00 0.00 04:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:20:01 AM eth0 6.12 6.05 0.83 0.48 0.00 0.00 0.00 0.00 04:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:21:01 AM eth0 0.33 0.00 0.01 0.00 0.00 0.00 0.00 0.00 04:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:22:01 AM eth0 8.83 8.60 1.48 0.87 0.00 0.00 0.00 0.00 04:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:23:01 AM eth0 6.48 5.38 1.61 1.09 0.00 0.00 0.00 0.00 04:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:24:01 AM eth0 10.98 9.07 2.74 1.80 0.00 0.00 0.00 0.00 04:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:25:01 AM eth0 11.53 9.16 3.00 1.99 0.00 0.00 0.00 0.00 04:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:26:01 AM eth0 10.86 9.00 2.73 1.80 0.00 0.00 0.00 0.00 04:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:27:01 AM eth0 11.21 9.00 2.80 1.80 0.00 0.00 0.00 0.00 04:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:28:01 AM eth0 11.73 9.40 3.00 1.88 0.00 0.00 0.00 0.00 04:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:29:01 AM eth0 21.26 18.10 5.48 3.51 0.00 0.00 0.00 0.00 04:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:30:01 AM eth0 0.70 0.50 0.12 0.08 0.00 0.00 0.00 0.00 04:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:31:01 AM eth0 0.32 0.05 0.01 0.00 0.00 0.00 0.00 0.00 04:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:32:01 AM eth0 0.90 0.23 0.13 0.04 0.00 0.00 0.00 0.00 04:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:33:01 AM eth0 0.85 0.43 0.41 0.26 0.00 0.00 0.00 0.00 04:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:34:01 AM eth0 0.20 0.00 0.01 0.00 0.00 0.00 0.00 0.00 04:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:35:01 AM eth0 0.53 0.33 0.08 0.05 0.00 0.00 0.00 0.00 04:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:36:01 AM eth0 0.22 0.05 0.01 0.00 0.00 0.00 0.00 0.00 04:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:37:01 AM eth0 9.85 9.53 1.75 1.07 0.00 0.00 0.00 0.00 04:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:38:01 AM eth0 9.52 9.22 1.73 1.14 0.00 0.00 0.00 0.00 04:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:39:01 AM eth0 9.50 9.26 2.95 1.07 0.00 0.00 0.00 0.00 04:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:01 AM eth0 11.40 11.20 3.47 1.49 0.00 0.00 0.00 0.00 04:41:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:41:01 AM eth0 10.76 9.83 3.33 1.48 0.00 0.00 0.00 0.00 04:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:42:01 AM eth0 15.44 15.21 4.06 1.59 0.00 0.00 0.00 0.00 04:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:43:01 AM eth0 9.18 8.77 3.05 1.08 0.00 0.00 0.00 0.00 04:44:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:44:01 AM eth0 127.09 77.51 205.99 310.00 0.00 0.00 0.00 0.00 04:45:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:45:01 AM eth0 23.41 20.49 43.66 8.96 0.00 0.00 0.00 0.00 Average: lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 Average: eth0 6.90 5.21 2.88 2.10 0.00 0.00 0.00 0.00 ---> sar -P ALL: Linux 4.18.0-553.5.1.el8.x86_64 (prd-centos8-robot-2c-8g-40228.novalocal) 07/07/2025 _x86_64_ (2 CPU) 12:00:01 AM CPU %user %nice %system %iowait %steal %idle 12:01:01 AM all 0.43 0.02 0.25 0.07 0.02 99.22 12:01:01 AM 0 0.67 0.00 0.15 0.13 0.02 99.03 12:01:01 AM 1 0.20 0.03 0.35 0.00 0.02 99.40 12:02:01 AM all 0.45 0.00 0.13 0.00 0.04 99.38 12:02:01 AM 0 0.59 0.00 0.13 0.00 0.03 99.25 12:02:01 AM 1 0.32 0.00 0.12 0.00 0.05 99.52 12:03:01 AM all 1.62 0.00 0.18 0.00 0.04 98.16 12:03:01 AM 0 2.63 0.00 0.29 0.00 0.05 97.03 12:03:01 AM 1 0.62 0.00 0.07 0.00 0.03 99.28 12:04:01 AM all 6.30 0.00 1.50 0.00 0.06 92.14 12:04:01 AM 0 6.84 0.00 2.71 0.00 0.07 90.38 12:04:01 AM 1 5.76 0.00 0.32 0.00 0.05 93.87 12:05:01 AM all 4.47 0.00 0.20 0.00 0.04 95.29 12:05:01 AM 0 7.79 0.00 0.25 0.00 0.05 91.91 12:05:01 AM 1 1.15 0.00 0.15 0.00 0.03 98.66 12:06:01 AM all 4.42 0.00 0.20 0.00 0.05 95.33 12:06:01 AM 0 5.10 0.00 0.22 0.00 0.05 94.63 12:06:01 AM 1 3.74 0.00 0.18 0.00 0.05 96.02 12:07:01 AM all 4.40 0.00 0.20 0.00 0.04 95.36 12:07:01 AM 0 4.95 0.00 0.17 0.00 0.03 94.85 12:07:01 AM 1 3.84 0.00 0.23 0.00 0.05 95.87 12:08:01 AM all 4.42 0.00 0.19 0.01 0.05 95.33 12:08:01 AM 0 3.08 0.00 0.20 0.00 0.05 96.67 12:08:01 AM 1 5.75 0.00 0.18 0.02 0.05 94.00 12:09:01 AM all 4.45 0.00 0.20 0.00 0.05 95.30 12:09:01 AM 0 2.11 0.00 0.20 0.00 0.05 97.64 12:09:01 AM 1 6.79 0.00 0.20 0.00 0.05 92.96 12:10:01 AM all 5.27 0.00 0.30 0.00 0.06 94.37 12:10:01 AM 0 2.43 0.00 0.18 0.00 0.05 97.34 12:10:01 AM 1 8.18 0.00 0.41 0.00 0.07 91.34 12:11:01 AM all 4.80 0.00 1.35 0.00 0.06 93.79 12:11:01 AM 0 0.62 0.00 0.15 0.00 0.03 99.20 12:11:01 AM 1 9.28 0.00 2.63 0.00 0.09 88.01 12:11:01 AM CPU %user %nice %system %iowait %steal %idle 12:12:01 AM all 0.55 0.00 0.10 0.00 0.04 99.31 12:12:01 AM 0 0.65 0.00 0.08 0.00 0.03 99.23 12:12:01 AM 1 0.45 0.00 0.12 0.00 0.05 99.38 12:13:01 AM all 2.30 0.00 0.19 0.00 0.03 97.47 12:13:01 AM 0 0.80 0.00 0.07 0.00 0.02 99.12 12:13:01 AM 1 3.83 0.00 0.32 0.00 0.05 95.80 12:14:01 AM all 6.53 0.00 2.42 0.00 0.05 91.00 12:14:01 AM 0 0.82 0.00 0.13 0.00 0.03 99.01 12:14:01 AM 1 12.62 0.00 4.86 0.00 0.07 82.45 12:15:01 AM all 4.43 0.00 0.31 0.00 0.05 95.21 12:15:01 AM 0 5.59 0.00 0.35 0.00 0.05 94.00 12:15:01 AM 1 3.26 0.00 0.27 0.00 0.05 96.42 12:16:01 AM all 4.43 0.00 0.31 0.00 0.05 95.21 12:16:01 AM 0 4.77 0.00 0.33 0.00 0.05 94.85 12:16:01 AM 1 4.10 0.00 0.28 0.00 0.05 95.57 12:17:01 AM all 4.48 0.00 0.33 0.00 0.05 95.14 12:17:01 AM 0 4.22 0.00 0.33 0.00 0.05 95.40 12:17:01 AM 1 4.74 0.00 0.32 0.00 0.05 94.89 12:18:01 AM all 4.44 0.00 0.33 0.00 0.05 95.18 12:18:01 AM 0 5.69 0.00 0.42 0.00 0.05 93.84 12:18:01 AM 1 3.19 0.00 0.25 0.00 0.05 96.51 12:19:01 AM all 4.48 0.00 0.31 0.00 0.07 95.14 12:19:01 AM 0 4.32 0.00 0.28 0.00 0.07 95.33 12:19:01 AM 1 4.64 0.00 0.33 0.00 0.07 94.96 12:20:01 AM all 7.30 0.00 0.44 0.00 0.05 92.20 12:20:01 AM 0 3.33 0.00 0.32 0.00 0.05 96.30 12:20:01 AM 1 11.27 0.00 0.57 0.00 0.05 88.11 12:21:01 AM all 0.64 0.00 0.11 0.00 0.04 99.21 12:21:01 AM 0 0.65 0.00 0.12 0.00 0.03 99.20 12:21:01 AM 1 0.63 0.00 0.10 0.00 0.05 99.22 12:22:01 AM all 0.25 0.00 0.06 0.00 0.02 99.67 12:22:01 AM 0 0.38 0.00 0.05 0.00 0.02 99.55 12:22:01 AM 1 0.12 0.00 0.07 0.00 0.02 99.80 12:22:01 AM CPU %user %nice %system %iowait %steal %idle 12:23:01 AM all 0.49 0.00 0.08 0.00 0.03 99.41 12:23:01 AM 0 0.55 0.00 0.03 0.00 0.02 99.40 12:23:01 AM 1 0.43 0.00 0.12 0.00 0.03 99.42 12:24:01 AM all 0.34 0.00 0.07 0.00 0.03 99.56 12:24:01 AM 0 0.55 0.00 0.03 0.00 0.03 99.38 12:24:01 AM 1 0.13 0.00 0.10 0.00 0.03 99.73 12:25:01 AM all 0.33 0.00 0.07 0.00 0.03 99.57 12:25:01 AM 0 0.43 0.00 0.05 0.00 0.02 99.50 12:25:01 AM 1 0.23 0.00 0.08 0.00 0.03 99.65 12:26:01 AM all 0.47 0.00 0.07 0.00 0.03 99.44 12:26:01 AM 0 0.45 0.00 0.10 0.00 0.03 99.42 12:26:01 AM 1 0.48 0.00 0.03 0.00 0.02 99.47 12:27:01 AM all 0.29 0.00 0.06 0.00 0.03 99.62 12:27:01 AM 0 0.28 0.00 0.07 0.00 0.03 99.62 12:27:01 AM 1 0.30 0.00 0.05 0.00 0.03 99.62 12:28:01 AM all 5.75 0.00 2.43 0.00 0.05 91.77 12:28:01 AM 0 10.59 0.00 4.82 0.00 0.07 84.51 12:28:01 AM 1 1.22 0.00 0.18 0.00 0.03 98.56 12:29:01 AM all 5.65 0.00 1.95 0.00 0.06 92.34 12:29:01 AM 0 0.45 0.00 0.18 0.00 0.05 99.31 12:29:01 AM 1 11.25 0.00 3.84 0.00 0.07 84.84 12:30:01 AM all 0.38 0.00 0.08 0.00 0.03 99.52 12:30:01 AM 0 0.62 0.00 0.05 0.00 0.03 99.30 12:30:01 AM 1 0.13 0.00 0.10 0.00 0.02 99.75 12:31:01 AM all 0.87 0.00 0.12 0.00 0.03 98.99 12:31:01 AM 0 0.60 0.00 0.08 0.00 0.02 99.30 12:31:01 AM 1 1.14 0.00 0.15 0.00 0.03 98.67 12:32:01 AM all 6.24 0.00 1.43 0.00 0.06 92.27 12:32:01 AM 0 1.44 0.00 0.15 0.00 0.05 98.36 12:32:01 AM 1 11.34 0.00 2.79 0.00 0.07 85.81 12:33:01 AM all 4.50 0.00 0.18 0.00 0.05 95.28 12:33:01 AM 0 4.37 0.00 0.20 0.00 0.05 95.38 12:33:01 AM 1 4.63 0.00 0.15 0.00 0.05 95.17 12:33:01 AM CPU %user %nice %system %iowait %steal %idle 12:34:01 AM all 4.36 0.00 0.18 0.00 0.04 95.42 12:34:01 AM 0 2.41 0.00 0.20 0.00 0.03 97.36 12:34:01 AM 1 6.30 0.00 0.17 0.00 0.05 93.48 12:35:01 AM all 4.47 0.00 0.23 0.00 0.05 95.25 12:35:01 AM 0 6.94 0.00 0.23 0.00 0.07 92.75 12:35:01 AM 1 2.00 0.00 0.22 0.00 0.03 97.75 12:36:01 AM all 4.38 0.00 0.15 0.00 0.04 95.43 12:36:01 AM 0 2.16 0.00 0.12 0.00 0.03 97.69 12:36:01 AM 1 6.61 0.00 0.18 0.00 0.05 93.16 12:37:01 AM all 4.36 0.00 0.19 0.00 0.04 95.40 12:37:01 AM 0 2.54 0.00 0.17 0.00 0.03 97.26 12:37:01 AM 1 6.18 0.00 0.22 0.00 0.05 93.55 12:38:01 AM all 5.03 0.00 0.27 0.00 0.05 94.65 12:38:01 AM 0 7.44 0.00 0.38 0.00 0.07 92.12 12:38:01 AM 1 2.67 0.00 0.17 0.00 0.03 97.13 12:39:01 AM all 6.71 0.00 1.83 0.00 0.06 91.39 12:39:01 AM 0 8.23 0.00 3.19 0.00 0.07 88.51 12:39:01 AM 1 5.22 0.00 0.50 0.00 0.05 94.22 12:40:01 AM all 5.99 0.00 1.31 0.00 0.07 92.63 12:40:01 AM 0 2.64 0.00 0.18 0.00 0.05 97.12 12:40:01 AM 1 9.49 0.00 2.48 0.00 0.09 87.95 12:41:01 AM all 4.45 0.00 0.19 0.00 0.04 95.32 12:41:01 AM 0 6.44 0.00 0.22 0.00 0.05 93.29 12:41:01 AM 1 2.46 0.00 0.17 0.00 0.03 97.34 12:42:01 AM all 4.38 0.00 0.19 0.00 0.05 95.38 12:42:01 AM 0 4.01 0.00 0.17 0.00 0.05 95.77 12:42:01 AM 1 4.74 0.00 0.22 0.00 0.05 94.99 12:43:01 AM all 4.54 0.00 0.20 0.00 0.05 95.21 12:43:01 AM 0 5.94 0.00 0.20 0.00 0.05 93.81 12:43:01 AM 1 3.14 0.00 0.20 0.00 0.05 96.61 12:44:01 AM all 4.33 0.00 0.16 0.00 0.05 95.46 12:44:01 AM 0 3.54 0.00 0.15 0.00 0.05 96.25 12:44:01 AM 1 5.12 0.00 0.17 0.00 0.05 94.67 12:44:01 AM CPU %user %nice %system %iowait %steal %idle 12:45:01 AM all 4.37 0.00 0.20 0.00 0.05 95.38 12:45:01 AM 0 5.99 0.00 0.22 0.00 0.05 93.74 12:45:01 AM 1 2.74 0.00 0.18 0.00 0.05 97.02 12:46:02 AM all 5.50 0.00 1.12 0.00 0.05 93.33 12:46:02 AM 0 2.41 0.00 0.12 0.00 0.03 97.44 12:46:02 AM 1 8.73 0.00 2.17 0.00 0.07 89.03 12:47:01 AM all 6.62 0.00 2.43 0.00 0.07 90.88 12:47:01 AM 0 9.63 0.00 4.49 0.00 0.09 85.79 12:47:01 AM 1 3.75 0.00 0.47 0.00 0.05 95.74 12:48:01 AM all 5.25 0.00 0.57 0.00 0.05 94.13 12:48:01 AM 0 7.07 0.00 0.83 0.00 0.05 92.05 12:48:01 AM 1 3.48 0.00 0.30 0.00 0.05 96.17 12:49:01 AM all 4.37 0.00 0.36 0.00 0.04 95.23 12:49:01 AM 0 2.65 0.00 0.27 0.00 0.03 97.05 12:49:01 AM 1 6.09 0.00 0.45 0.00 0.05 93.41 12:50:01 AM all 4.45 0.00 0.33 0.00 0.05 95.17 12:50:01 AM 0 4.87 0.00 0.33 0.00 0.05 94.75 12:50:01 AM 1 4.03 0.00 0.33 0.00 0.05 95.59 12:51:01 AM all 4.40 0.00 0.34 0.00 0.04 95.22 12:51:01 AM 0 4.75 0.00 0.40 0.00 0.05 94.79 12:51:01 AM 1 4.04 0.00 0.28 0.00 0.03 95.64 12:52:01 AM all 4.46 0.00 0.33 0.01 0.04 95.16 12:52:01 AM 0 4.13 0.00 0.28 0.02 0.03 95.53 12:52:01 AM 1 4.78 0.00 0.38 0.00 0.05 94.78 12:53:01 AM all 4.51 0.00 0.33 0.00 0.05 95.11 12:53:01 AM 0 6.98 0.00 0.49 0.00 0.05 92.48 12:53:01 AM 1 2.04 0.00 0.18 0.00 0.05 97.73 12:54:01 AM all 5.50 0.00 0.32 0.00 0.05 94.13 12:54:01 AM 0 7.55 0.00 0.38 0.00 0.05 92.02 12:54:01 AM 1 3.46 0.00 0.25 0.00 0.05 96.24 12:55:01 AM all 0.38 0.00 0.08 0.00 0.02 99.52 12:55:01 AM 0 0.40 0.00 0.10 0.00 0.02 99.48 12:55:01 AM 1 0.35 0.00 0.07 0.00 0.02 99.57 12:55:01 AM CPU %user %nice %system %iowait %steal %idle 12:56:01 AM all 0.30 0.00 0.08 0.00 0.03 99.59 12:56:01 AM 0 0.52 0.00 0.10 0.00 0.03 99.35 12:56:01 AM 1 0.08 0.00 0.07 0.00 0.02 99.83 12:57:01 AM all 0.41 0.00 0.10 0.00 0.03 99.47 12:57:01 AM 0 0.40 0.00 0.10 0.00 0.03 99.46 12:57:01 AM 1 0.42 0.00 0.10 0.00 0.02 99.47 12:58:01 AM all 0.38 0.00 0.08 0.00 0.03 99.52 12:58:01 AM 0 0.63 0.00 0.07 0.00 0.02 99.28 12:58:01 AM 1 0.12 0.00 0.08 0.00 0.03 99.77 12:59:01 AM all 0.56 0.00 0.08 0.00 0.03 99.34 12:59:01 AM 0 0.53 0.00 0.05 0.00 0.03 99.38 12:59:01 AM 1 0.58 0.00 0.10 0.00 0.02 99.30 01:00:01 AM all 0.37 0.00 0.08 0.00 0.03 99.53 01:00:01 AM 0 0.58 0.00 0.05 0.00 0.02 99.35 01:00:01 AM 1 0.15 0.00 0.10 0.00 0.03 99.72 01:01:01 AM all 2.75 0.00 0.19 0.00 0.03 97.03 01:01:01 AM 0 0.84 0.00 0.10 0.00 0.02 99.05 01:01:01 AM 1 4.70 0.00 0.27 0.00 0.05 94.97 01:02:01 AM all 6.77 0.00 2.60 0.00 0.06 90.57 01:02:01 AM 0 0.68 0.00 0.20 0.00 0.05 99.07 01:02:01 AM 1 13.45 0.00 5.24 0.00 0.07 81.24 01:03:01 AM all 2.41 0.00 1.71 0.00 0.03 95.85 01:03:01 AM 0 0.40 0.00 0.12 0.00 0.03 99.45 01:03:01 AM 1 4.46 0.00 3.33 0.00 0.03 92.18 01:04:01 AM all 0.35 0.00 0.10 0.00 0.03 99.52 01:04:01 AM 0 0.17 0.00 0.12 0.00 0.03 99.68 01:04:01 AM 1 0.53 0.00 0.08 0.00 0.03 99.35 01:05:01 AM all 3.99 0.00 1.45 0.00 0.04 94.52 01:05:01 AM 0 0.17 0.00 0.15 0.00 0.03 99.65 01:05:01 AM 1 8.00 0.00 2.81 0.00 0.05 89.14 01:06:01 AM all 5.22 0.00 0.29 0.00 0.05 94.44 01:06:01 AM 0 5.57 0.00 0.25 0.00 0.05 94.13 01:06:01 AM 1 4.88 0.00 0.32 0.00 0.05 94.75 01:06:01 AM CPU %user %nice %system %iowait %steal %idle 01:07:01 AM all 4.49 0.00 0.18 0.00 0.05 95.28 01:07:01 AM 0 4.08 0.00 0.18 0.00 0.05 95.68 01:07:01 AM 1 4.90 0.00 0.18 0.00 0.05 94.87 01:08:01 AM all 4.41 0.00 0.16 0.00 0.05 95.38 01:08:01 AM 0 4.97 0.00 0.18 0.00 0.05 94.80 01:08:01 AM 1 3.86 0.00 0.13 0.00 0.05 95.96 01:09:01 AM all 4.41 0.00 0.18 0.00 0.04 95.36 01:09:01 AM 0 2.12 0.00 0.20 0.00 0.03 97.64 01:09:01 AM 1 6.71 0.00 0.17 0.00 0.05 93.08 01:10:01 AM all 4.45 0.00 0.18 0.00 0.05 95.32 01:10:01 AM 0 3.23 0.00 0.17 0.00 0.05 96.56 01:10:01 AM 1 5.66 0.00 0.20 0.00 0.05 94.09 01:11:01 AM all 4.47 0.00 0.21 0.00 0.05 95.27 01:11:01 AM 0 6.81 0.00 0.25 0.00 0.05 92.89 01:11:01 AM 1 2.14 0.00 0.17 0.00 0.05 97.65 01:12:01 AM all 6.52 0.00 0.66 0.00 0.07 92.75 01:12:01 AM 0 1.07 0.00 0.17 0.00 0.05 98.71 01:12:01 AM 1 12.30 0.00 1.19 0.00 0.09 86.42 01:13:01 AM all 6.45 0.00 2.02 0.00 0.05 91.48 01:13:01 AM 0 0.52 0.00 0.13 0.00 0.03 99.31 01:13:01 AM 1 12.87 0.00 4.06 0.00 0.07 82.99 01:14:01 AM all 5.53 0.00 1.68 0.00 0.06 92.73 01:14:01 AM 0 2.46 0.00 0.22 0.00 0.05 97.28 01:14:01 AM 1 8.70 0.00 3.18 0.00 0.07 88.05 01:15:01 AM all 4.34 0.00 0.33 0.00 0.06 95.27 01:15:01 AM 0 1.59 0.00 0.17 0.00 0.05 98.19 01:15:01 AM 1 7.09 0.00 0.49 0.00 0.07 92.36 01:16:01 AM all 4.43 0.00 0.33 0.00 0.05 95.19 01:16:01 AM 0 4.45 0.00 0.30 0.00 0.05 95.20 01:16:01 AM 1 4.41 0.00 0.35 0.00 0.05 95.19 01:17:01 AM all 4.56 0.00 0.33 0.00 0.06 95.06 01:17:01 AM 0 2.88 0.00 0.22 0.00 0.05 96.86 01:17:01 AM 1 6.24 0.00 0.43 0.00 0.07 93.26 01:17:01 AM CPU %user %nice %system %iowait %steal %idle 01:18:01 AM all 4.48 0.00 0.35 0.00 0.05 95.12 01:18:01 AM 0 3.04 0.00 0.23 0.00 0.05 96.67 01:18:01 AM 1 5.92 0.00 0.47 0.00 0.05 93.56 01:19:01 AM all 4.27 0.00 0.33 0.00 0.06 95.34 01:19:01 AM 0 3.49 0.00 0.30 0.00 0.05 96.16 01:19:01 AM 1 5.04 0.00 0.37 0.00 0.07 94.52 01:20:01 AM all 5.72 0.00 0.33 0.00 0.04 93.90 01:20:01 AM 0 7.99 0.00 0.42 0.00 0.05 91.54 01:20:01 AM 1 3.46 0.00 0.25 0.00 0.03 96.26 01:21:01 AM all 0.54 0.00 0.08 0.00 0.03 99.35 01:21:01 AM 0 0.62 0.00 0.08 0.00 0.03 99.27 01:21:01 AM 1 0.47 0.00 0.08 0.00 0.02 99.43 01:22:01 AM all 0.38 0.00 0.07 0.00 0.03 99.53 01:22:01 AM 0 0.65 0.00 0.05 0.00 0.03 99.27 01:22:01 AM 1 0.10 0.00 0.08 0.00 0.02 99.80 01:23:01 AM all 0.53 0.18 0.12 0.00 0.03 99.16 01:23:01 AM 0 0.64 0.07 0.12 0.00 0.03 99.15 01:23:01 AM 1 0.42 0.28 0.12 0.00 0.02 99.17 01:24:01 AM all 0.33 0.00 0.07 0.00 0.03 99.57 01:24:01 AM 0 0.60 0.00 0.10 0.00 0.03 99.26 01:24:01 AM 1 0.07 0.00 0.03 0.00 0.02 99.88 01:25:01 AM all 0.51 0.00 0.08 0.00 0.03 99.39 01:25:01 AM 0 0.60 0.00 0.05 0.00 0.03 99.32 01:25:01 AM 1 0.42 0.00 0.10 0.00 0.02 99.47 01:26:01 AM all 0.28 0.00 0.08 0.00 0.03 99.62 01:26:01 AM 0 0.48 0.00 0.08 0.00 0.02 99.41 01:26:01 AM 1 0.07 0.00 0.07 0.00 0.03 99.83 01:27:01 AM all 2.13 0.00 0.13 0.00 0.03 97.72 01:27:01 AM 0 0.70 0.00 0.10 0.00 0.02 99.18 01:27:01 AM 1 3.57 0.00 0.15 0.00 0.03 96.25 01:28:01 AM all 6.66 0.00 2.52 0.01 0.06 90.75 01:28:01 AM 0 12.41 0.00 4.99 0.00 0.09 82.51 01:28:01 AM 1 1.36 0.00 0.24 0.02 0.03 98.35 01:28:01 AM CPU %user %nice %system %iowait %steal %idle 01:29:01 AM all 3.07 0.00 1.80 0.00 0.03 95.10 01:29:01 AM 0 5.58 0.00 3.56 0.00 0.03 90.83 01:29:01 AM 1 0.65 0.00 0.10 0.00 0.03 99.22 01:30:01 AM all 0.37 0.00 0.07 0.00 0.04 99.52 01:30:01 AM 0 0.15 0.00 0.07 0.00 0.05 99.73 01:30:01 AM 1 0.58 0.00 0.07 0.00 0.03 99.32 01:31:01 AM all 0.43 0.00 0.09 0.00 0.02 99.46 01:31:01 AM 0 0.37 0.00 0.12 0.00 0.02 99.50 01:31:01 AM 1 0.50 0.00 0.07 0.00 0.02 99.42 01:32:01 AM all 0.31 0.00 0.08 0.00 0.03 99.59 01:32:01 AM 0 0.52 0.00 0.05 0.00 0.03 99.40 01:32:01 AM 1 0.10 0.00 0.10 0.00 0.02 99.78 01:33:01 AM all 0.51 0.00 0.09 0.00 0.03 99.37 01:33:01 AM 0 0.40 0.00 0.08 0.00 0.03 99.48 01:33:01 AM 1 0.62 0.00 0.10 0.00 0.02 99.27 01:34:01 AM all 0.35 0.00 0.08 0.00 0.03 99.55 01:34:01 AM 0 0.64 0.00 0.10 0.00 0.03 99.23 01:34:01 AM 1 0.07 0.00 0.05 0.00 0.02 99.87 01:35:01 AM all 0.41 0.00 0.09 0.00 0.03 99.47 01:35:01 AM 0 0.45 0.00 0.10 0.00 0.03 99.41 01:35:01 AM 1 0.37 0.00 0.08 0.00 0.02 99.53 01:36:01 AM all 0.36 0.00 0.08 0.00 0.03 99.53 01:36:01 AM 0 0.62 0.00 0.07 0.00 0.03 99.28 01:36:01 AM 1 0.10 0.00 0.10 0.00 0.02 99.78 01:37:01 AM all 0.48 0.00 0.08 0.00 0.03 99.42 01:37:01 AM 0 0.57 0.00 0.05 0.00 0.02 99.37 01:37:01 AM 1 0.40 0.00 0.10 0.00 0.03 99.47 01:38:01 AM all 0.36 0.00 0.08 0.00 0.02 99.55 01:38:01 AM 0 0.15 0.00 0.08 0.00 0.03 99.73 01:38:01 AM 1 0.57 0.00 0.07 0.00 0.00 99.37 01:39:01 AM all 0.51 0.00 0.08 0.00 0.03 99.37 01:39:01 AM 0 0.37 0.00 0.10 0.00 0.05 99.48 01:39:01 AM 1 0.65 0.00 0.07 0.00 0.02 99.27 01:39:01 AM CPU %user %nice %system %iowait %steal %idle 01:40:01 AM all 0.37 0.00 0.08 0.00 0.03 99.53 01:40:01 AM 0 0.67 0.00 0.10 0.00 0.03 99.20 01:40:01 AM 1 0.07 0.00 0.05 0.00 0.02 99.87 01:41:01 AM all 0.49 0.00 0.11 0.00 0.03 99.37 01:41:01 AM 0 0.63 0.00 0.12 0.00 0.02 99.23 01:41:01 AM 1 0.35 0.00 0.10 0.00 0.03 99.52 01:42:01 AM all 0.39 0.00 0.08 0.00 0.03 99.50 01:42:01 AM 0 0.65 0.00 0.08 0.00 0.03 99.23 01:42:01 AM 1 0.13 0.00 0.08 0.00 0.02 99.77 01:43:01 AM all 0.33 0.00 0.09 0.00 0.02 99.56 01:43:01 AM 0 0.48 0.00 0.07 0.00 0.03 99.42 01:43:01 AM 1 0.18 0.00 0.12 0.00 0.00 99.70 01:44:01 AM all 6.35 0.00 1.42 0.00 0.06 92.16 01:44:01 AM 0 1.10 0.00 0.22 0.00 0.03 98.65 01:44:01 AM 1 11.96 0.00 2.71 0.00 0.09 85.25 01:45:01 AM all 4.23 0.00 0.22 0.00 0.04 95.51 01:45:01 AM 0 1.94 0.00 0.17 0.00 0.03 97.85 01:45:01 AM 1 6.51 0.00 0.27 0.00 0.05 93.18 01:46:01 AM all 4.43 0.00 0.19 0.00 0.04 95.33 01:46:01 AM 0 1.96 0.00 0.15 0.00 0.03 97.86 01:46:01 AM 1 6.90 0.00 0.23 0.00 0.05 92.81 01:47:01 AM all 4.45 0.00 0.16 0.00 0.05 95.34 01:47:01 AM 0 2.12 0.00 0.17 0.00 0.05 97.66 01:47:01 AM 1 6.77 0.00 0.15 0.00 0.05 93.03 01:48:01 AM all 4.54 0.00 0.20 0.00 0.06 95.20 01:48:01 AM 0 3.01 0.00 0.20 0.00 0.05 96.74 01:48:01 AM 1 6.07 0.00 0.20 0.00 0.07 93.67 01:49:01 AM all 4.45 0.00 0.20 0.00 0.04 95.31 01:49:01 AM 0 2.66 0.00 0.18 0.00 0.03 97.12 01:49:01 AM 1 6.23 0.00 0.22 0.00 0.05 93.50 01:50:01 AM all 4.82 0.00 0.23 0.00 0.06 94.90 01:50:01 AM 0 3.21 0.00 0.20 0.00 0.07 96.52 01:50:01 AM 1 6.44 0.00 0.25 0.00 0.05 93.25 01:50:01 AM CPU %user %nice %system %iowait %steal %idle 01:51:01 AM all 6.33 0.00 1.55 0.00 0.06 92.07 01:51:01 AM 0 0.80 0.00 0.12 0.00 0.03 99.05 01:51:01 AM 1 12.33 0.00 3.10 0.00 0.09 84.48 01:52:01 AM all 0.33 0.00 0.05 0.00 0.02 99.60 01:52:01 AM 0 0.50 0.00 0.03 0.00 0.02 99.45 01:52:01 AM 1 0.17 0.00 0.07 0.00 0.02 99.75 01:53:01 AM all 0.36 0.00 0.05 0.00 0.03 99.57 01:53:01 AM 0 0.56 0.00 0.03 0.00 0.02 99.39 01:53:01 AM 1 0.15 0.00 0.07 0.00 0.03 99.75 01:54:01 AM all 0.48 0.00 0.08 0.00 0.03 99.42 01:54:01 AM 0 0.80 0.00 0.03 0.00 0.02 99.15 01:54:01 AM 1 0.15 0.00 0.12 0.00 0.03 99.70 01:55:01 AM all 0.35 0.00 0.07 0.00 0.02 99.57 01:55:01 AM 0 0.57 0.00 0.05 0.00 0.02 99.37 01:55:01 AM 1 0.13 0.00 0.08 0.00 0.02 99.77 01:56:01 AM all 0.34 0.00 0.08 0.00 0.03 99.55 01:56:01 AM 0 0.28 0.00 0.08 0.00 0.02 99.62 01:56:01 AM 1 0.40 0.00 0.08 0.00 0.03 99.48 01:57:01 AM all 0.33 0.00 0.06 0.00 0.03 99.58 01:57:01 AM 0 0.12 0.00 0.08 0.00 0.03 99.77 01:57:01 AM 1 0.55 0.00 0.03 0.00 0.02 99.40 01:58:01 AM all 0.50 0.00 0.08 0.00 0.03 99.40 01:58:01 AM 0 0.38 0.00 0.10 0.00 0.02 99.50 01:58:01 AM 1 0.62 0.00 0.05 0.00 0.03 99.30 01:59:01 AM all 0.32 0.00 0.05 0.00 0.03 99.61 01:59:01 AM 0 0.12 0.00 0.07 0.00 0.03 99.78 01:59:01 AM 1 0.52 0.00 0.03 0.00 0.02 99.43 02:00:01 AM all 0.33 0.00 0.09 0.00 0.03 99.55 02:00:01 AM 0 0.35 0.00 0.08 0.00 0.02 99.55 02:00:01 AM 1 0.32 0.00 0.10 0.00 0.03 99.55 02:01:01 AM all 0.36 0.00 0.06 0.00 0.03 99.56 02:01:01 AM 0 0.58 0.00 0.05 0.00 0.02 99.35 02:01:01 AM 1 0.13 0.00 0.07 0.00 0.03 99.77 02:01:01 AM CPU %user %nice %system %iowait %steal %idle 02:02:01 AM all 0.35 0.00 0.12 0.00 0.02 99.52 02:02:01 AM 0 0.48 0.00 0.12 0.00 0.02 99.38 02:02:01 AM 1 0.22 0.00 0.12 0.00 0.02 99.65 02:03:01 AM all 0.12 0.00 0.07 0.00 0.03 99.78 02:03:01 AM 0 0.18 0.00 0.10 0.00 0.05 99.67 02:03:01 AM 1 0.05 0.00 0.03 0.00 0.02 99.90 02:04:01 AM all 3.60 0.00 1.32 0.00 0.04 95.04 02:04:01 AM 0 0.13 0.00 0.12 0.00 0.03 99.72 02:04:01 AM 1 7.23 0.00 2.58 0.00 0.05 90.13 02:05:01 AM all 5.08 0.00 0.25 0.00 0.05 94.62 02:05:01 AM 0 5.53 0.00 0.22 0.00 0.05 94.20 02:05:01 AM 1 4.63 0.00 0.29 0.00 0.05 95.04 02:06:01 AM all 4.44 0.00 0.19 0.00 0.06 95.31 02:06:01 AM 0 6.50 0.00 0.18 0.00 0.07 93.25 02:06:01 AM 1 2.39 0.00 0.20 0.00 0.05 97.36 02:07:01 AM all 4.41 0.00 0.20 0.00 0.04 95.34 02:07:01 AM 0 2.74 0.00 0.23 0.00 0.05 96.97 02:07:01 AM 1 6.09 0.00 0.17 0.00 0.03 93.71 02:08:01 AM all 4.46 0.00 0.18 0.00 0.06 95.29 02:08:01 AM 0 2.56 0.00 0.15 0.00 0.05 97.24 02:08:01 AM 1 6.37 0.00 0.22 0.00 0.07 93.35 02:09:01 AM all 4.46 0.00 0.19 0.00 0.05 95.29 02:09:01 AM 0 4.65 0.00 0.20 0.00 0.05 95.10 02:09:01 AM 1 4.28 0.00 0.18 0.00 0.05 95.49 02:10:01 AM all 4.40 0.00 0.20 0.00 0.05 95.35 02:10:01 AM 0 4.95 0.00 0.20 0.00 0.05 94.80 02:10:01 AM 1 3.84 0.00 0.20 0.00 0.05 95.90 02:11:01 AM all 5.63 0.00 1.31 0.00 0.06 93.00 02:11:01 AM 0 1.02 0.00 0.12 0.00 0.05 98.81 02:11:01 AM 1 10.53 0.00 2.58 0.00 0.07 86.81 02:12:01 AM all 0.34 0.00 0.07 0.00 0.03 99.57 02:12:01 AM 0 0.60 0.00 0.07 0.00 0.03 99.30 02:12:01 AM 1 0.08 0.00 0.07 0.00 0.02 99.83 02:12:01 AM CPU %user %nice %system %iowait %steal %idle 02:13:01 AM all 0.37 0.00 0.08 0.00 0.03 99.52 02:13:01 AM 0 0.45 0.00 0.12 0.00 0.03 99.40 02:13:01 AM 1 0.28 0.00 0.05 0.00 0.02 99.65 02:14:01 AM all 0.33 0.00 0.07 0.00 0.02 99.59 02:14:01 AM 0 0.55 0.00 0.05 0.00 0.02 99.38 02:14:01 AM 1 0.10 0.00 0.08 0.00 0.02 99.80 02:15:01 AM all 0.32 0.00 0.05 0.00 0.03 99.61 02:15:01 AM 0 0.50 0.00 0.03 0.00 0.02 99.45 02:15:01 AM 1 0.13 0.00 0.07 0.00 0.03 99.77 02:16:01 AM all 0.33 0.00 0.09 0.00 0.02 99.57 02:16:01 AM 0 0.37 0.00 0.15 0.00 0.03 99.45 02:16:01 AM 1 0.28 0.00 0.03 0.00 0.00 99.68 02:17:01 AM all 0.34 0.00 0.07 0.00 0.03 99.57 02:17:01 AM 0 0.62 0.00 0.05 0.00 0.03 99.30 02:17:01 AM 1 0.07 0.00 0.08 0.00 0.02 99.83 02:18:01 AM all 0.48 0.00 0.07 0.00 0.03 99.43 02:18:01 AM 0 0.60 0.00 0.07 0.00 0.03 99.30 02:18:01 AM 1 0.35 0.00 0.07 0.00 0.02 99.57 02:19:01 AM all 0.33 0.00 0.05 0.00 0.03 99.59 02:19:01 AM 0 0.55 0.00 0.03 0.00 0.02 99.40 02:19:01 AM 1 0.12 0.00 0.07 0.00 0.03 99.78 02:20:01 AM all 0.34 0.00 0.08 0.00 0.02 99.56 02:20:01 AM 0 0.37 0.00 0.08 0.00 0.02 99.53 02:20:01 AM 1 0.32 0.00 0.08 0.00 0.02 99.58 02:21:01 AM all 0.35 0.00 0.07 0.00 0.03 99.56 02:21:01 AM 0 0.57 0.00 0.05 0.00 0.02 99.37 02:21:01 AM 1 0.13 0.00 0.08 0.00 0.03 99.75 02:22:01 AM all 0.45 0.00 0.08 0.00 0.03 99.44 02:22:01 AM 0 0.58 0.00 0.08 0.00 0.03 99.30 02:22:01 AM 1 0.32 0.00 0.08 0.00 0.02 99.58 02:23:01 AM all 0.38 0.00 0.08 0.00 0.03 99.52 02:23:01 AM 0 0.55 0.00 0.07 0.00 0.02 99.37 02:23:01 AM 1 0.22 0.00 0.08 0.00 0.03 99.67 02:23:01 AM CPU %user %nice %system %iowait %steal %idle 02:24:01 AM all 4.21 0.00 1.42 0.00 0.04 94.33 02:24:01 AM 0 0.15 0.00 0.10 0.00 0.03 99.72 02:24:01 AM 1 8.52 0.00 2.82 0.00 0.05 88.62 02:25:01 AM all 5.09 0.00 0.23 0.00 0.05 94.62 02:25:01 AM 0 2.64 0.00 0.20 0.00 0.05 97.11 02:25:01 AM 1 7.55 0.00 0.27 0.00 0.05 92.13 02:26:01 AM all 4.47 0.00 0.18 0.00 0.06 95.29 02:26:01 AM 0 1.52 0.00 0.12 0.00 0.03 98.33 02:26:01 AM 1 7.42 0.00 0.23 0.00 0.08 92.26 02:27:01 AM all 4.52 0.00 0.22 0.00 0.05 95.21 02:27:01 AM 0 2.61 0.00 0.18 0.00 0.05 97.16 02:27:01 AM 1 6.44 0.00 0.25 0.00 0.05 93.26 02:28:01 AM all 4.45 0.00 0.20 0.00 0.05 95.30 02:28:01 AM 0 1.51 0.00 0.17 0.00 0.05 98.28 02:28:01 AM 1 7.39 0.00 0.23 0.00 0.05 92.32 02:29:01 AM all 4.40 0.00 0.22 0.00 0.04 95.35 02:29:01 AM 0 3.23 0.00 0.22 0.00 0.03 96.52 02:29:01 AM 1 5.57 0.00 0.22 0.00 0.05 94.17 02:30:01 AM all 4.39 0.00 0.18 0.00 0.05 95.38 02:30:01 AM 0 1.15 0.00 0.15 0.00 0.03 98.66 02:30:01 AM 1 7.63 0.00 0.20 0.00 0.07 92.10 02:31:01 AM all 5.43 0.16 1.53 0.01 0.05 92.81 02:31:01 AM 0 4.05 0.00 1.35 0.00 0.05 94.55 02:31:01 AM 1 6.83 0.33 1.72 0.02 0.05 91.05 02:32:01 AM all 0.34 0.00 0.08 0.00 0.02 99.57 02:32:01 AM 0 0.18 0.00 0.10 0.00 0.02 99.70 02:32:01 AM 1 0.50 0.00 0.05 0.00 0.02 99.43 02:33:01 AM all 0.50 0.00 0.08 0.00 0.03 99.39 02:33:01 AM 0 0.13 0.00 0.12 0.00 0.02 99.73 02:33:01 AM 1 0.87 0.00 0.05 0.00 0.03 99.05 02:34:01 AM all 0.34 0.00 0.07 0.00 0.02 99.57 02:34:01 AM 0 0.12 0.00 0.08 0.00 0.02 99.78 02:34:01 AM 1 0.57 0.00 0.05 0.00 0.02 99.37 02:34:01 AM CPU %user %nice %system %iowait %steal %idle 02:35:01 AM all 0.43 0.00 0.08 0.00 0.03 99.47 02:35:01 AM 0 0.13 0.00 0.08 0.00 0.03 99.75 02:35:01 AM 1 0.72 0.00 0.07 0.00 0.02 99.20 02:36:01 AM all 0.31 0.00 0.05 0.01 0.02 99.62 02:36:01 AM 0 0.15 0.00 0.07 0.02 0.02 99.75 02:36:01 AM 1 0.47 0.00 0.03 0.00 0.02 99.48 02:37:01 AM all 0.36 0.00 0.06 0.00 0.03 99.56 02:37:01 AM 0 0.18 0.00 0.10 0.00 0.03 99.68 02:37:01 AM 1 0.53 0.00 0.02 0.00 0.02 99.43 02:38:01 AM all 0.46 0.00 0.07 0.00 0.03 99.45 02:38:01 AM 0 0.10 0.00 0.07 0.00 0.03 99.80 02:38:01 AM 1 0.82 0.00 0.07 0.00 0.02 99.10 02:39:01 AM all 0.34 0.00 0.08 0.00 0.02 99.57 02:39:01 AM 0 0.12 0.00 0.08 0.00 0.02 99.78 02:39:01 AM 1 0.57 0.00 0.07 0.00 0.02 99.35 02:40:01 AM all 0.48 0.00 0.07 0.00 0.03 99.43 02:40:01 AM 0 0.18 0.00 0.08 0.00 0.03 99.70 02:40:01 AM 1 0.77 0.00 0.05 0.00 0.02 99.17 02:41:01 AM all 0.33 0.00 0.08 0.00 0.03 99.57 02:41:01 AM 0 0.22 0.00 0.10 0.00 0.03 99.65 02:41:01 AM 1 0.43 0.00 0.05 0.00 0.02 99.50 02:42:01 AM all 0.46 0.00 0.09 0.00 0.02 99.43 02:42:01 AM 0 0.62 0.00 0.10 0.00 0.02 99.26 02:42:01 AM 1 0.30 0.00 0.08 0.00 0.02 99.60 02:43:01 AM all 0.19 0.00 0.08 0.00 0.03 99.71 02:43:01 AM 0 0.23 0.00 0.05 0.00 0.02 99.70 02:43:01 AM 1 0.15 0.00 0.10 0.00 0.03 99.72 02:44:01 AM all 4.50 0.00 0.53 0.00 0.04 94.93 02:44:01 AM 0 8.25 0.00 0.96 0.00 0.05 90.73 02:44:01 AM 1 0.92 0.00 0.12 0.00 0.03 98.93 02:45:01 AM all 5.58 0.00 2.30 0.00 0.05 92.07 02:45:01 AM 0 5.66 0.00 4.25 0.00 0.05 90.03 02:45:01 AM 1 5.50 0.00 0.40 0.00 0.05 94.05 02:45:01 AM CPU %user %nice %system %iowait %steal %idle 02:46:01 AM all 4.36 0.00 0.37 0.00 0.05 95.22 02:46:01 AM 0 2.44 0.00 0.23 0.00 0.05 97.27 02:46:01 AM 1 6.28 0.00 0.50 0.00 0.05 93.16 02:47:01 AM all 4.38 0.00 0.33 0.00 0.05 95.23 02:47:01 AM 0 5.39 0.00 0.40 0.00 0.05 94.16 02:47:01 AM 1 3.38 0.00 0.27 0.00 0.05 96.31 02:48:01 AM all 4.45 0.00 0.37 0.00 0.05 95.13 02:48:01 AM 0 2.37 0.00 0.25 0.00 0.03 97.34 02:48:01 AM 1 6.52 0.00 0.48 0.00 0.07 92.93 02:49:01 AM all 4.42 0.00 0.38 0.00 0.05 95.14 02:49:01 AM 0 4.38 0.00 0.37 0.00 0.05 95.20 02:49:01 AM 1 4.46 0.00 0.40 0.00 0.05 95.09 02:50:01 AM all 4.45 0.00 0.34 0.00 0.05 95.16 02:50:01 AM 0 1.81 0.00 0.20 0.00 0.05 97.94 02:50:01 AM 1 7.09 0.00 0.48 0.00 0.05 92.38 02:51:01 AM all 5.99 0.00 0.37 0.00 0.05 93.60 02:51:01 AM 0 4.58 0.00 0.28 0.00 0.05 95.09 02:51:01 AM 1 7.39 0.00 0.45 0.00 0.05 92.11 02:52:01 AM all 0.53 0.00 0.08 0.00 0.03 99.36 02:52:01 AM 0 0.57 0.00 0.07 0.00 0.02 99.35 02:52:01 AM 1 0.50 0.00 0.10 0.00 0.03 99.37 02:53:01 AM all 0.33 0.00 0.06 0.00 0.03 99.58 02:53:01 AM 0 0.52 0.00 0.02 0.00 0.02 99.45 02:53:01 AM 1 0.15 0.00 0.10 0.00 0.03 99.72 02:54:01 AM all 0.53 0.00 0.08 0.00 0.03 99.37 02:54:01 AM 0 0.62 0.00 0.08 0.00 0.03 99.26 02:54:01 AM 1 0.43 0.00 0.08 0.00 0.02 99.47 02:55:01 AM all 0.34 0.00 0.07 0.00 0.03 99.57 02:55:01 AM 0 0.55 0.00 0.07 0.00 0.03 99.35 02:55:01 AM 1 0.13 0.00 0.07 0.00 0.02 99.78 02:56:01 AM all 0.51 0.00 0.06 0.00 0.03 99.41 02:56:01 AM 0 0.38 0.00 0.05 0.00 0.02 99.55 02:56:01 AM 1 0.63 0.00 0.07 0.00 0.03 99.27 02:56:01 AM CPU %user %nice %system %iowait %steal %idle 02:57:01 AM all 0.34 0.00 0.07 0.00 0.02 99.57 02:57:01 AM 0 0.13 0.00 0.07 0.00 0.02 99.78 02:57:01 AM 1 0.55 0.00 0.07 0.00 0.02 99.37 02:58:01 AM all 1.94 0.00 0.11 0.00 0.04 97.91 02:58:01 AM 0 1.99 0.00 0.08 0.00 0.03 97.89 02:58:01 AM 1 1.89 0.00 0.13 0.00 0.05 97.92 02:59:01 AM all 6.84 0.00 2.59 0.00 0.06 90.50 02:59:01 AM 0 2.67 0.00 0.32 0.00 0.05 96.95 02:59:01 AM 1 11.26 0.00 5.00 0.00 0.07 83.66 03:00:01 AM all 3.31 0.00 1.76 0.00 0.03 94.90 03:00:01 AM 0 6.23 0.00 3.52 0.00 0.05 90.20 03:00:01 AM 1 0.50 0.00 0.07 0.00 0.02 99.42 03:01:02 AM all 0.39 0.00 0.09 0.00 0.02 99.50 03:01:02 AM 0 0.35 0.00 0.10 0.00 0.02 99.53 03:01:02 AM 1 0.43 0.00 0.08 0.00 0.02 99.47 03:02:01 AM all 3.29 0.00 0.87 0.00 0.03 95.81 03:02:01 AM 0 6.24 0.00 1.60 0.00 0.04 92.12 03:02:01 AM 1 0.44 0.00 0.15 0.00 0.03 99.37 03:03:01 AM all 5.63 0.00 0.92 0.00 0.05 93.40 03:03:01 AM 0 6.09 0.00 1.66 0.00 0.05 92.20 03:03:01 AM 1 5.18 0.00 0.20 0.00 0.05 94.57 03:04:01 AM all 4.45 0.00 0.17 0.00 0.05 95.34 03:04:01 AM 0 2.73 0.00 0.13 0.00 0.05 97.09 03:04:01 AM 1 6.17 0.00 0.20 0.00 0.05 93.58 03:05:01 AM all 4.47 0.00 0.18 0.00 0.05 95.29 03:05:01 AM 0 2.04 0.00 0.17 0.00 0.05 97.74 03:05:01 AM 1 6.90 0.00 0.20 0.00 0.05 92.85 03:06:01 AM all 4.55 0.00 0.21 0.00 0.03 95.20 03:06:01 AM 0 1.19 0.00 0.20 0.00 0.03 98.58 03:06:01 AM 1 7.91 0.00 0.22 0.00 0.03 91.83 03:07:01 AM all 4.66 0.00 0.18 0.00 0.04 95.12 03:07:01 AM 0 1.61 0.00 0.18 0.00 0.03 98.17 03:07:01 AM 1 7.70 0.00 0.18 0.00 0.05 92.07 03:07:01 AM CPU %user %nice %system %iowait %steal %idle 03:08:01 AM all 4.49 0.00 0.19 0.00 0.03 95.28 03:08:01 AM 0 5.29 0.00 0.20 0.00 0.03 94.47 03:08:01 AM 1 3.69 0.00 0.18 0.00 0.03 96.09 03:09:01 AM all 6.05 0.00 0.38 0.00 0.05 93.52 03:09:01 AM 0 1.19 0.00 0.15 0.00 0.05 98.61 03:09:01 AM 1 11.13 0.00 0.61 0.00 0.05 88.21 03:10:01 AM all 6.88 0.00 2.71 0.00 0.06 90.35 03:10:01 AM 0 0.67 0.00 0.15 0.00 0.03 99.15 03:10:01 AM 1 13.69 0.00 5.51 0.00 0.09 80.71 03:11:01 AM all 5.39 0.00 0.25 0.00 0.05 94.30 03:11:01 AM 0 1.72 0.00 0.17 0.00 0.03 98.08 03:11:01 AM 1 9.11 0.00 0.34 0.00 0.07 90.48 03:12:01 AM all 4.50 0.00 0.15 0.01 0.05 95.29 03:12:01 AM 0 2.41 0.00 0.15 0.02 0.05 97.38 03:12:01 AM 1 6.59 0.00 0.15 0.00 0.05 93.21 03:13:01 AM all 4.29 0.00 0.18 0.00 0.03 95.50 03:13:01 AM 0 1.51 0.00 0.17 0.00 0.02 98.31 03:13:01 AM 1 7.08 0.00 0.18 0.00 0.03 92.71 03:14:01 AM all 4.42 0.00 0.22 0.00 0.05 95.31 03:14:01 AM 0 3.93 0.00 0.25 0.00 0.05 95.77 03:14:01 AM 1 4.92 0.00 0.18 0.00 0.05 94.85 03:15:01 AM all 4.46 0.00 0.17 0.00 0.05 95.33 03:15:01 AM 0 2.71 0.00 0.17 0.00 0.05 97.07 03:15:01 AM 1 6.21 0.00 0.17 0.00 0.05 93.58 03:16:01 AM all 4.41 0.00 0.19 0.00 0.04 95.35 03:16:01 AM 0 2.11 0.00 0.17 0.00 0.03 97.69 03:16:01 AM 1 6.72 0.00 0.22 0.00 0.05 93.01 03:17:01 AM all 6.33 0.00 1.47 0.00 0.05 92.15 03:17:01 AM 0 11.52 0.00 2.88 0.00 0.07 85.53 03:17:01 AM 1 1.45 0.00 0.15 0.00 0.03 98.36 03:18:01 AM all 7.26 0.00 2.64 0.00 0.07 90.03 03:18:01 AM 0 0.52 0.00 0.17 0.00 0.03 99.28 03:18:01 AM 1 14.56 0.00 5.31 0.00 0.11 80.02 03:18:01 AM CPU %user %nice %system %iowait %steal %idle 03:19:01 AM all 4.84 0.00 0.32 0.00 0.04 94.80 03:19:01 AM 0 1.05 0.00 0.15 0.00 0.03 98.76 03:19:01 AM 1 8.64 0.00 0.49 0.00 0.05 90.82 03:20:01 AM all 4.63 0.00 0.33 0.00 0.04 94.99 03:20:01 AM 0 2.84 0.00 0.25 0.00 0.05 96.86 03:20:01 AM 1 6.42 0.00 0.42 0.00 0.03 93.13 03:21:01 AM all 4.39 0.00 0.31 0.00 0.03 95.26 03:21:01 AM 0 1.46 0.00 0.17 0.00 0.02 98.36 03:21:01 AM 1 7.33 0.00 0.45 0.00 0.05 92.16 03:22:01 AM all 4.31 0.00 0.33 0.00 0.05 95.32 03:22:01 AM 0 2.98 0.00 0.23 0.00 0.05 96.74 03:22:01 AM 1 5.63 0.00 0.42 0.00 0.05 93.90 03:23:01 AM all 4.30 0.00 0.34 0.00 0.04 95.31 03:23:01 AM 0 3.85 0.00 0.32 0.00 0.03 95.80 03:23:01 AM 1 4.75 0.00 0.37 0.00 0.05 94.83 03:24:01 AM all 5.57 0.00 0.40 0.00 0.03 93.99 03:24:01 AM 0 4.99 0.00 0.35 0.00 0.03 94.62 03:24:01 AM 1 6.15 0.00 0.45 0.00 0.03 93.36 03:25:01 AM all 3.05 0.00 0.20 0.00 0.03 96.72 03:25:01 AM 0 3.97 0.00 0.22 0.00 0.03 95.78 03:25:01 AM 1 2.14 0.00 0.18 0.00 0.03 97.64 03:26:01 AM all 0.34 0.00 0.06 0.00 0.03 99.57 03:26:01 AM 0 0.10 0.00 0.08 0.00 0.03 99.78 03:26:01 AM 1 0.58 0.00 0.03 0.00 0.02 99.37 03:27:01 AM all 0.36 0.00 0.07 0.00 0.02 99.56 03:27:01 AM 0 0.13 0.00 0.08 0.00 0.02 99.77 03:27:01 AM 1 0.58 0.00 0.05 0.00 0.02 99.35 03:28:01 AM all 0.50 0.00 0.08 0.00 0.02 99.41 03:28:01 AM 0 0.13 0.00 0.08 0.00 0.02 99.77 03:28:01 AM 1 0.87 0.00 0.07 0.00 0.02 99.05 03:29:01 AM all 0.28 0.00 0.07 0.00 0.03 99.63 03:29:01 AM 0 0.17 0.00 0.08 0.00 0.03 99.72 03:29:01 AM 1 0.38 0.00 0.05 0.00 0.02 99.55 03:29:01 AM CPU %user %nice %system %iowait %steal %idle 03:30:01 AM all 0.33 0.00 0.08 0.00 0.02 99.57 03:30:01 AM 0 0.27 0.00 0.10 0.00 0.02 99.61 03:30:01 AM 1 0.40 0.00 0.07 0.00 0.02 99.52 03:31:01 AM all 0.35 0.00 0.07 0.00 0.02 99.57 03:31:01 AM 0 0.53 0.00 0.03 0.00 0.02 99.42 03:31:01 AM 1 0.17 0.00 0.10 0.00 0.02 99.72 03:32:01 AM all 4.53 0.00 3.21 0.00 0.05 92.21 03:32:01 AM 0 4.47 0.00 6.13 0.00 0.05 89.34 03:32:01 AM 1 4.58 0.00 0.32 0.00 0.05 95.05 03:33:01 AM all 6.58 0.00 2.33 0.00 0.05 91.04 03:33:01 AM 0 13.48 0.00 4.71 0.00 0.07 81.74 03:33:01 AM 1 0.27 0.00 0.15 0.00 0.03 99.55 03:34:01 AM all 0.86 0.00 0.09 0.00 0.03 99.02 03:34:01 AM 0 1.32 0.00 0.10 0.00 0.02 98.56 03:34:01 AM 1 0.40 0.00 0.08 0.00 0.03 99.48 03:35:01 AM all 0.34 0.00 0.10 0.00 0.03 99.53 03:35:01 AM 0 0.12 0.00 0.12 0.00 0.03 99.73 03:35:01 AM 1 0.57 0.00 0.08 0.00 0.02 99.33 03:36:01 AM all 6.03 0.00 1.68 0.00 0.06 92.23 03:36:01 AM 0 11.79 0.00 3.31 0.00 0.07 84.83 03:36:01 AM 1 0.73 0.00 0.18 0.00 0.05 99.03 03:37:01 AM all 6.90 0.00 3.39 0.00 0.07 89.64 03:37:01 AM 0 6.19 0.00 3.39 0.00 0.07 90.34 03:37:01 AM 1 7.60 0.00 3.39 0.00 0.07 88.94 03:38:01 AM all 7.39 0.00 2.05 0.00 0.10 90.46 03:38:01 AM 0 11.61 0.00 3.97 0.00 0.11 84.31 03:38:01 AM 1 3.44 0.00 0.24 0.00 0.08 96.24 03:39:01 AM all 3.95 0.00 1.49 0.00 0.06 94.49 03:39:01 AM 0 0.32 0.00 0.15 0.00 0.03 99.50 03:39:01 AM 1 7.79 0.00 2.91 0.00 0.09 89.21 03:40:01 AM all 0.38 0.00 0.08 0.00 0.03 99.51 03:40:01 AM 0 0.10 0.00 0.08 0.00 0.03 99.78 03:40:01 AM 1 0.65 0.00 0.08 0.00 0.03 99.23 03:40:01 AM CPU %user %nice %system %iowait %steal %idle 03:41:01 AM all 3.34 0.00 0.31 0.00 0.04 96.31 03:41:01 AM 0 2.77 0.00 0.31 0.00 0.05 96.88 03:41:01 AM 1 3.91 0.00 0.30 0.00 0.03 95.75 03:42:01 AM all 6.22 0.00 2.55 0.00 0.05 91.18 03:42:01 AM 0 8.70 0.00 4.87 0.00 0.05 86.38 03:42:01 AM 1 3.84 0.00 0.33 0.00 0.05 95.77 03:43:01 AM all 4.57 0.00 0.32 0.00 0.04 95.07 03:43:01 AM 0 2.02 0.00 0.22 0.00 0.05 97.71 03:43:01 AM 1 7.11 0.00 0.42 0.00 0.03 92.44 03:44:01 AM all 4.51 0.00 0.33 0.00 0.04 95.12 03:44:01 AM 0 2.36 0.00 0.20 0.00 0.03 97.41 03:44:01 AM 1 6.66 0.00 0.47 0.00 0.05 92.82 03:45:01 AM all 4.47 0.00 0.34 0.00 0.05 95.13 03:45:01 AM 0 4.20 0.00 0.32 0.00 0.05 95.43 03:45:01 AM 1 4.75 0.00 0.37 0.00 0.05 94.84 03:46:01 AM all 4.46 0.00 0.31 0.00 0.03 95.20 03:46:01 AM 0 4.35 0.00 0.33 0.00 0.03 95.28 03:46:01 AM 1 4.57 0.00 0.28 0.00 0.03 95.12 03:47:01 AM all 4.45 0.00 0.34 0.00 0.05 95.16 03:47:01 AM 0 3.38 0.00 0.25 0.00 0.05 96.32 03:47:01 AM 1 5.51 0.00 0.43 0.00 0.05 94.00 03:48:01 AM all 6.77 0.00 0.44 0.00 0.05 92.75 03:48:01 AM 0 7.40 0.00 0.45 0.00 0.05 92.10 03:48:01 AM 1 6.14 0.00 0.42 0.00 0.05 93.39 03:49:01 AM all 0.89 0.00 0.10 0.00 0.03 98.98 03:49:01 AM 0 0.90 0.00 0.12 0.00 0.03 98.95 03:49:01 AM 1 0.87 0.00 0.08 0.00 0.03 99.01 03:50:01 AM all 0.99 0.00 0.13 0.00 0.03 98.86 03:50:01 AM 0 1.27 0.00 0.17 0.00 0.03 98.53 03:50:01 AM 1 0.70 0.00 0.08 0.00 0.02 99.20 03:51:01 AM all 1.02 0.00 0.10 0.01 0.03 98.84 03:51:01 AM 0 0.99 0.00 0.13 0.00 0.03 98.85 03:51:01 AM 1 1.05 0.00 0.07 0.02 0.03 98.83 03:51:01 AM CPU %user %nice %system %iowait %steal %idle 03:52:01 AM all 0.94 0.00 0.13 0.00 0.03 98.91 03:52:01 AM 0 1.09 0.00 0.15 0.00 0.03 98.73 03:52:01 AM 1 0.78 0.00 0.12 0.00 0.02 99.08 03:53:01 AM all 0.93 0.00 0.12 0.00 0.03 98.92 03:53:01 AM 0 1.05 0.00 0.13 0.00 0.03 98.78 03:53:01 AM 1 0.80 0.00 0.10 0.00 0.03 99.06 03:54:01 AM all 2.67 0.00 0.20 0.00 0.04 97.09 03:54:01 AM 0 3.56 0.00 0.24 0.00 0.03 96.17 03:54:01 AM 1 1.79 0.00 0.17 0.00 0.05 98.00 03:55:01 AM all 6.57 0.00 3.45 0.00 0.06 89.92 03:55:01 AM 0 9.82 0.00 6.73 0.00 0.07 83.37 03:55:01 AM 1 3.48 0.00 0.34 0.00 0.05 96.13 03:56:01 AM all 6.97 0.00 3.55 0.00 0.06 89.41 03:56:01 AM 0 0.68 0.00 0.15 0.00 0.03 99.13 03:56:01 AM 1 13.79 0.00 7.24 0.00 0.09 78.88 03:57:01 AM all 6.84 0.00 1.74 0.00 0.05 91.37 03:57:01 AM 0 2.65 0.00 0.31 0.00 0.03 97.01 03:57:01 AM 1 11.28 0.00 3.26 0.00 0.07 85.38 03:58:01 AM all 6.98 0.00 2.25 0.00 0.07 90.70 03:58:01 AM 0 0.45 0.00 0.12 0.00 0.03 99.40 03:58:01 AM 1 14.05 0.00 4.57 0.00 0.11 81.27 03:59:01 AM all 7.05 0.00 2.90 0.00 0.06 89.99 03:59:01 AM 0 0.63 0.00 0.13 0.00 0.03 99.20 03:59:01 AM 1 14.06 0.00 5.93 0.00 0.09 79.92 04:00:01 AM all 6.91 0.00 2.55 0.00 0.06 90.48 04:00:01 AM 0 9.56 0.00 4.91 0.00 0.07 85.45 04:00:01 AM 1 4.39 0.00 0.30 0.00 0.05 95.26 04:01:01 AM all 4.80 0.00 0.36 0.00 0.05 94.79 04:01:01 AM 0 4.52 0.00 0.32 0.00 0.05 95.12 04:01:01 AM 1 5.08 0.00 0.40 0.00 0.05 94.47 04:02:01 AM all 4.42 0.00 0.33 0.00 0.03 95.21 04:02:01 AM 0 4.15 0.00 0.35 0.00 0.03 95.46 04:02:01 AM 1 4.70 0.00 0.32 0.00 0.03 94.95 04:02:01 AM CPU %user %nice %system %iowait %steal %idle 04:03:01 AM all 4.55 0.00 0.34 0.00 0.04 95.07 04:03:01 AM 0 3.05 0.00 0.25 0.00 0.05 96.65 04:03:01 AM 1 6.05 0.00 0.43 0.00 0.03 93.48 04:04:01 AM all 4.52 0.00 0.31 0.00 0.04 95.12 04:04:01 AM 0 1.92 0.00 0.15 0.00 0.03 97.89 04:04:01 AM 1 7.13 0.00 0.47 0.00 0.05 92.36 04:05:01 AM all 4.32 0.00 0.33 0.00 0.05 95.30 04:05:01 AM 0 3.48 0.00 0.27 0.00 0.05 96.20 04:05:01 AM 1 5.16 0.00 0.38 0.00 0.05 94.40 04:06:01 AM all 4.44 0.00 0.33 0.00 0.04 95.18 04:06:01 AM 0 2.88 0.00 0.25 0.00 0.03 96.84 04:06:01 AM 1 6.00 0.00 0.42 0.00 0.05 93.53 04:07:01 AM all 4.87 0.00 0.28 0.00 0.04 94.81 04:07:01 AM 0 2.43 0.00 0.27 0.00 0.05 97.26 04:07:01 AM 1 7.32 0.00 0.28 0.00 0.03 92.37 04:08:01 AM all 0.29 0.00 0.07 0.00 0.02 99.62 04:08:01 AM 0 0.13 0.00 0.07 0.00 0.02 99.78 04:08:01 AM 1 0.45 0.00 0.07 0.00 0.02 99.47 04:09:02 AM all 0.33 0.00 0.05 0.00 0.02 99.60 04:09:02 AM 0 0.07 0.00 0.03 0.00 0.02 99.88 04:09:02 AM 1 0.60 0.00 0.07 0.00 0.02 99.32 04:10:01 AM all 0.56 0.00 0.06 0.00 0.03 99.35 04:10:01 AM 0 0.49 0.00 0.05 0.00 0.02 99.44 04:10:01 AM 1 0.63 0.00 0.07 0.00 0.03 99.27 04:11:01 AM all 0.13 0.00 0.08 0.00 0.02 99.77 04:11:01 AM 0 0.03 0.00 0.03 0.00 0.00 99.93 04:11:01 AM 1 0.23 0.00 0.12 0.00 0.03 99.61 04:12:01 AM all 0.53 0.00 0.08 0.01 0.02 99.37 04:12:01 AM 0 0.38 0.00 0.07 0.02 0.02 99.52 04:12:01 AM 1 0.67 0.00 0.10 0.00 0.02 99.22 04:13:01 AM all 0.26 0.00 0.08 0.00 0.03 99.64 04:13:01 AM 0 0.05 0.00 0.03 0.00 0.02 99.90 04:13:01 AM 1 0.47 0.00 0.12 0.00 0.03 99.38 04:13:01 AM CPU %user %nice %system %iowait %steal %idle 04:14:01 AM all 3.39 0.00 1.36 0.00 0.03 95.22 04:14:01 AM 0 5.39 0.00 2.58 0.00 0.02 92.01 04:14:01 AM 1 1.45 0.00 0.18 0.00 0.03 98.33 04:15:01 AM all 6.53 0.00 3.27 0.00 0.06 90.14 04:15:01 AM 0 6.49 0.00 4.05 0.00 0.07 89.39 04:15:01 AM 1 6.57 0.00 2.51 0.00 0.05 90.87 04:16:01 AM all 2.06 0.00 0.69 0.00 0.03 97.22 04:16:01 AM 0 1.21 0.00 1.16 0.00 0.05 97.58 04:16:01 AM 1 2.92 0.00 0.22 0.00 0.02 96.85 04:17:01 AM all 0.36 0.00 0.08 0.00 0.03 99.54 04:17:01 AM 0 0.57 0.00 0.03 0.00 0.02 99.38 04:17:01 AM 1 0.15 0.00 0.12 0.00 0.03 99.70 04:18:01 AM all 4.61 0.00 1.49 0.00 0.05 93.85 04:18:01 AM 0 0.68 0.00 0.12 0.00 0.03 99.16 04:18:01 AM 1 8.78 0.00 2.95 0.00 0.07 88.19 04:19:01 AM all 0.43 0.00 0.13 0.00 0.03 99.41 04:19:01 AM 0 0.35 0.00 0.13 0.00 0.03 99.48 04:19:01 AM 1 0.50 0.00 0.13 0.00 0.03 99.33 04:20:01 AM all 5.06 0.20 2.04 0.00 0.04 92.66 04:20:01 AM 0 9.71 0.00 3.94 0.00 0.05 86.30 04:20:01 AM 1 0.67 0.38 0.25 0.00 0.03 98.66 04:21:01 AM all 0.38 0.00 0.08 0.00 0.02 99.53 04:21:01 AM 0 0.15 0.00 0.08 0.00 0.02 99.75 04:21:01 AM 1 0.60 0.00 0.07 0.00 0.02 99.32 04:22:01 AM all 2.04 0.00 0.18 0.00 0.03 97.75 04:22:01 AM 0 1.07 0.00 0.15 0.00 0.03 98.74 04:22:01 AM 1 3.03 0.00 0.20 0.00 0.03 96.73 04:23:01 AM all 6.61 0.00 2.54 0.00 0.06 90.79 04:23:01 AM 0 1.47 0.00 0.27 0.00 0.03 98.23 04:23:01 AM 1 12.08 0.00 4.96 0.00 0.09 82.87 04:24:01 AM all 4.49 0.00 0.33 0.00 0.03 95.15 04:24:01 AM 0 4.87 0.00 0.30 0.00 0.03 94.80 04:24:01 AM 1 4.11 0.00 0.35 0.00 0.03 95.50 04:24:01 AM CPU %user %nice %system %iowait %steal %idle 04:25:01 AM all 4.41 0.00 0.34 0.00 0.05 95.20 04:25:01 AM 0 3.70 0.00 0.32 0.00 0.05 95.94 04:25:01 AM 1 5.12 0.00 0.37 0.00 0.05 94.47 04:26:01 AM all 4.52 0.00 0.34 0.00 0.04 95.09 04:26:01 AM 0 1.47 0.00 0.17 0.00 0.03 98.33 04:26:01 AM 1 7.57 0.00 0.52 0.00 0.05 91.86 04:27:01 AM all 4.48 0.00 0.37 0.00 0.06 95.09 04:27:01 AM 0 4.12 0.00 0.33 0.00 0.05 95.50 04:27:01 AM 1 4.84 0.00 0.40 0.00 0.07 94.69 04:28:01 AM all 4.42 0.00 0.31 0.00 0.03 95.23 04:28:01 AM 0 2.96 0.00 0.25 0.00 0.03 96.76 04:28:01 AM 1 5.89 0.00 0.37 0.00 0.03 93.71 04:29:01 AM all 7.67 0.00 0.44 0.00 0.05 91.83 04:29:01 AM 0 6.65 0.00 0.44 0.00 0.05 92.87 04:29:01 AM 1 8.70 0.00 0.45 0.00 0.05 90.80 04:30:01 AM all 0.68 0.00 0.08 0.00 0.03 99.21 04:30:01 AM 0 0.65 0.00 0.07 0.00 0.03 99.25 04:30:01 AM 1 0.70 0.00 0.10 0.00 0.03 99.17 04:31:01 AM all 0.35 0.00 0.08 0.00 0.02 99.56 04:31:01 AM 0 0.58 0.00 0.07 0.00 0.02 99.33 04:31:01 AM 1 0.12 0.00 0.08 0.00 0.02 99.78 04:32:01 AM all 0.50 0.00 0.07 0.00 0.03 99.41 04:32:01 AM 0 0.53 0.00 0.03 0.00 0.02 99.42 04:32:01 AM 1 0.47 0.00 0.10 0.00 0.03 99.40 04:33:01 AM all 0.35 0.00 0.07 0.00 0.02 99.57 04:33:01 AM 0 0.53 0.00 0.03 0.00 0.02 99.42 04:33:01 AM 1 0.17 0.00 0.10 0.00 0.02 99.72 04:34:01 AM all 0.33 0.00 0.06 0.00 0.02 99.59 04:34:01 AM 0 0.52 0.00 0.05 0.00 0.02 99.42 04:34:01 AM 1 0.15 0.00 0.07 0.00 0.02 99.77 04:35:01 AM all 0.51 0.00 0.07 0.00 0.03 99.40 04:35:01 AM 0 0.60 0.00 0.05 0.00 0.02 99.33 04:35:01 AM 1 0.42 0.00 0.08 0.00 0.03 99.47 04:35:01 AM CPU %user %nice %system %iowait %steal %idle 04:36:01 AM all 0.35 0.00 0.06 0.00 0.02 99.57 04:36:01 AM 0 0.52 0.00 0.00 0.00 0.02 99.47 04:36:01 AM 1 0.18 0.00 0.12 0.00 0.02 99.68 04:37:01 AM all 4.90 0.00 2.87 0.00 0.06 92.16 04:37:01 AM 0 1.17 0.00 0.13 0.00 0.03 98.66 04:37:01 AM 1 8.89 0.00 5.80 0.00 0.09 85.21 04:38:01 AM all 7.13 0.00 3.55 0.00 0.06 89.26 04:38:01 AM 0 1.55 0.00 0.28 0.00 0.03 98.13 04:38:01 AM 1 13.23 0.00 7.12 0.00 0.09 79.56 04:39:01 AM all 7.14 0.00 3.67 0.00 0.07 89.13 04:39:01 AM 0 11.25 0.00 7.07 0.00 0.09 81.58 04:39:01 AM 1 3.28 0.00 0.47 0.00 0.05 96.20 04:40:01 AM all 7.66 0.00 3.63 0.00 0.07 88.64 04:40:01 AM 0 13.41 0.00 7.27 0.00 0.09 79.23 04:40:01 AM 1 2.33 0.00 0.25 0.00 0.05 97.36 04:41:01 AM all 7.35 0.00 3.51 0.00 0.06 89.08 04:41:01 AM 0 0.54 0.00 0.30 0.00 0.05 99.11 04:41:01 AM 1 14.82 0.00 7.02 0.00 0.07 78.08 04:42:01 AM all 7.08 0.00 4.34 0.01 0.07 88.50 04:42:01 AM 0 9.72 0.00 6.73 0.00 0.07 83.48 04:42:01 AM 1 4.53 0.00 2.04 0.02 0.07 93.34 04:43:01 AM all 6.86 0.00 4.56 0.00 0.06 88.52 04:43:01 AM 0 0.89 0.00 0.23 0.00 0.03 98.85 04:43:01 AM 1 13.43 0.00 9.31 0.00 0.09 77.17 04:44:01 AM all 18.83 0.00 2.79 0.01 0.08 78.30 04:44:01 AM 0 7.43 0.00 1.32 0.02 0.07 91.17 04:44:01 AM 1 30.67 0.00 4.31 0.00 0.09 64.93 04:45:01 AM all 28.86 0.00 3.43 0.48 0.07 67.16 04:45:01 AM 0 25.78 0.00 3.09 0.40 0.07 70.66 04:45:01 AM 1 31.94 0.00 3.77 0.55 0.07 63.67 Average: all 3.27 0.00 0.59 0.00 0.04 96.09 Average: 0 2.61 0.00 0.53 0.00 0.04 96.82 Average: 1 3.94 0.00 0.66 0.00 0.04 95.36