Started by upstream project "integration-distribution-mri-test-scandium" build number 3 originally caused by: Started by timer Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on prd-centos8-robot-2c-8g-16416 (centos8-robot-2c-8g) in workspace /w/workspace/controller-csit-3node-clustering-tell-all-scandium [ssh-agent] Looking for ssh-agent implementation... [ssh-agent] Exec ssh-agent (binary ssh-agent on a remote machine) $ ssh-agent SSH_AUTH_SOCK=/tmp/ssh-1ZScZrXHCtKl/agent.5268 SSH_AGENT_PID=5269 [ssh-agent] Started. Running ssh-add (command line suppressed) Identity added: /w/workspace/controller-csit-3node-clustering-tell-all-scandium@tmp/private_key_1664668735304058053.key (/w/workspace/controller-csit-3node-clustering-tell-all-scandium@tmp/private_key_1664668735304058053.key) [ssh-agent] Using credentials jenkins (Release Engineering Jenkins Key) The recommended git tool is: NONE using credential opendaylight-jenkins-ssh Wiping out workspace first. Cloning the remote Git repository Cloning repository git://devvexx.opendaylight.org/mirror/integration/test > git init /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test # timeout=10 Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test > git --version # timeout=10 > git --version # 'git version 2.43.0' using GIT_SSH to set credentials Release Engineering Jenkins Key [INFO] Currently running in a labeled security context [INFO] Currently SELinux is 'enforcing' on the host > /usr/bin/chcon --type=ssh_home_t /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test@tmp/jenkins-gitclient-ssh11958167655395581899.key Verifying host key using known hosts file You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification. > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10 Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test using GIT_SSH to set credentials Release Engineering Jenkins Key [INFO] Currently running in a labeled security context [INFO] Currently SELinux is 'enforcing' on the host > /usr/bin/chcon --type=ssh_home_t /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test@tmp/jenkins-gitclient-ssh7136956847562593172.key Verifying host key using known hosts file You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification. > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test master # timeout=10 > git rev-parse FETCH_HEAD^{commit} # timeout=10 Checking out Revision 02dd570f7544c8cd6eb17bda775de9bccc89f923 (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f 02dd570f7544c8cd6eb17bda775de9bccc89f923 # timeout=10 Commit message: "Migrate Get Requests invocations(libraries)" > git rev-parse FETCH_HEAD^{commit} # timeout=10 > git rev-list --no-walk c88ead2b4a65ba004398ad07cfe033ae1e467b17 # timeout=10 No emails were triggered. provisioning config files... copy managed file [npmrc] to file:/home/jenkins/.npmrc copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins13725294411635143466.sh ---> python-tools-install.sh Setup pyenv: system * 3.8.13 (set by /opt/pyenv/version) * 3.9.13 (set by /opt/pyenv/version) * 3.10.13 (set by /opt/pyenv/version) * 3.11.7 (set by /opt/pyenv/version) lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-C3xR lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools lf-activate-venv(): INFO: Adding /tmp/venv-C3xR/bin to PATH Generating Requirements File Python 3.11.7 pip 24.0 from /tmp/venv-C3xR/lib/python3.11/site-packages/pip (python 3.11) appdirs==1.4.4 argcomplete==3.3.0 aspy.yaml==1.3.0 attrs==23.2.0 autopage==0.5.2 beautifulsoup4==4.12.3 boto3==1.34.93 botocore==1.34.93 bs4==0.0.2 cachetools==5.3.3 certifi==2024.2.2 cffi==1.16.0 cfgv==3.4.0 chardet==5.2.0 charset-normalizer==3.3.2 click==8.1.7 cliff==4.6.0 cmd2==2.4.3 cryptography==3.3.2 debtcollector==3.0.0 decorator==5.1.1 defusedxml==0.7.1 Deprecated==1.2.14 distlib==0.3.8 dnspython==2.6.1 docker==4.2.2 dogpile.cache==1.3.2 email_validator==2.1.1 filelock==3.13.4 future==1.0.0 gitdb==4.0.11 GitPython==3.1.43 google-auth==2.29.0 httplib2==0.22.0 identify==2.5.36 idna==3.7 importlib-resources==1.5.0 iso8601==2.1.0 Jinja2==3.1.3 jmespath==1.0.1 jsonpatch==1.33 jsonpointer==2.4 jsonschema==4.21.1 jsonschema-specifications==2023.12.1 keystoneauth1==5.6.0 kubernetes==29.0.0 lftools==0.37.10 lxml==5.2.1 MarkupSafe==2.1.5 msgpack==1.0.8 multi_key_dict==2.0.3 munch==4.0.0 netaddr==1.2.1 netifaces==0.11.0 niet==1.4.2 nodeenv==1.8.0 oauth2client==4.1.3 oauthlib==3.2.2 openstacksdk==3.1.0 os-client-config==2.1.0 os-service-types==1.7.0 osc-lib==3.0.1 oslo.config==9.4.0 oslo.context==5.5.0 oslo.i18n==6.3.0 oslo.log==5.5.1 oslo.serialization==5.4.0 oslo.utils==7.1.0 packaging==24.0 pbr==6.0.0 platformdirs==4.2.1 prettytable==3.10.0 pyasn1==0.6.0 pyasn1_modules==0.4.0 pycparser==2.22 pygerrit2==2.0.15 PyGithub==2.3.0 pyinotify==0.9.6 PyJWT==2.8.0 PyNaCl==1.5.0 pyparsing==2.4.7 pyperclip==1.8.2 pyrsistent==0.20.0 python-cinderclient==9.5.0 python-dateutil==2.9.0.post0 python-heatclient==3.5.0 python-jenkins==1.8.2 python-keystoneclient==5.4.0 python-magnumclient==4.4.0 python-novaclient==18.6.0 python-openstackclient==6.6.0 python-swiftclient==4.5.0 PyYAML==6.0.1 referencing==0.35.0 requests==2.31.0 requests-oauthlib==2.0.0 requestsexceptions==1.4.0 rfc3986==2.0.0 rpds-py==0.18.0 rsa==4.9 ruamel.yaml==0.18.6 ruamel.yaml.clib==0.2.8 s3transfer==0.10.1 simplejson==3.19.2 six==1.16.0 smmap==5.0.1 soupsieve==2.5 stevedore==5.2.0 tabulate==0.9.0 toml==0.10.2 tomlkit==0.12.4 tqdm==4.66.2 typing_extensions==4.11.0 tzdata==2024.1 urllib3==1.26.18 virtualenv==20.26.0 wcwidth==0.2.13 websocket-client==1.8.0 wrapt==1.16.0 xdg==6.0.0 xmltodict==0.13.0 yq==3.4.3 [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content OS_STACK_TEMPLATE=csit-2-instance-type.yaml OS_CLOUD=vex OS_STACK_NAME=releng-controller-csit-3node-clustering-tell-all-scandium-3 OS_STACK_TEMPLATE_DIR=openstack-hot [EnvInject] - Variables injected successfully. provisioning config files... copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins7099284959416303049.sh ---> Create parameters file for OpenStack HOT OpenStack Heat parameters generated ----------------------------------- parameters: vm_0_count: '3' vm_0_flavor: 'v3-standard-4' vm_0_image: 'ZZCI - CentOS Stream 8 - builder - x86_64 - 20240401-160147.446' vm_1_count: '0' vm_1_flavor: 'v3-standard-2' vm_1_image: 'ZZCI - Ubuntu 18.04 - mininet-ovs-28 - x86_64 - 20230601-180106.003' job_name: '43164-3' silo: 'releng' [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash -l /tmp/jenkins4557206163088605179.sh ---> Create HEAT stack + source /home/jenkins/lf-env.sh + lf-activate-venv --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq ++ mktemp -d /tmp/venv-XXXX + lf_venv=/tmp/venv-Jkqw + local venv_file=/tmp/.os_lf_venv + local python=python3 + local options + local set_path=true + local install_args= ++ getopt -o np:v: -l no-path,system-site-packages,python:,venv-file: -n lf-activate-venv -- --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq + options=' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\''' + eval set -- ' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\''' ++ set -- --python python3 -- 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq + true + case $1 in + python=python3 + shift 2 + true + case $1 in + shift + break + case $python in + local pkg_list= + [[ -d /opt/pyenv ]] + echo 'Setup pyenv:' Setup pyenv: + export PYENV_ROOT=/opt/pyenv + PYENV_ROOT=/opt/pyenv + export PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin + PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin + pyenv versions system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.python-version) + command -v pyenv ++ pyenv init - --no-rehash + eval 'PATH="$(bash --norc -ec '\''IFS=:; paths=($PATH); for i in ${!paths[@]}; do if [[ ${paths[i]} == "'\'''\''/opt/pyenv/shims'\'''\''" ]]; then unset '\''\'\'''\''paths[i]'\''\'\'''\''; fi; done; echo "${paths[*]}"'\'')" export PATH="/opt/pyenv/shims:${PATH}" export PYENV_SHELL=bash source '\''/opt/pyenv/libexec/../completions/pyenv.bash'\'' pyenv() { local command command="${1:-}" if [ "$#" -gt 0 ]; then shift fi case "$command" in rehash|shell) eval "$(pyenv "sh-$command" "$@")" ;; *) command pyenv "$command" "$@" ;; esac }' +++ bash --norc -ec 'IFS=:; paths=($PATH); for i in ${!paths[@]}; do if [[ ${paths[i]} == "/opt/pyenv/shims" ]]; then unset '\''paths[i]'\''; fi; done; echo "${paths[*]}"' ++ PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin ++ export PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin ++ PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin ++ export PYENV_SHELL=bash ++ PYENV_SHELL=bash ++ source /opt/pyenv/libexec/../completions/pyenv.bash +++ complete -F _pyenv pyenv ++ lf-pyver python3 ++ local py_version_xy=python3 ++ local py_version_xyz= ++ pyenv versions ++ local command ++ command=versions ++ '[' 1 -gt 0 ']' ++ shift ++ case "$command" in ++ command pyenv versions ++ pyenv versions ++ awk '{ print $1 }' ++ sed 's/^[ *]* //' ++ grep -E '^[0-9.]*[0-9]$' ++ [[ ! -s /tmp/.pyenv_versions ]] +++ grep '^3' /tmp/.pyenv_versions +++ tail -n 1 +++ sort -V ++ py_version_xyz=3.11.7 ++ [[ -z 3.11.7 ]] ++ echo 3.11.7 ++ return 0 + pyenv local 3.11.7 + local command + command=local + '[' 2 -gt 0 ']' + shift + case "$command" in + command pyenv local 3.11.7 + pyenv local 3.11.7 + for arg in "$@" + case $arg in + pkg_list+='lftools[openstack] ' + for arg in "$@" + case $arg in + pkg_list+='kubernetes ' + for arg in "$@" + case $arg in + pkg_list+='niet ' + for arg in "$@" + case $arg in + pkg_list+='python-heatclient ' + for arg in "$@" + case $arg in + pkg_list+='python-openstackclient ' + for arg in "$@" + case $arg in + pkg_list+='python-magnumclient ' + for arg in "$@" + case $arg in + pkg_list+='yq ' + [[ -f /tmp/.os_lf_venv ]] ++ cat /tmp/.os_lf_venv + lf_venv=/tmp/venv-C3xR + echo 'lf-activate-venv(): INFO: Reuse venv:/tmp/venv-C3xR from' file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Reuse venv:/tmp/venv-C3xR from file:/tmp/.os_lf_venv + /tmp/venv-C3xR/bin/python3 -m pip install --upgrade --quiet pip virtualenv + [[ -z lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq ]] + echo 'lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq ' lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq + /tmp/venv-C3xR/bin/python3 -m pip install --upgrade --quiet --upgrade-strategy eager 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq + type python3 + true + echo 'lf-activate-venv(): INFO: Adding /tmp/venv-C3xR/bin to PATH' lf-activate-venv(): INFO: Adding /tmp/venv-C3xR/bin to PATH + PATH=/tmp/venv-C3xR/bin:/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin + return 0 + openstack --os-cloud vex limits show --absolute +--------------------------+---------+ | Name | Value | +--------------------------+---------+ | maxTotalInstances | -1 | | maxTotalCores | 450 | | maxTotalRAMSize | 1000000 | | maxServerMeta | 128 | | maxImageMeta | 128 | | maxPersonality | 5 | | maxPersonalitySize | 10240 | | maxTotalKeypairs | 100 | | maxServerGroups | 10 | | maxServerGroupMembers | 10 | | maxTotalFloatingIps | -1 | | maxSecurityGroups | -1 | | maxSecurityGroupRules | -1 | | totalRAMUsed | 663552 | | totalCoresUsed | 162 | | totalInstancesUsed | 53 | | totalFloatingIpsUsed | 0 | | totalSecurityGroupsUsed | 0 | | totalServerGroupsUsed | 0 | | maxTotalVolumes | -1 | | maxTotalSnapshots | 10 | | maxTotalVolumeGigabytes | 4096 | | maxTotalBackups | 10 | | maxTotalBackupGigabytes | 1000 | | totalVolumesUsed | 0 | | totalGigabytesUsed | 0 | | totalSnapshotsUsed | 0 | | totalBackupsUsed | 0 | | totalBackupGigabytesUsed | 0 | +--------------------------+---------+ + pushd /opt/ciman/openstack-hot /opt/ciman/openstack-hot /w/workspace/controller-csit-3node-clustering-tell-all-scandium + lftools openstack --os-cloud vex stack create releng-controller-csit-3node-clustering-tell-all-scandium-3 csit-2-instance-type.yaml /w/workspace/controller-csit-3node-clustering-tell-all-scandium/stack-parameters.yaml Creating stack releng-controller-csit-3node-clustering-tell-all-scandium-3 Waiting to initialize infrastructure... Stack initialization successful. ------------------------------------ Stack Details ------------------------------------ {'added': None, 'capabilities': [], 'created_at': '2024-04-28T06:05:35Z', 'deleted': None, 'deleted_at': None, 'description': 'No description', 'environment': None, 'environment_files': None, 'files': None, 'files_container': None, 'id': 'f5a75375-f1f5-4dcc-84db-37227d702c21', 'is_rollback_disabled': True, 'links': [{'href': 'https://orchestration.public.mtl1.vexxhost.net/v1/12c36e260d8e4bb2913965203b1b491f/stacks/releng-controller-csit-3node-clustering-tell-all-scandium-3/f5a75375-f1f5-4dcc-84db-37227d702c21', 'rel': 'self'}], 'location': Munch({'cloud': 'vex', 'region_name': 'ca-ymq-1', 'zone': None, 'project': Munch({'id': '12c36e260d8e4bb2913965203b1b491f', 'name': '61975f2c-7c17-4d69-82fa-c3ae420ad6fd', 'domain_id': None, 'domain_name': 'Default'})}), 'name': 'releng-controller-csit-3node-clustering-tell-all-scandium-3', 'notification_topics': [], 'outputs': [{'description': 'IP addresses of the 2nd vm types', 'output_key': 'vm_1_ips', 'output_value': []}, {'description': 'IP addresses of the 1st vm types', 'output_key': 'vm_0_ips', 'output_value': ['10.30.171.127', '10.30.170.58', '10.30.171.170']}], 'owner_id': ****, 'parameters': {'OS::project_id': '12c36e260d8e4bb2913965203b1b491f', 'OS::stack_id': 'f5a75375-f1f5-4dcc-84db-37227d702c21', 'OS::stack_name': 'releng-controller-csit-3node-clustering-tell-all-scandium-3', 'job_name': '43164-3', 'silo': 'releng', 'vm_0_count': '3', 'vm_0_flavor': 'v3-standard-4', 'vm_0_image': 'ZZCI - CentOS Stream 8 - builder - x86_64 - ' '20240401-160147.446', 'vm_1_count': '0', 'vm_1_flavor': 'v3-standard-2', 'vm_1_image': 'ZZCI - Ubuntu 18.04 - mininet-ovs-28 - x86_64 - ' '20230601-180106.003'}, 'parent_id': None, 'replaced': None, 'status': 'CREATE_COMPLETE', 'status_reason': 'Stack CREATE completed successfully', 'tags': [], 'template': None, 'template_description': 'No description', 'template_url': None, 'timeout_mins': 15, 'unchanged': None, 'updated': None, 'updated_at': None, 'user_project_id': 'b655d8b6d1104883a04176477a6cc8ed'} ------------------------------------ + popd /w/workspace/controller-csit-3node-clustering-tell-all-scandium [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash -l /tmp/jenkins10474803262772576559.sh ---> Copy SSH public keys to CSIT lab Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-C3xR from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes python-heatclient python-openstackclient lf-activate-venv(): INFO: Adding /tmp/venv-C3xR/bin to PATH SSH not responding on 10.30.171.170. Retrying in 10 seconds... SSH not responding on 10.30.171.127. Retrying in 10 seconds... SSH not responding on 10.30.170.58. Retrying in 10 seconds... Ping to 10.30.171.127 successful. Ping to 10.30.171.170 successful. Ping to 10.30.170.58 successful. SSH not responding on 10.30.171.127. Retrying in 10 seconds... SSH not responding on 10.30.171.170. Retrying in 10 seconds... SSH not responding on 10.30.170.58. Retrying in 10 seconds... Ping to 10.30.171.127 successful. Ping to 10.30.171.170 successful. Ping to 10.30.170.58 successful. SSH not responding on 10.30.170.58. Retrying in 10 seconds... SSH not responding on 10.30.171.127. Retrying in 10 seconds... Warning: Permanently added '10.30.171.170' (ECDSA) to the list of known hosts. 10.30.171.170 releng-43164-3-0-builder-2.novalocal Successfully copied public keys to slave 10.30.171.170 Ping to 10.30.170.58 successful. Ping to 10.30.171.127 successful. SSH not responding on 10.30.170.58. Retrying in 10 seconds... SSH not responding on 10.30.171.127. Retrying in 10 seconds... Ping to 10.30.170.58 successful. Ping to 10.30.171.127 successful. Warning: Permanently added '10.30.170.58' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.171.127' (ECDSA) to the list of known hosts. 10.30.170.58 releng-43164-3-0-builder-1.novalocal Successfully copied public keys to slave 10.30.170.58 10.30.171.127 releng-43164-3-0-builder-0.novalocal Successfully copied public keys to slave 10.30.171.127 Process 6682 ready. Process 6683 ready. Process 6685 ready. SSH ready on all stack servers. [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash -l /tmp/jenkins134246257224876641.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.python-version) lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-rhgV lf-activate-venv(): INFO: Save venv in file: /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.robot_venv lf-activate-venv(): INFO: Installing: setuptools wheel lf-activate-venv(): INFO: Adding /tmp/venv-rhgV/bin to PATH + echo 'Installing Python Requirements' Installing Python Requirements + cat + python -m pip install -r requirements.txt Looking in indexes: https://nexus3.opendaylight.org/repository/PyPi/simple Collecting docker-py (from -r requirements.txt (line 1)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/docker-py/1.10.6/docker_py-1.10.6-py2.py3-none-any.whl (50 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 50.0/50.0 kB 10.9 MB/s eta 0:00:00 Collecting ipaddr (from -r requirements.txt (line 2)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/ipaddr/2.2.0/ipaddr-2.2.0.tar.gz (26 kB) Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Collecting netaddr (from -r requirements.txt (line 3)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/netaddr/1.2.1/netaddr-1.2.1-py3-none-any.whl (2.3 MB) Collecting netifaces (from -r requirements.txt (line 4)) Using cached netifaces-0.11.0-cp311-cp311-linux_x86_64.whl Collecting pyhocon (from -r requirements.txt (line 5)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyhocon/0.3.60/pyhocon-0.3.60.tar.gz (158 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 158.8/158.8 kB 20.3 MB/s eta 0:00:00 Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Collecting requests (from -r requirements.txt (line 6)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/requests/2.31.0/requests-2.31.0-py3-none-any.whl (62 kB) Collecting robotframework (from -r requirements.txt (line 7)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework/7.0/robotframework-7.0-py3-none-any.whl (726 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 726.3/726.3 kB 17.9 MB/s eta 0:00:00 Collecting robotframework-httplibrary (from -r requirements.txt (line 8)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-httplibrary/0.4.2/robotframework-httplibrary-0.4.2.tar.gz (9.1 kB) Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Collecting robotframework-requests==0.9.3 (from -r requirements.txt (line 9)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-requests/0.9.3/robotframework_requests-0.9.3-py3-none-any.whl (21 kB) Collecting robotframework-selenium2library (from -r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-selenium2library/3.0.0/robotframework_selenium2library-3.0.0-py2.py3-none-any.whl (6.2 kB) Collecting robotframework-sshlibrary==3.8.0 (from -r requirements.txt (line 11)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-sshlibrary/3.8.0/robotframework-sshlibrary-3.8.0.tar.gz (51 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 51.4/51.4 kB 10.8 MB/s eta 0:00:00 Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Collecting scapy (from -r requirements.txt (line 12)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/scapy/2.5.0/scapy-2.5.0.tar.gz (1.3 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.3/1.3 MB 31.2 MB/s eta 0:00:00 Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Collecting jsonpath-rw (from -r requirements.txt (line 15)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpath-rw/1.4.0/jsonpath-rw-1.4.0.tar.gz (13 kB) Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Collecting elasticsearch (from -r requirements.txt (line 18)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch/8.13.0/elasticsearch-8.13.0-py3-none-any.whl (451 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 451.0/451.0 kB 1.5 MB/s eta 0:00:00 Collecting elasticsearch-dsl (from -r requirements.txt (line 19)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch-dsl/8.13.0/elasticsearch_dsl-8.13.0-py3-none-any.whl (88 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 88.6/88.6 kB 12.9 MB/s eta 0:00:00 Collecting pyangbind (from -r requirements.txt (line 22)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyangbind/0.8.5/pyangbind-0.8.5-py3-none-any.whl (52 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 52.9/52.9 kB 10.1 MB/s eta 0:00:00 Collecting isodate (from -r requirements.txt (line 25)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/isodate/0.6.1/isodate-0.6.1-py2.py3-none-any.whl (41 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 41.7/41.7 kB 3.9 MB/s eta 0:00:00 Collecting jmespath (from -r requirements.txt (line 28)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jmespath/1.0.1/jmespath-1.0.1-py3-none-any.whl (20 kB) Collecting jsonpatch (from -r requirements.txt (line 31)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpatch/1.33/jsonpatch-1.33-py2.py3-none-any.whl (12 kB) Collecting paramiko>=1.15.3 (from robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/paramiko/3.4.0/paramiko-3.4.0-py3-none-any.whl (225 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 225.9/225.9 kB 24.9 MB/s eta 0:00:00 Collecting scp>=0.13.0 (from robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/scp/0.14.5/scp-0.14.5-py2.py3-none-any.whl (8.7 kB) Collecting docker-pycreds>=0.2.1 (from docker-py->-r requirements.txt (line 1)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/docker-pycreds/0.4.0/docker_pycreds-0.4.0-py2.py3-none-any.whl (9.0 kB) Collecting six>=1.4.0 (from docker-py->-r requirements.txt (line 1)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/six/1.16.0/six-1.16.0-py2.py3-none-any.whl (11 kB) Collecting websocket-client>=0.32.0 (from docker-py->-r requirements.txt (line 1)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/websocket-client/1.8.0/websocket_client-1.8.0-py3-none-any.whl (58 kB) Collecting pyparsing<4,>=2 (from pyhocon->-r requirements.txt (line 5)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pyparsing/3.1.2/pyparsing-3.1.2-py3-none-any.whl (103 kB) Collecting charset-normalizer<4,>=2 (from requests->-r requirements.txt (line 6)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/charset-normalizer/3.3.2/charset_normalizer-3.3.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (140 kB) Collecting idna<4,>=2.5 (from requests->-r requirements.txt (line 6)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/idna/3.7/idna-3.7-py3-none-any.whl (66 kB) Collecting urllib3<3,>=1.21.1 (from requests->-r requirements.txt (line 6)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/urllib3/2.2.1/urllib3-2.2.1-py3-none-any.whl (121 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 121.1/121.1 kB 17.1 MB/s eta 0:00:00 Collecting certifi>=2017.4.17 (from requests->-r requirements.txt (line 6)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/certifi/2024.2.2/certifi-2024.2.2-py3-none-any.whl (163 kB) Collecting webtest>=2.0 (from robotframework-httplibrary->-r requirements.txt (line 8)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/webtest/3.0.0/WebTest-3.0.0-py3-none-any.whl (31 kB) Collecting jsonpointer (from robotframework-httplibrary->-r requirements.txt (line 8)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpointer/2.4/jsonpointer-2.4-py2.py3-none-any.whl (7.8 kB) Collecting robotframework-seleniumlibrary>=3.0.0 (from robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-seleniumlibrary/6.3.0/robotframework_seleniumlibrary-6.3.0-py2.py3-none-any.whl (97 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 97.6/97.6 kB 14.2 MB/s eta 0:00:00 Collecting ply (from jsonpath-rw->-r requirements.txt (line 15)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/ply/3.11/ply-3.11-py2.py3-none-any.whl (49 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 49.6/49.6 kB 8.1 MB/s eta 0:00:00 Collecting decorator (from jsonpath-rw->-r requirements.txt (line 15)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/decorator/5.1.1/decorator-5.1.1-py3-none-any.whl (9.1 kB) Collecting elastic-transport<9,>=8.13 (from elasticsearch->-r requirements.txt (line 18)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elastic-transport/8.13.0/elastic_transport-8.13.0-py3-none-any.whl (64 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 64.3/64.3 kB 10.6 MB/s eta 0:00:00 Collecting python-dateutil (from elasticsearch-dsl->-r requirements.txt (line 19)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/python-dateutil/2.9.0.post0/python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) Collecting pyang (from pyangbind->-r requirements.txt (line 22)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyang/2.6.0/pyang-2.6.0-py2.py3-none-any.whl (594 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 594.1/594.1 kB 46.3 MB/s eta 0:00:00 Collecting lxml (from pyangbind->-r requirements.txt (line 22)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/lxml/5.2.1/lxml-5.2.1-cp311-cp311-manylinux_2_28_x86_64.whl (5.0 MB) Collecting regex (from pyangbind->-r requirements.txt (line 22)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/regex/2024.4.16/regex-2024.4.16-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (785 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 785.1/785.1 kB 19.7 MB/s eta 0:00:00 Collecting enum34 (from pyangbind->-r requirements.txt (line 22)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/enum34/1.1.10/enum34-1.1.10-py3-none-any.whl (11 kB) Collecting bcrypt>=3.2 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/bcrypt/4.1.2/bcrypt-4.1.2-cp39-abi3-manylinux_2_28_x86_64.whl (698 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 698.9/698.9 kB 39.6 MB/s eta 0:00:00 Collecting cryptography>=3.3 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/cryptography/42.0.5/cryptography-42.0.5-cp39-abi3-manylinux_2_28_x86_64.whl (4.6 MB) Collecting pynacl>=1.5 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pynacl/1.5.0/PyNaCl-1.5.0-cp36-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.manylinux_2_24_x86_64.whl (856 kB) Collecting selenium>=4.3.0 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/selenium/4.20.0/selenium-4.20.0-py3-none-any.whl (9.5 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 9.5/9.5 MB 66.7 MB/s eta 0:00:00 Collecting robotframework-pythonlibcore>=3.0.0 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-pythonlibcore/4.4.1/robotframework_pythonlibcore-4.4.1-py2.py3-none-any.whl (12 kB) Collecting WebOb>=1.2 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/webob/1.8.7/WebOb-1.8.7-py2.py3-none-any.whl (114 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 115.0/115.0 kB 15.5 MB/s eta 0:00:00 Collecting waitress>=0.8.5 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/waitress/3.0.0/waitress-3.0.0-py3-none-any.whl (56 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 56.7/56.7 kB 8.4 MB/s eta 0:00:00 Collecting beautifulsoup4 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/beautifulsoup4/4.12.3/beautifulsoup4-4.12.3-py3-none-any.whl (147 kB) Collecting cffi>=1.12 (from cryptography>=3.3->paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/cffi/1.16.0/cffi-1.16.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (464 kB) Collecting trio~=0.17 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/trio/0.25.0/trio-0.25.0-py3-none-any.whl (467 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 467.2/467.2 kB 40.8 MB/s eta 0:00:00 Collecting trio-websocket~=0.9 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/trio-websocket/0.11.1/trio_websocket-0.11.1-py3-none-any.whl (17 kB) Collecting typing_extensions>=4.9.0 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/typing-extensions/4.11.0/typing_extensions-4.11.0-py3-none-any.whl (34 kB) Collecting soupsieve>1.2 (from beautifulsoup4->webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/soupsieve/2.5/soupsieve-2.5-py3-none-any.whl (36 kB) Collecting pycparser (from cffi>=1.12->cryptography>=3.3->paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pycparser/2.22/pycparser-2.22-py3-none-any.whl (117 kB) Collecting attrs>=23.2.0 (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/attrs/23.2.0/attrs-23.2.0-py3-none-any.whl (60 kB) Collecting sortedcontainers (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/sortedcontainers/2.4.0/sortedcontainers-2.4.0-py2.py3-none-any.whl (29 kB) Collecting outcome (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/outcome/1.3.0.post0/outcome-1.3.0.post0-py2.py3-none-any.whl (10 kB) Collecting sniffio>=1.3.0 (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/sniffio/1.3.1/sniffio-1.3.1-py3-none-any.whl (10 kB) Collecting wsproto>=0.14 (from trio-websocket~=0.9->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/wsproto/1.2.0/wsproto-1.2.0-py3-none-any.whl (24 kB) Collecting pysocks!=1.5.7,<2.0,>=1.5.6 (from urllib3[socks]<3,>=1.26->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pysocks/1.7.1/PySocks-1.7.1-py3-none-any.whl (16 kB) Collecting h11<1,>=0.9.0 (from wsproto>=0.14->trio-websocket~=0.9->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/h11/0.14.0/h11-0.14.0-py3-none-any.whl (58 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 58.3/58.3 kB 7.5 MB/s eta 0:00:00 Building wheels for collected packages: robotframework-sshlibrary, ipaddr, pyhocon, robotframework-httplibrary, scapy, jsonpath-rw Building wheel for robotframework-sshlibrary (setup.py): started Building wheel for robotframework-sshlibrary (setup.py): finished with status 'done' Created wheel for robotframework-sshlibrary: filename=robotframework_sshlibrary-3.8.0-py3-none-any.whl size=55119 sha256=6dd0c5dd930e91cec9454db41d42f0ddfbd62dabf03b2a04230253aaeddbf8ce Stored in directory: /home/jenkins/.cache/pip/wheels/f7/c9/b3/a977b7bcc410d45ae27d240df3d00a12585509180e373ecccc Building wheel for ipaddr (setup.py): started Building wheel for ipaddr (setup.py): finished with status 'done' Created wheel for ipaddr: filename=ipaddr-2.2.0-py3-none-any.whl size=18280 sha256=19688b78d66b72bbd08401cceacbfca744a0929abcf0e0ecf969458465261a91 Stored in directory: /home/jenkins/.cache/pip/wheels/dc/6c/04/da2d847fa8d45c59af3e1d83e2acc29cb8adcbaf04c0898dbf Building wheel for pyhocon (setup.py): started Building wheel for pyhocon (setup.py): finished with status 'done' Created wheel for pyhocon: filename=pyhocon-0.3.60-py3-none-any.whl size=20865 sha256=853381c9f429c546b3b9aaf488a4824810cb8196610303da6a2812697d48dcec Stored in directory: /home/jenkins/.cache/pip/wheels/02/09/4e/04a983205b51f96912ae6fc13f56f3050a586c98200fe36725 Building wheel for robotframework-httplibrary (setup.py): started Building wheel for robotframework-httplibrary (setup.py): finished with status 'done' Created wheel for robotframework-httplibrary: filename=robotframework_httplibrary-0.4.2-py3-none-any.whl size=9953 sha256=978d01f74efbcc2855497bc381c4e95e77f18f153b3c23dc18044c8a807b5fe9 Stored in directory: /home/jenkins/.cache/pip/wheels/aa/bc/0d/9a20dd51effef392aae2733cb4c7b66c6fa29fca33d88b57ed Building wheel for scapy (setup.py): started Building wheel for scapy (setup.py): finished with status 'done' Created wheel for scapy: filename=scapy-2.5.0-py2.py3-none-any.whl size=1444327 sha256=0912aa1ba793d1bdd717a01aacdfb3005379d0969ba038138d3c2bdef60f9799 Stored in directory: /home/jenkins/.cache/pip/wheels/3b/a7/d6/87eeec31fbfcb2bd8ace7dad8172b6d6ebbe1ec6827dbb389a Building wheel for jsonpath-rw (setup.py): started Building wheel for jsonpath-rw (setup.py): finished with status 'done' Created wheel for jsonpath-rw: filename=jsonpath_rw-1.4.0-py3-none-any.whl size=15130 sha256=352b6bc18432647bd72735606910da2cab4bae069b2668c7f1c4f73adda3339a Stored in directory: /home/jenkins/.cache/pip/wheels/f1/54/63/9a8da38cefae13755097b36cc852decc25d8ef69c37d58d4eb Successfully built robotframework-sshlibrary ipaddr pyhocon robotframework-httplibrary scapy jsonpath-rw Installing collected packages: sortedcontainers, ply, netifaces, ipaddr, enum34, websocket-client, WebOb, waitress, urllib3, typing_extensions, soupsieve, sniffio, six, scapy, robotframework-pythonlibcore, robotframework, regex, pysocks, pyparsing, pycparser, netaddr, lxml, jsonpointer, jmespath, idna, h11, decorator, charset-normalizer, certifi, bcrypt, attrs, wsproto, requests, python-dateutil, pyhocon, pyang, outcome, jsonpath-rw, jsonpatch, isodate, elastic-transport, docker-pycreds, cffi, beautifulsoup4, webtest, trio, robotframework-requests, pynacl, pyangbind, elasticsearch, docker-py, cryptography, trio-websocket, robotframework-httplibrary, paramiko, elasticsearch-dsl, selenium, scp, robotframework-sshlibrary, robotframework-seleniumlibrary, robotframework-selenium2library Successfully installed WebOb-1.8.7 attrs-23.2.0 bcrypt-4.1.2 beautifulsoup4-4.12.3 certifi-2024.2.2 cffi-1.16.0 charset-normalizer-3.3.2 cryptography-42.0.5 decorator-5.1.1 docker-py-1.10.6 docker-pycreds-0.4.0 elastic-transport-8.13.0 elasticsearch-8.13.0 elasticsearch-dsl-8.13.0 enum34-1.1.10 h11-0.14.0 idna-3.7 ipaddr-2.2.0 isodate-0.6.1 jmespath-1.0.1 jsonpatch-1.33 jsonpath-rw-1.4.0 jsonpointer-2.4 lxml-5.2.1 netaddr-1.2.1 netifaces-0.11.0 outcome-1.3.0.post0 paramiko-3.4.0 ply-3.11 pyang-2.6.0 pyangbind-0.8.5 pycparser-2.22 pyhocon-0.3.60 pynacl-1.5.0 pyparsing-3.1.2 pysocks-1.7.1 python-dateutil-2.9.0.post0 regex-2024.4.16 requests-2.31.0 robotframework-7.0 robotframework-httplibrary-0.4.2 robotframework-pythonlibcore-4.4.1 robotframework-requests-0.9.3 robotframework-selenium2library-3.0.0 robotframework-seleniumlibrary-6.3.0 robotframework-sshlibrary-3.8.0 scapy-2.5.0 scp-0.14.5 selenium-4.20.0 six-1.16.0 sniffio-1.3.1 sortedcontainers-2.4.0 soupsieve-2.5 trio-0.25.0 trio-websocket-0.11.1 typing_extensions-4.11.0 urllib3-2.2.1 waitress-3.0.0 websocket-client-1.8.0 webtest-3.0.0 wsproto-1.2.0 + pip freeze attrs==23.2.0 bcrypt==4.1.2 beautifulsoup4==4.12.3 certifi==2024.2.2 cffi==1.16.0 charset-normalizer==3.3.2 cryptography==42.0.5 decorator==5.1.1 distlib==0.3.8 docker-py==1.10.6 docker-pycreds==0.4.0 elastic-transport==8.13.0 elasticsearch==8.13.0 elasticsearch-dsl==8.13.0 enum34==1.1.10 filelock==3.13.4 h11==0.14.0 idna==3.7 ipaddr==2.2.0 isodate==0.6.1 jmespath==1.0.1 jsonpatch==1.33 jsonpath-rw==1.4.0 jsonpointer==2.4 lxml==5.2.1 netaddr==1.2.1 netifaces==0.11.0 outcome==1.3.0.post0 paramiko==3.4.0 platformdirs==4.2.1 ply==3.11 pyang==2.6.0 pyangbind==0.8.5 pycparser==2.22 pyhocon==0.3.60 PyNaCl==1.5.0 pyparsing==3.1.2 PySocks==1.7.1 python-dateutil==2.9.0.post0 regex==2024.4.16 requests==2.31.0 robotframework==7.0 robotframework-httplibrary==0.4.2 robotframework-pythonlibcore==4.4.1 robotframework-requests==0.9.3 robotframework-selenium2library==3.0.0 robotframework-seleniumlibrary==6.3.0 robotframework-sshlibrary==3.8.0 scapy==2.5.0 scp==0.14.5 selenium==4.20.0 six==1.16.0 sniffio==1.3.1 sortedcontainers==2.4.0 soupsieve==2.5 trio==0.25.0 trio-websocket==0.11.1 typing_extensions==4.11.0 urllib3==2.2.1 virtualenv==20.26.0 waitress==3.0.0 WebOb==1.8.7 websocket-client==1.8.0 WebTest==3.0.0 wsproto==1.2.0 [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'env.properties' [EnvInject] - Variables injected successfully. [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash -l /tmp/jenkins13695122470751571410.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-C3xR from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: python-heatclient python-openstackclient yq ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. lftools 0.37.10 requires urllib3<2.1.0, but you have urllib3 2.2.1 which is incompatible. lf-activate-venv(): INFO: Adding /tmp/venv-C3xR/bin to PATH + ODL_SYSTEM=() + TOOLS_SYSTEM=() + OPENSTACK_SYSTEM=() + OPENSTACK_CONTROLLERS=() + mapfile -t ADDR ++ openstack stack show -f json -c outputs releng-controller-csit-3node-clustering-tell-all-scandium-3 ++ jq -r '.outputs[] | select(.output_key | match("^vm_[0-9]+_ips$")) | .output_value | .[]' + for i in "${ADDR[@]}" ++ ssh 10.30.171.127 hostname -s Warning: Permanently added '10.30.171.127' (ECDSA) to the list of known hosts. + REMHOST=releng-43164-3-0-builder-0 + case ${REMHOST} in + ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}") + for i in "${ADDR[@]}" ++ ssh 10.30.170.58 hostname -s Warning: Permanently added '10.30.170.58' (ECDSA) to the list of known hosts. + REMHOST=releng-43164-3-0-builder-1 + case ${REMHOST} in + ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}") + for i in "${ADDR[@]}" ++ ssh 10.30.171.170 hostname -s Warning: Permanently added '10.30.171.170' (ECDSA) to the list of known hosts. + REMHOST=releng-43164-3-0-builder-2 + case ${REMHOST} in + ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}") + echo NUM_ODL_SYSTEM=3 + echo NUM_TOOLS_SYSTEM=0 + '[' '' == yes ']' + NUM_OPENSTACK_SYSTEM=0 + echo NUM_OPENSTACK_SYSTEM=0 + '[' 0 -eq 2 ']' + echo ODL_SYSTEM_IP=10.30.171.127 ++ seq 0 2 + for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 ))) + echo ODL_SYSTEM_1_IP=10.30.171.127 + for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 ))) + echo ODL_SYSTEM_2_IP=10.30.170.58 + for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 ))) + echo ODL_SYSTEM_3_IP=10.30.171.170 + echo TOOLS_SYSTEM_IP= ++ seq 0 -1 + openstack_index=0 + NUM_OPENSTACK_CONTROL_NODES=1 + echo NUM_OPENSTACK_CONTROL_NODES=1 ++ seq 0 0 + for i in $(seq 0 $((NUM_OPENSTACK_CONTROL_NODES - 1))) + echo OPENSTACK_CONTROL_NODE_1_IP= + NUM_OPENSTACK_COMPUTE_NODES=-1 + echo NUM_OPENSTACK_COMPUTE_NODES=-1 + '[' -1 -ge 2 ']' ++ seq 0 -2 + NUM_OPENSTACK_HAPROXY_NODES=0 + echo NUM_OPENSTACK_HAPROXY_NODES=0 ++ seq 0 -1 + echo 'Contents of slave_addresses.txt:' Contents of slave_addresses.txt: + cat slave_addresses.txt NUM_ODL_SYSTEM=3 NUM_TOOLS_SYSTEM=0 NUM_OPENSTACK_SYSTEM=0 ODL_SYSTEM_IP=10.30.171.127 ODL_SYSTEM_1_IP=10.30.171.127 ODL_SYSTEM_2_IP=10.30.170.58 ODL_SYSTEM_3_IP=10.30.171.170 TOOLS_SYSTEM_IP= NUM_OPENSTACK_CONTROL_NODES=1 OPENSTACK_CONTROL_NODE_1_IP= NUM_OPENSTACK_COMPUTE_NODES=-1 NUM_OPENSTACK_HAPROXY_NODES=0 [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'slave_addresses.txt' [EnvInject] - Variables injected successfully. [controller-csit-3node-clustering-tell-all-scandium] $ /bin/sh /tmp/jenkins18396919187947253907.sh Preparing for JRE Version 17 Karaf artifact is karaf Karaf project is integration Java home is /usr/lib/jvm/java-17-openjdk [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'set_variables.env' [EnvInject] - Variables injected successfully. [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins17090396554921394210.sh --2024-04-28 06:07:39-- http://git.opendaylight.org/gerrit/gitweb?p=integration/distribution.git;a=blob_plain;f=pom.xml;hb=refs/heads/master Resolving git.opendaylight.org (git.opendaylight.org)... 52.47.161.242, 35.181.223.58, 13.39.230.180, ... Connecting to git.opendaylight.org (git.opendaylight.org)|52.47.161.242|:80... connected. HTTP request sent, awaiting response... 200 OK Length: 2620 (2.6K) [text/plain] Saving to: ‘pom.xml’ 0K .. 100% 269M=0s 2024-04-28 06:07:39 (269 MB/s) - ‘pom.xml’ saved [2620/2620] Bundle version is 0.21.0-SNAPSHOT --2024-04-28 06:07:39-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.0-SNAPSHOT/maven-metadata.xml Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6 Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 1410 (1.4K) [application/xml] Saving to: ‘maven-metadata.xml’ 0K . 100% 58.3M=0s 2024-04-28 06:07:39 (58.3 MB/s) - ‘maven-metadata.xml’ saved [1410/1410] org.opendaylight.integration karaf 0.21.0-SNAPSHOT 20240428.030741 111 20240428030741 pom 0.21.0-20240428.030741-111 20240428030741 tar.gz 0.21.0-20240428.030741-111 20240428030741 zip 0.21.0-20240428.030741-111 20240428030741 cyclonedx xml 0.21.0-20240428.030741-111 20240428030741 cyclonedx json 0.21.0-20240428.030741-111 20240428030741 Nexus timestamp is 0.21.0-20240428.030741-111 Distribution bundle URL is https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.0-SNAPSHOT/karaf-0.21.0-20240428.030741-111.zip Distribution bundle is karaf-0.21.0-20240428.030741-111.zip Distribution bundle version is 0.21.0-SNAPSHOT Distribution folder is karaf-0.21.0-SNAPSHOT Nexus prefix is https://nexus.opendaylight.org [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'detect_variables.env' [EnvInject] - Variables injected successfully. [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash -l /tmp/jenkins3045915035869257884.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-C3xR from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: python-heatclient python-openstackclient lf-activate-venv(): INFO: Adding /tmp/venv-C3xR/bin to PATH Copying common-functions.sh to /tmp Copying common-functions.sh to 10.30.171.127:/tmp Warning: Permanently added '10.30.171.127' (ECDSA) to the list of known hosts. Copying common-functions.sh to 10.30.170.58:/tmp Warning: Permanently added '10.30.170.58' (ECDSA) to the list of known hosts. Copying common-functions.sh to 10.30.171.170:/tmp Warning: Permanently added '10.30.171.170' (ECDSA) to the list of known hosts. [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins6627041814227882594.sh common-functions.sh is being sourced common-functions environment: MAVENCONF: /tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ACTUALFEATURES: FEATURESCONF: /tmp/karaf-0.21.0-SNAPSHOT/etc/org.apache.karaf.features.cfg CUSTOMPROP: /tmp/karaf-0.21.0-SNAPSHOT/etc/custom.properties LOGCONF: /tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg MEMCONF: /tmp/karaf-0.21.0-SNAPSHOT/bin/setenv CONTROLLERMEM: 2048m AKKACONF: /tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/akka.conf MODULESCONF: /tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/modules.conf MODULESHARDSCONF: /tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/module-shards.conf SUITES: ################################################# ## Configure Cluster and Start ## ################################################# ACTUALFEATURES: odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app SPACE_SEPARATED_FEATURES: odl-integration-compatible-with-all odl-jolokia odl-restconf odl-clustering-test-app Locating script plan to use... script plan exists!!! Changing the script plan path... # Place the scripts in run order: /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/scripts/car_people_shard.sh Executing /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/scripts/car_people_shard.sh... Add car-people shards file Copy shard config to member-1 with IP address 10.30.171.127 Warning: Permanently added '10.30.171.127' (ECDSA) to the list of known hosts. Copy shard config to member-2 with IP address 10.30.170.58 Warning: Permanently added '10.30.170.58' (ECDSA) to the list of known hosts. Copy shard config to member-3 with IP address 10.30.171.170 Warning: Permanently added '10.30.171.170' (ECDSA) to the list of known hosts. Finished running script plans Configuring member-1 with IP address 10.30.171.127 Warning: Permanently added '10.30.171.127' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.171.127' (ECDSA) to the list of known hosts. + source /tmp/common-functions.sh karaf-0.21.0-SNAPSHOT common-functions.sh is being sourced ++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]] ++ echo 'common-functions.sh is being sourced' ++ BUNDLEFOLDER=karaf-0.21.0-SNAPSHOT ++ export MAVENCONF=/tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ++ MAVENCONF=/tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ++ export FEATURESCONF=/tmp/karaf-0.21.0-SNAPSHOT/etc/org.apache.karaf.features.cfg ++ FEATURESCONF=/tmp/karaf-0.21.0-SNAPSHOT/etc/org.apache.karaf.features.cfg ++ export CUSTOMPROP=/tmp/karaf-0.21.0-SNAPSHOT/etc/custom.properties ++ CUSTOMPROP=/tmp/karaf-0.21.0-SNAPSHOT/etc/custom.properties ++ export LOGCONF=/tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ++ LOGCONF=/tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ++ export MEMCONF=/tmp/karaf-0.21.0-SNAPSHOT/bin/setenv ++ MEMCONF=/tmp/karaf-0.21.0-SNAPSHOT/bin/setenv ++ export CONTROLLERMEM= ++ CONTROLLERMEM= ++ export AKKACONF=/tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/akka.conf ++ AKKACONF=/tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/akka.conf ++ export MODULESCONF=/tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/modules.conf ++ MODULESCONF=/tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/modules.conf ++ export MODULESHARDSCONF=/tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/module-shards.conf ++ MODULESHARDSCONF=/tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/module-shards.conf ++ print_common_env ++ cat common-functions environment: MAVENCONF: /tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ACTUALFEATURES: FEATURESCONF: /tmp/karaf-0.21.0-SNAPSHOT/etc/org.apache.karaf.features.cfg CUSTOMPROP: /tmp/karaf-0.21.0-SNAPSHOT/etc/custom.properties LOGCONF: /tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg MEMCONF: /tmp/karaf-0.21.0-SNAPSHOT/bin/setenv CONTROLLERMEM: AKKACONF: /tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/akka.conf MODULESCONF: /tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/modules.conf MODULESHARDSCONF: /tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/module-shards.conf SUITES: ++ SSH='ssh -t -t' ++ extra_services_cntl=' dnsmasq.service httpd.service libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service rabbitmq-server.service ' ++ extra_services_cmp=' libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service ' Changing to /tmp Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.0-SNAPSHOT/karaf-0.21.0-20240428.030741-111.zip + echo 'Changing to /tmp' + cd /tmp + echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.0-SNAPSHOT/karaf-0.21.0-20240428.030741-111.zip' + wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.0-SNAPSHOT/karaf-0.21.0-20240428.030741-111.zip --2024-04-28 06:07:50-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.0-SNAPSHOT/karaf-0.21.0-20240428.030741-111.zip Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6 Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 290582777 (277M) [application/zip] Saving to: ‘karaf-0.21.0-20240428.030741-111.zip’ 0K ........ ........ ........ ........ ........ ........ 1% 78.3M 3s 3072K ........ ........ ........ ........ ........ ........ 2% 158M 3s 6144K ........ ........ ........ ........ ........ ........ 3% 186M 2s 9216K ........ ........ ........ ........ ........ ........ 4% 188M 2s 12288K ........ ........ ........ ........ ........ ........ 5% 178M 2s 15360K ........ ........ ........ ........ ........ ........ 6% 218M 2s 18432K ........ ........ ........ ........ ........ ........ 7% 273M 2s 21504K ........ ........ ........ ........ ........ ........ 8% 226M 2s 24576K ........ ........ ........ ........ ........ ........ 9% 239M 1s 27648K ........ ........ ........ ........ ........ ........ 10% 240M 1s 30720K ........ ........ ........ ........ ........ ........ 11% 277M 1s 33792K ........ ........ ........ ........ ........ ........ 12% 302M 1s 36864K ........ ........ ........ ........ ........ ........ 14% 262M 1s 39936K ........ ........ ........ ........ ........ ........ 15% 264M 1s 43008K ........ ........ ........ ........ ........ ........ 16% 257M 1s 46080K ........ ........ ........ ........ ........ ........ 17% 273M 1s 49152K ........ ........ ........ ........ ........ ........ 18% 299M 1s 52224K ........ ........ ........ ........ ........ ........ 19% 305M 1s 55296K ........ ........ ........ ........ ........ ........ 20% 337M 1s 58368K ........ ........ ........ ........ ........ ........ 21% 320M 1s 61440K ........ ........ ........ ........ ........ ........ 22% 337M 1s 64512K ........ ........ ........ ........ ........ ........ 23% 328M 1s 67584K ........ ........ ........ ........ ........ ........ 24% 310M 1s 70656K ........ ........ ........ ........ ........ ........ 25% 273M 1s 73728K ........ ........ ........ ........ ........ ........ 27% 307M 1s 76800K ........ ........ ........ ........ ........ ........ 28% 339M 1s 79872K ........ ........ ........ ........ ........ ........ 29% 308M 1s 82944K ........ ........ ........ ........ ........ ........ 30% 348M 1s 86016K ........ ........ ........ ........ ........ ........ 31% 301M 1s 89088K ........ ........ ........ ........ ........ ........ 32% 313M 1s 92160K ........ ........ ........ ........ ........ ........ 33% 305M 1s 95232K ........ ........ ........ ........ ........ ........ 34% 286M 1s 98304K ........ ........ ........ ........ ........ ........ 35% 301M 1s 101376K ........ ........ ........ ........ ........ ........ 36% 328M 1s 104448K ........ ........ ........ ........ ........ ........ 37% 302M 1s 107520K ........ ........ ........ ........ ........ ........ 38% 317M 1s 110592K ........ ........ ........ ........ ........ ........ 40% 312M 1s 113664K ........ ........ ........ ........ ........ ........ 41% 290M 1s 116736K ........ ........ ........ ........ ........ ........ 42% 322M 1s 119808K ........ ........ ........ ........ ........ ........ 43% 317M 1s 122880K ........ ........ ........ ........ ........ ........ 44% 276M 1s 125952K ........ ........ ........ ........ ........ ........ 45% 186M 1s 129024K ........ ........ ........ ........ ........ ........ 46% 307M 1s 132096K ........ ........ ........ ........ ........ ........ 47% 361M 1s 135168K ........ ........ ........ ........ ........ ........ 48% 335M 1s 138240K ........ ........ ........ ........ ........ ........ 49% 312M 1s 141312K ........ ........ ........ ........ ........ ........ 50% 284M 1s 144384K ........ ........ ........ ........ ........ ........ 51% 272M 1s 147456K ........ ........ ........ ........ ........ ........ 53% 296M 0s 150528K ........ ........ ........ ........ ........ ........ 54% 323M 0s 153600K ........ ........ ........ ........ ........ ........ 55% 248M 0s 156672K ........ ........ ........ ........ ........ ........ 56% 283M 0s 159744K ........ ........ ........ ........ ........ ........ 57% 307M 0s 162816K ........ ........ ........ ........ ........ ........ 58% 176M 0s 165888K ........ ........ ........ ........ ........ ........ 59% 342M 0s 168960K ........ ........ ........ ........ ........ ........ 60% 351M 0s 172032K ........ ........ ........ ........ ........ ........ 61% 341M 0s 175104K ........ ........ ........ ........ ........ ........ 62% 349M 0s 178176K ........ ........ ........ ........ ........ ........ 63% 312M 0s 181248K ........ ........ ........ ........ ........ ........ 64% 289M 0s 184320K ........ ........ ........ ........ ........ ........ 66% 282M 0s 187392K ........ ........ ........ ........ ........ ........ 67% 294M 0s 190464K ........ ........ ........ ........ ........ ........ 68% 284M 0s 193536K ........ ........ ........ ........ ........ ........ 69% 269M 0s 196608K ........ ........ ........ ........ ........ ........ 70% 280M 0s 199680K ........ ........ ........ ........ ........ ........ 71% 303M 0s 202752K ........ ........ ........ ........ ........ ........ 72% 282M 0s 205824K ........ ........ ........ ........ ........ ........ 73% 308M 0s 208896K ........ ........ ........ ........ ........ ........ 74% 310M 0s 211968K ........ ........ ........ ........ ........ ........ 75% 257M 0s 215040K ........ ........ ........ ........ ........ ........ 76% 275M 0s 218112K ........ ........ ........ ........ ........ ........ 77% 279M 0s 221184K ........ ........ ........ ........ ........ ........ 79% 309M 0s 224256K ........ ........ ........ ........ ........ ........ 80% 311M 0s 227328K ........ ........ ........ ........ ........ ........ 81% 287M 0s 230400K ........ ........ ........ ........ ........ ........ 82% 285M 0s 233472K ........ ........ ........ ........ ........ ........ 83% 284M 0s 236544K ........ ........ ........ ........ ........ ........ 84% 292M 0s 239616K ........ ........ ........ ........ ........ ........ 85% 303M 0s 242688K ........ ........ ........ ........ ........ ........ 86% 281M 0s 245760K ........ ........ ........ ........ ........ ........ 87% 272M 0s 248832K ........ ........ ........ ........ ........ ........ 88% 333M 0s 251904K ........ ........ ........ ........ ........ ........ 89% 290M 0s 254976K ........ ........ ........ ........ ........ ........ 90% 277M 0s 258048K ........ ........ ........ ........ ........ ........ 92% 272M 0s 261120K ........ ........ ........ ........ ........ ........ 93% 314M 0s 264192K ........ ........ ........ ........ ........ ........ 94% 303M 0s 267264K ........ ........ ........ ........ ........ ........ 95% 300M 0s 270336K ........ ........ ........ ........ ........ ........ 96% 279M 0s 273408K ........ ........ ........ ........ ........ ........ 97% 324M 0s 276480K ........ ........ ........ ........ ........ ........ 98% 280M 0s 279552K ........ ........ ........ ........ ........ ........ 99% 291M 0s 282624K ........ ........ . 100% 330M=1.0s 2024-04-28 06:07:51 (274 MB/s) - ‘karaf-0.21.0-20240428.030741-111.zip’ saved [290582777/290582777] Extracting the new controller... + echo 'Extracting the new controller...' + unzip -q karaf-0.21.0-20240428.030741-111.zip Adding external repositories... + echo 'Adding external repositories...' + sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg + cat /tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # If set to true, the following property will not allow any certificate to be used # when accessing Maven repositories through SSL # #org.ops4j.pax.url.mvn.certificateCheck= # # Path to the local Maven settings file. # The repositories defined in this file will be automatically added to the list # of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property # below is not set. # The following locations are checked for the existence of the settings.xml file # * 1. looks for the specified url # * 2. if not found looks for ${user.home}/.m2/settings.xml # * 3. if not found looks for ${maven.home}/conf/settings.xml # * 4. if not found looks for ${M2_HOME}/conf/settings.xml # #org.ops4j.pax.url.mvn.settings= # # Path to the local Maven repository which is used to avoid downloading # artifacts when they already exist locally. # The value of this property will be extracted from the settings.xml file # above, or defaulted to: # System.getProperty( "user.home" ) + "/.m2/repository" # org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository} # # Default this to false. It's just weird to use undocumented repos # org.ops4j.pax.url.mvn.useFallbackRepositories=false # # Uncomment if you don't wanna use the proxy settings # from the Maven conf/settings.xml file # # org.ops4j.pax.url.mvn.proxySupport=false # # Comma separated list of repositories scanned when resolving an artifact. # Those repositories will be checked before iterating through the # below list of repositories and even before the local repository # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snaphots # @noreleases : the repository does not contain any released artifacts # # The following property value will add the system folder as a repo. # org.ops4j.pax.url.mvn.defaultRepositories=\ file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\ file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\ file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots # Use the default local repo (e.g.~/.m2/repository) as a "remote" repo #org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false # # Comma separated list of repositories scanned when resolving an artifact. # The default list includes the following repositories: # http://repo1.maven.org/maven2@id=central # http://repository.springsource.com/maven/bundles/release@id=spring.ebr # http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external # http://zodiac.springsource.com/maven/bundles/release@id=gemini # http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases # https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases # https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases # To add repositories to the default ones, prepend '+' to the list of repositories # to add. # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snapshots # @noreleases : the repository does not contain any released artifacts # @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended # org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases ### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.+ [[ True == \T\r\u\e ]] Configuring the startup features... + echo 'Configuring the startup features...' + sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.21.0-SNAPSHOT/etc/org.apache.karaf.features.cfg + FEATURE_TEST_STRING=features-test + FEATURE_TEST_VERSION=0.21.0-SNAPSHOT + KARAF_VERSION=karaf4 + [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]] + sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.21.0-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.21.0-SNAPSHOT/etc/org.apache.karaf.features.cfg + [[ ! -z '' ]] + cat /tmp/karaf-0.21.0-SNAPSHOT/etc/org.apache.karaf.features.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # Comma separated list of features repositories to register by default # featuresRepositories = mvn:org.opendaylight.integration/features-test/0.21.0-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/a3113b32-3c7b-4877-8dee-44fd2349d37b.xml # # Comma separated list of features to install at startup # featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, f51e7fcb-6431-426d-8642-8007f1b6be68 # # Resource repositories (OBR) that the features resolver can use # to resolve requirements/capabilities # # The format of the resourceRepositories is # resourceRepositories=[xml:url|json:url],... # for Instance: # #resourceRepositories=xml:http://host/path/to/index.xml # or #resourceRepositories=json:http://host/path/to/index.json # # # Defines if the boot features are started in asynchronous mode (in a dedicated thread) # featuresBootAsynchronous=false # # Service requirements enforcement # # By default, the feature resolver checks the service requirements/capabilities of # bundles for new features (xml schema >= 1.3.0) in order to automatically installs # the required bundles. # The following flag can have those values: # - disable: service requirements are completely ignored # - default: service requirements are ignored for old features # - enforce: service requirements are always verified # #serviceRequirements=default # # Store cfg file for config element in feature # #configCfgStore=true # # Define if the feature service automatically refresh bundles # autoRefresh=true # # Configuration of features processing mechanism (overrides, blacklisting, modification of features) # XML file defines instructions related to features processing # versions.properties may declare properties to resolve placeholders in XML file # both files are relative to ${karaf.etc} # #featureProcessing=org.apache.karaf.features.xml #featureProcessingVersions=versions.properties + configure_karaf_log karaf4 '' + local -r karaf_version=karaf4 + local -r controllerdebugmap= + local logapi=log4j + grep log4j2 /tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n log4j2.rootLogger.level = INFO #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 64MB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE Configuring the karaf log... karaf_version: karaf4, logapi: log4j2 + logapi=log4j2 + echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2' + '[' log4j2 == log4j2 ']' + sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg + orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver + orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN' + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN' controllerdebugmap: + unset IFS + echo 'controllerdebugmap: ' + '[' -n '' ']' cat /tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg + echo 'cat /tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg' + cat /tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # Common pattern layout for appenders log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n # Root logger log4j2.rootLogger.level = INFO # uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} # Filters for logs marked by org.opendaylight.odlparent.Markers log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL # Loggers configuration # Spifly logger log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN # Security audit logger log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Appenders configuration # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} # Rolling file appender log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i # uncomment to not force a disk flush #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 1GB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 # Audit file appender log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 # OSGi appender log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * # help with identification of maven-related problems with pax-url-aether #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN + set_java_vars /usr/lib/jvm/java-17-openjdk 3072m /tmp/karaf-0.21.0-SNAPSHOT/bin/setenv + local -r java_home=/usr/lib/jvm/java-17-openjdk + local -r controllermem=3072m Configure + local -r memconf=/tmp/karaf-0.21.0-SNAPSHOT/bin/setenv + echo Configure + echo ' java home: /usr/lib/jvm/java-17-openjdk' java home: /usr/lib/jvm/java-17-openjdk max memory: 3072m memconf: /tmp/karaf-0.21.0-SNAPSHOT/bin/setenv + echo ' max memory: 3072m' + echo ' memconf: /tmp/karaf-0.21.0-SNAPSHOT/bin/setenv' + sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk}%g' /tmp/karaf-0.21.0-SNAPSHOT/bin/setenv + sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.21.0-SNAPSHOT/bin/setenv + echo 'cat /tmp/karaf-0.21.0-SNAPSHOT/bin/setenv' cat /tmp/karaf-0.21.0-SNAPSHOT/bin/setenv + cat /tmp/karaf-0.21.0-SNAPSHOT/bin/setenv #!/bin/sh # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # # # handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf # script: client, instance, shell, start, status, stop, karaf # # if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then # Actions go here... # fi # # general settings which should be applied for all scripts go here; please keep # in mind that it is possible that scripts might be executed more than once, e.g. # in example of the start script where the start script is executed first and the # karaf script afterwards. # # # The following section shows the possible configuration options for the default # karaf scripts # export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk} # Location of Java installation # export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration # export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options # export EXTRA_JAVA_OPTS # Additional JVM options # export KARAF_HOME # Karaf home folder # export KARAF_DATA # Karaf data folder # export KARAF_BASE # Karaf base folder # export KARAF_ETC # Karaf etc folder # export KARAF_LOG # Karaf log folder # export KARAF_SYSTEM_OPTS # First citizen Karaf options # export KARAF_OPTS # Additional available Karaf options # export KARAF_DEBUG # Enable debug mode # export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start # export KARAF_NOROOT # Prevent execution as root if set to true Set Java version + echo 'Set Java version' + sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-17-openjdk/bin/java 1 + sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-17-openjdk/bin/java JDK default version ... + echo 'JDK default version ...' + java -version openjdk version "17.0.6-ea" 2023-01-17 LTS OpenJDK Runtime Environment (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS) OpenJDK 64-Bit Server VM (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS, mixed mode, sharing) Set JAVA_HOME + echo 'Set JAVA_HOME' + export JAVA_HOME=/usr/lib/jvm/java-17-openjdk + JAVA_HOME=/usr/lib/jvm/java-17-openjdk ++ readlink -e /usr/lib/jvm/java-17-openjdk/bin/java + JAVA_RESOLVED=/usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java Listing all open ports on controller system... + echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java' + echo 'Listing all open ports on controller system...' + netstat -pnatu (Not all processes could be identified, non-owned process info will not be shown, you would have to be root to see it all.) Active Internet connections (servers and established) Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN - tcp 0 0 0.0.0.0:111 0.0.0.0:* LISTEN - tcp 0 68 10.30.171.127:22 10.30.170.112:58700 ESTABLISHED - tcp 0 0 10.30.171.127:51646 199.204.45.87:443 TIME_WAIT - tcp6 0 0 :::5555 :::* LISTEN - tcp6 0 0 :::22 :::* LISTEN - tcp6 0 0 :::111 :::* LISTEN - udp 0 0 10.30.171.127:68 10.30.170.2:67 ESTABLISHED - udp 0 0 0.0.0.0:111 0.0.0.0:* - udp 0 0 127.0.0.1:323 0.0.0.0:* - udp6 0 0 :::111 :::* - udp6 0 0 ::1:323 :::* - Custom shard config exists!!! Copying the shard config... + '[' -f /tmp/custom_shard_config.txt ']' + echo 'Custom shard config exists!!!' + echo 'Copying the shard config...' + cp /tmp/custom_shard_config.txt /tmp/karaf-0.21.0-SNAPSHOT/bin/ Configuring cluster + echo 'Configuring cluster' + /tmp/karaf-0.21.0-SNAPSHOT/bin/configure_cluster.sh 1 10.30.171.127 10.30.170.58 10.30.171.170 ################################################ ## Configure Cluster ## ################################################ NOTE: Cluster configuration files not found. Copying from /tmp/karaf-0.21.0-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/9.0.2 Configuring unique name in akka.conf Configuring hostname in akka.conf Configuring data and rpc seed nodes in akka.conf modules = [ { name = "inventory" namespace = "urn:opendaylight:inventory" shard-strategy = "module" }, { name = "topology" namespace = "urn:TBD:params:xml:ns:yang:network-topology" shard-strategy = "module" }, { name = "toaster" namespace = "http://netconfcentral.org/ns/toaster" shard-strategy = "module" }, { name = "car" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" shard-strategy = "module" }, { name = "people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" shard-strategy = "module" }, { name = "car-people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" shard-strategy = "module" } ] Configuring replication type in module-shards.conf ################################################ ## NOTE: Manually restart controller to ## ## apply configuration. ## ################################################ Dump akka.conf + echo 'Dump akka.conf' + cat /tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/akka.conf odl-cluster-data { akka { remote { artery { enabled = on transport = tcp canonical.hostname = "10.30.171.127" canonical.port = 2550 } } cluster { # Using artery. seed-nodes = ["akka://opendaylight-cluster-data@10.30.171.127:2550", "akka://opendaylight-cluster-data@10.30.170.58:2550", "akka://opendaylight-cluster-data@10.30.171.170:2550"] roles = ["member-1"] # when under load we might trip a false positive on the failure detector # failure-detector { # heartbeat-interval = 4 s # acceptable-heartbeat-pause = 16s # } } persistence { # By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by # modifying the following two properties. The directory location specified may be a relative or absolute path. # The relative path is always relative to KARAF_HOME. # snapshot-store.local.dir = "target/snapshots" # Use lz4 compression for LocalSnapshotStore snapshots snapshot-store.local.use-lz4-compression = false # Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB snapshot-store.local.lz4-blocksize = 256KB } disable-default-actor-system-quarantined-event-handling = "false" } } Dump modules.conf + echo 'Dump modules.conf' + cat /tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/modules.conf modules = [ { name = "inventory" namespace = "urn:opendaylight:inventory" shard-strategy = "module" }, { name = "topology" namespace = "urn:TBD:params:xml:ns:yang:network-topology" shard-strategy = "module" }, { name = "toaster" namespace = "http://netconfcentral.org/ns/toaster" shard-strategy = "module" }, { name = "car" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" shard-strategy = "module" }, { name = "people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" shard-strategy = "module" }, { name = "car-people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" shard-strategy = "module" } ] Dump module-shards.conf + echo 'Dump module-shards.conf' + cat /tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/module-shards.conf module-shards = [ { name = "default" shards = [ { name = "default" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "inventory" shards = [ { name="inventory" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "topology" shards = [ { name="topology" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "toaster" shards = [ { name="toaster" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "car" shards = [ { name="car" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "people" shards = [ { name="people" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "car-people" shards = [ { name="car-people" replicas = ["member-1", "member-2", "member-3"] } ] } ] Configuring member-2 with IP address 10.30.170.58 Warning: Permanently added '10.30.170.58' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.170.58' (ECDSA) to the list of known hosts. + source /tmp/common-functions.sh karaf-0.21.0-SNAPSHOT common-functions.sh is being sourced ++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]] ++ echo 'common-functions.sh is being sourced' ++ BUNDLEFOLDER=karaf-0.21.0-SNAPSHOT ++ export MAVENCONF=/tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ++ MAVENCONF=/tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ++ export FEATURESCONF=/tmp/karaf-0.21.0-SNAPSHOT/etc/org.apache.karaf.features.cfg ++ FEATURESCONF=/tmp/karaf-0.21.0-SNAPSHOT/etc/org.apache.karaf.features.cfg ++ export CUSTOMPROP=/tmp/karaf-0.21.0-SNAPSHOT/etc/custom.properties ++ CUSTOMPROP=/tmp/karaf-0.21.0-SNAPSHOT/etc/custom.properties ++ export LOGCONF=/tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ++ LOGCONF=/tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ++ export MEMCONF=/tmp/karaf-0.21.0-SNAPSHOT/bin/setenv ++ MEMCONF=/tmp/karaf-0.21.0-SNAPSHOT/bin/setenv ++ export CONTROLLERMEM= ++ CONTROLLERMEM= ++ export AKKACONF=/tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/akka.conf ++ AKKACONF=/tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/akka.conf ++ export MODULESCONF=/tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/modules.conf ++ MODULESCONF=/tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/modules.conf ++ export MODULESHARDSCONF=/tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/module-shards.conf ++ MODULESHARDSCONF=/tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/module-shards.conf ++ print_common_env ++ cat common-functions environment: MAVENCONF: /tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ACTUALFEATURES: FEATURESCONF: /tmp/karaf-0.21.0-SNAPSHOT/etc/org.apache.karaf.features.cfg CUSTOMPROP: /tmp/karaf-0.21.0-SNAPSHOT/etc/custom.properties LOGCONF: /tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg MEMCONF: /tmp/karaf-0.21.0-SNAPSHOT/bin/setenv CONTROLLERMEM: AKKACONF: /tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/akka.conf MODULESCONF: /tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/modules.conf MODULESHARDSCONF: /tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/module-shards.conf SUITES: ++ SSH='ssh -t -t' ++ extra_services_cntl=' dnsmasq.service httpd.service libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service rabbitmq-server.service ' ++ extra_services_cmp=' libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service ' Changing to /tmp Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.0-SNAPSHOT/karaf-0.21.0-20240428.030741-111.zip + echo 'Changing to /tmp' + cd /tmp + echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.0-SNAPSHOT/karaf-0.21.0-20240428.030741-111.zip' + wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.0-SNAPSHOT/karaf-0.21.0-20240428.030741-111.zip --2024-04-28 06:07:55-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.0-SNAPSHOT/karaf-0.21.0-20240428.030741-111.zip Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6 Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 290582777 (277M) [application/zip] Saving to: ‘karaf-0.21.0-20240428.030741-111.zip’ 0K ........ ........ ........ ........ ........ ........ 1% 67.4M 4s 3072K ........ ........ ........ ........ ........ ........ 2% 133M 3s 6144K ........ ........ ........ ........ ........ ........ 3% 194M 2s 9216K ........ ........ ........ ........ ........ ........ 4% 199M 2s 12288K ........ ........ ........ ........ ........ ........ 5% 242M 2s 15360K ........ ........ ........ ........ ........ ........ 6% 214M 2s 18432K ........ ........ ........ ........ ........ ........ 7% 237M 2s 21504K ........ ........ ........ ........ ........ ........ 8% 231M 2s 24576K ........ ........ ........ ........ ........ ........ 9% 226M 2s 27648K ........ ........ ........ ........ ........ ........ 10% 243M 1s 30720K ........ ........ ........ ........ ........ ........ 11% 234M 1s 33792K ........ ........ ........ ........ ........ ........ 12% 291M 1s 36864K ........ ........ ........ ........ ........ ........ 14% 293M 1s 39936K ........ ........ ........ ........ ........ ........ 15% 283M 1s 43008K ........ ........ ........ ........ ........ ........ 16% 200M 1s 46080K ........ ........ ........ ........ ........ ........ 17% 310M 1s 49152K ........ ........ ........ ........ ........ ........ 18% 311M 1s 52224K ........ ........ ........ ........ ........ ........ 19% 311M 1s 55296K ........ ........ ........ ........ ........ ........ 20% 304M 1s 58368K ........ ........ ........ ........ ........ ........ 21% 305M 1s 61440K ........ ........ ........ ........ ........ ........ 22% 305M 1s 64512K ........ ........ ........ ........ ........ ........ 23% 359M 1s 67584K ........ ........ ........ ........ ........ ........ 24% 387M 1s 70656K ........ ........ ........ ........ ........ ........ 25% 390M 1s 73728K ........ ........ ........ ........ ........ ........ 27% 359M 1s 76800K ........ ........ ........ ........ ........ ........ 28% 306M 1s 79872K ........ ........ ........ ........ ........ ........ 29% 303M 1s 82944K ........ ........ ........ ........ ........ ........ 30% 310M 1s 86016K ........ ........ ........ ........ ........ ........ 31% 303M 1s 89088K ........ ........ ........ ........ ........ ........ 32% 301M 1s 92160K ........ ........ ........ ........ ........ ........ 33% 305M 1s 95232K ........ ........ ........ ........ ........ ........ 34% 307M 1s 98304K ........ ........ ........ ........ ........ ........ 35% 304M 1s 101376K ........ ........ ........ ........ ........ ........ 36% 317M 1s 104448K ........ ........ ........ ........ ........ ........ 37% 324M 1s 107520K ........ ........ ........ ........ ........ ........ 38% 316M 1s 110592K ........ ........ ........ ........ ........ ........ 40% 324M 1s 113664K ........ ........ ........ ........ ........ ........ 41% 324M 1s 116736K ........ ........ ........ ........ ........ ........ 42% 317M 1s 119808K ........ ........ ........ ........ ........ ........ 43% 320M 1s 122880K ........ ........ ........ ........ ........ ........ 44% 316M 1s 125952K ........ ........ ........ ........ ........ ........ 45% 318M 1s 129024K ........ ........ ........ ........ ........ ........ 46% 321M 1s 132096K ........ ........ ........ ........ ........ ........ 47% 320M 1s 135168K ........ ........ ........ ........ ........ ........ 48% 325M 1s 138240K ........ ........ ........ ........ ........ ........ 49% 271M 1s 141312K ........ ........ ........ ........ ........ ........ 50% 280M 1s 144384K ........ ........ ........ ........ ........ ........ 51% 393M 1s 147456K ........ ........ ........ ........ ........ ........ 53% 401M 0s 150528K ........ ........ ........ ........ ........ ........ 54% 389M 0s 153600K ........ ........ ........ ........ ........ ........ 55% 380M 0s 156672K ........ ........ ........ ........ ........ ........ 56% 349M 0s 159744K ........ ........ ........ ........ ........ ........ 57% 368M 0s 162816K ........ ........ ........ ........ ........ ........ 58% 351M 0s 165888K ........ ........ ........ ........ ........ ........ 59% 374M 0s 168960K ........ ........ ........ ........ ........ ........ 60% 352M 0s 172032K ........ ........ ........ ........ ........ ........ 61% 370M 0s 175104K ........ ........ ........ ........ ........ ........ 62% 355M 0s 178176K ........ ........ ........ ........ ........ ........ 63% 369M 0s 181248K ........ ........ ........ ........ ........ ........ 64% 355M 0s 184320K ........ ........ ........ ........ ........ ........ 66% 322M 0s 187392K ........ ........ ........ ........ ........ ........ 67% 195M 0s 190464K ........ ........ ........ ........ ........ ........ 68% 291M 0s 193536K ........ ........ ........ ........ ........ ........ 69% 351M 0s 196608K ........ ........ ........ ........ ........ ........ 70% 298M 0s 199680K ........ ........ ........ ........ ........ ........ 71% 338M 0s 202752K ........ ........ ........ ........ ........ ........ 72% 336M 0s 205824K ........ ........ ........ ........ ........ ........ 73% 333M 0s 208896K ........ ........ ........ ........ ........ ........ 74% 339M 0s 211968K ........ ........ ........ ........ ........ ........ 75% 330M 0s 215040K ........ ........ ........ ........ ........ ........ 76% 341M 0s 218112K ........ ........ ........ ........ ........ ........ 77% 256M 0s 221184K ........ ........ ........ ........ ........ ........ 79% 162M 0s 224256K ........ ........ ........ ........ ........ ........ 80% 340M 0s 227328K ........ ........ ........ ........ ........ ........ 81% 339M 0s 230400K ........ ........ ........ ........ ........ ........ 82% 332M 0s 233472K ........ ........ ........ ........ ........ ........ 83% 336M 0s 236544K ........ ........ ........ ........ ........ ........ 84% 325M 0s 239616K ........ ........ ........ ........ ........ ........ 85% 333M 0s 242688K ........ ........ ........ ........ ........ ........ 86% 330M 0s 245760K ........ ........ ........ ........ ........ ........ 87% 337M 0s 248832K ........ ........ ........ ........ ........ ........ 88% 335M 0s 251904K ........ ........ ........ ........ ........ ........ 89% 345M 0s 254976K ........ ........ ........ ........ ........ ........ 90% 338M 0s 258048K ........ ........ ........ ........ ........ ........ 92% 325M 0s 261120K ........ ........ ........ ........ ........ ........ 93% 333M 0s 264192K ........ ........ ........ ........ ........ ........ 94% 328M 0s 267264K ........ ........ ........ ........ ........ ........ 95% 190M 0s 270336K ........ ........ ........ ........ ........ ........ 96% 366M 0s 273408K ........ ........ ........ ........ ........ ........ 97% 378M 0s 276480K ........ ........ ........ ........ ........ ........ 98% 362M 0s 279552K ........ ........ ........ ........ ........ ........ 99% 396M 0s 282624K ........ ........ . 100% 400M=1.0s 2024-04-28 06:07:56 (290 MB/s) - ‘karaf-0.21.0-20240428.030741-111.zip’ saved [290582777/290582777] Extracting the new controller... + echo 'Extracting the new controller...' + unzip -q karaf-0.21.0-20240428.030741-111.zip + echo 'Adding external repositories...' Adding external repositories... + sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg + cat /tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # If set to true, the following property will not allow any certificate to be used # when accessing Maven repositories through SSL # #org.ops4j.pax.url.mvn.certificateCheck= # # Path to the local Maven settings file. # The repositories defined in this file will be automatically added to the list # of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property # below is not set. # The following locations are checked for the existence of the settings.xml file # * 1. looks for the specified url # * 2. if not found looks for ${user.home}/.m2/settings.xml # * 3. if not found looks for ${maven.home}/conf/settings.xml # * 4. if not found looks for ${M2_HOME}/conf/settings.xml # #org.ops4j.pax.url.mvn.settings= # # Path to the local Maven repository which is used to avoid downloading # artifacts when they already exist locally. # The value of this property will be extracted from the settings.xml file # above, or defaulted to: # System.getProperty( "user.home" ) + "/.m2/repository" # org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository} # # Default this to false. It's just weird to use undocumented repos # org.ops4j.pax.url.mvn.useFallbackRepositories=false # # Uncomment if you don't wanna use the proxy settings # from the Maven conf/settings.xml file # # org.ops4j.pax.url.mvn.proxySupport=false # # Comma separated list of repositories scanned when resolving an artifact. # Those repositories will be checked before iterating through the # below list of repositories and even before the local repository # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snaphots # @noreleases : the repository does not contain any released artifacts # # The following property value will add the system folder as a repo. # org.ops4j.pax.url.mvn.defaultRepositories=\ file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\ file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\ file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots # Use the default local repo (e.g.~/.m2/repository) as a "remote" repo #org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false # # Comma separated list of repositories scanned when resolving an artifact. # The default list includes the following repositories: # http://repo1.maven.org/maven2@id=central # http://repository.springsource.com/maven/bundles/release@id=spring.ebr # http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external # http://zodiac.springsource.com/maven/bundles/release@id=gemini # http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases # https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases # https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases # To add repositories to the default ones, prepend '+' to the list of repositories # to add. # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snapshots # @noreleases : the repository does not contain any released artifacts # @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended # org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases ### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.+ [[ True == \T\r\u\e ]] + echo 'Configuring the startup features...' Configuring the startup features... + sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.21.0-SNAPSHOT/etc/org.apache.karaf.features.cfg + FEATURE_TEST_STRING=features-test + FEATURE_TEST_VERSION=0.21.0-SNAPSHOT + KARAF_VERSION=karaf4 + [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]] + sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.21.0-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.21.0-SNAPSHOT/etc/org.apache.karaf.features.cfg + [[ ! -z '' ]] + cat /tmp/karaf-0.21.0-SNAPSHOT/etc/org.apache.karaf.features.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # Comma separated list of features repositories to register by default # featuresRepositories = mvn:org.opendaylight.integration/features-test/0.21.0-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/a3113b32-3c7b-4877-8dee-44fd2349d37b.xml # # Comma separated list of features to install at startup # featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, f51e7fcb-6431-426d-8642-8007f1b6be68 # # Resource repositories (OBR) that the features resolver can use # to resolve requirements/capabilities # # The format of the resourceRepositories is # resourceRepositories=[xml:url|json:url],... # for Instance: # #resourceRepositories=xml:http://host/path/to/index.xml # or #resourceRepositories=json:http://host/path/to/index.json # # # Defines if the boot features are started in asynchronous mode (in a dedicated thread) # featuresBootAsynchronous=false # # Service requirements enforcement # # By default, the feature resolver checks the service requirements/capabilities of # bundles for new features (xml schema >= 1.3.0) in order to automatically installs # the required bundles. # The following flag can have those values: # - disable: service requirements are completely ignored # - default: service requirements are ignored for old features # - enforce: service requirements are always verified # #serviceRequirements=default # # Store cfg file for config element in feature # #configCfgStore=true # # Define if the feature service automatically refresh bundles # autoRefresh=true # # Configuration of features processing mechanism (overrides, blacklisting, modification of features) # XML file defines instructions related to features processing # versions.properties may declare properties to resolve placeholders in XML file # both files are relative to ${karaf.etc} # #featureProcessing=org.apache.karaf.features.xml #featureProcessingVersions=versions.properties + configure_karaf_log karaf4 '' + local -r karaf_version=karaf4 + local -r controllerdebugmap= + local logapi=log4j + grep log4j2 /tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n log4j2.rootLogger.level = INFO #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 64MB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE + logapi=log4j2 + echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2' Configuring the karaf log... karaf_version: karaf4, logapi: log4j2 + '[' log4j2 == log4j2 ']' + sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg + orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver + orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN' controllerdebugmap: cat /tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN' + unset IFS + echo 'controllerdebugmap: ' + '[' -n '' ']' + echo 'cat /tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg' + cat /tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # Common pattern layout for appenders log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n # Root logger log4j2.rootLogger.level = INFO # uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} # Filters for logs marked by org.opendaylight.odlparent.Markers log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL # Loggers configuration # Spifly logger log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN # Security audit logger log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Appenders configuration # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} # Rolling file appender log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i # uncomment to not force a disk flush #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 1GB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 # Audit file appender log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 # OSGi appender log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * # help with identification of maven-related problems with pax-url-aether #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN Configure java home: /usr/lib/jvm/java-17-openjdk max memory: 3072m memconf: /tmp/karaf-0.21.0-SNAPSHOT/bin/setenv + set_java_vars /usr/lib/jvm/java-17-openjdk 3072m /tmp/karaf-0.21.0-SNAPSHOT/bin/setenv + local -r java_home=/usr/lib/jvm/java-17-openjdk + local -r controllermem=3072m + local -r memconf=/tmp/karaf-0.21.0-SNAPSHOT/bin/setenv + echo Configure + echo ' java home: /usr/lib/jvm/java-17-openjdk' + echo ' max memory: 3072m' + echo ' memconf: /tmp/karaf-0.21.0-SNAPSHOT/bin/setenv' + sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk}%g' /tmp/karaf-0.21.0-SNAPSHOT/bin/setenv + sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.21.0-SNAPSHOT/bin/setenv cat /tmp/karaf-0.21.0-SNAPSHOT/bin/setenv + echo 'cat /tmp/karaf-0.21.0-SNAPSHOT/bin/setenv' + cat /tmp/karaf-0.21.0-SNAPSHOT/bin/setenv #!/bin/sh # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # # # handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf # script: client, instance, shell, start, status, stop, karaf # # if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then # Actions go here... # fi # # general settings which should be applied for all scripts go here; please keep # in mind that it is possible that scripts might be executed more than once, e.g. # in example of the start script where the start script is executed first and the # karaf script afterwards. # # # The following section shows the possible configuration options for the default # karaf scripts # export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk} # Location of Java installation # export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration # export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options # export EXTRA_JAVA_OPTS # Additional JVM options # export KARAF_HOME # Karaf home folder # export KARAF_DATA # Karaf data folder # export KARAF_BASE # Karaf base folder # export KARAF_ETC # Karaf etc folder # export KARAF_LOG # Karaf log folder # export KARAF_SYSTEM_OPTS # First citizen Karaf options # export KARAF_OPTS # Additional available Karaf options # export KARAF_DEBUG # Enable debug mode # export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start # export KARAF_NOROOT # Prevent execution as root if set to true Set Java version + echo 'Set Java version' + sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-17-openjdk/bin/java 1 + sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-17-openjdk/bin/java JDK default version ... + echo 'JDK default version ...' + java -version openjdk version "17.0.6-ea" 2023-01-17 LTS OpenJDK Runtime Environment (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS) OpenJDK 64-Bit Server VM (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS, mixed mode, sharing) Set JAVA_HOME + echo 'Set JAVA_HOME' + export JAVA_HOME=/usr/lib/jvm/java-17-openjdk + JAVA_HOME=/usr/lib/jvm/java-17-openjdk ++ readlink -e /usr/lib/jvm/java-17-openjdk/bin/java Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java Listing all open ports on controller system... + JAVA_RESOLVED=/usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java + echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java' + echo 'Listing all open ports on controller system...' + netstat -pnatu (Not all processes could be identified, non-owned process info will not be shown, you would have to be root to see it all.) Active Internet connections (servers and established) Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name tcp 0 0 0.0.0.0:111 0.0.0.0:* LISTEN - tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN - tcp 0 0 10.30.170.58:52040 199.204.45.87:443 TIME_WAIT - tcp 0 164 10.30.170.58:22 10.30.170.112:33028 ESTABLISHED - tcp6 0 0 :::111 :::* LISTEN - tcp6 0 0 :::5555 :::* LISTEN - tcp6 0 0 :::22 :::* LISTEN - udp 0 0 10.30.170.58:68 10.30.170.4:67 ESTABLISHED - udp 0 0 0.0.0.0:111 0.0.0.0:* - udp 0 0 127.0.0.1:323 0.0.0.0:* - udp6 0 0 :::111 :::* - udp6 0 0 ::1:323 :::* - Custom shard config exists!!! Copying the shard config... + '[' -f /tmp/custom_shard_config.txt ']' + echo 'Custom shard config exists!!!' + echo 'Copying the shard config...' + cp /tmp/custom_shard_config.txt /tmp/karaf-0.21.0-SNAPSHOT/bin/ Configuring cluster + echo 'Configuring cluster' + /tmp/karaf-0.21.0-SNAPSHOT/bin/configure_cluster.sh 2 10.30.171.127 10.30.170.58 10.30.171.170 ################################################ ## Configure Cluster ## ################################################ NOTE: Cluster configuration files not found. Copying from /tmp/karaf-0.21.0-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/9.0.2 Configuring unique name in akka.conf Configuring hostname in akka.conf Configuring data and rpc seed nodes in akka.conf modules = [ { name = "inventory" namespace = "urn:opendaylight:inventory" shard-strategy = "module" }, { name = "topology" namespace = "urn:TBD:params:xml:ns:yang:network-topology" shard-strategy = "module" }, { name = "toaster" namespace = "http://netconfcentral.org/ns/toaster" shard-strategy = "module" }, { name = "car" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" shard-strategy = "module" }, { name = "people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" shard-strategy = "module" }, { name = "car-people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" shard-strategy = "module" } ] Configuring replication type in module-shards.conf ################################################ ## NOTE: Manually restart controller to ## ## apply configuration. ## ################################################ Dump akka.conf + echo 'Dump akka.conf' + cat /tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/akka.conf odl-cluster-data { akka { remote { artery { enabled = on transport = tcp canonical.hostname = "10.30.170.58" canonical.port = 2550 } } cluster { # Using artery. seed-nodes = ["akka://opendaylight-cluster-data@10.30.171.127:2550", "akka://opendaylight-cluster-data@10.30.170.58:2550", "akka://opendaylight-cluster-data@10.30.171.170:2550"] roles = ["member-2"] # when under load we might trip a false positive on the failure detector # failure-detector { # heartbeat-interval = 4 s # acceptable-heartbeat-pause = 16s # } } persistence { # By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by # modifying the following two properties. The directory location specified may be a relative or absolute path. # The relative path is always relative to KARAF_HOME. # snapshot-store.local.dir = "target/snapshots" # Use lz4 compression for LocalSnapshotStore snapshots snapshot-store.local.use-lz4-compression = false # Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB snapshot-store.local.lz4-blocksize = 256KB } disable-default-actor-system-quarantined-event-handling = "false" } } Dump modules.conf + echo 'Dump modules.conf' + cat /tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/modules.conf modules = [ { name = "inventory" namespace = "urn:opendaylight:inventory" shard-strategy = "module" }, { name = "topology" namespace = "urn:TBD:params:xml:ns:yang:network-topology" shard-strategy = "module" }, { name = "toaster" namespace = "http://netconfcentral.org/ns/toaster" shard-strategy = "module" }, { name = "car" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" shard-strategy = "module" }, { name = "people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" shard-strategy = "module" }, { name = "car-people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" shard-strategy = "module" } ] Dump module-shards.conf + echo 'Dump module-shards.conf' + cat /tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/module-shards.conf module-shards = [ { name = "default" shards = [ { name = "default" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "inventory" shards = [ { name="inventory" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "topology" shards = [ { name="topology" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "toaster" shards = [ { name="toaster" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "car" shards = [ { name="car" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "people" shards = [ { name="people" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "car-people" shards = [ { name="car-people" replicas = ["member-1", "member-2", "member-3"] } ] } ] Configuring member-3 with IP address 10.30.171.170 Warning: Permanently added '10.30.171.170' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.171.170' (ECDSA) to the list of known hosts. common-functions.sh is being sourced + source /tmp/common-functions.sh karaf-0.21.0-SNAPSHOT ++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]] ++ echo 'common-functions.sh is being sourced' ++ BUNDLEFOLDER=karaf-0.21.0-SNAPSHOT ++ export MAVENCONF=/tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ++ MAVENCONF=/tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ++ export FEATURESCONF=/tmp/karaf-0.21.0-SNAPSHOT/etc/org.apache.karaf.features.cfg ++ FEATURESCONF=/tmp/karaf-0.21.0-SNAPSHOT/etc/org.apache.karaf.features.cfg ++ export CUSTOMPROP=/tmp/karaf-0.21.0-SNAPSHOT/etc/custom.properties ++ CUSTOMPROP=/tmp/karaf-0.21.0-SNAPSHOT/etc/custom.properties ++ export LOGCONF=/tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ++ LOGCONF=/tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ++ export MEMCONF=/tmp/karaf-0.21.0-SNAPSHOT/bin/setenv ++ MEMCONF=/tmp/karaf-0.21.0-SNAPSHOT/bin/setenv ++ export CONTROLLERMEM= ++ CONTROLLERMEM= ++ export AKKACONF=/tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/akka.conf ++ AKKACONF=/tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/akka.conf ++ export MODULESCONF=/tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/modules.conf ++ MODULESCONF=/tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/modules.conf ++ export MODULESHARDSCONF=/tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/module-shards.conf ++ MODULESHARDSCONF=/tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/module-shards.conf ++ print_common_env ++ cat common-functions environment: MAVENCONF: /tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ACTUALFEATURES: FEATURESCONF: /tmp/karaf-0.21.0-SNAPSHOT/etc/org.apache.karaf.features.cfg CUSTOMPROP: /tmp/karaf-0.21.0-SNAPSHOT/etc/custom.properties LOGCONF: /tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg MEMCONF: /tmp/karaf-0.21.0-SNAPSHOT/bin/setenv CONTROLLERMEM: AKKACONF: /tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/akka.conf MODULESCONF: /tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/modules.conf MODULESHARDSCONF: /tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/module-shards.conf SUITES: ++ SSH='ssh -t -t' ++ extra_services_cntl=' dnsmasq.service httpd.service libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service rabbitmq-server.service ' ++ extra_services_cmp=' libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service ' Changing to /tmp Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.0-SNAPSHOT/karaf-0.21.0-20240428.030741-111.zip + echo 'Changing to /tmp' + cd /tmp + echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.0-SNAPSHOT/karaf-0.21.0-20240428.030741-111.zip' + wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.0-SNAPSHOT/karaf-0.21.0-20240428.030741-111.zip --2024-04-28 06:07:59-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.0-SNAPSHOT/karaf-0.21.0-20240428.030741-111.zip Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6 Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 290582777 (277M) [application/zip] Saving to: ‘karaf-0.21.0-20240428.030741-111.zip’ 0K ........ ........ ........ ........ ........ ........ 1% 110M 2s 3072K ........ ........ ........ ........ ........ ........ 2% 175M 2s 6144K ........ ........ ........ ........ ........ ........ 3% 210M 2s 9216K ........ ........ ........ ........ ........ ........ 4% 204M 2s 12288K ........ ........ ........ ........ ........ ........ 5% 224M 2s 15360K ........ ........ ........ ........ ........ ........ 6% 212M 1s 18432K ........ ........ ........ ........ ........ ........ 7% 250M 1s 21504K ........ ........ ........ ........ ........ ........ 8% 278M 1s 24576K ........ ........ ........ ........ ........ ........ 9% 264M 1s 27648K ........ ........ ........ ........ ........ ........ 10% 291M 1s 30720K ........ ........ ........ ........ ........ ........ 11% 291M 1s 33792K ........ ........ ........ ........ ........ ........ 12% 312M 1s 36864K ........ ........ ........ ........ ........ ........ 14% 321M 1s 39936K ........ ........ ........ ........ ........ ........ 15% 292M 1s 43008K ........ ........ ........ ........ ........ ........ 16% 276M 1s 46080K ........ ........ ........ ........ ........ ........ 17% 267M 1s 49152K ........ ........ ........ ........ ........ ........ 18% 268M 1s 52224K ........ ........ ........ ........ ........ ........ 19% 271M 1s 55296K ........ ........ ........ ........ ........ ........ 20% 276M 1s 58368K ........ ........ ........ ........ ........ ........ 21% 272M 1s 61440K ........ ........ ........ ........ ........ ........ 22% 279M 1s 64512K ........ ........ ........ ........ ........ ........ 23% 284M 1s 67584K ........ ........ ........ ........ ........ ........ 24% 268M 1s 70656K ........ ........ ........ ........ ........ ........ 25% 286M 1s 73728K ........ ........ ........ ........ ........ ........ 27% 281M 1s 76800K ........ ........ ........ ........ ........ ........ 28% 311M 1s 79872K ........ ........ ........ ........ ........ ........ 29% 312M 1s 82944K ........ ........ ........ ........ ........ ........ 30% 317M 1s 86016K ........ ........ ........ ........ ........ ........ 31% 304M 1s 89088K ........ ........ ........ ........ ........ ........ 32% 308M 1s 92160K ........ ........ ........ ........ ........ ........ 33% 314M 1s 95232K ........ ........ ........ ........ ........ ........ 34% 313M 1s 98304K ........ ........ ........ ........ ........ ........ 35% 292M 1s 101376K ........ ........ ........ ........ ........ ........ 36% 309M 1s 104448K ........ ........ ........ ........ ........ ........ 37% 166M 1s 107520K ........ ........ ........ ........ ........ ........ 38% 307M 1s 110592K ........ ........ ........ ........ ........ ........ 40% 396M 1s 113664K ........ ........ ........ ........ ........ ........ 41% 308M 1s 116736K ........ ........ ........ ........ ........ ........ 42% 221M 1s 119808K ........ ........ ........ ........ ........ ........ 43% 204M 1s 122880K ........ ........ ........ ........ ........ ........ 44% 166M 1s 125952K ........ ........ ........ ........ ........ ........ 45% 231M 1s 129024K ........ ........ ........ ........ ........ ........ 46% 266M 1s 132096K ........ ........ ........ ........ ........ ........ 47% 299M 1s 135168K ........ ........ ........ ........ ........ ........ 48% 100M 1s 138240K ........ ........ ........ ........ ........ ........ 49% 279M 1s 141312K ........ ........ ........ ........ ........ ........ 50% 389M 1s 144384K ........ ........ ........ ........ ........ ........ 51% 111M 1s 147456K ........ ........ ........ ........ ........ ........ 53% 295M 1s 150528K ........ ........ ........ ........ ........ ........ 54% 368M 1s 153600K ........ ........ ........ ........ ........ ........ 55% 297M 1s 156672K ........ ........ ........ ........ ........ ........ 56% 295M 0s 159744K ........ ........ ........ ........ ........ ........ 57% 305M 0s 162816K ........ ........ ........ ........ ........ ........ 58% 309M 0s 165888K ........ ........ ........ ........ ........ ........ 59% 308M 0s 168960K ........ ........ ........ ........ ........ ........ 60% 306M 0s 172032K ........ ........ ........ ........ ........ ........ 61% 309M 0s 175104K ........ ........ ........ ........ ........ ........ 62% 312M 0s 178176K ........ ........ ........ ........ ........ ........ 63% 298M 0s 181248K ........ ........ ........ ........ ........ ........ 64% 292M 0s 184320K ........ ........ ........ ........ ........ ........ 66% 301M 0s 187392K ........ ........ ........ ........ ........ ........ 67% 285M 0s 190464K ........ ........ ........ ........ ........ ........ 68% 304M 0s 193536K ........ ........ ........ ........ ........ ........ 69% 300M 0s 196608K ........ ........ ........ ........ ........ ........ 70% 300M 0s 199680K ........ ........ ........ ........ ........ ........ 71% 288M 0s 202752K ........ ........ ........ ........ ........ ........ 72% 282M 0s 205824K ........ ........ ........ ........ ........ ........ 73% 285M 0s 208896K ........ ........ ........ ........ ........ ........ 74% 285M 0s 211968K ........ ........ ........ ........ ........ ........ 75% 282M 0s 215040K ........ ........ ........ ........ ........ ........ 76% 86.9M 0s 218112K ........ ........ ........ ........ ........ ........ 77% 274M 0s 221184K ........ ........ ........ ........ ........ ........ 79% 379M 0s 224256K ........ ........ ........ ........ ........ ........ 80% 62.5M 0s 227328K ........ ........ ........ ........ ........ ........ 81% 237M 0s 230400K ........ ........ ........ ........ ........ ........ 82% 419M 0s 233472K ........ ........ ........ ........ ........ ........ 83% 305M 0s 236544K ........ ........ ........ ........ ........ ........ 84% 71.0M 0s 239616K ........ ........ ........ ........ ........ ........ 85% 80.0M 0s 242688K ........ ........ ........ ........ ........ ........ 86% 292M 0s 245760K ........ ........ ........ ........ ........ ........ 87% 309M 0s 248832K ........ ........ ........ ........ ........ ........ 88% 305M 0s 251904K ........ ........ ........ ........ ........ ........ 89% 296M 0s 254976K ........ ........ ........ ........ ........ ........ 90% 12.5M 0s 258048K ........ ........ ........ ........ ........ ........ 92% 261M 0s 261120K ........ ........ ........ ........ ........ ........ 93% 190M 0s 264192K ........ ........ ........ ........ ........ ........ 94% 356M 0s 267264K ........ ........ ........ ........ ........ ........ 95% 374M 0s 270336K ........ ........ ........ ........ ........ ........ 96% 388M 0s 273408K ........ ........ ........ ........ ........ ........ 97% 377M 0s 276480K ........ ........ ........ ........ ........ ........ 98% 385M 0s 279552K ........ ........ ........ ........ ........ ........ 99% 378M 0s 282624K ........ ........ . 100% 390M=1.4s 2024-04-28 06:08:01 (200 MB/s) - ‘karaf-0.21.0-20240428.030741-111.zip’ saved [290582777/290582777] Extracting the new controller... + echo 'Extracting the new controller...' + unzip -q karaf-0.21.0-20240428.030741-111.zip Adding external repositories... + echo 'Adding external repositories...' + sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg + cat /tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # If set to true, the following property will not allow any certificate to be used # when accessing Maven repositories through SSL # #org.ops4j.pax.url.mvn.certificateCheck= # # Path to the local Maven settings file. # The repositories defined in this file will be automatically added to the list # of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property # below is not set. # The following locations are checked for the existence of the settings.xml file # * 1. looks for the specified url # * 2. if not found looks for ${user.home}/.m2/settings.xml # * 3. if not found looks for ${maven.home}/conf/settings.xml # * 4. if not found looks for ${M2_HOME}/conf/settings.xml # #org.ops4j.pax.url.mvn.settings= # # Path to the local Maven repository which is used to avoid downloading # artifacts when they already exist locally. # The value of this property will be extracted from the settings.xml file # above, or defaulted to: # System.getProperty( "user.home" ) + "/.m2/repository" # org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository} # # Default this to false. It's just weird to use undocumented repos # org.ops4j.pax.url.mvn.useFallbackRepositories=false # # Uncomment if you don't wanna use the proxy settings # from the Maven conf/settings.xml file # # org.ops4j.pax.url.mvn.proxySupport=false # # Comma separated list of repositories scanned when resolving an artifact. # Those repositories will be checked before iterating through the # below list of repositories and even before the local repository # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snaphots # @noreleases : the repository does not contain any released artifacts # # The following property value will add the system folder as a repo. # org.ops4j.pax.url.mvn.defaultRepositories=\ file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\ file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\ file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots # Use the default local repo (e.g.~/.m2/repository) as a "remote" repo #org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false # # Comma separated list of repositories scanned when resolving an artifact. # The default list includes the following repositories: # http://repo1.maven.org/maven2@id=central # http://repository.springsource.com/maven/bundles/release@id=spring.ebr # http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external # http://zodiac.springsource.com/maven/bundles/release@id=gemini # http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases # https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases # https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases # To add repositories to the default ones, prepend '+' to the list of repositories # to add. # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snapshots # @noreleases : the repository does not contain any released artifacts # @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended # org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases ### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.+ [[ True == \T\r\u\e ]] + echo 'Configuring the startup features...' Configuring the startup features... + sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.21.0-SNAPSHOT/etc/org.apache.karaf.features.cfg + FEATURE_TEST_STRING=features-test + FEATURE_TEST_VERSION=0.21.0-SNAPSHOT + KARAF_VERSION=karaf4 + [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]] + sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.21.0-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.21.0-SNAPSHOT/etc/org.apache.karaf.features.cfg + [[ ! -z '' ]] + cat /tmp/karaf-0.21.0-SNAPSHOT/etc/org.apache.karaf.features.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # Comma separated list of features repositories to register by default # featuresRepositories = mvn:org.opendaylight.integration/features-test/0.21.0-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/a3113b32-3c7b-4877-8dee-44fd2349d37b.xml # # Comma separated list of features to install at startup # featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, f51e7fcb-6431-426d-8642-8007f1b6be68 # # Resource repositories (OBR) that the features resolver can use # to resolve requirements/capabilities # # The format of the resourceRepositories is # resourceRepositories=[xml:url|json:url],... # for Instance: # #resourceRepositories=xml:http://host/path/to/index.xml # or #resourceRepositories=json:http://host/path/to/index.json # # # Defines if the boot features are started in asynchronous mode (in a dedicated thread) # featuresBootAsynchronous=false # # Service requirements enforcement # # By default, the feature resolver checks the service requirements/capabilities of # bundles for new features (xml schema >= 1.3.0) in order to automatically installs # the required bundles. # The following flag can have those values: # - disable: service requirements are completely ignored # - default: service requirements are ignored for old features # - enforce: service requirements are always verified # #serviceRequirements=default # # Store cfg file for config element in feature # #configCfgStore=true # # Define if the feature service automatically refresh bundles # autoRefresh=true # # Configuration of features processing mechanism (overrides, blacklisting, modification of features) # XML file defines instructions related to features processing # versions.properties may declare properties to resolve placeholders in XML file # both files are relative to ${karaf.etc} # #featureProcessing=org.apache.karaf.features.xml #featureProcessingVersions=versions.properties + configure_karaf_log karaf4 '' + local -r karaf_version=karaf4 + local -r controllerdebugmap= + local logapi=log4j + grep log4j2 /tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n log4j2.rootLogger.level = INFO #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 64MB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE Configuring the karaf log... karaf_version: karaf4, logapi: log4j2 + logapi=log4j2 + echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2' + '[' log4j2 == log4j2 ']' + sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg + orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver + orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN' + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN' controllerdebugmap: + unset IFS + echo 'controllerdebugmap: ' cat /tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg + '[' -n '' ']' + echo 'cat /tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg' + cat /tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # Common pattern layout for appenders log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n # Root logger log4j2.rootLogger.level = INFO # uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} # Filters for logs marked by org.opendaylight.odlparent.Markers log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL # Loggers configuration # Spifly logger log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN # Security audit logger log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Appenders configuration # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} # Rolling file appender log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i # uncomment to not force a disk flush #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 1GB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 # Audit file appender log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 # OSGi appender log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * # help with identification of maven-related problems with pax-url-aether #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN + set_java_vars /usr/lib/jvm/java-17-openjdk 3072m /tmp/karaf-0.21.0-SNAPSHOT/bin/setenv + local -r java_home=/usr/lib/jvm/java-17-openjdk Configure java home: /usr/lib/jvm/java-17-openjdk + local -r controllermem=3072m + local -r memconf=/tmp/karaf-0.21.0-SNAPSHOT/bin/setenv + echo Configure + echo ' java home: /usr/lib/jvm/java-17-openjdk' max memory: 3072m memconf: /tmp/karaf-0.21.0-SNAPSHOT/bin/setenv + echo ' max memory: 3072m' + echo ' memconf: /tmp/karaf-0.21.0-SNAPSHOT/bin/setenv' + sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk}%g' /tmp/karaf-0.21.0-SNAPSHOT/bin/setenv + sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.21.0-SNAPSHOT/bin/setenv cat /tmp/karaf-0.21.0-SNAPSHOT/bin/setenv + echo 'cat /tmp/karaf-0.21.0-SNAPSHOT/bin/setenv' + cat /tmp/karaf-0.21.0-SNAPSHOT/bin/setenv #!/bin/sh # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # # # handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf # script: client, instance, shell, start, status, stop, karaf # # if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then # Actions go here... # fi # # general settings which should be applied for all scripts go here; please keep # in mind that it is possible that scripts might be executed more than once, e.g. # in example of the start script where the start script is executed first and the # karaf script afterwards. # # # The following section shows the possible configuration options for the default # karaf scripts # export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk} # Location of Java installation # export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration # export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options # export EXTRA_JAVA_OPTS # Additional JVM options # export KARAF_HOME # Karaf home folder # export KARAF_DATA # Karaf data folder # export KARAF_BASE # Karaf base folder # export KARAF_ETC # Karaf etc folder # export KARAF_LOG # Karaf log folder # export KARAF_SYSTEM_OPTS # First citizen Karaf options # export KARAF_OPTS # Additional available Karaf options # export KARAF_DEBUG # Enable debug mode # export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start # export KARAF_NOROOT # Prevent execution as root if set to true Set Java version + echo 'Set Java version' + sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-17-openjdk/bin/java 1 + sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-17-openjdk/bin/java JDK default version ... + echo 'JDK default version ...' + java -version openjdk version "17.0.6-ea" 2023-01-17 LTS OpenJDK Runtime Environment (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS) OpenJDK 64-Bit Server VM (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS, mixed mode, sharing) Set JAVA_HOME + echo 'Set JAVA_HOME' + export JAVA_HOME=/usr/lib/jvm/java-17-openjdk + JAVA_HOME=/usr/lib/jvm/java-17-openjdk ++ readlink -e /usr/lib/jvm/java-17-openjdk/bin/java Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java Listing all open ports on controller system... + JAVA_RESOLVED=/usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java + echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java' + echo 'Listing all open ports on controller system...' + netstat -pnatu Active Internet connections (servers and established) Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN - tcp 0 0 0.0.0.0:111 0.0.0.0:* LISTEN - tcp 0 0 10.30.171.170:45314 199.204.45.87:443 TIME_WAIT - tcp 0 0 10.30.171.170:22 10.30.170.112:53038 ESTABLISHED - tcp6 0 0 :::5555 :::* LISTEN - tcp6 0 0 :::22 :::* LISTEN - tcp6 0 0 :::111 :::* LISTEN - udp 0 0 10.30.171.170:68 10.30.170.4:67 ESTABLISHED - udp 0 0 0.0.0.0:111 0.0.0.0:* - udp 0 0 127.0.0.1:323 0.0.0.0:* - udp6 0 0 :::111 :::* - udp6 0 0 ::1:323 :::* - Custom shard config exists!!! (Not all processes could be identified, non-owned process info will not be shown, you would have to be root to see it all.) + '[' -f /tmp/custom_shard_config.txt ']' + echo 'Custom shard config exists!!!' Copying the shard config... + echo 'Copying the shard config...' + cp /tmp/custom_shard_config.txt /tmp/karaf-0.21.0-SNAPSHOT/bin/ Configuring cluster + echo 'Configuring cluster' + /tmp/karaf-0.21.0-SNAPSHOT/bin/configure_cluster.sh 3 10.30.171.127 10.30.170.58 10.30.171.170 ################################################ ## Configure Cluster ## ################################################ NOTE: Cluster configuration files not found. Copying from /tmp/karaf-0.21.0-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/9.0.2 Configuring unique name in akka.conf Configuring hostname in akka.conf Configuring data and rpc seed nodes in akka.conf modules = [ { name = "inventory" namespace = "urn:opendaylight:inventory" shard-strategy = "module" }, { name = "topology" namespace = "urn:TBD:params:xml:ns:yang:network-topology" shard-strategy = "module" }, { name = "toaster" namespace = "http://netconfcentral.org/ns/toaster" shard-strategy = "module" }, { name = "car" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" shard-strategy = "module" }, { name = "people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" shard-strategy = "module" }, { name = "car-people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" shard-strategy = "module" } ] Configuring replication type in module-shards.conf ################################################ ## NOTE: Manually restart controller to ## ## apply configuration. ## ################################################ Dump akka.conf + echo 'Dump akka.conf' + cat /tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/akka.conf odl-cluster-data { akka { remote { artery { enabled = on transport = tcp canonical.hostname = "10.30.171.170" canonical.port = 2550 } } cluster { # Using artery. seed-nodes = ["akka://opendaylight-cluster-data@10.30.171.127:2550", "akka://opendaylight-cluster-data@10.30.170.58:2550", "akka://opendaylight-cluster-data@10.30.171.170:2550"] roles = ["member-3"] # when under load we might trip a false positive on the failure detector # failure-detector { # heartbeat-interval = 4 s # acceptable-heartbeat-pause = 16s # } } persistence { # By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by # modifying the following two properties. The directory location specified may be a relative or absolute path. # The relative path is always relative to KARAF_HOME. # snapshot-store.local.dir = "target/snapshots" # Use lz4 compression for LocalSnapshotStore snapshots snapshot-store.local.use-lz4-compression = false # Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB snapshot-store.local.lz4-blocksize = 256KB } disable-default-actor-system-quarantined-event-handling = "false" } } Dump modules.conf + echo 'Dump modules.conf' + cat /tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/modules.conf modules = [ { name = "inventory" namespace = "urn:opendaylight:inventory" shard-strategy = "module" }, { name = "topology" namespace = "urn:TBD:params:xml:ns:yang:network-topology" shard-strategy = "module" }, { name = "toaster" namespace = "http://netconfcentral.org/ns/toaster" shard-strategy = "module" }, { name = "car" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" shard-strategy = "module" }, { name = "people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" shard-strategy = "module" }, { name = "car-people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" shard-strategy = "module" } ] Dump module-shards.conf + echo 'Dump module-shards.conf' + cat /tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/module-shards.conf module-shards = [ { name = "default" shards = [ { name = "default" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "inventory" shards = [ { name="inventory" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "topology" shards = [ { name="topology" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "toaster" shards = [ { name="toaster" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "car" shards = [ { name="car" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "people" shards = [ { name="people" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "car-people" shards = [ { name="car-people" replicas = ["member-1", "member-2", "member-3"] } ] } ] Locating config plan to use... Finished running config plans Starting member-1 with IP address 10.30.171.127 Warning: Permanently added '10.30.171.127' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.171.127' (ECDSA) to the list of known hosts. Redirecting karaf console output to karaf_console.log Starting controller... start: Redirecting Karaf output to /tmp/karaf-0.21.0-SNAPSHOT/data/log/karaf_console.log Starting member-2 with IP address 10.30.170.58 Warning: Permanently added '10.30.170.58' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.170.58' (ECDSA) to the list of known hosts. Redirecting karaf console output to karaf_console.log Starting controller... start: Redirecting Karaf output to /tmp/karaf-0.21.0-SNAPSHOT/data/log/karaf_console.log Starting member-3 with IP address 10.30.171.170 Warning: Permanently added '10.30.171.170' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.171.170' (ECDSA) to the list of known hosts. Redirecting karaf console output to karaf_console.log Starting controller... start: Redirecting Karaf output to /tmp/karaf-0.21.0-SNAPSHOT/data/log/karaf_console.log [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins12384471927523412849.sh common-functions.sh is being sourced common-functions environment: MAVENCONF: /tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ACTUALFEATURES: FEATURESCONF: /tmp/karaf-0.21.0-SNAPSHOT/etc/org.apache.karaf.features.cfg CUSTOMPROP: /tmp/karaf-0.21.0-SNAPSHOT/etc/custom.properties LOGCONF: /tmp/karaf-0.21.0-SNAPSHOT/etc/org.ops4j.pax.logging.cfg MEMCONF: /tmp/karaf-0.21.0-SNAPSHOT/bin/setenv CONTROLLERMEM: 2048m AKKACONF: /tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/akka.conf MODULESCONF: /tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/modules.conf MODULESHARDSCONF: /tmp/karaf-0.21.0-SNAPSHOT/configuration/initial/module-shards.conf SUITES: + echo '#################################################' ################################################# + echo '## Verify Cluster is UP ##' ## Verify Cluster is UP ## + echo '#################################################' ################################################# + create_post_startup_script + cat + copy_and_run_post_startup_script + seed_index=1 ++ seq 1 3 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_1_IP + echo 'Execute the post startup script on controller 10.30.171.127' Execute the post startup script on controller 10.30.171.127 + scp /w/workspace/controller-csit-3node-clustering-tell-all-scandium/post-startup-script.sh 10.30.171.127:/tmp/ Warning: Permanently added '10.30.171.127' (ECDSA) to the list of known hosts. + ssh 10.30.171.127 'bash /tmp/post-startup-script.sh 1' Warning: Permanently added '10.30.171.127' (ECDSA) to the list of known hosts. tcp6 0 0 :::8101 :::* LISTEN Waiting up to 3 minutes for controller to come up, checking every 5 seconds... 2024-04-28T06:09:03,088 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 300 - org.opendaylight.infrautils.ready-api - 6.0.6 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Controller is UP 2024-04-28T06:09:03,088 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 300 - org.opendaylight.infrautils.ready-api - 6.0.6 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Listing all open ports on controller system... (Not all processes could be identified, non-owned process info will not be shown, you would have to be root to see it all.) Active Internet connections (servers and established) Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN - tcp 0 0 0.0.0.0:111 0.0.0.0:* LISTEN - tcp 0 164 10.30.171.127:22 10.30.170.112:58358 ESTABLISHED - tcp6 0 0 127.0.0.1:42931 :::* LISTEN 5745/java tcp6 0 0 :::5555 :::* LISTEN - tcp6 0 0 :::8181 :::* LISTEN 5745/java tcp6 0 0 10.30.171.127:2550 :::* LISTEN 5745/java tcp6 0 0 :::22 :::* LISTEN - tcp6 0 0 127.0.0.1:44444 :::* LISTEN 5745/java tcp6 0 0 :::6653 :::* LISTEN 5745/java tcp6 0 0 :::1790 :::* LISTEN 5745/java tcp6 0 0 :::8101 :::* LISTEN 5745/java tcp6 0 0 :::6633 :::* LISTEN 5745/java tcp6 0 0 127.0.0.1:1099 :::* LISTEN 5745/java tcp6 0 0 :::111 :::* LISTEN - tcp6 0 0 :::6640 :::* LISTEN 5745/java tcp6 0 0 10.30.171.127:2550 10.30.171.170:52722 ESTABLISHED 5745/java tcp6 0 0 127.0.0.1:47362 127.0.0.1:44444 TIME_WAIT - tcp6 0 0 10.30.171.127:43198 10.30.170.58:2550 ESTABLISHED 5745/java tcp6 0 0 10.30.171.127:40104 10.30.171.170:2550 ESTABLISHED 5745/java tcp6 0 0 10.30.171.127:2550 10.30.170.58:47620 ESTABLISHED 5745/java tcp6 0 0 10.30.171.127:40120 10.30.171.170:2550 ESTABLISHED 5745/java tcp6 0 0 127.0.0.1:56808 127.0.0.1:1099 TIME_WAIT - tcp6 0 0 10.30.171.127:2550 10.30.171.170:52738 ESTABLISHED 5745/java tcp6 0 0 10.30.171.127:43214 10.30.170.58:2550 ESTABLISHED 5745/java tcp6 0 0 10.30.171.127:2550 10.30.170.58:47606 ESTABLISHED 5745/java tcp6 0 0 127.0.0.1:47350 127.0.0.1:44444 TIME_WAIT - tcp6 32 0 10.30.171.127:34904 199.204.45.87:443 CLOSE_WAIT 5745/java udp 0 0 10.30.171.127:68 10.30.170.2:67 ESTABLISHED - udp 0 0 0.0.0.0:111 0.0.0.0:* - udp 0 0 127.0.0.1:323 0.0.0.0:* - udp6 0 0 :::111 :::* - udp6 0 0 ::1:323 :::* - udp6 0 0 :::4342 :::* 5745/java looking for "BindException: Address already in use" in log file looking for "server is unhealthy" in log file + '[' 1 == 0 ']' + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_2_IP + echo 'Execute the post startup script on controller 10.30.170.58' Execute the post startup script on controller 10.30.170.58 + scp /w/workspace/controller-csit-3node-clustering-tell-all-scandium/post-startup-script.sh 10.30.170.58:/tmp/ Warning: Permanently added '10.30.170.58' (ECDSA) to the list of known hosts. + ssh 10.30.170.58 'bash /tmp/post-startup-script.sh 2' Warning: Permanently added '10.30.170.58' (ECDSA) to the list of known hosts. tcp6 0 0 :::8101 :::* LISTEN Waiting up to 3 minutes for controller to come up, checking every 5 seconds... 2024-04-28T06:09:02,261 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 300 - org.opendaylight.infrautils.ready-api - 6.0.6 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Controller is UP 2024-04-28T06:09:02,261 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 300 - org.opendaylight.infrautils.ready-api - 6.0.6 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Listing all open ports on controller system... (Not all processes could be identified, non-owned process info will not be shown, you would have to be root to see it all.) Active Internet connections (servers and established) Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name tcp 0 0 0.0.0.0:111 0.0.0.0:* LISTEN - tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN - tcp 0 164 10.30.170.58:22 10.30.170.112:56504 ESTABLISHED - tcp6 0 0 :::6633 :::* LISTEN 5763/java tcp6 0 0 127.0.0.1:1099 :::* LISTEN 5763/java tcp6 0 0 :::111 :::* LISTEN - tcp6 0 0 :::6640 :::* LISTEN 5763/java tcp6 0 0 :::5555 :::* LISTEN - tcp6 0 0 :::8181 :::* LISTEN 5763/java tcp6 0 0 10.30.170.58:2550 :::* LISTEN 5763/java tcp6 0 0 :::22 :::* LISTEN - tcp6 0 0 :::12345 :::* LISTEN 5763/java tcp6 0 0 127.0.0.1:44444 :::* LISTEN 5763/java tcp6 0 0 :::6653 :::* LISTEN 5763/java tcp6 0 0 :::4189 :::* LISTEN 5763/java tcp6 0 0 :::1790 :::* LISTEN 5763/java tcp6 0 0 127.0.0.1:39039 :::* LISTEN 5763/java tcp6 0 0 :::8101 :::* LISTEN 5763/java tcp6 0 0 127.0.0.1:54224 127.0.0.1:1099 TIME_WAIT - tcp6 0 0 127.0.0.1:54236 127.0.0.1:1099 TIME_WAIT - tcp6 0 0 127.0.0.1:45396 127.0.0.1:44444 TIME_WAIT - tcp6 0 0 10.30.170.58:39346 10.30.171.170:2550 ESTABLISHED 5763/java tcp6 0 0 10.30.170.58:47620 10.30.171.127:2550 ESTABLISHED 5763/java tcp6 0 0 10.30.170.58:2550 10.30.171.127:43198 ESTABLISHED 5763/java tcp6 0 0 10.30.170.58:2550 10.30.171.170:46936 ESTABLISHED 5763/java tcp6 0 0 127.0.0.1:45404 127.0.0.1:44444 TIME_WAIT - tcp6 0 0 10.30.170.58:47606 10.30.171.127:2550 ESTABLISHED 5763/java tcp6 32 0 10.30.170.58:56254 199.204.45.87:443 CLOSE_WAIT 5763/java tcp6 0 0 10.30.170.58:2550 10.30.171.127:43214 ESTABLISHED 5763/java tcp6 0 0 10.30.170.58:2550 10.30.171.170:46920 ESTABLISHED 5763/java tcp6 0 0 10.30.170.58:39332 10.30.171.170:2550 ESTABLISHED 5763/java udp 0 0 10.30.170.58:68 10.30.170.4:67 ESTABLISHED - udp 0 0 0.0.0.0:111 0.0.0.0:* - udp 0 0 127.0.0.1:323 0.0.0.0:* - udp6 0 0 :::4342 :::* 5763/java udp6 0 0 :::111 :::* - udp6 0 0 ::1:323 :::* - looking for "BindException: Address already in use" in log file looking for "server is unhealthy" in log file + '[' 2 == 0 ']' + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_3_IP + echo 'Execute the post startup script on controller 10.30.171.170' Execute the post startup script on controller 10.30.171.170 + scp /w/workspace/controller-csit-3node-clustering-tell-all-scandium/post-startup-script.sh 10.30.171.170:/tmp/ Warning: Permanently added '10.30.171.170' (ECDSA) to the list of known hosts. + ssh 10.30.171.170 'bash /tmp/post-startup-script.sh 3' Warning: Permanently added '10.30.171.170' (ECDSA) to the list of known hosts. tcp6 0 0 :::8101 :::* LISTEN Waiting up to 3 minutes for controller to come up, checking every 5 seconds... 2024-04-28T06:09:02,857 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 300 - org.opendaylight.infrautils.ready-api - 6.0.6 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Controller is UP 2024-04-28T06:09:02,857 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 300 - org.opendaylight.infrautils.ready-api - 6.0.6 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Listing all open ports on controller system... (Not all processes could be identified, non-owned process info will not be shown, you would have to be root to see it all.) Active Internet connections (servers and established) Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN - tcp 0 0 0.0.0.0:111 0.0.0.0:* LISTEN - tcp 0 0 10.30.171.170:22 10.30.170.112:57230 ESTABLISHED - tcp6 0 0 :::6640 :::* LISTEN 5730/java tcp6 0 0 :::5555 :::* LISTEN - tcp6 0 0 :::8181 :::* LISTEN 5730/java tcp6 0 0 10.30.171.170:2550 :::* LISTEN 5730/java tcp6 0 0 :::22 :::* LISTEN - tcp6 0 0 127.0.0.1:44444 :::* LISTEN 5730/java tcp6 0 0 :::6653 :::* LISTEN 5730/java tcp6 0 0 :::1790 :::* LISTEN 5730/java tcp6 0 0 127.0.0.1:41251 :::* LISTEN 5730/java tcp6 0 0 :::8101 :::* LISTEN 5730/java tcp6 0 0 :::6633 :::* LISTEN 5730/java tcp6 0 0 127.0.0.1:1099 :::* LISTEN 5730/java tcp6 0 0 :::111 :::* LISTEN - tcp6 0 0 127.0.0.1:35476 127.0.0.1:44444 TIME_WAIT - tcp6 0 0 127.0.0.1:35490 127.0.0.1:44444 TIME_WAIT - tcp6 0 0 10.30.171.170:46920 10.30.170.58:2550 ESTABLISHED 5730/java tcp6 0 0 10.30.171.170:2550 10.30.170.58:39346 ESTABLISHED 5730/java tcp6 0 0 10.30.171.170:2550 10.30.170.58:39332 ESTABLISHED 5730/java tcp6 0 0 10.30.171.170:52738 10.30.171.127:2550 ESTABLISHED 5730/java tcp6 0 0 10.30.171.170:2550 10.30.171.127:40120 ESTABLISHED 5730/java tcp6 0 0 10.30.171.170:46936 10.30.170.58:2550 ESTABLISHED 5730/java tcp6 0 0 127.0.0.1:49020 127.0.0.1:1099 TIME_WAIT - tcp6 0 0 10.30.171.170:52722 10.30.171.127:2550 ESTABLISHED 5730/java tcp6 32 0 10.30.171.170:49176 199.204.45.87:443 CLOSE_WAIT 5730/java tcp6 0 0 10.30.171.170:2550 10.30.171.127:40104 ESTABLISHED 5730/java udp 0 0 10.30.171.170:68 10.30.170.4:67 ESTABLISHED - udp 0 0 0.0.0.0:111 0.0.0.0:* - udp 0 0 127.0.0.1:323 0.0.0.0:* - udp6 0 0 :::4342 :::* 5730/java udp6 0 0 :::111 :::* - udp6 0 0 ::1:323 :::* - looking for "BindException: Address already in use" in log file looking for "server is unhealthy" in log file + '[' 0 == 0 ']' + seed_index=1 + dump_controller_threads ++ seq 1 3 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_1_IP + echo 'Let'\''s take the karaf thread dump' Let's take the karaf thread dump + ssh 10.30.171.127 'sudo ps aux' Warning: Permanently added '10.30.171.127' (ECDSA) to the list of known hosts. ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-scandium/ps_before.log ++ grep -v grep ++ cut -f2 '-d ' ++ tr -s ' ' + pid=5745 + echo 'karaf main: org.apache.karaf.main.Main, pid:5745' karaf main: org.apache.karaf.main.Main, pid:5745 + ssh 10.30.171.127 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 5745' Warning: Permanently added '10.30.171.127' (ECDSA) to the list of known hosts. + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_2_IP + echo 'Let'\''s take the karaf thread dump' Let's take the karaf thread dump + ssh 10.30.170.58 'sudo ps aux' Warning: Permanently added '10.30.170.58' (ECDSA) to the list of known hosts. ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-scandium/ps_before.log ++ grep -v grep ++ tr -s ' ' ++ cut -f2 '-d ' + pid=5763 + echo 'karaf main: org.apache.karaf.main.Main, pid:5763' karaf main: org.apache.karaf.main.Main, pid:5763 + ssh 10.30.170.58 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 5763' Warning: Permanently added '10.30.170.58' (ECDSA) to the list of known hosts. + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_3_IP + echo 'Let'\''s take the karaf thread dump' Let's take the karaf thread dump + ssh 10.30.171.170 'sudo ps aux' Warning: Permanently added '10.30.171.170' (ECDSA) to the list of known hosts. ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-scandium/ps_before.log ++ grep -v grep ++ cut -f2 '-d ' ++ tr -s ' ' + pid=5730 + echo 'karaf main: org.apache.karaf.main.Main, pid:5730' karaf main: org.apache.karaf.main.Main, pid:5730 + ssh 10.30.171.170 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 5730' Warning: Permanently added '10.30.171.170' (ECDSA) to the list of known hosts. + '[' 0 -gt 0 ']' + echo 'Generating controller variables...' Generating controller variables... ++ seq 1 3 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_1_IP + odl_variables=' -v ODL_SYSTEM_1_IP:10.30.171.127' + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_2_IP + odl_variables=' -v ODL_SYSTEM_1_IP:10.30.171.127 -v ODL_SYSTEM_2_IP:10.30.170.58' + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_3_IP + odl_variables=' -v ODL_SYSTEM_1_IP:10.30.171.127 -v ODL_SYSTEM_2_IP:10.30.170.58 -v ODL_SYSTEM_3_IP:10.30.171.170' + echo 'Generating mininet variables...' Generating mininet variables... ++ seq 1 0 + get_test_suites SUITES + local __suite_list=SUITES + echo 'Locating test plan to use...' Locating test plan to use... + testplan_filepath=/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/testplans/controller-clustering-tell-scandium.txt + '[' '!' -f /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/testplans/controller-clustering-tell-scandium.txt ']' + testplan_filepath=/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/testplans/controller-clustering-tell.txt + '[' disabled '!=' disabled ']' + echo 'Changing the testplan path...' Changing the testplan path... + sed s:integration:/w/workspace/controller-csit-3node-clustering-tell-all-scandium: /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/testplans/controller-clustering-tell.txt + cat testplan.txt # Place the suites in run order: # disabling all "prefix based" suites. This functionality was newly # introduced with these tests in 2017. The assumption is that # development stopped in that area, but may continue at a later # time. Still, the tests are failing and no resources to solve the # failures at this time. If/When this changes, we can uncomment # those suites. Note that every suite is commented out with it's # accompanying "restart_with_tell_based_true" setup suite. # /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot # /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/ddb-sanity-prefix-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot # /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot # /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown_prefbasedshard.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot # /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot # /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement_prefbasedshard.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot # /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot # /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/leader_isolation_prefbasedshard.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/client_isolation.robot # /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot # /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/client_isolation_prefbasedshard.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/listener_stability.robot # /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot # /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/listener_stability_prefbasedshard.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot + '[' -z '' ']' ++ grep -E -v '(^[[:space:]]*#|^[[:space:]]*$)' testplan.txt ++ tr '\012' ' ' + suite_list='/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot ' + eval 'SUITES='\''/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot '\''' ++ SUITES='/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot ' + echo 'Starting Robot test suites /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot ...' Starting Robot test suites /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot ... + robot -N controller-clustering-tell.txt --removekeywords wuks -e exclude -e skip_if_scandium -v BUNDLEFOLDER:karaf-0.21.0-SNAPSHOT -v BUNDLE_URL:https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.0-SNAPSHOT/karaf-0.21.0-20240428.030741-111.zip -v CONTROLLER:10.30.171.127 -v CONTROLLER1:10.30.170.58 -v CONTROLLER2:10.30.171.170 -v CONTROLLER_USER:jenkins -v JAVA_HOME:/usr/lib/jvm/java-17-openjdk -v JDKVERSION:openjdk17 -v JENKINS_WORKSPACE:/w/workspace/controller-csit-3node-clustering-tell-all-scandium -v MININET: -v MININET1: -v MININET2: -v MININET_USER:jenkins -v NEXUSURL_PREFIX:https://nexus.opendaylight.org -v NUM_ODL_SYSTEM:3 -v NUM_TOOLS_SYSTEM:0 -v ODL_STREAM:scandium -v ODL_SYSTEM_IP:10.30.171.127 -v ODL_SYSTEM_1_IP:10.30.171.127 -v ODL_SYSTEM_2_IP:10.30.170.58 -v ODL_SYSTEM_3_IP:10.30.171.170 -v ODL_SYSTEM_USER:jenkins -v TOOLS_SYSTEM_IP: -v TOOLS_SYSTEM_USER:jenkins -v USER_HOME:/home/jenkins -v IS_KARAF_APPL:True -v WORKSPACE:/tmp /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot ============================================================================== controller-clustering-tell.txt ============================================================================== controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... ============================================================================== Stop_All_Members :: Stop every odl node. | PASS | ------------------------------------------------------------------------------ Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 5 minutes. The last error was: Dictionary '${Stream_dict}' has no key 'scandium'. ------------------------------------------------------------------------------ controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL | 3 tests, 2 passed, 1 failed ============================================================================== controller-clustering-tell.txt.Ddb-Sanity-Module-Based :: DOMDataBroker tes... ============================================================================== Get_Shard_Role :: Get shard role. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_ddb_sanity_module_based_get_shard_role" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_get_shard_role&order=bug_status" HTTPError: 404 Client Error: Not Found for url: http://10.30.171.127:8181/restconf/operations/cluster-admin:get-shard-role ------------------------------------------------------------------------------ Subscribe_Listener_To_Leader :: Subscribe listener to leader. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_ddb_sanity_module_based_subscribe_listener_to_leader" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_subscribe_listener_to_leader&order=bug_status" HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.127:8181/rests/operations/odl-mdsal-lowlevel-control:unsubscribe-dtcl ------------------------------------------------------------------------------ Subscribe_Listener_To_Follower :: Subscribe listener to follower. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_ddb_sanity_module_based_subscribe_listener_to_follower" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_subscribe_listener_to_follower&order=bug_status" HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.58:8181/rests/operations/odl-mdsal-lowlevel-control:unsubscribe-dtcl ------------------------------------------------------------------------------ Make_Leader_Local :: Make the loeader local and verify. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_ddb_sanity_module_based_make_leader_local" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_make_leader_local&order=bug_status" HTTPError: 404 Client Error: Not Found for url: http://10.30.170.58:8181/restconf/operations/cluster-admin:make-leader-local ------------------------------------------------------------------------------ Remove_Leader_Shard_Replica_And_Add_It_Back :: Remove and add shar... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_ddb_sanity_module_based_remove_leader_shard_replica_and_add_it_back" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_remove_leader_shard_replica_and_add_it_back&order=bug_status" HTTPError: 404 Client Error: Not Found for url: http://10.30.171.127:8181/restconf/operations/cluster-admin:remove-shard-replica ------------------------------------------------------------------------------ Remove_Follower_Shard_Replica_And_Add_It_Back :: Remove and add sh... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_ddb_sanity_module_based_remove_follower_shard_replica_and_add_it_back" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_remove_follower_shard_replica_and_add_it_back&order=bug_status" HTTPError: 404 Client Error: Not Found for url: http://10.30.170.58:8181/restconf/operations/cluster-admin:remove-shard-replica ------------------------------------------------------------------------------ Write_Transactions_One_Node_Leader :: Write transactions. | PASS | ------------------------------------------------------------------------------ Write_Transactions_One_Node_Follower :: Write transactions. | PASS | ------------------------------------------------------------------------------ Write_Transactions_All_Nodes :: Write transactions. | PASS | ------------------------------------------------------------------------------ controller-clustering-tell.txt.Ddb-Sanity-Module-Based :: DOMDataB... | FAIL | 9 tests, 3 passed, 6 failed ============================================================================== controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ConnectionError: HTTPConnectionPool(host='10.30.170.58', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-tell.txt.Clean Leader Shutdown :: DOMDataBroker testi... ============================================================================== Local_Leader_Shutdown :: Shutdown the leader on the same node as t... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_clean_leader_shutdown_local_leader_shutdown" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_clean_leader_shutdown_local_leader_shutdown&order=bug_status" ConnectionError: HTTPConnectionPool(host='10.30.170.58', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-2-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) ------------------------------------------------------------------------------ Restart :: Restart odl | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_clean_leader_shutdown_restart" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_clean_leader_shutdown_restart&order=bug_status" Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Remote_Leader_Shutdown :: Shutdown the leader on different node as... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_clean_leader_shutdown_remote_leader_shutdown" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_clean_leader_shutdown_remote_leader_shutdown&order=bug_status" HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore ------------------------------------------------------------------------------ controller-clustering-tell.txt.Clean Leader Shutdown :: DOMDataBro... | FAIL | 3 tests, 0 passed, 3 failed ============================================================================== controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore ------------------------------------------------------------------------------ controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-tell.txt.Explicit Leader Movement :: DOMDataBroker te... ============================================================================== Local_To_Remote_Movement :: Leader moves from local to remote node... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_explicit_leader_movement_local_to_remote_movement" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_local_to_remote_movement&order=bug_status" HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore ------------------------------------------------------------------------------ Restart1 :: Restart odl | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_explicit_leader_movement_restart1" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_restart1&order=bug_status" Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Remote_To_Remote_Movement :: Leader moves from one remote to other... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_explicit_leader_movement_remote_to_remote_movement" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_remote_to_remote_movement&order=bug_status" HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore ------------------------------------------------------------------------------ Restart2 :: Restart odl | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_explicit_leader_movement_restart2" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_restart2&order=bug_status" Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Remote_To_Local_Movement :: Leader moves from remote to local node... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_explicit_leader_movement_remote_to_local_movement" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_remote_to_local_movement&order=bug_status" HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore ------------------------------------------------------------------------------ controller-clustering-tell.txt.Explicit Leader Movement :: DOMData... | FAIL | 5 tests, 0 passed, 5 failed ============================================================================== controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore ------------------------------------------------------------------------------ controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-tell.txt.Leader Isolation :: DOMDataBroker testing: L... ============================================================================== Healing_Within_Request_Timeout :: The isolated node (leader) is re... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_leader_isolation_healing_within_request_timeout" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_leader_isolation_healing_within_request_timeout&order=bug_status" HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore ------------------------------------------------------------------------------ Restart :: Restart odl | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_leader_isolation_restart" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_leader_isolation_restart&order=bug_status" Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Healing_After_Request_Timeout :: The isolated node (leader) is rej... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_leader_isolation_healing_after_request_timeout" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_leader_isolation_healing_after_request_timeout&order=bug_status" HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore ------------------------------------------------------------------------------ controller-clustering-tell.txt.Leader Isolation :: DOMDataBroker t... | FAIL | 3 tests, 0 passed, 3 failed ============================================================================== controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore ------------------------------------------------------------------------------ controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-tell.txt.Client Isolation :: DOMDataBroker testing: C... ============================================================================== Producer_On_Shard_Leader_Node_ChainedTx :: Client isolation with p... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_client_isolation_producer_on_shard_leader_node_chainedtx" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_producer_on_shard_leader_node_chainedtx&order=bug_status" HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore Also keyword teardown failed: Several failures occurred: 1) Variable '${client_node_dst}' not found. 2) Variable '${client_node_dst}' not found. 3) Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 1 minute 10 seconds. The last error was: Several failures occurred: 1) Dictionary '${Stream_dict}' has no key 'scandium'. 2) HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore [ Message content over the limit has been removed. ] 145) Resolving variable '${response.text}' failed: AttributeError: 'NoneType' object has no attribute 'text' 146) Evaluating expression "json.loads('''None''')" failed: JSONDecodeError: Expecting value: line 1 column 1 (char 0) 147) TypeError: Expected argument 1 to be a dictionary, got None instead. 148) TypeError: Expected argument 1 to be a dictionary, got None instead. 149) Unrecognized Raft state: None 150) No leader found. 151) Too many Leaders. 152) IndexError: Given index 0 is out of the range 0--1. 4) KeyError: 'threads' ------------------------------------------------------------------------------ Restart1 :: Restart odl | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_client_isolation_restart1" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_restart1&order=bug_status" Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Producer_On_Shard_Leader_Node_SimpleTx :: Client isolation with pr... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_client_isolation_producer_on_shard_leader_node_simpletx" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_producer_on_shard_leader_node_simpletx&order=bug_status" HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore Also keyword teardown failed: Several failures occurred: 1) Variable '${client_node_dst}' not found. 2) Variable '${client_node_dst}' not found. 3) Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 1 minute 10 seconds. The last error was: Several failures occurred: 1) Dictionary '${Stream_dict}' has no key 'scandium'. 2) HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore [ Message content over the limit has been removed. ] 204) Resolving variable '${response.text}' failed: AttributeError: 'NoneType' object has no attribute 'text' 205) Evaluating expression "json.loads('''None''')" failed: JSONDecodeError: Expecting value: line 1 column 1 (char 0) 206) TypeError: Expected argument 1 to be a dictionary, got None instead. 207) TypeError: Expected argument 1 to be a dictionary, got None instead. 208) Unrecognized Raft state: None 209) No leader found. 210) Too many Leaders. 211) IndexError: Given index 0 is out of the range 0--1. 4) KeyError: 'threads' ------------------------------------------------------------------------------ Restart2 :: Restart odl | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_client_isolation_restart2" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_restart2&order=bug_status" Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Producer_On_Shard_Non_Leader_Node_ChainedTx :: Client isolation wi... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_client_isolation_producer_on_shard_non_leader_node_chainedtx" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_producer_on_shard_non_leader_node_chainedtx&order=bug_status" HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore Also keyword teardown failed: Several failures occurred: 1) Variable '${client_node_dst}' not found. 2) Variable '${client_node_dst}' not found. 3) Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 1 minute 10 seconds. The last error was: Several failures occurred: 1) Dictionary '${Stream_dict}' has no key 'scandium'. 2) HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore [ Message content over the limit has been removed. ] 204) Resolving variable '${response.text}' failed: AttributeError: 'NoneType' object has no attribute 'text' 205) Evaluating expression "json.loads('''None''')" failed: JSONDecodeError: Expecting value: line 1 column 1 (char 0) 206) TypeError: Expected argument 1 to be a dictionary, got None instead. 207) TypeError: Expected argument 1 to be a dictionary, got None instead. 208) Unrecognized Raft state: None 209) No leader found. 210) Too many Leaders. 211) IndexError: Given index 0 is out of the range 0--1. 4) KeyError: 'threads' ------------------------------------------------------------------------------ Restart3 :: Restart odl | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_client_isolation_restart3" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_restart3&order=bug_status" Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Producer_On_Shard_Non_Leader_Node_SimpleTx :: Client isolation wit... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_client_isolation_producer_on_shard_non_leader_node_simpletx" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_producer_on_shard_non_leader_node_simpletx&order=bug_status" HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore Also keyword teardown failed: Several failures occurred: 1) Variable '${client_node_dst}' not found. 2) Variable '${client_node_dst}' not found. 3) Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 1 minute 10 seconds. The last error was: Several failures occurred: 1) Dictionary '${Stream_dict}' has no key 'scandium'. 2) HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore [ Message content over the limit has been removed. ] 204) Resolving variable '${response.text}' failed: AttributeError: 'NoneType' object has no attribute 'text' 205) Evaluating expression "json.loads('''None''')" failed: JSONDecodeError: Expecting value: line 1 column 1 (char 0) 206) TypeError: Expected argument 1 to be a dictionary, got None instead. 207) TypeError: Expected argument 1 to be a dictionary, got None instead. 208) Unrecognized Raft state: None 209) No leader found. 210) Too many Leaders. 211) IndexError: Given index 0 is out of the range 0--1. 4) KeyError: 'threads' ------------------------------------------------------------------------------ controller-clustering-tell.txt.Client Isolation :: DOMDataBroker t... | FAIL | 7 tests, 0 passed, 7 failed ============================================================================== controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore ------------------------------------------------------------------------------ controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-tell.txt.Listener Stability :: DOMDataBroker testing:... ============================================================================== Move_Leader_From_Listener_Local_To_Remote :: Listener runs on lead... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_listener_stability_move_leader_from_listener_local_to_remote" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_listener_stability_move_leader_from_listener_local_to_remote&order=bug_status" HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore ------------------------------------------------------------------------------ Restart_1 :: Restart odl. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_listener_stability_restart_1" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_listener_stability_restart_1&order=bug_status" Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Move_Leader_From_Listener_Remote_To_Other_Remote :: Listener runs ... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_listener_stability_move_leader_from_listener_remote_to_other_remote" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_listener_stability_move_leader_from_listener_remote_to_other_remote&order=bug_status" HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore ------------------------------------------------------------------------------ Restart_2 :: Restart odl. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_listener_stability_restart_2" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_listener_stability_restart_2&order=bug_status" Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Move_Leader_From_Listener_Remote_To_Local :: Listener runs on foll... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_listener_stability_move_leader_from_listener_remote_to_local" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_listener_stability_move_leader_from_listener_remote_to_local&order=bug_status" HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore ------------------------------------------------------------------------------ controller-clustering-tell.txt.Listener Stability :: DOMDataBroker... | FAIL | 5 tests, 0 passed, 5 failed ============================================================================== controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore ------------------------------------------------------------------------------ controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-tell.txt.Master Stability :: Cluster Singleton testin... ============================================================================== Register_Singleton_Constant_On_Each_Node_And_Verify :: Register a ... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_master_stability_register_singleton_constant_on_each_node_and_verify" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_register_singleton_constant_on_each_node_and_verify&order=bug_status" HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/operations/odl-mdsal-lowlevel-control:register-singleton-constant ------------------------------------------------------------------------------ Unregister_Singleton_Constant_On_Non_Master_Node :: Unregister the... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_master_stability_unregister_singleton_constant_on_non_master_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_unregister_singleton_constant_on_non_master_node&order=bug_status" Variable '@{cs_candidates}' not found. Did you mean: @{cs_exp_candidates} ------------------------------------------------------------------------------ Monitor_Stability_While_Unregistered :: Verify that the owner rema... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_master_stability_monitor_stability_while_unregistered" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_monitor_stability_while_unregistered&order=bug_status" Variable '${cs_owner}' not found. ------------------------------------------------------------------------------ Reregister_Singleton_Constant :: Re-register the unregistered cand... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_master_stability_reregister_singleton_constant" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_reregister_singleton_constant&order=bug_status" Variable '${unregistered_node}' not found. ------------------------------------------------------------------------------ Verify_Stability_After_Reregistration :: Verify that the owner rem... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_master_stability_verify_stability_after_reregistration" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_verify_stability_after_reregistration&order=bug_status" Variable '${cs_owner}' not found. ------------------------------------------------------------------------------ Unregister_Singleton_Constant_On_Each_Node :: Unregister the appli... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_master_stability_unregister_singleton_constant_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_unregister_singleton_constant_on_each_node&order=bug_status" HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/operations/odl-mdsal-lowlevel-control:unregister-singleton-constant ------------------------------------------------------------------------------ controller-clustering-tell.txt.Master Stability :: Cluster Singlet... | FAIL | 6 tests, 0 passed, 6 failed ============================================================================== controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore ------------------------------------------------------------------------------ controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-tell.txt.Partition And Heal :: Cluster Singleton test... ============================================================================== Register_Singleton_Constant_On_Each_Node :: Register a candidate a... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_partition_and_heal_register_singleton_constant_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_register_singleton_constant_on_each_node&order=bug_status" HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/operations/odl-mdsal-lowlevel-control:register-singleton-constant ------------------------------------------------------------------------------ Verify_Singleton_Constant_On_Each_Node :: Store the owner and cand... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_partition_and_heal_verify_singleton_constant_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_verify_singleton_constant_on_each_node&order=bug_status" Could not parse owner and candidates for device get-singleton-constant-service'] ------------------------------------------------------------------------------ Isolate_Owner_Node :: Isolate the cluster node which is the owner.... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_partition_and_heal_isolate_owner_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_isolate_owner_node&order=bug_status" Variable '${cs_owner}' not found. ------------------------------------------------------------------------------ Monitor_Stability_While_Isolated :: Monitor the stability of the s... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_partition_and_heal_monitor_stability_while_isolated" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_monitor_stability_while_isolated&order=bug_status" Invalid IF condition: Evaluating expression '"${index}" == "${cs_isolated_index}"' failed: Variable '${cs_isolated_index}' not found. ------------------------------------------------------------------------------ Rejoin_Isolated_node :: Rejoin isolated node. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_partition_and_heal_rejoin_isolated_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_rejoin_isolated_node&order=bug_status" Variable '${cs_isolated_index}' not found. ------------------------------------------------------------------------------ Unregister_Singleton_Constant_On_Each_Node :: Unregister the appli... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_partition_and_heal_unregister_singleton_constant_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_unregister_singleton_constant_on_each_node&order=bug_status" HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/operations/odl-mdsal-lowlevel-control:unregister-singleton-constant ------------------------------------------------------------------------------ controller-clustering-tell.txt.Partition And Heal :: Cluster Singl... | FAIL | 6 tests, 0 passed, 6 failed ============================================================================== controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore ------------------------------------------------------------------------------ controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-tell.txt.Chasing The Leader :: Cluster Singleton test... ============================================================================== Register_Candidates :: Register a candidate application on each no... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_chasing_the_leader_register_candidates" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_chasing_the_leader_register_candidates&order=bug_status" HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/operations/odl-mdsal-lowlevel-control:register-flapping-singleton ------------------------------------------------------------------------------ Do_Nothing :: Do nothing for the time of the test duration, becaus... | PASS | ------------------------------------------------------------------------------ Unregister_Candidates_And_Validate_Criteria :: Unregister the test... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_chasing_the_leader_unregister_candidates_and_validate_criteria" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_chasing_the_leader_unregister_candidates_and_validate_criteria&order=bug_status" HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/operations/odl-mdsal-lowlevel-control:unregister-flapping-singleton ------------------------------------------------------------------------------ controller-clustering-tell.txt.Chasing The Leader :: Cluster Singl... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore ------------------------------------------------------------------------------ controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-tell.txt.Carpeople Crud :: Suite for performing basic... ============================================================================== Add_Cars_To_Leader :: Add 30 cars to car Leader by one big PUT. | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Added_Cars_On_Leader :: GET response from Leader should match ... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Added_Cars_On_Followers :: The same check on other members. | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Add_People_To_First_Follower :: Add 30 people to people first Foll... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Added_People_On_Leader :: GET response from Leader should matc... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Added_People_On_Followers :: The same check on other members. | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Buy_Cars_On_Leader :: Buy some cars on car-people Leader, loop of ... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Buy_Cars_On_Followers :: On each Follower buy corresponding ID seg... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Added_CarPeople_On_Leader :: GET car-person mappings from Lead... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Added_CarPeople_On_Followers :: The same check on other members. | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_All_CarPeople_On_Leader :: DELETE car-people container. No ... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_All_People_On_Leader :: DELETE people container. No verific... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_All_Cars_On_Leader :: DELETE cars container. No verificatio... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ controller-clustering-tell.txt.Carpeople Crud :: Suite for perform... | FAIL | Suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 13 tests, 0 passed, 13 failed ============================================================================== controller-clustering-tell.txt.Car Failover Crud :: Suite mixing basic oper... ============================================================================== Add_Original_Cars_On_Old_Leader_And_Verify :: Add initial cars on ... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Stop_Original_Car_Leader :: Stop the car Leader to cause a new lea... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Wait_For_New_Leader :: Wait until new car Leader is elected. | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Original_Cars_On_New_Leader :: GET cars from new Leader, shoul... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Original_Cars_On_New_Followers :: The same check on other exis... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_Original_Cars_On_New_Leader :: Delete cars on the new Leader. | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Add_Leader_Cars_On_New_Leader :: Add cars on the new Leader. | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Leader_Cars_On_New_Leader :: GET cars from new Leader, should ... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Leader_Cars_On_New_Followers :: The same check on other existi... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_Leader_Cars_On_New_First_Follower :: Delete cars in new fir... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Add_Follower_Cars_On_New_First_Follower :: Add cars on the new fir... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Folower_Cars_On_New_Leader :: Get cars from the new Leader, sh... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Follower_Cars_On_New_Followers :: The same check on other exis... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Start_Old_Car_Leader :: Start the stopped member without deleting ... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Folower_Cars_On_Old_Leader :: GET cars from the restarted memb... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_Follower_Cars_On_New_Leader :: Delete cars on the last Leader. | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ controller-clustering-tell.txt.Car Failover Crud :: Suite mixing b... | FAIL | Suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 16 tests, 0 passed, 16 failed ============================================================================== controller-clustering-tell.txt.Car Persistence Recovery :: This test restar... ============================================================================== Add_Cars_On_Leader_And_Verify :: Single big PUT to datastore to ad... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Stop_All_Members :: Stop all controllers. | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Start_All_Members :: Start all controllers (should restore the per... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Memorize_Leader_And_Followers :: Locate current Leader of car Shard. | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Cars_On_Leader :: GET cars from Leader, should match the PUT d... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Cars_On_Followers :: The same check on other members. | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_Cars_On_Leader :: Delete cars on the new Leader. | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ controller-clustering-tell.txt.Car Persistence Recovery :: This te... | FAIL | Suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 7 tests, 0 passed, 7 failed ============================================================================== controller-clustering-tell.txt.Buycar Failover :: This test focuses on test... ============================================================================== Add_Cars_To_Leader_And_Verify :: Add all needed cars to car Leader... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Add_People_To_First_Follower_And_Verify :: Add all needed people t... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Buy_Cars_On_Leader_And_Verify :: Buy some cars on the leader member. | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Buy_Cars_On_Follower_And_Verify :: Buy some cars on the first foll... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Reboot_People_Leader :: Previous people Leader is rebooted. We sho... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Buy_Cars_On_Leader_After_Reboot_And_Verify :: Buy some cars on the... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Buy_Cars_On_Follower_After_Reboot_And_Verify :: Buy some cars on t... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_All_CarPeople :: DELETE car-people container. No verificati... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_All_People :: DELETE people container. No verification beyo... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_All_Cars :: DELETE cars container. No verification beyond h... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ controller-clustering-tell.txt.Buycar Failover :: This test focuse... | FAIL | Suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 10 tests, 0 passed, 10 failed ============================================================================== controller-clustering-tell.txt.Entity Isolate :: Suite for performing membe... ============================================================================== Check All Shards Before Isolate :: Check all shards in controller. | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Isolate Entity Leader :: Isolate the entity-ownership Leader to ca... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Check All Shards After Isolate :: Check all shards in controller. | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Rejoin Entity Leader :: Rejoin the entity-ownership Leader. | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Check All Shards After Rejoin :: Check all shards in controller. | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ controller-clustering-tell.txt.Entity Isolate :: Suite for perform... | FAIL | Suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 5 tests, 0 passed, 5 failed ============================================================================== controller-clustering-tell.txt.Buycar Failover Isolation :: This test focus... ============================================================================== Add_Cars_To_Leader_And_Verify :: Add all needed cars to car Leader... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Add_People_To_First_Follower_And_Verify :: Add all needed people t... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Buy_Cars_On_Leader_And_Verify :: Buy some cars on the leader member. | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Buy_Cars_On_Follower_And_Verify :: Buy some cars on the first foll... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Isolate_and_Rejoin_People_Leader :: Previous people Leader is isol... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Buy_Cars_On_Leader_After_Rejoin_And_Verify :: Buy some cars on the... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Buy_Cars_On_Follower_After_Rejoin_And_Verify :: Buy some cars on t... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_All_CarPeople :: DELETE car-people container. No verificati... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_All_People :: DELETE people container. No verification beyo... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_All_Cars :: DELETE cars container. No verification beyond h... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ controller-clustering-tell.txt.Buycar Failover Isolation :: This t... | FAIL | Suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 10 tests, 0 passed, 10 failed ============================================================================== controller-clustering-tell.txt.Car Failover Crud Isolation :: Suite mixing ... ============================================================================== Add_Original_Cars_On_Old_Leader_And_Verify :: Add initial cars on ... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Isolate_Original_Car_Leader :: Isolate the car Leader to cause a n... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Wait_For_New_Leader :: Wait until new car Leader is elected. | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Original_Cars_On_New_Leader :: GET cars from new Leader, shoul... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Original_Cars_On_New_Followers :: The same check on other exis... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_Original_Cars_On_New_Leader :: Delete cars on the new Leader. | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Add_Leader_Cars_On_New_Leader :: Add cars on the new Leader. | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Leader_Cars_On_New_Leader :: GET cars from new Leader, should ... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Leader_Cars_On_New_Followers :: The same check on other existi... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_Leader_Cars_On_New_First_Follower :: Delete cars in new fir... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Add_Follower_Cars_On_New_First_Follower :: Add cars on the new fir... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Folower_Cars_On_New_Leader :: Get cars from the new Leader, sh... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Follower_Cars_On_New_Followers :: The same check on other exis... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Rejoin_Old_Car_Leader :: Rejoin the isolated member without deleti... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Folower_Cars_On_Old_Leader :: GET cars from the restarted memb... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_Follower_Cars_On_New_Leader :: Delete cars on the last Leader. | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ controller-clustering-tell.txt.Car Failover Crud Isolation :: Suit... | FAIL | Suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 16 tests, 0 passed, 16 failed ============================================================================== controller-clustering-tell.txt.Car Outage Corners :: Cluster suite for test... ============================================================================== Stop_Majority_Of_The_Followers :: Stop half plus one car Follower ... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Attempt_To_Add_Cars_To_Leader :: Adding cars should fail, as major... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Start_Tipping_Follower :: Start one Follower member without persis... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Add_Cars_On_Tipping_Follower :: Add cars on the tipping Follower. | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Cars_On_Existing_Members :: On each up member: GET cars, shoul... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Start_Other_Followers :: Start other followers without persisted d... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Cars_On_New_Follower_Leader :: GET cars from a new follower to... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_Cars_On_Leader :: Delete cars on Leader. | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ controller-clustering-tell.txt.Car Outage Corners :: Cluster suite... | FAIL | Suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.171.127:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 8 tests, 0 passed, 8 failed ============================================================================== controller-clustering-tell.txt | FAIL | 162 tests, 15 passed, 147 failed ============================================================================== Output: /w/workspace/controller-csit-3node-clustering-tell-all-scandium/output.xml Log: /w/workspace/controller-csit-3node-clustering-tell-all-scandium/log.html Report: /w/workspace/controller-csit-3node-clustering-tell-all-scandium/report.html + true + echo 'Examining the files in data/log and checking filesize' Examining the files in data/log and checking filesize + ssh 10.30.171.127 'ls -altr /tmp/karaf-0.21.0-SNAPSHOT/data/log/' Warning: Permanently added '10.30.171.127' (ECDSA) to the list of known hosts. total 127556 drwxrwxr-x. 2 jenkins jenkins 48 Apr 28 06:08 . -rw-rw-r--. 1 jenkins jenkins 1720 Apr 28 06:08 karaf_console.log drwxrwxr-x. 4 jenkins jenkins 28 Apr 28 10:08 .. -rw-rw-r--. 1 jenkins jenkins 86158602 Apr 28 10:15 karaf.log + ssh 10.30.171.127 'du -hs /tmp/karaf-0.21.0-SNAPSHOT/data/log/*' Warning: Permanently added '10.30.171.127' (ECDSA) to the list of known hosts. 4.0K /tmp/karaf-0.21.0-SNAPSHOT/data/log/karaf_console.log 125M /tmp/karaf-0.21.0-SNAPSHOT/data/log/karaf.log + ssh 10.30.170.58 'ls -altr /tmp/karaf-0.21.0-SNAPSHOT/data/log/' Warning: Permanently added '10.30.170.58' (ECDSA) to the list of known hosts. total 77380 drwxrwxr-x. 2 jenkins jenkins 48 Apr 28 06:08 . -rw-rw-r--. 1 jenkins jenkins 1720 Apr 28 06:08 karaf_console.log drwxrwxr-x. 9 jenkins jenkins 149 Apr 28 10:09 .. -rw-rw-r--. 1 jenkins jenkins 49482723 Apr 28 10:15 karaf.log + ssh 10.30.170.58 'du -hs /tmp/karaf-0.21.0-SNAPSHOT/data/log/*' Warning: Permanently added '10.30.170.58' (ECDSA) to the list of known hosts. 4.0K /tmp/karaf-0.21.0-SNAPSHOT/data/log/karaf_console.log 76M /tmp/karaf-0.21.0-SNAPSHOT/data/log/karaf.log + ssh 10.30.171.170 'ls -altr /tmp/karaf-0.21.0-SNAPSHOT/data/log/' Warning: Permanently added '10.30.171.170' (ECDSA) to the list of known hosts. total 35780 drwxrwxr-x. 2 jenkins jenkins 48 Apr 28 06:08 . -rw-rw-r--. 1 jenkins jenkins 1720 Apr 28 06:08 karaf_console.log drwxrwxr-x. 4 jenkins jenkins 28 Apr 28 10:08 .. -rw-rw-r--. 1 jenkins jenkins 19870415 Apr 28 10:15 karaf.log + ssh 10.30.171.170 'du -hs /tmp/karaf-0.21.0-SNAPSHOT/data/log/*' Warning: Permanently added '10.30.171.170' (ECDSA) to the list of known hosts. 4.0K /tmp/karaf-0.21.0-SNAPSHOT/data/log/karaf_console.log 35M /tmp/karaf-0.21.0-SNAPSHOT/data/log/karaf.log + set +e ++ seq 1 3 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_1_IP + echo 'Let'\''s take the karaf thread dump again' Let's take the karaf thread dump again + ssh 10.30.171.127 'sudo ps aux' Warning: Permanently added '10.30.171.127' (ECDSA) to the list of known hosts. ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-scandium/ps_after.log ++ grep -v grep ++ cut -f2 '-d ' ++ tr -s ' ' + pid=10401 + echo 'karaf main: org.apache.karaf.main.Main, pid:10401' karaf main: org.apache.karaf.main.Main, pid:10401 + ssh 10.30.171.127 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 10401' Warning: Permanently added '10.30.171.127' (ECDSA) to the list of known hosts. + echo 'killing karaf process...' killing karaf process... + ssh 10.30.171.127 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh' Warning: Permanently added '10.30.171.127' (ECDSA) to the list of known hosts. + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_2_IP + echo 'Let'\''s take the karaf thread dump again' Let's take the karaf thread dump again + ssh 10.30.170.58 'sudo ps aux' Warning: Permanently added '10.30.170.58' (ECDSA) to the list of known hosts. ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-scandium/ps_after.log ++ grep -v grep ++ cut -f2 '-d ' ++ tr -s ' ' + pid=37042 + echo 'karaf main: org.apache.karaf.main.Main, pid:37042' karaf main: org.apache.karaf.main.Main, pid:37042 + ssh 10.30.170.58 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 37042' Warning: Permanently added '10.30.170.58' (ECDSA) to the list of known hosts. + echo 'killing karaf process...' killing karaf process... + ssh 10.30.170.58 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh' Warning: Permanently added '10.30.170.58' (ECDSA) to the list of known hosts. + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_3_IP + echo 'Let'\''s take the karaf thread dump again' Let's take the karaf thread dump again + ssh 10.30.171.170 'sudo ps aux' Warning: Permanently added '10.30.171.170' (ECDSA) to the list of known hosts. ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-scandium/ps_after.log ++ grep -v grep ++ tr -s ' ' ++ cut -f2 '-d ' + pid=16253 + echo 'karaf main: org.apache.karaf.main.Main, pid:16253' karaf main: org.apache.karaf.main.Main, pid:16253 + ssh 10.30.171.170 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 16253' Warning: Permanently added '10.30.171.170' (ECDSA) to the list of known hosts. + echo 'killing karaf process...' killing karaf process... + ssh 10.30.171.170 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh' Warning: Permanently added '10.30.171.170' (ECDSA) to the list of known hosts. + sleep 5 ++ seq 1 3 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_1_IP + echo 'Compressing karaf.log 1' Compressing karaf.log 1 + ssh 10.30.171.127 gzip --best /tmp/karaf-0.21.0-SNAPSHOT/data/log/karaf.log Warning: Permanently added '10.30.171.127' (ECDSA) to the list of known hosts. gzip: /tmp/karaf-0.21.0-SNAPSHOT/data/log/karaf.log: file size changed while zipping + echo 'Fetching compressed karaf.log 1' Fetching compressed karaf.log 1 + scp 10.30.171.127:/tmp/karaf-0.21.0-SNAPSHOT/data/log/karaf.log.gz odl1_karaf.log.gz Warning: Permanently added '10.30.171.127' (ECDSA) to the list of known hosts. + ssh 10.30.171.127 rm -f /tmp/karaf-0.21.0-SNAPSHOT/data/log/karaf.log.gz Warning: Permanently added '10.30.171.127' (ECDSA) to the list of known hosts. + scp 10.30.171.127:/tmp/karaf-0.21.0-SNAPSHOT/data/log/karaf_console.log odl1_karaf_console.log Warning: Permanently added '10.30.171.127' (ECDSA) to the list of known hosts. + ssh 10.30.171.127 rm -f /tmp/karaf-0.21.0-SNAPSHOT/data/log/karaf_console.log Warning: Permanently added '10.30.171.127' (ECDSA) to the list of known hosts. + echo 'Fetch GC logs' Fetch GC logs + mkdir -p gclogs-1 + scp '10.30.171.127:/tmp/karaf-0.21.0-SNAPSHOT/data/log/*.log' gclogs-1/ Warning: Permanently added '10.30.171.127' (ECDSA) to the list of known hosts. scp: /tmp/karaf-0.21.0-SNAPSHOT/data/log/*.log: No such file or directory + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_2_IP + echo 'Compressing karaf.log 2' Compressing karaf.log 2 + ssh 10.30.170.58 gzip --best /tmp/karaf-0.21.0-SNAPSHOT/data/log/karaf.log Warning: Permanently added '10.30.170.58' (ECDSA) to the list of known hosts. gzip: /tmp/karaf-0.21.0-SNAPSHOT/data/log/karaf.log: file size changed while zipping + echo 'Fetching compressed karaf.log 2' Fetching compressed karaf.log 2 + scp 10.30.170.58:/tmp/karaf-0.21.0-SNAPSHOT/data/log/karaf.log.gz odl2_karaf.log.gz Warning: Permanently added '10.30.170.58' (ECDSA) to the list of known hosts. + ssh 10.30.170.58 rm -f /tmp/karaf-0.21.0-SNAPSHOT/data/log/karaf.log.gz Warning: Permanently added '10.30.170.58' (ECDSA) to the list of known hosts. + scp 10.30.170.58:/tmp/karaf-0.21.0-SNAPSHOT/data/log/karaf_console.log odl2_karaf_console.log Warning: Permanently added '10.30.170.58' (ECDSA) to the list of known hosts. + ssh 10.30.170.58 rm -f /tmp/karaf-0.21.0-SNAPSHOT/data/log/karaf_console.log Warning: Permanently added '10.30.170.58' (ECDSA) to the list of known hosts. + echo 'Fetch GC logs' Fetch GC logs + mkdir -p gclogs-2 + scp '10.30.170.58:/tmp/karaf-0.21.0-SNAPSHOT/data/log/*.log' gclogs-2/ Warning: Permanently added '10.30.170.58' (ECDSA) to the list of known hosts. scp: /tmp/karaf-0.21.0-SNAPSHOT/data/log/*.log: No such file or directory + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_3_IP + echo 'Compressing karaf.log 3' Compressing karaf.log 3 + ssh 10.30.171.170 gzip --best /tmp/karaf-0.21.0-SNAPSHOT/data/log/karaf.log Warning: Permanently added '10.30.171.170' (ECDSA) to the list of known hosts. + echo 'Fetching compressed karaf.log 3' Fetching compressed karaf.log 3 + scp 10.30.171.170:/tmp/karaf-0.21.0-SNAPSHOT/data/log/karaf.log.gz odl3_karaf.log.gz Warning: Permanently added '10.30.171.170' (ECDSA) to the list of known hosts. + ssh 10.30.171.170 rm -f /tmp/karaf-0.21.0-SNAPSHOT/data/log/karaf.log.gz Warning: Permanently added '10.30.171.170' (ECDSA) to the list of known hosts. + scp 10.30.171.170:/tmp/karaf-0.21.0-SNAPSHOT/data/log/karaf_console.log odl3_karaf_console.log Warning: Permanently added '10.30.171.170' (ECDSA) to the list of known hosts. + ssh 10.30.171.170 rm -f /tmp/karaf-0.21.0-SNAPSHOT/data/log/karaf_console.log Warning: Permanently added '10.30.171.170' (ECDSA) to the list of known hosts. + echo 'Fetch GC logs' Fetch GC logs + mkdir -p gclogs-3 + scp '10.30.171.170:/tmp/karaf-0.21.0-SNAPSHOT/data/log/*.log' gclogs-3/ Warning: Permanently added '10.30.171.170' (ECDSA) to the list of known hosts. scp: /tmp/karaf-0.21.0-SNAPSHOT/data/log/*.log: No such file or directory + echo 'Examine copied files' Examine copied files + ls -lt total 72232 drwxrwxr-x. 2 jenkins jenkins 6 Apr 28 10:15 gclogs-3 -rw-rw-r--. 1 jenkins jenkins 1720 Apr 28 10:15 odl3_karaf_console.log -rw-rw-r--. 1 jenkins jenkins 879966 Apr 28 10:15 odl3_karaf.log.gz drwxrwxr-x. 2 jenkins jenkins 6 Apr 28 10:15 gclogs-2 -rw-rw-r--. 1 jenkins jenkins 1720 Apr 28 10:15 odl2_karaf_console.log -rw-rw-r--. 1 jenkins jenkins 1632035 Apr 28 10:15 odl2_karaf.log.gz drwxrwxr-x. 2 jenkins jenkins 6 Apr 28 10:15 gclogs-1 -rw-rw-r--. 1 jenkins jenkins 1720 Apr 28 10:15 odl1_karaf_console.log -rw-rw-r--. 1 jenkins jenkins 2386458 Apr 28 10:15 odl1_karaf.log.gz -rw-rw-r--. 1 jenkins jenkins 110619 Apr 28 10:15 karaf_3_16253_threads_after.log -rw-rw-r--. 1 jenkins jenkins 16130 Apr 28 10:15 ps_after.log -rw-rw-r--. 1 jenkins jenkins 128322 Apr 28 10:15 karaf_2_37042_threads_after.log -rw-rw-r--. 1 jenkins jenkins 160418 Apr 28 10:15 karaf_1_10401_threads_after.log -rw-rw-r--. 1 jenkins jenkins 305087 Apr 28 10:15 report.html -rw-rw-r--. 1 jenkins jenkins 3046086 Apr 28 10:15 log.html -rw-rw-r--. 1 jenkins jenkins 64692966 Apr 28 10:15 output.xml -rw-rw-r--. 1 jenkins jenkins 6069 Apr 28 06:09 testplan.txt -rw-rw-r--. 1 jenkins jenkins 164295 Apr 28 06:09 karaf_3_5730_threads_before.log -rw-rw-r--. 1 jenkins jenkins 16490 Apr 28 06:09 ps_before.log -rw-rw-r--. 1 jenkins jenkins 157814 Apr 28 06:09 karaf_2_5763_threads_before.log -rw-rw-r--. 1 jenkins jenkins 158285 Apr 28 06:09 karaf_1_5745_threads_before.log -rw-rw-r--. 1 jenkins jenkins 3106 Apr 28 06:08 post-startup-script.sh -rw-rw-r--. 1 jenkins jenkins 252 Apr 28 06:07 startup-script.sh -rw-rw-r--. 1 jenkins jenkins 3454 Apr 28 06:07 configuration-script.sh -rw-rw-r--. 1 jenkins jenkins 695 Apr 28 06:07 custom_shard_config.txt -rw-rw-r--. 1 jenkins jenkins 136 Apr 28 06:07 scriptplan.txt -rw-rw-r--. 1 jenkins jenkins 337 Apr 28 06:07 detect_variables.env -rw-rw-r--. 1 jenkins jenkins 2620 Apr 28 06:07 pom.xml -rw-rw-r--. 1 jenkins jenkins 86 Apr 28 06:07 set_variables.env -rw-rw-r--. 1 jenkins jenkins 313 Apr 28 06:07 slave_addresses.txt -rw-rw-r--. 1 jenkins jenkins 570 Apr 28 06:07 requirements.txt -rw-rw-r--. 1 jenkins jenkins 26 Apr 28 06:07 env.properties -rw-rw-r--. 1 jenkins jenkins 334 Apr 28 06:05 stack-parameters.yaml drwxrwxr-x. 7 jenkins jenkins 4096 Apr 28 06:03 test drwxrwxr-x. 2 jenkins jenkins 6 Apr 28 06:03 test@tmp -rw-rw-r--. 1 jenkins jenkins 1410 Apr 28 03:07 maven-metadata.xml + true [controller-csit-3node-clustering-tell-all-scandium] $ /bin/sh /tmp/jenkins12713944318803686277.sh Cleaning up Robot installation... $ ssh-agent -k unset SSH_AUTH_SOCK; unset SSH_AGENT_PID; echo Agent pid 5269 killed; [ssh-agent] Stopped. Recording plot data Robot results publisher started... INFO: Checking test criticality is deprecated and will be dropped in a future release! -Parsing output xml: Done! -Copying log files to build dir: Done! -Assigning results to build: Done! -Checking thresholds: Done! Done publishing Robot results. Build step 'Publish Robot Framework test results' changed build result to UNSTABLE [PostBuildScript] - [INFO] Executing post build scripts. [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins16098112595592205077.sh Archiving csit artifacts mv: cannot stat '*_1.png': No such file or directory mv: cannot stat '/tmp/odl1_*': No such file or directory mv: cannot stat '*_2.png': No such file or directory mv: cannot stat '/tmp/odl2_*': No such file or directory mv: cannot stat '*_3.png': No such file or directory mv: cannot stat '/tmp/odl3_*': No such file or directory % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 1960k 0 1960k 0 0 3705k 0 --:--:-- --:--:-- --:--:-- 3698k 100 4861k 0 4861k 0 0 4324k 0 --:--:-- 0:00:01 --:--:-- 4324k Archive: robot-plugin.zip inflating: ./archives/robot-plugin/log.html inflating: ./archives/robot-plugin/output.xml inflating: ./archives/robot-plugin/report.html mv: cannot stat '*.log.gz': No such file or directory mv: cannot stat '*.csv': No such file or directory mv: cannot stat '*.png': No such file or directory [PostBuildScript] - [INFO] Executing post build scripts. [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins10723187318028851011.sh [PostBuildScript] - [INFO] Executing post build scripts. [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content OS_CLOUD=vex OS_STACK_NAME=releng-controller-csit-3node-clustering-tell-all-scandium-3 [EnvInject] - Variables injected successfully. provisioning config files... copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins7474978632002679893.sh ---> openstack-stack-delete.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-C3xR from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes python-heatclient python-openstackclient lf-activate-venv(): INFO: Adding /tmp/venv-C3xR/bin to PATH INFO: Retrieving stack cost for: releng-controller-csit-3node-clustering-tell-all-scandium-3 DEBUG: Successfully retrieved stack cost: total: 1.6500000000000001 INFO: Deleting stack releng-controller-csit-3node-clustering-tell-all-scandium-3 Successfully deleted stack releng-controller-csit-3node-clustering-tell-all-scandium-3 [PostBuildScript] - [INFO] Executing post build scripts. [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins15470143469712468183.sh ---> sysstat.sh [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins6979928615878199124.sh ---> package-listing.sh ++ facter osfamily ++ tr '[:upper:]' '[:lower:]' + OS_FAMILY=redhat + workspace=/w/workspace/controller-csit-3node-clustering-tell-all-scandium + START_PACKAGES=/tmp/packages_start.txt + END_PACKAGES=/tmp/packages_end.txt + DIFF_PACKAGES=/tmp/packages_diff.txt + PACKAGES=/tmp/packages_start.txt + '[' /w/workspace/controller-csit-3node-clustering-tell-all-scandium ']' + PACKAGES=/tmp/packages_end.txt + case "${OS_FAMILY}" in + rpm -qa + sort + '[' -f /tmp/packages_start.txt ']' + '[' -f /tmp/packages_end.txt ']' + diff /tmp/packages_start.txt /tmp/packages_end.txt + '[' /w/workspace/controller-csit-3node-clustering-tell-all-scandium ']' + mkdir -p /w/workspace/controller-csit-3node-clustering-tell-all-scandium/archives/ + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/controller-csit-3node-clustering-tell-all-scandium/archives/ [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins15041296623540751810.sh ---> capture-instance-metadata.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-C3xR from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools lf-activate-venv(): INFO: Adding /tmp/venv-C3xR/bin to PATH INFO: Running in OpenStack, capturing instance metadata [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins16770252930012476561.sh provisioning config files... Could not find credentials [logs] for controller-csit-3node-clustering-tell-all-scandium #3 copy managed file [jenkins-log-archives-settings] to file:/w/workspace/controller-csit-3node-clustering-tell-all-scandium@tmp/config488656810728562760tmp Regular expression run condition: Expression=[^.*logs-s3.*], Label=[odl-logs-s3-cloudfront-index] Run condition [Regular expression match] enabling perform for step [Provide Configuration files] provisioning config files... copy managed file [jenkins-s3-log-ship] to file:/home/jenkins/.aws/credentials [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content SERVER_ID=logs [EnvInject] - Variables injected successfully. [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins17318660539355314100.sh ---> create-netrc.sh WARN: Log server credential not found. [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins16385641395214927220.sh ---> python-tools-install.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-C3xR from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools lf-activate-venv(): INFO: Adding /tmp/venv-C3xR/bin to PATH [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins11415421724532848193.sh ---> sudo-logs.sh Archiving 'sudo' log.. [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins15857381601297625350.sh ---> job-cost.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-C3xR from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 lf-activate-venv(): INFO: Adding /tmp/venv-C3xR/bin to PATH DEBUG: total: 1.6500000000000001 INFO: Retrieving Stack Cost... INFO: Retrieving Pricing Info for: v3-standard-2 INFO: Archiving Costs [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash -l /tmp/jenkins2855119597814307920.sh ---> logs-deploy.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-C3xR from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools lf-activate-venv(): INFO: Adding /tmp/venv-C3xR/bin to PATH WARNING: Nexus logging server not set INFO: S3 path logs/releng/vex-yul-odl-jenkins-1/controller-csit-3node-clustering-tell-all-scandium/3/ INFO: archiving logs to S3 ---> uname -a: Linux prd-centos8-robot-2c-8g-16416.novalocal 4.18.0-547.el8.x86_64 #1 SMP Wed Mar 20 00:35:01 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux ---> lscpu: Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Byte Order: Little Endian CPU(s): 2 On-line CPU(s) list: 0,1 Thread(s) per core: 1 Core(s) per socket: 1 Socket(s): 2 NUMA node(s): 1 Vendor ID: AuthenticAMD CPU family: 23 Model: 49 Model name: AMD EPYC-Rome Processor Stepping: 0 CPU MHz: 2800.000 BogoMIPS: 5600.00 Virtualization: AMD-V Hypervisor vendor: KVM Virtualization type: full L1d cache: 32K L1i cache: 32K L2 cache: 512K L3 cache: 16384K NUMA node0 CPU(s): 0,1 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities ---> nproc: 2 ---> df -h: Filesystem Size Used Avail Use% Mounted on devtmpfs 3.8G 0 3.8G 0% /dev tmpfs 3.8G 0 3.8G 0% /dev/shm tmpfs 3.8G 17M 3.8G 1% /run tmpfs 3.8G 0 3.8G 0% /sys/fs/cgroup /dev/vda1 40G 9.6G 31G 24% / tmpfs 770M 0 770M 0% /run/user/1001 ---> free -m: total used free shared buff/cache available Mem: 7697 637 4602 19 2456 6762 Swap: 1023 0 1023 ---> ip addr: 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever inet6 ::1/128 scope host valid_lft forever preferred_lft forever 2: eth0: mtu 1458 qdisc mq state UP group default qlen 1000 link/ether fa:16:3e:b0:14:12 brd ff:ff:ff:ff:ff:ff altname enp0s3 altname ens3 inet 10.30.170.112/23 brd 10.30.171.255 scope global dynamic noprefixroute eth0 valid_lft 71157sec preferred_lft 71157sec inet6 fe80::f816:3eff:feb0:1412/64 scope link valid_lft forever preferred_lft forever ---> sar -b -r -n DEV: Linux 4.18.0-547.el8.x86_64 (centos-stream-8-robot-8eca76b2-cb40-4fba-ac9e-845c8a03a7a7.noval) 04/28/2024 _x86_64_ (2 CPU) 06:03:05 LINUX RESTART (2 CPU) 06:04:01 AM tps rtps wtps bread/s bwrtn/s 06:05:01 AM 90.33 7.05 83.29 1311.25 6136.24 06:06:01 AM 71.44 0.75 70.69 52.72 8671.81 06:07:01 AM 18.15 0.85 17.30 123.98 1391.17 06:08:01 AM 59.76 2.72 57.04 406.60 7403.82 06:09:01 AM 12.20 0.00 12.20 0.00 928.22 06:10:01 AM 0.62 0.00 0.62 0.00 44.12 06:11:01 AM 1.82 0.00 1.82 0.00 72.89 06:12:01 AM 0.17 0.00 0.17 0.00 9.10 06:13:01 AM 0.22 0.00 0.22 0.00 16.71 06:14:01 AM 0.30 0.03 0.27 1.87 10.13 06:15:01 AM 0.37 0.02 0.35 0.13 24.76 06:16:01 AM 0.22 0.00 0.22 0.00 24.29 06:17:01 AM 0.17 0.00 0.17 0.00 1.88 06:18:01 AM 0.17 0.00 0.17 0.00 3.10 06:19:01 AM 1.42 0.03 1.38 0.27 36.54 06:20:01 AM 0.47 0.00 0.47 0.00 9.20 06:21:01 AM 0.22 0.00 0.22 0.00 41.62 06:22:01 AM 0.32 0.00 0.32 0.00 8.57 06:23:01 AM 0.12 0.00 0.12 0.00 2.95 06:24:01 AM 0.32 0.00 0.32 0.00 17.70 06:25:01 AM 0.23 0.00 0.23 0.00 10.10 06:26:01 AM 0.20 0.00 0.20 0.00 14.83 06:27:01 AM 0.17 0.00 0.17 0.00 14.68 06:28:01 AM 0.15 0.00 0.15 0.00 13.90 06:29:01 AM 0.27 0.00 0.27 0.00 18.89 06:30:01 AM 0.18 0.00 0.18 0.00 10.41 06:31:01 AM 0.28 0.00 0.28 0.00 21.89 06:32:01 AM 0.25 0.00 0.25 0.00 9.80 06:33:01 AM 0.20 0.00 0.20 0.00 14.71 06:34:01 AM 0.27 0.00 0.27 0.00 11.56 06:35:01 AM 0.17 0.00 0.17 0.00 16.01 06:36:01 AM 0.15 0.00 0.15 0.00 7.62 06:37:01 AM 0.12 0.00 0.12 0.00 12.66 06:38:01 AM 0.12 0.00 0.12 0.00 1.22 06:39:01 AM 0.47 0.00 0.47 0.00 19.43 06:40:01 AM 0.52 0.00 0.52 0.00 16.78 06:41:01 AM 0.68 0.00 0.68 0.00 20.40 06:42:01 AM 0.17 0.00 0.17 0.00 11.05 06:43:01 AM 0.15 0.00 0.15 0.00 10.31 06:44:01 AM 0.35 0.00 0.35 0.00 18.68 06:45:01 AM 0.18 0.00 0.18 0.00 12.15 06:46:01 AM 0.13 0.00 0.13 0.00 1.47 06:47:01 AM 0.17 0.00 0.17 0.00 13.88 06:48:01 AM 0.27 0.00 0.27 0.00 11.61 06:49:01 AM 0.33 0.00 0.33 0.00 20.38 06:50:01 AM 0.18 0.00 0.18 0.00 14.15 06:51:01 AM 0.17 0.00 0.17 0.00 8.57 06:52:01 AM 0.50 0.00 0.50 0.00 23.31 06:53:01 AM 0.35 0.00 0.35 0.00 22.98 06:54:01 AM 0.30 0.00 0.30 0.00 8.51 06:55:01 AM 0.22 0.00 0.22 0.00 4.92 06:56:01 AM 0.18 0.00 0.18 0.00 6.15 06:57:01 AM 0.13 0.00 0.13 0.00 3.20 06:58:01 AM 0.15 0.02 0.13 0.13 5.06 06:59:01 AM 24.78 16.81 7.97 717.61 5528.66 07:00:01 AM 1.30 0.00 1.30 0.00 543.35 07:01:01 AM 0.22 0.00 0.22 0.00 12.58 07:02:01 AM 0.48 0.08 0.40 1.86 22.67 07:03:01 AM 0.13 0.00 0.13 0.00 8.27 07:04:01 AM 0.32 0.00 0.32 0.00 20.93 07:05:01 AM 0.62 0.00 0.62 0.00 21.71 07:06:01 AM 0.32 0.00 0.32 0.00 16.01 07:07:01 AM 0.48 0.00 0.48 0.00 16.83 07:08:02 AM 0.47 0.00 0.47 0.00 16.16 07:09:01 AM 0.36 0.00 0.36 0.00 11.20 07:10:01 AM 0.22 0.00 0.22 0.00 18.01 07:11:01 AM 0.18 0.00 0.18 0.00 15.89 07:12:01 AM 0.22 0.00 0.22 0.00 19.08 07:13:01 AM 0.20 0.00 0.20 0.00 16.66 07:14:01 AM 0.18 0.00 0.18 0.00 16.33 07:15:01 AM 0.32 0.00 0.32 0.00 18.03 07:16:01 AM 0.30 0.00 0.30 0.00 15.08 07:17:01 AM 0.15 0.00 0.15 0.00 8.97 07:18:01 AM 0.13 0.00 0.13 0.00 23.08 07:19:01 AM 0.23 0.00 0.23 0.00 5.97 07:20:01 AM 0.20 0.00 0.20 0.00 5.38 07:21:01 AM 0.22 0.00 0.22 0.00 5.65 07:22:01 AM 0.28 0.00 0.28 0.00 5.78 07:23:01 AM 0.20 0.00 0.20 0.00 6.40 07:24:01 AM 0.15 0.00 0.15 0.00 14.05 07:25:01 AM 0.22 0.00 0.22 0.00 15.63 07:26:01 AM 0.18 0.00 0.18 0.00 16.53 07:27:01 AM 0.12 0.00 0.12 0.00 8.00 07:28:01 AM 0.15 0.00 0.15 0.00 17.33 07:29:01 AM 1.28 0.30 0.98 6.40 30.74 07:30:01 AM 0.22 0.00 0.22 0.00 16.14 07:31:01 AM 0.18 0.00 0.18 0.00 22.50 07:32:01 AM 0.35 0.00 0.35 0.00 16.29 07:33:01 AM 0.33 0.00 0.33 0.00 16.38 07:34:01 AM 0.38 0.00 0.38 0.00 17.68 07:35:01 AM 0.20 0.00 0.20 0.00 8.65 07:36:01 AM 0.23 0.00 0.23 0.00 18.94 07:37:01 AM 0.13 0.00 0.13 0.00 17.06 07:38:01 AM 0.22 0.00 0.22 0.00 4.67 07:39:01 AM 0.50 0.00 0.50 0.00 9.68 07:40:01 AM 0.42 0.00 0.42 0.00 6.92 07:41:01 AM 0.47 0.00 0.47 0.00 8.40 07:42:01 AM 0.57 0.00 0.57 0.00 8.98 07:43:01 AM 0.33 0.00 0.33 0.00 14.00 07:44:01 AM 0.45 0.00 0.45 0.00 6.22 07:45:01 AM 0.37 0.03 0.33 1.33 6.65 07:46:01 AM 0.30 0.00 0.30 0.00 3.42 07:47:01 AM 0.22 0.00 0.22 0.00 5.70 07:48:01 AM 0.15 0.00 0.15 0.00 1.47 07:49:01 AM 0.45 0.00 0.45 0.00 11.50 07:50:01 AM 0.27 0.00 0.27 0.00 3.20 07:51:01 AM 0.18 0.00 0.18 0.00 1.90 07:52:01 AM 0.18 0.00 0.18 0.00 5.45 07:53:01 AM 0.08 0.00 0.08 0.00 0.65 07:54:01 AM 0.28 0.00 0.28 0.00 8.35 07:55:01 AM 0.18 0.00 0.18 0.00 1.53 07:56:01 AM 0.20 0.00 0.20 0.00 5.80 07:57:01 AM 0.23 0.00 0.23 0.00 2.67 07:58:01 AM 0.18 0.00 0.18 0.00 20.01 07:59:01 AM 0.40 0.00 0.40 0.00 12.88 08:00:01 AM 0.18 0.00 0.18 0.00 14.30 08:01:01 AM 0.18 0.00 0.18 0.00 15.49 08:02:01 AM 0.28 0.00 0.28 0.00 11.33 08:03:01 AM 0.22 0.00 0.22 0.00 19.61 08:04:01 AM 0.40 0.00 0.40 0.00 10.05 08:05:01 AM 0.32 0.00 0.32 0.00 3.15 08:06:01 AM 0.48 0.00 0.48 0.00 9.46 08:07:01 AM 0.37 0.00 0.37 0.00 3.48 08:08:01 AM 0.32 0.00 0.32 0.00 6.66 08:09:01 AM 0.65 0.00 0.65 0.00 10.23 08:10:01 AM 0.33 0.00 0.33 0.00 6.90 08:11:01 AM 0.35 0.00 0.35 0.00 4.23 08:12:01 AM 0.38 0.00 0.38 0.00 7.23 08:13:02 AM 0.30 0.00 0.30 0.00 3.05 08:14:01 AM 0.36 0.00 0.36 0.00 8.39 08:15:01 AM 0.27 0.00 0.27 0.00 3.47 08:16:01 AM 0.20 0.00 0.20 0.00 1.88 08:17:01 AM 0.13 0.00 0.13 0.00 4.38 08:18:01 AM 0.08 0.00 0.08 0.00 0.85 08:19:01 AM 0.23 0.00 0.23 0.00 17.83 08:20:01 AM 0.33 0.00 0.33 0.00 18.43 08:21:01 AM 0.23 0.00 0.23 0.00 14.03 08:22:01 AM 0.27 0.00 0.27 0.00 15.86 08:23:01 AM 0.48 0.00 0.48 0.00 16.43 08:24:01 AM 0.55 0.00 0.55 0.00 20.75 08:25:01 AM 0.25 0.00 0.25 0.00 4.32 08:26:01 AM 0.12 0.00 0.12 0.00 0.77 08:27:01 AM 0.18 0.00 0.18 0.00 4.97 08:28:01 AM 0.42 0.00 0.42 0.00 4.30 08:29:01 AM 0.22 0.00 0.22 0.00 6.31 08:30:01 AM 0.18 0.00 0.18 0.00 3.20 08:31:01 AM 0.32 0.00 0.32 0.00 6.68 08:32:01 AM 0.25 0.00 0.25 0.00 3.77 08:33:01 AM 0.80 0.00 0.80 0.00 15.26 08:34:01 AM 0.37 0.00 0.37 0.00 5.32 08:35:01 AM 0.30 0.00 0.30 0.00 8.01 08:36:01 AM 0.18 0.00 0.18 0.00 2.13 08:37:01 AM 0.12 0.00 0.12 0.00 3.85 08:38:01 AM 0.15 0.00 0.15 0.00 1.92 08:39:01 AM 0.18 0.00 0.18 0.00 1.78 08:40:01 AM 0.23 0.00 0.23 0.00 20.73 08:41:01 AM 0.18 0.00 0.18 0.00 14.70 08:42:01 AM 0.27 0.00 0.27 0.00 18.00 08:43:01 AM 0.17 0.00 0.17 0.00 8.71 08:44:01 AM 0.35 0.00 0.35 0.00 20.10 08:45:01 AM 0.15 0.00 0.15 0.00 16.79 08:46:01 AM 0.12 0.00 0.12 0.00 1.32 08:47:01 AM 0.10 0.00 0.10 0.00 1.05 08:48:01 AM 0.18 0.00 0.18 0.00 5.07 08:49:01 AM 0.27 0.00 0.27 0.00 5.13 08:50:01 AM 0.13 0.00 0.13 0.00 4.13 08:51:01 AM 0.25 0.00 0.25 0.00 3.35 08:52:01 AM 0.20 0.00 0.20 0.00 5.75 08:53:01 AM 0.12 0.00 0.12 0.00 1.17 08:54:01 AM 0.30 0.00 0.30 0.00 8.80 08:55:01 AM 0.17 0.00 0.17 0.00 1.75 08:56:01 AM 0.22 0.00 0.22 0.00 5.15 08:57:01 AM 0.15 0.00 0.15 0.00 1.58 08:58:01 AM 0.13 0.00 0.13 0.00 4.53 08:59:01 AM 0.38 0.00 0.38 0.00 6.73 09:00:01 AM 0.18 0.00 0.18 0.00 16.14 09:01:01 AM 0.18 0.00 0.18 0.00 14.03 09:02:01 AM 0.23 0.00 0.23 0.00 15.06 09:03:01 AM 0.22 0.00 0.22 0.00 9.46 09:04:01 AM 0.35 0.00 0.35 0.00 19.23 09:05:01 AM 0.30 0.00 0.30 0.00 18.26 09:06:01 AM 0.20 0.00 0.20 0.00 22.81 09:07:01 AM 0.15 0.00 0.15 0.00 5.20 09:08:01 AM 0.40 0.00 0.40 0.00 6.68 09:09:01 AM 0.52 0.00 0.52 0.00 9.82 09:10:01 AM 0.42 0.00 0.42 0.00 7.05 09:11:01 AM 0.58 0.00 0.58 0.00 10.01 09:12:01 AM 0.40 0.00 0.40 0.00 18.94 09:13:01 AM 0.37 0.00 0.37 0.00 16.08 09:14:01 AM 0.33 0.00 0.33 0.00 15.31 09:15:01 AM 0.25 0.00 0.25 0.00 11.88 09:16:01 AM 0.20 0.00 0.20 0.00 15.88 09:17:01 AM 0.13 0.00 0.13 0.00 15.46 09:18:01 AM 0.12 0.00 0.12 0.00 7.90 09:19:01 AM 0.33 0.00 0.33 0.00 21.88 09:20:01 AM 0.38 0.00 0.38 0.00 21.03 09:21:01 AM 0.47 0.00 0.47 0.00 14.26 09:22:01 AM 0.37 0.00 0.37 0.00 18.55 09:23:01 AM 0.52 0.00 0.52 0.00 17.23 09:24:01 AM 0.62 0.00 0.62 0.00 19.45 09:25:01 AM 0.20 0.00 0.20 0.00 18.54 09:26:01 AM 0.22 0.00 0.22 0.00 17.81 09:27:01 AM 0.23 0.00 0.23 0.00 10.16 09:28:01 AM 0.22 0.00 0.22 0.00 18.81 09:29:01 AM 0.27 0.00 0.27 0.00 11.43 09:30:01 AM 0.17 0.00 0.17 0.00 16.13 09:31:01 AM 0.15 0.00 0.15 0.00 21.28 09:32:01 AM 0.17 0.00 0.17 0.00 4.40 09:33:01 AM 0.30 0.00 0.30 0.00 7.88 09:34:01 AM 0.28 0.00 0.28 0.00 7.55 09:35:01 AM 0.28 0.00 0.28 0.00 6.48 09:36:01 AM 0.20 0.00 0.20 0.00 6.95 09:37:01 AM 0.17 0.00 0.17 0.00 26.60 09:38:01 AM 0.28 0.00 0.28 0.00 18.93 09:39:01 AM 0.20 0.00 0.20 0.00 10.31 09:40:01 AM 1.03 0.00 1.03 0.00 32.19 09:41:01 AM 0.72 0.00 0.72 0.00 20.56 09:42:01 AM 0.23 0.00 0.23 0.00 11.75 09:43:01 AM 0.20 0.00 0.20 0.00 26.96 09:44:01 AM 0.17 0.00 0.17 0.00 3.40 09:45:01 AM 0.22 0.00 0.22 0.00 7.51 09:46:01 AM 0.25 0.00 0.25 0.00 4.70 09:47:01 AM 0.35 0.00 0.35 0.00 7.50 09:48:01 AM 0.47 0.00 0.47 0.00 7.51 09:49:01 AM 0.42 0.00 0.42 0.00 14.18 09:50:01 AM 0.23 0.00 0.23 0.00 31.52 09:51:01 AM 0.30 0.00 0.30 0.00 13.06 09:52:01 AM 0.20 0.00 0.20 0.00 15.73 09:53:01 AM 0.30 0.00 0.30 0.00 13.60 09:54:01 AM 0.32 0.00 0.32 0.00 18.65 09:55:01 AM 0.27 0.00 0.27 0.00 13.71 09:56:01 AM 0.38 0.00 0.38 0.00 23.78 09:57:01 AM 0.40 0.00 0.40 0.00 6.92 09:58:01 AM 0.40 0.00 0.40 0.00 6.81 09:59:01 AM 0.55 0.00 0.55 0.00 10.86 10:00:01 AM 0.42 0.00 0.42 0.00 6.91 10:01:01 AM 0.57 0.00 0.57 0.00 10.13 10:02:01 AM 0.27 0.00 0.27 0.00 13.63 10:03:01 AM 0.13 0.00 0.13 0.00 16.01 10:04:01 AM 0.30 0.00 0.30 0.00 12.90 10:05:01 AM 0.17 0.00 0.17 0.00 17.19 10:06:01 AM 0.15 0.00 0.15 0.00 9.75 10:07:01 AM 0.33 0.00 0.33 0.00 20.43 10:08:01 AM 0.57 0.00 0.57 0.00 16.73 10:09:01 AM 0.52 0.00 0.52 0.00 28.08 10:10:01 AM 0.42 0.00 0.42 0.00 7.18 10:11:01 AM 0.48 0.00 0.48 0.00 8.80 10:12:01 AM 0.37 0.00 0.37 0.00 5.77 10:13:01 AM 0.48 0.00 0.48 0.00 7.51 10:14:01 AM 0.65 0.00 0.65 0.00 12.06 10:15:01 AM 0.43 0.00 0.43 0.00 38.67 10:16:01 AM 12.75 0.25 12.50 35.06 643.99 10:17:01 AM 27.51 0.45 27.06 52.78 3529.12 Average: 1.54 0.12 1.43 10.72 148.92 06:04:01 AM kbmemfree kbavail kbmemused %memused kbbuffers kbcached kbcommit %commit kbactive kbinact kbdirty 06:05:01 AM 5304548 7058964 2577880 32.70 2688 1936492 697768 7.81 213576 2042604 174740 06:06:01 AM 5252100 7081212 2630328 33.37 2688 2006280 671336 7.52 229604 2054460 28252 06:07:01 AM 5230652 7067772 2651776 33.64 2688 2014408 666356 7.46 244172 2061440 3160 06:08:01 AM 5003088 7046244 2879340 36.53 2688 2212640 668764 7.49 266536 2234688 15956 06:09:01 AM 5006296 7049288 2876132 36.49 2688 2212648 668764 7.49 266544 2234704 4 06:10:01 AM 4962584 7006528 2919844 37.04 2688 2213608 756548 8.47 266728 2278156 36 06:11:01 AM 4961344 7005652 2921084 37.06 2688 2213960 756548 8.47 266728 2279352 52 06:12:01 AM 4959636 7004296 2922792 37.08 2688 2214320 756548 8.47 266728 2281336 188 06:13:01 AM 4957804 7002808 2924624 37.10 2688 2214664 756548 8.47 266728 2283184 80 06:14:01 AM 4955132 7000860 2927296 37.14 2688 2215388 756548 8.47 266924 2285628 544 06:15:01 AM 4950776 6997204 2931652 37.19 2688 2216080 756548 8.47 266992 2289896 632 06:16:01 AM 4951172 6997632 2931256 37.19 2688 2216112 756548 8.47 266992 2289608 4 06:17:01 AM 4952632 6999124 2929796 37.17 2688 2216136 756548 8.47 267428 2288000 16 06:18:01 AM 4952544 6999064 2929884 37.17 2688 2216164 745500 8.35 267428 2288028 24 06:19:01 AM 4953476 7000020 2928952 37.16 2688 2216196 745500 8.35 267504 2286916 4 06:20:01 AM 4953204 6999868 2929224 37.16 2688 2216308 744396 8.33 267504 2287104 16 06:21:01 AM 4952220 7000064 2930208 37.17 2688 2217488 744396 8.33 267520 2288172 4 06:22:01 AM 4952248 7000216 2930180 37.17 2688 2217612 744396 8.33 267520 2288300 8 06:23:01 AM 4951956 6999984 2930472 37.18 2688 2217672 744396 8.33 267520 2288420 4 06:24:01 AM 4949456 6997908 2932972 37.21 2688 2218096 765584 8.57 267520 2291212 80 06:25:01 AM 4948904 6997704 2933524 37.22 2688 2218444 765584 8.57 267520 2291512 208 06:26:01 AM 4948932 6998072 2933496 37.22 2688 2218792 765584 8.57 267520 2291784 172 06:27:01 AM 4948456 6997952 2933972 37.22 2688 2219148 765584 8.57 267520 2292076 124 06:28:01 AM 4947968 6997832 2934460 37.23 2688 2219508 765584 8.57 267520 2292560 96 06:29:01 AM 4947664 6997876 2934764 37.23 2688 2219864 765584 8.57 267520 2292984 32 06:30:01 AM 4946304 6997152 2936124 37.25 2688 2220492 753744 8.44 267520 2294200 396 06:31:01 AM 4945928 6997008 2936500 37.25 2688 2220724 753744 8.44 267520 2294700 64 06:32:01 AM 4945636 6996992 2936792 37.26 2688 2221016 753744 8.44 267520 2295088 168 06:33:01 AM 4945036 6996684 2937392 37.27 2688 2221308 753744 8.44 267520 2295348 64 06:34:01 AM 4945080 6997020 2937348 37.26 2688 2221600 753744 8.44 267520 2295520 156 06:35:01 AM 4944896 6997132 2937532 37.27 2688 2221896 753744 8.44 267520 2295756 88 06:36:01 AM 4944192 6996976 2938236 37.28 2688 2222444 753744 8.44 267728 2296124 364 06:37:01 AM 4944020 6996828 2938408 37.28 2688 2222452 753744 8.44 267732 2296260 16 06:38:01 AM 4944160 6997020 2938268 37.28 2688 2222504 753744 8.44 267732 2296196 56 06:39:01 AM 4943272 6996488 2939156 37.29 2688 2222860 769120 8.61 267732 2296880 40 06:40:01 AM 4943056 6996624 2939372 37.29 2688 2223212 753052 8.43 267732 2297336 32 06:41:01 AM 4942836 6996764 2939592 37.29 2688 2223572 753052 8.43 267732 2297444 24 06:42:01 AM 4942428 6996708 2940000 37.30 2688 2223924 753052 8.43 267732 2297876 108 06:43:01 AM 4942104 6996740 2940324 37.30 2688 2224280 753052 8.43 267732 2298232 184 06:44:01 AM 4941396 6996392 2941032 37.31 2688 2224640 753052 8.43 267732 2298780 152 06:45:01 AM 4941312 6996492 2941116 37.31 2688 2224824 753052 8.43 267732 2298780 8 06:46:01 AM 4941456 6996648 2940972 37.31 2688 2224836 753052 8.43 267732 2298792 16 06:47:01 AM 4940800 6996428 2941628 37.32 2688 2225280 769768 8.62 267732 2299432 92 06:48:01 AM 4940640 6996620 2941788 37.32 2688 2225624 753128 8.43 267732 2299592 168 06:49:01 AM 4940208 6996544 2942220 37.33 2688 2225980 753128 8.43 267732 2300004 96 06:50:01 AM 4939456 6996140 2942972 37.34 2688 2226336 768604 8.61 267732 2300400 68 06:51:01 AM 4939504 6996552 2942924 37.34 2688 2226700 768604 8.61 267732 2300648 208 06:52:01 AM 4939252 6996660 2943176 37.34 2688 2227052 768604 8.61 267732 2301088 24 06:53:01 AM 4938620 6996632 2943808 37.35 2688 2227656 768604 8.61 267732 2301796 40 06:54:01 AM 4938052 6996148 2944376 37.35 2688 2227748 768604 8.61 267732 2302148 32 06:55:01 AM 4937780 6995968 2944648 37.36 2688 2227840 768604 8.61 267732 2302560 64 06:56:01 AM 4937620 6995900 2944808 37.36 2688 2227932 768604 8.61 267732 2302700 24 06:57:01 AM 4937700 6996076 2944728 37.36 2688 2228028 768604 8.61 267732 2302660 56 06:58:01 AM 4936296 6994760 2946132 37.38 2688 2228116 744984 8.34 267732 2304028 20 06:59:01 AM 4741024 6991460 3141404 39.85 2688 2419812 764844 8.56 381344 2383036 15476 07:00:01 AM 4740388 6991180 3142040 39.86 2688 2420168 763004 8.54 381344 2383440 124 07:01:01 AM 4739592 6990744 3142836 39.87 2688 2420524 763004 8.54 381344 2384144 152 07:02:01 AM 4739612 6991188 3142816 39.87 2688 2420956 763004 8.54 381416 2384300 24 07:03:01 AM 4738872 6990800 3143556 39.88 2688 2421300 763004 8.54 381416 2384956 152 07:04:01 AM 4738504 6990780 3143924 39.89 2688 2421648 763004 8.54 381416 2385256 24 07:05:01 AM 4738388 6991148 3144040 39.89 2688 2422132 763004 8.54 381468 2385492 40 07:06:01 AM 4738128 6991228 3144300 39.89 2688 2422488 763004 8.54 381468 2385844 52 07:07:01 AM 4737636 6991096 3144792 39.90 2688 2422840 763004 8.54 381468 2386204 32 07:08:02 AM 4737260 6991084 3145168 39.90 2688 2423204 763004 8.54 381468 2386568 32 07:09:01 AM 4736788 6990944 3145640 39.91 2688 2423544 763004 8.54 381468 2387092 188 07:10:01 AM 4735976 6990492 3146452 39.92 2688 2423904 785472 8.79 381468 2387616 132 07:11:01 AM 4736256 6991140 3146172 39.91 2688 2424260 785472 8.79 381468 2387808 48 07:12:01 AM 4735200 6990704 3147228 39.93 2688 2424888 764464 8.56 381468 2388356 208 07:13:01 AM 4734092 6989948 3148336 39.94 2688 2425232 764464 8.56 381468 2389644 132 07:14:01 AM 4733628 6989836 3148800 39.95 2688 2425584 764464 8.56 381468 2390220 56 07:15:01 AM 4733444 6990004 3148984 39.95 2688 2425944 764464 8.56 381468 2390432 28 07:16:01 AM 4732952 6989868 3149476 39.96 2688 2426296 764464 8.56 381468 2390844 4 07:17:01 AM 4732660 6989936 3149768 39.96 2688 2426656 764464 8.56 381468 2391224 152 07:18:01 AM 4732136 6989964 3150292 39.97 2688 2427208 764464 8.56 381468 2391776 40 07:19:01 AM 4731772 6989692 3150656 39.97 2688 2427300 764464 8.56 381468 2392040 12 07:20:01 AM 4731112 6989124 3151316 39.98 2688 2427392 767352 8.59 381468 2392356 40 07:21:01 AM 4731680 6989792 3150748 39.97 2688 2427484 747880 8.37 381468 2392104 4 07:22:01 AM 4731400 6989600 3151028 39.98 2688 2427580 747880 8.37 381468 2392308 40 07:23:01 AM 4731380 6989672 3151048 39.98 2688 2427672 747880 8.37 381468 2392284 4 07:24:01 AM 4731320 6990160 3151108 39.98 2688 2428212 768296 8.60 381468 2392628 168 07:25:01 AM 4730940 6990132 3151488 39.98 2688 2428572 768296 8.60 381468 2392912 156 07:26:01 AM 4730308 6989860 3152120 39.99 2688 2428932 768296 8.60 381468 2393388 56 07:27:01 AM 4730428 6990340 3152000 39.99 2688 2429284 768296 8.60 381468 2393632 192 07:28:01 AM 4729736 6990008 3152692 40.00 2688 2429644 768296 8.60 381468 2394112 64 07:29:01 AM 4729128 6989948 3153300 40.00 2688 2430200 768296 8.60 381568 2394644 212 07:30:01 AM 4730328 6991704 3152100 39.99 2688 2430756 748632 8.38 381568 2393084 340 07:31:01 AM 4730284 6992028 3152144 39.99 2688 2431116 748632 8.38 381568 2393360 64 07:32:01 AM 4729800 6991892 3152628 40.00 2688 2431472 748632 8.38 381568 2393868 40 07:33:01 AM 4729092 6991536 3153336 40.00 2688 2431820 748632 8.38 381568 2394436 4 07:34:01 AM 4729068 6991872 3153360 40.00 2688 2432172 748632 8.38 381568 2394596 4 07:35:01 AM 4728520 6991680 3153908 40.01 2688 2432528 748632 8.38 381568 2395032 176 07:36:01 AM 4727760 6991544 3154668 40.02 2688 2433156 748632 8.38 381568 2395672 296 07:37:01 AM 4727944 6991916 3154484 40.02 2688 2433352 748632 8.38 381568 2395732 8 07:38:01 AM 4727952 6992016 3154476 40.02 2688 2433444 748632 8.38 381568 2395824 4 07:39:01 AM 4727788 6991956 3154640 40.02 2688 2433540 748632 8.38 381568 2396112 4 07:40:01 AM 4727592 6991848 3154836 40.02 2688 2433628 748632 8.38 381568 2396132 4 07:41:01 AM 4727440 6991792 3154988 40.03 2688 2433724 748632 8.38 381568 2396112 4 07:42:01 AM 4727316 6991760 3155112 40.03 2688 2433816 748632 8.38 381568 2396204 4 07:43:01 AM 4726984 6991736 3155444 40.03 2688 2434124 748632 8.38 381568 2396612 4 07:44:01 AM 4726864 6991620 3155564 40.03 2688 2434128 748632 8.38 381576 2396680 4 07:45:01 AM 4726956 6991840 3155472 40.03 2688 2434256 748632 8.38 381572 2396644 4 07:46:01 AM 4727068 6991952 3155360 40.03 2688 2434256 748632 8.38 381572 2396648 4 07:47:01 AM 4726520 6991492 3155908 40.04 2688 2434344 748632 8.38 381572 2397184 4 07:48:01 AM 4727028 6992000 3155400 40.03 2688 2434344 748632 8.38 381572 2396776 4 07:49:01 AM 4726932 6991992 3155496 40.03 2688 2434432 748632 8.38 381600 2396868 4 07:50:01 AM 4726420 6991480 3156008 40.04 2688 2434432 748664 8.38 381600 2396952 4 07:51:01 AM 4726660 6991816 3155768 40.04 2688 2434524 748664 8.38 381600 2396928 96 07:52:01 AM 4726660 6991816 3155768 40.04 2688 2434524 748664 8.38 381600 2397044 4 07:53:01 AM 4726580 6991828 3155848 40.04 2688 2434616 748664 8.38 381600 2397020 96 07:54:01 AM 4726520 6991768 3155908 40.04 2688 2434616 748664 8.38 381600 2397088 12 07:55:01 AM 4726360 6991720 3156068 40.04 2688 2434728 748664 8.38 381600 2397132 124 07:56:01 AM 4726356 6991724 3156072 40.04 2688 2434736 748664 8.38 381600 2397140 4 07:57:01 AM 4724276 6989852 3158152 40.07 2688 2434944 765964 8.58 381608 2399404 216 07:58:01 AM 4723780 6989704 3158648 40.07 2688 2435300 765964 8.58 381608 2400084 24 07:59:01 AM 4722764 6989056 3159664 40.08 2688 2435656 765964 8.58 381608 2400784 168 08:00:01 AM 4722144 6988796 3160284 40.09 2688 2436016 769616 8.62 381608 2401288 140 08:01:01 AM 4720840 6987836 3161588 40.11 2688 2436368 769616 8.62 381608 2402280 64 08:02:01 AM 4721412 6988776 3161016 40.10 2688 2436728 769616 8.62 381628 2402096 208 08:03:01 AM 4721104 6988800 3161324 40.11 2688 2437056 769616 8.62 381628 2402304 4 08:04:01 AM 4720904 6988720 3161524 40.11 2688 2437176 769616 8.62 381628 2402596 4 08:05:01 AM 4720932 6988748 3161496 40.11 2688 2437176 769616 8.62 381628 2402548 8 08:06:01 AM 4720908 6988820 3161520 40.11 2688 2437272 769616 8.62 381628 2402644 4 08:07:01 AM 4721092 6989008 3161336 40.11 2688 2437276 769616 8.62 381628 2402532 4 08:08:01 AM 4720720 6988728 3161708 40.11 2688 2437368 769616 8.62 381628 2402740 4 08:09:01 AM 4721360 6989368 3161068 40.10 2688 2437368 769616 8.62 381628 2402408 4 08:10:01 AM 4720876 6988980 3161552 40.11 2688 2437464 773676 8.66 381628 2402552 4 08:11:01 AM 4721228 6989340 3161200 40.10 2688 2437464 773676 8.66 381628 2402444 4 08:12:01 AM 4721180 6989388 3161248 40.11 2688 2437560 773676 8.66 381628 2402604 4 08:13:02 AM 4720996 6989204 3161432 40.11 2688 2437560 773676 8.66 381628 2402684 4 08:14:01 AM 4720400 6988700 3162028 40.11 2688 2437652 773676 8.66 381628 2403356 12 08:15:01 AM 4720336 6988640 3162092 40.12 2688 2437656 773676 8.66 381628 2403312 8 08:16:01 AM 4719760 6988156 3162668 40.12 2688 2437748 773676 8.66 381628 2404012 100 08:17:01 AM 4719556 6987952 3162872 40.13 2688 2437748 773676 8.66 381628 2404136 8 08:18:01 AM 4719108 6987712 3163320 40.13 2688 2437964 773676 8.66 381628 2404696 220 08:19:01 AM 4718552 6987516 3163876 40.14 2688 2438316 773676 8.66 381628 2405144 128 08:20:01 AM 4717804 6987116 3164624 40.15 2688 2438672 789052 8.83 381628 2405536 52 08:21:01 AM 4718164 6987804 3164264 40.14 2688 2439020 769572 8.62 381628 2405656 32 08:22:01 AM 4717896 6987900 3164532 40.15 2688 2439372 769572 8.62 381628 2406132 16 08:23:01 AM 4717032 6987388 3165396 40.16 2688 2439732 769572 8.62 381628 2406600 4 08:24:01 AM 4716852 6987680 3165576 40.16 2688 2440196 769572 8.62 381628 2406920 4 08:25:01 AM 4716928 6987756 3165500 40.16 2688 2440196 769572 8.62 381628 2406852 4 08:26:01 AM 4716628 6987548 3165800 40.16 2688 2440288 769572 8.62 381628 2407052 100 08:27:01 AM 4716584 6987508 3165844 40.16 2688 2440292 769572 8.62 381628 2407180 4 08:28:01 AM 4716752 6987676 3165676 40.16 2688 2440292 769572 8.62 381628 2406976 4 08:29:01 AM 4716336 6987352 3166092 40.17 2688 2440384 769572 8.62 381628 2407268 12 08:30:01 AM 4716212 6987232 3166216 40.17 2688 2440388 767464 8.59 381628 2407340 12 08:31:01 AM 4716148 6987260 3166280 40.17 2688 2440480 767464 8.59 381628 2407468 4 08:32:01 AM 4716472 6987592 3165956 40.16 2688 2440488 765900 8.58 390844 2398136 256 08:33:01 AM 4716148 6987364 3166280 40.17 2688 2440584 765900 8.58 390844 2398300 8 08:34:01 AM 4716332 6987548 3166096 40.17 2688 2440584 765900 8.58 390844 2398164 12 08:35:01 AM 4716296 6987608 3166132 40.17 2688 2440680 765900 8.58 390844 2398224 8 08:36:01 AM 4716388 6987700 3166040 40.17 2688 2440680 765900 8.58 390844 2398224 4 08:37:01 AM 4715868 6987272 3166560 40.17 2688 2440772 765900 8.58 390844 2398748 4 08:38:01 AM 4715828 6987236 3166600 40.17 2688 2440776 765900 8.58 390844 2398752 4 08:39:01 AM 4715528 6987228 3166900 40.18 2688 2441068 765900 8.58 390844 2399104 312 08:40:01 AM 4714832 6986884 3167596 40.19 2688 2441428 781448 8.75 390844 2399504 156 08:41:01 AM 4714852 6987264 3167576 40.19 2688 2441788 765716 8.57 390844 2399752 112 08:42:01 AM 4714260 6987032 3168168 40.19 2688 2442140 765716 8.57 390844 2400112 32 08:43:01 AM 4714004 6987132 3168424 40.20 2688 2442504 765716 8.57 390844 2400472 184 08:44:01 AM 4713348 6986832 3169080 40.20 2688 2442852 765716 8.57 390844 2401012 112 08:45:01 AM 4713268 6987120 3169160 40.21 2688 2443220 765716 8.57 390844 2401208 4 08:46:01 AM 4713204 6987060 3169224 40.21 2688 2443224 765716 8.57 390844 2401328 4 08:47:01 AM 4712848 6986796 3169580 40.21 2688 2443316 765716 8.57 390844 2401604 100 08:48:01 AM 4713020 6986968 3169408 40.21 2688 2443316 765716 8.57 390844 2401420 4 08:49:01 AM 4713064 6987108 3169364 40.21 2688 2443412 765716 8.57 390844 2401468 100 08:50:01 AM 4712644 6986688 3169784 40.21 2688 2443412 759240 8.50 390844 2401632 4 08:51:01 AM 4712876 6987024 3169552 40.21 2688 2443512 759240 8.50 390844 2401504 100 08:52:01 AM 4712920 6987068 3169508 40.21 2688 2443512 759240 8.50 390844 2401504 4 08:53:01 AM 4712864 6987104 3169564 40.21 2688 2443604 759240 8.50 390844 2401608 100 08:54:01 AM 4712820 6987064 3169608 40.21 2688 2443608 759240 8.50 390844 2401680 12 08:55:01 AM 4712876 6987120 3169552 40.21 2688 2443608 759240 8.50 390844 2401612 8 08:56:01 AM 4712876 6987212 3169552 40.21 2688 2443700 759240 8.50 390844 2401704 4 08:57:01 AM 4712608 6986948 3169820 40.21 2688 2443704 774644 8.67 390844 2401844 12 08:58:01 AM 4712428 6986860 3170000 40.22 2688 2443796 774644 8.67 390844 2402124 4 08:59:01 AM 4712576 6987008 3169852 40.21 2688 2443796 774644 8.67 390844 2401940 12 09:00:01 AM 4713160 6988084 3169268 40.21 2688 2444300 760296 8.51 390844 2401120 96 09:01:01 AM 4712828 6988112 3169600 40.21 2688 2444648 760296 8.51 390844 2401624 64 09:02:01 AM 4713104 6988740 3169324 40.21 2688 2445008 760296 8.51 390848 2401392 48 09:03:01 AM 4712772 6988772 3169656 40.21 2688 2445372 760296 8.51 390848 2401756 200 09:04:01 AM 4712384 6988740 3170044 40.22 2688 2445720 760296 8.51 390848 2402188 160 09:05:01 AM 4712068 6988768 3170360 40.22 2688 2446064 760296 8.51 390848 2402464 48 09:06:01 AM 4711500 6988808 3170928 40.23 2688 2446672 760296 8.51 390848 2403076 40 09:07:01 AM 4711396 6988796 3171032 40.23 2688 2446764 760296 8.51 390848 2403168 4 09:08:01 AM 4711160 6988648 3171268 40.23 2688 2446852 760296 8.51 390848 2403256 4 09:09:01 AM 4711024 6988600 3171404 40.23 2688 2446948 760296 8.51 390848 2403540 4 09:10:01 AM 4710792 6988468 3171636 40.24 2688 2447040 760248 8.51 390848 2403572 4 09:11:01 AM 4710808 6988576 3171620 40.24 2688 2447136 760248 8.51 390848 2403684 4 09:12:01 AM 4709984 6988248 3172444 40.25 2688 2447632 760248 8.51 390848 2404280 64 09:13:01 AM 4708528 6987168 3173900 40.27 2688 2447996 760248 8.51 390848 2405836 56 09:14:01 AM 4708440 6987436 3173988 40.27 2688 2448352 760248 8.51 390848 2405856 112 09:15:01 AM 4708392 6987736 3174036 40.27 2688 2448708 760248 8.51 390848 2406144 192 09:16:01 AM 4707956 6987652 3174472 40.27 2688 2449052 760248 8.51 390848 2406508 112 09:17:01 AM 4707560 6987632 3174868 40.28 2688 2449424 760248 8.51 390848 2406872 48 09:18:01 AM 4706864 6987388 3175564 40.29 2688 2449876 760248 8.51 390848 2407436 288 09:19:01 AM 4706384 6987260 3176044 40.29 2688 2450236 760248 8.51 390848 2407856 160 09:20:01 AM 4705952 6987188 3176476 40.30 2688 2450588 768472 8.60 390848 2408148 16 09:21:01 AM 4706044 6987640 3176384 40.30 2688 2450948 768472 8.60 390848 2408392 104 09:22:01 AM 4705424 6987380 3177004 40.30 2688 2451308 768472 8.60 390848 2409008 40 09:23:01 AM 4705292 6987600 3177136 40.31 2688 2451660 768472 8.60 390848 2409108 20 09:24:01 AM 4704808 6987596 3177620 40.31 2688 2452140 751212 8.41 390848 2409780 144 09:25:01 AM 4704268 6987552 3178160 40.32 2688 2452636 751212 8.41 390848 2410104 156 09:26:01 AM 4703932 6987564 3178496 40.32 2688 2452992 751212 8.41 390848 2410572 24 09:27:01 AM 4703516 6987508 3178912 40.33 2688 2453352 751212 8.41 390848 2410808 168 09:28:01 AM 4703364 6987720 3179064 40.33 2688 2453708 751212 8.41 390848 2411172 32 09:29:01 AM 4702720 6987432 3179708 40.34 2688 2454064 751212 8.41 390848 2411596 184 09:30:01 AM 4702104 6987172 3180324 40.35 2688 2454416 771824 8.64 390848 2412116 88 09:31:01 AM 4702012 6987620 3180416 40.35 2688 2454956 750524 8.40 390848 2412420 24 09:32:01 AM 4701820 6987520 3180608 40.35 2688 2455048 750524 8.40 390848 2412656 68 09:33:01 AM 4701780 6987572 3180648 40.35 2688 2455140 750524 8.40 390848 2412816 36 09:34:01 AM 4701652 6987536 3180776 40.35 2688 2455232 766032 8.58 390848 2412888 4 09:35:01 AM 4701448 6987424 3180980 40.36 2688 2455324 766032 8.58 390848 2412796 40 09:36:01 AM 4701156 6987228 3181272 40.36 2688 2455420 766032 8.58 390848 2413160 4 09:37:01 AM 4700680 6987652 3181748 40.37 2688 2456320 766032 8.58 390848 2413880 144 09:38:01 AM 4700124 6987448 3182304 40.37 2688 2456680 766032 8.58 390848 2414232 48 09:39:01 AM 4697660 6985348 3184768 40.40 2688 2457040 768520 8.61 390848 2416748 176 09:40:01 AM 4699292 6987344 3183136 40.38 2688 2457392 780316 8.74 391520 2414376 32 09:41:01 AM 4698924 6987328 3183504 40.39 2688 2457752 780316 8.74 391520 2414728 24 09:42:01 AM 4698652 6987420 3183776 40.39 2688 2458116 780316 8.74 391520 2415092 112 09:43:01 AM 4698112 6987544 3184316 40.40 2688 2458772 780316 8.74 391520 2415640 24 09:44:01 AM 4697924 6987440 3184504 40.40 2688 2458864 780316 8.74 391520 2415792 56 09:45:01 AM 4697868 6987476 3184560 40.40 2688 2458956 780316 8.74 391520 2415816 20 09:46:01 AM 4697824 6987524 3184604 40.40 2688 2459048 764560 8.56 391520 2415908 52 09:47:01 AM 4697212 6987004 3185216 40.41 2688 2459140 764560 8.56 391520 2416416 24 09:48:01 AM 4697512 6987400 3184916 40.41 2688 2459236 764560 8.56 391520 2416220 24 09:49:01 AM 4696584 6987256 3185844 40.42 2688 2460012 764560 8.56 391540 2417072 508 09:50:01 AM 4695812 6986864 3186616 40.43 2688 2460392 784108 8.78 391540 2417612 40 09:51:01 AM 4696232 6987652 3186196 40.42 2688 2460748 764636 8.56 391540 2417620 120 09:52:01 AM 4695668 6987428 3186760 40.43 2688 2461088 764636 8.56 391540 2418076 32 09:53:01 AM 4695256 6987388 3187172 40.43 2688 2461468 764636 8.56 391540 2418440 112 09:54:01 AM 4694860 6987352 3187568 40.44 2688 2461820 764636 8.56 391540 2418756 72 09:55:01 AM 4694664 6987504 3187764 40.44 2688 2462168 764636 8.56 391540 2419040 88 09:56:01 AM 4693980 6987340 3188448 40.45 2688 2462688 764636 8.56 391540 2419632 4 09:57:01 AM 4693900 6987352 3188528 40.45 2688 2462780 764636 8.56 391540 2419644 4 09:58:01 AM 4694080 6987624 3188348 40.45 2688 2462872 764636 8.56 391540 2419716 4 09:59:01 AM 4693772 6987404 3188656 40.45 2688 2462968 764636 8.56 391540 2419892 4 10:00:01 AM 4693816 6987540 3188612 40.45 2688 2463056 764636 8.56 391540 2419924 4 10:01:01 AM 4692680 6986508 3189748 40.47 2688 2463152 764636 8.56 391540 2420792 4 10:02:01 AM 4693384 6987536 3189044 40.46 2688 2463480 749064 8.39 391556 2420364 4 10:03:01 AM 4692820 6987456 3189608 40.46 2688 2463964 768268 8.60 391556 2420940 48 10:04:01 AM 4692408 6987408 3190020 40.47 2688 2464324 768268 8.60 391556 2421352 192 10:05:01 AM 4691980 6987332 3190448 40.48 2688 2464676 768268 8.60 391556 2421556 64 10:06:01 AM 4691728 6987440 3190700 40.48 2688 2465036 768268 8.60 391556 2421916 176 10:07:01 AM 4691244 6987308 3191184 40.48 2688 2465396 768268 8.60 391556 2422268 24 10:08:01 AM 4691020 6987444 3191408 40.49 2688 2465748 768268 8.60 391556 2422744 40 10:09:01 AM 4690308 6987344 3192120 40.50 2688 2466368 768268 8.60 391556 2423308 24 10:10:01 AM 4690012 6987144 3192416 40.50 2688 2466460 771856 8.64 391556 2423452 20 10:11:01 AM 4690076 6987296 3192352 40.50 2688 2466552 771856 8.64 391556 2423544 4 10:12:01 AM 4690136 6987460 3192292 40.50 2688 2466648 771856 8.64 391556 2423532 24 10:13:01 AM 4689984 6987392 3192444 40.50 2688 2466740 771856 8.64 391556 2423616 24 10:14:01 AM 4689776 6987284 3192652 40.50 2688 2466832 771856 8.64 391556 2423816 24 10:15:01 AM 4681820 6980688 3200608 40.60 2688 2468184 892540 9.99 391556 2430428 348 10:16:01 AM 4739720 6945876 3142708 39.87 2688 2381032 717544 8.03 473044 2311708 89708 10:17:01 AM 4700976 6912408 3181452 40.36 2688 2386596 760272 8.51 631236 2196124 16124 Average: 4768561 6991400 3113867 39.50 2688 2392415 760938 8.52 362018 2375831 1428 06:04:01 AM IFACE rxpck/s txpck/s rxkB/s txkB/s rxcmp/s txcmp/s rxmcst/s %ifutil 06:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 06:05:01 AM eth0 78.07 67.42 922.56 8.45 0.00 0.00 0.00 0.00 06:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 06:06:01 AM eth0 32.75 25.41 274.21 5.53 0.00 0.00 0.00 0.00 06:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 06:07:01 AM eth0 24.08 15.70 6.81 4.78 0.00 0.00 0.00 0.00 06:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 06:08:01 AM eth0 701.17 519.16 408.48 113.16 0.00 0.00 0.00 0.00 06:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 06:09:01 AM eth0 31.21 23.54 12.92 5.44 0.00 0.00 0.00 0.00 06:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 06:10:01 AM eth0 41.32 31.44 15.74 5.03 0.00 0.00 0.00 0.00 06:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 06:11:01 AM eth0 9.70 9.48 2.00 1.79 0.00 0.00 0.00 0.00 06:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 06:12:01 AM eth0 9.65 9.58 2.01 1.76 0.00 0.00 0.00 0.00 06:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 06:13:01 AM eth0 9.90 9.45 1.98 1.78 0.00 0.00 0.00 0.00 06:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 06:14:01 AM eth0 20.31 17.21 4.35 3.28 0.00 0.00 0.00 0.00 06:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 06:15:01 AM eth0 3.32 2.83 6.76 0.75 0.00 0.00 0.00 0.00 06:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 06:16:01 AM eth0 0.40 0.07 0.02 0.00 0.00 0.00 0.00 0.00 06:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 06:17:01 AM eth0 6.61 0.10 0.86 0.01 0.00 0.00 0.00 0.00 06:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 06:18:01 AM eth0 0.60 0.07 0.03 0.00 0.00 0.00 0.00 0.00 06:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 06:19:01 AM eth0 0.87 0.18 0.22 0.07 0.00 0.00 0.00 0.00 06:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 06:20:01 AM eth0 2.52 2.13 0.46 0.43 0.00 0.00 0.00 0.00 06:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 06:21:01 AM eth0 39.50 39.64 7.53 2.91 0.00 0.00 0.00 0.00 06:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 06:22:01 AM eth0 2.95 2.70 0.83 0.21 0.00 0.00 0.00 0.00 06:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 06:23:01 AM eth0 3.90 3.18 0.75 0.25 0.00 0.00 0.00 0.00 06:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 06:24:01 AM eth0 17.61 15.11 3.82 2.42 0.00 0.00 0.00 0.00 06:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 06:25:01 AM eth0 9.91 9.91 2.28 2.00 0.00 0.00 0.00 0.00 06:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 06:26:01 AM eth0 9.98 9.92 2.07 1.82 0.00 0.00 0.00 0.00 06:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 06:27:01 AM eth0 16.70 9.63 3.01 1.81 0.00 0.00 0.00 0.00 06:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 06:28:01 AM eth0 10.26 9.58 2.05 1.79 0.00 0.00 0.00 0.00 06:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 06:29:01 AM eth0 10.25 9.78 2.20 1.83 0.00 0.00 0.00 0.00 06:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 06:30:01 AM eth0 16.68 15.84 3.73 2.98 0.00 0.00 0.00 0.00 06:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 06:31:01 AM eth0 1.55 0.87 0.48 0.29 0.00 0.00 0.00 0.00 06:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 06:32:01 AM eth0 1.85 0.77 0.36 0.17 0.00 0.00 0.00 0.00 06:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 06:33:01 AM eth0 1.23 0.82 0.44 0.30 0.00 0.00 0.00 0.00 06:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 06:34:01 AM eth0 1.03 0.68 0.27 0.16 0.00 0.00 0.00 0.00 06:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 06:35:01 AM eth0 1.00 0.63 0.22 0.10 0.00 0.00 0.00 0.00 06:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 06:36:01 AM eth0 10.45 10.35 2.11 1.14 0.00 0.00 0.00 0.00 06:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 06:37:01 AM eth0 0.32 0.00 0.02 0.00 0.00 0.00 0.00 0.00 06:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 06:38:01 AM eth0 2.00 1.40 0.37 0.24 0.00 0.00 0.00 0.00 06:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 06:39:01 AM eth0 11.50 10.70 2.86 2.26 0.00 0.00 0.00 0.00 06:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 06:40:01 AM eth0 10.15 9.73 2.26 1.81 0.00 0.00 0.00 0.00 06:41:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 06:41:01 AM eth0 9.62 9.68 2.03 1.81 0.00 0.00 0.00 0.00 06:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 06:42:01 AM eth0 9.33 9.56 2.01 1.80 0.00 0.00 0.00 0.00 06:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 06:43:01 AM eth0 9.43 9.58 2.01 1.80 0.00 0.00 0.00 0.00 06:44:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 06:44:01 AM eth0 9.65 9.66 2.11 1.85 0.00 0.00 0.00 0.00 06:45:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 06:45:01 AM eth0 5.40 5.22 1.08 0.68 0.00 0.00 0.00 0.00 06:46:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 06:46:01 AM eth0 0.42 0.07 0.08 0.00 0.00 0.00 0.00 0.00 06:47:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 06:47:01 AM eth0 13.65 13.75 3.01 2.24 0.00 0.00 0.00 0.00 06:48:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 06:48:01 AM eth0 9.43 9.55 2.00 1.79 0.00 0.00 0.00 0.00 06:49:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 06:49:01 AM eth0 9.48 9.65 2.05 1.83 0.00 0.00 0.00 0.00 06:50:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 06:50:01 AM eth0 9.45 9.66 2.02 1.81 0.00 0.00 0.00 0.00 06:51:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 06:51:01 AM eth0 9.48 9.73 2.02 1.81 0.00 0.00 0.00 0.00 06:52:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 06:52:01 AM eth0 9.45 9.66 2.02 1.81 0.00 0.00 0.00 0.00 06:53:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 06:53:01 AM eth0 14.95 14.90 3.43 2.74 0.00 0.00 0.00 0.00 06:54:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 06:54:01 AM eth0 0.65 0.32 0.21 0.11 0.00 0.00 0.00 0.00 06:55:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 06:55:01 AM eth0 0.97 0.33 0.23 0.11 0.00 0.00 0.00 0.00 06:56:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 06:56:01 AM eth0 0.58 0.38 0.33 0.24 0.00 0.00 0.00 0.00 06:57:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 06:57:01 AM eth0 0.30 0.27 0.08 0.05 0.00 0.00 0.00 0.00 06:58:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 06:58:01 AM eth0 0.28 0.27 0.08 0.05 0.00 0.00 0.00 0.00 06:59:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 06:59:01 AM eth0 156.32 116.81 1375.97 8.81 0.00 0.00 0.00 0.00 07:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:00:01 AM eth0 9.43 9.65 2.02 1.81 0.00 0.00 0.00 0.00 07:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:01:01 AM eth0 9.75 9.75 2.09 1.81 0.00 0.00 0.00 0.00 07:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:02:01 AM eth0 9.44 9.72 2.02 1.81 0.00 0.00 0.00 0.00 07:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:03:01 AM eth0 10.13 9.75 2.20 1.87 0.00 0.00 0.00 0.00 07:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:04:01 AM eth0 9.83 9.90 2.34 2.06 0.00 0.00 0.00 0.00 07:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:05:01 AM eth0 16.19 16.48 3.01 2.21 0.00 0.00 0.00 0.00 07:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:06:01 AM eth0 9.40 9.67 2.02 1.81 0.00 0.00 0.00 0.00 07:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:07:01 AM eth0 9.53 9.65 2.02 1.81 0.00 0.00 0.00 0.00 07:08:02 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:08:02 AM eth0 9.56 9.66 2.03 1.81 0.00 0.00 0.00 0.00 07:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:09:01 AM eth0 9.42 9.56 2.05 1.83 0.00 0.00 0.00 0.00 07:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:10:01 AM eth0 9.38 9.62 2.02 1.80 0.00 0.00 0.00 0.00 07:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:11:01 AM eth0 9.53 9.68 2.03 1.81 0.00 0.00 0.00 0.00 07:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:12:01 AM eth0 21.10 21.51 4.02 2.91 0.00 0.00 0.00 0.00 07:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:13:01 AM eth0 9.40 9.55 2.01 1.80 0.00 0.00 0.00 0.00 07:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:14:01 AM eth0 9.41 9.56 2.06 1.84 0.00 0.00 0.00 0.00 07:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:15:01 AM eth0 9.28 9.61 1.99 1.78 0.00 0.00 0.00 0.00 07:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:16:01 AM eth0 9.47 9.70 2.02 1.81 0.00 0.00 0.00 0.00 07:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:17:01 AM eth0 9.52 9.72 2.02 1.81 0.00 0.00 0.00 0.00 07:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:18:01 AM eth0 13.03 12.96 2.98 2.38 0.00 0.00 0.00 0.00 07:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:19:01 AM eth0 1.35 0.55 0.56 0.37 0.00 0.00 0.00 0.00 07:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:20:01 AM eth0 0.30 0.25 0.08 0.05 0.00 0.00 0.00 0.00 07:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:21:01 AM eth0 0.28 0.25 0.08 0.05 0.00 0.00 0.00 0.00 07:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:22:01 AM eth0 0.25 0.25 0.08 0.05 0.00 0.00 0.00 0.00 07:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:23:01 AM eth0 0.43 0.23 0.13 0.05 0.00 0.00 0.00 0.00 07:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:24:01 AM eth0 25.23 25.51 4.74 2.92 0.00 0.00 0.00 0.00 07:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:25:01 AM eth0 9.60 9.63 2.07 1.81 0.00 0.00 0.00 0.00 07:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:26:01 AM eth0 9.51 9.65 2.02 1.81 0.00 0.00 0.00 0.00 07:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:27:01 AM eth0 9.43 9.73 2.02 1.81 0.00 0.00 0.00 0.00 07:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:28:01 AM eth0 9.42 9.72 2.02 1.81 0.00 0.00 0.00 0.00 07:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:29:01 AM eth0 9.80 9.90 2.54 1.88 0.00 0.00 0.00 0.00 07:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:30:01 AM eth0 18.46 18.93 3.53 2.51 0.00 0.00 0.00 0.00 07:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:31:01 AM eth0 9.42 9.72 2.02 1.81 0.00 0.00 0.00 0.00 07:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:32:01 AM eth0 10.25 9.96 2.20 1.89 0.00 0.00 0.00 0.00 07:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:33:01 AM eth0 9.65 9.85 2.26 2.00 0.00 0.00 0.00 0.00 07:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:34:01 AM eth0 9.60 9.75 2.10 1.87 0.00 0.00 0.00 0.00 07:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:35:01 AM eth0 9.12 9.37 1.97 1.76 0.00 0.00 0.00 0.00 07:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:36:01 AM eth0 16.96 16.73 3.80 3.10 0.00 0.00 0.00 0.00 07:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:37:01 AM eth0 2.40 2.48 0.54 0.47 0.00 0.00 0.00 0.00 07:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:38:01 AM eth0 0.23 0.23 0.08 0.04 0.00 0.00 0.00 0.00 07:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:39:01 AM eth0 0.43 0.35 0.16 0.11 0.00 0.00 0.00 0.00 07:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:40:01 AM eth0 0.25 0.23 0.08 0.05 0.00 0.00 0.00 0.00 07:41:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:41:01 AM eth0 0.20 0.25 0.08 0.05 0.00 0.00 0.00 0.00 07:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:42:01 AM eth0 0.27 0.25 0.08 0.05 0.00 0.00 0.00 0.00 07:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:43:01 AM eth0 16.46 16.73 2.90 1.56 0.00 0.00 0.00 0.00 07:44:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:44:01 AM eth0 0.33 0.13 0.08 0.07 0.00 0.00 0.00 0.00 07:45:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:45:01 AM eth0 0.48 0.30 0.10 0.03 0.00 0.00 0.00 0.00 07:46:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:46:01 AM eth0 0.85 0.05 0.08 0.00 0.00 0.00 0.00 0.00 07:47:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:47:01 AM eth0 0.92 0.60 0.56 0.41 0.00 0.00 0.00 0.00 07:48:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:48:01 AM eth0 0.22 0.08 0.01 0.01 0.00 0.00 0.00 0.00 07:49:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:49:01 AM eth0 0.50 0.37 0.13 0.10 0.00 0.00 0.00 0.00 07:50:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:50:01 AM eth0 0.15 0.05 0.01 0.00 0.00 0.00 0.00 0.00 07:51:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:51:01 AM eth0 0.33 0.25 0.05 0.03 0.00 0.00 0.00 0.00 07:52:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:52:01 AM eth0 0.12 0.03 0.00 0.00 0.00 0.00 0.00 0.00 07:53:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:53:01 AM eth0 0.33 0.30 0.06 0.03 0.00 0.00 0.00 0.00 07:54:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:54:01 AM eth0 0.28 0.12 0.08 0.07 0.00 0.00 0.00 0.00 07:55:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:55:01 AM eth0 0.40 0.30 0.15 0.03 0.00 0.00 0.00 0.00 07:56:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:56:01 AM eth0 0.15 0.05 0.01 0.00 0.00 0.00 0.00 0.00 07:57:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:57:01 AM eth0 7.51 7.50 1.61 0.90 0.00 0.00 0.00 0.00 07:58:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:58:01 AM eth0 9.45 9.65 2.02 1.81 0.00 0.00 0.00 0.00 07:59:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 07:59:01 AM eth0 9.53 9.80 2.09 1.87 0.00 0.00 0.00 0.00 08:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 08:00:01 AM eth0 9.45 9.67 2.02 1.81 0.00 0.00 0.00 0.00 08:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 08:01:01 AM eth0 9.31 9.60 2.01 1.80 0.00 0.00 0.00 0.00 08:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 08:02:01 AM eth0 9.40 9.71 2.02 1.81 0.00 0.00 0.00 0.00 08:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 08:03:01 AM eth0 9.85 9.93 2.04 1.65 0.00 0.00 0.00 0.00 08:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 08:04:01 AM eth0 2.17 2.00 0.40 0.20 0.00 0.00 0.00 0.00 08:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 08:05:01 AM eth0 0.13 0.03 0.01 0.00 0.00 0.00 0.00 0.00 08:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 08:06:01 AM eth0 0.32 0.23 0.03 0.02 0.00 0.00 0.00 0.00 08:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 08:07:01 AM eth0 0.13 0.05 0.01 0.00 0.00 0.00 0.00 0.00 08:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 08:08:01 AM eth0 0.43 0.25 0.04 0.02 0.00 0.00 0.00 0.00 08:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 08:09:01 AM eth0 0.30 0.12 0.09 0.07 0.00 0.00 0.00 0.00 08:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 08:10:01 AM eth0 0.42 0.28 0.03 0.03 0.00 0.00 0.00 0.00 08:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 08:11:01 AM eth0 0.13 0.05 0.01 0.00 0.00 0.00 0.00 0.00 08:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 08:12:01 AM eth0 0.35 0.25 0.03 0.02 0.00 0.00 0.00 0.00 08:13:02 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 08:13:02 AM eth0 0.15 0.05 0.01 0.00 0.00 0.00 0.00 0.00 08:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 08:14:01 AM eth0 0.51 0.31 0.11 0.09 0.00 0.00 0.00 0.00 08:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 08:15:01 AM eth0 0.13 0.05 0.01 0.00 0.00 0.00 0.00 0.00 08:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 08:16:01 AM eth0 0.35 0.27 0.03 0.03 0.00 0.00 0.00 0.00 08:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 08:17:01 AM eth0 0.12 0.02 0.01 0.00 0.00 0.00 0.00 0.00 08:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 08:18:01 AM eth0 6.36 6.36 1.16 0.85 0.00 0.00 0.00 0.00 08:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 08:19:01 AM eth0 9.52 9.75 2.09 1.87 0.00 0.00 0.00 0.00 08:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 08:20:01 AM eth0 9.35 9.57 2.01 1.80 0.00 0.00 0.00 0.00 08:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 08:21:01 AM eth0 9.28 9.61 1.99 1.79 0.00 0.00 0.00 0.00 08:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 08:22:01 AM eth0 9.38 9.58 2.00 1.78 0.00 0.00 0.00 0.00 08:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 08:23:01 AM eth0 9.38 9.65 2.01 1.80 0.00 0.00 0.00 0.00 08:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 08:24:01 AM eth0 10.85 11.03 2.39 1.91 0.00 0.00 0.00 0.00 08:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 08:25:01 AM eth0 0.17 0.05 0.01 0.00 0.00 0.00 0.00 0.00 08:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 08:26:01 AM eth0 0.72 0.17 0.08 0.02 0.00 0.00 0.00 0.00 08:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 08:27:01 AM eth0 0.55 0.42 0.26 0.21 0.00 0.00 0.00 0.00 08:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 08:28:01 AM eth0 0.18 0.07 0.01 0.00 0.00 0.00 0.00 0.00 08:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 08:29:01 AM eth0 0.57 0.45 0.11 0.10 0.00 0.00 0.00 0.00 08:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 08:30:01 AM eth0 0.72 0.08 0.14 0.07 0.00 0.00 0.00 0.00 08:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 08:31:01 AM eth0 0.58 0.48 0.28 0.22 0.00 0.00 0.00 0.00 08:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 08:32:01 AM eth0 0.88 0.22 0.16 0.08 0.00 0.00 0.00 0.00 08:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 08:33:01 AM eth0 0.90 0.50 0.67 0.22 0.00 0.00 0.00 0.00 08:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 08:34:01 AM eth0 0.40 0.15 0.09 0.07 0.00 0.00 0.00 0.00 08:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 08:35:01 AM eth0 0.48 0.23 0.08 0.02 0.00 0.00 0.00 0.00 08:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 08:36:01 AM eth0 0.22 0.10 0.01 0.01 0.00 0.00 0.00 0.00 08:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 08:37:01 AM eth0 0.30 0.23 0.03 0.02 0.00 0.00 0.00 0.00 08:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 08:38:01 AM eth0 0.18 0.05 0.01 0.00 0.00 0.00 0.00 0.00 08:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 08:39:01 AM eth0 8.45 8.53 1.68 1.31 0.00 0.00 0.00 0.00 08:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 08:40:01 AM eth0 9.46 9.68 2.03 1.81 0.00 0.00 0.00 0.00 08:41:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 08:41:01 AM eth0 9.41 9.78 2.02 1.81 0.00 0.00 0.00 0.00 08:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 08:42:01 AM eth0 9.47 9.67 2.02 1.81 0.00 0.00 0.00 0.00 08:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 08:43:01 AM eth0 9.31 9.61 2.01 1.80 0.00 0.00 0.00 0.00 08:44:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 08:44:01 AM eth0 9.50 9.73 2.09 1.87 0.00 0.00 0.00 0.00 08:45:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 08:45:01 AM eth0 6.56 6.60 1.70 1.22 0.00 0.00 0.00 0.00 08:46:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 08:46:01 AM eth0 0.17 0.03 0.01 0.00 0.00 0.00 0.00 0.00 08:47:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 08:47:01 AM eth0 0.50 0.37 0.27 0.21 0.00 0.00 0.00 0.00 08:48:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 08:48:01 AM eth0 0.15 0.05 0.01 0.00 0.00 0.00 0.00 0.00 08:49:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 08:49:01 AM eth0 0.72 0.35 0.17 0.09 0.00 0.00 0.00 0.00 08:50:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 08:50:01 AM eth0 0.27 0.03 0.02 0.00 0.00 0.00 0.00 0.00 08:51:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 08:51:01 AM eth0 0.28 0.27 0.03 0.03 0.00 0.00 0.00 0.00 08:52:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 08:52:01 AM eth0 0.13 0.05 0.01 0.00 0.00 0.00 0.00 0.00 08:53:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 08:53:01 AM eth0 0.18 0.17 0.02 0.02 0.00 0.00 0.00 0.00 08:54:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 08:54:01 AM eth0 0.38 0.22 0.09 0.07 0.00 0.00 0.00 0.00 08:55:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 08:55:01 AM eth0 0.12 0.05 0.01 0.00 0.00 0.00 0.00 0.00 08:56:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 08:56:01 AM eth0 0.37 0.27 0.03 0.03 0.00 0.00 0.00 0.00 08:57:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 08:57:01 AM eth0 0.78 0.12 0.16 0.07 0.00 0.00 0.00 0.00 08:58:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 08:58:01 AM eth0 0.68 0.43 0.28 0.22 0.00 0.00 0.00 0.00 08:59:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 08:59:01 AM eth0 0.92 0.20 0.23 0.13 0.00 0.00 0.00 0.00 09:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:00:01 AM eth0 16.86 17.29 3.27 11.70 0.00 0.00 0.00 0.00 09:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:01:01 AM eth0 9.48 9.70 2.02 1.81 0.00 0.00 0.00 0.00 09:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:02:01 AM eth0 9.48 9.73 2.02 1.81 0.00 0.00 0.00 0.00 09:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:03:01 AM eth0 9.68 9.66 2.07 1.81 0.00 0.00 0.00 0.00 09:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:04:01 AM eth0 9.48 9.73 2.09 1.87 0.00 0.00 0.00 0.00 09:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:05:01 AM eth0 9.46 9.73 2.02 1.81 0.00 0.00 0.00 0.00 09:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:06:01 AM eth0 14.48 14.20 3.28 2.64 0.00 0.00 0.00 0.00 09:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:07:01 AM eth0 0.27 0.25 0.08 0.05 0.00 0.00 0.00 0.00 09:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:08:01 AM eth0 0.55 0.35 0.47 0.05 0.00 0.00 0.00 0.00 09:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:09:01 AM eth0 0.35 0.32 0.15 0.11 0.00 0.00 0.00 0.00 09:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:10:01 AM eth0 0.27 0.25 0.08 0.05 0.00 0.00 0.00 0.00 09:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:11:01 AM eth0 0.88 0.33 0.23 0.11 0.00 0.00 0.00 0.00 09:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:12:01 AM eth0 25.27 24.96 4.87 2.88 0.00 0.00 0.00 0.00 09:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:13:01 AM eth0 9.75 9.83 2.27 2.00 0.00 0.00 0.00 0.00 09:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:14:01 AM eth0 9.50 9.70 2.09 1.87 0.00 0.00 0.00 0.00 09:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:15:01 AM eth0 9.40 9.62 2.02 1.81 0.00 0.00 0.00 0.00 09:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:16:01 AM eth0 9.46 9.70 2.02 1.81 0.00 0.00 0.00 0.00 09:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:17:01 AM eth0 9.38 9.75 2.02 1.81 0.00 0.00 0.00 0.00 09:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:18:01 AM eth0 13.65 14.03 2.85 2.04 0.00 0.00 0.00 0.00 09:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:19:01 AM eth0 9.53 9.57 2.08 1.84 0.00 0.00 0.00 0.00 09:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:20:01 AM eth0 9.46 9.70 2.01 1.81 0.00 0.00 0.00 0.00 09:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:21:01 AM eth0 9.37 9.60 2.00 1.78 0.00 0.00 0.00 0.00 09:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:22:01 AM eth0 10.59 10.05 2.47 2.10 0.00 0.00 0.00 0.00 09:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:23:01 AM eth0 9.45 9.77 2.02 1.81 0.00 0.00 0.00 0.00 09:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:24:01 AM eth0 14.20 14.41 2.82 2.26 0.00 0.00 0.00 0.00 09:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:25:01 AM eth0 17.51 17.81 3.32 2.55 0.00 0.00 0.00 0.00 09:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:26:01 AM eth0 9.45 9.67 2.03 1.81 0.00 0.00 0.00 0.00 09:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:27:01 AM eth0 9.30 9.62 2.01 1.80 0.00 0.00 0.00 0.00 09:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:28:01 AM eth0 9.38 9.65 2.02 1.81 0.00 0.00 0.00 0.00 09:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:29:01 AM eth0 9.55 9.80 2.09 1.87 0.00 0.00 0.00 0.00 09:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:30:01 AM eth0 9.43 9.68 2.02 1.81 0.00 0.00 0.00 0.00 09:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:31:01 AM eth0 12.58 12.46 2.90 2.31 0.00 0.00 0.00 0.00 09:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:32:01 AM eth0 1.23 0.42 0.51 0.12 0.00 0.00 0.00 0.00 09:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:33:01 AM eth0 0.50 0.37 0.33 0.23 0.00 0.00 0.00 0.00 09:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:34:01 AM eth0 0.38 0.32 0.15 0.11 0.00 0.00 0.00 0.00 09:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:35:01 AM eth0 0.70 0.25 0.13 0.05 0.00 0.00 0.00 0.00 09:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:36:01 AM eth0 0.60 0.38 0.33 0.23 0.00 0.00 0.00 0.00 09:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:37:01 AM eth0 53.62 54.44 9.91 5.11 0.00 0.00 0.00 0.00 09:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:38:01 AM eth0 9.45 9.73 2.02 1.81 0.00 0.00 0.00 0.00 09:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:39:01 AM eth0 9.66 9.86 2.11 1.88 0.00 0.00 0.00 0.00 09:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:40:01 AM eth0 9.40 9.68 2.02 1.81 0.00 0.00 0.00 0.00 09:41:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:41:01 AM eth0 9.51 9.70 2.13 1.81 0.00 0.00 0.00 0.00 09:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:42:01 AM eth0 9.48 9.57 2.02 1.80 0.00 0.00 0.00 0.00 09:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:43:01 AM eth0 16.60 16.43 3.75 3.06 0.00 0.00 0.00 0.00 09:44:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:44:01 AM eth0 0.45 0.32 0.16 0.11 0.00 0.00 0.00 0.00 09:45:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:45:01 AM eth0 0.23 0.27 0.08 0.05 0.00 0.00 0.00 0.00 09:46:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:46:01 AM eth0 0.18 0.25 0.08 0.05 0.00 0.00 0.00 0.00 09:47:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:47:01 AM eth0 0.50 0.40 0.33 0.24 0.00 0.00 0.00 0.00 09:48:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:48:01 AM eth0 0.22 0.25 0.08 0.05 0.00 0.00 0.00 0.00 09:49:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:49:01 AM eth0 44.72 45.30 8.66 4.06 0.00 0.00 0.00 0.00 09:50:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:50:01 AM eth0 9.45 9.81 2.03 1.82 0.00 0.00 0.00 0.00 09:51:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:51:01 AM eth0 9.47 9.77 2.02 1.81 0.00 0.00 0.00 0.00 09:52:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:52:01 AM eth0 9.42 9.65 2.02 1.81 0.00 0.00 0.00 0.00 09:53:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:53:01 AM eth0 9.36 9.66 2.02 1.81 0.00 0.00 0.00 0.00 09:54:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:54:01 AM eth0 9.62 9.72 2.10 1.87 0.00 0.00 0.00 0.00 09:55:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:55:01 AM eth0 9.38 9.65 2.02 1.81 0.00 0.00 0.00 0.00 09:56:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:56:01 AM eth0 11.36 11.18 2.65 2.08 0.00 0.00 0.00 0.00 09:57:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:57:01 AM eth0 0.28 0.25 0.08 0.05 0.00 0.00 0.00 0.00 09:58:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:58:01 AM eth0 0.20 0.25 0.08 0.05 0.00 0.00 0.00 0.00 09:59:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:59:01 AM eth0 0.42 0.33 0.16 0.11 0.00 0.00 0.00 0.00 10:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 10:00:01 AM eth0 0.25 0.25 0.08 0.05 0.00 0.00 0.00 0.00 10:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 10:01:01 AM eth0 0.20 0.25 0.08 0.05 0.00 0.00 0.00 0.00 10:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 10:02:01 AM eth0 15.11 15.33 3.15 1.48 0.00 0.00 0.00 0.00 10:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 10:03:01 AM eth0 21.73 22.16 4.10 2.61 0.00 0.00 0.00 0.00 10:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 10:04:01 AM eth0 9.53 9.75 2.09 1.87 0.00 0.00 0.00 0.00 10:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 10:05:01 AM eth0 9.36 9.53 2.02 1.80 0.00 0.00 0.00 0.00 10:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 10:06:01 AM eth0 9.45 9.68 2.02 1.81 0.00 0.00 0.00 0.00 10:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 10:07:01 AM eth0 9.40 9.70 2.02 1.81 0.00 0.00 0.00 0.00 10:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 10:08:01 AM eth0 9.50 9.86 2.02 1.82 0.00 0.00 0.00 0.00 10:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 10:09:01 AM eth0 15.28 14.96 3.52 2.85 0.00 0.00 0.00 0.00 10:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 10:10:01 AM eth0 0.23 0.27 0.08 0.05 0.00 0.00 0.00 0.00 10:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 10:11:01 AM eth0 0.25 0.23 0.08 0.05 0.00 0.00 0.00 0.00 10:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 10:12:01 AM eth0 0.25 0.25 0.08 0.05 0.00 0.00 0.00 0.00 10:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 10:13:01 AM eth0 0.22 0.25 0.08 0.05 0.00 0.00 0.00 0.00 10:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 10:14:01 AM eth0 1.05 0.40 0.30 0.18 0.00 0.00 0.00 0.00 10:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 10:15:01 AM eth0 47.50 47.82 11.45 6.08 0.00 0.00 0.00 0.00 10:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 10:16:01 AM eth0 115.40 87.64 247.32 288.97 0.00 0.00 0.00 0.00 10:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 10:17:01 AM eth0 16.36 16.24 13.91 8.27 0.00 0.00 0.00 0.00 Average: lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 Average: eth0 11.27 10.00 14.36 2.89 0.00 0.00 0.00 0.00 ---> sar -P ALL: Linux 4.18.0-547.el8.x86_64 (centos-stream-8-robot-8eca76b2-cb40-4fba-ac9e-845c8a03a7a7.noval) 04/28/2024 _x86_64_ (2 CPU) 06:03:05 LINUX RESTART (2 CPU) 06:04:01 AM CPU %user %nice %system %iowait %steal %idle 06:05:01 AM all 39.71 0.00 5.37 2.29 0.13 52.50 06:05:01 AM 0 54.65 0.00 6.55 2.37 0.12 36.31 06:05:01 AM 1 24.85 0.00 4.19 2.21 0.13 68.61 06:06:01 AM all 23.16 0.00 3.26 2.20 0.08 71.29 06:06:01 AM 0 34.83 0.00 3.62 1.29 0.09 60.17 06:06:01 AM 1 11.52 0.00 2.90 3.11 0.08 82.38 06:07:01 AM all 11.74 0.00 1.75 0.67 0.07 85.78 06:07:01 AM 0 18.98 0.00 1.87 0.90 0.07 78.18 06:07:01 AM 1 4.48 0.00 1.64 0.43 0.07 93.38 06:08:01 AM all 32.26 0.00 5.19 1.38 0.12 61.05 06:08:01 AM 0 45.14 0.00 6.15 1.32 0.12 47.27 06:08:01 AM 1 19.40 0.00 4.24 1.44 0.12 74.80 06:09:01 AM all 0.53 0.00 0.28 0.47 0.03 98.69 06:09:01 AM 0 0.75 0.00 0.30 0.00 0.03 98.91 06:09:01 AM 1 0.30 0.00 0.27 0.94 0.03 98.46 06:10:01 AM all 4.99 0.00 0.48 0.01 0.07 94.45 06:10:01 AM 0 6.01 0.00 0.52 0.00 0.07 93.41 06:10:01 AM 1 3.98 0.00 0.44 0.02 0.07 95.50 06:11:01 AM all 4.25 0.00 0.31 0.00 0.08 95.37 06:11:01 AM 0 6.09 0.00 0.37 0.00 0.08 93.46 06:11:01 AM 1 2.41 0.00 0.25 0.00 0.07 97.28 06:12:01 AM all 4.13 0.00 0.32 0.00 0.08 95.48 06:12:01 AM 0 3.66 0.00 0.33 0.00 0.07 95.94 06:12:01 AM 1 4.60 0.00 0.30 0.00 0.08 95.02 06:13:01 AM all 4.12 0.00 0.30 0.00 0.08 95.50 06:13:01 AM 0 6.14 0.00 0.44 0.00 0.08 93.34 06:13:01 AM 1 2.11 0.00 0.17 0.00 0.07 97.66 06:14:01 AM all 6.69 0.00 0.31 0.01 0.08 92.92 06:14:01 AM 0 7.61 0.00 0.35 0.02 0.08 91.93 06:14:01 AM 1 5.76 0.00 0.27 0.00 0.07 93.90 06:15:01 AM all 1.68 0.00 0.22 0.00 0.07 98.04 06:15:01 AM 0 0.89 0.00 0.15 0.00 0.08 98.88 06:15:01 AM 1 2.47 0.00 0.28 0.00 0.05 97.19 06:15:01 AM CPU %user %nice %system %iowait %steal %idle 06:16:01 AM all 0.59 0.00 0.08 0.00 0.06 99.27 06:16:01 AM 0 0.58 0.00 0.12 0.00 0.08 99.21 06:16:01 AM 1 0.60 0.00 0.05 0.00 0.03 99.32 06:17:01 AM all 0.63 0.00 0.11 0.00 0.07 99.19 06:17:01 AM 0 0.52 0.00 0.12 0.00 0.08 99.28 06:17:01 AM 1 0.75 0.00 0.10 0.00 0.05 99.10 06:18:01 AM all 0.58 0.00 0.09 0.00 0.07 99.26 06:18:01 AM 0 0.60 0.00 0.12 0.00 0.08 99.20 06:18:01 AM 1 0.57 0.00 0.07 0.00 0.05 99.32 06:19:01 AM all 0.65 0.00 0.23 0.01 0.07 99.05 06:19:01 AM 0 0.70 0.00 0.25 0.02 0.07 98.96 06:19:01 AM 1 0.60 0.00 0.20 0.00 0.07 99.13 06:20:01 AM all 1.24 0.00 0.12 0.00 0.06 98.59 06:20:01 AM 0 1.84 0.00 0.13 0.00 0.05 97.97 06:20:01 AM 1 0.64 0.00 0.10 0.00 0.07 99.20 06:21:01 AM all 3.44 0.00 0.22 0.02 0.05 96.28 06:21:01 AM 0 5.40 0.00 0.22 0.03 0.05 94.30 06:21:01 AM 1 1.49 0.00 0.22 0.00 0.05 98.24 06:22:01 AM all 0.70 0.00 0.11 0.00 0.04 99.15 06:22:01 AM 0 0.62 0.00 0.12 0.00 0.03 99.23 06:22:01 AM 1 0.79 0.00 0.10 0.00 0.05 99.06 06:23:01 AM all 0.53 0.00 0.09 0.00 0.03 99.35 06:23:01 AM 0 0.38 0.00 0.08 0.00 0.02 99.52 06:23:01 AM 1 0.67 0.00 0.10 0.00 0.05 99.18 06:24:01 AM all 4.30 0.00 0.27 0.00 0.07 95.36 06:24:01 AM 0 4.93 0.00 0.33 0.00 0.08 94.65 06:24:01 AM 1 3.67 0.00 0.20 0.00 0.05 96.08 06:25:01 AM all 4.29 0.00 0.33 0.00 0.08 95.30 06:25:01 AM 0 6.14 0.00 0.40 0.00 0.08 93.37 06:25:01 AM 1 2.44 0.00 0.25 0.00 0.08 97.23 06:26:01 AM all 4.30 0.00 0.32 0.00 0.09 95.29 06:26:01 AM 0 5.48 0.00 0.37 0.00 0.12 94.03 06:26:01 AM 1 3.11 0.00 0.27 0.00 0.07 96.55 06:26:01 AM CPU %user %nice %system %iowait %steal %idle 06:27:01 AM all 4.29 0.00 0.31 0.00 0.08 95.32 06:27:01 AM 0 4.03 0.00 0.28 0.00 0.07 95.62 06:27:01 AM 1 4.55 0.00 0.33 0.00 0.08 95.03 06:28:01 AM all 4.29 0.00 0.26 0.00 0.08 95.37 06:28:01 AM 0 5.87 0.00 0.33 0.00 0.08 93.71 06:28:01 AM 1 2.71 0.00 0.18 0.00 0.08 97.02 06:29:01 AM all 4.18 0.00 0.32 0.00 0.08 95.43 06:29:01 AM 0 5.12 0.00 0.38 0.00 0.08 94.42 06:29:01 AM 1 3.24 0.00 0.25 0.00 0.07 96.44 06:30:01 AM all 6.06 0.00 0.35 0.00 0.08 93.51 06:30:01 AM 0 3.95 0.00 0.30 0.00 0.07 95.69 06:30:01 AM 1 8.19 0.00 0.40 0.00 0.08 91.33 06:31:01 AM all 0.90 0.00 0.10 0.00 0.07 98.93 06:31:01 AM 0 0.62 0.00 0.08 0.00 0.05 99.25 06:31:01 AM 1 1.19 0.00 0.12 0.00 0.08 98.61 06:32:01 AM all 0.92 0.00 0.10 0.00 0.08 98.91 06:32:01 AM 0 0.57 0.00 0.07 0.00 0.05 99.32 06:32:01 AM 1 1.27 0.00 0.13 0.00 0.10 98.50 06:33:01 AM all 0.94 0.00 0.12 0.00 0.06 98.88 06:33:01 AM 0 0.77 0.00 0.10 0.00 0.05 99.08 06:33:01 AM 1 1.12 0.00 0.13 0.00 0.07 98.68 06:34:01 AM all 0.93 0.00 0.11 0.00 0.08 98.89 06:34:01 AM 0 1.37 0.00 0.12 0.00 0.08 98.43 06:34:01 AM 1 0.48 0.00 0.10 0.00 0.07 99.35 06:35:01 AM all 0.95 0.00 0.09 0.00 0.08 98.88 06:35:01 AM 0 0.57 0.00 0.07 0.00 0.05 99.32 06:35:01 AM 1 1.34 0.00 0.12 0.00 0.10 98.45 06:36:01 AM all 2.45 0.00 0.17 0.00 0.07 97.32 06:36:01 AM 0 3.57 0.00 0.18 0.00 0.08 96.17 06:36:01 AM 1 1.34 0.00 0.15 0.00 0.05 98.46 06:37:01 AM all 0.51 0.00 0.09 0.00 0.07 99.33 06:37:01 AM 0 0.42 0.00 0.12 0.00 0.08 99.38 06:37:01 AM 1 0.60 0.00 0.07 0.00 0.05 99.28 06:37:01 AM CPU %user %nice %system %iowait %steal %idle 06:38:01 AM all 0.95 0.00 0.10 0.00 0.08 98.87 06:38:01 AM 0 1.26 0.00 0.15 0.00 0.08 98.51 06:38:01 AM 1 0.65 0.00 0.05 0.00 0.07 99.23 06:39:01 AM all 5.17 0.00 0.26 0.00 0.08 94.49 06:39:01 AM 0 7.12 0.00 0.36 0.00 0.07 92.45 06:39:01 AM 1 3.24 0.00 0.17 0.00 0.08 96.51 06:40:01 AM all 4.38 0.00 0.19 0.00 0.08 95.35 06:40:01 AM 0 2.99 0.00 0.17 0.00 0.08 96.76 06:40:01 AM 1 5.77 0.00 0.22 0.00 0.08 93.93 06:41:01 AM all 4.23 0.00 0.18 0.00 0.08 95.52 06:41:01 AM 0 2.33 0.00 0.17 0.00 0.07 97.44 06:41:01 AM 1 6.14 0.00 0.18 0.00 0.08 93.59 06:42:01 AM all 4.30 0.00 0.18 0.00 0.07 95.45 06:42:01 AM 0 5.53 0.00 0.20 0.00 0.07 94.20 06:42:01 AM 1 3.08 0.00 0.17 0.00 0.07 96.69 06:43:01 AM all 4.24 0.00 0.18 0.00 0.08 95.50 06:43:01 AM 0 2.16 0.00 0.18 0.00 0.07 97.59 06:43:01 AM 1 6.33 0.00 0.18 0.00 0.08 93.40 06:44:01 AM all 4.23 0.00 0.19 0.00 0.08 95.49 06:44:01 AM 0 2.16 0.00 0.15 0.00 0.07 97.63 06:44:01 AM 1 6.31 0.00 0.23 0.00 0.10 93.35 06:45:01 AM all 1.63 0.00 0.13 0.00 0.07 98.17 06:45:01 AM 0 0.92 0.00 0.08 0.00 0.05 98.95 06:45:01 AM 1 2.34 0.00 0.18 0.00 0.08 97.39 06:46:01 AM all 0.51 0.00 0.10 0.00 0.07 99.32 06:46:01 AM 0 0.63 0.00 0.07 0.00 0.05 99.25 06:46:01 AM 1 0.38 0.00 0.13 0.00 0.08 99.40 06:47:01 AM all 4.27 0.00 0.30 0.00 0.08 95.34 06:47:01 AM 0 2.46 0.00 0.23 0.00 0.07 97.24 06:47:01 AM 1 6.09 0.00 0.37 0.00 0.10 93.44 06:48:01 AM all 4.23 0.00 0.32 0.01 0.08 95.37 06:48:01 AM 0 3.14 0.00 0.30 0.00 0.08 96.47 06:48:01 AM 1 5.31 0.00 0.34 0.02 0.07 94.27 06:48:01 AM CPU %user %nice %system %iowait %steal %idle 06:49:01 AM all 4.06 0.00 0.32 0.01 0.08 95.53 06:49:01 AM 0 4.84 0.00 0.37 0.02 0.08 94.69 06:49:01 AM 1 3.28 0.00 0.27 0.00 0.08 96.37 06:50:01 AM all 4.27 0.00 0.33 0.00 0.08 95.31 06:50:01 AM 0 5.39 0.00 0.40 0.00 0.08 94.13 06:50:01 AM 1 3.15 0.00 0.27 0.00 0.08 96.50 06:51:01 AM all 4.37 0.00 0.32 0.00 0.08 95.23 06:51:01 AM 0 5.86 0.00 0.42 0.00 0.08 93.64 06:51:01 AM 1 2.88 0.00 0.22 0.00 0.08 96.82 06:52:01 AM all 4.28 0.00 0.34 0.00 0.08 95.30 06:52:01 AM 0 4.87 0.00 0.33 0.00 0.07 94.73 06:52:01 AM 1 3.70 0.00 0.35 0.00 0.08 95.87 06:53:01 AM all 5.72 0.00 0.33 0.00 0.08 93.87 06:53:01 AM 0 7.05 0.00 0.37 0.00 0.08 92.50 06:53:01 AM 1 4.38 0.00 0.30 0.00 0.07 95.25 06:54:01 AM all 0.61 0.00 0.09 0.00 0.06 99.24 06:54:01 AM 0 0.42 0.00 0.10 0.00 0.05 99.43 06:54:01 AM 1 0.80 0.00 0.08 0.00 0.07 99.05 06:55:01 AM all 0.59 0.00 0.09 0.00 0.06 99.26 06:55:01 AM 0 0.30 0.00 0.08 0.00 0.05 99.57 06:55:01 AM 1 0.89 0.00 0.10 0.00 0.07 98.95 06:56:01 AM all 0.61 0.00 0.09 0.00 0.08 99.21 06:56:01 AM 0 0.57 0.00 0.08 0.00 0.08 99.26 06:56:01 AM 1 0.65 0.00 0.10 0.00 0.08 99.16 06:57:01 AM all 0.58 0.00 0.10 0.00 0.08 99.24 06:57:01 AM 0 0.75 0.00 0.12 0.00 0.07 99.07 06:57:01 AM 1 0.42 0.00 0.08 0.00 0.08 99.41 06:58:01 AM all 0.37 0.01 0.10 0.00 0.08 99.45 06:58:01 AM 0 0.57 0.00 0.13 0.00 0.08 99.21 06:58:01 AM 1 0.17 0.02 0.07 0.00 0.07 99.68 06:59:01 AM all 3.60 16.77 1.21 1.32 0.08 77.01 06:59:01 AM 0 5.50 22.06 1.53 1.11 0.08 69.73 06:59:01 AM 1 1.71 11.49 0.90 1.52 0.08 84.29 06:59:01 AM CPU %user %nice %system %iowait %steal %idle 07:00:01 AM all 4.34 0.00 0.19 0.08 0.08 95.31 07:00:01 AM 0 6.22 0.00 0.22 0.05 0.08 93.43 07:00:01 AM 1 2.46 0.00 0.17 0.10 0.08 97.19 07:01:01 AM all 4.34 0.00 0.20 0.00 0.07 95.39 07:01:01 AM 0 6.26 0.00 0.23 0.00 0.08 93.42 07:01:01 AM 1 2.42 0.00 0.17 0.00 0.05 97.36 07:02:01 AM all 4.21 0.00 0.19 0.02 0.08 95.49 07:02:01 AM 0 6.26 0.00 0.20 0.00 0.10 93.44 07:02:01 AM 1 2.17 0.00 0.18 0.03 0.07 97.54 07:03:01 AM all 4.29 0.00 0.20 0.00 0.09 95.42 07:03:01 AM 0 2.62 0.00 0.20 0.00 0.08 97.09 07:03:01 AM 1 5.96 0.00 0.20 0.00 0.10 93.74 07:04:01 AM all 4.27 0.00 0.15 0.00 0.08 95.50 07:04:01 AM 0 2.36 0.00 0.15 0.00 0.07 97.43 07:04:01 AM 1 6.20 0.00 0.15 0.00 0.08 93.57 07:05:01 AM all 5.17 0.00 0.27 0.00 0.08 94.48 07:05:01 AM 0 2.27 0.00 0.15 0.00 0.07 97.51 07:05:01 AM 1 8.12 0.00 0.39 0.00 0.09 91.40 07:06:01 AM all 4.24 0.00 0.19 0.00 0.08 95.49 07:06:01 AM 0 4.79 0.00 0.17 0.00 0.07 94.98 07:06:01 AM 1 3.70 0.00 0.22 0.00 0.08 96.00 07:07:01 AM all 4.32 0.00 0.19 0.00 0.08 95.40 07:07:01 AM 0 3.44 0.00 0.15 0.00 0.08 96.32 07:07:01 AM 1 5.20 0.00 0.23 0.00 0.08 94.48 07:08:02 AM all 4.27 0.00 0.21 0.00 0.08 95.44 07:08:02 AM 0 2.59 0.00 0.18 0.00 0.07 97.16 07:08:02 AM 1 5.96 0.00 0.23 0.00 0.08 93.72 07:09:01 AM all 4.18 0.00 0.19 0.00 0.09 95.55 07:09:01 AM 0 5.17 0.00 0.24 0.00 0.09 94.51 07:09:01 AM 1 3.18 0.00 0.14 0.00 0.09 96.60 07:10:01 AM all 4.29 0.00 0.21 0.00 0.08 95.42 07:10:01 AM 0 2.52 0.00 0.20 0.00 0.08 97.19 07:10:01 AM 1 6.06 0.00 0.22 0.00 0.08 93.64 07:10:01 AM CPU %user %nice %system %iowait %steal %idle 07:11:01 AM all 4.26 0.00 0.18 0.01 0.08 95.48 07:11:01 AM 0 3.93 0.00 0.17 0.02 0.07 95.82 07:11:01 AM 1 4.59 0.00 0.20 0.00 0.08 95.13 07:12:01 AM all 5.48 0.00 0.33 0.00 0.08 94.11 07:12:01 AM 0 3.90 0.00 0.28 0.00 0.08 95.74 07:12:01 AM 1 7.07 0.00 0.37 0.00 0.08 92.48 07:13:01 AM all 4.24 0.00 0.31 0.00 0.08 95.37 07:13:01 AM 0 5.49 0.00 0.38 0.00 0.08 94.04 07:13:01 AM 1 2.99 0.00 0.23 0.00 0.08 96.69 07:14:01 AM all 4.17 0.00 0.30 0.00 0.08 95.46 07:14:01 AM 0 4.94 0.00 0.37 0.00 0.07 94.63 07:14:01 AM 1 3.40 0.00 0.23 0.00 0.08 96.29 07:15:01 AM all 4.19 0.00 0.31 0.00 0.08 95.42 07:15:01 AM 0 5.92 0.00 0.40 0.00 0.08 93.60 07:15:01 AM 1 2.46 0.00 0.22 0.00 0.08 97.24 07:16:01 AM all 4.23 0.00 0.32 0.00 0.08 95.37 07:16:01 AM 0 1.50 0.00 0.15 0.00 0.07 98.28 07:16:01 AM 1 6.96 0.00 0.49 0.00 0.10 92.45 07:17:01 AM all 4.29 0.00 0.28 0.00 0.08 95.35 07:17:01 AM 0 1.85 0.00 0.13 0.00 0.07 97.95 07:17:01 AM 1 6.74 0.00 0.44 0.00 0.08 92.74 07:18:01 AM all 4.96 0.00 0.26 0.00 0.08 94.70 07:18:01 AM 0 3.71 0.00 0.30 0.00 0.10 95.88 07:18:01 AM 1 6.21 0.00 0.22 0.00 0.07 93.51 07:19:01 AM all 0.64 0.00 0.08 0.00 0.08 99.20 07:19:01 AM 0 0.58 0.00 0.10 0.00 0.08 99.23 07:19:01 AM 1 0.70 0.00 0.07 0.00 0.07 99.17 07:20:01 AM all 0.61 0.00 0.08 0.00 0.06 99.25 07:20:01 AM 0 0.60 0.00 0.10 0.00 0.07 99.23 07:20:01 AM 1 0.62 0.00 0.07 0.00 0.05 99.26 07:21:01 AM all 0.63 0.00 0.10 0.00 0.08 99.19 07:21:01 AM 0 0.38 0.00 0.10 0.00 0.07 99.45 07:21:01 AM 1 0.87 0.00 0.10 0.00 0.10 98.93 07:21:01 AM CPU %user %nice %system %iowait %steal %idle 07:22:01 AM all 0.60 0.00 0.10 0.00 0.05 99.25 07:22:01 AM 0 0.63 0.00 0.07 0.00 0.03 99.27 07:22:01 AM 1 0.57 0.00 0.13 0.00 0.07 99.23 07:23:01 AM all 0.58 0.00 0.10 0.00 0.08 99.24 07:23:01 AM 0 0.32 0.00 0.07 0.00 0.05 99.57 07:23:01 AM 1 0.85 0.00 0.13 0.00 0.10 98.91 07:24:01 AM all 4.27 0.00 0.25 0.00 0.08 95.40 07:24:01 AM 0 4.13 0.00 0.27 0.00 0.07 95.53 07:24:01 AM 1 4.41 0.00 0.23 0.00 0.08 95.27 07:25:01 AM all 4.31 0.00 0.18 0.00 0.09 95.41 07:25:01 AM 0 6.46 0.00 0.22 0.00 0.12 93.21 07:25:01 AM 1 2.17 0.00 0.15 0.00 0.07 97.61 07:26:01 AM all 4.31 0.00 0.20 0.00 0.08 95.41 07:26:01 AM 0 6.09 0.00 0.22 0.00 0.08 93.61 07:26:01 AM 1 2.54 0.00 0.18 0.00 0.07 97.21 07:27:01 AM all 4.32 0.00 0.16 0.00 0.08 95.44 07:27:01 AM 0 6.32 0.00 0.22 0.00 0.10 93.36 07:27:01 AM 1 2.31 0.00 0.10 0.00 0.07 97.53 07:28:01 AM all 4.31 0.00 0.18 0.00 0.08 95.43 07:28:01 AM 0 5.40 0.00 0.18 0.00 0.08 94.33 07:28:01 AM 1 3.21 0.00 0.17 0.00 0.08 96.54 07:29:01 AM all 4.27 0.01 0.23 0.02 0.07 95.41 07:29:01 AM 0 6.66 0.02 0.27 0.02 0.08 92.95 07:29:01 AM 1 1.87 0.00 0.18 0.02 0.05 97.88 07:30:01 AM all 5.86 0.00 0.34 0.00 0.08 93.73 07:30:01 AM 0 6.02 0.00 0.30 0.00 0.08 93.59 07:30:01 AM 1 5.69 0.00 0.37 0.00 0.07 93.87 07:31:01 AM all 4.24 0.00 0.30 0.00 0.08 95.37 07:31:01 AM 0 2.92 0.00 0.20 0.00 0.07 96.81 07:31:01 AM 1 5.56 0.00 0.40 0.00 0.10 93.94 07:32:01 AM all 4.28 0.00 0.33 0.00 0.08 95.31 07:32:01 AM 0 3.09 0.00 0.25 0.00 0.07 96.59 07:32:01 AM 1 5.48 0.00 0.42 0.00 0.08 94.02 07:32:01 AM CPU %user %nice %system %iowait %steal %idle 07:33:01 AM all 4.50 0.00 0.33 0.00 0.07 95.10 07:33:01 AM 0 7.20 0.00 0.49 0.00 0.07 92.24 07:33:01 AM 1 1.81 0.00 0.18 0.00 0.07 97.94 07:34:01 AM all 4.21 0.00 0.32 0.00 0.08 95.39 07:34:01 AM 0 4.39 0.00 0.35 0.00 0.07 95.20 07:34:01 AM 1 4.04 0.00 0.28 0.00 0.08 95.59 07:35:01 AM all 4.21 0.00 0.31 0.00 0.08 95.40 07:35:01 AM 0 3.58 0.00 0.25 0.00 0.07 96.11 07:35:01 AM 1 4.84 0.00 0.37 0.00 0.10 94.69 07:36:01 AM all 6.45 0.00 0.39 0.00 0.09 93.08 07:36:01 AM 0 5.56 0.00 0.35 0.00 0.08 94.01 07:36:01 AM 1 7.34 0.00 0.42 0.00 0.10 92.14 07:37:01 AM all 1.36 0.00 0.13 0.00 0.07 98.44 07:37:01 AM 0 0.55 0.00 0.12 0.00 0.05 99.28 07:37:01 AM 1 2.18 0.00 0.13 0.00 0.08 97.61 07:38:01 AM all 0.61 0.00 0.09 0.00 0.08 99.22 07:38:01 AM 0 0.65 0.00 0.12 0.00 0.08 99.15 07:38:01 AM 1 0.57 0.00 0.07 0.00 0.07 99.30 07:39:01 AM all 0.64 0.00 0.10 0.01 0.06 99.19 07:39:01 AM 0 0.45 0.00 0.10 0.00 0.05 99.40 07:39:01 AM 1 0.84 0.00 0.10 0.02 0.07 98.98 07:40:01 AM all 0.60 0.00 0.09 0.00 0.08 99.23 07:40:01 AM 0 0.55 0.00 0.08 0.00 0.08 99.28 07:40:01 AM 1 0.65 0.00 0.10 0.00 0.07 99.18 07:41:01 AM all 0.58 0.00 0.11 0.00 0.07 99.24 07:41:01 AM 0 0.35 0.00 0.08 0.00 0.05 99.52 07:41:01 AM 1 0.82 0.00 0.13 0.00 0.08 98.96 07:42:01 AM all 0.47 0.00 0.11 0.00 0.08 99.34 07:42:01 AM 0 0.30 0.00 0.08 0.00 0.07 99.55 07:42:01 AM 1 0.64 0.00 0.13 0.00 0.10 99.13 07:43:01 AM all 1.80 0.00 0.13 0.00 0.05 98.02 07:43:01 AM 0 2.63 0.00 0.10 0.00 0.03 97.24 07:43:01 AM 1 0.97 0.00 0.15 0.00 0.07 98.81 07:43:01 AM CPU %user %nice %system %iowait %steal %idle 07:44:01 AM all 0.35 0.00 0.07 0.00 0.03 99.55 07:44:01 AM 0 0.52 0.00 0.03 0.00 0.00 99.45 07:44:01 AM 1 0.18 0.00 0.10 0.00 0.07 99.65 07:45:01 AM all 0.48 0.00 0.08 0.00 0.05 99.40 07:45:01 AM 0 0.43 0.00 0.07 0.00 0.03 99.47 07:45:01 AM 1 0.52 0.00 0.08 0.00 0.07 99.33 07:46:01 AM all 0.35 0.00 0.08 0.00 0.04 99.52 07:46:01 AM 0 0.47 0.00 0.05 0.00 0.03 99.45 07:46:01 AM 1 0.23 0.00 0.12 0.00 0.05 99.60 07:47:01 AM all 0.48 0.00 0.10 0.00 0.04 99.37 07:47:01 AM 0 0.50 0.00 0.08 0.00 0.03 99.38 07:47:01 AM 1 0.47 0.00 0.12 0.00 0.05 99.37 07:48:01 AM all 0.34 0.00 0.05 0.00 0.04 99.57 07:48:01 AM 0 0.20 0.00 0.05 0.00 0.03 99.72 07:48:01 AM 1 0.48 0.00 0.05 0.00 0.05 99.42 07:49:01 AM all 0.37 0.01 0.09 0.00 0.05 99.48 07:49:01 AM 0 0.52 0.00 0.07 0.00 0.03 99.38 07:49:01 AM 1 0.22 0.02 0.12 0.00 0.07 99.58 07:50:01 AM all 0.11 0.00 0.07 0.00 0.04 99.78 07:50:01 AM 0 0.03 0.00 0.03 0.00 0.02 99.92 07:50:01 AM 1 0.18 0.00 0.10 0.00 0.07 99.65 07:51:01 AM all 0.48 0.00 0.08 0.00 0.04 99.40 07:51:01 AM 0 0.35 0.00 0.08 0.00 0.02 99.55 07:51:01 AM 1 0.62 0.00 0.07 0.00 0.07 99.25 07:52:01 AM all 0.33 0.00 0.08 0.00 0.04 99.55 07:52:01 AM 0 0.05 0.00 0.08 0.00 0.03 99.83 07:52:01 AM 1 0.62 0.00 0.07 0.00 0.05 99.27 07:53:01 AM all 0.47 0.00 0.07 0.00 0.05 99.42 07:53:01 AM 0 0.33 0.00 0.08 0.00 0.05 99.53 07:53:01 AM 1 0.60 0.00 0.05 0.00 0.05 99.30 07:54:01 AM all 0.34 0.00 0.08 0.00 0.05 99.52 07:54:01 AM 0 0.10 0.00 0.10 0.00 0.05 99.75 07:54:01 AM 1 0.58 0.00 0.07 0.00 0.05 99.30 07:54:01 AM CPU %user %nice %system %iowait %steal %idle 07:55:01 AM all 0.50 0.00 0.08 0.00 0.03 99.39 07:55:01 AM 0 0.40 0.00 0.07 0.00 0.02 99.52 07:55:01 AM 1 0.60 0.00 0.08 0.00 0.05 99.27 07:56:01 AM all 0.36 0.00 0.06 0.00 0.03 99.55 07:56:01 AM 0 0.12 0.00 0.07 0.00 0.03 99.78 07:56:01 AM 1 0.60 0.00 0.05 0.00 0.03 99.32 07:57:01 AM all 1.71 0.00 0.12 0.00 0.06 98.11 07:57:01 AM 0 2.76 0.00 0.13 0.00 0.07 97.04 07:57:01 AM 1 0.67 0.00 0.10 0.00 0.05 99.18 07:58:01 AM all 4.26 0.00 0.19 0.00 0.08 95.46 07:58:01 AM 0 3.44 0.00 0.18 0.00 0.08 96.29 07:58:01 AM 1 5.09 0.00 0.20 0.00 0.08 94.63 07:59:01 AM all 4.25 0.00 0.18 0.01 0.08 95.48 07:59:01 AM 0 4.68 0.00 0.20 0.02 0.07 95.03 07:59:01 AM 1 3.82 0.00 0.17 0.00 0.08 95.93 08:00:01 AM all 4.33 0.00 0.17 0.00 0.08 95.42 08:00:01 AM 0 6.11 0.00 0.22 0.00 0.08 93.59 08:00:01 AM 1 2.56 0.00 0.12 0.00 0.07 97.26 08:01:01 AM all 4.18 0.00 0.19 0.00 0.08 95.55 08:01:01 AM 0 6.30 0.00 0.23 0.00 0.08 93.38 08:01:01 AM 1 2.07 0.00 0.15 0.00 0.07 97.71 08:02:01 AM all 4.35 0.00 0.18 0.00 0.08 95.39 08:02:01 AM 0 6.36 0.00 0.20 0.00 0.08 93.36 08:02:01 AM 1 2.34 0.00 0.17 0.00 0.07 97.43 08:03:01 AM all 4.73 0.00 0.21 0.00 0.08 94.97 08:03:01 AM 0 7.03 0.00 0.27 0.00 0.08 92.61 08:03:01 AM 1 2.46 0.00 0.15 0.00 0.08 97.31 08:04:01 AM all 0.63 0.00 0.08 0.00 0.04 99.26 08:04:01 AM 0 0.62 0.00 0.07 0.00 0.02 99.30 08:04:01 AM 1 0.63 0.00 0.08 0.00 0.07 99.21 08:05:01 AM all 0.33 0.00 0.06 0.00 0.04 99.57 08:05:01 AM 0 0.08 0.00 0.08 0.00 0.05 99.78 08:05:01 AM 1 0.57 0.00 0.03 0.00 0.03 99.37 08:05:01 AM CPU %user %nice %system %iowait %steal %idle 08:06:01 AM all 0.48 0.00 0.08 0.00 0.03 99.41 08:06:01 AM 0 0.35 0.00 0.08 0.00 0.02 99.55 08:06:01 AM 1 0.62 0.00 0.07 0.00 0.05 99.26 08:07:01 AM all 0.38 0.00 0.07 0.00 0.04 99.52 08:07:01 AM 0 0.12 0.00 0.08 0.00 0.03 99.77 08:07:01 AM 1 0.63 0.00 0.05 0.00 0.05 99.27 08:08:01 AM all 0.52 0.00 0.09 0.00 0.04 99.35 08:08:01 AM 0 0.33 0.00 0.10 0.00 0.03 99.53 08:08:01 AM 1 0.70 0.00 0.08 0.00 0.05 99.16 08:09:01 AM all 0.34 0.00 0.08 0.00 0.04 99.54 08:09:01 AM 0 0.08 0.00 0.07 0.00 0.05 99.80 08:09:01 AM 1 0.60 0.00 0.08 0.00 0.03 99.28 08:10:01 AM all 0.48 0.00 0.08 0.00 0.05 99.39 08:10:01 AM 0 0.42 0.00 0.10 0.00 0.05 99.43 08:10:01 AM 1 0.55 0.00 0.05 0.00 0.05 99.35 08:11:01 AM all 0.29 0.00 0.10 0.00 0.05 99.56 08:11:01 AM 0 0.13 0.00 0.12 0.00 0.05 99.70 08:11:01 AM 1 0.45 0.00 0.08 0.00 0.05 99.42 08:12:01 AM all 0.33 0.00 0.09 0.00 0.05 99.52 08:12:01 AM 0 0.38 0.00 0.07 0.00 0.07 99.48 08:12:01 AM 1 0.28 0.00 0.12 0.00 0.03 99.56 08:13:02 AM all 0.18 0.00 0.06 0.00 0.04 99.72 08:13:02 AM 0 0.08 0.00 0.07 0.00 0.03 99.82 08:13:02 AM 1 0.28 0.00 0.05 0.00 0.05 99.61 08:14:01 AM all 0.49 0.00 0.07 0.00 0.04 99.40 08:14:01 AM 0 0.34 0.00 0.07 0.00 0.03 99.56 08:14:01 AM 1 0.65 0.00 0.07 0.00 0.05 99.24 08:15:01 AM all 0.34 0.00 0.06 0.00 0.04 99.56 08:15:01 AM 0 0.05 0.00 0.05 0.00 0.03 99.87 08:15:01 AM 1 0.63 0.00 0.07 0.00 0.05 99.25 08:16:01 AM all 0.45 0.00 0.07 0.00 0.04 99.44 08:16:01 AM 0 0.33 0.00 0.10 0.00 0.03 99.53 08:16:01 AM 1 0.57 0.00 0.03 0.00 0.05 99.35 08:16:01 AM CPU %user %nice %system %iowait %steal %idle 08:17:01 AM all 0.33 0.00 0.07 0.00 0.05 99.55 08:17:01 AM 0 0.43 0.00 0.05 0.00 0.03 99.48 08:17:01 AM 1 0.23 0.00 0.08 0.00 0.07 99.62 08:18:01 AM all 1.72 0.00 0.09 0.00 0.06 98.13 08:18:01 AM 0 2.20 0.00 0.10 0.00 0.05 97.65 08:18:01 AM 1 1.24 0.00 0.08 0.00 0.07 98.61 08:19:01 AM all 4.34 0.00 0.18 0.00 0.08 95.40 08:19:01 AM 0 4.01 0.00 0.15 0.00 0.07 95.77 08:19:01 AM 1 4.67 0.00 0.22 0.00 0.08 95.03 08:20:01 AM all 4.30 0.00 0.18 0.00 0.08 95.43 08:20:01 AM 0 5.12 0.00 0.20 0.00 0.08 94.60 08:20:01 AM 1 3.48 0.00 0.17 0.00 0.08 96.27 08:21:01 AM all 4.29 0.00 0.21 0.00 0.08 95.43 08:21:01 AM 0 4.68 0.00 0.22 0.00 0.07 95.03 08:21:01 AM 1 3.90 0.00 0.20 0.00 0.08 95.82 08:22:01 AM all 4.24 0.00 0.17 0.00 0.07 95.52 08:22:01 AM 0 4.00 0.00 0.17 0.00 0.07 95.77 08:22:01 AM 1 4.49 0.00 0.17 0.00 0.07 95.28 08:23:01 AM all 4.24 0.00 0.20 0.00 0.08 95.48 08:23:01 AM 0 5.15 0.00 0.22 0.00 0.08 94.55 08:23:01 AM 1 3.33 0.00 0.18 0.00 0.08 96.40 08:24:01 AM all 4.18 0.00 0.20 0.00 0.07 95.55 08:24:01 AM 0 5.62 0.00 0.23 0.00 0.07 94.08 08:24:01 AM 1 2.74 0.00 0.17 0.00 0.07 97.02 08:25:01 AM all 0.33 0.00 0.06 0.00 0.05 99.56 08:25:01 AM 0 0.05 0.00 0.03 0.00 0.03 99.88 08:25:01 AM 1 0.62 0.00 0.08 0.00 0.07 99.23 08:26:01 AM all 0.45 0.00 0.07 0.00 0.04 99.44 08:26:01 AM 0 0.32 0.00 0.08 0.00 0.03 99.57 08:26:01 AM 1 0.58 0.00 0.05 0.00 0.05 99.32 08:27:01 AM all 0.33 0.00 0.08 0.00 0.06 99.53 08:27:01 AM 0 0.05 0.00 0.07 0.00 0.05 99.83 08:27:01 AM 1 0.60 0.00 0.10 0.00 0.07 99.23 08:27:01 AM CPU %user %nice %system %iowait %steal %idle 08:28:01 AM all 0.33 0.00 0.05 0.00 0.05 99.57 08:28:01 AM 0 0.12 0.00 0.08 0.00 0.05 99.75 08:28:01 AM 1 0.55 0.00 0.02 0.00 0.05 99.38 08:29:01 AM all 0.46 0.00 0.08 0.00 0.04 99.42 08:29:01 AM 0 0.30 0.00 0.08 0.00 0.02 99.60 08:29:01 AM 1 0.62 0.00 0.07 0.00 0.07 99.25 08:30:01 AM all 0.35 0.00 0.06 0.00 0.03 99.56 08:30:01 AM 0 0.10 0.00 0.07 0.00 0.03 99.80 08:30:01 AM 1 0.60 0.00 0.05 0.00 0.03 99.32 08:31:01 AM all 0.48 0.00 0.08 0.01 0.05 99.38 08:31:01 AM 0 0.33 0.00 0.05 0.00 0.03 99.58 08:31:01 AM 1 0.63 0.00 0.10 0.02 0.07 99.18 08:32:01 AM all 0.18 0.14 0.16 0.00 0.04 99.47 08:32:01 AM 0 0.08 0.00 0.10 0.00 0.03 99.78 08:32:01 AM 1 0.28 0.28 0.22 0.00 0.05 99.16 08:33:01 AM all 0.33 0.00 0.08 0.00 0.05 99.55 08:33:01 AM 0 0.35 0.00 0.08 0.00 0.03 99.53 08:33:01 AM 1 0.30 0.00 0.07 0.00 0.07 99.56 08:34:01 AM all 0.36 0.00 0.06 0.00 0.06 99.52 08:34:01 AM 0 0.07 0.00 0.05 0.00 0.05 99.83 08:34:01 AM 1 0.65 0.00 0.07 0.00 0.07 99.22 08:35:01 AM all 0.49 0.00 0.06 0.00 0.03 99.42 08:35:01 AM 0 0.37 0.00 0.07 0.00 0.02 99.55 08:35:01 AM 1 0.62 0.00 0.05 0.00 0.05 99.28 08:36:01 AM all 0.26 0.00 0.07 0.00 0.05 99.62 08:36:01 AM 0 0.13 0.00 0.10 0.00 0.05 99.72 08:36:01 AM 1 0.38 0.00 0.03 0.00 0.05 99.53 08:37:01 AM all 0.46 0.00 0.07 0.00 0.05 99.42 08:37:01 AM 0 0.33 0.00 0.08 0.00 0.03 99.55 08:37:01 AM 1 0.58 0.00 0.05 0.00 0.07 99.30 08:38:01 AM all 0.33 0.00 0.06 0.00 0.04 99.57 08:38:01 AM 0 0.10 0.00 0.08 0.00 0.03 99.78 08:38:01 AM 1 0.57 0.00 0.03 0.00 0.05 99.35 08:38:01 AM CPU %user %nice %system %iowait %steal %idle 08:39:01 AM all 2.69 0.00 0.13 0.00 0.07 97.11 08:39:01 AM 0 4.25 0.00 0.17 0.00 0.07 95.52 08:39:01 AM 1 1.14 0.00 0.10 0.00 0.07 98.70 08:40:01 AM all 4.23 0.00 0.20 0.00 0.07 95.50 08:40:01 AM 0 4.65 0.00 0.22 0.00 0.07 95.07 08:40:01 AM 1 3.82 0.00 0.18 0.00 0.07 95.93 08:41:01 AM all 4.27 0.00 0.19 0.00 0.07 95.47 08:41:01 AM 0 4.05 0.00 0.17 0.00 0.07 95.72 08:41:01 AM 1 4.50 0.00 0.22 0.00 0.07 95.21 08:42:01 AM all 4.28 0.00 0.18 0.00 0.08 95.45 08:42:01 AM 0 4.25 0.00 0.15 0.00 0.08 95.52 08:42:01 AM 1 4.32 0.00 0.22 0.00 0.08 95.38 08:43:01 AM all 4.28 0.00 0.20 0.00 0.08 95.43 08:43:01 AM 0 3.61 0.00 0.18 0.00 0.08 96.12 08:43:01 AM 1 4.96 0.00 0.22 0.00 0.08 94.74 08:44:01 AM all 4.27 0.00 0.18 0.00 0.08 95.47 08:44:01 AM 0 2.40 0.00 0.15 0.00 0.07 97.38 08:44:01 AM 1 6.15 0.00 0.22 0.00 0.08 93.55 08:45:01 AM all 3.04 0.00 0.16 0.00 0.06 96.74 08:45:01 AM 0 2.07 0.00 0.17 0.00 0.07 97.70 08:45:01 AM 1 4.02 0.00 0.15 0.00 0.05 95.78 08:46:01 AM all 0.35 0.00 0.07 0.00 0.05 99.53 08:46:01 AM 0 0.62 0.00 0.05 0.00 0.05 99.28 08:46:01 AM 1 0.08 0.00 0.08 0.00 0.05 99.78 08:47:01 AM all 0.46 0.00 0.08 0.00 0.05 99.41 08:47:01 AM 0 0.60 0.00 0.07 0.00 0.05 99.28 08:47:01 AM 1 0.32 0.00 0.10 0.00 0.05 99.53 08:48:01 AM all 0.35 0.00 0.05 0.00 0.04 99.56 08:48:01 AM 0 0.60 0.00 0.05 0.00 0.05 99.30 08:48:01 AM 1 0.10 0.00 0.05 0.00 0.03 99.82 08:49:01 AM all 0.46 0.00 0.08 0.01 0.05 99.40 08:49:01 AM 0 0.60 0.00 0.08 0.00 0.05 99.27 08:49:01 AM 1 0.32 0.00 0.08 0.02 0.05 99.53 08:49:01 AM CPU %user %nice %system %iowait %steal %idle 08:50:01 AM all 0.34 0.00 0.07 0.00 0.04 99.55 08:50:01 AM 0 0.60 0.00 0.07 0.00 0.03 99.30 08:50:01 AM 1 0.08 0.00 0.07 0.00 0.05 99.80 08:51:01 AM all 0.45 0.00 0.07 0.00 0.04 99.44 08:51:01 AM 0 0.58 0.00 0.08 0.00 0.05 99.28 08:51:01 AM 1 0.32 0.00 0.05 0.00 0.03 99.60 08:52:01 AM all 0.17 0.00 0.08 0.00 0.04 99.72 08:52:01 AM 0 0.27 0.00 0.08 0.00 0.05 99.60 08:52:01 AM 1 0.07 0.00 0.07 0.00 0.03 99.83 08:53:01 AM all 0.36 0.00 0.07 0.00 0.04 99.53 08:53:01 AM 0 0.32 0.00 0.02 0.00 0.03 99.63 08:53:01 AM 1 0.40 0.00 0.12 0.00 0.05 99.43 08:54:01 AM all 0.34 0.00 0.06 0.00 0.06 99.54 08:54:01 AM 0 0.57 0.00 0.03 0.00 0.05 99.35 08:54:01 AM 1 0.12 0.00 0.08 0.00 0.07 99.73 08:55:01 AM all 0.33 0.00 0.05 0.00 0.04 99.58 08:55:01 AM 0 0.52 0.00 0.02 0.00 0.02 99.45 08:55:01 AM 1 0.13 0.00 0.08 0.00 0.07 99.72 08:56:01 AM all 0.44 0.00 0.08 0.00 0.05 99.43 08:56:01 AM 0 0.27 0.00 0.08 0.00 0.05 99.60 08:56:01 AM 1 0.62 0.00 0.07 0.00 0.05 99.27 08:57:01 AM all 0.34 0.00 0.06 0.00 0.05 99.55 08:57:01 AM 0 0.27 0.00 0.10 0.00 0.07 99.57 08:57:01 AM 1 0.42 0.00 0.02 0.00 0.03 99.53 08:58:01 AM all 0.46 0.00 0.07 0.00 0.05 99.42 08:58:01 AM 0 0.77 0.00 0.05 0.00 0.02 99.17 08:58:01 AM 1 0.15 0.00 0.08 0.00 0.08 99.68 08:59:01 AM all 0.33 0.00 0.06 0.00 0.03 99.57 08:59:01 AM 0 0.50 0.00 0.02 0.00 0.02 99.47 08:59:01 AM 1 0.17 0.00 0.10 0.00 0.05 99.68 09:00:01 AM all 4.42 0.00 0.29 0.00 0.07 95.22 09:00:01 AM 0 6.30 0.00 0.35 0.00 0.07 93.29 09:00:01 AM 1 2.54 0.00 0.23 0.00 0.07 97.16 09:00:01 AM CPU %user %nice %system %iowait %steal %idle 09:01:01 AM all 4.17 0.00 0.33 0.00 0.08 95.41 09:01:01 AM 0 4.83 0.00 0.37 0.00 0.08 94.71 09:01:01 AM 1 3.51 0.00 0.30 0.00 0.08 96.10 09:02:01 AM all 4.28 0.00 0.33 0.00 0.08 95.31 09:02:01 AM 0 4.28 0.00 0.30 0.00 0.08 95.34 09:02:01 AM 1 4.28 0.00 0.35 0.00 0.08 95.28 09:03:01 AM all 4.26 0.00 0.33 0.00 0.08 95.33 09:03:01 AM 0 3.16 0.00 0.25 0.00 0.07 96.53 09:03:01 AM 1 5.36 0.00 0.42 0.00 0.08 94.14 09:04:01 AM all 4.28 0.00 0.33 0.00 0.09 95.30 09:04:01 AM 0 4.45 0.00 0.33 0.00 0.08 95.13 09:04:01 AM 1 4.12 0.00 0.32 0.00 0.10 95.47 09:05:01 AM all 4.29 0.00 0.31 0.00 0.08 95.33 09:05:01 AM 0 5.23 0.00 0.33 0.00 0.08 94.35 09:05:01 AM 1 3.34 0.00 0.28 0.00 0.07 96.30 09:06:01 AM all 5.52 0.00 0.31 0.00 0.08 94.09 09:06:01 AM 0 5.55 0.00 0.32 0.00 0.07 94.06 09:06:01 AM 1 5.49 0.00 0.30 0.00 0.08 94.13 09:07:01 AM all 0.60 0.00 0.08 0.00 0.07 99.25 09:07:01 AM 0 0.62 0.00 0.07 0.00 0.05 99.27 09:07:01 AM 1 0.58 0.00 0.10 0.00 0.08 99.23 09:08:01 AM all 0.57 0.00 0.11 0.00 0.06 99.27 09:08:01 AM 0 0.50 0.00 0.12 0.00 0.07 99.32 09:08:01 AM 1 0.64 0.00 0.10 0.00 0.05 99.21 09:09:01 AM all 0.59 0.00 0.07 0.01 0.07 99.26 09:09:01 AM 0 0.52 0.00 0.08 0.02 0.08 99.30 09:09:01 AM 1 0.67 0.00 0.05 0.00 0.05 99.23 09:10:01 AM all 0.40 0.00 0.12 0.00 0.06 99.42 09:10:01 AM 0 0.32 0.00 0.08 0.00 0.05 99.55 09:10:01 AM 1 0.49 0.00 0.15 0.00 0.07 99.30 09:11:01 AM all 0.63 0.00 0.11 0.00 0.08 99.18 09:11:01 AM 0 0.63 0.00 0.07 0.00 0.05 99.25 09:11:01 AM 1 0.62 0.00 0.15 0.00 0.12 99.11 09:11:01 AM CPU %user %nice %system %iowait %steal %idle 09:12:01 AM all 3.85 0.00 0.22 0.00 0.08 95.86 09:12:01 AM 0 4.29 0.00 0.18 0.00 0.07 95.46 09:12:01 AM 1 3.40 0.00 0.25 0.00 0.08 96.26 09:13:01 AM all 4.27 0.00 0.18 0.00 0.09 95.46 09:13:01 AM 0 3.11 0.00 0.18 0.00 0.08 96.62 09:13:01 AM 1 5.42 0.00 0.18 0.00 0.10 94.29 09:14:01 AM all 4.31 0.00 0.18 0.01 0.08 95.42 09:14:01 AM 0 2.54 0.00 0.18 0.00 0.07 97.21 09:14:01 AM 1 6.08 0.00 0.17 0.02 0.10 93.63 09:15:01 AM all 4.20 0.00 0.19 0.00 0.08 95.53 09:15:01 AM 0 3.01 0.00 0.18 0.00 0.07 96.74 09:15:01 AM 1 5.39 0.00 0.20 0.00 0.08 94.32 09:16:01 AM all 4.33 0.00 0.18 0.00 0.08 95.42 09:16:01 AM 0 4.53 0.00 0.18 0.00 0.08 95.20 09:16:01 AM 1 4.13 0.00 0.17 0.00 0.07 95.63 09:17:01 AM all 4.28 0.00 0.19 0.00 0.09 95.43 09:17:01 AM 0 4.72 0.00 0.20 0.00 0.08 95.00 09:17:01 AM 1 3.85 0.00 0.18 0.00 0.10 95.87 09:18:01 AM all 5.20 0.00 0.26 0.00 0.08 94.46 09:18:01 AM 0 3.64 0.00 0.17 0.00 0.08 96.10 09:18:01 AM 1 6.78 0.00 0.36 0.00 0.07 92.79 09:19:01 AM all 4.27 0.00 0.18 0.00 0.08 95.47 09:19:01 AM 0 3.22 0.00 0.13 0.00 0.07 96.57 09:19:01 AM 1 5.33 0.00 0.22 0.00 0.10 94.36 09:20:01 AM all 4.18 0.00 0.21 0.00 0.08 95.53 09:20:01 AM 0 3.41 0.00 0.20 0.00 0.07 96.32 09:20:01 AM 1 4.95 0.00 0.22 0.00 0.08 94.74 09:21:01 AM all 4.27 0.00 0.18 0.00 0.08 95.47 09:21:01 AM 0 5.32 0.00 0.18 0.00 0.08 94.41 09:21:01 AM 1 3.21 0.00 0.18 0.00 0.07 96.54 09:22:01 AM all 4.40 0.00 0.18 0.00 0.09 95.34 09:22:01 AM 0 4.34 0.00 0.19 0.00 0.09 95.39 09:22:01 AM 1 4.46 0.00 0.17 0.00 0.09 95.29 09:22:01 AM CPU %user %nice %system %iowait %steal %idle 09:23:01 AM all 4.28 0.00 0.21 0.00 0.08 95.43 09:23:01 AM 0 6.01 0.00 0.25 0.00 0.08 93.66 09:23:01 AM 1 2.56 0.00 0.17 0.00 0.07 97.21 09:24:01 AM all 4.63 0.00 0.23 0.01 0.08 95.06 09:24:01 AM 0 3.83 0.00 0.18 0.00 0.08 95.90 09:24:01 AM 1 5.43 0.00 0.27 0.02 0.08 94.21 09:25:01 AM all 4.88 0.00 0.35 0.00 0.08 94.69 09:25:01 AM 0 6.39 0.00 0.47 0.00 0.10 93.04 09:25:01 AM 1 3.36 0.00 0.23 0.00 0.07 96.34 09:26:01 AM all 4.25 0.00 0.31 0.00 0.09 95.35 09:26:01 AM 0 2.82 0.00 0.22 0.00 0.08 96.88 09:26:01 AM 1 5.68 0.00 0.40 0.00 0.10 93.82 09:27:01 AM all 4.29 0.00 0.33 0.00 0.08 95.31 09:27:01 AM 0 1.49 0.00 0.18 0.00 0.07 98.26 09:27:01 AM 1 7.11 0.00 0.47 0.00 0.08 92.34 09:28:01 AM all 4.25 0.00 0.33 0.00 0.08 95.34 09:28:01 AM 0 3.21 0.00 0.27 0.00 0.07 96.46 09:28:01 AM 1 5.29 0.00 0.38 0.00 0.10 94.23 09:29:01 AM all 4.20 0.00 0.34 0.00 0.08 95.38 09:29:01 AM 0 4.31 0.00 0.32 0.00 0.08 95.29 09:29:01 AM 1 4.09 0.00 0.37 0.00 0.07 95.48 09:30:01 AM all 4.26 0.00 0.28 0.00 0.09 95.37 09:30:01 AM 0 1.74 0.00 0.15 0.00 0.07 98.05 09:30:01 AM 1 6.79 0.00 0.42 0.00 0.12 92.68 09:31:01 AM all 4.75 0.00 0.26 0.00 0.07 94.92 09:31:01 AM 0 1.05 0.00 0.18 0.00 0.07 98.70 09:31:01 AM 1 8.45 0.00 0.33 0.00 0.07 91.14 09:32:01 AM all 0.59 0.00 0.08 0.00 0.08 99.25 09:32:01 AM 0 0.63 0.00 0.08 0.00 0.08 99.20 09:32:01 AM 1 0.55 0.00 0.08 0.00 0.07 99.30 09:33:01 AM all 0.59 0.00 0.11 0.00 0.06 99.24 09:33:01 AM 0 0.72 0.00 0.10 0.00 0.05 99.13 09:33:01 AM 1 0.47 0.00 0.12 0.00 0.07 99.35 09:33:01 AM CPU %user %nice %system %iowait %steal %idle 09:34:01 AM all 0.63 0.00 0.09 0.00 0.08 99.19 09:34:01 AM 0 0.80 0.00 0.10 0.00 0.08 99.02 09:34:01 AM 1 0.47 0.00 0.08 0.00 0.08 99.36 09:35:01 AM all 0.47 0.00 0.09 0.00 0.08 99.36 09:35:01 AM 0 0.42 0.00 0.10 0.00 0.08 99.40 09:35:01 AM 1 0.52 0.00 0.08 0.00 0.07 99.33 09:36:01 AM all 0.52 0.00 0.12 0.00 0.08 99.28 09:36:01 AM 0 0.57 0.00 0.10 0.00 0.08 99.25 09:36:01 AM 1 0.47 0.00 0.13 0.00 0.08 99.31 09:37:01 AM all 5.84 0.00 0.49 0.00 0.08 93.58 09:37:01 AM 0 7.02 0.00 0.37 0.00 0.08 92.52 09:37:01 AM 1 4.65 0.00 0.62 0.00 0.08 94.64 09:38:01 AM all 4.30 0.00 0.33 0.00 0.08 95.29 09:38:01 AM 0 6.78 0.00 0.45 0.00 0.08 92.69 09:38:01 AM 1 1.82 0.00 0.20 0.00 0.08 97.89 09:39:01 AM all 4.25 0.01 0.33 0.00 0.08 95.33 09:39:01 AM 0 6.11 0.00 0.45 0.00 0.10 93.34 09:39:01 AM 1 2.39 0.02 0.22 0.00 0.07 97.31 09:40:01 AM all 4.31 0.15 0.39 0.00 0.09 95.05 09:40:01 AM 0 6.05 0.00 0.47 0.00 0.10 93.38 09:40:01 AM 1 2.57 0.30 0.32 0.00 0.08 96.73 09:41:01 AM all 4.25 0.00 0.32 0.00 0.09 95.34 09:41:01 AM 0 4.60 0.00 0.33 0.00 0.08 94.98 09:41:01 AM 1 3.90 0.00 0.30 0.00 0.10 95.70 09:42:01 AM all 4.26 0.00 0.34 0.00 0.08 95.32 09:42:01 AM 0 4.51 0.00 0.33 0.00 0.08 95.07 09:42:01 AM 1 4.00 0.00 0.35 0.00 0.08 95.57 09:43:01 AM all 6.50 0.00 0.38 0.00 0.08 93.04 09:43:01 AM 0 10.39 0.00 0.52 0.00 0.08 89.01 09:43:01 AM 1 2.62 0.00 0.25 0.00 0.07 97.06 09:44:01 AM all 0.59 0.00 0.09 0.00 0.08 99.24 09:44:01 AM 0 0.52 0.00 0.12 0.00 0.10 99.27 09:44:01 AM 1 0.67 0.00 0.07 0.00 0.05 99.21 09:44:01 AM CPU %user %nice %system %iowait %steal %idle 09:45:01 AM all 0.58 0.00 0.10 0.00 0.05 99.27 09:45:01 AM 0 0.53 0.00 0.15 0.00 0.07 99.25 09:45:01 AM 1 0.63 0.00 0.05 0.00 0.03 99.28 09:46:01 AM all 0.58 0.00 0.11 0.00 0.07 99.24 09:46:01 AM 0 0.57 0.00 0.13 0.00 0.08 99.22 09:46:01 AM 1 0.60 0.00 0.08 0.00 0.05 99.27 09:47:01 AM all 0.74 0.00 0.10 0.00 0.07 99.09 09:47:01 AM 0 0.65 0.00 0.07 0.00 0.07 99.22 09:47:01 AM 1 0.84 0.00 0.13 0.00 0.07 98.96 09:48:01 AM all 0.52 0.00 0.12 0.00 0.07 99.30 09:48:01 AM 0 0.48 0.00 0.12 0.00 0.08 99.31 09:48:01 AM 1 0.55 0.00 0.12 0.00 0.05 99.28 09:49:01 AM all 4.30 0.00 0.44 0.00 0.08 95.18 09:49:01 AM 0 5.39 0.00 0.47 0.00 0.08 94.05 09:49:01 AM 1 3.21 0.00 0.42 0.00 0.07 96.31 09:50:01 AM all 4.30 0.00 0.33 0.00 0.08 95.29 09:50:01 AM 0 4.73 0.00 0.38 0.00 0.07 94.81 09:50:01 AM 1 3.86 0.00 0.28 0.00 0.08 95.77 09:51:01 AM all 4.30 0.00 0.33 0.00 0.08 95.30 09:51:01 AM 0 4.88 0.00 0.35 0.00 0.08 94.68 09:51:01 AM 1 3.71 0.00 0.30 0.00 0.07 95.92 09:52:01 AM all 4.22 0.00 0.37 0.00 0.08 95.33 09:52:01 AM 0 3.54 0.00 0.32 0.00 0.08 96.06 09:52:01 AM 1 4.89 0.00 0.42 0.00 0.08 94.61 09:53:01 AM all 4.24 0.00 0.31 0.01 0.08 95.36 09:53:01 AM 0 4.20 0.00 0.30 0.02 0.08 95.40 09:53:01 AM 1 4.28 0.00 0.32 0.00 0.08 95.32 09:54:01 AM all 4.26 0.00 0.35 0.00 0.08 95.31 09:54:01 AM 0 2.49 0.00 0.23 0.00 0.07 97.21 09:54:01 AM 1 6.03 0.00 0.47 0.00 0.10 93.40 09:55:01 AM all 4.22 0.00 0.33 0.00 0.08 95.37 09:55:01 AM 0 2.24 0.00 0.18 0.00 0.07 97.51 09:55:01 AM 1 6.20 0.00 0.47 0.00 0.10 93.23 09:55:01 AM CPU %user %nice %system %iowait %steal %idle 09:56:01 AM all 4.27 0.00 0.25 0.00 0.08 95.41 09:56:01 AM 0 6.06 0.00 0.28 0.00 0.08 93.57 09:56:01 AM 1 2.48 0.00 0.22 0.00 0.07 97.24 09:57:01 AM all 0.56 0.00 0.08 0.00 0.08 99.28 09:57:01 AM 0 0.35 0.00 0.07 0.00 0.05 99.53 09:57:01 AM 1 0.77 0.00 0.10 0.00 0.10 99.03 09:58:01 AM all 0.59 0.00 0.10 0.00 0.08 99.22 09:58:01 AM 0 0.60 0.00 0.07 0.00 0.07 99.27 09:58:01 AM 1 0.58 0.00 0.13 0.00 0.10 99.18 09:59:01 AM all 0.58 0.00 0.11 0.00 0.06 99.25 09:59:01 AM 0 0.67 0.00 0.12 0.00 0.05 99.17 09:59:01 AM 1 0.50 0.00 0.10 0.00 0.07 99.33 10:00:01 AM all 0.62 0.00 0.10 0.00 0.07 99.22 10:00:01 AM 0 0.53 0.00 0.12 0.00 0.07 99.28 10:00:01 AM 1 0.70 0.00 0.08 0.00 0.07 99.15 10:01:01 AM all 0.61 0.00 0.08 0.01 0.07 99.23 10:01:01 AM 0 0.60 0.00 0.10 0.00 0.08 99.21 10:01:01 AM 1 0.62 0.00 0.07 0.02 0.05 99.25 10:02:01 AM all 2.13 0.00 0.28 0.00 0.08 97.52 10:02:01 AM 0 2.44 0.00 0.20 0.00 0.07 97.29 10:02:01 AM 1 1.83 0.00 0.35 0.00 0.08 97.74 10:03:01 AM all 4.31 0.00 0.29 0.00 0.08 95.31 10:03:01 AM 0 5.39 0.00 0.33 0.00 0.08 94.19 10:03:01 AM 1 3.23 0.00 0.25 0.00 0.08 96.44 10:04:01 AM all 4.19 0.00 0.36 0.00 0.09 95.36 10:04:01 AM 0 3.39 0.00 0.32 0.00 0.10 96.19 10:04:01 AM 1 4.99 0.00 0.40 0.00 0.08 94.52 10:05:01 AM all 4.09 0.00 0.34 0.00 0.08 95.49 10:05:01 AM 0 3.12 0.00 0.28 0.00 0.07 96.53 10:05:01 AM 1 5.06 0.00 0.40 0.00 0.08 94.45 10:06:01 AM all 4.29 0.00 0.35 0.00 0.08 95.28 10:06:01 AM 0 6.32 0.00 0.47 0.00 0.10 93.11 10:06:01 AM 1 2.26 0.00 0.23 0.00 0.07 97.44 10:06:01 AM CPU %user %nice %system %iowait %steal %idle 10:07:01 AM all 4.24 0.00 0.33 0.00 0.08 95.35 10:07:01 AM 0 4.38 0.00 0.35 0.00 0.08 95.19 10:07:01 AM 1 4.10 0.00 0.30 0.00 0.08 95.52 10:08:01 AM all 4.20 0.00 0.33 0.00 0.07 95.41 10:08:01 AM 0 5.53 0.00 0.37 0.00 0.08 94.02 10:08:01 AM 1 2.88 0.00 0.28 0.00 0.05 96.79 10:09:01 AM all 5.84 0.00 0.32 0.00 0.10 93.74 10:09:01 AM 0 5.44 0.00 0.28 0.00 0.10 94.18 10:09:01 AM 1 6.24 0.00 0.35 0.00 0.10 93.30 10:10:01 AM all 0.58 0.00 0.11 0.00 0.07 99.24 10:10:01 AM 0 0.50 0.00 0.15 0.00 0.10 99.25 10:10:01 AM 1 0.67 0.00 0.07 0.00 0.03 99.23 10:11:01 AM all 0.59 0.00 0.10 0.00 0.08 99.23 10:11:01 AM 0 0.53 0.00 0.12 0.00 0.08 99.27 10:11:01 AM 1 0.65 0.00 0.08 0.00 0.07 99.20 10:12:01 AM all 0.59 0.00 0.08 0.00 0.07 99.27 10:12:01 AM 0 0.35 0.00 0.07 0.00 0.07 99.52 10:12:01 AM 1 0.84 0.00 0.08 0.00 0.07 99.01 10:13:01 AM all 0.58 0.00 0.09 0.00 0.08 99.25 10:13:01 AM 0 0.35 0.00 0.10 0.00 0.08 99.47 10:13:01 AM 1 0.82 0.00 0.08 0.00 0.07 99.03 10:14:01 AM all 0.59 0.00 0.09 0.00 0.07 99.25 10:14:01 AM 0 0.55 0.00 0.10 0.00 0.08 99.26 10:14:01 AM 1 0.63 0.00 0.08 0.00 0.05 99.23 10:15:01 AM all 7.71 0.00 1.56 0.00 0.08 90.65 10:15:01 AM 0 8.36 0.00 1.51 0.00 0.07 90.06 10:15:01 AM 1 7.07 0.00 1.61 0.00 0.08 91.24 10:16:01 AM all 29.81 0.00 2.72 0.19 0.08 67.20 10:16:01 AM 0 25.24 0.00 2.17 0.20 0.08 72.31 10:16:01 AM 1 34.38 0.00 3.28 0.18 0.08 62.07 10:17:01 AM all 30.43 0.00 3.11 0.68 0.09 65.69 10:17:01 AM 0 33.60 0.00 2.88 0.55 0.10 62.86 10:17:01 AM 1 27.25 0.00 3.34 0.80 0.08 68.53 Average: CPU %user %nice %system %iowait %steal %idle Average: all 3.18 0.07 0.27 0.04 0.07 96.37 Average: 0 3.43 0.09 0.28 0.03 0.07 96.10 Average: 1 2.93 0.05 0.26 0.04 0.07 96.64